2024-09-10T22:23:30.122 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T22:23:30.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T22:23:30.234 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899733 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/multimds_misc} email: hyelloji@redhat.com first_in_suite: false job_id: '7899733' kernel: flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: pid file: '' mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Scrub error on inode sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCPRabptrnz3Su7nM6cu45fB1dWYad0/5DTQFx+CZy2zX9p//4vy3hZ/z3K/Plc6inh2ahlmJ6BiDxc3HYpwTdE= smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPTBHP5GuMCVj00csu1PqYoNHHsrVupPCjIeJ/Buw49mTPiRggXcuN+toq+8Qdkbhfa3vuo0ZShNQx4IsRUqMs4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_multimds_misc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T22:23:30.234 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T22:23:30.235 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T22:23:30.235 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T22:23:30.237 INFO:teuthology.task.internal:Checking packages... 2024-09-10T22:23:30.259 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T22:23:30.259 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T22:23:30.259 INFO:teuthology.packaging:ref: None 2024-09-10T22:23:30.259 INFO:teuthology.packaging:tag: None 2024-09-10T22:23:30.259 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T22:23:30.259 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:23:30.260 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T22:23:30.411 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854-g8f219c47-1jammy 2024-09-10T22:23:30.412 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T22:23:30.418 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T22:23:30.418 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T22:23:30.459 INFO:teuthology.task.internal:Saving configuration 2024-09-10T22:23:30.476 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T22:23:30.482 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T22:23:30.511 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899733', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 22:17:40.121478', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILB5syYKF0L6EsZGeUGYOYNqNgd3sv6dNfCzpsKVIN74'} 2024-09-10T22:23:30.535 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899733', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 22:17:40.123357', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDNoBubEZOeZbyJRuvSfeN+e3eXYg54oORPJzOhSIQRx'} 2024-09-10T22:23:30.535 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T22:23:30.540 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-10T22:23:30.540 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-10T22:23:30.540 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T22:23:30.603 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f40ed62fbe0>, signals=[15]) 2024-09-10T22:23:30.603 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T22:23:30.608 INFO:teuthology.task.internal:Opening connections... 2024-09-10T22:23:30.608 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:23:30.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:23:30.704 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2024-09-10T22:23:30.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:23:30.837 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T22:23:30.843 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-09-10T22:23:30.849 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-09-10T22:23:30.849 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-09-10T22:23:30.894 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T22:23:30.895 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Ubuntu" 2024-09-10T22:23:30.895 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="22.04" 2024-09-10T22:23:30.895 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T22:23:30.895 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_CODENAME=jammy 2024-09-10T22:23:30.895 INFO:teuthology.orchestra.run.smithi103.stdout:ID=ubuntu 2024-09-10T22:23:30.895 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE=debian 2024-09-10T22:23:30.895 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T22:23:30.895 INFO:teuthology.orchestra.run.smithi103.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T22:23:30.895 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T22:23:30.895 INFO:teuthology.orchestra.run.smithi103.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T22:23:30.895 INFO:teuthology.orchestra.run.smithi103.stdout:UBUNTU_CODENAME=jammy 2024-09-10T22:23:30.896 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-09-10T22:23:30.933 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2024-09-10T22:23:30.938 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2024-09-10T22:23:30.938 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-09-10T22:23:30.984 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T22:23:30.984 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Ubuntu" 2024-09-10T22:23:30.984 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="22.04" 2024-09-10T22:23:30.985 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T22:23:30.985 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_CODENAME=jammy 2024-09-10T22:23:30.985 INFO:teuthology.orchestra.run.smithi131.stdout:ID=ubuntu 2024-09-10T22:23:30.985 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE=debian 2024-09-10T22:23:30.985 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T22:23:30.985 INFO:teuthology.orchestra.run.smithi131.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T22:23:30.986 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T22:23:30.986 INFO:teuthology.orchestra.run.smithi131.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T22:23:30.986 INFO:teuthology.orchestra.run.smithi131.stdout:UBUNTU_CODENAME=jammy 2024-09-10T22:23:30.987 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-09-10T22:23:31.016 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T22:23:31.025 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T22:23:31.067 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T22:23:31.068 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2024-09-10T22:23:31.070 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2024-09-10T22:23:31.075 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T22:23:31.097 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T22:23:31.098 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2024-09-10T22:23:31.115 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2024-09-10T22:23:31.136 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T22:23:31.192 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T22:23:31.206 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T22:23:31.206 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'mon.b': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, timeout 300 2024-09-10T22:23:31.207 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T22:23:31.207 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T22:23:31.211 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:23:31.211 DEBUG:teuthology.task.kernel:sha1 for mon.a is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T22:23:31.211 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T22:23:31.212 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-10T22:23:31.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:23:31.213 DEBUG:teuthology.task.kernel:sha1 for mon.b is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T22:23:31.213 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T22:23:31.213 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-09-10T22:23:31.258 INFO:teuthology.orchestra.run.smithi103.stdout:5.15.0-56-generic 2024-09-10T22:23:31.258 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T22:23:31.259 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T22:23:31.259 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T22:23:31.270 INFO:teuthology.orchestra.run.smithi131.stdout:5.15.0-56-generic 2024-09-10T22:23:31.270 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T22:23:31.270 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T22:23:31.270 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T22:23:31.413 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2024-09-10T22:23:31.413 DEBUG:teuthology.orchestra.run.smithi103:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-10T22:23:31.414 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2024-09-10T22:23:31.414 DEBUG:teuthology.orchestra.run.smithi131:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-10T22:23:31.433 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-10T22:23:31.450 INFO:teuthology.orchestra.run.smithi131.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-10T22:23:31.559 INFO:teuthology.orchestra.run.smithi103.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-10T22:23:31.559 INFO:teuthology.orchestra.run.smithi103.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-10T22:23:31.559 INFO:teuthology.orchestra.run.smithi103.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-10T22:23:31.559 INFO:teuthology.orchestra.run.smithi103.stderr:hint: 2024-09-10T22:23:31.559 INFO:teuthology.orchestra.run.smithi103.stderr:hint: git config --global init.defaultBranch 2024-09-10T22:23:31.559 INFO:teuthology.orchestra.run.smithi103.stderr:hint: 2024-09-10T22:23:31.559 INFO:teuthology.orchestra.run.smithi103.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-10T22:23:31.560 INFO:teuthology.orchestra.run.smithi103.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-10T22:23:31.560 INFO:teuthology.orchestra.run.smithi103.stderr:hint: 2024-09-10T22:23:31.560 INFO:teuthology.orchestra.run.smithi103.stderr:hint: git branch -m 2024-09-10T22:23:31.560 INFO:teuthology.orchestra.run.smithi103.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-10T22:23:31.562 DEBUG:teuthology.orchestra.run.smithi103:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-10T22:23:31.578 INFO:teuthology.orchestra.run.smithi131.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-10T22:23:31.578 INFO:teuthology.orchestra.run.smithi131.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-10T22:23:31.578 INFO:teuthology.orchestra.run.smithi131.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-10T22:23:31.578 INFO:teuthology.orchestra.run.smithi131.stderr:hint: 2024-09-10T22:23:31.578 INFO:teuthology.orchestra.run.smithi131.stderr:hint: git config --global init.defaultBranch 2024-09-10T22:23:31.578 INFO:teuthology.orchestra.run.smithi131.stderr:hint: 2024-09-10T22:23:31.578 INFO:teuthology.orchestra.run.smithi131.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-10T22:23:31.578 INFO:teuthology.orchestra.run.smithi131.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-10T22:23:31.578 INFO:teuthology.orchestra.run.smithi131.stderr:hint: 2024-09-10T22:23:31.578 INFO:teuthology.orchestra.run.smithi131.stderr:hint: git branch -m 2024-09-10T22:23:31.579 INFO:teuthology.orchestra.run.smithi131.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-10T22:23:31.581 DEBUG:teuthology.orchestra.run.smithi131:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-10T22:23:31.636 DEBUG:teuthology.orchestra.run.smithi103:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-10T22:23:31.647 DEBUG:teuthology.orchestra.run.smithi131:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-10T22:23:31.692 DEBUG:teuthology.orchestra.run.smithi103:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-10T22:23:31.700 DEBUG:teuthology.orchestra.run.smithi131:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-10T22:23:53.739 INFO:teuthology.orchestra.run.smithi131.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-10T22:23:53.740 INFO:teuthology.orchestra.run.smithi131.stderr: * [new branch] main -> origin/main 2024-09-10T22:23:53.770 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20190312 -> 20190312 2024-09-10T22:23:53.770 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20190416 -> 20190416 2024-09-10T22:23:53.770 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20190514 -> 20190514 2024-09-10T22:23:53.770 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20190618 -> 20190618 2024-09-10T22:23:53.770 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20190717 -> 20190717 2024-09-10T22:23:53.770 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20190815 -> 20190815 2024-09-10T22:23:53.771 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20190923 -> 20190923 2024-09-10T22:23:53.771 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20191022 -> 20191022 2024-09-10T22:23:53.771 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20191215 -> 20191215 2024-09-10T22:23:53.771 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20200122 -> 20200122 2024-09-10T22:23:53.771 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20200316 -> 20200316 2024-09-10T22:23:53.771 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20200421 -> 20200421 2024-09-10T22:23:53.771 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20200519 -> 20200519 2024-09-10T22:23:53.777 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20200619 -> 20200619 2024-09-10T22:23:53.777 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20200721 -> 20200721 2024-09-10T22:23:53.777 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20200817 -> 20200817 2024-09-10T22:23:53.777 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20200918 -> 20200918 2024-09-10T22:23:53.777 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20201022 -> 20201022 2024-09-10T22:23:53.777 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20201118 -> 20201118 2024-09-10T22:23:53.777 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20201218 -> 20201218 2024-09-10T22:23:53.777 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20210208 -> 20210208 2024-09-10T22:23:53.777 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20210315 -> 20210315 2024-09-10T22:23:53.777 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20210511 -> 20210511 2024-09-10T22:23:53.778 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20210716 -> 20210716 2024-09-10T22:23:53.778 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20210818 -> 20210818 2024-09-10T22:23:53.778 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20210919 -> 20210919 2024-09-10T22:23:53.778 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20211027 -> 20211027 2024-09-10T22:23:53.778 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20211216 -> 20211216 2024-09-10T22:23:53.778 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20220209 -> 20220209 2024-09-10T22:23:53.778 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20220310 -> 20220310 2024-09-10T22:23:53.778 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20220411 -> 20220411 2024-09-10T22:23:53.778 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20220509 -> 20220509 2024-09-10T22:23:53.778 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20220610 -> 20220610 2024-09-10T22:23:53.778 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20220708 -> 20220708 2024-09-10T22:23:53.779 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20220815 -> 20220815 2024-09-10T22:23:53.779 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20220913 -> 20220913 2024-09-10T22:23:53.779 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20221012 -> 20221012 2024-09-10T22:23:53.779 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20221109 -> 20221109 2024-09-10T22:23:53.779 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20221214 -> 20221214 2024-09-10T22:23:53.779 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20230117 -> 20230117 2024-09-10T22:23:53.779 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20230210 -> 20230210 2024-09-10T22:23:53.779 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20230310 -> 20230310 2024-09-10T22:23:53.779 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20230404 -> 20230404 2024-09-10T22:23:53.779 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20230515 -> 20230515 2024-09-10T22:23:53.779 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20230625 -> 20230625 2024-09-10T22:23:53.780 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20230804 -> 20230804 2024-09-10T22:23:53.780 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20230919 -> 20230919 2024-09-10T22:23:53.780 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20231030 -> 20231030 2024-09-10T22:23:53.780 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20231111 -> 20231111 2024-09-10T22:23:53.780 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20231211 -> 20231211 2024-09-10T22:23:53.780 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20240115 -> 20240115 2024-09-10T22:23:53.780 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20240220 -> 20240220 2024-09-10T22:23:53.780 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20240312 -> 20240312 2024-09-10T22:23:53.780 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20240410 -> 20240410 2024-09-10T22:23:53.780 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20240513 -> 20240513 2024-09-10T22:23:53.781 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20240610 -> 20240610 2024-09-10T22:23:53.781 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20240709 -> 20240709 2024-09-10T22:23:53.781 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20240811 -> 20240811 2024-09-10T22:23:53.781 INFO:teuthology.orchestra.run.smithi131.stderr: * [new tag] 20240909 -> 20240909 2024-09-10T22:23:54.166 INFO:teuthology.orchestra.run.smithi103.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-10T22:23:54.166 INFO:teuthology.orchestra.run.smithi103.stderr: * [new branch] main -> origin/main 2024-09-10T22:23:54.194 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20190312 -> 20190312 2024-09-10T22:23:54.194 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20190416 -> 20190416 2024-09-10T22:23:54.194 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20190514 -> 20190514 2024-09-10T22:23:54.194 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20190618 -> 20190618 2024-09-10T22:23:54.194 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20190717 -> 20190717 2024-09-10T22:23:54.194 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20190815 -> 20190815 2024-09-10T22:23:54.195 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20190923 -> 20190923 2024-09-10T22:23:54.195 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20191022 -> 20191022 2024-09-10T22:23:54.196 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20191215 -> 20191215 2024-09-10T22:23:54.196 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20200122 -> 20200122 2024-09-10T22:23:54.197 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20200316 -> 20200316 2024-09-10T22:23:54.197 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20200421 -> 20200421 2024-09-10T22:23:54.197 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20200519 -> 20200519 2024-09-10T22:23:54.197 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20200619 -> 20200619 2024-09-10T22:23:54.197 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20200721 -> 20200721 2024-09-10T22:23:54.197 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20200817 -> 20200817 2024-09-10T22:23:54.197 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20200918 -> 20200918 2024-09-10T22:23:54.197 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20201022 -> 20201022 2024-09-10T22:23:54.197 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20201118 -> 20201118 2024-09-10T22:23:54.197 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20201218 -> 20201218 2024-09-10T22:23:54.197 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20210208 -> 20210208 2024-09-10T22:23:54.197 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20210315 -> 20210315 2024-09-10T22:23:54.197 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20210511 -> 20210511 2024-09-10T22:23:54.197 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20210716 -> 20210716 2024-09-10T22:23:54.200 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20210818 -> 20210818 2024-09-10T22:23:54.200 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20210919 -> 20210919 2024-09-10T22:23:54.200 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20211027 -> 20211027 2024-09-10T22:23:54.200 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20211216 -> 20211216 2024-09-10T22:23:54.200 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20220209 -> 20220209 2024-09-10T22:23:54.201 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20220310 -> 20220310 2024-09-10T22:23:54.201 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20220411 -> 20220411 2024-09-10T22:23:54.201 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20220509 -> 20220509 2024-09-10T22:23:54.201 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20220610 -> 20220610 2024-09-10T22:23:54.201 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20220708 -> 20220708 2024-09-10T22:23:54.201 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20220815 -> 20220815 2024-09-10T22:23:54.201 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20220913 -> 20220913 2024-09-10T22:23:54.201 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20221012 -> 20221012 2024-09-10T22:23:54.201 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20221109 -> 20221109 2024-09-10T22:23:54.201 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20221214 -> 20221214 2024-09-10T22:23:54.201 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20230117 -> 20230117 2024-09-10T22:23:54.201 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20230210 -> 20230210 2024-09-10T22:23:54.201 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20230310 -> 20230310 2024-09-10T22:23:54.201 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20230404 -> 20230404 2024-09-10T22:23:54.202 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20230515 -> 20230515 2024-09-10T22:23:54.202 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20230625 -> 20230625 2024-09-10T22:23:54.202 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20230804 -> 20230804 2024-09-10T22:23:54.202 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20230919 -> 20230919 2024-09-10T22:23:54.202 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20231030 -> 20231030 2024-09-10T22:23:54.202 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20231111 -> 20231111 2024-09-10T22:23:54.203 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20231211 -> 20231211 2024-09-10T22:23:54.203 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20240115 -> 20240115 2024-09-10T22:23:54.203 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20240220 -> 20240220 2024-09-10T22:23:54.203 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20240312 -> 20240312 2024-09-10T22:23:54.203 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20240410 -> 20240410 2024-09-10T22:23:54.204 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20240513 -> 20240513 2024-09-10T22:23:54.204 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20240610 -> 20240610 2024-09-10T22:23:54.204 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20240709 -> 20240709 2024-09-10T22:23:54.204 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20240811 -> 20240811 2024-09-10T22:23:54.204 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20240909 -> 20240909 2024-09-10T22:23:58.289 INFO:teuthology.orchestra.run.smithi131.stderr:Updating files: 44% (1550/3501) Updating files: 45% (1576/3501) Updating files: 46% (1611/3501) Updating files: 47% (1646/3501) Updating files: 48% (1681/3501) Updating files: 49% (1716/3501) Updating files: 50% (1751/3501) Updating files: 51% (1786/3501) Updating files: 52% (1821/3501) Updating files: 53% (1856/3501) Updating files: 54% (1891/3501) Updating files: 55% (1926/3501) Updating files: 56% (1961/3501) Updating files: 57% (1996/3501) Updating files: 58% (2031/3501) Updating files: 59% (2066/3501) Updating files: 59% (2069/3501) Updating files: 60% (2101/3501) Updating files: 61% (2136/3501) Updating files: 62% (2171/3501) Updating files: 63% (2206/3501) Updating files: 64% (2241/3501) Updating files: 65% (2276/3501) Updating files: 66% (2311/3501) Updating files: 67% (2346/3501) Updating files: 68% (2381/3501) Updating files: 69% (2416/3501) Updating files: 69% (2426/3501) Updating files: 70% (2451/3501) Updating files: 71% (2486/3501) Updating files: 72% (2521/3501) Updating files: 73% (2556/3501) Updating files: 74% (2591/3501) Updating files: 75% (2626/3501) Updating files: 76% (2661/3501) Updating files: 77% (2696/3501) Updating files: 78% (2731/3501) Updating files: 79% (2766/3501) Updating files: 80% (2801/3501) Updating files: 81% (2836/3501) Updating files: 82% (2871/3501) Updating files: 82% (2891/3501) Updating files: 83% (2906/3501) Updating files: 84% (2941/3501) Updating files: 85% (2976/3501) Updating files: 86% (3011/3501) Updating files: 87% (3046/3501) Updating files: 88% (3081/3501) Updating files: 89% (3116/3501) Updating files: 90% (3151/3501) Updating files: 91% (3186/3501) Updating files: 92% (3221/3501) Updating files: 93% (3256/3501) Updating files: 94% (3291/3501) Updating files: 95% (3326/3501) Updating files: 96% (3361/3501) Updating files: 97% (3396/3501) Updating files: 98% (3431/3501) Updating files: 99% (3466/3501) Updating files: 100% (3501/3501) Updating files: 100% (3501/3501), done. 2024-09-10T22:23:58.294 INFO:teuthology.orchestra.run.smithi131.stdout:HEAD is now at ce299c0f Merge branch 'rt1320' into 'main' 2024-09-10T22:23:58.315 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.b... 2024-09-10T22:23:58.315 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T22:23:58.470 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-10T22:23:58.471 DEBUG:teuthology.orchestra.run.smithi131:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-10T22:23:58.473 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi131.front.sepia.ceph.com to complete... 2024-09-10T22:23:58.708 INFO:teuthology.orchestra.run.smithi103.stderr:Updating files: 44% (1550/3501) Updating files: 45% (1576/3501) Updating files: 46% (1611/3501) Updating files: 47% (1646/3501) Updating files: 48% (1681/3501) Updating files: 49% (1716/3501) Updating files: 50% (1751/3501) Updating files: 51% (1786/3501) Updating files: 52% (1821/3501) Updating files: 53% (1856/3501) Updating files: 54% (1891/3501) Updating files: 55% (1926/3501) Updating files: 56% (1961/3501) Updating files: 57% (1996/3501) Updating files: 58% (2031/3501) Updating files: 59% (2066/3501) Updating files: 59% (2069/3501) Updating files: 60% (2101/3501) Updating files: 61% (2136/3501) Updating files: 62% (2171/3501) Updating files: 63% (2206/3501) Updating files: 64% (2241/3501) Updating files: 65% (2276/3501) Updating files: 66% (2311/3501) Updating files: 67% (2346/3501) Updating files: 68% (2381/3501) Updating files: 69% (2416/3501) Updating files: 69% (2427/3501) Updating files: 70% (2451/3501) Updating files: 71% (2486/3501) Updating files: 72% (2521/3501) Updating files: 73% (2556/3501) Updating files: 74% (2591/3501) Updating files: 75% (2626/3501) Updating files: 76% (2661/3501) Updating files: 77% (2696/3501) Updating files: 78% (2731/3501) Updating files: 79% (2766/3501) Updating files: 80% (2801/3501) Updating files: 81% (2836/3501) Updating files: 82% (2871/3501) Updating files: 82% (2891/3501) Updating files: 83% (2906/3501) Updating files: 84% (2941/3501) Updating files: 85% (2976/3501) Updating files: 86% (3011/3501) Updating files: 87% (3046/3501) Updating files: 88% (3081/3501) Updating files: 89% (3116/3501) Updating files: 90% (3151/3501) Updating files: 91% (3186/3501) Updating files: 92% (3221/3501) Updating files: 93% (3256/3501) Updating files: 94% (3291/3501) Updating files: 95% (3326/3501) Updating files: 96% (3361/3501) Updating files: 97% (3396/3501) Updating files: 98% (3431/3501) Updating files: 99% (3466/3501) Updating files: 100% (3501/3501) Updating files: 100% (3501/3501), done. 2024-09-10T22:23:58.713 INFO:teuthology.orchestra.run.smithi103.stdout:HEAD is now at ce299c0f Merge branch 'rt1320' into 'main' 2024-09-10T22:23:58.734 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.a... 2024-09-10T22:23:58.734 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T22:23:58.885 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-10T22:23:58.885 DEBUG:teuthology.orchestra.run.smithi103:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-10T22:23:58.888 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi103.front.sepia.ceph.com to complete... 2024-09-10T22:23:59.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10 22:23:59 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-10T22:23:59.495 INFO:teuthology.orchestra.run.smithi131.stderr:FINISHED --2024-09-10 22:23:59-- 2024-09-10T22:23:59.495 INFO:teuthology.orchestra.run.smithi131.stderr:Total wall clock time: 1.0s 2024-09-10T22:23:59.496 INFO:teuthology.orchestra.run.smithi131.stderr:Downloaded: 1 files, 43M in 0.9s (50.0 MB/s) 2024-09-10T22:23:59.499 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.b... 2024-09-10T22:23:59.500 DEBUG:teuthology.orchestra.run.smithi131:> sudo dpkg -i /tmp/linux-image.deb 2024-09-10T22:23:59.767 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-10T22:24:00.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10 22:24:00 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-10T22:24:00.915 INFO:teuthology.orchestra.run.smithi103.stderr:FINISHED --2024-09-10 22:24:00-- 2024-09-10T22:24:00.915 INFO:teuthology.orchestra.run.smithi103.stderr:Total wall clock time: 1.9s 2024-09-10T22:24:00.915 INFO:teuthology.orchestra.run.smithi103.stderr:Downloaded: 1 files, 43M in 1.7s (25.1 MB/s) 2024-09-10T22:24:00.919 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.a... 2024-09-10T22:24:00.919 DEBUG:teuthology.orchestra.run.smithi103:> sudo dpkg -i /tmp/linux-image.deb 2024-09-10T22:24:01.254 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-10T22:24:01.782 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-10T22:24:01.787 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-10T22:24:02.030 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-10T22:24:03.255 INFO:teuthology.orchestra.run.smithi103.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-10T22:24:03.259 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-10T22:24:03.363 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-10T22:24:05.869 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-10T22:24:05.978 INFO:teuthology.orchestra.run.smithi131.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:06.842 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-10T22:24:06.953 INFO:teuthology.orchestra.run.smithi103.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:28.102 INFO:teuthology.orchestra.run.smithi103.stderr:Sourcing file `/etc/default/grub' 2024-09-10T22:24:28.115 INFO:teuthology.orchestra.run.smithi103.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T22:24:28.141 INFO:teuthology.orchestra.run.smithi103.stderr:Generating grub configuration file ... 2024-09-10T22:24:28.435 INFO:teuthology.orchestra.run.smithi103.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:28.450 INFO:teuthology.orchestra.run.smithi103.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:28.731 INFO:teuthology.orchestra.run.smithi103.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T22:24:28.743 INFO:teuthology.orchestra.run.smithi103.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T22:24:28.806 INFO:teuthology.orchestra.run.smithi103.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T22:24:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T22:24:28.958 INFO:teuthology.orchestra.run.smithi103.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T22:24:28.958 INFO:teuthology.orchestra.run.smithi103.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T22:24:28.958 INFO:teuthology.orchestra.run.smithi103.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T22:24:28.996 INFO:teuthology.orchestra.run.smithi103.stderr:done 2024-09-10T22:24:29.170 DEBUG:teuthology.orchestra.run.smithi103:> dpkg-deb -c /tmp/linux-image.deb 2024-09-10T22:24:29.178 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-10T22:24:29.178 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-10T22:24:29.178 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:29.186 INFO:teuthology.orchestra.run.smithi131.stderr:Sourcing file `/etc/default/grub' 2024-09-10T22:24:29.192 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:29.193 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:29.203 INFO:teuthology.orchestra.run.smithi131.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T22:24:29.214 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-10T22:24:29.214 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-10T22:24:29.214 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-10T22:24:29.214 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-10T22:24:29.214 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-10T22:24:29.214 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-10T22:24:29.215 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-10T22:24:29.215 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-10T22:24:29.215 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-10T22:24:29.215 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-10T22:24:29.215 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-10T22:24:29.215 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-10T22:24:29.215 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-10T22:24:29.215 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-10T22:24:29.215 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T22:24:29.215 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T22:24:29.216 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T22:24:29.216 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T22:24:29.216 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T22:24:29.216 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T22:24:29.216 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T22:24:29.216 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T22:24:29.216 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T22:24:29.216 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T22:24:29.216 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T22:24:29.216 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T22:24:29.217 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T22:24:29.217 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T22:24:29.217 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T22:24:29.217 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T22:24:29.217 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T22:24:29.217 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T22:24:29.217 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T22:24:29.217 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-10T22:24:29.217 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-10T22:24:29.217 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-10T22:24:29.218 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T22:24:29.218 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-10T22:24:29.218 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-10T22:24:29.218 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-10T22:24:29.218 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T22:24:29.218 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T22:24:29.218 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T22:24:29.227 INFO:teuthology.orchestra.run.smithi131.stderr:Generating grub configuration file ... 2024-09-10T22:24:29.298 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-10T22:24:29.298 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-10T22:24:29.298 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-10T22:24:29.298 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-10T22:24:29.298 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T22:24:29.299 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T22:24:29.299 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T22:24:29.299 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-10T22:24:29.299 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-10T22:24:29.299 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-10T22:24:29.299 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T22:24:29.299 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T22:24:29.299 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T22:24:29.299 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T22:24:29.299 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T22:24:29.299 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T22:24:29.300 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T22:24:29.300 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T22:24:29.300 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T22:24:29.300 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T22:24:29.300 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T22:24:29.300 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T22:24:29.300 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T22:24:29.300 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T22:24:29.301 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T22:24:29.301 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T22:24:29.301 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T22:24:29.301 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T22:24:29.301 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-10T22:24:29.301 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T22:24:29.302 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-10T22:24:29.302 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T22:24:29.302 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T22:24:29.302 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T22:24:29.302 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T22:24:29.302 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T22:24:29.302 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T22:24:29.302 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T22:24:29.302 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T22:24:29.303 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-10T22:24:29.303 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T22:24:29.303 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T22:24:29.303 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T22:24:29.303 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T22:24:29.303 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T22:24:29.303 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T22:24:29.303 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T22:24:29.303 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T22:24:29.303 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T22:24:29.304 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T22:24:29.304 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T22:24:29.304 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T22:24:29.304 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T22:24:29.304 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T22:24:29.304 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T22:24:29.304 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T22:24:29.304 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T22:24:29.304 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-10T22:24:29.304 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T22:24:29.304 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-10T22:24:29.305 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-10T22:24:29.305 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-10T22:24:29.305 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T22:24:29.305 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T22:24:29.305 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-10T22:24:29.305 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-10T22:24:29.305 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T22:24:29.305 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T22:24:29.305 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T22:24:29.305 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T22:24:29.306 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T22:24:29.306 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-10T22:24:29.306 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T22:24:29.306 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-10T22:24:29.306 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T22:24:29.306 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-10T22:24:29.306 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T22:24:29.306 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T22:24:29.306 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T22:24:29.306 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T22:24:29.306 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T22:24:29.307 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T22:24:29.307 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T22:24:29.307 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T22:24:29.307 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T22:24:29.307 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T22:24:29.307 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T22:24:29.307 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T22:24:29.307 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T22:24:29.307 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T22:24:29.307 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T22:24:29.308 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T22:24:29.308 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T22:24:29.308 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T22:24:29.308 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-10T22:24:29.308 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T22:24:29.308 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T22:24:29.308 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T22:24:29.308 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T22:24:29.308 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T22:24:29.309 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T22:24:29.309 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T22:24:29.309 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T22:24:29.309 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T22:24:29.309 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T22:24:29.309 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T22:24:29.309 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T22:24:29.309 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T22:24:29.309 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-10T22:24:29.309 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T22:24:29.310 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-10T22:24:29.310 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T22:24:29.310 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T22:24:29.310 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T22:24:29.310 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T22:24:29.310 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T22:24:29.310 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T22:24:29.310 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T22:24:29.310 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T22:24:29.310 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T22:24:29.311 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T22:24:29.311 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T22:24:29.311 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T22:24:29.311 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T22:24:29.311 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T22:24:29.311 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T22:24:29.311 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T22:24:29.311 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T22:24:29.311 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T22:24:29.311 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T22:24:29.312 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T22:24:29.312 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-10T22:24:29.312 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T22:24:29.312 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-10T22:24:29.312 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T22:24:29.312 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-10T22:24:29.312 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-10T22:24:29.312 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T22:24:29.312 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-10T22:24:29.312 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T22:24:29.313 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T22:24:29.313 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-10T22:24:29.313 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T22:24:29.313 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T22:24:29.313 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-10T22:24:29.313 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T22:24:29.313 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T22:24:29.313 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T22:24:29.313 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-10T22:24:29.313 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T22:24:29.314 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-10T22:24:29.314 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T22:24:29.314 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-10T22:24:29.314 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-10T22:24:29.314 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T22:24:29.314 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-10T22:24:29.314 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T22:24:29.314 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T22:24:29.314 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T22:24:29.314 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T22:24:29.315 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T22:24:29.315 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-10T22:24:29.315 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T22:24:29.315 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T22:24:29.315 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T22:24:29.315 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T22:24:29.315 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T22:24:29.315 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T22:24:29.316 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T22:24:29.316 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-10T22:24:29.316 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T22:24:29.316 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-10T22:24:29.316 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T22:24:29.316 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T22:24:29.316 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-10T22:24:29.316 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T22:24:29.316 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-10T22:24:29.316 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-10T22:24:29.317 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-10T22:24:29.317 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T22:24:29.317 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T22:24:29.317 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-10T22:24:29.317 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-10T22:24:29.317 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-10T22:24:29.317 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-10T22:24:29.317 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-10T22:24:29.317 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-10T22:24:29.318 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-10T22:24:29.318 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-10T22:24:29.318 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-10T22:24:29.318 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-10T22:24:29.318 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-10T22:24:29.318 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T22:24:29.318 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T22:24:29.318 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T22:24:29.319 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-10T22:24:29.319 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-10T22:24:29.319 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T22:24:29.319 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T22:24:29.319 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-10T22:24:29.319 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-10T22:24:29.319 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-10T22:24:29.319 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T22:24:29.319 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-10T22:24:29.319 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T22:24:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T22:24:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T22:24:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-10T22:24:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T22:24:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-10T22:24:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T22:24:29.320 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-10T22:24:29.321 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-10T22:24:29.321 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T22:24:29.321 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-10T22:24:29.321 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T22:24:29.321 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-10T22:24:29.321 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T22:24:29.321 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T22:24:29.322 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T22:24:29.322 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T22:24:29.322 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T22:24:29.322 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T22:24:29.322 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T22:24:29.322 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T22:24:29.322 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T22:24:29.322 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T22:24:29.323 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T22:24:29.323 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T22:24:29.323 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T22:24:29.323 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-10T22:24:29.323 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-10T22:24:29.323 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-10T22:24:29.323 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-10T22:24:29.323 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-10T22:24:29.323 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-10T22:24:29.323 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-10T22:24:29.323 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-10T22:24:29.324 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-10T22:24:29.324 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-10T22:24:29.324 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-10T22:24:29.324 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-10T22:24:29.324 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T22:24:29.324 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-10T22:24:29.324 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-10T22:24:29.324 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-10T22:24:29.324 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-10T22:24:29.325 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-10T22:24:29.325 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-10T22:24:29.325 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-10T22:24:29.325 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-10T22:24:29.325 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-10T22:24:29.325 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T22:24:29.325 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-10T22:24:29.325 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-10T22:24:29.325 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-10T22:24:29.326 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-10T22:24:29.326 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-10T22:24:29.326 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-10T22:24:29.326 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-10T22:24:29.326 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-10T22:24:29.326 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-10T22:24:29.326 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-10T22:24:29.326 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-10T22:24:29.327 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-10T22:24:29.327 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-10T22:24:29.327 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-10T22:24:29.327 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-10T22:24:29.327 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T22:24:29.327 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-10T22:24:29.327 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-10T22:24:29.328 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-10T22:24:29.328 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-10T22:24:29.328 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-10T22:24:29.328 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-10T22:24:29.328 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-10T22:24:29.328 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T22:24:29.328 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T22:24:29.328 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T22:24:29.329 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-10T22:24:29.329 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-10T22:24:29.329 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-10T22:24:29.329 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-10T22:24:29.329 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-10T22:24:29.329 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T22:24:29.329 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T22:24:29.329 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T22:24:29.329 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T22:24:29.329 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-10T22:24:29.329 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T22:24:29.330 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-10T22:24:29.330 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T22:24:29.330 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T22:24:29.330 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T22:24:29.330 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T22:24:29.330 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T22:24:29.330 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T22:24:29.330 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T22:24:29.330 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-10T22:24:29.330 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T22:24:29.330 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T22:24:29.331 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T22:24:29.331 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T22:24:29.331 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T22:24:29.331 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-10T22:24:29.331 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T22:24:29.331 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T22:24:29.331 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-10T22:24:29.331 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-10T22:24:29.331 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-10T22:24:29.331 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-10T22:24:29.331 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T22:24:29.332 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-10T22:24:29.332 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T22:24:29.332 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T22:24:29.332 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T22:24:29.332 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T22:24:29.332 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T22:24:29.332 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T22:24:29.332 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T22:24:29.332 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T22:24:29.332 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T22:24:29.332 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T22:24:29.333 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T22:24:29.333 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T22:24:29.333 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T22:24:29.333 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T22:24:29.333 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T22:24:29.333 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T22:24:29.333 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T22:24:29.333 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T22:24:29.333 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T22:24:29.333 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T22:24:29.333 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T22:24:29.334 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T22:24:29.334 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T22:24:29.334 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T22:24:29.334 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T22:24:29.334 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T22:24:29.334 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T22:24:29.334 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T22:24:29.334 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T22:24:29.334 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T22:24:29.334 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T22:24:29.335 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T22:24:29.335 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T22:24:29.335 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T22:24:29.335 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T22:24:29.335 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T22:24:29.335 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T22:24:29.335 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T22:24:29.335 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T22:24:29.335 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-10T22:24:29.335 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T22:24:29.335 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-10T22:24:29.336 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-10T22:24:29.336 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-10T22:24:29.336 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-10T22:24:29.336 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T22:24:29.336 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-10T22:24:29.336 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T22:24:29.336 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T22:24:29.336 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T22:24:29.336 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-10T22:24:29.336 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T22:24:29.336 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T22:24:29.337 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T22:24:29.337 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T22:24:29.337 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T22:24:29.337 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T22:24:29.337 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T22:24:29.337 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T22:24:29.337 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T22:24:29.337 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T22:24:29.337 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T22:24:29.337 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T22:24:29.337 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T22:24:29.338 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T22:24:29.338 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T22:24:29.338 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T22:24:29.338 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T22:24:29.338 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T22:24:29.338 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T22:24:29.338 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T22:24:29.338 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T22:24:29.338 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T22:24:29.338 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T22:24:29.339 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T22:24:29.339 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T22:24:29.339 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-10T22:24:29.339 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-10T22:24:29.339 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-10T22:24:29.339 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T22:24:29.339 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T22:24:29.339 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T22:24:29.339 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T22:24:29.339 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T22:24:29.339 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-10T22:24:29.339 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T22:24:29.339 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T22:24:29.340 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T22:24:29.340 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T22:24:29.340 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T22:24:29.340 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T22:24:29.340 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T22:24:29.340 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T22:24:29.340 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T22:24:29.340 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T22:24:29.340 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-10T22:24:29.340 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T22:24:29.341 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T22:24:29.341 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T22:24:29.341 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T22:24:29.341 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T22:24:29.341 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T22:24:29.341 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T22:24:29.341 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T22:24:29.341 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-10T22:24:29.341 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T22:24:29.341 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T22:24:29.342 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T22:24:29.342 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T22:24:29.342 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T22:24:29.342 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T22:24:29.342 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T22:24:29.342 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T22:24:29.342 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T22:24:29.342 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T22:24:29.342 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T22:24:29.342 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T22:24:29.343 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T22:24:29.343 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T22:24:29.343 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T22:24:29.343 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T22:24:29.343 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T22:24:29.343 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T22:24:29.343 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T22:24:29.343 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T22:24:29.343 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T22:24:29.343 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T22:24:29.343 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T22:24:29.344 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T22:24:29.344 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T22:24:29.344 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T22:24:29.344 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T22:24:29.344 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T22:24:29.344 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T22:24:29.344 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T22:24:29.344 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T22:24:29.344 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T22:24:29.344 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-10T22:24:29.344 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T22:24:29.345 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-10T22:24:29.345 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T22:24:29.345 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T22:24:29.345 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T22:24:29.345 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T22:24:29.345 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T22:24:29.345 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T22:24:29.345 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T22:24:29.345 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-10T22:24:29.345 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T22:24:29.346 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T22:24:29.346 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T22:24:29.346 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T22:24:29.346 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T22:24:29.346 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T22:24:29.346 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T22:24:29.346 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T22:24:29.346 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T22:24:29.346 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T22:24:29.346 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T22:24:29.346 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T22:24:29.346 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T22:24:29.347 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T22:24:29.347 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T22:24:29.347 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T22:24:29.347 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T22:24:29.347 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T22:24:29.347 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T22:24:29.347 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T22:24:29.347 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T22:24:29.347 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T22:24:29.347 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T22:24:29.347 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T22:24:29.348 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T22:24:29.348 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T22:24:29.348 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T22:24:29.348 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T22:24:29.348 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T22:24:29.348 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T22:24:29.348 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T22:24:29.348 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T22:24:29.348 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T22:24:29.348 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T22:24:29.348 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T22:24:29.349 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T22:24:29.349 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T22:24:29.349 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T22:24:29.349 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T22:24:29.349 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T22:24:29.349 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T22:24:29.349 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-10T22:24:29.349 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-10T22:24:29.349 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-10T22:24:29.349 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-10T22:24:29.349 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T22:24:29.350 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T22:24:29.350 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-10T22:24:29.350 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-10T22:24:29.350 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-10T22:24:29.350 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-10T22:24:29.350 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T22:24:29.350 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T22:24:29.350 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T22:24:29.350 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-10T22:24:29.350 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T22:24:29.350 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-10T22:24:29.351 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T22:24:29.351 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T22:24:29.351 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T22:24:29.351 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T22:24:29.351 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-10T22:24:29.351 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-10T22:24:29.351 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T22:24:29.351 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T22:24:29.351 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T22:24:29.351 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-10T22:24:29.351 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T22:24:29.351 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T22:24:29.352 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-10T22:24:29.352 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T22:24:29.352 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T22:24:29.352 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T22:24:29.352 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-10T22:24:29.352 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T22:24:29.352 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T22:24:29.352 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-10T22:24:29.352 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-10T22:24:29.352 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T22:24:29.352 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-10T22:24:29.353 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T22:24:29.353 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T22:24:29.353 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T22:24:29.353 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T22:24:29.353 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-10T22:24:29.353 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T22:24:29.353 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T22:24:29.353 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T22:24:29.353 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-10T22:24:29.353 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-10T22:24:29.353 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-10T22:24:29.354 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-10T22:24:29.354 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-10T22:24:29.354 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-10T22:24:29.354 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T22:24:29.354 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T22:24:29.354 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T22:24:29.354 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T22:24:29.354 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T22:24:29.354 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T22:24:29.354 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T22:24:29.354 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-10T22:24:29.355 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-10T22:24:29.355 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T22:24:29.355 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-10T22:24:29.355 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T22:24:29.355 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-10T22:24:29.355 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T22:24:29.355 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-10T22:24:29.355 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T22:24:29.355 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-10T22:24:29.355 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-10T22:24:29.355 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-10T22:24:29.355 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-10T22:24:29.356 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-10T22:24:29.356 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-10T22:24:29.356 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T22:24:29.356 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-10T22:24:29.356 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T22:24:29.356 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-10T22:24:29.356 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T22:24:29.356 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-10T22:24:29.356 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T22:24:29.356 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-10T22:24:29.357 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T22:24:29.357 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-10T22:24:29.357 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-10T22:24:29.357 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-10T22:24:29.357 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-10T22:24:29.357 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T22:24:29.357 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T22:24:29.357 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T22:24:29.357 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T22:24:29.357 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-10T22:24:29.357 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-10T22:24:29.358 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-10T22:24:29.358 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-10T22:24:29.358 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-10T22:24:29.358 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T22:24:29.358 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-10T22:24:29.358 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-10T22:24:29.358 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-10T22:24:29.358 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-10T22:24:29.358 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-10T22:24:29.358 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-10T22:24:29.358 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-10T22:24:29.358 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-10T22:24:29.359 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-10T22:24:29.359 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-10T22:24:29.359 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-10T22:24:29.359 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-10T22:24:29.359 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-10T22:24:29.359 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-10T22:24:29.359 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-10T22:24:29.359 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-10T22:24:29.359 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-10T22:24:29.359 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-10T22:24:29.360 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-10T22:24:29.360 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-10T22:24:29.360 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-10T22:24:29.360 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T22:24:29.360 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T22:24:29.360 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T22:24:29.360 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T22:24:29.360 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-10T22:24:29.360 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-10T22:24:29.360 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T22:24:29.360 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T22:24:29.361 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T22:24:29.361 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T22:24:29.361 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-10T22:24:29.361 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T22:24:29.361 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-10T22:24:29.361 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T22:24:29.361 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T22:24:29.361 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-10T22:24:29.361 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T22:24:29.361 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-10T22:24:29.361 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-10T22:24:29.362 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-10T22:24:29.362 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T22:24:29.362 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-10T22:24:29.362 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T22:24:29.362 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-10T22:24:29.362 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-10T22:24:29.362 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-10T22:24:29.362 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-10T22:24:29.362 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T22:24:29.362 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-10T22:24:29.362 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-10T22:24:29.362 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-10T22:24:29.362 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T22:24:29.363 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-10T22:24:29.363 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-10T22:24:29.363 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-10T22:24:29.363 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T22:24:29.363 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-10T22:24:29.363 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-10T22:24:29.363 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-10T22:24:29.363 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-10T22:24:29.363 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-10T22:24:29.363 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-10T22:24:29.363 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-10T22:24:29.363 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T22:24:29.364 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-10T22:24:29.364 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-10T22:24:29.364 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-10T22:24:29.364 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-10T22:24:29.364 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T22:24:29.364 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T22:24:29.364 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T22:24:29.364 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T22:24:29.364 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T22:24:29.364 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T22:24:29.364 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T22:24:29.365 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T22:24:29.365 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-10T22:24:29.365 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-10T22:24:29.365 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T22:24:29.365 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T22:24:29.365 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-10T22:24:29.365 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T22:24:29.365 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T22:24:29.365 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T22:24:29.365 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T22:24:29.365 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-10T22:24:29.366 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T22:24:29.366 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T22:24:29.366 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-10T22:24:29.366 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-10T22:24:29.366 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T22:24:29.366 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T22:24:29.366 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T22:24:29.366 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-10T22:24:29.366 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T22:24:29.366 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T22:24:29.366 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-10T22:24:29.366 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T22:24:29.366 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T22:24:29.367 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T22:24:29.367 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-10T22:24:29.367 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-10T22:24:29.367 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T22:24:29.367 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T22:24:29.367 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T22:24:29.367 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T22:24:29.367 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T22:24:29.367 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-10T22:24:29.367 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-10T22:24:29.367 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T22:24:29.367 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T22:24:29.367 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T22:24:29.368 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T22:24:29.368 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T22:24:29.368 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T22:24:29.368 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T22:24:29.368 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-10T22:24:29.368 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-10T22:24:29.368 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-10T22:24:29.368 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-10T22:24:29.368 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-10T22:24:29.368 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-10T22:24:29.368 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-10T22:24:29.368 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-10T22:24:29.369 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-10T22:24:29.369 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-10T22:24:29.369 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-10T22:24:29.369 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-10T22:24:29.369 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-10T22:24:29.369 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-10T22:24:29.369 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T22:24:29.369 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T22:24:29.370 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-10T22:24:29.370 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-10T22:24:29.370 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-10T22:24:29.370 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-10T22:24:29.370 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-10T22:24:29.370 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-10T22:24:29.370 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-10T22:24:29.370 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-10T22:24:29.370 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-10T22:24:29.370 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-10T22:24:29.370 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T22:24:29.371 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-10T22:24:29.371 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-10T22:24:29.371 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T22:24:29.371 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T22:24:29.371 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T22:24:29.371 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-10T22:24:29.371 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-10T22:24:29.371 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-10T22:24:29.371 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-10T22:24:29.371 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-10T22:24:29.372 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T22:24:29.372 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T22:24:29.372 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T22:24:29.372 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T22:24:29.372 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-10T22:24:29.372 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-10T22:24:29.372 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-10T22:24:29.372 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-10T22:24:29.372 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T22:24:29.372 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-10T22:24:29.372 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-10T22:24:29.373 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-10T22:24:29.373 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-10T22:24:29.373 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-10T22:24:29.373 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T22:24:29.373 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T22:24:29.373 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T22:24:29.373 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T22:24:29.373 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-10T22:24:29.373 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-10T22:24:29.373 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-10T22:24:29.373 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T22:24:29.374 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-10T22:24:29.374 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-10T22:24:29.374 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-10T22:24:29.374 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T22:24:29.374 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T22:24:29.374 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-10T22:24:29.374 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T22:24:29.374 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T22:24:29.374 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-10T22:24:29.374 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T22:24:29.374 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T22:24:29.374 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T22:24:29.375 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-10T22:24:29.375 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-10T22:24:29.375 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-10T22:24:29.375 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T22:24:29.375 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T22:24:29.375 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T22:24:29.375 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T22:24:29.375 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-10T22:24:29.375 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T22:24:29.375 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-10T22:24:29.375 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-10T22:24:29.376 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T22:24:29.376 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-10T22:24:29.376 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-10T22:24:29.376 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T22:24:29.376 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T22:24:29.376 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T22:24:29.376 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-10T22:24:29.376 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T22:24:29.376 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T22:24:29.376 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T22:24:29.376 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-10T22:24:29.376 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-10T22:24:29.377 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T22:24:29.377 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T22:24:29.377 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T22:24:29.377 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T22:24:29.377 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-10T22:24:29.377 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T22:24:29.377 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T22:24:29.377 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T22:24:29.377 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T22:24:29.377 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-10T22:24:29.377 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T22:24:29.378 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-10T22:24:29.378 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T22:24:29.378 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-10T22:24:29.378 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T22:24:29.378 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-10T22:24:29.378 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T22:24:29.378 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-10T22:24:29.378 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T22:24:29.379 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T22:24:29.379 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T22:24:29.379 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-10T22:24:29.379 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-10T22:24:29.379 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T22:24:29.379 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-10T22:24:29.379 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T22:24:29.379 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-10T22:24:29.379 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T22:24:29.379 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-10T22:24:29.379 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T22:24:29.380 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T22:24:29.380 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-10T22:24:29.380 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T22:24:29.380 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T22:24:29.380 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-10T22:24:29.380 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T22:24:29.380 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T22:24:29.380 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-10T22:24:29.380 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T22:24:29.380 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T22:24:29.381 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-10T22:24:29.381 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-10T22:24:29.381 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T22:24:29.381 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-10T22:24:29.381 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-10T22:24:29.381 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T22:24:29.381 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-10T22:24:29.381 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T22:24:29.381 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-10T22:24:29.382 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T22:24:29.382 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-10T22:24:29.382 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T22:24:29.382 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-10T22:24:29.382 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T22:24:29.382 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-10T22:24:29.382 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-10T22:24:29.382 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T22:24:29.382 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-10T22:24:29.383 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-10T22:24:29.383 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T22:24:29.383 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T22:24:29.383 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T22:24:29.383 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T22:24:29.383 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T22:24:29.383 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T22:24:29.383 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-10T22:24:29.384 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T22:24:29.384 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T22:24:29.384 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T22:24:29.384 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-10T22:24:29.384 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-10T22:24:29.384 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-10T22:24:29.384 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T22:24:29.385 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T22:24:29.385 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T22:24:29.385 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-10T22:24:29.385 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-10T22:24:29.385 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-10T22:24:29.385 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T22:24:29.387 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-10T22:24:29.387 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T22:24:29.388 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-10T22:24:29.388 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T22:24:29.388 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-10T22:24:29.388 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T22:24:29.388 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-10T22:24:29.388 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T22:24:29.516 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-10T22:24:29.516 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T22:24:29.516 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-10T22:24:29.517 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T22:24:29.517 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-10T22:24:29.517 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T22:24:29.517 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-10T22:24:29.517 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T22:24:29.517 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-10T22:24:29.517 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T22:24:29.517 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-10T22:24:29.517 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T22:24:29.517 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-10T22:24:29.518 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T22:24:29.518 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T22:24:29.518 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-10T22:24:29.518 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T22:24:29.518 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T22:24:29.518 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T22:24:29.518 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-10T22:24:29.518 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-10T22:24:29.518 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T22:24:29.518 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T22:24:29.518 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-10T22:24:29.519 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-10T22:24:29.519 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T22:24:29.519 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-10T22:24:29.519 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-10T22:24:29.519 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-10T22:24:29.519 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-10T22:24:29.519 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T22:24:29.519 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-10T22:24:29.519 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-10T22:24:29.519 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T22:24:29.519 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-10T22:24:29.520 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T22:24:29.520 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T22:24:29.520 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-10T22:24:29.520 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T22:24:29.520 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-10T22:24:29.520 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T22:24:29.520 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-10T22:24:29.520 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T22:24:29.520 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T22:24:29.520 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-10T22:24:29.520 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-10T22:24:29.520 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T22:24:29.521 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T22:24:29.521 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-10T22:24:29.521 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T22:24:29.521 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-10T22:24:29.521 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T22:24:29.521 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-10T22:24:29.521 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T22:24:29.521 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T22:24:29.521 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T22:24:29.521 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T22:24:29.521 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-10T22:24:29.522 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-10T22:24:29.522 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-10T22:24:29.522 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-10T22:24:29.522 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T22:24:29.522 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-10T22:24:29.522 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T22:24:29.522 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-10T22:24:29.522 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T22:24:29.522 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T22:24:29.522 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-10T22:24:29.523 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T22:24:29.523 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T22:24:29.523 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T22:24:29.523 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T22:24:29.523 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-10T22:24:29.523 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-10T22:24:29.523 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-10T22:24:29.523 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T22:24:29.523 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-10T22:24:29.523 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T22:24:29.523 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-10T22:24:29.524 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T22:24:29.524 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T22:24:29.524 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T22:24:29.524 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T22:24:29.524 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-10T22:24:29.524 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T22:24:29.524 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-10T22:24:29.524 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T22:24:29.524 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-10T22:24:29.524 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T22:24:29.524 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T22:24:29.525 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-10T22:24:29.525 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T22:24:29.525 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T22:24:29.525 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-10T22:24:29.525 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T22:24:29.525 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-10T22:24:29.525 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-10T22:24:29.526 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-10T22:24:29.526 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-10T22:24:29.526 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T22:24:29.526 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-10T22:24:29.526 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T22:24:29.526 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-10T22:24:29.526 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T22:24:29.526 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T22:24:29.526 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-10T22:24:29.526 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T22:24:29.526 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T22:24:29.527 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T22:24:29.527 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-10T22:24:29.527 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T22:24:29.527 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T22:24:29.527 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-10T22:24:29.527 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T22:24:29.527 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T22:24:29.527 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T22:24:29.527 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T22:24:29.527 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T22:24:29.527 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-10T22:24:29.527 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T22:24:29.528 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T22:24:29.528 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-10T22:24:29.528 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T22:24:29.528 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T22:24:29.528 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T22:24:29.528 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T22:24:29.528 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T22:24:29.528 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T22:24:29.528 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T22:24:29.528 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T22:24:29.528 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T22:24:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T22:24:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T22:24:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T22:24:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T22:24:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T22:24:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T22:24:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T22:24:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T22:24:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T22:24:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T22:24:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-10T22:24:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-10T22:24:29.529 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-10T22:24:29.530 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T22:24:29.530 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T22:24:29.530 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T22:24:29.530 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T22:24:29.530 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T22:24:29.530 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T22:24:29.530 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T22:24:29.530 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T22:24:29.530 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-10T22:24:29.530 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T22:24:29.530 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T22:24:29.531 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T22:24:29.531 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-10T22:24:29.531 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T22:24:29.531 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T22:24:29.531 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T22:24:29.531 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T22:24:29.531 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T22:24:29.531 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T22:24:29.531 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T22:24:29.531 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-10T22:24:29.531 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T22:24:29.531 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-10T22:24:29.532 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T22:24:29.532 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-10T22:24:29.532 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T22:24:29.532 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-10T22:24:29.532 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T22:24:29.532 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-10T22:24:29.532 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-10T22:24:29.532 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T22:24:29.532 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T22:24:29.532 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-10T22:24:29.533 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T22:24:29.533 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T22:24:29.533 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T22:24:29.533 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T22:24:29.533 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-10T22:24:29.533 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-10T22:24:29.533 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T22:24:29.533 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-10T22:24:29.533 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-10T22:24:29.533 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-10T22:24:29.534 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T22:24:29.534 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-10T22:24:29.534 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T22:24:29.534 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-10T22:24:29.534 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-10T22:24:29.534 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-10T22:24:29.534 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T22:24:29.534 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T22:24:29.534 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-10T22:24:29.534 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-10T22:24:29.534 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-10T22:24:29.535 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-10T22:24:29.535 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-10T22:24:29.535 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-10T22:24:29.535 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-10T22:24:29.535 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T22:24:29.535 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-10T22:24:29.535 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-10T22:24:29.535 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-10T22:24:29.535 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-10T22:24:29.535 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-10T22:24:29.535 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-10T22:24:29.535 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-10T22:24:29.536 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-10T22:24:29.536 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-10T22:24:29.536 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-10T22:24:29.536 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T22:24:29.536 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T22:24:29.536 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T22:24:29.536 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T22:24:29.536 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T22:24:29.536 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T22:24:29.536 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T22:24:29.536 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T22:24:29.537 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T22:24:29.537 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T22:24:29.537 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T22:24:29.537 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T22:24:29.537 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-10T22:24:29.537 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-10T22:24:29.537 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T22:24:29.537 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-10T22:24:29.537 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T22:24:29.537 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T22:24:29.537 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T22:24:29.538 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T22:24:29.538 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T22:24:29.538 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T22:24:29.538 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T22:24:29.538 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T22:24:29.538 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T22:24:29.538 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T22:24:29.538 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T22:24:29.538 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-10T22:24:29.538 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-10T22:24:29.538 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-10T22:24:29.538 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-10T22:24:29.539 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-10T22:24:29.539 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-10T22:24:29.539 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-10T22:24:29.539 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-10T22:24:29.539 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-10T22:24:29.539 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-10T22:24:29.539 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-10T22:24:29.539 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-10T22:24:29.539 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-10T22:24:29.539 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-10T22:24:29.539 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-10T22:24:29.539 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-10T22:24:29.540 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-10T22:24:29.540 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-10T22:24:29.540 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-10T22:24:29.540 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-10T22:24:29.540 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-10T22:24:29.540 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-10T22:24:29.540 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-10T22:24:29.540 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-10T22:24:29.540 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-10T22:24:29.540 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-10T22:24:29.541 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-10T22:24:29.541 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-10T22:24:29.541 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-10T22:24:29.541 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-10T22:24:29.541 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T22:24:29.541 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T22:24:29.541 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-10T22:24:29.541 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-10T22:24:29.541 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T22:24:29.541 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T22:24:29.541 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T22:24:29.542 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T22:24:29.542 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-10T22:24:29.542 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T22:24:29.542 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T22:24:29.542 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-10T22:24:29.542 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-10T22:24:29.542 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-10T22:24:29.542 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T22:24:29.542 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T22:24:29.542 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-10T22:24:29.542 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-10T22:24:29.543 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-10T22:24:29.543 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T22:24:29.543 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-10T22:24:29.543 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-10T22:24:29.543 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-10T22:24:29.543 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T22:24:29.543 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T22:24:29.543 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T22:24:29.543 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T22:24:29.543 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T22:24:29.544 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T22:24:29.544 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T22:24:29.544 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T22:24:29.544 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T22:24:29.544 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T22:24:29.544 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T22:24:29.544 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T22:24:29.544 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T22:24:29.544 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-10T22:24:29.544 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T22:24:29.544 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T22:24:29.545 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T22:24:29.545 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-10T22:24:29.545 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T22:24:29.545 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-10T22:24:29.545 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-10T22:24:29.545 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-10T22:24:29.545 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-10T22:24:29.545 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-10T22:24:29.545 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T22:24:29.545 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-10T22:24:29.545 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T22:24:29.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-10T22:24:29.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T22:24:29.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T22:24:29.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T22:24:29.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T22:24:29.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-10T22:24:29.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T22:24:29.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T22:24:29.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T22:24:29.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T22:24:29.547 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T22:24:29.547 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-10T22:24:29.547 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T22:24:29.547 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-10T22:24:29.547 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-10T22:24:29.547 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-10T22:24:29.547 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-10T22:24:29.547 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T22:24:29.547 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-10T22:24:29.547 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T22:24:29.547 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T22:24:29.548 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T22:24:29.548 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T22:24:29.548 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T22:24:29.548 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-10T22:24:29.548 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T22:24:29.548 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T22:24:29.548 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-10T22:24:29.548 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T22:24:29.548 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T22:24:29.548 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-10T22:24:29.548 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-10T22:24:29.549 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T22:24:29.549 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-10T22:24:29.549 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T22:24:29.549 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T22:24:29.549 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-10T22:24:29.549 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T22:24:29.549 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-10T22:24:29.549 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T22:24:29.549 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-10T22:24:29.549 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T22:24:29.549 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-10T22:24:29.550 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T22:24:29.550 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T22:24:29.550 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-10T22:24:29.550 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T22:24:29.550 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-10T22:24:29.550 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-10T22:24:29.550 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T22:24:29.550 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-10T22:24:29.550 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T22:24:29.550 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T22:24:29.550 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T22:24:29.551 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T22:24:29.551 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-10T22:24:29.551 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T22:24:29.551 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T22:24:29.551 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-10T22:24:29.551 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T22:24:29.551 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T22:24:29.551 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-10T22:24:29.551 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-10T22:24:29.551 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T22:24:29.551 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T22:24:29.551 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T22:24:29.552 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T22:24:29.552 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-10T22:24:29.552 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T22:24:29.552 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T22:24:29.552 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T22:24:29.552 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-10T22:24:29.552 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T22:24:29.552 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T22:24:29.552 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T22:24:29.552 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-10T22:24:29.552 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T22:24:29.552 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T22:24:29.553 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T22:24:29.553 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-10T22:24:29.553 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T22:24:29.553 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-10T22:24:29.553 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T22:24:29.553 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-10T22:24:29.553 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T22:24:29.553 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T22:24:29.553 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T22:24:29.553 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T22:24:29.553 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-10T22:24:29.553 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T22:24:29.554 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-10T22:24:29.554 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T22:24:29.554 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T22:24:29.554 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-10T22:24:29.554 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-10T22:24:29.554 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-10T22:24:29.554 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-10T22:24:29.554 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-10T22:24:29.554 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-10T22:24:29.554 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T22:24:29.554 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T22:24:29.555 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-10T22:24:29.555 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T22:24:29.555 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-10T22:24:29.555 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T22:24:29.555 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T22:24:29.555 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-10T22:24:29.555 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T22:24:29.555 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-10T22:24:29.555 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T22:24:29.555 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T22:24:29.555 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T22:24:29.555 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T22:24:29.556 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T22:24:29.556 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T22:24:29.556 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T22:24:29.556 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T22:24:29.556 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T22:24:29.556 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T22:24:29.556 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-10T22:24:29.556 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T22:24:29.556 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T22:24:29.556 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T22:24:29.556 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T22:24:29.557 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-10T22:24:29.557 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-10T22:24:29.557 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T22:24:29.557 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-10T22:24:29.557 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-10T22:24:29.557 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T22:24:29.557 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-10T22:24:29.557 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T22:24:29.557 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T22:24:29.557 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T22:24:29.557 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T22:24:29.558 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T22:24:29.558 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T22:24:29.558 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-10T22:24:29.558 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T22:24:29.558 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-10T22:24:29.558 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-10T22:24:29.558 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-10T22:24:29.558 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T22:24:29.558 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T22:24:29.558 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T22:24:29.558 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T22:24:29.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T22:24:29.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T22:24:29.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T22:24:29.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T22:24:29.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T22:24:29.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T22:24:29.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T22:24:29.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T22:24:29.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T22:24:29.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T22:24:29.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T22:24:29.560 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-10T22:24:29.560 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T22:24:29.560 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T22:24:29.560 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T22:24:29.560 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-10T22:24:29.560 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-10T22:24:29.560 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T22:24:29.560 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-10T22:24:29.560 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-10T22:24:29.561 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T22:24:29.561 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T22:24:29.561 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T22:24:29.561 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-10T22:24:29.561 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-10T22:24:29.561 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-10T22:24:29.561 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T22:24:29.561 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-10T22:24:29.561 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-10T22:24:29.561 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T22:24:29.561 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-10T22:24:29.561 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-10T22:24:29.562 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T22:24:29.562 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-10T22:24:29.562 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-10T22:24:29.562 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-10T22:24:29.562 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-10T22:24:29.562 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-10T22:24:29.562 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T22:24:29.562 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-10T22:24:29.562 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T22:24:29.562 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-10T22:24:29.562 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-10T22:24:29.563 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T22:24:29.563 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T22:24:29.563 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T22:24:29.563 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-10T22:24:29.563 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-10T22:24:29.563 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-10T22:24:29.563 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T22:24:29.563 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-10T22:24:29.563 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T22:24:29.563 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-10T22:24:29.563 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-10T22:24:29.564 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-10T22:24:29.564 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-10T22:24:29.564 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-10T22:24:29.564 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-10T22:24:29.564 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-10T22:24:29.564 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-10T22:24:29.564 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-10T22:24:29.564 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-10T22:24:29.564 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T22:24:29.564 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T22:24:29.564 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T22:24:29.565 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T22:24:29.565 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-10T22:24:29.565 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-10T22:24:29.565 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-10T22:24:29.565 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-10T22:24:29.565 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-10T22:24:29.565 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-10T22:24:29.565 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-10T22:24:29.565 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-10T22:24:29.565 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-10T22:24:29.565 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-10T22:24:29.566 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-10T22:24:29.566 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-10T22:24:29.566 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-10T22:24:29.566 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-10T22:24:29.566 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-10T22:24:29.566 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-10T22:24:29.566 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-10T22:24:29.566 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-10T22:24:29.566 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-10T22:24:29.566 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-10T22:24:29.566 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-10T22:24:29.567 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-10T22:24:29.567 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-10T22:24:29.567 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-10T22:24:29.567 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-10T22:24:29.567 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-10T22:24:29.567 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-10T22:24:29.567 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-10T22:24:29.567 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-10T22:24:29.567 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-10T22:24:29.567 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-10T22:24:29.567 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-10T22:24:29.567 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-10T22:24:29.568 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-10T22:24:29.568 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-10T22:24:29.568 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-10T22:24:29.568 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-10T22:24:29.568 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-10T22:24:29.568 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-10T22:24:29.568 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-10T22:24:29.568 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-10T22:24:29.568 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-10T22:24:29.568 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-10T22:24:29.568 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-10T22:24:29.568 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-10T22:24:29.569 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-10T22:24:29.569 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-10T22:24:29.569 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-10T22:24:29.569 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-10T22:24:29.569 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-10T22:24:29.569 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-10T22:24:29.569 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-10T22:24:29.569 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-10T22:24:29.569 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-10T22:24:29.569 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-10T22:24:29.569 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-10T22:24:29.570 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-10T22:24:29.570 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-10T22:24:29.570 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-10T22:24:29.570 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-10T22:24:29.570 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-10T22:24:29.570 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-10T22:24:29.570 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-10T22:24:29.570 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T22:24:29.570 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-10T22:24:29.570 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-10T22:24:29.570 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-10T22:24:29.571 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-10T22:24:29.571 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T22:24:29.571 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T22:24:29.571 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-10T22:24:29.571 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T22:24:29.571 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T22:24:29.571 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-10T22:24:29.571 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-10T22:24:29.571 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-10T22:24:29.571 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T22:24:29.571 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T22:24:29.572 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T22:24:29.572 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T22:24:29.572 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T22:24:29.572 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T22:24:29.572 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T22:24:29.572 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T22:24:29.572 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-10T22:24:29.572 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-10T22:24:29.572 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T22:24:29.572 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T22:24:29.572 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T22:24:29.573 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T22:24:29.573 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T22:24:29.573 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-10T22:24:29.573 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T22:24:29.573 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T22:24:29.573 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-10T22:24:29.573 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-10T22:24:29.573 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-10T22:24:29.573 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-10T22:24:29.573 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-10T22:24:29.573 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T22:24:29.573 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-10T22:24:29.574 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-10T22:24:29.574 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-10T22:24:29.574 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-10T22:24:29.574 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T22:24:29.574 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T22:24:29.574 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T22:24:29.574 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T22:24:29.574 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T22:24:29.574 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T22:24:29.574 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T22:24:29.574 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T22:24:29.575 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T22:24:29.575 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-10T22:24:29.575 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T22:24:29.575 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T22:24:29.575 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T22:24:29.575 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T22:24:29.575 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T22:24:29.575 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T22:24:29.575 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T22:24:29.575 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T22:24:29.575 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T22:24:29.576 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T22:24:29.576 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T22:24:29.576 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T22:24:29.576 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T22:24:29.576 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-10T22:24:29.576 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T22:24:29.576 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T22:24:29.576 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-10T22:24:29.576 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T22:24:29.577 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T22:24:29.577 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T22:24:29.577 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T22:24:29.577 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T22:24:29.577 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T22:24:29.577 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T22:24:29.577 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T22:24:29.577 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T22:24:29.577 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T22:24:29.577 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T22:24:29.577 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T22:24:29.578 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T22:24:29.578 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T22:24:29.578 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T22:24:29.578 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T22:24:29.578 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T22:24:29.578 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T22:24:29.578 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-10T22:24:29.578 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T22:24:29.578 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T22:24:29.578 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-10T22:24:29.578 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T22:24:29.578 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-10T22:24:29.579 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T22:24:29.579 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T22:24:29.579 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T22:24:29.579 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T22:24:29.579 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T22:24:29.579 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T22:24:29.579 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T22:24:29.579 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T22:24:29.580 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T22:24:29.580 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T22:24:29.580 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T22:24:29.580 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T22:24:29.580 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T22:24:29.580 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T22:24:29.580 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T22:24:29.580 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-10T22:24:29.580 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T22:24:29.580 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T22:24:29.580 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T22:24:29.581 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-10T22:24:29.581 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-10T22:24:29.581 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T22:24:29.581 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T22:24:29.581 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T22:24:29.581 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T22:24:29.581 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-10T22:24:29.581 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T22:24:29.581 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T22:24:29.581 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T22:24:29.581 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T22:24:29.582 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-10T22:24:29.582 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-10T22:24:29.582 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-10T22:24:29.582 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-10T22:24:29.582 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-10T22:24:29.582 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-10T22:24:29.582 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-10T22:24:29.582 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T22:24:29.582 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-10T22:24:29.582 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-10T22:24:29.582 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-10T22:24:29.583 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-10T22:24:29.583 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-10T22:24:29.583 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-10T22:24:29.583 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T22:24:29.583 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-10T22:24:29.583 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-10T22:24:29.583 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-10T22:24:29.583 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-10T22:24:29.583 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-10T22:24:29.583 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-10T22:24:29.583 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T22:24:29.584 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-10T22:24:29.584 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-10T22:24:29.584 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-10T22:24:29.584 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T22:24:29.584 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T22:24:29.584 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-10T22:24:29.584 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-10T22:24:29.584 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-10T22:24:29.584 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T22:24:29.584 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T22:24:29.584 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T22:24:29.585 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T22:24:29.585 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T22:24:29.585 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T22:24:29.585 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T22:24:29.585 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T22:24:29.585 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T22:24:29.585 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T22:24:29.585 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T22:24:29.585 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T22:24:29.585 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-10T22:24:29.586 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-10T22:24:29.586 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-10T22:24:29.586 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T22:24:29.586 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T22:24:29.586 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-10T22:24:29.586 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-10T22:24:29.586 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-10T22:24:29.586 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-10T22:24:29.586 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-10T22:24:29.586 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-10T22:24:29.586 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T22:24:29.587 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T22:24:29.587 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T22:24:29.587 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T22:24:29.587 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T22:24:29.587 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T22:24:29.587 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T22:24:29.587 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T22:24:29.587 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T22:24:29.587 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T22:24:29.587 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-10T22:24:29.587 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T22:24:29.587 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-10T22:24:29.588 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-10T22:24:29.588 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T22:24:29.588 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-10T22:24:29.588 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-10T22:24:29.588 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T22:24:29.588 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T22:24:29.588 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-10T22:24:29.588 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-10T22:24:29.588 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-10T22:24:29.588 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T22:24:29.588 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-10T22:24:29.589 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T22:24:29.589 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-10T22:24:29.589 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T22:24:29.589 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T22:24:29.589 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-10T22:24:29.589 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T22:24:29.589 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T22:24:29.589 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T22:24:29.589 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T22:24:29.589 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-10T22:24:29.589 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T22:24:29.590 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-10T22:24:29.590 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-10T22:24:29.590 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T22:24:29.590 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-10T22:24:29.590 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T22:24:29.590 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T22:24:29.590 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T22:24:29.590 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-10T22:24:29.590 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T22:24:29.591 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T22:24:29.591 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-10T22:24:29.591 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-10T22:24:29.592 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T22:24:29.592 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-10T22:24:29.592 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-10T22:24:29.592 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T22:24:29.592 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-10T22:24:29.592 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-10T22:24:29.592 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-10T22:24:29.592 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T22:24:29.592 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-10T22:24:29.592 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-10T22:24:29.592 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-10T22:24:29.593 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-10T22:24:29.593 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-10T22:24:29.593 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T22:24:29.593 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-10T22:24:29.593 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-10T22:24:29.593 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T22:24:29.593 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-10T22:24:29.593 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T22:24:29.593 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-10T22:24:29.593 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T22:24:29.593 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-10T22:24:29.594 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T22:24:29.594 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-10T22:24:29.594 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T22:24:29.594 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-10T22:24:29.594 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-10T22:24:29.594 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-10T22:24:29.594 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T22:24:29.594 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-10T22:24:29.594 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T22:24:29.594 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-10T22:24:29.594 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-10T22:24:29.595 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-10T22:24:29.595 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T22:24:29.595 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-10T22:24:29.595 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T22:24:29.595 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-10T22:24:29.595 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-10T22:24:29.595 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-10T22:24:29.595 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T22:24:29.595 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-10T22:24:29.595 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T22:24:29.595 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-10T22:24:29.596 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T22:24:29.596 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-10T22:24:29.596 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T22:24:29.596 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-10T22:24:29.596 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-10T22:24:29.596 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-10T22:24:29.596 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T22:24:29.596 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-10T22:24:29.596 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T22:24:29.596 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-10T22:24:29.596 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T22:24:29.596 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-10T22:24:29.597 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T22:24:29.597 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-10T22:24:29.597 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T22:24:29.597 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-10T22:24:29.597 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-10T22:24:29.597 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T22:24:29.597 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-10T22:24:29.597 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T22:24:29.597 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-10T22:24:29.597 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T22:24:29.597 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T22:24:29.598 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-10T22:24:29.598 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T22:24:29.598 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T22:24:29.598 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-10T22:24:29.598 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T22:24:29.598 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T22:24:29.598 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-10T22:24:29.598 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T22:24:29.598 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-10T22:24:29.598 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T22:24:29.598 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-10T22:24:29.599 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T22:24:29.599 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T22:24:29.599 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T22:24:29.599 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T22:24:29.599 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T22:24:29.599 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T22:24:29.599 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T22:24:29.599 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T22:24:29.599 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T22:24:29.599 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T22:24:29.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T22:24:29.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-10T22:24:29.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T22:24:29.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T22:24:29.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T22:24:29.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T22:24:29.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T22:24:29.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T22:24:29.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T22:24:29.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T22:24:29.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T22:24:29.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T22:24:29.601 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T22:24:29.601 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T22:24:29.601 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T22:24:29.601 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T22:24:29.601 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T22:24:29.601 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T22:24:29.601 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T22:24:29.601 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T22:24:29.601 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T22:24:29.601 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T22:24:29.601 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T22:24:29.602 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T22:24:29.602 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T22:24:29.602 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T22:24:29.602 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T22:24:29.602 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T22:24:29.602 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T22:24:29.602 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T22:24:29.602 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T22:24:29.602 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T22:24:29.602 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T22:24:29.603 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T22:24:29.603 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T22:24:29.603 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T22:24:29.603 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T22:24:29.603 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T22:24:29.603 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T22:24:29.603 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T22:24:29.603 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T22:24:29.603 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-10T22:24:29.603 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-10T22:24:29.603 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-10T22:24:29.604 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-10T22:24:29.604 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T22:24:29.604 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-10T22:24:29.604 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T22:24:29.604 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-10T22:24:29.604 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T22:24:29.604 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T22:24:29.604 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T22:24:29.604 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T22:24:29.604 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T22:24:29.604 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-10T22:24:29.605 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-10T22:24:29.605 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-10T22:24:29.605 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T22:24:29.605 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-10T22:24:29.605 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T22:24:29.605 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-10T22:24:29.605 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-10T22:24:29.605 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-10T22:24:29.605 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-10T22:24:29.605 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-10T22:24:29.605 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-10T22:24:29.606 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-10T22:24:29.606 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-10T22:24:29.606 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-10T22:24:29.606 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T22:24:29.606 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-10T22:24:29.606 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T22:24:29.606 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-10T22:24:29.606 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-10T22:24:29.606 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T22:24:29.606 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-10T22:24:29.606 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T22:24:29.607 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T22:24:29.607 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-10T22:24:29.607 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T22:24:29.607 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-10T22:24:29.607 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T22:24:29.607 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-10T22:24:29.607 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T22:24:29.607 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-10T22:24:29.607 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T22:24:29.607 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-10T22:24:29.607 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T22:24:29.608 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-10T22:24:29.608 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-10T22:24:29.608 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-10T22:24:29.608 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-10T22:24:29.608 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-10T22:24:29.608 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T22:24:29.608 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-10T22:24:29.608 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T22:24:29.608 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-10T22:24:29.608 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T22:24:29.608 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-10T22:24:29.609 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T22:24:29.609 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T22:24:29.609 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-10T22:24:29.609 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T22:24:29.609 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T22:24:29.609 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-10T22:24:29.609 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T22:24:29.609 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T22:24:29.609 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-10T22:24:29.609 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T22:24:29.610 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-10T22:24:29.610 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-10T22:24:29.610 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-10T22:24:29.610 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-10T22:24:29.610 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-10T22:24:29.610 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T22:24:29.610 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-10T22:24:29.610 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-10T22:24:29.610 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T22:24:29.610 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-10T22:24:29.610 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-10T22:24:29.611 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-10T22:24:29.611 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-10T22:24:29.611 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T22:24:29.611 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T22:24:29.611 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T22:24:29.611 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-10T22:24:29.611 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-10T22:24:29.611 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-10T22:24:29.611 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T22:24:29.611 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-10T22:24:29.611 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-10T22:24:29.611 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T22:24:29.612 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T22:24:29.612 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T22:24:29.612 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T22:24:29.612 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T22:24:29.612 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T22:24:29.612 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T22:24:29.612 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T22:24:29.612 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-10T22:24:29.612 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T22:24:29.612 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T22:24:29.612 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T22:24:29.613 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T22:24:29.613 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T22:24:29.613 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-10T22:24:29.613 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T22:24:29.613 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-10T22:24:29.613 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T22:24:29.613 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T22:24:29.613 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T22:24:29.613 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T22:24:29.613 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-10T22:24:29.613 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T22:24:29.613 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-10T22:24:29.614 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T22:24:29.614 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T22:24:29.614 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-10T22:24:29.614 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T22:24:29.614 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T22:24:29.614 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T22:24:29.614 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T22:24:29.614 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T22:24:29.614 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T22:24:29.614 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T22:24:29.614 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T22:24:29.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T22:24:29.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T22:24:29.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T22:24:29.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T22:24:29.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T22:24:29.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T22:24:29.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T22:24:29.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T22:24:29.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T22:24:29.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T22:24:29.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T22:24:29.616 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T22:24:29.616 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T22:24:29.616 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T22:24:29.616 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T22:24:29.616 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-10T22:24:29.616 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T22:24:29.616 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-10T22:24:29.616 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T22:24:29.616 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-10T22:24:29.616 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T22:24:29.617 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T22:24:29.617 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T22:24:29.617 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T22:24:29.617 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-10T22:24:29.617 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T22:24:29.617 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T22:24:29.617 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T22:24:29.617 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T22:24:29.617 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T22:24:29.617 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-10T22:24:29.617 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-10T22:24:29.617 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-10T22:24:29.618 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-10T22:24:29.618 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T22:24:29.618 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T22:24:29.618 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T22:24:29.618 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-10T22:24:29.618 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T22:24:29.618 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T22:24:29.618 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T22:24:29.618 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T22:24:29.618 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T22:24:29.618 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T22:24:29.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T22:24:29.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T22:24:29.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T22:24:29.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T22:24:29.619 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-10T22:24:29.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T22:24:29.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T22:24:29.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T22:24:29.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-10T22:24:29.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T22:24:29.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-10T22:24:29.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T22:24:29.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T22:24:29.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T22:24:29.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-10T22:24:29.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T22:24:29.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T22:24:29.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T22:24:29.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T22:24:29.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T22:24:29.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T22:24:29.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T22:24:29.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T22:24:29.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T22:24:29.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-10T22:24:29.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T22:24:29.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T22:24:29.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T22:24:29.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T22:24:29.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T22:24:29.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T22:24:29.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T22:24:29.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T22:24:29.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T22:24:29.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T22:24:29.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T22:24:29.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T22:24:29.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T22:24:29.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T22:24:29.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T22:24:29.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T22:24:29.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T22:24:29.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T22:24:29.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T22:24:29.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T22:24:29.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T22:24:29.623 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T22:24:29.623 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-10T22:24:29.623 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T22:24:29.623 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T22:24:29.623 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T22:24:29.623 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-10T22:24:29.623 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T22:24:29.623 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T22:24:29.623 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T22:24:29.623 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T22:24:29.623 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-10T22:24:29.623 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-10T22:24:29.624 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T22:24:29.624 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-10T22:24:29.624 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T22:24:29.624 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T22:24:29.624 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T22:24:29.624 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T22:24:29.624 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T22:24:29.624 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T22:24:29.624 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T22:24:29.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T22:24:29.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T22:24:29.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T22:24:29.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T22:24:29.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T22:24:29.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T22:24:29.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T22:24:29.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T22:24:29.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T22:24:29.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T22:24:29.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T22:24:29.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T22:24:29.626 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T22:24:29.626 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T22:24:29.626 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T22:24:29.626 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T22:24:29.626 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T22:24:29.626 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T22:24:29.626 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T22:24:29.626 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-10T22:24:29.626 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T22:24:29.626 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-10T22:24:29.626 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T22:24:29.626 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T22:24:29.627 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T22:24:29.627 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T22:24:29.627 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T22:24:29.627 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T22:24:29.627 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T22:24:29.627 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-10T22:24:29.627 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-10T22:24:29.627 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-10T22:24:29.627 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T22:24:29.627 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-10T22:24:29.627 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-10T22:24:29.628 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T22:24:29.628 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-10T22:24:29.628 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T22:24:29.628 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-10T22:24:29.628 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-10T22:24:29.628 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T22:24:29.628 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T22:24:29.628 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T22:24:29.628 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T22:24:29.628 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T22:24:29.628 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T22:24:29.629 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T22:24:29.629 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T22:24:29.629 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T22:24:29.629 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T22:24:29.629 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T22:24:29.629 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T22:24:29.629 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T22:24:29.629 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T22:24:29.629 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T22:24:29.629 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T22:24:29.629 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-10T22:24:29.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T22:24:29.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T22:24:29.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T22:24:29.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T22:24:29.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T22:24:29.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T22:24:29.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T22:24:29.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T22:24:29.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T22:24:29.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T22:24:29.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T22:24:29.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T22:24:29.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T22:24:29.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T22:24:29.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T22:24:29.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T22:24:29.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T22:24:29.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T22:24:29.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T22:24:29.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T22:24:29.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T22:24:29.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T22:24:29.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T22:24:29.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T22:24:29.632 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T22:24:29.632 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T22:24:29.632 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T22:24:29.632 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T22:24:29.632 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T22:24:29.632 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T22:24:29.632 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T22:24:29.632 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T22:24:29.632 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T22:24:29.632 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T22:24:29.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T22:24:29.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T22:24:29.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T22:24:29.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T22:24:29.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T22:24:29.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T22:24:29.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T22:24:29.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T22:24:29.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-10T22:24:29.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T22:24:29.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T22:24:29.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T22:24:29.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T22:24:29.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T22:24:29.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T22:24:29.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T22:24:29.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T22:24:29.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T22:24:29.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T22:24:29.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T22:24:29.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T22:24:29.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T22:24:29.635 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T22:24:29.635 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T22:24:29.635 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-10T22:24:29.635 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T22:24:29.635 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T22:24:29.635 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T22:24:29.635 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T22:24:29.635 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T22:24:29.635 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-10T22:24:29.635 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-10T22:24:29.635 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-10T22:24:29.636 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T22:24:29.636 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T22:24:29.636 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T22:24:29.636 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T22:24:29.636 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T22:24:29.636 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T22:24:29.636 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T22:24:29.636 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T22:24:29.636 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T22:24:29.636 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T22:24:29.636 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T22:24:29.636 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T22:24:29.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T22:24:29.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T22:24:29.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T22:24:29.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T22:24:29.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T22:24:29.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T22:24:29.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T22:24:29.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T22:24:29.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T22:24:29.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T22:24:29.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T22:24:29.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T22:24:29.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T22:24:29.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T22:24:29.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T22:24:29.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T22:24:29.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T22:24:29.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T22:24:29.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T22:24:29.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T22:24:29.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T22:24:29.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T22:24:29.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T22:24:29.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T22:24:29.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T22:24:29.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T22:24:29.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T22:24:29.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T22:24:29.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T22:24:29.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T22:24:29.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T22:24:29.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T22:24:29.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T22:24:29.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T22:24:29.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T22:24:29.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T22:24:29.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T22:24:29.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T22:24:29.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T22:24:29.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T22:24:29.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T22:24:29.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T22:24:29.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T22:24:29.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T22:24:29.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T22:24:29.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T22:24:29.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T22:24:29.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T22:24:29.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T22:24:29.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T22:24:29.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T22:24:29.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T22:24:29.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T22:24:29.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T22:24:29.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T22:24:29.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T22:24:29.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T22:24:29.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-10T22:24:29.642 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T22:24:29.642 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T22:24:29.642 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-10T22:24:29.642 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T22:24:29.642 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-10T22:24:29.642 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T22:24:29.642 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-10T22:24:29.642 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T22:24:29.642 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T22:24:29.642 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T22:24:29.642 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T22:24:29.643 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-10T22:24:29.643 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T22:24:29.643 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-10T22:24:29.643 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-10T22:24:29.643 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-10T22:24:29.643 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-10T22:24:29.643 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T22:24:29.643 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T22:24:29.643 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T22:24:29.643 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-10T22:24:29.643 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-10T22:24:29.643 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-10T22:24:29.644 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T22:24:29.644 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T22:24:29.644 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T22:24:29.644 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T22:24:29.644 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T22:24:29.644 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T22:24:29.644 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T22:24:29.644 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T22:24:29.644 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T22:24:29.644 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T22:24:29.644 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T22:24:29.644 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-10T22:24:29.645 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T22:24:29.645 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T22:24:29.645 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T22:24:29.645 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T22:24:29.645 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T22:24:29.645 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T22:24:29.645 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T22:24:29.645 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T22:24:29.645 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T22:24:29.645 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T22:24:29.645 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T22:24:29.646 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T22:24:29.646 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T22:24:29.646 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T22:24:29.646 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-10T22:24:29.646 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T22:24:29.646 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T22:24:29.646 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T22:24:29.646 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T22:24:29.646 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T22:24:29.646 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T22:24:29.647 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T22:24:29.647 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T22:24:29.647 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T22:24:29.647 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T22:24:29.647 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T22:24:29.647 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T22:24:29.647 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T22:24:29.647 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T22:24:29.647 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T22:24:29.647 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T22:24:29.647 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T22:24:29.648 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T22:24:29.648 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-10T22:24:29.648 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T22:24:29.648 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T22:24:29.648 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-10T22:24:29.648 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-10T22:24:29.648 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T22:24:29.648 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T22:24:29.648 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T22:24:29.648 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-10T22:24:29.648 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T22:24:29.649 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-10T22:24:29.649 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T22:24:29.649 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T22:24:29.649 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-10T22:24:29.649 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T22:24:29.649 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-10T22:24:29.649 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T22:24:29.649 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T22:24:29.649 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T22:24:29.649 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T22:24:29.650 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T22:24:29.650 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-10T22:24:29.650 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-10T22:24:29.650 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-10T22:24:29.650 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-10T22:24:29.650 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T22:24:29.650 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-10T22:24:29.650 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T22:24:29.650 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T22:24:29.650 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T22:24:29.650 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T22:24:29.651 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T22:24:29.651 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T22:24:29.651 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T22:24:29.651 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T22:24:29.651 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T22:24:29.651 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T22:24:29.651 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T22:24:29.651 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T22:24:29.651 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T22:24:29.651 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-10T22:24:29.652 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-10T22:24:29.652 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-10T22:24:29.652 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-10T22:24:29.652 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-10T22:24:29.652 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-10T22:24:29.657 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:29.657 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:29.657 DEBUG:teuthology.orchestra.run.smithi103:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-10T22:24:29.659 INFO:teuthology.orchestra.run.smithi131.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:29.659 INFO:teuthology.orchestra.run.smithi131.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:29.664 INFO:teuthology.orchestra.run.smithi103.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-10T22:24:29.664 INFO:teuthology.orchestra.run.smithi103.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-10T22:24:29.665 INFO:teuthology.orchestra.run.smithi103.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-10T22:24:29.665 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-10T22:24:29.665 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:29.665 DEBUG:teuthology.orchestra.run.smithi103:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-10T22:24:29.707 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi103.front.sepia.ceph.com to complete... 2024-09-10T22:24:29.920 INFO:teuthology.orchestra.run.smithi131.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T22:24:29.935 INFO:teuthology.orchestra.run.smithi131.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T22:24:29.999 INFO:teuthology.orchestra.run.smithi131.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T22:24:30.004 INFO:teuthology.orchestra.run.smithi131.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T22:24:30.052 INFO:teuthology.orchestra.run.smithi103.stderr:Sourcing file `/etc/default/grub' 2024-09-10T22:24:30.053 INFO:teuthology.orchestra.run.smithi103.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T22:24:30.075 INFO:teuthology.orchestra.run.smithi103.stderr:Generating grub configuration file ... 2024-09-10T22:24:30.145 INFO:teuthology.orchestra.run.smithi131.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T22:24:30.145 INFO:teuthology.orchestra.run.smithi131.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T22:24:30.146 INFO:teuthology.orchestra.run.smithi131.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T22:24:30.191 INFO:teuthology.orchestra.run.smithi131.stderr:done 2024-09-10T22:24:30.309 INFO:teuthology.orchestra.run.smithi103.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:30.315 INFO:teuthology.orchestra.run.smithi103.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:30.403 DEBUG:teuthology.orchestra.run.smithi131:> dpkg-deb -c /tmp/linux-image.deb 2024-09-10T22:24:30.411 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-10T22:24:30.411 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-10T22:24:30.411 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:30.429 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:30.429 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:30.455 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-10T22:24:30.455 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-10T22:24:30.455 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-10T22:24:30.455 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-10T22:24:30.455 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-10T22:24:30.455 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-10T22:24:30.455 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-10T22:24:30.455 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-10T22:24:30.456 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-10T22:24:30.456 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-10T22:24:30.456 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-10T22:24:30.456 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-10T22:24:30.456 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-10T22:24:30.456 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-10T22:24:30.456 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T22:24:30.456 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T22:24:30.456 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T22:24:30.456 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T22:24:30.457 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T22:24:30.457 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T22:24:30.457 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T22:24:30.457 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T22:24:30.457 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T22:24:30.457 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T22:24:30.457 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T22:24:30.457 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T22:24:30.457 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T22:24:30.457 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T22:24:30.457 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T22:24:30.458 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T22:24:30.458 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T22:24:30.458 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T22:24:30.458 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T22:24:30.458 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-10T22:24:30.458 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-10T22:24:30.458 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-10T22:24:30.458 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T22:24:30.458 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-10T22:24:30.458 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-10T22:24:30.458 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-10T22:24:30.458 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T22:24:30.459 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T22:24:30.459 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T22:24:30.542 INFO:teuthology.orchestra.run.smithi103.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T22:24:30.548 INFO:teuthology.orchestra.run.smithi103.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T22:24:30.554 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-10T22:24:30.555 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-10T22:24:30.555 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-10T22:24:30.555 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-10T22:24:30.555 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T22:24:30.555 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T22:24:30.555 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T22:24:30.555 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-10T22:24:30.555 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-10T22:24:30.555 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-10T22:24:30.555 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T22:24:30.556 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T22:24:30.556 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T22:24:30.556 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T22:24:30.556 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T22:24:30.556 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T22:24:30.556 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T22:24:30.556 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T22:24:30.556 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T22:24:30.556 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T22:24:30.556 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T22:24:30.556 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T22:24:30.557 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T22:24:30.557 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T22:24:30.557 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T22:24:30.557 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T22:24:30.557 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T22:24:30.557 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T22:24:30.557 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-10T22:24:30.557 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T22:24:30.557 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-10T22:24:30.557 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T22:24:30.557 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T22:24:30.558 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T22:24:30.558 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T22:24:30.558 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T22:24:30.558 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T22:24:30.558 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T22:24:30.558 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T22:24:30.558 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-10T22:24:30.558 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T22:24:30.558 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T22:24:30.558 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T22:24:30.558 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T22:24:30.559 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T22:24:30.559 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T22:24:30.559 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T22:24:30.559 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T22:24:30.559 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T22:24:30.559 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T22:24:30.559 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T22:24:30.559 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T22:24:30.559 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T22:24:30.559 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T22:24:30.560 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T22:24:30.560 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T22:24:30.560 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T22:24:30.560 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-10T22:24:30.560 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T22:24:30.560 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-10T22:24:30.560 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-10T22:24:30.560 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-10T22:24:30.560 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T22:24:30.560 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T22:24:30.560 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-10T22:24:30.561 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-10T22:24:30.561 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T22:24:30.561 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T22:24:30.561 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T22:24:30.561 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T22:24:30.561 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T22:24:30.561 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-10T22:24:30.561 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T22:24:30.561 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-10T22:24:30.561 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T22:24:30.562 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-10T22:24:30.562 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T22:24:30.562 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T22:24:30.562 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T22:24:30.562 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T22:24:30.562 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T22:24:30.562 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T22:24:30.562 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T22:24:30.562 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T22:24:30.562 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T22:24:30.562 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T22:24:30.563 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T22:24:30.563 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T22:24:30.563 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T22:24:30.563 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T22:24:30.563 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T22:24:30.563 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T22:24:30.563 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T22:24:30.563 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T22:24:30.563 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-10T22:24:30.564 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T22:24:30.564 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T22:24:30.564 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T22:24:30.564 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T22:24:30.564 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T22:24:30.564 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T22:24:30.564 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T22:24:30.564 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T22:24:30.564 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T22:24:30.565 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T22:24:30.565 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T22:24:30.565 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T22:24:30.565 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T22:24:30.565 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-10T22:24:30.565 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T22:24:30.565 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-10T22:24:30.565 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T22:24:30.566 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T22:24:30.566 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T22:24:30.566 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T22:24:30.566 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T22:24:30.566 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T22:24:30.566 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T22:24:30.566 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T22:24:30.566 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T22:24:30.566 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T22:24:30.566 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T22:24:30.567 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T22:24:30.567 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T22:24:30.567 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T22:24:30.567 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T22:24:30.567 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T22:24:30.567 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T22:24:30.567 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T22:24:30.567 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T22:24:30.567 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T22:24:30.567 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-10T22:24:30.568 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T22:24:30.568 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-10T22:24:30.568 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T22:24:30.568 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-10T22:24:30.568 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-10T22:24:30.568 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T22:24:30.568 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-10T22:24:30.568 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T22:24:30.568 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T22:24:30.568 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-10T22:24:30.569 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T22:24:30.569 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T22:24:30.569 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-10T22:24:30.569 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T22:24:30.569 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T22:24:30.569 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T22:24:30.569 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-10T22:24:30.569 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T22:24:30.569 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-10T22:24:30.569 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T22:24:30.569 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-10T22:24:30.570 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-10T22:24:30.570 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T22:24:30.570 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-10T22:24:30.570 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T22:24:30.570 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T22:24:30.570 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T22:24:30.570 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T22:24:30.570 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T22:24:30.570 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-10T22:24:30.570 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T22:24:30.570 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T22:24:30.571 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T22:24:30.571 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T22:24:30.571 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T22:24:30.571 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T22:24:30.571 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T22:24:30.571 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-10T22:24:30.571 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T22:24:30.571 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-10T22:24:30.571 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T22:24:30.571 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T22:24:30.572 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-10T22:24:30.572 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T22:24:30.572 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-10T22:24:30.572 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-10T22:24:30.572 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-10T22:24:30.572 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T22:24:30.572 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T22:24:30.572 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-10T22:24:30.572 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-10T22:24:30.572 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-10T22:24:30.573 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-10T22:24:30.573 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-10T22:24:30.573 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-10T22:24:30.573 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-10T22:24:30.573 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-10T22:24:30.573 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-10T22:24:30.573 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-10T22:24:30.573 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-10T22:24:30.573 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T22:24:30.573 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T22:24:30.573 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T22:24:30.574 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-10T22:24:30.574 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-10T22:24:30.574 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T22:24:30.574 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T22:24:30.574 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-10T22:24:30.574 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-10T22:24:30.574 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-10T22:24:30.574 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T22:24:30.574 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-10T22:24:30.574 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T22:24:30.575 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T22:24:30.575 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T22:24:30.575 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-10T22:24:30.575 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T22:24:30.575 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-10T22:24:30.575 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T22:24:30.575 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-10T22:24:30.575 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-10T22:24:30.575 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T22:24:30.575 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-10T22:24:30.575 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T22:24:30.576 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-10T22:24:30.576 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T22:24:30.576 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T22:24:30.576 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T22:24:30.576 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T22:24:30.576 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T22:24:30.576 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T22:24:30.576 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T22:24:30.576 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T22:24:30.576 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T22:24:30.577 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T22:24:30.577 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T22:24:30.577 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T22:24:30.577 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T22:24:30.577 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-10T22:24:30.577 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-10T22:24:30.577 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-10T22:24:30.577 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-10T22:24:30.577 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-10T22:24:30.577 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-10T22:24:30.578 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-10T22:24:30.578 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-10T22:24:30.578 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-10T22:24:30.578 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-10T22:24:30.578 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-10T22:24:30.578 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-10T22:24:30.578 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T22:24:30.578 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-10T22:24:30.578 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-10T22:24:30.578 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-10T22:24:30.578 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-10T22:24:30.579 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-10T22:24:30.579 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-10T22:24:30.579 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-10T22:24:30.579 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-10T22:24:30.579 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-10T22:24:30.579 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T22:24:30.579 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-10T22:24:30.579 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-10T22:24:30.579 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-10T22:24:30.579 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-10T22:24:30.579 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-10T22:24:30.580 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-10T22:24:30.580 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-10T22:24:30.580 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-10T22:24:30.580 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-10T22:24:30.580 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-10T22:24:30.580 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-10T22:24:30.580 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-10T22:24:30.580 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-10T22:24:30.580 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-10T22:24:30.580 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-10T22:24:30.581 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T22:24:30.581 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-10T22:24:30.581 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-10T22:24:30.581 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-10T22:24:30.581 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-10T22:24:30.581 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-10T22:24:30.581 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-10T22:24:30.581 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-10T22:24:30.581 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T22:24:30.581 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T22:24:30.581 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T22:24:30.582 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-10T22:24:30.582 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-10T22:24:30.582 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-10T22:24:30.582 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-10T22:24:30.582 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-10T22:24:30.582 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T22:24:30.582 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T22:24:30.582 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T22:24:30.582 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T22:24:30.582 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-10T22:24:30.582 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T22:24:30.583 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-10T22:24:30.583 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T22:24:30.583 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T22:24:30.583 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T22:24:30.583 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T22:24:30.583 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T22:24:30.583 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T22:24:30.583 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T22:24:30.583 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-10T22:24:30.583 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T22:24:30.584 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T22:24:30.584 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T22:24:30.584 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T22:24:30.584 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T22:24:30.584 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-10T22:24:30.584 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T22:24:30.584 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T22:24:30.584 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-10T22:24:30.585 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-10T22:24:30.585 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-10T22:24:30.585 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-10T22:24:30.585 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T22:24:30.585 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-10T22:24:30.585 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T22:24:30.585 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T22:24:30.585 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T22:24:30.585 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T22:24:30.586 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T22:24:30.586 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T22:24:30.586 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T22:24:30.586 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T22:24:30.586 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T22:24:30.586 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T22:24:30.586 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T22:24:30.586 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T22:24:30.586 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T22:24:30.586 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T22:24:30.586 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T22:24:30.586 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T22:24:30.587 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T22:24:30.587 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T22:24:30.587 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T22:24:30.587 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T22:24:30.587 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T22:24:30.587 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T22:24:30.587 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T22:24:30.587 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T22:24:30.587 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T22:24:30.587 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T22:24:30.588 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T22:24:30.588 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T22:24:30.588 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T22:24:30.588 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T22:24:30.588 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T22:24:30.588 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T22:24:30.588 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T22:24:30.588 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T22:24:30.588 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T22:24:30.588 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T22:24:30.589 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T22:24:30.589 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T22:24:30.589 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T22:24:30.589 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-10T22:24:30.589 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T22:24:30.589 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-10T22:24:30.589 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-10T22:24:30.589 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-10T22:24:30.589 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-10T22:24:30.589 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T22:24:30.589 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-10T22:24:30.589 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T22:24:30.590 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T22:24:30.590 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T22:24:30.590 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-10T22:24:30.590 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T22:24:30.590 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T22:24:30.590 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T22:24:30.590 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T22:24:30.590 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T22:24:30.590 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T22:24:30.590 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T22:24:30.591 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T22:24:30.591 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T22:24:30.591 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T22:24:30.591 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T22:24:30.591 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T22:24:30.591 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T22:24:30.591 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T22:24:30.591 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T22:24:30.591 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T22:24:30.591 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T22:24:30.592 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T22:24:30.592 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T22:24:30.592 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T22:24:30.592 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T22:24:30.592 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T22:24:30.592 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T22:24:30.592 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T22:24:30.592 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T22:24:30.592 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-10T22:24:30.592 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-10T22:24:30.592 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-10T22:24:30.592 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T22:24:30.593 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T22:24:30.593 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T22:24:30.593 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T22:24:30.593 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T22:24:30.593 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-10T22:24:30.593 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T22:24:30.593 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T22:24:30.593 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T22:24:30.593 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T22:24:30.593 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T22:24:30.593 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T22:24:30.594 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T22:24:30.594 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T22:24:30.594 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T22:24:30.594 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T22:24:30.594 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-10T22:24:30.594 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T22:24:30.594 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T22:24:30.594 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T22:24:30.594 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T22:24:30.594 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T22:24:30.594 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T22:24:30.595 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T22:24:30.595 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T22:24:30.595 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-10T22:24:30.595 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T22:24:30.595 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T22:24:30.595 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T22:24:30.595 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T22:24:30.595 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T22:24:30.595 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T22:24:30.595 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T22:24:30.595 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T22:24:30.595 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T22:24:30.596 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T22:24:30.596 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T22:24:30.596 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T22:24:30.596 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T22:24:30.596 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T22:24:30.596 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T22:24:30.596 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T22:24:30.596 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T22:24:30.596 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T22:24:30.596 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T22:24:30.596 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T22:24:30.597 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T22:24:30.597 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T22:24:30.597 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T22:24:30.597 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T22:24:30.597 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T22:24:30.597 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T22:24:30.597 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T22:24:30.597 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T22:24:30.597 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T22:24:30.597 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T22:24:30.598 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T22:24:30.598 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T22:24:30.598 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-10T22:24:30.598 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T22:24:30.598 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-10T22:24:30.598 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T22:24:30.598 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T22:24:30.598 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T22:24:30.598 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T22:24:30.598 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T22:24:30.598 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T22:24:30.599 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T22:24:30.599 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-10T22:24:30.599 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T22:24:30.599 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T22:24:30.599 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T22:24:30.599 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T22:24:30.599 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T22:24:30.599 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T22:24:30.599 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T22:24:30.599 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T22:24:30.599 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T22:24:30.600 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T22:24:30.600 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T22:24:30.600 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T22:24:30.600 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T22:24:30.600 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T22:24:30.600 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T22:24:30.600 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T22:24:30.600 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T22:24:30.600 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T22:24:30.600 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T22:24:30.601 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T22:24:30.601 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T22:24:30.601 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T22:24:30.601 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T22:24:30.601 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T22:24:30.601 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T22:24:30.601 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T22:24:30.601 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T22:24:30.601 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T22:24:30.601 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T22:24:30.602 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T22:24:30.602 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T22:24:30.602 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T22:24:30.602 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T22:24:30.602 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T22:24:30.602 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T22:24:30.602 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T22:24:30.602 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T22:24:30.602 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T22:24:30.602 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T22:24:30.602 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T22:24:30.602 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T22:24:30.603 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-10T22:24:30.603 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-10T22:24:30.603 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-10T22:24:30.603 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-10T22:24:30.603 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T22:24:30.603 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T22:24:30.603 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-10T22:24:30.603 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-10T22:24:30.603 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-10T22:24:30.603 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-10T22:24:30.603 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T22:24:30.604 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T22:24:30.604 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T22:24:30.604 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-10T22:24:30.604 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T22:24:30.604 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-10T22:24:30.604 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T22:24:30.604 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T22:24:30.604 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T22:24:30.604 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T22:24:30.604 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-10T22:24:30.605 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-10T22:24:30.605 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T22:24:30.605 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T22:24:30.605 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T22:24:30.605 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-10T22:24:30.605 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T22:24:30.605 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T22:24:30.605 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-10T22:24:30.605 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T22:24:30.605 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T22:24:30.605 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T22:24:30.605 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-10T22:24:30.606 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T22:24:30.606 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T22:24:30.606 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-10T22:24:30.606 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-10T22:24:30.606 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T22:24:30.606 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-10T22:24:30.606 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T22:24:30.606 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T22:24:30.606 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T22:24:30.606 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T22:24:30.606 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-10T22:24:30.607 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T22:24:30.607 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T22:24:30.607 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T22:24:30.607 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-10T22:24:30.607 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-10T22:24:30.607 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-10T22:24:30.607 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-10T22:24:30.607 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-10T22:24:30.607 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-10T22:24:30.607 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T22:24:30.607 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T22:24:30.607 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T22:24:30.608 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T22:24:30.608 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T22:24:30.608 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T22:24:30.608 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T22:24:30.608 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-10T22:24:30.608 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-10T22:24:30.608 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T22:24:30.608 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-10T22:24:30.608 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T22:24:30.608 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-10T22:24:30.609 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T22:24:30.609 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-10T22:24:30.609 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T22:24:30.609 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-10T22:24:30.609 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-10T22:24:30.609 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-10T22:24:30.609 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-10T22:24:30.609 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-10T22:24:30.609 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-10T22:24:30.609 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T22:24:30.609 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-10T22:24:30.610 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T22:24:30.610 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-10T22:24:30.610 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T22:24:30.610 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-10T22:24:30.610 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T22:24:30.610 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-10T22:24:30.610 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T22:24:30.610 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-10T22:24:30.610 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-10T22:24:30.610 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-10T22:24:30.611 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-10T22:24:30.611 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T22:24:30.611 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T22:24:30.611 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T22:24:30.611 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T22:24:30.611 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-10T22:24:30.611 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-10T22:24:30.611 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-10T22:24:30.611 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-10T22:24:30.611 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-10T22:24:30.611 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T22:24:30.611 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-10T22:24:30.612 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-10T22:24:30.612 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-10T22:24:30.612 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-10T22:24:30.612 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-10T22:24:30.612 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-10T22:24:30.612 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-10T22:24:30.612 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-10T22:24:30.612 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-10T22:24:30.612 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-10T22:24:30.612 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-10T22:24:30.612 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-10T22:24:30.613 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-10T22:24:30.613 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-10T22:24:30.613 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-10T22:24:30.613 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-10T22:24:30.613 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-10T22:24:30.613 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-10T22:24:30.613 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-10T22:24:30.613 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-10T22:24:30.613 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-10T22:24:30.614 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T22:24:30.614 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T22:24:30.614 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T22:24:30.614 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T22:24:30.614 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-10T22:24:30.614 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-10T22:24:30.614 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T22:24:30.614 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T22:24:30.614 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T22:24:30.614 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T22:24:30.615 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-10T22:24:30.615 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T22:24:30.615 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-10T22:24:30.615 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T22:24:30.615 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T22:24:30.615 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-10T22:24:30.615 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T22:24:30.615 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-10T22:24:30.615 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-10T22:24:30.616 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-10T22:24:30.616 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T22:24:30.616 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-10T22:24:30.616 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T22:24:30.616 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-10T22:24:30.616 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-10T22:24:30.616 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-10T22:24:30.616 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-10T22:24:30.616 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T22:24:30.617 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-10T22:24:30.617 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-10T22:24:30.617 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-10T22:24:30.617 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T22:24:30.617 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-10T22:24:30.617 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-10T22:24:30.617 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-10T22:24:30.617 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T22:24:30.617 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-10T22:24:30.617 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-10T22:24:30.617 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-10T22:24:30.617 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-10T22:24:30.618 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-10T22:24:30.618 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-10T22:24:30.618 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-10T22:24:30.618 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T22:24:30.618 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-10T22:24:30.618 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-10T22:24:30.618 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-10T22:24:30.618 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-10T22:24:30.618 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T22:24:30.619 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T22:24:30.619 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T22:24:30.619 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T22:24:30.619 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T22:24:30.619 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T22:24:30.619 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T22:24:30.619 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T22:24:30.619 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-10T22:24:30.619 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-10T22:24:30.619 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T22:24:30.619 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T22:24:30.619 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-10T22:24:30.620 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T22:24:30.620 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T22:24:30.620 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T22:24:30.620 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T22:24:30.620 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-10T22:24:30.620 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T22:24:30.620 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T22:24:30.620 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-10T22:24:30.620 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-10T22:24:30.620 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T22:24:30.620 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T22:24:30.621 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T22:24:30.621 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-10T22:24:30.621 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T22:24:30.621 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T22:24:30.621 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-10T22:24:30.621 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T22:24:30.621 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T22:24:30.621 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T22:24:30.621 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-10T22:24:30.621 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-10T22:24:30.621 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T22:24:30.622 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T22:24:30.622 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T22:24:30.622 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T22:24:30.622 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T22:24:30.622 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-10T22:24:30.622 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-10T22:24:30.622 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T22:24:30.622 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T22:24:30.622 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T22:24:30.622 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T22:24:30.622 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T22:24:30.623 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T22:24:30.623 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T22:24:30.623 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-10T22:24:30.623 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-10T22:24:30.623 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-10T22:24:30.623 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-10T22:24:30.623 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-10T22:24:30.623 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-10T22:24:30.623 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-10T22:24:30.623 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-10T22:24:30.623 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-10T22:24:30.623 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-10T22:24:30.624 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-10T22:24:30.624 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-10T22:24:30.624 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-10T22:24:30.624 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-10T22:24:30.624 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T22:24:30.624 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T22:24:30.624 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-10T22:24:30.624 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-10T22:24:30.624 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-10T22:24:30.624 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-10T22:24:30.625 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-10T22:24:30.625 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-10T22:24:30.625 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-10T22:24:30.625 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-10T22:24:30.625 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-10T22:24:30.625 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-10T22:24:30.625 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T22:24:30.625 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-10T22:24:30.625 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-10T22:24:30.626 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T22:24:30.626 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T22:24:30.626 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T22:24:30.626 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-10T22:24:30.626 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-10T22:24:30.626 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-10T22:24:30.626 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-10T22:24:30.626 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-10T22:24:30.626 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T22:24:30.626 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T22:24:30.627 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T22:24:30.627 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T22:24:30.627 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-10T22:24:30.627 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-10T22:24:30.627 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-10T22:24:30.627 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-10T22:24:30.627 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T22:24:30.627 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-10T22:24:30.627 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-10T22:24:30.627 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-10T22:24:30.627 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-10T22:24:30.628 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-10T22:24:30.628 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T22:24:30.628 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T22:24:30.628 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T22:24:30.628 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T22:24:30.628 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-10T22:24:30.628 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-10T22:24:30.628 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-10T22:24:30.628 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T22:24:30.628 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-10T22:24:30.628 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-10T22:24:30.629 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-10T22:24:30.629 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T22:24:30.629 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T22:24:30.629 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-10T22:24:30.629 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T22:24:30.629 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T22:24:30.629 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-10T22:24:30.629 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T22:24:30.629 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T22:24:30.629 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T22:24:30.630 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-10T22:24:30.630 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-10T22:24:30.630 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-10T22:24:30.630 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T22:24:30.630 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T22:24:30.630 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T22:24:30.630 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T22:24:30.630 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-10T22:24:30.630 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T22:24:30.631 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-10T22:24:30.631 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-10T22:24:30.631 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T22:24:30.631 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-10T22:24:30.631 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-10T22:24:30.631 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T22:24:30.631 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T22:24:30.631 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T22:24:30.631 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-10T22:24:30.631 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T22:24:30.631 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T22:24:30.631 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T22:24:30.632 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-10T22:24:30.632 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-10T22:24:30.632 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T22:24:30.632 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T22:24:30.632 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T22:24:30.632 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T22:24:30.632 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-10T22:24:30.632 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T22:24:30.632 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T22:24:30.632 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T22:24:30.632 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T22:24:30.633 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-10T22:24:30.633 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T22:24:30.633 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-10T22:24:30.633 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T22:24:30.633 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-10T22:24:30.633 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T22:24:30.633 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-10T22:24:30.633 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T22:24:30.633 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-10T22:24:30.633 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T22:24:30.633 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T22:24:30.634 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T22:24:30.634 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-10T22:24:30.634 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-10T22:24:30.634 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T22:24:30.634 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-10T22:24:30.634 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T22:24:30.634 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-10T22:24:30.634 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T22:24:30.634 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-10T22:24:30.634 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T22:24:30.634 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T22:24:30.634 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-10T22:24:30.635 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T22:24:30.635 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T22:24:30.635 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-10T22:24:30.635 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T22:24:30.636 INFO:teuthology.orchestra.run.smithi103.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T22:24:30.636 INFO:teuthology.orchestra.run.smithi103.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T22:24:30.737 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T22:24:30.738 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-10T22:24:30.738 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T22:24:30.738 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T22:24:30.738 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-10T22:24:30.738 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-10T22:24:30.738 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T22:24:30.738 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-10T22:24:30.738 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-10T22:24:30.738 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T22:24:30.738 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-10T22:24:30.738 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T22:24:30.738 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-10T22:24:30.739 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T22:24:30.739 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-10T22:24:30.739 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T22:24:30.739 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-10T22:24:30.739 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T22:24:30.739 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-10T22:24:30.739 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-10T22:24:30.739 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T22:24:30.739 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-10T22:24:30.739 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-10T22:24:30.739 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T22:24:30.740 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T22:24:30.740 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T22:24:30.740 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T22:24:30.740 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T22:24:30.740 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T22:24:30.740 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-10T22:24:30.740 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T22:24:30.740 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T22:24:30.740 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T22:24:30.740 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-10T22:24:30.741 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-10T22:24:30.741 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-10T22:24:30.741 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T22:24:30.741 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T22:24:30.741 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T22:24:30.741 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-10T22:24:30.741 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-10T22:24:30.741 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-10T22:24:30.741 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T22:24:30.741 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-10T22:24:30.742 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T22:24:30.742 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-10T22:24:30.742 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T22:24:30.742 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-10T22:24:30.742 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T22:24:30.742 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-10T22:24:30.742 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T22:24:30.742 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-10T22:24:30.742 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T22:24:30.742 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-10T22:24:30.742 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T22:24:30.743 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-10T22:24:30.743 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T22:24:30.743 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-10T22:24:30.743 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T22:24:30.743 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-10T22:24:30.743 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T22:24:30.743 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-10T22:24:30.743 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T22:24:30.743 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-10T22:24:30.743 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T22:24:30.743 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T22:24:30.744 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-10T22:24:30.744 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T22:24:30.744 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T22:24:30.744 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T22:24:30.744 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-10T22:24:30.744 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-10T22:24:30.744 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T22:24:30.744 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T22:24:30.744 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-10T22:24:30.744 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-10T22:24:30.744 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T22:24:30.744 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-10T22:24:30.745 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-10T22:24:30.745 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-10T22:24:30.745 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-10T22:24:30.745 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T22:24:30.745 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-10T22:24:30.745 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-10T22:24:30.745 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T22:24:30.745 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-10T22:24:30.745 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T22:24:30.745 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T22:24:30.745 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-10T22:24:30.746 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T22:24:30.746 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-10T22:24:30.746 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T22:24:30.746 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-10T22:24:30.746 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T22:24:30.746 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T22:24:30.746 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-10T22:24:30.746 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-10T22:24:30.746 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T22:24:30.746 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T22:24:30.746 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-10T22:24:30.746 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T22:24:30.747 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-10T22:24:30.747 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T22:24:30.747 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-10T22:24:30.747 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T22:24:30.747 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T22:24:30.747 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T22:24:30.747 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T22:24:30.747 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-10T22:24:30.747 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-10T22:24:30.747 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-10T22:24:30.747 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-10T22:24:30.747 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T22:24:30.748 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-10T22:24:30.748 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T22:24:30.748 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-10T22:24:30.748 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T22:24:30.748 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T22:24:30.748 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-10T22:24:30.748 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T22:24:30.748 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T22:24:30.748 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T22:24:30.748 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T22:24:30.748 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-10T22:24:30.749 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-10T22:24:30.749 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-10T22:24:30.749 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T22:24:30.749 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-10T22:24:30.749 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T22:24:30.749 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-10T22:24:30.749 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T22:24:30.749 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T22:24:30.749 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T22:24:30.749 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T22:24:30.749 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-10T22:24:30.750 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T22:24:30.750 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-10T22:24:30.750 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T22:24:30.750 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-10T22:24:30.750 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T22:24:30.750 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T22:24:30.750 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-10T22:24:30.750 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T22:24:30.750 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T22:24:30.750 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-10T22:24:30.751 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T22:24:30.751 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-10T22:24:30.751 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-10T22:24:30.751 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-10T22:24:30.751 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-10T22:24:30.751 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T22:24:30.751 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-10T22:24:30.752 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T22:24:30.752 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-10T22:24:30.752 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T22:24:30.752 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T22:24:30.752 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-10T22:24:30.752 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T22:24:30.752 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T22:24:30.752 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T22:24:30.752 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-10T22:24:30.752 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T22:24:30.753 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T22:24:30.753 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-10T22:24:30.753 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T22:24:30.753 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T22:24:30.753 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T22:24:30.753 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T22:24:30.753 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T22:24:30.753 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-10T22:24:30.753 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T22:24:30.753 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T22:24:30.753 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-10T22:24:30.753 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T22:24:30.754 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T22:24:30.754 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T22:24:30.754 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T22:24:30.754 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T22:24:30.754 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T22:24:30.754 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T22:24:30.754 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T22:24:30.754 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T22:24:30.754 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T22:24:30.754 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T22:24:30.754 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T22:24:30.754 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T22:24:30.755 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T22:24:30.755 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T22:24:30.755 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T22:24:30.755 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T22:24:30.755 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T22:24:30.755 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T22:24:30.755 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-10T22:24:30.755 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-10T22:24:30.755 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-10T22:24:30.756 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T22:24:30.756 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T22:24:30.756 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T22:24:30.756 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T22:24:30.756 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T22:24:30.756 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T22:24:30.756 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T22:24:30.756 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T22:24:30.757 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-10T22:24:30.757 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T22:24:30.757 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T22:24:30.757 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T22:24:30.757 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-10T22:24:30.757 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T22:24:30.757 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T22:24:30.757 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T22:24:30.757 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T22:24:30.757 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T22:24:30.758 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T22:24:30.758 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T22:24:30.758 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-10T22:24:30.758 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T22:24:30.758 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-10T22:24:30.758 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T22:24:30.758 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-10T22:24:30.758 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T22:24:30.758 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-10T22:24:30.758 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T22:24:30.758 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-10T22:24:30.759 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-10T22:24:30.759 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T22:24:30.759 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T22:24:30.759 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-10T22:24:30.759 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T22:24:30.759 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T22:24:30.759 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T22:24:30.759 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T22:24:30.759 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-10T22:24:30.759 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-10T22:24:30.759 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T22:24:30.760 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-10T22:24:30.760 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-10T22:24:30.760 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-10T22:24:30.760 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T22:24:30.760 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-10T22:24:30.760 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T22:24:30.760 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-10T22:24:30.760 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-10T22:24:30.761 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-10T22:24:30.761 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T22:24:30.761 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T22:24:30.761 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-10T22:24:30.761 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-10T22:24:30.761 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-10T22:24:30.761 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-10T22:24:30.761 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-10T22:24:30.761 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-10T22:24:30.761 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-10T22:24:30.762 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T22:24:30.762 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-10T22:24:30.762 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-10T22:24:30.762 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-10T22:24:30.762 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-10T22:24:30.762 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-10T22:24:30.762 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-10T22:24:30.762 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-10T22:24:30.762 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-10T22:24:30.762 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-10T22:24:30.762 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-10T22:24:30.763 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T22:24:30.763 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T22:24:30.763 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T22:24:30.763 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T22:24:30.763 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T22:24:30.763 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T22:24:30.763 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T22:24:30.763 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T22:24:30.763 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T22:24:30.763 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T22:24:30.763 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T22:24:30.764 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T22:24:30.764 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-10T22:24:30.764 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-10T22:24:30.764 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T22:24:30.764 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-10T22:24:30.764 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T22:24:30.764 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T22:24:30.764 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T22:24:30.764 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T22:24:30.764 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T22:24:30.765 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T22:24:30.765 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T22:24:30.765 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T22:24:30.765 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T22:24:30.765 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T22:24:30.765 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T22:24:30.765 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-10T22:24:30.765 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-10T22:24:30.765 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-10T22:24:30.766 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-10T22:24:30.766 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-10T22:24:30.766 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-10T22:24:30.766 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-10T22:24:30.766 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-10T22:24:30.766 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-10T22:24:30.766 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-10T22:24:30.766 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-10T22:24:30.766 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-10T22:24:30.767 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-10T22:24:30.767 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-10T22:24:30.767 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-10T22:24:30.767 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-10T22:24:30.767 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-10T22:24:30.767 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-10T22:24:30.767 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-10T22:24:30.767 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-10T22:24:30.768 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-10T22:24:30.768 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-10T22:24:30.768 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-10T22:24:30.768 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-10T22:24:30.768 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-10T22:24:30.769 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-10T22:24:30.769 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-10T22:24:30.769 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-10T22:24:30.769 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-10T22:24:30.769 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-10T22:24:30.769 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T22:24:30.769 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T22:24:30.769 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-10T22:24:30.770 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-10T22:24:30.770 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T22:24:30.770 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T22:24:30.770 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T22:24:30.770 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T22:24:30.770 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-10T22:24:30.770 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T22:24:30.771 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T22:24:30.771 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-10T22:24:30.771 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-10T22:24:30.771 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-10T22:24:30.771 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T22:24:30.771 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T22:24:30.771 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-10T22:24:30.771 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-10T22:24:30.772 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-10T22:24:30.772 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T22:24:30.772 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-10T22:24:30.772 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-10T22:24:30.772 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-10T22:24:30.772 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T22:24:30.772 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T22:24:30.772 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T22:24:30.772 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T22:24:30.773 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T22:24:30.773 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T22:24:30.773 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T22:24:30.773 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T22:24:30.773 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T22:24:30.773 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T22:24:30.773 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T22:24:30.773 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T22:24:30.773 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T22:24:30.774 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-10T22:24:30.774 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T22:24:30.774 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T22:24:30.774 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T22:24:30.774 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-10T22:24:30.774 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T22:24:30.774 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-10T22:24:30.774 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-10T22:24:30.774 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-10T22:24:30.775 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-10T22:24:30.775 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-10T22:24:30.775 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T22:24:30.775 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-10T22:24:30.775 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T22:24:30.775 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-10T22:24:30.775 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T22:24:30.775 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T22:24:30.775 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T22:24:30.775 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T22:24:30.776 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-10T22:24:30.776 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T22:24:30.776 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T22:24:30.776 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T22:24:30.776 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T22:24:30.776 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T22:24:30.776 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-10T22:24:30.776 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T22:24:30.776 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-10T22:24:30.776 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-10T22:24:30.777 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-10T22:24:30.777 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-10T22:24:30.777 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T22:24:30.777 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-10T22:24:30.777 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T22:24:30.777 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T22:24:30.777 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T22:24:30.777 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T22:24:30.777 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T22:24:30.778 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-10T22:24:30.778 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T22:24:30.778 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T22:24:30.778 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-10T22:24:30.778 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T22:24:30.778 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T22:24:30.778 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-10T22:24:30.778 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-10T22:24:30.778 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T22:24:30.779 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-10T22:24:30.779 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T22:24:30.779 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T22:24:30.779 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-10T22:24:30.779 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T22:24:30.779 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-10T22:24:30.779 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T22:24:30.779 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-10T22:24:30.779 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T22:24:30.780 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-10T22:24:30.780 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T22:24:30.780 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T22:24:30.780 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-10T22:24:30.780 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T22:24:30.780 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-10T22:24:30.780 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-10T22:24:30.780 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T22:24:30.780 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-10T22:24:30.781 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T22:24:30.781 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T22:24:30.781 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T22:24:30.781 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T22:24:30.781 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-10T22:24:30.781 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T22:24:30.781 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T22:24:30.781 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-10T22:24:30.781 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T22:24:30.781 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T22:24:30.782 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-10T22:24:30.782 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-10T22:24:30.782 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T22:24:30.782 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T22:24:30.782 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T22:24:30.782 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T22:24:30.782 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-10T22:24:30.783 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T22:24:30.783 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T22:24:30.783 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T22:24:30.783 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-10T22:24:30.783 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T22:24:30.783 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T22:24:30.783 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T22:24:30.784 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-10T22:24:30.784 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T22:24:30.784 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T22:24:30.784 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T22:24:30.784 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-10T22:24:30.784 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T22:24:30.784 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-10T22:24:30.784 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T22:24:30.784 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-10T22:24:30.784 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T22:24:30.784 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T22:24:30.785 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T22:24:30.785 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T22:24:30.785 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-10T22:24:30.785 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T22:24:30.785 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-10T22:24:30.785 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T22:24:30.785 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T22:24:30.785 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-10T22:24:30.785 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-10T22:24:30.785 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-10T22:24:30.786 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-10T22:24:30.786 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-10T22:24:30.786 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-10T22:24:30.786 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T22:24:30.786 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T22:24:30.786 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-10T22:24:30.786 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T22:24:30.786 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-10T22:24:30.786 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T22:24:30.786 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T22:24:30.786 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-10T22:24:30.786 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T22:24:30.787 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-10T22:24:30.787 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T22:24:30.787 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T22:24:30.787 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T22:24:30.787 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T22:24:30.787 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T22:24:30.787 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T22:24:30.787 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T22:24:30.787 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T22:24:30.787 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T22:24:30.787 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T22:24:30.787 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-10T22:24:30.788 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T22:24:30.788 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T22:24:30.788 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T22:24:30.788 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T22:24:30.788 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-10T22:24:30.788 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-10T22:24:30.788 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T22:24:30.788 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-10T22:24:30.788 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-10T22:24:30.788 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T22:24:30.788 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-10T22:24:30.789 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T22:24:30.789 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T22:24:30.789 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T22:24:30.789 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T22:24:30.789 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T22:24:30.789 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T22:24:30.789 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-10T22:24:30.789 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T22:24:30.789 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-10T22:24:30.789 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-10T22:24:30.789 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-10T22:24:30.789 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T22:24:30.790 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T22:24:30.790 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T22:24:30.790 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T22:24:30.790 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T22:24:30.790 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T22:24:30.790 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T22:24:30.790 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T22:24:30.790 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T22:24:30.790 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T22:24:30.790 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T22:24:30.790 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T22:24:30.791 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T22:24:30.791 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T22:24:30.791 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T22:24:30.791 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-10T22:24:30.791 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T22:24:30.791 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T22:24:30.791 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T22:24:30.791 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-10T22:24:30.792 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-10T22:24:30.792 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T22:24:30.792 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-10T22:24:30.792 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-10T22:24:30.792 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T22:24:30.792 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T22:24:30.792 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T22:24:30.792 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-10T22:24:30.792 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-10T22:24:30.792 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-10T22:24:30.792 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T22:24:30.793 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-10T22:24:30.793 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-10T22:24:30.793 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T22:24:30.793 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-10T22:24:30.793 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-10T22:24:30.793 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T22:24:30.793 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-10T22:24:30.793 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-10T22:24:30.793 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-10T22:24:30.793 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-10T22:24:30.793 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-10T22:24:30.794 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T22:24:30.794 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-10T22:24:30.794 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T22:24:30.794 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-10T22:24:30.794 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-10T22:24:30.794 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T22:24:30.794 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T22:24:30.794 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T22:24:30.794 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-10T22:24:30.794 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-10T22:24:30.795 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-10T22:24:30.795 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T22:24:30.795 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-10T22:24:30.795 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T22:24:30.795 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-10T22:24:30.795 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-10T22:24:30.795 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-10T22:24:30.795 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-10T22:24:30.795 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-10T22:24:30.795 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-10T22:24:30.795 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-10T22:24:30.795 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-10T22:24:30.796 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-10T22:24:30.796 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-10T22:24:30.796 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T22:24:30.796 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T22:24:30.796 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T22:24:30.796 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T22:24:30.796 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-10T22:24:30.796 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-10T22:24:30.796 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-10T22:24:30.796 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-10T22:24:30.796 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-10T22:24:30.797 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-10T22:24:30.797 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-10T22:24:30.797 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-10T22:24:30.797 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-10T22:24:30.797 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-10T22:24:30.797 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-10T22:24:30.797 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-10T22:24:30.797 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-10T22:24:30.797 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-10T22:24:30.797 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-10T22:24:30.797 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-10T22:24:30.798 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-10T22:24:30.798 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-10T22:24:30.798 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-10T22:24:30.798 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-10T22:24:30.798 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-10T22:24:30.798 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-10T22:24:30.798 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-10T22:24:30.798 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-10T22:24:30.798 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-10T22:24:30.798 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-10T22:24:30.798 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-10T22:24:30.799 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-10T22:24:30.799 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-10T22:24:30.799 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-10T22:24:30.799 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-10T22:24:30.799 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-10T22:24:30.799 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-10T22:24:30.799 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-10T22:24:30.799 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-10T22:24:30.799 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-10T22:24:30.799 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-10T22:24:30.799 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-10T22:24:30.799 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-10T22:24:30.800 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-10T22:24:30.800 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-10T22:24:30.800 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-10T22:24:30.800 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-10T22:24:30.800 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-10T22:24:30.800 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-10T22:24:30.800 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-10T22:24:30.800 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-10T22:24:30.800 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-10T22:24:30.800 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-10T22:24:30.800 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-10T22:24:30.801 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-10T22:24:30.801 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-10T22:24:30.801 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-10T22:24:30.801 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-10T22:24:30.801 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-10T22:24:30.801 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-10T22:24:30.801 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-10T22:24:30.801 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-10T22:24:30.801 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-10T22:24:30.801 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-10T22:24:30.801 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-10T22:24:30.801 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-10T22:24:30.802 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-10T22:24:30.802 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T22:24:30.802 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-10T22:24:30.802 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-10T22:24:30.802 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-10T22:24:30.802 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-10T22:24:30.802 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T22:24:30.802 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T22:24:30.802 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-10T22:24:30.802 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T22:24:30.802 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T22:24:30.803 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-10T22:24:30.803 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-10T22:24:30.803 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-10T22:24:30.803 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T22:24:30.803 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T22:24:30.803 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T22:24:30.803 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T22:24:30.803 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T22:24:30.803 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T22:24:30.803 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T22:24:30.803 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T22:24:30.804 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-10T22:24:30.804 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-10T22:24:30.804 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T22:24:30.804 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T22:24:30.804 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T22:24:30.804 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T22:24:30.804 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T22:24:30.804 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-10T22:24:30.804 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T22:24:30.804 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T22:24:30.804 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-10T22:24:30.805 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-10T22:24:30.805 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-10T22:24:30.805 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-10T22:24:30.805 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-10T22:24:30.805 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T22:24:30.805 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-10T22:24:30.805 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-10T22:24:30.805 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-10T22:24:30.805 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-10T22:24:30.805 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T22:24:30.805 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T22:24:30.806 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T22:24:30.806 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T22:24:30.806 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T22:24:30.806 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T22:24:30.806 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T22:24:30.806 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T22:24:30.806 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T22:24:30.806 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-10T22:24:30.806 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T22:24:30.806 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T22:24:30.806 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T22:24:30.807 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T22:24:30.807 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T22:24:30.807 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T22:24:30.807 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T22:24:30.807 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T22:24:30.807 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T22:24:30.807 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T22:24:30.807 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T22:24:30.807 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T22:24:30.807 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T22:24:30.807 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-10T22:24:30.808 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T22:24:30.808 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T22:24:30.808 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-10T22:24:30.808 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T22:24:30.808 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T22:24:30.808 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T22:24:30.808 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T22:24:30.808 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T22:24:30.808 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T22:24:30.808 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T22:24:30.809 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T22:24:30.809 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T22:24:30.809 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T22:24:30.809 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T22:24:30.809 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T22:24:30.809 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T22:24:30.809 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T22:24:30.809 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T22:24:30.809 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T22:24:30.809 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T22:24:30.810 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T22:24:30.810 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-10T22:24:30.810 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T22:24:30.810 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T22:24:30.810 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-10T22:24:30.810 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T22:24:30.810 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-10T22:24:30.810 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T22:24:30.810 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T22:24:30.810 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T22:24:30.810 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T22:24:30.811 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T22:24:30.811 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T22:24:30.811 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T22:24:30.811 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T22:24:30.811 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T22:24:30.811 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T22:24:30.811 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T22:24:30.811 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T22:24:30.811 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T22:24:30.811 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T22:24:30.812 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T22:24:30.812 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-10T22:24:30.812 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T22:24:30.812 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T22:24:30.812 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T22:24:30.812 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-10T22:24:30.812 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-10T22:24:30.812 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T22:24:30.812 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T22:24:30.812 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T22:24:30.813 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T22:24:30.813 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-10T22:24:30.813 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T22:24:30.813 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T22:24:30.813 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T22:24:30.813 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T22:24:30.813 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-10T22:24:30.813 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-10T22:24:30.813 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-10T22:24:30.813 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-10T22:24:30.814 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-10T22:24:30.814 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-10T22:24:30.814 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-10T22:24:30.814 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T22:24:30.814 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-10T22:24:30.814 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-10T22:24:30.814 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-10T22:24:30.814 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-10T22:24:30.814 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-10T22:24:30.814 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-10T22:24:30.815 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T22:24:30.815 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-10T22:24:30.815 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-10T22:24:30.815 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-10T22:24:30.815 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-10T22:24:30.815 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-10T22:24:30.815 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-10T22:24:30.815 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T22:24:30.816 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-10T22:24:30.816 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-10T22:24:30.816 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-10T22:24:30.816 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T22:24:30.816 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T22:24:30.816 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-10T22:24:30.816 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-10T22:24:30.816 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-10T22:24:30.816 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T22:24:30.816 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T22:24:30.816 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T22:24:30.817 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T22:24:30.817 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T22:24:30.817 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T22:24:30.817 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T22:24:30.817 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T22:24:30.817 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T22:24:30.817 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T22:24:30.817 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T22:24:30.817 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T22:24:30.817 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-10T22:24:30.818 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-10T22:24:30.818 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-10T22:24:30.818 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T22:24:30.818 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T22:24:30.818 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-10T22:24:30.818 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-10T22:24:30.818 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-10T22:24:30.818 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-10T22:24:30.818 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-10T22:24:30.818 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-10T22:24:30.818 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T22:24:30.818 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T22:24:30.819 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T22:24:30.819 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T22:24:30.819 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T22:24:30.819 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T22:24:30.819 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T22:24:30.819 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T22:24:30.819 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T22:24:30.819 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T22:24:30.819 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-10T22:24:30.819 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T22:24:30.819 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-10T22:24:30.820 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-10T22:24:30.820 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T22:24:30.820 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-10T22:24:30.820 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-10T22:24:30.820 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T22:24:30.820 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T22:24:30.820 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-10T22:24:30.820 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-10T22:24:30.820 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-10T22:24:30.820 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T22:24:30.820 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-10T22:24:30.820 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T22:24:30.821 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-10T22:24:30.821 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T22:24:30.821 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T22:24:30.821 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-10T22:24:30.821 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T22:24:30.821 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T22:24:30.821 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T22:24:30.821 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T22:24:30.821 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-10T22:24:30.821 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T22:24:30.821 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-10T22:24:30.822 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-10T22:24:30.822 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T22:24:30.823 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-10T22:24:30.823 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T22:24:30.823 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T22:24:30.824 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T22:24:30.824 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-10T22:24:30.824 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T22:24:30.824 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T22:24:30.824 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-10T22:24:30.824 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-10T22:24:30.824 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T22:24:30.824 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-10T22:24:30.824 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-10T22:24:30.824 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T22:24:30.824 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-10T22:24:30.825 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-10T22:24:30.825 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-10T22:24:30.825 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T22:24:30.825 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-10T22:24:30.825 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-10T22:24:30.825 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-10T22:24:30.825 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-10T22:24:30.825 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-10T22:24:30.825 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T22:24:30.825 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-10T22:24:30.825 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-10T22:24:30.826 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T22:24:30.826 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-10T22:24:30.826 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T22:24:30.826 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-10T22:24:30.826 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T22:24:30.826 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-10T22:24:30.826 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T22:24:30.826 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-10T22:24:30.826 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T22:24:30.826 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-10T22:24:30.827 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-10T22:24:30.827 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-10T22:24:30.827 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T22:24:30.827 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-10T22:24:30.827 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T22:24:30.827 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-10T22:24:30.827 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-10T22:24:30.827 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-10T22:24:30.827 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T22:24:30.827 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-10T22:24:30.827 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T22:24:30.828 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-10T22:24:30.828 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-10T22:24:30.828 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-10T22:24:30.828 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T22:24:30.828 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-10T22:24:30.828 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T22:24:30.828 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-10T22:24:30.828 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T22:24:30.828 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-10T22:24:30.828 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T22:24:30.828 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-10T22:24:30.829 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-10T22:24:30.829 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-10T22:24:30.829 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T22:24:30.829 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-10T22:24:30.829 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T22:24:30.829 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-10T22:24:30.829 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T22:24:30.829 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-10T22:24:30.829 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T22:24:30.829 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-10T22:24:30.829 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T22:24:30.829 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-10T22:24:30.830 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-10T22:24:30.830 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T22:24:30.830 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-10T22:24:30.830 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T22:24:30.830 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-10T22:24:30.830 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T22:24:30.830 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T22:24:30.830 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-10T22:24:30.830 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T22:24:30.830 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T22:24:30.830 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-10T22:24:30.831 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T22:24:30.831 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T22:24:30.831 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-10T22:24:30.831 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T22:24:30.831 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-10T22:24:30.831 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T22:24:30.831 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-10T22:24:30.831 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T22:24:30.831 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T22:24:30.831 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T22:24:30.831 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T22:24:30.832 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T22:24:30.832 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T22:24:30.832 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T22:24:30.832 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T22:24:30.832 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T22:24:30.832 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T22:24:30.832 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T22:24:30.832 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-10T22:24:30.832 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T22:24:30.832 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T22:24:30.832 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T22:24:30.832 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T22:24:30.833 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T22:24:30.833 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T22:24:30.833 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T22:24:30.833 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T22:24:30.833 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T22:24:30.833 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T22:24:30.833 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T22:24:30.833 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T22:24:30.833 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T22:24:30.833 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T22:24:30.833 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T22:24:30.834 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T22:24:30.834 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T22:24:30.834 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T22:24:30.834 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T22:24:30.834 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T22:24:30.834 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T22:24:30.834 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T22:24:30.834 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T22:24:30.834 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T22:24:30.834 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T22:24:30.834 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T22:24:30.835 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T22:24:30.835 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T22:24:30.835 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T22:24:30.835 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T22:24:30.835 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T22:24:30.835 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T22:24:30.835 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T22:24:30.835 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T22:24:30.835 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T22:24:30.835 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T22:24:30.835 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T22:24:30.836 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T22:24:30.836 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T22:24:30.836 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-10T22:24:30.836 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-10T22:24:30.836 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-10T22:24:30.836 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-10T22:24:30.836 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T22:24:30.836 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-10T22:24:30.836 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T22:24:30.836 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-10T22:24:30.836 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T22:24:30.837 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T22:24:30.837 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T22:24:30.837 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T22:24:30.837 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T22:24:30.837 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-10T22:24:30.837 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-10T22:24:30.837 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-10T22:24:30.837 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T22:24:30.837 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-10T22:24:30.837 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T22:24:30.837 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-10T22:24:30.838 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-10T22:24:30.838 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-10T22:24:30.838 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-10T22:24:30.838 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-10T22:24:30.838 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-10T22:24:30.838 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-10T22:24:30.838 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-10T22:24:30.838 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-10T22:24:30.838 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T22:24:30.838 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-10T22:24:30.838 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T22:24:30.838 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-10T22:24:30.839 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-10T22:24:30.839 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T22:24:30.840 INFO:teuthology.orchestra.run.smithi103.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T22:24:30.840 INFO:teuthology.orchestra.run.smithi103.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T22:24:30.840 INFO:teuthology.orchestra.run.smithi103.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T22:24:30.840 INFO:teuthology.orchestra.run.smithi103.stderr:done 2024-09-10T22:24:30.885 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-10T22:24:30.885 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T22:24:30.886 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T22:24:30.886 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-10T22:24:30.886 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T22:24:30.886 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-10T22:24:30.886 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T22:24:30.886 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-10T22:24:30.886 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T22:24:30.886 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-10T22:24:30.886 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T22:24:30.886 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-10T22:24:30.886 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T22:24:30.887 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-10T22:24:30.887 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-10T22:24:30.887 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-10T22:24:30.887 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-10T22:24:30.887 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-10T22:24:30.887 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T22:24:30.887 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-10T22:24:30.887 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T22:24:30.887 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-10T22:24:30.887 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T22:24:30.887 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-10T22:24:30.887 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T22:24:30.888 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T22:24:30.888 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-10T22:24:30.888 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T22:24:30.888 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T22:24:30.888 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-10T22:24:30.888 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T22:24:30.888 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T22:24:30.888 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-10T22:24:30.889 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T22:24:30.889 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-10T22:24:30.889 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-10T22:24:30.889 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-10T22:24:30.889 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-10T22:24:30.889 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-10T22:24:30.889 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T22:24:30.889 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-10T22:24:30.889 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-10T22:24:30.889 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T22:24:30.889 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-10T22:24:30.890 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-10T22:24:30.890 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-10T22:24:30.890 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-10T22:24:30.890 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T22:24:30.890 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T22:24:30.890 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T22:24:30.890 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-10T22:24:30.890 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-10T22:24:30.890 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-10T22:24:30.890 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T22:24:30.890 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-10T22:24:30.891 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-10T22:24:30.891 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T22:24:30.891 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T22:24:30.891 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T22:24:30.891 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T22:24:30.891 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T22:24:30.891 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T22:24:30.891 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T22:24:30.891 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T22:24:30.891 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-10T22:24:30.891 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T22:24:30.891 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T22:24:30.892 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T22:24:30.892 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T22:24:30.892 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T22:24:30.892 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-10T22:24:30.892 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T22:24:30.892 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-10T22:24:30.892 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T22:24:30.892 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T22:24:30.892 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T22:24:30.892 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T22:24:30.892 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-10T22:24:30.893 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T22:24:30.893 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-10T22:24:30.893 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T22:24:30.893 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T22:24:30.893 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-10T22:24:30.893 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T22:24:30.893 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T22:24:30.893 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T22:24:30.893 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T22:24:30.893 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T22:24:30.893 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T22:24:30.894 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T22:24:30.894 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T22:24:30.894 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T22:24:30.894 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T22:24:30.894 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T22:24:30.894 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T22:24:30.894 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T22:24:30.894 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T22:24:30.894 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T22:24:30.894 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T22:24:30.894 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T22:24:30.894 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T22:24:30.895 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T22:24:30.895 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T22:24:30.895 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T22:24:30.895 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T22:24:30.895 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T22:24:30.895 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-10T22:24:30.895 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T22:24:30.895 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-10T22:24:30.895 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T22:24:30.895 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-10T22:24:30.895 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T22:24:30.896 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T22:24:30.896 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T22:24:30.896 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T22:24:30.896 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-10T22:24:30.896 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T22:24:30.896 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T22:24:30.896 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T22:24:30.896 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T22:24:30.896 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T22:24:30.896 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-10T22:24:30.897 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-10T22:24:30.897 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-10T22:24:30.897 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-10T22:24:30.897 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T22:24:30.897 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T22:24:30.897 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T22:24:30.897 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-10T22:24:30.897 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T22:24:30.897 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T22:24:30.897 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T22:24:30.897 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T22:24:30.897 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T22:24:30.898 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T22:24:30.898 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T22:24:30.898 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T22:24:30.898 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T22:24:30.898 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T22:24:30.898 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-10T22:24:30.898 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T22:24:30.898 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T22:24:30.898 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T22:24:30.898 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-10T22:24:30.898 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T22:24:30.899 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-10T22:24:30.899 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T22:24:30.899 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T22:24:30.899 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T22:24:30.899 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-10T22:24:30.899 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T22:24:30.899 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T22:24:30.899 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T22:24:30.899 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T22:24:30.899 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T22:24:30.899 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T22:24:30.900 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T22:24:30.900 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T22:24:30.900 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T22:24:30.900 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-10T22:24:30.900 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T22:24:30.900 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T22:24:30.900 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T22:24:30.900 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T22:24:30.900 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T22:24:30.900 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T22:24:30.900 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T22:24:30.901 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T22:24:30.901 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T22:24:30.901 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T22:24:30.901 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T22:24:30.901 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T22:24:30.901 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T22:24:30.901 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T22:24:30.901 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T22:24:30.901 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T22:24:30.901 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T22:24:30.901 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T22:24:30.902 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T22:24:30.902 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T22:24:30.902 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T22:24:30.902 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T22:24:30.902 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-10T22:24:30.902 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T22:24:30.902 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T22:24:30.902 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T22:24:30.902 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-10T22:24:30.902 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T22:24:30.902 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T22:24:30.902 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T22:24:30.903 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T22:24:30.903 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-10T22:24:30.903 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-10T22:24:30.903 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T22:24:30.903 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-10T22:24:30.903 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T22:24:30.903 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T22:24:30.903 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T22:24:30.903 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T22:24:30.903 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T22:24:30.904 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T22:24:30.904 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T22:24:30.904 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T22:24:30.904 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T22:24:30.904 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T22:24:30.904 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T22:24:30.904 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T22:24:30.904 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T22:24:30.904 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T22:24:30.904 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T22:24:30.904 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T22:24:30.905 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T22:24:30.905 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T22:24:30.905 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T22:24:30.905 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T22:24:30.905 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T22:24:30.905 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T22:24:30.905 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T22:24:30.905 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T22:24:30.905 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T22:24:30.905 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T22:24:30.905 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-10T22:24:30.906 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T22:24:30.906 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-10T22:24:30.906 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T22:24:30.906 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T22:24:30.906 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T22:24:30.906 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T22:24:30.906 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T22:24:30.906 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T22:24:30.906 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T22:24:30.906 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-10T22:24:30.906 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-10T22:24:30.907 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-10T22:24:30.907 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T22:24:30.907 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-10T22:24:30.907 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-10T22:24:30.907 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T22:24:30.907 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-10T22:24:30.907 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T22:24:30.907 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-10T22:24:30.907 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-10T22:24:30.907 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T22:24:30.907 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T22:24:30.907 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T22:24:30.908 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T22:24:30.908 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T22:24:30.908 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T22:24:30.908 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T22:24:30.908 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T22:24:30.908 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T22:24:30.908 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T22:24:30.908 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T22:24:30.908 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T22:24:30.908 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T22:24:30.908 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T22:24:30.909 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T22:24:30.909 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T22:24:30.909 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-10T22:24:30.909 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T22:24:30.909 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T22:24:30.909 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T22:24:30.909 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T22:24:30.909 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T22:24:30.909 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T22:24:30.909 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T22:24:30.909 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T22:24:30.909 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T22:24:30.910 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T22:24:30.910 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T22:24:30.910 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T22:24:30.910 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T22:24:30.910 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T22:24:30.910 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T22:24:30.910 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T22:24:30.910 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T22:24:30.910 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T22:24:30.910 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T22:24:30.911 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T22:24:30.911 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T22:24:30.911 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T22:24:30.911 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T22:24:30.911 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T22:24:30.911 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T22:24:30.911 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T22:24:30.911 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T22:24:30.911 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T22:24:30.911 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T22:24:30.911 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T22:24:30.911 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T22:24:30.912 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T22:24:30.912 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T22:24:30.912 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T22:24:30.912 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T22:24:30.912 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T22:24:30.912 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T22:24:30.912 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T22:24:30.912 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T22:24:30.912 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T22:24:30.912 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T22:24:30.912 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T22:24:30.913 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-10T22:24:30.913 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T22:24:30.913 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T22:24:30.913 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T22:24:30.913 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T22:24:30.913 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T22:24:30.913 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T22:24:30.913 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T22:24:30.913 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T22:24:30.913 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T22:24:30.913 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T22:24:30.913 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T22:24:30.914 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T22:24:30.914 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T22:24:30.914 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T22:24:30.914 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T22:24:30.914 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-10T22:24:30.914 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T22:24:30.914 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T22:24:30.914 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T22:24:30.914 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T22:24:30.914 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T22:24:30.914 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-10T22:24:30.914 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-10T22:24:30.915 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-10T22:24:30.915 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T22:24:30.915 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T22:24:30.915 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T22:24:30.915 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T22:24:30.915 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T22:24:30.915 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T22:24:30.915 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T22:24:30.915 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T22:24:30.915 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T22:24:30.915 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T22:24:30.915 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T22:24:30.916 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T22:24:30.916 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T22:24:30.916 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T22:24:30.916 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T22:24:30.916 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T22:24:30.916 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T22:24:30.916 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T22:24:30.916 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T22:24:30.916 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T22:24:30.916 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T22:24:30.916 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T22:24:30.917 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T22:24:30.917 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T22:24:30.917 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T22:24:30.917 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T22:24:30.917 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T22:24:30.917 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T22:24:30.917 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T22:24:30.917 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T22:24:30.917 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T22:24:30.917 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T22:24:30.917 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T22:24:30.918 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T22:24:30.918 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T22:24:30.918 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T22:24:30.918 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T22:24:30.918 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T22:24:30.918 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T22:24:30.918 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T22:24:30.918 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T22:24:30.918 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T22:24:30.918 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T22:24:30.918 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T22:24:30.919 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T22:24:30.919 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T22:24:30.919 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T22:24:30.919 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T22:24:30.919 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T22:24:30.919 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T22:24:30.919 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T22:24:30.919 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T22:24:30.919 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T22:24:30.919 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T22:24:30.919 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T22:24:30.919 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T22:24:30.920 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T22:24:30.920 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T22:24:30.920 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T22:24:30.920 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T22:24:30.920 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T22:24:30.920 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T22:24:30.920 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T22:24:30.920 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T22:24:30.920 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T22:24:30.920 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T22:24:30.920 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T22:24:30.921 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T22:24:30.921 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T22:24:30.921 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-10T22:24:30.921 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T22:24:30.921 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T22:24:30.921 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-10T22:24:30.921 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T22:24:30.921 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-10T22:24:30.921 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T22:24:30.921 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-10T22:24:30.922 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T22:24:30.922 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T22:24:30.922 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T22:24:30.922 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T22:24:30.922 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-10T22:24:30.922 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T22:24:30.922 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-10T22:24:30.922 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-10T22:24:30.922 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-10T22:24:30.922 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-10T22:24:30.923 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T22:24:30.923 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T22:24:30.923 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T22:24:30.923 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-10T22:24:30.923 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-10T22:24:30.923 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-10T22:24:30.923 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T22:24:30.923 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T22:24:30.923 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T22:24:30.923 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T22:24:30.923 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T22:24:30.923 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T22:24:30.924 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T22:24:30.924 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T22:24:30.924 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T22:24:30.924 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T22:24:30.924 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T22:24:30.924 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-10T22:24:30.924 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T22:24:30.924 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T22:24:30.924 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T22:24:30.924 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T22:24:30.924 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T22:24:30.925 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T22:24:30.925 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T22:24:30.925 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T22:24:30.926 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T22:24:30.926 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T22:24:30.926 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T22:24:30.926 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T22:24:30.926 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T22:24:30.926 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T22:24:30.926 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-10T22:24:30.926 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T22:24:30.926 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T22:24:30.926 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T22:24:30.926 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T22:24:30.927 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T22:24:30.927 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T22:24:30.927 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T22:24:30.927 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T22:24:30.927 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T22:24:30.927 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T22:24:30.927 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T22:24:30.927 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T22:24:30.927 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T22:24:30.927 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T22:24:30.927 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T22:24:30.928 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T22:24:30.928 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T22:24:30.928 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T22:24:30.928 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-10T22:24:30.928 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T22:24:30.928 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T22:24:30.928 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-10T22:24:30.928 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-10T22:24:30.928 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T22:24:30.928 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T22:24:30.929 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T22:24:30.929 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-10T22:24:30.929 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T22:24:30.929 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-10T22:24:30.929 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T22:24:30.929 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T22:24:30.929 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-10T22:24:30.929 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T22:24:30.929 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-10T22:24:30.929 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T22:24:30.929 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T22:24:30.930 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T22:24:30.930 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T22:24:30.930 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T22:24:30.930 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-10T22:24:30.930 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-10T22:24:30.930 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-10T22:24:30.930 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-10T22:24:30.930 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T22:24:30.930 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-10T22:24:30.930 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T22:24:30.930 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T22:24:30.931 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T22:24:30.931 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T22:24:30.931 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T22:24:30.931 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T22:24:30.931 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T22:24:30.931 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T22:24:30.931 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T22:24:30.931 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T22:24:30.931 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T22:24:30.931 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T22:24:30.931 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T22:24:30.931 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-10T22:24:30.932 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-10T22:24:30.932 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-10T22:24:30.932 INFO:teuthology.orchestra.run.smithi131.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-10T22:24:30.932 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-10T22:24:30.932 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-10T22:24:30.936 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:30.937 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:30.937 DEBUG:teuthology.orchestra.run.smithi131:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-10T22:24:30.944 INFO:teuthology.orchestra.run.smithi131.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-10T22:24:30.944 INFO:teuthology.orchestra.run.smithi131.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-10T22:24:30.944 INFO:teuthology.orchestra.run.smithi131.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-10T22:24:30.945 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-10T22:24:30.945 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:30.945 DEBUG:teuthology.orchestra.run.smithi131:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-10T22:24:30.988 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi131.front.sepia.ceph.com to complete... 2024-09-10T22:24:31.385 INFO:teuthology.orchestra.run.smithi131.stderr:Sourcing file `/etc/default/grub' 2024-09-10T22:24:31.386 INFO:teuthology.orchestra.run.smithi131.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T22:24:31.408 INFO:teuthology.orchestra.run.smithi131.stderr:Generating grub configuration file ... 2024-09-10T22:24:31.571 INFO:teuthology.orchestra.run.smithi131.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:31.577 INFO:teuthology.orchestra.run.smithi131.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:24:31.793 INFO:teuthology.orchestra.run.smithi131.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T22:24:31.799 INFO:teuthology.orchestra.run.smithi131.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T22:24:31.840 INFO:teuthology.orchestra.run.smithi131.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T22:24:31.846 INFO:teuthology.orchestra.run.smithi131.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T22:24:31.989 INFO:teuthology.orchestra.run.smithi131.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T22:24:31.989 INFO:teuthology.orchestra.run.smithi131.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T22:24:31.989 INFO:teuthology.orchestra.run.smithi131.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T22:24:32.008 INFO:teuthology.orchestra.run.smithi131.stderr:done 2024-09-10T22:25:01.889 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T22:25:01.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-10T22:25:01.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:25:03.142 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-10T22:25:03.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-10T22:25:03.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:25:20.445 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-10T22:25:21.725 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-09-10T22:25:29.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-10T22:25:29.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:25:30.727 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-10T22:25:30.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:25:32.545 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-10T22:25:44.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-10T22:25:44.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:25:47.649 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-10T22:26:02.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-10T22:26:02.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:26:30.784 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T22:26:34.394 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-10T22:26:34.954 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-10T22:26:34.954 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T22:26:34.955 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-10T22:26:35.009 INFO:teuthology.orchestra.run.smithi103.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:26:35.009 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:26:35.009 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T22:26:35.009 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T22:26:36.010 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T22:26:36.010 DEBUG:teuthology.orchestra.run.smithi103:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T22:26:36.109 INFO:teuthology.orchestra.run.smithi103.stdout:ttyS1 2024-09-10T22:26:36.173 DEBUG:teuthology.parallel:result is None 2024-09-10T22:26:42.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-10T22:26:42.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:26:43.173 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-09-10T22:26:43.866 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-10T22:26:43.866 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T22:26:43.866 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-09-10T22:26:43.915 INFO:teuthology.orchestra.run.smithi131.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:26:43.916 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T22:26:43.916 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T22:26:43.916 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T22:26:44.917 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-10T22:26:44.917 DEBUG:teuthology.orchestra.run.smithi131:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T22:26:45.006 INFO:teuthology.orchestra.run.smithi131.stdout:ttyS1 2024-09-10T22:26:45.081 DEBUG:teuthology.parallel:result is None 2024-09-10T22:26:45.081 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T22:26:45.088 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T22:26:45.088 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T22:26:45.091 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T22:26:45.100 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T22:26:45.105 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T22:26:45.111 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T22:26:45.112 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T22:26:45.140 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T22:26:45.167 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T22:26:45.173 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T22:26:45.173 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T22:26:45.204 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T22:26:45.227 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T22:26:45.236 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T22:26:45.240 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T22:26:45.249 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T22:26:45.252 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T22:26:45.258 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T22:26:45.258 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T22:26:45.292 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T22:26:45.316 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T22:26:45.325 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T22:26:45.325 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T22:26:45.360 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T22:26:45.368 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T22:26:45.421 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T22:26:45.477 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:26:45.477 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T22:26:45.546 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T22:26:45.554 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T22:26:45.605 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:26:45.605 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T22:26:45.687 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2024-09-10T22:26:45.690 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2024-09-10T22:26:45.801 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T22:26:45.808 INFO:teuthology.task.internal:Starting timer... 2024-09-10T22:26:45.808 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T22:26:45.822 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T22:26:45.831 DEBUG:teuthology.task.selinux:Excluding smithi103: OS 'ubuntu' does not support SELinux 2024-09-10T22:26:45.831 DEBUG:teuthology.task.selinux:Excluding smithi131: OS 'ubuntu' does not support SELinux 2024-09-10T22:26:45.831 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T22:26:45.831 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-10T22:26:45.831 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T22:26:45.831 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T22:26:45.879 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T22:26:45.890 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T22:26:45.891 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi103.front.sepia.ceph.com,smithi131.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T22:34:52.046 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi103.front.sepia.ceph.com'), Remote(name='ubuntu@smithi131.front.sepia.ceph.com')] 2024-09-10T22:34:52.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-10T22:34:52.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:34:52.141 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-10T22:34:52.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-10T22:34:52.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-10T22:34:52.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:34:52.353 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-09-10T22:34:52.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-10T22:34:52.479 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T22:34:52.490 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T22:34:52.490 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T22:34:52.491 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:34:52.494 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T22:34:52.495 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:34:52.531 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T22:34:52.531 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: Command line: ntpd -gq 2024-09-10T22:34:52.531 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: ---------------------------------------------------- 2024-09-10T22:34:52.531 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T22:34:52.531 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T22:34:52.531 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: corporation. Support and training for ntp-4 are 2024-09-10T22:34:52.532 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: available at https://www.nwtime.org/support 2024-09-10T22:34:52.532 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: ---------------------------------------------------- 2024-09-10T22:34:52.532 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: proto: precision = 0.042 usec (-24) 2024-09-10T22:34:52.532 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: basedate set to 2022-02-04 2024-09-10T22:34:52.533 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: gps base set to 2022-02-06 (week 2196) 2024-09-10T22:34:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T22:34:52.534 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T22:34:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T22:34:52.535 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T22:34:52.535 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T22:34:52.535 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T22:34:52.535 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T22:34:52.535 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: Listen normally on 3 enp3s0f1 172.21.15.103:123 2024-09-10T22:34:52.536 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: Listen normally on 4 lo [::1]:123 2024-09-10T22:34:52.536 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc0b%5]:123 2024-09-10T22:34:52.536 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:34:52 ntpd[18459]: Listening on routing socket on fd #22 for interface updates 2024-09-10T22:34:52.559 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T22:34:52.559 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: Command line: ntpd -gq 2024-09-10T22:34:52.560 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: ---------------------------------------------------- 2024-09-10T22:34:52.560 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T22:34:52.560 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T22:34:52.560 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: corporation. Support and training for ntp-4 are 2024-09-10T22:34:52.560 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: available at https://www.nwtime.org/support 2024-09-10T22:34:52.560 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: ---------------------------------------------------- 2024-09-10T22:34:52.561 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: proto: precision = 0.043 usec (-24) 2024-09-10T22:34:52.561 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: basedate set to 2022-02-04 2024-09-10T22:34:52.561 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: gps base set to 2022-02-06 (week 2196) 2024-09-10T22:34:52.561 INFO:teuthology.orchestra.run.smithi131.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T22:34:52.562 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T22:34:52.562 INFO:teuthology.orchestra.run.smithi131.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T22:34:52.563 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T22:34:52.563 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T22:34:52.563 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T22:34:52.564 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T22:34:52.564 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: Listen normally on 3 enp3s0f1 172.21.15.131:123 2024-09-10T22:34:52.564 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: Listen normally on 4 lo [::1]:123 2024-09-10T22:34:52.564 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:72f9%5]:123 2024-09-10T22:34:52.564 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:52 ntpd[18451]: Listening on routing socket on fd #22 for interface updates 2024-09-10T22:34:53.531 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:53 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:53.531 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:53 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:53.560 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:53 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:53.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:53 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:53.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:53 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:53.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:53 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:53.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:53 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:53.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:53 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:53.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:53 ntpd[18451]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T22:34:53.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:53 ntpd[18451]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T22:34:53.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:53 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:53.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:53 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:53.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:53 ntpd[18451]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T22:34:53.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:53 ntpd[18451]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T22:34:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:54 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:54 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:54 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:54 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:54 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T22:34:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:54 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T22:34:55.531 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:55 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:55.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:55 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:55.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:55 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:55.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:55 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:55.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:55 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T22:34:55.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:55 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T22:34:55.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:55 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:55.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:55 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:55.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:55 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:55.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:55 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:55.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:55 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:55.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:55 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:55.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:55 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:55.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:55 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:55.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:55 ntpd[18451]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T22:34:55.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:55 ntpd[18451]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T22:34:55.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:55 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:55.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:55 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:55.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:55 ntpd[18451]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T22:34:55.563 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:55 ntpd[18451]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T22:34:55.563 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:55 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:55.563 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:55 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:55.563 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:55 ntpd[18451]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T22:34:55.563 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:55 ntpd[18451]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T22:34:56.531 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:56 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:56.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:56 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:56.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:56 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:56.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:56 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:56.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:56 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T22:34:56.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:56 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T22:34:56.559 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:56 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:56.559 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:56 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:57.533 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:57 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:57.533 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:57 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:57.533 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:57 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:57.533 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:57 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:57.534 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:57 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:57.534 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:57 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:57.534 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:57 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T22:34:57.534 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:57 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T22:34:57.534 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:57 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:57.534 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:57 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:57.534 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:57 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T22:34:57.534 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:57 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T22:34:57.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:57 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:57.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:57 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:57.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:57 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:57.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:57 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:57.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:57 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:57.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:57 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:57.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:57 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:57.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:57 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:57.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:57 ntpd[18451]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T22:34:57.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:57 ntpd[18451]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T22:34:57.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:57 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:57.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:57 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:57.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:57 ntpd[18451]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T22:34:57.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:57 ntpd[18451]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T22:34:57.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:57 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:57.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:57 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:57.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:57 ntpd[18451]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T22:34:57.563 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:57 ntpd[18451]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T22:34:58.531 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:58 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:58.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:58 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:58.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:58 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:58.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:58 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:58.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:58 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T22:34:58.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:58 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T22:34:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:59 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:59 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:59 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:59 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:59 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:59 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:59 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T22:34:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:59 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T22:34:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:59 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:59 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:59 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T22:34:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:34:59 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T22:34:59.560 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:59 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:59.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:59 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:59.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:59 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:59.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:59 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:59.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:59 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:59.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:59 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:59.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:59 ntpd[18451]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:34:59.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:59 ntpd[18451]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:34:59.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:59 ntpd[18451]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T22:34:59.561 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:59 ntpd[18451]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T22:34:59.562 INFO:teuthology.orchestra.run.smithi131.stdout:10 Sep 22:34:59 ntpd[18451]: ntpd: time slew +0.000136 s 2024-09-10T22:34:59.562 INFO:teuthology.orchestra.run.smithi131.stdout:ntpd: time slew +0.000136s 2024-09-10T22:34:59.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:59 ntpd[18451]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T22:34:59.562 INFO:teuthology.orchestra.run.smithi131.stderr:10 Sep 22:34:59 ntpd[18451]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T22:34:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T22:34:59.932 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================== 2024-09-10T22:34:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T22:34:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T22:34:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T22:34:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T22:35:00.531 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:35:00 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:35:00.531 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:35:00 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:35:00.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:35:00 ntpd[18459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T22:35:00.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:35:00 ntpd[18459]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T22:35:00.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:35:00 ntpd[18459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T22:35:00.532 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:35:00 ntpd[18459]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T22:35:00.532 INFO:teuthology.orchestra.run.smithi103.stdout:10 Sep 22:35:00 ntpd[18459]: ntpd: time slew -0.000502 s 2024-09-10T22:35:00.532 INFO:teuthology.orchestra.run.smithi103.stdout:ntpd: time slew -0.000502s 2024-09-10T22:35:00.533 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:35:00 ntpd[18459]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T22:35:00.533 INFO:teuthology.orchestra.run.smithi103.stderr:10 Sep 22:35:00 ntpd[18459]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T22:35:00.639 INFO:teuthology.orchestra.run.smithi103.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T22:35:00.639 INFO:teuthology.orchestra.run.smithi103.stdout:============================================================================== 2024-09-10T22:35:00.639 INFO:teuthology.orchestra.run.smithi103.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T22:35:00.639 INFO:teuthology.orchestra.run.smithi103.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T22:35:00.639 INFO:teuthology.orchestra.run.smithi103.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T22:35:00.639 INFO:teuthology.orchestra.run.smithi103.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T22:35:00.640 INFO:teuthology.run_tasks:Running task install... 2024-09-10T22:35:00.649 DEBUG:teuthology.task.install:project ceph 2024-09-10T22:35:00.649 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-10T22:35:00.649 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T22:35:00.649 INFO:teuthology.task.install:Using flavor: default 2024-09-10T22:35:00.656 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T22:35:00.656 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T22:35:00.661 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-key list | grep Ceph 2024-09-10T22:35:00.661 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-key list | grep Ceph 2024-09-10T22:35:00.765 INFO:teuthology.orchestra.run.smithi131.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T22:35:00.785 INFO:teuthology.orchestra.run.smithi103.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T22:35:00.817 INFO:teuthology.orchestra.run.smithi131.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T22:35:00.817 INFO:teuthology.orchestra.run.smithi131.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T22:35:00.818 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-10T22:35:00.818 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-10T22:35:00.819 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:35:00.836 INFO:teuthology.orchestra.run.smithi103.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T22:35:00.836 INFO:teuthology.orchestra.run.smithi103.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T22:35:00.837 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-10T22:35:00.838 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-10T22:35:00.838 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:35:00.974 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default/ 2024-09-10T22:35:00.974 INFO:teuthology.task.install.deb:Package version is 19.3.0-4854-g8f219c47-1jammy 2024-09-10T22:35:01.004 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default/ 2024-09-10T22:35:01.004 INFO:teuthology.task.install.deb:Package version is 19.3.0-4854-g8f219c47-1jammy 2024-09-10T22:35:01.116 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:35:01.117 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T22:35:01.124 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:35:01.124 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T22:35:01.136 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get update 2024-09-10T22:35:01.143 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-get update 2024-09-10T22:35:01.320 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T22:35:01.326 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T22:35:01.339 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T22:35:01.343 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T22:35:01.371 INFO:teuthology.orchestra.run.smithi131.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T22:35:01.380 INFO:teuthology.orchestra.run.smithi103.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T22:35:01.394 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-10T22:35:01.402 INFO:teuthology.orchestra.run.smithi103.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-10T22:35:01.418 INFO:teuthology.orchestra.run.smithi131.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T22:35:01.424 INFO:teuthology.orchestra.run.smithi103.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T22:35:01.439 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-09-10T22:35:01.445 INFO:teuthology.orchestra.run.smithi103.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-09-10T22:35:01.456 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T22:35:01.459 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T22:35:01.477 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-10T22:35:01.480 INFO:teuthology.orchestra.run.smithi103.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-10T22:35:01.529 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T22:35:01.611 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T22:35:01.922 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 29.3 kB in 1s (52.5 kB/s) 2024-09-10T22:35:01.941 INFO:teuthology.orchestra.run.smithi103.stdout:Fetched 29.3 kB in 1s (51.6 kB/s) 2024-09-10T22:35:02.956 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-09-10T22:35:02.969 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2024-09-10T22:35:02.971 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4854-g8f219c47-1jammy cephadm=19.3.0-4854-g8f219c47-1jammy ceph-mds=19.3.0-4854-g8f219c47-1jammy ceph-mgr=19.3.0-4854-g8f219c47-1jammy ceph-common=19.3.0-4854-g8f219c47-1jammy ceph-fuse=19.3.0-4854-g8f219c47-1jammy ceph-test=19.3.0-4854-g8f219c47-1jammy ceph-volume=19.3.0-4854-g8f219c47-1jammy radosgw=19.3.0-4854-g8f219c47-1jammy python3-rados=19.3.0-4854-g8f219c47-1jammy python3-rgw=19.3.0-4854-g8f219c47-1jammy python3-cephfs=19.3.0-4854-g8f219c47-1jammy python3-rbd=19.3.0-4854-g8f219c47-1jammy libcephfs2=19.3.0-4854-g8f219c47-1jammy libcephfs-dev=19.3.0-4854-g8f219c47-1jammy librados2=19.3.0-4854-g8f219c47-1jammy librbd1=19.3.0-4854-g8f219c47-1jammy rbd-fuse=19.3.0-4854-g8f219c47-1jammy python3-cephfs=19.3.0-4854-g8f219c47-1jammy cephfs-shell=19.3.0-4854-g8f219c47-1jammy cephfs-top=19.3.0-4854-g8f219c47-1jammy cephfs-mirror=19.3.0-4854-g8f219c47-1jammy 2024-09-10T22:35:02.984 DEBUG:teuthology.orchestra.run.smithi103:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4854-g8f219c47-1jammy cephadm=19.3.0-4854-g8f219c47-1jammy ceph-mds=19.3.0-4854-g8f219c47-1jammy ceph-mgr=19.3.0-4854-g8f219c47-1jammy ceph-common=19.3.0-4854-g8f219c47-1jammy ceph-fuse=19.3.0-4854-g8f219c47-1jammy ceph-test=19.3.0-4854-g8f219c47-1jammy ceph-volume=19.3.0-4854-g8f219c47-1jammy radosgw=19.3.0-4854-g8f219c47-1jammy python3-rados=19.3.0-4854-g8f219c47-1jammy python3-rgw=19.3.0-4854-g8f219c47-1jammy python3-cephfs=19.3.0-4854-g8f219c47-1jammy python3-rbd=19.3.0-4854-g8f219c47-1jammy libcephfs2=19.3.0-4854-g8f219c47-1jammy libcephfs-dev=19.3.0-4854-g8f219c47-1jammy librados2=19.3.0-4854-g8f219c47-1jammy librbd1=19.3.0-4854-g8f219c47-1jammy rbd-fuse=19.3.0-4854-g8f219c47-1jammy python3-cephfs=19.3.0-4854-g8f219c47-1jammy cephfs-shell=19.3.0-4854-g8f219c47-1jammy cephfs-top=19.3.0-4854-g8f219c47-1jammy cephfs-mirror=19.3.0-4854-g8f219c47-1jammy 2024-09-10T22:35:03.048 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-09-10T22:35:03.061 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2024-09-10T22:35:03.232 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2024-09-10T22:35:03.232 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2024-09-10T22:35:03.252 INFO:teuthology.orchestra.run.smithi103.stdout:Building dependency tree... 2024-09-10T22:35:03.252 INFO:teuthology.orchestra.run.smithi103.stdout:Reading state information... 2024-09-10T22:35:03.421 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T22:35:03.421 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T22:35:03.421 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T22:35:03.421 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T22:35:03.422 INFO:teuthology.orchestra.run.smithi131.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T22:35:03.422 INFO:teuthology.orchestra.run.smithi131.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T22:35:03.422 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T22:35:03.423 INFO:teuthology.orchestra.run.smithi131.stdout:The following additional packages will be installed: 2024-09-10T22:35:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T22:35:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T22:35:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-10T22:35:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-10T22:35:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-10T22:35:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-10T22:35:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-10T22:35:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-10T22:35:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-10T22:35:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-10T22:35:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2024-09-10T22:35:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-10T22:35:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-10T22:35:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-10T22:35:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-10T22:35:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-10T22:35:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-10T22:35:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-10T22:35:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-10T22:35:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-10T22:35:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-10T22:35:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-10T22:35:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-10T22:35:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-10T22:35:03.426 INFO:teuthology.orchestra.run.smithi131.stdout:Suggested packages: 2024-09-10T22:35:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T22:35:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T22:35:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T22:35:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T22:35:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T22:35:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T22:35:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T22:35:03.427 INFO:teuthology.orchestra.run.smithi131.stdout:Recommended packages: 2024-09-10T22:35:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: btrfs-tools 2024-09-10T22:35:03.449 INFO:teuthology.orchestra.run.smithi103.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T22:35:03.449 INFO:teuthology.orchestra.run.smithi103.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T22:35:03.449 INFO:teuthology.orchestra.run.smithi103.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T22:35:03.450 INFO:teuthology.orchestra.run.smithi103.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T22:35:03.450 INFO:teuthology.orchestra.run.smithi103.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T22:35:03.450 INFO:teuthology.orchestra.run.smithi103.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T22:35:03.450 INFO:teuthology.orchestra.run.smithi103.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T22:35:03.451 INFO:teuthology.orchestra.run.smithi103.stdout:The following additional packages will be installed: 2024-09-10T22:35:03.451 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T22:35:03.452 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T22:35:03.452 INFO:teuthology.orchestra.run.smithi103.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-10T22:35:03.452 INFO:teuthology.orchestra.run.smithi103.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-10T22:35:03.452 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-10T22:35:03.453 INFO:teuthology.orchestra.run.smithi103.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-10T22:35:03.453 INFO:teuthology.orchestra.run.smithi103.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-10T22:35:03.453 INFO:teuthology.orchestra.run.smithi103.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-10T22:35:03.453 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-10T22:35:03.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-10T22:35:03.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2024-09-10T22:35:03.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-10T22:35:03.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-10T22:35:03.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-10T22:35:03.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-10T22:35:03.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-10T22:35:03.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-10T22:35:03.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-10T22:35:03.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-10T22:35:03.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-10T22:35:03.454 INFO:teuthology.orchestra.run.smithi103.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-10T22:35:03.455 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-10T22:35:03.455 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-10T22:35:03.455 INFO:teuthology.orchestra.run.smithi103.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-10T22:35:03.455 INFO:teuthology.orchestra.run.smithi103.stdout:Suggested packages: 2024-09-10T22:35:03.455 INFO:teuthology.orchestra.run.smithi103.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T22:35:03.455 INFO:teuthology.orchestra.run.smithi103.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T22:35:03.455 INFO:teuthology.orchestra.run.smithi103.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T22:35:03.455 INFO:teuthology.orchestra.run.smithi103.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T22:35:03.456 INFO:teuthology.orchestra.run.smithi103.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T22:35:03.456 INFO:teuthology.orchestra.run.smithi103.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T22:35:03.456 INFO:teuthology.orchestra.run.smithi103.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T22:35:03.456 INFO:teuthology.orchestra.run.smithi103.stdout:Recommended packages: 2024-09-10T22:35:03.456 INFO:teuthology.orchestra.run.smithi103.stdout: btrfs-tools 2024-09-10T22:35:03.581 INFO:teuthology.orchestra.run.smithi131.stdout:The following NEW packages will be installed: 2024-09-10T22:35:03.582 INFO:teuthology.orchestra.run.smithi131.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T22:35:03.582 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T22:35:03.582 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-10T22:35:03.582 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-10T22:35:03.582 INFO:teuthology.orchestra.run.smithi131.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-10T22:35:03.582 INFO:teuthology.orchestra.run.smithi131.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-10T22:35:03.582 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-10T22:35:03.582 INFO:teuthology.orchestra.run.smithi131.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-10T22:35:03.583 INFO:teuthology.orchestra.run.smithi131.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-10T22:35:03.583 INFO:teuthology.orchestra.run.smithi131.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-10T22:35:03.583 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-10T22:35:03.584 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-10T22:35:03.584 INFO:teuthology.orchestra.run.smithi131.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-10T22:35:03.584 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T22:35:03.584 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T22:35:03.584 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T22:35:03.584 INFO:teuthology.orchestra.run.smithi131.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T22:35:03.584 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T22:35:03.584 INFO:teuthology.orchestra.run.smithi131.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T22:35:03.584 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-10T22:35:03.584 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-10T22:35:03.584 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-10T22:35:03.584 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T22:35:03.584 INFO:teuthology.orchestra.run.smithi131.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T22:35:03.584 INFO:teuthology.orchestra.run.smithi131.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T22:35:03.585 INFO:teuthology.orchestra.run.smithi131.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T22:35:03.585 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-10T22:35:03.585 INFO:teuthology.orchestra.run.smithi131.stdout: socat unzip xmlstarlet zip 2024-09-10T22:35:03.609 INFO:teuthology.orchestra.run.smithi103.stdout:The following NEW packages will be installed: 2024-09-10T22:35:03.609 INFO:teuthology.orchestra.run.smithi103.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T22:35:03.610 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T22:35:03.610 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-10T22:35:03.610 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-10T22:35:03.610 INFO:teuthology.orchestra.run.smithi103.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-10T22:35:03.610 INFO:teuthology.orchestra.run.smithi103.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-10T22:35:03.610 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-10T22:35:03.610 INFO:teuthology.orchestra.run.smithi103.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-10T22:35:03.612 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-10T22:35:03.612 INFO:teuthology.orchestra.run.smithi103.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-10T22:35:03.612 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-10T22:35:03.612 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-10T22:35:03.612 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-10T22:35:03.612 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T22:35:03.612 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T22:35:03.612 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T22:35:03.612 INFO:teuthology.orchestra.run.smithi103.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T22:35:03.612 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T22:35:03.612 INFO:teuthology.orchestra.run.smithi103.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T22:35:03.612 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-10T22:35:03.612 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-10T22:35:03.613 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-10T22:35:03.613 INFO:teuthology.orchestra.run.smithi103.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T22:35:03.613 INFO:teuthology.orchestra.run.smithi103.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T22:35:03.613 INFO:teuthology.orchestra.run.smithi103.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T22:35:03.613 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T22:35:03.613 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-10T22:35:03.613 INFO:teuthology.orchestra.run.smithi103.stdout: socat unzip xmlstarlet zip 2024-09-10T22:35:03.733 INFO:teuthology.orchestra.run.smithi131.stdout:0 upgraded, 125 newly installed, 0 to remove and 334 not upgraded. 2024-09-10T22:35:03.733 INFO:teuthology.orchestra.run.smithi131.stdout:Need to get 251 MB of archives. 2024-09-10T22:35:03.733 INFO:teuthology.orchestra.run.smithi131.stdout:After this operation, 936 MB of additional disk space will be used. 2024-09-10T22:35:03.733 INFO:teuthology.orchestra.run.smithi131.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4854-g8f219c47-1jammy [3,633 kB] 2024-09-10T22:35:03.760 INFO:teuthology.orchestra.run.smithi103.stdout:0 upgraded, 125 newly installed, 0 to remove and 334 not upgraded. 2024-09-10T22:35:03.761 INFO:teuthology.orchestra.run.smithi103.stdout:Need to get 251 MB of archives. 2024-09-10T22:35:03.761 INFO:teuthology.orchestra.run.smithi103.stdout:After this operation, 936 MB of additional disk space will be used. 2024-09-10T22:35:03.761 INFO:teuthology.orchestra.run.smithi103.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4854-g8f219c47-1jammy [3,633 kB] 2024-09-10T22:35:03.779 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-10T22:35:03.806 INFO:teuthology.orchestra.run.smithi103.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-10T22:35:03.861 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T22:35:03.889 INFO:teuthology.orchestra.run.smithi103.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T22:35:03.907 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-10T22:35:03.934 INFO:teuthology.orchestra.run.smithi103.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-10T22:35:03.940 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4854-g8f219c47-1jammy [3,330 kB] 2024-09-10T22:35:03.955 INFO:teuthology.orchestra.run.smithi103.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4854-g8f219c47-1jammy [3,330 kB] 2024-09-10T22:35:04.028 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4854-g8f219c47-1jammy [721 kB] 2024-09-10T22:35:04.047 INFO:teuthology.orchestra.run.smithi103.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4854-g8f219c47-1jammy [721 kB] 2024-09-10T22:35:04.058 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4854-g8f219c47-1jammy [356 kB] 2024-09-10T22:35:04.063 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4854-g8f219c47-1jammy [32.8 kB] 2024-09-10T22:35:04.064 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4854-g8f219c47-1jammy [180 kB] 2024-09-10T22:35:04.067 INFO:teuthology.orchestra.run.smithi131.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4854-g8f219c47-1jammy [71.2 kB] 2024-09-10T22:35:04.068 INFO:teuthology.orchestra.run.smithi131.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4854-g8f219c47-1jammy [338 kB] 2024-09-10T22:35:04.080 INFO:teuthology.orchestra.run.smithi103.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4854-g8f219c47-1jammy [356 kB] 2024-09-10T22:35:04.086 INFO:teuthology.orchestra.run.smithi103.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4854-g8f219c47-1jammy [32.8 kB] 2024-09-10T22:35:04.086 INFO:teuthology.orchestra.run.smithi103.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4854-g8f219c47-1jammy [180 kB] 2024-09-10T22:35:04.090 INFO:teuthology.orchestra.run.smithi103.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4854-g8f219c47-1jammy [71.2 kB] 2024-09-10T22:35:04.090 INFO:teuthology.orchestra.run.smithi103.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4854-g8f219c47-1jammy [338 kB] 2024-09-10T22:35:04.095 INFO:teuthology.orchestra.run.smithi131.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4854-g8f219c47-1jammy [7,988 kB] 2024-09-10T22:35:04.108 INFO:teuthology.orchestra.run.smithi131.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T22:35:04.118 INFO:teuthology.orchestra.run.smithi103.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4854-g8f219c47-1jammy [7,988 kB] 2024-09-10T22:35:04.133 INFO:teuthology.orchestra.run.smithi103.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T22:35:04.197 INFO:teuthology.orchestra.run.smithi131.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T22:35:04.210 INFO:teuthology.orchestra.run.smithi131.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T22:35:04.222 INFO:teuthology.orchestra.run.smithi103.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T22:35:04.235 INFO:teuthology.orchestra.run.smithi103.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T22:35:04.260 INFO:teuthology.orchestra.run.smithi131.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T22:35:04.284 INFO:teuthology.orchestra.run.smithi103.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T22:35:04.355 INFO:teuthology.orchestra.run.smithi131.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4854-g8f219c47-1jammy [112 kB] 2024-09-10T22:35:04.356 INFO:teuthology.orchestra.run.smithi131.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4854-g8f219c47-1jammy [473 kB] 2024-09-10T22:35:04.362 INFO:teuthology.orchestra.run.smithi131.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4854-g8f219c47-1jammy [28.3 MB] 2024-09-10T22:35:04.384 INFO:teuthology.orchestra.run.smithi103.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4854-g8f219c47-1jammy [112 kB] 2024-09-10T22:35:04.385 INFO:teuthology.orchestra.run.smithi103.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4854-g8f219c47-1jammy [473 kB] 2024-09-10T22:35:04.390 INFO:teuthology.orchestra.run.smithi103.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4854-g8f219c47-1jammy [28.3 MB] 2024-09-10T22:35:04.433 INFO:teuthology.orchestra.run.smithi131.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T22:35:04.441 INFO:teuthology.orchestra.run.smithi131.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T22:35:04.458 INFO:teuthology.orchestra.run.smithi103.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T22:35:04.467 INFO:teuthology.orchestra.run.smithi103.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T22:35:04.469 INFO:teuthology.orchestra.run.smithi131.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T22:35:04.477 INFO:teuthology.orchestra.run.smithi131.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-10T22:35:04.480 INFO:teuthology.orchestra.run.smithi131.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T22:35:04.481 INFO:teuthology.orchestra.run.smithi131.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T22:35:04.493 INFO:teuthology.orchestra.run.smithi103.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T22:35:04.498 INFO:teuthology.orchestra.run.smithi131.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T22:35:04.502 INFO:teuthology.orchestra.run.smithi103.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-10T22:35:04.503 INFO:teuthology.orchestra.run.smithi131.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T22:35:04.504 INFO:teuthology.orchestra.run.smithi103.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T22:35:04.505 INFO:teuthology.orchestra.run.smithi103.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T22:35:04.506 INFO:teuthology.orchestra.run.smithi131.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T22:35:04.515 INFO:teuthology.orchestra.run.smithi131.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T22:35:04.524 INFO:teuthology.orchestra.run.smithi103.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T22:35:04.528 INFO:teuthology.orchestra.run.smithi103.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T22:35:04.532 INFO:teuthology.orchestra.run.smithi103.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T22:35:04.540 INFO:teuthology.orchestra.run.smithi103.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T22:35:04.591 INFO:teuthology.orchestra.run.smithi131.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T22:35:04.593 INFO:teuthology.orchestra.run.smithi131.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T22:35:04.595 INFO:teuthology.orchestra.run.smithi131.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T22:35:04.596 INFO:teuthology.orchestra.run.smithi131.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T22:35:04.597 INFO:teuthology.orchestra.run.smithi131.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T22:35:04.597 INFO:teuthology.orchestra.run.smithi131.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T22:35:04.598 INFO:teuthology.orchestra.run.smithi131.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T22:35:04.598 INFO:teuthology.orchestra.run.smithi131.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T22:35:04.599 INFO:teuthology.orchestra.run.smithi131.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T22:35:04.615 INFO:teuthology.orchestra.run.smithi103.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T22:35:04.617 INFO:teuthology.orchestra.run.smithi103.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T22:35:04.619 INFO:teuthology.orchestra.run.smithi103.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T22:35:04.621 INFO:teuthology.orchestra.run.smithi103.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T22:35:04.621 INFO:teuthology.orchestra.run.smithi103.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T22:35:04.622 INFO:teuthology.orchestra.run.smithi103.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T22:35:04.623 INFO:teuthology.orchestra.run.smithi103.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T22:35:04.623 INFO:teuthology.orchestra.run.smithi103.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T22:35:04.623 INFO:teuthology.orchestra.run.smithi103.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T22:35:04.678 INFO:teuthology.orchestra.run.smithi131.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T22:35:04.679 INFO:teuthology.orchestra.run.smithi131.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T22:35:04.681 INFO:teuthology.orchestra.run.smithi131.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T22:35:04.703 INFO:teuthology.orchestra.run.smithi103.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T22:35:04.704 INFO:teuthology.orchestra.run.smithi103.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T22:35:04.704 INFO:teuthology.orchestra.run.smithi103.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T22:35:04.760 INFO:teuthology.orchestra.run.smithi131.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T22:35:04.762 INFO:teuthology.orchestra.run.smithi131.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T22:35:04.762 INFO:teuthology.orchestra.run.smithi131.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T22:35:04.763 INFO:teuthology.orchestra.run.smithi131.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T22:35:04.763 INFO:teuthology.orchestra.run.smithi131.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T22:35:04.764 INFO:teuthology.orchestra.run.smithi131.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T22:35:04.765 INFO:teuthology.orchestra.run.smithi131.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T22:35:04.785 INFO:teuthology.orchestra.run.smithi103.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T22:35:04.787 INFO:teuthology.orchestra.run.smithi103.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T22:35:04.788 INFO:teuthology.orchestra.run.smithi103.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T22:35:04.788 INFO:teuthology.orchestra.run.smithi103.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T22:35:04.789 INFO:teuthology.orchestra.run.smithi103.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T22:35:04.790 INFO:teuthology.orchestra.run.smithi103.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T22:35:04.790 INFO:teuthology.orchestra.run.smithi103.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T22:35:04.841 INFO:teuthology.orchestra.run.smithi131.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T22:35:04.842 INFO:teuthology.orchestra.run.smithi131.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T22:35:04.843 INFO:teuthology.orchestra.run.smithi131.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T22:35:04.866 INFO:teuthology.orchestra.run.smithi103.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T22:35:04.867 INFO:teuthology.orchestra.run.smithi103.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T22:35:04.868 INFO:teuthology.orchestra.run.smithi103.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T22:35:04.923 INFO:teuthology.orchestra.run.smithi131.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T22:35:04.928 INFO:teuthology.orchestra.run.smithi131.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T22:35:04.928 INFO:teuthology.orchestra.run.smithi131.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T22:35:04.929 INFO:teuthology.orchestra.run.smithi131.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T22:35:04.929 INFO:teuthology.orchestra.run.smithi131.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T22:35:04.930 INFO:teuthology.orchestra.run.smithi131.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T22:35:04.932 INFO:teuthology.orchestra.run.smithi131.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T22:35:04.949 INFO:teuthology.orchestra.run.smithi103.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T22:35:04.953 INFO:teuthology.orchestra.run.smithi103.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T22:35:04.953 INFO:teuthology.orchestra.run.smithi103.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T22:35:04.954 INFO:teuthology.orchestra.run.smithi103.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T22:35:04.954 INFO:teuthology.orchestra.run.smithi103.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T22:35:04.955 INFO:teuthology.orchestra.run.smithi103.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T22:35:04.957 INFO:teuthology.orchestra.run.smithi103.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T22:35:05.004 INFO:teuthology.orchestra.run.smithi131.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T22:35:05.005 INFO:teuthology.orchestra.run.smithi131.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T22:35:05.006 INFO:teuthology.orchestra.run.smithi131.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T22:35:05.029 INFO:teuthology.orchestra.run.smithi103.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T22:35:05.030 INFO:teuthology.orchestra.run.smithi103.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T22:35:05.031 INFO:teuthology.orchestra.run.smithi103.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T22:35:05.086 INFO:teuthology.orchestra.run.smithi131.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T22:35:05.086 INFO:teuthology.orchestra.run.smithi131.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T22:35:05.087 INFO:teuthology.orchestra.run.smithi131.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T22:35:05.089 INFO:teuthology.orchestra.run.smithi131.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T22:35:05.110 INFO:teuthology.orchestra.run.smithi103.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T22:35:05.111 INFO:teuthology.orchestra.run.smithi103.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T22:35:05.112 INFO:teuthology.orchestra.run.smithi103.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T22:35:05.114 INFO:teuthology.orchestra.run.smithi103.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T22:35:05.198 INFO:teuthology.orchestra.run.smithi131.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T22:35:05.198 INFO:teuthology.orchestra.run.smithi131.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T22:35:05.200 INFO:teuthology.orchestra.run.smithi131.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T22:35:05.200 INFO:teuthology.orchestra.run.smithi131.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T22:35:05.201 INFO:teuthology.orchestra.run.smithi131.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T22:35:05.272 INFO:teuthology.orchestra.run.smithi131.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T22:35:05.274 INFO:teuthology.orchestra.run.smithi131.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T22:35:05.275 INFO:teuthology.orchestra.run.smithi131.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T22:35:05.285 INFO:teuthology.orchestra.run.smithi131.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4854-g8f219c47-1jammy [5,206 kB] 2024-09-10T22:35:05.299 INFO:teuthology.orchestra.run.smithi103.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T22:35:05.300 INFO:teuthology.orchestra.run.smithi103.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T22:35:05.301 INFO:teuthology.orchestra.run.smithi103.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T22:35:05.302 INFO:teuthology.orchestra.run.smithi103.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T22:35:05.303 INFO:teuthology.orchestra.run.smithi103.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T22:35:05.346 INFO:teuthology.orchestra.run.smithi131.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T22:35:05.346 INFO:teuthology.orchestra.run.smithi131.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T22:35:05.347 INFO:teuthology.orchestra.run.smithi131.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T22:35:05.347 INFO:teuthology.orchestra.run.smithi131.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T22:35:05.348 INFO:teuthology.orchestra.run.smithi131.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T22:35:05.349 INFO:teuthology.orchestra.run.smithi131.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T22:35:05.349 INFO:teuthology.orchestra.run.smithi103.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4854-g8f219c47-1jammy [5,206 kB] 2024-09-10T22:35:05.374 INFO:teuthology.orchestra.run.smithi103.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T22:35:05.377 INFO:teuthology.orchestra.run.smithi103.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T22:35:05.377 INFO:teuthology.orchestra.run.smithi103.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T22:35:05.413 INFO:teuthology.orchestra.run.smithi131.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T22:35:05.413 INFO:teuthology.orchestra.run.smithi131.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T22:35:05.417 INFO:teuthology.orchestra.run.smithi131.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T22:35:05.442 INFO:teuthology.orchestra.run.smithi131.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4854-g8f219c47-1jammy [251 kB] 2024-09-10T22:35:05.444 INFO:teuthology.orchestra.run.smithi131.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4854-g8f219c47-1jammy [124 kB] 2024-09-10T22:35:05.446 INFO:teuthology.orchestra.run.smithi131.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4854-g8f219c47-1jammy [1,562 kB] 2024-09-10T22:35:05.447 INFO:teuthology.orchestra.run.smithi103.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T22:35:05.448 INFO:teuthology.orchestra.run.smithi103.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T22:35:05.464 INFO:teuthology.orchestra.run.smithi103.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T22:35:05.465 INFO:teuthology.orchestra.run.smithi103.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T22:35:05.466 INFO:teuthology.orchestra.run.smithi103.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T22:35:05.466 INFO:teuthology.orchestra.run.smithi103.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T22:35:05.467 INFO:teuthology.orchestra.run.smithi103.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T22:35:05.468 INFO:teuthology.orchestra.run.smithi103.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T22:35:05.471 INFO:teuthology.orchestra.run.smithi103.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T22:35:05.494 INFO:teuthology.orchestra.run.smithi131.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T22:35:05.496 INFO:teuthology.orchestra.run.smithi131.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T22:35:05.496 INFO:teuthology.orchestra.run.smithi131.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T22:35:05.500 INFO:teuthology.orchestra.run.smithi131.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T22:35:05.503 INFO:teuthology.orchestra.run.smithi131.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-10T22:35:05.503 INFO:teuthology.orchestra.run.smithi131.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4854-g8f219c47-1jammy [6,308 kB] 2024-09-10T22:35:05.503 INFO:teuthology.orchestra.run.smithi131.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T22:35:05.504 INFO:teuthology.orchestra.run.smithi131.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T22:35:05.514 INFO:teuthology.orchestra.run.smithi103.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4854-g8f219c47-1jammy [251 kB] 2024-09-10T22:35:05.534 INFO:teuthology.orchestra.run.smithi103.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4854-g8f219c47-1jammy [124 kB] 2024-09-10T22:35:05.536 INFO:teuthology.orchestra.run.smithi103.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4854-g8f219c47-1jammy [1,562 kB] 2024-09-10T22:35:05.546 INFO:teuthology.orchestra.run.smithi103.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T22:35:05.547 INFO:teuthology.orchestra.run.smithi103.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T22:35:05.548 INFO:teuthology.orchestra.run.smithi103.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T22:35:05.576 INFO:teuthology.orchestra.run.smithi131.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T22:35:05.580 INFO:teuthology.orchestra.run.smithi131.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T22:35:05.581 INFO:teuthology.orchestra.run.smithi131.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T22:35:05.584 INFO:teuthology.orchestra.run.smithi103.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4854-g8f219c47-1jammy [6,308 kB] 2024-09-10T22:35:05.627 INFO:teuthology.orchestra.run.smithi103.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T22:35:05.632 INFO:teuthology.orchestra.run.smithi103.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-10T22:35:05.633 INFO:teuthology.orchestra.run.smithi103.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T22:35:05.634 INFO:teuthology.orchestra.run.smithi103.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T22:35:05.635 INFO:teuthology.orchestra.run.smithi103.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T22:35:05.640 INFO:teuthology.orchestra.run.smithi103.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T22:35:05.641 INFO:teuthology.orchestra.run.smithi103.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T22:35:05.657 INFO:teuthology.orchestra.run.smithi131.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T22:35:05.658 INFO:teuthology.orchestra.run.smithi131.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T22:35:05.658 INFO:teuthology.orchestra.run.smithi131.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T22:35:05.659 INFO:teuthology.orchestra.run.smithi131.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T22:35:05.660 INFO:teuthology.orchestra.run.smithi131.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T22:35:05.661 INFO:teuthology.orchestra.run.smithi131.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T22:35:05.668 INFO:teuthology.orchestra.run.smithi131.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T22:35:05.702 INFO:teuthology.orchestra.run.smithi131.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4854-g8f219c47-1jammy [23.1 MB] 2024-09-10T22:35:05.708 INFO:teuthology.orchestra.run.smithi103.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T22:35:05.709 INFO:teuthology.orchestra.run.smithi103.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T22:35:05.709 INFO:teuthology.orchestra.run.smithi103.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T22:35:05.738 INFO:teuthology.orchestra.run.smithi131.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T22:35:05.739 INFO:teuthology.orchestra.run.smithi131.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T22:35:05.741 INFO:teuthology.orchestra.run.smithi131.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T22:35:05.790 INFO:teuthology.orchestra.run.smithi103.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T22:35:05.791 INFO:teuthology.orchestra.run.smithi103.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T22:35:05.792 INFO:teuthology.orchestra.run.smithi103.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T22:35:05.801 INFO:teuthology.orchestra.run.smithi103.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T22:35:05.802 INFO:teuthology.orchestra.run.smithi103.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T22:35:05.803 INFO:teuthology.orchestra.run.smithi103.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T22:35:05.804 INFO:teuthology.orchestra.run.smithi103.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4854-g8f219c47-1jammy [23.1 MB] 2024-09-10T22:35:05.806 INFO:teuthology.orchestra.run.smithi103.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T22:35:05.820 INFO:teuthology.orchestra.run.smithi131.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T22:35:05.871 INFO:teuthology.orchestra.run.smithi103.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T22:35:06.455 INFO:teuthology.orchestra.run.smithi131.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4854-g8f219c47-1jammy [14.0 kB] 2024-09-10T22:35:06.456 INFO:teuthology.orchestra.run.smithi131.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4854-g8f219c47-1jammy [880 kB] 2024-09-10T22:35:06.463 INFO:teuthology.orchestra.run.smithi131.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4854-g8f219c47-1jammy [2,454 kB] 2024-09-10T22:35:06.553 INFO:teuthology.orchestra.run.smithi131.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4854-g8f219c47-1jammy [813 kB] 2024-09-10T22:35:06.565 INFO:teuthology.orchestra.run.smithi131.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4854-g8f219c47-1jammy [160 kB] 2024-09-10T22:35:06.580 INFO:teuthology.orchestra.run.smithi131.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4854-g8f219c47-1jammy [61.4 MB] 2024-09-10T22:35:06.585 INFO:teuthology.orchestra.run.smithi103.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4854-g8f219c47-1jammy [14.0 kB] 2024-09-10T22:35:06.585 INFO:teuthology.orchestra.run.smithi103.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4854-g8f219c47-1jammy [880 kB] 2024-09-10T22:35:06.594 INFO:teuthology.orchestra.run.smithi103.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4854-g8f219c47-1jammy [2,454 kB] 2024-09-10T22:35:06.688 INFO:teuthology.orchestra.run.smithi103.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4854-g8f219c47-1jammy [813 kB] 2024-09-10T22:35:06.725 INFO:teuthology.orchestra.run.smithi103.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4854-g8f219c47-1jammy [160 kB] 2024-09-10T22:35:06.727 INFO:teuthology.orchestra.run.smithi103.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4854-g8f219c47-1jammy [61.4 MB] 2024-09-10T22:35:08.629 INFO:teuthology.orchestra.run.smithi131.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4854-g8f219c47-1jammy [8,625 kB] 2024-09-10T22:35:08.721 INFO:teuthology.orchestra.run.smithi103.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4854-g8f219c47-1jammy [8,625 kB] 2024-09-10T22:35:08.948 INFO:teuthology.orchestra.run.smithi103.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4854-g8f219c47-1jammy [14.2 kB] 2024-09-10T22:35:08.948 INFO:teuthology.orchestra.run.smithi103.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4854-g8f219c47-1jammy [55.8 MB] 2024-09-10T22:35:08.949 INFO:teuthology.orchestra.run.smithi131.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4854-g8f219c47-1jammy [14.2 kB] 2024-09-10T22:35:08.950 INFO:teuthology.orchestra.run.smithi131.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4854-g8f219c47-1jammy [55.8 MB] 2024-09-10T22:35:10.539 INFO:teuthology.orchestra.run.smithi103.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4854-g8f219c47-1jammy [130 kB] 2024-09-10T22:35:10.540 INFO:teuthology.orchestra.run.smithi103.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-4854-g8f219c47-1jammy [233 kB] 2024-09-10T22:35:10.542 INFO:teuthology.orchestra.run.smithi103.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-4854-g8f219c47-1jammy [33.9 kB] 2024-09-10T22:35:10.543 INFO:teuthology.orchestra.run.smithi103.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-4854-g8f219c47-1jammy [23.4 kB] 2024-09-10T22:35:10.543 INFO:teuthology.orchestra.run.smithi103.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4854-g8f219c47-1jammy [39.0 kB] 2024-09-10T22:35:10.544 INFO:teuthology.orchestra.run.smithi103.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4854-g8f219c47-1jammy [15.9 MB] 2024-09-10T22:35:10.981 INFO:teuthology.orchestra.run.smithi103.stdout:Get:125 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4854-g8f219c47-1jammy [91.2 kB] 2024-09-10T22:35:11.062 INFO:teuthology.orchestra.run.smithi131.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4854-g8f219c47-1jammy [130 kB] 2024-09-10T22:35:11.063 INFO:teuthology.orchestra.run.smithi131.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-4854-g8f219c47-1jammy [233 kB] 2024-09-10T22:35:11.065 INFO:teuthology.orchestra.run.smithi131.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-4854-g8f219c47-1jammy [33.9 kB] 2024-09-10T22:35:11.066 INFO:teuthology.orchestra.run.smithi131.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-4854-g8f219c47-1jammy [23.4 kB] 2024-09-10T22:35:11.066 INFO:teuthology.orchestra.run.smithi131.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4854-g8f219c47-1jammy [39.0 kB] 2024-09-10T22:35:11.067 INFO:teuthology.orchestra.run.smithi131.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4854-g8f219c47-1jammy [15.9 MB] 2024-09-10T22:35:11.320 INFO:teuthology.orchestra.run.smithi131.stdout:Get:125 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4854-g8f219c47-1jammy [91.2 kB] 2024-09-10T22:35:11.630 INFO:teuthology.orchestra.run.smithi103.stdout:Fetched 251 MB in 7s (34.2 MB/s) 2024-09-10T22:35:11.780 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-10T22:35:11.844 INFO:teuthology.orchestra.run.smithi103.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-10T22:35:11.847 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-10T22:35:11.897 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-10T22:35:11.975 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 251 MB in 8s (32.6 MB/s) 2024-09-10T22:35:12.115 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-10T22:35:12.180 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-10T22:35:12.183 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-10T22:35:12.198 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T22:35:12.211 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T22:35:12.239 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-10T22:35:12.256 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T22:35:12.542 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T22:35:12.555 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T22:35:12.567 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cmd2. 2024-09-10T22:35:12.581 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-10T22:35:12.600 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T22:35:12.626 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-10T22:35:12.911 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cmd2. 2024-09-10T22:35:12.925 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-10T22:35:12.961 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-10T22:35:12.970 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T22:35:12.984 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T22:35:13.071 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T22:35:13.281 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T22:35:13.295 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T22:35:13.382 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T22:35:13.407 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T22:35:13.421 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T22:35:13.466 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T22:35:13.710 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T22:35:13.724 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T22:35:13.769 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T22:35:13.827 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T22:35:13.841 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T22:35:13.885 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T22:35:14.130 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T22:35:14.149 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T22:35:14.188 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T22:35:14.347 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T22:35:14.361 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T22:35:14.413 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T22:35:14.560 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T22:35:14.574 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T22:35:14.624 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T22:35:15.009 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T22:35:15.023 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T22:35:15.045 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T22:35:15.059 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T22:35:15.067 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T22:35:15.104 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T22:35:15.403 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T22:35:15.417 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T22:35:15.453 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T22:35:15.465 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T22:35:15.480 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T22:35:15.515 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T22:35:15.835 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T22:35:15.840 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T22:35:15.850 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T22:35:15.853 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T22:35:15.893 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T22:35:15.898 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T22:35:16.196 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librados2. 2024-09-10T22:35:16.212 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../010-librados2_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:16.217 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package librados2. 2024-09-10T22:35:16.231 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../010-librados2_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:16.254 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librados2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:16.268 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librados2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:16.704 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libnbd0. 2024-09-10T22:35:16.717 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../011-libnbd0_1.10.5-1_amd64.deb ... 2024-09-10T22:35:16.741 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libnbd0. 2024-09-10T22:35:16.754 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-10T22:35:16.756 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../011-libnbd0_1.10.5-1_amd64.deb ... 2024-09-10T22:35:16.800 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-10T22:35:17.069 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librbd1. 2024-09-10T22:35:17.081 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package librbd1. 2024-09-10T22:35:17.084 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../012-librbd1_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:17.095 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../012-librbd1_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:17.119 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librbd1 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:17.140 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librbd1 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:17.505 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T22:35:17.519 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../013-libcephfs2_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:17.563 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libcephfs2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:17.567 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T22:35:17.581 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../013-libcephfs2_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:17.618 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libcephfs2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:17.853 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rados. 2024-09-10T22:35:17.866 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rados. 2024-09-10T22:35:17.866 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../014-python3-rados_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:17.880 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../014-python3-rados_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:17.904 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rados (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:17.924 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rados (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:18.227 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T22:35:18.231 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T22:35:18.242 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../015-python3-ceph-argparse_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:35:18.244 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../015-python3-ceph-argparse_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:35:18.277 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-ceph-argparse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:18.281 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-ceph-argparse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:18.496 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T22:35:18.512 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../016-python3-cephfs_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:18.534 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T22:35:18.546 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cephfs (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:18.547 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../016-python3-cephfs_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:18.584 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cephfs (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:18.883 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T22:35:18.898 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../017-python3-ceph-common_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:35:18.911 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T22:35:18.925 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../017-python3-ceph-common_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:35:18.941 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-ceph-common (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:18.970 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-ceph-common (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:19.278 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T22:35:19.289 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T22:35:19.293 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T22:35:19.302 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T22:35:19.331 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T22:35:19.336 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T22:35:19.589 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T22:35:19.604 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../019-python3-rbd_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:19.617 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T22:35:19.630 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../019-python3-rbd_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:19.647 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rbd (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:19.667 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rbd (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:19.967 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T22:35:19.982 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T22:35:20.025 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T22:35:20.329 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T22:35:20.342 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T22:35:20.387 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T22:35:20.545 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T22:35:20.561 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../021-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T22:35:20.603 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T22:35:20.665 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T22:35:20.679 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../021-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T22:35:20.748 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T22:35:20.906 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T22:35:20.921 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../022-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T22:35:20.965 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T22:35:21.018 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T22:35:21.032 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../022-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T22:35:21.067 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T22:35:21.285 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua5.1. 2024-09-10T22:35:21.300 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../023-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T22:35:21.335 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T22:35:21.396 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package lua5.1. 2024-09-10T22:35:21.411 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../023-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T22:35:21.454 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T22:35:21.638 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-any. 2024-09-10T22:35:21.653 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../024-lua-any_27ubuntu1_all.deb ... 2024-09-10T22:35:21.696 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T22:35:21.757 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package lua-any. 2024-09-10T22:35:21.771 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../024-lua-any_27ubuntu1_all.deb ... 2024-09-10T22:35:21.815 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T22:35:21.949 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package zip. 2024-09-10T22:35:21.964 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../025-zip_3.0-12build2_amd64.deb ... 2024-09-10T22:35:22.007 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T22:35:22.076 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package zip. 2024-09-10T22:35:22.090 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../025-zip_3.0-12build2_amd64.deb ... 2024-09-10T22:35:22.126 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T22:35:22.344 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package unzip. 2024-09-10T22:35:22.359 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../026-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T22:35:22.394 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T22:35:22.413 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package unzip. 2024-09-10T22:35:22.427 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../026-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T22:35:22.471 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T22:35:22.790 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package luarocks. 2024-09-10T22:35:22.805 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../027-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T22:35:22.849 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T22:35:22.883 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package luarocks. 2024-09-10T22:35:22.896 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../027-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T22:35:22.933 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T22:35:23.233 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librgw2. 2024-09-10T22:35:23.247 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../028-librgw2_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:23.291 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librgw2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:23.357 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package librgw2. 2024-09-10T22:35:23.368 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../028-librgw2_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:23.407 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librgw2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:23.811 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T22:35:23.825 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../029-python3-rgw_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:23.869 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rgw (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:23.951 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T22:35:23.965 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../029-python3-rgw_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:24.001 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rgw (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:24.197 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T22:35:24.212 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../030-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T22:35:24.255 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T22:35:24.354 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T22:35:24.367 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../030-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T22:35:24.412 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T22:35:24.575 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T22:35:24.590 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../031-libradosstriper1_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:24.633 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libradosstriper1 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:24.740 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T22:35:24.753 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../031-libradosstriper1_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:24.790 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libradosstriper1 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:25.053 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-common. 2024-09-10T22:35:25.069 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../032-ceph-common_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:25.112 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-common (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:25.419 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-common. 2024-09-10T22:35:25.432 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../032-ceph-common_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:25.477 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-common (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:26.434 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-base. 2024-09-10T22:35:26.449 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../033-ceph-base_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:26.501 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-base (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:26.724 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-base. 2024-09-10T22:35:26.740 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../033-ceph-base_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:26.791 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-base (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:27.063 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T22:35:27.077 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../034-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T22:35:27.122 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T22:35:27.378 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T22:35:27.391 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../034-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T22:35:27.424 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T22:35:27.428 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T22:35:27.439 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../035-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T22:35:27.483 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T22:35:27.731 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T22:35:27.745 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../035-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T22:35:27.778 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T22:35:27.789 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T22:35:27.793 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../036-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T22:35:27.828 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T22:35:28.109 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T22:35:28.123 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../036-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T22:35:28.131 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T22:35:28.146 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../037-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T22:35:28.159 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T22:35:28.189 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T22:35:28.495 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T22:35:28.512 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../037-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T22:35:28.512 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T22:35:28.524 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../038-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T22:35:28.553 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T22:35:28.576 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T22:35:28.837 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T22:35:28.852 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../039-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T22:35:28.856 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T22:35:28.870 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../038-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T22:35:28.887 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T22:35:28.914 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T22:35:29.182 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-portend. 2024-09-10T22:35:29.196 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../040-python3-portend_3.0.0-1_all.deb ... 2024-09-10T22:35:29.240 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T22:35:29.251 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T22:35:29.265 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../039-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T22:35:29.309 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T22:35:29.543 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T22:35:29.558 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../041-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T22:35:29.612 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-portend. 2024-09-10T22:35:29.626 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../040-python3-portend_3.0.0-1_all.deb ... 2024-09-10T22:35:29.626 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T22:35:29.662 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T22:35:29.871 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T22:35:29.885 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../042-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T22:35:29.921 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T22:35:29.981 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T22:35:29.995 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../041-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T22:35:30.039 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T22:35:30.200 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T22:35:30.214 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../043-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T22:35:30.249 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T22:35:30.342 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T22:35:30.356 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../042-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T22:35:30.417 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T22:35:30.570 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T22:35:30.585 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../044-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T22:35:30.628 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T22:35:30.762 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T22:35:30.776 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../043-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T22:35:30.821 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T22:35:30.981 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T22:35:30.996 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../045-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T22:35:31.039 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T22:35:31.157 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T22:35:31.171 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../044-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T22:35:31.215 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T22:35:31.325 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-mako. 2024-09-10T22:35:31.340 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../046-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T22:35:31.375 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T22:35:31.535 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T22:35:31.549 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../045-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T22:35:31.585 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T22:35:31.679 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T22:35:31.694 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../047-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T22:35:31.737 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T22:35:31.904 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-mako. 2024-09-10T22:35:31.919 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../046-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T22:35:31.963 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T22:35:32.074 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T22:35:32.089 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../048-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T22:35:32.132 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T22:35:32.316 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T22:35:32.330 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../047-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T22:35:32.391 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T22:35:32.443 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-webob. 2024-09-10T22:35:32.458 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../049-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T22:35:32.502 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T22:35:32.702 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T22:35:32.716 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../048-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T22:35:32.760 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T22:35:32.805 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T22:35:32.820 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../050-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T22:35:32.857 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T22:35:33.080 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-webob. 2024-09-10T22:35:33.092 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../049-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T22:35:33.124 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T22:35:33.129 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T22:35:33.139 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../051-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T22:35:33.199 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T22:35:33.449 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T22:35:33.460 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../050-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T22:35:33.469 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-paste. 2024-09-10T22:35:33.484 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../052-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T22:35:33.493 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T22:35:33.527 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T22:35:33.819 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T22:35:33.829 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../051-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T22:35:33.830 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T22:35:33.846 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../053-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T22:35:33.869 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T22:35:33.889 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T22:35:34.155 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-paste. 2024-09-10T22:35:34.158 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T22:35:34.165 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../052-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T22:35:34.174 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../054-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T22:35:34.208 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T22:35:34.230 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T22:35:34.528 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T22:35:34.541 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T22:35:34.543 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../055-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T22:35:34.551 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../053-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T22:35:34.587 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T22:35:34.591 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T22:35:34.894 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T22:35:34.898 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T22:35:34.907 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../054-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T22:35:34.913 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../056-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T22:35:34.944 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T22:35:34.956 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T22:35:35.247 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T22:35:35.258 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../055-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T22:35:35.297 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T22:35:35.311 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T22:35:35.326 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../057-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T22:35:35.369 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T22:35:35.698 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-idna. 2024-09-10T22:35:35.713 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../058-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T22:35:35.756 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T22:35:35.766 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T22:35:35.780 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../056-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T22:35:35.825 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T22:35:36.205 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T22:35:36.220 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../057-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T22:35:36.288 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T22:35:36.885 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T22:35:36.896 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../059-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T22:35:36.934 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T22:35:37.271 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-requests. 2024-09-10T22:35:37.285 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../060-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T22:35:37.329 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T22:35:37.374 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-idna. 2024-09-10T22:35:37.388 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../058-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T22:35:37.424 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T22:35:37.641 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T22:35:37.653 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../061-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T22:35:37.690 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T22:35:37.769 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T22:35:37.782 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../059-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T22:35:37.819 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T22:35:38.019 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T22:35:38.032 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../062-ceph-mgr-modules-core_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:35:38.069 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:38.130 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-requests. 2024-09-10T22:35:38.143 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../060-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T22:35:38.189 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T22:35:38.441 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T22:35:38.453 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../063-libsqlite3-mod-ceph_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:38.491 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:38.525 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T22:35:38.538 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../061-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T22:35:38.583 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T22:35:38.811 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T22:35:38.823 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../064-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T22:35:38.860 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T22:35:38.869 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T22:35:38.883 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../062-ceph-mgr-modules-core_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:35:38.928 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:39.205 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T22:35:39.221 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../065-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T22:35:39.263 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T22:35:39.332 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T22:35:39.345 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../063-libsqlite3-mod-ceph_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:39.390 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:39.558 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T22:35:39.572 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../066-ceph-mgr_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:39.616 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:39.702 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T22:35:39.715 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../064-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T22:35:39.760 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T22:35:39.987 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T22:35:40.000 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../067-ceph-mon_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:40.045 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mon (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:40.063 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T22:35:40.077 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../065-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T22:35:40.121 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T22:35:40.499 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T22:35:40.513 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../066-ceph-mgr_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:40.557 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:40.640 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T22:35:40.653 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../068-ceph-osd_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:40.784 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-osd (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:40.919 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T22:35:40.933 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../067-ceph-mon_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:40.994 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mon (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:41.547 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T22:35:41.561 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../068-ceph-osd_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:41.631 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-osd (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:41.652 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph. 2024-09-10T22:35:41.665 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../069-ceph_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:41.719 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:42.021 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T22:35:42.035 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../070-ceph-fuse_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:42.079 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-fuse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:42.433 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T22:35:42.442 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph. 2024-09-10T22:35:42.446 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../071-ceph-mds_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:42.455 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../069-ceph_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:42.490 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mds (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:42.500 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:42.820 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T22:35:42.833 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../070-ceph-fuse_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:42.852 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephadm. 2024-09-10T22:35:42.866 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../072-cephadm_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:42.903 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-fuse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:42.910 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephadm (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:43.230 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T22:35:43.239 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T22:35:43.244 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../073-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T22:35:43.253 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../071-ceph-mds_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:43.288 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T22:35:43.297 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mds (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:43.600 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T22:35:43.613 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../074-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T22:35:43.658 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T22:35:43.700 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package cephadm. 2024-09-10T22:35:43.713 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../072-cephadm_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:43.758 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking cephadm (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:44.087 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T22:35:44.100 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../073-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T22:35:44.182 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T22:35:44.481 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T22:35:44.493 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../074-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T22:35:44.522 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T22:35:44.671 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-babel. 2024-09-10T22:35:44.684 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../075-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T22:35:44.713 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T22:35:44.999 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T22:35:45.011 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../076-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T22:35:45.073 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T22:35:45.394 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T22:35:45.407 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../077-ceph-mgr-cephadm_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:35:45.444 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:45.544 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-babel. 2024-09-10T22:35:45.556 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../075-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T22:35:45.594 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T22:35:45.789 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T22:35:45.802 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../078-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T22:35:45.839 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T22:35:46.084 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-routes. 2024-09-10T22:35:46.097 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../079-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T22:35:46.105 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T22:35:46.117 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../076-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T22:35:46.134 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T22:35:46.155 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T22:35:46.471 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T22:35:46.484 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../080-ceph-mgr-dashboard_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:35:46.499 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T22:35:46.512 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../077-ceph-mgr-cephadm_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:35:46.512 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:46.550 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:46.911 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T22:35:46.924 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../078-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T22:35:46.961 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T22:35:47.247 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-routes. 2024-09-10T22:35:47.260 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../079-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T22:35:47.297 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T22:35:47.634 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T22:35:47.647 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../080-ceph-mgr-dashboard_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:35:47.692 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:48.885 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T22:35:48.893 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../081-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T22:35:48.934 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T22:35:49.405 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T22:35:49.411 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../082-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T22:35:49.533 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T22:35:49.928 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T22:35:49.938 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../083-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T22:35:49.978 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T22:35:49.982 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T22:35:49.996 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../081-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T22:35:50.066 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T22:35:50.249 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T22:35:50.258 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../084-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T22:35:50.298 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T22:35:50.578 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T22:35:50.590 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../082-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T22:35:50.730 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T22:35:50.974 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T22:35:50.981 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../085-ceph-mgr-diskprediction-local_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:35:51.057 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:51.068 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T22:35:51.080 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../083-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T22:35:51.118 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T22:35:51.446 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T22:35:51.458 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../084-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T22:35:51.487 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T22:35:51.986 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T22:35:51.994 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../086-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T22:35:52.044 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T22:35:52.122 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T22:35:52.134 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../085-ceph-mgr-diskprediction-local_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:35:52.172 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:52.372 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T22:35:52.381 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../087-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T22:35:52.422 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T22:35:52.751 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T22:35:52.759 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../088-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T22:35:52.800 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T22:35:53.112 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T22:35:53.121 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../089-python3-rsa_4.8-1_all.deb ... 2024-09-10T22:35:53.162 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T22:35:53.251 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T22:35:53.265 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../086-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T22:35:53.309 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T22:35:53.483 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T22:35:53.492 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../090-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T22:35:53.532 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T22:35:53.612 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T22:35:53.625 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../087-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T22:35:53.662 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T22:35:53.844 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T22:35:53.853 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../091-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T22:35:53.894 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T22:35:53.974 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T22:35:53.987 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../088-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T22:35:54.024 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T22:35:54.206 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T22:35:54.218 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../092-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T22:35:54.256 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T22:35:54.302 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T22:35:54.315 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../089-python3-rsa_4.8-1_all.deb ... 2024-09-10T22:35:54.352 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T22:35:54.609 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T22:35:54.624 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../093-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T22:35:54.667 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T22:35:54.706 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T22:35:54.719 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../090-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T22:35:54.756 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T22:35:55.076 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T22:35:55.088 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../091-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T22:35:55.159 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T22:35:55.332 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T22:35:55.341 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../094-ceph-mgr-k8sevents_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:35:55.382 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:55.454 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T22:35:55.467 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../092-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T22:35:55.495 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T22:35:55.701 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T22:35:55.710 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../095-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T22:35:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T22:35:55.800 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T22:35:55.812 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../093-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T22:35:55.849 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T22:35:56.338 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T22:35:56.348 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../096-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T22:35:56.388 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T22:35:56.649 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package jq. 2024-09-10T22:35:56.659 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../097-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T22:35:56.699 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T22:35:56.818 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T22:35:56.841 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../094-ceph-mgr-k8sevents_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:35:56.855 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:57.093 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package socat. 2024-09-10T22:35:57.104 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../098-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T22:35:57.143 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T22:35:57.192 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T22:35:57.204 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../095-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T22:35:57.241 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T22:35:57.405 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T22:35:57.416 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../099-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T22:35:57.455 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T22:35:57.578 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T22:35:57.591 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../096-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T22:35:57.636 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T22:35:57.793 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-test. 2024-09-10T22:35:57.802 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../100-ceph-test_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:57.842 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-test (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:35:57.939 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package jq. 2024-09-10T22:35:57.952 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../097-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T22:35:57.981 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T22:35:58.209 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package socat. 2024-09-10T22:35:58.221 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../098-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T22:35:58.259 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T22:35:58.596 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T22:35:58.608 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../099-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T22:35:58.646 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T22:35:59.050 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-test. 2024-09-10T22:35:59.063 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../100-ceph-test_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:35:59.100 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-test (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:00.064 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T22:36:00.074 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../101-ceph-volume_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:36:00.114 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-volume (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:00.493 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-10T22:36:00.503 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../102-cephfs-mirror_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:36:00.543 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephfs-mirror (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:00.832 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-colorama. 2024-09-10T22:36:00.841 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../103-python3-colorama_0.4.4-1_all.deb ... 2024-09-10T22:36:00.873 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-10T22:36:01.142 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephfs-shell. 2024-09-10T22:36:01.152 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../104-cephfs-shell_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:36:01.192 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephfs-shell (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:01.363 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T22:36:01.377 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../101-ceph-volume_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:36:01.430 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-volume (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:01.453 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephfs-top. 2024-09-10T22:36:01.463 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../105-cephfs-top_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:36:01.503 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephfs-top (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:01.739 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T22:36:01.749 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../106-libcephfs-dev_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:36:01.797 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libcephfs-dev (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:01.834 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-10T22:36:01.849 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../102-cephfs-mirror_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:36:01.893 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking cephfs-mirror (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:02.116 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T22:36:02.127 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../107-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T22:36:02.183 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T22:36:02.204 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-colorama. 2024-09-10T22:36:02.218 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../103-python3-colorama_0.4.4-1_all.deb ... 2024-09-10T22:36:02.262 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-10T22:36:02.487 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T22:36:02.497 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../108-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T22:36:02.528 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T22:36:02.548 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package cephfs-shell. 2024-09-10T22:36:02.562 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../104-cephfs-shell_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:36:02.606 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking cephfs-shell (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:02.859 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package cephfs-top. 2024-09-10T22:36:02.873 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../105-cephfs-top_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T22:36:02.882 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T22:36:02.893 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../109-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T22:36:02.917 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking cephfs-top (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:02.932 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T22:36:03.204 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T22:36:03.218 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../106-libcephfs-dev_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:36:03.262 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libcephfs-dev (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:03.379 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package pkg-config. 2024-09-10T22:36:03.388 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../110-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T22:36:03.428 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T22:36:03.557 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T22:36:03.571 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../107-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T22:36:03.637 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T22:36:03.681 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T22:36:03.692 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../111-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T22:36:03.731 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T22:36:03.961 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T22:36:03.976 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../108-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T22:36:04.019 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T22:36:04.151 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T22:36:04.160 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../112-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T22:36:04.201 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T22:36:04.416 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T22:36:04.430 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../109-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T22:36:04.474 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T22:36:04.526 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T22:36:04.535 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../113-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T22:36:04.578 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T22:36:04.890 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T22:36:04.899 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../114-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T22:36:04.921 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package pkg-config. 2024-09-10T22:36:04.931 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T22:36:04.934 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../110-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T22:36:04.971 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T22:36:05.217 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T22:36:05.224 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T22:36:05.227 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../115-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T22:36:05.238 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../111-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T22:36:05.267 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T22:36:05.282 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T22:36:05.578 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-py. 2024-09-10T22:36:05.588 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../116-python3-py_1.10.0-1_all.deb ... 2024-09-10T22:36:05.636 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T22:36:05.710 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T22:36:05.724 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../112-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T22:36:05.769 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T22:36:05.948 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T22:36:05.958 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../117-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T22:36:05.998 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T22:36:06.072 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T22:36:06.086 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../113-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T22:36:06.130 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T22:36:06.459 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T22:36:06.459 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T22:36:06.469 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../118-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T22:36:06.473 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../114-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T22:36:06.509 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T22:36:06.517 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T22:36:06.812 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-toml. 2024-09-10T22:36:06.822 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../119-python3-toml_0.10.2-1_all.deb ... 2024-09-10T22:36:06.853 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T22:36:06.867 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../115-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T22:36:06.898 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T22:36:06.903 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T22:36:07.207 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T22:36:07.217 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../120-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T22:36:07.257 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T22:36:07.273 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-py. 2024-09-10T22:36:07.287 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../116-python3-py_1.10.0-1_all.deb ... 2024-09-10T22:36:07.323 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T22:36:07.577 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T22:36:07.586 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../121-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T22:36:07.626 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T22:36:07.660 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T22:36:07.674 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../117-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T22:36:07.710 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T22:36:07.896 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T22:36:07.906 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../122-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T22:36:07.945 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T22:36:08.181 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T22:36:08.193 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../118-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T22:36:08.230 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T22:36:08.525 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-toml. 2024-09-10T22:36:08.538 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../119-python3-toml_0.10.2-1_all.deb ... 2024-09-10T22:36:08.575 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T22:36:08.691 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package radosgw. 2024-09-10T22:36:08.700 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../123-radosgw_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:36:08.740 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking radosgw (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:08.903 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T22:36:08.916 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../120-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T22:36:08.961 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T22:36:09.290 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T22:36:09.303 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../121-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T22:36:09.340 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T22:36:09.452 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T22:36:09.463 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../124-rbd-fuse_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:36:09.502 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking rbd-fuse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:09.635 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T22:36:09.648 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../122-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T22:36:09.693 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T22:36:09.785 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T22:36:10.049 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T22:36:10.174 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T22:36:10.405 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package radosgw. 2024-09-10T22:36:10.418 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../123-radosgw_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:36:10.433 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T22:36:10.455 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking radosgw (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:10.841 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T22:36:11.175 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T22:36:11.189 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../124-rbd-fuse_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T22:36:11.234 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking rbd-fuse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:11.424 INFO:teuthology.orchestra.run.smithi131.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T22:36:11.460 INFO:teuthology.orchestra.run.smithi131.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-10T22:36:11.501 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephadm (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:11.744 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T22:36:12.018 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T22:36:12.020 INFO:teuthology.orchestra.run.smithi131.stdout:Adding system user cephadm....done 2024-09-10T22:36:12.174 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T22:36:12.174 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T22:36:12.429 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T22:36:12.483 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T22:36:12.734 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T22:36:12.816 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T22:36:12.877 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T22:36:13.120 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T22:36:13.388 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T22:36:13.417 INFO:teuthology.orchestra.run.smithi103.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T22:36:13.470 INFO:teuthology.orchestra.run.smithi103.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-10T22:36:13.517 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up cephadm (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:13.522 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T22:36:13.833 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T22:36:14.069 INFO:teuthology.orchestra.run.smithi103.stdout:Adding system user cephadm....done 2024-09-10T22:36:14.201 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T22:36:14.224 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T22:36:14.500 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T22:36:14.510 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-10T22:36:14.760 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T22:36:14.761 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T22:36:14.886 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T22:36:15.145 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T22:36:15.146 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T22:36:15.413 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T22:36:15.431 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T22:36:15.548 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T22:36:15.691 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T22:36:15.858 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T22:36:15.966 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T22:36:16.227 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T22:36:16.242 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-ceph-argparse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:16.493 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T22:36:16.495 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-10T22:36:16.619 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-10T22:36:16.745 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T22:36:16.772 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T22:36:17.057 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T22:36:17.163 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-10T22:36:17.325 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T22:36:17.439 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T22:36:17.585 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T22:36:17.589 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T22:36:17.857 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T22:36:17.928 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T22:36:18.187 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-ceph-argparse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:18.268 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T22:36:18.296 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T22:36:18.352 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T22:36:18.455 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T22:36:18.461 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T22:36:18.606 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-10T22:36:18.749 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T22:36:18.829 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T22:36:18.858 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-10T22:36:18.963 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T22:36:19.109 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T22:36:19.240 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T22:36:19.260 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T22:36:19.516 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T22:36:19.520 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T22:36:19.817 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T22:36:19.940 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T22:36:19.950 INFO:teuthology.orchestra.run.smithi103.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T22:36:20.001 INFO:teuthology.orchestra.run.smithi103.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T22:36:20.073 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T22:36:20.199 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T22:36:20.559 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T22:36:20.619 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T22:36:20.685 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T22:36:20.888 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T22:36:20.953 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T22:36:21.013 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T22:36:21.164 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T22:36:21.230 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T22:36:21.482 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T22:36:21.539 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T22:36:21.673 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T22:36:21.883 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T22:36:22.134 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T22:36:22.426 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T22:36:22.520 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T22:36:22.702 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T22:36:22.828 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T22:36:22.829 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-10T22:36:22.954 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T22:36:23.146 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T22:36:23.314 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T22:36:23.542 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T22:36:23.715 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T22:36:23.807 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T22:36:23.933 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-ceph-common (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:23.966 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T22:36:24.226 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T22:36:24.352 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T22:36:24.560 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T22:36:24.653 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-10T22:36:24.979 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T22:36:25.330 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T22:36:25.607 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T22:36:25.733 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-ceph-common (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:25.782 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T22:36:26.042 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T22:36:26.059 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T22:36:26.176 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T22:36:26.385 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T22:36:26.428 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T22:36:26.553 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T22:36:26.688 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T22:36:26.998 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T22:36:27.474 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T22:36:27.634 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T22:36:27.733 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T22:36:27.852 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T22:36:27.859 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T22:36:27.986 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T22:36:28.168 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T22:36:28.254 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T22:36:28.380 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T22:36:28.420 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T22:36:28.506 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T22:36:28.687 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T22:36:28.816 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T22:36:28.955 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T22:36:29.067 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T22:36:29.223 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T22:36:29.319 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T22:36:29.478 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T22:36:29.516 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T22:36:29.641 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T22:36:29.796 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T22:36:29.926 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T22:36:30.052 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T22:36:30.089 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T22:36:30.345 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T22:36:30.365 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T22:36:30.633 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T22:36:30.702 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T22:36:30.926 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T22:36:30.980 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T22:36:31.106 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T22:36:31.202 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T22:36:31.224 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T22:36:31.312 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T22:36:31.370 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T22:36:31.533 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T22:36:31.657 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T22:36:31.659 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T22:36:31.780 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T22:36:32.052 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T22:36:32.082 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T22:36:32.328 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T22:36:32.391 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T22:36:32.471 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T22:36:32.651 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T22:36:32.739 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T22:36:32.777 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T22:36:32.865 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T22:36:32.903 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T22:36:32.992 INFO:teuthology.orchestra.run.smithi103.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T22:36:33.183 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T22:36:33.272 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T22:36:33.398 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T22:36:33.476 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T22:36:33.793 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T22:36:33.845 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T22:36:33.971 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T22:36:34.053 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T22:36:34.178 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T22:36:34.256 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T22:36:34.438 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T22:36:34.574 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T22:36:34.597 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T22:36:34.833 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T22:36:34.923 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T22:36:35.201 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T22:36:35.233 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T22:36:35.494 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T22:36:35.595 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T22:36:35.721 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T22:36:35.872 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T22:36:35.998 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librados2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:36.014 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T22:36:36.124 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:36.225 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T22:36:36.291 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T22:36:36.551 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T22:36:36.553 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libcephfs2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:36.679 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libradosstriper1 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:36.821 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T22:36:36.936 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T22:36:37.115 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librbd1 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:37.229 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T22:36:37.232 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-modules-core (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:37.358 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-fuse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:37.567 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T22:36:37.567 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T22:36:37.581 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T22:36:37.708 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librados2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:37.834 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:37.969 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T22:36:38.201 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libcephfs-dev (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:38.305 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libcephfs2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:38.327 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rados (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:38.453 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librgw2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:38.456 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libradosstriper1 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:38.579 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephfs-top (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:38.582 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T22:36:38.713 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T22:36:38.876 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librbd1 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:38.977 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-modules-core (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:39.128 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-fuse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:39.339 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T22:36:39.339 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T22:36:39.971 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libcephfs-dev (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:39.984 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rbd (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:40.084 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up rbd-fuse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:40.097 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rados (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:40.210 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rgw (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:40.223 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librgw2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:40.361 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cephfs (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:40.374 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up cephfs-top (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:40.487 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephfs-shell (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:40.501 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T22:36:40.613 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-common (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:41.141 INFO:teuthology.orchestra.run.smithi131.stdout:Adding group ceph....done 2024-09-10T22:36:41.534 INFO:teuthology.orchestra.run.smithi131.stdout:Adding system user ceph....done 2024-09-10T22:36:41.702 INFO:teuthology.orchestra.run.smithi131.stdout:Setting system user ceph properties....done 2024-09-10T22:36:41.723 INFO:teuthology.orchestra.run.smithi131.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T22:36:41.763 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rbd (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:41.863 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T22:36:41.889 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up rbd-fuse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:42.260 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T22:36:42.323 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rgw (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:42.449 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cephfs (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:42.576 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up cephfs-shell (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:42.693 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-common (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:42.906 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephfs-mirror (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:43.123 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-10T22:36:43.123 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-10T22:36:43.272 INFO:teuthology.orchestra.run.smithi103.stdout:Adding group ceph....done 2024-09-10T22:36:43.691 INFO:teuthology.orchestra.run.smithi103.stdout:Adding system user ceph....done 2024-09-10T22:36:43.740 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-test (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:43.859 INFO:teuthology.orchestra.run.smithi103.stdout:Setting system user ceph properties....done 2024-09-10T22:36:43.877 INFO:teuthology.orchestra.run.smithi103.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T22:36:43.908 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up radosgw (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:44.018 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T22:36:44.443 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T22:36:44.471 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:36:44.471 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:36:45.126 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-base (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:45.162 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up cephfs-mirror (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:45.370 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-10T22:36:45.370 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-10T22:36:45.486 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T22:36:46.047 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-test (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:46.144 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mds (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:46.198 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up radosgw (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:46.402 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T22:36:46.402 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T22:36:46.752 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:36:46.752 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:36:47.033 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:47.242 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T22:36:47.242 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T22:36:47.374 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-base (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:47.745 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T22:36:47.848 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-osd (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:48.165 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T22:36:48.166 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T22:36:48.394 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mds (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:48.617 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T22:36:48.618 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T22:36:48.808 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:48.934 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:49.076 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mon (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:49.280 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:49.284 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T22:36:49.285 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T22:36:49.517 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T22:36:49.518 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T22:36:49.919 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-cephadm (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:50.062 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:50.156 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-osd (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:50.188 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-dashboard (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:50.331 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-volume (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:50.463 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T22:36:50.463 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T22:36:50.691 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T22:36:50.792 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T22:36:50.969 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T22:36:51.108 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:51.226 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:51.402 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mon (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:51.610 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T22:36:51.611 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T22:36:52.061 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T22:36:52.237 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-cephadm (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:52.379 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:52.505 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-dashboard (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:52.673 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-volume (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T22:36:52.792 INFO:teuthology.orchestra.run.smithi131.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T22:36:52.797 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-10T22:36:52.875 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-09-10T22:36:53.026 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T22:36:53.058 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2024-09-10T22:36:53.059 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2024-09-10T22:36:53.135 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T22:36:53.244 INFO:teuthology.orchestra.run.smithi131.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-10T22:36:53.244 INFO:teuthology.orchestra.run.smithi131.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-10T22:36:53.244 INFO:teuthology.orchestra.run.smithi131.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-10T22:36:53.244 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T22:36:53.244 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T22:36:53.244 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T22:36:53.244 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T22:36:53.245 INFO:teuthology.orchestra.run.smithi131.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T22:36:53.245 INFO:teuthology.orchestra.run.smithi131.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T22:36:53.245 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T22:36:53.246 INFO:teuthology.orchestra.run.smithi131.stdout:The following additional packages will be installed: 2024-09-10T22:36:53.246 INFO:teuthology.orchestra.run.smithi131.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-10T22:36:53.246 INFO:teuthology.orchestra.run.smithi131.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-10T22:36:53.247 INFO:teuthology.orchestra.run.smithi131.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-10T22:36:53.247 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-10T22:36:53.247 INFO:teuthology.orchestra.run.smithi131.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-10T22:36:53.248 INFO:teuthology.orchestra.run.smithi131.stdout:Suggested packages: 2024-09-10T22:36:53.248 INFO:teuthology.orchestra.run.smithi131.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-10T22:36:53.248 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-10T22:36:53.248 INFO:teuthology.orchestra.run.smithi131.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-10T22:36:53.305 INFO:teuthology.orchestra.run.smithi131.stdout:The following NEW packages will be installed: 2024-09-10T22:36:53.306 INFO:teuthology.orchestra.run.smithi131.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-10T22:36:53.306 INFO:teuthology.orchestra.run.smithi131.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-10T22:36:53.306 INFO:teuthology.orchestra.run.smithi131.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-10T22:36:53.306 INFO:teuthology.orchestra.run.smithi131.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-10T22:36:53.306 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-10T22:36:53.307 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-10T22:36:53.307 INFO:teuthology.orchestra.run.smithi131.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-10T22:36:53.308 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages will be upgraded: 2024-09-10T22:36:53.308 INFO:teuthology.orchestra.run.smithi131.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-10T22:36:53.397 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T22:36:53.512 INFO:teuthology.orchestra.run.smithi131.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-10T22:36:53.512 INFO:teuthology.orchestra.run.smithi131.stdout:Need to get 55.8 MB of archives. 2024-09-10T22:36:53.512 INFO:teuthology.orchestra.run.smithi131.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-10T22:36:53.512 INFO:teuthology.orchestra.run.smithi131.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-10T22:36:54.130 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-10T22:36:54.146 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-10T22:36:54.270 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-10T22:36:54.271 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-10T22:36:54.272 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-10T22:36:54.300 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-10T22:36:54.302 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-10T22:36:54.305 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-10T22:36:54.308 INFO:teuthology.orchestra.run.smithi131.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-10T22:36:54.308 INFO:teuthology.orchestra.run.smithi131.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-10T22:36:54.310 INFO:teuthology.orchestra.run.smithi131.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-10T22:36:54.374 INFO:teuthology.orchestra.run.smithi131.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-10T22:36:54.375 INFO:teuthology.orchestra.run.smithi131.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-10T22:36:54.375 INFO:teuthology.orchestra.run.smithi131.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-10T22:36:54.456 INFO:teuthology.orchestra.run.smithi131.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-10T22:36:54.557 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T22:36:55.135 INFO:teuthology.orchestra.run.smithi131.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-10T22:36:55.136 INFO:teuthology.orchestra.run.smithi131.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-10T22:36:55.137 INFO:teuthology.orchestra.run.smithi131.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-10T22:36:55.140 INFO:teuthology.orchestra.run.smithi131.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-10T22:36:55.140 INFO:teuthology.orchestra.run.smithi131.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-10T22:36:55.146 INFO:teuthology.orchestra.run.smithi131.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-10T22:36:55.147 INFO:teuthology.orchestra.run.smithi131.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-10T22:36:55.157 INFO:teuthology.orchestra.run.smithi131.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-10T22:36:55.157 INFO:teuthology.orchestra.run.smithi131.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-10T22:36:55.234 INFO:teuthology.orchestra.run.smithi131.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-10T22:36:55.241 INFO:teuthology.orchestra.run.smithi131.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-10T22:36:55.250 INFO:teuthology.orchestra.run.smithi103.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T22:36:55.254 DEBUG:teuthology.orchestra.run.smithi103:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-10T22:36:55.286 INFO:teuthology.orchestra.run.smithi131.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-10T22:36:55.328 INFO:teuthology.orchestra.run.smithi131.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-10T22:36:55.330 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2024-09-10T22:36:55.364 INFO:teuthology.orchestra.run.smithi131.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-10T22:36:55.364 INFO:teuthology.orchestra.run.smithi131.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-10T22:36:55.365 INFO:teuthology.orchestra.run.smithi131.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-10T22:36:55.365 INFO:teuthology.orchestra.run.smithi131.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-10T22:36:55.388 INFO:teuthology.orchestra.run.smithi131.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-10T22:36:55.391 INFO:teuthology.orchestra.run.smithi131.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-10T22:36:55.513 INFO:teuthology.orchestra.run.smithi103.stdout:Building dependency tree... 2024-09-10T22:36:55.514 INFO:teuthology.orchestra.run.smithi103.stdout:Reading state information... 2024-09-10T22:36:55.701 INFO:teuthology.orchestra.run.smithi103.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-10T22:36:55.701 INFO:teuthology.orchestra.run.smithi103.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-10T22:36:55.701 INFO:teuthology.orchestra.run.smithi103.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-10T22:36:55.701 INFO:teuthology.orchestra.run.smithi103.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T22:36:55.701 INFO:teuthology.orchestra.run.smithi103.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T22:36:55.701 INFO:teuthology.orchestra.run.smithi103.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T22:36:55.701 INFO:teuthology.orchestra.run.smithi103.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T22:36:55.702 INFO:teuthology.orchestra.run.smithi103.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T22:36:55.702 INFO:teuthology.orchestra.run.smithi103.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T22:36:55.702 INFO:teuthology.orchestra.run.smithi103.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T22:36:55.703 INFO:teuthology.orchestra.run.smithi103.stdout:The following additional packages will be installed: 2024-09-10T22:36:55.703 INFO:teuthology.orchestra.run.smithi103.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-10T22:36:55.703 INFO:teuthology.orchestra.run.smithi103.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-10T22:36:55.703 INFO:teuthology.orchestra.run.smithi103.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-10T22:36:55.703 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-10T22:36:55.704 INFO:teuthology.orchestra.run.smithi103.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-10T22:36:55.705 INFO:teuthology.orchestra.run.smithi103.stdout:Suggested packages: 2024-09-10T22:36:55.705 INFO:teuthology.orchestra.run.smithi103.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-10T22:36:55.705 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-10T22:36:55.705 INFO:teuthology.orchestra.run.smithi103.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-10T22:36:55.762 INFO:teuthology.orchestra.run.smithi103.stdout:The following NEW packages will be installed: 2024-09-10T22:36:55.763 INFO:teuthology.orchestra.run.smithi103.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-10T22:36:55.763 INFO:teuthology.orchestra.run.smithi103.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-10T22:36:55.763 INFO:teuthology.orchestra.run.smithi103.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-10T22:36:55.764 INFO:teuthology.orchestra.run.smithi103.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-10T22:36:55.764 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-10T22:36:55.764 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-10T22:36:55.764 INFO:teuthology.orchestra.run.smithi103.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-10T22:36:55.765 INFO:teuthology.orchestra.run.smithi103.stdout:The following packages will be upgraded: 2024-09-10T22:36:55.765 INFO:teuthology.orchestra.run.smithi103.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-10T22:36:55.869 INFO:teuthology.orchestra.run.smithi131.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-10T22:36:55.869 INFO:teuthology.orchestra.run.smithi131.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-10T22:36:55.869 INFO:teuthology.orchestra.run.smithi131.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-10T22:36:55.870 INFO:teuthology.orchestra.run.smithi131.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-10T22:36:55.870 INFO:teuthology.orchestra.run.smithi131.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-10T22:36:55.870 INFO:teuthology.orchestra.run.smithi131.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-10T22:36:55.900 INFO:teuthology.orchestra.run.smithi131.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-10T22:36:55.900 INFO:teuthology.orchestra.run.smithi131.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-10T22:36:55.951 INFO:teuthology.orchestra.run.smithi103.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-10T22:36:55.951 INFO:teuthology.orchestra.run.smithi103.stdout:Need to get 55.8 MB of archives. 2024-09-10T22:36:55.952 INFO:teuthology.orchestra.run.smithi103.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-10T22:36:55.952 INFO:teuthology.orchestra.run.smithi103.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-10T22:36:56.284 INFO:teuthology.orchestra.run.smithi131.stdout:Preconfiguring packages ... 2024-09-10T22:36:56.437 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 55.8 MB in 3s (21.6 MB/s) 2024-09-10T22:36:56.571 INFO:teuthology.orchestra.run.smithi103.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-10T22:36:56.587 INFO:teuthology.orchestra.run.smithi103.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-10T22:36:56.711 INFO:teuthology.orchestra.run.smithi103.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-10T22:36:56.712 INFO:teuthology.orchestra.run.smithi103.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-10T22:36:56.713 INFO:teuthology.orchestra.run.smithi103.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-10T22:36:56.729 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143286 files and directories currently installed.) 2024-09-10T22:36:56.733 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-10T22:36:56.741 INFO:teuthology.orchestra.run.smithi103.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-10T22:36:56.743 INFO:teuthology.orchestra.run.smithi103.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-10T22:36:56.746 INFO:teuthology.orchestra.run.smithi103.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-10T22:36:56.749 INFO:teuthology.orchestra.run.smithi103.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-10T22:36:56.749 INFO:teuthology.orchestra.run.smithi103.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-10T22:36:56.751 INFO:teuthology.orchestra.run.smithi103.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-10T22:36:56.815 INFO:teuthology.orchestra.run.smithi103.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-10T22:36:56.816 INFO:teuthology.orchestra.run.smithi103.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-10T22:36:56.816 INFO:teuthology.orchestra.run.smithi103.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-10T22:36:56.897 INFO:teuthology.orchestra.run.smithi103.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-10T22:36:56.902 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-10T22:36:57.529 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-10T22:36:57.581 INFO:teuthology.orchestra.run.smithi103.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-10T22:36:57.583 INFO:teuthology.orchestra.run.smithi103.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-10T22:36:57.584 INFO:teuthology.orchestra.run.smithi103.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-10T22:36:57.586 INFO:teuthology.orchestra.run.smithi103.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-10T22:36:57.587 INFO:teuthology.orchestra.run.smithi103.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-10T22:36:57.591 INFO:teuthology.orchestra.run.smithi103.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-10T22:36:57.593 INFO:teuthology.orchestra.run.smithi103.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-10T22:36:57.640 INFO:teuthology.orchestra.run.smithi103.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-10T22:36:57.640 INFO:teuthology.orchestra.run.smithi103.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-10T22:36:57.716 INFO:teuthology.orchestra.run.smithi103.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-10T22:36:57.722 INFO:teuthology.orchestra.run.smithi103.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-10T22:36:57.734 INFO:teuthology.orchestra.run.smithi103.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-10T22:36:57.809 INFO:teuthology.orchestra.run.smithi103.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-10T22:36:57.813 INFO:teuthology.orchestra.run.smithi103.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-10T22:36:57.813 INFO:teuthology.orchestra.run.smithi103.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-10T22:36:57.814 INFO:teuthology.orchestra.run.smithi103.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-10T22:36:57.815 INFO:teuthology.orchestra.run.smithi103.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-10T22:36:57.833 INFO:teuthology.orchestra.run.smithi103.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-10T22:36:57.835 INFO:teuthology.orchestra.run.smithi103.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-10T22:36:58.324 INFO:teuthology.orchestra.run.smithi103.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-10T22:36:58.324 INFO:teuthology.orchestra.run.smithi103.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-10T22:36:58.324 INFO:teuthology.orchestra.run.smithi103.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-10T22:36:58.324 INFO:teuthology.orchestra.run.smithi103.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-10T22:36:58.325 INFO:teuthology.orchestra.run.smithi103.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-10T22:36:58.325 INFO:teuthology.orchestra.run.smithi103.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-10T22:36:58.337 INFO:teuthology.orchestra.run.smithi103.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-10T22:36:58.338 INFO:teuthology.orchestra.run.smithi103.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-10T22:36:58.721 INFO:teuthology.orchestra.run.smithi103.stdout:Preconfiguring packages ... 2024-09-10T22:36:58.875 INFO:teuthology.orchestra.run.smithi103.stdout:Fetched 55.8 MB in 3s (21.8 MB/s) 2024-09-10T22:36:59.188 INFO:teuthology.orchestra.run.smithi103.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143286 files and directories currently installed.) 2024-09-10T22:36:59.192 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-10T22:36:59.314 INFO:teuthology.orchestra.run.smithi131.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-10T22:36:59.332 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-10T22:36:59.552 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package flex. 2024-09-10T22:36:59.623 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143286 files and directories currently installed.) 2024-09-10T22:36:59.627 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-10T22:36:59.675 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-10T22:36:59.958 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-10T22:37:00.187 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-10T22:37:00.365 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-10T22:37:00.779 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-10T22:37:01.052 INFO:teuthology.orchestra.run.smithi103.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-10T22:37:01.305 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package flex. 2024-09-10T22:37:01.345 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143359 files and directories currently installed.) 2024-09-10T22:37:01.349 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-10T22:37:01.374 INFO:teuthology.orchestra.run.smithi103.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143286 files and directories currently installed.) 2024-09-10T22:37:01.378 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-10T22:37:01.429 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-10T22:37:01.472 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-10T22:37:01.902 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-10T22:37:01.966 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-10T22:37:02.037 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-10T22:37:02.119 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-10T22:37:02.361 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-10T22:37:02.535 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-10T22:37:02.755 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package bison. 2024-09-10T22:37:02.831 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143359 files and directories currently installed.) 2024-09-10T22:37:02.835 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-10T22:37:02.882 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-10T22:37:03.065 INFO:teuthology.orchestra.run.smithi103.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143359 files and directories currently installed.) 2024-09-10T22:37:03.069 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-10T22:37:03.194 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-10T22:37:03.325 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-10T22:37:03.340 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-10T22:37:03.383 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-10T22:37:03.666 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-10T22:37:03.703 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package dump. 2024-09-10T22:37:03.718 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-10T22:37:03.753 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking dump (0.4b47-3) ... 2024-09-10T22:37:03.793 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-10T22:37:04.074 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package indent. 2024-09-10T22:37:04.089 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-10T22:37:04.100 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-10T22:37:04.132 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-10T22:37:04.393 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-10T22:37:04.409 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-10T22:37:04.452 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-10T22:37:04.452 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package bison. 2024-09-10T22:37:04.526 INFO:teuthology.orchestra.run.smithi103.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143359 files and directories currently installed.) 2024-09-10T22:37:04.530 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-10T22:37:04.580 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-10T22:37:04.739 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-10T22:37:04.755 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-10T22:37:04.789 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-10T22:37:05.006 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-10T22:37:05.021 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-10T22:37:05.050 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-10T22:37:05.064 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-10T22:37:05.066 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-10T22:37:05.108 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-10T22:37:05.384 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package dump. 2024-09-10T22:37:05.400 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-10T22:37:05.436 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking dump (0.4b47-3) ... 2024-09-10T22:37:05.470 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-10T22:37:05.486 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-10T22:37:05.528 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-10T22:37:05.739 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package indent. 2024-09-10T22:37:05.755 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-10T22:37:05.781 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-10T22:37:05.797 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-10T22:37:05.797 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-10T22:37:05.831 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-10T22:37:06.058 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-10T22:37:06.074 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-10T22:37:06.076 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libjson-perl. 2024-09-10T22:37:06.092 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-10T22:37:06.134 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-10T22:37:06.141 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-10T22:37:06.421 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-10T22:37:06.437 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-10T22:37:06.462 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-10T22:37:06.478 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-10T22:37:06.479 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-10T22:37:06.521 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-10T22:37:06.715 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-10T22:37:06.731 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-10T22:37:06.799 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-10T22:37:07.119 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-10T22:37:07.135 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-10T22:37:07.177 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-10T22:37:07.439 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-10T22:37:07.454 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-10T22:37:07.488 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-10T22:37:07.741 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libjson-perl. 2024-09-10T22:37:07.757 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-10T22:37:07.800 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-10T22:37:07.882 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-10T22:37:07.898 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-10T22:37:07.940 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T22:37:08.120 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-10T22:37:08.136 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-10T22:37:08.170 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-10T22:37:08.185 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-10T22:37:08.201 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-10T22:37:08.293 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T22:37:08.614 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-10T22:37:08.630 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-10T22:37:08.664 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T22:37:09.034 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-10T22:37:09.047 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-10T22:37:09.092 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-10T22:37:09.411 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-10T22:37:09.425 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-10T22:37:09.470 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-10T22:37:09.625 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-10T22:37:09.640 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-10T22:37:09.682 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T22:37:09.806 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-10T22:37:09.819 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-10T22:37:09.856 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T22:37:09.969 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-10T22:37:09.985 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-10T22:37:10.027 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T22:37:10.217 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-10T22:37:10.234 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-10T22:37:10.275 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T22:37:10.314 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-10T22:37:10.330 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-10T22:37:10.405 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T22:37:10.562 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-10T22:37:10.576 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-10T22:37:10.620 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T22:37:10.750 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-10T22:37:10.766 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-10T22:37:10.808 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-10T22:37:10.865 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-10T22:37:10.880 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-10T22:37:10.922 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-10T22:37:11.154 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-10T22:37:11.170 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-10T22:37:11.212 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-10T22:37:11.443 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-10T22:37:11.457 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-10T22:37:11.501 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-10T22:37:11.523 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-10T22:37:11.539 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-10T22:37:11.581 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T22:37:11.830 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package modemmanager. 2024-09-10T22:37:11.844 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-10T22:37:11.888 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T22:37:11.943 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-10T22:37:11.958 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-10T22:37:12.001 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T22:37:12.338 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-10T22:37:12.353 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-10T22:37:12.387 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T22:37:12.503 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package network-manager. 2024-09-10T22:37:12.518 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-10T22:37:12.561 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-10T22:37:12.599 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-10T22:37:12.615 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-10T22:37:12.657 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-10T22:37:13.194 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-10T22:37:13.209 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-10T22:37:13.219 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ppp. 2024-09-10T22:37:13.234 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-10T22:37:13.253 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-10T22:37:13.591 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-10T22:37:13.614 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package modemmanager. 2024-09-10T22:37:13.630 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-10T22:37:13.672 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T22:37:13.959 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package pptp-linux. 2024-09-10T22:37:13.974 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-10T22:37:14.017 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-10T22:37:14.270 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-10T22:37:14.284 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-10T22:37:14.328 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-10T22:37:14.598 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-10T22:37:14.612 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-10T22:37:14.647 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-client-common (238) ... 2024-09-10T22:37:14.832 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package network-manager. 2024-09-10T22:37:14.848 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-10T22:37:14.898 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-10T22:37:14.969 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-10T22:37:14.983 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-10T22:37:15.027 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T22:37:15.606 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-common. 2024-09-10T22:37:15.620 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-10T22:37:15.665 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ppp. 2024-09-10T22:37:15.681 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-10T22:37:15.682 INFO:teuthology.orchestra.run.smithi131.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-10T22:37:15.714 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-common (238) ... 2024-09-10T22:37:16.047 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-10T22:37:16.147 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-14. 2024-09-10T22:37:16.161 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-10T22:37:16.208 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T22:37:16.404 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package pptp-linux. 2024-09-10T22:37:16.418 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-10T22:37:16.462 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-10T22:37:16.715 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-10T22:37:16.729 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-10T22:37:16.773 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-10T22:37:17.109 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-10T22:37:17.124 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-10T22:37:17.168 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking postgresql-client-common (238) ... 2024-09-10T22:37:17.326 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql. 2024-09-10T22:37:17.341 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-10T22:37:17.384 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql (14+238) ... 2024-09-10T22:37:17.439 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-10T22:37:17.454 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-10T22:37:17.497 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T22:37:17.628 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-client. 2024-09-10T22:37:17.642 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-10T22:37:17.686 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-client (14+238) ... 2024-09-10T22:37:17.930 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-10T22:37:17.944 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-10T22:37:18.005 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-10T22:37:18.069 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package postgresql-common. 2024-09-10T22:37:18.084 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-10T22:37:18.145 INFO:teuthology.orchestra.run.smithi103.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-10T22:37:18.202 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking postgresql-common (238) ... 2024-09-10T22:37:18.333 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package tcl8.6. 2024-09-10T22:37:18.347 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-10T22:37:18.421 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-10T22:37:18.668 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package postgresql-14. 2024-09-10T22:37:18.683 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-10T22:37:18.694 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package tcl. 2024-09-10T22:37:18.709 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-10T22:37:18.729 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T22:37:18.757 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-10T22:37:19.089 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package wpasupplicant. 2024-09-10T22:37:19.105 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-10T22:37:19.147 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-10T22:37:19.485 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-10T22:37:19.497 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-10T22:37:19.534 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-10T22:37:19.824 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package postgresql. 2024-09-10T22:37:19.839 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-10T22:37:19.882 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking postgresql (14+238) ... 2024-09-10T22:37:19.955 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-10T22:37:19.967 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-10T22:37:20.013 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-10T22:37:20.117 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package postgresql-client. 2024-09-10T22:37:20.132 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-10T22:37:20.193 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking postgresql-client (14+238) ... 2024-09-10T22:37:20.297 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-client-common (238) ... 2024-09-10T22:37:20.386 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-10T22:37:20.401 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-10T22:37:20.445 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-10T22:37:20.502 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-10T22:37:20.628 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-10T22:37:20.755 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T22:37:20.831 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package tcl8.6. 2024-09-10T22:37:20.845 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-10T22:37:20.889 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-10T22:37:20.906 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-10T22:37:21.032 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-10T22:37:21.158 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T22:37:21.174 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package tcl. 2024-09-10T22:37:21.190 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-10T22:37:21.237 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-10T22:37:21.586 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package wpasupplicant. 2024-09-10T22:37:21.601 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-10T22:37:21.636 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-10T22:37:21.998 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-10T22:37:22.014 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-10T22:37:22.057 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-10T22:37:22.112 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-10T22:37:22.214 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-10T22:37:22.452 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-10T22:37:22.468 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-10T22:37:22.510 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-10T22:37:22.590 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-10T22:37:22.591 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-10T22:37:22.812 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up postgresql-client-common (238) ... 2024-09-10T22:37:23.024 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-10T22:37:23.133 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-10T22:37:23.260 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T22:37:23.317 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-10T22:37:23.411 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-10T22:37:23.442 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-10T22:37:23.537 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-10T22:37:23.544 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-10T22:37:23.663 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T22:37:24.045 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-10T22:37:24.171 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-10T22:37:24.297 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-10T22:37:24.448 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-10T22:37:24.574 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-10T22:37:24.618 INFO:teuthology.orchestra.run.smithi103.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-10T22:37:24.719 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-10T22:37:25.096 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-10T22:37:25.096 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-10T22:37:25.205 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-10T22:37:25.331 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up dump (0.4b47-3) ... 2024-09-10T22:37:25.426 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-10T22:37:25.491 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T22:37:25.625 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-10T22:37:25.726 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-10T22:37:25.846 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-10T22:37:25.852 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-10T22:37:25.978 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-10T22:37:25.997 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-10T22:37:26.068 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-10T22:37:26.124 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-10T22:37:26.138 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-10T22:37:26.249 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-10T22:37:26.264 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-10T22:37:26.375 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-10T22:37:26.440 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-10T22:37:26.501 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-10T22:37:26.567 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T22:37:26.669 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-10T22:37:26.676 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-10T22:37:26.795 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-10T22:37:26.861 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-client (14+238) ... 2024-09-10T22:37:26.987 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-10T22:37:27.459 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-10T22:37:27.585 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up dump (0.4b47-3) ... 2024-09-10T22:37:27.593 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:27.594 INFO:teuthology.orchestra.run.smithi131.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-10T22:37:27.594 INFO:teuthology.orchestra.run.smithi131.stdout:which means they are currently configured by ifupdown: 2024-09-10T22:37:27.594 INFO:teuthology.orchestra.run.smithi131.stdout:- enp3s0f1 2024-09-10T22:37:27.594 INFO:teuthology.orchestra.run.smithi131.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-10T22:37:27.594 INFO:teuthology.orchestra.run.smithi131.stdout:remove their configuration from /etc/network/interfaces. 2024-09-10T22:37:27.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:27.680 INFO:teuthology.orchestra.run.smithi103.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-10T22:37:27.726 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-10T22:37:27.745 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T22:37:27.896 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-10T22:37:28.022 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-10T22:37:28.131 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-10T22:37:28.141 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-10T22:37:28.257 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-10T22:37:28.347 INFO:teuthology.orchestra.run.smithi103.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-10T22:37:28.409 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-10T22:37:28.560 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-10T22:37:28.567 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-10T22:37:28.736 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-10T22:37:28.862 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T22:37:28.988 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-10T22:37:29.173 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up postgresql-client (14+238) ... 2024-09-10T22:37:29.256 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T22:37:29.291 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-10T22:37:29.407 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-10T22:37:29.667 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-10T22:37:29.785 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-common (238) ... 2024-09-10T22:37:30.303 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:30.303 INFO:teuthology.orchestra.run.smithi103.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-10T22:37:30.303 INFO:teuthology.orchestra.run.smithi103.stdout:which means they are currently configured by ifupdown: 2024-09-10T22:37:30.303 INFO:teuthology.orchestra.run.smithi103.stdout:- enp3s0f1 2024-09-10T22:37:30.303 INFO:teuthology.orchestra.run.smithi103.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-10T22:37:30.303 INFO:teuthology.orchestra.run.smithi103.stdout:remove their configuration from /etc/network/interfaces. 2024-09-10T22:37:30.303 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:30.437 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-10T22:37:30.720 INFO:teuthology.orchestra.run.smithi131.stdout:Adding user postgres to group ssl-cert 2024-09-10T22:37:30.835 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-10T22:37:30.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:30.971 INFO:teuthology.orchestra.run.smithi131.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-10T22:37:31.238 INFO:teuthology.orchestra.run.smithi131.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-10T22:37:31.238 INFO:teuthology.orchestra.run.smithi131.stdout:Removing obsolete dictionary files: 2024-09-10T22:37:31.257 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-10T22:37:31.952 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-10T22:37:32.002 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T22:37:32.153 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-10T22:37:32.279 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-10T22:37:32.403 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T22:37:32.430 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up postgresql-common (238) ... 2024-09-10T22:37:32.744 INFO:teuthology.orchestra.run.smithi131.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-10T22:37:32.763 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-10T22:37:32.812 INFO:teuthology.orchestra.run.smithi131.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-10T22:37:32.812 INFO:teuthology.orchestra.run.smithi131.stdout:This user must also own the server process. 2024-09-10T22:37:32.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:32.812 INFO:teuthology.orchestra.run.smithi131.stdout:The database cluster will be initialized with locale "en_US". 2024-09-10T22:37:32.812 INFO:teuthology.orchestra.run.smithi131.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-10T22:37:32.812 INFO:teuthology.orchestra.run.smithi131.stdout:The default text search configuration will be set to "english". 2024-09-10T22:37:32.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:32.812 INFO:teuthology.orchestra.run.smithi131.stdout:Data page checksums are disabled. 2024-09-10T22:37:32.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:32.812 INFO:teuthology.orchestra.run.smithi131.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-10T22:37:32.813 INFO:teuthology.orchestra.run.smithi131.stdout:creating subdirectories ... ok 2024-09-10T22:37:32.813 INFO:teuthology.orchestra.run.smithi131.stdout:selecting dynamic shared memory implementation ... posix 2024-09-10T22:37:32.837 INFO:teuthology.orchestra.run.smithi131.stdout:selecting default max_connections ... 100 2024-09-10T22:37:32.870 INFO:teuthology.orchestra.run.smithi131.stdout:selecting default shared_buffers ... 128MB 2024-09-10T22:37:32.885 INFO:teuthology.orchestra.run.smithi131.stdout:selecting default time zone ... Etc/UTC 2024-09-10T22:37:32.885 INFO:teuthology.orchestra.run.smithi131.stdout:creating configuration files ... ok 2024-09-10T22:37:33.046 INFO:teuthology.orchestra.run.smithi131.stdout:running bootstrap script ... ok 2024-09-10T22:37:33.427 INFO:teuthology.orchestra.run.smithi103.stdout:Adding user postgres to group ssl-cert 2024-09-10T22:37:33.665 INFO:teuthology.orchestra.run.smithi131.stdout:performing post-bootstrap initialization ... ok 2024-09-10T22:37:33.683 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:33.683 INFO:teuthology.orchestra.run.smithi103.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-10T22:37:33.950 INFO:teuthology.orchestra.run.smithi103.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-10T22:37:33.951 INFO:teuthology.orchestra.run.smithi103.stdout:Removing obsolete dictionary files: 2024-09-10T22:37:34.216 INFO:teuthology.orchestra.run.smithi131.stdout:syncing data to disk ... ok 2024-09-10T22:37:34.690 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-10T22:37:34.734 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-10T22:37:35.131 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T22:37:35.463 INFO:teuthology.orchestra.run.smithi103.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-10T22:37:35.485 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-10T22:37:35.535 INFO:teuthology.orchestra.run.smithi103.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-10T22:37:35.536 INFO:teuthology.orchestra.run.smithi103.stdout:This user must also own the server process. 2024-09-10T22:37:35.536 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:35.536 INFO:teuthology.orchestra.run.smithi103.stdout:The database cluster will be initialized with locale "en_US". 2024-09-10T22:37:35.536 INFO:teuthology.orchestra.run.smithi103.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-10T22:37:35.536 INFO:teuthology.orchestra.run.smithi103.stdout:The default text search configuration will be set to "english". 2024-09-10T22:37:35.536 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:35.536 INFO:teuthology.orchestra.run.smithi103.stdout:Data page checksums are disabled. 2024-09-10T22:37:35.536 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:35.536 INFO:teuthology.orchestra.run.smithi103.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-10T22:37:35.537 INFO:teuthology.orchestra.run.smithi103.stdout:creating subdirectories ... ok 2024-09-10T22:37:35.537 INFO:teuthology.orchestra.run.smithi103.stdout:selecting dynamic shared memory implementation ... posix 2024-09-10T22:37:35.560 INFO:teuthology.orchestra.run.smithi103.stdout:selecting default max_connections ... 100 2024-09-10T22:37:35.593 INFO:teuthology.orchestra.run.smithi103.stdout:selecting default shared_buffers ... 128MB 2024-09-10T22:37:35.607 INFO:teuthology.orchestra.run.smithi103.stdout:selecting default time zone ... Etc/UTC 2024-09-10T22:37:35.608 INFO:teuthology.orchestra.run.smithi103.stdout:creating configuration files ... ok 2024-09-10T22:37:35.769 INFO:teuthology.orchestra.run.smithi103.stdout:running bootstrap script ... ok 2024-09-10T22:37:36.382 INFO:teuthology.orchestra.run.smithi103.stdout:performing post-bootstrap initialization ... ok 2024-09-10T22:37:36.929 INFO:teuthology.orchestra.run.smithi103.stdout:syncing data to disk ... ok 2024-09-10T22:37:37.444 INFO:teuthology.orchestra.run.smithi103.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-10T22:37:37.786 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T22:37:37.912 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-10T22:37:38.038 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql (14+238) ... 2024-09-10T22:37:38.164 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T22:37:38.290 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T22:37:38.550 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-10T22:37:38.551 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-10T22:37:39.284 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T22:37:39.385 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-10T22:37:39.679 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T22:37:39.833 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T22:37:40.506 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T22:37:40.657 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-10T22:37:40.783 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up postgresql (14+238) ... 2024-09-10T22:37:40.909 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T22:37:41.035 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T22:37:41.206 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-10T22:37:41.295 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-10T22:37:41.295 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-10T22:37:41.302 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T22:37:41.842 INFO:teuthology.orchestra.run.smithi131.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T22:37:41.850 DEBUG:teuthology.parallel:result is None 2024-09-10T22:37:42.071 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T22:37:42.163 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-10T22:37:42.457 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T22:37:42.651 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T22:37:44.020 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-10T22:37:44.121 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T22:37:44.659 INFO:teuthology.orchestra.run.smithi103.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T22:37:44.665 DEBUG:teuthology.parallel:result is None 2024-09-10T22:37:44.666 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:37:44.815 DEBUG:teuthology.orchestra.run.smithi103:> dpkg-query -W -f '${Version}' ceph 2024-09-10T22:37:44.837 INFO:teuthology.orchestra.run.smithi103.stdout:19.3.0-4854-g8f219c47-1jammy 2024-09-10T22:37:44.837 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854-g8f219c47-1jammy 2024-09-10T22:37:44.837 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854-g8f219c47-1jammy is installed. 2024-09-10T22:37:44.839 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:37:44.986 DEBUG:teuthology.orchestra.run.smithi131:> dpkg-query -W -f '${Version}' ceph 2024-09-10T22:37:45.010 INFO:teuthology.orchestra.run.smithi131.stdout:19.3.0-4854-g8f219c47-1jammy 2024-09-10T22:37:45.010 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854-g8f219c47-1jammy 2024-09-10T22:37:45.010 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854-g8f219c47-1jammy is installed. 2024-09-10T22:37:45.012 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T22:37:45.012 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:37:45.013 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T22:37:45.032 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:37:45.033 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T22:37:45.078 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T22:37:45.078 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:37:45.078 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T22:37:45.097 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T22:37:45.157 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:37:45.157 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T22:37:45.177 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T22:37:45.240 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T22:37:45.240 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:37:45.240 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T22:37:45.259 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T22:37:45.320 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:37:45.320 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T22:37:45.340 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T22:37:45.408 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T22:37:45.408 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:37:45.408 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T22:37:45.427 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T22:37:45.489 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:37:45.489 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T22:37:45.510 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T22:37:45.576 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T22:37:45.660 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T22:37:45.660 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /var/log/ceph 2024-09-10T22:37:45.663 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /var/log/ceph 2024-09-10T22:37:45.684 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T22:37:45.684 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T22:37:45.725 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T22:37:45.748 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T22:37:45.748 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T22:37:45.785 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T22:37:45.814 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-10T22:37:45.814 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-10T22:37:45.814 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-10T22:37:45.814 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:37:45.814 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T22:37:45.850 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T22:37:45.934 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:37:45.935 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T22:37:45.943 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T22:37:46.037 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T22:37:46.037 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Scrub error on inode'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T22:37:46.038 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899733', 'branch': 'wip-hemanth-testing-2024-09-10-0723', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/multimds_misc}', 'email': 'hyelloji@redhat.com', 'first_in_suite': False, 'job_id': '7899733', 'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-hemanth-testing-2024-09-10-0723'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Scrub error on inode'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-hemanth-testing-2024-09-10-0723', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'owner': 'scheduled_hyelloji@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6190, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'sleep_before_teardown': 0, 'subset': '479/1024', 'suite': 'fs', 'suite_branch': 'wip-hemanth-testing-2024-09-10-0723', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi103.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCPRabptrnz3Su7nM6cu45fB1dWYad0/5DTQFx+CZy2zX9p//4vy3hZ/z3K/Plc6inh2ahlmJ6BiDxc3HYpwTdE=', 'smithi131.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPTBHP5GuMCVj00csu1PqYoNHHsrVupPCjIeJ/Buw49mTPiRggXcuN+toq+8Qdkbhfa3vuo0ZShNQx4IsRUqMs4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Scrub error on inode'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_multimds_misc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_16:59:47', 'tube': 'smithi', 'user': 'hyelloji', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T22:37:46.038 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T22:37:46.041 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T22:37:46.050 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T22:37:46.093 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T22:37:46.113 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:37:46.113 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T22:37:46.158 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T22:37:46.158 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2024-09-10T22:37:46.206 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T22:37:46.207 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:37:46.207 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 893 Links: 1 2024-09-10T22:37:46.207 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:37:46.207 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-10 22:31:06.453499616 +0000 2024-09-10T22:37:46.207 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-10 22:31:06.449499652 +0000 2024-09-10T22:37:46.207 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-10 22:31:06.449499652 +0000 2024-09-10T22:37:46.207 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-10 22:31:06.449499652 +0000 2024-09-10T22:37:46.207 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T22:37:46.267 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-10T22:37:46.267 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-10T22:37:46.267 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000420451 s, 1.2 MB/s 2024-09-10T22:37:46.269 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T22:37:46.320 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2024-09-10T22:37:46.373 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T22:37:46.373 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:37:46.374 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 912 Links: 1 2024-09-10T22:37:46.374 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:37:46.374 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-10 22:31:07.297492076 +0000 2024-09-10T22:37:46.374 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-10 22:31:07.049494291 +0000 2024-09-10T22:37:46.374 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-10 22:31:07.049494291 +0000 2024-09-10T22:37:46.374 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-10 22:31:07.049494291 +0000 2024-09-10T22:37:46.374 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T22:37:46.431 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-10T22:37:46.431 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-10T22:37:46.431 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000354139 s, 1.4 MB/s 2024-09-10T22:37:46.433 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T22:37:46.484 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2024-09-10T22:37:46.534 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T22:37:46.534 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:37:46.534 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 927 Links: 1 2024-09-10T22:37:46.535 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:37:46.535 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-10 22:31:07.877486896 +0000 2024-09-10T22:37:46.535 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-10 22:31:07.625489147 +0000 2024-09-10T22:37:46.535 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-10 22:31:07.625489147 +0000 2024-09-10T22:37:46.535 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-10 22:31:07.625489147 +0000 2024-09-10T22:37:46.535 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T22:37:46.591 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-10T22:37:46.591 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-10T22:37:46.591 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000338712 s, 1.5 MB/s 2024-09-10T22:37:46.593 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T22:37:46.644 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2024-09-10T22:37:46.695 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T22:37:46.695 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:37:46.695 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 945 Links: 1 2024-09-10T22:37:46.695 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:37:46.695 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-10 22:31:08.433481930 +0000 2024-09-10T22:37:46.695 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-10 22:31:08.161484360 +0000 2024-09-10T22:37:46.695 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-10 22:31:08.161484360 +0000 2024-09-10T22:37:46.695 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-10 22:31:08.161484360 +0000 2024-09-10T22:37:46.695 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T22:37:46.756 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-10T22:37:46.756 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-10T22:37:46.756 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000365599 s, 1.4 MB/s 2024-09-10T22:37:46.757 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T22:37:46.808 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T22:37:46.808 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:37:46.808 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T22:37:46.817 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T22:37:46.817 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2024-09-10T22:37:46.869 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T22:37:46.869 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:37:46.869 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 899 Links: 1 2024-09-10T22:37:46.869 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:37:46.869 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-10 22:31:12.351058935 +0000 2024-09-10T22:37:46.869 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-10 22:31:12.079061364 +0000 2024-09-10T22:37:46.869 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-10 22:31:12.079061364 +0000 2024-09-10T22:37:46.869 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-09-10 22:31:12.079061364 +0000 2024-09-10T22:37:46.869 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T22:37:46.934 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-10T22:37:46.934 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-10T22:37:46.935 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000418703 s, 1.2 MB/s 2024-09-10T22:37:46.936 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T22:37:46.991 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2024-09-10T22:37:47.040 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T22:37:47.041 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:37:47.041 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 913 Links: 1 2024-09-10T22:37:47.041 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:37:47.041 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-10 22:31:12.931053754 +0000 2024-09-10T22:37:47.041 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-10 22:31:12.643056327 +0000 2024-09-10T22:37:47.041 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-10 22:31:12.643056327 +0000 2024-09-10T22:37:47.041 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-09-10 22:31:12.643056327 +0000 2024-09-10T22:37:47.041 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T22:37:47.103 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-10T22:37:47.103 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-10T22:37:47.103 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000379428 s, 1.3 MB/s 2024-09-10T22:37:47.105 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T22:37:47.159 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2024-09-10T22:37:47.209 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T22:37:47.209 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:37:47.209 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 932 Links: 1 2024-09-10T22:37:47.209 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:37:47.209 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-10 22:31:13.503048645 +0000 2024-09-10T22:37:47.209 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-10 22:31:13.247050932 +0000 2024-09-10T22:37:47.209 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-10 22:31:13.247050932 +0000 2024-09-10T22:37:47.209 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-09-10 22:31:13.247050932 +0000 2024-09-10T22:37:47.209 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T22:37:47.271 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-10T22:37:47.271 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-10T22:37:47.271 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000383046 s, 1.3 MB/s 2024-09-10T22:37:47.273 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T22:37:47.327 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2024-09-10T22:37:47.377 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T22:37:47.378 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:37:47.378 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 947 Links: 1 2024-09-10T22:37:47.378 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:37:47.378 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-10 22:31:14.071043572 +0000 2024-09-10T22:37:47.378 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-10 22:31:13.811045894 +0000 2024-09-10T22:37:47.378 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-10 22:31:13.811045894 +0000 2024-09-10T22:37:47.379 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-09-10 22:31:13.811045894 +0000 2024-09-10T22:37:47.379 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T22:37:47.439 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-10T22:37:47.439 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-10T22:37:47.439 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000424567 s, 1.2 MB/s 2024-09-10T22:37:47.441 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T22:37:47.499 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T22:37:47.499 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T22:37:47.499 INFO:tasks.ceph:Generating config... 2024-09-10T22:37:47.500 INFO:tasks.ceph:[client] pid file = 2024-09-10T22:37:47.500 INFO:tasks.ceph:[mgr] client mount timeout = 30 2024-09-10T22:37:47.500 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-10T22:37:47.500 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T22:37:47.500 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T22:37:47.500 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T22:37:47.500 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T22:37:47.501 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T22:37:47.501 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-10T22:37:47.501 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T22:37:47.501 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T22:37:47.501 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-10T22:37:47.501 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-10T22:37:47.501 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T22:37:47.501 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T22:37:47.501 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-10T22:37:47.501 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T22:37:47.501 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T22:37:47.501 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T22:37:47.501 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T22:37:47.501 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T22:37:47.502 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T22:37:47.502 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T22:37:47.545 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T22:37:47.557 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T22:37:47.644 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T22:37:47.663 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.103'), ('mon.b', '172.21.15.131'), ('mon.c', '[v2:172.21.15.131:3301,v1:172.21.15.131:6790]')] 2024-09-10T22:37:47.664 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.103,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'client mount timeout': 30, 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-10T22:37:47.664 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:37:47.664 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T22:37:47.715 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.103 --add b 172.21.15.131 --addv c '[v2:172.21.15.131:3301,v1:172.21.15.131:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T22:37:47.804 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T22:37:47.804 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: generated fsid fb22394a-7771-44f4-99d8-bddd262146a5 2024-09-10T22:37:47.804 INFO:teuthology.orchestra.run.smithi103.stdout:setting min_mon_release = quincy 2024-09-10T22:37:47.805 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 0 2024-09-10T22:37:47.805 INFO:teuthology.orchestra.run.smithi103.stdout:fsid fb22394a-7771-44f4-99d8-bddd262146a5 2024-09-10T22:37:47.805 INFO:teuthology.orchestra.run.smithi103.stdout:last_changed 2024-09-10T22:37:47.805918+0000 2024-09-10T22:37:47.805 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-10T22:37:47.805918+0000 2024-09-10T22:37:47.805 INFO:teuthology.orchestra.run.smithi103.stdout:min_mon_release 17 (quincy) 2024-09-10T22:37:47.805 INFO:teuthology.orchestra.run.smithi103.stdout:election_strategy: 1 2024-09-10T22:37:47.805 INFO:teuthology.orchestra.run.smithi103.stdout:0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-10T22:37:47.805 INFO:teuthology.orchestra.run.smithi103.stdout:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-10T22:37:47.805 INFO:teuthology.orchestra.run.smithi103.stdout:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2024-09-10T22:37:47.805 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-10T22:37:47.807 DEBUG:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T22:37:47.815 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fb22394a-7771-44f4-99d8-bddd262146a5... 2024-09-10T22:37:47.815 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T22:37:47.861 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T22:37:47.900 INFO:teuthology.orchestra.run.smithi103.stdout:[global] 2024-09-10T22:37:47.900 INFO:teuthology.orchestra.run.smithi103.stdout: chdir = "" 2024-09-10T22:37:47.900 INFO:teuthology.orchestra.run.smithi103.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T22:37:47.900 INFO:teuthology.orchestra.run.smithi103.stdout: auth supported = cephx 2024-09-10T22:37:47.900 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.900 INFO:teuthology.orchestra.run.smithi103.stdout: filestore xattr use omap = true 2024-09-10T22:37:47.900 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.900 INFO:teuthology.orchestra.run.smithi103.stdout: mon clock drift allowed = 1.000 2024-09-10T22:37:47.900 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.900 INFO:teuthology.orchestra.run.smithi103.stdout: osd crush chooseleaf type = 0 2024-09-10T22:37:47.901 INFO:teuthology.orchestra.run.smithi103.stdout: auth debug = true 2024-09-10T22:37:47.901 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.901 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on old message = true 2024-09-10T22:37:47.901 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on bug = true 2024-09-10T22:37:47.901 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.901 INFO:teuthology.orchestra.run.smithi103.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T22:37:47.901 INFO:teuthology.orchestra.run.smithi103.stdout: mon pg warn max object skew = 0 2024-09-10T22:37:47.901 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.901 INFO:teuthology.orchestra.run.smithi103.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T22:37:47.901 INFO:teuthology.orchestra.run.smithi103.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T22:37:47.901 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.901 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default size = 2 2024-09-10T22:37:47.901 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.901 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow primary affinity = true 2024-09-10T22:37:47.902 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow pg remap = true 2024-09-10T22:37:47.902 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on legacy crush tunables = false 2024-09-10T22:37:47.902 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on crush straw calc version zero = false 2024-09-10T22:37:47.902 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on no sortbitwise = false 2024-09-10T22:37:47.902 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on osd down out interval zero = false 2024-09-10T22:37:47.902 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on too few osds = false 2024-09-10T22:37:47.902 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T22:37:47.902 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T22:37:47.902 INFO:teuthology.orchestra.run.smithi103.stdout: mon_allow_pool_size_one = true 2024-09-10T22:37:47.902 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.902 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T22:37:47.902 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.902 INFO:teuthology.orchestra.run.smithi103.stdout: osd default data pool replay window = 5 2024-09-10T22:37:47.902 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.903 INFO:teuthology.orchestra.run.smithi103.stdout: mon allow pool delete = true 2024-09-10T22:37:47.903 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.903 INFO:teuthology.orchestra.run.smithi103.stdout: mon cluster log file level = debug 2024-09-10T22:37:47.903 INFO:teuthology.orchestra.run.smithi103.stdout: debug asserts on shutdown = true 2024-09-10T22:37:47.903 INFO:teuthology.orchestra.run.smithi103.stdout: mon health detail to clog = false 2024-09-10T22:37:47.903 INFO:teuthology.orchestra.run.smithi103.stdout: mon host = "172.21.15.103,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]" 2024-09-10T22:37:47.903 INFO:teuthology.orchestra.run.smithi103.stdout: fsid = fb22394a-7771-44f4-99d8-bddd262146a5 2024-09-10T22:37:47.903 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.903 INFO:teuthology.orchestra.run.smithi103.stdout:[osd] 2024-09-10T22:37:47.903 INFO:teuthology.orchestra.run.smithi103.stdout: osd journal size = 100 2024-09-10T22:37:47.903 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.903 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub load threshold = 5.0 2024-09-10T22:37:47.903 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub max interval = 600 2024-09-10T22:37:47.903 INFO:teuthology.orchestra.run.smithi103.stdout: osd mclock profile = high_recovery_ops 2024-09-10T22:37:47.904 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.904 INFO:teuthology.orchestra.run.smithi103.stdout: osd recover clone overlap = true 2024-09-10T22:37:47.904 INFO:teuthology.orchestra.run.smithi103.stdout: osd recovery max chunk = 1048576 2024-09-10T22:37:47.904 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.904 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug shutdown = true 2024-09-10T22:37:47.904 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug op order = true 2024-09-10T22:37:47.904 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug verify stray on activate = true 2024-09-10T22:37:47.904 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug trim objects = true 2024-09-10T22:37:47.904 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.904 INFO:teuthology.orchestra.run.smithi103.stdout: osd open classes on start = true 2024-09-10T22:37:47.904 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug pg log writeout = true 2024-09-10T22:37:47.904 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.904 INFO:teuthology.orchestra.run.smithi103.stdout: osd deep scrub update digest min age = 30 2024-09-10T22:37:47.904 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.905 INFO:teuthology.orchestra.run.smithi103.stdout: osd map max advance = 10 2024-09-10T22:37:47.905 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.905 INFO:teuthology.orchestra.run.smithi103.stdout: journal zero on create = true 2024-09-10T22:37:47.905 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.905 INFO:teuthology.orchestra.run.smithi103.stdout: filestore ondisk finisher threads = 3 2024-09-10T22:37:47.905 INFO:teuthology.orchestra.run.smithi103.stdout: filestore apply finisher threads = 3 2024-09-10T22:37:47.905 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.905 INFO:teuthology.orchestra.run.smithi103.stdout: bdev debug aio = true 2024-09-10T22:37:47.905 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug misdirected ops = true 2024-09-10T22:37:47.905 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore block size = 96636764160 2024-09-10T22:37:47.905 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore fsck on mount = True 2024-09-10T22:37:47.905 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluefs = 20 2024-09-10T22:37:47.905 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluestore = 20 2024-09-10T22:37:47.905 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-10T22:37:47.906 INFO:teuthology.orchestra.run.smithi103.stdout: debug osd = 20 2024-09-10T22:37:47.906 INFO:teuthology.orchestra.run.smithi103.stdout: debug rocksdb = 10 2024-09-10T22:37:47.906 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T22:37:47.906 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd full ratio = 0.9 2024-09-10T22:37:47.906 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd nearfull ratio = 0.8 2024-09-10T22:37:47.906 INFO:teuthology.orchestra.run.smithi103.stdout: osd failsafe full ratio = 0.95 2024-09-10T22:37:47.906 INFO:teuthology.orchestra.run.smithi103.stdout: osd objectstore = bluestore 2024-09-10T22:37:47.906 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.906 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr] 2024-09-10T22:37:47.906 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-10T22:37:47.906 INFO:teuthology.orchestra.run.smithi103.stdout: debug mgr = 20 2024-09-10T22:37:47.906 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-09-10T22:37:47.906 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-09-10T22:37:47.906 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-09-10T22:37:47.907 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-09-10T22:37:47.907 INFO:teuthology.orchestra.run.smithi103.stdout: mgr/telemetry/nag = false 2024-09-10T22:37:47.907 INFO:teuthology.orchestra.run.smithi103.stdout: client mount timeout = 30 2024-09-10T22:37:47.907 INFO:teuthology.orchestra.run.smithi103.stdout: debug client = 20 2024-09-10T22:37:47.907 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.907 INFO:teuthology.orchestra.run.smithi103.stdout:[mon] 2024-09-10T22:37:47.907 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-10T22:37:47.907 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-09-10T22:37:47.907 INFO:teuthology.orchestra.run.smithi103.stdout: debug paxos = 20 2024-09-10T22:37:47.907 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-09-10T22:37:47.907 INFO:teuthology.orchestra.run.smithi103.stdout: mon data avail warn = 5 2024-09-10T22:37:47.907 INFO:teuthology.orchestra.run.smithi103.stdout: mon mgr mkfs grace = 240 2024-09-10T22:37:47.907 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-09-10T22:37:47.907 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd reporter subtree level = osd 2024-09-10T22:37:47.908 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd prime pg temp = true 2024-09-10T22:37:47.908 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-09-10T22:37:47.908 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.908 INFO:teuthology.orchestra.run.smithi103.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T22:37:47.908 INFO:teuthology.orchestra.run.smithi103.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T22:37:47.908 INFO:teuthology.orchestra.run.smithi103.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T22:37:47.908 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.908 INFO:teuthology.orchestra.run.smithi103.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T22:37:47.908 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T22:37:47.908 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T22:37:47.908 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.908 INFO:teuthology.orchestra.run.smithi103.stdout: # 1m isn't quite enough 2024-09-10T22:37:47.908 INFO:teuthology.orchestra.run.smithi103.stdout: mon_down_mkfs_grace = 2m 2024-09-10T22:37:47.908 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.909 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_filestore_osds = false 2024-09-10T22:37:47.909 INFO:teuthology.orchestra.run.smithi103.stdout: mon down mkfs grace = 300 2024-09-10T22:37:47.909 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:37:47.909 INFO:teuthology.orchestra.run.smithi103.stdout:[client] 2024-09-10T22:37:47.909 INFO:teuthology.orchestra.run.smithi103.stdout: rgw cache enabled = true 2024-09-10T22:37:47.909 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable ops log = true 2024-09-10T22:37:47.909 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable usage log = true 2024-09-10T22:37:47.909 INFO:teuthology.orchestra.run.smithi103.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T22:37:47.909 INFO:teuthology.orchestra.run.smithi103.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T22:37:47.909 INFO:teuthology.orchestra.run.smithi103.stdout: pid file = "" 2024-09-10T22:37:47.909 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.a] 2024-09-10T22:37:47.909 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.b] 2024-09-10T22:37:47.909 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.c] 2024-09-10T22:37:47.910 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a] 2024-09-10T22:37:47.910 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.c] 2024-09-10T22:37:47.910 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b] 2024-09-10T22:37:47.910 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.d] 2024-09-10T22:37:47.910 INFO:teuthology.orchestra.run.smithi131.stdout:[global] 2024-09-10T22:37:47.910 INFO:teuthology.orchestra.run.smithi131.stdout: chdir = "" 2024-09-10T22:37:47.910 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T22:37:47.910 INFO:teuthology.orchestra.run.smithi131.stdout: auth supported = cephx 2024-09-10T22:37:47.910 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.911 INFO:teuthology.orchestra.run.smithi131.stdout: filestore xattr use omap = true 2024-09-10T22:37:47.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.911 INFO:teuthology.orchestra.run.smithi131.stdout: mon clock drift allowed = 1.000 2024-09-10T22:37:47.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.911 INFO:teuthology.orchestra.run.smithi131.stdout: osd crush chooseleaf type = 0 2024-09-10T22:37:47.911 INFO:teuthology.orchestra.run.smithi131.stdout: auth debug = true 2024-09-10T22:37:47.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.911 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on old message = true 2024-09-10T22:37:47.911 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on bug = true 2024-09-10T22:37:47.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.911 INFO:teuthology.orchestra.run.smithi131.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T22:37:47.911 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn max object skew = 0 2024-09-10T22:37:47.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.911 INFO:teuthology.orchestra.run.smithi131.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T22:37:47.912 INFO:teuthology.orchestra.run.smithi131.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T22:37:47.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.912 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default size = 2 2024-09-10T22:37:47.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.912 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow primary affinity = true 2024-09-10T22:37:47.912 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow pg remap = true 2024-09-10T22:37:47.912 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on legacy crush tunables = false 2024-09-10T22:37:47.912 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on crush straw calc version zero = false 2024-09-10T22:37:47.912 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on no sortbitwise = false 2024-09-10T22:37:47.912 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on osd down out interval zero = false 2024-09-10T22:37:47.912 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on too few osds = false 2024-09-10T22:37:47.912 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T22:37:47.912 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T22:37:47.912 INFO:teuthology.orchestra.run.smithi131.stdout: mon_allow_pool_size_one = true 2024-09-10T22:37:47.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.913 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T22:37:47.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.913 INFO:teuthology.orchestra.run.smithi131.stdout: osd default data pool replay window = 5 2024-09-10T22:37:47.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.913 INFO:teuthology.orchestra.run.smithi131.stdout: mon allow pool delete = true 2024-09-10T22:37:47.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.913 INFO:teuthology.orchestra.run.smithi131.stdout: mon cluster log file level = debug 2024-09-10T22:37:47.913 INFO:teuthology.orchestra.run.smithi131.stdout: debug asserts on shutdown = true 2024-09-10T22:37:47.913 INFO:teuthology.orchestra.run.smithi131.stdout: mon health detail to clog = false 2024-09-10T22:37:47.913 INFO:teuthology.orchestra.run.smithi131.stdout: mon host = "172.21.15.103,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]" 2024-09-10T22:37:47.913 INFO:teuthology.orchestra.run.smithi131.stdout: fsid = fb22394a-7771-44f4-99d8-bddd262146a5 2024-09-10T22:37:47.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.913 INFO:teuthology.orchestra.run.smithi131.stdout:[osd] 2024-09-10T22:37:47.914 INFO:teuthology.orchestra.run.smithi131.stdout: osd journal size = 100 2024-09-10T22:37:47.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.914 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub load threshold = 5.0 2024-09-10T22:37:47.914 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub max interval = 600 2024-09-10T22:37:47.914 INFO:teuthology.orchestra.run.smithi131.stdout: osd mclock profile = high_recovery_ops 2024-09-10T22:37:47.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.914 INFO:teuthology.orchestra.run.smithi131.stdout: osd recover clone overlap = true 2024-09-10T22:37:47.914 INFO:teuthology.orchestra.run.smithi131.stdout: osd recovery max chunk = 1048576 2024-09-10T22:37:47.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.914 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug shutdown = true 2024-09-10T22:37:47.914 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug op order = true 2024-09-10T22:37:47.914 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug verify stray on activate = true 2024-09-10T22:37:47.914 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug trim objects = true 2024-09-10T22:37:47.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.915 INFO:teuthology.orchestra.run.smithi131.stdout: osd open classes on start = true 2024-09-10T22:37:47.915 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug pg log writeout = true 2024-09-10T22:37:47.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.915 INFO:teuthology.orchestra.run.smithi131.stdout: osd deep scrub update digest min age = 30 2024-09-10T22:37:47.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.915 INFO:teuthology.orchestra.run.smithi131.stdout: osd map max advance = 10 2024-09-10T22:37:47.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.915 INFO:teuthology.orchestra.run.smithi131.stdout: journal zero on create = true 2024-09-10T22:37:47.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.915 INFO:teuthology.orchestra.run.smithi131.stdout: filestore ondisk finisher threads = 3 2024-09-10T22:37:47.915 INFO:teuthology.orchestra.run.smithi131.stdout: filestore apply finisher threads = 3 2024-09-10T22:37:47.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.915 INFO:teuthology.orchestra.run.smithi131.stdout: bdev debug aio = true 2024-09-10T22:37:47.916 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug misdirected ops = true 2024-09-10T22:37:47.916 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore block size = 96636764160 2024-09-10T22:37:47.916 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore fsck on mount = True 2024-09-10T22:37:47.916 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluefs = 20 2024-09-10T22:37:47.916 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluestore = 20 2024-09-10T22:37:47.916 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-09-10T22:37:47.916 INFO:teuthology.orchestra.run.smithi131.stdout: debug osd = 20 2024-09-10T22:37:47.916 INFO:teuthology.orchestra.run.smithi131.stdout: debug rocksdb = 10 2024-09-10T22:37:47.916 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T22:37:47.916 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd full ratio = 0.9 2024-09-10T22:37:47.916 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd nearfull ratio = 0.8 2024-09-10T22:37:47.916 INFO:teuthology.orchestra.run.smithi131.stdout: osd failsafe full ratio = 0.95 2024-09-10T22:37:47.916 INFO:teuthology.orchestra.run.smithi131.stdout: osd objectstore = bluestore 2024-09-10T22:37:47.916 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.917 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr] 2024-09-10T22:37:47.917 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-09-10T22:37:47.917 INFO:teuthology.orchestra.run.smithi131.stdout: debug mgr = 20 2024-09-10T22:37:47.917 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-09-10T22:37:47.917 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-09-10T22:37:47.917 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-09-10T22:37:47.917 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-09-10T22:37:47.917 INFO:teuthology.orchestra.run.smithi131.stdout: mgr/telemetry/nag = false 2024-09-10T22:37:47.917 INFO:teuthology.orchestra.run.smithi131.stdout: client mount timeout = 30 2024-09-10T22:37:47.917 INFO:teuthology.orchestra.run.smithi131.stdout: debug client = 20 2024-09-10T22:37:47.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.917 INFO:teuthology.orchestra.run.smithi131.stdout:[mon] 2024-09-10T22:37:47.917 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-09-10T22:37:47.917 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-09-10T22:37:47.917 INFO:teuthology.orchestra.run.smithi131.stdout: debug paxos = 20 2024-09-10T22:37:47.918 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-09-10T22:37:47.918 INFO:teuthology.orchestra.run.smithi131.stdout: mon data avail warn = 5 2024-09-10T22:37:47.918 INFO:teuthology.orchestra.run.smithi131.stdout: mon mgr mkfs grace = 240 2024-09-10T22:37:47.918 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-09-10T22:37:47.918 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd reporter subtree level = osd 2024-09-10T22:37:47.918 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd prime pg temp = true 2024-09-10T22:37:47.918 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-09-10T22:37:47.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.918 INFO:teuthology.orchestra.run.smithi131.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T22:37:47.918 INFO:teuthology.orchestra.run.smithi131.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T22:37:47.918 INFO:teuthology.orchestra.run.smithi131.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T22:37:47.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.918 INFO:teuthology.orchestra.run.smithi131.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T22:37:47.918 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T22:37:47.918 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T22:37:47.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.919 INFO:teuthology.orchestra.run.smithi131.stdout: # 1m isn't quite enough 2024-09-10T22:37:47.919 INFO:teuthology.orchestra.run.smithi131.stdout: mon_down_mkfs_grace = 2m 2024-09-10T22:37:47.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.919 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_filestore_osds = false 2024-09-10T22:37:47.919 INFO:teuthology.orchestra.run.smithi131.stdout: mon down mkfs grace = 300 2024-09-10T22:37:47.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-10T22:37:47.919 INFO:teuthology.orchestra.run.smithi131.stdout:[client] 2024-09-10T22:37:47.919 INFO:teuthology.orchestra.run.smithi131.stdout: rgw cache enabled = true 2024-09-10T22:37:47.919 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable ops log = true 2024-09-10T22:37:47.919 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable usage log = true 2024-09-10T22:37:47.919 INFO:teuthology.orchestra.run.smithi131.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T22:37:47.919 INFO:teuthology.orchestra.run.smithi131.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T22:37:47.919 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = "" 2024-09-10T22:37:47.919 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.a] 2024-09-10T22:37:47.919 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.b] 2024-09-10T22:37:47.920 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.c] 2024-09-10T22:37:47.920 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2024-09-10T22:37:47.920 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2024-09-10T22:37:47.920 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2024-09-10T22:37:47.920 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.d] 2024-09-10T22:37:47.922 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T22:37:47.923 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T22:37:48.019 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T22:37:48.019 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:37:48.019 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T22:37:48.028 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:37:48.028 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T22:37:48.078 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:37:48.078 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:37:48.078 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T22:37:48.078 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T22:37:48.149 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:37:48.149 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T22:37:48.202 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi131.front.sepia.ceph.com 2024-09-10T22:37:48.203 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:37:48.203 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T22:37:48.203 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T22:37:48.237 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:37:48.237 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T22:37:48.288 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T22:37:48.288 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T22:37:48.289 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T22:37:48.342 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T22:37:48.347 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T22:37:48.405 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T22:37:48.428 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T22:37:48.428 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T22:37:48.482 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T22:37:48.486 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-10T22:37:48.505 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T22:37:48.603 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T22:37:48.608 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-10T22:37:48.627 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T22:37:48.686 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T22:37:48.691 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-10T22:37:48.711 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T22:37:48.810 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T22:37:48.814 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-10T22:37:48.834 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T22:37:48.834 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T22:37:48.876 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T22:37:48.893 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-10T22:37:48.975 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-10T22:37:48.991 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T22:37:49.033 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-10T22:37:49.049 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-10T22:37:49.137 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-10T22:37:49.153 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T22:37:49.154 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T22:37:49.154 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T22:37:49.172 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T22:37:49.172 INFO:tasks.ceph:role: osd.0 2024-09-10T22:37:49.173 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:37:49.173 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T22:37:49.240 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T22:37:49.240 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T22:37:49.240 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T22:37:49.240 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T22:37:49.240 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T22:37:49.240 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-10T22:37:49.240 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T22:37:49.241 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T22:37:49.241 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T22:37:49.241 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T22:37:49.641 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-10T22:37:49.643 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-10T22:37:49.644 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T22:37:49.740 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T22:37:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T22:37:49.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:37:49.756 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T22:37:49.816 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T22:37:49.816 INFO:tasks.ceph:role: osd.1 2024-09-10T22:37:49.817 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:37:49.817 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T22:37:50.285 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-10T22:37:50.288 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-10T22:37:50.288 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-10T22:37:50.429 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T22:37:50.444 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T22:37:50.445 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:37:50.445 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T22:37:50.505 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T22:37:50.505 INFO:tasks.ceph:role: osd.2 2024-09-10T22:37:50.505 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:37:50.505 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T22:37:50.573 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T22:37:50.573 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T22:37:50.573 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T22:37:50.573 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T22:37:50.573 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T22:37:50.574 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-10T22:37:50.574 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T22:37:50.574 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T22:37:50.574 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T22:37:50.574 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T22:37:50.990 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-10T22:37:50.993 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-10T22:37:50.993 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-10T22:37:51.129 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T22:37:51.145 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T22:37:51.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:37:51.146 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T22:37:51.206 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T22:37:51.206 INFO:tasks.ceph:role: osd.3 2024-09-10T22:37:51.206 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:37:51.206 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T22:37:51.273 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T22:37:51.274 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T22:37:51.274 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T22:37:51.274 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T22:37:51.274 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T22:37:51.274 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-10T22:37:51.274 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T22:37:51.274 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T22:37:51.274 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T22:37:51.274 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T22:37:51.639 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-10T22:37:51.642 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-10T22:37:51.642 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-10T22:37:51.714 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T22:37:51.775 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T22:37:51.776 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:37:51.776 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T22:37:51.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:37:51.890+0000 7f656a2a27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T22:37:51.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:37:51.894+0000 7f656a2a27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T22:37:51.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:37:51.894+0000 7f656a2a27c0 -1 bdev(0x55ae1f5c9800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T22:37:51.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:37:51.894+0000 7f656a2a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T22:37:55.130 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T22:37:55.152 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T22:37:55.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:37:55.246+0000 7f35f40dc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T22:37:55.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:37:55.246+0000 7f35f40dc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T22:37:55.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:37:55.246+0000 7f35f40dc7c0 -1 bdev(0x55ec27643800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T22:37:55.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:37:55.246+0000 7f35f40dc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T22:37:58.493 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T22:37:58.514 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T22:37:58.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:37:58.601+0000 7fe458dd87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T22:37:58.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:37:58.605+0000 7fe458dd87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T22:37:58.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:37:58.605+0000 7fe458dd87c0 -1 bdev(0x5571d8793800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T22:37:58.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:37:58.605+0000 7fe458dd87c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T22:38:01.857 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T22:38:01.879 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T22:38:01.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:01.977+0000 7f31b1da27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T22:38:01.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:01.977+0000 7f31b1da27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T22:38:01.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:01.977+0000 7f31b1da27c0 -1 bdev(0x55b6936d1800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T22:38:01.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:01.977+0000 7f31b1da27c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T22:38:05.177 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T22:38:05.198 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-10T22:38:05.220 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T22:38:05.220 INFO:tasks.ceph:role: osd.4 2024-09-10T22:38:05.221 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-10T22:38:05.221 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T22:38:05.292 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T22:38:05.292 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T22:38:05.292 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T22:38:05.292 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T22:38:05.292 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T22:38:05.292 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-09-10T22:38:05.292 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T22:38:05.292 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T22:38:05.292 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T22:38:05.292 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T22:38:05.693 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-09-10T22:38:05.696 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-09-10T22:38:05.696 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-10T22:38:05.798 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-10T22:38:05.815 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T22:38:05.815 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:38:05.816 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-10T22:38:05.879 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T22:38:05.879 INFO:tasks.ceph:role: osd.5 2024-09-10T22:38:05.879 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-10T22:38:05.879 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T22:38:05.947 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T22:38:05.947 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T22:38:05.947 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T22:38:05.947 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T22:38:05.947 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T22:38:05.947 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-09-10T22:38:05.947 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T22:38:05.947 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T22:38:05.947 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T22:38:05.947 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T22:38:06.348 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-09-10T22:38:06.351 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-09-10T22:38:06.351 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-10T22:38:06.498 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-10T22:38:06.515 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T22:38:06.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:38:06.517 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-10T22:38:06.584 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T22:38:06.584 INFO:tasks.ceph:role: osd.6 2024-09-10T22:38:06.584 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-10T22:38:06.584 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T22:38:06.656 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T22:38:06.656 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T22:38:06.656 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T22:38:06.656 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T22:38:06.657 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T22:38:06.657 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-09-10T22:38:06.657 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T22:38:06.657 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T22:38:06.657 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T22:38:06.657 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T22:38:07.076 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-09-10T22:38:07.078 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-09-10T22:38:07.079 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-10T22:38:07.215 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-10T22:38:07.232 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T22:38:07.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:38:07.233 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-10T22:38:07.299 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T22:38:07.300 INFO:tasks.ceph:role: osd.7 2024-09-10T22:38:07.300 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-10T22:38:07.300 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T22:38:07.376 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T22:38:07.376 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T22:38:07.376 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T22:38:07.376 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T22:38:07.376 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T22:38:07.376 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-09-10T22:38:07.376 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T22:38:07.376 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T22:38:07.376 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T22:38:07.377 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T22:38:07.741 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-09-10T22:38:07.743 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-09-10T22:38:07.744 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-10T22:38:07.823 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-10T22:38:07.879 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T22:38:07.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:38:07.880 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T22:38:08.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:08.007+0000 7f06b424f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-10T22:38:08.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:08.007+0000 7f06b424f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-10T22:38:08.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:08.007+0000 7f06b424f7c0 -1 bdev(0x564c6fde7800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-10T22:38:08.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:08.007+0000 7f06b424f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-10T22:38:11.262 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T22:38:11.283 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T22:38:11.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:11.375+0000 7fc1baeec7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-10T22:38:11.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:11.379+0000 7fc1baeec7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-10T22:38:11.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:11.379+0000 7fc1baeec7c0 -1 bdev(0x561ecd0bf800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-10T22:38:11.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:11.379+0000 7fc1baeec7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-10T22:38:14.606 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T22:38:14.626 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T22:38:14.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:14.715+0000 7fc5d98c17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-10T22:38:14.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:14.715+0000 7fc5d98c17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-10T22:38:14.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:14.715+0000 7fc5d98c17c0 -1 bdev(0x5578f0649800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-10T22:38:14.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:14.719+0000 7fc5d98c17c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-10T22:38:16.040 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:38:16.044 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:38:17.961 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T22:38:17.981 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T22:38:18.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:18.075+0000 7fb4015a27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-10T22:38:18.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:18.079+0000 7fb4015a27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-10T22:38:18.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:18.079+0000 7fb4015a27c0 -1 bdev(0x55aab2aa1800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-10T22:38:18.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:18.079+0000 7fb4015a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-10T22:38:21.294 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T22:38:21.314 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T22:38:21.314 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:38:21.314 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-10T22:38:21.336 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:38:21.336 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-10T22:38:21.399 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:38:21.399 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-10T22:38:21.462 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:38:21.463 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T22:38:21.532 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:38:21.532 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T22:38:21.594 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:38:21.594 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T22:38:21.658 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:38:21.658 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T22:38:21.718 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:38:21.719 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T22:38:21.740 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:38:21.740 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-10T22:38:21.805 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:38:21.805 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-10T22:38:21.873 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:38:21.873 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-10T22:38:21.940 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:38:21.940 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-10T22:38:22.008 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:38:22.008 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-10T22:38:22.072 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:38:22.072 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-10T22:38:22.136 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:38:22.136 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T22:38:22.145 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:38:22.145 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-10T22:38:22.195 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:38:22.195 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-10T22:38:22.203 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:38:22.203 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-10T22:38:22.252 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T22:38:22.252 DEBUG:teuthology.orchestra.run.smithi103:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T22:38:22.255 DEBUG:teuthology.orchestra.run.smithi131:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T22:38:22.300 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.y] 2024-09-10T22:38:22.300 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA8yuBma9x+FBAAQrKkw3eGcKnLxSqVz/DHJQ== 2024-09-10T22:38:22.300 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a] 2024-09-10T22:38:22.300 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA8yuBmh8HQHBAAZlp4CnHLegqhgWrgXoyltw== 2024-09-10T22:38:22.300 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.c] 2024-09-10T22:38:22.300 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA8yuBm8I0TJBAAmW480qKYYrolVm7+SlJ97w== 2024-09-10T22:38:22.300 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.0] 2024-09-10T22:38:22.300 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA/yuBm+fNzNRAAwt8IZXd3mcEh5UbXc924UQ== 2024-09-10T22:38:22.300 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.1] 2024-09-10T22:38:22.300 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBDyuBmNBfvDhAAcBNATtrJNZ4RFzYXqWt2pg== 2024-09-10T22:38:22.301 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.2] 2024-09-10T22:38:22.301 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBGyuBmJD9HJBAAgq8tqoeDT8WNr7pMxQCCJw== 2024-09-10T22:38:22.301 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.3] 2024-09-10T22:38:22.301 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBJyuBmzxWIOhAA4yOLmTZAY0MRLj+w3mhCeQ== 2024-09-10T22:38:22.301 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.x] 2024-09-10T22:38:22.301 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA8yuBmghJQGBAAXvlC58nhT9H/c71/ToGCSw== 2024-09-10T22:38:22.301 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b] 2024-09-10T22:38:22.301 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA8yuBmpYUNKRAAstv0pZDy3081UKcsSWnWIg== 2024-09-10T22:38:22.301 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.d] 2024-09-10T22:38:22.301 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA8yuBmB55uMBAA1VqVuUEAk1i2LFBoZXiRmA== 2024-09-10T22:38:22.301 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.4] 2024-09-10T22:38:22.301 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBQyuBm3pi6ABAAnwu13uYkLRJuU5y+DE2Isw== 2024-09-10T22:38:22.301 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.5] 2024-09-10T22:38:22.301 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBTyuBmkaPVFhAALlwgsnQ/dUJVLTK2iAh6Ww== 2024-09-10T22:38:22.302 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.6] 2024-09-10T22:38:22.302 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBWyuBmL2kKKxAAbxeyAuzd994tvNfKKs+WIA== 2024-09-10T22:38:22.302 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.7] 2024-09-10T22:38:22.302 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBayuBmUmSwBBAAWTFVgtYXlyEI+rJzGIM+Aw== 2024-09-10T22:38:22.302 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-09-10T22:38:22.302 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA8yuBmtOhZNBAAeszxWpV60NIn/zOInT5Zzw== 2024-09-10T22:38:22.302 INFO:teuthology.orchestra.run.smithi103.stdout:[client.2] 2024-09-10T22:38:22.302 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA8yuBmd1E5OhAAfidEn8dwfGna8gwefsYtUg== 2024-09-10T22:38:22.302 INFO:teuthology.orchestra.run.smithi103.stdout:[client.1] 2024-09-10T22:38:22.302 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA9yuBmu20iAhAASacT/hh3sxW1XU/XD6uDjA== 2024-09-10T22:38:22.302 INFO:teuthology.orchestra.run.smithi103.stdout:[client.3] 2024-09-10T22:38:22.302 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA9yuBmGGhVCBAAAs3y0cfqMN0t0/PTNsVEQw== 2024-09-10T22:38:22.314 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.y] 2024-09-10T22:38:22.314 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA8yuBma9x+FBAAQrKkw3eGcKnLxSqVz/DHJQ== 2024-09-10T22:38:22.314 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2024-09-10T22:38:22.314 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA8yuBmh8HQHBAAZlp4CnHLegqhgWrgXoyltw== 2024-09-10T22:38:22.314 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2024-09-10T22:38:22.314 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA8yuBm8I0TJBAAmW480qKYYrolVm7+SlJ97w== 2024-09-10T22:38:22.315 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.0] 2024-09-10T22:38:22.315 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA/yuBm+fNzNRAAwt8IZXd3mcEh5UbXc924UQ== 2024-09-10T22:38:22.315 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.1] 2024-09-10T22:38:22.315 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQBDyuBmNBfvDhAAcBNATtrJNZ4RFzYXqWt2pg== 2024-09-10T22:38:22.315 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.2] 2024-09-10T22:38:22.315 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQBGyuBmJD9HJBAAgq8tqoeDT8WNr7pMxQCCJw== 2024-09-10T22:38:22.315 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.3] 2024-09-10T22:38:22.315 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQBJyuBmzxWIOhAA4yOLmTZAY0MRLj+w3mhCeQ== 2024-09-10T22:38:22.315 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.x] 2024-09-10T22:38:22.315 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA8yuBmghJQGBAAXvlC58nhT9H/c71/ToGCSw== 2024-09-10T22:38:22.315 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2024-09-10T22:38:22.315 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA8yuBmpYUNKRAAstv0pZDy3081UKcsSWnWIg== 2024-09-10T22:38:22.315 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.d] 2024-09-10T22:38:22.315 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA8yuBmB55uMBAA1VqVuUEAk1i2LFBoZXiRmA== 2024-09-10T22:38:22.316 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.4] 2024-09-10T22:38:22.316 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQBQyuBm3pi6ABAAnwu13uYkLRJuU5y+DE2Isw== 2024-09-10T22:38:22.316 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.5] 2024-09-10T22:38:22.316 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQBTyuBmkaPVFhAALlwgsnQ/dUJVLTK2iAh6Ww== 2024-09-10T22:38:22.316 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.6] 2024-09-10T22:38:22.316 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQBWyuBmL2kKKxAAbxeyAuzd994tvNfKKs+WIA== 2024-09-10T22:38:22.316 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.7] 2024-09-10T22:38:22.316 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQBayuBmUmSwBBAAWTFVgtYXlyEI+rJzGIM+Aw== 2024-09-10T22:38:22.316 INFO:teuthology.orchestra.run.smithi131.stdout:[client.0] 2024-09-10T22:38:22.316 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA8yuBmtOhZNBAAeszxWpV60NIn/zOInT5Zzw== 2024-09-10T22:38:22.316 INFO:teuthology.orchestra.run.smithi131.stdout:[client.2] 2024-09-10T22:38:22.316 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA8yuBmd1E5OhAAfidEn8dwfGna8gwefsYtUg== 2024-09-10T22:38:22.317 INFO:teuthology.orchestra.run.smithi131.stdout:[client.1] 2024-09-10T22:38:22.317 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA9yuBmu20iAhAASacT/hh3sxW1XU/XD6uDjA== 2024-09-10T22:38:22.317 INFO:teuthology.orchestra.run.smithi131.stdout:[client.3] 2024-09-10T22:38:22.317 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQA9yuBmGGhVCBAAAs3y0cfqMN0t0/PTNsVEQw== 2024-09-10T22:38:22.318 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T22:38:22.353 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T22:38:22.417 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T22:38:22.420 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T22:38:22.480 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T22:38:22.484 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T22:38:22.541 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T22:38:22.544 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T22:38:22.597 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T22:38:22.600 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T22:38:22.654 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T22:38:22.657 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T22:38:22.710 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T22:38:22.713 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T22:38:22.767 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T22:38:22.770 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T22:38:22.824 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T22:38:22.827 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T22:38:22.884 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T22:38:22.887 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T22:38:22.944 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T22:38:22.948 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T22:38:23.001 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T22:38:23.005 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T22:38:23.058 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T22:38:23.061 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T22:38:23.114 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T22:38:23.117 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T22:38:23.170 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T22:38:23.174 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T22:38:23.230 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T22:38:23.233 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T22:38:23.290 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T22:38:23.293 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T22:38:23.350 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T22:38:23.353 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T22:38:23.409 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T22:38:23.409 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T22:38:23.428 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T22:38:23.537 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T22:38:23.557 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-10T22:38:23.576 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T22:38:23.691 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-10T22:38:23.711 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-10T22:38:23.770 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T22:38:23.884 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-10T22:38:23.903 DEBUG:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T22:38:23.906 DEBUG:teuthology.orchestra.run.smithi131:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T22:38:23.951 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T22:38:23.952 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T22:38:23.952 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T22:38:23.957 INFO:tasks.ceph.mon.a:Started 2024-09-10T22:38:23.957 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T22:38:23.957 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T22:38:23.995 INFO:tasks.ceph.mon.b:Started 2024-09-10T22:38:23.995 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T22:38:23.995 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T22:38:23.998 INFO:tasks.ceph.mon.c:Started 2024-09-10T22:38:23.998 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T22:38:23.998 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-10T22:38:23.998 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-10T22:38:24.001 INFO:tasks.ceph.mgr.y:Started 2024-09-10T22:38:24.001 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T22:38:24.002 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T22:38:24.005 INFO:tasks.ceph.mgr.x:Started 2024-09-10T22:38:24.005 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-10T22:38:24.005 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-10T22:38:24.008 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-10T22:38:24.008 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-10T22:38:24.057 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-10T22:38:24.057 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-10T22:38:24.101 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-10T22:38:24.101 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-10T22:38:24.150 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-10T22:38:24.150 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-10T22:38:24.202 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-10T22:38:24.202 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-10T22:38:24.251 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-10T22:38:24.252 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-10T22:38:24.298 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-10T22:38:24.298 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-10T22:38:24.346 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-10T22:38:24.346 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-10T22:38:24.394 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-10T22:38:24.394 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-10T22:38:24.442 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-10T22:38:24.442 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-10T22:38:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.485+0000 7fcc97e00640 1 -- 172.21.15.103:0/1012202125 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc7c0052f0 msgr2=0x7fcc7c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.485+0000 7fcc97e00640 1 --2- 172.21.15.103:0/1012202125 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc7c0052f0 0x7fcc7c00b9d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000c610 tx=0x7fcc9001d350 comp rx=0 tx=0).stop 2024-09-10T22:38:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.485+0000 7fcc97e00640 1 -- 172.21.15.103:0/1012202125 shutdown_connections 2024-09-10T22:38:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.485+0000 7fcc97e00640 1 --2- 172.21.15.103:0/1012202125 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc7c0052f0 0x7fcc7c00b9d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.485+0000 7fcc97e00640 1 -- 172.21.15.103:0/1012202125 >> 172.21.15.103:0/1012202125 conn(0x7fcc9806cc00 msgr2=0x7fcc9806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:24.493 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-10T22:38:24.493 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-10T22:38:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.485+0000 7f346e200640 1 -- 172.21.15.103:0/1797413788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34681f78f0 msgr2=0x7f34680cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.485+0000 7f346e200640 1 --2- 172.21.15.103:0/1797413788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34681f78f0 0x7f34680cc0f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f34600ae040 tx=0x7f344c005840 comp rx=0 tx=0).stop 2024-09-10T22:38:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.485+0000 7f346e200640 1 -- 172.21.15.103:0/1797413788 shutdown_connections 2024-09-10T22:38:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.485+0000 7f346e200640 1 --2- 172.21.15.103:0/1797413788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34681f78f0 0x7f34680cc0f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.485+0000 7f346e200640 1 --2- 172.21.15.103:0/1797413788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3468158b70 0x7f34681f73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.485+0000 7f346e200640 1 --2- 172.21.15.103:0/1797413788 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f344c004d50 0x7f34680af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.489+0000 7f346e200640 1 -- 172.21.15.103:0/1797413788 >> 172.21.15.103:0/1797413788 conn(0x7f34680d1ac0 msgr2=0x7f346815f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.489+0000 7f346e200640 1 -- 172.21.15.103:0/1797413788 shutdown_connections 2024-09-10T22:38:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.489+0000 7f346e200640 1 -- 172.21.15.103:0/1797413788 wait complete. 2024-09-10T22:38:24.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.489+0000 7f2d4e000640 1 -- 172.21.15.103:0/1476633976 <== mon.0 v2:172.21.15.103:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f2d440054d0 con 0x7f2d500080a0 2024-09-10T22:38:24.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.489+0000 7fcc97e00640 1 -- 172.21.15.103:0/1012202125 shutdown_connections 2024-09-10T22:38:24.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.493+0000 7fcc97e00640 1 -- 172.21.15.103:0/1012202125 wait complete. 2024-09-10T22:38:24.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.493+0000 7fcc97e00640 1 Processor -- start 2024-09-10T22:38:24.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.493+0000 7fcc97e00640 1 -- start start 2024-09-10T22:38:24.501 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-10T22:38:24.501 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-10T22:38:24.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.497+0000 7f8ec1600640 1 -- 172.21.15.103:0/1217976108 <== mon.1 v2:172.21.15.131:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f8eb8004c30 con 0x7f8ec406d310 2024-09-10T22:38:24.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.497+0000 7f8ec1600640 1 -- 172.21.15.103:0/1217976108 <== mon.1 v2:172.21.15.131:3300/0 10 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v4)=0 v4) ==== 123+0+0 (secure 0 0 0) 0x7f8eb801b430 con 0x7f8ec406d310 2024-09-10T22:38:24.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.501+0000 7fcc97e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc7c0052f0 0x7fcc9815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.501+0000 7fcc97e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9815c6e0 0x7fcc98144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.501+0000 7fcc96a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc7c0052f0 0x7fcc9815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.501+0000 7fcc96a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc7c0052f0 0x7fcc9815c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:41456/0 (socket says 172.21.15.103:41456) 2024-09-10T22:38:24.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.501+0000 7fcc96a00640 1 -- 172.21.15.103:0/67682190 learned_addr learned my addr 172.21.15.103:0/67682190 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:24.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.501+0000 7fcc96000640 1 --2- 172.21.15.103:0/67682190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9815c6e0 0x7fcc98144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.501+0000 7fcc97e00640 1 --2- 172.21.15.103:0/67682190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc98145910 0x7fcc981445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.501+0000 7fcc97e00640 1 -- 172.21.15.103:0/67682190 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9815e310 con 0x7fcc98145910 2024-09-10T22:38:24.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.501+0000 7fcc97e00640 1 -- 172.21.15.103:0/67682190 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9815e190 con 0x7fcc9815c6e0 2024-09-10T22:38:24.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.501+0000 7fcc97e00640 1 -- 172.21.15.103:0/67682190 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcc982030d0 con 0x7fcc7c0052f0 2024-09-10T22:38:24.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.505+0000 7fcc97400640 1 --2- 172.21.15.103:0/67682190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc98145910 0x7fcc981445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.505+0000 7fcc96a00640 1 -- 172.21.15.103:0/67682190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9815c6e0 msgr2=0x7fcc98144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.510 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T22:38:24.510 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-10T22:38:24.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.505+0000 7fcc96a00640 1 --2- 172.21.15.103:0/67682190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9815c6e0 0x7fcc98144090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.505+0000 7fcc96a00640 1 -- 172.21.15.103:0/67682190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc98145910 msgr2=0x7fcc981445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.505+0000 7fcc96a00640 1 --2- 172.21.15.103:0/67682190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc98145910 0x7fcc981445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.505+0000 7fcc96a00640 1 -- 172.21.15.103:0/67682190 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc98147090 con 0x7fcc7c0052f0 2024-09-10T22:38:24.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.509+0000 7fcc96a00640 1 --2- 172.21.15.103:0/67682190 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc7c0052f0 0x7fcc9815c1a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800c500 tx=0x7fcc8800c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:24.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.509+0000 7fcc8ea00640 1 -- 172.21.15.103:0/67682190 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc88012830 con 0x7fcc7c0052f0 2024-09-10T22:38:24.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.509+0000 7fcc8ea00640 1 -- 172.21.15.103:0/67682190 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7fcc88017070 con 0x7fcc7c0052f0 2024-09-10T22:38:24.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.509+0000 7fcc8ea00640 1 -- 172.21.15.103:0/67682190 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc88012c10 con 0x7fcc7c0052f0 2024-09-10T22:38:24.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.509+0000 7fcc97e00640 1 -- 172.21.15.103:0/67682190 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc98150180 con 0x7fcc7c0052f0 2024-09-10T22:38:24.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.509+0000 7fcc97e00640 1 -- 172.21.15.103:0/67682190 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc98150740 con 0x7fcc7c0052f0 2024-09-10T22:38:24.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.509+0000 7fcc8ea00640 1 -- 172.21.15.103:0/67682190 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fcc8801c460 con 0x7fcc7c0052f0 2024-09-10T22:38:24.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.509+0000 7fcc8ea00640 1 -- 172.21.15.103:0/67682190 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcc8801b760 con 0x7fcc7c0052f0 2024-09-10T22:38:24.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.509+0000 7f9ad6200640 1 -- 172.21.15.103:0/171301625 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ad0070df0 msgr2=0x7f9ad015e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.513+0000 7f9ad6200640 1 --2- 172.21.15.103:0/171301625 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ad0070df0 0x7f9ad015e2c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9ad00d17a0 tx=0x7f9ac8021510 comp rx=0 tx=0).stop 2024-09-10T22:38:24.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.509+0000 7fcc97e00640 1 -- 172.21.15.103:0/67682190 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc98160370 con 0x7fcc7c0052f0 2024-09-10T22:38:24.525 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T22:38:24.526 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-10T22:38:24.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.517+0000 7f8ecc600640 1 -- 172.21.15.103:0/1217976108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ec406d310 msgr2=0x7f8ec4154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.517+0000 7f8ecc600640 1 --2- 172.21.15.103:0/1217976108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ec406d310 0x7f8ec4154b50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8010aa0 tx=0x7f8eb8010ea0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.521+0000 7f8ecc600640 1 -- 172.21.15.103:0/1217976108 shutdown_connections 2024-09-10T22:38:24.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.521+0000 7f8ecc600640 1 --2- 172.21.15.103:0/1217976108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ec41f8620 0x7f8ec4150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.521+0000 7f8ecc600640 1 --2- 172.21.15.103:0/1217976108 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ec415f040 0x7f8ec415f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.521+0000 7f8ecc600640 1 --2- 172.21.15.103:0/1217976108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ec406d310 0x7f8ec4154b50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.521+0000 7f8ecc600640 1 -- 172.21.15.103:0/1217976108 >> 172.21.15.103:0/1217976108 conn(0x7f8ec40cd3c0 msgr2=0x7f8ec40cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:24.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.521+0000 7f8ecc600640 1 -- 172.21.15.103:0/1217976108 shutdown_connections 2024-09-10T22:38:24.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.521+0000 7f8ecc600640 1 -- 172.21.15.103:0/1217976108 wait complete. 2024-09-10T22:38:24.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.513+0000 7fcc8ea00640 1 -- 172.21.15.103:0/67682190 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fcc88012db0 con 0x7fcc7c0052f0 2024-09-10T22:38:24.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.525+0000 7f9ad6200640 1 -- 172.21.15.103:0/171301625 shutdown_connections 2024-09-10T22:38:24.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.525+0000 7f9ad6200640 1 --2- 172.21.15.103:0/171301625 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ad0070df0 0x7f9ad015e2c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.525+0000 7f9ad6200640 1 --2- 172.21.15.103:0/171301625 >> v2:172.21.15.103:3300/0 conn(0x7f9ad015ce60 0x7f9ad00708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.525+0000 7f9ad6200640 1 --2- 172.21.15.103:0/171301625 >> v2:172.21.15.131:3300/0 conn(0x7f9ad00d1010 0x7f9ad015fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.525+0000 7f9ad6200640 1 -- 172.21.15.103:0/171301625 >> 172.21.15.103:0/171301625 conn(0x7f9ad006dd10 msgr2=0x7f9ad006e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:24.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.529+0000 7f9ad6200640 1 -- 172.21.15.103:0/171301625 shutdown_connections 2024-09-10T22:38:24.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.529+0000 7f9ad6200640 1 -- 172.21.15.103:0/171301625 wait complete. 2024-09-10T22:38:24.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.529+0000 7f9ad6200640 1 Processor -- start 2024-09-10T22:38:24.537 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-10T22:38:24.537 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-10T22:38:24.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.541+0000 7f9ad6200640 1 -- start start 2024-09-10T22:38:24.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.541+0000 7f9ad6200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ad0070df0 0x7f9ad00aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.541+0000 7f9ad6200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ad00d1010 0x7f9ad0153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.541+0000 7f9ad6200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ad015ce60 0x7f9ad0154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.541+0000 7f9ad6200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad0073700 con 0x7f9ad00d1010 2024-09-10T22:38:24.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.541+0000 7f9ad6200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad006cf60 con 0x7f9ad015ce60 2024-09-10T22:38:24.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.541+0000 7f9ad6200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad0073880 con 0x7f9ad0070df0 2024-09-10T22:38:24.548 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T22:38:24.548 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T22:38:24.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.541+0000 7f9ad4e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ad0070df0 0x7f9ad00aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.541+0000 7f9ad4e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ad0070df0 0x7f9ad00aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:41468/0 (socket says 172.21.15.103:41468) 2024-09-10T22:38:24.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.541+0000 7f9ad4e00640 1 -- 172.21.15.103:0/1265922932 learned_addr learned my addr 172.21.15.103:0/1265922932 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:24.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.541+0000 7f9ad5800640 1 --2- 172.21.15.103:0/1265922932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ad015ce60 0x7f9ad0154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.541+0000 7f9acfe00640 1 --2- 172.21.15.103:0/1265922932 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ad00d1010 0x7f9ad0153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.541+0000 7f9ad4e00640 1 -- 172.21.15.103:0/1265922932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ad015ce60 msgr2=0x7f9ad0154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.541+0000 7f9ad4e00640 1 --2- 172.21.15.103:0/1265922932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ad015ce60 0x7f9ad0154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.541+0000 7f9ad4e00640 1 -- 172.21.15.103:0/1265922932 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ad00d1010 msgr2=0x7f9ad0153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.541+0000 7f9ad4e00640 1 --2- 172.21.15.103:0/1265922932 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ad00d1010 0x7f9ad0153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.541+0000 7f9ad4e00640 1 -- 172.21.15.103:0/1265922932 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad01f2ef0 con 0x7f9ad0070df0 2024-09-10T22:38:24.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.541+0000 7f9acfe00640 1 --2- 172.21.15.103:0/1265922932 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ad00d1010 0x7f9ad0153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:38:24.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.545+0000 7f9ad4e00640 1 --2- 172.21.15.103:0/1265922932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ad0070df0 0x7f9ad00aef70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400d720 tx=0x7f9ac400dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:24.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.549+0000 7f9accc00640 1 -- 172.21.15.103:0/1265922932 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4017070 con 0x7f9ad0070df0 2024-09-10T22:38:24.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.549+0000 7f9accc00640 1 -- 172.21.15.103:0/1265922932 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f9ac4009c30 con 0x7f9ad0070df0 2024-09-10T22:38:24.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.549+0000 7f9accc00640 1 -- 172.21.15.103:0/1265922932 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac400de30 con 0x7f9ad0070df0 2024-09-10T22:38:24.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.549+0000 7f2d57200640 1 -- 172.21.15.103:0/1476633976 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f2d2c005110 con 0x7f2d500080a0 2024-09-10T22:38:24.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.553+0000 7f9ad6200640 1 -- 172.21.15.103:0/1265922932 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad01f71f0 con 0x7f9ad0070df0 2024-09-10T22:38:24.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.553+0000 7f9ad6200640 1 -- 172.21.15.103:0/1265922932 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad01f3470 con 0x7f9ad0070df0 2024-09-10T22:38:24.562 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-10T22:38:24.562 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-10T22:38:24.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.557+0000 7f9accc00640 1 -- 172.21.15.103:0/1265922932 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f9ac4023060 con 0x7f9ad0070df0 2024-09-10T22:38:24.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.557+0000 7f9accc00640 1 -- 172.21.15.103:0/1265922932 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9ac4004dc0 con 0x7f9ad0070df0 2024-09-10T22:38:24.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.557+0000 7f9ad6200640 1 -- 172.21.15.103:0/1265922932 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad015fca0 con 0x7f9ad0070df0 2024-09-10T22:38:24.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.561+0000 7f9accc00640 1 -- 172.21.15.103:0/1265922932 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f9ac40047a0 con 0x7f9ad0070df0 2024-09-10T22:38:24.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.573+0000 7f9accc00640 1 -- 172.21.15.103:0/1265922932 <== mon.2 v2:172.21.15.131:3301/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f9ac4005070 con 0x7f9ad0070df0 2024-09-10T22:38:24.581 DEBUG:tasks.ceph:set 18 configs 2024-09-10T22:38:24.582 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi103') 2024-09-10T22:38:24.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.577+0000 7f2d4e000640 1 -- 172.21.15.103:0/1476633976 <== mon.0 v2:172.21.15.103:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f2d44003600 con 0x7f2d500080a0 2024-09-10T22:38:24.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.577+0000 7f2d4e000640 1 -- 172.21.15.103:0/1476633976 <== mon.0 v2:172.21.15.103:3300/0 11 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f2d44003950 con 0x7f2d500080a0 2024-09-10T22:38:24.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.577+0000 7f7e23400640 1 -- 172.21.15.103:0/2865681325 <== mon.2 v2:172.21.15.131:3301/0 4 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f7e100ad440 con 0x7f7e240af010 2024-09-10T22:38:24.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.573+0000 7f7e2b600640 1 -- 172.21.15.103:0/2865681325 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e240af010 msgr2=0x7f7e2415f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.577+0000 7f7e2b600640 1 --2- 172.21.15.103:0/2865681325 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e240af010 0x7f7e2415f320 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7e10009840 tx=0x7f7e1001c840 comp rx=0 tx=0).stop 2024-09-10T22:38:24.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.577+0000 7f7e2b600640 1 -- 172.21.15.103:0/2865681325 shutdown_connections 2024-09-10T22:38:24.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.577+0000 7f7e2b600640 1 --2- 172.21.15.103:0/2865681325 >> v2:172.21.15.131:3300/0 conn(0x7f7e2415cef0 0x7f7e2415d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.577+0000 7f7e2b600640 1 --2- 172.21.15.103:0/2865681325 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e240af010 0x7f7e2415f320 secure :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7e10009840 tx=0x7f7e1001c840 comp rx=0 tx=0).stop 2024-09-10T22:38:24.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.577+0000 7f7e2b600640 1 -- 172.21.15.103:0/2865681325 >> 172.21.15.103:0/2865681325 conn(0x7f7e2406cc00 msgr2=0x7f7e2406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:24.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.581+0000 7fcc8ea00640 1 -- 172.21.15.103:0/67682190 <== mon.2 v2:172.21.15.131:3301/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fcc8801ca30 con 0x7fcc7c0052f0 2024-09-10T22:38:24.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.585+0000 7f7e2b600640 1 -- 172.21.15.103:0/2865681325 shutdown_connections 2024-09-10T22:38:24.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.589+0000 7f7e2b600640 1 -- 172.21.15.103:0/2865681325 wait complete. 2024-09-10T22:38:24.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.589+0000 7f7e2b600640 1 Processor -- start 2024-09-10T22:38:24.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f2d57200640 1 -- 172.21.15.103:0/1476633976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d500080a0 msgr2=0x7f2d500e32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f2d57200640 1 --2- 172.21.15.103:0/1476633976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d500080a0 0x7f2d500e32a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2d44009950 tx=0x7f2d440196b0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f2d57200640 1 -- 172.21.15.103:0/1476633976 shutdown_connections 2024-09-10T22:38:24.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f2d57200640 1 --2- 172.21.15.103:0/1476633976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d50055b90 0x7f2d50180250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f2d57200640 1 --2- 172.21.15.103:0/1476633976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d500080a0 0x7f2d500e32a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f2d57200640 1 --2- 172.21.15.103:0/1476633976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d50007780 0x7f2d500d7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f2d57200640 1 -- 172.21.15.103:0/1476633976 >> 172.21.15.103:0/1476633976 conn(0x7f2d50056720 msgr2=0x7f2d50033490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:24.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f7e2b600640 1 -- start start 2024-09-10T22:38:24.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f7e2b600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e240b2790 0x7f7e2415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f2d57200640 1 -- 172.21.15.103:0/1476633976 shutdown_connections 2024-09-10T22:38:24.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f7e2b600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e2415cef0 0x7f7e24153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f7e2b600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e24154420 0x7f7e240affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f2d57200640 1 -- 172.21.15.103:0/1476633976 wait complete. 2024-09-10T22:38:24.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f7e28c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e240b2790 0x7f7e2415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f7e28c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e240b2790 0x7f7e2415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:41476/0 (socket says 172.21.15.103:41476) 2024-09-10T22:38:24.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f7e28c00640 1 -- 172.21.15.103:0/3426691284 learned_addr learned my addr 172.21.15.103:0/3426691284 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:24.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f7e29600640 1 --2- 172.21.15.103:0/3426691284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e24154420 0x7f7e240affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f7e23e00640 1 --2- 172.21.15.103:0/3426691284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e2415cef0 0x7f7e24153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f7e2b600640 1 -- 172.21.15.103:0/3426691284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7e24168930 con 0x7f7e2415cef0 2024-09-10T22:38:24.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f7e2b600640 1 -- 172.21.15.103:0/3426691284 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7e241687b0 con 0x7f7e24154420 2024-09-10T22:38:24.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f7e2b600640 1 -- 172.21.15.103:0/3426691284 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7e24168ab0 con 0x7f7e240b2790 2024-09-10T22:38:24.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f7e29600640 1 -- 172.21.15.103:0/3426691284 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e240b2790 msgr2=0x7f7e2415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f7e29600640 1 --2- 172.21.15.103:0/3426691284 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e240b2790 0x7f7e2415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f7e29600640 1 -- 172.21.15.103:0/3426691284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e2415cef0 msgr2=0x7f7e24153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f7e29600640 1 --2- 172.21.15.103:0/3426691284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e2415cef0 0x7f7e24153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f7e29600640 1 -- 172.21.15.103:0/3426691284 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2415ac30 con 0x7f7e24154420 2024-09-10T22:38:24.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.597+0000 7f7e23e00640 1 --2- 172.21.15.103:0/3426691284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e2415cef0 0x7f7e24153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:38:24.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.601+0000 7f7e29600640 1 --2- 172.21.15.103:0/3426691284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e24154420 0x7f7e240affb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00be20 tx=0x7f7e1c00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:24.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.601+0000 7f7e20c00640 1 -- 172.21.15.103:0/3426691284 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c019070 con 0x7f7e24154420 2024-09-10T22:38:24.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.601+0000 7f7e20c00640 1 -- 172.21.15.103:0/3426691284 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f7e1c014440 con 0x7f7e24154420 2024-09-10T22:38:24.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.601+0000 7f7e20c00640 1 -- 172.21.15.103:0/3426691284 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c019070 con 0x7f7e24154420 2024-09-10T22:38:24.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.601+0000 7f7e2b600640 1 -- 172.21.15.103:0/3426691284 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e2415aeb0 con 0x7f7e24154420 2024-09-10T22:38:24.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.601+0000 7f7e2b600640 1 -- 172.21.15.103:0/3426691284 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e2415b470 con 0x7f7e24154420 2024-09-10T22:38:24.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.601+0000 7f7e20c00640 1 -- 172.21.15.103:0/3426691284 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f7e1c014650 con 0x7f7e24154420 2024-09-10T22:38:24.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.601+0000 7f7e20c00640 1 -- 172.21.15.103:0/3426691284 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7e1c00cc70 con 0x7f7e24154420 2024-09-10T22:38:24.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.601+0000 7f7e1a000640 1 -- 172.21.15.103:0/3426691284 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dfc005090 con 0x7f7e24154420 2024-09-10T22:38:24.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.605+0000 7f7e20c00640 1 -- 172.21.15.103:0/3426691284 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f7e1c023070 con 0x7f7e24154420 2024-09-10T22:38:24.639 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi103') 2024-09-10T22:38:24.640 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi103') 2024-09-10T22:38:24.640 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi103') 2024-09-10T22:38:24.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.721+0000 7ff7abe00640 1 -- 172.21.15.103:0/2561091611 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7ac06f9d0 msgr2=0x7ff7ac15e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.721+0000 7ff7abe00640 1 --2- 172.21.15.103:0/2561091611 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7ac06f9d0 0x7ff7ac15e120 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009bc0 tx=0x7ff7a401cbc0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.721+0000 7ff7abe00640 1 -- 172.21.15.103:0/2561091611 shutdown_connections 2024-09-10T22:38:24.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.721+0000 7ff7abe00640 1 --2- 172.21.15.103:0/2561091611 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7ac06f9d0 0x7ff7ac15e120 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.721+0000 7ff7abe00640 1 --2- 172.21.15.103:0/2561091611 >> v2:172.21.15.103:3300/0 conn(0x7ff7ac157f30 0x7ff7ac06f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.721+0000 7ff7abe00640 1 -- 172.21.15.103:0/2561091611 >> 172.21.15.103:0/2561091611 conn(0x7ff7ac06cc00 msgr2=0x7ff7ac06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:24.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.721+0000 7ff7abe00640 1 -- 172.21.15.103:0/2561091611 shutdown_connections 2024-09-10T22:38:24.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.721+0000 7ff7abe00640 1 -- 172.21.15.103:0/2561091611 wait complete. 2024-09-10T22:38:24.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.725+0000 7ff7abe00640 1 Processor -- start 2024-09-10T22:38:24.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.725+0000 7ff7abe00640 1 -- start start 2024-09-10T22:38:24.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.725+0000 7ff7abe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7ac06f9d0 0x7ff7ac148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.725+0000 7ff7abe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7ac157f30 0x7ff7ac159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7aaa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7ac06f9d0 0x7ff7ac148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7aaa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7ac06f9d0 0x7ff7ac148400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:45446/0 (socket says 172.21.15.103:45446) 2024-09-10T22:38:24.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7aaa00640 1 -- 172.21.15.103:0/3508635538 learned_addr learned my addr 172.21.15.103:0/3508635538 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:24.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7abe00640 1 --2- 172.21.15.103:0/3508635538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7ac15e660 0x7ff7ac06e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7abe00640 1 -- 172.21.15.103:0/3508635538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac1673c0 con 0x7ff7ac157f30 2024-09-10T22:38:24.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7abe00640 1 -- 172.21.15.103:0/3508635538 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac167240 con 0x7ff7ac06f9d0 2024-09-10T22:38:24.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7abe00640 1 -- 172.21.15.103:0/3508635538 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ac167540 con 0x7ff7ac15e660 2024-09-10T22:38:24.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7aaa00640 1 -- 172.21.15.103:0/3508635538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7ac15e660 msgr2=0x7ff7ac06e380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T22:38:24.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7aaa00640 1 --2- 172.21.15.103:0/3508635538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7ac15e660 0x7ff7ac06e380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7aaa00640 1 -- 172.21.15.103:0/3508635538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7ac157f30 msgr2=0x7ff7ac159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7aaa00640 1 --2- 172.21.15.103:0/3508635538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7ac157f30 0x7ff7ac159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7aaa00640 1 -- 172.21.15.103:0/3508635538 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ac159db0 con 0x7ff7ac06f9d0 2024-09-10T22:38:24.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7aaa00640 1 --2- 172.21.15.103:0/3508635538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7ac06f9d0 0x7ff7ac148400 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff79400b4a0 tx=0x7ff79400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:24.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7a2a00640 1 -- 172.21.15.103:0/3508635538 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff794014070 con 0x7ff7ac06f9d0 2024-09-10T22:38:24.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7a2a00640 1 -- 172.21.15.103:0/3508635538 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7ff7940106e0 con 0x7ff7ac06f9d0 2024-09-10T22:38:24.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7a2a00640 1 -- 172.21.15.103:0/3508635538 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff794010b50 con 0x7ff7ac06f9d0 2024-09-10T22:38:24.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7abe00640 1 -- 172.21.15.103:0/3508635538 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ac148b90 con 0x7ff7ac06f9d0 2024-09-10T22:38:24.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7abe00640 1 -- 172.21.15.103:0/3508635538 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ac149150 con 0x7ff7ac06f9d0 2024-09-10T22:38:24.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7a2a00640 1 -- 172.21.15.103:0/3508635538 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7ff794019450 con 0x7ff7ac06f9d0 2024-09-10T22:38:24.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.729+0000 7ff7abe00640 1 -- 172.21.15.103:0/3508635538 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7ac15e120 con 0x7ff7ac06f9d0 2024-09-10T22:38:24.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.733+0000 7ff7a2a00640 1 -- 172.21.15.103:0/3508635538 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff794019ce0 con 0x7ff7ac06f9d0 2024-09-10T22:38:24.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.737+0000 7ff7a2a00640 1 -- 172.21.15.103:0/3508635538 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7ff794010cf0 con 0x7ff7ac06f9d0 2024-09-10T22:38:24.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.809+0000 7f5df5400640 1 -- 172.21.15.103:0/1734752145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5de80e2ee0 msgr2=0x7f5de8034340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.809+0000 7f5df5400640 1 --2- 172.21.15.103:0/1734752145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5de80e2ee0 0x7f5de8034340 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5de800d580 tx=0x7f5de401c870 comp rx=0 tx=0).stop 2024-09-10T22:38:24.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.809+0000 7f5df5400640 1 -- 172.21.15.103:0/1734752145 shutdown_connections 2024-09-10T22:38:24.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.809+0000 7f5df5400640 1 --2- 172.21.15.103:0/1734752145 >> v2:172.21.15.103:3300/0 conn(0x7f5de8052a50 0x7f5de8052e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.809+0000 7f5df5400640 1 --2- 172.21.15.103:0/1734752145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5de80e2ee0 0x7f5de8034340 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.809+0000 7f5df5400640 1 -- 172.21.15.103:0/1734752145 >> 172.21.15.103:0/1734752145 conn(0x7f5de801d780 msgr2=0x7f5de8054570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:24.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.809+0000 7f5df5400640 1 -- 172.21.15.103:0/1734752145 shutdown_connections 2024-09-10T22:38:24.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.809+0000 7f5df5400640 1 -- 172.21.15.103:0/1734752145 wait complete. 2024-09-10T22:38:24.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.813+0000 7f5df5400640 1 Processor -- start 2024-09-10T22:38:24.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.813+0000 7f9ad6200640 1 -- 172.21.15.103:0/1265922932 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f9ad0070690 con 0x7f9ad0070df0 2024-09-10T22:38:24.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.817+0000 7fcc97e00640 1 -- 172.21.15.103:0/67682190 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fcc980b2930 con 0x7fcc7c0052f0 2024-09-10T22:38:24.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.817+0000 7f5df5400640 1 -- start start 2024-09-10T22:38:24.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.817+0000 7f5df5400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5de8035f10 0x7f5de804d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.817+0000 7f5df5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5de8052a50 0x7f5de804b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.817+0000 7f5df5400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5de80e2ee0 0x7f5de818c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.817+0000 7f5defe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5de8035f10 0x7f5de804d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.817+0000 7f5defe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5de8035f10 0x7f5de804d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:41486/0 (socket says 172.21.15.103:41486) 2024-09-10T22:38:24.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.817+0000 7f5def400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5de8052a50 0x7f5de804b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.817+0000 7f5def400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5de8052a50 0x7f5de804b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34896/0 (socket says 172.21.15.103:34896) 2024-09-10T22:38:24.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.817+0000 7f5defe00640 1 -- 172.21.15.103:0/1200040569 learned_addr learned my addr 172.21.15.103:0/1200040569 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:24.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.817+0000 7f5df5400640 1 -- 172.21.15.103:0/1200040569 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5de8053930 con 0x7f5de8052a50 2024-09-10T22:38:24.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.817+0000 7f5df5400640 1 -- 172.21.15.103:0/1200040569 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5de80537b0 con 0x7f5de80e2ee0 2024-09-10T22:38:24.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.817+0000 7f5df5400640 1 -- 172.21.15.103:0/1200040569 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5de8033900 con 0x7f5de8035f10 2024-09-10T22:38:24.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.817+0000 7f5df4a00640 1 --2- 172.21.15.103:0/1200040569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5de80e2ee0 0x7f5de818c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.821+0000 7f5defe00640 1 -- 172.21.15.103:0/1200040569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5de80e2ee0 msgr2=0x7f5de818c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.821+0000 7f5defe00640 1 --2- 172.21.15.103:0/1200040569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5de80e2ee0 0x7f5de818c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.821+0000 7f5defe00640 1 -- 172.21.15.103:0/1200040569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5de8052a50 msgr2=0x7f5de804b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.821+0000 7f5defe00640 1 --2- 172.21.15.103:0/1200040569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5de8052a50 0x7f5de804b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.821+0000 7f5defe00640 1 -- 172.21.15.103:0/1200040569 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de804baf0 con 0x7f5de8035f10 2024-09-10T22:38:24.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.821+0000 7f5df4a00640 1 --2- 172.21.15.103:0/1200040569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5de80e2ee0 0x7f5de818c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:38:24.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.821+0000 7f5defe00640 1 --2- 172.21.15.103:0/1200040569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5de8035f10 0x7f5de804d9c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5de4000c10 tx=0x7f5de40a57b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:24.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.821+0000 7f5de3e00640 1 -- 172.21.15.103:0/1200040569 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de40bc020 con 0x7f5de8035f10 2024-09-10T22:38:24.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.821+0000 7f5de3e00640 1 -- 172.21.15.103:0/1200040569 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f5de4005020 con 0x7f5de8035f10 2024-09-10T22:38:24.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.821+0000 7f5de3e00640 1 -- 172.21.15.103:0/1200040569 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de40b2040 con 0x7f5de8035f10 2024-09-10T22:38:24.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.821+0000 7f5df5400640 1 -- 172.21.15.103:0/1200040569 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de804e0d0 con 0x7f5de8035f10 2024-09-10T22:38:24.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.821+0000 7f5df5400640 1 -- 172.21.15.103:0/1200040569 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de804e690 con 0x7f5de8035f10 2024-09-10T22:38:24.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.821+0000 7f5de3e00640 1 -- 172.21.15.103:0/1200040569 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f5de40b5070 con 0x7f5de8035f10 2024-09-10T22:38:24.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.821+0000 7f5de3e00640 1 -- 172.21.15.103:0/1200040569 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5de4003a10 con 0x7f5de8035f10 2024-09-10T22:38:24.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.821+0000 7f5de1600640 1 -- 172.21.15.103:0/1200040569 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de8052e60 con 0x7f5de8035f10 2024-09-10T22:38:24.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.829+0000 7f5de3e00640 1 -- 172.21.15.103:0/1200040569 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f5de40c6060 con 0x7f5de8035f10 2024-09-10T22:38:24.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.829+0000 7fcc8ea00640 1 -- 172.21.15.103:0/67682190 <== mon.2 v2:172.21.15.131:3301/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v6)=0 v6) ==== 108+0+0 (secure 0 0 0) 0x7fcc8801ccb0 con 0x7fcc7c0052f0 2024-09-10T22:38:24.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.837+0000 7f5de3e00640 1 -- 172.21.15.103:0/1200040569 <== mon.2 v2:172.21.15.131:3301/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5de4000e50 con 0x7f5de8035f10 2024-09-10T22:38:24.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.837+0000 7f9accc00640 1 -- 172.21.15.103:0/1265922932 <== mon.2 v2:172.21.15.131:3301/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ac4029020 con 0x7f9ad0070df0 2024-09-10T22:38:24.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.841+0000 7fcc97e00640 1 -- 172.21.15.103:0/67682190 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc7c0052f0 msgr2=0x7fcc9815c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.841+0000 7fcc97e00640 1 --2- 172.21.15.103:0/67682190 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc7c0052f0 0x7fcc9815c1a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800c500 tx=0x7fcc8800c9c0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.841+0000 7ff7a2a00640 1 -- 172.21.15.103:0/3508635538 <== mon.1 v2:172.21.15.131:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff79400f680 con 0x7ff7ac06f9d0 2024-09-10T22:38:24.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.841+0000 7f7e20c00640 1 -- 172.21.15.103:0/3426691284 <== mon.1 v2:172.21.15.131:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e1c01e440 con 0x7f7e24154420 2024-09-10T22:38:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.841+0000 7fcc97e00640 1 -- 172.21.15.103:0/67682190 shutdown_connections 2024-09-10T22:38:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.841+0000 7fcc97e00640 1 --2- 172.21.15.103:0/67682190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc98145910 0x7fcc981445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.841+0000 7fcc97e00640 1 --2- 172.21.15.103:0/67682190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9815c6e0 0x7fcc98144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.841+0000 7fcc97e00640 1 --2- 172.21.15.103:0/67682190 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc7c0052f0 0x7fcc9815c1a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.841+0000 7fcc97e00640 1 -- 172.21.15.103:0/67682190 >> 172.21.15.103:0/67682190 conn(0x7fcc9806cc00 msgr2=0x7fcc9806fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.841+0000 7fcc97e00640 1 -- 172.21.15.103:0/67682190 shutdown_connections 2024-09-10T22:38:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.841+0000 7fcc97e00640 1 -- 172.21.15.103:0/67682190 wait complete. 2024-09-10T22:38:24.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.845+0000 7f9accc00640 1 -- 172.21.15.103:0/1265922932 <== mon.2 v2:172.21.15.131:3301/0 9 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v7)=0 v7) ==== 123+0+0 (secure 0 0 0) 0x7f9ac40053f0 con 0x7f9ad0070df0 2024-09-10T22:38:24.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.857+0000 7f9ad6200640 1 -- 172.21.15.103:0/1265922932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ad0070df0 msgr2=0x7f9ad00aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.857+0000 7f9ad6200640 1 --2- 172.21.15.103:0/1265922932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ad0070df0 0x7f9ad00aef70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400d720 tx=0x7f9ac400dbe0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.857+0000 7f22e2c00640 1 -- 172.21.15.103:0/4161277587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22dc0733e0 msgr2=0x7f22dc15ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.857+0000 7f22e2c00640 1 --2- 172.21.15.103:0/4161277587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22dc0733e0 0x7f22dc15ea30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f22dc0b4dc0 tx=0x7f22c802d850 comp rx=0 tx=0).stop 2024-09-10T22:38:24.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.861+0000 7f22e2c00640 1 -- 172.21.15.103:0/4161277587 shutdown_connections 2024-09-10T22:38:24.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.861+0000 7f22e2c00640 1 --2- 172.21.15.103:0/4161277587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22dc0733e0 0x7f22dc15ea30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.861+0000 7f22e2c00640 1 --2- 172.21.15.103:0/4161277587 >> v2:172.21.15.103:3300/0 conn(0x7f22dc0b3b00 0x7f22dc154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.861+0000 7f22e2c00640 1 -- 172.21.15.103:0/4161277587 >> 172.21.15.103:0/4161277587 conn(0x7f22dc06d200 msgr2=0x7f22dc0b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:24.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.861+0000 7f9ad6200640 1 -- 172.21.15.103:0/1265922932 shutdown_connections 2024-09-10T22:38:24.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.861+0000 7f9ad6200640 1 --2- 172.21.15.103:0/1265922932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ad015ce60 0x7f9ad0154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.861+0000 7f9ad6200640 1 --2- 172.21.15.103:0/1265922932 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ad00d1010 0x7f9ad0153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.861+0000 7f9ad6200640 1 --2- 172.21.15.103:0/1265922932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ad0070df0 0x7f9ad00aef70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.861+0000 7f9ad6200640 1 -- 172.21.15.103:0/1265922932 >> 172.21.15.103:0/1265922932 conn(0x7f9ad006dd10 msgr2=0x7f9ad006e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:24.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.861+0000 7f22e2c00640 1 -- 172.21.15.103:0/4161277587 shutdown_connections 2024-09-10T22:38:24.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.861+0000 7f22e2c00640 1 -- 172.21.15.103:0/4161277587 wait complete. 2024-09-10T22:38:24.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.861+0000 7f9ad6200640 1 -- 172.21.15.103:0/1265922932 shutdown_connections 2024-09-10T22:38:24.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.861+0000 7f9ad6200640 1 -- 172.21.15.103:0/1265922932 wait complete. 2024-09-10T22:38:24.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.865+0000 7f22e2c00640 1 Processor -- start 2024-09-10T22:38:24.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.865+0000 7f22e2c00640 1 -- start start 2024-09-10T22:38:24.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22e2c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22dc0733e0 0x7f22dc14eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22e2c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22dc0b3b00 0x7f22dc156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22e2c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22dc161080 0x7f22dc15b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22e2c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc160320 con 0x7f22dc0b3b00 2024-09-10T22:38:24.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22e2c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc1601a0 con 0x7f22dc0733e0 2024-09-10T22:38:24.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22e2c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f22dc164930 con 0x7f22dc161080 2024-09-10T22:38:24.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22dbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22dc0733e0 0x7f22dc14eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22e0c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22dc161080 0x7f22dc15b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22dbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22dc0733e0 0x7f22dc14eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:45486/0 (socket says 172.21.15.103:45486) 2024-09-10T22:38:24.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22dbe00640 1 -- 172.21.15.103:0/3342444202 learned_addr learned my addr 172.21.15.103:0/3342444202 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:24.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22db400640 1 --2- 172.21.15.103:0/3342444202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22dc0b3b00 0x7f22dc156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22dbe00640 1 -- 172.21.15.103:0/3342444202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22dc161080 msgr2=0x7f22dc15b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22dbe00640 1 --2- 172.21.15.103:0/3342444202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22dc161080 0x7f22dc15b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22dbe00640 1 -- 172.21.15.103:0/3342444202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22dc0b3b00 msgr2=0x7f22dc156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22dbe00640 1 --2- 172.21.15.103:0/3342444202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22dc0b3b00 0x7f22dc156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22dbe00640 1 -- 172.21.15.103:0/3342444202 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22dc156400 con 0x7f22dc0733e0 2024-09-10T22:38:24.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22dbe00640 1 --2- 172.21.15.103:0/3342444202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22dc0733e0 0x7f22dc14eec0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00b420 tx=0x7f22cc00b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22d3e00640 1 -- 172.21.15.103:0/3342444202 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc011830 con 0x7f22dc0733e0 2024-09-10T22:38:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22d3e00640 1 -- 172.21.15.103:0/3342444202 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22cc016070 con 0x7f22dc0733e0 2024-09-10T22:38:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22d3e00640 1 -- 172.21.15.103:0/3342444202 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc011d80 con 0x7f22dc0733e0 2024-09-10T22:38:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22e2c00640 1 -- 172.21.15.103:0/3342444202 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22dc1566e0 con 0x7f22dc0733e0 2024-09-10T22:38:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22e2c00640 1 -- 172.21.15.103:0/3342444202 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22dc14f400 con 0x7f22dc0733e0 2024-09-10T22:38:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22d3e00640 1 -- 172.21.15.103:0/3342444202 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f22cc003610 con 0x7f22dc0733e0 2024-09-10T22:38:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.873+0000 7f22d3e00640 1 -- 172.21.15.103:0/3342444202 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f22cc01a8f0 con 0x7f22dc0733e0 2024-09-10T22:38:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.877+0000 7f22e2c00640 1 -- 172.21.15.103:0/3342444202 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22dc15ea30 con 0x7f22dc0733e0 2024-09-10T22:38:24.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.877+0000 7f22d3e00640 1 -- 172.21.15.103:0/3342444202 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f22cc01f020 con 0x7f22dc0733e0 2024-09-10T22:38:24.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.889+0000 7f2082800640 1 -- 172.21.15.103:0/4107958708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2074036020 msgr2=0x7f2074100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.889+0000 7f2082800640 1 --2- 172.21.15.103:0/4107958708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2074036020 0x7f2074100c70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f207000a950 tx=0x7f207001db20 comp rx=0 tx=0).stop 2024-09-10T22:38:24.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.889+0000 7f2082800640 1 -- 172.21.15.103:0/4107958708 shutdown_connections 2024-09-10T22:38:24.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.889+0000 7f2082800640 1 --2- 172.21.15.103:0/4107958708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2074036020 0x7f2074100c70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.889+0000 7f2082800640 1 -- 172.21.15.103:0/4107958708 >> 172.21.15.103:0/4107958708 conn(0x7f207401d7b0 msgr2=0x7f20740545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:24.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.889+0000 7fb0b2000640 1 -- 172.21.15.103:0/4264364148 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0ac0b3b00 msgr2=0x7fb0ac154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.889+0000 7fb0b2000640 1 --2- 172.21.15.103:0/4264364148 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0ac0b3b00 0x7fb0ac154a70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac15dfb0 tx=0x7fb09c01c760 comp rx=0 tx=0).stop 2024-09-10T22:38:24.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.889+0000 7fb0b2000640 1 -- 172.21.15.103:0/4264364148 shutdown_connections 2024-09-10T22:38:24.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.889+0000 7fb0b2000640 1 --2- 172.21.15.103:0/4264364148 >> v2:172.21.15.103:3300/0 conn(0x7fb0ac0733e0 0x7fb0ac15ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.889+0000 7fb0b2000640 1 --2- 172.21.15.103:0/4264364148 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0ac0b3b00 0x7fb0ac154a70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.889+0000 7fb0b2000640 1 -- 172.21.15.103:0/4264364148 >> 172.21.15.103:0/4264364148 conn(0x7fb0ac06d200 msgr2=0x7fb0ac0b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:24.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.889+0000 7fb0b2000640 1 -- 172.21.15.103:0/4264364148 shutdown_connections 2024-09-10T22:38:24.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.889+0000 7fb0b2000640 1 -- 172.21.15.103:0/4264364148 wait complete. 2024-09-10T22:38:24.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.893+0000 7f2082800640 1 -- 172.21.15.103:0/4107958708 shutdown_connections 2024-09-10T22:38:24.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.893+0000 7f2082800640 1 -- 172.21.15.103:0/4107958708 wait complete. 2024-09-10T22:38:24.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.893+0000 7fb0b2000640 1 Processor -- start 2024-09-10T22:38:24.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.897+0000 7f7e1a000640 1 -- 172.21.15.103:0/3426691284 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f7dfc005380 con 0x7f7e24154420 2024-09-10T22:38:24.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.893+0000 7fb0b2000640 1 -- start start 2024-09-10T22:38:24.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.897+0000 7fb0b2000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0ac0733e0 0x7fb0ac1597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.897+0000 7fb0b2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0ac0b3b00 0x7fb0ac145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.897+0000 7f2082800640 1 Processor -- start 2024-09-10T22:38:24.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.897+0000 7f2082800640 1 -- start start 2024-09-10T22:38:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.897+0000 7fb0b2000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0ac161080 0x7fb0ac1585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.897+0000 7fb0ab400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0ac0733e0 0x7fb0ac1597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.897+0000 7fb0ab400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0ac0733e0 0x7fb0ac1597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:45502/0 (socket says 172.21.15.103:45502) 2024-09-10T22:38:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.897+0000 7fb0ab400640 1 -- 172.21.15.103:0/3735918015 learned_addr learned my addr 172.21.15.103:0/3735918015 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.897+0000 7fb0b2000640 1 -- 172.21.15.103:0/3735918015 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac160340 con 0x7fb0ac0b3b00 2024-09-10T22:38:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.897+0000 7fb0b2000640 1 -- 172.21.15.103:0/3735918015 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac1601c0 con 0x7fb0ac0733e0 2024-09-10T22:38:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.897+0000 7fb0b2000640 1 -- 172.21.15.103:0/3735918015 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb0ac164930 con 0x7fb0ac161080 2024-09-10T22:38:24.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.897+0000 7f2082800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2074036020 0x7f20740520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.897+0000 7f2082800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2074039d00 0x7f2074053a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.897+0000 7f2082800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2074054ec0 0x7f20740312d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f2082800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2074111390 con 0x7f2074039d00 2024-09-10T22:38:24.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f2082800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2074111210 con 0x7f2074054ec0 2024-09-10T22:38:24.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f2082800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2074111510 con 0x7f2074036020 2024-09-10T22:38:24.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f207aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2074039d00 0x7f2074053a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f207aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2074039d00 0x7f2074053a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34930/0 (socket says 172.21.15.103:34930) 2024-09-10T22:38:24.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f207aa00640 1 -- 172.21.15.103:0/3840028455 learned_addr learned my addr 172.21.15.103:0/3840028455 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:24.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f207b400640 1 --2- 172.21.15.103:0/3840028455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2074036020 0x7f20740520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f207be00640 1 --2- 172.21.15.103:0/3840028455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2074054ec0 0x7f20740312d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7fb0aaa00640 1 --2- 172.21.15.103:0/3735918015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0ac0b3b00 0x7fb0ac145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f207be00640 1 -- 172.21.15.103:0/3840028455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2074036020 msgr2=0x7f20740520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f207be00640 1 --2- 172.21.15.103:0/3840028455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2074036020 0x7f20740520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f207be00640 1 -- 172.21.15.103:0/3840028455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2074039d00 msgr2=0x7f2074053a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f207be00640 1 --2- 172.21.15.103:0/3840028455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2074039d00 0x7f2074053a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f207be00640 1 -- 172.21.15.103:0/3840028455 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20740eb6e0 con 0x7f2074054ec0 2024-09-10T22:38:24.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f207b400640 1 --2- 172.21.15.103:0/3840028455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2074036020 0x7f20740520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:38:24.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f207be00640 1 --2- 172.21.15.103:0/3840028455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2074054ec0 0x7f20740312d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f207c069f90 tx=0x7f207c069d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:24.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f206f400640 1 -- 172.21.15.103:0/3840028455 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c0756e0 con 0x7f2074054ec0 2024-09-10T22:38:24.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f206f400640 1 -- 172.21.15.103:0/3840028455 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f207c0759b0 con 0x7f2074054ec0 2024-09-10T22:38:24.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f206f400640 1 -- 172.21.15.103:0/3840028455 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c075fa0 con 0x7f2074054ec0 2024-09-10T22:38:24.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f2082800640 1 -- 172.21.15.103:0/3840028455 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20740eb9c0 con 0x7f2074054ec0 2024-09-10T22:38:24.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f2082800640 1 -- 172.21.15.103:0/3840028455 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f207404ed90 con 0x7f2074054ec0 2024-09-10T22:38:24.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f206f400640 1 -- 172.21.15.103:0/3840028455 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f207c076140 con 0x7f2074054ec0 2024-09-10T22:38:24.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.905+0000 7f206f400640 1 -- 172.21.15.103:0/3840028455 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f207c08b780 con 0x7f2074054ec0 2024-09-10T22:38:24.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.909+0000 7fb0abe00640 1 --2- 172.21.15.103:0/3735918015 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0ac161080 0x7fb0ac1585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.909+0000 7f2082800640 1 -- 172.21.15.103:0/3840028455 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2074100c70 con 0x7f2074054ec0 2024-09-10T22:38:24.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.909+0000 7fb0ab400640 1 -- 172.21.15.103:0/3735918015 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0ac161080 msgr2=0x7fb0ac1585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.909+0000 7fb0ab400640 1 --2- 172.21.15.103:0/3735918015 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0ac161080 0x7fb0ac1585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.909+0000 7fb0ab400640 1 -- 172.21.15.103:0/3735918015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0ac0b3b00 msgr2=0x7fb0ac145200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.909+0000 7fb0ab400640 1 --2- 172.21.15.103:0/3735918015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0ac0b3b00 0x7fb0ac145200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.909+0000 7fb0ab400640 1 -- 172.21.15.103:0/3735918015 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ac15a010 con 0x7fb0ac0733e0 2024-09-10T22:38:24.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.909+0000 7fb0ab400640 1 --2- 172.21.15.103:0/3735918015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0ac0733e0 0x7fb0ac1597c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400ba50 tx=0x7fb0a400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:24.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.909+0000 7fb0a3400640 1 -- 172.21.15.103:0/3735918015 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4019070 con 0x7fb0ac0733e0 2024-09-10T22:38:24.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.909+0000 7fb0a3400640 1 -- 172.21.15.103:0/3735918015 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0a400cd10 con 0x7fb0ac0733e0 2024-09-10T22:38:24.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.909+0000 7fb0a3400640 1 -- 172.21.15.103:0/3735918015 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a40146a0 con 0x7fb0ac0733e0 2024-09-10T22:38:24.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.909+0000 7fb0b2000640 1 -- 172.21.15.103:0/3735918015 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0ac15a2f0 con 0x7fb0ac0733e0 2024-09-10T22:38:24.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.909+0000 7fb0b2000640 1 -- 172.21.15.103:0/3735918015 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0ac15a8b0 con 0x7fb0ac0733e0 2024-09-10T22:38:24.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.909+0000 7fb0a3400640 1 -- 172.21.15.103:0/3735918015 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fb0a4014840 con 0x7fb0ac0733e0 2024-09-10T22:38:24.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.909+0000 7fb0a3400640 1 -- 172.21.15.103:0/3735918015 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb0a401d6f0 con 0x7fb0ac0733e0 2024-09-10T22:38:24.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.909+0000 7f206f400640 1 -- 172.21.15.103:0/3840028455 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f207c087030 con 0x7f2074054ec0 2024-09-10T22:38:24.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.913+0000 7fa92b800640 1 -- 172.21.15.103:0/3262693405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9240733e0 msgr2=0x7fa92415ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.913+0000 7fa92b800640 1 --2- 172.21.15.103:0/3262693405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9240733e0 0x7fa92415ea30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa924154fb0 tx=0x7fa91401c8d0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.913+0000 7fa92b800640 1 -- 172.21.15.103:0/3262693405 shutdown_connections 2024-09-10T22:38:24.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.913+0000 7fa92b800640 1 --2- 172.21.15.103:0/3262693405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9240733e0 0x7fa92415ea30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.913+0000 7fa92b800640 1 --2- 172.21.15.103:0/3262693405 >> v2:172.21.15.131:3300/0 conn(0x7fa9240b3b00 0x7fa924154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.913+0000 7fa92b800640 1 -- 172.21.15.103:0/3262693405 >> 172.21.15.103:0/3262693405 conn(0x7fa92406d200 msgr2=0x7fa9240b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:24.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.917+0000 7fb0a0c00640 1 -- 172.21.15.103:0/3735918015 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0840052a0 con 0x7fb0ac0733e0 2024-09-10T22:38:24.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.917+0000 7fb0a3400640 1 -- 172.21.15.103:0/3735918015 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fb0a401e440 con 0x7fb0ac0733e0 2024-09-10T22:38:24.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.921+0000 7f7e20c00640 1 -- 172.21.15.103:0/3426691284 <== mon.1 v2:172.21.15.131:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f7e1c023070 con 0x7f7e24154420 2024-09-10T22:38:24.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.921+0000 7fa92b800640 1 -- 172.21.15.103:0/3262693405 shutdown_connections 2024-09-10T22:38:24.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.921+0000 7fa92b800640 1 -- 172.21.15.103:0/3262693405 wait complete. 2024-09-10T22:38:24.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.921+0000 7fa92b800640 1 Processor -- start 2024-09-10T22:38:24.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.925+0000 7fa92b800640 1 -- start start 2024-09-10T22:38:24.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.929+0000 7f7e2b600640 1 -- 172.21.15.103:0/3426691284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e24154420 msgr2=0x7f7e240affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.929+0000 7f7e2b600640 1 --2- 172.21.15.103:0/3426691284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e24154420 0x7f7e240affb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00be20 tx=0x7f7e1c00bf10 comp rx=0 tx=0).stop 2024-09-10T22:38:24.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa92b800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9240733e0 0x7fa9242081e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa92b800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9240b3b00 0x7fa924204150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa92b800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa924161080 0x7fa924201630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:24.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa92b800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa9241603e0 con 0x7fa9240733e0 2024-09-10T22:38:24.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa92b800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa924160260 con 0x7fa924161080 2024-09-10T22:38:24.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa92b800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa92416f150 con 0x7fa9240b3b00 2024-09-10T22:38:24.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa923e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9240b3b00 0x7fa924204150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa923e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9240b3b00 0x7fa924204150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:41544/0 (socket says 172.21.15.103:41544) 2024-09-10T22:38:24.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa923e00640 1 -- 172.21.15.103:0/3143470375 learned_addr learned my addr 172.21.15.103:0/3143470375 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:24.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa928e00640 1 --2- 172.21.15.103:0/3143470375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9240733e0 0x7fa9242081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa929800640 1 --2- 172.21.15.103:0/3143470375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa924161080 0x7fa924201630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:24.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa923e00640 1 -- 172.21.15.103:0/3143470375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa924161080 msgr2=0x7fa924201630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa923e00640 1 --2- 172.21.15.103:0/3143470375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa924161080 0x7fa924201630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa923e00640 1 -- 172.21.15.103:0/3143470375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9240733e0 msgr2=0x7fa9242081e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa923e00640 1 --2- 172.21.15.103:0/3143470375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9240733e0 0x7fa9242081e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa923e00640 1 -- 172.21.15.103:0/3143470375 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa924201b70 con 0x7fa9240b3b00 2024-09-10T22:38:24.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa929800640 1 --2- 172.21.15.103:0/3143470375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa924161080 0x7fa924201630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:38:24.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa923e00640 1 --2- 172.21.15.103:0/3143470375 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9240b3b00 0x7fa924204150 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00ccb0 tx=0x7fa91c00a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:24.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.933+0000 7fa920c00640 1 -- 172.21.15.103:0/3143470375 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c0039a0 con 0x7fa9240b3b00 2024-09-10T22:38:24.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.937+0000 7fa92b800640 1 -- 172.21.15.103:0/3143470375 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9242048c0 con 0x7fa9240b3b00 2024-09-10T22:38:24.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.937+0000 7ff7abe00640 1 -- 172.21.15.103:0/3508635538 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7ff7ac15c690 con 0x7ff7ac06f9d0 2024-09-10T22:38:24.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.929+0000 7f7e2b600640 1 -- 172.21.15.103:0/3426691284 shutdown_connections 2024-09-10T22:38:24.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.929+0000 7f7e2b600640 1 --2- 172.21.15.103:0/3426691284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e24154420 0x7f7e240affb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.929+0000 7f7e2b600640 1 --2- 172.21.15.103:0/3426691284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e2415cef0 0x7f7e24153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.929+0000 7f7e2b600640 1 --2- 172.21.15.103:0/3426691284 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e240b2790 0x7f7e2415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.929+0000 7f7e2b600640 1 -- 172.21.15.103:0/3426691284 >> 172.21.15.103:0/3426691284 conn(0x7f7e2406cc00 msgr2=0x7f7e240cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:24.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.929+0000 7f7e2b600640 1 -- 172.21.15.103:0/3426691284 shutdown_connections 2024-09-10T22:38:24.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.929+0000 7f7e2b600640 1 -- 172.21.15.103:0/3426691284 wait complete. 2024-09-10T22:38:24.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.937+0000 7fa92b800640 1 -- 172.21.15.103:0/3143470375 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa924204e80 con 0x7fa9240b3b00 2024-09-10T22:38:24.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.937+0000 7fa91a000640 1 -- 172.21.15.103:0/3143470375 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8fc0052a0 con 0x7fa9240b3b00 2024-09-10T22:38:24.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.937+0000 7fa920c00640 1 -- 172.21.15.103:0/3143470375 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa91c003c30 con 0x7fa9240b3b00 2024-09-10T22:38:24.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.937+0000 7fa920c00640 1 -- 172.21.15.103:0/3143470375 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c004020 con 0x7fa9240b3b00 2024-09-10T22:38:24.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.937+0000 7fa920c00640 1 -- 172.21.15.103:0/3143470375 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa91c0045d0 con 0x7fa9240b3b00 2024-09-10T22:38:24.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.945+0000 7fa920c00640 1 -- 172.21.15.103:0/3143470375 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa91c018710 con 0x7fa9240b3b00 2024-09-10T22:38:24.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.945+0000 7fa920c00640 1 -- 172.21.15.103:0/3143470375 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fa91c014030 con 0x7fa9240b3b00 2024-09-10T22:38:24.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.949+0000 7ff7a2a00640 1 -- 172.21.15.103:0/3508635538 <== mon.1 v2:172.21.15.131:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7ff79400f830 con 0x7ff7ac06f9d0 2024-09-10T22:38:24.959 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi103') 2024-09-10T22:38:24.960 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi103') 2024-09-10T22:38:24.960 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi103') 2024-09-10T22:38:24.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.961+0000 7ff7abe00640 1 -- 172.21.15.103:0/3508635538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7ac06f9d0 msgr2=0x7ff7ac148400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.961+0000 7ff7abe00640 1 --2- 172.21.15.103:0/3508635538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7ac06f9d0 0x7ff7ac148400 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff79400b4a0 tx=0x7ff79400b960 comp rx=0 tx=0).stop 2024-09-10T22:38:24.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.961+0000 7ff7abe00640 1 -- 172.21.15.103:0/3508635538 shutdown_connections 2024-09-10T22:38:24.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.961+0000 7ff7abe00640 1 --2- 172.21.15.103:0/3508635538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7ac15e660 0x7ff7ac06e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.961+0000 7ff7abe00640 1 --2- 172.21.15.103:0/3508635538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7ac157f30 0x7ff7ac159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.961+0000 7ff7abe00640 1 --2- 172.21.15.103:0/3508635538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7ac06f9d0 0x7ff7ac148400 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.961+0000 7ff7abe00640 1 -- 172.21.15.103:0/3508635538 >> 172.21.15.103:0/3508635538 conn(0x7ff7ac06cc00 msgr2=0x7ff7ac14ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:24.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.965+0000 7ff7abe00640 1 -- 172.21.15.103:0/3508635538 shutdown_connections 2024-09-10T22:38:24.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.965+0000 7ff7abe00640 1 -- 172.21.15.103:0/3508635538 wait complete. 2024-09-10T22:38:24.978 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi103') 2024-09-10T22:38:24.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.985+0000 7fdbef400640 1 -- 172.21.15.103:0/101036478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbe80ccae0 msgr2=0x7fdbe80ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:24.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.985+0000 7fdbef400640 1 --2- 172.21.15.103:0/101036478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbe80ccae0 0x7fdbe80ce8a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8072300 tx=0x7fdbd001c890 comp rx=0 tx=0).stop 2024-09-10T22:38:24.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.985+0000 7fdbef400640 1 -- 172.21.15.103:0/101036478 shutdown_connections 2024-09-10T22:38:24.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.985+0000 7fdbef400640 1 --2- 172.21.15.103:0/101036478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbe80ccae0 0x7fdbe80ce8a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.985+0000 7fdbef400640 1 --2- 172.21.15.103:0/101036478 >> v2:172.21.15.103:3300/0 conn(0x7fdbe80ca880 0x7fdbe806f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:24.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.985+0000 7fdbef400640 1 -- 172.21.15.103:0/101036478 >> 172.21.15.103:0/101036478 conn(0x7fdbe80b1390 msgr2=0x7fdbe80b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:24.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.993+0000 7fdbef400640 1 -- 172.21.15.103:0/101036478 shutdown_connections 2024-09-10T22:38:24.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.993+0000 7fdbef400640 1 -- 172.21.15.103:0/101036478 wait complete. 2024-09-10T22:38:24.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.993+0000 7fdbef400640 1 Processor -- start 2024-09-10T22:38:24.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:24.997+0000 7fdbef400640 1 -- start start 2024-09-10T22:38:25.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbef400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbe806f410 0x7fdbe8151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:25.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbef400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdbe80ca880 0x7fdbe80c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:25.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbef400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbe80ccae0 0x7fdbe80c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:25.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbef400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe806e690 con 0x7fdbe806f410 2024-09-10T22:38:25.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbef400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe806e510 con 0x7fdbe80ccae0 2024-09-10T22:38:25.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbef400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe806e810 con 0x7fdbe80ca880 2024-09-10T22:38:25.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbe7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbe806f410 0x7fdbe8151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:25.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbe7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbe806f410 0x7fdbe8151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34956/0 (socket says 172.21.15.103:34956) 2024-09-10T22:38:25.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbe7e00640 1 -- 172.21.15.103:0/3628758173 learned_addr learned my addr 172.21.15.103:0/3628758173 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:25.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbe7400640 1 --2- 172.21.15.103:0/3628758173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdbe80ca880 0x7fdbe80c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:25.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbeca00640 1 --2- 172.21.15.103:0/3628758173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbe80ccae0 0x7fdbe80c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:25.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbe7400640 1 -- 172.21.15.103:0/3628758173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbe80ccae0 msgr2=0x7fdbe80c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbe7400640 1 --2- 172.21.15.103:0/3628758173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbe80ccae0 0x7fdbe80c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbe7400640 1 -- 172.21.15.103:0/3628758173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbe806f410 msgr2=0x7fdbe8151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbe7400640 1 --2- 172.21.15.103:0/3628758173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbe806f410 0x7fdbe8151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbe7400640 1 -- 172.21.15.103:0/3628758173 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe8153c40 con 0x7fdbe80ca880 2024-09-10T22:38:25.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbe7400640 1 --2- 172.21.15.103:0/3628758173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdbe80ca880 0x7fdbe80c9580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400e9f0 tx=0x7fdbd400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:25.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbe4c00640 1 -- 172.21.15.103:0/3628758173 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd400cd80 con 0x7fdbe80ca880 2024-09-10T22:38:25.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbe4c00640 1 -- 172.21.15.103:0/3628758173 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbd4004020 con 0x7fdbe80ca880 2024-09-10T22:38:25.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbe4c00640 1 -- 172.21.15.103:0/3628758173 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4004470 con 0x7fdbe80ca880 2024-09-10T22:38:25.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbef400640 1 -- 172.21.15.103:0/3628758173 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe8153eb0 con 0x7fdbe80ca880 2024-09-10T22:38:25.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbef400640 1 -- 172.21.15.103:0/3628758173 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe815a220 con 0x7fdbe80ca880 2024-09-10T22:38:25.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbe4c00640 1 -- 172.21.15.103:0/3628758173 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fdbd40053b0 con 0x7fdbe80ca880 2024-09-10T22:38:25.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.001+0000 7fdbe4c00640 1 -- 172.21.15.103:0/3628758173 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdbd4003bb0 con 0x7fdbe80ca880 2024-09-10T22:38:25.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.009+0000 7fdbef400640 1 -- 172.21.15.103:0/3628758173 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe80b1a50 con 0x7fdbe80ca880 2024-09-10T22:38:25.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.009+0000 7fdbe4c00640 1 -- 172.21.15.103:0/3628758173 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fdbd4003e00 con 0x7fdbe80ca880 2024-09-10T22:38:25.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.013+0000 7f634ec00640 1 -- 172.21.15.103:0/837117500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63480ae8c0 msgr2=0x7f63480b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.013+0000 7f634ec00640 1 --2- 172.21.15.103:0/837117500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63480ae8c0 0x7f63480b1fb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6338009b40 tx=0x7f633801c8e0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.013+0000 7f634ec00640 1 -- 172.21.15.103:0/837117500 shutdown_connections 2024-09-10T22:38:25.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.013+0000 7f634ec00640 1 --2- 172.21.15.103:0/837117500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63480ae8c0 0x7f63480b1fb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.013+0000 7f634ec00640 1 -- 172.21.15.103:0/837117500 >> 172.21.15.103:0/837117500 conn(0x7f63480b1490 msgr2=0x7f63480b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:25.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.013+0000 7f634ec00640 1 -- 172.21.15.103:0/837117500 shutdown_connections 2024-09-10T22:38:25.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.013+0000 7f634ec00640 1 -- 172.21.15.103:0/837117500 wait complete. 2024-09-10T22:38:25.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.017+0000 7f634ec00640 1 Processor -- start 2024-09-10T22:38:25.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f634ec00640 1 -- start start 2024-09-10T22:38:25.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f634ec00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6348074190 0x7f63481fa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:25.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f634ec00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63480ae8c0 0x7f6348156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:25.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f634ec00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f634815b750 0x7f63480b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:25.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f634ec00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6348169800 con 0x7f634815b750 2024-09-10T22:38:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f634ec00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f634806f740 con 0x7f6348074190 2024-09-10T22:38:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f634ec00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6348169980 con 0x7f63480ae8c0 2024-09-10T22:38:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f634d800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6348074190 0x7f63481fa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f634d800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6348074190 0x7f63481fa7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:45526/0 (socket says 172.21.15.103:45526) 2024-09-10T22:38:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f634d800640 1 -- 172.21.15.103:0/1078364992 learned_addr learned my addr 172.21.15.103:0/1078364992 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f634e200640 1 --2- 172.21.15.103:0/1078364992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f634815b750 0x7f63480b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f634d800640 1 -- 172.21.15.103:0/1078364992 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63480ae8c0 msgr2=0x7f6348156980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T22:38:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f634d800640 1 --2- 172.21.15.103:0/1078364992 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63480ae8c0 0x7f6348156980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f634d800640 1 -- 172.21.15.103:0/1078364992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f634815b750 msgr2=0x7f63480b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f634d800640 1 --2- 172.21.15.103:0/1078364992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f634815b750 0x7f63480b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f634d800640 1 -- 172.21.15.103:0/1078364992 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634815db80 con 0x7f6348074190 2024-09-10T22:38:25.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f634e200640 1 --2- 172.21.15.103:0/1078364992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f634815b750 0x7f63480b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:38:25.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f634d800640 1 --2- 172.21.15.103:0/1078364992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6348074190 0x7f63481fa7a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f633000c870 tx=0x7f633000cd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:25.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f6345600640 1 -- 172.21.15.103:0/1078364992 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330018070 con 0x7f6348074190 2024-09-10T22:38:25.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f6345600640 1 -- 172.21.15.103:0/1078364992 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6330007030 con 0x7f6348074190 2024-09-10T22:38:25.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.021+0000 7f6345600640 1 -- 172.21.15.103:0/1078364992 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330018070 con 0x7f6348074190 2024-09-10T22:38:25.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.025+0000 7f634ec00640 1 -- 172.21.15.103:0/1078364992 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63481fae30 con 0x7f6348074190 2024-09-10T22:38:25.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.025+0000 7f634ec00640 1 -- 172.21.15.103:0/1078364992 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63481fb3f0 con 0x7f6348074190 2024-09-10T22:38:25.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.025+0000 7f6345600640 1 -- 172.21.15.103:0/1078364992 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f6330007220 con 0x7f6348074190 2024-09-10T22:38:25.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.025+0000 7f6345600640 1 -- 172.21.15.103:0/1078364992 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f63300038b0 con 0x7f6348074190 2024-09-10T22:38:25.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.033+0000 7f634ec00640 1 -- 172.21.15.103:0/1078364992 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63200052a0 con 0x7f6348074190 2024-09-10T22:38:25.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.033+0000 7f6345600640 1 -- 172.21.15.103:0/1078364992 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f6330021070 con 0x7f6348074190 2024-09-10T22:38:25.041 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi103') 2024-09-10T22:38:25.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.037+0000 7f5de1600640 1 -- 172.21.15.103:0/1200040569 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f5de8036680 con 0x7f5de8035f10 2024-09-10T22:38:25.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.045+0000 7f5c22000640 1 -- 172.21.15.103:0/410740800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c14006430 msgr2=0x7f5c14006850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.045+0000 7f5c22000640 1 --2- 172.21.15.103:0/410740800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c14006430 0x7f5c14006850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400dc20 tx=0x7f5c1001f0b0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.049+0000 7f5c22000640 1 -- 172.21.15.103:0/410740800 shutdown_connections 2024-09-10T22:38:25.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.049+0000 7f5c22000640 1 --2- 172.21.15.103:0/410740800 >> v2:172.21.15.131:3300/0 conn(0x7f5c14053080 0x7f5c140534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.049+0000 7f5c22000640 1 --2- 172.21.15.103:0/410740800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c14006430 0x7f5c14006850 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.049+0000 7f5c22000640 1 --2- 172.21.15.103:0/410740800 >> v2:172.21.15.103:3300/0 conn(0x7f5c140ea1f0 0x7f5c14005ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.049+0000 7f5c22000640 1 -- 172.21.15.103:0/410740800 >> 172.21.15.103:0/410740800 conn(0x7f5c1403a5b0 msgr2=0x7f5c1403a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:25.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.049+0000 7f5c22000640 1 -- 172.21.15.103:0/410740800 shutdown_connections 2024-09-10T22:38:25.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.049+0000 7f5c22000640 1 -- 172.21.15.103:0/410740800 wait complete. 2024-09-10T22:38:25.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.049+0000 7f5c22000640 1 Processor -- start 2024-09-10T22:38:25.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.053+0000 7f5c22000640 1 -- start start 2024-09-10T22:38:25.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.053+0000 7f5c22000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c14006430 0x7f5c140e24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:25.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.053+0000 7f5c22000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c14053080 0x7f5c140e0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:25.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.053+0000 7f5c22000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c140ea1f0 0x7f5c1404e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:25.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.053+0000 7f5c1a000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c14053080 0x7f5c140e0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:25.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.053+0000 7f5c1a000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c14053080 0x7f5c140e0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:45566/0 (socket says 172.21.15.103:45566) 2024-09-10T22:38:25.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.053+0000 7f5c1a000640 1 -- 172.21.15.103:0/2172040252 learned_addr learned my addr 172.21.15.103:0/2172040252 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:25.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.053+0000 7f5c22000640 1 -- 172.21.15.103:0/2172040252 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1403e780 con 0x7f5c140ea1f0 2024-09-10T22:38:25.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.053+0000 7f5c22000640 1 -- 172.21.15.103:0/2172040252 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1403e600 con 0x7f5c14053080 2024-09-10T22:38:25.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.053+0000 7f5c22000640 1 -- 172.21.15.103:0/2172040252 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5c14053a30 con 0x7f5c14006430 2024-09-10T22:38:25.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.057+0000 7f5c1b400640 1 --2- 172.21.15.103:0/2172040252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c140ea1f0 0x7f5c1404e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:25.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.057+0000 7f5c1aa00640 1 --2- 172.21.15.103:0/2172040252 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c14006430 0x7f5c140e24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:25.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.057+0000 7f5c1a000640 1 -- 172.21.15.103:0/2172040252 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c14006430 msgr2=0x7f5c140e24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.057+0000 7f5c1a000640 1 --2- 172.21.15.103:0/2172040252 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c14006430 0x7f5c140e24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.057+0000 7f5c1a000640 1 -- 172.21.15.103:0/2172040252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c140ea1f0 msgr2=0x7f5c1404e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.057+0000 7f5c1a000640 1 --2- 172.21.15.103:0/2172040252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c140ea1f0 0x7f5c1404e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.057+0000 7f5c1a000640 1 -- 172.21.15.103:0/2172040252 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c14050d30 con 0x7f5c14053080 2024-09-10T22:38:25.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.057+0000 7f5c1b400640 1 --2- 172.21.15.103:0/2172040252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c140ea1f0 0x7f5c1404e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:38:25.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.057+0000 7f5c1a000640 1 --2- 172.21.15.103:0/2172040252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c14053080 0x7f5c140e0310 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5c100b3040 tx=0x7f5c10005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:25.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.057+0000 7f5de3e00640 1 -- 172.21.15.103:0/1200040569 <== mon.2 v2:172.21.15.131:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f5de4016490 con 0x7f5de8035f10 2024-09-10T22:38:25.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.057+0000 7f5c0f400640 1 -- 172.21.15.103:0/2172040252 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c100b5040 con 0x7f5c14053080 2024-09-10T22:38:25.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.057+0000 7f5c0f400640 1 -- 172.21.15.103:0/2172040252 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c10005250 con 0x7f5c14053080 2024-09-10T22:38:25.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.057+0000 7f5c0f400640 1 -- 172.21.15.103:0/2172040252 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c100046d0 con 0x7f5c14053080 2024-09-10T22:38:25.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f388fe00640 1 -- 172.21.15.103:0/372390842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3890073c00 msgr2=0x7f3890074030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f388fe00640 1 --2- 172.21.15.103:0/372390842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3890073c00 0x7f3890074030 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f389006dc20 tx=0x7f387801c800 comp rx=0 tx=0).stop 2024-09-10T22:38:25.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f388fe00640 1 -- 172.21.15.103:0/372390842 shutdown_connections 2024-09-10T22:38:25.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f388fe00640 1 --2- 172.21.15.103:0/372390842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3890073c00 0x7f3890074030 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f388fe00640 1 --2- 172.21.15.103:0/372390842 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38900ae850 0x7f3890072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f388fe00640 1 --2- 172.21.15.103:0/372390842 >> v2:172.21.15.103:3300/0 conn(0x7f389015b750 0x7f38900aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f388fe00640 1 -- 172.21.15.103:0/372390842 >> 172.21.15.103:0/372390842 conn(0x7f389006cc00 msgr2=0x7f389006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:25.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f388fe00640 1 -- 172.21.15.103:0/372390842 shutdown_connections 2024-09-10T22:38:25.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f5c22000640 1 -- 172.21.15.103:0/2172040252 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c14051010 con 0x7f5c14053080 2024-09-10T22:38:25.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f5c22000640 1 -- 172.21.15.103:0/2172040252 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c140e0850 con 0x7f5c14053080 2024-09-10T22:38:25.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f5c0f400640 1 -- 172.21.15.103:0/2172040252 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f5c100b8070 con 0x7f5c14053080 2024-09-10T22:38:25.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f5c0f400640 1 -- 172.21.15.103:0/2172040252 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5c100b0930 con 0x7f5c14053080 2024-09-10T22:38:25.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f388fe00640 1 -- 172.21.15.103:0/372390842 wait complete. 2024-09-10T22:38:25.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f5de1600640 1 -- 172.21.15.103:0/1200040569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5de8035f10 msgr2=0x7f5de804d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f5de1600640 1 --2- 172.21.15.103:0/1200040569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5de8035f10 0x7f5de804d9c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5de4000c10 tx=0x7f5de40a57b0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f5c0cc00640 1 -- 172.21.15.103:0/2172040252 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c14007ae0 con 0x7f5c14053080 2024-09-10T22:38:25.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f5de1600640 1 -- 172.21.15.103:0/1200040569 shutdown_connections 2024-09-10T22:38:25.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f5de1600640 1 --2- 172.21.15.103:0/1200040569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5de80e2ee0 0x7f5de818c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f5de1600640 1 --2- 172.21.15.103:0/1200040569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5de8052a50 0x7f5de804b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f5de1600640 1 --2- 172.21.15.103:0/1200040569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5de8035f10 0x7f5de804d9c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.061+0000 7f5de1600640 1 -- 172.21.15.103:0/1200040569 >> 172.21.15.103:0/1200040569 conn(0x7f5de801d780 msgr2=0x7f5de8051240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:25.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.065+0000 7f388fe00640 1 Processor -- start 2024-09-10T22:38:25.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.065+0000 7f5c0f400640 1 -- 172.21.15.103:0/2172040252 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f5c100c0060 con 0x7f5c14053080 2024-09-10T22:38:25.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.065+0000 7f5de1600640 1 -- 172.21.15.103:0/1200040569 shutdown_connections 2024-09-10T22:38:25.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.065+0000 7f5de1600640 1 -- 172.21.15.103:0/1200040569 wait complete. 2024-09-10T22:38:25.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7fe753200640 1 -- 172.21.15.103:0/1115551339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe74c0ae8c0 msgr2=0x7fe74c0b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7fe753200640 1 --2- 172.21.15.103:0/1115551339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe74c0ae8c0 0x7fe74c0b1fb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe748009bc0 tx=0x7fe74801cac0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7fe753200640 1 -- 172.21.15.103:0/1115551339 shutdown_connections 2024-09-10T22:38:25.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7fe753200640 1 --2- 172.21.15.103:0/1115551339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe74c0ae8c0 0x7fe74c0b1fb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7fe753200640 1 -- 172.21.15.103:0/1115551339 >> 172.21.15.103:0/1115551339 conn(0x7fe74c0b1490 msgr2=0x7fe74c0b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:25.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7fe753200640 1 -- 172.21.15.103:0/1115551339 shutdown_connections 2024-09-10T22:38:25.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7fe753200640 1 -- 172.21.15.103:0/1115551339 wait complete. 2024-09-10T22:38:25.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.069+0000 7f388fe00640 1 -- start start 2024-09-10T22:38:25.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7f388fe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3890073c00 0x7f389015a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:25.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7f388fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38900ae850 0x7f38902079e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:25.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7f388fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f389015b750 0x7f3890158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:25.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7f388fe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f389015f3b0 con 0x7f389015b750 2024-09-10T22:38:25.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7f388fe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f389015f230 con 0x7f38900ae850 2024-09-10T22:38:25.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7f388fe00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f389015f530 con 0x7f3890073c00 2024-09-10T22:38:25.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7f388ea00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3890073c00 0x7f389015a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:25.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7f388ea00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3890073c00 0x7f389015a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:41590/0 (socket says 172.21.15.103:41590) 2024-09-10T22:38:25.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7f388ea00640 1 -- 172.21.15.103:0/1327698483 learned_addr learned my addr 172.21.15.103:0/1327698483 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:25.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7f388e000640 1 --2- 172.21.15.103:0/1327698483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38900ae850 0x7f38902079e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:25.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7f388ea00640 1 -- 172.21.15.103:0/1327698483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38900ae850 msgr2=0x7f38902079e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7f388ea00640 1 --2- 172.21.15.103:0/1327698483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38900ae850 0x7f38902079e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7f388ea00640 1 -- 172.21.15.103:0/1327698483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f389015b750 msgr2=0x7f3890158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7f388ea00640 1 --2- 172.21.15.103:0/1327698483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f389015b750 0x7f3890158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7f388ea00640 1 -- 172.21.15.103:0/1327698483 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38900b48a0 con 0x7f3890073c00 2024-09-10T22:38:25.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.073+0000 7f388e000640 1 --2- 172.21.15.103:0/1327698483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38900ae850 0x7f38902079e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:38:25.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.077+0000 7fe753200640 1 Processor -- start 2024-09-10T22:38:25.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.077+0000 7f388ea00640 1 --2- 172.21.15.103:0/1327698483 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3890073c00 0x7f389015a470 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f388800e7a0 tx=0x7f388800ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:25.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.077+0000 7f22e2c00640 1 -- 172.21.15.103:0/3342444202 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f22dc0b31d0 con 0x7f22dc0733e0 2024-09-10T22:38:25.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7f3887400640 1 -- 172.21.15.103:0/1327698483 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388800cc40 con 0x7f3890073c00 2024-09-10T22:38:25.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7f3887400640 1 -- 172.21.15.103:0/1327698483 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3888010430 con 0x7f3890073c00 2024-09-10T22:38:25.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7f3887400640 1 -- 172.21.15.103:0/1327698483 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888010880 con 0x7f3890073c00 2024-09-10T22:38:25.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7f388fe00640 1 -- 172.21.15.103:0/1327698483 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3890164190 con 0x7f3890073c00 2024-09-10T22:38:25.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7f388fe00640 1 -- 172.21.15.103:0/1327698483 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3890164430 con 0x7f3890073c00 2024-09-10T22:38:25.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7fb0a0c00640 1 -- 172.21.15.103:0/3735918015 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fb084005590 con 0x7fb0ac0733e0 2024-09-10T22:38:25.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7f3887400640 1 -- 172.21.15.103:0/1327698483 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f38880047d0 con 0x7f3890073c00 2024-09-10T22:38:25.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7f3887400640 1 -- 172.21.15.103:0/1327698483 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f38880054b0 con 0x7f3890073c00 2024-09-10T22:38:25.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.085+0000 7f3884c00640 1 -- 172.21.15.103:0/1327698483 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3890070200 con 0x7f3890073c00 2024-09-10T22:38:25.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.077+0000 7fe753200640 1 -- start start 2024-09-10T22:38:25.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7fe753200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe74c074190 0x7fe74c1f8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:25.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7fe753200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74c0ae8c0 0x7fe74c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:25.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7fe753200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe74c15b750 0x7fe74c154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:25.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7fe753200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe74c169800 con 0x7fe74c0ae8c0 2024-09-10T22:38:25.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7fe753200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe74c06f6f0 con 0x7fe74c074190 2024-09-10T22:38:25.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7fe753200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe74c169980 con 0x7fe74c15b750 2024-09-10T22:38:25.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7fe752800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe74c15b750 0x7fe74c154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:25.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7fe751e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe74c074190 0x7fe74c1f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:25.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7fe751e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe74c074190 0x7fe74c1f8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:45570/0 (socket says 172.21.15.103:45570) 2024-09-10T22:38:25.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7fe751e00640 1 -- 172.21.15.103:0/851614287 learned_addr learned my addr 172.21.15.103:0/851614287 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:25.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7fe752800640 1 -- 172.21.15.103:0/851614287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe74c074190 msgr2=0x7fe74c1f8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7fe752800640 1 --2- 172.21.15.103:0/851614287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe74c074190 0x7fe74c1f8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7fe752800640 1 -- 172.21.15.103:0/851614287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74c0ae8c0 msgr2=0x7fe74c155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7fe752800640 1 --2- 172.21.15.103:0/851614287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74c0ae8c0 0x7fe74c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7fe752800640 1 -- 172.21.15.103:0/851614287 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74c14eed0 con 0x7fe74c15b750 2024-09-10T22:38:25.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7fe752800640 1 --2- 172.21.15.103:0/851614287 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe74c15b750 0x7fe74c154bc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0747d0 tx=0x7fe7480053b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:25.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.081+0000 7fe746000640 1 -- 172.21.15.103:0/851614287 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7480b2070 con 0x7fe74c15b750 2024-09-10T22:38:25.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.085+0000 7fe746000640 1 -- 172.21.15.103:0/851614287 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7480b3040 con 0x7fe74c15b750 2024-09-10T22:38:25.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.085+0000 7fe746000640 1 -- 172.21.15.103:0/851614287 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7480b2070 con 0x7fe74c15b750 2024-09-10T22:38:25.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.085+0000 7fe753200640 1 -- 172.21.15.103:0/851614287 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe74c14f1b0 con 0x7fe74c15b750 2024-09-10T22:38:25.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.085+0000 7fe753200640 1 -- 172.21.15.103:0/851614287 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe74c14f770 con 0x7fe74c15b750 2024-09-10T22:38:25.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.085+0000 7fe746000640 1 -- 172.21.15.103:0/851614287 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fe748004030 con 0x7fe74c15b750 2024-09-10T22:38:25.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.085+0000 7fe746000640 1 -- 172.21.15.103:0/851614287 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe7480057f0 con 0x7fe74c15b750 2024-09-10T22:38:25.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.085+0000 7f3887400640 1 -- 172.21.15.103:0/1327698483 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f3890070200 con 0x7f3890073c00 2024-09-10T22:38:25.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.085+0000 7fe753200640 1 -- 172.21.15.103:0/851614287 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe74c0b1fb0 con 0x7fe74c15b750 2024-09-10T22:38:25.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.089+0000 7fa91a000640 1 -- 172.21.15.103:0/3143470375 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fa8fc005860 con 0x7fa9240b3b00 2024-09-10T22:38:25.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.089+0000 7f22d3e00640 1 -- 172.21.15.103:0/3342444202 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v11)=0 v11) ==== 119+0+0 (secure 0 0 0) 0x7f22cc01a410 con 0x7f22dc0733e0 2024-09-10T22:38:25.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.089+0000 7fe746000640 1 -- 172.21.15.103:0/851614287 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fe7480167d0 con 0x7fe74c15b750 2024-09-10T22:38:25.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.089+0000 7f2082800640 1 -- 172.21.15.103:0/3840028455 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f207400dc30 con 0x7f2074054ec0 2024-09-10T22:38:25.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7fb0a3400640 1 -- 172.21.15.103:0/3735918015 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v12)=0 v12) ==== 125+0+0 (secure 0 0 0) 0x7fb0a401e620 con 0x7fb0ac0733e0 2024-09-10T22:38:25.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7f22e2c00640 1 -- 172.21.15.103:0/3342444202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22dc0733e0 msgr2=0x7f22dc14eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7f22e2c00640 1 --2- 172.21.15.103:0/3342444202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22dc0733e0 0x7f22dc14eec0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00b420 tx=0x7f22cc00b8e0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7f22e2c00640 1 -- 172.21.15.103:0/3342444202 shutdown_connections 2024-09-10T22:38:25.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7f22e2c00640 1 --2- 172.21.15.103:0/3342444202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22dc161080 0x7f22dc15b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7f22e2c00640 1 --2- 172.21.15.103:0/3342444202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22dc0b3b00 0x7f22dc156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7f22e2c00640 1 --2- 172.21.15.103:0/3342444202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22dc0733e0 0x7f22dc14eec0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7f22e2c00640 1 -- 172.21.15.103:0/3342444202 >> 172.21.15.103:0/3342444202 conn(0x7f22dc06d200 msgr2=0x7f22dc0cc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:25.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7fb0a0c00640 1 -- 172.21.15.103:0/3735918015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0ac0733e0 msgr2=0x7fb0ac1597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7fb0a0c00640 1 --2- 172.21.15.103:0/3735918015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0ac0733e0 0x7fb0ac1597c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400ba50 tx=0x7fb0a400bf10 comp rx=0 tx=0).stop 2024-09-10T22:38:25.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7f22e2c00640 1 -- 172.21.15.103:0/3342444202 shutdown_connections 2024-09-10T22:38:25.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7f22e2c00640 1 -- 172.21.15.103:0/3342444202 wait complete. 2024-09-10T22:38:25.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7fb0a0c00640 1 -- 172.21.15.103:0/3735918015 shutdown_connections 2024-09-10T22:38:25.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7fb0a0c00640 1 --2- 172.21.15.103:0/3735918015 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0ac161080 0x7fb0ac1585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7fb0a0c00640 1 --2- 172.21.15.103:0/3735918015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0ac0b3b00 0x7fb0ac145200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7fb0a0c00640 1 --2- 172.21.15.103:0/3735918015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0ac0733e0 0x7fb0ac1597c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7fb0a0c00640 1 -- 172.21.15.103:0/3735918015 >> 172.21.15.103:0/3735918015 conn(0x7fb0ac06d200 msgr2=0x7fb0ac0b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:25.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.101+0000 7fa920c00640 1 -- 172.21.15.103:0/3143470375 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v13)=0 v13) ==== 115+0+0 (secure 0 0 0) 0x7fa91c004b30 con 0x7fa9240b3b00 2024-09-10T22:38:25.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7fb0a0c00640 1 -- 172.21.15.103:0/3735918015 shutdown_connections 2024-09-10T22:38:25.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.097+0000 7fb0a0c00640 1 -- 172.21.15.103:0/3735918015 wait complete. 2024-09-10T22:38:25.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.105+0000 7fa91a000640 1 -- 172.21.15.103:0/3143470375 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9240b3b00 msgr2=0x7fa924204150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.105+0000 7fa91a000640 1 --2- 172.21.15.103:0/3143470375 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9240b3b00 0x7fa924204150 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00ccb0 tx=0x7fa91c00a620 comp rx=0 tx=0).stop 2024-09-10T22:38:25.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.105+0000 7fa91a000640 1 -- 172.21.15.103:0/3143470375 shutdown_connections 2024-09-10T22:38:25.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.105+0000 7fa91a000640 1 --2- 172.21.15.103:0/3143470375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa924161080 0x7fa924201630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.105+0000 7fa91a000640 1 --2- 172.21.15.103:0/3143470375 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9240b3b00 0x7fa924204150 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00ccb0 tx=0x7fa91c00a620 comp rx=0 tx=0).stop 2024-09-10T22:38:25.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.105+0000 7fa91a000640 1 --2- 172.21.15.103:0/3143470375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9240733e0 0x7fa9242081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.105+0000 7fa91a000640 1 -- 172.21.15.103:0/3143470375 >> 172.21.15.103:0/3143470375 conn(0x7fa92406d200 msgr2=0x7fa92406eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:25.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.105+0000 7fa91a000640 1 -- 172.21.15.103:0/3143470375 shutdown_connections 2024-09-10T22:38:25.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.105+0000 7fa91a000640 1 -- 172.21.15.103:0/3143470375 wait complete. 2024-09-10T22:38:25.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.109+0000 7f206f400640 1 -- 172.21.15.103:0/3840028455 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v14)=0 v14) ==== 121+0+0 (secure 0 0 0) 0x7f207c083780 con 0x7f2074054ec0 2024-09-10T22:38:25.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.113+0000 7f2082800640 1 -- 172.21.15.103:0/3840028455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2074054ec0 msgr2=0x7f20740312d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.113+0000 7f2082800640 1 --2- 172.21.15.103:0/3840028455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2074054ec0 0x7f20740312d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f207c069f90 tx=0x7f207c069d70 comp rx=0 tx=0).stop 2024-09-10T22:38:25.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.113+0000 7f2082800640 1 -- 172.21.15.103:0/3840028455 shutdown_connections 2024-09-10T22:38:25.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.113+0000 7f2082800640 1 --2- 172.21.15.103:0/3840028455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2074054ec0 0x7f20740312d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.113+0000 7f2082800640 1 --2- 172.21.15.103:0/3840028455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2074039d00 0x7f2074053a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.113+0000 7f2082800640 1 --2- 172.21.15.103:0/3840028455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2074036020 0x7f20740520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.113+0000 7f2082800640 1 -- 172.21.15.103:0/3840028455 >> 172.21.15.103:0/3840028455 conn(0x7f207401d7b0 msgr2=0x7f2074054680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:25.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.113+0000 7f2082800640 1 -- 172.21.15.103:0/3840028455 shutdown_connections 2024-09-10T22:38:25.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.113+0000 7f2082800640 1 -- 172.21.15.103:0/3840028455 wait complete. 2024-09-10T22:38:25.155 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi103') 2024-09-10T22:38:25.155 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi103') 2024-09-10T22:38:25.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.161+0000 7fdbef400640 1 -- 172.21.15.103:0/3628758173 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fdbe80b1770 con 0x7fdbe80ca880 2024-09-10T22:38:25.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.165+0000 7fdbe4c00640 1 -- 172.21.15.103:0/3628758173 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7fdbd40047b0 con 0x7fdbe80ca880 2024-09-10T22:38:25.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.169+0000 7fdbef400640 1 -- 172.21.15.103:0/3628758173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdbe80ca880 msgr2=0x7fdbe80c9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.169+0000 7fdbef400640 1 --2- 172.21.15.103:0/3628758173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdbe80ca880 0x7fdbe80c9580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400e9f0 tx=0x7fdbd400eeb0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.169+0000 7fdbef400640 1 -- 172.21.15.103:0/3628758173 shutdown_connections 2024-09-10T22:38:25.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.169+0000 7fdbef400640 1 --2- 172.21.15.103:0/3628758173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbe80ccae0 0x7fdbe80c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.169+0000 7fdbef400640 1 --2- 172.21.15.103:0/3628758173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdbe80ca880 0x7fdbe80c9580 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.169+0000 7fdbef400640 1 --2- 172.21.15.103:0/3628758173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbe806f410 0x7fdbe8151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.169+0000 7fdbef400640 1 -- 172.21.15.103:0/3628758173 >> 172.21.15.103:0/3628758173 conn(0x7fdbe80b1390 msgr2=0x7fdbe80b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:25.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.169+0000 7fdbef400640 1 -- 172.21.15.103:0/3628758173 shutdown_connections 2024-09-10T22:38:25.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.169+0000 7fdbef400640 1 -- 172.21.15.103:0/3628758173 wait complete. 2024-09-10T22:38:25.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.177+0000 7f634ec00640 1 -- 172.21.15.103:0/1078364992 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f6320005590 con 0x7f6348074190 2024-09-10T22:38:25.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.181+0000 7f6345600640 1 -- 172.21.15.103:0/1078364992 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7f6330003b00 con 0x7f6348074190 2024-09-10T22:38:25.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.181+0000 7f634ec00640 1 -- 172.21.15.103:0/1078364992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6348074190 msgr2=0x7f63481fa7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.181+0000 7f634ec00640 1 --2- 172.21.15.103:0/1078364992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6348074190 0x7f63481fa7a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f633000c870 tx=0x7f633000cd30 comp rx=0 tx=0).stop 2024-09-10T22:38:25.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.181+0000 7f634ec00640 1 -- 172.21.15.103:0/1078364992 shutdown_connections 2024-09-10T22:38:25.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.181+0000 7f634ec00640 1 --2- 172.21.15.103:0/1078364992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f634815b750 0x7f63480b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.181+0000 7f634ec00640 1 --2- 172.21.15.103:0/1078364992 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63480ae8c0 0x7f6348156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.181+0000 7f634ec00640 1 --2- 172.21.15.103:0/1078364992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6348074190 0x7f63481fa7a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.181+0000 7f634ec00640 1 -- 172.21.15.103:0/1078364992 >> 172.21.15.103:0/1078364992 conn(0x7f63480b1490 msgr2=0x7f63480cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:25.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.181+0000 7f634ec00640 1 -- 172.21.15.103:0/1078364992 shutdown_connections 2024-09-10T22:38:25.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.181+0000 7f634ec00640 1 -- 172.21.15.103:0/1078364992 wait complete. 2024-09-10T22:38:25.208 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi103') 2024-09-10T22:38:25.208 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi103') 2024-09-10T22:38:25.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.205+0000 7f5c0cc00640 1 -- 172.21.15.103:0/2172040252 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f5c140061a0 con 0x7f5c14053080 2024-09-10T22:38:25.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.209+0000 7f5c0f400640 1 -- 172.21.15.103:0/2172040252 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f5c10018c10 con 0x7f5c14053080 2024-09-10T22:38:25.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.213+0000 7f5c0cc00640 1 -- 172.21.15.103:0/2172040252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c14053080 msgr2=0x7f5c140e0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.213+0000 7f5c0cc00640 1 --2- 172.21.15.103:0/2172040252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c14053080 0x7f5c140e0310 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5c100b3040 tx=0x7f5c10005760 comp rx=0 tx=0).stop 2024-09-10T22:38:25.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.213+0000 7f5c0cc00640 1 -- 172.21.15.103:0/2172040252 shutdown_connections 2024-09-10T22:38:25.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.213+0000 7f5c0cc00640 1 --2- 172.21.15.103:0/2172040252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c140ea1f0 0x7f5c1404e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.213+0000 7f5c0cc00640 1 --2- 172.21.15.103:0/2172040252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c14053080 0x7f5c140e0310 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.213+0000 7f5c0cc00640 1 --2- 172.21.15.103:0/2172040252 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c14006430 0x7f5c140e24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.213+0000 7f5c0cc00640 1 -- 172.21.15.103:0/2172040252 >> 172.21.15.103:0/2172040252 conn(0x7f5c1403a5b0 msgr2=0x7f5c140e58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:25.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.213+0000 7f5c0cc00640 1 -- 172.21.15.103:0/2172040252 shutdown_connections 2024-09-10T22:38:25.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.213+0000 7f5c0cc00640 1 -- 172.21.15.103:0/2172040252 wait complete. 2024-09-10T22:38:25.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.217+0000 7fe753200640 1 -- 172.21.15.103:0/851614287 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fe74c0745b0 con 0x7fe74c15b750 2024-09-10T22:38:25.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.221+0000 7fe746000640 1 -- 172.21.15.103:0/851614287 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v18)=0 v18) ==== 120+0+0 (secure 0 0 0) 0x7fe7480043a0 con 0x7fe74c15b750 2024-09-10T22:38:25.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.225+0000 7f3884c00640 1 -- 172.21.15.103:0/1327698483 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f3890072e00 con 0x7f3890073c00 2024-09-10T22:38:25.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.225+0000 7fe753200640 1 -- 172.21.15.103:0/851614287 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe74c15b750 msgr2=0x7fe74c154bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.225+0000 7fe753200640 1 --2- 172.21.15.103:0/851614287 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe74c15b750 0x7fe74c154bc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0747d0 tx=0x7fe7480053b0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.225+0000 7fe753200640 1 -- 172.21.15.103:0/851614287 shutdown_connections 2024-09-10T22:38:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.225+0000 7fe753200640 1 --2- 172.21.15.103:0/851614287 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe74c15b750 0x7fe74c154bc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.225+0000 7fe753200640 1 --2- 172.21.15.103:0/851614287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74c0ae8c0 0x7fe74c155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.225+0000 7fe753200640 1 --2- 172.21.15.103:0/851614287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe74c074190 0x7fe74c1f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.225+0000 7fe753200640 1 -- 172.21.15.103:0/851614287 >> 172.21.15.103:0/851614287 conn(0x7fe74c0b1490 msgr2=0x7fe74c0cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.225+0000 7fe753200640 1 -- 172.21.15.103:0/851614287 shutdown_connections 2024-09-10T22:38:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.225+0000 7fe753200640 1 -- 172.21.15.103:0/851614287 wait complete. 2024-09-10T22:38:25.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.225+0000 7f3887400640 1 -- 172.21.15.103:0/1327698483 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v19)=0 v19) ==== 120+0+0 (secure 0 0 0) 0x7f3888026070 con 0x7f3890073c00 2024-09-10T22:38:25.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.229+0000 7f3884c00640 1 -- 172.21.15.103:0/1327698483 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3890073c00 msgr2=0x7f389015a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.229+0000 7f3884c00640 1 --2- 172.21.15.103:0/1327698483 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3890073c00 0x7f389015a470 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f388800e7a0 tx=0x7f388800ec60 comp rx=0 tx=0).stop 2024-09-10T22:38:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.229+0000 7f3884c00640 1 -- 172.21.15.103:0/1327698483 shutdown_connections 2024-09-10T22:38:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.229+0000 7f3884c00640 1 --2- 172.21.15.103:0/1327698483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f389015b750 0x7f3890158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.229+0000 7f3884c00640 1 --2- 172.21.15.103:0/1327698483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38900ae850 0x7f38902079e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.229+0000 7f3884c00640 1 --2- 172.21.15.103:0/1327698483 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3890073c00 0x7f389015a470 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.229+0000 7f3884c00640 1 -- 172.21.15.103:0/1327698483 >> 172.21.15.103:0/1327698483 conn(0x7f389006cc00 msgr2=0x7f389015c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.229+0000 7f3884c00640 1 -- 172.21.15.103:0/1327698483 shutdown_connections 2024-09-10T22:38:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.229+0000 7f3884c00640 1 -- 172.21.15.103:0/1327698483 wait complete. 2024-09-10T22:38:25.241 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi103') 2024-09-10T22:38:25.253 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi103') 2024-09-10T22:38:25.254 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi103') 2024-09-10T22:38:25.254 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi103') 2024-09-10T22:38:25.255 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi103') 2024-09-10T22:38:25.255 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T22:38:25.255 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T22:38:25.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.437+0000 7fc7cfe00640 1 -- 172.21.15.103:0/813668698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7c80b0680 msgr2=0x7fc7c80b2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.437+0000 7fc7cfe00640 1 --2- 172.21.15.103:0/813668698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7c80b0680 0x7fc7c80b2790 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80b0e70 tx=0x7fc7b401c880 comp rx=0 tx=0).stop 2024-09-10T22:38:25.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.437+0000 7fc7cfe00640 1 -- 172.21.15.103:0/813668698 shutdown_connections 2024-09-10T22:38:25.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.437+0000 7fc7cfe00640 1 --2- 172.21.15.103:0/813668698 >> v2:172.21.15.131:3300/0 conn(0x7fc7c80b5ca0 0x7fc7c806cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.437+0000 7fc7cfe00640 1 --2- 172.21.15.103:0/813668698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7c80b0680 0x7fc7c80b2790 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.437+0000 7fc7cfe00640 1 -- 172.21.15.103:0/813668698 >> 172.21.15.103:0/813668698 conn(0x7fc7c80b4ed0 msgr2=0x7fc7c80b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:25.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.437+0000 7fc7cfe00640 1 -- 172.21.15.103:0/813668698 shutdown_connections 2024-09-10T22:38:25.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.437+0000 7fc7cfe00640 1 -- 172.21.15.103:0/813668698 wait complete. 2024-09-10T22:38:25.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.437+0000 7fc7cfe00640 1 Processor -- start 2024-09-10T22:38:25.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.437+0000 7fc7cfe00640 1 -- start start 2024-09-10T22:38:25.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cfe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7c80b0680 0x7fc7c815a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:25.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7c80b5ca0 0x7fc7c8153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:25.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cfe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7c81582c0 0x7fc7c8153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:25.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cfe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c8167ba0 con 0x7fc7c80b5ca0 2024-09-10T22:38:25.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cfe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c8167a20 con 0x7fc7c80b0680 2024-09-10T22:38:25.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cfe00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c8167d20 con 0x7fc7c81582c0 2024-09-10T22:38:25.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7c80b5ca0 0x7fc7c8153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:25.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7c80b5ca0 0x7fc7c8153a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35024/0 (socket says 172.21.15.103:35024) 2024-09-10T22:38:25.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cca00640 1 -- 172.21.15.103:0/2434878553 learned_addr learned my addr 172.21.15.103:0/2434878553 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:25.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cd400640 1 --2- 172.21.15.103:0/2434878553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7c80b0680 0x7fc7c815a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:25.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cde00640 1 --2- 172.21.15.103:0/2434878553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7c81582c0 0x7fc7c8153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:25.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cca00640 1 -- 172.21.15.103:0/2434878553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7c81582c0 msgr2=0x7fc7c8153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cca00640 1 --2- 172.21.15.103:0/2434878553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7c81582c0 0x7fc7c8153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cca00640 1 -- 172.21.15.103:0/2434878553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7c80b0680 msgr2=0x7fc7c815a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cca00640 1 --2- 172.21.15.103:0/2434878553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7c80b0680 0x7fc7c815a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cca00640 1 -- 172.21.15.103:0/2434878553 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c8152520 con 0x7fc7c80b5ca0 2024-09-10T22:38:25.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cca00640 1 --2- 172.21.15.103:0/2434878553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7c80b5ca0 0x7fc7c8153a00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40b0040 tx=0x7fc7b40a5770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:25.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7c5600640 1 -- 172.21.15.103:0/2434878553 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b40b2040 con 0x7fc7c80b5ca0 2024-09-10T22:38:25.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7c5600640 1 -- 172.21.15.103:0/2434878553 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7b4005030 con 0x7fc7c80b5ca0 2024-09-10T22:38:25.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7c5600640 1 -- 172.21.15.103:0/2434878553 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b40044f0 con 0x7fc7c80b5ca0 2024-09-10T22:38:25.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cfe00640 1 -- 172.21.15.103:0/2434878553 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c8152800 con 0x7fc7c80b5ca0 2024-09-10T22:38:25.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cfe00640 1 -- 172.21.15.103:0/2434878553 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c81532e0 con 0x7fc7c80b5ca0 2024-09-10T22:38:25.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7c5600640 1 -- 172.21.15.103:0/2434878553 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fc7b40bf060 con 0x7fc7c80b5ca0 2024-09-10T22:38:25.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7c5600640 1 -- 172.21.15.103:0/2434878553 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc7b4003c40 con 0x7fc7c80b5ca0 2024-09-10T22:38:25.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.441+0000 7fc7cfe00640 1 -- 172.21.15.103:0/2434878553 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7c80b2790 con 0x7fc7c80b5ca0 2024-09-10T22:38:25.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.445+0000 7fc7c5600640 1 -- 172.21.15.103:0/2434878553 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fc7b4016470 con 0x7fc7c80b5ca0 2024-09-10T22:38:25.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.509+0000 7fc7cfe00640 1 -- 172.21.15.103:0/2434878553 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fc7c806cd10 con 0x7fc7c80b5ca0 2024-09-10T22:38:25.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.509+0000 7fc7c5600640 1 -- 172.21.15.103:0/2434878553 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fc7b4005480 con 0x7fc7c80b5ca0 2024-09-10T22:38:25.513 INFO:teuthology.orchestra.run.smithi103.stderr:adjusted tunables profile to default 2024-09-10T22:38:25.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.509+0000 7fc7cfe00640 1 -- 172.21.15.103:0/2434878553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7c80b5ca0 msgr2=0x7fc7c8153a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:25.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.509+0000 7fc7cfe00640 1 --2- 172.21.15.103:0/2434878553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7c80b5ca0 0x7fc7c8153a00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40b0040 tx=0x7fc7b40a5770 comp rx=0 tx=0).stop 2024-09-10T22:38:25.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.509+0000 7fc7cfe00640 1 -- 172.21.15.103:0/2434878553 shutdown_connections 2024-09-10T22:38:25.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.509+0000 7fc7cfe00640 1 --2- 172.21.15.103:0/2434878553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7c81582c0 0x7fc7c8153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.509+0000 7fc7cfe00640 1 --2- 172.21.15.103:0/2434878553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7c80b5ca0 0x7fc7c8153a00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.509+0000 7fc7cfe00640 1 --2- 172.21.15.103:0/2434878553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7c80b0680 0x7fc7c815a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:25.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.509+0000 7fc7cfe00640 1 -- 172.21.15.103:0/2434878553 >> 172.21.15.103:0/2434878553 conn(0x7fc7c80b4ed0 msgr2=0x7fc7c8074a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:25.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.509+0000 7fc7cfe00640 1 -- 172.21.15.103:0/2434878553 shutdown_connections 2024-09-10T22:38:25.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:25.509+0000 7fc7cfe00640 1 -- 172.21.15.103:0/2434878553 wait complete. 2024-09-10T22:38:25.533 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T22:38:25.533 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T22:38:25.533 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:38:25.533 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T22:38:25.553 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:38:25.553 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T22:38:25.614 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:38:25.615 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T22:38:25.674 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:38:25.674 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T22:38:25.734 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:38:25.734 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-10T22:38:25.754 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:38:25.754 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-10T22:38:25.816 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:38:25.816 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-10T22:38:25.875 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:38:25.875 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-10T22:38:25.935 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new ce30f7bb-8593-4a94-bad7-0a8db358cac6 0 2024-09-10T22:38:26.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febb6c00640 1 -- 172.21.15.131:0/544278992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febb00b09c0 msgr2=0x7febb00ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:26.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febb6c00640 1 --2- 172.21.15.131:0/544278992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febb00b09c0 0x7febb00ce600 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7febb00cbf40 tx=0x7feb9c01c770 comp rx=0 tx=0).stop 2024-09-10T22:38:26.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febb6c00640 1 -- 172.21.15.131:0/544278992 shutdown_connections 2024-09-10T22:38:26.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febb6c00640 1 --2- 172.21.15.131:0/544278992 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7febb00ceb40 0x7febb00cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febb6c00640 1 --2- 172.21.15.131:0/544278992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febb00b09c0 0x7febb00ce600 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febb6c00640 1 --2- 172.21.15.131:0/544278992 >> v2:172.21.15.103:3300/0 conn(0x7febb015be30 0x7febb00ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febb6c00640 1 -- 172.21.15.131:0/544278992 >> 172.21.15.131:0/544278992 conn(0x7febb00d1ac0 msgr2=0x7febb00d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:26.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febb6c00640 1 -- 172.21.15.131:0/544278992 shutdown_connections 2024-09-10T22:38:26.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febb6c00640 1 -- 172.21.15.131:0/544278992 wait complete. 2024-09-10T22:38:26.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febb6c00640 1 Processor -- start 2024-09-10T22:38:26.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febb6c00640 1 -- start start 2024-09-10T22:38:26.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febb6c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febb00b09c0 0x7febb0150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:26.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febb6c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7febb00ceb40 0x7febb00cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:26.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febb6c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febb015be30 0x7febb014fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:26.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febb6c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7febb00aed50 con 0x7febb015be30 2024-09-10T22:38:26.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febb6c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7febb00aebd0 con 0x7febb00b09c0 2024-09-10T22:38:26.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febb6c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7febb00aeed0 con 0x7febb00ceb40 2024-09-10T22:38:26.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febafe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febb00b09c0 0x7febb0150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:26.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febaf400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7febb00ceb40 0x7febb00cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:26.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febafe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febb00b09c0 0x7febb0150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46580/0 (socket says 172.21.15.131:46580) 2024-09-10T22:38:26.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febafe00640 1 -- 172.21.15.131:0/1294797925 learned_addr learned my addr 172.21.15.131:0/1294797925 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-10T22:38:26.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febb4c00640 1 --2- 172.21.15.131:0/1294797925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febb015be30 0x7febb014fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:26.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febaf400640 1 -- 172.21.15.131:0/1294797925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febb00b09c0 msgr2=0x7febb0150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:26.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febaf400640 1 --2- 172.21.15.131:0/1294797925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febb00b09c0 0x7febb0150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febaf400640 1 -- 172.21.15.131:0/1294797925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febb015be30 msgr2=0x7febb014fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:26.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febaf400640 1 --2- 172.21.15.131:0/1294797925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febb015be30 0x7febb014fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febaf400640 1 -- 172.21.15.131:0/1294797925 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb0151140 con 0x7febb00ceb40 2024-09-10T22:38:26.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.118+0000 7febafe00640 1 --2- 172.21.15.131:0/1294797925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febb00b09c0 0x7febb0150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:38:26.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.122+0000 7febaf400640 1 --2- 172.21.15.131:0/1294797925 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7febb00ceb40 0x7febb00cb260 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0ac000 tx=0x7feb9c0a85c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:26.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.122+0000 7feba7e00640 1 -- 172.21.15.131:0/1294797925 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c005ca0 con 0x7febb00ceb40 2024-09-10T22:38:26.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.122+0000 7feba7e00640 1 -- 172.21.15.131:0/1294797925 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb9c004030 con 0x7febb00ceb40 2024-09-10T22:38:26.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.122+0000 7febb6c00640 1 -- 172.21.15.131:0/1294797925 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb0152500 con 0x7febb00ceb40 2024-09-10T22:38:26.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.122+0000 7feba7e00640 1 -- 172.21.15.131:0/1294797925 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c004480 con 0x7febb00ceb40 2024-09-10T22:38:26.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.122+0000 7febb6c00640 1 -- 172.21.15.131:0/1294797925 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7febb0152ac0 con 0x7febb00ceb40 2024-09-10T22:38:26.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.122+0000 7feba7e00640 1 -- 172.21.15.131:0/1294797925 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7feb9c005070 con 0x7febb00ceb40 2024-09-10T22:38:26.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.122+0000 7feba7e00640 1 -- 172.21.15.131:0/1294797925 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7feb9c004a10 con 0x7febb00ceb40 2024-09-10T22:38:26.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.122+0000 7febb6c00640 1 -- 172.21.15.131:0/1294797925 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb00cf9c0 con 0x7febb00ceb40 2024-09-10T22:38:26.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.122+0000 7feba7e00640 1 -- 172.21.15.131:0/1294797925 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7febb0151140 con 0x7febb00ceb40 2024-09-10T22:38:26.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.194+0000 7febb6c00640 1 -- 172.21.15.131:0/1294797925 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ce30f7bb-8593-4a94-bad7-0a8db358cac6", "id": 0} v 0) -- 0x7febb015a770 con 0x7febb00ceb40 2024-09-10T22:38:26.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.198+0000 7feba7e00640 1 -- 172.21.15.131:0/1294797925 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ce30f7bb-8593-4a94-bad7-0a8db358cac6", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7feb9c0ac030 con 0x7febb00ceb40 2024-09-10T22:38:26.198 INFO:teuthology.orchestra.run.smithi131.stdout:0 2024-09-10T22:38:26.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.198+0000 7febb6c00640 1 -- 172.21.15.131:0/1294797925 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7febb00ceb40 msgr2=0x7febb00cb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:26.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.198+0000 7febb6c00640 1 --2- 172.21.15.131:0/1294797925 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7febb00ceb40 0x7febb00cb260 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0ac000 tx=0x7feb9c0a85c0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.198+0000 7febb6c00640 1 -- 172.21.15.131:0/1294797925 shutdown_connections 2024-09-10T22:38:26.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.198+0000 7febb6c00640 1 --2- 172.21.15.131:0/1294797925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febb015be30 0x7febb014fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.198+0000 7febb6c00640 1 --2- 172.21.15.131:0/1294797925 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7febb00ceb40 0x7febb00cb260 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.198+0000 7febb6c00640 1 --2- 172.21.15.131:0/1294797925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febb00b09c0 0x7febb0150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.198+0000 7febb6c00640 1 -- 172.21.15.131:0/1294797925 >> 172.21.15.131:0/1294797925 conn(0x7febb00d1ac0 msgr2=0x7febb00b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:26.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.198+0000 7febb6c00640 1 -- 172.21.15.131:0/1294797925 shutdown_connections 2024-09-10T22:38:26.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.198+0000 7febb6c00640 1 -- 172.21.15.131:0/1294797925 wait complete. 2024-09-10T22:38:26.217 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new f357d2a3-0c7f-4148-90c5-eda524593f42 1 2024-09-10T22:38:26.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.358+0000 7ff745000640 1 -- 172.21.15.131:0/1863221618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7400ce010 msgr2=0x7ff7400d2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:26.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.358+0000 7ff745000640 1 --2- 172.21.15.131:0/1863221618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7400ce010 0x7ff7400d2360 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff7400d2940 tx=0x7ff73001f0b0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff745000640 1 -- 172.21.15.131:0/1863221618 shutdown_connections 2024-09-10T22:38:26.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff745000640 1 --2- 172.21.15.131:0/1863221618 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7400ce950 0x7ff7400cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff745000640 1 --2- 172.21.15.131:0/1863221618 >> v2:172.21.15.103:3300/0 conn(0x7ff740071e90 0x7ff7400cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff745000640 1 --2- 172.21.15.131:0/1863221618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7400ce010 0x7ff7400d2360 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff745000640 1 -- 172.21.15.131:0/1863221618 >> 172.21.15.131:0/1863221618 conn(0x7ff7400d1840 msgr2=0x7ff7400d1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:26.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff745000640 1 -- 172.21.15.131:0/1863221618 shutdown_connections 2024-09-10T22:38:26.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff745000640 1 -- 172.21.15.131:0/1863221618 wait complete. 2024-09-10T22:38:26.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff745000640 1 Processor -- start 2024-09-10T22:38:26.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff745000640 1 -- start start 2024-09-10T22:38:26.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff745000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff740071e90 0x7ff7400b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:26.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff745000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7400ce010 0x7ff740158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:26.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff745000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7400ce950 0x7ff74015dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:26.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff745000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff74015fb20 con 0x7ff7400ce010 2024-09-10T22:38:26.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff745000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff74015f9a0 con 0x7ff7400ce950 2024-09-10T22:38:26.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff745000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff74015fca0 con 0x7ff740071e90 2024-09-10T22:38:26.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff73f400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff740071e90 0x7ff7400b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:26.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff73fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7400ce950 0x7ff74015dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:26.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff73f400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff740071e90 0x7ff7400b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:60720/0 (socket says 172.21.15.131:60720) 2024-09-10T22:38:26.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff73f400640 1 -- 172.21.15.131:0/979272284 learned_addr learned my addr 172.21.15.131:0/979272284 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-10T22:38:26.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff737e00640 1 --2- 172.21.15.131:0/979272284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7400ce010 0x7ff740158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:26.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff73f400640 1 -- 172.21.15.131:0/979272284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7400ce950 msgr2=0x7ff74015dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:26.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff73f400640 1 --2- 172.21.15.131:0/979272284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7400ce950 0x7ff74015dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff73f400640 1 -- 172.21.15.131:0/979272284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7400ce010 msgr2=0x7ff740158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:26.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff73f400640 1 --2- 172.21.15.131:0/979272284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7400ce010 0x7ff740158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.362+0000 7ff73f400640 1 -- 172.21.15.131:0/979272284 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff740159330 con 0x7ff740071e90 2024-09-10T22:38:26.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.366+0000 7ff73f400640 1 --2- 172.21.15.131:0/979272284 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff740071e90 0x7ff7400b3b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff7300b3040 tx=0x7ff730005760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:26.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.366+0000 7ff737400640 1 -- 172.21.15.131:0/979272284 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7300b5040 con 0x7ff740071e90 2024-09-10T22:38:26.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.366+0000 7ff737400640 1 -- 172.21.15.131:0/979272284 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff730005330 con 0x7ff740071e90 2024-09-10T22:38:26.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.366+0000 7ff745000640 1 -- 172.21.15.131:0/979272284 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7400b2480 con 0x7ff740071e90 2024-09-10T22:38:26.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.366+0000 7ff737400640 1 -- 172.21.15.131:0/979272284 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7300046d0 con 0x7ff740071e90 2024-09-10T22:38:26.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.366+0000 7ff745000640 1 -- 172.21.15.131:0/979272284 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7400b2a40 con 0x7ff740071e90 2024-09-10T22:38:26.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.366+0000 7ff737400640 1 -- 172.21.15.131:0/979272284 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7ff7300b8070 con 0x7ff740071e90 2024-09-10T22:38:26.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.366+0000 7ff737400640 1 -- 172.21.15.131:0/979272284 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7ff7300b0440 con 0x7ff740071e90 2024-09-10T22:38:26.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.366+0000 7ff745000640 1 -- 172.21.15.131:0/979272284 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7400b3220 con 0x7ff740071e90 2024-09-10T22:38:26.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.366+0000 7ff737400640 1 -- 172.21.15.131:0/979272284 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7ff7400b3220 con 0x7ff740071e90 2024-09-10T22:38:26.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.438+0000 7ff745000640 1 -- 172.21.15.131:0/979272284 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f357d2a3-0c7f-4148-90c5-eda524593f42", "id": 1} v 0) -- 0x7ff7400d2360 con 0x7ff740071e90 2024-09-10T22:38:26.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.442+0000 7ff737400640 1 -- 172.21.15.131:0/979272284 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f357d2a3-0c7f-4148-90c5-eda524593f42", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7ff7300bf060 con 0x7ff740071e90 2024-09-10T22:38:26.442 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-09-10T22:38:26.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.442+0000 7ff745000640 1 -- 172.21.15.131:0/979272284 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff740071e90 msgr2=0x7ff7400b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:26.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.442+0000 7ff745000640 1 --2- 172.21.15.131:0/979272284 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff740071e90 0x7ff7400b3b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff7300b3040 tx=0x7ff730005760 comp rx=0 tx=0).stop 2024-09-10T22:38:26.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.442+0000 7ff745000640 1 -- 172.21.15.131:0/979272284 shutdown_connections 2024-09-10T22:38:26.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.442+0000 7ff745000640 1 --2- 172.21.15.131:0/979272284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7400ce950 0x7ff74015dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.442+0000 7ff745000640 1 --2- 172.21.15.131:0/979272284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7400ce010 0x7ff740158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.442+0000 7ff745000640 1 --2- 172.21.15.131:0/979272284 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff740071e90 0x7ff7400b3b10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.442+0000 7ff745000640 1 -- 172.21.15.131:0/979272284 >> 172.21.15.131:0/979272284 conn(0x7ff7400d1840 msgr2=0x7ff74006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:26.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.442+0000 7ff745000640 1 -- 172.21.15.131:0/979272284 shutdown_connections 2024-09-10T22:38:26.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.442+0000 7ff745000640 1 -- 172.21.15.131:0/979272284 wait complete. 2024-09-10T22:38:26.462 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 96b59070-0658-4edc-9d9d-f7beca957744 2 2024-09-10T22:38:26.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.602+0000 7fcf07a00640 1 -- 172.21.15.131:0/3834429761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf000ceb40 msgr2=0x7fcf000cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:26.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.602+0000 7fcf07a00640 1 --2- 172.21.15.131:0/3834429761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf000ceb40 0x7fcf000cf9c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcf0015f970 tx=0x7fcef801ccf0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.602+0000 7fcf07a00640 1 -- 172.21.15.131:0/3834429761 shutdown_connections 2024-09-10T22:38:26.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.602+0000 7fcf07a00640 1 --2- 172.21.15.131:0/3834429761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf000ceb40 0x7fcf000cf9c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.602+0000 7fcf07a00640 1 --2- 172.21.15.131:0/3834429761 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf000b09c0 0x7fcf000ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.602+0000 7fcf07a00640 1 --2- 172.21.15.131:0/3834429761 >> v2:172.21.15.103:3300/0 conn(0x7fcf0015be30 0x7fcf000ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.602+0000 7fcf07a00640 1 -- 172.21.15.131:0/3834429761 >> 172.21.15.131:0/3834429761 conn(0x7fcf000d1ac0 msgr2=0x7fcf000d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:26.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.602+0000 7fcf07a00640 1 -- 172.21.15.131:0/3834429761 shutdown_connections 2024-09-10T22:38:26.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.602+0000 7fcf07a00640 1 -- 172.21.15.131:0/3834429761 wait complete. 2024-09-10T22:38:26.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.602+0000 7fcf07a00640 1 Processor -- start 2024-09-10T22:38:26.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.602+0000 7fcf07a00640 1 -- start start 2024-09-10T22:38:26.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf07a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf000b09c0 0x7fcf000b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:26.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf07a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf000ceb40 0x7fcf000cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:26.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf07a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf0015be30 0x7fcf00071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:26.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf07a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcf000aed50 con 0x7fcf000ceb40 2024-09-10T22:38:26.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf07a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcf000aebd0 con 0x7fcf000b09c0 2024-09-10T22:38:26.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf07a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcf000aeed0 con 0x7fcf0015be30 2024-09-10T22:38:26.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf05000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf000b09c0 0x7fcf000b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:26.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf05000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf000b09c0 0x7fcf000b67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46614/0 (socket says 172.21.15.131:46614) 2024-09-10T22:38:26.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf05000640 1 -- 172.21.15.131:0/3041169157 learned_addr learned my addr 172.21.15.131:0/3041169157 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-10T22:38:26.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf05a00640 1 --2- 172.21.15.131:0/3041169157 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf0015be30 0x7fcf00071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:26.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fceffe00640 1 --2- 172.21.15.131:0/3041169157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf000ceb40 0x7fcf000cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:26.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf05000640 1 -- 172.21.15.131:0/3041169157 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf0015be30 msgr2=0x7fcf00071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:26.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf05000640 1 --2- 172.21.15.131:0/3041169157 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf0015be30 0x7fcf00071d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf05000640 1 -- 172.21.15.131:0/3041169157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf000ceb40 msgr2=0x7fcf000cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:26.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf05000640 1 --2- 172.21.15.131:0/3041169157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf000ceb40 0x7fcf000cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf05000640 1 -- 172.21.15.131:0/3041169157 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf000b6dc0 con 0x7fcf000b09c0 2024-09-10T22:38:26.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf05000640 1 --2- 172.21.15.131:0/3041169157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf000b09c0 0x7fcf000b67e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcef400e7a0 tx=0x7fcef400ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:26.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcefcc00640 1 -- 172.21.15.131:0/3041169157 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef400ccc0 con 0x7fcf000b09c0 2024-09-10T22:38:26.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcefcc00640 1 -- 172.21.15.131:0/3041169157 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcef4010430 con 0x7fcf000b09c0 2024-09-10T22:38:26.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcefcc00640 1 -- 172.21.15.131:0/3041169157 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef4010860 con 0x7fcf000b09c0 2024-09-10T22:38:26.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf07a00640 1 -- 172.21.15.131:0/3041169157 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf001f7420 con 0x7fcf000b09c0 2024-09-10T22:38:26.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf07a00640 1 -- 172.21.15.131:0/3041169157 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf00072290 con 0x7fcf000b09c0 2024-09-10T22:38:26.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcefcc00640 1 -- 172.21.15.131:0/3041169157 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fcef4010a00 con 0x7fcf000b09c0 2024-09-10T22:38:26.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcefcc00640 1 -- 172.21.15.131:0/3041169157 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fcef4018840 con 0x7fcf000b09c0 2024-09-10T22:38:26.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.606+0000 7fcf07a00640 1 -- 172.21.15.131:0/3041169157 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf001f7210 con 0x7fcf000b09c0 2024-09-10T22:38:26.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.610+0000 7fcefcc00640 1 -- 172.21.15.131:0/3041169157 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fcef4010d20 con 0x7fcf000b09c0 2024-09-10T22:38:26.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.678+0000 7fcf07a00640 1 -- 172.21.15.131:0/3041169157 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "96b59070-0658-4edc-9d9d-f7beca957744", "id": 2} v 0) -- 0x7fcf000cf9c0 con 0x7fcf000b09c0 2024-09-10T22:38:26.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.686+0000 7fcefcc00640 1 -- 172.21.15.131:0/3041169157 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96b59070-0658-4edc-9d9d-f7beca957744", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fcef4018c90 con 0x7fcf000b09c0 2024-09-10T22:38:26.685 INFO:teuthology.orchestra.run.smithi131.stdout:2 2024-09-10T22:38:26.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.686+0000 7fcf07a00640 1 -- 172.21.15.131:0/3041169157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf000b09c0 msgr2=0x7fcf000b67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:26.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.686+0000 7fcf07a00640 1 --2- 172.21.15.131:0/3041169157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf000b09c0 0x7fcf000b67e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcef400e7a0 tx=0x7fcef400ec60 comp rx=0 tx=0).stop 2024-09-10T22:38:26.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.686+0000 7fcf07a00640 1 -- 172.21.15.131:0/3041169157 shutdown_connections 2024-09-10T22:38:26.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.686+0000 7fcf07a00640 1 --2- 172.21.15.131:0/3041169157 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf0015be30 0x7fcf00071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.686+0000 7fcf07a00640 1 --2- 172.21.15.131:0/3041169157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf000ceb40 0x7fcf000cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.686+0000 7fcf07a00640 1 --2- 172.21.15.131:0/3041169157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf000b09c0 0x7fcf000b67e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.686+0000 7fcf07a00640 1 -- 172.21.15.131:0/3041169157 >> 172.21.15.131:0/3041169157 conn(0x7fcf000d1ac0 msgr2=0x7fcf000ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:26.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.686+0000 7fcf07a00640 1 -- 172.21.15.131:0/3041169157 shutdown_connections 2024-09-10T22:38:26.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.686+0000 7fcf07a00640 1 -- 172.21.15.131:0/3041169157 wait complete. 2024-09-10T22:38:26.705 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 293f6bbb-b099-4dac-939d-31d6cff71be2 3 2024-09-10T22:38:26.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.846+0000 7f8013000640 1 -- 172.21.15.131:0/2530091559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f800c15be30 msgr2=0x7f800c0ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:26.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.846+0000 7f8013000640 1 --2- 172.21.15.131:0/2530091559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f800c15be30 0x7f800c0ce0c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc009840 tx=0x7f7ffc01c790 comp rx=0 tx=0).stop 2024-09-10T22:38:26.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.846+0000 7f8013000640 1 -- 172.21.15.131:0/2530091559 shutdown_connections 2024-09-10T22:38:26.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.846+0000 7f8013000640 1 --2- 172.21.15.131:0/2530091559 >> v2:172.21.15.103:3300/0 conn(0x7f800c0ae9c0 0x7f800c0aee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.846+0000 7f8013000640 1 --2- 172.21.15.131:0/2530091559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f800c15be30 0x7f800c0ce0c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.846+0000 7f8013000640 1 -- 172.21.15.131:0/2530091559 >> 172.21.15.131:0/2530091559 conn(0x7f800c0d1ac0 msgr2=0x7f800c0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:26.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.846+0000 7f8013000640 1 -- 172.21.15.131:0/2530091559 shutdown_connections 2024-09-10T22:38:26.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.846+0000 7f8013000640 1 -- 172.21.15.131:0/2530091559 wait complete. 2024-09-10T22:38:26.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.846+0000 7f8013000640 1 Processor -- start 2024-09-10T22:38:26.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.846+0000 7f8013000640 1 -- start start 2024-09-10T22:38:26.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f8013000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f800c0ae9c0 0x7f800c153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:26.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f8013000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f800c0b09c0 0x7f800c154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:26.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f8013000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f800c15be30 0x7f800c06f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:26.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f8013000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f800c168df0 con 0x7f800c15be30 2024-09-10T22:38:26.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f8013000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f800c168c70 con 0x7f800c0b09c0 2024-09-10T22:38:26.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f8013000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f800c168f70 con 0x7f800c0ae9c0 2024-09-10T22:38:26.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f800b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f800c0b09c0 0x7f800c154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:26.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f800be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f800c0ae9c0 0x7f800c153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:26.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f800b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f800c0b09c0 0x7f800c154e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46626/0 (socket says 172.21.15.131:46626) 2024-09-10T22:38:26.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f800b400640 1 -- 172.21.15.131:0/2763916873 learned_addr learned my addr 172.21.15.131:0/2763916873 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-10T22:38:26.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f8011000640 1 --2- 172.21.15.131:0/2763916873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f800c15be30 0x7f800c06f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:26.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f800b400640 1 -- 172.21.15.131:0/2763916873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f800c0ae9c0 msgr2=0x7f800c153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:26.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f800b400640 1 --2- 172.21.15.131:0/2763916873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f800c0ae9c0 0x7f800c153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f800b400640 1 -- 172.21.15.131:0/2763916873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f800c15be30 msgr2=0x7f800c06f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:26.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f800b400640 1 --2- 172.21.15.131:0/2763916873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f800c15be30 0x7f800c06f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f800b400640 1 -- 172.21.15.131:0/2763916873 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800c156000 con 0x7f800c0b09c0 2024-09-10T22:38:26.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f800b400640 1 --2- 172.21.15.131:0/2763916873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f800c0b09c0 0x7f800c154e20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800c460 tx=0x7f7ff800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:26.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f8003e00640 1 -- 172.21.15.131:0/2763916873 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8011790 con 0x7f800c0b09c0 2024-09-10T22:38:26.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f8003e00640 1 -- 172.21.15.131:0/2763916873 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ff8017070 con 0x7f800c0b09c0 2024-09-10T22:38:26.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f8003e00640 1 -- 172.21.15.131:0/2763916873 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8011ca0 con 0x7f800c0b09c0 2024-09-10T22:38:26.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f8013000640 1 -- 172.21.15.131:0/2763916873 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f800c0c8d30 con 0x7f800c0b09c0 2024-09-10T22:38:26.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f8013000640 1 -- 172.21.15.131:0/2763916873 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f800c06fc50 con 0x7f800c0b09c0 2024-09-10T22:38:26.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f8003e00640 1 -- 172.21.15.131:0/2763916873 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f7ff801c460 con 0x7f800c0b09c0 2024-09-10T22:38:26.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f8003e00640 1 -- 172.21.15.131:0/2763916873 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f7ff8012bd0 con 0x7f800c0b09c0 2024-09-10T22:38:26.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.850+0000 7f8013000640 1 -- 172.21.15.131:0/2763916873 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f800c0c9320 con 0x7f800c0b09c0 2024-09-10T22:38:26.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.854+0000 7f8003e00640 1 -- 172.21.15.131:0/2763916873 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f7ff8012e20 con 0x7f800c0b09c0 2024-09-10T22:38:26.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.922+0000 7f8013000640 1 -- 172.21.15.131:0/2763916873 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "293f6bbb-b099-4dac-939d-31d6cff71be2", "id": 3} v 0) -- 0x7f800c0aee70 con 0x7f800c0b09c0 2024-09-10T22:38:26.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.930+0000 7f8003e00640 1 -- 172.21.15.131:0/2763916873 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "293f6bbb-b099-4dac-939d-31d6cff71be2", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f7ff8012740 con 0x7f800c0b09c0 2024-09-10T22:38:26.930 INFO:teuthology.orchestra.run.smithi131.stdout:3 2024-09-10T22:38:26.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.930+0000 7f8013000640 1 -- 172.21.15.131:0/2763916873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f800c0b09c0 msgr2=0x7f800c154e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:26.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.930+0000 7f8013000640 1 --2- 172.21.15.131:0/2763916873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f800c0b09c0 0x7f800c154e20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800c460 tx=0x7f7ff800c860 comp rx=0 tx=0).stop 2024-09-10T22:38:26.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.930+0000 7f8013000640 1 -- 172.21.15.131:0/2763916873 shutdown_connections 2024-09-10T22:38:26.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.930+0000 7f8013000640 1 --2- 172.21.15.131:0/2763916873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f800c15be30 0x7f800c06f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.930+0000 7f8013000640 1 --2- 172.21.15.131:0/2763916873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f800c0b09c0 0x7f800c154e20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.930+0000 7f8013000640 1 --2- 172.21.15.131:0/2763916873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f800c0ae9c0 0x7f800c153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:26.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.930+0000 7f8013000640 1 -- 172.21.15.131:0/2763916873 >> 172.21.15.131:0/2763916873 conn(0x7f800c0d1ac0 msgr2=0x7f800c071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:26.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.930+0000 7f8013000640 1 -- 172.21.15.131:0/2763916873 shutdown_connections 2024-09-10T22:38:26.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:26.930+0000 7f8013000640 1 -- 172.21.15.131:0/2763916873 wait complete. 2024-09-10T22:38:26.949 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new f7fc4e89-2d18-40a3-9459-7d945f43d76d 4 2024-09-10T22:38:27.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.098+0000 7fe8f4400640 1 -- 172.21.15.131:0/3754160919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8ec0b0fd0 msgr2=0x7fe8ec0b14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:27.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.098+0000 7fe8f4400640 1 --2- 172.21.15.131:0/3754160919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8ec0b0fd0 0x7fe8ec0b14b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009900 tx=0x7fe8d801c850 comp rx=0 tx=0).stop 2024-09-10T22:38:27.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.098+0000 7fe8f4400640 1 -- 172.21.15.131:0/3754160919 shutdown_connections 2024-09-10T22:38:27.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.098+0000 7fe8f4400640 1 --2- 172.21.15.131:0/3754160919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8ec0b0fd0 0x7fe8ec0b14b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.098+0000 7fe8f4400640 1 -- 172.21.15.131:0/3754160919 >> 172.21.15.131:0/3754160919 conn(0x7fe8ec0b3680 msgr2=0x7fe8ec0b3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:27.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.098+0000 7fe8f4400640 1 -- 172.21.15.131:0/3754160919 shutdown_connections 2024-09-10T22:38:27.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.098+0000 7fe8f4400640 1 -- 172.21.15.131:0/3754160919 wait complete. 2024-09-10T22:38:27.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f4400640 1 Processor -- start 2024-09-10T22:38:27.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f4400640 1 -- start start 2024-09-10T22:38:27.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f4400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8ec0b0fd0 0x7fe8ec0cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:27.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f4400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8ec0c7000 0x7fe8ec1f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:27.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f4400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8ec15f0e0 0x7fe8ec14b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:27.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f4400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec16a390 con 0x7fe8ec0b0fd0 2024-09-10T22:38:27.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f4400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec16a210 con 0x7fe8ec15f0e0 2024-09-10T22:38:27.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f4400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe8ec16a510 con 0x7fe8ec0c7000 2024-09-10T22:38:27.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f2400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8ec15f0e0 0x7fe8ec14b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:27.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f2400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8ec15f0e0 0x7fe8ec14b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46648/0 (socket says 172.21.15.131:46648) 2024-09-10T22:38:27.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f1a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8ec0b0fd0 0x7fe8ec0cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:27.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f2400640 1 -- 172.21.15.131:0/990716879 learned_addr learned my addr 172.21.15.131:0/990716879 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-10T22:38:27.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f1000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8ec0c7000 0x7fe8ec1f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:27.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f2400640 1 -- 172.21.15.131:0/990716879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8ec0c7000 msgr2=0x7fe8ec1f65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:27.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f2400640 1 --2- 172.21.15.131:0/990716879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8ec0c7000 0x7fe8ec1f65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f2400640 1 -- 172.21.15.131:0/990716879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8ec0b0fd0 msgr2=0x7fe8ec0cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:27.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f2400640 1 --2- 172.21.15.131:0/990716879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8ec0b0fd0 0x7fe8ec0cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f2400640 1 -- 172.21.15.131:0/990716879 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ec1f6af0 con 0x7fe8ec15f0e0 2024-09-10T22:38:27.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f2400640 1 --2- 172.21.15.131:0/990716879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8ec15f0e0 0x7fe8ec14b3c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400c500 tx=0x7fe8e400c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:27.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8e9600640 1 -- 172.21.15.131:0/990716879 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e40052d0 con 0x7fe8ec15f0e0 2024-09-10T22:38:27.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8e9600640 1 -- 172.21.15.131:0/990716879 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8e4005470 con 0x7fe8ec15f0e0 2024-09-10T22:38:27.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f4400640 1 -- 172.21.15.131:0/990716879 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8ec0cdaa0 con 0x7fe8ec15f0e0 2024-09-10T22:38:27.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8e9600640 1 -- 172.21.15.131:0/990716879 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4012870 con 0x7fe8ec15f0e0 2024-09-10T22:38:27.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8f4400640 1 -- 172.21.15.131:0/990716879 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8ec0ce340 con 0x7fe8ec15f0e0 2024-09-10T22:38:27.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8e9600640 1 -- 172.21.15.131:0/990716879 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fe8e4012a10 con 0x7fe8ec15f0e0 2024-09-10T22:38:27.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.102+0000 7fe8e9600640 1 -- 172.21.15.131:0/990716879 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fe8e4012d30 con 0x7fe8ec15f0e0 2024-09-10T22:38:27.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.106+0000 7fe8f4400640 1 -- 172.21.15.131:0/990716879 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8ec0b14b0 con 0x7fe8ec15f0e0 2024-09-10T22:38:27.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.106+0000 7fe8e9600640 1 -- 172.21.15.131:0/990716879 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fe8ec1f6af0 con 0x7fe8ec15f0e0 2024-09-10T22:38:27.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.218+0000 7fe8f4400640 1 -- 172.21.15.131:0/990716879 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f7fc4e89-2d18-40a3-9459-7d945f43d76d", "id": 4} v 0) -- 0x7fe8ec14b900 con 0x7fe8ec15f0e0 2024-09-10T22:38:27.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.226+0000 7fe8e9600640 1 -- 172.21.15.131:0/990716879 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f7fc4e89-2d18-40a3-9459-7d945f43d76d", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fe8e4003770 con 0x7fe8ec15f0e0 2024-09-10T22:38:27.226 INFO:teuthology.orchestra.run.smithi131.stdout:4 2024-09-10T22:38:27.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.226+0000 7fe8f4400640 1 -- 172.21.15.131:0/990716879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8ec15f0e0 msgr2=0x7fe8ec14b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:27.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.226+0000 7fe8f4400640 1 --2- 172.21.15.131:0/990716879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8ec15f0e0 0x7fe8ec14b3c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400c500 tx=0x7fe8e400c9c0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.226+0000 7fe8f4400640 1 -- 172.21.15.131:0/990716879 shutdown_connections 2024-09-10T22:38:27.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.226+0000 7fe8f4400640 1 --2- 172.21.15.131:0/990716879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8ec15f0e0 0x7fe8ec14b3c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.226+0000 7fe8f4400640 1 --2- 172.21.15.131:0/990716879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8ec0c7000 0x7fe8ec1f65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.226+0000 7fe8f4400640 1 --2- 172.21.15.131:0/990716879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8ec0b0fd0 0x7fe8ec0cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.226+0000 7fe8f4400640 1 -- 172.21.15.131:0/990716879 >> 172.21.15.131:0/990716879 conn(0x7fe8ec0b3680 msgr2=0x7fe8ec070790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:27.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.226+0000 7fe8f4400640 1 -- 172.21.15.131:0/990716879 shutdown_connections 2024-09-10T22:38:27.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.226+0000 7fe8f4400640 1 -- 172.21.15.131:0/990716879 wait complete. 2024-09-10T22:38:27.246 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new f816f067-f546-49df-b936-c86b9dba2bf8 5 2024-09-10T22:38:27.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.386+0000 7facebe00640 1 -- 172.21.15.131:0/2680977113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facec15a240 msgr2=0x7facec0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:27.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.386+0000 7facebe00640 1 --2- 172.21.15.131:0/2680977113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facec15a240 0x7facec0b4740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7facd800a950 tx=0x7facd801dab0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.386+0000 7facebe00640 1 -- 172.21.15.131:0/2680977113 shutdown_connections 2024-09-10T22:38:27.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.386+0000 7facebe00640 1 --2- 172.21.15.131:0/2680977113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facec15a240 0x7facec0b4740 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.386+0000 7facebe00640 1 --2- 172.21.15.131:0/2680977113 >> v2:172.21.15.131:3300/0 conn(0x7facec0b4360 0x7facec06e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.386+0000 7facebe00640 1 -- 172.21.15.131:0/2680977113 >> 172.21.15.131:0/2680977113 conn(0x7facec0cfa50 msgr2=0x7facec0cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:27.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.386+0000 7facebe00640 1 -- 172.21.15.131:0/2680977113 shutdown_connections 2024-09-10T22:38:27.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.386+0000 7facebe00640 1 -- 172.21.15.131:0/2680977113 wait complete. 2024-09-10T22:38:27.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facebe00640 1 Processor -- start 2024-09-10T22:38:27.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facebe00640 1 -- start start 2024-09-10T22:38:27.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facebe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facec0b4360 0x7facec150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:27.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facebe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facec15a240 0x7facec0726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:27.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facec15b620 0x7facec072c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:27.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facebe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7facec15c550 con 0x7facec15b620 2024-09-10T22:38:27.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facebe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7facec15c3d0 con 0x7facec15a240 2024-09-10T22:38:27.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facebe00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7facec15c6d0 con 0x7facec0b4360 2024-09-10T22:38:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facea000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facec15a240 0x7facec0726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7faceaa00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facec0b4360 0x7facec150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facea000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facec15a240 0x7facec0726d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46672/0 (socket says 172.21.15.131:46672) 2024-09-10T22:38:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facea000640 1 -- 172.21.15.131:0/2001014899 learned_addr learned my addr 172.21.15.131:0/2001014899 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-10T22:38:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7faceb400640 1 --2- 172.21.15.131:0/2001014899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facec15b620 0x7facec072c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facea000640 1 -- 172.21.15.131:0/2001014899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facec0b4360 msgr2=0x7facec150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facea000640 1 --2- 172.21.15.131:0/2001014899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facec0b4360 0x7facec150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facea000640 1 -- 172.21.15.131:0/2001014899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facec15b620 msgr2=0x7facec072c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facea000640 1 --2- 172.21.15.131:0/2001014899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facec15b620 0x7facec072c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facea000640 1 -- 172.21.15.131:0/2001014899 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec151820 con 0x7facec15a240 2024-09-10T22:38:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7faceaa00640 1 --2- 172.21.15.131:0/2001014899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facec0b4360 0x7facec150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:38:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facea000640 1 --2- 172.21.15.131:0/2001014899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facec15a240 0x7facec0726d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7facd800a8a0 tx=0x7facd8005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:27.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7face2a00640 1 -- 172.21.15.131:0/2001014899 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd80b3040 con 0x7facec15a240 2024-09-10T22:38:27.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7face2a00640 1 -- 172.21.15.131:0/2001014899 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7facd8005310 con 0x7facec15a240 2024-09-10T22:38:27.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7face2a00640 1 -- 172.21.15.131:0/2001014899 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd80046d0 con 0x7facec15a240 2024-09-10T22:38:27.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facebe00640 1 -- 172.21.15.131:0/2001014899 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facec1f5060 con 0x7facec15a240 2024-09-10T22:38:27.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7facebe00640 1 -- 172.21.15.131:0/2001014899 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facec1f4d30 con 0x7facec15a240 2024-09-10T22:38:27.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7face2a00640 1 -- 172.21.15.131:0/2001014899 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7facd800b040 con 0x7facec15a240 2024-09-10T22:38:27.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.390+0000 7face2a00640 1 -- 172.21.15.131:0/2001014899 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7facd80be070 con 0x7facec15a240 2024-09-10T22:38:27.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.394+0000 7facebe00640 1 -- 172.21.15.131:0/2001014899 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facec06e6d0 con 0x7facec15a240 2024-09-10T22:38:27.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.394+0000 7face2a00640 1 -- 172.21.15.131:0/2001014899 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7facd80d9950 con 0x7facec15a240 2024-09-10T22:38:27.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.466+0000 7facebe00640 1 -- 172.21.15.131:0/2001014899 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f816f067-f546-49df-b936-c86b9dba2bf8", "id": 5} v 0) -- 0x7facec075fb0 con 0x7facec15a240 2024-09-10T22:38:27.466 INFO:tasks.ceph.mgr.x.smithi131.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-10T22:38:27.466 INFO:tasks.ceph.mgr.x.smithi131.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-10T22:38:27.466 INFO:tasks.ceph.mgr.x.smithi131.stderr: from numpy import show_config as show_numpy_config 2024-09-10T22:38:27.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.470+0000 7face2a00640 1 -- 172.21.15.131:0/2001014899 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f816f067-f546-49df-b936-c86b9dba2bf8", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7facd80c7030 con 0x7facec15a240 2024-09-10T22:38:27.472 INFO:teuthology.orchestra.run.smithi131.stdout:5 2024-09-10T22:38:27.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.474+0000 7facebe00640 1 -- 172.21.15.131:0/2001014899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facec15a240 msgr2=0x7facec0726d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:27.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.474+0000 7facebe00640 1 --2- 172.21.15.131:0/2001014899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facec15a240 0x7facec0726d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7facd800a8a0 tx=0x7facd8005dd0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.474+0000 7facebe00640 1 -- 172.21.15.131:0/2001014899 shutdown_connections 2024-09-10T22:38:27.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.474+0000 7facebe00640 1 --2- 172.21.15.131:0/2001014899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facec15b620 0x7facec072c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.474+0000 7facebe00640 1 --2- 172.21.15.131:0/2001014899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facec15a240 0x7facec0726d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.474+0000 7facebe00640 1 --2- 172.21.15.131:0/2001014899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facec0b4360 0x7facec150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.474+0000 7facebe00640 1 -- 172.21.15.131:0/2001014899 >> 172.21.15.131:0/2001014899 conn(0x7facec0cfa50 msgr2=0x7facec15bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:27.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.474+0000 7facebe00640 1 -- 172.21.15.131:0/2001014899 shutdown_connections 2024-09-10T22:38:27.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.474+0000 7facebe00640 1 -- 172.21.15.131:0/2001014899 wait complete. 2024-09-10T22:38:27.491 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 8086074e-005d-4d1c-ab5a-44065fbcf5a1 6 2024-09-10T22:38:27.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.630+0000 7f1d08e00640 1 -- 172.21.15.131:0/1255727568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d0415be30 msgr2=0x7f1d040ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:27.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.630+0000 7f1d08e00640 1 --2- 172.21.15.131:0/1255727568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d0415be30 0x7f1d040ce0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009900 tx=0x7f1cf401c850 comp rx=0 tx=0).stop 2024-09-10T22:38:27.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.630+0000 7f1d08e00640 1 -- 172.21.15.131:0/1255727568 shutdown_connections 2024-09-10T22:38:27.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.630+0000 7f1d08e00640 1 --2- 172.21.15.131:0/1255727568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d0415be30 0x7f1d040ce0c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.630+0000 7f1d08e00640 1 -- 172.21.15.131:0/1255727568 >> 172.21.15.131:0/1255727568 conn(0x7f1d040d1ac0 msgr2=0x7f1d040d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:27.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.630+0000 7f1d08e00640 1 -- 172.21.15.131:0/1255727568 shutdown_connections 2024-09-10T22:38:27.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.630+0000 7f1d08e00640 1 -- 172.21.15.131:0/1255727568 wait complete. 2024-09-10T22:38:27.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d08e00640 1 Processor -- start 2024-09-10T22:38:27.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d08e00640 1 -- start start 2024-09-10T22:38:27.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d08e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d040ae9c0 0x7f1d0414aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:27.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d08e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d040b09c0 0x7f1d041f77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d08e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d0415be30 0x7f1d04158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d08e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1d04169e50 con 0x7f1d040b09c0 2024-09-10T22:38:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d08e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1d04169cd0 con 0x7f1d0415be30 2024-09-10T22:38:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d08e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1d04169fd0 con 0x7f1d040ae9c0 2024-09-10T22:38:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d01e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d040ae9c0 0x7f1d0414aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d02800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d0415be30 0x7f1d04158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1cfbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d040b09c0 0x7f1d041f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d02800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d0415be30 0x7f1d04158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46686/0 (socket says 172.21.15.131:46686) 2024-09-10T22:38:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d01e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d040ae9c0 0x7f1d0414aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:60816/0 (socket says 172.21.15.131:60816) 2024-09-10T22:38:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d02800640 1 -- 172.21.15.131:0/2258663765 learned_addr learned my addr 172.21.15.131:0/2258663765 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-10T22:38:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d02800640 1 -- 172.21.15.131:0/2258663765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d040ae9c0 msgr2=0x7f1d0414aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d02800640 1 --2- 172.21.15.131:0/2258663765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d040ae9c0 0x7f1d0414aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d02800640 1 -- 172.21.15.131:0/2258663765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d040b09c0 msgr2=0x7f1d041f77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:27.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d02800640 1 --2- 172.21.15.131:0/2258663765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d040b09c0 0x7f1d041f77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d02800640 1 -- 172.21.15.131:0/2258663765 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d04159420 con 0x7f1d0415be30 2024-09-10T22:38:27.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d01e00640 1 --2- 172.21.15.131:0/2258663765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d040ae9c0 0x7f1d0414aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:38:27.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d02800640 1 --2- 172.21.15.131:0/2258663765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d0415be30 0x7f1d04158bd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00c7c0 tx=0x7f1cfc00cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:27.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1cfa000640 1 -- 172.21.15.131:0/2258663765 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc003b80 con 0x7f1d0415be30 2024-09-10T22:38:27.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1cfa000640 1 -- 172.21.15.131:0/2258663765 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cfc003d20 con 0x7f1d0415be30 2024-09-10T22:38:27.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1cfa000640 1 -- 172.21.15.131:0/2258663765 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc00aa50 con 0x7f1d0415be30 2024-09-10T22:38:27.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d08e00640 1 -- 172.21.15.131:0/2258663765 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d04159700 con 0x7f1d0415be30 2024-09-10T22:38:27.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1d08e00640 1 -- 172.21.15.131:0/2258663765 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d0406e030 con 0x7f1d0415be30 2024-09-10T22:38:27.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1cfa000640 1 -- 172.21.15.131:0/2258663765 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f1cfc00abf0 con 0x7f1d0415be30 2024-09-10T22:38:27.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.634+0000 7f1cfa000640 1 -- 172.21.15.131:0/2258663765 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f1cfc0056c0 con 0x7f1d0415be30 2024-09-10T22:38:27.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.638+0000 7f1d08e00640 1 -- 172.21.15.131:0/2258663765 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d040aee10 con 0x7f1d0415be30 2024-09-10T22:38:27.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.638+0000 7f1cfa000640 1 -- 172.21.15.131:0/2258663765 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f1cfc0050d0 con 0x7f1d0415be30 2024-09-10T22:38:27.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.706+0000 7f1d08e00640 1 -- 172.21.15.131:0/2258663765 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8086074e-005d-4d1c-ab5a-44065fbcf5a1", "id": 6} v 0) -- 0x7f1d0406e200 con 0x7f1d0415be30 2024-09-10T22:38:27.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.714+0000 7f1cfa000640 1 -- 172.21.15.131:0/2258663765 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8086074e-005d-4d1c-ab5a-44065fbcf5a1", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f1cfc0052b0 con 0x7f1d0415be30 2024-09-10T22:38:27.716 INFO:teuthology.orchestra.run.smithi131.stdout:6 2024-09-10T22:38:27.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.714+0000 7f1d08e00640 1 -- 172.21.15.131:0/2258663765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d0415be30 msgr2=0x7f1d04158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:27.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.714+0000 7f1d08e00640 1 --2- 172.21.15.131:0/2258663765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d0415be30 0x7f1d04158bd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00c7c0 tx=0x7f1cfc00cc80 comp rx=0 tx=0).stop 2024-09-10T22:38:27.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.714+0000 7f1d08e00640 1 -- 172.21.15.131:0/2258663765 shutdown_connections 2024-09-10T22:38:27.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.714+0000 7f1d08e00640 1 --2- 172.21.15.131:0/2258663765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d0415be30 0x7f1d04158bd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.714+0000 7f1d08e00640 1 --2- 172.21.15.131:0/2258663765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d040b09c0 0x7f1d041f77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.714+0000 7f1d08e00640 1 --2- 172.21.15.131:0/2258663765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d040ae9c0 0x7f1d0414aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.714+0000 7f1d08e00640 1 -- 172.21.15.131:0/2258663765 >> 172.21.15.131:0/2258663765 conn(0x7f1d040d1ac0 msgr2=0x7f1d04070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:27.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.718+0000 7f1d08e00640 1 -- 172.21.15.131:0/2258663765 shutdown_connections 2024-09-10T22:38:27.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.718+0000 7f1d08e00640 1 -- 172.21.15.131:0/2258663765 wait complete. 2024-09-10T22:38:27.735 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 46616502-72f3-447a-bb60-8f7b936e58ba 7 2024-09-10T22:38:27.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.874+0000 7ff653a00640 1 -- 172.21.15.131:0/2968465382 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff64c0b09c0 msgr2=0x7ff64c0ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:27.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.874+0000 7ff653a00640 1 --2- 172.21.15.131:0/2968465382 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff64c0b09c0 0x7ff64c0ce600 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff64c15f970 tx=0x7ff63801c830 comp rx=0 tx=0).stop 2024-09-10T22:38:27.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.874+0000 7ff653a00640 1 -- 172.21.15.131:0/2968465382 shutdown_connections 2024-09-10T22:38:27.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.874+0000 7ff653a00640 1 --2- 172.21.15.131:0/2968465382 >> v2:172.21.15.131:3300/0 conn(0x7ff64c0ceb40 0x7ff64c0cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.874+0000 7ff653a00640 1 --2- 172.21.15.131:0/2968465382 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff64c0b09c0 0x7ff64c0ce600 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.874+0000 7ff653a00640 1 --2- 172.21.15.131:0/2968465382 >> v2:172.21.15.103:3300/0 conn(0x7ff64c15be30 0x7ff64c0ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.874+0000 7ff653a00640 1 -- 172.21.15.131:0/2968465382 >> 172.21.15.131:0/2968465382 conn(0x7ff64c0d1ac0 msgr2=0x7ff64c0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:27.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff653a00640 1 -- 172.21.15.131:0/2968465382 shutdown_connections 2024-09-10T22:38:27.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff653a00640 1 -- 172.21.15.131:0/2968465382 wait complete. 2024-09-10T22:38:27.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff653a00640 1 Processor -- start 2024-09-10T22:38:27.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff653a00640 1 -- start start 2024-09-10T22:38:27.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff653a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff64c0b09c0 0x7ff64c150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:27.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff653a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff64c0ceb40 0x7ff64c0b7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:27.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff653a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff64c15be30 0x7ff64c0b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:27.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff653a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff64c0aed50 con 0x7ff64c15be30 2024-09-10T22:38:27.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff653a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff64c0aebd0 con 0x7ff64c0b09c0 2024-09-10T22:38:27.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff653a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff64c0aeed0 con 0x7ff64c0ceb40 2024-09-10T22:38:27.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff651000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff64c0b09c0 0x7ff64c150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:27.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff64be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff64c0ceb40 0x7ff64c0b7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:27.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff651000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff64c0b09c0 0x7ff64c150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46706/0 (socket says 172.21.15.131:46706) 2024-09-10T22:38:27.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff651000640 1 -- 172.21.15.131:0/2413978692 learned_addr learned my addr 172.21.15.131:0/2413978692 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-10T22:38:27.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff651a00640 1 --2- 172.21.15.131:0/2413978692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff64c15be30 0x7ff64c0b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:27.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff651000640 1 -- 172.21.15.131:0/2413978692 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff64c0ceb40 msgr2=0x7ff64c0b7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:27.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff651000640 1 --2- 172.21.15.131:0/2413978692 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff64c0ceb40 0x7ff64c0b7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff651000640 1 -- 172.21.15.131:0/2413978692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff64c15be30 msgr2=0x7ff64c0b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:27.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff651000640 1 --2- 172.21.15.131:0/2413978692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff64c15be30 0x7ff64c0b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff651000640 1 -- 172.21.15.131:0/2413978692 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64c1f71a0 con 0x7ff64c0b09c0 2024-09-10T22:38:27.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.878+0000 7ff651000640 1 --2- 172.21.15.131:0/2413978692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff64c0b09c0 0x7ff64c150af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff64000e7d0 tx=0x7ff64000ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:27.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.882+0000 7ff648c00640 1 -- 172.21.15.131:0/2413978692 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640024070 con 0x7ff64c0b09c0 2024-09-10T22:38:27.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.882+0000 7ff648c00640 1 -- 172.21.15.131:0/2413978692 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff64000c8b0 con 0x7ff64c0b09c0 2024-09-10T22:38:27.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.882+0000 7ff648c00640 1 -- 172.21.15.131:0/2413978692 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64000cce0 con 0x7ff64c0b09c0 2024-09-10T22:38:27.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.882+0000 7ff653a00640 1 -- 172.21.15.131:0/2413978692 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff64c0b1ac0 con 0x7ff64c0b09c0 2024-09-10T22:38:27.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.882+0000 7ff653a00640 1 -- 172.21.15.131:0/2413978692 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff64c0b2080 con 0x7ff64c0b09c0 2024-09-10T22:38:27.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.882+0000 7ff648c00640 1 -- 172.21.15.131:0/2413978692 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7ff64001f650 con 0x7ff64c0b09c0 2024-09-10T22:38:27.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.882+0000 7ff648c00640 1 -- 172.21.15.131:0/2413978692 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7ff6400297b0 con 0x7ff64c0b09c0 2024-09-10T22:38:27.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.882+0000 7ff653a00640 1 -- 172.21.15.131:0/2413978692 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff64c0cf9c0 con 0x7ff64c0b09c0 2024-09-10T22:38:27.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.882+0000 7ff648c00640 1 -- 172.21.15.131:0/2413978692 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7ff64c1f71a0 con 0x7ff64c0b09c0 2024-09-10T22:38:27.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.954+0000 7ff653a00640 1 -- 172.21.15.131:0/2413978692 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "46616502-72f3-447a-bb60-8f7b936e58ba", "id": 7} v 0) -- 0x7ff64c0d2770 con 0x7ff64c0b09c0 2024-09-10T22:38:27.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.958+0000 7ff648c00640 1 -- 172.21.15.131:0/2413978692 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46616502-72f3-447a-bb60-8f7b936e58ba", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7ff640029a60 con 0x7ff64c0b09c0 2024-09-10T22:38:27.960 INFO:teuthology.orchestra.run.smithi131.stdout:7 2024-09-10T22:38:27.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.962+0000 7ff653a00640 1 -- 172.21.15.131:0/2413978692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff64c0b09c0 msgr2=0x7ff64c150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:27.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.962+0000 7ff653a00640 1 --2- 172.21.15.131:0/2413978692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff64c0b09c0 0x7ff64c150af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff64000e7d0 tx=0x7ff64000ebd0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.962+0000 7ff653a00640 1 -- 172.21.15.131:0/2413978692 shutdown_connections 2024-09-10T22:38:27.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.962+0000 7ff653a00640 1 --2- 172.21.15.131:0/2413978692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff64c15be30 0x7ff64c0b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.962+0000 7ff653a00640 1 --2- 172.21.15.131:0/2413978692 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff64c0ceb40 0x7ff64c0b7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.962+0000 7ff653a00640 1 --2- 172.21.15.131:0/2413978692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff64c0b09c0 0x7ff64c150af0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:27.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.962+0000 7ff653a00640 1 -- 172.21.15.131:0/2413978692 >> 172.21.15.131:0/2413978692 conn(0x7ff64c0d1ac0 msgr2=0x7ff64c06f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:27.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.962+0000 7ff653a00640 1 -- 172.21.15.131:0/2413978692 shutdown_connections 2024-09-10T22:38:27.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:38:27.962+0000 7ff653a00640 1 -- 172.21.15.131:0/2413978692 wait complete. 2024-09-10T22:38:27.979 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T22:38:27.980 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T22:38:27.983 INFO:tasks.ceph.osd.0:Started 2024-09-10T22:38:27.983 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T22:38:27.983 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T22:38:27.986 INFO:tasks.ceph.osd.1:Started 2024-09-10T22:38:27.986 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T22:38:27.986 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T22:38:27.989 INFO:tasks.ceph.osd.2:Started 2024-09-10T22:38:27.989 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T22:38:27.990 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T22:38:27.990 INFO:tasks.ceph.mgr.y.smithi103.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-10T22:38:27.990 INFO:tasks.ceph.mgr.y.smithi103.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-10T22:38:27.990 INFO:tasks.ceph.mgr.y.smithi103.stderr: from numpy import show_config as show_numpy_config 2024-09-10T22:38:27.994 INFO:tasks.ceph.osd.3:Started 2024-09-10T22:38:27.994 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-10T22:38:27.994 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-10T22:38:27.997 INFO:tasks.ceph.osd.4:Started 2024-09-10T22:38:27.997 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-10T22:38:27.997 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-10T22:38:28.000 INFO:tasks.ceph.osd.5:Started 2024-09-10T22:38:28.000 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-10T22:38:28.000 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-10T22:38:28.003 INFO:tasks.ceph.osd.6:Started 2024-09-10T22:38:28.003 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-10T22:38:28.003 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-10T22:38:28.007 INFO:tasks.ceph.osd.7:Started 2024-09-10T22:38:28.008 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:38:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.181+0000 7f3103800640 1 -- 172.21.15.103:0/1283488283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30fc15be30 msgr2=0x7f30fc0ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.181+0000 7f3103800640 1 --2- 172.21.15.103:0/1283488283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30fc15be30 0x7f30fc0ce0c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009840 tx=0x7f30f001c790 comp rx=0 tx=0).stop 2024-09-10T22:38:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.181+0000 7f3103800640 1 -- 172.21.15.103:0/1283488283 shutdown_connections 2024-09-10T22:38:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.181+0000 7f3103800640 1 --2- 172.21.15.103:0/1283488283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30fc0ae9c0 0x7f30fc0aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.181+0000 7f3103800640 1 --2- 172.21.15.103:0/1283488283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30fc15be30 0x7f30fc0ce0c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.181+0000 7f3103800640 1 -- 172.21.15.103:0/1283488283 >> 172.21.15.103:0/1283488283 conn(0x7f30fc0d1ac0 msgr2=0x7f30fc0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.181+0000 7f3103800640 1 -- 172.21.15.103:0/1283488283 shutdown_connections 2024-09-10T22:38:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.181+0000 7f3103800640 1 -- 172.21.15.103:0/1283488283 wait complete. 2024-09-10T22:38:28.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3103800640 1 Processor -- start 2024-09-10T22:38:28.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3103800640 1 -- start start 2024-09-10T22:38:28.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3103800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30fc0ae9c0 0x7f30fc152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:28.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3103800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30fc0b09c0 0x7f30fc152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:28.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3103800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30fc15be30 0x7f30fc1fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:28.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3103800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc168df0 con 0x7f30fc15be30 2024-09-10T22:38:28.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3103800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc168c70 con 0x7f30fc0b09c0 2024-09-10T22:38:28.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3103800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f30fc168f70 con 0x7f30fc0ae9c0 2024-09-10T22:38:28.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3101800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30fc15be30 0x7f30fc1fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:28.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3101800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30fc15be30 0x7f30fc1fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44402/0 (socket says 172.21.15.103:44402) 2024-09-10T22:38:28.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3101800640 1 -- 172.21.15.103:0/211643846 learned_addr learned my addr 172.21.15.103:0/211643846 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:28.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3100e00640 1 --2- 172.21.15.103:0/211643846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30fc0ae9c0 0x7f30fc152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:28.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f30fbe00640 1 --2- 172.21.15.103:0/211643846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30fc0b09c0 0x7f30fc152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:28.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3101800640 1 -- 172.21.15.103:0/211643846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30fc0ae9c0 msgr2=0x7f30fc152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:28.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3101800640 1 --2- 172.21.15.103:0/211643846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30fc0ae9c0 0x7f30fc152910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:28.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3101800640 1 -- 172.21.15.103:0/211643846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30fc0b09c0 msgr2=0x7f30fc152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:28.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3101800640 1 --2- 172.21.15.103:0/211643846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30fc0b09c0 0x7f30fc152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:28.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3101800640 1 -- 172.21.15.103:0/211643846 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30fc070730 con 0x7f30fc15be30 2024-09-10T22:38:28.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3101800640 1 --2- 172.21.15.103:0/211643846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30fc15be30 0x7f30fc1fad80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009d30 tx=0x7f30f400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:28.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f30f8c00640 1 -- 172.21.15.103:0/211643846 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4003b80 con 0x7f30fc15be30 2024-09-10T22:38:28.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f30f8c00640 1 -- 172.21.15.103:0/211643846 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30f4003d20 con 0x7f30fc15be30 2024-09-10T22:38:28.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f30f8c00640 1 -- 172.21.15.103:0/211643846 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4004280 con 0x7f30fc15be30 2024-09-10T22:38:28.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3103800640 1 -- 172.21.15.103:0/211643846 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30fc070a10 con 0x7f30fc15be30 2024-09-10T22:38:28.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f3103800640 1 -- 172.21.15.103:0/211643846 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30fc0714f0 con 0x7f30fc15be30 2024-09-10T22:38:28.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f30f8c00640 1 -- 172.21.15.103:0/211643846 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f30f4021440 con 0x7f30fc15be30 2024-09-10T22:38:28.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.185+0000 7f30f8c00640 1 -- 172.21.15.103:0/211643846 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f30f4018b00 con 0x7f30fc15be30 2024-09-10T22:38:28.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.189+0000 7f3103800640 1 -- 172.21.15.103:0/211643846 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30fc0aee50 con 0x7f30fc15be30 2024-09-10T22:38:28.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.189+0000 7f30f8c00640 1 -- 172.21.15.103:0/211643846 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f30f4018430 con 0x7f30fc15be30 2024-09-10T22:38:28.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.253+0000 7f3103800640 1 -- 172.21.15.103:0/211643846 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30fc0cbcc0 con 0x7f30fc15be30 2024-09-10T22:38:28.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.253+0000 7f30f8c00640 1 -- 172.21.15.103:0/211643846 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f30f4018610 con 0x7f30fc15be30 2024-09-10T22:38:28.258 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:38:28.258 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":10,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:38:27.956330+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:38:28.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.253+0000 7f3103800640 1 -- 172.21.15.103:0/211643846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30fc15be30 msgr2=0x7f30fc1fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:28.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.253+0000 7f3103800640 1 --2- 172.21.15.103:0/211643846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30fc15be30 0x7f30fc1fad80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009d30 tx=0x7f30f400c6a0 comp rx=0 tx=0).stop 2024-09-10T22:38:28.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.253+0000 7f3103800640 1 -- 172.21.15.103:0/211643846 shutdown_connections 2024-09-10T22:38:28.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.253+0000 7f3103800640 1 --2- 172.21.15.103:0/211643846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30fc15be30 0x7f30fc1fad80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:28.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.253+0000 7f3103800640 1 --2- 172.21.15.103:0/211643846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30fc0b09c0 0x7f30fc152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:28.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.253+0000 7f3103800640 1 --2- 172.21.15.103:0/211643846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30fc0ae9c0 0x7f30fc152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:28.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.253+0000 7f3103800640 1 -- 172.21.15.103:0/211643846 >> 172.21.15.103:0/211643846 conn(0x7f30fc0d1ac0 msgr2=0x7f30fc06e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:28.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.253+0000 7f3103800640 1 -- 172.21.15.103:0/211643846 shutdown_connections 2024-09-10T22:38:28.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:28.253+0000 7f3103800640 1 -- 172.21.15.103:0/211643846 wait complete. 2024-09-10T22:38:28.277 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T22:38:28.277 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T22:38:29.083 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T22:38:29.219 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.213+0000 7f39f9600640 1 -- 172.21.15.103:0/1523869420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39f415bc00 msgr2=0x7f39f40d0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:29.220 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.213+0000 7f39f9600640 1 --2- 172.21.15.103:0/1523869420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39f415bc00 0x7f39f40d0d90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f39f40735f0 tx=0x7f39e401c890 comp rx=0 tx=0).stop 2024-09-10T22:38:29.220 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.213+0000 7f39f9600640 1 -- 172.21.15.103:0/1523869420 shutdown_connections 2024-09-10T22:38:29.220 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.213+0000 7f39f9600640 1 --2- 172.21.15.103:0/1523869420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39f40b1830 0x7f39f40cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:29.220 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.213+0000 7f39f9600640 1 --2- 172.21.15.103:0/1523869420 >> v2:172.21.15.131:3300/0 conn(0x7f39f40b12e0 0x7f39f40cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:29.220 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.213+0000 7f39f9600640 1 --2- 172.21.15.103:0/1523869420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39f415bc00 0x7f39f40d0d90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:29.220 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.213+0000 7f39f9600640 1 -- 172.21.15.103:0/1523869420 >> 172.21.15.103:0/1523869420 conn(0x7f39f40b5240 msgr2=0x7f39f40b5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:29.220 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39f9600640 1 -- 172.21.15.103:0/1523869420 shutdown_connections 2024-09-10T22:38:29.220 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39f9600640 1 -- 172.21.15.103:0/1523869420 wait complete. 2024-09-10T22:38:29.221 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39f9600640 1 Processor -- start 2024-09-10T22:38:29.221 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39f9600640 1 -- start start 2024-09-10T22:38:29.223 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39f9600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39f40b12e0 0x7f39f4099110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:29.223 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39f9600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39f40b1830 0x7f39f40c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:29.223 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39f9600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39f415bc00 0x7f39f40c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:29.223 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39f9600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f39f40b1d80 con 0x7f39f40b1830 2024-09-10T22:38:29.223 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39f9600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f39f40cb5e0 con 0x7f39f40b12e0 2024-09-10T22:38:29.223 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39f9600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f39f40b1f00 con 0x7f39f415bc00 2024-09-10T22:38:29.224 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39ebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39f40b1830 0x7f39f40c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:29.224 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39ebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39f40b1830 0x7f39f40c4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44414/0 (socket says 172.21.15.103:44414) 2024-09-10T22:38:29.224 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39ebe00640 1 -- 172.21.15.103:0/1751149317 learned_addr learned my addr 172.21.15.103:0/1751149317 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:29.224 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39f2a00640 1 --2- 172.21.15.103:0/1751149317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39f40b12e0 0x7f39f4099110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:29.224 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39f3400640 1 --2- 172.21.15.103:0/1751149317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39f415bc00 0x7f39f40c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:29.224 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39ebe00640 1 -- 172.21.15.103:0/1751149317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39f415bc00 msgr2=0x7f39f40c51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:29.224 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39ebe00640 1 --2- 172.21.15.103:0/1751149317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39f415bc00 0x7f39f40c51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:29.224 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39ebe00640 1 -- 172.21.15.103:0/1751149317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39f40b12e0 msgr2=0x7f39f4099110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:29.224 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39ebe00640 1 --2- 172.21.15.103:0/1751149317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39f40b12e0 0x7f39f4099110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:29.224 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39ebe00640 1 -- 172.21.15.103:0/1751149317 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f40c74a0 con 0x7f39f40b1830 2024-09-10T22:38:29.224 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39f3400640 1 --2- 172.21.15.103:0/1751149317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39f415bc00 0x7f39f40c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:38:29.225 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39ebe00640 1 --2- 172.21.15.103:0/1751149317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39f40b1830 0x7f39f40c4ca0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00d720 tx=0x7f39dc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:29.225 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39eaa00640 1 -- 172.21.15.103:0/1751149317 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc017070 con 0x7f39f40b1830 2024-09-10T22:38:29.225 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39eaa00640 1 -- 172.21.15.103:0/1751149317 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39dc009d20 con 0x7f39f40b1830 2024-09-10T22:38:29.225 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39eaa00640 1 -- 172.21.15.103:0/1751149317 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc004280 con 0x7f39f40b1830 2024-09-10T22:38:29.225 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.217+0000 7f39f9600640 1 -- 172.21.15.103:0/1751149317 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f40c7780 con 0x7f39f40b1830 2024-09-10T22:38:29.225 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.221+0000 7f39f9600640 1 -- 172.21.15.103:0/1751149317 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f40cc9b0 con 0x7f39f40b1830 2024-09-10T22:38:29.225 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.221+0000 7f39eaa00640 1 -- 172.21.15.103:0/1751149317 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f39dc0053b0 con 0x7f39f40b1830 2024-09-10T22:38:29.225 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.221+0000 7f39eaa00640 1 -- 172.21.15.103:0/1751149317 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f39dc004420 con 0x7f39f40b1830 2024-09-10T22:38:29.226 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.221+0000 7f39f9600640 1 -- 172.21.15.103:0/1751149317 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39f40d0d90 con 0x7f39f40b1830 2024-09-10T22:38:29.226 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.221+0000 7f39eaa00640 1 -- 172.21.15.103:0/1751149317 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f39dc020020 con 0x7f39f40b1830 2024-09-10T22:38:29.286 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.281+0000 7f39f9600640 1 -- 172.21.15.103:0/1751149317 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39f406add0 con 0x7f39f40b1830 2024-09-10T22:38:29.287 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.281+0000 7f39eaa00640 1 -- 172.21.15.103:0/1751149317 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f39dc0047b0 con 0x7f39f40b1830 2024-09-10T22:38:29.287 INFO:teuthology.misc.health.smithi103.stdout: 2024-09-10T22:38:29.287 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":10,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:38:27.956330+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:38:29.288 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.285+0000 7f39f9600640 1 -- 172.21.15.103:0/1751149317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39f40b1830 msgr2=0x7f39f40c4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:29.288 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.285+0000 7f39f9600640 1 --2- 172.21.15.103:0/1751149317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39f40b1830 0x7f39f40c4ca0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00d720 tx=0x7f39dc00dbe0 comp rx=0 tx=0).stop 2024-09-10T22:38:29.288 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.285+0000 7f39f9600640 1 -- 172.21.15.103:0/1751149317 shutdown_connections 2024-09-10T22:38:29.289 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.285+0000 7f39f9600640 1 --2- 172.21.15.103:0/1751149317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39f415bc00 0x7f39f40c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:29.289 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.285+0000 7f39f9600640 1 --2- 172.21.15.103:0/1751149317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39f40b1830 0x7f39f40c4ca0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:29.289 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.285+0000 7f39f9600640 1 --2- 172.21.15.103:0/1751149317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39f40b12e0 0x7f39f4099110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:29.289 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.285+0000 7f39f9600640 1 -- 172.21.15.103:0/1751149317 >> 172.21.15.103:0/1751149317 conn(0x7f39f40b5240 msgr2=0x7f39f40c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:29.289 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.285+0000 7f39f9600640 1 -- 172.21.15.103:0/1751149317 shutdown_connections 2024-09-10T22:38:29.289 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:29.285+0000 7f39f9600640 1 -- 172.21.15.103:0/1751149317 wait complete. 2024-09-10T22:38:29.305 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T22:38:29.370 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-09-10T22:38:29.370+0000 7f0cecf6e7c0 -1 Falling back to public interface 2024-09-10T22:38:29.664 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-09-10T22:38:29.661+0000 7f00bc7a97c0 -1 Falling back to public interface 2024-09-10T22:38:29.682 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-09-10T22:38:29.682+0000 7ffa5fa2c7c0 -1 Falling back to public interface 2024-09-10T22:38:29.689 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-09-10T22:38:29.685+0000 7f1c23c957c0 -1 Falling back to public interface 2024-09-10T22:38:29.700 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-09-10T22:38:29.697+0000 7fb4de5157c0 -1 Falling back to public interface 2024-09-10T22:38:29.762 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-09-10T22:38:29.762+0000 7f4fc363d7c0 -1 Falling back to public interface 2024-09-10T22:38:29.772 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-09-10T22:38:29.769+0000 7fcc096707c0 -1 Falling back to public interface 2024-09-10T22:38:29.886 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-09-10T22:38:29.886+0000 7f3dbcaf57c0 -1 Falling back to public interface 2024-09-10T22:38:30.620 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-10T22:38:30.618+0000 7ff1c5000640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T22:38:30.620 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-10T22:38:30.618+0000 7ff1c5000640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T22:38:33.790 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-09-10T22:38:33.785+0000 7f00bc7a97c0 -1 osd.1 0 log_to_monitors true 2024-09-10T22:38:33.902 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-09-10T22:38:33.897+0000 7fb4de5157c0 -1 osd.2 0 log_to_monitors true 2024-09-10T22:38:33.929 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-09-10T22:38:33.925+0000 7f0cecf6e7c0 -1 osd.5 0 log_to_monitors true 2024-09-10T22:38:34.009 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-09-10T22:38:34.005+0000 7f4fc363d7c0 -1 osd.6 0 log_to_monitors true 2024-09-10T22:38:34.203 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-09-10T22:38:34.201+0000 7ffa5fa2c7c0 -1 osd.4 0 log_to_monitors true 2024-09-10T22:38:34.228 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-09-10T22:38:34.225+0000 7fcc096707c0 -1 osd.3 0 log_to_monitors true 2024-09-10T22:38:34.432 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-09-10T22:38:34.429+0000 7f1c23c957c0 -1 osd.0 0 log_to_monitors true 2024-09-10T22:38:34.613 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-09-10T22:38:34.609+0000 7f3dbcaf57c0 -1 osd.7 0 log_to_monitors true 2024-09-10T22:38:35.728 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-09-10T22:38:35.724+0000 7f00b7600640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T22:38:35.756 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-09-10T22:38:35.752+0000 7f00ad600640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:38:36.111 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T22:38:36.269 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.264+0000 7f3bc8c00640 1 -- 172.21.15.103:0/2350752316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bc415f110 msgr2=0x7f3bc40ce140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:36.269 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.264+0000 7f3bc8c00640 1 --2- 172.21.15.103:0/2350752316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bc415f110 0x7f3bc40ce140 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4009900 tx=0x7f3bb401c850 comp rx=0 tx=0).stop 2024-09-10T22:38:36.269 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.264+0000 7f3bc8c00640 1 -- 172.21.15.103:0/2350752316 shutdown_connections 2024-09-10T22:38:36.269 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.264+0000 7f3bc8c00640 1 --2- 172.21.15.103:0/2350752316 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bc40b2720 0x7f3bc40cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:36.269 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.264+0000 7f3bc8c00640 1 --2- 172.21.15.103:0/2350752316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bc415f110 0x7f3bc40ce140 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:36.269 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.264+0000 7f3bc8c00640 1 -- 172.21.15.103:0/2350752316 >> 172.21.15.103:0/2350752316 conn(0x7f3bc409aa70 msgr2=0x7f3bc40d1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:36.270 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.264+0000 7f3bc8c00640 1 -- 172.21.15.103:0/2350752316 shutdown_connections 2024-09-10T22:38:36.270 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.264+0000 7f3bc8c00640 1 -- 172.21.15.103:0/2350752316 wait complete. 2024-09-10T22:38:36.271 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.264+0000 7f3bc8c00640 1 Processor -- start 2024-09-10T22:38:36.271 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.264+0000 7f3bc8c00640 1 -- start start 2024-09-10T22:38:36.272 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bc8c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bc40b2720 0x7f3bc41f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:36.272 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bc8c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bc40cfb40 0x7f3bc40ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:36.272 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bc8c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bc415f110 0x7f3bc415ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:36.272 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bc8c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc4168850 con 0x7f3bc415f110 2024-09-10T22:38:36.272 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bc8c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc40cd8e0 con 0x7f3bc40cfb40 2024-09-10T22:38:36.272 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bc8c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc41689d0 con 0x7f3bc40b2720 2024-09-10T22:38:36.272 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bc2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bc415f110 0x7f3bc415ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:36.273 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bc1400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bc40cfb40 0x7f3bc40ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:36.273 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bc2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bc415f110 0x7f3bc415ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44476/0 (socket says 172.21.15.103:44476) 2024-09-10T22:38:36.273 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bc2800640 1 -- 172.21.15.103:0/2560277474 learned_addr learned my addr 172.21.15.103:0/2560277474 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:36.273 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bc1e00640 1 --2- 172.21.15.103:0/2560277474 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bc40b2720 0x7f3bc41f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:36.273 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bc2800640 1 -- 172.21.15.103:0/2560277474 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bc40b2720 msgr2=0x7f3bc41f7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:36.274 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bc2800640 1 --2- 172.21.15.103:0/2560277474 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bc40b2720 0x7f3bc41f7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:36.274 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bc2800640 1 -- 172.21.15.103:0/2560277474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bc40cfb40 msgr2=0x7f3bc40ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:36.274 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bc2800640 1 --2- 172.21.15.103:0/2560277474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bc40cfb40 0x7f3bc40ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:36.274 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bc2800640 1 -- 172.21.15.103:0/2560277474 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc415b190 con 0x7f3bc415f110 2024-09-10T22:38:36.274 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bc1400640 1 --2- 172.21.15.103:0/2560277474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bc40cfb40 0x7f3bc40ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:38:36.274 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bc2800640 1 --2- 172.21.15.103:0/2560277474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bc415f110 0x7f3bc415ba30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc00efd0 tx=0x7f3bbc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:36.274 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bba000640 1 -- 172.21.15.103:0/2560277474 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc003b80 con 0x7f3bc415f110 2024-09-10T22:38:36.274 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bba000640 1 -- 172.21.15.103:0/2560277474 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bbc003d20 con 0x7f3bc415f110 2024-09-10T22:38:36.275 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.268+0000 7f3bba000640 1 -- 172.21.15.103:0/2560277474 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc004280 con 0x7f3bc415f110 2024-09-10T22:38:36.275 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.272+0000 7f3bc8c00640 1 -- 172.21.15.103:0/2560277474 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc415b470 con 0x7f3bc415f110 2024-09-10T22:38:36.275 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.272+0000 7f3bc8c00640 1 -- 172.21.15.103:0/2560277474 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc4156900 con 0x7f3bc415f110 2024-09-10T22:38:36.279 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.276+0000 7f3bc8c00640 1 -- 172.21.15.103:0/2560277474 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b9c0052a0 con 0x7f3bc415f110 2024-09-10T22:38:36.280 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.276+0000 7f3bba000640 1 -- 172.21.15.103:0/2560277474 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) ==== 96338+0+0 (secure 0 0 0) 0x7f3bbc004420 con 0x7f3bc415f110 2024-09-10T22:38:36.281 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.276+0000 7f3bba000640 1 --2- 172.21.15.103:0/2560277474 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3ba4072550 0x7f3ba4074a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:36.281 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.276+0000 7f3bba000640 1 -- 172.21.15.103:0/2560277474 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7f3bbc092f80 con 0x7f3bc415f110 2024-09-10T22:38:36.282 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.276+0000 7f3bc1e00640 1 --2- 172.21.15.103:0/2560277474 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3ba4072550 0x7f3ba4074a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:36.282 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.276+0000 7f3bc1e00640 1 --2- 172.21.15.103:0/2560277474 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3ba4072550 0x7f3ba4074a10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40af000 tx=0x7f3bb401b090 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:36.300 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.296+0000 7f3bba000640 1 -- 172.21.15.103:0/2560277474 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3bbc05ee00 con 0x7f3bc415f110 2024-09-10T22:38:36.519 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.512+0000 7f3bc8c00640 1 -- 172.21.15.103:0/2560277474 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b9c005590 con 0x7f3bc415f110 2024-09-10T22:38:36.520 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.516+0000 7f3bba000640 1 -- 172.21.15.103:0/2560277474 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7567 (secure 0 0 0) 0x7f3bbc063830 con 0x7f3bc415f110 2024-09-10T22:38:36.520 INFO:teuthology.misc.health.smithi103.stdout: 2024-09-10T22:38:36.520 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":13,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:38:35.849757+0000","last_up_change":"2024-09-10T22:38:35.849757+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:38:36.522 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.516+0000 7f3bc8c00640 1 -- 172.21.15.103:0/2560277474 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3ba4072550 msgr2=0x7f3ba4074a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:36.522 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.516+0000 7f3bc8c00640 1 --2- 172.21.15.103:0/2560277474 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3ba4072550 0x7f3ba4074a10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40af000 tx=0x7f3bb401b090 comp rx=0 tx=0).stop 2024-09-10T22:38:36.523 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.516+0000 7f3bc8c00640 1 -- 172.21.15.103:0/2560277474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bc415f110 msgr2=0x7f3bc415ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:36.523 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.516+0000 7f3bc8c00640 1 --2- 172.21.15.103:0/2560277474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bc415f110 0x7f3bc415ba30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc00efd0 tx=0x7f3bbc00c6a0 comp rx=0 tx=0).stop 2024-09-10T22:38:36.523 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.516+0000 7f3bc8c00640 1 -- 172.21.15.103:0/2560277474 shutdown_connections 2024-09-10T22:38:36.523 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.516+0000 7f3bc8c00640 1 --2- 172.21.15.103:0/2560277474 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3ba4072550 0x7f3ba4074a10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:36.523 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.516+0000 7f3bc8c00640 1 --2- 172.21.15.103:0/2560277474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bc415f110 0x7f3bc415ba30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:36.523 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.516+0000 7f3bc8c00640 1 --2- 172.21.15.103:0/2560277474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bc40cfb40 0x7f3bc40ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:36.523 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.516+0000 7f3bc8c00640 1 --2- 172.21.15.103:0/2560277474 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bc40b2720 0x7f3bc41f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:36.523 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.516+0000 7f3bc8c00640 1 -- 172.21.15.103:0/2560277474 >> 172.21.15.103:0/2560277474 conn(0x7f3bc409aa70 msgr2=0x7f3bc406dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:36.523 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.516+0000 7f3bc8c00640 1 -- 172.21.15.103:0/2560277474 shutdown_connections 2024-09-10T22:38:36.523 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:36.516+0000 7f3bc8c00640 1 -- 172.21.15.103:0/2560277474 wait complete. 2024-09-10T22:38:36.547 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-10T22:38:37.573 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-09-10T22:38:37.568+0000 7f1c1f600640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T22:38:37.600 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-09-10T22:38:37.596+0000 7f1c14c00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:38:37.634 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-09-10T22:38:37.628+0000 7fb4d9400640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T22:38:37.656 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-09-10T22:38:37.652+0000 7fb4cf400640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:38:37.703 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-09-10T22:38:37.696+0000 7fcc04600640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T22:38:37.728 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-09-10T22:38:37.724+0000 7fcbfa600640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:38:38.175 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-09-10T22:38:38.169+0000 7f0ce7e00640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T22:38:38.188 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-09-10T22:38:38.185+0000 7f3db8400640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T22:38:38.206 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-09-10T22:38:38.205+0000 7f0cdde00640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:38:38.231 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-09-10T22:38:38.229+0000 7f3dada00640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:38:38.233 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-09-10T22:38:38.233+0000 7f4fbf000640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T22:38:38.244 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-09-10T22:38:38.241+0000 7ffa5aa00640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T22:38:38.274 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-09-10T22:38:38.273+0000 7ffa50000640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:38:38.275 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-09-10T22:38:38.273+0000 7f4fb4600640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:38:43.354 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T22:38:43.487 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.484+0000 7faa25e00640 1 -- 172.21.15.103:0/3178163489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa200cfb40 msgr2=0x7faa200ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:43.487 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.484+0000 7faa25e00640 1 --2- 172.21.15.103:0/3178163489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa200cfb40 0x7faa200ce680 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faa200d2230 tx=0x7faa0c01c830 comp rx=0 tx=0).stop 2024-09-10T22:38:43.487 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.484+0000 7faa25e00640 1 -- 172.21.15.103:0/3178163489 shutdown_connections 2024-09-10T22:38:43.487 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.484+0000 7faa25e00640 1 --2- 172.21.15.103:0/3178163489 >> v2:172.21.15.131:3300/0 conn(0x7faa200b2720 0x7faa200b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:43.487 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.484+0000 7faa25e00640 1 --2- 172.21.15.103:0/3178163489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa200cfb40 0x7faa200ce680 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:43.487 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.484+0000 7faa25e00640 1 --2- 172.21.15.103:0/3178163489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa2015f110 0x7faa200ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:43.487 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.484+0000 7faa25e00640 1 -- 172.21.15.103:0/3178163489 >> 172.21.15.103:0/3178163489 conn(0x7faa2009aa70 msgr2=0x7faa200d1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:43.487 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.484+0000 7faa25e00640 1 -- 172.21.15.103:0/3178163489 shutdown_connections 2024-09-10T22:38:43.487 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.484+0000 7faa25e00640 1 -- 172.21.15.103:0/3178163489 wait complete. 2024-09-10T22:38:43.488 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa25e00640 1 Processor -- start 2024-09-10T22:38:43.488 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa25e00640 1 -- start start 2024-09-10T22:38:43.489 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa25e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa200b2720 0x7faa201432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:43.489 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa25e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa200cfb40 0x7faa200b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:43.489 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa25e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa2015f110 0x7faa20071510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:43.489 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa25e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faa200ccd70 con 0x7faa200cfb40 2024-09-10T22:38:43.490 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa25e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faa200ccbf0 con 0x7faa200b2720 2024-09-10T22:38:43.490 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa25e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7faa200ccef0 con 0x7faa2015f110 2024-09-10T22:38:43.490 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa1e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa200cfb40 0x7faa200b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:43.490 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa1e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa200cfb40 0x7faa200b5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50976/0 (socket says 172.21.15.103:50976) 2024-09-10T22:38:43.490 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa1e000640 1 -- 172.21.15.103:0/3876419913 learned_addr learned my addr 172.21.15.103:0/3876419913 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:43.490 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa1ea00640 1 --2- 172.21.15.103:0/3876419913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa200b2720 0x7faa201432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:43.490 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa1f400640 1 --2- 172.21.15.103:0/3876419913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa2015f110 0x7faa20071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:43.490 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa1e000640 1 -- 172.21.15.103:0/3876419913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa2015f110 msgr2=0x7faa20071510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:43.490 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa1e000640 1 --2- 172.21.15.103:0/3876419913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa2015f110 0x7faa20071510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:43.490 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa1e000640 1 -- 172.21.15.103:0/3876419913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa200b2720 msgr2=0x7faa201432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:43.490 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa1e000640 1 --2- 172.21.15.103:0/3876419913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa200b2720 0x7faa201432b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:43.490 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa1e000640 1 -- 172.21.15.103:0/3876419913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa201437f0 con 0x7faa200cfb40 2024-09-10T22:38:43.491 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa1e000640 1 --2- 172.21.15.103:0/3876419913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa200cfb40 0x7faa200b5fb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0b0040 tx=0x7faa0c005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:43.491 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa17400640 1 -- 172.21.15.103:0/3876419913 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0b2040 con 0x7faa200cfb40 2024-09-10T22:38:43.491 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa17400640 1 -- 172.21.15.103:0/3876419913 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa0c004350 con 0x7faa200cfb40 2024-09-10T22:38:43.491 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa25e00640 1 -- 172.21.15.103:0/3876419913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa201f8ec0 con 0x7faa200cfb40 2024-09-10T22:38:43.491 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa17400640 1 -- 172.21.15.103:0/3876419913 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c005290 con 0x7faa200cfb40 2024-09-10T22:38:43.492 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa25e00640 1 -- 172.21.15.103:0/3876419913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa201f9480 con 0x7faa200cfb40 2024-09-10T22:38:43.492 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.488+0000 7faa25e00640 1 -- 172.21.15.103:0/3876419913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa200d0710 con 0x7faa200cfb40 2024-09-10T22:38:43.493 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.492+0000 7faa17400640 1 -- 172.21.15.103:0/3876419913 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) ==== 96338+0+0 (secure 0 0 0) 0x7faa0c0c0060 con 0x7faa200cfb40 2024-09-10T22:38:43.494 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.492+0000 7faa17400640 1 --2- 172.21.15.103:0/3876419913 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faa00072550 0x7faa00074a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:43.494 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.492+0000 7faa17400640 1 -- 172.21.15.103:0/3876419913 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7faa0c12c8a0 con 0x7faa200cfb40 2024-09-10T22:38:43.495 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.492+0000 7faa1ea00640 1 --2- 172.21.15.103:0/3876419913 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faa00072550 0x7faa00074a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:43.495 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.492+0000 7faa1ea00640 1 --2- 172.21.15.103:0/3876419913 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faa00072550 0x7faa00074a10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faa10009ac0 tx=0x7faa100091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:43.497 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.496+0000 7faa17400640 1 -- 172.21.15.103:0/3876419913 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7faa0c0164b0 con 0x7faa200cfb40 2024-09-10T22:38:43.665 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.664+0000 7faa25e00640 1 -- 172.21.15.103:0/3876419913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa200b1020 con 0x7faa200cfb40 2024-09-10T22:38:43.666 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.664+0000 7faa17400640 1 -- 172.21.15.103:0/3876419913 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12956 (secure 0 0 0) 0x7faa0c0f7d50 con 0x7faa200cfb40 2024-09-10T22:38:43.666 INFO:teuthology.misc.health.smithi103.stdout: 2024-09-10T22:38:43.666 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":19,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:38:42.612434+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:38:43.669 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.668+0000 7faa25e00640 1 -- 172.21.15.103:0/3876419913 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faa00072550 msgr2=0x7faa00074a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:43.669 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.668+0000 7faa25e00640 1 --2- 172.21.15.103:0/3876419913 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faa00072550 0x7faa00074a10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faa10009ac0 tx=0x7faa100091e0 comp rx=0 tx=0).stop 2024-09-10T22:38:43.669 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.668+0000 7faa25e00640 1 -- 172.21.15.103:0/3876419913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa200cfb40 msgr2=0x7faa200b5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:43.669 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.668+0000 7faa25e00640 1 --2- 172.21.15.103:0/3876419913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa200cfb40 0x7faa200b5fb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0b0040 tx=0x7faa0c005e00 comp rx=0 tx=0).stop 2024-09-10T22:38:43.669 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.668+0000 7faa25e00640 1 -- 172.21.15.103:0/3876419913 shutdown_connections 2024-09-10T22:38:43.669 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.668+0000 7faa25e00640 1 --2- 172.21.15.103:0/3876419913 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faa00072550 0x7faa00074a10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:43.669 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.668+0000 7faa25e00640 1 --2- 172.21.15.103:0/3876419913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa2015f110 0x7faa20071510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:43.669 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.668+0000 7faa25e00640 1 --2- 172.21.15.103:0/3876419913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa200cfb40 0x7faa200b5fb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:43.669 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.668+0000 7faa25e00640 1 --2- 172.21.15.103:0/3876419913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa200b2720 0x7faa201432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:43.669 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.668+0000 7faa25e00640 1 -- 172.21.15.103:0/3876419913 >> 172.21.15.103:0/3876419913 conn(0x7faa2009aa70 msgr2=0x7faa200cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:43.670 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.668+0000 7faa25e00640 1 -- 172.21.15.103:0/3876419913 shutdown_connections 2024-09-10T22:38:43.670 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T22:38:43.668+0000 7faa25e00640 1 -- 172.21.15.103:0/3876419913 wait complete. 2024-09-10T22:38:43.686 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-10T22:38:43.686 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T22:38:43.687 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T22:38:43.687 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T22:38:43.690 INFO:tasks.ceph.mds.a:Started 2024-09-10T22:38:43.690 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T22:38:43.690 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T22:38:43.693 INFO:tasks.ceph.mds.c:Started 2024-09-10T22:38:43.693 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T22:38:43.693 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T22:38:43.696 INFO:tasks.ceph.mds.b:Started 2024-09-10T22:38:43.696 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T22:38:43.696 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T22:38:43.700 INFO:tasks.ceph.mds.d:Started 2024-09-10T22:38:43.700 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-10T22:38:43.700 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:38:43.788 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-09-10T22:38:43.789 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-09-10T22:38:43.803 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2024-09-10T22:38:43.803 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2024-09-10T22:38:43.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.852+0000 7fe161600640 1 -- 172.21.15.103:0/2002258583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe15c0ae9c0 msgr2=0x7fe15c0aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:43.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.852+0000 7fe161600640 1 --2- 172.21.15.103:0/2002258583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe15c0ae9c0 0x7fe15c0aee50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe154009c80 tx=0x7fe15401cd10 comp rx=0 tx=0).stop 2024-09-10T22:38:43.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.852+0000 7fe161600640 1 -- 172.21.15.103:0/2002258583 shutdown_connections 2024-09-10T22:38:43.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.852+0000 7fe161600640 1 --2- 172.21.15.103:0/2002258583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe15c0ae9c0 0x7fe15c0aee50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:43.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.852+0000 7fe161600640 1 --2- 172.21.15.103:0/2002258583 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe15c0b09c0 0x7fe15c0ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:43.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.852+0000 7fe161600640 1 -- 172.21.15.103:0/2002258583 >> 172.21.15.103:0/2002258583 conn(0x7fe15c0d1ac0 msgr2=0x7fe15c0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:43.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.852+0000 7fe161600640 1 -- 172.21.15.103:0/2002258583 shutdown_connections 2024-09-10T22:38:43.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.852+0000 7fe161600640 1 -- 172.21.15.103:0/2002258583 wait complete. 2024-09-10T22:38:43.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.852+0000 7fe161600640 1 Processor -- start 2024-09-10T22:38:43.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.852+0000 7fe161600640 1 -- start start 2024-09-10T22:38:43.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe161600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe15c0ae9c0 0x7fe15c156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:43.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe161600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe15c0b09c0 0x7fe15c0c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:43.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe161600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe15c15be30 0x7fe15c157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:43.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe161600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c168df0 con 0x7fe15c0b09c0 2024-09-10T22:38:43.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe161600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c168c70 con 0x7fe15c0ae9c0 2024-09-10T22:38:43.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe161600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe15c168f70 con 0x7fe15c15be30 2024-09-10T22:38:43.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe152000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe15c0b09c0 0x7fe15c0c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:43.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe152000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe15c0b09c0 0x7fe15c0c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51002/0 (socket says 172.21.15.103:51002) 2024-09-10T22:38:43.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe152000640 1 -- 172.21.15.103:0/460152139 learned_addr learned my addr 172.21.15.103:0/460152139 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:43.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe15aa00640 1 --2- 172.21.15.103:0/460152139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe15c0ae9c0 0x7fe15c156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:43.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe15b400640 1 --2- 172.21.15.103:0/460152139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe15c15be30 0x7fe15c157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:43.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe152000640 1 -- 172.21.15.103:0/460152139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe15c15be30 msgr2=0x7fe15c157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:43.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe152000640 1 --2- 172.21.15.103:0/460152139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe15c15be30 0x7fe15c157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:43.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe152000640 1 -- 172.21.15.103:0/460152139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe15c0ae9c0 msgr2=0x7fe15c156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:43.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe152000640 1 --2- 172.21.15.103:0/460152139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe15c0ae9c0 0x7fe15c156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:43.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe152000640 1 -- 172.21.15.103:0/460152139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15c0c8c30 con 0x7fe15c0b09c0 2024-09-10T22:38:43.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe152000640 1 --2- 172.21.15.103:0/460152139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe15c0b09c0 0x7fe15c0c81b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe14400e940 tx=0x7fe14400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:43.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe153400640 1 -- 172.21.15.103:0/460152139 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14400cd80 con 0x7fe15c0b09c0 2024-09-10T22:38:43.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe153400640 1 -- 172.21.15.103:0/460152139 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe144005020 con 0x7fe15c0b09c0 2024-09-10T22:38:43.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe153400640 1 -- 172.21.15.103:0/460152139 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144005450 con 0x7fe15c0b09c0 2024-09-10T22:38:43.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe161600640 1 -- 172.21.15.103:0/460152139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe15c0c8ed0 con 0x7fe15c0b09c0 2024-09-10T22:38:43.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe161600640 1 -- 172.21.15.103:0/460152139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe15c0c9490 con 0x7fe15c0b09c0 2024-09-10T22:38:43.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.856+0000 7fe161600640 1 -- 172.21.15.103:0/460152139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe15c0aee50 con 0x7fe15c0b09c0 2024-09-10T22:38:43.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.860+0000 7fe153400640 1 -- 172.21.15.103:0/460152139 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) ==== 96338+0+0 (secure 0 0 0) 0x7fe1440047b0 con 0x7fe15c0b09c0 2024-09-10T22:38:43.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.860+0000 7fe153400640 1 --2- 172.21.15.103:0/460152139 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe138072550 0x7fe138074a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:43.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.860+0000 7fe153400640 1 -- 172.21.15.103:0/460152139 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fe144093840 con 0x7fe15c0b09c0 2024-09-10T22:38:43.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.860+0000 7fe15aa00640 1 --2- 172.21.15.103:0/460152139 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe138072550 0x7fe138074a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:43.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.860+0000 7fe15aa00640 1 --2- 172.21.15.103:0/460152139 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe138072550 0x7fe138074a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe14c007fd0 tx=0x7fe14c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:43.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.864+0000 7fe153400640 1 -- 172.21.15.103:0/460152139 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe14405ec60 con 0x7fe15c0b09c0 2024-09-10T22:38:43.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:43.992+0000 7fe153400640 1 -- 172.21.15.103:0/460152139 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe14405aed0 con 0x7fe15c0b09c0 2024-09-10T22:38:44.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:44.068+0000 7fe161600640 1 -- 172.21.15.103:0/460152139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe15c072340 con 0x7fe15c0b09c0 2024-09-10T22:38:44.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:44.068+0000 7fe153400640 1 -- 172.21.15.103:0/460152139 <== mon.0 v2:172.21.15.103:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7fe14408a020 con 0x7fe15c0b09c0 2024-09-10T22:38:44.069 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:38:44.069 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":2,"btime":"2024-09-10T22:38:43:795413+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/467299119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":467299119},{"type":"v1","addr":"172.21.15.103:6834","nonce":467299119}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T22:38:44.070 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 2 2024-09-10T22:38:44.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:44.068+0000 7fe161600640 1 -- 172.21.15.103:0/460152139 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe138072550 msgr2=0x7fe138074a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:44.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:44.068+0000 7fe161600640 1 --2- 172.21.15.103:0/460152139 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe138072550 0x7fe138074a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe14c007fd0 tx=0x7fe14c009040 comp rx=0 tx=0).stop 2024-09-10T22:38:44.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:44.068+0000 7fe161600640 1 -- 172.21.15.103:0/460152139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe15c0b09c0 msgr2=0x7fe15c0c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:44.068+0000 7fe161600640 1 --2- 172.21.15.103:0/460152139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe15c0b09c0 0x7fe15c0c81b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe14400e940 tx=0x7fe14400ee00 comp rx=0 tx=0).stop 2024-09-10T22:38:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:44.068+0000 7fe161600640 1 -- 172.21.15.103:0/460152139 shutdown_connections 2024-09-10T22:38:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:44.068+0000 7fe161600640 1 --2- 172.21.15.103:0/460152139 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe138072550 0x7fe138074a10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:44.068+0000 7fe161600640 1 --2- 172.21.15.103:0/460152139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe15c15be30 0x7fe15c157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:44.068+0000 7fe161600640 1 --2- 172.21.15.103:0/460152139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe15c0b09c0 0x7fe15c0c81b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:44.068+0000 7fe161600640 1 --2- 172.21.15.103:0/460152139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe15c0ae9c0 0x7fe15c156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:44.068+0000 7fe161600640 1 -- 172.21.15.103:0/460152139 >> 172.21.15.103:0/460152139 conn(0x7fe15c0d1ac0 msgr2=0x7fe15c06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:44.068+0000 7fe161600640 1 -- 172.21.15.103:0/460152139 shutdown_connections 2024-09-10T22:38:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:44.068+0000 7fe161600640 1 -- 172.21.15.103:0/460152139 wait complete. 2024-09-10T22:38:46.092 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:38:46.122 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:38:46.147 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:38:46.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.244+0000 7fdf07c00640 1 -- 172.21.15.103:0/4137672275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf0015be30 msgr2=0x7fdf000ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:46.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.244+0000 7fdf07c00640 1 --2- 172.21.15.103:0/4137672275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf0015be30 0x7fdf000ce0c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdf000cbf40 tx=0x7fdef001c830 comp rx=0 tx=0).stop 2024-09-10T22:38:46.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.244+0000 7fdf07c00640 1 -- 172.21.15.103:0/4137672275 shutdown_connections 2024-09-10T22:38:46.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.244+0000 7fdf07c00640 1 --2- 172.21.15.103:0/4137672275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf000ceb40 0x7fdf000cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.244+0000 7fdf07c00640 1 --2- 172.21.15.103:0/4137672275 >> v2:172.21.15.131:3300/0 conn(0x7fdf000b09c0 0x7fdf000ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.244+0000 7fdf07c00640 1 --2- 172.21.15.103:0/4137672275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf0015be30 0x7fdf000ce0c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.244+0000 7fdf07c00640 1 -- 172.21.15.103:0/4137672275 >> 172.21.15.103:0/4137672275 conn(0x7fdf000d1ac0 msgr2=0x7fdf000d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:46.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.244+0000 7fdf07c00640 1 -- 172.21.15.103:0/4137672275 shutdown_connections 2024-09-10T22:38:46.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.244+0000 7fdf07c00640 1 -- 172.21.15.103:0/4137672275 wait complete. 2024-09-10T22:38:46.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdf07c00640 1 Processor -- start 2024-09-10T22:38:46.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdf07c00640 1 -- start start 2024-09-10T22:38:46.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdf07c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf000b09c0 0x7fdf0014dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:46.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdf07c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf000ceb40 0x7fdf000b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:46.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdf07c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf0015be30 0x7fdf0015a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:46.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdf07c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdf000aed50 con 0x7fdf000ceb40 2024-09-10T22:38:46.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdf07c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdf000aebd0 con 0x7fdf0015be30 2024-09-10T22:38:46.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdf07c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdf000aeed0 con 0x7fdf000b09c0 2024-09-10T22:38:46.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdef7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf000ceb40 0x7fdf000b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:46.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdef7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf000ceb40 0x7fdf000b6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51026/0 (socket says 172.21.15.103:51026) 2024-09-10T22:38:46.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdef7e00640 1 -- 172.21.15.103:0/953458160 learned_addr learned my addr 172.21.15.103:0/953458160 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:46.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdf05c00640 1 --2- 172.21.15.103:0/953458160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf0015be30 0x7fdf0015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:46.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdf05200640 1 --2- 172.21.15.103:0/953458160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf000b09c0 0x7fdf0014dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:46.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdef7e00640 1 -- 172.21.15.103:0/953458160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf000b09c0 msgr2=0x7fdf0014dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:46.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdef7e00640 1 --2- 172.21.15.103:0/953458160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf000b09c0 0x7fdf0014dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdef7e00640 1 -- 172.21.15.103:0/953458160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf0015be30 msgr2=0x7fdf0015a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:46.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdef7e00640 1 --2- 172.21.15.103:0/953458160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf0015be30 0x7fdf0015a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdef7e00640 1 -- 172.21.15.103:0/953458160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf000b69f0 con 0x7fdf000ceb40 2024-09-10T22:38:46.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdef7e00640 1 --2- 172.21.15.103:0/953458160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf000ceb40 0x7fdf000b6010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdee800c9a0 tx=0x7fdee800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:46.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdefd600640 1 -- 172.21.15.103:0/953458160 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee8007c10 con 0x7fdf000ceb40 2024-09-10T22:38:46.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdefd600640 1 -- 172.21.15.103:0/953458160 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdee8005020 con 0x7fdf000ceb40 2024-09-10T22:38:46.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdf07c00640 1 -- 172.21.15.103:0/953458160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf001f85b0 con 0x7fdf000ceb40 2024-09-10T22:38:46.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdefd600640 1 -- 172.21.15.103:0/953458160 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee8005450 con 0x7fdf000ceb40 2024-09-10T22:38:46.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.248+0000 7fdf07c00640 1 -- 172.21.15.103:0/953458160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf001f8b70 con 0x7fdf000ceb40 2024-09-10T22:38:46.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.252+0000 7fdf07c00640 1 -- 172.21.15.103:0/953458160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf000cf9c0 con 0x7fdf000ceb40 2024-09-10T22:38:46.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.252+0000 7fdefd600640 1 -- 172.21.15.103:0/953458160 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdee80047b0 con 0x7fdf000ceb40 2024-09-10T22:38:46.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.252+0000 7fdefd600640 1 --2- 172.21.15.103:0/953458160 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdedc0725e0 0x7fdedc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:46.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.252+0000 7fdefd600640 1 -- 172.21.15.103:0/953458160 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fdee80934b0 con 0x7fdf000ceb40 2024-09-10T22:38:46.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.252+0000 7fdf05200640 1 --2- 172.21.15.103:0/953458160 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdedc0725e0 0x7fdedc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:46.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.252+0000 7fdf05200640 1 --2- 172.21.15.103:0/953458160 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdedc0725e0 0x7fdedc074aa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdef00af000 tx=0x7fdef001b070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:46.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.256+0000 7fdefd600640 1 -- 172.21.15.103:0/953458160 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdee8014030 con 0x7fdf000ceb40 2024-09-10T22:38:46.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.456+0000 7fdf07c00640 1 -- 172.21.15.103:0/953458160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf000d2370 con 0x7fdf000ceb40 2024-09-10T22:38:46.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.456+0000 7fdefd600640 1 -- 172.21.15.103:0/953458160 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3912 (secure 0 0 0) 0x7fdee805e7f0 con 0x7fdf000ceb40 2024-09-10T22:38:46.459 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:38:46.459 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":3,"btime":"2024-09-10T22:38:44:798679+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/467299119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":467299119},{"type":"v1","addr":"172.21.15.103:6834","nonce":467299119}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3161095873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3161095873},{"type":"v1","addr":"172.21.15.131:6837","nonce":3161095873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/774650981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":774650981},{"type":"v1","addr":"172.21.15.103:6835","nonce":774650981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4390,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/2821479330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2821479330},{"type":"v1","addr":"172.21.15.131:6836","nonce":2821479330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T22:38:46.460 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 3 2024-09-10T22:38:46.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.460+0000 7fdf07c00640 1 -- 172.21.15.103:0/953458160 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdedc0725e0 msgr2=0x7fdedc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:46.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.460+0000 7fdf07c00640 1 --2- 172.21.15.103:0/953458160 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdedc0725e0 0x7fdedc074aa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdef00af000 tx=0x7fdef001b070 comp rx=0 tx=0).stop 2024-09-10T22:38:46.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.460+0000 7fdf07c00640 1 -- 172.21.15.103:0/953458160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf000ceb40 msgr2=0x7fdf000b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:46.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.460+0000 7fdf07c00640 1 --2- 172.21.15.103:0/953458160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf000ceb40 0x7fdf000b6010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdee800c9a0 tx=0x7fdee800ce60 comp rx=0 tx=0).stop 2024-09-10T22:38:46.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.460+0000 7fdf07c00640 1 -- 172.21.15.103:0/953458160 shutdown_connections 2024-09-10T22:38:46.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.460+0000 7fdf07c00640 1 --2- 172.21.15.103:0/953458160 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdedc0725e0 0x7fdedc074aa0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.460+0000 7fdf07c00640 1 --2- 172.21.15.103:0/953458160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf0015be30 0x7fdf0015a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.460+0000 7fdf07c00640 1 --2- 172.21.15.103:0/953458160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf000ceb40 0x7fdf000b6010 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.460+0000 7fdf07c00640 1 --2- 172.21.15.103:0/953458160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf000b09c0 0x7fdf0014dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.460+0000 7fdf07c00640 1 -- 172.21.15.103:0/953458160 >> 172.21.15.103:0/953458160 conn(0x7fdf000d1ac0 msgr2=0x7fdf00156300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:46.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.460+0000 7fdf07c00640 1 -- 172.21.15.103:0/953458160 shutdown_connections 2024-09-10T22:38:46.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.460+0000 7fdf07c00640 1 -- 172.21.15.103:0/953458160 wait complete. 2024-09-10T22:38:46.480 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T22:38:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.620+0000 7f112cc00640 1 -- 172.21.15.103:0/1828127010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f110c003a80 msgr2=0x7f110c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.620+0000 7f112cc00640 1 --2- 172.21.15.103:0/1828127010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f110c003a80 0x7f110c003ea0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1118009b30 tx=0x7f111801d230 comp rx=0 tx=0).stop 2024-09-10T22:38:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.620+0000 7f1127e00640 1 -- 172.21.15.103:0/1828127010 reap_dead start 2024-09-10T22:38:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.620+0000 7f112cc00640 1 -- 172.21.15.103:0/1828127010 shutdown_connections 2024-09-10T22:38:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.620+0000 7f112cc00640 1 -- 172.21.15.103:0/1828127010 >> 172.21.15.103:0/1828127010 conn(0x7f11280cff60 msgr2=0x7f11280d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.620+0000 7f112cc00640 1 -- 172.21.15.103:0/1828127010 shutdown_connections 2024-09-10T22:38:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.620+0000 7f112cc00640 1 -- 172.21.15.103:0/1828127010 wait complete. 2024-09-10T22:38:46.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f112cc00640 1 Processor -- start 2024-09-10T22:38:46.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f112cc00640 1 -- start start 2024-09-10T22:38:46.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f112cc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f110c003a80 0x7f11281f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:46.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f112cc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11280b5460 0x7f1128159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f112cc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1128164760 0x7f11280b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f112cc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f112806d910 con 0x7f11280b5460 2024-09-10T22:38:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f112cc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f112806d790 con 0x7f110c003a80 2024-09-10T22:38:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f112cc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f112815c560 con 0x7f1128164760 2024-09-10T22:38:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f1126a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11280b5460 0x7f1128159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f1126a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11280b5460 0x7f1128159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51034/0 (socket says 172.21.15.103:51034) 2024-09-10T22:38:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f1126a00640 1 -- 172.21.15.103:0/3969493625 learned_addr learned my addr 172.21.15.103:0/3969493625 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f1127400640 1 --2- 172.21.15.103:0/3969493625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f110c003a80 0x7f11281f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f1127e00640 1 --2- 172.21.15.103:0/3969493625 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1128164760 0x7f11280b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f1126a00640 1 -- 172.21.15.103:0/3969493625 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1128164760 msgr2=0x7f11280b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f1126a00640 1 --2- 172.21.15.103:0/3969493625 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1128164760 0x7f11280b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f1126a00640 1 -- 172.21.15.103:0/3969493625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f110c003a80 msgr2=0x7f11281f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:46.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f1126a00640 1 --2- 172.21.15.103:0/3969493625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f110c003a80 0x7f11281f7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f1126a00640 1 -- 172.21.15.103:0/3969493625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11280b46a0 con 0x7f11280b5460 2024-09-10T22:38:46.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f1126a00640 1 --2- 172.21.15.103:0/3969493625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11280b5460 0x7f1128159fd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1114011b10 tx=0x7f1114011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:46.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f111f400640 1 -- 172.21.15.103:0/3969493625 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111401e070 con 0x7f11280b5460 2024-09-10T22:38:46.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f111f400640 1 -- 172.21.15.103:0/3969493625 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1114004460 con 0x7f11280b5460 2024-09-10T22:38:46.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f111f400640 1 -- 172.21.15.103:0/3969493625 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111400fbc0 con 0x7f11280b5460 2024-09-10T22:38:46.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f112cc00640 1 -- 172.21.15.103:0/3969493625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11280b4980 con 0x7f11280b5460 2024-09-10T22:38:46.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f112cc00640 1 -- 172.21.15.103:0/3969493625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1128164d20 con 0x7f11280b5460 2024-09-10T22:38:46.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.624+0000 7f112cc00640 1 -- 172.21.15.103:0/3969493625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11280ce690 con 0x7f11280b5460 2024-09-10T22:38:46.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.628+0000 7f111f400640 1 -- 172.21.15.103:0/3969493625 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1114003600 con 0x7f11280b5460 2024-09-10T22:38:46.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.628+0000 7f111f400640 1 --2- 172.21.15.103:0/3969493625 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1108072610 0x7f1108074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:46.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.628+0000 7f111f400640 1 -- 172.21.15.103:0/3969493625 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f1114093aa0 con 0x7f11280b5460 2024-09-10T22:38:46.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.628+0000 7f1127400640 1 --2- 172.21.15.103:0/3969493625 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1108072610 0x7f1108074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:46.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.628+0000 7f1127400640 1 --2- 172.21.15.103:0/3969493625 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1108072610 0x7f1108074ad0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f11180ae000 tx=0x7f1118019fd0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:46.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.632+0000 7f111f400640 1 -- 172.21.15.103:0/3969493625 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f111405eea0 con 0x7f11280b5460 2024-09-10T22:38:46.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.800+0000 7f112cc00640 1 -- 172.21.15.103:0/3969493625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f112815abf0 con 0x7f11280b5460 2024-09-10T22:38:46.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.800+0000 7f111f400640 1 -- 172.21.15.103:0/3969493625 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f11140638d0 con 0x7f11280b5460 2024-09-10T22:38:46.803 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:38:46.803 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-09-10T22:38:46.803 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:38:46.803 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2024-09-10T22:38:46.803 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": ".mgr" 2024-09-10T22:38:46.803 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:38:46.803 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-09-10T22:38:46.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.804+0000 7f112cc00640 1 -- 172.21.15.103:0/3969493625 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1108072610 msgr2=0x7f1108074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:46.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.804+0000 7f112cc00640 1 --2- 172.21.15.103:0/3969493625 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1108072610 0x7f1108074ad0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f11180ae000 tx=0x7f1118019fd0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.804+0000 7f112cc00640 1 -- 172.21.15.103:0/3969493625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11280b5460 msgr2=0x7f1128159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:46.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.804+0000 7f112cc00640 1 --2- 172.21.15.103:0/3969493625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11280b5460 0x7f1128159fd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1114011b10 tx=0x7f1114011f10 comp rx=0 tx=0).stop 2024-09-10T22:38:46.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.804+0000 7f112cc00640 1 -- 172.21.15.103:0/3969493625 shutdown_connections 2024-09-10T22:38:46.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.804+0000 7f112cc00640 1 --2- 172.21.15.103:0/3969493625 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1108072610 0x7f1108074ad0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.804+0000 7f112cc00640 1 --2- 172.21.15.103:0/3969493625 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1128164760 0x7f11280b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.804+0000 7f112cc00640 1 --2- 172.21.15.103:0/3969493625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11280b5460 0x7f1128159fd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.804+0000 7f112cc00640 1 --2- 172.21.15.103:0/3969493625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f110c003a80 0x7f11281f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.804+0000 7f112cc00640 1 -- 172.21.15.103:0/3969493625 >> 172.21.15.103:0/3969493625 conn(0x7f11280cff60 msgr2=0x7f1128068990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:46.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.804+0000 7f112cc00640 1 -- 172.21.15.103:0/3969493625 shutdown_connections 2024-09-10T22:38:46.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.804+0000 7f112cc00640 1 -- 172.21.15.103:0/3969493625 wait complete. 2024-09-10T22:38:46.824 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T22:38:46.825 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T22:38:46.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.968+0000 7fdaa6800640 1 -- 172.21.15.103:0/1082853240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaa0070b40 msgr2=0x7fdaa00cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:46.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.968+0000 7fdaa6800640 1 --2- 172.21.15.103:0/1082853240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaa0070b40 0x7fdaa00cdc40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fda98009bc0 tx=0x7fda9801cb10 comp rx=0 tx=0).stop 2024-09-10T22:38:46.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.968+0000 7fdaa6800640 1 -- 172.21.15.103:0/1082853240 shutdown_connections 2024-09-10T22:38:46.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.968+0000 7fdaa6800640 1 --2- 172.21.15.103:0/1082853240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaa0070b40 0x7fdaa00cdc40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.968+0000 7fdaa6800640 1 --2- 172.21.15.103:0/1082853240 >> v2:172.21.15.131:3300/0 conn(0x7fdaa015f0e0 0x7fdaa00d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.968+0000 7fdaa6800640 1 -- 172.21.15.103:0/1082853240 >> 172.21.15.103:0/1082853240 conn(0x7fdaa00d18d0 msgr2=0x7fdaa00d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:46.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.968+0000 7fdaa6800640 1 -- 172.21.15.103:0/1082853240 shutdown_connections 2024-09-10T22:38:46.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.968+0000 7fdaa6800640 1 -- 172.21.15.103:0/1082853240 wait complete. 2024-09-10T22:38:46.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa6800640 1 Processor -- start 2024-09-10T22:38:46.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa6800640 1 -- start start 2024-09-10T22:38:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa6800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa0070b40 0x7fdaa015a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa6800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa00d23f0 0x7fdaa00c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa6800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaa015f0e0 0x7fdaa00b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa6800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa0168a20 con 0x7fdaa0070b40 2024-09-10T22:38:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa6800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa01688a0 con 0x7fdaa00d23f0 2024-09-10T22:38:46.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa6800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa0168ba0 con 0x7fdaa015f0e0 2024-09-10T22:38:46.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa0070b40 0x7fdaa015a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:46.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa0070b40 0x7fdaa015a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48792/0 (socket says 172.21.15.103:48792) 2024-09-10T22:38:46.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa5400640 1 -- 172.21.15.103:0/2219037120 learned_addr learned my addr 172.21.15.103:0/2219037120 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:46.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa4a00640 1 --2- 172.21.15.103:0/2219037120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa00d23f0 0x7fdaa00c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:46.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa5e00640 1 --2- 172.21.15.103:0/2219037120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaa015f0e0 0x7fdaa00b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:46.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa5400640 1 -- 172.21.15.103:0/2219037120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaa015f0e0 msgr2=0x7fdaa00b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:46.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa5400640 1 --2- 172.21.15.103:0/2219037120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaa015f0e0 0x7fdaa00b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa5400640 1 -- 172.21.15.103:0/2219037120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa00d23f0 msgr2=0x7fdaa00c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:46.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa5400640 1 --2- 172.21.15.103:0/2219037120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa00d23f0 0x7fdaa00c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:46.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa5400640 1 -- 172.21.15.103:0/2219037120 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa015ab90 con 0x7fdaa0070b40 2024-09-10T22:38:46.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa5400640 1 --2- 172.21.15.103:0/2219037120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa0070b40 0x7fdaa015a650 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fda9400e9a0 tx=0x7fda9400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:46.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fda9d600640 1 -- 172.21.15.103:0/2219037120 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9400cd80 con 0x7fdaa0070b40 2024-09-10T22:38:46.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fda9d600640 1 -- 172.21.15.103:0/2219037120 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda94004020 con 0x7fdaa0070b40 2024-09-10T22:38:46.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fda9d600640 1 -- 172.21.15.103:0/2219037120 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94004450 con 0x7fdaa0070b40 2024-09-10T22:38:46.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa6800640 1 -- 172.21.15.103:0/2219037120 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa00b65c0 con 0x7fdaa0070b40 2024-09-10T22:38:46.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa6800640 1 -- 172.21.15.103:0/2219037120 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa00b6b80 con 0x7fdaa0070b40 2024-09-10T22:38:46.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.972+0000 7fdaa6800640 1 -- 172.21.15.103:0/2219037120 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaa00cdc40 con 0x7fdaa0070b40 2024-09-10T22:38:46.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.976+0000 7fda9d600640 1 -- 172.21.15.103:0/2219037120 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fda94003600 con 0x7fdaa0070b40 2024-09-10T22:38:46.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.976+0000 7fda9d600640 1 --2- 172.21.15.103:0/2219037120 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda80072610 0x7fda80074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:46.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.976+0000 7fda9d600640 1 -- 172.21.15.103:0/2219037120 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fda94093750 con 0x7fdaa0070b40 2024-09-10T22:38:46.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.976+0000 7fdaa4a00640 1 --2- 172.21.15.103:0/2219037120 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda80072610 0x7fda80074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:46.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.976+0000 7fdaa4a00640 1 --2- 172.21.15.103:0/2219037120 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda80072610 0x7fda80074ad0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fda8c001910 tx=0x7fda8c001420 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:46.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:46.980+0000 7fda9d600640 1 -- 172.21.15.103:0/2219037120 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fda9405eb20 con 0x7fdaa0070b40 2024-09-10T22:38:47.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.144+0000 7fdaa6800640 1 -- 172.21.15.103:0/2219037120 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fdaa00cc700 con 0x7fdaa0070b40 2024-09-10T22:38:47.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.812+0000 7fda9d600640 1 -- 172.21.15.103:0/2219037120 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7fda94063550 con 0x7fdaa0070b40 2024-09-10T22:38:47.816 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2024-09-10T22:38:47.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.816+0000 7fdaa6800640 1 -- 172.21.15.103:0/2219037120 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda80072610 msgr2=0x7fda80074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.816+0000 7fdaa6800640 1 --2- 172.21.15.103:0/2219037120 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda80072610 0x7fda80074ad0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fda8c001910 tx=0x7fda8c001420 comp rx=0 tx=0).stop 2024-09-10T22:38:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.816+0000 7fdaa6800640 1 -- 172.21.15.103:0/2219037120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa0070b40 msgr2=0x7fdaa015a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.816+0000 7fdaa6800640 1 --2- 172.21.15.103:0/2219037120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa0070b40 0x7fdaa015a650 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fda9400e9a0 tx=0x7fda9400ee60 comp rx=0 tx=0).stop 2024-09-10T22:38:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.816+0000 7fdaa6800640 1 -- 172.21.15.103:0/2219037120 shutdown_connections 2024-09-10T22:38:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.816+0000 7fdaa6800640 1 --2- 172.21.15.103:0/2219037120 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda80072610 0x7fda80074ad0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.816+0000 7fdaa6800640 1 --2- 172.21.15.103:0/2219037120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaa015f0e0 0x7fdaa00b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.816+0000 7fdaa6800640 1 --2- 172.21.15.103:0/2219037120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa00d23f0 0x7fdaa00c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.816+0000 7fdaa6800640 1 --2- 172.21.15.103:0/2219037120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa0070b40 0x7fdaa015a650 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.816+0000 7fdaa6800640 1 -- 172.21.15.103:0/2219037120 >> 172.21.15.103:0/2219037120 conn(0x7fdaa00d18d0 msgr2=0x7fdaa00d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.816+0000 7fdaa6800640 1 -- 172.21.15.103:0/2219037120 shutdown_connections 2024-09-10T22:38:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.816+0000 7fdaa6800640 1 -- 172.21.15.103:0/2219037120 wait complete. 2024-09-10T22:38:47.845 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-10T22:38:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.992+0000 7f42f3200640 1 -- 172.21.15.103:0/1011620509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42f415ea90 msgr2=0x7f42f41599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.992+0000 7f42f3200640 1 --2- 172.21.15.103:0/1011620509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42f415ea90 0x7f42f41599a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f42f406e330 tx=0x7f42ec01cd50 comp rx=0 tx=0).stop 2024-09-10T22:38:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.992+0000 7f42f3200640 1 -- 172.21.15.103:0/1011620509 shutdown_connections 2024-09-10T22:38:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.992+0000 7f42f3200640 1 --2- 172.21.15.103:0/1011620509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42f415ea90 0x7f42f41599a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.992+0000 7f42f3200640 1 --2- 172.21.15.103:0/1011620509 >> v2:172.21.15.131:3300/0 conn(0x7f42f406feb0 0x7f42f40b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.992+0000 7f42f3200640 1 -- 172.21.15.103:0/1011620509 >> 172.21.15.103:0/1011620509 conn(0x7f42f40b12f0 msgr2=0x7f42f40b1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.992+0000 7f42f3200640 1 -- 172.21.15.103:0/1011620509 shutdown_connections 2024-09-10T22:38:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.992+0000 7f42f3200640 1 -- 172.21.15.103:0/1011620509 wait complete. 2024-09-10T22:38:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f3200640 1 Processor -- start 2024-09-10T22:38:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f3200640 1 -- start start 2024-09-10T22:38:47.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f3200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42f406feb0 0x7f42f40ce690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:47.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f3200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42f40cbb40 0x7f42f4154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:48.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f3200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42f415ea90 0x7f42f415b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:48.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f3200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f42f415a5b0 con 0x7f42f406feb0 2024-09-10T22:38:48.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f3200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f42f415a430 con 0x7f42f40cbb40 2024-09-10T22:38:48.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f3200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f42f415a730 con 0x7f42f415ea90 2024-09-10T22:38:48.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42f406feb0 0x7f42f40ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:48.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42f406feb0 0x7f42f40ce690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48810/0 (socket says 172.21.15.103:48810) 2024-09-10T22:38:48.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f1e00640 1 -- 172.21.15.103:0/1206349151 learned_addr learned my addr 172.21.15.103:0/1206349151 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:48.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f1400640 1 --2- 172.21.15.103:0/1206349151 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42f40cbb40 0x7f42f4154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:48.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f2800640 1 --2- 172.21.15.103:0/1206349151 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42f415ea90 0x7f42f415b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:48.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f1e00640 1 -- 172.21.15.103:0/1206349151 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42f415ea90 msgr2=0x7f42f415b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:48.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f1e00640 1 --2- 172.21.15.103:0/1206349151 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42f415ea90 0x7f42f415b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:48.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f1e00640 1 -- 172.21.15.103:0/1206349151 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42f40cbb40 msgr2=0x7f42f4154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:48.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f1e00640 1 --2- 172.21.15.103:0/1206349151 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42f40cbb40 0x7f42f4154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:48.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f1e00640 1 -- 172.21.15.103:0/1206349151 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f41f7e60 con 0x7f42f406feb0 2024-09-10T22:38:48.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f1e00640 1 --2- 172.21.15.103:0/1206349151 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42f406feb0 0x7f42f40ce690 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f42e400c480 tx=0x7f42e400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:48.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42ea000640 1 -- 172.21.15.103:0/1206349151 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4012830 con 0x7f42f406feb0 2024-09-10T22:38:48.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42ea000640 1 -- 172.21.15.103:0/1206349151 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42e4017070 con 0x7f42f406feb0 2024-09-10T22:38:48.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f3200640 1 -- 172.21.15.103:0/1206349151 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f415ad00 con 0x7f42f406feb0 2024-09-10T22:38:48.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42ea000640 1 -- 172.21.15.103:0/1206349151 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4012d80 con 0x7f42f406feb0 2024-09-10T22:38:48.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:47.996+0000 7f42f3200640 1 -- 172.21.15.103:0/1206349151 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f41f8400 con 0x7f42f406feb0 2024-09-10T22:38:48.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.000+0000 7f42f3200640 1 -- 172.21.15.103:0/1206349151 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f41599a0 con 0x7f42f406feb0 2024-09-10T22:38:48.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.000+0000 7f42ea000640 1 -- 172.21.15.103:0/1206349151 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f42e401c460 con 0x7f42f406feb0 2024-09-10T22:38:48.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.000+0000 7f42ea000640 1 --2- 172.21.15.103:0/1206349151 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f42d40725e0 0x7f42d4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:48.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.000+0000 7f42ea000640 1 -- 172.21.15.103:0/1206349151 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f42e4092d90 con 0x7f42f406feb0 2024-09-10T22:38:48.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.000+0000 7f42f1400640 1 --2- 172.21.15.103:0/1206349151 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f42d40725e0 0x7f42d4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:48.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.000+0000 7f42f1400640 1 --2- 172.21.15.103:0/1206349151 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f42d40725e0 0x7f42d4074aa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f42f40b0e50 tx=0x7f42e000b490 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:48.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.004+0000 7f42ea000640 1 -- 172.21.15.103:0/1206349151 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f42e405dff0 con 0x7f42f406feb0 2024-09-10T22:38:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.172+0000 7f42f3200640 1 -- 172.21.15.103:0/1206349151 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f42f40c9d20 con 0x7f42f406feb0 2024-09-10T22:38:48.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.816+0000 7f42ea000640 1 -- 172.21.15.103:0/1206349151 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) ==== 171+0+0 (secure 0 0 0) 0x7f42e4062a20 con 0x7f42f406feb0 2024-09-10T22:38:48.819 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2024-09-10T22:38:48.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.820+0000 7f42f3200640 1 -- 172.21.15.103:0/1206349151 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f42d40725e0 msgr2=0x7f42d4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:48.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.820+0000 7f42f3200640 1 --2- 172.21.15.103:0/1206349151 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f42d40725e0 0x7f42d4074aa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f42f40b0e50 tx=0x7f42e000b490 comp rx=0 tx=0).stop 2024-09-10T22:38:48.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.820+0000 7f42f3200640 1 -- 172.21.15.103:0/1206349151 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42f406feb0 msgr2=0x7f42f40ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:48.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.820+0000 7f42f3200640 1 --2- 172.21.15.103:0/1206349151 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42f406feb0 0x7f42f40ce690 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f42e400c480 tx=0x7f42e400c940 comp rx=0 tx=0).stop 2024-09-10T22:38:48.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.820+0000 7f42f3200640 1 -- 172.21.15.103:0/1206349151 shutdown_connections 2024-09-10T22:38:48.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.820+0000 7f42f3200640 1 --2- 172.21.15.103:0/1206349151 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f42d40725e0 0x7f42d4074aa0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:48.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.820+0000 7f42f3200640 1 --2- 172.21.15.103:0/1206349151 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42f415ea90 0x7f42f415b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:48.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.820+0000 7f42f3200640 1 --2- 172.21.15.103:0/1206349151 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42f40cbb40 0x7f42f4154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:48.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.820+0000 7f42f3200640 1 --2- 172.21.15.103:0/1206349151 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42f406feb0 0x7f42f40ce690 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f42e400c480 tx=0x7f42e400c940 comp rx=0 tx=0).stop 2024-09-10T22:38:48.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.820+0000 7f42f3200640 1 -- 172.21.15.103:0/1206349151 >> 172.21.15.103:0/1206349151 conn(0x7f42f40b12f0 msgr2=0x7f42f40ca040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:48.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.820+0000 7f42f3200640 1 -- 172.21.15.103:0/1206349151 shutdown_connections 2024-09-10T22:38:48.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:48.820+0000 7f42f3200640 1 -- 172.21.15.103:0/1206349151 wait complete. 2024-09-10T22:38:48.859 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T22:38:49.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bbf600640 1 -- 172.21.15.103:0/1864209935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bb8150a50 msgr2=0x7f8bb815aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:49.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bbf600640 1 --2- 172.21.15.103:0/1864209935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bb8150a50 0x7f8bb815aa50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800b8b0 tx=0x7f8ba801d3b0 comp rx=0 tx=0).stop 2024-09-10T22:38:49.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bbf600640 1 -- 172.21.15.103:0/1864209935 shutdown_connections 2024-09-10T22:38:49.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bbf600640 1 --2- 172.21.15.103:0/1864209935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bb8150a50 0x7f8bb815aa50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:49.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bbf600640 1 -- 172.21.15.103:0/1864209935 >> 172.21.15.103:0/1864209935 conn(0x7f8bb806cc00 msgr2=0x7f8bb806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:49.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bbf600640 1 -- 172.21.15.103:0/1864209935 shutdown_connections 2024-09-10T22:38:49.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bbf600640 1 -- 172.21.15.103:0/1864209935 wait complete. 2024-09-10T22:38:49.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bbf600640 1 Processor -- start 2024-09-10T22:38:49.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bbf600640 1 -- start start 2024-09-10T22:38:49.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bbf600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bb8073c30 0x7f8bb8148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:49.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bbf600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bb80b4b20 0x7f8bb814a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:49.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bbf600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8bb8150a50 0x7f8bb813b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:49.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bbf600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb8169160 con 0x7f8bb80b4b20 2024-09-10T22:38:49.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bbf600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb8074540 con 0x7f8bb8073c30 2024-09-10T22:38:49.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bbf600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb81692e0 con 0x7f8bb8150a50 2024-09-10T22:38:49.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bb7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bb80b4b20 0x7f8bb814a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:49.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bb7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bb80b4b20 0x7f8bb814a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48824/0 (socket says 172.21.15.103:48824) 2024-09-10T22:38:49.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bb7e00640 1 -- 172.21.15.103:0/2712697921 learned_addr learned my addr 172.21.15.103:0/2712697921 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:49.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bbcc00640 1 --2- 172.21.15.103:0/2712697921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bb8073c30 0x7f8bb8148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:49.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bbd600640 1 --2- 172.21.15.103:0/2712697921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8bb8150a50 0x7f8bb813b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:49.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bb7e00640 1 -- 172.21.15.103:0/2712697921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8bb8150a50 msgr2=0x7f8bb813b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:49.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bb7e00640 1 --2- 172.21.15.103:0/2712697921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8bb8150a50 0x7f8bb813b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:49.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bb7e00640 1 -- 172.21.15.103:0/2712697921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bb8073c30 msgr2=0x7f8bb8148350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:49.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bb7e00640 1 --2- 172.21.15.103:0/2712697921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bb8073c30 0x7f8bb8148350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:49.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.004+0000 7f8bb7e00640 1 -- 172.21.15.103:0/2712697921 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb80b2ba0 con 0x7f8bb80b4b20 2024-09-10T22:38:49.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.008+0000 7f8bb7e00640 1 --2- 172.21.15.103:0/2712697921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bb80b4b20 0x7f8bb814a260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400c410 tx=0x7f8ba400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:49.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.008+0000 7f8bb4c00640 1 -- 172.21.15.103:0/2712697921 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4011790 con 0x7f8bb80b4b20 2024-09-10T22:38:49.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.008+0000 7f8bb4c00640 1 -- 172.21.15.103:0/2712697921 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ba4017070 con 0x7f8bb80b4b20 2024-09-10T22:38:49.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.008+0000 7f8bb4c00640 1 -- 172.21.15.103:0/2712697921 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4011d00 con 0x7f8bb80b4b20 2024-09-10T22:38:49.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.008+0000 7f8bbf600640 1 -- 172.21.15.103:0/2712697921 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb814a940 con 0x7f8bb80b4b20 2024-09-10T22:38:49.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.008+0000 7f8bbf600640 1 -- 172.21.15.103:0/2712697921 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb8152d50 con 0x7f8bb80b4b20 2024-09-10T22:38:49.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.008+0000 7f8bbf600640 1 -- 172.21.15.103:0/2712697921 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb815aa50 con 0x7f8bb80b4b20 2024-09-10T22:38:49.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.008+0000 7f8bb4c00640 1 -- 172.21.15.103:0/2712697921 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8ba401c460 con 0x7f8bb80b4b20 2024-09-10T22:38:49.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.012+0000 7f8bb4c00640 1 --2- 172.21.15.103:0/2712697921 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8b980725e0 0x7f8b98074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:49.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.012+0000 7f8bb4c00640 1 -- 172.21.15.103:0/2712697921 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f8ba4092d10 con 0x7f8bb80b4b20 2024-09-10T22:38:49.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.012+0000 7f8bbcc00640 1 --2- 172.21.15.103:0/2712697921 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8b980725e0 0x7f8b98074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:49.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.012+0000 7f8bbcc00640 1 --2- 172.21.15.103:0/2712697921 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8b980725e0 0x7f8b98074aa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80af000 tx=0x7f8ba801bbf0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:49.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.016+0000 7f8bb4c00640 1 -- 172.21.15.103:0/2712697921 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8ba4098020 con 0x7f8bb80b4b20 2024-09-10T22:38:49.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.212+0000 7f8bbf600640 1 -- 172.21.15.103:0/2712697921 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8bb813b710 con 0x7f8bb80b4b20 2024-09-10T22:38:49.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.844+0000 7f8bb4c00640 1 -- 172.21.15.103:0/2712697921 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f8ba4021020 con 0x7f8bb80b4b20 2024-09-10T22:38:49.846 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T22:38:49.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.848+0000 7f8bbf600640 1 -- 172.21.15.103:0/2712697921 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8b980725e0 msgr2=0x7f8b98074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:49.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.848+0000 7f8bbf600640 1 --2- 172.21.15.103:0/2712697921 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8b980725e0 0x7f8b98074aa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80af000 tx=0x7f8ba801bbf0 comp rx=0 tx=0).stop 2024-09-10T22:38:49.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.848+0000 7f8bbf600640 1 -- 172.21.15.103:0/2712697921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bb80b4b20 msgr2=0x7f8bb814a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:49.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.848+0000 7f8bbf600640 1 --2- 172.21.15.103:0/2712697921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bb80b4b20 0x7f8bb814a260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400c410 tx=0x7f8ba400c8d0 comp rx=0 tx=0).stop 2024-09-10T22:38:49.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.848+0000 7f8bbf600640 1 -- 172.21.15.103:0/2712697921 shutdown_connections 2024-09-10T22:38:49.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.848+0000 7f8bbf600640 1 --2- 172.21.15.103:0/2712697921 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8b980725e0 0x7f8b98074aa0 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80af000 tx=0x7f8ba801bbf0 comp rx=0 tx=0).stop 2024-09-10T22:38:49.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.848+0000 7f8bbf600640 1 --2- 172.21.15.103:0/2712697921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8bb8150a50 0x7f8bb813b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:49.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.848+0000 7f8bbf600640 1 --2- 172.21.15.103:0/2712697921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bb80b4b20 0x7f8bb814a260 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:49.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.848+0000 7f8bbf600640 1 --2- 172.21.15.103:0/2712697921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bb8073c30 0x7f8bb8148350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:49.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.848+0000 7f8bbf600640 1 -- 172.21.15.103:0/2712697921 >> 172.21.15.103:0/2712697921 conn(0x7f8bb806cc00 msgr2=0x7f8bb80b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:49.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.852+0000 7f8bbf600640 1 -- 172.21.15.103:0/2712697921 shutdown_connections 2024-09-10T22:38:49.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:49.852+0000 7f8bbf600640 1 -- 172.21.15.103:0/2712697921 wait complete. 2024-09-10T22:38:49.889 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-10T22:38:49.889 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-10T22:38:50.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.036+0000 7fa6c5e00640 1 -- 172.21.15.103:0/4100370901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c00af9d0 msgr2=0x7fa6c0166a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:50.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.036+0000 7fa6c5e00640 1 --2- 172.21.15.103:0/4100370901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c00af9d0 0x7fa6c0166a50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009bc0 tx=0x7fa6b801ca30 comp rx=0 tx=0).stop 2024-09-10T22:38:50.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.036+0000 7fa6c5e00640 1 -- 172.21.15.103:0/4100370901 shutdown_connections 2024-09-10T22:38:50.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.036+0000 7fa6c5e00640 1 --2- 172.21.15.103:0/4100370901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c00af9d0 0x7fa6c0166a50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:50.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.036+0000 7fa6c5e00640 1 -- 172.21.15.103:0/4100370901 >> 172.21.15.103:0/4100370901 conn(0x7fa6c00d1ac0 msgr2=0x7fa6c00d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:50.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.036+0000 7fa6c5e00640 1 -- 172.21.15.103:0/4100370901 shutdown_connections 2024-09-10T22:38:50.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.036+0000 7fa6c5e00640 1 -- 172.21.15.103:0/4100370901 wait complete. 2024-09-10T22:38:50.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.036+0000 7fa6c5e00640 1 Processor -- start 2024-09-10T22:38:50.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.036+0000 7fa6c5e00640 1 -- start start 2024-09-10T22:38:50.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6c5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c00af9d0 0x7fa6c014ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:50.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6c5e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6c00b09c0 0x7fa6c00b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:50.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6c5e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c015be30 0x7fa6c014e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:50.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6c5e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c0169bf0 con 0x7fa6c00af9d0 2024-09-10T22:38:50.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6c5e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c0169a70 con 0x7fa6c015be30 2024-09-10T22:38:50.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6c5e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa6c0169d70 con 0x7fa6c00b09c0 2024-09-10T22:38:50.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6bea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c00af9d0 0x7fa6c014ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:50.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6bea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c00af9d0 0x7fa6c014ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48838/0 (socket says 172.21.15.103:48838) 2024-09-10T22:38:50.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6bea00640 1 -- 172.21.15.103:0/3178289621 learned_addr learned my addr 172.21.15.103:0/3178289621 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:50.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6bf400640 1 --2- 172.21.15.103:0/3178289621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c015be30 0x7fa6c014e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:50.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6b7e00640 1 --2- 172.21.15.103:0/3178289621 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6c00b09c0 0x7fa6c00b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:50.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6bea00640 1 -- 172.21.15.103:0/3178289621 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6c00b09c0 msgr2=0x7fa6c00b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:50.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6bea00640 1 --2- 172.21.15.103:0/3178289621 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6c00b09c0 0x7fa6c00b6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:50.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6bea00640 1 -- 172.21.15.103:0/3178289621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c015be30 msgr2=0x7fa6c014e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:50.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6bea00640 1 --2- 172.21.15.103:0/3178289621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c015be30 0x7fa6c014e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:50.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6bea00640 1 -- 172.21.15.103:0/3178289621 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c00af410 con 0x7fa6c00af9d0 2024-09-10T22:38:50.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6b7e00640 1 --2- 172.21.15.103:0/3178289621 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6c00b09c0 0x7fa6c00b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:38:50.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6bea00640 1 --2- 172.21.15.103:0/3178289621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c00af9d0 0x7fa6c014ee20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000c6b0 tx=0x7fa6b000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:50.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6b7400640 1 -- 172.21.15.103:0/3178289621 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0016020 con 0x7fa6c00af9d0 2024-09-10T22:38:50.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6b7400640 1 -- 172.21.15.103:0/3178289621 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6b000a930 con 0x7fa6c00af9d0 2024-09-10T22:38:50.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6c5e00640 1 -- 172.21.15.103:0/3178289621 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6c00b5f60 con 0x7fa6c00af9d0 2024-09-10T22:38:50.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6b7400640 1 -- 172.21.15.103:0/3178289621 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b000ad80 con 0x7fa6c00af9d0 2024-09-10T22:38:50.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6c5e00640 1 -- 172.21.15.103:0/3178289621 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6c00b64e0 con 0x7fa6c00af9d0 2024-09-10T22:38:50.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.040+0000 7fa6c5e00640 1 -- 172.21.15.103:0/3178289621 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6c00ce0c0 con 0x7fa6c00af9d0 2024-09-10T22:38:50.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.044+0000 7fa6b7400640 1 -- 172.21.15.103:0/3178289621 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa6b0012420 con 0x7fa6c00af9d0 2024-09-10T22:38:50.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.044+0000 7fa6b7400640 1 --2- 172.21.15.103:0/3178289621 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa69c072610 0x7fa69c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:50.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.044+0000 7fa6b7400640 1 -- 172.21.15.103:0/3178289621 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa6b00935e0 con 0x7fa6c00af9d0 2024-09-10T22:38:50.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.044+0000 7fa6b7e00640 1 --2- 172.21.15.103:0/3178289621 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa69c072610 0x7fa69c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:50.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.044+0000 7fa6b7e00640 1 --2- 172.21.15.103:0/3178289621 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa69c072610 0x7fa69c074ad0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80017a0 tx=0x7fa6a8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:50.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.048+0000 7fa6b7400640 1 -- 172.21.15.103:0/3178289621 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa6b0020020 con 0x7fa6c00af9d0 2024-09-10T22:38:50.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.224+0000 7fa6c5e00640 1 -- 172.21.15.103:0/3178289621 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fa6c0075d40 con 0x7fa6c00af9d0 2024-09-10T22:38:50.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.848+0000 7fa6b7400640 1 -- 172.21.15.103:0/3178289621 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) ==== 157+0+0 (secure 0 0 0) 0x7fa6b005ecb0 con 0x7fa6c00af9d0 2024-09-10T22:38:50.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.852+0000 7fa6c5e00640 1 -- 172.21.15.103:0/3178289621 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa69c072610 msgr2=0x7fa69c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:50.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.852+0000 7fa6c5e00640 1 --2- 172.21.15.103:0/3178289621 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa69c072610 0x7fa69c074ad0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80017a0 tx=0x7fa6a8009040 comp rx=0 tx=0).stop 2024-09-10T22:38:50.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.852+0000 7fa6c5e00640 1 -- 172.21.15.103:0/3178289621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c00af9d0 msgr2=0x7fa6c014ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:50.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.852+0000 7fa6c5e00640 1 --2- 172.21.15.103:0/3178289621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c00af9d0 0x7fa6c014ee20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000c6b0 tx=0x7fa6b000cb70 comp rx=0 tx=0).stop 2024-09-10T22:38:50.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.852+0000 7fa6c5e00640 1 -- 172.21.15.103:0/3178289621 shutdown_connections 2024-09-10T22:38:50.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.852+0000 7fa6c5e00640 1 --2- 172.21.15.103:0/3178289621 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa69c072610 0x7fa69c074ad0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:50.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.852+0000 7fa6c5e00640 1 --2- 172.21.15.103:0/3178289621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c015be30 0x7fa6c014e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:50.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.852+0000 7fa6c5e00640 1 --2- 172.21.15.103:0/3178289621 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6c00b09c0 0x7fa6c00b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:50.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.852+0000 7fa6c5e00640 1 --2- 172.21.15.103:0/3178289621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c00af9d0 0x7fa6c014ee20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:50.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.852+0000 7fa6c5e00640 1 -- 172.21.15.103:0/3178289621 >> 172.21.15.103:0/3178289621 conn(0x7fa6c00d1ac0 msgr2=0x7fa6c00d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:50.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.852+0000 7fa6c5e00640 1 -- 172.21.15.103:0/3178289621 shutdown_connections 2024-09-10T22:38:50.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:50.852+0000 7fa6c5e00640 1 -- 172.21.15.103:0/3178289621 wait complete. 2024-09-10T22:38:50.875 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T22:38:51.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.024+0000 7fae32400640 1 -- 172.21.15.103:0/871035786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae10004810 msgr2=0x7fae10004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:51.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.024+0000 7fae32400640 1 --2- 172.21.15.103:0/871035786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae10004810 0x7fae10004c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fae1400c2c0 tx=0x7fae1401f700 comp rx=0 tx=0).stop 2024-09-10T22:38:51.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.024+0000 7fae2be00640 1 -- 172.21.15.103:0/871035786 reap_dead start 2024-09-10T22:38:51.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.024+0000 7fae32400640 1 -- 172.21.15.103:0/871035786 shutdown_connections 2024-09-10T22:38:51.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.024+0000 7fae32400640 1 -- 172.21.15.103:0/871035786 >> 172.21.15.103:0/871035786 conn(0x7fae2c0cf830 msgr2=0x7fae2c0cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:51.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.024+0000 7fae32400640 1 -- 172.21.15.103:0/871035786 shutdown_connections 2024-09-10T22:38:51.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.024+0000 7fae32400640 1 -- 172.21.15.103:0/871035786 wait complete. 2024-09-10T22:38:51.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.024+0000 7fae32400640 1 Processor -- start 2024-09-10T22:38:51.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.024+0000 7fae32400640 1 -- start start 2024-09-10T22:38:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae32400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae10004810 0x7fae2c0b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae32400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae2c1423a0 0x7fae2c142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae32400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae2c152770 0x7fae2c152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae32400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c15f4a0 con 0x7fae2c1423a0 2024-09-10T22:38:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae32400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c15f320 con 0x7fae2c152770 2024-09-10T22:38:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae32400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fae2c15f620 con 0x7fae10004810 2024-09-10T22:38:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae22a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae2c1423a0 0x7fae2c142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae22a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae2c1423a0 0x7fae2c142820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48864/0 (socket says 172.21.15.103:48864) 2024-09-10T22:38:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae22a00640 1 -- 172.21.15.103:0/981653542 learned_addr learned my addr 172.21.15.103:0/981653542 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae2b400640 1 --2- 172.21.15.103:0/981653542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae10004810 0x7fae2c0b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae2be00640 1 --2- 172.21.15.103:0/981653542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae2c152770 0x7fae2c152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae22a00640 1 -- 172.21.15.103:0/981653542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae10004810 msgr2=0x7fae2c0b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae22a00640 1 --2- 172.21.15.103:0/981653542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae10004810 0x7fae2c0b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae22a00640 1 -- 172.21.15.103:0/981653542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae2c152770 msgr2=0x7fae2c152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae22a00640 1 --2- 172.21.15.103:0/981653542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae2c152770 0x7fae2c152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae22a00640 1 -- 172.21.15.103:0/981653542 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2c145140 con 0x7fae2c1423a0 2024-09-10T22:38:51.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae22a00640 1 --2- 172.21.15.103:0/981653542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae2c1423a0 0x7fae2c142820 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fae14026310 tx=0x7fae14001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:51.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae23e00640 1 -- 172.21.15.103:0/981653542 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae140062a0 con 0x7fae2c1423a0 2024-09-10T22:38:51.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae23e00640 1 -- 172.21.15.103:0/981653542 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae140be070 con 0x7fae2c1423a0 2024-09-10T22:38:51.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae32400640 1 -- 172.21.15.103:0/981653542 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2c145420 con 0x7fae2c1423a0 2024-09-10T22:38:51.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae23e00640 1 -- 172.21.15.103:0/981653542 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae140064c0 con 0x7fae2c1423a0 2024-09-10T22:38:51.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae32400640 1 -- 172.21.15.103:0/981653542 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae2c1459e0 con 0x7fae2c1423a0 2024-09-10T22:38:51.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae32400640 1 -- 172.21.15.103:0/981653542 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae2c072490 con 0x7fae2c1423a0 2024-09-10T22:38:51.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.028+0000 7fae23e00640 1 -- 172.21.15.103:0/981653542 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fae14003600 con 0x7fae2c1423a0 2024-09-10T22:38:51.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.032+0000 7fae23e00640 1 --2- 172.21.15.103:0/981653542 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fae080725e0 0x7fae08074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:51.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.032+0000 7fae23e00640 1 -- 172.21.15.103:0/981653542 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6007+0+0 (secure 0 0 0) 0x7fae14130e70 con 0x7fae2c1423a0 2024-09-10T22:38:51.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.032+0000 7fae2b400640 1 --2- 172.21.15.103:0/981653542 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fae080725e0 0x7fae08074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:51.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.032+0000 7fae2b400640 1 --2- 172.21.15.103:0/981653542 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fae080725e0 0x7fae08074aa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae2c158000 tx=0x7fae1c0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:51.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.036+0000 7fae23e00640 1 -- 172.21.15.103:0/981653542 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fae140194b0 con 0x7fae2c1423a0 2024-09-10T22:38:51.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:51.200+0000 7fae32400640 1 -- 172.21.15.103:0/981653542 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fae2c1601c0 con 0x7fae2c1423a0 2024-09-10T22:38:52.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:52.864+0000 7fae23e00640 1 -- 172.21.15.103:0/981653542 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) ==== 228+0+0 (secure 0 0 0) 0x7fae140fc380 con 0x7fae2c1423a0 2024-09-10T22:38:52.864 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data_ec' created 2024-09-10T22:38:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:52.868+0000 7fae32400640 1 -- 172.21.15.103:0/981653542 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fae080725e0 msgr2=0x7fae08074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:52.868+0000 7fae32400640 1 --2- 172.21.15.103:0/981653542 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fae080725e0 0x7fae08074aa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae2c158000 tx=0x7fae1c0091e0 comp rx=0 tx=0).stop 2024-09-10T22:38:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:52.868+0000 7fae32400640 1 -- 172.21.15.103:0/981653542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae2c1423a0 msgr2=0x7fae2c142820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:52.868+0000 7fae32400640 1 --2- 172.21.15.103:0/981653542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae2c1423a0 0x7fae2c142820 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fae14026310 tx=0x7fae14001cc0 comp rx=0 tx=0).stop 2024-09-10T22:38:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:52.868+0000 7fae32400640 1 -- 172.21.15.103:0/981653542 shutdown_connections 2024-09-10T22:38:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:52.868+0000 7fae32400640 1 --2- 172.21.15.103:0/981653542 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fae080725e0 0x7fae08074aa0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:52.868+0000 7fae32400640 1 --2- 172.21.15.103:0/981653542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae2c152770 0x7fae2c152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:52.868+0000 7fae32400640 1 --2- 172.21.15.103:0/981653542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae2c1423a0 0x7fae2c142820 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:52.868+0000 7fae32400640 1 --2- 172.21.15.103:0/981653542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae10004810 0x7fae2c0b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:52.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:52.868+0000 7fae32400640 1 -- 172.21.15.103:0/981653542 >> 172.21.15.103:0/981653542 conn(0x7fae2c0cf830 msgr2=0x7fae2c0ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:52.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:52.868+0000 7fae32400640 1 -- 172.21.15.103:0/981653542 shutdown_connections 2024-09-10T22:38:52.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:52.868+0000 7fae32400640 1 -- 172.21.15.103:0/981653542 wait complete. 2024-09-10T22:38:52.900 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-10T22:38:53.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe96200640 1 -- 172.21.15.103:0/60831180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe900cfda0 msgr2=0x7efe9015eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:53.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe96200640 1 --2- 172.21.15.103:0/60831180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe900cfda0 0x7efe9015eca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efe900b0ec0 tx=0x7efe8001cc30 comp rx=0 tx=0).stop 2024-09-10T22:38:53.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe96200640 1 -- 172.21.15.103:0/60831180 shutdown_connections 2024-09-10T22:38:53.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe96200640 1 --2- 172.21.15.103:0/60831180 >> v2:172.21.15.131:3300/0 conn(0x7efe900717a0 0x7efe9015f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:53.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe96200640 1 --2- 172.21.15.103:0/60831180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe900cfda0 0x7efe9015eca0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:53.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe96200640 1 -- 172.21.15.103:0/60831180 >> 172.21.15.103:0/60831180 conn(0x7efe900d1ad0 msgr2=0x7efe900d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:53.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe96200640 1 -- 172.21.15.103:0/60831180 shutdown_connections 2024-09-10T22:38:53.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe96200640 1 -- 172.21.15.103:0/60831180 wait complete. 2024-09-10T22:38:53.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe96200640 1 Processor -- start 2024-09-10T22:38:53.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe96200640 1 -- start start 2024-09-10T22:38:53.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe96200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe900717a0 0x7efe901fbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:53.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe96200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe900cfda0 0x7efe900b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:53.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe96200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe900d25f0 0x7efe901fac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:53.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe96200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efe90168f90 con 0x7efe900d25f0 2024-09-10T22:38:53.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe96200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7efe90168e10 con 0x7efe900cfda0 2024-09-10T22:38:53.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe96200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7efe90169110 con 0x7efe900717a0 2024-09-10T22:38:53.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe8fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe900d25f0 0x7efe901fac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:53.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe8fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe900d25f0 0x7efe901fac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48884/0 (socket says 172.21.15.103:48884) 2024-09-10T22:38:53.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.048+0000 7efe8fe00640 1 -- 172.21.15.103:0/3929405738 learned_addr learned my addr 172.21.15.103:0/3929405738 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:53.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.052+0000 7efe8f400640 1 --2- 172.21.15.103:0/3929405738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe900717a0 0x7efe901fbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:53.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.052+0000 7efe86a00640 1 --2- 172.21.15.103:0/3929405738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe900cfda0 0x7efe900b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:53.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.052+0000 7efe8fe00640 1 -- 172.21.15.103:0/3929405738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe900717a0 msgr2=0x7efe901fbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:53.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.052+0000 7efe8fe00640 1 --2- 172.21.15.103:0/3929405738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe900717a0 0x7efe901fbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:53.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.052+0000 7efe8fe00640 1 -- 172.21.15.103:0/3929405738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe900cfda0 msgr2=0x7efe900b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:53.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.052+0000 7efe8fe00640 1 --2- 172.21.15.103:0/3929405738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe900cfda0 0x7efe900b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:53.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.052+0000 7efe8fe00640 1 -- 172.21.15.103:0/3929405738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe900b4f40 con 0x7efe900d25f0 2024-09-10T22:38:53.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.052+0000 7efe8fe00640 1 --2- 172.21.15.103:0/3929405738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe900d25f0 0x7efe901fac60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efe8800d780 tx=0x7efe8800dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:53.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.052+0000 7efe87e00640 1 -- 172.21.15.103:0/3929405738 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe88017070 con 0x7efe900d25f0 2024-09-10T22:38:53.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.052+0000 7efe87e00640 1 -- 172.21.15.103:0/3929405738 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe8800de90 con 0x7efe900d25f0 2024-09-10T22:38:53.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.052+0000 7efe96200640 1 -- 172.21.15.103:0/3929405738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe900b5220 con 0x7efe900d25f0 2024-09-10T22:38:53.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.052+0000 7efe87e00640 1 -- 172.21.15.103:0/3929405738 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe88005020 con 0x7efe900d25f0 2024-09-10T22:38:53.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.052+0000 7efe96200640 1 -- 172.21.15.103:0/3929405738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe900b57e0 con 0x7efe900d25f0 2024-09-10T22:38:53.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.052+0000 7efe96200640 1 -- 172.21.15.103:0/3929405738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe90070700 con 0x7efe900d25f0 2024-09-10T22:38:53.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.052+0000 7efe87e00640 1 -- 172.21.15.103:0/3929405738 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7efe880051c0 con 0x7efe900d25f0 2024-09-10T22:38:53.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.056+0000 7efe87e00640 1 --2- 172.21.15.103:0/3929405738 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efe6c0725e0 0x7efe6c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:53.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.056+0000 7efe87e00640 1 -- 172.21.15.103:0/3929405738 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7efe88093640 con 0x7efe900d25f0 2024-09-10T22:38:53.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.056+0000 7efe8f400640 1 --2- 172.21.15.103:0/3929405738 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efe6c0725e0 0x7efe6c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:53.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.056+0000 7efe8f400640 1 --2- 172.21.15.103:0/3929405738 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efe6c0725e0 0x7efe6c074aa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efe800af000 tx=0x7efe8001b470 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:53.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.060+0000 7efe87e00640 1 -- 172.21.15.103:0/3929405738 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7efe8805e310 con 0x7efe900d25f0 2024-09-10T22:38:53.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.224+0000 7efe96200640 1 -- 172.21.15.103:0/3929405738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7efe9006ae30 con 0x7efe900d25f0 2024-09-10T22:38:53.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.868+0000 7efe87e00640 1 -- 172.21.15.103:0/3929405738 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) ==== 169+0+0 (secure 0 0 0) 0x7efe88067080 con 0x7efe900d25f0 2024-09-10T22:38:53.871 INFO:teuthology.orchestra.run.smithi103.stderr:set pool 4 allow_ec_overwrites to true 2024-09-10T22:38:53.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.872+0000 7efe96200640 1 -- 172.21.15.103:0/3929405738 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efe6c0725e0 msgr2=0x7efe6c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:53.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.872+0000 7efe96200640 1 --2- 172.21.15.103:0/3929405738 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efe6c0725e0 0x7efe6c074aa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efe800af000 tx=0x7efe8001b470 comp rx=0 tx=0).stop 2024-09-10T22:38:53.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.872+0000 7efe96200640 1 -- 172.21.15.103:0/3929405738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe900d25f0 msgr2=0x7efe901fac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:53.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.872+0000 7efe96200640 1 --2- 172.21.15.103:0/3929405738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe900d25f0 0x7efe901fac60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efe8800d780 tx=0x7efe8800dc40 comp rx=0 tx=0).stop 2024-09-10T22:38:53.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.872+0000 7efe96200640 1 -- 172.21.15.103:0/3929405738 shutdown_connections 2024-09-10T22:38:53.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.872+0000 7efe96200640 1 --2- 172.21.15.103:0/3929405738 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efe6c0725e0 0x7efe6c074aa0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:53.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.872+0000 7efe96200640 1 --2- 172.21.15.103:0/3929405738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe900d25f0 0x7efe901fac60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:53.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.872+0000 7efe96200640 1 --2- 172.21.15.103:0/3929405738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe900cfda0 0x7efe900b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:53.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.872+0000 7efe96200640 1 --2- 172.21.15.103:0/3929405738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe900717a0 0x7efe901fbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:53.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.872+0000 7efe96200640 1 -- 172.21.15.103:0/3929405738 >> 172.21.15.103:0/3929405738 conn(0x7efe900d1ad0 msgr2=0x7efe900d1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:53.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.872+0000 7efe96200640 1 -- 172.21.15.103:0/3929405738 shutdown_connections 2024-09-10T22:38:53.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:53.872+0000 7efe96200640 1 -- 172.21.15.103:0/3929405738 wait complete. 2024-09-10T22:38:53.916 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-10T22:38:54.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.060+0000 7fc860200640 1 -- 172.21.15.103:0/3546968361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8400050f0 msgr2=0x7fc840005920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:54.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.060+0000 7fc860200640 1 --2- 172.21.15.103:0/3546968361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8400050f0 0x7fc840005920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc84400c2e0 tx=0x7fc84401f700 comp rx=0 tx=0).stop 2024-09-10T22:38:54.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.060+0000 7fc85e200640 1 -- 172.21.15.103:0/3546968361 reap_dead start 2024-09-10T22:38:54.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.060+0000 7fc860200640 1 -- 172.21.15.103:0/3546968361 shutdown_connections 2024-09-10T22:38:54.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.060+0000 7fc860200640 1 -- 172.21.15.103:0/3546968361 >> 172.21.15.103:0/3546968361 conn(0x7fc85806cc00 msgr2=0x7fc85806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:54.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.060+0000 7fc860200640 1 -- 172.21.15.103:0/3546968361 shutdown_connections 2024-09-10T22:38:54.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.060+0000 7fc860200640 1 -- 172.21.15.103:0/3546968361 wait complete. 2024-09-10T22:38:54.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc860200640 1 Processor -- start 2024-09-10T22:38:54.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc860200640 1 -- start start 2024-09-10T22:38:54.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc860200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8400050f0 0x7fc8581f3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:54.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc860200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8581efbf0 0x7fc85813db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:54.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc860200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8580a9c50 0x7fc8580b0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:54.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc860200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc85815d820 con 0x7fc8400050f0 2024-09-10T22:38:54.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc860200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc85815d6a0 con 0x7fc8581efbf0 2024-09-10T22:38:54.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc860200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc85815d9a0 con 0x7fc8580a9c50 2024-09-10T22:38:54.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc85d800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8400050f0 0x7fc8581f3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:54.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc85d800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8400050f0 0x7fc8581f3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48902/0 (socket says 172.21.15.103:48902) 2024-09-10T22:38:54.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc85d800640 1 -- 172.21.15.103:0/1323283394 learned_addr learned my addr 172.21.15.103:0/1323283394 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:54.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc85ce00640 1 --2- 172.21.15.103:0/1323283394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8581efbf0 0x7fc85813db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:54.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc85e200640 1 --2- 172.21.15.103:0/1323283394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8580a9c50 0x7fc8580b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:54.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc85d800640 1 -- 172.21.15.103:0/1323283394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8580a9c50 msgr2=0x7fc8580b0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:54.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc85d800640 1 --2- 172.21.15.103:0/1323283394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8580a9c50 0x7fc8580b0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:54.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc85d800640 1 -- 172.21.15.103:0/1323283394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8581efbf0 msgr2=0x7fc85813db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:54.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc85d800640 1 --2- 172.21.15.103:0/1323283394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8581efbf0 0x7fc85813db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:54.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc85d800640 1 -- 172.21.15.103:0/1323283394 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8581f0490 con 0x7fc8400050f0 2024-09-10T22:38:54.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc85ce00640 1 --2- 172.21.15.103:0/1323283394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8581efbf0 0x7fc85813db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:38:54.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc85d800640 1 --2- 172.21.15.103:0/1323283394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8400050f0 0x7fc8581f3d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc84c011ae0 tx=0x7fc84c009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:54.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc855600640 1 -- 172.21.15.103:0/1323283394 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c01e070 con 0x7fc8400050f0 2024-09-10T22:38:54.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc855600640 1 -- 172.21.15.103:0/1323283394 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc84c00fe40 con 0x7fc8400050f0 2024-09-10T22:38:54.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc855600640 1 -- 172.21.15.103:0/1323283394 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0042b0 con 0x7fc8400050f0 2024-09-10T22:38:54.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc860200640 1 -- 172.21.15.103:0/1323283394 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8581f0770 con 0x7fc8400050f0 2024-09-10T22:38:54.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc860200640 1 -- 172.21.15.103:0/1323283394 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8580a9450 con 0x7fc8400050f0 2024-09-10T22:38:54.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.064+0000 7fc860200640 1 -- 172.21.15.103:0/1323283394 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8580740c0 con 0x7fc8400050f0 2024-09-10T22:38:54.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.068+0000 7fc855600640 1 -- 172.21.15.103:0/1323283394 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc84c003600 con 0x7fc8400050f0 2024-09-10T22:38:54.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.068+0000 7fc855600640 1 --2- 172.21.15.103:0/1323283394 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc8380725e0 0x7fc838074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:54.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.068+0000 7fc855600640 1 -- 172.21.15.103:0/1323283394 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6500+0+0 (secure 0 0 0) 0x7fc84c0941a0 con 0x7fc8400050f0 2024-09-10T22:38:54.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.068+0000 7fc85ce00640 1 --2- 172.21.15.103:0/1323283394 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc8380725e0 0x7fc838074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:54.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.068+0000 7fc85ce00640 1 --2- 172.21.15.103:0/1323283394 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc8380725e0 0x7fc838074aa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8440b0000 tx=0x7fc84401c540 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:54.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.072+0000 7fc855600640 1 -- 172.21.15.103:0/1323283394 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc84c05f060 con 0x7fc8400050f0 2024-09-10T22:38:54.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.280+0000 7fc860200640 1 -- 172.21.15.103:0/1323283394 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fc858075df0 con 0x7fc8400050f0 2024-09-10T22:38:54.809 INFO:tasks.ceph.mds.b.smithi131.stderr:2024-09-10T22:38:54.804+0000 7f70c4800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T22:38:54.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.872+0000 7fc855600640 1 -- 172.21.15.103:0/1323283394 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7fc84c063a90 con 0x7fc8400050f0 2024-09-10T22:38:54.873 INFO:teuthology.orchestra.run.smithi103.stderr:added data pool 4 to fsmap 2024-09-10T22:38:54.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.872+0000 7fc860200640 1 -- 172.21.15.103:0/1323283394 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc8380725e0 msgr2=0x7fc838074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:54.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.872+0000 7fc860200640 1 --2- 172.21.15.103:0/1323283394 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc8380725e0 0x7fc838074aa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8440b0000 tx=0x7fc84401c540 comp rx=0 tx=0).stop 2024-09-10T22:38:54.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.872+0000 7fc860200640 1 -- 172.21.15.103:0/1323283394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8400050f0 msgr2=0x7fc8581f3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:54.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.872+0000 7fc860200640 1 --2- 172.21.15.103:0/1323283394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8400050f0 0x7fc8581f3d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc84c011ae0 tx=0x7fc84c009ea0 comp rx=0 tx=0).stop 2024-09-10T22:38:54.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.872+0000 7fc860200640 1 -- 172.21.15.103:0/1323283394 shutdown_connections 2024-09-10T22:38:54.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.872+0000 7fc860200640 1 --2- 172.21.15.103:0/1323283394 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc8380725e0 0x7fc838074aa0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:54.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.872+0000 7fc860200640 1 --2- 172.21.15.103:0/1323283394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8580a9c50 0x7fc8580b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:54.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.872+0000 7fc860200640 1 --2- 172.21.15.103:0/1323283394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8581efbf0 0x7fc85813db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:54.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.872+0000 7fc860200640 1 --2- 172.21.15.103:0/1323283394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8400050f0 0x7fc8581f3d40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:54.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.872+0000 7fc860200640 1 -- 172.21.15.103:0/1323283394 >> 172.21.15.103:0/1323283394 conn(0x7fc85806cc00 msgr2=0x7fc8580b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:54.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.872+0000 7fc860200640 1 -- 172.21.15.103:0/1323283394 shutdown_connections 2024-09-10T22:38:54.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:54.872+0000 7fc860200640 1 -- 172.21.15.103:0/1323283394 wait complete. 2024-09-10T22:38:54.897 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:38:55.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f9995800640 1 -- 172.21.15.103:0/506133757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99900b2840 msgr2=0x7f99900d0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:55.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f9995800640 1 --2- 172.21.15.103:0/506133757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99900b2840 0x7f99900d0100 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f997c009900 tx=0x7f997c01c850 comp rx=0 tx=0).stop 2024-09-10T22:38:55.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f9995800640 1 -- 172.21.15.103:0/506133757 shutdown_connections 2024-09-10T22:38:55.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f9995800640 1 --2- 172.21.15.103:0/506133757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99900b2840 0x7f99900d0100 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f9995800640 1 --2- 172.21.15.103:0/506133757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999015f330 0x7f99900cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f9995800640 1 -- 172.21.15.103:0/506133757 >> 172.21.15.103:0/506133757 conn(0x7f99900d1ab0 msgr2=0x7f99900d1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:55.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f9995800640 1 -- 172.21.15.103:0/506133757 shutdown_connections 2024-09-10T22:38:55.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f9995800640 1 -- 172.21.15.103:0/506133757 wait complete. 2024-09-10T22:38:55.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f9995800640 1 Processor -- start 2024-09-10T22:38:55.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f9995800640 1 -- start start 2024-09-10T22:38:55.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f9995800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99900b2840 0x7f99901fb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:55.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f9995800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99900d0640 0x7f9990156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:55.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f9995800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999015f330 0x7f99901f8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:55.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f9995800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9990169200 con 0x7f99900d0640 2024-09-10T22:38:55.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f9995800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9990169080 con 0x7f99900b2840 2024-09-10T22:38:55.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f9995800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9990169380 con 0x7f999015f330 2024-09-10T22:38:55.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f998e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99900d0640 0x7f9990156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:55.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f998e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99900d0640 0x7f9990156bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48914/0 (socket says 172.21.15.103:48914) 2024-09-10T22:38:55.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.040+0000 7f998e000640 1 -- 172.21.15.103:0/3717980872 learned_addr learned my addr 172.21.15.103:0/3717980872 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:55.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.044+0000 7f998ea00640 1 --2- 172.21.15.103:0/3717980872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99900b2840 0x7f99901fb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:55.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.044+0000 7f998e000640 1 -- 172.21.15.103:0/3717980872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999015f330 msgr2=0x7f99901f8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:55.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.044+0000 7f998e000640 1 --2- 172.21.15.103:0/3717980872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999015f330 0x7f99901f8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.044+0000 7f998e000640 1 -- 172.21.15.103:0/3717980872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99900b2840 msgr2=0x7f99901fb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:55.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.044+0000 7f998e000640 1 --2- 172.21.15.103:0/3717980872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99900b2840 0x7f99901fb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.044+0000 7f998e000640 1 -- 172.21.15.103:0/3717980872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99901fbb50 con 0x7f99900d0640 2024-09-10T22:38:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.044+0000 7f998ea00640 1 --2- 172.21.15.103:0/3717980872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99900b2840 0x7f99901fb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:38:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.044+0000 7f998e000640 1 --2- 172.21.15.103:0/3717980872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99900d0640 0x7f9990156bd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f997c009850 tx=0x7f997c003710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.044+0000 7f9986a00640 1 -- 172.21.15.103:0/3717980872 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c0b2040 con 0x7f99900d0640 2024-09-10T22:38:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.044+0000 7f9986a00640 1 -- 172.21.15.103:0/3717980872 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f997c003bf0 con 0x7f99900d0640 2024-09-10T22:38:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.044+0000 7f9995800640 1 -- 172.21.15.103:0/3717980872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99901fbdf0 con 0x7f99900d0640 2024-09-10T22:38:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.044+0000 7f9986a00640 1 -- 172.21.15.103:0/3717980872 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c005020 con 0x7f99900d0640 2024-09-10T22:38:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.044+0000 7f9995800640 1 -- 172.21.15.103:0/3717980872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99901fc3b0 con 0x7f99900d0640 2024-09-10T22:38:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.044+0000 7f9995800640 1 -- 172.21.15.103:0/3717980872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99900c4f30 con 0x7f99900d0640 2024-09-10T22:38:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.044+0000 7f9986a00640 1 -- 172.21.15.103:0/3717980872 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f997c0be030 con 0x7f99900d0640 2024-09-10T22:38:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.044+0000 7f9986a00640 1 --2- 172.21.15.103:0/3717980872 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f99700725e0 0x7f9970074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.048+0000 7f9986a00640 1 -- 172.21.15.103:0/3717980872 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f997c12cd90 con 0x7f99900d0640 2024-09-10T22:38:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.048+0000 7f998ea00640 1 --2- 172.21.15.103:0/3717980872 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f99700725e0 0x7f9970074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.048+0000 7f998ea00640 1 --2- 172.21.15.103:0/3717980872 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f99700725e0 0x7f9970074aa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9980007eb0 tx=0x7f99800073c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:55.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.048+0000 7f9986a00640 1 -- 172.21.15.103:0/3717980872 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f997c0164d0 con 0x7f99900d0640 2024-09-10T22:38:55.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.244+0000 7f9995800640 1 -- 172.21.15.103:0/3717980872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9990070ff0 con 0x7f99900d0640 2024-09-10T22:38:55.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.248+0000 7f9986a00640 1 -- 172.21.15.103:0/3717980872 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5225 (secure 0 0 0) 0x7f997c0f8120 con 0x7f99900d0640 2024-09-10T22:38:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:38:55.249 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":7,"btime":"2024-09-10T22:38:54:871338+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/467299119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":467299119},{"type":"v1","addr":"172.21.15.103:6834","nonce":467299119}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3161095873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3161095873},{"type":"v1","addr":"172.21.15.131:6837","nonce":3161095873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/774650981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":774650981},{"type":"v1","addr":"172.21.15.103:6835","nonce":774650981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:38:49.214867+0000","modified":"2024-09-10T22:38:54.282554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6836/2821479330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2821479330},{"type":"v1","addr":"172.21.15.131:6836","nonce":2821479330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4390,"qdb_cluster":[4390]},"id":1}]} 2024-09-10T22:38:55.249 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 7 2024-09-10T22:38:55.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.248+0000 7f9995800640 1 -- 172.21.15.103:0/3717980872 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f99700725e0 msgr2=0x7f9970074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:55.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.248+0000 7f9995800640 1 --2- 172.21.15.103:0/3717980872 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f99700725e0 0x7f9970074aa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9980007eb0 tx=0x7f99800073c0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.248+0000 7f9995800640 1 -- 172.21.15.103:0/3717980872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99900d0640 msgr2=0x7f9990156bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:55.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.248+0000 7f9995800640 1 --2- 172.21.15.103:0/3717980872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99900d0640 0x7f9990156bd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f997c009850 tx=0x7f997c003710 comp rx=0 tx=0).stop 2024-09-10T22:38:55.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.248+0000 7f9995800640 1 -- 172.21.15.103:0/3717980872 shutdown_connections 2024-09-10T22:38:55.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.248+0000 7f9995800640 1 --2- 172.21.15.103:0/3717980872 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f99700725e0 0x7f9970074aa0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.248+0000 7f9995800640 1 --2- 172.21.15.103:0/3717980872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999015f330 0x7f99901f8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.248+0000 7f9995800640 1 --2- 172.21.15.103:0/3717980872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99900d0640 0x7f9990156bd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.248+0000 7f9995800640 1 --2- 172.21.15.103:0/3717980872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99900b2840 0x7f99901fb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.248+0000 7f9995800640 1 -- 172.21.15.103:0/3717980872 >> 172.21.15.103:0/3717980872 conn(0x7f99900d1ab0 msgr2=0x7f999006e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:55.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.248+0000 7f9995800640 1 -- 172.21.15.103:0/3717980872 shutdown_connections 2024-09-10T22:38:55.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.248+0000 7f9995800640 1 -- 172.21.15.103:0/3717980872 wait complete. 2024-09-10T22:38:55.269 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:38:55.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.408+0000 7f76d6200640 1 -- 172.21.15.103:0/3521168430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d00d23f0 msgr2=0x7f76d0070430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:55.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.408+0000 7f76d6200640 1 --2- 172.21.15.103:0/3521168430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d00d23f0 0x7f76d0070430 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f76d0072e40 tx=0x7f76bc01c770 comp rx=0 tx=0).stop 2024-09-10T22:38:55.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.408+0000 7f76d6200640 1 -- 172.21.15.103:0/3521168430 shutdown_connections 2024-09-10T22:38:55.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.408+0000 7f76d6200640 1 --2- 172.21.15.103:0/3521168430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d00d23f0 0x7f76d0070430 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.408+0000 7f76d6200640 1 --2- 172.21.15.103:0/3521168430 >> v2:172.21.15.131:3300/0 conn(0x7f76d015f0e0 0x7f76d00d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.408+0000 7f76d6200640 1 -- 172.21.15.103:0/3521168430 >> 172.21.15.103:0/3521168430 conn(0x7f76d00d18d0 msgr2=0x7f76d00d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:55.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.408+0000 7f76d6200640 1 -- 172.21.15.103:0/3521168430 shutdown_connections 2024-09-10T22:38:55.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.408+0000 7f76d6200640 1 -- 172.21.15.103:0/3521168430 wait complete. 2024-09-10T22:38:55.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.408+0000 7f76d6200640 1 Processor -- start 2024-09-10T22:38:55.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.408+0000 7f76d6200640 1 -- start start 2024-09-10T22:38:55.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d6200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d0070970 0x7f76d00c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:55.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d6200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76d00d23f0 0x7f76d00c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:55.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d6200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76d015f0e0 0x7f76d00c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:55.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d6200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f76d0168a20 con 0x7f76d0070970 2024-09-10T22:38:55.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d6200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f76d01688a0 con 0x7f76d015f0e0 2024-09-10T22:38:55.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d6200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f76d0168ba0 con 0x7f76d00d23f0 2024-09-10T22:38:55.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d4e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d0070970 0x7f76d00c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:55.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d4e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d0070970 0x7f76d00c7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48930/0 (socket says 172.21.15.103:48930) 2024-09-10T22:38:55.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d4e00640 1 -- 172.21.15.103:0/65944959 learned_addr learned my addr 172.21.15.103:0/65944959 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:55.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76cfe00640 1 --2- 172.21.15.103:0/65944959 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76d00d23f0 0x7f76d00c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:55.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d5800640 1 --2- 172.21.15.103:0/65944959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76d015f0e0 0x7f76d00c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:55.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d4e00640 1 -- 172.21.15.103:0/65944959 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76d00d23f0 msgr2=0x7f76d00c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:55.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d4e00640 1 --2- 172.21.15.103:0/65944959 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76d00d23f0 0x7f76d00c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d4e00640 1 -- 172.21.15.103:0/65944959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76d015f0e0 msgr2=0x7f76d00c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:55.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d4e00640 1 --2- 172.21.15.103:0/65944959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76d015f0e0 0x7f76d00c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d4e00640 1 -- 172.21.15.103:0/65944959 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d00b03d0 con 0x7f76d0070970 2024-09-10T22:38:55.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d5800640 1 --2- 172.21.15.103:0/65944959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76d015f0e0 0x7f76d00c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:38:55.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d4e00640 1 --2- 172.21.15.103:0/65944959 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d0070970 0x7f76d00c7b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f76c400d750 tx=0x7f76c400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:55.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76ccc00640 1 -- 172.21.15.103:0/65944959 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4017070 con 0x7f76d0070970 2024-09-10T22:38:55.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76ccc00640 1 -- 172.21.15.103:0/65944959 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76c4009d20 con 0x7f76d0070970 2024-09-10T22:38:55.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d6200640 1 -- 172.21.15.103:0/65944959 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d00afb30 con 0x7f76d0070970 2024-09-10T22:38:55.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76ccc00640 1 -- 172.21.15.103:0/65944959 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c400de60 con 0x7f76d0070970 2024-09-10T22:38:55.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d6200640 1 -- 172.21.15.103:0/65944959 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d00b00f0 con 0x7f76d0070970 2024-09-10T22:38:55.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.412+0000 7f76d6200640 1 -- 172.21.15.103:0/65944959 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d0070430 con 0x7f76d0070970 2024-09-10T22:38:55.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.416+0000 7f76ccc00640 1 -- 172.21.15.103:0/65944959 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f76c4004280 con 0x7f76d0070970 2024-09-10T22:38:55.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.416+0000 7f76ccc00640 1 --2- 172.21.15.103:0/65944959 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76b00725e0 0x7f76b0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:55.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.416+0000 7f76ccc00640 1 -- 172.21.15.103:0/65944959 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f76c4093920 con 0x7f76d0070970 2024-09-10T22:38:55.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.416+0000 7f76cfe00640 1 --2- 172.21.15.103:0/65944959 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76b00725e0 0x7f76b0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:55.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.416+0000 7f76cfe00640 1 --2- 172.21.15.103:0/65944959 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76b00725e0 0x7f76b0074aa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0af000 tx=0x7f76bc01afb0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:55.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.420+0000 7f76ccc00640 1 -- 172.21.15.103:0/65944959 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f76c4020020 con 0x7f76d0070970 2024-09-10T22:38:55.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.588+0000 7f76d6200640 1 -- 172.21.15.103:0/65944959 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76d006f490 con 0x7f76d0070970 2024-09-10T22:38:55.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.588+0000 7f76ccc00640 1 -- 172.21.15.103:0/65944959 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7f76c405ecb0 con 0x7f76d0070970 2024-09-10T22:38:55.590 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:38:55.590 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":27,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:38:54.282386+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:38:47.154691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:38:48.182281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T22:38:51.874808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:38:55.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.592+0000 7f76d6200640 1 -- 172.21.15.103:0/65944959 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76b00725e0 msgr2=0x7f76b0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:55.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.592+0000 7f76d6200640 1 --2- 172.21.15.103:0/65944959 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76b00725e0 0x7f76b0074aa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0af000 tx=0x7f76bc01afb0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.592+0000 7f76d6200640 1 -- 172.21.15.103:0/65944959 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d0070970 msgr2=0x7f76d00c7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:55.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.592+0000 7f76d6200640 1 --2- 172.21.15.103:0/65944959 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d0070970 0x7f76d00c7b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f76c400d750 tx=0x7f76c400dc10 comp rx=0 tx=0).stop 2024-09-10T22:38:55.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.592+0000 7f76d6200640 1 -- 172.21.15.103:0/65944959 shutdown_connections 2024-09-10T22:38:55.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.592+0000 7f76d6200640 1 --2- 172.21.15.103:0/65944959 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76b00725e0 0x7f76b0074aa0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.592+0000 7f76d6200640 1 --2- 172.21.15.103:0/65944959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76d015f0e0 0x7f76d00c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.592+0000 7f76d6200640 1 --2- 172.21.15.103:0/65944959 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76d00d23f0 0x7f76d00c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.592+0000 7f76d6200640 1 --2- 172.21.15.103:0/65944959 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d0070970 0x7f76d00c7b10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.592+0000 7f76d6200640 1 -- 172.21.15.103:0/65944959 >> 172.21.15.103:0/65944959 conn(0x7f76d00d18d0 msgr2=0x7f76d006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:55.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.592+0000 7f76d6200640 1 -- 172.21.15.103:0/65944959 shutdown_connections 2024-09-10T22:38:55.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.592+0000 7f76d6200640 1 -- 172.21.15.103:0/65944959 wait complete. 2024-09-10T22:38:55.612 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:38:55.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.752+0000 7fda9fe00640 1 -- 172.21.15.103:0/3615382456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa015a950 msgr2=0x7fdaa015adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:55.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.752+0000 7fda9fe00640 1 --2- 172.21.15.103:0/3615382456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa015a950 0x7fdaa015adc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fda88009900 tx=0x7fda8801c8e0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.752+0000 7fda9fe00640 1 -- 172.21.15.103:0/3615382456 shutdown_connections 2024-09-10T22:38:55.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.752+0000 7fda9fe00640 1 --2- 172.21.15.103:0/3615382456 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaa015b300 0x7fdaa00caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.752+0000 7fda9fe00640 1 --2- 172.21.15.103:0/3615382456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa015a950 0x7fdaa015adc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.752+0000 7fda9fe00640 1 -- 172.21.15.103:0/3615382456 >> 172.21.15.103:0/3615382456 conn(0x7fdaa00cfb00 msgr2=0x7fdaa00cff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:55.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.752+0000 7fda9fe00640 1 -- 172.21.15.103:0/3615382456 shutdown_connections 2024-09-10T22:38:55.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.752+0000 7fda9fe00640 1 -- 172.21.15.103:0/3615382456 wait complete. 2024-09-10T22:38:55.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.752+0000 7fda9fe00640 1 Processor -- start 2024-09-10T22:38:55.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.752+0000 7fda9fe00640 1 -- start start 2024-09-10T22:38:55.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9fe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaa015a570 0x7fdaa01545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:55.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa015a950 0x7fdaa014af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:55.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa015b300 0x7fdaa014bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:55.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9fe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa01678e0 con 0x7fdaa015b300 2024-09-10T22:38:55.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9fe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa0167760 con 0x7fdaa015a950 2024-09-10T22:38:55.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9fe00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa0167a60 con 0x7fdaa015a570 2024-09-10T22:38:55.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa015b300 0x7fdaa014bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:55.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa015b300 0x7fdaa014bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48940/0 (socket says 172.21.15.103:48940) 2024-09-10T22:38:55.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9f400640 1 -- 172.21.15.103:0/3080490972 learned_addr learned my addr 172.21.15.103:0/3080490972 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:55.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9f400640 1 -- 172.21.15.103:0/3080490972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaa015a570 msgr2=0x7fdaa01545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:55.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9ea00640 1 --2- 172.21.15.103:0/3080490972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaa015a570 0x7fdaa01545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:55.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda96000640 1 --2- 172.21.15.103:0/3080490972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa015a950 0x7fdaa014af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:55.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9f400640 1 --2- 172.21.15.103:0/3080490972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaa015a570 0x7fdaa01545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9f400640 1 -- 172.21.15.103:0/3080490972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa015a950 msgr2=0x7fdaa014af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:55.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9f400640 1 --2- 172.21.15.103:0/3080490972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa015a950 0x7fdaa014af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9f400640 1 -- 172.21.15.103:0/3080490972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa01faba0 con 0x7fdaa015b300 2024-09-10T22:38:55.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9ea00640 1 --2- 172.21.15.103:0/3080490972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaa015a570 0x7fdaa01545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:38:55.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda96000640 1 --2- 172.21.15.103:0/3080490972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa015a950 0x7fdaa014af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:38:55.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9f400640 1 --2- 172.21.15.103:0/3080490972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa015b300 0x7fdaa014bdc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda9800e970 tx=0x7fda9800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:55.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda97400640 1 -- 172.21.15.103:0/3080490972 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98004d30 con 0x7fdaa015b300 2024-09-10T22:38:55.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda97400640 1 -- 172.21.15.103:0/3080490972 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda9800cac0 con 0x7fdaa015b300 2024-09-10T22:38:55.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda97400640 1 -- 172.21.15.103:0/3080490972 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98005020 con 0x7fdaa015b300 2024-09-10T22:38:55.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9fe00640 1 -- 172.21.15.103:0/3080490972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa0154b30 con 0x7fdaa015b300 2024-09-10T22:38:55.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9fe00640 1 -- 172.21.15.103:0/3080490972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa0156540 con 0x7fdaa015b300 2024-09-10T22:38:55.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.756+0000 7fda9fe00640 1 -- 172.21.15.103:0/3080490972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaa015adc0 con 0x7fdaa015b300 2024-09-10T22:38:55.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.760+0000 7fda97400640 1 -- 172.21.15.103:0/3080490972 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fda9800f040 con 0x7fdaa015b300 2024-09-10T22:38:55.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.760+0000 7fda97400640 1 --2- 172.21.15.103:0/3080490972 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda7c0725e0 0x7fda7c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:55.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.760+0000 7fda97400640 1 -- 172.21.15.103:0/3080490972 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fda98093b20 con 0x7fdaa015b300 2024-09-10T22:38:55.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.760+0000 7fda9ea00640 1 --2- 172.21.15.103:0/3080490972 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda7c0725e0 0x7fda7c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:55.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.760+0000 7fda9ea00640 1 --2- 172.21.15.103:0/3080490972 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda7c0725e0 0x7fda7c074aa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda900016d0 tx=0x7fda90009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:55.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.764+0000 7fda97400640 1 -- 172.21.15.103:0/3080490972 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fda98016030 con 0x7fdaa015b300 2024-09-10T22:38:55.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.932+0000 7fda9fe00640 1 -- 172.21.15.103:0/3080490972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdaa00d0a10 con 0x7fdaa015b300 2024-09-10T22:38:55.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.932+0000 7fda97400640 1 -- 172.21.15.103:0/3080490972 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7fda9805ef50 con 0x7fdaa015b300 2024-09-10T22:38:55.934 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:38:55.934 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":27,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:38:54.282386+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:38:47.154691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:38:48.182281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T22:38:51.874808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:38:55.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.936+0000 7fda9fe00640 1 -- 172.21.15.103:0/3080490972 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda7c0725e0 msgr2=0x7fda7c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:55.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.936+0000 7fda9fe00640 1 --2- 172.21.15.103:0/3080490972 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda7c0725e0 0x7fda7c074aa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda900016d0 tx=0x7fda90009040 comp rx=0 tx=0).stop 2024-09-10T22:38:55.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.936+0000 7fda9fe00640 1 -- 172.21.15.103:0/3080490972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa015b300 msgr2=0x7fdaa014bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:55.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.936+0000 7fda9fe00640 1 --2- 172.21.15.103:0/3080490972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa015b300 0x7fdaa014bdc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda9800e970 tx=0x7fda9800ee30 comp rx=0 tx=0).stop 2024-09-10T22:38:55.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.936+0000 7fda9fe00640 1 -- 172.21.15.103:0/3080490972 shutdown_connections 2024-09-10T22:38:55.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.936+0000 7fda9fe00640 1 --2- 172.21.15.103:0/3080490972 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda7c0725e0 0x7fda7c074aa0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.936+0000 7fda9fe00640 1 --2- 172.21.15.103:0/3080490972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa015b300 0x7fdaa014bdc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.936+0000 7fda9fe00640 1 --2- 172.21.15.103:0/3080490972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa015a950 0x7fdaa014af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.936+0000 7fda9fe00640 1 --2- 172.21.15.103:0/3080490972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaa015a570 0x7fdaa01545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:55.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.936+0000 7fda9fe00640 1 -- 172.21.15.103:0/3080490972 >> 172.21.15.103:0/3080490972 conn(0x7fdaa00cfb00 msgr2=0x7fdaa015c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:55.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.936+0000 7fda9fe00640 1 -- 172.21.15.103:0/3080490972 shutdown_connections 2024-09-10T22:38:55.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:55.936+0000 7fda9fe00640 1 -- 172.21.15.103:0/3080490972 wait complete. 2024-09-10T22:38:55.975 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:38:56.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.116+0000 7f1c21600640 1 -- 172.21.15.103:0/3801677459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c1c0cc130 msgr2=0x7f1c1c0adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:56.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.116+0000 7f1c21600640 1 --2- 172.21.15.103:0/3801677459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c1c0cc130 0x7f1c1c0adba0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009840 tx=0x7f1c0c01c820 comp rx=0 tx=0).stop 2024-09-10T22:38:56.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.116+0000 7f1c21600640 1 -- 172.21.15.103:0/3801677459 shutdown_connections 2024-09-10T22:38:56.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.116+0000 7f1c21600640 1 --2- 172.21.15.103:0/3801677459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1c0ad5f0 0x7f1c1c0b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:56.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.116+0000 7f1c21600640 1 --2- 172.21.15.103:0/3801677459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c1c0cc130 0x7f1c1c0adba0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:56.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.116+0000 7f1c21600640 1 -- 172.21.15.103:0/3801677459 >> 172.21.15.103:0/3801677459 conn(0x7f1c1c0b1c00 msgr2=0x7f1c1c0b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:56.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.116+0000 7f1c21600640 1 -- 172.21.15.103:0/3801677459 shutdown_connections 2024-09-10T22:38:56.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.116+0000 7f1c21600640 1 -- 172.21.15.103:0/3801677459 wait complete. 2024-09-10T22:38:56.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.116+0000 7f1c21600640 1 Processor -- start 2024-09-10T22:38:56.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.116+0000 7f1c21600640 1 -- start start 2024-09-10T22:38:56.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c21600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c06de20 0x7f1c1c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:56.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c21600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1c0ad5f0 0x7f1c1c1591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:56.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c21600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c1c0cc130 0x7f1c1c072dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:56.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c21600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1c1678b0 con 0x7f1c1c06de20 2024-09-10T22:38:56.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c21600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1c167730 con 0x7f1c1c0cc130 2024-09-10T22:38:56.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c21600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1c1c167a30 con 0x7f1c1c0ad5f0 2024-09-10T22:38:56.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c1aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c06de20 0x7f1c1c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:56.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c1aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c06de20 0x7f1c1c15d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48944/0 (socket says 172.21.15.103:48944) 2024-09-10T22:38:56.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c1aa00640 1 -- 172.21.15.103:0/2624281620 learned_addr learned my addr 172.21.15.103:0/2624281620 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:56.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c1a000640 1 --2- 172.21.15.103:0/2624281620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1c0ad5f0 0x7f1c1c1591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:56.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c1b400640 1 --2- 172.21.15.103:0/2624281620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c1c0cc130 0x7f1c1c072dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:56.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c1aa00640 1 -- 172.21.15.103:0/2624281620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1c0ad5f0 msgr2=0x7f1c1c1591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:56.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c1aa00640 1 --2- 172.21.15.103:0/2624281620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1c0ad5f0 0x7f1c1c1591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:56.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c1aa00640 1 -- 172.21.15.103:0/2624281620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c1c0cc130 msgr2=0x7f1c1c072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:56.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c1aa00640 1 --2- 172.21.15.103:0/2624281620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c1c0cc130 0x7f1c1c072dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:56.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c1aa00640 1 -- 172.21.15.103:0/2624281620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c1c159bf0 con 0x7f1c1c06de20 2024-09-10T22:38:56.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c1aa00640 1 --2- 172.21.15.103:0/2624281620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c06de20 0x7f1c1c15d560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009790 tx=0x7f1c0c0a66d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:56.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c12a00640 1 -- 172.21.15.103:0/2624281620 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c004180 con 0x7f1c1c06de20 2024-09-10T22:38:56.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c12a00640 1 -- 172.21.15.103:0/2624281620 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c0c004410 con 0x7f1c1c06de20 2024-09-10T22:38:56.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c21600640 1 -- 172.21.15.103:0/2624281620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c1c15dbf0 con 0x7f1c1c06de20 2024-09-10T22:38:56.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c12a00640 1 -- 172.21.15.103:0/2624281620 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c0052d0 con 0x7f1c1c06de20 2024-09-10T22:38:56.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c21600640 1 -- 172.21.15.103:0/2624281620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c1c0c9670 con 0x7f1c1c06de20 2024-09-10T22:38:56.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c21600640 1 -- 172.21.15.103:0/2624281620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c1c0c91a0 con 0x7f1c1c06de20 2024-09-10T22:38:56.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.120+0000 7f1c12a00640 1 -- 172.21.15.103:0/2624281620 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1c0c005470 con 0x7f1c1c06de20 2024-09-10T22:38:56.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.124+0000 7f1c12a00640 1 --2- 172.21.15.103:0/2624281620 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1bfc0725e0 0x7f1bfc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:56.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.124+0000 7f1c12a00640 1 -- 172.21.15.103:0/2624281620 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1c0c12dc80 con 0x7f1c1c06de20 2024-09-10T22:38:56.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.124+0000 7f1c1a000640 1 --2- 172.21.15.103:0/2624281620 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1bfc0725e0 0x7f1bfc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:56.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.124+0000 7f1c1a000640 1 --2- 172.21.15.103:0/2624281620 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1bfc0725e0 0x7f1bfc074aa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0752a0 tx=0x7f1c08009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:56.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.128+0000 7f1c12a00640 1 -- 172.21.15.103:0/2624281620 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1c0c0c5020 con 0x7f1c1c06de20 2024-09-10T22:38:56.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.324+0000 7f1c21600640 1 -- 172.21.15.103:0/2624281620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c1c0b3550 con 0x7f1c1c06de20 2024-09-10T22:38:56.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.324+0000 7f1c12a00640 1 -- 172.21.15.103:0/2624281620 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5225 (secure 0 0 0) 0x7f1c0c016410 con 0x7f1c1c06de20 2024-09-10T22:38:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:38:56.326 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":7,"btime":"2024-09-10T22:38:54:871338+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/467299119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":467299119},{"type":"v1","addr":"172.21.15.103:6834","nonce":467299119}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3161095873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3161095873},{"type":"v1","addr":"172.21.15.131:6837","nonce":3161095873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/774650981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":774650981},{"type":"v1","addr":"172.21.15.103:6835","nonce":774650981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:38:49.214867+0000","modified":"2024-09-10T22:38:54.282554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6836/2821479330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2821479330},{"type":"v1","addr":"172.21.15.131:6836","nonce":2821479330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4390,"qdb_cluster":[4390]},"id":1}]} 2024-09-10T22:38:56.327 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 7 2024-09-10T22:38:56.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.328+0000 7f1c21600640 1 -- 172.21.15.103:0/2624281620 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1bfc0725e0 msgr2=0x7f1bfc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:56.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.328+0000 7f1c21600640 1 --2- 172.21.15.103:0/2624281620 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1bfc0725e0 0x7f1bfc074aa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0752a0 tx=0x7f1c08009040 comp rx=0 tx=0).stop 2024-09-10T22:38:56.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.328+0000 7f1c21600640 1 -- 172.21.15.103:0/2624281620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c06de20 msgr2=0x7f1c1c15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:56.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.328+0000 7f1c21600640 1 --2- 172.21.15.103:0/2624281620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c06de20 0x7f1c1c15d560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009790 tx=0x7f1c0c0a66d0 comp rx=0 tx=0).stop 2024-09-10T22:38:56.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.328+0000 7f1c21600640 1 -- 172.21.15.103:0/2624281620 shutdown_connections 2024-09-10T22:38:56.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.328+0000 7f1c21600640 1 --2- 172.21.15.103:0/2624281620 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1bfc0725e0 0x7f1bfc074aa0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:56.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.328+0000 7f1c21600640 1 --2- 172.21.15.103:0/2624281620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c1c0cc130 0x7f1c1c072dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:56.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.328+0000 7f1c21600640 1 --2- 172.21.15.103:0/2624281620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1c0ad5f0 0x7f1c1c1591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:56.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.328+0000 7f1c21600640 1 --2- 172.21.15.103:0/2624281620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c06de20 0x7f1c1c15d560 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:56.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.328+0000 7f1c21600640 1 -- 172.21.15.103:0/2624281620 >> 172.21.15.103:0/2624281620 conn(0x7f1c1c0b1c00 msgr2=0x7f1c1c0caa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:56.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.328+0000 7f1c21600640 1 -- 172.21.15.103:0/2624281620 shutdown_connections 2024-09-10T22:38:56.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.328+0000 7f1c21600640 1 -- 172.21.15.103:0/2624281620 wait complete. 2024-09-10T22:38:56.347 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:38:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.484+0000 7f326ac00640 1 -- 172.21.15.103:0/3168779978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32640cf260 msgr2=0x7f32640cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.484+0000 7f326ac00640 1 --2- 172.21.15.103:0/3168779978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32640cf260 0x7f32640cf800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3254009840 tx=0x7f325401c820 comp rx=0 tx=0).stop 2024-09-10T22:38:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f326ac00640 1 -- 172.21.15.103:0/3168779978 shutdown_connections 2024-09-10T22:38:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f326ac00640 1 --2- 172.21.15.103:0/3168779978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32640cf260 0x7f32640cf800 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f326ac00640 1 -- 172.21.15.103:0/3168779978 >> 172.21.15.103:0/3168779978 conn(0x7f326406cc00 msgr2=0x7f326406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f326ac00640 1 -- 172.21.15.103:0/3168779978 shutdown_connections 2024-09-10T22:38:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f326ac00640 1 -- 172.21.15.103:0/3168779978 wait complete. 2024-09-10T22:38:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f326ac00640 1 Processor -- start 2024-09-10T22:38:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f326ac00640 1 -- start start 2024-09-10T22:38:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f326ac00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3264072500 0x7f32641f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f326ac00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32640b2c10 0x7f32640af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f326ac00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32640cf260 0x7f326414b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f326ac00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3264168c40 con 0x7f3264072500 2024-09-10T22:38:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f326ac00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3264157e40 con 0x7f32640cf260 2024-09-10T22:38:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f326ac00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3264168dc0 con 0x7f32640b2c10 2024-09-10T22:38:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f3263e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3264072500 0x7f32641f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f3263e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3264072500 0x7f32641f7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48970/0 (socket says 172.21.15.103:48970) 2024-09-10T22:38:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f3263e00640 1 -- 172.21.15.103:0/1472759503 learned_addr learned my addr 172.21.15.103:0/1472759503 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f325b400640 1 --2- 172.21.15.103:0/1472759503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32640b2c10 0x7f32640af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f3268c00640 1 --2- 172.21.15.103:0/1472759503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32640cf260 0x7f326414b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f3263e00640 1 -- 172.21.15.103:0/1472759503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32640b2c10 msgr2=0x7f32640af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f3263e00640 1 --2- 172.21.15.103:0/1472759503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32640b2c10 0x7f32640af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f3263e00640 1 -- 172.21.15.103:0/1472759503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32640cf260 msgr2=0x7f326414b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f3263e00640 1 --2- 172.21.15.103:0/1472759503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32640cf260 0x7f326414b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f3263e00640 1 -- 172.21.15.103:0/1472759503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32641f8550 con 0x7f3264072500 2024-09-10T22:38:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f3263e00640 1 --2- 172.21.15.103:0/1472759503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3264072500 0x7f32641f7cd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3254009790 tx=0x7f3254004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:56.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.488+0000 7f3260c00640 1 -- 172.21.15.103:0/1472759503 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32540be070 con 0x7f3264072500 2024-09-10T22:38:56.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.492+0000 7f3260c00640 1 -- 172.21.15.103:0/1472759503 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3254005070 con 0x7f3264072500 2024-09-10T22:38:56.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.492+0000 7f3260c00640 1 -- 172.21.15.103:0/1472759503 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3254005460 con 0x7f3264072500 2024-09-10T22:38:56.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.492+0000 7f326ac00640 1 -- 172.21.15.103:0/1472759503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32641f8830 con 0x7f3264072500 2024-09-10T22:38:56.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.492+0000 7f326ac00640 1 -- 172.21.15.103:0/1472759503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32641f8210 con 0x7f3264072500 2024-09-10T22:38:56.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.492+0000 7f326ac00640 1 -- 172.21.15.103:0/1472759503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32640cf800 con 0x7f3264072500 2024-09-10T22:38:56.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.492+0000 7f3260c00640 1 -- 172.21.15.103:0/1472759503 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f32540046d0 con 0x7f3264072500 2024-09-10T22:38:56.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.492+0000 7f3260c00640 1 --2- 172.21.15.103:0/1472759503 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f32400725e0 0x7f3240074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:56.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.492+0000 7f3260c00640 1 -- 172.21.15.103:0/1472759503 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f325412dcf0 con 0x7f3264072500 2024-09-10T22:38:56.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.492+0000 7f325b400640 1 --2- 172.21.15.103:0/1472759503 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f32400725e0 0x7f3240074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:56.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.496+0000 7f325b400640 1 --2- 172.21.15.103:0/1472759503 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f32400725e0 0x7f3240074aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f326414b2a0 tx=0x7f324c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:56.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.496+0000 7f3260c00640 1 -- 172.21.15.103:0/1472759503 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3254016410 con 0x7f3264072500 2024-09-10T22:38:56.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.664+0000 7f326ac00640 1 -- 172.21.15.103:0/1472759503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f326406ff30 con 0x7f3264072500 2024-09-10T22:38:56.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.664+0000 7f3260c00640 1 -- 172.21.15.103:0/1472759503 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7f32540f9080 con 0x7f3264072500 2024-09-10T22:38:56.666 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:38:56.667 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":27,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:38:54.282386+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:38:47.154691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:38:48.182281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T22:38:51.874808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:38:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.668+0000 7f326ac00640 1 -- 172.21.15.103:0/1472759503 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f32400725e0 msgr2=0x7f3240074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.668+0000 7f326ac00640 1 --2- 172.21.15.103:0/1472759503 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f32400725e0 0x7f3240074aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f326414b2a0 tx=0x7f324c009040 comp rx=0 tx=0).stop 2024-09-10T22:38:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.668+0000 7f326ac00640 1 -- 172.21.15.103:0/1472759503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3264072500 msgr2=0x7f32641f7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.668+0000 7f326ac00640 1 --2- 172.21.15.103:0/1472759503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3264072500 0x7f32641f7cd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3254009790 tx=0x7f3254004040 comp rx=0 tx=0).stop 2024-09-10T22:38:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.668+0000 7f326ac00640 1 -- 172.21.15.103:0/1472759503 shutdown_connections 2024-09-10T22:38:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.668+0000 7f326ac00640 1 --2- 172.21.15.103:0/1472759503 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f32400725e0 0x7f3240074aa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.668+0000 7f326ac00640 1 --2- 172.21.15.103:0/1472759503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32640cf260 0x7f326414b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.668+0000 7f326ac00640 1 --2- 172.21.15.103:0/1472759503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32640b2c10 0x7f32640af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:56.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.668+0000 7f326ac00640 1 --2- 172.21.15.103:0/1472759503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3264072500 0x7f32641f7cd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:56.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.668+0000 7f326ac00640 1 -- 172.21.15.103:0/1472759503 >> 172.21.15.103:0/1472759503 conn(0x7f326406cc00 msgr2=0x7f326406e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:56.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.668+0000 7f326ac00640 1 -- 172.21.15.103:0/1472759503 shutdown_connections 2024-09-10T22:38:56.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:56.668+0000 7f326ac00640 1 -- 172.21.15.103:0/1472759503 wait complete. 2024-09-10T22:38:57.090 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:38:49.214867+0000', 'modified': '2024-09-10T22:38:54.282554+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4390}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4390': {'gid': 4390, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.131:6836/2821479330', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6834', 'nonce': 2821479330}, {'type': 'v1', 'addr': '172.21.15.131:6836', 'nonce': 2821479330}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4390, 'qdb_cluster': [4390]} 2024-09-10T22:38:57.090 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T22:38:57.090 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-10T22:38:57.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.236+0000 7f81d0a00640 1 -- 172.21.15.103:0/209438610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81b0004810 msgr2=0x7f81b0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:57.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.236+0000 7f81d0a00640 1 --2- 172.21.15.103:0/209438610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81b0004810 0x7f81b0004c90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f81b400c2e0 tx=0x7f81b401f6a0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.236+0000 7f81d0a00640 1 -- 172.21.15.103:0/209438610 shutdown_connections 2024-09-10T22:38:57.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.236+0000 7f81d0a00640 1 --2- 172.21.15.103:0/209438610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81b0004810 0x7f81b0004c90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.236+0000 7f81d0a00640 1 -- 172.21.15.103:0/209438610 >> 172.21.15.103:0/209438610 conn(0x7f81cc0b1c00 msgr2=0x7f81cc0b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:57.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.236+0000 7f81d0a00640 1 -- 172.21.15.103:0/209438610 shutdown_connections 2024-09-10T22:38:57.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.236+0000 7f81d0a00640 1 -- 172.21.15.103:0/209438610 wait complete. 2024-09-10T22:38:57.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.236+0000 7f81d0a00640 1 Processor -- start 2024-09-10T22:38:57.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.236+0000 7f81d0a00640 1 -- start start 2024-09-10T22:38:57.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.236+0000 7f81d0a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81b0004810 0x7f81cc0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.236+0000 7f81d0a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81cc1f5210 0x7f81cc15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.236+0000 7f81d0a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81cc15e410 0x7f81cc0c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.236+0000 7f81d0a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc0cc970 con 0x7f81cc1f5210 2024-09-10T22:38:57.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.236+0000 7f81d0a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc0ae440 con 0x7f81b0004810 2024-09-10T22:38:57.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.236+0000 7f81d0a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f81cc0ccaf0 con 0x7f81cc15e410 2024-09-10T22:38:57.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.240+0000 7f81c1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81cc1f5210 0x7f81cc15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.240+0000 7f81c1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81cc1f5210 0x7f81cc15ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46862/0 (socket says 172.21.15.103:46862) 2024-09-10T22:38:57.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.240+0000 7f81c1400640 1 -- 172.21.15.103:0/4280597487 learned_addr learned my addr 172.21.15.103:0/4280597487 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:57.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.240+0000 7f81c9e00640 1 --2- 172.21.15.103:0/4280597487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81b0004810 0x7f81cc0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.240+0000 7f81ca800640 1 --2- 172.21.15.103:0/4280597487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81cc15e410 0x7f81cc0c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.240+0000 7f81c1400640 1 -- 172.21.15.103:0/4280597487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81cc15e410 msgr2=0x7f81cc0c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:57.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.240+0000 7f81c1400640 1 --2- 172.21.15.103:0/4280597487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81cc15e410 0x7f81cc0c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.240+0000 7f81c1400640 1 -- 172.21.15.103:0/4280597487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81b0004810 msgr2=0x7f81cc0c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:57.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.240+0000 7f81c1400640 1 --2- 172.21.15.103:0/4280597487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81b0004810 0x7f81cc0c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.240+0000 7f81c1400640 1 -- 172.21.15.103:0/4280597487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81cc1f5750 con 0x7f81cc1f5210 2024-09-10T22:38:57.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.240+0000 7f81c1400640 1 --2- 172.21.15.103:0/4280597487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81cc1f5210 0x7f81cc15ded0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f81b40263b0 tx=0x7f81b4001d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:57.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.240+0000 7f81c2a00640 1 -- 172.21.15.103:0/4280597487 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b40b3040 con 0x7f81cc1f5210 2024-09-10T22:38:57.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.240+0000 7f81c2a00640 1 -- 172.21.15.103:0/4280597487 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81b40bd070 con 0x7f81cc1f5210 2024-09-10T22:38:57.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.240+0000 7f81c2a00640 1 -- 172.21.15.103:0/4280597487 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4003860 con 0x7f81cc1f5210 2024-09-10T22:38:57.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.240+0000 7f81d0a00640 1 -- 172.21.15.103:0/4280597487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81cc0c3e70 con 0x7f81cc1f5210 2024-09-10T22:38:57.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.240+0000 7f81d0a00640 1 -- 172.21.15.103:0/4280597487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81cc09de00 con 0x7f81cc1f5210 2024-09-10T22:38:57.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.240+0000 7f81c2a00640 1 -- 172.21.15.103:0/4280597487 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f81b4003a00 con 0x7f81cc1f5210 2024-09-10T22:38:57.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81c2a00640 1 --2- 172.21.15.103:0/4280597487 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f81a8072610 0x7f81a8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81c2a00640 1 -- 172.21.15.103:0/4280597487 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f81b41310c0 con 0x7f81cc1f5210 2024-09-10T22:38:57.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81d3e36000 1 Processor -- start 2024-09-10T22:38:57.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81c9e00640 1 --2- 172.21.15.103:0/4280597487 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f81a8072610 0x7f81a8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81d3e36000 1 -- start start 2024-09-10T22:38:57.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81c9e00640 1 --2- 172.21.15.103:0/4280597487 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f81a8072610 0x7f81a8074ad0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f81bc006fd0 tx=0x7f81bc006a70 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:57.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81d3e36000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af49d0 0x560da9af4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81d3e36000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9af52f0 0x560da9aa88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81d3e36000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 0x560da9aa91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81d3e36000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560da99c93f0 con 0x560da9aa8e10 2024-09-10T22:38:57.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81d3e36000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560da9906b20 con 0x560da9af49d0 2024-09-10T22:38:57.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81d3e36000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560da98f5f50 con 0x560da9af52f0 2024-09-10T22:38:57.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81ca800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 0x560da9aa91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81ca800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 0x560da9aa91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46876/0 (socket says 172.21.15.103:46876) 2024-09-10T22:38:57.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81ca800640 1 -- 172.21.15.103:0/2125822004 learned_addr learned my addr 172.21.15.103:0/2125822004 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:57.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81c1400640 1 --2- 172.21.15.103:0/2125822004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9af52f0 0x560da9aa88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81c9e00640 1 --2- 172.21.15.103:0/2125822004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af49d0 0x560da9af4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81ca800640 1 -- 172.21.15.103:0/2125822004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9af52f0 msgr2=0x560da9aa88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:38:57.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81ca800640 1 --2- 172.21.15.103:0/2125822004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9af52f0 0x560da9aa88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81ca800640 1 -- 172.21.15.103:0/2125822004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af49d0 msgr2=0x560da9af4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:38:57.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81ca800640 1 --2- 172.21.15.103:0/2125822004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af49d0 0x560da9af4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81ca800640 1 -- 172.21.15.103:0/2125822004 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560da98bd590 con 0x560da9aa8e10 2024-09-10T22:38:57.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81ca800640 1 --2- 172.21.15.103:0/2125822004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 0x560da9aa91f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f81cc072ca0 tx=0x7f81c4003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c31f610775c5350 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:57.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81baa00640 1 -- 172.21.15.103:0/2125822004 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c4004710 con 0x560da9aa8e10 2024-09-10T22:38:57.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81baa00640 1 -- 172.21.15.103:0/2125822004 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81c401b440 con 0x560da9aa8e10 2024-09-10T22:38:57.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.244+0000 7f81baa00640 1 -- 172.21.15.103:0/2125822004 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c401b850 con 0x560da9aa8e10 2024-09-10T22:38:57.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81d3e36000 1 -- 172.21.15.103:0/2125822004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 msgr2=0x560da9aa91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:57.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81d3e36000 1 --2- 172.21.15.103:0/2125822004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 0x560da9aa91f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f81cc072ca0 tx=0x7f81c4003d50 comp rx=0 tx=0).stop 2024-09-10T22:38:57.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81d3e36000 1 -- 172.21.15.103:0/2125822004 shutdown_connections 2024-09-10T22:38:57.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81d3e36000 1 --2- 172.21.15.103:0/2125822004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 0x560da9aa91f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81d3e36000 1 --2- 172.21.15.103:0/2125822004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9af52f0 0x560da9aa88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81d3e36000 1 --2- 172.21.15.103:0/2125822004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af49d0 0x560da9af4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81d3e36000 1 -- 172.21.15.103:0/2125822004 >> 172.21.15.103:0/2125822004 conn(0x560da9992130 msgr2=0x560da9ad7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:57.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81d3e36000 1 -- 172.21.15.103:0/2125822004 shutdown_connections 2024-09-10T22:38:57.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81d3e36000 1 -- 172.21.15.103:0/2125822004 wait complete. 2024-09-10T22:38:57.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81d3e36000 1 -- start start 2024-09-10T22:38:57.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81d3e36000 1 Processor -- start 2024-09-10T22:38:57.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81d3e36000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9aa8e10 0x560da9ad56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81d3e36000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9af49d0 0x560da9ad5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81d3e36000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af52f0 0x560da9ad63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81d3e36000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560da98905d0 con 0x560da9af49d0 2024-09-10T22:38:57.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81d3e36000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560da98f9d60 con 0x560da9af52f0 2024-09-10T22:38:57.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81d3e36000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560da989c500 con 0x560da9aa8e10 2024-09-10T22:38:57.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81d3e36000 10 client.0 _ll_register_callbacks cb 0x560da98a0810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:38:57.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81c1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9af49d0 0x560da9ad5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81c1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9af49d0 0x560da9ad5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46878/0 (socket says 172.21.15.103:46878) 2024-09-10T22:38:57.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81c1400640 1 -- 172.21.15.103:0/2040222578 learned_addr learned my addr 172.21.15.103:0/2040222578 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:57.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81c9e00640 1 --2- 172.21.15.103:0/2040222578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9aa8e10 0x560da9ad56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81ca800640 1 --2- 172.21.15.103:0/2040222578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af52f0 0x560da9ad63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81c1400640 1 -- 172.21.15.103:0/2040222578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9aa8e10 msgr2=0x560da9ad56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:38:57.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81c1400640 1 --2- 172.21.15.103:0/2040222578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9aa8e10 0x560da9ad56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81c1400640 1 -- 172.21.15.103:0/2040222578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af52f0 msgr2=0x560da9ad63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:38:57.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81c1400640 1 --2- 172.21.15.103:0/2040222578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af52f0 0x560da9ad63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81c1400640 1 -- 172.21.15.103:0/2040222578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560da9894170 con 0x560da9af49d0 2024-09-10T22:38:57.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81c1400640 1 --2- 172.21.15.103:0/2040222578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9af49d0 0x560da9ad5e70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f81b40fb9c0 tx=0x7f81b40fba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9acb9404ed5ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:57.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.248+0000 7f81af400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:38:57.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81af400640 1 -- 172.21.15.103:0/2040222578 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b40fb430 con 0x560da9af49d0 2024-09-10T22:38:57.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 1 -- 172.21.15.103:0/2040222578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560da988e0f0 con 0x560da9af49d0 2024-09-10T22:38:57.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81af400640 1 -- 172.21.15.103:0/2040222578 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f81b40e9170 con 0x560da9af49d0 2024-09-10T22:38:57.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81af400640 1 -- 172.21.15.103:0/2040222578 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f81b40fb7d0 con 0x560da9af49d0 2024-09-10T22:38:57.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 10 client.4446 fetch_fsmap learned FSMap version 7 2024-09-10T22:38:57.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 1 -- 172.21.15.103:0/2040222578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x560da997aef0 con 0x560da9af49d0 2024-09-10T22:38:57.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81af400640 1 -- 172.21.15.103:0/2040222578 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560da988e0f0 con 0x560da9af49d0 2024-09-10T22:38:57.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81af400640 1 -- 172.21.15.103:0/2040222578 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f81b40faf20 con 0x560da9af49d0 2024-09-10T22:38:57.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 10 client.4446 fetch_fsmap finished waiting for FSMap version 7 2024-09-10T22:38:57.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 10 client.4446 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T22:38:57.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 20 client.4446 populate_metadata read hostname 'smithi103' 2024-09-10T22:38:57.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 1 --2- 172.21.15.103:0/2040222578 >> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] conn(0x560da9ad70f0 0x560da9b06c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 4 client.4446 mds_command: new command op to 4390 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:38:57.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 1 -- 172.21.15.103:0/2040222578 --> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560da9908a70 con 0x560da9ad70f0 2024-09-10T22:38:57.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81c9e00640 1 --2- 172.21.15.103:0/2040222578 >> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] conn(0x560da9ad70f0 0x560da9b06c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81c9e00640 1 --2- 172.21.15.103:0/2040222578 >> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] conn(0x560da9ad70f0 0x560da9b06c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=365ec91d3850f619 server_cookie=eead5bf2342d30e9 in_seq=0 out_seq=0 2024-09-10T22:38:57.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81af400640 10 client.4446 ms_handle_connect on v2:172.21.15.131:6834/2821479330 2024-09-10T22:38:57.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81af400640 1 -- 172.21.15.103:0/2040222578 <== mds.0 v2:172.21.15.131:6834/2821479330 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560da9908a70 con 0x560da9ad70f0 2024-09-10T22:38:57.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81af400640 10 client.4446 handle_command_reply: tid=0 2024-09-10T22:38:57.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 1 client.4446 shutdown 2024-09-10T22:38:57.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 1 -- 172.21.15.103:0/2040222578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9af49d0 msgr2=0x560da9ad5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:57.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 1 --2- 172.21.15.103:0/2040222578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9af49d0 0x560da9ad5e70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f81b40fb9c0 tx=0x7f81b40fba90 comp rx=0 tx=0).stop 2024-09-10T22:38:57.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 1 -- 172.21.15.103:0/2040222578 shutdown_connections 2024-09-10T22:38:57.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 1 --2- 172.21.15.103:0/2040222578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af52f0 0x560da9ad63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 1 --2- 172.21.15.103:0/2040222578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9af49d0 0x560da9ad5e70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 1 --2- 172.21.15.103:0/2040222578 >> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] conn(0x560da9ad70f0 0x560da9b06c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 1 --2- 172.21.15.103:0/2040222578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9aa8e10 0x560da9ad56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 1 -- 172.21.15.103:0/2040222578 >> 172.21.15.103:0/2040222578 conn(0x560da9992130 msgr2=0x560da9aa7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:57.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81af400640 0 client.4446 ms_handle_reset on v2:172.21.15.131:6834/2821479330 2024-09-10T22:38:57.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 1 -- 172.21.15.103:0/2040222578 shutdown_connections 2024-09-10T22:38:57.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 1 -- 172.21.15.103:0/2040222578 wait complete. 2024-09-10T22:38:57.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.252+0000 7f81d3e36000 20 client.4446 trim_cache size 0 max 16384 2024-09-10T22:38:57.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81d3e36000 1 Processor -- start 2024-09-10T22:38:57.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81d3e36000 1 -- start start 2024-09-10T22:38:57.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81d3e36000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 0x560da9b66bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81d3e36000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af49d0 0x560da9b67100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81d3e36000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9af52f0 0x560da9b67640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81d3e36000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc202aa0 con 0x560da9aa8e10 2024-09-10T22:38:57.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81d3e36000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc201aa0 con 0x560da9af49d0 2024-09-10T22:38:57.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81d3e36000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f81cc0c8810 con 0x560da9af52f0 2024-09-10T22:38:57.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81c9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 0x560da9b66bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81c9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 0x560da9b66bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46890/0 (socket says 172.21.15.103:46890) 2024-09-10T22:38:57.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81c9e00640 1 -- 172.21.15.103:0/4006430060 learned_addr learned my addr 172.21.15.103:0/4006430060 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:57.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81c9e00640 1 -- 172.21.15.103:0/4006430060 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9af52f0 msgr2=0x560da9b67640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:38:57.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81c1400640 1 --2- 172.21.15.103:0/4006430060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af49d0 0x560da9b67100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81c9e00640 1 --2- 172.21.15.103:0/4006430060 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9af52f0 0x560da9b67640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81c9e00640 1 -- 172.21.15.103:0/4006430060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af49d0 msgr2=0x560da9b67100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:38:57.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81c9e00640 1 --2- 172.21.15.103:0/4006430060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af49d0 0x560da9b67100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81c9e00640 1 -- 172.21.15.103:0/4006430060 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560da9951d90 con 0x560da9aa8e10 2024-09-10T22:38:57.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81c1400640 1 --2- 172.21.15.103:0/4006430060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af49d0 0x560da9b67100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:38:57.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81c9e00640 1 --2- 172.21.15.103:0/4006430060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 0x560da9b66bc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0068c0 tx=0x7f81bc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934f17b18dff1074 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:57.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81ba000640 1 -- 172.21.15.103:0/4006430060 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc020a20 con 0x560da9aa8e10 2024-09-10T22:38:57.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81ba000640 1 -- 172.21.15.103:0/4006430060 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81bc020bc0 con 0x560da9aa8e10 2024-09-10T22:38:57.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.272+0000 7f81ba000640 1 -- 172.21.15.103:0/4006430060 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc020df0 con 0x560da9aa8e10 2024-09-10T22:38:57.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 -- 172.21.15.103:0/4006430060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 msgr2=0x560da9b66bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:57.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 --2- 172.21.15.103:0/4006430060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 0x560da9b66bc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0068c0 tx=0x7f81bc012000 comp rx=0 tx=0).stop 2024-09-10T22:38:57.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 -- 172.21.15.103:0/4006430060 shutdown_connections 2024-09-10T22:38:57.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 --2- 172.21.15.103:0/4006430060 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9af52f0 0x560da9b67640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 --2- 172.21.15.103:0/4006430060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af49d0 0x560da9b67100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 --2- 172.21.15.103:0/4006430060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 0x560da9b66bc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 -- 172.21.15.103:0/4006430060 >> 172.21.15.103:0/4006430060 conn(0x560da9992130 msgr2=0x560da9b01fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:57.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 -- 172.21.15.103:0/4006430060 shutdown_connections 2024-09-10T22:38:57.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 -- 172.21.15.103:0/4006430060 wait complete. 2024-09-10T22:38:57.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 -- start start 2024-09-10T22:38:57.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 Processor -- start 2024-09-10T22:38:57.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 0x560da9b08790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af49d0 0x560da9b08cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9af52f0 0x560da9b09210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560da98f9d60 con 0x560da9aa8e10 2024-09-10T22:38:57.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc201450 con 0x560da9af49d0 2024-09-10T22:38:57.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560da98905d0 con 0x560da9af52f0 2024-09-10T22:38:57.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 10 client.0 _ll_register_callbacks cb 0x7f81b40f8310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:38:57.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81c9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 0x560da9b08790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81c9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 0x560da9b08790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46896/0 (socket says 172.21.15.103:46896) 2024-09-10T22:38:57.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81c9e00640 1 -- 172.21.15.103:0/2777391560 learned_addr learned my addr 172.21.15.103:0/2777391560 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:57.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81c1400640 1 --2- 172.21.15.103:0/2777391560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af49d0 0x560da9b08cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81ca800640 1 --2- 172.21.15.103:0/2777391560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9af52f0 0x560da9b09210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81c9e00640 1 -- 172.21.15.103:0/2777391560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9af52f0 msgr2=0x560da9b09210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:38:57.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81c9e00640 1 --2- 172.21.15.103:0/2777391560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9af52f0 0x560da9b09210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81c9e00640 1 -- 172.21.15.103:0/2777391560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af49d0 msgr2=0x560da9b08cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:38:57.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81c9e00640 1 --2- 172.21.15.103:0/2777391560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af49d0 0x560da9b08cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81c9e00640 1 -- 172.21.15.103:0/2777391560 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560da98bca90 con 0x560da9aa8e10 2024-09-10T22:38:57.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81c9e00640 1 --2- 172.21.15.103:0/2777391560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 0x560da9b08790 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f81bc006340 tx=0x7f81bc020aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a79d814a0cba24b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:57.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81af400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:38:57.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81af400640 1 -- 172.21.15.103:0/2777391560 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc03e020 con 0x560da9aa8e10 2024-09-10T22:38:57.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81af400640 1 -- 172.21.15.103:0/2777391560 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f81bc030940 con 0x560da9aa8e10 2024-09-10T22:38:57.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 -- 172.21.15.103:0/2777391560 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81bc020bc0 con 0x560da9aa8e10 2024-09-10T22:38:57.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81af400640 1 -- 172.21.15.103:0/2777391560 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f81bc048050 con 0x560da9aa8e10 2024-09-10T22:38:57.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 10 client.4452 fetch_fsmap learned FSMap version 7 2024-09-10T22:38:57.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81d3e36000 1 -- 172.21.15.103:0/2777391560 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x560da989b050 con 0x560da9aa8e10 2024-09-10T22:38:57.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81af400640 1 -- 172.21.15.103:0/2777391560 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81bc020bc0 con 0x560da9aa8e10 2024-09-10T22:38:57.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.276+0000 7f81af400640 1 -- 172.21.15.103:0/2777391560 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f81bc04b020 con 0x560da9aa8e10 2024-09-10T22:38:57.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d3e36000 10 client.4452 fetch_fsmap finished waiting for FSMap version 7 2024-09-10T22:38:57.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d3e36000 10 client.4452 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T22:38:57.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d3e36000 20 client.4452 populate_metadata read hostname 'smithi103' 2024-09-10T22:38:57.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d3e36000 1 --2- 172.21.15.103:0/2777391560 >> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] conn(0x560da9b70c30 0x560da9b73020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d3e36000 4 client.4452 mds_command: new command op to 4390 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:38:57.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d3e36000 1 -- 172.21.15.103:0/2777391560 --> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] -- command(tid 0: {"prefix": "status"}) -- 0x560da9904520 con 0x560da9b70c30 2024-09-10T22:38:57.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81c1400640 1 --2- 172.21.15.103:0/2777391560 >> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] conn(0x560da9b70c30 0x560da9b73020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81c1400640 1 --2- 172.21.15.103:0/2777391560 >> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] conn(0x560da9b70c30 0x560da9b73020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92a38b569395ec76 server_cookie=cd0241e6ea63a48d in_seq=0 out_seq=0 2024-09-10T22:38:57.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81af400640 10 client.4452 ms_handle_connect on v2:172.21.15.131:6834/2821479330 2024-09-10T22:38:57.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81af400640 1 -- 172.21.15.103:0/2777391560 <== mds.0 v2:172.21.15.131:6834/2821479330 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x560da9904520 con 0x560da9b70c30 2024-09-10T22:38:57.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81af400640 10 client.4452 handle_command_reply: tid=0 2024-09-10T22:38:57.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d3e36000 1 client.4452 shutdown 2024-09-10T22:38:57.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d3e36000 1 -- 172.21.15.103:0/2777391560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 msgr2=0x560da9b08790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:57.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d3e36000 1 --2- 172.21.15.103:0/2777391560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 0x560da9b08790 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f81bc006340 tx=0x7f81bc020aa0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d3e36000 1 -- 172.21.15.103:0/2777391560 shutdown_connections 2024-09-10T22:38:57.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d3e36000 1 --2- 172.21.15.103:0/2777391560 >> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] conn(0x560da9b70c30 0x560da9b73020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d3e36000 1 --2- 172.21.15.103:0/2777391560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560da9af52f0 0x560da9b09210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d3e36000 1 --2- 172.21.15.103:0/2777391560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da9af49d0 0x560da9b08cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d3e36000 1 --2- 172.21.15.103:0/2777391560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560da9aa8e10 0x560da9b08790 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d3e36000 1 -- 172.21.15.103:0/2777391560 >> 172.21.15.103:0/2777391560 conn(0x560da9992130 msgr2=0x560da9ab0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:57.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81af400640 0 client.4452 ms_handle_reset on v2:172.21.15.131:6834/2821479330 2024-09-10T22:38:57.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d3e36000 1 -- 172.21.15.103:0/2777391560 shutdown_connections 2024-09-10T22:38:57.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d3e36000 1 -- 172.21.15.103:0/2777391560 wait complete. 2024-09-10T22:38:57.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d3e36000 20 client.4452 trim_cache size 0 max 16384 2024-09-10T22:38:57.286 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:38:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:38:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-10T22:38:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4390, 2024-09-10T22:38:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:38:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:38:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:38:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 7.4338333539999999, 2024-09-10T22:38:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 7, 2024-09-10T22:38:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 27, 2024-09-10T22:38:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 26, 2024-09-10T22:38:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 13.474652052 2024-09-10T22:38:57.287 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:38:57.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d0a00640 1 -- 172.21.15.103:0/4280597487 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f81a8072610 msgr2=0x7f81a8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:57.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d0a00640 1 --2- 172.21.15.103:0/4280597487 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f81a8072610 0x7f81a8074ad0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f81bc006fd0 tx=0x7f81bc006a70 comp rx=0 tx=0).stop 2024-09-10T22:38:57.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d0a00640 1 -- 172.21.15.103:0/4280597487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81cc1f5210 msgr2=0x7f81cc15ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:57.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d0a00640 1 --2- 172.21.15.103:0/4280597487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81cc1f5210 0x7f81cc15ded0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f81b40263b0 tx=0x7f81b4001d90 comp rx=0 tx=0).stop 2024-09-10T22:38:57.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d0a00640 1 -- 172.21.15.103:0/4280597487 shutdown_connections 2024-09-10T22:38:57.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d0a00640 1 --2- 172.21.15.103:0/4280597487 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f81a8072610 0x7f81a8074ad0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d0a00640 1 --2- 172.21.15.103:0/4280597487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81cc15e410 0x7f81cc0c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d0a00640 1 --2- 172.21.15.103:0/4280597487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81cc1f5210 0x7f81cc15ded0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d0a00640 1 --2- 172.21.15.103:0/4280597487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81b0004810 0x7f81cc0c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d0a00640 1 -- 172.21.15.103:0/4280597487 >> 172.21.15.103:0/4280597487 conn(0x7f81cc0b1c00 msgr2=0x7f81cc0cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:57.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d0a00640 1 -- 172.21.15.103:0/4280597487 shutdown_connections 2024-09-10T22:38:57.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.280+0000 7f81d0a00640 1 -- 172.21.15.103:0/4280597487 wait complete. 2024-09-10T22:38:57.301 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T22:38:57.301 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-10T22:38:57.302 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T22:38:57.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.440+0000 7fd31a200640 1 -- 172.21.15.103:0/805388297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f8004030 msgr2=0x7fd2f8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:57.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.440+0000 7fd31a200640 1 --2- 172.21.15.103:0/805388297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f8004030 0x7fd2f8004810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd300009b60 tx=0x7fd30001d2b0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.440+0000 7fd313e00640 1 -- 172.21.15.103:0/805388297 reap_dead start 2024-09-10T22:38:57.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.440+0000 7fd31a200640 1 -- 172.21.15.103:0/805388297 shutdown_connections 2024-09-10T22:38:57.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.440+0000 7fd31a200640 1 -- 172.21.15.103:0/805388297 >> 172.21.15.103:0/805388297 conn(0x7fd3140d1ac0 msgr2=0x7fd3140d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:57.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.440+0000 7fd31a200640 1 -- 172.21.15.103:0/805388297 shutdown_connections 2024-09-10T22:38:57.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.440+0000 7fd31a200640 1 -- 172.21.15.103:0/805388297 wait complete. 2024-09-10T22:38:57.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd31a200640 1 Processor -- start 2024-09-10T22:38:57.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd31a200640 1 -- start start 2024-09-10T22:38:57.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd31a200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f8004030 0x7fd3141f7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd31a200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd314163db0 0x7fd314164230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd31a200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd31406ded0 0x7fd31406e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd31a200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd3140af940 con 0x7fd2f8004030 2024-09-10T22:38:57.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd31a200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd3140af7c0 con 0x7fd31406ded0 2024-09-10T22:38:57.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd31a200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd3140afac0 con 0x7fd314163db0 2024-09-10T22:38:57.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd313400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f8004030 0x7fd3141f7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd313400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f8004030 0x7fd3141f7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46912/0 (socket says 172.21.15.103:46912) 2024-09-10T22:38:57.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd313400640 1 -- 172.21.15.103:0/815996857 learned_addr learned my addr 172.21.15.103:0/815996857 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:38:57.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd312a00640 1 --2- 172.21.15.103:0/815996857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd314163db0 0x7fd314164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd313e00640 1 --2- 172.21.15.103:0/815996857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd31406ded0 0x7fd31406e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd313400640 1 -- 172.21.15.103:0/815996857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd314163db0 msgr2=0x7fd314164230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:57.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd313400640 1 --2- 172.21.15.103:0/815996857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd314163db0 0x7fd314164230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd313400640 1 -- 172.21.15.103:0/815996857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd31406ded0 msgr2=0x7fd31406e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:57.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd313400640 1 --2- 172.21.15.103:0/815996857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd31406ded0 0x7fd31406e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd313400640 1 -- 172.21.15.103:0/815996857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31406ec00 con 0x7fd2f8004030 2024-09-10T22:38:57.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd313400640 1 --2- 172.21.15.103:0/815996857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f8004030 0x7fd3141f7140 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd30400e670 tx=0x7fd30400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:57.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd30b400640 1 -- 172.21.15.103:0/815996857 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd304015070 con 0x7fd2f8004030 2024-09-10T22:38:57.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd30b400640 1 -- 172.21.15.103:0/815996857 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd30400ca00 con 0x7fd2f8004030 2024-09-10T22:38:57.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd31a200640 1 -- 172.21.15.103:0/815996857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31406eee0 con 0x7fd2f8004030 2024-09-10T22:38:57.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd30b400640 1 -- 172.21.15.103:0/815996857 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30400cdd0 con 0x7fd2f8004030 2024-09-10T22:38:57.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.444+0000 7fd31a200640 1 -- 172.21.15.103:0/815996857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31406f4a0 con 0x7fd2f8004030 2024-09-10T22:38:57.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.448+0000 7fd31a200640 1 -- 172.21.15.103:0/815996857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd314164770 con 0x7fd2f8004030 2024-09-10T22:38:57.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.448+0000 7fd30b400640 1 -- 172.21.15.103:0/815996857 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd304011460 con 0x7fd2f8004030 2024-09-10T22:38:57.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.448+0000 7fd30b400640 1 --2- 172.21.15.103:0/815996857 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2f4072610 0x7fd2f4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:57.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.448+0000 7fd30b400640 1 -- 172.21.15.103:0/815996857 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd304093c50 con 0x7fd2f8004030 2024-09-10T22:38:57.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.448+0000 7fd312a00640 1 --2- 172.21.15.103:0/815996857 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2f4072610 0x7fd2f4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:57.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.452+0000 7fd312a00640 1 --2- 172.21.15.103:0/815996857 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2f4072610 0x7fd2f4074ad0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd3000ae000 tx=0x7fd30001a050 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:57.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.452+0000 7fd30b400640 1 -- 172.21.15.103:0/815996857 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd30405e900 con 0x7fd2f8004030 2024-09-10T22:38:57.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.660+0000 7fd31a200640 1 -- 172.21.15.103:0/815996857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd3140ce0c0 con 0x7fd2f8004030 2024-09-10T22:38:57.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.660+0000 7fd30b400640 1 -- 172.21.15.103:0/815996857 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7fd304063330 con 0x7fd2f8004030 2024-09-10T22:38:57.661 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T22:38:57.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.660+0000 7fd31a200640 1 -- 172.21.15.103:0/815996857 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2f4072610 msgr2=0x7fd2f4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:57.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.660+0000 7fd31a200640 1 --2- 172.21.15.103:0/815996857 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2f4072610 0x7fd2f4074ad0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd3000ae000 tx=0x7fd30001a050 comp rx=0 tx=0).stop 2024-09-10T22:38:57.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.660+0000 7fd31a200640 1 -- 172.21.15.103:0/815996857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f8004030 msgr2=0x7fd3141f7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:57.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.660+0000 7fd31a200640 1 --2- 172.21.15.103:0/815996857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f8004030 0x7fd3141f7140 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd30400e670 tx=0x7fd30400ea70 comp rx=0 tx=0).stop 2024-09-10T22:38:57.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.660+0000 7fd31a200640 1 -- 172.21.15.103:0/815996857 shutdown_connections 2024-09-10T22:38:57.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.660+0000 7fd31a200640 1 --2- 172.21.15.103:0/815996857 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2f4072610 0x7fd2f4074ad0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.660+0000 7fd31a200640 1 --2- 172.21.15.103:0/815996857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd31406ded0 0x7fd31406e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.660+0000 7fd31a200640 1 --2- 172.21.15.103:0/815996857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd314163db0 0x7fd314164230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.660+0000 7fd31a200640 1 --2- 172.21.15.103:0/815996857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f8004030 0x7fd3141f7140 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:57.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.660+0000 7fd31a200640 1 -- 172.21.15.103:0/815996857 >> 172.21.15.103:0/815996857 conn(0x7fd3140d1ac0 msgr2=0x7fd3140b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:57.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.660+0000 7fd31a200640 1 -- 172.21.15.103:0/815996857 shutdown_connections 2024-09-10T22:38:57.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57.660+0000 7fd31a200640 1 -- 172.21.15.103:0/815996857 wait complete. 2024-09-10T22:38:57.679 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T22:38:57.679 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T22:38:57.680 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-10T22:38:57.680 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-10T22:38:57.680 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-10T22:38:57.680 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T22:38:57.680 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T22:38:57.680 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T22:38:57.680 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-10T22:38:57.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:38:57.680 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-10T22:38:57.689 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T22:38:57.689 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T22:38:57.689 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T22:38:57.689 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:38:57.689 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-10T22:38:57.689 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:38:57.689 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:38:57.690 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:38:57.690 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-10T22:38:57.690 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:38:57.690 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:38:57.690 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-10T22:38:57.690 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:38:57.690 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-10T22:38:57.690 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T22:38:57.690 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-10T22:38:57.690 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-10T22:38:57.690 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42444sec preferred_lft 42444sec 2024-09-10T22:38:57.690 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2024-09-10T22:38:57.690 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:38:57.691 INFO:teuthology.orchestra.run.smithi103.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T22:38:57.691 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 02:42:c3:dd:ba:ba brd ff:ff:ff:ff:ff:ff 2024-09-10T22:38:57.691 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T22:38:57.691 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:38:57.692 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T22:38:57.692 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:38:57.692 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:38:57.692 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add name ceph-brx type bridge 2024-09-10T22:38:57.692 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr flush dev ceph-brx 2024-09-10T22:38:57.692 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set ceph-brx up 2024-09-10T22:38:57.692 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T22:38:57.693 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:38:57.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:38:57.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:38:57.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:38:57.850 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T22:38:57.870 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-10T22:38:57.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:38:57.872 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-10T22:38:57.942 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-10T22:38:57.942 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T22:38:57.942 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-10T22:38:57.942 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T22:38:57.942 INFO:teuthology.orchestra.run.smithi103.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-10T22:38:57.943 INFO:teuthology.orchestra.run.smithi103.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T22:38:57.943 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T22:38:57.943 INFO:teuthology.orchestra.run.smithi103.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:38:57.943 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:38:57.943 INFO:teuthology.orchestra.run.smithi103.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:38:57.943 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T22:38:57.944 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:38:57.944 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:38:57.944 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T22:38:57.944 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T22:38:57.944 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T22:38:57.944 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:38:58.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:38:58.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:38:58.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:38:58.075 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-10T22:38:58.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:38:58.085 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2024-09-10T22:38:58.136 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:38:58.136 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:38:58.136 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T22:38:58.136 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-10T22:38:58.136 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:38:58.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:38:58.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:38:58.266 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-10T22:38:58.266 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:38:58.266 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:38:58.266 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-10T22:38:58.266 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T22:38:58.266 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-10T22:38:58.266 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-10T22:38:58.267 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-10T22:38:58.267 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:38:58.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:38:58.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:38:58.430 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:38:58.430 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:38:58.431 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-10T22:38:58.431 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T22:38:58.431 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:38:58.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:38:58.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:38:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:38:58.515 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-10T22:38:58.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:38:58.515 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-10T22:38:58.524 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-10T22:38:58.524 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:38:58.524 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-10T22:38:58.574 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:38:58.634 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:38:58.685 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:38:58.685 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:38:58.685 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:38:58.685 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:38:58.685 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:38:58.685 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:38:58.685 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:38:58.685 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:38:58.685 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:38:58.685 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:38:58.685 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:38:58.686 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:38:58.686 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:38:58.686 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:38:58.686 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:38:58.686 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:38:58.686 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:38:58.686 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:38:58.686 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:38:58.686 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:38:58.686 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:38:58.686 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:38:58.686 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:38:58.686 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:38:58.687 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:38:58.687 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:38:58.687 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:38:58.687 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:38:58.687 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:38:58.687 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T22:38:58.687 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T22:38:58.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:38:58.688 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:38:58.739 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T22:38:58.739 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-10T22:38:58.790 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:38:58.810 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:38:58.865 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:38:58.865 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:38:58.865 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:38:58.865 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:38:58.865 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:38:58.865 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:38:58.865 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:38:58.865 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:38:58.865 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:38:58.866 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:38:58.866 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:38:58.866 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:38:58.866 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:38:58.866 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:38:58.866 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:38:58.866 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:38:58.866 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:38:58.866 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:38:58.866 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:38:58.866 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:38:58.867 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:38:58.867 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:38:58.867 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:38:58.867 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:38:58.867 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:38:58.867 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:38:58.867 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:38:58.867 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:38:58.867 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:38:58.867 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T22:38:58.867 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T22:38:58.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:38:58.868 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:38:58.886 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:2024-09-10T22:38:58.884+0000 7fcd341ff580 -1 init, newargv = 0x55a33bdb63d0 newargc=15 2024-09-10T22:38:58.886 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:ceph-fuse[35036]: starting ceph client 2024-09-10T22:38:58.897 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:ceph-fuse[35036]: starting fuse 2024-09-10T22:38:59.997 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:39:00.022 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:39:00.074 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:39:00.074 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:39:00.074 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:39:00.074 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:39:00.074 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:39:00.074 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:39:00.074 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:39:00.074 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:39:00.074 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:39:00.074 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:39:00.075 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:39:00.075 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:39:00.075 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:39:00.075 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:39:00.075 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:39:00.075 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:39:00.075 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:39:00.075 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:39:00.075 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:39:00.075 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:39:00.075 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:39:00.075 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:39:00.075 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:39:00.075 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:39:00.076 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:39:00.076 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:39:00.076 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:39:00.076 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:39:00.076 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:39:00.076 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T22:39:00.076 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T22:39:00.076 INFO:teuthology.orchestra.run.smithi103.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-10T22:39:00.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:00.077 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:39:00.128 INFO:teuthology.orchestra.run.smithi103.stdout:44 2024-09-10T22:39:00.129 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T22:39:00.129 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-09-10T22:39:00.129 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-09-10T22:39:00.129 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-09-10T22:39:00.130 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:39:00.130 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-09-10T22:39:00.130 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:39:00.130 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-09-10T22:39:00.130 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-10T22:39:00.130 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-09-10T22:39:00.130 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-10T22:39:00.131 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:39:00.131 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-09-10T22:39:00.131 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-09-10T22:39:00.131 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-09-10T22:39:00.131 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-09-10T22:39:00.131 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:39:00.132 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-09-10T22:39:00.132 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T22:39:00.132 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T22:39:00.132 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T22:39:00.132 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-09-10T22:39:00.133 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-09-10T22:39:00.133 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-09-10T22:39:00.133 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T22:39:00.133 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:39:00.133 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.admin")) 2024-09-10T22:39:00.133 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:39:00.264 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.admin.35036.asok 2024-09-10T22:39:00.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:00.276 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.35036.asok 2024-09-10T22:39:00.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:00.276 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.35036.asok status 2024-09-10T22:39:00.447 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:39:00.448 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-09-10T22:39:00.448 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T22:39:00.448 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:39:00.448 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "admin", 2024-09-10T22:39:00.448 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-09-10T22:39:00.448 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-10T22:39:00.448 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "35036", 2024-09-10T22:39:00.448 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-09-10T22:39:00.448 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:00.448 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-09-10T22:39:00.448 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-09-10T22:39:00.448 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4464, 2024-09-10T22:39:00.449 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-09-10T22:39:00.449 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-09-10T22:39:00.449 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-09-10T22:39:00.449 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4464 2024-09-10T22:39:00.449 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:00.449 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T22:39:00.449 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T22:39:00.449 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-10T22:39:00.449 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3466300247 2024-09-10T22:39:00.449 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:00.449 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:00.450 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T22:39:00.450 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T22:39:00.450 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-10T22:39:00.450 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3466300247 2024-09-10T22:39:00.450 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:00.450 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.4464 192.168.0.1:0/3466300247", 2024-09-10T22:39:00.450 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/3466300247", 2024-09-10T22:39:00.450 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-09-10T22:39:00.450 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 7, 2024-09-10T22:39:00.450 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 27, 2024-09-10T22:39:00.450 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-09-10T22:39:00.450 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-09-10T22:39:00.451 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-09-10T22:39:00.451 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:39:00.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:00.462 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-09-10T22:39:00.463 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-10T22:39:00.472 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-09-10T22:39:00.472 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-10T22:39:00.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:00.472 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-10T22:39:00.535 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-10T22:39:00.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T22:39:00.657 INFO:teuthology.orchestra.run.smithi103.stdout:# file: . 2024-09-10T22:39:00.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-10T22:39:00.658 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:00.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:00.664 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:39:00.665 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:39:00.674 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T22:39:00.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.852+0000 7fa237200640 1 -- 172.21.15.103:0/1713587007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2300cfdd0 msgr2=0x7fa230073d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:00.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.852+0000 7fa237200640 1 --2- 172.21.15.103:0/1713587007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2300cfdd0 0x7fa230073d20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa2300d08e0 tx=0x7fa22801c880 comp rx=0 tx=0).stop 2024-09-10T22:39:00.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa237200640 1 -- 172.21.15.103:0/1713587007 shutdown_connections 2024-09-10T22:39:00.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa237200640 1 --2- 172.21.15.103:0/1713587007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2300cfdd0 0x7fa230073d20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:00.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa237200640 1 --2- 172.21.15.103:0/1713587007 >> v2:172.21.15.131:3300/0 conn(0x7fa2300cf9f0 0x7fa23006eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:00.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa237200640 1 -- 172.21.15.103:0/1713587007 >> 172.21.15.103:0/1713587007 conn(0x7fa23006cc00 msgr2=0x7fa23006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:00.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa237200640 1 -- 172.21.15.103:0/1713587007 shutdown_connections 2024-09-10T22:39:00.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa237200640 1 -- 172.21.15.103:0/1713587007 wait complete. 2024-09-10T22:39:00.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa237200640 1 Processor -- start 2024-09-10T22:39:00.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa237200640 1 -- start start 2024-09-10T22:39:00.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa237200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa23006f0c0 0x7fa230148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:00.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa237200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2300cf9f0 0x7fa230155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:00.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa237200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2300cfdd0 0x7fa2301f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:00.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa237200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa2300cd6c0 con 0x7fa2300cfdd0 2024-09-10T22:39:00.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa237200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa2300cd540 con 0x7fa23006f0c0 2024-09-10T22:39:00.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa237200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa2300cd840 con 0x7fa2300cf9f0 2024-09-10T22:39:00.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa235200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2300cfdd0 0x7fa2301f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:00.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa22fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa23006f0c0 0x7fa230148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:00.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa227400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2300cf9f0 0x7fa230155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:00.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa235200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2300cfdd0 0x7fa2301f87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46944/0 (socket says 172.21.15.103:46944) 2024-09-10T22:39:00.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa22fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa23006f0c0 0x7fa230148ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:41020/0 (socket says 172.21.15.103:41020) 2024-09-10T22:39:00.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa235200640 1 -- 172.21.15.103:0/4246443697 learned_addr learned my addr 172.21.15.103:0/4246443697 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:00.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa235200640 1 -- 172.21.15.103:0/4246443697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2300cf9f0 msgr2=0x7fa230155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:00.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa235200640 1 --2- 172.21.15.103:0/4246443697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2300cf9f0 0x7fa230155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:00.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa235200640 1 -- 172.21.15.103:0/4246443697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa23006f0c0 msgr2=0x7fa230148ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:00.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa235200640 1 --2- 172.21.15.103:0/4246443697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa23006f0c0 0x7fa230148ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:00.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa235200640 1 -- 172.21.15.103:0/4246443697 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23014aff0 con 0x7fa2300cfdd0 2024-09-10T22:39:00.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.856+0000 7fa235200640 1 --2- 172.21.15.103:0/4246443697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2300cfdd0 0x7fa2301f87d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa2280b0040 tx=0x7fa2280a5660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:00.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.860+0000 7fa22cc00640 1 -- 172.21.15.103:0/4246443697 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2280b2040 con 0x7fa2300cfdd0 2024-09-10T22:39:00.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.860+0000 7fa22cc00640 1 -- 172.21.15.103:0/4246443697 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa228004470 con 0x7fa2300cfdd0 2024-09-10T22:39:00.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.860+0000 7fa22cc00640 1 -- 172.21.15.103:0/4246443697 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2280052d0 con 0x7fa2300cfdd0 2024-09-10T22:39:00.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.860+0000 7fa237200640 1 -- 172.21.15.103:0/4246443697 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa23014a750 con 0x7fa2300cfdd0 2024-09-10T22:39:00.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.860+0000 7fa237200640 1 -- 172.21.15.103:0/4246443697 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa23014ad10 con 0x7fa2300cfdd0 2024-09-10T22:39:00.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.860+0000 7fa237200640 1 -- 172.21.15.103:0/4246443697 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa23006eb80 con 0x7fa2300cfdd0 2024-09-10T22:39:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.860+0000 7fa22cc00640 1 -- 172.21.15.103:0/4246443697 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa228005470 con 0x7fa2300cfdd0 2024-09-10T22:39:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.860+0000 7fa22cc00640 1 --2- 172.21.15.103:0/4246443697 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa20c0725e0 0x7fa20c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.860+0000 7fa22cc00640 1 -- 172.21.15.103:0/4246443697 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa22812cf70 con 0x7fa2300cfdd0 2024-09-10T22:39:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.860+0000 7fa22fe00640 1 --2- 172.21.15.103:0/4246443697 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa20c0725e0 0x7fa20c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.864+0000 7fa22fe00640 1 --2- 172.21.15.103:0/4246443697 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa20c0725e0 0x7fa20c074aa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa220009f00 tx=0x7fa220009650 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:00.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:00.864+0000 7fa22cc00640 1 -- 172.21.15.103:0/4246443697 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa228016470 con 0x7fa2300cfdd0 2024-09-10T22:39:01.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.040+0000 7fa237200640 1 -- 172.21.15.103:0/4246443697 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa230152680 con 0x7fa2300cfdd0 2024-09-10T22:39:01.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.040+0000 7fa22cc00640 1 -- 172.21.15.103:0/4246443697 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fa2280f7c20 con 0x7fa2300cfdd0 2024-09-10T22:39:01.043 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T22:39:01.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.044+0000 7fa237200640 1 -- 172.21.15.103:0/4246443697 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa20c0725e0 msgr2=0x7fa20c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:01.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.044+0000 7fa237200640 1 --2- 172.21.15.103:0/4246443697 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa20c0725e0 0x7fa20c074aa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa220009f00 tx=0x7fa220009650 comp rx=0 tx=0).stop 2024-09-10T22:39:01.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.044+0000 7fa237200640 1 -- 172.21.15.103:0/4246443697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2300cfdd0 msgr2=0x7fa2301f87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:01.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.044+0000 7fa237200640 1 --2- 172.21.15.103:0/4246443697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2300cfdd0 0x7fa2301f87d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa2280b0040 tx=0x7fa2280a5660 comp rx=0 tx=0).stop 2024-09-10T22:39:01.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.044+0000 7fa237200640 1 -- 172.21.15.103:0/4246443697 shutdown_connections 2024-09-10T22:39:01.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.044+0000 7fa237200640 1 --2- 172.21.15.103:0/4246443697 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa20c0725e0 0x7fa20c074aa0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:01.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.044+0000 7fa237200640 1 --2- 172.21.15.103:0/4246443697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2300cfdd0 0x7fa2301f87d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:01.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.044+0000 7fa237200640 1 --2- 172.21.15.103:0/4246443697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2300cf9f0 0x7fa230155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:01.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.044+0000 7fa237200640 1 --2- 172.21.15.103:0/4246443697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa23006f0c0 0x7fa230148ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:01.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.044+0000 7fa237200640 1 -- 172.21.15.103:0/4246443697 >> 172.21.15.103:0/4246443697 conn(0x7fa23006cc00 msgr2=0x7fa230150060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:01.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.044+0000 7fa237200640 1 -- 172.21.15.103:0/4246443697 shutdown_connections 2024-09-10T22:39:01.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.044+0000 7fa237200640 1 -- 172.21.15.103:0/4246443697 wait complete. 2024-09-10T22:39:01.064 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:39:01.064 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:39:01.073 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T22:39:01.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.256+0000 7f7443400640 1 -- 172.21.15.103:0/2254119649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f743c0d2540 msgr2=0x7f743c0b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:01.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.256+0000 7f7443400640 1 --2- 172.21.15.103:0/2254119649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f743c0d2540 0x7f743c0b1490 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f743c15f6f0 tx=0x7f743401cd50 comp rx=0 tx=0).stop 2024-09-10T22:39:01.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.256+0000 7f7443400640 1 -- 172.21.15.103:0/2254119649 shutdown_connections 2024-09-10T22:39:01.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.256+0000 7f7443400640 1 --2- 172.21.15.103:0/2254119649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f743c0d2540 0x7f743c0b1490 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:01.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.256+0000 7f7443400640 1 --2- 172.21.15.103:0/2254119649 >> v2:172.21.15.131:3300/0 conn(0x7f743c0d0710 0x7f743c0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:01.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.256+0000 7f7443400640 1 -- 172.21.15.103:0/2254119649 >> 172.21.15.103:0/2254119649 conn(0x7f743c0d1a20 msgr2=0x7f743c0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:01.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.256+0000 7f7443400640 1 -- 172.21.15.103:0/2254119649 shutdown_connections 2024-09-10T22:39:01.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.256+0000 7f7443400640 1 -- 172.21.15.103:0/2254119649 wait complete. 2024-09-10T22:39:01.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.256+0000 7f7443400640 1 Processor -- start 2024-09-10T22:39:01.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.256+0000 7f7443400640 1 -- start start 2024-09-10T22:39:01.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7443400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f743c0d0710 0x7f743c0c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:01.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7443400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f743c0d2540 0x7f743c15af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:01.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7443400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f743c15bcb0 0x7f743c1faf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:01.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7443400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f743c168960 con 0x7f743c15bcb0 2024-09-10T22:39:01.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7443400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f743c1687e0 con 0x7f743c0d0710 2024-09-10T22:39:01.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7443400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f743c168ae0 con 0x7f743c0d2540 2024-09-10T22:39:01.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7441400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f743c15bcb0 0x7f743c1faf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:01.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7441400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f743c15bcb0 0x7f743c1faf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46956/0 (socket says 172.21.15.103:46956) 2024-09-10T22:39:01.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7441400640 1 -- 172.21.15.103:0/2823340516 learned_addr learned my addr 172.21.15.103:0/2823340516 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:01.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7433e00640 1 --2- 172.21.15.103:0/2823340516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f743c0d2540 0x7f743c15af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:01.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7440a00640 1 --2- 172.21.15.103:0/2823340516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f743c0d0710 0x7f743c0c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:01.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7441400640 1 -- 172.21.15.103:0/2823340516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f743c0d2540 msgr2=0x7f743c15af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:01.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7441400640 1 --2- 172.21.15.103:0/2823340516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f743c0d2540 0x7f743c15af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:01.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7441400640 1 -- 172.21.15.103:0/2823340516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f743c0d0710 msgr2=0x7f743c0c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:01.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7441400640 1 --2- 172.21.15.103:0/2823340516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f743c0d0710 0x7f743c0c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:01.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7441400640 1 -- 172.21.15.103:0/2823340516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743c1fb4b0 con 0x7f743c15bcb0 2024-09-10T22:39:01.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7441400640 1 --2- 172.21.15.103:0/2823340516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f743c15bcb0 0x7f743c1faf70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7434019960 tx=0x7f7434003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:01.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7439600640 1 -- 172.21.15.103:0/2823340516 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74340bb070 con 0x7f743c15bcb0 2024-09-10T22:39:01.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7439600640 1 -- 172.21.15.103:0/2823340516 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7434004d10 con 0x7f743c15bcb0 2024-09-10T22:39:01.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7443400640 1 -- 172.21.15.103:0/2823340516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f743c0cb930 con 0x7f743c15bcb0 2024-09-10T22:39:01.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7439600640 1 -- 172.21.15.103:0/2823340516 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74340b2040 con 0x7f743c15bcb0 2024-09-10T22:39:01.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7443400640 1 -- 172.21.15.103:0/2823340516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f743c1fa770 con 0x7f743c15bcb0 2024-09-10T22:39:01.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7443400640 1 -- 172.21.15.103:0/2823340516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f743c0cf5f0 con 0x7f743c15bcb0 2024-09-10T22:39:01.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.260+0000 7f7439600640 1 -- 172.21.15.103:0/2823340516 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f74340b5030 con 0x7f743c15bcb0 2024-09-10T22:39:01.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.264+0000 7f7439600640 1 --2- 172.21.15.103:0/2823340516 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f74180725e0 0x7f7418074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:01.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.264+0000 7f7439600640 1 -- 172.21.15.103:0/2823340516 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f743412d240 con 0x7f743c15bcb0 2024-09-10T22:39:01.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.264+0000 7f7440a00640 1 --2- 172.21.15.103:0/2823340516 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f74180725e0 0x7f7418074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:01.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.264+0000 7f7440a00640 1 --2- 172.21.15.103:0/2823340516 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f74180725e0 0x7f7418074aa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f742c007fd0 tx=0x7f742c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:01.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.268+0000 7f7439600640 1 -- 172.21.15.103:0/2823340516 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7434016970 con 0x7f743c15bcb0 2024-09-10T22:39:01.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.444+0000 7f7443400640 1 -- 172.21.15.103:0/2823340516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f743c0723d0 con 0x7f743c15bcb0 2024-09-10T22:39:01.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.444+0000 7f7439600640 1 -- 172.21.15.103:0/2823340516 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f74340f7ef0 con 0x7f743c15bcb0 2024-09-10T22:39:01.445 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T22:39:01.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.444+0000 7f7443400640 1 -- 172.21.15.103:0/2823340516 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f74180725e0 msgr2=0x7f7418074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:01.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.444+0000 7f7443400640 1 --2- 172.21.15.103:0/2823340516 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f74180725e0 0x7f7418074aa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f742c007fd0 tx=0x7f742c009040 comp rx=0 tx=0).stop 2024-09-10T22:39:01.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.444+0000 7f7443400640 1 -- 172.21.15.103:0/2823340516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f743c15bcb0 msgr2=0x7f743c1faf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:01.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.444+0000 7f7443400640 1 --2- 172.21.15.103:0/2823340516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f743c15bcb0 0x7f743c1faf70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7434019960 tx=0x7f7434003f60 comp rx=0 tx=0).stop 2024-09-10T22:39:01.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.444+0000 7f7443400640 1 -- 172.21.15.103:0/2823340516 shutdown_connections 2024-09-10T22:39:01.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.444+0000 7f7443400640 1 --2- 172.21.15.103:0/2823340516 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f74180725e0 0x7f7418074aa0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:01.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.444+0000 7f7443400640 1 --2- 172.21.15.103:0/2823340516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f743c15bcb0 0x7f743c1faf70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:01.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.444+0000 7f7443400640 1 --2- 172.21.15.103:0/2823340516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f743c0d2540 0x7f743c15af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:01.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.444+0000 7f7443400640 1 --2- 172.21.15.103:0/2823340516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f743c0d0710 0x7f743c0c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:01.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.444+0000 7f7443400640 1 -- 172.21.15.103:0/2823340516 >> 172.21.15.103:0/2823340516 conn(0x7f743c0d1a20 msgr2=0x7f743c0d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:01.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.444+0000 7f7443400640 1 -- 172.21.15.103:0/2823340516 shutdown_connections 2024-09-10T22:39:01.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:01.444+0000 7f7443400640 1 -- 172.21.15.103:0/2823340516 wait complete. 2024-09-10T22:39:01.465 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-09-10T22:39:01.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:01.465 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-10T22:39:01.497 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:ceph-fuse[35036]: fuse finished with error 0 and tester_r 0 2024-09-10T22:39:01.499 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:39:07.601 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:39:07.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:07.602 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-10T22:39:07.625 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:39:07.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.815+0000 7fa8dbe00640 1 -- 172.21.15.103:0/2015753877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc070580 msgr2=0x7fa8dc15eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:07.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.815+0000 7fa8dbe00640 1 --2- 172.21.15.103:0/2015753877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc070580 0x7fa8dc15eb20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009bc0 tx=0x7fa8d401cb10 comp rx=0 tx=0).stop 2024-09-10T22:39:07.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.815+0000 7fa8dbe00640 1 -- 172.21.15.103:0/2015753877 shutdown_connections 2024-09-10T22:39:07.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.815+0000 7fa8dbe00640 1 --2- 172.21.15.103:0/2015753877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc070580 0x7fa8dc15eb20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:07.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.815+0000 7fa8dbe00640 1 -- 172.21.15.103:0/2015753877 >> 172.21.15.103:0/2015753877 conn(0x7fa8dc0b2210 msgr2=0x7fa8dc0cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:07.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.815+0000 7fa8dbe00640 1 -- 172.21.15.103:0/2015753877 shutdown_connections 2024-09-10T22:39:07.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.815+0000 7fa8dbe00640 1 -- 172.21.15.103:0/2015753877 wait complete. 2024-09-10T22:39:07.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.815+0000 7fa8dbe00640 1 Processor -- start 2024-09-10T22:39:07.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.815+0000 7fa8dbe00640 1 -- start start 2024-09-10T22:39:07.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8dbe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8dc06e2c0 0x7fa8dc145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:07.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8dbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8dc070580 0x7fa8dc1498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:07.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8dbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc0cf370 0x7fa8dc1486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:07.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8dbe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc16c610 con 0x7fa8dc0cf370 2024-09-10T22:39:07.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8dbe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc16c490 con 0x7fa8dc070580 2024-09-10T22:39:07.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8dbe00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa8dc16c790 con 0x7fa8dc06e2c0 2024-09-10T22:39:07.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8db400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc0cf370 0x7fa8dc1486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:07.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8db400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc0cf370 0x7fa8dc1486b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49048/0 (socket says 172.21.15.103:49048) 2024-09-10T22:39:07.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8db400640 1 -- 172.21.15.103:0/3070163766 learned_addr learned my addr 172.21.15.103:0/3070163766 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:07.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8da000640 1 --2- 172.21.15.103:0/3070163766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8dc070580 0x7fa8dc1498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:07.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8daa00640 1 --2- 172.21.15.103:0/3070163766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8dc06e2c0 0x7fa8dc145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:07.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8db400640 1 -- 172.21.15.103:0/3070163766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8dc06e2c0 msgr2=0x7fa8dc145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:07.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8db400640 1 --2- 172.21.15.103:0/3070163766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8dc06e2c0 0x7fa8dc145120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:07.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8db400640 1 -- 172.21.15.103:0/3070163766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8dc070580 msgr2=0x7fa8dc1498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:07.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8db400640 1 --2- 172.21.15.103:0/3070163766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8dc070580 0x7fa8dc1498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:07.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8db400640 1 -- 172.21.15.103:0/3070163766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8dc145660 con 0x7fa8dc0cf370 2024-09-10T22:39:07.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8db400640 1 --2- 172.21.15.103:0/3070163766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc0cf370 0x7fa8dc1486b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4019720 tx=0x7fa8d4009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:07.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8d2a00640 1 -- 172.21.15.103:0/3070163766 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40b2040 con 0x7fa8dc0cf370 2024-09-10T22:39:07.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8d2a00640 1 -- 172.21.15.103:0/3070163766 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8d4004d40 con 0x7fa8dc0cf370 2024-09-10T22:39:07.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8dbe00640 1 -- 172.21.15.103:0/3070163766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8dc14a2a0 con 0x7fa8dc0cf370 2024-09-10T22:39:07.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8d2a00640 1 -- 172.21.15.103:0/3070163766 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4004240 con 0x7fa8dc0cf370 2024-09-10T22:39:07.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8dbe00640 1 -- 172.21.15.103:0/3070163766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8dc14ec70 con 0x7fa8dc0cf370 2024-09-10T22:39:07.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.819+0000 7fa8dbe00640 1 -- 172.21.15.103:0/3070163766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8dc15eb20 con 0x7fa8dc0cf370 2024-09-10T22:39:07.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.823+0000 7fa8d2a00640 1 -- 172.21.15.103:0/3070163766 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa8d40b5070 con 0x7fa8dc0cf370 2024-09-10T22:39:07.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.823+0000 7fa8d2a00640 1 --2- 172.21.15.103:0/3070163766 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa8bc0725e0 0x7fa8bc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:07.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.823+0000 7fa8d2a00640 1 -- 172.21.15.103:0/3070163766 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa8d412d290 con 0x7fa8dc0cf370 2024-09-10T22:39:07.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.823+0000 7fa8daa00640 1 --2- 172.21.15.103:0/3070163766 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa8bc0725e0 0x7fa8bc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:07.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.823+0000 7fa8daa00640 1 --2- 172.21.15.103:0/3070163766 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa8bc0725e0 0x7fa8bc074aa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc0016f0 tx=0x7fa8cc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:07.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.827+0000 7fa8d2a00640 1 -- 172.21.15.103:0/3070163766 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa8dc14a2a0 con 0x7fa8dc0cf370 2024-09-10T22:39:07.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.995+0000 7fa8dbe00640 1 -- 172.21.15.103:0/3070163766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8dc074d20 con 0x7fa8dc0cf370 2024-09-10T22:39:08.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.999+0000 7fa8d2a00640 1 -- 172.21.15.103:0/3070163766 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7fa8d4016790 con 0x7fa8dc0cf370 2024-09-10T22:39:08.000 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:08.000 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":27,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:38:54.282386+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:38:47.154691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:38:48.182281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T22:38:51.874808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:39:08.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.999+0000 7fa8dbe00640 1 -- 172.21.15.103:0/3070163766 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa8bc0725e0 msgr2=0x7fa8bc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:08.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.999+0000 7fa8dbe00640 1 --2- 172.21.15.103:0/3070163766 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa8bc0725e0 0x7fa8bc074aa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc0016f0 tx=0x7fa8cc009040 comp rx=0 tx=0).stop 2024-09-10T22:39:08.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.999+0000 7fa8dbe00640 1 -- 172.21.15.103:0/3070163766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc0cf370 msgr2=0x7fa8dc1486b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:08.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.999+0000 7fa8dbe00640 1 --2- 172.21.15.103:0/3070163766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc0cf370 0x7fa8dc1486b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4019720 tx=0x7fa8d4009300 comp rx=0 tx=0).stop 2024-09-10T22:39:08.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.999+0000 7fa8dbe00640 1 -- 172.21.15.103:0/3070163766 shutdown_connections 2024-09-10T22:39:08.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.999+0000 7fa8dbe00640 1 --2- 172.21.15.103:0/3070163766 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa8bc0725e0 0x7fa8bc074aa0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.999+0000 7fa8dbe00640 1 --2- 172.21.15.103:0/3070163766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc0cf370 0x7fa8dc1486b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.999+0000 7fa8dbe00640 1 --2- 172.21.15.103:0/3070163766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8dc070580 0x7fa8dc1498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.999+0000 7fa8dbe00640 1 --2- 172.21.15.103:0/3070163766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8dc06e2c0 0x7fa8dc145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.999+0000 7fa8dbe00640 1 -- 172.21.15.103:0/3070163766 >> 172.21.15.103:0/3070163766 conn(0x7fa8dc0b2210 msgr2=0x7fa8dc161e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:08.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.999+0000 7fa8dbe00640 1 -- 172.21.15.103:0/3070163766 shutdown_connections 2024-09-10T22:39:08.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:07.999+0000 7fa8dbe00640 1 -- 172.21.15.103:0/3070163766 wait complete. 2024-09-10T22:39:08.021 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:39:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.159+0000 7f83cc000640 1 -- 172.21.15.103:0/2038831373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83c406cc00 msgr2=0x7f83c406cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.159+0000 7f83cc000640 1 --2- 172.21.15.103:0/2038831373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83c406cc00 0x7f83c406cfe0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f83c40b0530 tx=0x7f83b801c830 comp rx=0 tx=0).stop 2024-09-10T22:39:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.159+0000 7f83cc000640 1 -- 172.21.15.103:0/2038831373 shutdown_connections 2024-09-10T22:39:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.159+0000 7f83cc000640 1 --2- 172.21.15.103:0/2038831373 >> v2:172.21.15.131:3300/0 conn(0x7f83c40d1460 0x7f83c40cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.159+0000 7f83cc000640 1 --2- 172.21.15.103:0/2038831373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83c406cc00 0x7f83c406cfe0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.159+0000 7f83cc000640 1 -- 172.21.15.103:0/2038831373 >> 172.21.15.103:0/2038831373 conn(0x7f83c40d0940 msgr2=0x7f83c40d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.159+0000 7f83cc000640 1 -- 172.21.15.103:0/2038831373 shutdown_connections 2024-09-10T22:39:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.159+0000 7f83cc000640 1 -- 172.21.15.103:0/2038831373 wait complete. 2024-09-10T22:39:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.159+0000 7f83cc000640 1 Processor -- start 2024-09-10T22:39:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83cc000640 1 -- start start 2024-09-10T22:39:08.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83cc000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c406cc00 0x7f83c41578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:08.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83cc000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83c4071be0 0x7f83c413f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:08.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83cc000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83c40d1460 0x7f83c415e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:08.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83cc000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f83c41688a0 con 0x7f83c40d1460 2024-09-10T22:39:08.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83cc000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f83c4168720 con 0x7f83c406cc00 2024-09-10T22:39:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83cc000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f83c4168a20 con 0x7f83c4071be0 2024-09-10T22:39:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83ca000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83c40d1460 0x7f83c415e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83c9600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c406cc00 0x7f83c41578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83c9600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c406cc00 0x7f83c41578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:42834/0 (socket says 172.21.15.103:42834) 2024-09-10T22:39:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83c9600640 1 -- 172.21.15.103:0/398032720 learned_addr learned my addr 172.21.15.103:0/398032720 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83c8c00640 1 --2- 172.21.15.103:0/398032720 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83c4071be0 0x7f83c413f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83ca000640 1 -- 172.21.15.103:0/398032720 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83c4071be0 msgr2=0x7f83c413f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83ca000640 1 --2- 172.21.15.103:0/398032720 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83c4071be0 0x7f83c413f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83ca000640 1 -- 172.21.15.103:0/398032720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c406cc00 msgr2=0x7f83c41578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83ca000640 1 --2- 172.21.15.103:0/398032720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c406cc00 0x7f83c41578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83ca000640 1 -- 172.21.15.103:0/398032720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c4157f00 con 0x7f83c40d1460 2024-09-10T22:39:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83c9600640 1 --2- 172.21.15.103:0/398032720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c406cc00 0x7f83c41578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:39:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83ca000640 1 --2- 172.21.15.103:0/398032720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83c40d1460 0x7f83c415e090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0012f0 tx=0x7f83bc00cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83c1600640 1 -- 172.21.15.103:0/398032720 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc003b80 con 0x7f83c40d1460 2024-09-10T22:39:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83c1600640 1 -- 172.21.15.103:0/398032720 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83bc003d40 con 0x7f83c40d1460 2024-09-10T22:39:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83c1600640 1 -- 172.21.15.103:0/398032720 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc0052d0 con 0x7f83c40d1460 2024-09-10T22:39:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83cc000640 1 -- 172.21.15.103:0/398032720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c41581e0 con 0x7f83c40d1460 2024-09-10T22:39:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83cc000640 1 -- 172.21.15.103:0/398032720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c41587a0 con 0x7f83c40d1460 2024-09-10T22:39:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.163+0000 7f83cc000640 1 -- 172.21.15.103:0/398032720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83c406cfe0 con 0x7f83c40d1460 2024-09-10T22:39:08.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.167+0000 7f83c1600640 1 -- 172.21.15.103:0/398032720 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f83bc005470 con 0x7f83c40d1460 2024-09-10T22:39:08.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.167+0000 7f83c1600640 1 --2- 172.21.15.103:0/398032720 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f83a40725e0 0x7f83a4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:08.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.167+0000 7f83c1600640 1 -- 172.21.15.103:0/398032720 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f83bc0932b0 con 0x7f83c40d1460 2024-09-10T22:39:08.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.167+0000 7f83c9600640 1 --2- 172.21.15.103:0/398032720 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f83a40725e0 0x7f83a4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:08.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.167+0000 7f83c9600640 1 --2- 172.21.15.103:0/398032720 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f83a40725e0 0x7f83a4074aa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f83c415f200 tx=0x7f83b80195d0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:08.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.171+0000 7f83c1600640 1 -- 172.21.15.103:0/398032720 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f83bc05df60 con 0x7f83c40d1460 2024-09-10T22:39:08.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.335+0000 7f83cc000640 1 -- 172.21.15.103:0/398032720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83c41522e0 con 0x7f83c40d1460 2024-09-10T22:39:08.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.335+0000 7f83c1600640 1 -- 172.21.15.103:0/398032720 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7f83bc062990 con 0x7f83c40d1460 2024-09-10T22:39:08.339 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:08.339 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":27,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:38:54.282386+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:38:47.154691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:38:48.182281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T22:38:51.874808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:39:08.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.339+0000 7f83cc000640 1 -- 172.21.15.103:0/398032720 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f83a40725e0 msgr2=0x7f83a4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:08.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.339+0000 7f83cc000640 1 --2- 172.21.15.103:0/398032720 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f83a40725e0 0x7f83a4074aa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f83c415f200 tx=0x7f83b80195d0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.339+0000 7f83cc000640 1 -- 172.21.15.103:0/398032720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83c40d1460 msgr2=0x7f83c415e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:08.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.339+0000 7f83cc000640 1 --2- 172.21.15.103:0/398032720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83c40d1460 0x7f83c415e090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0012f0 tx=0x7f83bc00cb20 comp rx=0 tx=0).stop 2024-09-10T22:39:08.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.339+0000 7f83cc000640 1 -- 172.21.15.103:0/398032720 shutdown_connections 2024-09-10T22:39:08.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.339+0000 7f83cc000640 1 --2- 172.21.15.103:0/398032720 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f83a40725e0 0x7f83a4074aa0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.339+0000 7f83cc000640 1 --2- 172.21.15.103:0/398032720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83c40d1460 0x7f83c415e090 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.339+0000 7f83cc000640 1 --2- 172.21.15.103:0/398032720 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83c4071be0 0x7f83c413f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.339+0000 7f83cc000640 1 --2- 172.21.15.103:0/398032720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c406cc00 0x7f83c41578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.339+0000 7f83cc000640 1 -- 172.21.15.103:0/398032720 >> 172.21.15.103:0/398032720 conn(0x7f83c40d0940 msgr2=0x7f83c40b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:08.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.339+0000 7f83cc000640 1 -- 172.21.15.103:0/398032720 shutdown_connections 2024-09-10T22:39:08.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.339+0000 7f83cc000640 1 -- 172.21.15.103:0/398032720 wait complete. 2024-09-10T22:39:08.361 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T22:39:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.503+0000 7fca14e00640 1 -- 172.21.15.103:0/1147222387 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca1006e150 msgr2=0x7fca1006e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.503+0000 7fca14e00640 1 --2- 172.21.15.103:0/1147222387 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca1006e150 0x7fca1006e590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009840 tx=0x7fc9f801c680 comp rx=0 tx=0).stop 2024-09-10T22:39:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.503+0000 7fca14e00640 1 -- 172.21.15.103:0/1147222387 shutdown_connections 2024-09-10T22:39:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.503+0000 7fca14e00640 1 --2- 172.21.15.103:0/1147222387 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca1006ead0 0x7fca10071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.503+0000 7fca14e00640 1 --2- 172.21.15.103:0/1147222387 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca1006e150 0x7fca1006e590 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.503+0000 7fca14e00640 1 -- 172.21.15.103:0/1147222387 >> 172.21.15.103:0/1147222387 conn(0x7fca100d1ad0 msgr2=0x7fca100d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.503+0000 7fca14e00640 1 -- 172.21.15.103:0/1147222387 shutdown_connections 2024-09-10T22:39:08.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.503+0000 7fca14e00640 1 -- 172.21.15.103:0/1147222387 wait complete. 2024-09-10T22:39:08.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.503+0000 7fca14e00640 1 Processor -- start 2024-09-10T22:39:08.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.503+0000 7fca14e00640 1 -- start start 2024-09-10T22:39:08.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca14e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca1006e150 0x7fca1015b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:08.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca14e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca1006ead0 0x7fca1009ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca14e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1015de80 0x7fca101606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca14e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fca1016aca0 con 0x7fca1015de80 2024-09-10T22:39:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca14e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fca100724c0 con 0x7fca1006ead0 2024-09-10T22:39:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca14e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fca1016ae20 con 0x7fca1006e150 2024-09-10T22:39:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca0e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1015de80 0x7fca101606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca0e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1015de80 0x7fca101606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49078/0 (socket says 172.21.15.103:49078) 2024-09-10T22:39:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca0e800640 1 -- 172.21.15.103:0/1819518774 learned_addr learned my addr 172.21.15.103:0/1819518774 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca05400640 1 --2- 172.21.15.103:0/1819518774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca1006ead0 0x7fca1009ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca0de00640 1 --2- 172.21.15.103:0/1819518774 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca1006e150 0x7fca1015b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca0e800640 1 -- 172.21.15.103:0/1819518774 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca1006e150 msgr2=0x7fca1015b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca0e800640 1 --2- 172.21.15.103:0/1819518774 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca1006e150 0x7fca1015b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca0e800640 1 -- 172.21.15.103:0/1819518774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca1006ead0 msgr2=0x7fca1009ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca0e800640 1 --2- 172.21.15.103:0/1819518774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca1006ead0 0x7fca1009ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca0e800640 1 -- 172.21.15.103:0/1819518774 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1015b5f0 con 0x7fca1015de80 2024-09-10T22:39:08.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca0de00640 1 --2- 172.21.15.103:0/1819518774 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca1006e150 0x7fca1015b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:08.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca0e800640 1 --2- 172.21.15.103:0/1819518774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1015de80 0x7fca101606c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fca0800e8c0 tx=0x7fca0800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:08.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca06a00640 1 -- 172.21.15.103:0/1819518774 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0800ccc0 con 0x7fca1015de80 2024-09-10T22:39:08.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca06a00640 1 -- 172.21.15.103:0/1819518774 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca0800ce60 con 0x7fca1015de80 2024-09-10T22:39:08.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca06a00640 1 -- 172.21.15.103:0/1819518774 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08005280 con 0x7fca1015de80 2024-09-10T22:39:08.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca14e00640 1 -- 172.21.15.103:0/1819518774 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca1009f2d0 con 0x7fca1015de80 2024-09-10T22:39:08.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca14e00640 1 -- 172.21.15.103:0/1819518774 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca1009dfd0 con 0x7fca1015de80 2024-09-10T22:39:08.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.507+0000 7fca14e00640 1 -- 172.21.15.103:0/1819518774 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca1006e590 con 0x7fca1015de80 2024-09-10T22:39:08.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.511+0000 7fca06a00640 1 -- 172.21.15.103:0/1819518774 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fca08005420 con 0x7fca1015de80 2024-09-10T22:39:08.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.511+0000 7fca06a00640 1 --2- 172.21.15.103:0/1819518774 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9ec0725e0 0x7fc9ec074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:08.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.511+0000 7fca06a00640 1 -- 172.21.15.103:0/1819518774 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fca08093fd0 con 0x7fca1015de80 2024-09-10T22:39:08.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.511+0000 7fca0de00640 1 --2- 172.21.15.103:0/1819518774 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9ec0725e0 0x7fc9ec074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:08.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.511+0000 7fca0de00640 1 --2- 172.21.15.103:0/1819518774 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9ec0725e0 0x7fc9ec074aa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fca0000e220 tx=0x7fca00009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:08.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.515+0000 7fca06a00640 1 -- 172.21.15.103:0/1819518774 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fca1015b5f0 con 0x7fca1015de80 2024-09-10T22:39:08.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.711+0000 7fca14e00640 1 -- 172.21.15.103:0/1819518774 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fca1006d980 con 0x7fca1015de80 2024-09-10T22:39:08.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.923+0000 7fca06a00640 1 -- 172.21.15.103:0/1819518774 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7fca0805f370 con 0x7fca1015de80 2024-09-10T22:39:08.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.923+0000 7fca14e00640 1 -- 172.21.15.103:0/1819518774 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9ec0725e0 msgr2=0x7fc9ec074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:08.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.923+0000 7fca14e00640 1 --2- 172.21.15.103:0/1819518774 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9ec0725e0 0x7fc9ec074aa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fca0000e220 tx=0x7fca00009040 comp rx=0 tx=0).stop 2024-09-10T22:39:08.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.923+0000 7fca14e00640 1 -- 172.21.15.103:0/1819518774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1015de80 msgr2=0x7fca101606c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:08.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.923+0000 7fca14e00640 1 --2- 172.21.15.103:0/1819518774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1015de80 0x7fca101606c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fca0800e8c0 tx=0x7fca0800ed80 comp rx=0 tx=0).stop 2024-09-10T22:39:08.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.927+0000 7fca14e00640 1 -- 172.21.15.103:0/1819518774 shutdown_connections 2024-09-10T22:39:08.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.927+0000 7fca14e00640 1 --2- 172.21.15.103:0/1819518774 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9ec0725e0 0x7fc9ec074aa0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.927+0000 7fca14e00640 1 --2- 172.21.15.103:0/1819518774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1015de80 0x7fca101606c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.927+0000 7fca14e00640 1 --2- 172.21.15.103:0/1819518774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca1006ead0 0x7fca1009ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.927+0000 7fca14e00640 1 --2- 172.21.15.103:0/1819518774 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca1006e150 0x7fca1015b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:08.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.927+0000 7fca14e00640 1 -- 172.21.15.103:0/1819518774 >> 172.21.15.103:0/1819518774 conn(0x7fca100d1ad0 msgr2=0x7fca100d1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:08.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.927+0000 7fca14e00640 1 -- 172.21.15.103:0/1819518774 shutdown_connections 2024-09-10T22:39:08.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:08.927+0000 7fca14e00640 1 -- 172.21.15.103:0/1819518774 wait complete. 2024-09-10T22:39:08.947 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-10T22:39:08.948 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T22:39:09.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f5b200640 1 -- 172.21.15.103:0/3631688297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f540d0b90 msgr2=0x7f0f540d1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:09.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f5b200640 1 --2- 172.21.15.103:0/3631688297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f540d0b90 0x7f0f540d1cc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0f5408c390 tx=0x7f0f4c01c600 comp rx=0 tx=0).stop 2024-09-10T22:39:09.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f5b200640 1 -- 172.21.15.103:0/3631688297 shutdown_connections 2024-09-10T22:39:09.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f5b200640 1 --2- 172.21.15.103:0/3631688297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f540d0b90 0x7f0f540d1cc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:09.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f5b200640 1 --2- 172.21.15.103:0/3631688297 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f540d4760 0x7f0f540d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:09.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f5b200640 1 --2- 172.21.15.103:0/3631688297 >> v2:172.21.15.131:3300/0 conn(0x7f0f5415deb0 0x7f0f54162220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:09.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f5b200640 1 -- 172.21.15.103:0/3631688297 >> 172.21.15.103:0/3631688297 conn(0x7f0f540d3c40 msgr2=0x7f0f540d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:09.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f5b200640 1 -- 172.21.15.103:0/3631688297 shutdown_connections 2024-09-10T22:39:09.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f5b200640 1 -- 172.21.15.103:0/3631688297 wait complete. 2024-09-10T22:39:09.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f5b200640 1 Processor -- start 2024-09-10T22:39:09.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f5b200640 1 -- start start 2024-09-10T22:39:09.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f5b200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f540d0b90 0x7f0f54158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:09.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f5b200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f540d4760 0x7f0f541545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:09.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f5b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f54154c50 0x7f0f540c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:09.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f5b200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0f540b7120 con 0x7f0f54154c50 2024-09-10T22:39:09.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f5b200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0f540b6fa0 con 0x7f0f540d0b90 2024-09-10T22:39:09.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f5b200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0f540b72a0 con 0x7f0f540d4760 2024-09-10T22:39:09.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f59200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f54154c50 0x7f0f540c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:09.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f53e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f540d0b90 0x7f0f54158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:09.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f59200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f54154c50 0x7f0f540c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49100/0 (socket says 172.21.15.103:49100) 2024-09-10T22:39:09.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f59200640 1 -- 172.21.15.103:0/1848420804 learned_addr learned my addr 172.21.15.103:0/1848420804 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:09.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f4b400640 1 --2- 172.21.15.103:0/1848420804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f540d4760 0x7f0f541545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:09.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f59200640 1 -- 172.21.15.103:0/1848420804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f540d4760 msgr2=0x7f0f541545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:09.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f59200640 1 --2- 172.21.15.103:0/1848420804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f540d4760 0x7f0f541545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:09.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f59200640 1 -- 172.21.15.103:0/1848420804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f540d0b90 msgr2=0x7f0f54158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:09.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f59200640 1 --2- 172.21.15.103:0/1848420804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f540d0b90 0x7f0f54158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:09.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.091+0000 7f0f59200640 1 -- 172.21.15.103:0/1848420804 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f540b9620 con 0x7f0f54154c50 2024-09-10T22:39:09.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.095+0000 7f0f59200640 1 --2- 172.21.15.103:0/1848420804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f54154c50 0x7f0f540c8080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c01acb0 tx=0x7f0f4c0a9510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:09.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.095+0000 7f0f50c00640 1 -- 172.21.15.103:0/1848420804 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c0c0070 con 0x7f0f54154c50 2024-09-10T22:39:09.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.095+0000 7f0f50c00640 1 -- 172.21.15.103:0/1848420804 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f4c0aa9b0 con 0x7f0f54154c50 2024-09-10T22:39:09.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.095+0000 7f0f50c00640 1 -- 172.21.15.103:0/1848420804 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c0ad040 con 0x7f0f54154c50 2024-09-10T22:39:09.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.095+0000 7f0f5b200640 1 -- 172.21.15.103:0/1848420804 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f540c79c0 con 0x7f0f54154c50 2024-09-10T22:39:09.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.095+0000 7f0f5b200640 1 -- 172.21.15.103:0/1848420804 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f540c8790 con 0x7f0f54154c50 2024-09-10T22:39:09.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.095+0000 7f0f5b200640 1 -- 172.21.15.103:0/1848420804 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f540ccf50 con 0x7f0f54154c50 2024-09-10T22:39:09.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.095+0000 7f0f50c00640 1 -- 172.21.15.103:0/1848420804 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0f4c003600 con 0x7f0f54154c50 2024-09-10T22:39:09.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.095+0000 7f0f50c00640 1 --2- 172.21.15.103:0/1848420804 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f300725e0 0x7f0f30074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:09.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.095+0000 7f0f50c00640 1 -- 172.21.15.103:0/1848420804 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0f4c12dd60 con 0x7f0f54154c50 2024-09-10T22:39:09.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.099+0000 7f0f53e00640 1 --2- 172.21.15.103:0/1848420804 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f300725e0 0x7f0f30074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:09.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.099+0000 7f0f53e00640 1 --2- 172.21.15.103:0/1848420804 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f300725e0 0x7f0f30074aa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f541fadd0 tx=0x7f0f4400a590 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:09.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.099+0000 7f0f50c00640 1 -- 172.21.15.103:0/1848420804 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0f540c8790 con 0x7f0f54154c50 2024-09-10T22:39:09.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.299+0000 7f0f5b200640 1 -- 172.21.15.103:0/1848420804 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0f540ccc70 con 0x7f0f54154c50 2024-09-10T22:39:09.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.931+0000 7f0f50c00640 1 -- 172.21.15.103:0/1848420804 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f0f4c0164b0 con 0x7f0f54154c50 2024-09-10T22:39:09.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.931+0000 7f0f5b200640 1 -- 172.21.15.103:0/1848420804 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f300725e0 msgr2=0x7f0f30074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:09.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.931+0000 7f0f5b200640 1 --2- 172.21.15.103:0/1848420804 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f300725e0 0x7f0f30074aa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f541fadd0 tx=0x7f0f4400a590 comp rx=0 tx=0).stop 2024-09-10T22:39:09.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.931+0000 7f0f5b200640 1 -- 172.21.15.103:0/1848420804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f54154c50 msgr2=0x7f0f540c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:09.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.931+0000 7f0f5b200640 1 --2- 172.21.15.103:0/1848420804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f54154c50 0x7f0f540c8080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c01acb0 tx=0x7f0f4c0a9510 comp rx=0 tx=0).stop 2024-09-10T22:39:09.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.931+0000 7f0f5b200640 1 -- 172.21.15.103:0/1848420804 shutdown_connections 2024-09-10T22:39:09.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.931+0000 7f0f5b200640 1 --2- 172.21.15.103:0/1848420804 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f300725e0 0x7f0f30074aa0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:09.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.931+0000 7f0f5b200640 1 --2- 172.21.15.103:0/1848420804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f54154c50 0x7f0f540c8080 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:09.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.931+0000 7f0f5b200640 1 --2- 172.21.15.103:0/1848420804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f540d4760 0x7f0f541545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:09.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.931+0000 7f0f5b200640 1 --2- 172.21.15.103:0/1848420804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f540d0b90 0x7f0f54158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:09.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.931+0000 7f0f5b200640 1 -- 172.21.15.103:0/1848420804 >> 172.21.15.103:0/1848420804 conn(0x7f0f540d3c40 msgr2=0x7f0f54157d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:09.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.931+0000 7f0f5b200640 1 -- 172.21.15.103:0/1848420804 shutdown_connections 2024-09-10T22:39:09.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:09.931+0000 7f0f5b200640 1 -- 172.21.15.103:0/1848420804 wait complete. 2024-09-10T22:39:09.957 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T22:39:09.957 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:39:10.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.095+0000 7f0b68e00640 1 -- 172.21.15.103:0/1774190468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b640b09c0 msgr2=0x7f0b640ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:10.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.095+0000 7f0b68e00640 1 --2- 172.21.15.103:0/1774190468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b640b09c0 0x7f0b640ce7d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0b640d1590 tx=0x7f0b5001c770 comp rx=0 tx=0).stop 2024-09-10T22:39:10.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.095+0000 7f0b68e00640 1 -- 172.21.15.103:0/1774190468 shutdown_connections 2024-09-10T22:39:10.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.095+0000 7f0b68e00640 1 --2- 172.21.15.103:0/1774190468 >> v2:172.21.15.131:3300/0 conn(0x7f0b640ae9c0 0x7f0b640aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.095+0000 7f0b68e00640 1 --2- 172.21.15.103:0/1774190468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b640b09c0 0x7f0b640ce7d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.095+0000 7f0b68e00640 1 -- 172.21.15.103:0/1774190468 >> 172.21.15.103:0/1774190468 conn(0x7f0b640d1ac0 msgr2=0x7f0b640d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:10.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.095+0000 7f0b68e00640 1 -- 172.21.15.103:0/1774190468 shutdown_connections 2024-09-10T22:39:10.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.095+0000 7f0b68e00640 1 -- 172.21.15.103:0/1774190468 wait complete. 2024-09-10T22:39:10.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.095+0000 7f0b68e00640 1 Processor -- start 2024-09-10T22:39:10.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b68e00640 1 -- start start 2024-09-10T22:39:10.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b68e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b640ae9c0 0x7f0b6414e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:10.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b68e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b640b09c0 0x7f0b6414fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:10.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b68e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b6415be30 0x7f0b64071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:10.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b68e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0b64168c70 con 0x7f0b640b09c0 2024-09-10T22:39:10.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b68e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0b640cef50 con 0x7f0b6415be30 2024-09-10T22:39:10.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b68e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0b64168df0 con 0x7f0b640ae9c0 2024-09-10T22:39:10.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b61400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b640b09c0 0x7f0b6414fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:10.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b61400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b640b09c0 0x7f0b6414fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49116/0 (socket says 172.21.15.103:49116) 2024-09-10T22:39:10.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b61400640 1 -- 172.21.15.103:0/4121578477 learned_addr learned my addr 172.21.15.103:0/4121578477 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:10.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b62800640 1 --2- 172.21.15.103:0/4121578477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b6415be30 0x7f0b64071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:10.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b61e00640 1 --2- 172.21.15.103:0/4121578477 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b640ae9c0 0x7f0b6414e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:10.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b61400640 1 -- 172.21.15.103:0/4121578477 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b640ae9c0 msgr2=0x7f0b6414e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:10.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b61400640 1 --2- 172.21.15.103:0/4121578477 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b640ae9c0 0x7f0b6414e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b61400640 1 -- 172.21.15.103:0/4121578477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b6415be30 msgr2=0x7f0b64071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:10.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b61400640 1 --2- 172.21.15.103:0/4121578477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b6415be30 0x7f0b64071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b61400640 1 -- 172.21.15.103:0/4121578477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b64071840 con 0x7f0b640b09c0 2024-09-10T22:39:10.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b62800640 1 --2- 172.21.15.103:0/4121578477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b6415be30 0x7f0b64071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:10.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b61400640 1 --2- 172.21.15.103:0/4121578477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b640b09c0 0x7f0b6414fe30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0b50000c10 tx=0x7f0b500a5630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:10.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b5a000640 1 -- 172.21.15.103:0/4121578477 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b500bc070 con 0x7f0b640b09c0 2024-09-10T22:39:10.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b5a000640 1 -- 172.21.15.103:0/4121578477 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b50004430 con 0x7f0b640b09c0 2024-09-10T22:39:10.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b68e00640 1 -- 172.21.15.103:0/4121578477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b6414f070 con 0x7f0b640b09c0 2024-09-10T22:39:10.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b5a000640 1 -- 172.21.15.103:0/4121578477 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b500b2040 con 0x7f0b640b09c0 2024-09-10T22:39:10.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b68e00640 1 -- 172.21.15.103:0/4121578477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b6414f630 con 0x7f0b640b09c0 2024-09-10T22:39:10.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.099+0000 7f0b68e00640 1 -- 172.21.15.103:0/4121578477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b640aee10 con 0x7f0b640b09c0 2024-09-10T22:39:10.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.103+0000 7f0b5a000640 1 -- 172.21.15.103:0/4121578477 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0b500b5070 con 0x7f0b640b09c0 2024-09-10T22:39:10.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.103+0000 7f0b5a000640 1 --2- 172.21.15.103:0/4121578477 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0b440725e0 0x7f0b44074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:10.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.103+0000 7f0b5a000640 1 -- 172.21.15.103:0/4121578477 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0b5012ce40 con 0x7f0b640b09c0 2024-09-10T22:39:10.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.103+0000 7f0b61e00640 1 --2- 172.21.15.103:0/4121578477 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0b440725e0 0x7f0b44074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:10.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.103+0000 7f0b61e00640 1 --2- 172.21.15.103:0/4121578477 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0b440725e0 0x7f0b44074aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b540012f0 tx=0x7f0b54009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:10.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.107+0000 7f0b5a000640 1 -- 172.21.15.103:0/4121578477 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0b500163f0 con 0x7f0b640b09c0 2024-09-10T22:39:10.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.307+0000 7f0b68e00640 1 -- 172.21.15.103:0/4121578477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b64155580 con 0x7f0b640b09c0 2024-09-10T22:39:10.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.307+0000 7f0b5a000640 1 -- 172.21.15.103:0/4121578477 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7f0b500f8140 con 0x7f0b640b09c0 2024-09-10T22:39:10.310 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:10.310 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-09-10T22:39:09:926600+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/467299119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":467299119},{"type":"v1","addr":"172.21.15.103:6834","nonce":467299119}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3161095873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3161095873},{"type":"v1","addr":"172.21.15.131:6837","nonce":3161095873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/774650981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":774650981},{"type":"v1","addr":"172.21.15.103:6835","nonce":774650981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:38:49.214867+0000","modified":"2024-09-10T22:39:09.303311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6836/2821479330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2821479330},{"type":"v1","addr":"172.21.15.131:6836","nonce":2821479330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4390,"qdb_cluster":[4390]},"id":1}]} 2024-09-10T22:39:10.311 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-09-10T22:39:10.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.311+0000 7f0b68e00640 1 -- 172.21.15.103:0/4121578477 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0b440725e0 msgr2=0x7f0b44074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.311+0000 7f0b68e00640 1 --2- 172.21.15.103:0/4121578477 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0b440725e0 0x7f0b44074aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b540012f0 tx=0x7f0b54009040 comp rx=0 tx=0).stop 2024-09-10T22:39:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.311+0000 7f0b68e00640 1 -- 172.21.15.103:0/4121578477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b640b09c0 msgr2=0x7f0b6414fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.311+0000 7f0b68e00640 1 --2- 172.21.15.103:0/4121578477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b640b09c0 0x7f0b6414fe30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0b50000c10 tx=0x7f0b500a5630 comp rx=0 tx=0).stop 2024-09-10T22:39:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.311+0000 7f0b68e00640 1 -- 172.21.15.103:0/4121578477 shutdown_connections 2024-09-10T22:39:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.311+0000 7f0b68e00640 1 --2- 172.21.15.103:0/4121578477 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0b440725e0 0x7f0b44074aa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.311+0000 7f0b68e00640 1 --2- 172.21.15.103:0/4121578477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b6415be30 0x7f0b64071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.311+0000 7f0b68e00640 1 --2- 172.21.15.103:0/4121578477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b640b09c0 0x7f0b6414fe30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.311+0000 7f0b68e00640 1 --2- 172.21.15.103:0/4121578477 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b640ae9c0 0x7f0b6414e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.311+0000 7f0b68e00640 1 -- 172.21.15.103:0/4121578477 >> 172.21.15.103:0/4121578477 conn(0x7f0b640d1ac0 msgr2=0x7f0b64071af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.311+0000 7f0b68e00640 1 -- 172.21.15.103:0/4121578477 shutdown_connections 2024-09-10T22:39:10.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.311+0000 7f0b68e00640 1 -- 172.21.15.103:0/4121578477 wait complete. 2024-09-10T22:39:10.331 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:39:10.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.471+0000 7ff9b1000640 1 -- 172.21.15.103:0/774094625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff990004d50 msgr2=0x7ff9900051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:10.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.471+0000 7ff9b1000640 1 --2- 172.21.15.103:0/774094625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff990004d50 0x7ff9900051d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400c660 tx=0x7ff9a401fa40 comp rx=0 tx=0).stop 2024-09-10T22:39:10.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.471+0000 7ff9aa800640 1 -- 172.21.15.103:0/774094625 reap_dead start 2024-09-10T22:39:10.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.471+0000 7ff9b1000640 1 -- 172.21.15.103:0/774094625 shutdown_connections 2024-09-10T22:39:10.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.471+0000 7ff9b1000640 1 -- 172.21.15.103:0/774094625 >> 172.21.15.103:0/774094625 conn(0x7ff9ac06cc00 msgr2=0x7ff9ac06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:10.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.471+0000 7ff9b1000640 1 -- 172.21.15.103:0/774094625 shutdown_connections 2024-09-10T22:39:10.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.471+0000 7ff9b1000640 1 -- 172.21.15.103:0/774094625 wait complete. 2024-09-10T22:39:10.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.471+0000 7ff9b1000640 1 Processor -- start 2024-09-10T22:39:10.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.471+0000 7ff9b1000640 1 -- start start 2024-09-10T22:39:10.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.471+0000 7ff9b1000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff990004d50 0x7ff9ac1600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:10.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9b1000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9ac1f60f0 0x7ff9ac0adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:10.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9b1000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9ac154710 0x7ff9ac154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:10.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9b1000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0b3100 con 0x7ff9ac154710 2024-09-10T22:39:10.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9b1000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0b2f80 con 0x7ff990004d50 2024-09-10T22:39:10.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9b1000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ac0b3280 con 0x7ff9ac1f60f0 2024-09-10T22:39:10.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9aa800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9ac154710 0x7ff9ac154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:10.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9aa800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9ac154710 0x7ff9ac154b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49130/0 (socket says 172.21.15.103:49130) 2024-09-10T22:39:10.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9aa800640 1 -- 172.21.15.103:0/854951428 learned_addr learned my addr 172.21.15.103:0/854951428 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:10.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9a9e00640 1 --2- 172.21.15.103:0/854951428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff990004d50 0x7ff9ac1600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:10.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9a1400640 1 --2- 172.21.15.103:0/854951428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9ac1f60f0 0x7ff9ac0adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:10.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9aa800640 1 -- 172.21.15.103:0/854951428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9ac1f60f0 msgr2=0x7ff9ac0adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:10.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9aa800640 1 --2- 172.21.15.103:0/854951428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9ac1f60f0 0x7ff9ac0adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9aa800640 1 -- 172.21.15.103:0/854951428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff990004d50 msgr2=0x7ff9ac1600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:10.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9aa800640 1 --2- 172.21.15.103:0/854951428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff990004d50 0x7ff9ac1600c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9aa800640 1 -- 172.21.15.103:0/854951428 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac1583a0 con 0x7ff9ac154710 2024-09-10T22:39:10.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9aa800640 1 --2- 172.21.15.103:0/854951428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9ac154710 0x7ff9ac154b90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40202e0 tx=0x7ff9a4001530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:10.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9a2a00640 1 -- 172.21.15.103:0/854951428 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a40011d0 con 0x7ff9ac154710 2024-09-10T22:39:10.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9a2a00640 1 -- 172.21.15.103:0/854951428 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9a4004e40 con 0x7ff9ac154710 2024-09-10T22:39:10.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9a2a00640 1 -- 172.21.15.103:0/854951428 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4002090 con 0x7ff9ac154710 2024-09-10T22:39:10.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9b1000640 1 -- 172.21.15.103:0/854951428 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ac158680 con 0x7ff9ac154710 2024-09-10T22:39:10.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9b1000640 1 -- 172.21.15.103:0/854951428 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ac1f6570 con 0x7ff9ac154710 2024-09-10T22:39:10.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9b1000640 1 -- 172.21.15.103:0/854951428 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9ac1550d0 con 0x7ff9ac154710 2024-09-10T22:39:10.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.475+0000 7ff9a2a00640 1 -- 172.21.15.103:0/854951428 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff9a4003980 con 0x7ff9ac154710 2024-09-10T22:39:10.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.479+0000 7ff9a2a00640 1 --2- 172.21.15.103:0/854951428 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff988072610 0x7ff988074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:10.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.479+0000 7ff9a2a00640 1 -- 172.21.15.103:0/854951428 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff9a412fb10 con 0x7ff9ac154710 2024-09-10T22:39:10.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.479+0000 7ff9a9e00640 1 --2- 172.21.15.103:0/854951428 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff988072610 0x7ff988074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:10.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.479+0000 7ff9a9e00640 1 --2- 172.21.15.103:0/854951428 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff988072610 0x7ff988074ad0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009c60 tx=0x7ff99c0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:10.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.483+0000 7ff9a2a00640 1 -- 172.21.15.103:0/854951428 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff9a40c2070 con 0x7ff9ac154710 2024-09-10T22:39:10.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.647+0000 7ff9b1000640 1 -- 172.21.15.103:0/854951428 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9ac0ae6b0 con 0x7ff9ac154710 2024-09-10T22:39:10.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.647+0000 7ff9a2a00640 1 -- 172.21.15.103:0/854951428 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7ff9a40197f0 con 0x7ff9ac154710 2024-09-10T22:39:10.651 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:10.651 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":27,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:38:54.282386+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:38:47.154691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:38:48.182281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T22:38:51.874808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:39:10.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.651+0000 7ff9b1000640 1 -- 172.21.15.103:0/854951428 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff988072610 msgr2=0x7ff988074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:10.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.651+0000 7ff9b1000640 1 --2- 172.21.15.103:0/854951428 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff988072610 0x7ff988074ad0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009c60 tx=0x7ff99c0091e0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.651+0000 7ff9b1000640 1 -- 172.21.15.103:0/854951428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9ac154710 msgr2=0x7ff9ac154b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:10.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.651+0000 7ff9b1000640 1 --2- 172.21.15.103:0/854951428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9ac154710 0x7ff9ac154b90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40202e0 tx=0x7ff9a4001530 comp rx=0 tx=0).stop 2024-09-10T22:39:10.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.651+0000 7ff9b1000640 1 -- 172.21.15.103:0/854951428 shutdown_connections 2024-09-10T22:39:10.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.651+0000 7ff9b1000640 1 --2- 172.21.15.103:0/854951428 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff988072610 0x7ff988074ad0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.651+0000 7ff9b1000640 1 --2- 172.21.15.103:0/854951428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9ac154710 0x7ff9ac154b90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.651+0000 7ff9b1000640 1 --2- 172.21.15.103:0/854951428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9ac1f60f0 0x7ff9ac0adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.651+0000 7ff9b1000640 1 --2- 172.21.15.103:0/854951428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff990004d50 0x7ff9ac1600c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.651+0000 7ff9b1000640 1 -- 172.21.15.103:0/854951428 >> 172.21.15.103:0/854951428 conn(0x7ff9ac06cc00 msgr2=0x7ff9ac0ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:10.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.651+0000 7ff9b1000640 1 -- 172.21.15.103:0/854951428 shutdown_connections 2024-09-10T22:39:10.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.651+0000 7ff9b1000640 1 -- 172.21.15.103:0/854951428 wait complete. 2024-09-10T22:39:10.672 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T22:39:10.673 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:39:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.811+0000 7f0343200640 1 -- 172.21.15.103:0/903008812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f034406fd20 msgr2=0x7f034415b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.811+0000 7f0343200640 1 --2- 172.21.15.103:0/903008812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f034406fd20 0x7f034415b770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f03440c6290 tx=0x7f033401c8c0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.811+0000 7f0343200640 1 -- 172.21.15.103:0/903008812 shutdown_connections 2024-09-10T22:39:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.811+0000 7f0343200640 1 --2- 172.21.15.103:0/903008812 >> v2:172.21.15.131:3300/0 conn(0x7f0344070100 0x7f03441511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.811+0000 7f0343200640 1 --2- 172.21.15.103:0/903008812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03440ae2b0 0x7f034415ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.811+0000 7f0343200640 1 --2- 172.21.15.103:0/903008812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f034406fd20 0x7f034415b770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.811+0000 7f0343200640 1 -- 172.21.15.103:0/903008812 >> 172.21.15.103:0/903008812 conn(0x7f03440cff60 msgr2=0x7f03440d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.811+0000 7f0343200640 1 -- 172.21.15.103:0/903008812 shutdown_connections 2024-09-10T22:39:10.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.811+0000 7f0343200640 1 -- 172.21.15.103:0/903008812 wait complete. 2024-09-10T22:39:10.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.811+0000 7f0343200640 1 Processor -- start 2024-09-10T22:39:10.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.811+0000 7f0343200640 1 -- start start 2024-09-10T22:39:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0343200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f034406fd20 0x7f034415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0343200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0344070100 0x7f03440c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0343200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03440ae2b0 0x7f034409c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0343200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f034406f7b0 con 0x7f034406fd20 2024-09-10T22:39:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0343200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f034406f630 con 0x7f0344070100 2024-09-10T22:39:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0343200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f034406f930 con 0x7f03440ae2b0 2024-09-10T22:39:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0341e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f034406fd20 0x7f034415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0341e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f034406fd20 0x7f034415d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49152/0 (socket says 172.21.15.103:49152) 2024-09-10T22:39:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0341e00640 1 -- 172.21.15.103:0/574763855 learned_addr learned my addr 172.21.15.103:0/574763855 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0341400640 1 --2- 172.21.15.103:0/574763855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0344070100 0x7f03440c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0342800640 1 --2- 172.21.15.103:0/574763855 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03440ae2b0 0x7f034409c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0341e00640 1 -- 172.21.15.103:0/574763855 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03440ae2b0 msgr2=0x7f034409c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0341e00640 1 --2- 172.21.15.103:0/574763855 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03440ae2b0 0x7f034409c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0341e00640 1 -- 172.21.15.103:0/574763855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0344070100 msgr2=0x7f03440c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0341e00640 1 --2- 172.21.15.103:0/574763855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0344070100 0x7f03440c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0341e00640 1 -- 172.21.15.103:0/574763855 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03440b4710 con 0x7f034406fd20 2024-09-10T22:39:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0341400640 1 --2- 172.21.15.103:0/574763855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0344070100 0x7f03440c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0341e00640 1 --2- 172.21.15.103:0/574763855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f034406fd20 0x7f034415d2c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f03340b0040 tx=0x7f03340a56b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f033a000640 1 -- 172.21.15.103:0/574763855 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03340b2040 con 0x7f034406fd20 2024-09-10T22:39:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f033a000640 1 -- 172.21.15.103:0/574763855 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0334004470 con 0x7f034406fd20 2024-09-10T22:39:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f033a000640 1 -- 172.21.15.103:0/574763855 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0334005290 con 0x7f034406fd20 2024-09-10T22:39:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0343200640 1 -- 172.21.15.103:0/574763855 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03440b49f0 con 0x7f034406fd20 2024-09-10T22:39:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0343200640 1 -- 172.21.15.103:0/574763855 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f034409c390 con 0x7f034406fd20 2024-09-10T22:39:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.815+0000 7f0343200640 1 -- 172.21.15.103:0/574763855 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03441511a0 con 0x7f034406fd20 2024-09-10T22:39:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.819+0000 7f033a000640 1 -- 172.21.15.103:0/574763855 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0334005430 con 0x7f034406fd20 2024-09-10T22:39:10.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.819+0000 7f033a000640 1 --2- 172.21.15.103:0/574763855 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f03240725e0 0x7f0324074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:10.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.819+0000 7f033a000640 1 -- 172.21.15.103:0/574763855 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f033412ccf0 con 0x7f034406fd20 2024-09-10T22:39:10.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.819+0000 7f0341400640 1 --2- 172.21.15.103:0/574763855 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f03240725e0 0x7f0324074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:10.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.819+0000 7f0341400640 1 --2- 172.21.15.103:0/574763855 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f03240725e0 0x7f0324074aa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f03440cbf20 tx=0x7f03300091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:10.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.823+0000 7f033a000640 1 -- 172.21.15.103:0/574763855 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f03340bc060 con 0x7f034406fd20 2024-09-10T22:39:10.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.987+0000 7f0343200640 1 -- 172.21.15.103:0/574763855 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f034406e1b0 con 0x7f03240725e0 2024-09-10T22:39:10.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.995+0000 7f033a000640 1 -- 172.21.15.103:0/574763855 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f034406e1b0 con 0x7f03240725e0 2024-09-10T22:39:11.002 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:39:11.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.999+0000 7f0343200640 1 -- 172.21.15.103:0/574763855 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f03240725e0 msgr2=0x7f0324074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:11.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.999+0000 7f0343200640 1 --2- 172.21.15.103:0/574763855 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f03240725e0 0x7f0324074aa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f03440cbf20 tx=0x7f03300091e0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.999+0000 7f0343200640 1 -- 172.21.15.103:0/574763855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f034406fd20 msgr2=0x7f034415d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:11.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.999+0000 7f0343200640 1 --2- 172.21.15.103:0/574763855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f034406fd20 0x7f034415d2c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f03340b0040 tx=0x7f03340a56b0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.999+0000 7f0343200640 1 -- 172.21.15.103:0/574763855 shutdown_connections 2024-09-10T22:39:11.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.999+0000 7f0343200640 1 --2- 172.21.15.103:0/574763855 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f03240725e0 0x7f0324074aa0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.999+0000 7f0343200640 1 --2- 172.21.15.103:0/574763855 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03440ae2b0 0x7f034409c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.999+0000 7f0343200640 1 --2- 172.21.15.103:0/574763855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0344070100 0x7f03440c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.999+0000 7f0343200640 1 --2- 172.21.15.103:0/574763855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f034406fd20 0x7f034415d2c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.999+0000 7f0343200640 1 -- 172.21.15.103:0/574763855 >> 172.21.15.103:0/574763855 conn(0x7f03440cff60 msgr2=0x7f03440b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:11.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.999+0000 7f0343200640 1 -- 172.21.15.103:0/574763855 shutdown_connections 2024-09-10T22:39:11.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:10.999+0000 7f0343200640 1 -- 172.21.15.103:0/574763855 wait complete. 2024-09-10T22:39:11.022 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-10T22:39:09.622236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219696,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755024,"statfs":{"total":773094113280,"available":772869144576,"internally_reserved":0,"allocated":3514368,"data_stored":2074472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003106"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921053+0000","last_change":"2024-09-10T22:38:48.852520+0000","last_active":"2024-09-10T22:38:54.921053+0000","last_peered":"2024-09-10T22:38:54.921053+0000","last_clean":"2024-09-10T22:38:54.921053+0000","last_became_active":"2024-09-10T22:38:48.852277+0000","last_became_peered":"2024-09-10T22:38:48.852277+0000","last_unstale":"2024-09-10T22:38:54.921053+0000","last_undegraded":"2024-09-10T22:38:54.921053+0000","last_fullsized":"2024-09-10T22:38:54.921053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:57.474446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922482+0000","last_change":"2024-09-10T22:38:49.865286+0000","last_active":"2024-09-10T22:38:54.922482+0000","last_peered":"2024-09-10T22:38:54.922482+0000","last_clean":"2024-09-10T22:38:54.922482+0000","last_became_active":"2024-09-10T22:38:49.864978+0000","last_became_peered":"2024-09-10T22:38:49.864978+0000","last_unstale":"2024-09-10T22:38:54.922482+0000","last_undegraded":"2024-09-10T22:38:54.922482+0000","last_fullsized":"2024-09-10T22:38:54.922482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:48.790469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921444+0000","last_change":"2024-09-10T22:38:54.251129+0000","last_active":"2024-09-10T22:38:54.921444+0000","last_peered":"2024-09-10T22:38:54.921444+0000","last_clean":"2024-09-10T22:38:54.921444+0000","last_became_active":"2024-09-10T22:38:54.250166+0000","last_became_peered":"2024-09-10T22:38:54.250166+0000","last_unstale":"2024-09-10T22:38:54.921444+0000","last_undegraded":"2024-09-10T22:38:54.921444+0000","last_fullsized":"2024-09-10T22:38:54.921444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:29.717841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922539+0000","last_change":"2024-09-10T22:38:48.841492+0000","last_active":"2024-09-10T22:38:54.922539+0000","last_peered":"2024-09-10T22:38:54.922539+0000","last_clean":"2024-09-10T22:38:54.922539+0000","last_became_active":"2024-09-10T22:38:48.841173+0000","last_became_peered":"2024-09-10T22:38:48.841173+0000","last_unstale":"2024-09-10T22:38:54.922539+0000","last_undegraded":"2024-09-10T22:38:54.922539+0000","last_fullsized":"2024-09-10T22:38:54.922539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:27.985660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920864+0000","last_change":"2024-09-10T22:38:49.865338+0000","last_active":"2024-09-10T22:38:54.920864+0000","last_peered":"2024-09-10T22:38:54.920864+0000","last_clean":"2024-09-10T22:38:54.920864+0000","last_became_active":"2024-09-10T22:38:49.864649+0000","last_became_peered":"2024-09-10T22:38:49.864649+0000","last_unstale":"2024-09-10T22:38:54.920864+0000","last_undegraded":"2024-09-10T22:38:54.920864+0000","last_fullsized":"2024-09-10T22:38:54.920864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:40.212977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921237+0000","last_change":"2024-09-10T22:38:53.901798+0000","last_active":"2024-09-10T22:38:54.921237+0000","last_peered":"2024-09-10T22:38:54.921237+0000","last_clean":"2024-09-10T22:38:54.921237+0000","last_became_active":"2024-09-10T22:38:53.901092+0000","last_became_peered":"2024-09-10T22:38:53.901092+0000","last_unstale":"2024-09-10T22:38:54.921237+0000","last_undegraded":"2024-09-10T22:38:54.921237+0000","last_fullsized":"2024-09-10T22:38:54.921237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:41.242227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921986+0000","last_change":"2024-09-10T22:38:48.857962+0000","last_active":"2024-09-10T22:38:54.921986+0000","last_peered":"2024-09-10T22:38:54.921986+0000","last_clean":"2024-09-10T22:38:54.921986+0000","last_became_active":"2024-09-10T22:38:48.857774+0000","last_became_peered":"2024-09-10T22:38:48.857774+0000","last_unstale":"2024-09-10T22:38:54.921986+0000","last_undegraded":"2024-09-10T22:38:54.921986+0000","last_fullsized":"2024-09-10T22:38:54.921986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:51.705558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880518+0000","last_change":"2024-09-10T22:38:49.872509+0000","last_active":"2024-09-10T22:38:54.880518+0000","last_peered":"2024-09-10T22:38:54.880518+0000","last_clean":"2024-09-10T22:38:54.880518+0000","last_became_active":"2024-09-10T22:38:49.871924+0000","last_became_peered":"2024-09-10T22:38:49.871924+0000","last_unstale":"2024-09-10T22:38:54.880518+0000","last_undegraded":"2024-09-10T22:38:54.880518+0000","last_fullsized":"2024-09-10T22:38:54.880518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:04.224631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920786+0000","last_change":"2024-09-10T22:38:53.905850+0000","last_active":"2024-09-10T22:38:54.920786+0000","last_peered":"2024-09-10T22:38:54.920786+0000","last_clean":"2024-09-10T22:38:54.920786+0000","last_became_active":"2024-09-10T22:38:53.905409+0000","last_became_peered":"2024-09-10T22:38:53.905409+0000","last_unstale":"2024-09-10T22:38:54.920786+0000","last_undegraded":"2024-09-10T22:38:54.920786+0000","last_fullsized":"2024-09-10T22:38:54.920786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:21.421252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921776+0000","last_change":"2024-09-10T22:38:48.856520+0000","last_active":"2024-09-10T22:38:54.921776+0000","last_peered":"2024-09-10T22:38:54.921776+0000","last_clean":"2024-09-10T22:38:54.921776+0000","last_became_active":"2024-09-10T22:38:48.856155+0000","last_became_peered":"2024-09-10T22:38:48.856155+0000","last_unstale":"2024-09-10T22:38:54.921776+0000","last_undegraded":"2024-09-10T22:38:54.921776+0000","last_fullsized":"2024-09-10T22:38:54.921776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:14.631039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880696+0000","last_change":"2024-09-10T22:38:49.873562+0000","last_active":"2024-09-10T22:38:54.880696+0000","last_peered":"2024-09-10T22:38:54.880696+0000","last_clean":"2024-09-10T22:38:54.880696+0000","last_became_active":"2024-09-10T22:38:49.864062+0000","last_became_peered":"2024-09-10T22:38:49.864062+0000","last_unstale":"2024-09-10T22:38:54.880696+0000","last_undegraded":"2024-09-10T22:38:54.880696+0000","last_fullsized":"2024-09-10T22:38:54.880696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:25.174871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920712+0000","last_change":"2024-09-10T22:38:53.903054+0000","last_active":"2024-09-10T22:38:54.920712+0000","last_peered":"2024-09-10T22:38:54.920712+0000","last_clean":"2024-09-10T22:38:54.920712+0000","last_became_active":"2024-09-10T22:38:53.902428+0000","last_became_peered":"2024-09-10T22:38:53.902428+0000","last_unstale":"2024-09-10T22:38:54.920712+0000","last_undegraded":"2024-09-10T22:38:54.920712+0000","last_fullsized":"2024-09-10T22:38:54.920712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:46.628037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880327+0000","last_change":"2024-09-10T22:38:49.865192+0000","last_active":"2024-09-10T22:38:54.880327+0000","last_peered":"2024-09-10T22:38:54.880327+0000","last_clean":"2024-09-10T22:38:54.880327+0000","last_became_active":"2024-09-10T22:38:49.864716+0000","last_became_peered":"2024-09-10T22:38:49.864716+0000","last_unstale":"2024-09-10T22:38:54.880327+0000","last_undegraded":"2024-09-10T22:38:54.880327+0000","last_fullsized":"2024-09-10T22:38:54.880327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:55.123251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921503+0000","last_change":"2024-09-10T22:38:48.856397+0000","last_active":"2024-09-10T22:38:54.921503+0000","last_peered":"2024-09-10T22:38:54.921503+0000","last_clean":"2024-09-10T22:38:54.921503+0000","last_became_active":"2024-09-10T22:38:48.856073+0000","last_became_peered":"2024-09-10T22:38:48.856073+0000","last_unstale":"2024-09-10T22:38:54.921503+0000","last_undegraded":"2024-09-10T22:38:54.921503+0000","last_fullsized":"2024-09-10T22:38:54.921503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:39.081533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921189+0000","last_change":"2024-09-10T22:38:53.894114+0000","last_active":"2024-09-10T22:38:54.921189+0000","last_peered":"2024-09-10T22:38:54.921189+0000","last_clean":"2024-09-10T22:38:54.921189+0000","last_became_active":"2024-09-10T22:38:53.893814+0000","last_became_peered":"2024-09-10T22:38:53.893814+0000","last_unstale":"2024-09-10T22:38:54.921189+0000","last_undegraded":"2024-09-10T22:38:54.921189+0000","last_fullsized":"2024-09-10T22:38:54.921189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:56.732998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921915+0000","last_change":"2024-09-10T22:38:49.863144+0000","last_active":"2024-09-10T22:38:54.921915+0000","last_peered":"2024-09-10T22:38:54.921915+0000","last_clean":"2024-09-10T22:38:54.921915+0000","last_became_active":"2024-09-10T22:38:49.862085+0000","last_became_peered":"2024-09-10T22:38:49.862085+0000","last_unstale":"2024-09-10T22:38:54.921915+0000","last_undegraded":"2024-09-10T22:38:54.921915+0000","last_fullsized":"2024-09-10T22:38:54.921915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:03.094296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876526+0000","last_change":"2024-09-10T22:38:48.842046+0000","last_active":"2024-09-10T22:38:54.876526+0000","last_peered":"2024-09-10T22:38:54.876526+0000","last_clean":"2024-09-10T22:38:54.876526+0000","last_became_active":"2024-09-10T22:38:48.841395+0000","last_became_peered":"2024-09-10T22:38:48.841395+0000","last_unstale":"2024-09-10T22:38:54.876526+0000","last_undegraded":"2024-09-10T22:38:54.876526+0000","last_fullsized":"2024-09-10T22:38:54.876526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:27.834255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921402+0000","last_change":"2024-09-10T22:38:53.901790+0000","last_active":"2024-09-10T22:38:54.921402+0000","last_peered":"2024-09-10T22:38:54.921402+0000","last_clean":"2024-09-10T22:38:54.921402+0000","last_became_active":"2024-09-10T22:38:53.901365+0000","last_became_peered":"2024-09-10T22:38:53.901365+0000","last_unstale":"2024-09-10T22:38:54.921402+0000","last_undegraded":"2024-09-10T22:38:54.921402+0000","last_fullsized":"2024-09-10T22:38:54.921402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:54.134756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921530+0000","last_change":"2024-09-10T22:38:49.857384+0000","last_active":"2024-09-10T22:38:54.921530+0000","last_peered":"2024-09-10T22:38:54.921530+0000","last_clean":"2024-09-10T22:38:54.921530+0000","last_became_active":"2024-09-10T22:38:49.857072+0000","last_became_peered":"2024-09-10T22:38:49.857072+0000","last_unstale":"2024-09-10T22:38:54.921530+0000","last_undegraded":"2024-09-10T22:38:54.921530+0000","last_fullsized":"2024-09-10T22:38:54.921530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:34.910658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876365+0000","last_change":"2024-09-10T22:38:48.843182+0000","last_active":"2024-09-10T22:38:54.876365+0000","last_peered":"2024-09-10T22:38:54.876365+0000","last_clean":"2024-09-10T22:38:54.876365+0000","last_became_active":"2024-09-10T22:38:48.842923+0000","last_became_peered":"2024-09-10T22:38:48.842923+0000","last_unstale":"2024-09-10T22:38:54.876365+0000","last_undegraded":"2024-09-10T22:38:54.876365+0000","last_fullsized":"2024-09-10T22:38:54.876365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:43.650324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877435+0000","last_change":"2024-09-10T22:38:54.251266+0000","last_active":"2024-09-10T22:38:54.877435+0000","last_peered":"2024-09-10T22:38:54.877435+0000","last_clean":"2024-09-10T22:38:54.877435+0000","last_became_active":"2024-09-10T22:38:54.250869+0000","last_became_peered":"2024-09-10T22:38:54.250869+0000","last_unstale":"2024-09-10T22:38:54.877435+0000","last_undegraded":"2024-09-10T22:38:54.877435+0000","last_fullsized":"2024-09-10T22:38:54.877435+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:41.537209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921172+0000","last_change":"2024-09-10T22:38:49.845466+0000","last_active":"2024-09-10T22:38:54.921172+0000","last_peered":"2024-09-10T22:38:54.921172+0000","last_clean":"2024-09-10T22:38:54.921172+0000","last_became_active":"2024-09-10T22:38:49.844534+0000","last_became_peered":"2024-09-10T22:38:49.844534+0000","last_unstale":"2024-09-10T22:38:54.921172+0000","last_undegraded":"2024-09-10T22:38:54.921172+0000","last_fullsized":"2024-09-10T22:38:54.921172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:51.184856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920528+0000","last_change":"2024-09-10T22:38:48.856827+0000","last_active":"2024-09-10T22:38:54.920528+0000","last_peered":"2024-09-10T22:38:54.920528+0000","last_clean":"2024-09-10T22:38:54.920528+0000","last_became_active":"2024-09-10T22:38:48.856254+0000","last_became_peered":"2024-09-10T22:38:48.856254+0000","last_unstale":"2024-09-10T22:38:54.920528+0000","last_undegraded":"2024-09-10T22:38:54.920528+0000","last_fullsized":"2024-09-10T22:38:54.920528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:50.178089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921261+0000","last_change":"2024-09-10T22:38:53.901780+0000","last_active":"2024-09-10T22:38:54.921261+0000","last_peered":"2024-09-10T22:38:54.921261+0000","last_clean":"2024-09-10T22:38:54.921261+0000","last_became_active":"2024-09-10T22:38:53.901291+0000","last_became_peered":"2024-09-10T22:38:53.901291+0000","last_unstale":"2024-09-10T22:38:54.921261+0000","last_undegraded":"2024-09-10T22:38:54.921261+0000","last_fullsized":"2024-09-10T22:38:54.921261+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:15.947890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921201+0000","last_change":"2024-09-10T22:38:49.851843+0000","last_active":"2024-09-10T22:38:54.921201+0000","last_peered":"2024-09-10T22:38:54.921201+0000","last_clean":"2024-09-10T22:38:54.921201+0000","last_became_active":"2024-09-10T22:38:49.851557+0000","last_became_peered":"2024-09-10T22:38:49.851557+0000","last_unstale":"2024-09-10T22:38:54.921201+0000","last_undegraded":"2024-09-10T22:38:54.921201+0000","last_fullsized":"2024-09-10T22:38:54.921201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:06.748400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881167+0000","last_change":"2024-09-10T22:38:48.853061+0000","last_active":"2024-09-10T22:38:54.881167+0000","last_peered":"2024-09-10T22:38:54.881167+0000","last_clean":"2024-09-10T22:38:54.881167+0000","last_became_active":"2024-09-10T22:38:48.852801+0000","last_became_peered":"2024-09-10T22:38:48.852801+0000","last_unstale":"2024-09-10T22:38:54.881167+0000","last_undegraded":"2024-09-10T22:38:54.881167+0000","last_fullsized":"2024-09-10T22:38:54.881167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:15.095892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920897+0000","last_change":"2024-09-10T22:38:54.251299+0000","last_active":"2024-09-10T22:38:54.920897+0000","last_peered":"2024-09-10T22:38:54.920897+0000","last_clean":"2024-09-10T22:38:54.920897+0000","last_became_active":"2024-09-10T22:38:54.250832+0000","last_became_peered":"2024-09-10T22:38:54.250832+0000","last_unstale":"2024-09-10T22:38:54.920897+0000","last_undegraded":"2024-09-10T22:38:54.920897+0000","last_fullsized":"2024-09-10T22:38:54.920897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:58.412799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922726+0000","last_change":"2024-09-10T22:38:49.861588+0000","last_active":"2024-09-10T22:38:54.922726+0000","last_peered":"2024-09-10T22:38:54.922726+0000","last_clean":"2024-09-10T22:38:54.922726+0000","last_became_active":"2024-09-10T22:38:49.861318+0000","last_became_peered":"2024-09-10T22:38:49.861318+0000","last_unstale":"2024-09-10T22:38:54.922726+0000","last_undegraded":"2024-09-10T22:38:54.922726+0000","last_fullsized":"2024-09-10T22:38:54.922726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:17.481705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876977+0000","last_change":"2024-09-10T22:38:48.837942+0000","last_active":"2024-09-10T22:38:54.876977+0000","last_peered":"2024-09-10T22:38:54.876977+0000","last_clean":"2024-09-10T22:38:54.876977+0000","last_became_active":"2024-09-10T22:38:48.836464+0000","last_became_peered":"2024-09-10T22:38:48.836464+0000","last_unstale":"2024-09-10T22:38:54.876977+0000","last_undegraded":"2024-09-10T22:38:54.876977+0000","last_fullsized":"2024-09-10T22:38:54.876977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:08.401116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920961+0000","last_change":"2024-09-10T22:38:54.247221+0000","last_active":"2024-09-10T22:38:54.920961+0000","last_peered":"2024-09-10T22:38:54.920961+0000","last_clean":"2024-09-10T22:38:54.920961+0000","last_became_active":"2024-09-10T22:38:54.246819+0000","last_became_peered":"2024-09-10T22:38:54.246819+0000","last_unstale":"2024-09-10T22:38:54.920961+0000","last_undegraded":"2024-09-10T22:38:54.920961+0000","last_fullsized":"2024-09-10T22:38:54.920961+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:32.793677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877019+0000","last_change":"2024-09-10T22:38:49.854852+0000","last_active":"2024-09-10T22:38:54.877019+0000","last_peered":"2024-09-10T22:38:54.877019+0000","last_clean":"2024-09-10T22:38:54.877019+0000","last_became_active":"2024-09-10T22:38:49.854524+0000","last_became_peered":"2024-09-10T22:38:49.854524+0000","last_unstale":"2024-09-10T22:38:54.877019+0000","last_undegraded":"2024-09-10T22:38:54.877019+0000","last_fullsized":"2024-09-10T22:38:54.877019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:50.918432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922069+0000","last_change":"2024-09-10T22:38:48.858074+0000","last_active":"2024-09-10T22:38:54.922069+0000","last_peered":"2024-09-10T22:38:54.922069+0000","last_clean":"2024-09-10T22:38:54.922069+0000","last_became_active":"2024-09-10T22:38:48.857790+0000","last_became_peered":"2024-09-10T22:38:48.857790+0000","last_unstale":"2024-09-10T22:38:54.922069+0000","last_undegraded":"2024-09-10T22:38:54.922069+0000","last_fullsized":"2024-09-10T22:38:54.922069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:33.673133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920591+0000","last_change":"2024-09-10T22:38:54.247274+0000","last_active":"2024-09-10T22:38:54.920591+0000","last_peered":"2024-09-10T22:38:54.920591+0000","last_clean":"2024-09-10T22:38:54.920591+0000","last_became_active":"2024-09-10T22:38:54.246824+0000","last_became_peered":"2024-09-10T22:38:54.246824+0000","last_unstale":"2024-09-10T22:38:54.920591+0000","last_undegraded":"2024-09-10T22:38:54.920591+0000","last_fullsized":"2024-09-10T22:38:54.920591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:29.221197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880773+0000","last_change":"2024-09-10T22:38:49.858913+0000","last_active":"2024-09-10T22:38:54.880773+0000","last_peered":"2024-09-10T22:38:54.880773+0000","last_clean":"2024-09-10T22:38:54.880773+0000","last_became_active":"2024-09-10T22:38:49.858622+0000","last_became_peered":"2024-09-10T22:38:49.858622+0000","last_unstale":"2024-09-10T22:38:54.880773+0000","last_undegraded":"2024-09-10T22:38:54.880773+0000","last_fullsized":"2024-09-10T22:38:54.880773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:24:23.510664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877113+0000","last_change":"2024-09-10T22:38:48.839218+0000","last_active":"2024-09-10T22:38:54.877113+0000","last_peered":"2024-09-10T22:38:54.877113+0000","last_clean":"2024-09-10T22:38:54.877113+0000","last_became_active":"2024-09-10T22:38:48.838970+0000","last_became_peered":"2024-09-10T22:38:48.838970+0000","last_unstale":"2024-09-10T22:38:54.877113+0000","last_undegraded":"2024-09-10T22:38:54.877113+0000","last_fullsized":"2024-09-10T22:38:54.877113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:08.395191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876369+0000","last_change":"2024-09-10T22:38:53.898832+0000","last_active":"2024-09-10T22:38:54.876369+0000","last_peered":"2024-09-10T22:38:54.876369+0000","last_clean":"2024-09-10T22:38:54.876369+0000","last_became_active":"2024-09-10T22:38:53.898360+0000","last_became_peered":"2024-09-10T22:38:53.898360+0000","last_unstale":"2024-09-10T22:38:54.876369+0000","last_undegraded":"2024-09-10T22:38:54.876369+0000","last_fullsized":"2024-09-10T22:38:54.876369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:26.747212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921150+0000","last_change":"2024-09-10T22:38:49.852619+0000","last_active":"2024-09-10T22:38:54.921150+0000","last_peered":"2024-09-10T22:38:54.921150+0000","last_clean":"2024-09-10T22:38:54.921150+0000","last_became_active":"2024-09-10T22:38:49.852266+0000","last_became_peered":"2024-09-10T22:38:49.852266+0000","last_unstale":"2024-09-10T22:38:54.921150+0000","last_undegraded":"2024-09-10T22:38:54.921150+0000","last_fullsized":"2024-09-10T22:38:54.921150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:59.442647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881111+0000","last_change":"2024-09-10T22:38:48.851373+0000","last_active":"2024-09-10T22:38:54.881111+0000","last_peered":"2024-09-10T22:38:54.881111+0000","last_clean":"2024-09-10T22:38:54.881111+0000","last_became_active":"2024-09-10T22:38:48.850929+0000","last_became_peered":"2024-09-10T22:38:48.850929+0000","last_unstale":"2024-09-10T22:38:54.881111+0000","last_undegraded":"2024-09-10T22:38:54.881111+0000","last_fullsized":"2024-09-10T22:38:54.881111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:14.631039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877092+0000","last_change":"2024-09-10T22:38:53.905250+0000","last_active":"2024-09-10T22:38:54.877092+0000","last_peered":"2024-09-10T22:38:54.877092+0000","last_clean":"2024-09-10T22:38:54.877092+0000","last_became_active":"2024-09-10T22:38:53.904841+0000","last_became_peered":"2024-09-10T22:38:53.904841+0000","last_unstale":"2024-09-10T22:38:54.877092+0000","last_undegraded":"2024-09-10T22:38:54.877092+0000","last_fullsized":"2024-09-10T22:38:54.877092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:47.327614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876131+0000","last_change":"2024-09-10T22:38:49.852020+0000","last_active":"2024-09-10T22:38:54.876131+0000","last_peered":"2024-09-10T22:38:54.876131+0000","last_clean":"2024-09-10T22:38:54.876131+0000","last_became_active":"2024-09-10T22:38:49.851701+0000","last_became_peered":"2024-09-10T22:38:49.851701+0000","last_unstale":"2024-09-10T22:38:54.876131+0000","last_undegraded":"2024-09-10T22:38:54.876131+0000","last_fullsized":"2024-09-10T22:38:54.876131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:26.280355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.919678+0000","last_change":"2024-09-10T22:38:48.840603+0000","last_active":"2024-09-10T22:38:54.919678+0000","last_peered":"2024-09-10T22:38:54.919678+0000","last_clean":"2024-09-10T22:38:54.919678+0000","last_became_active":"2024-09-10T22:38:48.840005+0000","last_became_peered":"2024-09-10T22:38:48.840005+0000","last_unstale":"2024-09-10T22:38:54.919678+0000","last_undegraded":"2024-09-10T22:38:54.919678+0000","last_fullsized":"2024-09-10T22:38:54.919678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:25.578472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877502+0000","last_change":"2024-09-10T22:38:53.909084+0000","last_active":"2024-09-10T22:38:54.877502+0000","last_peered":"2024-09-10T22:38:54.877502+0000","last_clean":"2024-09-10T22:38:54.877502+0000","last_became_active":"2024-09-10T22:38:53.908638+0000","last_became_peered":"2024-09-10T22:38:53.908638+0000","last_unstale":"2024-09-10T22:38:54.877502+0000","last_undegraded":"2024-09-10T22:38:54.877502+0000","last_fullsized":"2024-09-10T22:38:54.877502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:39.597856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920309+0000","last_change":"2024-09-10T22:38:49.862424+0000","last_active":"2024-09-10T22:38:54.920309+0000","last_peered":"2024-09-10T22:38:54.920309+0000","last_clean":"2024-09-10T22:38:54.920309+0000","last_became_active":"2024-09-10T22:38:49.862139+0000","last_became_peered":"2024-09-10T22:38:49.862139+0000","last_unstale":"2024-09-10T22:38:54.920309+0000","last_undegraded":"2024-09-10T22:38:54.920309+0000","last_fullsized":"2024-09-10T22:38:54.920309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:25.404715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920624+0000","last_change":"2024-09-10T22:38:48.856517+0000","last_active":"2024-09-10T22:38:54.920624+0000","last_peered":"2024-09-10T22:38:54.920624+0000","last_clean":"2024-09-10T22:38:54.920624+0000","last_became_active":"2024-09-10T22:38:48.855941+0000","last_became_peered":"2024-09-10T22:38:48.855941+0000","last_unstale":"2024-09-10T22:38:54.920624+0000","last_undegraded":"2024-09-10T22:38:54.920624+0000","last_fullsized":"2024-09-10T22:38:54.920624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:58.435880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921081+0000","last_change":"2024-09-10T22:38:54.252398+0000","last_active":"2024-09-10T22:38:54.921081+0000","last_peered":"2024-09-10T22:38:54.921081+0000","last_clean":"2024-09-10T22:38:54.921081+0000","last_became_active":"2024-09-10T22:38:54.251445+0000","last_became_peered":"2024-09-10T22:38:54.251445+0000","last_unstale":"2024-09-10T22:38:54.921081+0000","last_undegraded":"2024-09-10T22:38:54.921081+0000","last_fullsized":"2024-09-10T22:38:54.921081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:30.242290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921676+0000","last_change":"2024-09-10T22:38:49.875972+0000","last_active":"2024-09-10T22:38:54.921676+0000","last_peered":"2024-09-10T22:38:54.921676+0000","last_clean":"2024-09-10T22:38:54.921676+0000","last_became_active":"2024-09-10T22:38:49.875696+0000","last_became_peered":"2024-09-10T22:38:49.875696+0000","last_unstale":"2024-09-10T22:38:54.921676+0000","last_undegraded":"2024-09-10T22:38:54.921676+0000","last_fullsized":"2024-09-10T22:38:54.921676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:40.212977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881021+0000","last_change":"2024-09-10T22:38:48.853917+0000","last_active":"2024-09-10T22:38:54.881021+0000","last_peered":"2024-09-10T22:38:54.881021+0000","last_clean":"2024-09-10T22:38:54.881021+0000","last_became_active":"2024-09-10T22:38:48.853608+0000","last_became_peered":"2024-09-10T22:38:48.853608+0000","last_unstale":"2024-09-10T22:38:54.881021+0000","last_undegraded":"2024-09-10T22:38:54.881021+0000","last_fullsized":"2024-09-10T22:38:54.881021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:00.500956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920938+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:38:54.920938+0000","last_peered":"2024-09-10T22:38:54.920938+0000","last_clean":"2024-09-10T22:38:54.920938+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:38:54.920938+0000","last_undegraded":"2024-09-10T22:38:54.920938+0000","last_fullsized":"2024-09-10T22:38:54.920938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880476+0000","last_change":"2024-09-10T22:38:54.250797+0000","last_active":"2024-09-10T22:38:54.880476+0000","last_peered":"2024-09-10T22:38:54.880476+0000","last_clean":"2024-09-10T22:38:54.880476+0000","last_became_active":"2024-09-10T22:38:54.250390+0000","last_became_peered":"2024-09-10T22:38:54.250390+0000","last_unstale":"2024-09-10T22:38:54.880476+0000","last_undegraded":"2024-09-10T22:38:54.880476+0000","last_fullsized":"2024-09-10T22:38:54.880476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:15.947890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921825+0000","last_change":"2024-09-10T22:38:49.876676+0000","last_active":"2024-09-10T22:38:54.921825+0000","last_peered":"2024-09-10T22:38:54.921825+0000","last_clean":"2024-09-10T22:38:54.921825+0000","last_became_active":"2024-09-10T22:38:49.874334+0000","last_became_peered":"2024-09-10T22:38:49.874334+0000","last_unstale":"2024-09-10T22:38:54.921825+0000","last_undegraded":"2024-09-10T22:38:54.921825+0000","last_fullsized":"2024-09-10T22:38:54.921825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:11.901564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920182+0000","last_change":"2024-09-10T22:38:48.851184+0000","last_active":"2024-09-10T22:38:54.920182+0000","last_peered":"2024-09-10T22:38:54.920182+0000","last_clean":"2024-09-10T22:38:54.920182+0000","last_became_active":"2024-09-10T22:38:48.850954+0000","last_became_peered":"2024-09-10T22:38:48.850954+0000","last_unstale":"2024-09-10T22:38:54.920182+0000","last_undegraded":"2024-09-10T22:38:54.920182+0000","last_fullsized":"2024-09-10T22:38:54.920182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:16.521277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880433+0000","last_change":"2024-09-10T22:38:54.247648+0000","last_active":"2024-09-10T22:38:54.880433+0000","last_peered":"2024-09-10T22:38:54.880433+0000","last_clean":"2024-09-10T22:38:54.880433+0000","last_became_active":"2024-09-10T22:38:54.247076+0000","last_became_peered":"2024-09-10T22:38:54.247076+0000","last_unstale":"2024-09-10T22:38:54.880433+0000","last_undegraded":"2024-09-10T22:38:54.880433+0000","last_fullsized":"2024-09-10T22:38:54.880433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:54.134756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880747+0000","last_change":"2024-09-10T22:38:49.872207+0000","last_active":"2024-09-10T22:38:54.880747+0000","last_peered":"2024-09-10T22:38:54.880747+0000","last_clean":"2024-09-10T22:38:54.880747+0000","last_became_active":"2024-09-10T22:38:49.864041+0000","last_became_peered":"2024-09-10T22:38:49.864041+0000","last_unstale":"2024-09-10T22:38:54.880747+0000","last_undegraded":"2024-09-10T22:38:54.880747+0000","last_fullsized":"2024-09-10T22:38:54.880747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:19.210276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876693+0000","last_change":"2024-09-10T22:38:48.845335+0000","last_active":"2024-09-10T22:38:54.876693+0000","last_peered":"2024-09-10T22:38:54.876693+0000","last_clean":"2024-09-10T22:38:54.876693+0000","last_became_active":"2024-09-10T22:38:48.844695+0000","last_became_peered":"2024-09-10T22:38:48.844695+0000","last_unstale":"2024-09-10T22:38:54.876693+0000","last_undegraded":"2024-09-10T22:38:54.876693+0000","last_fullsized":"2024-09-10T22:38:54.876693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:49.033938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920787+0000","last_change":"2024-09-10T22:38:53.903473+0000","last_active":"2024-09-10T22:38:54.920787+0000","last_peered":"2024-09-10T22:38:54.920787+0000","last_clean":"2024-09-10T22:38:54.920787+0000","last_became_active":"2024-09-10T22:38:53.902136+0000","last_became_peered":"2024-09-10T22:38:53.902136+0000","last_unstale":"2024-09-10T22:38:54.920787+0000","last_undegraded":"2024-09-10T22:38:54.920787+0000","last_fullsized":"2024-09-10T22:38:54.920787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:23.256602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922067+0000","last_change":"2024-09-10T22:38:49.873800+0000","last_active":"2024-09-10T22:38:54.922067+0000","last_peered":"2024-09-10T22:38:54.922067+0000","last_clean":"2024-09-10T22:38:54.922067+0000","last_became_active":"2024-09-10T22:38:49.871564+0000","last_became_peered":"2024-09-10T22:38:49.871564+0000","last_unstale":"2024-09-10T22:38:54.922067+0000","last_undegraded":"2024-09-10T22:38:54.922067+0000","last_fullsized":"2024-09-10T22:38:54.922067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:18.712686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920418+0000","last_change":"2024-09-10T22:38:48.840039+0000","last_active":"2024-09-10T22:38:54.920418+0000","last_peered":"2024-09-10T22:38:54.920418+0000","last_clean":"2024-09-10T22:38:54.920418+0000","last_became_active":"2024-09-10T22:38:48.839740+0000","last_became_peered":"2024-09-10T22:38:48.839740+0000","last_unstale":"2024-09-10T22:38:54.920418+0000","last_undegraded":"2024-09-10T22:38:54.920418+0000","last_fullsized":"2024-09-10T22:38:54.920418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:46.742902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879474+0000","last_change":"2024-09-10T22:38:54.250902+0000","last_active":"2024-09-10T22:38:54.879474+0000","last_peered":"2024-09-10T22:38:54.879474+0000","last_clean":"2024-09-10T22:38:54.879474+0000","last_became_active":"2024-09-10T22:38:54.250504+0000","last_became_peered":"2024-09-10T22:38:54.250504+0000","last_unstale":"2024-09-10T22:38:54.879474+0000","last_undegraded":"2024-09-10T22:38:54.879474+0000","last_fullsized":"2024-09-10T22:38:54.879474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:24.190512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922173+0000","last_change":"2024-09-10T22:38:49.870336+0000","last_active":"2024-09-10T22:38:54.922173+0000","last_peered":"2024-09-10T22:38:54.922173+0000","last_clean":"2024-09-10T22:38:54.922173+0000","last_became_active":"2024-09-10T22:38:49.870059+0000","last_became_peered":"2024-09-10T22:38:49.870059+0000","last_unstale":"2024-09-10T22:38:54.922173+0000","last_undegraded":"2024-09-10T22:38:54.922173+0000","last_fullsized":"2024-09-10T22:38:54.922173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:53.628621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921424+0000","last_change":"2024-09-10T22:38:48.843380+0000","last_active":"2024-09-10T22:38:54.921424+0000","last_peered":"2024-09-10T22:38:54.921424+0000","last_clean":"2024-09-10T22:38:54.921424+0000","last_became_active":"2024-09-10T22:38:48.843016+0000","last_became_peered":"2024-09-10T22:38:48.843016+0000","last_unstale":"2024-09-10T22:38:54.921424+0000","last_undegraded":"2024-09-10T22:38:54.921424+0000","last_fullsized":"2024-09-10T22:38:54.921424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:41.102824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920533+0000","last_change":"2024-09-10T22:38:53.903334+0000","last_active":"2024-09-10T22:38:54.920533+0000","last_peered":"2024-09-10T22:38:54.920533+0000","last_clean":"2024-09-10T22:38:54.920533+0000","last_became_active":"2024-09-10T22:38:53.902607+0000","last_became_peered":"2024-09-10T22:38:53.902607+0000","last_unstale":"2024-09-10T22:38:54.920533+0000","last_undegraded":"2024-09-10T22:38:54.920533+0000","last_fullsized":"2024-09-10T22:38:54.920533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:06.243501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921431+0000","last_change":"2024-09-10T22:38:49.864561+0000","last_active":"2024-09-10T22:38:54.921431+0000","last_peered":"2024-09-10T22:38:54.921431+0000","last_clean":"2024-09-10T22:38:54.921431+0000","last_became_active":"2024-09-10T22:38:49.863930+0000","last_became_peered":"2024-09-10T22:38:49.863930+0000","last_unstale":"2024-09-10T22:38:54.921431+0000","last_undegraded":"2024-09-10T22:38:54.921431+0000","last_fullsized":"2024-09-10T22:38:54.921431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:45.857292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.919529+0000","last_change":"2024-09-10T22:38:48.844675+0000","last_active":"2024-09-10T22:38:54.919529+0000","last_peered":"2024-09-10T22:38:54.919529+0000","last_clean":"2024-09-10T22:38:54.919529+0000","last_became_active":"2024-09-10T22:38:48.844321+0000","last_became_peered":"2024-09-10T22:38:48.844321+0000","last_unstale":"2024-09-10T22:38:54.919529+0000","last_undegraded":"2024-09-10T22:38:54.919529+0000","last_fullsized":"2024-09-10T22:38:54.919529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:27.985660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920890+0000","last_change":"2024-09-10T22:38:53.906658+0000","last_active":"2024-09-10T22:38:54.920890+0000","last_peered":"2024-09-10T22:38:54.920890+0000","last_clean":"2024-09-10T22:38:54.920890+0000","last_became_active":"2024-09-10T22:38:53.906243+0000","last_became_peered":"2024-09-10T22:38:53.906243+0000","last_unstale":"2024-09-10T22:38:54.920890+0000","last_undegraded":"2024-09-10T22:38:54.920890+0000","last_fullsized":"2024-09-10T22:38:54.920890+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:16.451902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879773+0000","last_change":"2024-09-10T22:38:49.853280+0000","last_active":"2024-09-10T22:38:54.879773+0000","last_peered":"2024-09-10T22:38:54.879773+0000","last_clean":"2024-09-10T22:38:54.879773+0000","last_became_active":"2024-09-10T22:38:49.853004+0000","last_became_peered":"2024-09-10T22:38:49.853004+0000","last_unstale":"2024-09-10T22:38:54.879773+0000","last_undegraded":"2024-09-10T22:38:54.879773+0000","last_fullsized":"2024-09-10T22:38:54.879773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:31.367854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879963+0000","last_change":"2024-09-10T22:38:48.842684+0000","last_active":"2024-09-10T22:38:54.879963+0000","last_peered":"2024-09-10T22:38:54.879963+0000","last_clean":"2024-09-10T22:38:54.879963+0000","last_became_active":"2024-09-10T22:38:48.842404+0000","last_became_peered":"2024-09-10T22:38:48.842404+0000","last_unstale":"2024-09-10T22:38:54.879963+0000","last_undegraded":"2024-09-10T22:38:54.879963+0000","last_fullsized":"2024-09-10T22:38:54.879963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:50.178089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922637+0000","last_change":"2024-09-10T22:38:54.251473+0000","last_active":"2024-09-10T22:38:54.922637+0000","last_peered":"2024-09-10T22:38:54.922637+0000","last_clean":"2024-09-10T22:38:54.922637+0000","last_became_active":"2024-09-10T22:38:54.250056+0000","last_became_peered":"2024-09-10T22:38:54.250056+0000","last_unstale":"2024-09-10T22:38:54.922637+0000","last_undegraded":"2024-09-10T22:38:54.922637+0000","last_fullsized":"2024-09-10T22:38:54.922637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:37.784629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921312+0000","last_change":"2024-09-10T22:38:49.871550+0000","last_active":"2024-09-10T22:38:54.921312+0000","last_peered":"2024-09-10T22:38:54.921312+0000","last_clean":"2024-09-10T22:38:54.921312+0000","last_became_active":"2024-09-10T22:38:49.870681+0000","last_became_peered":"2024-09-10T22:38:49.870681+0000","last_unstale":"2024-09-10T22:38:54.921312+0000","last_undegraded":"2024-09-10T22:38:54.921312+0000","last_fullsized":"2024-09-10T22:38:54.921312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:50.088430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880116+0000","last_change":"2024-09-10T22:38:48.855410+0000","last_active":"2024-09-10T22:38:54.880116+0000","last_peered":"2024-09-10T22:38:54.880116+0000","last_clean":"2024-09-10T22:38:54.880116+0000","last_became_active":"2024-09-10T22:38:48.855072+0000","last_became_peered":"2024-09-10T22:38:48.855072+0000","last_unstale":"2024-09-10T22:38:54.880116+0000","last_undegraded":"2024-09-10T22:38:54.880116+0000","last_fullsized":"2024-09-10T22:38:54.880116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:58.435880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922141+0000","last_change":"2024-09-10T22:38:54.247975+0000","last_active":"2024-09-10T22:38:54.922141+0000","last_peered":"2024-09-10T22:38:54.922141+0000","last_clean":"2024-09-10T22:38:54.922141+0000","last_became_active":"2024-09-10T22:38:54.246763+0000","last_became_peered":"2024-09-10T22:38:54.246763+0000","last_unstale":"2024-09-10T22:38:54.922141+0000","last_undegraded":"2024-09-10T22:38:54.922141+0000","last_fullsized":"2024-09-10T22:38:54.922141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:28.248826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920626+0000","last_change":"2024-09-10T22:38:49.857923+0000","last_active":"2024-09-10T22:38:54.920626+0000","last_peered":"2024-09-10T22:38:54.920626+0000","last_clean":"2024-09-10T22:38:54.920626+0000","last_became_active":"2024-09-10T22:38:49.855403+0000","last_became_peered":"2024-09-10T22:38:49.855403+0000","last_unstale":"2024-09-10T22:38:54.920626+0000","last_undegraded":"2024-09-10T22:38:54.920626+0000","last_fullsized":"2024-09-10T22:38:54.920626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:23.327063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921037+0000","last_change":"2024-09-10T22:38:48.849925+0000","last_active":"2024-09-10T22:38:54.921037+0000","last_peered":"2024-09-10T22:38:54.921037+0000","last_clean":"2024-09-10T22:38:54.921037+0000","last_became_active":"2024-09-10T22:38:48.849598+0000","last_became_peered":"2024-09-10T22:38:48.849598+0000","last_unstale":"2024-09-10T22:38:54.921037+0000","last_undegraded":"2024-09-10T22:38:54.921037+0000","last_fullsized":"2024-09-10T22:38:54.921037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:52.840320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880603+0000","last_change":"2024-09-10T22:38:54.250860+0000","last_active":"2024-09-10T22:38:54.880603+0000","last_peered":"2024-09-10T22:38:54.880603+0000","last_clean":"2024-09-10T22:38:54.880603+0000","last_became_active":"2024-09-10T22:38:54.250456+0000","last_became_peered":"2024-09-10T22:38:54.250456+0000","last_unstale":"2024-09-10T22:38:54.880603+0000","last_undegraded":"2024-09-10T22:38:54.880603+0000","last_fullsized":"2024-09-10T22:38:54.880603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:59.690022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921718+0000","last_change":"2024-09-10T22:38:49.867772+0000","last_active":"2024-09-10T22:38:54.921718+0000","last_peered":"2024-09-10T22:38:54.921718+0000","last_clean":"2024-09-10T22:38:54.921718+0000","last_became_active":"2024-09-10T22:38:49.867491+0000","last_became_peered":"2024-09-10T22:38:49.867491+0000","last_unstale":"2024-09-10T22:38:54.921718+0000","last_undegraded":"2024-09-10T22:38:54.921718+0000","last_fullsized":"2024-09-10T22:38:54.921718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:37.195901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:39:00.652505+0000","last_change":"2024-09-10T22:38:48.841117+0000","last_active":"2024-09-10T22:39:00.652505+0000","last_peered":"2024-09-10T22:39:00.652505+0000","last_clean":"2024-09-10T22:39:00.652505+0000","last_became_active":"2024-09-10T22:38:48.840707+0000","last_became_peered":"2024-09-10T22:38:48.840707+0000","last_unstale":"2024-09-10T22:39:00.652505+0000","last_undegraded":"2024-09-10T22:39:00.652505+0000","last_fullsized":"2024-09-10T22:39:00.652505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:58.435880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876459+0000","last_change":"2024-09-10T22:38:53.898755+0000","last_active":"2024-09-10T22:38:54.876459+0000","last_peered":"2024-09-10T22:38:54.876459+0000","last_clean":"2024-09-10T22:38:54.876459+0000","last_became_active":"2024-09-10T22:38:53.898182+0000","last_became_peered":"2024-09-10T22:38:53.898182+0000","last_unstale":"2024-09-10T22:38:54.876459+0000","last_undegraded":"2024-09-10T22:38:54.876459+0000","last_fullsized":"2024-09-10T22:38:54.876459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:45.658201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921595+0000","last_change":"2024-09-10T22:38:49.859641+0000","last_active":"2024-09-10T22:38:54.921595+0000","last_peered":"2024-09-10T22:38:54.921595+0000","last_clean":"2024-09-10T22:38:54.921595+0000","last_became_active":"2024-09-10T22:38:49.859208+0000","last_became_peered":"2024-09-10T22:38:49.859208+0000","last_unstale":"2024-09-10T22:38:54.921595+0000","last_undegraded":"2024-09-10T22:38:54.921595+0000","last_fullsized":"2024-09-10T22:38:54.921595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:40.088299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876659+0000","last_change":"2024-09-10T22:38:48.852988+0000","last_active":"2024-09-10T22:38:54.876659+0000","last_peered":"2024-09-10T22:38:54.876659+0000","last_clean":"2024-09-10T22:38:54.876659+0000","last_became_active":"2024-09-10T22:38:48.852717+0000","last_became_peered":"2024-09-10T22:38:48.852717+0000","last_unstale":"2024-09-10T22:38:54.876659+0000","last_undegraded":"2024-09-10T22:38:54.876659+0000","last_fullsized":"2024-09-10T22:38:54.876659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:26.855508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920866+0000","last_change":"2024-09-10T22:38:53.894090+0000","last_active":"2024-09-10T22:38:54.920866+0000","last_peered":"2024-09-10T22:38:54.920866+0000","last_clean":"2024-09-10T22:38:54.920866+0000","last_became_active":"2024-09-10T22:38:53.893574+0000","last_became_peered":"2024-09-10T22:38:53.893574+0000","last_unstale":"2024-09-10T22:38:54.920866+0000","last_undegraded":"2024-09-10T22:38:54.920866+0000","last_fullsized":"2024-09-10T22:38:54.920866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:49.903618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921016+0000","last_change":"2024-09-10T22:38:49.864920+0000","last_active":"2024-09-10T22:38:54.921016+0000","last_peered":"2024-09-10T22:38:54.921016+0000","last_clean":"2024-09-10T22:38:54.921016+0000","last_became_active":"2024-09-10T22:38:49.864424+0000","last_became_peered":"2024-09-10T22:38:49.864424+0000","last_unstale":"2024-09-10T22:38:54.921016+0000","last_undegraded":"2024-09-10T22:38:54.921016+0000","last_fullsized":"2024-09-10T22:38:54.921016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:19.035607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880817+0000","last_change":"2024-09-10T22:38:48.859261+0000","last_active":"2024-09-10T22:38:54.880817+0000","last_peered":"2024-09-10T22:38:54.880817+0000","last_clean":"2024-09-10T22:38:54.880817+0000","last_became_active":"2024-09-10T22:38:48.858966+0000","last_became_peered":"2024-09-10T22:38:48.858966+0000","last_unstale":"2024-09-10T22:38:54.880817+0000","last_undegraded":"2024-09-10T22:38:54.880817+0000","last_fullsized":"2024-09-10T22:38:54.880817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:15.095892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921394+0000","last_change":"2024-09-10T22:38:53.906015+0000","last_active":"2024-09-10T22:38:54.921394+0000","last_peered":"2024-09-10T22:38:54.921394+0000","last_clean":"2024-09-10T22:38:54.921394+0000","last_became_active":"2024-09-10T22:38:53.905650+0000","last_became_peered":"2024-09-10T22:38:53.905650+0000","last_unstale":"2024-09-10T22:38:54.921394+0000","last_undegraded":"2024-09-10T22:38:54.921394+0000","last_fullsized":"2024-09-10T22:38:54.921394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:41.757743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880707+0000","last_change":"2024-09-10T22:38:49.872132+0000","last_active":"2024-09-10T22:38:54.880707+0000","last_peered":"2024-09-10T22:38:54.880707+0000","last_clean":"2024-09-10T22:38:54.880707+0000","last_became_active":"2024-09-10T22:38:49.871810+0000","last_became_peered":"2024-09-10T22:38:49.871810+0000","last_unstale":"2024-09-10T22:38:54.880707+0000","last_undegraded":"2024-09-10T22:38:54.880707+0000","last_fullsized":"2024-09-10T22:38:54.880707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:17.481705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881042+0000","last_change":"2024-09-10T22:38:48.852986+0000","last_active":"2024-09-10T22:38:54.881042+0000","last_peered":"2024-09-10T22:38:54.881042+0000","last_clean":"2024-09-10T22:38:54.881042+0000","last_became_active":"2024-09-10T22:38:48.852519+0000","last_became_peered":"2024-09-10T22:38:48.852519+0000","last_unstale":"2024-09-10T22:38:54.881042+0000","last_undegraded":"2024-09-10T22:38:54.881042+0000","last_fullsized":"2024-09-10T22:38:54.881042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:00.500956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921502+0000","last_change":"2024-09-10T22:38:54.248043+0000","last_active":"2024-09-10T22:38:54.921502+0000","last_peered":"2024-09-10T22:38:54.921502+0000","last_clean":"2024-09-10T22:38:54.921502+0000","last_became_active":"2024-09-10T22:38:54.247585+0000","last_became_peered":"2024-09-10T22:38:54.247585+0000","last_unstale":"2024-09-10T22:38:54.921502+0000","last_undegraded":"2024-09-10T22:38:54.921502+0000","last_fullsized":"2024-09-10T22:38:54.921502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:17.956102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920839+0000","last_change":"2024-09-10T22:38:54.252858+0000","last_active":"2024-09-10T22:38:54.920839+0000","last_peered":"2024-09-10T22:38:54.920839+0000","last_clean":"2024-09-10T22:38:54.920839+0000","last_became_active":"2024-09-10T22:38:54.251257+0000","last_became_peered":"2024-09-10T22:38:54.251257+0000","last_unstale":"2024-09-10T22:38:54.920839+0000","last_undegraded":"2024-09-10T22:38:54.920839+0000","last_fullsized":"2024-09-10T22:38:54.920839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:24:27.556990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876243+0000","last_change":"2024-09-10T22:38:49.856861+0000","last_active":"2024-09-10T22:38:54.876243+0000","last_peered":"2024-09-10T22:38:54.876243+0000","last_clean":"2024-09-10T22:38:54.876243+0000","last_became_active":"2024-09-10T22:38:49.856585+0000","last_became_peered":"2024-09-10T22:38:49.856585+0000","last_unstale":"2024-09-10T22:38:54.876243+0000","last_undegraded":"2024-09-10T22:38:54.876243+0000","last_fullsized":"2024-09-10T22:38:54.876243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:53.022943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879803+0000","last_change":"2024-09-10T22:38:48.845774+0000","last_active":"2024-09-10T22:38:54.879803+0000","last_peered":"2024-09-10T22:38:54.879803+0000","last_clean":"2024-09-10T22:38:54.879803+0000","last_became_active":"2024-09-10T22:38:48.845377+0000","last_became_peered":"2024-09-10T22:38:48.845377+0000","last_unstale":"2024-09-10T22:38:54.879803+0000","last_undegraded":"2024-09-10T22:38:54.879803+0000","last_fullsized":"2024-09-10T22:38:54.879803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:50.178089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880779+0000","last_change":"2024-09-10T22:38:53.902490+0000","last_active":"2024-09-10T22:38:54.880779+0000","last_peered":"2024-09-10T22:38:54.880779+0000","last_clean":"2024-09-10T22:38:54.880779+0000","last_became_active":"2024-09-10T22:38:53.901598+0000","last_became_peered":"2024-09-10T22:38:53.901598+0000","last_unstale":"2024-09-10T22:38:54.880779+0000","last_undegraded":"2024-09-10T22:38:54.880779+0000","last_fullsized":"2024-09-10T22:38:54.880779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:41.242227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921373+0000","last_change":"2024-09-10T22:38:49.863394+0000","last_active":"2024-09-10T22:38:54.921373+0000","last_peered":"2024-09-10T22:38:54.921373+0000","last_clean":"2024-09-10T22:38:54.921373+0000","last_became_active":"2024-09-10T22:38:49.861032+0000","last_became_peered":"2024-09-10T22:38:49.861032+0000","last_unstale":"2024-09-10T22:38:54.921373+0000","last_undegraded":"2024-09-10T22:38:54.921373+0000","last_fullsized":"2024-09-10T22:38:54.921373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:31.367854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921736+0000","last_change":"2024-09-10T22:38:48.836017+0000","last_active":"2024-09-10T22:38:54.921736+0000","last_peered":"2024-09-10T22:38:54.921736+0000","last_clean":"2024-09-10T22:38:54.921736+0000","last_became_active":"2024-09-10T22:38:48.835739+0000","last_became_peered":"2024-09-10T22:38:48.835739+0000","last_unstale":"2024-09-10T22:38:54.921736+0000","last_undegraded":"2024-09-10T22:38:54.921736+0000","last_fullsized":"2024-09-10T22:38:54.921736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:00.479025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880538+0000","last_change":"2024-09-10T22:38:48.843526+0000","last_active":"2024-09-10T22:38:54.880538+0000","last_peered":"2024-09-10T22:38:54.880538+0000","last_clean":"2024-09-10T22:38:54.880538+0000","last_became_active":"2024-09-10T22:38:48.843248+0000","last_became_peered":"2024-09-10T22:38:48.843248+0000","last_unstale":"2024-09-10T22:38:54.880538+0000","last_undegraded":"2024-09-10T22:38:54.880538+0000","last_fullsized":"2024-09-10T22:38:54.880538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:39.081533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920942+0000","last_change":"2024-09-10T22:38:49.854189+0000","last_active":"2024-09-10T22:38:54.920942+0000","last_peered":"2024-09-10T22:38:54.920942+0000","last_clean":"2024-09-10T22:38:54.920942+0000","last_became_active":"2024-09-10T22:38:49.853954+0000","last_became_peered":"2024-09-10T22:38:49.853954+0000","last_unstale":"2024-09-10T22:38:54.920942+0000","last_undegraded":"2024-09-10T22:38:54.920942+0000","last_fullsized":"2024-09-10T22:38:54.920942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:55.123251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.919913+0000","last_change":"2024-09-10T22:38:53.912413+0000","last_active":"2024-09-10T22:38:54.919913+0000","last_peered":"2024-09-10T22:38:54.919913+0000","last_clean":"2024-09-10T22:38:54.919913+0000","last_became_active":"2024-09-10T22:38:53.904237+0000","last_became_peered":"2024-09-10T22:38:53.904237+0000","last_unstale":"2024-09-10T22:38:54.919913+0000","last_undegraded":"2024-09-10T22:38:54.919913+0000","last_fullsized":"2024-09-10T22:38:54.919913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:27.373389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921981+0000","last_change":"2024-09-10T22:38:48.853221+0000","last_active":"2024-09-10T22:38:54.921981+0000","last_peered":"2024-09-10T22:38:54.921981+0000","last_clean":"2024-09-10T22:38:54.921981+0000","last_became_active":"2024-09-10T22:38:48.852950+0000","last_became_peered":"2024-09-10T22:38:48.852950+0000","last_unstale":"2024-09-10T22:38:54.921981+0000","last_undegraded":"2024-09-10T22:38:54.921981+0000","last_fullsized":"2024-09-10T22:38:54.921981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:25.578472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920722+0000","last_change":"2024-09-10T22:38:49.851848+0000","last_active":"2024-09-10T22:38:54.920722+0000","last_peered":"2024-09-10T22:38:54.920722+0000","last_clean":"2024-09-10T22:38:54.920722+0000","last_became_active":"2024-09-10T22:38:49.851614+0000","last_became_peered":"2024-09-10T22:38:49.851614+0000","last_unstale":"2024-09-10T22:38:54.920722+0000","last_undegraded":"2024-09-10T22:38:54.920722+0000","last_fullsized":"2024-09-10T22:38:54.920722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:52.712325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922284+0000","last_change":"2024-09-10T22:38:53.910509+0000","last_active":"2024-09-10T22:38:54.922284+0000","last_peered":"2024-09-10T22:38:54.922284+0000","last_clean":"2024-09-10T22:38:54.922284+0000","last_became_active":"2024-09-10T22:38:53.910132+0000","last_became_peered":"2024-09-10T22:38:53.910132+0000","last_unstale":"2024-09-10T22:38:54.922284+0000","last_undegraded":"2024-09-10T22:38:54.922284+0000","last_fullsized":"2024-09-10T22:38:54.922284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:56.978517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879620+0000","last_change":"2024-09-10T22:38:49.859715+0000","last_active":"2024-09-10T22:38:54.879620+0000","last_peered":"2024-09-10T22:38:54.879620+0000","last_clean":"2024-09-10T22:38:54.879620+0000","last_became_active":"2024-09-10T22:38:49.859460+0000","last_became_peered":"2024-09-10T22:38:49.859460+0000","last_unstale":"2024-09-10T22:38:54.879620+0000","last_undegraded":"2024-09-10T22:38:54.879620+0000","last_fullsized":"2024-09-10T22:38:54.879620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:47.476429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.919633+0000","last_change":"2024-09-10T22:38:49.857017+0000","last_active":"2024-09-10T22:38:54.919633+0000","last_peered":"2024-09-10T22:38:54.919633+0000","last_clean":"2024-09-10T22:38:54.919633+0000","last_became_active":"2024-09-10T22:38:49.856717+0000","last_became_peered":"2024-09-10T22:38:49.856717+0000","last_unstale":"2024-09-10T22:38:54.919633+0000","last_undegraded":"2024-09-10T22:38:54.919633+0000","last_fullsized":"2024-09-10T22:38:54.919633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:40.088299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880065+0000","last_change":"2024-09-10T22:38:49.864344+0000","last_active":"2024-09-10T22:38:54.880065+0000","last_peered":"2024-09-10T22:38:54.880065+0000","last_clean":"2024-09-10T22:38:54.880065+0000","last_became_active":"2024-09-10T22:38:49.863615+0000","last_became_peered":"2024-09-10T22:38:49.863615+0000","last_unstale":"2024-09-10T22:38:54.880065+0000","last_undegraded":"2024-09-10T22:38:54.880065+0000","last_fullsized":"2024-09-10T22:38:54.880065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:17.040028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920749+0000","last_change":"2024-09-10T22:38:49.863316+0000","last_active":"2024-09-10T22:38:54.920749+0000","last_peered":"2024-09-10T22:38:54.920749+0000","last_clean":"2024-09-10T22:38:54.920749+0000","last_became_active":"2024-09-10T22:38:49.860671+0000","last_became_peered":"2024-09-10T22:38:49.860671+0000","last_unstale":"2024-09-10T22:38:54.920749+0000","last_undegraded":"2024-09-10T22:38:54.920749+0000","last_fullsized":"2024-09-10T22:38:54.920749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:31.367854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922304+0000","last_change":"2024-09-10T22:38:49.859296+0000","last_active":"2024-09-10T22:38:54.922304+0000","last_peered":"2024-09-10T22:38:54.922304+0000","last_clean":"2024-09-10T22:38:54.922304+0000","last_became_active":"2024-09-10T22:38:49.859054+0000","last_became_peered":"2024-09-10T22:38:49.859054+0000","last_unstale":"2024-09-10T22:38:54.922304+0000","last_undegraded":"2024-09-10T22:38:54.922304+0000","last_fullsized":"2024-09-10T22:38:54.922304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:06.748400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876558+0000","last_change":"2024-09-10T22:38:49.855782+0000","last_active":"2024-09-10T22:38:54.876558+0000","last_peered":"2024-09-10T22:38:54.876558+0000","last_clean":"2024-09-10T22:38:54.876558+0000","last_became_active":"2024-09-10T22:38:49.855512+0000","last_became_peered":"2024-09-10T22:38:49.855512+0000","last_unstale":"2024-09-10T22:38:54.876558+0000","last_undegraded":"2024-09-10T22:38:54.876558+0000","last_fullsized":"2024-09-10T22:38:54.876558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:36.250426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881513+0000","last_change":"2024-09-10T22:38:49.864470+0000","last_active":"2024-09-10T22:38:54.881513+0000","last_peered":"2024-09-10T22:38:54.881513+0000","last_clean":"2024-09-10T22:38:54.881513+0000","last_became_active":"2024-09-10T22:38:49.864209+0000","last_became_peered":"2024-09-10T22:38:49.864209+0000","last_unstale":"2024-09-10T22:38:54.881513+0000","last_undegraded":"2024-09-10T22:38:54.881513+0000","last_fullsized":"2024-09-10T22:38:54.881513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:19.035607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922630+0000","last_change":"2024-09-10T22:38:49.857545+0000","last_active":"2024-09-10T22:38:54.922630+0000","last_peered":"2024-09-10T22:38:54.922630+0000","last_clean":"2024-09-10T22:38:54.922630+0000","last_became_active":"2024-09-10T22:38:49.857281+0000","last_became_peered":"2024-09-10T22:38:49.857281+0000","last_unstale":"2024-09-10T22:38:54.922630+0000","last_undegraded":"2024-09-10T22:38:54.922630+0000","last_fullsized":"2024-09-10T22:38:54.922630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:04.224631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879697+0000","last_change":"2024-09-10T22:38:49.856408+0000","last_active":"2024-09-10T22:38:54.879697+0000","last_peered":"2024-09-10T22:38:54.879697+0000","last_clean":"2024-09-10T22:38:54.879697+0000","last_became_active":"2024-09-10T22:38:49.856141+0000","last_became_peered":"2024-09-10T22:38:49.856141+0000","last_unstale":"2024-09-10T22:38:54.879697+0000","last_undegraded":"2024-09-10T22:38:54.879697+0000","last_fullsized":"2024-09-10T22:38:54.879697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:42.581712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921683+0000","last_change":"2024-09-10T22:38:49.859369+0000","last_active":"2024-09-10T22:38:54.921683+0000","last_peered":"2024-09-10T22:38:54.921683+0000","last_clean":"2024-09-10T22:38:54.921683+0000","last_became_active":"2024-09-10T22:38:49.859101+0000","last_became_peered":"2024-09-10T22:38:49.859101+0000","last_unstale":"2024-09-10T22:38:54.921683+0000","last_undegraded":"2024-09-10T22:38:54.921683+0000","last_fullsized":"2024-09-10T22:38:54.921683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:55.123251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879955+0000","last_change":"2024-09-10T22:38:49.863959+0000","last_active":"2024-09-10T22:38:54.879955+0000","last_peered":"2024-09-10T22:38:54.879955+0000","last_clean":"2024-09-10T22:38:54.879955+0000","last_became_active":"2024-09-10T22:38:49.860396+0000","last_became_peered":"2024-09-10T22:38:49.860396+0000","last_unstale":"2024-09-10T22:38:54.879955+0000","last_undegraded":"2024-09-10T22:38:54.879955+0000","last_fullsized":"2024-09-10T22:38:54.879955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:48.790469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920595+0000","last_change":"2024-09-10T22:38:49.864151+0000","last_active":"2024-09-10T22:38:54.920595+0000","last_peered":"2024-09-10T22:38:54.920595+0000","last_clean":"2024-09-10T22:38:54.920595+0000","last_became_active":"2024-09-10T22:38:49.863808+0000","last_became_peered":"2024-09-10T22:38:49.863808+0000","last_unstale":"2024-09-10T22:38:54.920595+0000","last_undegraded":"2024-09-10T22:38:54.920595+0000","last_fullsized":"2024-09-10T22:38:54.920595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:09.915981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880880+0000","last_change":"2024-09-10T22:38:49.860196+0000","last_active":"2024-09-10T22:38:54.880880+0000","last_peered":"2024-09-10T22:38:54.880880+0000","last_clean":"2024-09-10T22:38:54.880880+0000","last_became_active":"2024-09-10T22:38:49.858960+0000","last_became_peered":"2024-09-10T22:38:49.858960+0000","last_unstale":"2024-09-10T22:38:54.880880+0000","last_undegraded":"2024-09-10T22:38:54.880880+0000","last_fullsized":"2024-09-10T22:38:54.880880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:07.814853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921985+0000","last_change":"2024-09-10T22:38:49.868433+0000","last_active":"2024-09-10T22:38:54.921985+0000","last_peered":"2024-09-10T22:38:54.921985+0000","last_clean":"2024-09-10T22:38:54.921985+0000","last_became_active":"2024-09-10T22:38:49.868198+0000","last_became_peered":"2024-09-10T22:38:49.868198+0000","last_unstale":"2024-09-10T22:38:54.921985+0000","last_undegraded":"2024-09-10T22:38:54.921985+0000","last_fullsized":"2024-09-10T22:38:54.921985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:06.062397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920326+0000","last_change":"2024-09-10T22:38:49.859841+0000","last_active":"2024-09-10T22:38:54.920326+0000","last_peered":"2024-09-10T22:38:54.920326+0000","last_clean":"2024-09-10T22:38:54.920326+0000","last_became_active":"2024-09-10T22:38:49.859562+0000","last_became_peered":"2024-09-10T22:38:49.859562+0000","last_unstale":"2024-09-10T22:38:54.920326+0000","last_undegraded":"2024-09-10T22:38:54.920326+0000","last_fullsized":"2024-09-10T22:38:54.920326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:52.712325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880988+0000","last_change":"2024-09-10T22:38:49.872678+0000","last_active":"2024-09-10T22:38:54.880988+0000","last_peered":"2024-09-10T22:38:54.880988+0000","last_clean":"2024-09-10T22:38:54.880988+0000","last_became_active":"2024-09-10T22:38:49.865080+0000","last_became_peered":"2024-09-10T22:38:49.865080+0000","last_unstale":"2024-09-10T22:38:54.880988+0000","last_undegraded":"2024-09-10T22:38:54.880988+0000","last_fullsized":"2024-09-10T22:38:54.880988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:12.405576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879563+0000","last_change":"2024-09-10T22:38:49.874375+0000","last_active":"2024-09-10T22:38:54.879563+0000","last_peered":"2024-09-10T22:38:54.879563+0000","last_clean":"2024-09-10T22:38:54.879563+0000","last_became_active":"2024-09-10T22:38:49.864635+0000","last_became_peered":"2024-09-10T22:38:49.864635+0000","last_unstale":"2024-09-10T22:38:54.879563+0000","last_undegraded":"2024-09-10T22:38:54.879563+0000","last_fullsized":"2024-09-10T22:38:54.879563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:06.748400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876261+0000","last_change":"2024-09-10T22:38:49.855866+0000","last_active":"2024-09-10T22:38:54.876261+0000","last_peered":"2024-09-10T22:38:54.876261+0000","last_clean":"2024-09-10T22:38:54.876261+0000","last_became_active":"2024-09-10T22:38:49.855589+0000","last_became_peered":"2024-09-10T22:38:49.855589+0000","last_unstale":"2024-09-10T22:38:54.876261+0000","last_undegraded":"2024-09-10T22:38:54.876261+0000","last_fullsized":"2024-09-10T22:38:54.876261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:01.561974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920523+0000","last_change":"2024-09-10T22:38:49.853285+0000","last_active":"2024-09-10T22:38:54.920523+0000","last_peered":"2024-09-10T22:38:54.920523+0000","last_clean":"2024-09-10T22:38:54.920523+0000","last_became_active":"2024-09-10T22:38:49.853028+0000","last_became_peered":"2024-09-10T22:38:49.853028+0000","last_unstale":"2024-09-10T22:38:54.920523+0000","last_undegraded":"2024-09-10T22:38:54.920523+0000","last_fullsized":"2024-09-10T22:38:54.920523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:47.476429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921891+0000","last_change":"2024-09-10T22:38:49.865621+0000","last_active":"2024-09-10T22:38:54.921891+0000","last_peered":"2024-09-10T22:38:54.921891+0000","last_clean":"2024-09-10T22:38:54.921891+0000","last_became_active":"2024-09-10T22:38:49.865387+0000","last_became_peered":"2024-09-10T22:38:49.865387+0000","last_unstale":"2024-09-10T22:38:54.921891+0000","last_undegraded":"2024-09-10T22:38:54.921891+0000","last_fullsized":"2024-09-10T22:38:54.921891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:19.035607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921609+0000","last_change":"2024-09-10T22:38:49.870354+0000","last_active":"2024-09-10T22:38:54.921609+0000","last_peered":"2024-09-10T22:38:54.921609+0000","last_clean":"2024-09-10T22:38:54.921609+0000","last_became_active":"2024-09-10T22:38:49.870096+0000","last_became_peered":"2024-09-10T22:38:49.870096+0000","last_unstale":"2024-09-10T22:38:54.921609+0000","last_undegraded":"2024-09-10T22:38:54.921609+0000","last_fullsized":"2024-09-10T22:38:54.921609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:15.637806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880712+0000","last_change":"2024-09-10T22:38:49.875540+0000","last_active":"2024-09-10T22:38:54.880712+0000","last_peered":"2024-09-10T22:38:54.880712+0000","last_clean":"2024-09-10T22:38:54.880712+0000","last_became_active":"2024-09-10T22:38:49.875252+0000","last_became_peered":"2024-09-10T22:38:49.875252+0000","last_unstale":"2024-09-10T22:38:54.880712+0000","last_undegraded":"2024-09-10T22:38:54.880712+0000","last_fullsized":"2024-09-10T22:38:54.880712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:34.910658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881419+0000","last_change":"2024-09-10T22:38:49.875982+0000","last_active":"2024-09-10T22:38:54.881419+0000","last_peered":"2024-09-10T22:38:54.881419+0000","last_clean":"2024-09-10T22:38:54.881419+0000","last_became_active":"2024-09-10T22:38:49.875341+0000","last_became_peered":"2024-09-10T22:38:49.875341+0000","last_unstale":"2024-09-10T22:38:54.881419+0000","last_undegraded":"2024-09-10T22:38:54.881419+0000","last_fullsized":"2024-09-10T22:38:54.881419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:06.748400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921957+0000","last_change":"2024-09-10T22:38:49.879221+0000","last_active":"2024-09-10T22:38:54.921957+0000","last_peered":"2024-09-10T22:38:54.921957+0000","last_clean":"2024-09-10T22:38:54.921957+0000","last_became_active":"2024-09-10T22:38:49.878667+0000","last_became_peered":"2024-09-10T22:38:49.878667+0000","last_unstale":"2024-09-10T22:38:54.921957+0000","last_undegraded":"2024-09-10T22:38:54.921957+0000","last_fullsized":"2024-09-10T22:38:54.921957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:17.870564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921273+0000","last_change":"2024-09-10T22:38:49.875937+0000","last_active":"2024-09-10T22:38:54.921273+0000","last_peered":"2024-09-10T22:38:54.921273+0000","last_clean":"2024-09-10T22:38:54.921273+0000","last_became_active":"2024-09-10T22:38:49.875601+0000","last_became_peered":"2024-09-10T22:38:49.875601+0000","last_unstale":"2024-09-10T22:38:54.921273+0000","last_undegraded":"2024-09-10T22:38:54.921273+0000","last_fullsized":"2024-09-10T22:38:54.921273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:47.476429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921312+0000","last_change":"2024-09-10T22:38:49.861791+0000","last_active":"2024-09-10T22:38:54.921312+0000","last_peered":"2024-09-10T22:38:54.921312+0000","last_clean":"2024-09-10T22:38:54.921312+0000","last_became_active":"2024-09-10T22:38:49.861416+0000","last_became_peered":"2024-09-10T22:38:49.861416+0000","last_unstale":"2024-09-10T22:38:54.921312+0000","last_undegraded":"2024-09-10T22:38:54.921312+0000","last_fullsized":"2024-09-10T22:38:54.921312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:52.686672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879849+0000","last_change":"2024-09-10T22:38:49.865136+0000","last_active":"2024-09-10T22:38:54.879849+0000","last_peered":"2024-09-10T22:38:54.879849+0000","last_clean":"2024-09-10T22:38:54.879849+0000","last_became_active":"2024-09-10T22:38:49.863627+0000","last_became_peered":"2024-09-10T22:38:49.863627+0000","last_unstale":"2024-09-10T22:38:54.879849+0000","last_undegraded":"2024-09-10T22:38:54.879849+0000","last_fullsized":"2024-09-10T22:38:54.879849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:03.094296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921124+0000","last_change":"2024-09-10T22:38:49.869098+0000","last_active":"2024-09-10T22:38:54.921124+0000","last_peered":"2024-09-10T22:38:54.921124+0000","last_clean":"2024-09-10T22:38:54.921124+0000","last_became_active":"2024-09-10T22:38:49.868795+0000","last_became_peered":"2024-09-10T22:38:49.868795+0000","last_unstale":"2024-09-10T22:38:54.921124+0000","last_undegraded":"2024-09-10T22:38:54.921124+0000","last_fullsized":"2024-09-10T22:38:54.921124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:54.366473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880168+0000","last_change":"2024-09-10T22:38:49.878358+0000","last_active":"2024-09-10T22:38:54.880168+0000","last_peered":"2024-09-10T22:38:54.880168+0000","last_clean":"2024-09-10T22:38:54.880168+0000","last_became_active":"2024-09-10T22:38:49.874435+0000","last_became_peered":"2024-09-10T22:38:49.874435+0000","last_unstale":"2024-09-10T22:38:54.880168+0000","last_undegraded":"2024-09-10T22:38:54.880168+0000","last_fullsized":"2024-09-10T22:38:54.880168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:02.684980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920702+0000","last_change":"2024-09-10T22:38:49.851801+0000","last_active":"2024-09-10T22:38:54.920702+0000","last_peered":"2024-09-10T22:38:54.920702+0000","last_clean":"2024-09-10T22:38:54.920702+0000","last_became_active":"2024-09-10T22:38:49.851524+0000","last_became_peered":"2024-09-10T22:38:49.851524+0000","last_unstale":"2024-09-10T22:38:54.920702+0000","last_undegraded":"2024-09-10T22:38:54.920702+0000","last_fullsized":"2024-09-10T22:38:54.920702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:34.910658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876927+0000","last_change":"2024-09-10T22:38:49.852964+0000","last_active":"2024-09-10T22:38:54.876927+0000","last_peered":"2024-09-10T22:38:54.876927+0000","last_clean":"2024-09-10T22:38:54.876927+0000","last_became_active":"2024-09-10T22:38:49.852647+0000","last_became_peered":"2024-09-10T22:38:49.852647+0000","last_unstale":"2024-09-10T22:38:54.876927+0000","last_undegraded":"2024-09-10T22:38:54.876927+0000","last_fullsized":"2024-09-10T22:38:54.876927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:16.799449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921778+0000","last_change":"2024-09-10T22:38:49.878950+0000","last_active":"2024-09-10T22:38:54.921778+0000","last_peered":"2024-09-10T22:38:54.921778+0000","last_clean":"2024-09-10T22:38:54.921778+0000","last_became_active":"2024-09-10T22:38:49.874505+0000","last_became_peered":"2024-09-10T22:38:49.874505+0000","last_unstale":"2024-09-10T22:38:54.921778+0000","last_undegraded":"2024-09-10T22:38:54.921778+0000","last_fullsized":"2024-09-10T22:38:54.921778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:46.274751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":880640,"data_stored":701507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":286720,"data_stored":110647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":110683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":282624,"data_stored":110557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":888832,"data_stored":701563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":110717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:39:11.028 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:39:11.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.203+0000 7fe39b400640 1 -- 172.21.15.103:0/539248901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe39406e1d0 msgr2=0x7fe3940cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:11.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.203+0000 7fe39b400640 1 --2- 172.21.15.103:0/539248901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe39406e1d0 0x7fe3940cceb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009c80 tx=0x7fe38c01cda0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.203+0000 7fe39b400640 1 -- 172.21.15.103:0/539248901 shutdown_connections 2024-09-10T22:39:11.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.203+0000 7fe39b400640 1 --2- 172.21.15.103:0/539248901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe39406e1d0 0x7fe3940cceb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.203+0000 7fe39b400640 1 --2- 172.21.15.103:0/539248901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe39415b9e0 0x7fe3940cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.203+0000 7fe39b400640 1 -- 172.21.15.103:0/539248901 >> 172.21.15.103:0/539248901 conn(0x7fe3940b1c00 msgr2=0x7fe3940b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:11.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.203+0000 7fe39b400640 1 -- 172.21.15.103:0/539248901 shutdown_connections 2024-09-10T22:39:11.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.203+0000 7fe39b400640 1 -- 172.21.15.103:0/539248901 wait complete. 2024-09-10T22:39:11.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.203+0000 7fe39b400640 1 Processor -- start 2024-09-10T22:39:11.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.203+0000 7fe39b400640 1 -- start start 2024-09-10T22:39:11.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.203+0000 7fe39b400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe39406e1d0 0x7fe3941f9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:11.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.203+0000 7fe39b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3940ad8f0 0x7fe3940b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:11.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.203+0000 7fe39b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe39415b9e0 0x7fe3940b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:11.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.203+0000 7fe39b400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe394168ef0 con 0x7fe3940ad8f0 2024-09-10T22:39:11.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.203+0000 7fe39b400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe394168d70 con 0x7fe39415b9e0 2024-09-10T22:39:11.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.203+0000 7fe39b400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe394169070 con 0x7fe39406e1d0 2024-09-10T22:39:11.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe38be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3940ad8f0 0x7fe3940b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:11.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe38be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3940ad8f0 0x7fe3940b1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49170/0 (socket says 172.21.15.103:49170) 2024-09-10T22:39:11.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe38be00640 1 -- 172.21.15.103:0/1777724017 learned_addr learned my addr 172.21.15.103:0/1777724017 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:11.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe398a00640 1 --2- 172.21.15.103:0/1777724017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe39406e1d0 0x7fe3941f9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:11.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe399400640 1 --2- 172.21.15.103:0/1777724017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe39415b9e0 0x7fe3940b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:11.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe38be00640 1 -- 172.21.15.103:0/1777724017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe39406e1d0 msgr2=0x7fe3941f9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:11.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe38be00640 1 --2- 172.21.15.103:0/1777724017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe39406e1d0 0x7fe3941f9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe38be00640 1 -- 172.21.15.103:0/1777724017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe39415b9e0 msgr2=0x7fe3940b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:11.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe38be00640 1 --2- 172.21.15.103:0/1777724017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe39415b9e0 0x7fe3940b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe38be00640 1 -- 172.21.15.103:0/1777724017 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3940afb10 con 0x7fe3940ad8f0 2024-09-10T22:39:11.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe398a00640 1 --2- 172.21.15.103:0/1777724017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe39406e1d0 0x7fe3941f9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:11.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe399400640 1 --2- 172.21.15.103:0/1777724017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe39415b9e0 0x7fe3940b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:11.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe38be00640 1 --2- 172.21.15.103:0/1777724017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3940ad8f0 0x7fe3940b1000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00c400 tx=0x7fe37c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:11.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe391600640 1 -- 172.21.15.103:0/1777724017 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37c017070 con 0x7fe3940ad8f0 2024-09-10T22:39:11.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe391600640 1 -- 172.21.15.103:0/1777724017 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe37c0053e0 con 0x7fe3940ad8f0 2024-09-10T22:39:11.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe391600640 1 -- 172.21.15.103:0/1777724017 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37c003860 con 0x7fe3940ad8f0 2024-09-10T22:39:11.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe39b400640 1 -- 172.21.15.103:0/1777724017 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3940afdf0 con 0x7fe3940ad8f0 2024-09-10T22:39:11.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe39b400640 1 -- 172.21.15.103:0/1777724017 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3940b03b0 con 0x7fe3940ad8f0 2024-09-10T22:39:11.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe39b400640 1 -- 172.21.15.103:0/1777724017 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe39415f470 con 0x7fe3940ad8f0 2024-09-10T22:39:11.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.207+0000 7fe391600640 1 -- 172.21.15.103:0/1777724017 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe37c003a00 con 0x7fe3940ad8f0 2024-09-10T22:39:11.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.211+0000 7fe391600640 1 --2- 172.21.15.103:0/1777724017 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe370072610 0x7fe370074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:11.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.211+0000 7fe391600640 1 -- 172.21.15.103:0/1777724017 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe37c092d00 con 0x7fe3940ad8f0 2024-09-10T22:39:11.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.211+0000 7fe398a00640 1 --2- 172.21.15.103:0/1777724017 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe370072610 0x7fe370074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:11.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.211+0000 7fe398a00640 1 --2- 172.21.15.103:0/1777724017 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe370072610 0x7fe370074ad0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe384005fd0 tx=0x7fe384005f20 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:11.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.211+0000 7fe391600640 1 -- 172.21.15.103:0/1777724017 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe37c001130 con 0x7fe3940ad8f0 2024-09-10T22:39:11.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.379+0000 7fe39b400640 1 -- 172.21.15.103:0/1777724017 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe394073c50 con 0x7fe370072610 2024-09-10T22:39:11.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.383+0000 7fe391600640 1 -- 172.21.15.103:0/1777724017 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7fe394073c50 con 0x7fe370072610 2024-09-10T22:39:11.562 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:11.564 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:39:11.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.387+0000 7fe39b400640 1 -- 172.21.15.103:0/1777724017 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe370072610 msgr2=0x7fe370074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:11.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.387+0000 7fe39b400640 1 --2- 172.21.15.103:0/1777724017 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe370072610 0x7fe370074ad0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe384005fd0 tx=0x7fe384005f20 comp rx=0 tx=0).stop 2024-09-10T22:39:11.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.387+0000 7fe39b400640 1 -- 172.21.15.103:0/1777724017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3940ad8f0 msgr2=0x7fe3940b1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:11.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.387+0000 7fe39b400640 1 --2- 172.21.15.103:0/1777724017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3940ad8f0 0x7fe3940b1000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00c400 tx=0x7fe37c00c8c0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.387+0000 7fe39b400640 1 -- 172.21.15.103:0/1777724017 shutdown_connections 2024-09-10T22:39:11.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.387+0000 7fe39b400640 1 --2- 172.21.15.103:0/1777724017 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe370072610 0x7fe370074ad0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.387+0000 7fe39b400640 1 --2- 172.21.15.103:0/1777724017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe39415b9e0 0x7fe3940b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.387+0000 7fe39b400640 1 --2- 172.21.15.103:0/1777724017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3940ad8f0 0x7fe3940b1000 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.387+0000 7fe39b400640 1 --2- 172.21.15.103:0/1777724017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe39406e1d0 0x7fe3941f9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.387+0000 7fe39b400640 1 -- 172.21.15.103:0/1777724017 >> 172.21.15.103:0/1777724017 conn(0x7fe3940b1c00 msgr2=0x7fe3940cbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:11.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.387+0000 7fe39b400640 1 -- 172.21.15.103:0/1777724017 shutdown_connections 2024-09-10T22:39:11.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.387+0000 7fe39b400640 1 -- 172.21.15.103:0/1777724017 wait complete. 2024-09-10T22:39:11.567 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-10T22:39:09.622236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219696,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755024,"statfs":{"total":773094113280,"available":772869144576,"internally_reserved":0,"allocated":3514368,"data_stored":2074472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003106"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921053+0000","last_change":"2024-09-10T22:38:48.852520+0000","last_active":"2024-09-10T22:38:54.921053+0000","last_peered":"2024-09-10T22:38:54.921053+0000","last_clean":"2024-09-10T22:38:54.921053+0000","last_became_active":"2024-09-10T22:38:48.852277+0000","last_became_peered":"2024-09-10T22:38:48.852277+0000","last_unstale":"2024-09-10T22:38:54.921053+0000","last_undegraded":"2024-09-10T22:38:54.921053+0000","last_fullsized":"2024-09-10T22:38:54.921053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:57.474446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922482+0000","last_change":"2024-09-10T22:38:49.865286+0000","last_active":"2024-09-10T22:38:54.922482+0000","last_peered":"2024-09-10T22:38:54.922482+0000","last_clean":"2024-09-10T22:38:54.922482+0000","last_became_active":"2024-09-10T22:38:49.864978+0000","last_became_peered":"2024-09-10T22:38:49.864978+0000","last_unstale":"2024-09-10T22:38:54.922482+0000","last_undegraded":"2024-09-10T22:38:54.922482+0000","last_fullsized":"2024-09-10T22:38:54.922482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:48.790469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921444+0000","last_change":"2024-09-10T22:38:54.251129+0000","last_active":"2024-09-10T22:38:54.921444+0000","last_peered":"2024-09-10T22:38:54.921444+0000","last_clean":"2024-09-10T22:38:54.921444+0000","last_became_active":"2024-09-10T22:38:54.250166+0000","last_became_peered":"2024-09-10T22:38:54.250166+0000","last_unstale":"2024-09-10T22:38:54.921444+0000","last_undegraded":"2024-09-10T22:38:54.921444+0000","last_fullsized":"2024-09-10T22:38:54.921444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:29.717841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922539+0000","last_change":"2024-09-10T22:38:48.841492+0000","last_active":"2024-09-10T22:38:54.922539+0000","last_peered":"2024-09-10T22:38:54.922539+0000","last_clean":"2024-09-10T22:38:54.922539+0000","last_became_active":"2024-09-10T22:38:48.841173+0000","last_became_peered":"2024-09-10T22:38:48.841173+0000","last_unstale":"2024-09-10T22:38:54.922539+0000","last_undegraded":"2024-09-10T22:38:54.922539+0000","last_fullsized":"2024-09-10T22:38:54.922539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:27.985660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920864+0000","last_change":"2024-09-10T22:38:49.865338+0000","last_active":"2024-09-10T22:38:54.920864+0000","last_peered":"2024-09-10T22:38:54.920864+0000","last_clean":"2024-09-10T22:38:54.920864+0000","last_became_active":"2024-09-10T22:38:49.864649+0000","last_became_peered":"2024-09-10T22:38:49.864649+0000","last_unstale":"2024-09-10T22:38:54.920864+0000","last_undegraded":"2024-09-10T22:38:54.920864+0000","last_fullsized":"2024-09-10T22:38:54.920864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:40.212977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921237+0000","last_change":"2024-09-10T22:38:53.901798+0000","last_active":"2024-09-10T22:38:54.921237+0000","last_peered":"2024-09-10T22:38:54.921237+0000","last_clean":"2024-09-10T22:38:54.921237+0000","last_became_active":"2024-09-10T22:38:53.901092+0000","last_became_peered":"2024-09-10T22:38:53.901092+0000","last_unstale":"2024-09-10T22:38:54.921237+0000","last_undegraded":"2024-09-10T22:38:54.921237+0000","last_fullsized":"2024-09-10T22:38:54.921237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:41.242227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921986+0000","last_change":"2024-09-10T22:38:48.857962+0000","last_active":"2024-09-10T22:38:54.921986+0000","last_peered":"2024-09-10T22:38:54.921986+0000","last_clean":"2024-09-10T22:38:54.921986+0000","last_became_active":"2024-09-10T22:38:48.857774+0000","last_became_peered":"2024-09-10T22:38:48.857774+0000","last_unstale":"2024-09-10T22:38:54.921986+0000","last_undegraded":"2024-09-10T22:38:54.921986+0000","last_fullsized":"2024-09-10T22:38:54.921986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:51.705558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880518+0000","last_change":"2024-09-10T22:38:49.872509+0000","last_active":"2024-09-10T22:38:54.880518+0000","last_peered":"2024-09-10T22:38:54.880518+0000","last_clean":"2024-09-10T22:38:54.880518+0000","last_became_active":"2024-09-10T22:38:49.871924+0000","last_became_peered":"2024-09-10T22:38:49.871924+0000","last_unstale":"2024-09-10T22:38:54.880518+0000","last_undegraded":"2024-09-10T22:38:54.880518+0000","last_fullsized":"2024-09-10T22:38:54.880518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:04.224631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920786+0000","last_change":"2024-09-10T22:38:53.905850+0000","last_active":"2024-09-10T22:38:54.920786+0000","last_peered":"2024-09-10T22:38:54.920786+0000","last_clean":"2024-09-10T22:38:54.920786+0000","last_became_active":"2024-09-10T22:38:53.905409+0000","last_became_peered":"2024-09-10T22:38:53.905409+0000","last_unstale":"2024-09-10T22:38:54.920786+0000","last_undegraded":"2024-09-10T22:38:54.920786+0000","last_fullsized":"2024-09-10T22:38:54.920786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:21.421252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921776+0000","last_change":"2024-09-10T22:38:48.856520+0000","last_active":"2024-09-10T22:38:54.921776+0000","last_peered":"2024-09-10T22:38:54.921776+0000","last_clean":"2024-09-10T22:38:54.921776+0000","last_became_active":"2024-09-10T22:38:48.856155+0000","last_became_peered":"2024-09-10T22:38:48.856155+0000","last_unstale":"2024-09-10T22:38:54.921776+0000","last_undegraded":"2024-09-10T22:38:54.921776+0000","last_fullsized":"2024-09-10T22:38:54.921776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:14.631039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880696+0000","last_change":"2024-09-10T22:38:49.873562+0000","last_active":"2024-09-10T22:38:54.880696+0000","last_peered":"2024-09-10T22:38:54.880696+0000","last_clean":"2024-09-10T22:38:54.880696+0000","last_became_active":"2024-09-10T22:38:49.864062+0000","last_became_peered":"2024-09-10T22:38:49.864062+0000","last_unstale":"2024-09-10T22:38:54.880696+0000","last_undegraded":"2024-09-10T22:38:54.880696+0000","last_fullsized":"2024-09-10T22:38:54.880696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:25.174871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920712+0000","last_change":"2024-09-10T22:38:53.903054+0000","last_active":"2024-09-10T22:38:54.920712+0000","last_peered":"2024-09-10T22:38:54.920712+0000","last_clean":"2024-09-10T22:38:54.920712+0000","last_became_active":"2024-09-10T22:38:53.902428+0000","last_became_peered":"2024-09-10T22:38:53.902428+0000","last_unstale":"2024-09-10T22:38:54.920712+0000","last_undegraded":"2024-09-10T22:38:54.920712+0000","last_fullsized":"2024-09-10T22:38:54.920712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:46.628037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880327+0000","last_change":"2024-09-10T22:38:49.865192+0000","last_active":"2024-09-10T22:38:54.880327+0000","last_peered":"2024-09-10T22:38:54.880327+0000","last_clean":"2024-09-10T22:38:54.880327+0000","last_became_active":"2024-09-10T22:38:49.864716+0000","last_became_peered":"2024-09-10T22:38:49.864716+0000","last_unstale":"2024-09-10T22:38:54.880327+0000","last_undegraded":"2024-09-10T22:38:54.880327+0000","last_fullsized":"2024-09-10T22:38:54.880327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:55.123251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921503+0000","last_change":"2024-09-10T22:38:48.856397+0000","last_active":"2024-09-10T22:38:54.921503+0000","last_peered":"2024-09-10T22:38:54.921503+0000","last_clean":"2024-09-10T22:38:54.921503+0000","last_became_active":"2024-09-10T22:38:48.856073+0000","last_became_peered":"2024-09-10T22:38:48.856073+0000","last_unstale":"2024-09-10T22:38:54.921503+0000","last_undegraded":"2024-09-10T22:38:54.921503+0000","last_fullsized":"2024-09-10T22:38:54.921503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:39.081533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921189+0000","last_change":"2024-09-10T22:38:53.894114+0000","last_active":"2024-09-10T22:38:54.921189+0000","last_peered":"2024-09-10T22:38:54.921189+0000","last_clean":"2024-09-10T22:38:54.921189+0000","last_became_active":"2024-09-10T22:38:53.893814+0000","last_became_peered":"2024-09-10T22:38:53.893814+0000","last_unstale":"2024-09-10T22:38:54.921189+0000","last_undegraded":"2024-09-10T22:38:54.921189+0000","last_fullsized":"2024-09-10T22:38:54.921189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:56.732998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921915+0000","last_change":"2024-09-10T22:38:49.863144+0000","last_active":"2024-09-10T22:38:54.921915+0000","last_peered":"2024-09-10T22:38:54.921915+0000","last_clean":"2024-09-10T22:38:54.921915+0000","last_became_active":"2024-09-10T22:38:49.862085+0000","last_became_peered":"2024-09-10T22:38:49.862085+0000","last_unstale":"2024-09-10T22:38:54.921915+0000","last_undegraded":"2024-09-10T22:38:54.921915+0000","last_fullsized":"2024-09-10T22:38:54.921915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:03.094296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876526+0000","last_change":"2024-09-10T22:38:48.842046+0000","last_active":"2024-09-10T22:38:54.876526+0000","last_peered":"2024-09-10T22:38:54.876526+0000","last_clean":"2024-09-10T22:38:54.876526+0000","last_became_active":"2024-09-10T22:38:48.841395+0000","last_became_peered":"2024-09-10T22:38:48.841395+0000","last_unstale":"2024-09-10T22:38:54.876526+0000","last_undegraded":"2024-09-10T22:38:54.876526+0000","last_fullsized":"2024-09-10T22:38:54.876526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:27.834255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921402+0000","last_change":"2024-09-10T22:38:53.901790+0000","last_active":"2024-09-10T22:38:54.921402+0000","last_peered":"2024-09-10T22:38:54.921402+0000","last_clean":"2024-09-10T22:38:54.921402+0000","last_became_active":"2024-09-10T22:38:53.901365+0000","last_became_peered":"2024-09-10T22:38:53.901365+0000","last_unstale":"2024-09-10T22:38:54.921402+0000","last_undegraded":"2024-09-10T22:38:54.921402+0000","last_fullsized":"2024-09-10T22:38:54.921402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:54.134756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921530+0000","last_change":"2024-09-10T22:38:49.857384+0000","last_active":"2024-09-10T22:38:54.921530+0000","last_peered":"2024-09-10T22:38:54.921530+0000","last_clean":"2024-09-10T22:38:54.921530+0000","last_became_active":"2024-09-10T22:38:49.857072+0000","last_became_peered":"2024-09-10T22:38:49.857072+0000","last_unstale":"2024-09-10T22:38:54.921530+0000","last_undegraded":"2024-09-10T22:38:54.921530+0000","last_fullsized":"2024-09-10T22:38:54.921530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:34.910658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876365+0000","last_change":"2024-09-10T22:38:48.843182+0000","last_active":"2024-09-10T22:38:54.876365+0000","last_peered":"2024-09-10T22:38:54.876365+0000","last_clean":"2024-09-10T22:38:54.876365+0000","last_became_active":"2024-09-10T22:38:48.842923+0000","last_became_peered":"2024-09-10T22:38:48.842923+0000","last_unstale":"2024-09-10T22:38:54.876365+0000","last_undegraded":"2024-09-10T22:38:54.876365+0000","last_fullsized":"2024-09-10T22:38:54.876365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:43.650324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877435+0000","last_change":"2024-09-10T22:38:54.251266+0000","last_active":"2024-09-10T22:38:54.877435+0000","last_peered":"2024-09-10T22:38:54.877435+0000","last_clean":"2024-09-10T22:38:54.877435+0000","last_became_active":"2024-09-10T22:38:54.250869+0000","last_became_peered":"2024-09-10T22:38:54.250869+0000","last_unstale":"2024-09-10T22:38:54.877435+0000","last_undegraded":"2024-09-10T22:38:54.877435+0000","last_fullsized":"2024-09-10T22:38:54.877435+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:41.537209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921172+0000","last_change":"2024-09-10T22:38:49.845466+0000","last_active":"2024-09-10T22:38:54.921172+0000","last_peered":"2024-09-10T22:38:54.921172+0000","last_clean":"2024-09-10T22:38:54.921172+0000","last_became_active":"2024-09-10T22:38:49.844534+0000","last_became_peered":"2024-09-10T22:38:49.844534+0000","last_unstale":"2024-09-10T22:38:54.921172+0000","last_undegraded":"2024-09-10T22:38:54.921172+0000","last_fullsized":"2024-09-10T22:38:54.921172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:51.184856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920528+0000","last_change":"2024-09-10T22:38:48.856827+0000","last_active":"2024-09-10T22:38:54.920528+0000","last_peered":"2024-09-10T22:38:54.920528+0000","last_clean":"2024-09-10T22:38:54.920528+0000","last_became_active":"2024-09-10T22:38:48.856254+0000","last_became_peered":"2024-09-10T22:38:48.856254+0000","last_unstale":"2024-09-10T22:38:54.920528+0000","last_undegraded":"2024-09-10T22:38:54.920528+0000","last_fullsized":"2024-09-10T22:38:54.920528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:50.178089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921261+0000","last_change":"2024-09-10T22:38:53.901780+0000","last_active":"2024-09-10T22:38:54.921261+0000","last_peered":"2024-09-10T22:38:54.921261+0000","last_clean":"2024-09-10T22:38:54.921261+0000","last_became_active":"2024-09-10T22:38:53.901291+0000","last_became_peered":"2024-09-10T22:38:53.901291+0000","last_unstale":"2024-09-10T22:38:54.921261+0000","last_undegraded":"2024-09-10T22:38:54.921261+0000","last_fullsized":"2024-09-10T22:38:54.921261+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:15.947890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921201+0000","last_change":"2024-09-10T22:38:49.851843+0000","last_active":"2024-09-10T22:38:54.921201+0000","last_peered":"2024-09-10T22:38:54.921201+0000","last_clean":"2024-09-10T22:38:54.921201+0000","last_became_active":"2024-09-10T22:38:49.851557+0000","last_became_peered":"2024-09-10T22:38:49.851557+0000","last_unstale":"2024-09-10T22:38:54.921201+0000","last_undegraded":"2024-09-10T22:38:54.921201+0000","last_fullsized":"2024-09-10T22:38:54.921201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:06.748400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881167+0000","last_change":"2024-09-10T22:38:48.853061+0000","last_active":"2024-09-10T22:38:54.881167+0000","last_peered":"2024-09-10T22:38:54.881167+0000","last_clean":"2024-09-10T22:38:54.881167+0000","last_became_active":"2024-09-10T22:38:48.852801+0000","last_became_peered":"2024-09-10T22:38:48.852801+0000","last_unstale":"2024-09-10T22:38:54.881167+0000","last_undegraded":"2024-09-10T22:38:54.881167+0000","last_fullsized":"2024-09-10T22:38:54.881167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:15.095892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920897+0000","last_change":"2024-09-10T22:38:54.251299+0000","last_active":"2024-09-10T22:38:54.920897+0000","last_peered":"2024-09-10T22:38:54.920897+0000","last_clean":"2024-09-10T22:38:54.920897+0000","last_became_active":"2024-09-10T22:38:54.250832+0000","last_became_peered":"2024-09-10T22:38:54.250832+0000","last_unstale":"2024-09-10T22:38:54.920897+0000","last_undegraded":"2024-09-10T22:38:54.920897+0000","last_fullsized":"2024-09-10T22:38:54.920897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:58.412799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922726+0000","last_change":"2024-09-10T22:38:49.861588+0000","last_active":"2024-09-10T22:38:54.922726+0000","last_peered":"2024-09-10T22:38:54.922726+0000","last_clean":"2024-09-10T22:38:54.922726+0000","last_became_active":"2024-09-10T22:38:49.861318+0000","last_became_peered":"2024-09-10T22:38:49.861318+0000","last_unstale":"2024-09-10T22:38:54.922726+0000","last_undegraded":"2024-09-10T22:38:54.922726+0000","last_fullsized":"2024-09-10T22:38:54.922726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:17.481705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876977+0000","last_change":"2024-09-10T22:38:48.837942+0000","last_active":"2024-09-10T22:38:54.876977+0000","last_peered":"2024-09-10T22:38:54.876977+0000","last_clean":"2024-09-10T22:38:54.876977+0000","last_became_active":"2024-09-10T22:38:48.836464+0000","last_became_peered":"2024-09-10T22:38:48.836464+0000","last_unstale":"2024-09-10T22:38:54.876977+0000","last_undegraded":"2024-09-10T22:38:54.876977+0000","last_fullsized":"2024-09-10T22:38:54.876977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:08.401116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920961+0000","last_change":"2024-09-10T22:38:54.247221+0000","last_active":"2024-09-10T22:38:54.920961+0000","last_peered":"2024-09-10T22:38:54.920961+0000","last_clean":"2024-09-10T22:38:54.920961+0000","last_became_active":"2024-09-10T22:38:54.246819+0000","last_became_peered":"2024-09-10T22:38:54.246819+0000","last_unstale":"2024-09-10T22:38:54.920961+0000","last_undegraded":"2024-09-10T22:38:54.920961+0000","last_fullsized":"2024-09-10T22:38:54.920961+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:32.793677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877019+0000","last_change":"2024-09-10T22:38:49.854852+0000","last_active":"2024-09-10T22:38:54.877019+0000","last_peered":"2024-09-10T22:38:54.877019+0000","last_clean":"2024-09-10T22:38:54.877019+0000","last_became_active":"2024-09-10T22:38:49.854524+0000","last_became_peered":"2024-09-10T22:38:49.854524+0000","last_unstale":"2024-09-10T22:38:54.877019+0000","last_undegraded":"2024-09-10T22:38:54.877019+0000","last_fullsized":"2024-09-10T22:38:54.877019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:50.918432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922069+0000","last_change":"2024-09-10T22:38:48.858074+0000","last_active":"2024-09-10T22:38:54.922069+0000","last_peered":"2024-09-10T22:38:54.922069+0000","last_clean":"2024-09-10T22:38:54.922069+0000","last_became_active":"2024-09-10T22:38:48.857790+0000","last_became_peered":"2024-09-10T22:38:48.857790+0000","last_unstale":"2024-09-10T22:38:54.922069+0000","last_undegraded":"2024-09-10T22:38:54.922069+0000","last_fullsized":"2024-09-10T22:38:54.922069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:33.673133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920591+0000","last_change":"2024-09-10T22:38:54.247274+0000","last_active":"2024-09-10T22:38:54.920591+0000","last_peered":"2024-09-10T22:38:54.920591+0000","last_clean":"2024-09-10T22:38:54.920591+0000","last_became_active":"2024-09-10T22:38:54.246824+0000","last_became_peered":"2024-09-10T22:38:54.246824+0000","last_unstale":"2024-09-10T22:38:54.920591+0000","last_undegraded":"2024-09-10T22:38:54.920591+0000","last_fullsized":"2024-09-10T22:38:54.920591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:29.221197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880773+0000","last_change":"2024-09-10T22:38:49.858913+0000","last_active":"2024-09-10T22:38:54.880773+0000","last_peered":"2024-09-10T22:38:54.880773+0000","last_clean":"2024-09-10T22:38:54.880773+0000","last_became_active":"2024-09-10T22:38:49.858622+0000","last_became_peered":"2024-09-10T22:38:49.858622+0000","last_unstale":"2024-09-10T22:38:54.880773+0000","last_undegraded":"2024-09-10T22:38:54.880773+0000","last_fullsized":"2024-09-10T22:38:54.880773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:24:23.510664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877113+0000","last_change":"2024-09-10T22:38:48.839218+0000","last_active":"2024-09-10T22:38:54.877113+0000","last_peered":"2024-09-10T22:38:54.877113+0000","last_clean":"2024-09-10T22:38:54.877113+0000","last_became_active":"2024-09-10T22:38:48.838970+0000","last_became_peered":"2024-09-10T22:38:48.838970+0000","last_unstale":"2024-09-10T22:38:54.877113+0000","last_undegraded":"2024-09-10T22:38:54.877113+0000","last_fullsized":"2024-09-10T22:38:54.877113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:08.395191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876369+0000","last_change":"2024-09-10T22:38:53.898832+0000","last_active":"2024-09-10T22:38:54.876369+0000","last_peered":"2024-09-10T22:38:54.876369+0000","last_clean":"2024-09-10T22:38:54.876369+0000","last_became_active":"2024-09-10T22:38:53.898360+0000","last_became_peered":"2024-09-10T22:38:53.898360+0000","last_unstale":"2024-09-10T22:38:54.876369+0000","last_undegraded":"2024-09-10T22:38:54.876369+0000","last_fullsized":"2024-09-10T22:38:54.876369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:26.747212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921150+0000","last_change":"2024-09-10T22:38:49.852619+0000","last_active":"2024-09-10T22:38:54.921150+0000","last_peered":"2024-09-10T22:38:54.921150+0000","last_clean":"2024-09-10T22:38:54.921150+0000","last_became_active":"2024-09-10T22:38:49.852266+0000","last_became_peered":"2024-09-10T22:38:49.852266+0000","last_unstale":"2024-09-10T22:38:54.921150+0000","last_undegraded":"2024-09-10T22:38:54.921150+0000","last_fullsized":"2024-09-10T22:38:54.921150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:59.442647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881111+0000","last_change":"2024-09-10T22:38:48.851373+0000","last_active":"2024-09-10T22:38:54.881111+0000","last_peered":"2024-09-10T22:38:54.881111+0000","last_clean":"2024-09-10T22:38:54.881111+0000","last_became_active":"2024-09-10T22:38:48.850929+0000","last_became_peered":"2024-09-10T22:38:48.850929+0000","last_unstale":"2024-09-10T22:38:54.881111+0000","last_undegraded":"2024-09-10T22:38:54.881111+0000","last_fullsized":"2024-09-10T22:38:54.881111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:14.631039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877092+0000","last_change":"2024-09-10T22:38:53.905250+0000","last_active":"2024-09-10T22:38:54.877092+0000","last_peered":"2024-09-10T22:38:54.877092+0000","last_clean":"2024-09-10T22:38:54.877092+0000","last_became_active":"2024-09-10T22:38:53.904841+0000","last_became_peered":"2024-09-10T22:38:53.904841+0000","last_unstale":"2024-09-10T22:38:54.877092+0000","last_undegraded":"2024-09-10T22:38:54.877092+0000","last_fullsized":"2024-09-10T22:38:54.877092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:47.327614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876131+0000","last_change":"2024-09-10T22:38:49.852020+0000","last_active":"2024-09-10T22:38:54.876131+0000","last_peered":"2024-09-10T22:38:54.876131+0000","last_clean":"2024-09-10T22:38:54.876131+0000","last_became_active":"2024-09-10T22:38:49.851701+0000","last_became_peered":"2024-09-10T22:38:49.851701+0000","last_unstale":"2024-09-10T22:38:54.876131+0000","last_undegraded":"2024-09-10T22:38:54.876131+0000","last_fullsized":"2024-09-10T22:38:54.876131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:26.280355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.919678+0000","last_change":"2024-09-10T22:38:48.840603+0000","last_active":"2024-09-10T22:38:54.919678+0000","last_peered":"2024-09-10T22:38:54.919678+0000","last_clean":"2024-09-10T22:38:54.919678+0000","last_became_active":"2024-09-10T22:38:48.840005+0000","last_became_peered":"2024-09-10T22:38:48.840005+0000","last_unstale":"2024-09-10T22:38:54.919678+0000","last_undegraded":"2024-09-10T22:38:54.919678+0000","last_fullsized":"2024-09-10T22:38:54.919678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:25.578472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877502+0000","last_change":"2024-09-10T22:38:53.909084+0000","last_active":"2024-09-10T22:38:54.877502+0000","last_peered":"2024-09-10T22:38:54.877502+0000","last_clean":"2024-09-10T22:38:54.877502+0000","last_became_active":"2024-09-10T22:38:53.908638+0000","last_became_peered":"2024-09-10T22:38:53.908638+0000","last_unstale":"2024-09-10T22:38:54.877502+0000","last_undegraded":"2024-09-10T22:38:54.877502+0000","last_fullsized":"2024-09-10T22:38:54.877502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:39.597856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920309+0000","last_change":"2024-09-10T22:38:49.862424+0000","last_active":"2024-09-10T22:38:54.920309+0000","last_peered":"2024-09-10T22:38:54.920309+0000","last_clean":"2024-09-10T22:38:54.920309+0000","last_became_active":"2024-09-10T22:38:49.862139+0000","last_became_peered":"2024-09-10T22:38:49.862139+0000","last_unstale":"2024-09-10T22:38:54.920309+0000","last_undegraded":"2024-09-10T22:38:54.920309+0000","last_fullsized":"2024-09-10T22:38:54.920309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:25.404715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920624+0000","last_change":"2024-09-10T22:38:48.856517+0000","last_active":"2024-09-10T22:38:54.920624+0000","last_peered":"2024-09-10T22:38:54.920624+0000","last_clean":"2024-09-10T22:38:54.920624+0000","last_became_active":"2024-09-10T22:38:48.855941+0000","last_became_peered":"2024-09-10T22:38:48.855941+0000","last_unstale":"2024-09-10T22:38:54.920624+0000","last_undegraded":"2024-09-10T22:38:54.920624+0000","last_fullsized":"2024-09-10T22:38:54.920624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:58.435880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921081+0000","last_change":"2024-09-10T22:38:54.252398+0000","last_active":"2024-09-10T22:38:54.921081+0000","last_peered":"2024-09-10T22:38:54.921081+0000","last_clean":"2024-09-10T22:38:54.921081+0000","last_became_active":"2024-09-10T22:38:54.251445+0000","last_became_peered":"2024-09-10T22:38:54.251445+0000","last_unstale":"2024-09-10T22:38:54.921081+0000","last_undegraded":"2024-09-10T22:38:54.921081+0000","last_fullsized":"2024-09-10T22:38:54.921081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:30.242290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921676+0000","last_change":"2024-09-10T22:38:49.875972+0000","last_active":"2024-09-10T22:38:54.921676+0000","last_peered":"2024-09-10T22:38:54.921676+0000","last_clean":"2024-09-10T22:38:54.921676+0000","last_became_active":"2024-09-10T22:38:49.875696+0000","last_became_peered":"2024-09-10T22:38:49.875696+0000","last_unstale":"2024-09-10T22:38:54.921676+0000","last_undegraded":"2024-09-10T22:38:54.921676+0000","last_fullsized":"2024-09-10T22:38:54.921676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:40.212977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881021+0000","last_change":"2024-09-10T22:38:48.853917+0000","last_active":"2024-09-10T22:38:54.881021+0000","last_peered":"2024-09-10T22:38:54.881021+0000","last_clean":"2024-09-10T22:38:54.881021+0000","last_became_active":"2024-09-10T22:38:48.853608+0000","last_became_peered":"2024-09-10T22:38:48.853608+0000","last_unstale":"2024-09-10T22:38:54.881021+0000","last_undegraded":"2024-09-10T22:38:54.881021+0000","last_fullsized":"2024-09-10T22:38:54.881021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:00.500956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920938+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:38:54.920938+0000","last_peered":"2024-09-10T22:38:54.920938+0000","last_clean":"2024-09-10T22:38:54.920938+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:38:54.920938+0000","last_undegraded":"2024-09-10T22:38:54.920938+0000","last_fullsized":"2024-09-10T22:38:54.920938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880476+0000","last_change":"2024-09-10T22:38:54.250797+0000","last_active":"2024-09-10T22:38:54.880476+0000","last_peered":"2024-09-10T22:38:54.880476+0000","last_clean":"2024-09-10T22:38:54.880476+0000","last_became_active":"2024-09-10T22:38:54.250390+0000","last_became_peered":"2024-09-10T22:38:54.250390+0000","last_unstale":"2024-09-10T22:38:54.880476+0000","last_undegraded":"2024-09-10T22:38:54.880476+0000","last_fullsized":"2024-09-10T22:38:54.880476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:15.947890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921825+0000","last_change":"2024-09-10T22:38:49.876676+0000","last_active":"2024-09-10T22:38:54.921825+0000","last_peered":"2024-09-10T22:38:54.921825+0000","last_clean":"2024-09-10T22:38:54.921825+0000","last_became_active":"2024-09-10T22:38:49.874334+0000","last_became_peered":"2024-09-10T22:38:49.874334+0000","last_unstale":"2024-09-10T22:38:54.921825+0000","last_undegraded":"2024-09-10T22:38:54.921825+0000","last_fullsized":"2024-09-10T22:38:54.921825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:11.901564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920182+0000","last_change":"2024-09-10T22:38:48.851184+0000","last_active":"2024-09-10T22:38:54.920182+0000","last_peered":"2024-09-10T22:38:54.920182+0000","last_clean":"2024-09-10T22:38:54.920182+0000","last_became_active":"2024-09-10T22:38:48.850954+0000","last_became_peered":"2024-09-10T22:38:48.850954+0000","last_unstale":"2024-09-10T22:38:54.920182+0000","last_undegraded":"2024-09-10T22:38:54.920182+0000","last_fullsized":"2024-09-10T22:38:54.920182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:16.521277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880433+0000","last_change":"2024-09-10T22:38:54.247648+0000","last_active":"2024-09-10T22:38:54.880433+0000","last_peered":"2024-09-10T22:38:54.880433+0000","last_clean":"2024-09-10T22:38:54.880433+0000","last_became_active":"2024-09-10T22:38:54.247076+0000","last_became_peered":"2024-09-10T22:38:54.247076+0000","last_unstale":"2024-09-10T22:38:54.880433+0000","last_undegraded":"2024-09-10T22:38:54.880433+0000","last_fullsized":"2024-09-10T22:38:54.880433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:54.134756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880747+0000","last_change":"2024-09-10T22:38:49.872207+0000","last_active":"2024-09-10T22:38:54.880747+0000","last_peered":"2024-09-10T22:38:54.880747+0000","last_clean":"2024-09-10T22:38:54.880747+0000","last_became_active":"2024-09-10T22:38:49.864041+0000","last_became_peered":"2024-09-10T22:38:49.864041+0000","last_unstale":"2024-09-10T22:38:54.880747+0000","last_undegraded":"2024-09-10T22:38:54.880747+0000","last_fullsized":"2024-09-10T22:38:54.880747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:19.210276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876693+0000","last_change":"2024-09-10T22:38:48.845335+0000","last_active":"2024-09-10T22:38:54.876693+0000","last_peered":"2024-09-10T22:38:54.876693+0000","last_clean":"2024-09-10T22:38:54.876693+0000","last_became_active":"2024-09-10T22:38:48.844695+0000","last_became_peered":"2024-09-10T22:38:48.844695+0000","last_unstale":"2024-09-10T22:38:54.876693+0000","last_undegraded":"2024-09-10T22:38:54.876693+0000","last_fullsized":"2024-09-10T22:38:54.876693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:49.033938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920787+0000","last_change":"2024-09-10T22:38:53.903473+0000","last_active":"2024-09-10T22:38:54.920787+0000","last_peered":"2024-09-10T22:38:54.920787+0000","last_clean":"2024-09-10T22:38:54.920787+0000","last_became_active":"2024-09-10T22:38:53.902136+0000","last_became_peered":"2024-09-10T22:38:53.902136+0000","last_unstale":"2024-09-10T22:38:54.920787+0000","last_undegraded":"2024-09-10T22:38:54.920787+0000","last_fullsized":"2024-09-10T22:38:54.920787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:23.256602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922067+0000","last_change":"2024-09-10T22:38:49.873800+0000","last_active":"2024-09-10T22:38:54.922067+0000","last_peered":"2024-09-10T22:38:54.922067+0000","last_clean":"2024-09-10T22:38:54.922067+0000","last_became_active":"2024-09-10T22:38:49.871564+0000","last_became_peered":"2024-09-10T22:38:49.871564+0000","last_unstale":"2024-09-10T22:38:54.922067+0000","last_undegraded":"2024-09-10T22:38:54.922067+0000","last_fullsized":"2024-09-10T22:38:54.922067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:18.712686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920418+0000","last_change":"2024-09-10T22:38:48.840039+0000","last_active":"2024-09-10T22:38:54.920418+0000","last_peered":"2024-09-10T22:38:54.920418+0000","last_clean":"2024-09-10T22:38:54.920418+0000","last_became_active":"2024-09-10T22:38:48.839740+0000","last_became_peered":"2024-09-10T22:38:48.839740+0000","last_unstale":"2024-09-10T22:38:54.920418+0000","last_undegraded":"2024-09-10T22:38:54.920418+0000","last_fullsized":"2024-09-10T22:38:54.920418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:46.742902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879474+0000","last_change":"2024-09-10T22:38:54.250902+0000","last_active":"2024-09-10T22:38:54.879474+0000","last_peered":"2024-09-10T22:38:54.879474+0000","last_clean":"2024-09-10T22:38:54.879474+0000","last_became_active":"2024-09-10T22:38:54.250504+0000","last_became_peered":"2024-09-10T22:38:54.250504+0000","last_unstale":"2024-09-10T22:38:54.879474+0000","last_undegraded":"2024-09-10T22:38:54.879474+0000","last_fullsized":"2024-09-10T22:38:54.879474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:24.190512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922173+0000","last_change":"2024-09-10T22:38:49.870336+0000","last_active":"2024-09-10T22:38:54.922173+0000","last_peered":"2024-09-10T22:38:54.922173+0000","last_clean":"2024-09-10T22:38:54.922173+0000","last_became_active":"2024-09-10T22:38:49.870059+0000","last_became_peered":"2024-09-10T22:38:49.870059+0000","last_unstale":"2024-09-10T22:38:54.922173+0000","last_undegraded":"2024-09-10T22:38:54.922173+0000","last_fullsized":"2024-09-10T22:38:54.922173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:53.628621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921424+0000","last_change":"2024-09-10T22:38:48.843380+0000","last_active":"2024-09-10T22:38:54.921424+0000","last_peered":"2024-09-10T22:38:54.921424+0000","last_clean":"2024-09-10T22:38:54.921424+0000","last_became_active":"2024-09-10T22:38:48.843016+0000","last_became_peered":"2024-09-10T22:38:48.843016+0000","last_unstale":"2024-09-10T22:38:54.921424+0000","last_undegraded":"2024-09-10T22:38:54.921424+0000","last_fullsized":"2024-09-10T22:38:54.921424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:41.102824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920533+0000","last_change":"2024-09-10T22:38:53.903334+0000","last_active":"2024-09-10T22:38:54.920533+0000","last_peered":"2024-09-10T22:38:54.920533+0000","last_clean":"2024-09-10T22:38:54.920533+0000","last_became_active":"2024-09-10T22:38:53.902607+0000","last_became_peered":"2024-09-10T22:38:53.902607+0000","last_unstale":"2024-09-10T22:38:54.920533+0000","last_undegraded":"2024-09-10T22:38:54.920533+0000","last_fullsized":"2024-09-10T22:38:54.920533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:06.243501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921431+0000","last_change":"2024-09-10T22:38:49.864561+0000","last_active":"2024-09-10T22:38:54.921431+0000","last_peered":"2024-09-10T22:38:54.921431+0000","last_clean":"2024-09-10T22:38:54.921431+0000","last_became_active":"2024-09-10T22:38:49.863930+0000","last_became_peered":"2024-09-10T22:38:49.863930+0000","last_unstale":"2024-09-10T22:38:54.921431+0000","last_undegraded":"2024-09-10T22:38:54.921431+0000","last_fullsized":"2024-09-10T22:38:54.921431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:45.857292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.919529+0000","last_change":"2024-09-10T22:38:48.844675+0000","last_active":"2024-09-10T22:38:54.919529+0000","last_peered":"2024-09-10T22:38:54.919529+0000","last_clean":"2024-09-10T22:38:54.919529+0000","last_became_active":"2024-09-10T22:38:48.844321+0000","last_became_peered":"2024-09-10T22:38:48.844321+0000","last_unstale":"2024-09-10T22:38:54.919529+0000","last_undegraded":"2024-09-10T22:38:54.919529+0000","last_fullsized":"2024-09-10T22:38:54.919529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:27.985660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920890+0000","last_change":"2024-09-10T22:38:53.906658+0000","last_active":"2024-09-10T22:38:54.920890+0000","last_peered":"2024-09-10T22:38:54.920890+0000","last_clean":"2024-09-10T22:38:54.920890+0000","last_became_active":"2024-09-10T22:38:53.906243+0000","last_became_peered":"2024-09-10T22:38:53.906243+0000","last_unstale":"2024-09-10T22:38:54.920890+0000","last_undegraded":"2024-09-10T22:38:54.920890+0000","last_fullsized":"2024-09-10T22:38:54.920890+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:16.451902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879773+0000","last_change":"2024-09-10T22:38:49.853280+0000","last_active":"2024-09-10T22:38:54.879773+0000","last_peered":"2024-09-10T22:38:54.879773+0000","last_clean":"2024-09-10T22:38:54.879773+0000","last_became_active":"2024-09-10T22:38:49.853004+0000","last_became_peered":"2024-09-10T22:38:49.853004+0000","last_unstale":"2024-09-10T22:38:54.879773+0000","last_undegraded":"2024-09-10T22:38:54.879773+0000","last_fullsized":"2024-09-10T22:38:54.879773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:31.367854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879963+0000","last_change":"2024-09-10T22:38:48.842684+0000","last_active":"2024-09-10T22:38:54.879963+0000","last_peered":"2024-09-10T22:38:54.879963+0000","last_clean":"2024-09-10T22:38:54.879963+0000","last_became_active":"2024-09-10T22:38:48.842404+0000","last_became_peered":"2024-09-10T22:38:48.842404+0000","last_unstale":"2024-09-10T22:38:54.879963+0000","last_undegraded":"2024-09-10T22:38:54.879963+0000","last_fullsized":"2024-09-10T22:38:54.879963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:50.178089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922637+0000","last_change":"2024-09-10T22:38:54.251473+0000","last_active":"2024-09-10T22:38:54.922637+0000","last_peered":"2024-09-10T22:38:54.922637+0000","last_clean":"2024-09-10T22:38:54.922637+0000","last_became_active":"2024-09-10T22:38:54.250056+0000","last_became_peered":"2024-09-10T22:38:54.250056+0000","last_unstale":"2024-09-10T22:38:54.922637+0000","last_undegraded":"2024-09-10T22:38:54.922637+0000","last_fullsized":"2024-09-10T22:38:54.922637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:37.784629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921312+0000","last_change":"2024-09-10T22:38:49.871550+0000","last_active":"2024-09-10T22:38:54.921312+0000","last_peered":"2024-09-10T22:38:54.921312+0000","last_clean":"2024-09-10T22:38:54.921312+0000","last_became_active":"2024-09-10T22:38:49.870681+0000","last_became_peered":"2024-09-10T22:38:49.870681+0000","last_unstale":"2024-09-10T22:38:54.921312+0000","last_undegraded":"2024-09-10T22:38:54.921312+0000","last_fullsized":"2024-09-10T22:38:54.921312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:50.088430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880116+0000","last_change":"2024-09-10T22:38:48.855410+0000","last_active":"2024-09-10T22:38:54.880116+0000","last_peered":"2024-09-10T22:38:54.880116+0000","last_clean":"2024-09-10T22:38:54.880116+0000","last_became_active":"2024-09-10T22:38:48.855072+0000","last_became_peered":"2024-09-10T22:38:48.855072+0000","last_unstale":"2024-09-10T22:38:54.880116+0000","last_undegraded":"2024-09-10T22:38:54.880116+0000","last_fullsized":"2024-09-10T22:38:54.880116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:58.435880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922141+0000","last_change":"2024-09-10T22:38:54.247975+0000","last_active":"2024-09-10T22:38:54.922141+0000","last_peered":"2024-09-10T22:38:54.922141+0000","last_clean":"2024-09-10T22:38:54.922141+0000","last_became_active":"2024-09-10T22:38:54.246763+0000","last_became_peered":"2024-09-10T22:38:54.246763+0000","last_unstale":"2024-09-10T22:38:54.922141+0000","last_undegraded":"2024-09-10T22:38:54.922141+0000","last_fullsized":"2024-09-10T22:38:54.922141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:28.248826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920626+0000","last_change":"2024-09-10T22:38:49.857923+0000","last_active":"2024-09-10T22:38:54.920626+0000","last_peered":"2024-09-10T22:38:54.920626+0000","last_clean":"2024-09-10T22:38:54.920626+0000","last_became_active":"2024-09-10T22:38:49.855403+0000","last_became_peered":"2024-09-10T22:38:49.855403+0000","last_unstale":"2024-09-10T22:38:54.920626+0000","last_undegraded":"2024-09-10T22:38:54.920626+0000","last_fullsized":"2024-09-10T22:38:54.920626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:23.327063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921037+0000","last_change":"2024-09-10T22:38:48.849925+0000","last_active":"2024-09-10T22:38:54.921037+0000","last_peered":"2024-09-10T22:38:54.921037+0000","last_clean":"2024-09-10T22:38:54.921037+0000","last_became_active":"2024-09-10T22:38:48.849598+0000","last_became_peered":"2024-09-10T22:38:48.849598+0000","last_unstale":"2024-09-10T22:38:54.921037+0000","last_undegraded":"2024-09-10T22:38:54.921037+0000","last_fullsized":"2024-09-10T22:38:54.921037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:52.840320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880603+0000","last_change":"2024-09-10T22:38:54.250860+0000","last_active":"2024-09-10T22:38:54.880603+0000","last_peered":"2024-09-10T22:38:54.880603+0000","last_clean":"2024-09-10T22:38:54.880603+0000","last_became_active":"2024-09-10T22:38:54.250456+0000","last_became_peered":"2024-09-10T22:38:54.250456+0000","last_unstale":"2024-09-10T22:38:54.880603+0000","last_undegraded":"2024-09-10T22:38:54.880603+0000","last_fullsized":"2024-09-10T22:38:54.880603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:59.690022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921718+0000","last_change":"2024-09-10T22:38:49.867772+0000","last_active":"2024-09-10T22:38:54.921718+0000","last_peered":"2024-09-10T22:38:54.921718+0000","last_clean":"2024-09-10T22:38:54.921718+0000","last_became_active":"2024-09-10T22:38:49.867491+0000","last_became_peered":"2024-09-10T22:38:49.867491+0000","last_unstale":"2024-09-10T22:38:54.921718+0000","last_undegraded":"2024-09-10T22:38:54.921718+0000","last_fullsized":"2024-09-10T22:38:54.921718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:37.195901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:39:00.652505+0000","last_change":"2024-09-10T22:38:48.841117+0000","last_active":"2024-09-10T22:39:00.652505+0000","last_peered":"2024-09-10T22:39:00.652505+0000","last_clean":"2024-09-10T22:39:00.652505+0000","last_became_active":"2024-09-10T22:38:48.840707+0000","last_became_peered":"2024-09-10T22:38:48.840707+0000","last_unstale":"2024-09-10T22:39:00.652505+0000","last_undegraded":"2024-09-10T22:39:00.652505+0000","last_fullsized":"2024-09-10T22:39:00.652505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:58.435880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876459+0000","last_change":"2024-09-10T22:38:53.898755+0000","last_active":"2024-09-10T22:38:54.876459+0000","last_peered":"2024-09-10T22:38:54.876459+0000","last_clean":"2024-09-10T22:38:54.876459+0000","last_became_active":"2024-09-10T22:38:53.898182+0000","last_became_peered":"2024-09-10T22:38:53.898182+0000","last_unstale":"2024-09-10T22:38:54.876459+0000","last_undegraded":"2024-09-10T22:38:54.876459+0000","last_fullsized":"2024-09-10T22:38:54.876459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:45.658201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921595+0000","last_change":"2024-09-10T22:38:49.859641+0000","last_active":"2024-09-10T22:38:54.921595+0000","last_peered":"2024-09-10T22:38:54.921595+0000","last_clean":"2024-09-10T22:38:54.921595+0000","last_became_active":"2024-09-10T22:38:49.859208+0000","last_became_peered":"2024-09-10T22:38:49.859208+0000","last_unstale":"2024-09-10T22:38:54.921595+0000","last_undegraded":"2024-09-10T22:38:54.921595+0000","last_fullsized":"2024-09-10T22:38:54.921595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:40.088299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876659+0000","last_change":"2024-09-10T22:38:48.852988+0000","last_active":"2024-09-10T22:38:54.876659+0000","last_peered":"2024-09-10T22:38:54.876659+0000","last_clean":"2024-09-10T22:38:54.876659+0000","last_became_active":"2024-09-10T22:38:48.852717+0000","last_became_peered":"2024-09-10T22:38:48.852717+0000","last_unstale":"2024-09-10T22:38:54.876659+0000","last_undegraded":"2024-09-10T22:38:54.876659+0000","last_fullsized":"2024-09-10T22:38:54.876659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:26.855508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920866+0000","last_change":"2024-09-10T22:38:53.894090+0000","last_active":"2024-09-10T22:38:54.920866+0000","last_peered":"2024-09-10T22:38:54.920866+0000","last_clean":"2024-09-10T22:38:54.920866+0000","last_became_active":"2024-09-10T22:38:53.893574+0000","last_became_peered":"2024-09-10T22:38:53.893574+0000","last_unstale":"2024-09-10T22:38:54.920866+0000","last_undegraded":"2024-09-10T22:38:54.920866+0000","last_fullsized":"2024-09-10T22:38:54.920866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:49.903618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921016+0000","last_change":"2024-09-10T22:38:49.864920+0000","last_active":"2024-09-10T22:38:54.921016+0000","last_peered":"2024-09-10T22:38:54.921016+0000","last_clean":"2024-09-10T22:38:54.921016+0000","last_became_active":"2024-09-10T22:38:49.864424+0000","last_became_peered":"2024-09-10T22:38:49.864424+0000","last_unstale":"2024-09-10T22:38:54.921016+0000","last_undegraded":"2024-09-10T22:38:54.921016+0000","last_fullsized":"2024-09-10T22:38:54.921016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:19.035607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880817+0000","last_change":"2024-09-10T22:38:48.859261+0000","last_active":"2024-09-10T22:38:54.880817+0000","last_peered":"2024-09-10T22:38:54.880817+0000","last_clean":"2024-09-10T22:38:54.880817+0000","last_became_active":"2024-09-10T22:38:48.858966+0000","last_became_peered":"2024-09-10T22:38:48.858966+0000","last_unstale":"2024-09-10T22:38:54.880817+0000","last_undegraded":"2024-09-10T22:38:54.880817+0000","last_fullsized":"2024-09-10T22:38:54.880817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:15.095892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921394+0000","last_change":"2024-09-10T22:38:53.906015+0000","last_active":"2024-09-10T22:38:54.921394+0000","last_peered":"2024-09-10T22:38:54.921394+0000","last_clean":"2024-09-10T22:38:54.921394+0000","last_became_active":"2024-09-10T22:38:53.905650+0000","last_became_peered":"2024-09-10T22:38:53.905650+0000","last_unstale":"2024-09-10T22:38:54.921394+0000","last_undegraded":"2024-09-10T22:38:54.921394+0000","last_fullsized":"2024-09-10T22:38:54.921394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:41.757743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880707+0000","last_change":"2024-09-10T22:38:49.872132+0000","last_active":"2024-09-10T22:38:54.880707+0000","last_peered":"2024-09-10T22:38:54.880707+0000","last_clean":"2024-09-10T22:38:54.880707+0000","last_became_active":"2024-09-10T22:38:49.871810+0000","last_became_peered":"2024-09-10T22:38:49.871810+0000","last_unstale":"2024-09-10T22:38:54.880707+0000","last_undegraded":"2024-09-10T22:38:54.880707+0000","last_fullsized":"2024-09-10T22:38:54.880707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:17.481705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881042+0000","last_change":"2024-09-10T22:38:48.852986+0000","last_active":"2024-09-10T22:38:54.881042+0000","last_peered":"2024-09-10T22:38:54.881042+0000","last_clean":"2024-09-10T22:38:54.881042+0000","last_became_active":"2024-09-10T22:38:48.852519+0000","last_became_peered":"2024-09-10T22:38:48.852519+0000","last_unstale":"2024-09-10T22:38:54.881042+0000","last_undegraded":"2024-09-10T22:38:54.881042+0000","last_fullsized":"2024-09-10T22:38:54.881042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:00.500956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921502+0000","last_change":"2024-09-10T22:38:54.248043+0000","last_active":"2024-09-10T22:38:54.921502+0000","last_peered":"2024-09-10T22:38:54.921502+0000","last_clean":"2024-09-10T22:38:54.921502+0000","last_became_active":"2024-09-10T22:38:54.247585+0000","last_became_peered":"2024-09-10T22:38:54.247585+0000","last_unstale":"2024-09-10T22:38:54.921502+0000","last_undegraded":"2024-09-10T22:38:54.921502+0000","last_fullsized":"2024-09-10T22:38:54.921502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:17.956102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920839+0000","last_change":"2024-09-10T22:38:54.252858+0000","last_active":"2024-09-10T22:38:54.920839+0000","last_peered":"2024-09-10T22:38:54.920839+0000","last_clean":"2024-09-10T22:38:54.920839+0000","last_became_active":"2024-09-10T22:38:54.251257+0000","last_became_peered":"2024-09-10T22:38:54.251257+0000","last_unstale":"2024-09-10T22:38:54.920839+0000","last_undegraded":"2024-09-10T22:38:54.920839+0000","last_fullsized":"2024-09-10T22:38:54.920839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:24:27.556990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876243+0000","last_change":"2024-09-10T22:38:49.856861+0000","last_active":"2024-09-10T22:38:54.876243+0000","last_peered":"2024-09-10T22:38:54.876243+0000","last_clean":"2024-09-10T22:38:54.876243+0000","last_became_active":"2024-09-10T22:38:49.856585+0000","last_became_peered":"2024-09-10T22:38:49.856585+0000","last_unstale":"2024-09-10T22:38:54.876243+0000","last_undegraded":"2024-09-10T22:38:54.876243+0000","last_fullsized":"2024-09-10T22:38:54.876243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:53.022943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879803+0000","last_change":"2024-09-10T22:38:48.845774+0000","last_active":"2024-09-10T22:38:54.879803+0000","last_peered":"2024-09-10T22:38:54.879803+0000","last_clean":"2024-09-10T22:38:54.879803+0000","last_became_active":"2024-09-10T22:38:48.845377+0000","last_became_peered":"2024-09-10T22:38:48.845377+0000","last_unstale":"2024-09-10T22:38:54.879803+0000","last_undegraded":"2024-09-10T22:38:54.879803+0000","last_fullsized":"2024-09-10T22:38:54.879803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:50.178089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880779+0000","last_change":"2024-09-10T22:38:53.902490+0000","last_active":"2024-09-10T22:38:54.880779+0000","last_peered":"2024-09-10T22:38:54.880779+0000","last_clean":"2024-09-10T22:38:54.880779+0000","last_became_active":"2024-09-10T22:38:53.901598+0000","last_became_peered":"2024-09-10T22:38:53.901598+0000","last_unstale":"2024-09-10T22:38:54.880779+0000","last_undegraded":"2024-09-10T22:38:54.880779+0000","last_fullsized":"2024-09-10T22:38:54.880779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:41.242227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921373+0000","last_change":"2024-09-10T22:38:49.863394+0000","last_active":"2024-09-10T22:38:54.921373+0000","last_peered":"2024-09-10T22:38:54.921373+0000","last_clean":"2024-09-10T22:38:54.921373+0000","last_became_active":"2024-09-10T22:38:49.861032+0000","last_became_peered":"2024-09-10T22:38:49.861032+0000","last_unstale":"2024-09-10T22:38:54.921373+0000","last_undegraded":"2024-09-10T22:38:54.921373+0000","last_fullsized":"2024-09-10T22:38:54.921373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:31.367854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921736+0000","last_change":"2024-09-10T22:38:48.836017+0000","last_active":"2024-09-10T22:38:54.921736+0000","last_peered":"2024-09-10T22:38:54.921736+0000","last_clean":"2024-09-10T22:38:54.921736+0000","last_became_active":"2024-09-10T22:38:48.835739+0000","last_became_peered":"2024-09-10T22:38:48.835739+0000","last_unstale":"2024-09-10T22:38:54.921736+0000","last_undegraded":"2024-09-10T22:38:54.921736+0000","last_fullsized":"2024-09-10T22:38:54.921736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:00.479025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880538+0000","last_change":"2024-09-10T22:38:48.843526+0000","last_active":"2024-09-10T22:38:54.880538+0000","last_peered":"2024-09-10T22:38:54.880538+0000","last_clean":"2024-09-10T22:38:54.880538+0000","last_became_active":"2024-09-10T22:38:48.843248+0000","last_became_peered":"2024-09-10T22:38:48.843248+0000","last_unstale":"2024-09-10T22:38:54.880538+0000","last_undegraded":"2024-09-10T22:38:54.880538+0000","last_fullsized":"2024-09-10T22:38:54.880538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:39.081533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920942+0000","last_change":"2024-09-10T22:38:49.854189+0000","last_active":"2024-09-10T22:38:54.920942+0000","last_peered":"2024-09-10T22:38:54.920942+0000","last_clean":"2024-09-10T22:38:54.920942+0000","last_became_active":"2024-09-10T22:38:49.853954+0000","last_became_peered":"2024-09-10T22:38:49.853954+0000","last_unstale":"2024-09-10T22:38:54.920942+0000","last_undegraded":"2024-09-10T22:38:54.920942+0000","last_fullsized":"2024-09-10T22:38:54.920942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:55.123251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.919913+0000","last_change":"2024-09-10T22:38:53.912413+0000","last_active":"2024-09-10T22:38:54.919913+0000","last_peered":"2024-09-10T22:38:54.919913+0000","last_clean":"2024-09-10T22:38:54.919913+0000","last_became_active":"2024-09-10T22:38:53.904237+0000","last_became_peered":"2024-09-10T22:38:53.904237+0000","last_unstale":"2024-09-10T22:38:54.919913+0000","last_undegraded":"2024-09-10T22:38:54.919913+0000","last_fullsized":"2024-09-10T22:38:54.919913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:27.373389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921981+0000","last_change":"2024-09-10T22:38:48.853221+0000","last_active":"2024-09-10T22:38:54.921981+0000","last_peered":"2024-09-10T22:38:54.921981+0000","last_clean":"2024-09-10T22:38:54.921981+0000","last_became_active":"2024-09-10T22:38:48.852950+0000","last_became_peered":"2024-09-10T22:38:48.852950+0000","last_unstale":"2024-09-10T22:38:54.921981+0000","last_undegraded":"2024-09-10T22:38:54.921981+0000","last_fullsized":"2024-09-10T22:38:54.921981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:25.578472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920722+0000","last_change":"2024-09-10T22:38:49.851848+0000","last_active":"2024-09-10T22:38:54.920722+0000","last_peered":"2024-09-10T22:38:54.920722+0000","last_clean":"2024-09-10T22:38:54.920722+0000","last_became_active":"2024-09-10T22:38:49.851614+0000","last_became_peered":"2024-09-10T22:38:49.851614+0000","last_unstale":"2024-09-10T22:38:54.920722+0000","last_undegraded":"2024-09-10T22:38:54.920722+0000","last_fullsized":"2024-09-10T22:38:54.920722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:52.712325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922284+0000","last_change":"2024-09-10T22:38:53.910509+0000","last_active":"2024-09-10T22:38:54.922284+0000","last_peered":"2024-09-10T22:38:54.922284+0000","last_clean":"2024-09-10T22:38:54.922284+0000","last_became_active":"2024-09-10T22:38:53.910132+0000","last_became_peered":"2024-09-10T22:38:53.910132+0000","last_unstale":"2024-09-10T22:38:54.922284+0000","last_undegraded":"2024-09-10T22:38:54.922284+0000","last_fullsized":"2024-09-10T22:38:54.922284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:56.978517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879620+0000","last_change":"2024-09-10T22:38:49.859715+0000","last_active":"2024-09-10T22:38:54.879620+0000","last_peered":"2024-09-10T22:38:54.879620+0000","last_clean":"2024-09-10T22:38:54.879620+0000","last_became_active":"2024-09-10T22:38:49.859460+0000","last_became_peered":"2024-09-10T22:38:49.859460+0000","last_unstale":"2024-09-10T22:38:54.879620+0000","last_undegraded":"2024-09-10T22:38:54.879620+0000","last_fullsized":"2024-09-10T22:38:54.879620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:47.476429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.919633+0000","last_change":"2024-09-10T22:38:49.857017+0000","last_active":"2024-09-10T22:38:54.919633+0000","last_peered":"2024-09-10T22:38:54.919633+0000","last_clean":"2024-09-10T22:38:54.919633+0000","last_became_active":"2024-09-10T22:38:49.856717+0000","last_became_peered":"2024-09-10T22:38:49.856717+0000","last_unstale":"2024-09-10T22:38:54.919633+0000","last_undegraded":"2024-09-10T22:38:54.919633+0000","last_fullsized":"2024-09-10T22:38:54.919633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:40.088299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880065+0000","last_change":"2024-09-10T22:38:49.864344+0000","last_active":"2024-09-10T22:38:54.880065+0000","last_peered":"2024-09-10T22:38:54.880065+0000","last_clean":"2024-09-10T22:38:54.880065+0000","last_became_active":"2024-09-10T22:38:49.863615+0000","last_became_peered":"2024-09-10T22:38:49.863615+0000","last_unstale":"2024-09-10T22:38:54.880065+0000","last_undegraded":"2024-09-10T22:38:54.880065+0000","last_fullsized":"2024-09-10T22:38:54.880065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:17.040028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920749+0000","last_change":"2024-09-10T22:38:49.863316+0000","last_active":"2024-09-10T22:38:54.920749+0000","last_peered":"2024-09-10T22:38:54.920749+0000","last_clean":"2024-09-10T22:38:54.920749+0000","last_became_active":"2024-09-10T22:38:49.860671+0000","last_became_peered":"2024-09-10T22:38:49.860671+0000","last_unstale":"2024-09-10T22:38:54.920749+0000","last_undegraded":"2024-09-10T22:38:54.920749+0000","last_fullsized":"2024-09-10T22:38:54.920749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:31.367854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922304+0000","last_change":"2024-09-10T22:38:49.859296+0000","last_active":"2024-09-10T22:38:54.922304+0000","last_peered":"2024-09-10T22:38:54.922304+0000","last_clean":"2024-09-10T22:38:54.922304+0000","last_became_active":"2024-09-10T22:38:49.859054+0000","last_became_peered":"2024-09-10T22:38:49.859054+0000","last_unstale":"2024-09-10T22:38:54.922304+0000","last_undegraded":"2024-09-10T22:38:54.922304+0000","last_fullsized":"2024-09-10T22:38:54.922304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:06.748400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876558+0000","last_change":"2024-09-10T22:38:49.855782+0000","last_active":"2024-09-10T22:38:54.876558+0000","last_peered":"2024-09-10T22:38:54.876558+0000","last_clean":"2024-09-10T22:38:54.876558+0000","last_became_active":"2024-09-10T22:38:49.855512+0000","last_became_peered":"2024-09-10T22:38:49.855512+0000","last_unstale":"2024-09-10T22:38:54.876558+0000","last_undegraded":"2024-09-10T22:38:54.876558+0000","last_fullsized":"2024-09-10T22:38:54.876558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:36.250426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881513+0000","last_change":"2024-09-10T22:38:49.864470+0000","last_active":"2024-09-10T22:38:54.881513+0000","last_peered":"2024-09-10T22:38:54.881513+0000","last_clean":"2024-09-10T22:38:54.881513+0000","last_became_active":"2024-09-10T22:38:49.864209+0000","last_became_peered":"2024-09-10T22:38:49.864209+0000","last_unstale":"2024-09-10T22:38:54.881513+0000","last_undegraded":"2024-09-10T22:38:54.881513+0000","last_fullsized":"2024-09-10T22:38:54.881513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:19.035607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922630+0000","last_change":"2024-09-10T22:38:49.857545+0000","last_active":"2024-09-10T22:38:54.922630+0000","last_peered":"2024-09-10T22:38:54.922630+0000","last_clean":"2024-09-10T22:38:54.922630+0000","last_became_active":"2024-09-10T22:38:49.857281+0000","last_became_peered":"2024-09-10T22:38:49.857281+0000","last_unstale":"2024-09-10T22:38:54.922630+0000","last_undegraded":"2024-09-10T22:38:54.922630+0000","last_fullsized":"2024-09-10T22:38:54.922630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:04.224631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879697+0000","last_change":"2024-09-10T22:38:49.856408+0000","last_active":"2024-09-10T22:38:54.879697+0000","last_peered":"2024-09-10T22:38:54.879697+0000","last_clean":"2024-09-10T22:38:54.879697+0000","last_became_active":"2024-09-10T22:38:49.856141+0000","last_became_peered":"2024-09-10T22:38:49.856141+0000","last_unstale":"2024-09-10T22:38:54.879697+0000","last_undegraded":"2024-09-10T22:38:54.879697+0000","last_fullsized":"2024-09-10T22:38:54.879697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:42.581712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921683+0000","last_change":"2024-09-10T22:38:49.859369+0000","last_active":"2024-09-10T22:38:54.921683+0000","last_peered":"2024-09-10T22:38:54.921683+0000","last_clean":"2024-09-10T22:38:54.921683+0000","last_became_active":"2024-09-10T22:38:49.859101+0000","last_became_peered":"2024-09-10T22:38:49.859101+0000","last_unstale":"2024-09-10T22:38:54.921683+0000","last_undegraded":"2024-09-10T22:38:54.921683+0000","last_fullsized":"2024-09-10T22:38:54.921683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:55.123251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879955+0000","last_change":"2024-09-10T22:38:49.863959+0000","last_active":"2024-09-10T22:38:54.879955+0000","last_peered":"2024-09-10T22:38:54.879955+0000","last_clean":"2024-09-10T22:38:54.879955+0000","last_became_active":"2024-09-10T22:38:49.860396+0000","last_became_peered":"2024-09-10T22:38:49.860396+0000","last_unstale":"2024-09-10T22:38:54.879955+0000","last_undegraded":"2024-09-10T22:38:54.879955+0000","last_fullsized":"2024-09-10T22:38:54.879955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:48.790469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920595+0000","last_change":"2024-09-10T22:38:49.864151+0000","last_active":"2024-09-10T22:38:54.920595+0000","last_peered":"2024-09-10T22:38:54.920595+0000","last_clean":"2024-09-10T22:38:54.920595+0000","last_became_active":"2024-09-10T22:38:49.863808+0000","last_became_peered":"2024-09-10T22:38:49.863808+0000","last_unstale":"2024-09-10T22:38:54.920595+0000","last_undegraded":"2024-09-10T22:38:54.920595+0000","last_fullsized":"2024-09-10T22:38:54.920595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:09.915981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880880+0000","last_change":"2024-09-10T22:38:49.860196+0000","last_active":"2024-09-10T22:38:54.880880+0000","last_peered":"2024-09-10T22:38:54.880880+0000","last_clean":"2024-09-10T22:38:54.880880+0000","last_became_active":"2024-09-10T22:38:49.858960+0000","last_became_peered":"2024-09-10T22:38:49.858960+0000","last_unstale":"2024-09-10T22:38:54.880880+0000","last_undegraded":"2024-09-10T22:38:54.880880+0000","last_fullsized":"2024-09-10T22:38:54.880880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:07.814853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921985+0000","last_change":"2024-09-10T22:38:49.868433+0000","last_active":"2024-09-10T22:38:54.921985+0000","last_peered":"2024-09-10T22:38:54.921985+0000","last_clean":"2024-09-10T22:38:54.921985+0000","last_became_active":"2024-09-10T22:38:49.868198+0000","last_became_peered":"2024-09-10T22:38:49.868198+0000","last_unstale":"2024-09-10T22:38:54.921985+0000","last_undegraded":"2024-09-10T22:38:54.921985+0000","last_fullsized":"2024-09-10T22:38:54.921985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:06.062397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920326+0000","last_change":"2024-09-10T22:38:49.859841+0000","last_active":"2024-09-10T22:38:54.920326+0000","last_peered":"2024-09-10T22:38:54.920326+0000","last_clean":"2024-09-10T22:38:54.920326+0000","last_became_active":"2024-09-10T22:38:49.859562+0000","last_became_peered":"2024-09-10T22:38:49.859562+0000","last_unstale":"2024-09-10T22:38:54.920326+0000","last_undegraded":"2024-09-10T22:38:54.920326+0000","last_fullsized":"2024-09-10T22:38:54.920326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:52.712325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880988+0000","last_change":"2024-09-10T22:38:49.872678+0000","last_active":"2024-09-10T22:38:54.880988+0000","last_peered":"2024-09-10T22:38:54.880988+0000","last_clean":"2024-09-10T22:38:54.880988+0000","last_became_active":"2024-09-10T22:38:49.865080+0000","last_became_peered":"2024-09-10T22:38:49.865080+0000","last_unstale":"2024-09-10T22:38:54.880988+0000","last_undegraded":"2024-09-10T22:38:54.880988+0000","last_fullsized":"2024-09-10T22:38:54.880988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:12.405576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879563+0000","last_change":"2024-09-10T22:38:49.874375+0000","last_active":"2024-09-10T22:38:54.879563+0000","last_peered":"2024-09-10T22:38:54.879563+0000","last_clean":"2024-09-10T22:38:54.879563+0000","last_became_active":"2024-09-10T22:38:49.864635+0000","last_became_peered":"2024-09-10T22:38:49.864635+0000","last_unstale":"2024-09-10T22:38:54.879563+0000","last_undegraded":"2024-09-10T22:38:54.879563+0000","last_fullsized":"2024-09-10T22:38:54.879563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:06.748400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876261+0000","last_change":"2024-09-10T22:38:49.855866+0000","last_active":"2024-09-10T22:38:54.876261+0000","last_peered":"2024-09-10T22:38:54.876261+0000","last_clean":"2024-09-10T22:38:54.876261+0000","last_became_active":"2024-09-10T22:38:49.855589+0000","last_became_peered":"2024-09-10T22:38:49.855589+0000","last_unstale":"2024-09-10T22:38:54.876261+0000","last_undegraded":"2024-09-10T22:38:54.876261+0000","last_fullsized":"2024-09-10T22:38:54.876261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:01.561974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920523+0000","last_change":"2024-09-10T22:38:49.853285+0000","last_active":"2024-09-10T22:38:54.920523+0000","last_peered":"2024-09-10T22:38:54.920523+0000","last_clean":"2024-09-10T22:38:54.920523+0000","last_became_active":"2024-09-10T22:38:49.853028+0000","last_became_peered":"2024-09-10T22:38:49.853028+0000","last_unstale":"2024-09-10T22:38:54.920523+0000","last_undegraded":"2024-09-10T22:38:54.920523+0000","last_fullsized":"2024-09-10T22:38:54.920523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:47.476429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921891+0000","last_change":"2024-09-10T22:38:49.865621+0000","last_active":"2024-09-10T22:38:54.921891+0000","last_peered":"2024-09-10T22:38:54.921891+0000","last_clean":"2024-09-10T22:38:54.921891+0000","last_became_active":"2024-09-10T22:38:49.865387+0000","last_became_peered":"2024-09-10T22:38:49.865387+0000","last_unstale":"2024-09-10T22:38:54.921891+0000","last_undegraded":"2024-09-10T22:38:54.921891+0000","last_fullsized":"2024-09-10T22:38:54.921891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:19.035607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921609+0000","last_change":"2024-09-10T22:38:49.870354+0000","last_active":"2024-09-10T22:38:54.921609+0000","last_peered":"2024-09-10T22:38:54.921609+0000","last_clean":"2024-09-10T22:38:54.921609+0000","last_became_active":"2024-09-10T22:38:49.870096+0000","last_became_peered":"2024-09-10T22:38:49.870096+0000","last_unstale":"2024-09-10T22:38:54.921609+0000","last_undegraded":"2024-09-10T22:38:54.921609+0000","last_fullsized":"2024-09-10T22:38:54.921609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:15.637806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880712+0000","last_change":"2024-09-10T22:38:49.875540+0000","last_active":"2024-09-10T22:38:54.880712+0000","last_peered":"2024-09-10T22:38:54.880712+0000","last_clean":"2024-09-10T22:38:54.880712+0000","last_became_active":"2024-09-10T22:38:49.875252+0000","last_became_peered":"2024-09-10T22:38:49.875252+0000","last_unstale":"2024-09-10T22:38:54.880712+0000","last_undegraded":"2024-09-10T22:38:54.880712+0000","last_fullsized":"2024-09-10T22:38:54.880712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:34.910658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881419+0000","last_change":"2024-09-10T22:38:49.875982+0000","last_active":"2024-09-10T22:38:54.881419+0000","last_peered":"2024-09-10T22:38:54.881419+0000","last_clean":"2024-09-10T22:38:54.881419+0000","last_became_active":"2024-09-10T22:38:49.875341+0000","last_became_peered":"2024-09-10T22:38:49.875341+0000","last_unstale":"2024-09-10T22:38:54.881419+0000","last_undegraded":"2024-09-10T22:38:54.881419+0000","last_fullsized":"2024-09-10T22:38:54.881419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:06.748400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921957+0000","last_change":"2024-09-10T22:38:49.879221+0000","last_active":"2024-09-10T22:38:54.921957+0000","last_peered":"2024-09-10T22:38:54.921957+0000","last_clean":"2024-09-10T22:38:54.921957+0000","last_became_active":"2024-09-10T22:38:49.878667+0000","last_became_peered":"2024-09-10T22:38:49.878667+0000","last_unstale":"2024-09-10T22:38:54.921957+0000","last_undegraded":"2024-09-10T22:38:54.921957+0000","last_fullsized":"2024-09-10T22:38:54.921957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:17.870564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921273+0000","last_change":"2024-09-10T22:38:49.875937+0000","last_active":"2024-09-10T22:38:54.921273+0000","last_peered":"2024-09-10T22:38:54.921273+0000","last_clean":"2024-09-10T22:38:54.921273+0000","last_became_active":"2024-09-10T22:38:49.875601+0000","last_became_peered":"2024-09-10T22:38:49.875601+0000","last_unstale":"2024-09-10T22:38:54.921273+0000","last_undegraded":"2024-09-10T22:38:54.921273+0000","last_fullsized":"2024-09-10T22:38:54.921273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:47.476429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921312+0000","last_change":"2024-09-10T22:38:49.861791+0000","last_active":"2024-09-10T22:38:54.921312+0000","last_peered":"2024-09-10T22:38:54.921312+0000","last_clean":"2024-09-10T22:38:54.921312+0000","last_became_active":"2024-09-10T22:38:49.861416+0000","last_became_peered":"2024-09-10T22:38:49.861416+0000","last_unstale":"2024-09-10T22:38:54.921312+0000","last_undegraded":"2024-09-10T22:38:54.921312+0000","last_fullsized":"2024-09-10T22:38:54.921312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:52.686672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879849+0000","last_change":"2024-09-10T22:38:49.865136+0000","last_active":"2024-09-10T22:38:54.879849+0000","last_peered":"2024-09-10T22:38:54.879849+0000","last_clean":"2024-09-10T22:38:54.879849+0000","last_became_active":"2024-09-10T22:38:49.863627+0000","last_became_peered":"2024-09-10T22:38:49.863627+0000","last_unstale":"2024-09-10T22:38:54.879849+0000","last_undegraded":"2024-09-10T22:38:54.879849+0000","last_fullsized":"2024-09-10T22:38:54.879849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:03.094296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921124+0000","last_change":"2024-09-10T22:38:49.869098+0000","last_active":"2024-09-10T22:38:54.921124+0000","last_peered":"2024-09-10T22:38:54.921124+0000","last_clean":"2024-09-10T22:38:54.921124+0000","last_became_active":"2024-09-10T22:38:49.868795+0000","last_became_peered":"2024-09-10T22:38:49.868795+0000","last_unstale":"2024-09-10T22:38:54.921124+0000","last_undegraded":"2024-09-10T22:38:54.921124+0000","last_fullsized":"2024-09-10T22:38:54.921124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:54.366473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880168+0000","last_change":"2024-09-10T22:38:49.878358+0000","last_active":"2024-09-10T22:38:54.880168+0000","last_peered":"2024-09-10T22:38:54.880168+0000","last_clean":"2024-09-10T22:38:54.880168+0000","last_became_active":"2024-09-10T22:38:49.874435+0000","last_became_peered":"2024-09-10T22:38:49.874435+0000","last_unstale":"2024-09-10T22:38:54.880168+0000","last_undegraded":"2024-09-10T22:38:54.880168+0000","last_fullsized":"2024-09-10T22:38:54.880168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:02.684980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920702+0000","last_change":"2024-09-10T22:38:49.851801+0000","last_active":"2024-09-10T22:38:54.920702+0000","last_peered":"2024-09-10T22:38:54.920702+0000","last_clean":"2024-09-10T22:38:54.920702+0000","last_became_active":"2024-09-10T22:38:49.851524+0000","last_became_peered":"2024-09-10T22:38:49.851524+0000","last_unstale":"2024-09-10T22:38:54.920702+0000","last_undegraded":"2024-09-10T22:38:54.920702+0000","last_fullsized":"2024-09-10T22:38:54.920702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:34.910658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876927+0000","last_change":"2024-09-10T22:38:49.852964+0000","last_active":"2024-09-10T22:38:54.876927+0000","last_peered":"2024-09-10T22:38:54.876927+0000","last_clean":"2024-09-10T22:38:54.876927+0000","last_became_active":"2024-09-10T22:38:49.852647+0000","last_became_peered":"2024-09-10T22:38:49.852647+0000","last_unstale":"2024-09-10T22:38:54.876927+0000","last_undegraded":"2024-09-10T22:38:54.876927+0000","last_fullsized":"2024-09-10T22:38:54.876927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:16.799449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921778+0000","last_change":"2024-09-10T22:38:49.878950+0000","last_active":"2024-09-10T22:38:54.921778+0000","last_peered":"2024-09-10T22:38:54.921778+0000","last_clean":"2024-09-10T22:38:54.921778+0000","last_became_active":"2024-09-10T22:38:49.874505+0000","last_became_peered":"2024-09-10T22:38:49.874505+0000","last_unstale":"2024-09-10T22:38:54.921778+0000","last_undegraded":"2024-09-10T22:38:54.921778+0000","last_fullsized":"2024-09-10T22:38:54.921778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:46.274751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":880640,"data_stored":701507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":286720,"data_stored":110647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":110683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":282624,"data_stored":110557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":888832,"data_stored":701563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":110717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:39:11.572 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T22:39:11.572 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-10T22:39:11.572 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T22:39:11.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11d6000640 1 -- 172.21.15.103:0/3713905966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11d00cd080 msgr2=0x7f11d006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:11.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11d6000640 1 --2- 172.21.15.103:0/3713905966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11d00cd080 0x7f11d006d1c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f11d00cd820 tx=0x7f11bc01c800 comp rx=0 tx=0).stop 2024-09-10T22:39:11.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11d6000640 1 -- 172.21.15.103:0/3713905966 shutdown_connections 2024-09-10T22:39:11.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11d6000640 1 --2- 172.21.15.103:0/3713905966 >> v2:172.21.15.131:3300/0 conn(0x7f11d00ad8f0 0x7f11d006d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11d6000640 1 --2- 172.21.15.103:0/3713905966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11d00cd080 0x7f11d006d1c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11d6000640 1 -- 172.21.15.103:0/3713905966 >> 172.21.15.103:0/3713905966 conn(0x7f11d00b1c00 msgr2=0x7f11d00b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:11.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11d6000640 1 -- 172.21.15.103:0/3713905966 shutdown_connections 2024-09-10T22:39:11.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11d6000640 1 -- 172.21.15.103:0/3713905966 wait complete. 2024-09-10T22:39:11.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11d6000640 1 Processor -- start 2024-09-10T22:39:11.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11d6000640 1 -- start start 2024-09-10T22:39:11.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11d6000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11d00ad8f0 0x7f11d00c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:11.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11d6000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11d00cd080 0x7f11d00cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:11.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11d6000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11d015b9e0 0x7f11d00ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:11.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11d6000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f11d0168f90 con 0x7f11d00ad8f0 2024-09-10T22:39:11.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11d6000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f11d0168e10 con 0x7f11d00cd080 2024-09-10T22:39:11.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11d6000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f11d0169110 con 0x7f11d015b9e0 2024-09-10T22:39:11.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11cf400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11d00ad8f0 0x7f11d00c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:11.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11cf400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11d00ad8f0 0x7f11d00c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49188/0 (socket says 172.21.15.103:49188) 2024-09-10T22:39:11.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11cf400640 1 -- 172.21.15.103:0/994309857 learned_addr learned my addr 172.21.15.103:0/994309857 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:11.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11cea00640 1 --2- 172.21.15.103:0/994309857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11d00cd080 0x7f11d00cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:11.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11cfe00640 1 --2- 172.21.15.103:0/994309857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11d015b9e0 0x7f11d00ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:11.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11cf400640 1 -- 172.21.15.103:0/994309857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11d015b9e0 msgr2=0x7f11d00ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:11.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11cf400640 1 --2- 172.21.15.103:0/994309857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11d015b9e0 0x7f11d00ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11cf400640 1 -- 172.21.15.103:0/994309857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11d00cd080 msgr2=0x7f11d00cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:11.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11cf400640 1 --2- 172.21.15.103:0/994309857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11d00cd080 0x7f11d00cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.715+0000 7f11cf400640 1 -- 172.21.15.103:0/994309857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d0156500 con 0x7f11d00ad8f0 2024-09-10T22:39:11.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.719+0000 7f11cf400640 1 --2- 172.21.15.103:0/994309857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11d00ad8f0 0x7f11d00c6550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f11c000cbc0 tx=0x7f11c000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:11.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.719+0000 7f11c7400640 1 -- 172.21.15.103:0/994309857 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c0016020 con 0x7f11d00ad8f0 2024-09-10T22:39:11.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.719+0000 7f11c7400640 1 -- 172.21.15.103:0/994309857 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11c000a930 con 0x7f11d00ad8f0 2024-09-10T22:39:11.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.719+0000 7f11c7400640 1 -- 172.21.15.103:0/994309857 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c000ad80 con 0x7f11d00ad8f0 2024-09-10T22:39:11.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.719+0000 7f11d6000640 1 -- 172.21.15.103:0/994309857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d01567e0 con 0x7f11d00ad8f0 2024-09-10T22:39:11.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.719+0000 7f11d6000640 1 -- 172.21.15.103:0/994309857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d0156da0 con 0x7f11d00ad8f0 2024-09-10T22:39:11.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.719+0000 7f11d6000640 1 -- 172.21.15.103:0/994309857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11d00cc970 con 0x7f11d00ad8f0 2024-09-10T22:39:11.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.719+0000 7f11c7400640 1 -- 172.21.15.103:0/994309857 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f11c001b400 con 0x7f11d00ad8f0 2024-09-10T22:39:11.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.719+0000 7f11c7400640 1 --2- 172.21.15.103:0/994309857 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f11b0072610 0x7f11b0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:11.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.723+0000 7f11c7400640 1 -- 172.21.15.103:0/994309857 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f11c0093960 con 0x7f11d00ad8f0 2024-09-10T22:39:11.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.723+0000 7f11cea00640 1 --2- 172.21.15.103:0/994309857 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f11b0072610 0x7f11b0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:11.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.723+0000 7f11cea00640 1 --2- 172.21.15.103:0/994309857 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f11b0072610 0x7f11b0074ad0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0af000 tx=0x7f11bc01b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:11.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.723+0000 7f11c7400640 1 -- 172.21.15.103:0/994309857 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f11c0020020 con 0x7f11d00ad8f0 2024-09-10T22:39:11.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.891+0000 7f11d6000640 1 -- 172.21.15.103:0/994309857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f11d0158da0 con 0x7f11d00ad8f0 2024-09-10T22:39:11.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.891+0000 7f11c7400640 1 -- 172.21.15.103:0/994309857 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v27) ==== 86+0+160 (secure 0 0 0) 0x7f11c005ed00 con 0x7f11d00ad8f0 2024-09-10T22:39:11.895 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:11.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.895+0000 7f11d6000640 1 -- 172.21.15.103:0/994309857 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f11b0072610 msgr2=0x7f11b0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:11.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.895+0000 7f11d6000640 1 --2- 172.21.15.103:0/994309857 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f11b0072610 0x7f11b0074ad0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0af000 tx=0x7f11bc01b040 comp rx=0 tx=0).stop 2024-09-10T22:39:11.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.895+0000 7f11d6000640 1 -- 172.21.15.103:0/994309857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11d00ad8f0 msgr2=0x7f11d00c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:11.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.895+0000 7f11d6000640 1 --2- 172.21.15.103:0/994309857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11d00ad8f0 0x7f11d00c6550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f11c000cbc0 tx=0x7f11c000cbf0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.895+0000 7f11d6000640 1 -- 172.21.15.103:0/994309857 shutdown_connections 2024-09-10T22:39:11.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.895+0000 7f11d6000640 1 --2- 172.21.15.103:0/994309857 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f11b0072610 0x7f11b0074ad0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.895+0000 7f11d6000640 1 --2- 172.21.15.103:0/994309857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11d015b9e0 0x7f11d00ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.895+0000 7f11d6000640 1 --2- 172.21.15.103:0/994309857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11d00cd080 0x7f11d00cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.895+0000 7f11d6000640 1 --2- 172.21.15.103:0/994309857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11d00ad8f0 0x7f11d00c6550 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:11.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.895+0000 7f11d6000640 1 -- 172.21.15.103:0/994309857 >> 172.21.15.103:0/994309857 conn(0x7f11d00b1c00 msgr2=0x7f11d006faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:11.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.895+0000 7f11d6000640 1 -- 172.21.15.103:0/994309857 shutdown_connections 2024-09-10T22:39:11.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:11.895+0000 7f11d6000640 1 -- 172.21.15.103:0/994309857 wait complete. 2024-09-10T22:39:11.915 INFO:teuthology.orchestra.run.smithi103.stdout:[{"version":27,"timestamp":"2024-09-10T22:38:38.246200+0000","name":"","changes":[{"name":"osd.4/osd_mclock_max_capacity_iops_ssd","new_value":"3485.951614"}]}] 2024-09-10T22:39:11.916 INFO:tasks.ceph_manager:config epoch is 27 2024-09-10T22:39:11.916 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T22:39:11.916 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T22:39:11.916 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T22:39:12.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.055+0000 7fa6bf200640 1 -- 172.21.15.103:0/2449944158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b80af9d0 msgr2=0x7fa6b8166a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:12.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.055+0000 7fa6bf200640 1 --2- 172.21.15.103:0/2449944158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b80af9d0 0x7fa6b8166a50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0009bc0 tx=0x7fa6b001cb10 comp rx=0 tx=0).stop 2024-09-10T22:39:12.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.055+0000 7fa6bf200640 1 -- 172.21.15.103:0/2449944158 shutdown_connections 2024-09-10T22:39:12.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.055+0000 7fa6bf200640 1 --2- 172.21.15.103:0/2449944158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b80af9d0 0x7fa6b8166a50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.055+0000 7fa6bf200640 1 -- 172.21.15.103:0/2449944158 >> 172.21.15.103:0/2449944158 conn(0x7fa6b80d1ac0 msgr2=0x7fa6b80d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:12.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.055+0000 7fa6bf200640 1 -- 172.21.15.103:0/2449944158 shutdown_connections 2024-09-10T22:39:12.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.055+0000 7fa6bf200640 1 -- 172.21.15.103:0/2449944158 wait complete. 2024-09-10T22:39:12.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.055+0000 7fa6bf200640 1 Processor -- start 2024-09-10T22:39:12.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6bf200640 1 -- start start 2024-09-10T22:39:12.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6bf200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b80af9d0 0x7fa6b80c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:12.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6bf200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6b80b09c0 0x7fa6b80c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:12.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6bf200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6b815be30 0x7fa6b815ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:12.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6bf200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b8169ca0 con 0x7fa6b80af9d0 2024-09-10T22:39:12.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6bf200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b8169b20 con 0x7fa6b815be30 2024-09-10T22:39:12.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6bf200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa6b8169e20 con 0x7fa6b80b09c0 2024-09-10T22:39:12.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6b7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b80af9d0 0x7fa6b80c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:12.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6b7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b80af9d0 0x7fa6b80c77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49214/0 (socket says 172.21.15.103:49214) 2024-09-10T22:39:12.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6b7e00640 1 -- 172.21.15.103:0/1189213853 learned_addr learned my addr 172.21.15.103:0/1189213853 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:12.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6bd200640 1 --2- 172.21.15.103:0/1189213853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6b815be30 0x7fa6b815ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:12.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6afe00640 1 --2- 172.21.15.103:0/1189213853 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6b80b09c0 0x7fa6b80c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:12.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6b7e00640 1 -- 172.21.15.103:0/1189213853 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6b80b09c0 msgr2=0x7fa6b80c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:12.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6b7e00640 1 --2- 172.21.15.103:0/1189213853 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6b80b09c0 0x7fa6b80c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6b7e00640 1 -- 172.21.15.103:0/1189213853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6b815be30 msgr2=0x7fa6b815ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:12.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6b7e00640 1 --2- 172.21.15.103:0/1189213853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6b815be30 0x7fa6b815ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6b7e00640 1 -- 172.21.15.103:0/1189213853 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b80c7da0 con 0x7fa6b80af9d0 2024-09-10T22:39:12.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6b7e00640 1 --2- 172.21.15.103:0/1189213853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b80af9d0 0x7fa6b80c77a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800b410 tx=0x7fa6a800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:12.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6b4c00640 1 -- 172.21.15.103:0/1189213853 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8015030 con 0x7fa6b80af9d0 2024-09-10T22:39:12.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6b4c00640 1 -- 172.21.15.103:0/1189213853 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6a8004020 con 0x7fa6b80af9d0 2024-09-10T22:39:12.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6b4c00640 1 -- 172.21.15.103:0/1189213853 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80044b0 con 0x7fa6b80af9d0 2024-09-10T22:39:12.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6bf200640 1 -- 172.21.15.103:0/1189213853 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6b80c8080 con 0x7fa6b80af9d0 2024-09-10T22:39:12.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6bf200640 1 -- 172.21.15.103:0/1189213853 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6b80c6260 con 0x7fa6b80af9d0 2024-09-10T22:39:12.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.059+0000 7fa6bf200640 1 -- 172.21.15.103:0/1189213853 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6b80ce0c0 con 0x7fa6b80af9d0 2024-09-10T22:39:12.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.063+0000 7fa6b4c00640 1 -- 172.21.15.103:0/1189213853 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa6a8022060 con 0x7fa6b80af9d0 2024-09-10T22:39:12.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.063+0000 7fa6b4c00640 1 --2- 172.21.15.103:0/1189213853 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6940725e0 0x7fa694074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:12.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.063+0000 7fa6b4c00640 1 -- 172.21.15.103:0/1189213853 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa6a8093110 con 0x7fa6b80af9d0 2024-09-10T22:39:12.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.063+0000 7fa6afe00640 1 --2- 172.21.15.103:0/1189213853 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6940725e0 0x7fa694074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:12.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.063+0000 7fa6afe00640 1 --2- 172.21.15.103:0/1189213853 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6940725e0 0x7fa694074aa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8166da0 tx=0x7fa6a0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.067+0000 7fa6b4c00640 1 -- 172.21.15.103:0/1189213853 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa6a805e410 con 0x7fa6b80af9d0 2024-09-10T22:39:12.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.271+0000 7fa6bf200640 1 -- 172.21.15.103:0/1189213853 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fa6b80af600 con 0x7fa6b80af9d0 2024-09-10T22:39:12.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.275+0000 7fa6b4c00640 1 -- 172.21.15.103:0/1189213853 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+184992 (secure 0 0 0) 0x7fa6a805dd10 con 0x7fa6b80af9d0 2024-09-10T22:39:12.278 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:12.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.275+0000 7fa6bf200640 1 -- 172.21.15.103:0/1189213853 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6940725e0 msgr2=0x7fa694074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.275+0000 7fa6bf200640 1 --2- 172.21.15.103:0/1189213853 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6940725e0 0x7fa694074aa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8166da0 tx=0x7fa6a0009040 comp rx=0 tx=0).stop 2024-09-10T22:39:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.275+0000 7fa6bf200640 1 -- 172.21.15.103:0/1189213853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b80af9d0 msgr2=0x7fa6b80c77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.275+0000 7fa6bf200640 1 --2- 172.21.15.103:0/1189213853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b80af9d0 0x7fa6b80c77a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800b410 tx=0x7fa6a800b8d0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.275+0000 7fa6bf200640 1 -- 172.21.15.103:0/1189213853 shutdown_connections 2024-09-10T22:39:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.275+0000 7fa6bf200640 1 --2- 172.21.15.103:0/1189213853 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6940725e0 0x7fa694074aa0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.275+0000 7fa6bf200640 1 --2- 172.21.15.103:0/1189213853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6b815be30 0x7fa6b815ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.275+0000 7fa6bf200640 1 --2- 172.21.15.103:0/1189213853 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6b80b09c0 0x7fa6b80c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.275+0000 7fa6bf200640 1 --2- 172.21.15.103:0/1189213853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b80af9d0 0x7fa6b80c77a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.275+0000 7fa6bf200640 1 -- 172.21.15.103:0/1189213853 >> 172.21.15.103:0/1189213853 conn(0x7fa6b80d1ac0 msgr2=0x7fa6b8071730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.275+0000 7fa6bf200640 1 -- 172.21.15.103:0/1189213853 shutdown_connections 2024-09-10T22:39:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.275+0000 7fa6bf200640 1 -- 172.21.15.103:0/1189213853 wait complete. 2024-09-10T22:39:12.297 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":5,"flags":0,"active_gid":4114,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1797156177},{"type":"v1","addr":"172.21.15.131:6809","nonce":1797156177}]},"active_addr":"172.21.15.131:6809/1797156177","active_change":"2024-09-10T22:38:29.601798+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":1898539083}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":3357685099}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":1895450103}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":1804866961}]}]} 2024-09-10T22:39:12.302 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T22:39:12.302 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T22:39:12.302 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:39:12.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.439+0000 7fb86dc00640 1 -- 172.21.15.103:0/3513558049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb868070b40 msgr2=0x7fb8680cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.439+0000 7fb86dc00640 1 --2- 172.21.15.103:0/3513558049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb868070b40 0x7fb8680cdc40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb860009c80 tx=0x7fb86001ccb0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.439+0000 7fb86dc00640 1 -- 172.21.15.103:0/3513558049 shutdown_connections 2024-09-10T22:39:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.439+0000 7fb86dc00640 1 --2- 172.21.15.103:0/3513558049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb868070b40 0x7fb8680cdc40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.439+0000 7fb86dc00640 1 --2- 172.21.15.103:0/3513558049 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb86815f0e0 0x7fb8680d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.439+0000 7fb86dc00640 1 -- 172.21.15.103:0/3513558049 >> 172.21.15.103:0/3513558049 conn(0x7fb8680d18d0 msgr2=0x7fb8680d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.439+0000 7fb86dc00640 1 -- 172.21.15.103:0/3513558049 shutdown_connections 2024-09-10T22:39:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.439+0000 7fb86dc00640 1 -- 172.21.15.103:0/3513558049 wait complete. 2024-09-10T22:39:12.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86dc00640 1 Processor -- start 2024-09-10T22:39:12.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86dc00640 1 -- start start 2024-09-10T22:39:12.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86dc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb868070b40 0x7fb868159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:12.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86dc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8680d23f0 0x7fb868164e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:12.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86dc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb86815f0e0 0x7fb8681653d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:12.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86dc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb868168a20 con 0x7fb86815f0e0 2024-09-10T22:39:12.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86dc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb8681688a0 con 0x7fb868070b40 2024-09-10T22:39:12.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86dc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb868168ba0 con 0x7fb8680d23f0 2024-09-10T22:39:12.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb86815f0e0 0x7fb8681653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:12.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb86815f0e0 0x7fb8681653d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49230/0 (socket says 172.21.15.103:49230) 2024-09-10T22:39:12.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86d200640 1 -- 172.21.15.103:0/3553482826 learned_addr learned my addr 172.21.15.103:0/3553482826 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:12.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb867e00640 1 --2- 172.21.15.103:0/3553482826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb868070b40 0x7fb868159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:12.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb85f400640 1 --2- 172.21.15.103:0/3553482826 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8680d23f0 0x7fb868164e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:12.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86d200640 1 -- 172.21.15.103:0/3553482826 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8680d23f0 msgr2=0x7fb868164e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:12.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86d200640 1 --2- 172.21.15.103:0/3553482826 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8680d23f0 0x7fb868164e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86d200640 1 -- 172.21.15.103:0/3553482826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb868070b40 msgr2=0x7fb868159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:12.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86d200640 1 --2- 172.21.15.103:0/3553482826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb868070b40 0x7fb868159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86d200640 1 -- 172.21.15.103:0/3553482826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8680b1380 con 0x7fb86815f0e0 2024-09-10T22:39:12.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb85f400640 1 --2- 172.21.15.103:0/3553482826 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8680d23f0 0x7fb868164e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:12.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86d200640 1 --2- 172.21.15.103:0/3553482826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb86815f0e0 0x7fb8681653d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb86001a940 tx=0x7fb860009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:12.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb864c00640 1 -- 172.21.15.103:0/3553482826 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8600bb070 con 0x7fb86815f0e0 2024-09-10T22:39:12.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb864c00640 1 -- 172.21.15.103:0/3553482826 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb860004e00 con 0x7fb86815f0e0 2024-09-10T22:39:12.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86dc00640 1 -- 172.21.15.103:0/3553482826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8680b15f0 con 0x7fb86815f0e0 2024-09-10T22:39:12.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb864c00640 1 -- 172.21.15.103:0/3553482826 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8600b2040 con 0x7fb86815f0e0 2024-09-10T22:39:12.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86dc00640 1 -- 172.21.15.103:0/3553482826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8680b1bb0 con 0x7fb86815f0e0 2024-09-10T22:39:12.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.443+0000 7fb86dc00640 1 -- 172.21.15.103:0/3553482826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8680cdc40 con 0x7fb86815f0e0 2024-09-10T22:39:12.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.447+0000 7fb864c00640 1 -- 172.21.15.103:0/3553482826 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb8600b5030 con 0x7fb86815f0e0 2024-09-10T22:39:12.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.447+0000 7fb864c00640 1 --2- 172.21.15.103:0/3553482826 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb8440725e0 0x7fb844074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:12.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.447+0000 7fb864c00640 1 -- 172.21.15.103:0/3553482826 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb86012d180 con 0x7fb86815f0e0 2024-09-10T22:39:12.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.447+0000 7fb867e00640 1 --2- 172.21.15.103:0/3553482826 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb8440725e0 0x7fb844074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:12.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.447+0000 7fb867e00640 1 --2- 172.21.15.103:0/3553482826 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb8440725e0 0x7fb844074aa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb85800bb50 tx=0x7fb85800b2e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:12.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.451+0000 7fb864c00640 1 -- 172.21.15.103:0/3553482826 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb8600a5e20 con 0x7fb86815f0e0 2024-09-10T22:39:12.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.615+0000 7fb86dc00640 1 -- 172.21.15.103:0/3553482826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8680d1d50 con 0x7fb86815f0e0 2024-09-10T22:39:12.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.619+0000 7fb864c00640 1 -- 172.21.15.103:0/3553482826 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7fb860016990 con 0x7fb86815f0e0 2024-09-10T22:39:12.621 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:12.621 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":27,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:38:54.282386+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:38:47.154691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:38:48.182281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T22:38:51.874808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:39:12.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.619+0000 7fb86dc00640 1 -- 172.21.15.103:0/3553482826 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb8440725e0 msgr2=0x7fb844074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:12.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.619+0000 7fb86dc00640 1 --2- 172.21.15.103:0/3553482826 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb8440725e0 0x7fb844074aa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb85800bb50 tx=0x7fb85800b2e0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.619+0000 7fb86dc00640 1 -- 172.21.15.103:0/3553482826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb86815f0e0 msgr2=0x7fb8681653d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:12.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.619+0000 7fb86dc00640 1 --2- 172.21.15.103:0/3553482826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb86815f0e0 0x7fb8681653d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb86001a940 tx=0x7fb860009390 comp rx=0 tx=0).stop 2024-09-10T22:39:12.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.619+0000 7fb86dc00640 1 -- 172.21.15.103:0/3553482826 shutdown_connections 2024-09-10T22:39:12.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.619+0000 7fb86dc00640 1 --2- 172.21.15.103:0/3553482826 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb8440725e0 0x7fb844074aa0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.619+0000 7fb86dc00640 1 --2- 172.21.15.103:0/3553482826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb86815f0e0 0x7fb8681653d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.619+0000 7fb86dc00640 1 --2- 172.21.15.103:0/3553482826 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8680d23f0 0x7fb868164e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.619+0000 7fb86dc00640 1 --2- 172.21.15.103:0/3553482826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb868070b40 0x7fb868159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.619+0000 7fb86dc00640 1 -- 172.21.15.103:0/3553482826 >> 172.21.15.103:0/3553482826 conn(0x7fb8680d18d0 msgr2=0x7fb86815cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:12.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.619+0000 7fb86dc00640 1 -- 172.21.15.103:0/3553482826 shutdown_connections 2024-09-10T22:39:12.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.619+0000 7fb86dc00640 1 -- 172.21.15.103:0/3553482826 wait complete. 2024-09-10T22:39:12.642 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T22:39:12.642 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:39:12.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f4120000640 1 -- 172.21.15.103:0/4181585575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41000052f0 msgr2=0x7f410000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:12.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f4120000640 1 --2- 172.21.15.103:0/4181585575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41000052f0 0x7f410000b9d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4110009ce0 tx=0x7f411001d430 comp rx=0 tx=0).stop 2024-09-10T22:39:12.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f4120000640 1 -- 172.21.15.103:0/4181585575 shutdown_connections 2024-09-10T22:39:12.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f4120000640 1 --2- 172.21.15.103:0/4181585575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41000052f0 0x7f410000b9d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f4120000640 1 -- 172.21.15.103:0/4181585575 >> 172.21.15.103:0/4181585575 conn(0x7f41180d1ac0 msgr2=0x7f41180d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:12.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f4120000640 1 -- 172.21.15.103:0/4181585575 shutdown_connections 2024-09-10T22:39:12.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f4120000640 1 -- 172.21.15.103:0/4181585575 wait complete. 2024-09-10T22:39:12.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f4120000640 1 Processor -- start 2024-09-10T22:39:12.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f4120000640 1 -- start start 2024-09-10T22:39:12.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f4120000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41000052f0 0x7f41181f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:12.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f4120000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41181e4ee0 0x7f4118157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:12.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f4120000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41181e6f10 0x7f41181e73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:12.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f4120000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f411815c210 con 0x7f41181e4ee0 2024-09-10T22:39:12.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f4120000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f41180cda40 con 0x7f41181e6f10 2024-09-10T22:39:12.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f4120000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f411815c390 con 0x7f41000052f0 2024-09-10T22:39:12.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f411cc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41181e4ee0 0x7f4118157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:12.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f411cc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41181e4ee0 0x7f4118157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49234/0 (socket says 172.21.15.103:49234) 2024-09-10T22:39:12.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f411cc00640 1 -- 172.21.15.103:0/1276234781 learned_addr learned my addr 172.21.15.103:0/1276234781 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:12.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f411d600640 1 --2- 172.21.15.103:0/1276234781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41000052f0 0x7f41181f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:12.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f411e000640 1 --2- 172.21.15.103:0/1276234781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41181e6f10 0x7f41181e73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:12.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f411cc00640 1 -- 172.21.15.103:0/1276234781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41000052f0 msgr2=0x7f41181f23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:12.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f411cc00640 1 --2- 172.21.15.103:0/1276234781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41000052f0 0x7f41181f23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f411cc00640 1 -- 172.21.15.103:0/1276234781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41181e6f10 msgr2=0x7f41181e73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:12.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f411cc00640 1 --2- 172.21.15.103:0/1276234781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41181e6f10 0x7f41181e73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f411cc00640 1 -- 172.21.15.103:0/1276234781 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41181e6780 con 0x7f41181e4ee0 2024-09-10T22:39:12.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.783+0000 7f411cc00640 1 --2- 172.21.15.103:0/1276234781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41181e4ee0 0x7f4118157c80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4104012690 tx=0x7f4104012b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:12.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.787+0000 7f4115600640 1 -- 172.21.15.103:0/1276234781 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4104010b40 con 0x7f41181e4ee0 2024-09-10T22:39:12.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.787+0000 7f4115600640 1 -- 172.21.15.103:0/1276234781 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4104012e90 con 0x7f41181e4ee0 2024-09-10T22:39:12.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.787+0000 7f4115600640 1 -- 172.21.15.103:0/1276234781 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4104013450 con 0x7f41181e4ee0 2024-09-10T22:39:12.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.787+0000 7f4120000640 1 -- 172.21.15.103:0/1276234781 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41181f2be0 con 0x7f41181e4ee0 2024-09-10T22:39:12.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.787+0000 7f4120000640 1 -- 172.21.15.103:0/1276234781 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41181e69f0 con 0x7f41181e4ee0 2024-09-10T22:39:12.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.787+0000 7f4120000640 1 -- 172.21.15.103:0/1276234781 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41181e6bf0 con 0x7f41181e4ee0 2024-09-10T22:39:12.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.787+0000 7f4115600640 1 -- 172.21.15.103:0/1276234781 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f41040135f0 con 0x7f41181e4ee0 2024-09-10T22:39:12.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.787+0000 7f4115600640 1 --2- 172.21.15.103:0/1276234781 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f40f8072610 0x7f40f8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:12.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.787+0000 7f4115600640 1 -- 172.21.15.103:0/1276234781 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f41040971e0 con 0x7f41181e4ee0 2024-09-10T22:39:12.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.787+0000 7f411d600640 1 --2- 172.21.15.103:0/1276234781 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f40f8072610 0x7f40f8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:12.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.791+0000 7f411d600640 1 --2- 172.21.15.103:0/1276234781 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f40f8072610 0x7f40f8074ad0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f410c000f90 tx=0x7f410c006f00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:12.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.791+0000 7f4115600640 1 -- 172.21.15.103:0/1276234781 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f41181e6bf0 con 0x7f41181e4ee0 2024-09-10T22:39:12.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.963+0000 7f4120000640 1 -- 172.21.15.103:0/1276234781 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41180ce3d0 con 0x7f41181e4ee0 2024-09-10T22:39:12.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.963+0000 7f4115600640 1 -- 172.21.15.103:0/1276234781 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7f4104022020 con 0x7f41181e4ee0 2024-09-10T22:39:12.967 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:12.968 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":27,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:38:54.282386+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:38:47.154691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:38:48.182281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T22:38:51.874808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:39:12.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.967+0000 7f4120000640 1 -- 172.21.15.103:0/1276234781 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f40f8072610 msgr2=0x7f40f8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.967+0000 7f4120000640 1 --2- 172.21.15.103:0/1276234781 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f40f8072610 0x7f40f8074ad0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f410c000f90 tx=0x7f410c006f00 comp rx=0 tx=0).stop 2024-09-10T22:39:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.967+0000 7f4120000640 1 -- 172.21.15.103:0/1276234781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41181e4ee0 msgr2=0x7f4118157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.967+0000 7f4120000640 1 --2- 172.21.15.103:0/1276234781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41181e4ee0 0x7f4118157c80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4104012690 tx=0x7f4104012b50 comp rx=0 tx=0).stop 2024-09-10T22:39:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.967+0000 7f4120000640 1 -- 172.21.15.103:0/1276234781 shutdown_connections 2024-09-10T22:39:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.967+0000 7f4120000640 1 --2- 172.21.15.103:0/1276234781 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f40f8072610 0x7f40f8074ad0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.967+0000 7f4120000640 1 --2- 172.21.15.103:0/1276234781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41181e6f10 0x7f41181e73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.967+0000 7f4120000640 1 --2- 172.21.15.103:0/1276234781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41181e4ee0 0x7f4118157c80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.967+0000 7f4120000640 1 --2- 172.21.15.103:0/1276234781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41000052f0 0x7f41181f23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.967+0000 7f4120000640 1 -- 172.21.15.103:0/1276234781 >> 172.21.15.103:0/1276234781 conn(0x7f41180d1ac0 msgr2=0x7f411815aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.967+0000 7f4120000640 1 -- 172.21.15.103:0/1276234781 shutdown_connections 2024-09-10T22:39:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:12.967+0000 7f4120000640 1 -- 172.21.15.103:0/1276234781 wait complete. 2024-09-10T22:39:12.990 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T22:39:12.990 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T22:39:12.991 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T22:39:12.991 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T22:39:12.992 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T22:39:12.992 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T22:39:12.992 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T22:39:12.993 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T22:39:13.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.239+0000 7f09f5600640 1 -- 172.21.15.103:0/1206972083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09e8051c90 msgr2=0x7f09e8050160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.239+0000 7f09f5600640 1 --2- 172.21.15.103:0/1206972083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09e8051c90 0x7f09e8050160 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f09f006b370 tx=0x7f09f00980b0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.239+0000 7f09f5600640 1 -- 172.21.15.103:0/1206972083 shutdown_connections 2024-09-10T22:39:13.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.239+0000 7f09f5600640 1 --2- 172.21.15.103:0/1206972083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09e8051c90 0x7f09e8050160 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.239+0000 7f09f5600640 1 --2- 172.21.15.103:0/1206972083 >> v2:172.21.15.131:3300/0 conn(0x7f09e8037c50 0x7f09e804fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.239+0000 7f09f5600640 1 -- 172.21.15.103:0/1206972083 >> 172.21.15.103:0/1206972083 conn(0x7f09e801e8d0 msgr2=0x7f09e8055660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.239+0000 7f09f5600640 1 -- 172.21.15.103:0/1206972083 shutdown_connections 2024-09-10T22:39:13.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.239+0000 7f09f5600640 1 -- 172.21.15.103:0/1206972083 wait complete. 2024-09-10T22:39:13.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.243+0000 7f9dd9a00640 1 -- 172.21.15.103:0/1908434669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9dd40b53a0 msgr2=0x7f9dd415df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.243+0000 7f9dd9a00640 1 --2- 172.21.15.103:0/1908434669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9dd40b53a0 0x7f9dd415df20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009840 tx=0x7f9dc001c6b0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.243+0000 7f9dd9a00640 1 -- 172.21.15.103:0/1908434669 shutdown_connections 2024-09-10T22:39:13.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.243+0000 7f9dd9a00640 1 --2- 172.21.15.103:0/1908434669 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9dd40b5780 0x7f9dd406d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.243+0000 7f9dd9a00640 1 --2- 172.21.15.103:0/1908434669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9dd40b53a0 0x7f9dd415df20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.243+0000 7f9dd9a00640 1 -- 172.21.15.103:0/1908434669 >> 172.21.15.103:0/1908434669 conn(0x7f9dd406dd10 msgr2=0x7f9dd406e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.243+0000 7f09f5600640 1 Processor -- start 2024-09-10T22:39:13.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.243+0000 7f09f5600640 1 -- start start 2024-09-10T22:39:13.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.243+0000 7f9dd9a00640 1 -- 172.21.15.103:0/1908434669 shutdown_connections 2024-09-10T22:39:13.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.243+0000 7f9dd9a00640 1 -- 172.21.15.103:0/1908434669 wait complete. 2024-09-10T22:39:13.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f09f5600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09e8037870 0x7f09e80d64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f09f5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8037c50 0x7f09e80d9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f9dd9a00640 1 Processor -- start 2024-09-10T22:39:13.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f09f5600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09e8051c90 0x7f09e804ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f09f5600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f09e80efcc0 con 0x7f09e8037c50 2024-09-10T22:39:13.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7fccfd200640 1 -- 172.21.15.103:0/3115062758 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf8154b20 msgr2=0x7fccf80701c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f09f5600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f09e80efb40 con 0x7f09e8037870 2024-09-10T22:39:13.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f09f5600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f09e80efe40 con 0x7f09e8051c90 2024-09-10T22:39:13.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f09f4c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09e8051c90 0x7f09e804ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f09f4c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09e8051c90 0x7f09e804ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:55022/0 (socket says 172.21.15.103:55022) 2024-09-10T22:39:13.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f09f4c00640 1 -- 172.21.15.103:0/213829605 learned_addr learned my addr 172.21.15.103:0/213829605 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:13.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7fccfd200640 1 --2- 172.21.15.103:0/3115062758 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf8154b20 0x7fccf80701c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fccf80b0040 tx=0x7fcce801c8b0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7fccfd200640 1 -- 172.21.15.103:0/3115062758 shutdown_connections 2024-09-10T22:39:13.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7fccfd200640 1 --2- 172.21.15.103:0/3115062758 >> v2:172.21.15.131:3300/0 conn(0x7fccf80ccc70 0x7fccf806edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7fccfd200640 1 --2- 172.21.15.103:0/3115062758 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf8154b20 0x7fccf80701c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7fccfd200640 1 -- 172.21.15.103:0/3115062758 >> 172.21.15.103:0/3115062758 conn(0x7fccf80b1a90 msgr2=0x7fccf80b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7fccfd200640 1 -- 172.21.15.103:0/3115062758 shutdown_connections 2024-09-10T22:39:13.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7fccfd200640 1 -- 172.21.15.103:0/3115062758 wait complete. 2024-09-10T22:39:13.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f09ef400640 1 --2- 172.21.15.103:0/213829605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8037c50 0x7f09e80d9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f09efe00640 1 --2- 172.21.15.103:0/213829605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09e8037870 0x7f09e80d64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f9dd9a00640 1 -- start start 2024-09-10T22:39:13.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f9dd9a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9dd406f3d0 0x7f9dd4144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f09f4c00640 1 -- 172.21.15.103:0/213829605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09e8037870 msgr2=0x7f09e80d64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f09f4c00640 1 --2- 172.21.15.103:0/213829605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09e8037870 0x7f09e80d64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f09f4c00640 1 -- 172.21.15.103:0/213829605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8037c50 msgr2=0x7f09e80d9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f09f4c00640 1 --2- 172.21.15.103:0/213829605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8037c50 0x7f09e80d9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f09f4c00640 1 -- 172.21.15.103:0/213829605 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e804c150 con 0x7f09e8051c90 2024-09-10T22:39:13.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f9dd9a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd40b53a0 0x7f9dd4160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f9dd9a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9dd40b5780 0x7f9dd4160880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f9dd9a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd406fa00 con 0x7f9dd40b53a0 2024-09-10T22:39:13.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f9dd9a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd406f880 con 0x7f9dd40b5780 2024-09-10T22:39:13.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f9dd9a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd406fb80 con 0x7f9dd406f3d0 2024-09-10T22:39:13.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f9dd3e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9dd406f3d0 0x7f9dd4144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f9dd3e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9dd406f3d0 0x7f9dd4144ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:55024/0 (socket says 172.21.15.103:55024) 2024-09-10T22:39:13.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.247+0000 7f9dd3e00640 1 -- 172.21.15.103:0/2832967104 learned_addr learned my addr 172.21.15.103:0/2832967104 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:13.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f9dd9000640 1 --2- 172.21.15.103:0/2832967104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9dd40b5780 0x7f9dd4160880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f9dd9000640 1 -- 172.21.15.103:0/2832967104 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9dd406f3d0 msgr2=0x7f9dd4144ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f9dd9000640 1 --2- 172.21.15.103:0/2832967104 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9dd406f3d0 0x7f9dd4144ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f9dd9000640 1 -- 172.21.15.103:0/2832967104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd40b53a0 msgr2=0x7f9dd4160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f9dd9000640 1 --2- 172.21.15.103:0/2832967104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd40b53a0 0x7f9dd4160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f9dd9000640 1 -- 172.21.15.103:0/2832967104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd41fcaa0 con 0x7f9dd40b5780 2024-09-10T22:39:13.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f12b1600640 1 -- 172.21.15.103:0/1900968846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12ac06cc00 msgr2=0x7f12ac06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f12b1600640 1 --2- 172.21.15.103:0/1900968846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12ac06cc00 0x7f12ac06fca0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f12ac06a620 tx=0x7f12a401cc60 comp rx=0 tx=0).stop 2024-09-10T22:39:13.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f12b1600640 1 -- 172.21.15.103:0/1900968846 shutdown_connections 2024-09-10T22:39:13.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f12b1600640 1 --2- 172.21.15.103:0/1900968846 >> v2:172.21.15.103:3300/0 conn(0x7f12ac0afc80 0x7f12ac0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f12b1600640 1 --2- 172.21.15.103:0/1900968846 >> v2:172.21.15.131:3300/0 conn(0x7f12ac0cdee0 0x7f12ac06cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f12b1600640 1 --2- 172.21.15.103:0/1900968846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12ac06cc00 0x7f12ac06fca0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f12b1600640 1 -- 172.21.15.103:0/1900968846 >> 172.21.15.103:0/1900968846 conn(0x7f12ac0cd3c0 msgr2=0x7f12ac0cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f9dd9000640 1 --2- 172.21.15.103:0/2832967104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9dd40b5780 0x7f9dd4160880 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00fc50 tx=0x7f9dcc00d430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f12b1600640 1 -- 172.21.15.103:0/1900968846 shutdown_connections 2024-09-10T22:39:13.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7fccfd200640 1 Processor -- start 2024-09-10T22:39:13.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f12b1600640 1 -- 172.21.15.103:0/1900968846 wait complete. 2024-09-10T22:39:13.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7fccfd200640 1 -- start start 2024-09-10T22:39:13.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f09f4c00640 1 --2- 172.21.15.103:0/213829605 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09e8051c90 0x7f09e804ba50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f09f006be20 tx=0x7f09f0064620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f9dcbe00640 1 -- 172.21.15.103:0/2832967104 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc01a070 con 0x7f9dd40b5780 2024-09-10T22:39:13.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f9dcbe00640 1 -- 172.21.15.103:0/2832967104 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9dcc006aa0 con 0x7f9dd40b5780 2024-09-10T22:39:13.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f9dcbe00640 1 -- 172.21.15.103:0/2832967104 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc00fe60 con 0x7f9dd40b5780 2024-09-10T22:39:13.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f9dd9a00640 1 -- 172.21.15.103:0/2832967104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd41f8a40 con 0x7f9dd40b5780 2024-09-10T22:39:13.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7fccfd200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf80ad860 0x7fccf81feb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7fccfd200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccf80ccc70 0x7fccf80ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7fccfd200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccf8154b20 0x7fccf81ff140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7fccfd200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fccf816ad20 con 0x7fccf80ad860 2024-09-10T22:39:13.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7fccfd200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fccf816aba0 con 0x7fccf8154b20 2024-09-10T22:39:13.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7fccfd200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fccf816aea0 con 0x7fccf80ccc70 2024-09-10T22:39:13.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f9dd9a00640 1 -- 172.21.15.103:0/2832967104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd41f9000 con 0x7f9dd40b5780 2024-09-10T22:39:13.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7f9dd9a00640 1 -- 172.21.15.103:0/2832967104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9dd41f8830 con 0x7f9dd40b5780 2024-09-10T22:39:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.251+0000 7f09e3e00640 1 -- 172.21.15.103:0/213829605 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f0063800 con 0x7f09e8051c90 2024-09-10T22:39:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7f09e3e00640 1 -- 172.21.15.103:0/213829605 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09f012e040 con 0x7f09e8051c90 2024-09-10T22:39:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7f09e3e00640 1 -- 172.21.15.103:0/213829605 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f0063c90 con 0x7f09e8051c90 2024-09-10T22:39:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7f09f5600640 1 -- 172.21.15.103:0/213829605 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e80e4080 con 0x7f09e8051c90 2024-09-10T22:39:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fccf6800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccf8154b20 0x7fccf81ff140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fccf6800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccf8154b20 0x7fccf81ff140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:43052/0 (socket says 172.21.15.103:43052) 2024-09-10T22:39:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fccf6800640 1 -- 172.21.15.103:0/870006130 learned_addr learned my addr 172.21.15.103:0/870006130 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:13.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7f09f5600640 1 -- 172.21.15.103:0/213829605 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e80e4640 con 0x7f09e8051c90 2024-09-10T22:39:13.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7feca3200640 1 -- 172.21.15.103:0/3783816055 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feca4070e10 msgr2=0x7feca415da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7feca3200640 1 --2- 172.21.15.103:0/3783816055 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feca4070e10 0x7feca415da80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fec90009870 tx=0x7fec9001f050 comp rx=0 tx=0).stop 2024-09-10T22:39:13.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fccf6800640 1 -- 172.21.15.103:0/870006130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccf80ccc70 msgr2=0x7fccf80ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fccf5400640 1 --2- 172.21.15.103:0/870006130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccf80ccc70 0x7fccf80ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fccf6800640 1 --2- 172.21.15.103:0/870006130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccf80ccc70 0x7fccf80ce5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fccf6800640 1 -- 172.21.15.103:0/870006130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf80ad860 msgr2=0x7fccf81feb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fccf6800640 1 --2- 172.21.15.103:0/870006130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf80ad860 0x7fccf81feb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fccf6800640 1 -- 172.21.15.103:0/870006130 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf814ad70 con 0x7fccf8154b20 2024-09-10T22:39:13.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fccf6800640 1 --2- 172.21.15.103:0/870006130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccf8154b20 0x7fccf81ff140 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fccf000ba10 tx=0x7fccf000bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fccf5400640 1 --2- 172.21.15.103:0/870006130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccf80ccc70 0x7fccf80ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:39:13.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7f09f5600640 1 -- 172.21.15.103:0/213829605 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f09cc001040 con 0x7f09e8051c90 2024-09-10T22:39:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fccee000640 1 -- 172.21.15.103:0/870006130 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf0019070 con 0x7fccf8154b20 2024-09-10T22:39:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fccee000640 1 -- 172.21.15.103:0/870006130 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccf000cc90 con 0x7fccf8154b20 2024-09-10T22:39:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fccee000640 1 -- 172.21.15.103:0/870006130 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf00146a0 con 0x7fccf8154b20 2024-09-10T22:39:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fccfd200640 1 -- 172.21.15.103:0/870006130 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf80cec80 con 0x7fccf8154b20 2024-09-10T22:39:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fccfd200640 1 -- 172.21.15.103:0/870006130 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf80cf240 con 0x7fccf8154b20 2024-09-10T22:39:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fa74aa00640 1 -- 172.21.15.103:0/1260076250 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7440b2070 con 0x7fa74c15d5b0 2024-09-10T22:39:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fa751c00640 1 -- 172.21.15.103:0/1260076250 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74c15d5b0 msgr2=0x7fa74c15da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fa751c00640 1 --2- 172.21.15.103:0/1260076250 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74c15d5b0 0x7fa74c15da20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa744009bc0 tx=0x7fa74401cbe0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7feca3200640 1 -- 172.21.15.103:0/3783816055 shutdown_connections 2024-09-10T22:39:13.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7feca3200640 1 --2- 172.21.15.103:0/3783816055 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feca4070e10 0x7feca415da80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7feca3200640 1 -- 172.21.15.103:0/3783816055 >> 172.21.15.103:0/3783816055 conn(0x7feca40b21e0 msgr2=0x7feca40cff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fa751c00640 1 -- 172.21.15.103:0/1260076250 shutdown_connections 2024-09-10T22:39:13.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fa751c00640 1 --2- 172.21.15.103:0/1260076250 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74c15d5b0 0x7fa74c15da20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fa751c00640 1 --2- 172.21.15.103:0/1260076250 >> v2:172.21.15.131:3300/0 conn(0x7fa74c153ef0 0x7fa74c073fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fa751c00640 1 -- 172.21.15.103:0/1260076250 >> 172.21.15.103:0/1260076250 conn(0x7fa74c0b1490 msgr2=0x7fa74c0b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7f12b1600640 1 Processor -- start 2024-09-10T22:39:13.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7f12b1600640 1 -- start start 2024-09-10T22:39:13.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7fccfd200640 1 -- 172.21.15.103:0/870006130 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fccf806edb0 con 0x7fccf8154b20 2024-09-10T22:39:13.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7f12b1600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12ac06cc00 0x7f12ac15f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7f12b1600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12ac0afc80 0x7f12ac1f8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f972f000640 1 -- 172.21.15.103:0/4016021552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9710004810 msgr2=0x7f9710004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12b1600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12ac0cdee0 0x7f12ac144400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12b1600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac0ca810 con 0x7f12ac0cdee0 2024-09-10T22:39:13.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12b1600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac0ca690 con 0x7f12ac06cc00 2024-09-10T22:39:13.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12b1600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f12ac0ca990 con 0x7f12ac0afc80 2024-09-10T22:39:13.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12aaa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12ac06cc00 0x7f12ac15f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12aaa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12ac06cc00 0x7f12ac15f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:43058/0 (socket says 172.21.15.103:43058) 2024-09-10T22:39:13.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12aa000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12ac0afc80 0x7f12ac1f8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12aaa00640 1 -- 172.21.15.103:0/630105908 learned_addr learned my addr 172.21.15.103:0/630105908 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:13.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7feca3200640 1 -- 172.21.15.103:0/3783816055 shutdown_connections 2024-09-10T22:39:13.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f972f000640 1 --2- 172.21.15.103:0/4016021552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9710004810 0x7f9710004c90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9714006f90 tx=0x7f971401f660 comp rx=0 tx=0).stop 2024-09-10T22:39:13.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12aaa00640 1 -- 172.21.15.103:0/630105908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12ac0afc80 msgr2=0x7f12ac1f8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12aaa00640 1 --2- 172.21.15.103:0/630105908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12ac0afc80 0x7f12ac1f8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12aaa00640 1 -- 172.21.15.103:0/630105908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12ac0cdee0 msgr2=0x7f12ac144400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12aaa00640 1 --2- 172.21.15.103:0/630105908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12ac0cdee0 0x7f12ac144400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12aaa00640 1 -- 172.21.15.103:0/630105908 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ac160a80 con 0x7f12ac06cc00 2024-09-10T22:39:13.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.255+0000 7f9dcbe00640 1 -- 172.21.15.103:0/2832967104 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9dcc03aa50 con 0x7f9dd40b5780 2024-09-10T22:39:13.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f9dcbe00640 1 --2- 172.21.15.103:0/2832967104 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9db4072630 0x7f9db4074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f9dcbe00640 1 -- 172.21.15.103:0/2832967104 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9dcc096520 con 0x7f9dd40b5780 2024-09-10T22:39:13.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f9dcbe00640 1 --2- 172.21.15.103:0/2832967104 >> [v2:172.21.15.103:6816/3190036446,v1:172.21.15.103:6817/3190036446] conn(0x7f9db407bda0 0x7f9db407e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f9dcbe00640 1 -- 172.21.15.103:0/2832967104 --> [v2:172.21.15.103:6816/3190036446,v1:172.21.15.103:6817/3190036446] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9dcc01de50 con 0x7f9db407bda0 2024-09-10T22:39:13.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f9dcbe00640 1 -- 172.21.15.103:0/2832967104 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9dcc0968d0 con 0x7f9dd40b5780 2024-09-10T22:39:13.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7fa751c00640 1 -- 172.21.15.103:0/1260076250 shutdown_connections 2024-09-10T22:39:13.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7fccee000640 1 -- 172.21.15.103:0/870006130 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fccf003aaa0 con 0x7fccf8154b20 2024-09-10T22:39:13.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f5fc2000640 1 -- 172.21.15.103:0/2889207073 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fbc15e120 msgr2=0x7f5fbc0b1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f5fc2000640 1 --2- 172.21.15.103:0/2889207073 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fbc15e120 0x7f5fbc0b1740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009840 tx=0x7f5fa801c780 comp rx=0 tx=0).stop 2024-09-10T22:39:13.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f09e3e00640 1 -- 172.21.15.103:0/213829605 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f09f015ab30 con 0x7f09e8051c90 2024-09-10T22:39:13.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7feca3200640 1 -- 172.21.15.103:0/3783816055 wait complete. 2024-09-10T22:39:13.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7fa751c00640 1 -- 172.21.15.103:0/1260076250 wait complete. 2024-09-10T22:39:13.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12aaa00640 1 --2- 172.21.15.103:0/630105908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12ac06cc00 0x7f12ac15f300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12a4000f90 tx=0x7f12a4003f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f5fc2000640 1 -- 172.21.15.103:0/2889207073 shutdown_connections 2024-09-10T22:39:13.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f5fc2000640 1 --2- 172.21.15.103:0/2889207073 >> v2:172.21.15.103:3300/0 conn(0x7f5fbc099a00 0x7f5fbc0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f5fc2000640 1 --2- 172.21.15.103:0/2889207073 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fbc15e120 0x7f5fbc0b1740 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f5fc2000640 1 -- 172.21.15.103:0/2889207073 >> 172.21.15.103:0/2889207073 conn(0x7f5fbc0b1d00 msgr2=0x7f5fbc0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f5fc2000640 1 -- 172.21.15.103:0/2889207073 shutdown_connections 2024-09-10T22:39:13.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f5fc2000640 1 -- 172.21.15.103:0/2889207073 wait complete. 2024-09-10T22:39:13.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f9dd3e00640 1 --2- 172.21.15.103:0/2832967104 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9db4072630 0x7f9db4074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f972e600640 1 -- 172.21.15.103:0/4016021552 reap_dead start 2024-09-10T22:39:13.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f972f000640 1 -- 172.21.15.103:0/4016021552 shutdown_connections 2024-09-10T22:39:13.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f972f000640 1 -- 172.21.15.103:0/4016021552 >> 172.21.15.103:0/4016021552 conn(0x7f972806cc00 msgr2=0x7f972806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f972f000640 1 -- 172.21.15.103:0/4016021552 shutdown_connections 2024-09-10T22:39:13.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f972f000640 1 -- 172.21.15.103:0/4016021552 wait complete. 2024-09-10T22:39:13.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f09e3e00640 1 --2- 172.21.15.103:0/213829605 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f09d00726b0 0x7f09d0074b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f09e3e00640 1 -- 172.21.15.103:0/213829605 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f09f01a9160 con 0x7f09e8051c90 2024-09-10T22:39:13.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f09efe00640 1 --2- 172.21.15.103:0/213829605 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f09d00726b0 0x7f09d0074b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f09e3e00640 1 --2- 172.21.15.103:0/213829605 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x7f09d007be30 0x7f09d007e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f09e3e00640 1 -- 172.21.15.103:0/213829605 --> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f09f006da60 con 0x7f09d007be30 2024-09-10T22:39:13.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f09e3e00640 1 -- 172.21.15.103:0/213829605 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f09f01a9550 con 0x7f09e8051c90 2024-09-10T22:39:13.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f9dd3400640 1 --2- 172.21.15.103:0/2832967104 >> [v2:172.21.15.103:6816/3190036446,v1:172.21.15.103:6817/3190036446] conn(0x7f9db407bda0 0x7f9db407e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7feca3200640 1 Processor -- start 2024-09-10T22:39:13.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7feca3200640 1 -- start start 2024-09-10T22:39:13.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12a2a00640 1 -- 172.21.15.103:0/630105908 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a40b2040 con 0x7f12ac06cc00 2024-09-10T22:39:13.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12a2a00640 1 -- 172.21.15.103:0/630105908 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12a40bb070 con 0x7f12ac06cc00 2024-09-10T22:39:13.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12a2a00640 1 -- 172.21.15.103:0/630105908 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a4004710 con 0x7f12ac06cc00 2024-09-10T22:39:13.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12b1600640 1 -- 172.21.15.103:0/630105908 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ac15f9e0 con 0x7f12ac06cc00 2024-09-10T22:39:13.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f12b1600640 1 -- 172.21.15.103:0/630105908 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ac15ffa0 con 0x7f12ac06cc00 2024-09-10T22:39:13.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f09ef400640 1 --2- 172.21.15.103:0/213829605 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x7f09d007be30 0x7f09d007e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f09efe00640 1 --2- 172.21.15.103:0/213829605 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f09d00726b0 0x7f09d0074b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f09e4001250 tx=0x7f09e4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f972f000640 1 Processor -- start 2024-09-10T22:39:13.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f972f000640 1 -- start start 2024-09-10T22:39:13.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7f9dd3e00640 1 --2- 172.21.15.103:0/2832967104 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9db4072630 0x7f9db4074af0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9dc001ad60 tx=0x7f9dc001aef0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f9dd3400640 1 --2- 172.21.15.103:0/2832967104 >> [v2:172.21.15.103:6816/3190036446,v1:172.21.15.103:6817/3190036446] conn(0x7f9db407bda0 0x7f9db407e1e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7fa751c00640 1 Processor -- start 2024-09-10T22:39:13.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7fa751c00640 1 -- start start 2024-09-10T22:39:13.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7fccee000640 1 --2- 172.21.15.103:0/870006130 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fccd8072630 0x7fccd8074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7fccee000640 1 -- 172.21.15.103:0/870006130 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fccf0093630 con 0x7fccf8154b20 2024-09-10T22:39:13.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7fccee000640 1 --2- 172.21.15.103:0/870006130 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x7fccd807bdb0 0x7fccd807e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7fccee000640 1 -- 172.21.15.103:0/870006130 --> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fccf00091f0 con 0x7fccd807bdb0 2024-09-10T22:39:13.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.259+0000 7fccee000640 1 -- 172.21.15.103:0/870006130 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fccf0093b10 con 0x7fccf8154b20 2024-09-10T22:39:13.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f1297e00640 1 -- 172.21.15.103:0/630105908 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f12ac1f8e90 con 0x7f12ac06cc00 2024-09-10T22:39:13.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f5fc2000640 1 Processor -- start 2024-09-10T22:39:13.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f5fc2000640 1 -- start start 2024-09-10T22:39:13.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f9dcbe00640 1 -- 172.21.15.103:0/2832967104 <== osd.2 v2:172.21.15.103:6816/3190036446 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9dcc01de50 con 0x7f9db407bda0 2024-09-10T22:39:13.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7fccf5400640 1 --2- 172.21.15.103:0/870006130 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x7fccd807bdb0 0x7fccd807e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7fccf5e00640 1 --2- 172.21.15.103:0/870006130 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fccd8072630 0x7fccd8074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca3200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feca4070e10 0x7feca413bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca3200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feca40cf8e0 0x7feca413f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca3200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feca415ab50 0x7feca413feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f09ef400640 1 --2- 172.21.15.103:0/213829605 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x7f09d007be30 0x7f09d007e270 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca3200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feca415b2c0 con 0x7feca415ab50 2024-09-10T22:39:13.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca3200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feca415b140 con 0x7feca4070e10 2024-09-10T22:39:13.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca3200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7feca415b440 con 0x7feca40cf8e0 2024-09-10T22:39:13.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca1400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feca40cf8e0 0x7feca413f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca1400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feca40cf8e0 0x7feca413f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:55040/0 (socket says 172.21.15.103:55040) 2024-09-10T22:39:13.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca1400640 1 -- 172.21.15.103:0/788327513 learned_addr learned my addr 172.21.15.103:0/788327513 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:13.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca2800640 1 --2- 172.21.15.103:0/788327513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feca415ab50 0x7feca413feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca1400640 1 -- 172.21.15.103:0/788327513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feca4070e10 msgr2=0x7feca413bca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T22:39:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca1400640 1 --2- 172.21.15.103:0/788327513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feca4070e10 0x7feca413bca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca1400640 1 -- 172.21.15.103:0/788327513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feca415ab50 msgr2=0x7feca413feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f972f000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9728148260 0x7f97281e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca1400640 1 --2- 172.21.15.103:0/788327513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feca415ab50 0x7feca413feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca1400640 1 -- 172.21.15.103:0/788327513 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca4144800 con 0x7feca40cf8e0 2024-09-10T22:39:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca2800640 1 --2- 172.21.15.103:0/788327513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feca415ab50 0x7feca413feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:39:13.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f972f000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97281e7fb0 0x7f9728158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f972dc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9728148260 0x7f97281e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f972dc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9728148260 0x7f97281e7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:55044/0 (socket says 172.21.15.103:55044) 2024-09-10T22:39:13.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f972dc00640 1 -- 172.21.15.103:0/1543474022 learned_addr learned my addr 172.21.15.103:0/1543474022 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:13.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f972f000640 1 --2- 172.21.15.103:0/1543474022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9728159370 0x7f97281f7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f972d200640 1 --2- 172.21.15.103:0/1543474022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97281e7fb0 0x7f9728158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f972f000640 1 -- 172.21.15.103:0/1543474022 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f972815e310 con 0x7f9728159370 2024-09-10T22:39:13.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f972f000640 1 -- 172.21.15.103:0/1543474022 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f972815e190 con 0x7f97281e7fb0 2024-09-10T22:39:13.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f972f000640 1 -- 172.21.15.103:0/1543474022 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f97280d02f0 con 0x7f9728148260 2024-09-10T22:39:13.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f972e600640 1 --2- 172.21.15.103:0/1543474022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9728159370 0x7f97281f7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca1400640 1 --2- 172.21.15.103:0/788327513 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feca40cf8e0 0x7feca413f970 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00c7c0 tx=0x7fec9c00cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7fec9a000640 1 -- 172.21.15.103:0/788327513 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c027020 con 0x7feca40cf8e0 2024-09-10T22:39:13.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7fec9a000640 1 -- 172.21.15.103:0/788327513 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec9c00a850 con 0x7feca40cf8e0 2024-09-10T22:39:13.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7fec9a000640 1 -- 172.21.15.103:0/788327513 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c00aca0 con 0x7feca40cf8e0 2024-09-10T22:39:13.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7fa751c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa74c0b31a0 0x7fa74c14d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7fa751c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74c153ef0 0x7fa74c14d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7fa751c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa74c15d5b0 0x7fa74c1ff480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7fa74be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa74c0b31a0 0x7fa74c14d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7fa74be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa74c0b31a0 0x7fa74c14d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:43064/0 (socket says 172.21.15.103:43064) 2024-09-10T22:39:13.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7fccf5400640 1 --2- 172.21.15.103:0/870006130 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x7fccd807bdb0 0x7fccd807e1f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f12a2a00640 1 -- 172.21.15.103:0/630105908 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f12a40ad440 con 0x7f12ac06cc00 2024-09-10T22:39:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f5fc2000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fbc099a00 0x7f5fbc156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f5fc2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fbc15dd40 0x7f5fbc15cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f5fc2000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fbc15e120 0x7f5fbc15d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f5fc2000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc16b350 con 0x7f5fbc15dd40 2024-09-10T22:39:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f5fc2000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc16b1d0 con 0x7f5fbc099a00 2024-09-10T22:39:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f5fc2000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5fbc16b4d0 con 0x7f5fbc15e120 2024-09-10T22:39:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f5fbbe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fbc15e120 0x7f5fbc15d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f5fbbe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fbc15e120 0x7f5fbc15d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:55048/0 (socket says 172.21.15.103:55048) 2024-09-10T22:39:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7f5fbbe00640 1 -- 172.21.15.103:0/2180808131 learned_addr learned my addr 172.21.15.103:0/2180808131 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:13.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f972e600640 1 -- 172.21.15.103:0/1543474022 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9728148260 msgr2=0x7f97281e7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f972e600640 1 --2- 172.21.15.103:0/1543474022 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9728148260 0x7f97281e7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f972e600640 1 -- 172.21.15.103:0/1543474022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97281e7fb0 msgr2=0x7f9728158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f972e600640 1 --2- 172.21.15.103:0/1543474022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97281e7fb0 0x7f9728158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f972e600640 1 -- 172.21.15.103:0/1543474022 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97281f4950 con 0x7f9728159370 2024-09-10T22:39:13.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca3200640 1 -- 172.21.15.103:0/788327513 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feca4144ae0 con 0x7feca40cf8e0 2024-09-10T22:39:13.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7feca3200640 1 -- 172.21.15.103:0/788327513 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feca41444b0 con 0x7feca40cf8e0 2024-09-10T22:39:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7fa74be00640 1 -- 172.21.15.103:0/725693369 learned_addr learned my addr 172.21.15.103:0/725693369 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7fa751c00640 1 -- 172.21.15.103:0/725693369 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c168ea0 con 0x7fa74c15d5b0 2024-09-10T22:39:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7fa751c00640 1 -- 172.21.15.103:0/725693369 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c168d20 con 0x7fa74c0b31a0 2024-09-10T22:39:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7fa751c00640 1 -- 172.21.15.103:0/725693369 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa74c169020 con 0x7fa74c153ef0 2024-09-10T22:39:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7fa74b400640 1 --2- 172.21.15.103:0/725693369 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74c153ef0 0x7fa74c14d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7fa751200640 1 --2- 172.21.15.103:0/725693369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa74c15d5b0 0x7fa74c1ff480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7fa74be00640 1 -- 172.21.15.103:0/725693369 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74c153ef0 msgr2=0x7fa74c14d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7fa74be00640 1 --2- 172.21.15.103:0/725693369 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74c153ef0 0x7fa74c14d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7fa74be00640 1 -- 172.21.15.103:0/725693369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa74c15d5b0 msgr2=0x7fa74c1ff480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7fa74be00640 1 --2- 172.21.15.103:0/725693369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa74c15d5b0 0x7fa74c1ff480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7fa74be00640 1 -- 172.21.15.103:0/725693369 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74c14dab0 con 0x7fa74c0b31a0 2024-09-10T22:39:13.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7fa751200640 1 --2- 172.21.15.103:0/725693369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa74c15d5b0 0x7fa74c1ff480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:39:13.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7fa74be00640 1 --2- 172.21.15.103:0/725693369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa74c0b31a0 0x7fa74c14d030 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa73c007810 tx=0x7fa73c007cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.263+0000 7fccf5e00640 1 --2- 172.21.15.103:0/870006130 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fccd8072630 0x7fccd8074af0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcce80af000 tx=0x7fcce8019650 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f5fbaa00640 1 --2- 172.21.15.103:0/2180808131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fbc15dd40 0x7f5fbc15cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f5fbbe00640 1 -- 172.21.15.103:0/2180808131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fbc099a00 msgr2=0x7f5fbc156cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T22:39:13.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f5fbbe00640 1 --2- 172.21.15.103:0/2180808131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fbc099a00 0x7f5fbc156cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f5fbbe00640 1 -- 172.21.15.103:0/2180808131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fbc15dd40 msgr2=0x7f5fbc15cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f5fbbe00640 1 --2- 172.21.15.103:0/2180808131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fbc15dd40 0x7f5fbc15cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f5fbbe00640 1 -- 172.21.15.103:0/2180808131 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fbc0aef50 con 0x7f5fbc15e120 2024-09-10T22:39:13.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7feca3200640 1 -- 172.21.15.103:0/788327513 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec7c001040 con 0x7feca40cf8e0 2024-09-10T22:39:13.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7fa743e00640 1 -- 172.21.15.103:0/725693369 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c017030 con 0x7fa74c0b31a0 2024-09-10T22:39:13.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7fa751c00640 1 -- 172.21.15.103:0/725693369 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74c151900 con 0x7fa74c0b31a0 2024-09-10T22:39:13.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f5fbbe00640 1 --2- 172.21.15.103:0/2180808131 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fbc15e120 0x7f5fbc15d310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00d660 tx=0x7f5fac00db20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7fa751c00640 1 -- 172.21.15.103:0/725693369 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa74c0aa0d0 con 0x7fa74c0b31a0 2024-09-10T22:39:13.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7fa743e00640 1 -- 172.21.15.103:0/725693369 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa73c004020 con 0x7fa74c0b31a0 2024-09-10T22:39:13.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7fa743e00640 1 -- 172.21.15.103:0/725693369 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c017030 con 0x7fa74c0b31a0 2024-09-10T22:39:13.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f09e3e00640 1 -- 172.21.15.103:0/213829605 <== osd.0 v2:172.21.15.103:6808/2662233365 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f09f006da60 con 0x7f09d007be30 2024-09-10T22:39:13.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f972e600640 1 --2- 172.21.15.103:0/1543474022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9728159370 0x7f97281f7e30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f97280aea90 tx=0x7f971c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f9725600640 1 -- 172.21.15.103:0/1543474022 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c014030 con 0x7f9728159370 2024-09-10T22:39:13.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7fa751c00640 1 -- 172.21.15.103:0/725693369 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa724001040 con 0x7fa74c0b31a0 2024-09-10T22:39:13.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f9725600640 1 -- 172.21.15.103:0/1543474022 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f971c0107a0 con 0x7f9728159370 2024-09-10T22:39:13.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f9725600640 1 -- 172.21.15.103:0/1543474022 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c010bf0 con 0x7f9728159370 2024-09-10T22:39:13.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7fccee000640 1 -- 172.21.15.103:0/870006130 <== osd.5 v2:172.21.15.131:6800/175724775 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fccf00091f0 con 0x7fccd807bdb0 2024-09-10T22:39:13.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f5fb3400640 1 -- 172.21.15.103:0/2180808131 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac017070 con 0x7f5fbc15e120 2024-09-10T22:39:13.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f5fb3400640 1 -- 172.21.15.103:0/2180808131 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fac005310 con 0x7f5fbc15e120 2024-09-10T22:39:13.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f5fb3400640 1 -- 172.21.15.103:0/2180808131 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac009820 con 0x7f5fbc15e120 2024-09-10T22:39:13.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f5fc2000640 1 -- 172.21.15.103:0/2180808131 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fbc204660 con 0x7f5fbc15e120 2024-09-10T22:39:13.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f5fc2000640 1 -- 172.21.15.103:0/2180808131 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fbc1564b0 con 0x7f5fbc15e120 2024-09-10T22:39:13.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f5fc2000640 1 -- 172.21.15.103:0/2180808131 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5fbc0cdc80 con 0x7f5fbc15e120 2024-09-10T22:39:13.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f12a2a00640 1 --2- 172.21.15.103:0/630105908 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f128c0726b0 0x7f128c074b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f12a2a00640 1 -- 172.21.15.103:0/630105908 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f12a4002020 con 0x7f12ac06cc00 2024-09-10T22:39:13.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f12a2a00640 1 --2- 172.21.15.103:0/630105908 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x7f128c07be30 0x7f128c07e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f12a2a00640 1 -- 172.21.15.103:0/630105908 --> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f12a40a5e00 con 0x7f128c07be30 2024-09-10T22:39:13.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.267+0000 7f12a2a00640 1 -- 172.21.15.103:0/630105908 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f12a4130320 con 0x7f12ac06cc00 2024-09-10T22:39:13.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7f972f000640 1 -- 172.21.15.103:0/1543474022 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97281f4c30 con 0x7f9728159370 2024-09-10T22:39:13.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7f972f000640 1 -- 172.21.15.103:0/1543474022 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97281f51f0 con 0x7f9728159370 2024-09-10T22:39:13.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7fa743e00640 1 -- 172.21.15.103:0/725693369 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa73c024060 con 0x7fa74c0b31a0 2024-09-10T22:39:13.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7f5fb3400640 1 -- 172.21.15.103:0/2180808131 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5fac0099c0 con 0x7f5fbc15e120 2024-09-10T22:39:13.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7f972f000640 1 -- 172.21.15.103:0/1543474022 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f972815f540 con 0x7f9728159370 2024-09-10T22:39:13.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7fec9a000640 1 -- 172.21.15.103:0/788327513 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fec9c022070 con 0x7feca40cf8e0 2024-09-10T22:39:13.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7fec9a000640 1 --2- 172.21.15.103:0/788327513 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fec84072610 0x7fec84074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7fec9a000640 1 -- 172.21.15.103:0/788327513 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fec9c0a4bc0 con 0x7feca40cf8e0 2024-09-10T22:39:13.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7fec9a000640 1 --2- 172.21.15.103:0/788327513 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x7fec8407bd90 0x7fec8407e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7fec9a000640 1 -- 172.21.15.103:0/788327513 --> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec9c033e70 con 0x7fec8407bd90 2024-09-10T22:39:13.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7fec9a000640 1 -- 172.21.15.103:0/788327513 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fec9c0a4fb0 con 0x7feca40cf8e0 2024-09-10T22:39:13.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7feca1e00640 1 --2- 172.21.15.103:0/788327513 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fec84072610 0x7fec84074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7f12aa000640 1 --2- 172.21.15.103:0/630105908 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f128c0726b0 0x7f128c074b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7fa743e00640 1 --2- 172.21.15.103:0/725693369 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa72c0727e0 0x7fa72c074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7feca2800640 1 --2- 172.21.15.103:0/788327513 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x7fec8407bd90 0x7fec8407e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7f5fb3400640 1 --2- 172.21.15.103:0/2180808131 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5f9c0726b0 0x7f5f9c074b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7fa743e00640 1 -- 172.21.15.103:0/725693369 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa73c0939c0 con 0x7fa74c0b31a0 2024-09-10T22:39:13.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7f5fb3400640 1 -- 172.21.15.103:0/2180808131 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5fac093b80 con 0x7f5fbc15e120 2024-09-10T22:39:13.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7fa74b400640 1 --2- 172.21.15.103:0/725693369 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa72c0727e0 0x7fa72c074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7fa743e00640 1 --2- 172.21.15.103:0/725693369 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x7fa72c07bee0 0x7fa72c07e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7f5fb3400640 1 --2- 172.21.15.103:0/2180808131 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x7f5f9c07be20 0x7f5f9c07e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7f5fbb400640 1 --2- 172.21.15.103:0/2180808131 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5f9c0726b0 0x7f5f9c074b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7f5fb3400640 1 -- 172.21.15.103:0/2180808131 --> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5fac022e70 con 0x7f5f9c07be20 2024-09-10T22:39:13.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7f5fb3400640 1 -- 172.21.15.103:0/2180808131 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5fac093f70 con 0x7f5fbc15e120 2024-09-10T22:39:13.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.275+0000 7fa743e00640 1 -- 172.21.15.103:0/725693369 --> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa73c01de70 con 0x7fa72c07bee0 2024-09-10T22:39:13.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.275+0000 7fa743e00640 1 -- 172.21.15.103:0/725693369 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa73c093db0 con 0x7fa74c0b31a0 2024-09-10T22:39:13.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.275+0000 7fa74b400640 1 --2- 172.21.15.103:0/725693369 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa72c0727e0 0x7fa72c074ca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa74c15c960 tx=0x7fa738009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7f12ab400640 1 --2- 172.21.15.103:0/630105908 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x7f128c07be30 0x7f128c07e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.271+0000 7f12aa000640 1 --2- 172.21.15.103:0/630105908 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f128c0726b0 0x7f128c074b70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f12ac1f5b10 tx=0x7f129c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.275+0000 7fa751200640 1 --2- 172.21.15.103:0/725693369 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x7fa72c07bee0 0x7fa72c07e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.275+0000 7feca1e00640 1 --2- 172.21.15.103:0/788327513 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fec84072610 0x7fec84074ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fec900b2000 tx=0x7fec9001d890 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.275+0000 7f5fbaa00640 1 --2- 172.21.15.103:0/2180808131 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x7f5f9c07be20 0x7f5f9c07e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.275+0000 7f12ab400640 1 --2- 172.21.15.103:0/630105908 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x7f128c07be30 0x7f128c07e270 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.275+0000 7fa751200640 1 --2- 172.21.15.103:0/725693369 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x7fa72c07bee0 0x7fa72c07e320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.275+0000 7feca2800640 1 --2- 172.21.15.103:0/788327513 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x7fec8407bd90 0x7fec8407e1d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.275+0000 7f5fbb400640 1 --2- 172.21.15.103:0/2180808131 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5f9c0726b0 0x7f5f9c074b70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4002050 tx=0x7f5fb40016a0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.275+0000 7f5fbaa00640 1 --2- 172.21.15.103:0/2180808131 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x7f5f9c07be20 0x7f5f9c07e260 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.275+0000 7f9725600640 1 -- 172.21.15.103:0/1543474022 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f971c00f3c0 con 0x7f9728159370 2024-09-10T22:39:13.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.275+0000 7f12a2a00640 1 -- 172.21.15.103:0/630105908 <== osd.6 v2:172.21.15.131:6818/3165743337 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f12a40a5e00 con 0x7f128c07be30 2024-09-10T22:39:13.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.275+0000 7fa743e00640 1 -- 172.21.15.103:0/725693369 <== osd.4 v2:172.21.15.131:6810/2178799193 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa73c01de70 con 0x7fa72c07bee0 2024-09-10T22:39:13.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.275+0000 7f5fb3400640 1 -- 172.21.15.103:0/2180808131 <== osd.7 v2:172.21.15.131:6826/1279722082 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5fac022e70 con 0x7f5f9c07be20 2024-09-10T22:39:13.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.275+0000 7fec9a000640 1 -- 172.21.15.103:0/788327513 <== osd.3 v2:172.21.15.103:6824/3403069661 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec9c033e70 con 0x7fec8407bd90 2024-09-10T22:39:13.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.279+0000 7f9725600640 1 --2- 172.21.15.103:0/1543474022 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9708072610 0x7f9708074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.279+0000 7f9725600640 1 -- 172.21.15.103:0/1543474022 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f971c0934a0 con 0x7f9728159370 2024-09-10T22:39:13.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.279+0000 7f9725600640 1 --2- 172.21.15.103:0/1543474022 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x7f970807bd10 0x7f970807e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.279+0000 7f9725600640 1 -- 172.21.15.103:0/1543474022 --> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f971c00cea0 con 0x7f970807bd10 2024-09-10T22:39:13.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.279+0000 7f9725600640 1 -- 172.21.15.103:0/1543474022 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f971c09a050 con 0x7f9728159370 2024-09-10T22:39:13.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.279+0000 7f972dc00640 1 --2- 172.21.15.103:0/1543474022 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9708072610 0x7f9708074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.279+0000 7f972dc00640 1 --2- 172.21.15.103:0/1543474022 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9708072610 0x7f9708074ad0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f97200049e0 tx=0x7f9720009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.283+0000 7f972d200640 1 --2- 172.21.15.103:0/1543474022 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x7f970807bd10 0x7f970807e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.283+0000 7f972d200640 1 --2- 172.21.15.103:0/1543474022 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x7f970807bd10 0x7f970807e150 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.283+0000 7f9725600640 1 -- 172.21.15.103:0/1543474022 <== osd.1 v2:172.21.15.103:6800/4140822734 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f971c00cea0 con 0x7f970807bd10 2024-09-10T22:39:13.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.291+0000 7f9dd9a00640 1 -- 172.21.15.103:0/2832967104 --> [v2:172.21.15.103:6816/3190036446,v1:172.21.15.103:6817/3190036446] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9dd41f9770 con 0x7f9db407bda0 2024-09-10T22:39:13.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.291+0000 7f9dcbe00640 1 -- 172.21.15.103:0/2832967104 <== osd.2 v2:172.21.15.103:6816/3190036446 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9dd41f9770 con 0x7f9db407bda0 2024-09-10T22:39:13.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.291+0000 7f9dd9a00640 1 -- 172.21.15.103:0/2832967104 >> [v2:172.21.15.103:6816/3190036446,v1:172.21.15.103:6817/3190036446] conn(0x7f9db407bda0 msgr2=0x7f9db407e1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.291+0000 7f9dd9a00640 1 --2- 172.21.15.103:0/2832967104 >> [v2:172.21.15.103:6816/3190036446,v1:172.21.15.103:6817/3190036446] conn(0x7f9db407bda0 0x7f9db407e1e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.291+0000 7f9dd9a00640 1 -- 172.21.15.103:0/2832967104 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9db4072630 msgr2=0x7f9db4074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.291+0000 7f9dd9a00640 1 --2- 172.21.15.103:0/2832967104 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9db4072630 0x7f9db4074af0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9dc001ad60 tx=0x7f9dc001aef0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.291+0000 7f9dd9a00640 1 -- 172.21.15.103:0/2832967104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9dd40b5780 msgr2=0x7f9dd4160880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.291+0000 7f9dd9a00640 1 --2- 172.21.15.103:0/2832967104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9dd40b5780 0x7f9dd4160880 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00fc50 tx=0x7f9dcc00d430 comp rx=0 tx=0).stop 2024-09-10T22:39:13.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.291+0000 7f9dd9000640 1 -- 172.21.15.103:0/2832967104 reap_dead start 2024-09-10T22:39:13.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.291+0000 7f9dd9a00640 1 -- 172.21.15.103:0/2832967104 shutdown_connections 2024-09-10T22:39:13.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.291+0000 7f9dd9a00640 1 -- 172.21.15.103:0/2832967104 >> 172.21.15.103:0/2832967104 conn(0x7f9dd406dd10 msgr2=0x7f9dd415b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.295+0000 7f9dd9a00640 1 -- 172.21.15.103:0/2832967104 shutdown_connections 2024-09-10T22:39:13.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.295+0000 7f9dd9a00640 1 -- 172.21.15.103:0/2832967104 wait complete. 2024-09-10T22:39:13.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.299+0000 7fccfd200640 1 -- 172.21.15.103:0/870006130 --> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fccf80cf690 con 0x7fccd807bdb0 2024-09-10T22:39:13.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.299+0000 7f09f5600640 1 -- 172.21.15.103:0/213829605 --> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f09cc002de0 con 0x7f09d007be30 2024-09-10T22:39:13.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.299+0000 7fccee000640 1 -- 172.21.15.103:0/870006130 <== osd.5 v2:172.21.15.131:6800/175724775 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fccf80cf690 con 0x7fccd807bdb0 2024-09-10T22:39:13.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f09e3e00640 1 -- 172.21.15.103:0/213829605 <== osd.0 v2:172.21.15.103:6808/2662233365 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f09cc002de0 con 0x7f09d007be30 2024-09-10T22:39:13.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7fccfd200640 1 -- 172.21.15.103:0/870006130 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x7fccd807bdb0 msgr2=0x7fccd807e1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7fccfd200640 1 --2- 172.21.15.103:0/870006130 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x7fccd807bdb0 0x7fccd807e1f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f09f5600640 1 -- 172.21.15.103:0/213829605 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x7f09d007be30 msgr2=0x7f09d007e270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f09f5600640 1 --2- 172.21.15.103:0/213829605 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x7f09d007be30 0x7f09d007e270 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f1297e00640 1 -- 172.21.15.103:0/630105908 --> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f12ac0ce7f0 con 0x7f128c07be30 2024-09-10T22:39:13.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7fccfd200640 1 -- 172.21.15.103:0/870006130 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fccd8072630 msgr2=0x7fccd8074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7fccfd200640 1 --2- 172.21.15.103:0/870006130 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fccd8072630 0x7fccd8074af0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcce80af000 tx=0x7fcce8019650 comp rx=0 tx=0).stop 2024-09-10T22:39:13.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7fccfd200640 1 -- 172.21.15.103:0/870006130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccf8154b20 msgr2=0x7fccf81ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7fccfd200640 1 --2- 172.21.15.103:0/870006130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccf8154b20 0x7fccf81ff140 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fccf000ba10 tx=0x7fccf000bed0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f09f5600640 1 -- 172.21.15.103:0/213829605 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f09d00726b0 msgr2=0x7f09d0074b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f09f5600640 1 --2- 172.21.15.103:0/213829605 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f09d00726b0 0x7f09d0074b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f09e4001250 tx=0x7f09e4009040 comp rx=0 tx=0).stop 2024-09-10T22:39:13.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f09f5600640 1 -- 172.21.15.103:0/213829605 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09e8051c90 msgr2=0x7f09e804ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f09f5600640 1 --2- 172.21.15.103:0/213829605 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09e8051c90 0x7f09e804ba50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f09f006be20 tx=0x7f09f0064620 comp rx=0 tx=0).stop 2024-09-10T22:39:13.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f09f4c00640 1 -- 172.21.15.103:0/213829605 reap_dead start 2024-09-10T22:39:13.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f12a2a00640 1 -- 172.21.15.103:0/630105908 <== osd.6 v2:172.21.15.131:6818/3165743337 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f12ac0ce7f0 con 0x7f128c07be30 2024-09-10T22:39:13.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7fa751c00640 1 -- 172.21.15.103:0/725693369 --> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa724002de0 con 0x7fa72c07bee0 2024-09-10T22:39:13.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7fccf6800640 1 -- 172.21.15.103:0/870006130 reap_dead start 2024-09-10T22:39:13.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7fccfd200640 1 -- 172.21.15.103:0/870006130 shutdown_connections 2024-09-10T22:39:13.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7fccfd200640 1 -- 172.21.15.103:0/870006130 >> 172.21.15.103:0/870006130 conn(0x7fccf80b1a90 msgr2=0x7fccf815d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f09f5600640 1 -- 172.21.15.103:0/213829605 shutdown_connections 2024-09-10T22:39:13.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f09f5600640 1 -- 172.21.15.103:0/213829605 >> 172.21.15.103:0/213829605 conn(0x7f09e801e8d0 msgr2=0x7f09e800c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f09f5600640 1 -- 172.21.15.103:0/213829605 shutdown_connections 2024-09-10T22:39:13.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f09f5600640 1 -- 172.21.15.103:0/213829605 wait complete. 2024-09-10T22:39:13.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7fccfd200640 1 -- 172.21.15.103:0/870006130 shutdown_connections 2024-09-10T22:39:13.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f1297e00640 1 -- 172.21.15.103:0/630105908 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x7f128c07be30 msgr2=0x7f128c07e270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f1297e00640 1 --2- 172.21.15.103:0/630105908 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x7f128c07be30 0x7f128c07e270 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7fccfd200640 1 -- 172.21.15.103:0/870006130 wait complete. 2024-09-10T22:39:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f1297e00640 1 -- 172.21.15.103:0/630105908 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f128c0726b0 msgr2=0x7f128c074b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f1297e00640 1 --2- 172.21.15.103:0/630105908 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f128c0726b0 0x7f128c074b70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f12ac1f5b10 tx=0x7f129c008040 comp rx=0 tx=0).stop 2024-09-10T22:39:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f1297e00640 1 -- 172.21.15.103:0/630105908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12ac06cc00 msgr2=0x7f12ac15f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.303+0000 7f1297e00640 1 --2- 172.21.15.103:0/630105908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12ac06cc00 0x7f12ac15f300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12a4000f90 tx=0x7f12a4003f80 comp rx=0 tx=0).stop 2024-09-10T22:39:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7f12ab400640 1 -- 172.21.15.103:0/630105908 reap_dead start 2024-09-10T22:39:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7feca3200640 1 -- 172.21.15.103:0/788327513 --> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fec7c002de0 con 0x7fec8407bd90 2024-09-10T22:39:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7fa743e00640 1 -- 172.21.15.103:0/725693369 <== osd.4 v2:172.21.15.131:6810/2178799193 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa724002de0 con 0x7fa72c07bee0 2024-09-10T22:39:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7f1297e00640 1 -- 172.21.15.103:0/630105908 shutdown_connections 2024-09-10T22:39:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7f1297e00640 1 -- 172.21.15.103:0/630105908 >> 172.21.15.103:0/630105908 conn(0x7f12ac0cd3c0 msgr2=0x7f12ac159bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7fa751c00640 1 -- 172.21.15.103:0/725693369 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x7fa72c07bee0 msgr2=0x7fa72c07e320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7fa751c00640 1 --2- 172.21.15.103:0/725693369 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x7fa72c07bee0 0x7fa72c07e320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7f1297e00640 1 -- 172.21.15.103:0/630105908 shutdown_connections 2024-09-10T22:39:13.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7f1297e00640 1 -- 172.21.15.103:0/630105908 wait complete. 2024-09-10T22:39:13.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7fec9a000640 1 -- 172.21.15.103:0/788327513 <== osd.3 v2:172.21.15.103:6824/3403069661 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fec7c002de0 con 0x7fec8407bd90 2024-09-10T22:39:13.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7fa751c00640 1 -- 172.21.15.103:0/725693369 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa72c0727e0 msgr2=0x7fa72c074ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7fa751c00640 1 --2- 172.21.15.103:0/725693369 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa72c0727e0 0x7fa72c074ca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa74c15c960 tx=0x7fa738009040 comp rx=0 tx=0).stop 2024-09-10T22:39:13.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7fa751c00640 1 -- 172.21.15.103:0/725693369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa74c0b31a0 msgr2=0x7fa74c14d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7fa751c00640 1 --2- 172.21.15.103:0/725693369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa74c0b31a0 0x7fa74c14d030 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa73c007810 tx=0x7fa73c007cd0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7fa751200640 1 -- 172.21.15.103:0/725693369 reap_dead start 2024-09-10T22:39:13.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7fa751c00640 1 -- 172.21.15.103:0/725693369 shutdown_connections 2024-09-10T22:39:13.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7fa751c00640 1 -- 172.21.15.103:0/725693369 >> 172.21.15.103:0/725693369 conn(0x7fa74c0b1490 msgr2=0x7fa74c14dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7fa751c00640 1 -- 172.21.15.103:0/725693369 shutdown_connections 2024-09-10T22:39:13.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7fa751c00640 1 -- 172.21.15.103:0/725693369 wait complete. 2024-09-10T22:39:13.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7feca3200640 1 -- 172.21.15.103:0/788327513 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x7fec8407bd90 msgr2=0x7fec8407e1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7feca3200640 1 --2- 172.21.15.103:0/788327513 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x7fec8407bd90 0x7fec8407e1d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7feca3200640 1 -- 172.21.15.103:0/788327513 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fec84072610 msgr2=0x7fec84074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.307+0000 7feca3200640 1 --2- 172.21.15.103:0/788327513 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fec84072610 0x7fec84074ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fec900b2000 tx=0x7fec9001d890 comp rx=0 tx=0).stop 2024-09-10T22:39:13.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.311+0000 7feca3200640 1 -- 172.21.15.103:0/788327513 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feca40cf8e0 msgr2=0x7feca413f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.311+0000 7feca3200640 1 --2- 172.21.15.103:0/788327513 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feca40cf8e0 0x7feca413f970 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00c7c0 tx=0x7fec9c00cc80 comp rx=0 tx=0).stop 2024-09-10T22:39:13.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.311+0000 7feca2800640 1 -- 172.21.15.103:0/788327513 reap_dead start 2024-09-10T22:39:13.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.311+0000 7feca3200640 1 -- 172.21.15.103:0/788327513 shutdown_connections 2024-09-10T22:39:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.311+0000 7feca3200640 1 -- 172.21.15.103:0/788327513 >> 172.21.15.103:0/788327513 conn(0x7feca40b21e0 msgr2=0x7feca40cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.311+0000 7f5fc2000640 1 -- 172.21.15.103:0/2180808131 --> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5fbc06f0f0 con 0x7f5f9c07be20 2024-09-10T22:39:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.311+0000 7f5fb3400640 1 -- 172.21.15.103:0/2180808131 <== osd.7 v2:172.21.15.131:6826/1279722082 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5fbc06f0f0 con 0x7f5f9c07be20 2024-09-10T22:39:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.311+0000 7f972f000640 1 -- 172.21.15.103:0/1543474022 --> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f972806e5f0 con 0x7f970807bd10 2024-09-10T22:39:13.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.311+0000 7f9725600640 1 -- 172.21.15.103:0/1543474022 <== osd.1 v2:172.21.15.103:6800/4140822734 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f972806e5f0 con 0x7f970807bd10 2024-09-10T22:39:13.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.311+0000 7f972f000640 1 -- 172.21.15.103:0/1543474022 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x7f970807bd10 msgr2=0x7f970807e150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.311+0000 7f972f000640 1 --2- 172.21.15.103:0/1543474022 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x7f970807bd10 0x7f970807e150 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.315+0000 7f5fc2000640 1 -- 172.21.15.103:0/2180808131 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x7f5f9c07be20 msgr2=0x7f5f9c07e260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.315+0000 7f5fc2000640 1 --2- 172.21.15.103:0/2180808131 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x7f5f9c07be20 0x7f5f9c07e260 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.315+0000 7f972f000640 1 -- 172.21.15.103:0/1543474022 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9708072610 msgr2=0x7f9708074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.315+0000 7f972f000640 1 --2- 172.21.15.103:0/1543474022 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9708072610 0x7f9708074ad0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f97200049e0 tx=0x7f9720009500 comp rx=0 tx=0).stop 2024-09-10T22:39:13.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.315+0000 7f972f000640 1 -- 172.21.15.103:0/1543474022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9728159370 msgr2=0x7f97281f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.315+0000 7f972f000640 1 --2- 172.21.15.103:0/1543474022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9728159370 0x7f97281f7e30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f97280aea90 tx=0x7f971c00b8e0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.315+0000 7f972e600640 1 -- 172.21.15.103:0/1543474022 reap_dead start 2024-09-10T22:39:13.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.315+0000 7feca3200640 1 -- 172.21.15.103:0/788327513 shutdown_connections 2024-09-10T22:39:13.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.315+0000 7feca3200640 1 -- 172.21.15.103:0/788327513 wait complete. 2024-09-10T22:39:13.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.315+0000 7f5fc2000640 1 -- 172.21.15.103:0/2180808131 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5f9c0726b0 msgr2=0x7f5f9c074b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.315+0000 7f5fc2000640 1 --2- 172.21.15.103:0/2180808131 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5f9c0726b0 0x7f5f9c074b70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4002050 tx=0x7f5fb40016a0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.315+0000 7f5fc2000640 1 -- 172.21.15.103:0/2180808131 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fbc15e120 msgr2=0x7f5fbc15d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.315+0000 7f5fc2000640 1 --2- 172.21.15.103:0/2180808131 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5fbc15e120 0x7f5fbc15d310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00d660 tx=0x7f5fac00db20 comp rx=0 tx=0).stop 2024-09-10T22:39:13.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.315+0000 7f5fbbe00640 1 -- 172.21.15.103:0/2180808131 reap_dead start 2024-09-10T22:39:13.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.315+0000 7f5fc2000640 1 -- 172.21.15.103:0/2180808131 shutdown_connections 2024-09-10T22:39:13.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.315+0000 7f5fc2000640 1 -- 172.21.15.103:0/2180808131 >> 172.21.15.103:0/2180808131 conn(0x7f5fbc0b1d00 msgr2=0x7f5fbc098160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.315+0000 7f972f000640 1 -- 172.21.15.103:0/1543474022 shutdown_connections 2024-09-10T22:39:13.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.315+0000 7f972f000640 1 -- 172.21.15.103:0/1543474022 >> 172.21.15.103:0/1543474022 conn(0x7f972806cc00 msgr2=0x7f972815bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.319+0000 7f972f000640 1 -- 172.21.15.103:0/1543474022 shutdown_connections 2024-09-10T22:39:13.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.319+0000 7f5fc2000640 1 -- 172.21.15.103:0/2180808131 shutdown_connections 2024-09-10T22:39:13.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.319+0000 7f5fc2000640 1 -- 172.21.15.103:0/2180808131 wait complete. 2024-09-10T22:39:13.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.319+0000 7f972f000640 1 -- 172.21.15.103:0/1543474022 wait complete. 2024-09-10T22:39:13.332 INFO:teuthology.orchestra.run.smithi103.stdout:64424509449 2024-09-10T22:39:13.332 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T22:39:13.349 INFO:teuthology.orchestra.run.smithi103.stdout:64424509449 2024-09-10T22:39:13.350 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T22:39:13.350 INFO:teuthology.orchestra.run.smithi103.stdout:64424509450 2024-09-10T22:39:13.351 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T22:39:13.356 INFO:teuthology.orchestra.run.smithi103.stdout:64424509449 2024-09-10T22:39:13.356 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T22:39:13.357 INFO:teuthology.orchestra.run.smithi103.stdout:64424509449 2024-09-10T22:39:13.357 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T22:39:13.361 INFO:teuthology.orchestra.run.smithi103.stdout:55834574857 2024-09-10T22:39:13.362 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T22:39:13.366 INFO:teuthology.orchestra.run.smithi103.stdout:64424509449 2024-09-10T22:39:13.366 INFO:teuthology.orchestra.run.smithi103.stdout:64424509449 2024-09-10T22:39:13.367 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T22:39:13.367 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T22:39:13.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.583+0000 7f15cae00640 1 -- 172.21.15.103:0/2605862530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a80052f0 msgr2=0x7f15a800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.583+0000 7f15cae00640 1 --2- 172.21.15.103:0/2605862530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a80052f0 0x7f15a800b9d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00afd0 tx=0x7f15bc020cb0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.583+0000 7f15cae00640 1 -- 172.21.15.103:0/2605862530 shutdown_connections 2024-09-10T22:39:13.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.583+0000 7f15cae00640 1 --2- 172.21.15.103:0/2605862530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a80052f0 0x7f15a800b9d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.583+0000 7f15cae00640 1 -- 172.21.15.103:0/2605862530 >> 172.21.15.103:0/2605862530 conn(0x7f15c406d200 msgr2=0x7f15c40b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.583+0000 7f15cae00640 1 -- 172.21.15.103:0/2605862530 shutdown_connections 2024-09-10T22:39:13.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.583+0000 7f15cae00640 1 -- 172.21.15.103:0/2605862530 wait complete. 2024-09-10T22:39:13.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15cae00640 1 Processor -- start 2024-09-10T22:39:13.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15cae00640 1 -- start start 2024-09-10T22:39:13.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15cae00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15a80052f0 0x7f15c40a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15cae00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15c4141f90 0x7f15c413ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15cae00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15c415c7b0 0x7f15c415cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15cae00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f15c40b2b40 con 0x7f15c415c7b0 2024-09-10T22:39:13.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15cae00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f15c40b29c0 con 0x7f15c4141f90 2024-09-10T22:39:13.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15cae00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f15c40b1c80 con 0x7f15a80052f0 2024-09-10T22:39:13.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15c8e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15c415c7b0 0x7f15c415cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15c8e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15c415c7b0 0x7f15c415cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49376/0 (socket says 172.21.15.103:49376) 2024-09-10T22:39:13.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15c8e00640 1 -- 172.21.15.103:0/3337604388 learned_addr learned my addr 172.21.15.103:0/3337604388 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:13.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15c3e00640 1 --2- 172.21.15.103:0/3337604388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15a80052f0 0x7f15c40a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7fa873e00640 1 -- 172.21.15.103:0/3884796960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8740cf1e0 msgr2=0x7fa87415db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7fa873e00640 1 --2- 172.21.15.103:0/3884796960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8740cf1e0 0x7fa87415db90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa860009900 tx=0x7fa86001c840 comp rx=0 tx=0).stop 2024-09-10T22:39:13.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15c3400640 1 --2- 172.21.15.103:0/3337604388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15c4141f90 0x7f15c413ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7fa873e00640 1 -- 172.21.15.103:0/3884796960 shutdown_connections 2024-09-10T22:39:13.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7fa873e00640 1 --2- 172.21.15.103:0/3884796960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8740cf1e0 0x7fa87415db90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7fa873e00640 1 --2- 172.21.15.103:0/3884796960 >> v2:172.21.15.131:3300/0 conn(0x7fa8740ccb80 0x7fa8740b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7fa873e00640 1 -- 172.21.15.103:0/3884796960 >> 172.21.15.103:0/3884796960 conn(0x7fa87406d3f0 msgr2=0x7fa8740b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15c8e00640 1 -- 172.21.15.103:0/3337604388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15a80052f0 msgr2=0x7f15c40a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15c8e00640 1 --2- 172.21.15.103:0/3337604388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15a80052f0 0x7f15c40a9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15c8e00640 1 -- 172.21.15.103:0/3337604388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15c4141f90 msgr2=0x7f15c413ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15c8e00640 1 --2- 172.21.15.103:0/3337604388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15c4141f90 0x7f15c413ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15c8e00640 1 -- 172.21.15.103:0/3337604388 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c4150a50 con 0x7f15c415c7b0 2024-09-10T22:39:13.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.587+0000 7f15c8e00640 1 --2- 172.21.15.103:0/3337604388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15c415c7b0 0x7f15c415cc30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00ac90 tx=0x7f15bc005530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.591+0000 7fa873e00640 1 -- 172.21.15.103:0/3884796960 shutdown_connections 2024-09-10T22:39:13.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.591+0000 7fa873e00640 1 -- 172.21.15.103:0/3884796960 wait complete. 2024-09-10T22:39:13.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.591+0000 7f15bbe00640 1 -- 172.21.15.103:0/3337604388 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc0af040 con 0x7f15c415c7b0 2024-09-10T22:39:13.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.591+0000 7f15cae00640 1 -- 172.21.15.103:0/3337604388 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c4150490 con 0x7f15c415c7b0 2024-09-10T22:39:13.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.591+0000 7f15cae00640 1 -- 172.21.15.103:0/3337604388 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c413f590 con 0x7f15c415c7b0 2024-09-10T22:39:13.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.591+0000 7f15bbe00640 1 -- 172.21.15.103:0/3337604388 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15bc0071c0 con 0x7f15c415c7b0 2024-09-10T22:39:13.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.591+0000 7fa873e00640 1 Processor -- start 2024-09-10T22:39:13.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.591+0000 7f15bbe00640 1 -- 172.21.15.103:0/3337604388 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc0af040 con 0x7f15c415c7b0 2024-09-10T22:39:13.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.591+0000 7fa873e00640 1 -- start start 2024-09-10T22:39:13.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.591+0000 7f15cae00640 1 -- 172.21.15.103:0/3337604388 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f159c0052a0 con 0x7f15c415c7b0 2024-09-10T22:39:13.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.595+0000 7f15bbe00640 1 -- 172.21.15.103:0/3337604388 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f15bc0c6060 con 0x7f15c415c7b0 2024-09-10T22:39:13.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.595+0000 7fa873e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8740ccb80 0x7fa8741fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.595+0000 7fa873e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8740cf620 0x7fa87414bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.595+0000 7fa873e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8741ff370 0x7fa8741ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.595+0000 7fa873e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa874166c50 con 0x7fa8741ff370 2024-09-10T22:39:13.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.595+0000 7fa873e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa874166ad0 con 0x7fa8740cf620 2024-09-10T22:39:13.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.595+0000 7fa873e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa874166dd0 con 0x7fa8740ccb80 2024-09-10T22:39:13.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.595+0000 7fa872000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8740cf620 0x7fa87414bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.595+0000 7fa873400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8741ff370 0x7fa8741ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.595+0000 7fa873400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8741ff370 0x7fa8741ff820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49386/0 (socket says 172.21.15.103:49386) 2024-09-10T22:39:13.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.595+0000 7fa873400640 1 -- 172.21.15.103:0/716933891 learned_addr learned my addr 172.21.15.103:0/716933891 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:13.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.599+0000 7fa872a00640 1 --2- 172.21.15.103:0/716933891 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8740ccb80 0x7fa8741fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.599+0000 7f15bbe00640 1 --2- 172.21.15.103:0/3337604388 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f15a4072a10 0x7f15a4074ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.599+0000 7f15c3e00640 1 --2- 172.21.15.103:0/3337604388 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f15a4072a10 0x7f15a4074ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.599+0000 7f15bbe00640 1 -- 172.21.15.103:0/3337604388 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f15bc0ba070 con 0x7f15c415c7b0 2024-09-10T22:39:13.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.599+0000 7fa872a00640 1 -- 172.21.15.103:0/716933891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8740cf620 msgr2=0x7fa87414bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.599+0000 7fa872a00640 1 --2- 172.21.15.103:0/716933891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8740cf620 0x7fa87414bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.599+0000 7fa872a00640 1 -- 172.21.15.103:0/716933891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8741ff370 msgr2=0x7fa8741ff820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.599+0000 7fa872a00640 1 --2- 172.21.15.103:0/716933891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8741ff370 0x7fa8741ff820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.599+0000 7fa872a00640 1 -- 172.21.15.103:0/716933891 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa874153510 con 0x7fa8740ccb80 2024-09-10T22:39:13.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.599+0000 7fa872a00640 1 --2- 172.21.15.103:0/716933891 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8740ccb80 0x7fa8741fff30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa864009800 tx=0x7fa864009cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.599+0000 7fa86b400640 1 -- 172.21.15.103:0/716933891 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa864018020 con 0x7fa8740ccb80 2024-09-10T22:39:13.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.599+0000 7fa86b400640 1 -- 172.21.15.103:0/716933891 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa86400e9a0 con 0x7fa8740ccb80 2024-09-10T22:39:13.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.599+0000 7fa86b400640 1 -- 172.21.15.103:0/716933891 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86400edd0 con 0x7fa8740ccb80 2024-09-10T22:39:13.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.599+0000 7fa873e00640 1 -- 172.21.15.103:0/716933891 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8741537b0 con 0x7fa8740ccb80 2024-09-10T22:39:13.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.599+0000 7fa873e00640 1 -- 172.21.15.103:0/716933891 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa874153d70 con 0x7fa8740ccb80 2024-09-10T22:39:13.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.603+0000 7f15c3e00640 1 --2- 172.21.15.103:0/3337604388 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f15a4072a10 0x7f15a4074ed0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f15b0007fd0 tx=0x7f15b0007dc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.603+0000 7fa873e00640 1 -- 172.21.15.103:0/716933891 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa87415db90 con 0x7fa8740ccb80 2024-09-10T22:39:13.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.603+0000 7fa86b400640 1 -- 172.21.15.103:0/716933891 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa864014410 con 0x7fa8740ccb80 2024-09-10T22:39:13.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7fa86b400640 1 --2- 172.21.15.103:0/716933891 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa8540725e0 0x7fa854074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7fa86b400640 1 -- 172.21.15.103:0/716933891 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa864093dd0 con 0x7fa8740ccb80 2024-09-10T22:39:13.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7f3d0f200640 1 -- 172.21.15.103:0/3656683014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d10073fe0 msgr2=0x7f3d100b31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7f3d0f200640 1 --2- 172.21.15.103:0/3656683014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d10073fe0 0x7f3d100b31a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3d100716a0 tx=0x7f3cfc01c8c0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7f3d0f200640 1 -- 172.21.15.103:0/3656683014 shutdown_connections 2024-09-10T22:39:13.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7f3d0f200640 1 --2- 172.21.15.103:0/3656683014 >> v2:172.21.15.103:3300/0 conn(0x7f3d10070410 0x7f3d100b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7f3d0f200640 1 --2- 172.21.15.103:0/3656683014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d10073fe0 0x7f3d100b31a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7f3d0f200640 1 -- 172.21.15.103:0/3656683014 >> 172.21.15.103:0/3656683014 conn(0x7f3d100b1490 msgr2=0x7f3d100b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7f3d0f200640 1 -- 172.21.15.103:0/3656683014 shutdown_connections 2024-09-10T22:39:13.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7f3d0f200640 1 -- 172.21.15.103:0/3656683014 wait complete. 2024-09-10T22:39:13.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7f244b000640 1 -- 172.21.15.103:0/3602099803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2444165920 msgr2=0x7f2444165d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7f244b000640 1 --2- 172.21.15.103:0/3602099803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2444165920 0x7f2444165d50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2430009900 tx=0x7f243001c8a0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7fa872000640 1 --2- 172.21.15.103:0/716933891 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa8540725e0 0x7fa854074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7fa872000640 1 --2- 172.21.15.103:0/716933891 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa8540725e0 0x7fa854074aa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa8600af000 tx=0x7fa86001b080 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7f15bbe00640 1 -- 172.21.15.103:0/3337604388 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f15bc01a9c0 con 0x7f15c415c7b0 2024-09-10T22:39:13.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7f3d0f200640 1 Processor -- start 2024-09-10T22:39:13.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7f244b000640 1 -- 172.21.15.103:0/3602099803 shutdown_connections 2024-09-10T22:39:13.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7f244b000640 1 --2- 172.21.15.103:0/3602099803 >> v2:172.21.15.103:3300/0 conn(0x7f244409c900 0x7f244409cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7f244b000640 1 --2- 172.21.15.103:0/3602099803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2444165920 0x7f2444165d50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7f244b000640 1 -- 172.21.15.103:0/3602099803 >> 172.21.15.103:0/3602099803 conn(0x7f24440b5540 msgr2=0x7f24440b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7f244b000640 1 -- 172.21.15.103:0/3602099803 shutdown_connections 2024-09-10T22:39:13.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.607+0000 7f244b000640 1 -- 172.21.15.103:0/3602099803 wait complete. 2024-09-10T22:39:13.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f3d0f200640 1 -- start start 2024-09-10T22:39:13.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7fa86b400640 1 -- 172.21.15.103:0/716933891 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa864022020 con 0x7fa8740ccb80 2024-09-10T22:39:13.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f73f4c00640 1 -- 172.21.15.103:0/2002800726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73f00cfb80 msgr2=0x7f73f006e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f73f4c00640 1 --2- 172.21.15.103:0/2002800726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73f00cfb80 0x7f73f006e380 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f73f00d01e0 tx=0x7f73e001c4c0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f73f4c00640 1 -- 172.21.15.103:0/2002800726 shutdown_connections 2024-09-10T22:39:13.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f73f4c00640 1 --2- 172.21.15.103:0/2002800726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73f00cfb80 0x7f73f006e380 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f73f4c00640 1 --2- 172.21.15.103:0/2002800726 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73f015d490 0x7f73f00cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f73f4c00640 1 --2- 172.21.15.103:0/2002800726 >> v2:172.21.15.103:3300/0 conn(0x7f73f01433c0 0x7f73f00b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f73f4c00640 1 -- 172.21.15.103:0/2002800726 >> 172.21.15.103:0/2002800726 conn(0x7f73f006cc00 msgr2=0x7f73f006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f73f4c00640 1 -- 172.21.15.103:0/2002800726 shutdown_connections 2024-09-10T22:39:13.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f3d0f200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d10070410 0x7f3d100a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f3d0f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d10073fe0 0x7f3d10150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f3d0f200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d10153ef0 0x7f3d10150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f3d0f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3d10168f00 con 0x7f3d10073fe0 2024-09-10T22:39:13.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f3d0f200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3d10168d80 con 0x7f3d10153ef0 2024-09-10T22:39:13.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f3d0f200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3d10169080 con 0x7f3d10070410 2024-09-10T22:39:13.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f244b000640 1 Processor -- start 2024-09-10T22:39:13.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f73f4c00640 1 -- 172.21.15.103:0/2002800726 wait complete. 2024-09-10T22:39:13.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f3d0d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d10073fe0 0x7f3d10150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f3d0d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d10073fe0 0x7f3d10150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49416/0 (socket says 172.21.15.103:49416) 2024-09-10T22:39:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f3d0d400640 1 -- 172.21.15.103:0/2963743657 learned_addr learned my addr 172.21.15.103:0/2963743657 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f3d0d400640 1 -- 172.21.15.103:0/2963743657 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d10070410 msgr2=0x7f3d100a9450 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T22:39:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f3d0d400640 1 --2- 172.21.15.103:0/2963743657 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d10070410 0x7f3d100a9450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f3d0d400640 1 -- 172.21.15.103:0/2963743657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d10153ef0 msgr2=0x7f3d10150f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T22:39:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f3d0d400640 1 --2- 172.21.15.103:0/2963743657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d10153ef0 0x7f3d10150f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f3d0d400640 1 -- 172.21.15.103:0/2963743657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d10144080 con 0x7f3d10073fe0 2024-09-10T22:39:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.611+0000 7f73f4c00640 1 Processor -- start 2024-09-10T22:39:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f73f4c00640 1 -- start start 2024-09-10T22:39:13.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f244b000640 1 -- start start 2024-09-10T22:39:13.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f73f4c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73f00cfb80 0x7f73f0139910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f73f4c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73f01433c0 0x7f73f0158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f73f4c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73f015d490 0x7f73f0141a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f3d0d400640 1 --2- 172.21.15.103:0/2963743657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d10073fe0 0x7f3d10150a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009850 tx=0x7f3cfc0a6b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f73f4c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f73f0073200 con 0x7f73f00cfb80 2024-09-10T22:39:13.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f73ed400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73f01433c0 0x7f73f0158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f3d06000640 1 -- 172.21.15.103:0/2963743657 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc0ac070 con 0x7f3d10073fe0 2024-09-10T22:39:13.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f73ee800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73f015d490 0x7f73f0141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f73ed400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73f01433c0 0x7f73f0158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:43180/0 (socket says 172.21.15.103:43180) 2024-09-10T22:39:13.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f73ee800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73f015d490 0x7f73f0141a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:55122/0 (socket says 172.21.15.103:55122) 2024-09-10T22:39:13.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f73ed400640 1 -- 172.21.15.103:0/3328638132 learned_addr learned my addr 172.21.15.103:0/3328638132 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:13.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f73f4c00640 1 -- 172.21.15.103:0/3328638132 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f73f0073080 con 0x7f73f01433c0 2024-09-10T22:39:13.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f3d06000640 1 -- 172.21.15.103:0/2963743657 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cfc004030 con 0x7f3d10073fe0 2024-09-10T22:39:13.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f3d06000640 1 -- 172.21.15.103:0/2963743657 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc0044a0 con 0x7f3d10073fe0 2024-09-10T22:39:13.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f73f4c00640 1 -- 172.21.15.103:0/3328638132 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f73f0073380 con 0x7f73f015d490 2024-09-10T22:39:13.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f73ede00640 1 --2- 172.21.15.103:0/3328638132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73f00cfb80 0x7f73f0139910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f3d0f200640 1 -- 172.21.15.103:0/2963743657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d101fbeb0 con 0x7f3d10073fe0 2024-09-10T22:39:13.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f244b000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f244409c900 0x7f24441642e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f73ee800640 1 -- 172.21.15.103:0/3328638132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73f01433c0 msgr2=0x7f73f0158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f73ee800640 1 --2- 172.21.15.103:0/3328638132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73f01433c0 0x7f73f0158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f73ee800640 1 -- 172.21.15.103:0/3328638132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73f00cfb80 msgr2=0x7f73f0139910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f73ee800640 1 --2- 172.21.15.103:0/3328638132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73f00cfb80 0x7f73f0139910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.615+0000 7f73ee800640 1 -- 172.21.15.103:0/3328638132 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f013ac00 con 0x7f73f015d490 2024-09-10T22:39:13.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f73ee800640 1 --2- 172.21.15.103:0/3328638132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73f015d490 0x7f73f0141a60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f73e00aa000 tx=0x7f73e00042e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f73e6000640 1 -- 172.21.15.103:0/3328638132 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e0005440 con 0x7f73f015d490 2024-09-10T22:39:13.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f73e6000640 1 -- 172.21.15.103:0/3328638132 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73e00044d0 con 0x7f73f015d490 2024-09-10T22:39:13.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f73e6000640 1 -- 172.21.15.103:0/3328638132 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e0004930 con 0x7f73f015d490 2024-09-10T22:39:13.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f73f4c00640 1 -- 172.21.15.103:0/3328638132 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73f013aee0 con 0x7f73f015d490 2024-09-10T22:39:13.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f73f4c00640 1 -- 172.21.15.103:0/3328638132 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f73f0139110 con 0x7f73f015d490 2024-09-10T22:39:13.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f244b000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24440b2f80 0x7f24440ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f244b000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2444165920 0x7f24441618f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f3d0f200640 1 -- 172.21.15.103:0/2963743657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d101fc470 con 0x7f3d10073fe0 2024-09-10T22:39:13.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f2449c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f244409c900 0x7f24441642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f2449c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f244409c900 0x7f24441642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:43184/0 (socket says 172.21.15.103:43184) 2024-09-10T22:39:13.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f244b000640 1 -- 172.21.15.103:0/337620618 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f244416f050 con 0x7f24440b2f80 2024-09-10T22:39:13.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f2449c00640 1 -- 172.21.15.103:0/337620618 learned_addr learned my addr 172.21.15.103:0/337620618 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:13.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f244b000640 1 -- 172.21.15.103:0/337620618 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f244416eed0 con 0x7f244409c900 2024-09-10T22:39:13.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f244b000640 1 -- 172.21.15.103:0/337620618 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f244416f1d0 con 0x7f2444165920 2024-09-10T22:39:13.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f3d0f200640 1 -- 172.21.15.103:0/2963743657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d101fbc30 con 0x7f3d10073fe0 2024-09-10T22:39:13.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f73db400640 1 -- 172.21.15.103:0/3328638132 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73f00b4870 con 0x7f73f015d490 2024-09-10T22:39:13.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f2449c00640 1 -- 172.21.15.103:0/337620618 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2444165920 msgr2=0x7f24441618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f2449c00640 1 --2- 172.21.15.103:0/337620618 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2444165920 0x7f24441618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.619+0000 7f2449c00640 1 -- 172.21.15.103:0/337620618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24440b2f80 msgr2=0x7f24440ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7f2449200640 1 --2- 172.21.15.103:0/337620618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24440b2f80 0x7f24440ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7f2449c00640 1 --2- 172.21.15.103:0/337620618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24440b2f80 0x7f24440ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7f2449c00640 1 -- 172.21.15.103:0/337620618 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24441649c0 con 0x7f244409c900 2024-09-10T22:39:13.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7f2449200640 1 --2- 172.21.15.103:0/337620618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24440b2f80 0x7f24440ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:39:13.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7fc6fd600640 1 -- 172.21.15.103:0/1132683611 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6f80b3b00 msgr2=0x7fc6f80ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7fc6fd600640 1 --2- 172.21.15.103:0/1132683611 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6f80b3b00 0x7fc6f80ad860 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0009bc0 tx=0x7fc6f001cae0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7f2449c00640 1 --2- 172.21.15.103:0/337620618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f244409c900 0x7f24441642e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f243800c450 tx=0x7f243800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7f3d06000640 1 -- 172.21.15.103:0/2963743657 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3d1015ddc0 con 0x7f3d10073fe0 2024-09-10T22:39:13.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7f3d06000640 1 --2- 172.21.15.103:0/2963743657 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3cf00725e0 0x7f3cf0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7fc6fd600640 1 -- 172.21.15.103:0/1132683611 shutdown_connections 2024-09-10T22:39:13.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7fc6fd600640 1 --2- 172.21.15.103:0/1132683611 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6f80b3b00 0x7fc6f80ad860 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7fc6fd600640 1 --2- 172.21.15.103:0/1132683611 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6f815e400 0x7fc6f815e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7fc6fd600640 1 -- 172.21.15.103:0/1132683611 >> 172.21.15.103:0/1132683611 conn(0x7fc6f806d200 msgr2=0x7fc6f80b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7f73e6000640 1 -- 172.21.15.103:0/3328638132 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f73e00bb030 con 0x7f73f015d490 2024-09-10T22:39:13.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7f73e6000640 1 --2- 172.21.15.103:0/3328638132 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f73d0072660 0x7f73d0074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7f73e6000640 1 -- 172.21.15.103:0/3328638132 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f73e012d4f0 con 0x7f73f015d490 2024-09-10T22:39:13.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7f73ede00640 1 --2- 172.21.15.103:0/3328638132 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f73d0072660 0x7f73d0074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7f3d06000640 1 -- 172.21.15.103:0/2963743657 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3cfc12d2d0 con 0x7f3d10073fe0 2024-09-10T22:39:13.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7fc6fd600640 1 -- 172.21.15.103:0/1132683611 shutdown_connections 2024-09-10T22:39:13.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7fc6fd600640 1 -- 172.21.15.103:0/1132683611 wait complete. 2024-09-10T22:39:13.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.623+0000 7f2441600640 1 -- 172.21.15.103:0/337620618 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2438012830 con 0x7f244409c900 2024-09-10T22:39:13.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.627+0000 7f3d0de00640 1 --2- 172.21.15.103:0/2963743657 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3cf00725e0 0x7f3cf0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.627+0000 7f3d0de00640 1 --2- 172.21.15.103:0/2963743657 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3cf00725e0 0x7f3cf0074aa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3d1015b040 tx=0x7f3d00006b60 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.627+0000 7f73ede00640 1 --2- 172.21.15.103:0/3328638132 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f73d0072660 0x7f73d0074b20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f73dc00b3c0 tx=0x7f73dc00d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.627+0000 7f2441600640 1 -- 172.21.15.103:0/337620618 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2438017070 con 0x7f244409c900 2024-09-10T22:39:13.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.627+0000 7f2441600640 1 -- 172.21.15.103:0/337620618 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2438012d80 con 0x7f244409c900 2024-09-10T22:39:13.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.627+0000 7f244b000640 1 -- 172.21.15.103:0/337620618 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2444164ca0 con 0x7f244409c900 2024-09-10T22:39:13.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.627+0000 7f244b000640 1 -- 172.21.15.103:0/337620618 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2444165260 con 0x7f244409c900 2024-09-10T22:39:13.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.627+0000 7fc6fd600640 1 Processor -- start 2024-09-10T22:39:13.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.627+0000 7fc6fd600640 1 -- start start 2024-09-10T22:39:13.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6fd600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6f80733e0 0x7fc6f8149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7f73e6000640 1 -- 172.21.15.103:0/3328638132 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f73e00160b0 con 0x7f73f015d490 2024-09-10T22:39:13.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6fd600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6f80b3b00 0x7fc6f81529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6f6a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6f80733e0 0x7fc6f8149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6fd600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f815e400 0x7fc6f8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6f6000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6f80b3b00 0x7fc6f81529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6f6a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6f80733e0 0x7fc6f8149c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:43192/0 (socket says 172.21.15.103:43192) 2024-09-10T22:39:13.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6f6000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6f80b3b00 0x7fc6f81529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:55140/0 (socket says 172.21.15.103:55140) 2024-09-10T22:39:13.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6f6a00640 1 -- 172.21.15.103:0/3318831678 learned_addr learned my addr 172.21.15.103:0/3318831678 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:13.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7f244b000640 1 -- 172.21.15.103:0/337620618 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f244409cd30 con 0x7f244409c900 2024-09-10T22:39:13.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7f2441600640 1 -- 172.21.15.103:0/337620618 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f243801c460 con 0x7f244409c900 2024-09-10T22:39:13.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6fd600640 1 -- 172.21.15.103:0/3318831678 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f816acd0 con 0x7fc6f815e400 2024-09-10T22:39:13.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6fd600640 1 -- 172.21.15.103:0/3318831678 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f816ab50 con 0x7fc6f80733e0 2024-09-10T22:39:13.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6fd600640 1 -- 172.21.15.103:0/3318831678 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f816ae50 con 0x7fc6f80b3b00 2024-09-10T22:39:13.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6f7400640 1 --2- 172.21.15.103:0/3318831678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f815e400 0x7fc6f8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6f6a00640 1 -- 172.21.15.103:0/3318831678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6f80b3b00 msgr2=0x7fc6f81529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6f6a00640 1 --2- 172.21.15.103:0/3318831678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6f80b3b00 0x7fc6f81529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6f6a00640 1 -- 172.21.15.103:0/3318831678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f815e400 msgr2=0x7fc6f8152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6f6a00640 1 --2- 172.21.15.103:0/3318831678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f815e400 0x7fc6f8152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6f6a00640 1 -- 172.21.15.103:0/3318831678 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f814c7c0 con 0x7fc6f80733e0 2024-09-10T22:39:13.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6f7400640 1 --2- 172.21.15.103:0/3318831678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f815e400 0x7fc6f8152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:13.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7f2441600640 1 --2- 172.21.15.103:0/337620618 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f24240726b0 0x7f2424074b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7f2441600640 1 -- 172.21.15.103:0/337620618 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2438093370 con 0x7f244409c900 2024-09-10T22:39:13.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7fc6f6a00640 1 --2- 172.21.15.103:0/3318831678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6f80733e0 0x7fc6f8149c40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800e9f0 tx=0x7fc6e800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.631+0000 7f2449200640 1 --2- 172.21.15.103:0/337620618 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f24240726b0 0x7f2424074b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.635+0000 7f2449200640 1 --2- 172.21.15.103:0/337620618 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f24240726b0 0x7f2424074b70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f24300af000 tx=0x7f243001b0e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.635+0000 7f3d06000640 1 -- 172.21.15.103:0/2963743657 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3d101fbc30 con 0x7f3d10073fe0 2024-09-10T22:39:13.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.635+0000 7fc6eea00640 1 -- 172.21.15.103:0/3318831678 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e800cd80 con 0x7fc6f80733e0 2024-09-10T22:39:13.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.635+0000 7fc6fd600640 1 -- 172.21.15.103:0/3318831678 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f814caa0 con 0x7fc6f80733e0 2024-09-10T22:39:13.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.635+0000 7fc6fd600640 1 -- 172.21.15.103:0/3318831678 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f80afc00 con 0x7fc6f80733e0 2024-09-10T22:39:13.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.635+0000 7fc6eea00640 1 -- 172.21.15.103:0/3318831678 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6e8010430 con 0x7fc6f80733e0 2024-09-10T22:39:13.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.639+0000 7fc6eea00640 1 -- 172.21.15.103:0/3318831678 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e800cd80 con 0x7fc6f80733e0 2024-09-10T22:39:13.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.639+0000 7f2441600640 1 -- 172.21.15.103:0/337620618 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f243805e6f0 con 0x7f244409c900 2024-09-10T22:39:13.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.639+0000 7fc6fd600640 1 -- 172.21.15.103:0/3318831678 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6d00052a0 con 0x7fc6f80733e0 2024-09-10T22:39:13.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.643+0000 7fc6eea00640 1 -- 172.21.15.103:0/3318831678 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc6e8010600 con 0x7fc6f80733e0 2024-09-10T22:39:13.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.643+0000 7fc6eea00640 1 --2- 172.21.15.103:0/3318831678 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc6d80727e0 0x7fc6d8074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.643+0000 7fc6eea00640 1 -- 172.21.15.103:0/3318831678 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc6e8094110 con 0x7fc6f80733e0 2024-09-10T22:39:13.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.643+0000 7fc6eea00640 1 -- 172.21.15.103:0/3318831678 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc6e805ee80 con 0x7fc6f80733e0 2024-09-10T22:39:13.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.647+0000 7fc6f6000640 1 --2- 172.21.15.103:0/3318831678 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc6d80727e0 0x7fc6d8074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.651+0000 7fc6f6000640 1 --2- 172.21.15.103:0/3318831678 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc6d80727e0 0x7fc6d8074ca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc6f815ff40 tx=0x7fc6e4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.667+0000 7fafdae00640 1 -- 172.21.15.103:0/3005399444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafd40d1830 msgr2=0x7fafd40b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.667+0000 7fafdae00640 1 --2- 172.21.15.103:0/3005399444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafd40d1830 0x7fafd40b3640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fafd408d350 tx=0x7fafc401f0b0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.667+0000 7fafdae00640 1 -- 172.21.15.103:0/3005399444 shutdown_connections 2024-09-10T22:39:13.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.667+0000 7fafdae00640 1 --2- 172.21.15.103:0/3005399444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafd40d1830 0x7fafd40b3640 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.667+0000 7fafdae00640 1 --2- 172.21.15.103:0/3005399444 >> v2:172.21.15.103:3300/0 conn(0x7fafd40d21a0 0x7fafd40d4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.667+0000 7fafdae00640 1 -- 172.21.15.103:0/3005399444 >> 172.21.15.103:0/3005399444 conn(0x7fafd40d3c60 msgr2=0x7fafd40d4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.667+0000 7fafdae00640 1 -- 172.21.15.103:0/3005399444 shutdown_connections 2024-09-10T22:39:13.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.667+0000 7fafdae00640 1 -- 172.21.15.103:0/3005399444 wait complete. 2024-09-10T22:39:13.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.671+0000 7fafdae00640 1 Processor -- start 2024-09-10T22:39:13.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.671+0000 7fafdae00640 1 -- start start 2024-09-10T22:39:13.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafdae00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafd40d1830 0x7fafd41601f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafdae00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafd40d21a0 0x7fafd415eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafd3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafd40d1830 0x7fafd41601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafdae00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafd40cd610 0x7fafd40cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafd3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafd40d1830 0x7fafd41601f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49458/0 (socket says 172.21.15.103:49458) 2024-09-10T22:39:13.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafd3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafd40d21a0 0x7fafd415eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafd3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafd40d21a0 0x7fafd415eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:43214/0 (socket says 172.21.15.103:43214) 2024-09-10T22:39:13.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafdae00640 1 -- 172.21.15.103:0/1877574778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fafd40b3f10 con 0x7fafd40d1830 2024-09-10T22:39:13.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafd3e00640 1 -- 172.21.15.103:0/1877574778 learned_addr learned my addr 172.21.15.103:0/1877574778 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:13.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafdae00640 1 -- 172.21.15.103:0/1877574778 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fafd40b3d90 con 0x7fafd40d21a0 2024-09-10T22:39:13.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafdae00640 1 -- 172.21.15.103:0/1877574778 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fafd40b4090 con 0x7fafd40cd610 2024-09-10T22:39:13.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafd8e00640 1 --2- 172.21.15.103:0/1877574778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafd40cd610 0x7fafd40cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafd8e00640 1 -- 172.21.15.103:0/1877574778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafd40d21a0 msgr2=0x7fafd415eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafd8e00640 1 --2- 172.21.15.103:0/1877574778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafd40d21a0 0x7fafd415eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafd8e00640 1 -- 172.21.15.103:0/1877574778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafd40d1830 msgr2=0x7fafd41601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafd8e00640 1 --2- 172.21.15.103:0/1877574778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafd40d1830 0x7fafd41601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafd8e00640 1 -- 172.21.15.103:0/1877574778 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd415f430 con 0x7fafd40cd610 2024-09-10T22:39:13.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafd3400640 1 --2- 172.21.15.103:0/1877574778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafd40d21a0 0x7fafd415eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:39:13.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafd3e00640 1 --2- 172.21.15.103:0/1877574778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafd40d1830 0x7fafd41601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:39:13.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafd8e00640 1 --2- 172.21.15.103:0/1877574778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafd40cd610 0x7fafd40cad30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fafc40af000 tx=0x7fafc4005df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafcbe00640 1 -- 172.21.15.103:0/1877574778 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc40b5040 con 0x7fafd40cd610 2024-09-10T22:39:13.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafcbe00640 1 -- 172.21.15.103:0/1877574778 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafc4005340 con 0x7fafd40cd610 2024-09-10T22:39:13.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafcbe00640 1 -- 172.21.15.103:0/1877574778 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc40046d0 con 0x7fafd40cd610 2024-09-10T22:39:13.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.675+0000 7fafdae00640 1 -- 172.21.15.103:0/1877574778 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd4160860 con 0x7fafd40cd610 2024-09-10T22:39:13.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.679+0000 7fafdae00640 1 -- 172.21.15.103:0/1877574778 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd4157490 con 0x7fafd40cd610 2024-09-10T22:39:13.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.679+0000 7ff7d1e00640 1 -- 172.21.15.103:0/3698075776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7cc06fba0 msgr2=0x7ff7cc15e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.679+0000 7ff7d1e00640 1 --2- 172.21.15.103:0/3698075776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7cc06fba0 0x7ff7cc15e120 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800b9d0 tx=0x7ff7b801e580 comp rx=0 tx=0).stop 2024-09-10T22:39:13.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.679+0000 7fafdae00640 1 -- 172.21.15.103:0/1877574778 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd40b4600 con 0x7fafd40cd610 2024-09-10T22:39:13.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.679+0000 7ff7d1e00640 1 -- 172.21.15.103:0/3698075776 shutdown_connections 2024-09-10T22:39:13.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.679+0000 7ff7d1e00640 1 --2- 172.21.15.103:0/3698075776 >> v2:172.21.15.131:3300/0 conn(0x7ff7cc15e660 0x7ff7cc0b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.679+0000 7ff7d1e00640 1 --2- 172.21.15.103:0/3698075776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7cc06fba0 0x7ff7cc15e120 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.679+0000 7ff7d1e00640 1 -- 172.21.15.103:0/3698075776 >> 172.21.15.103:0/3698075776 conn(0x7ff7cc06cc00 msgr2=0x7ff7cc06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.679+0000 7ff7d1e00640 1 -- 172.21.15.103:0/3698075776 shutdown_connections 2024-09-10T22:39:13.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.679+0000 7ff7d1e00640 1 -- 172.21.15.103:0/3698075776 wait complete. 2024-09-10T22:39:13.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.679+0000 7fafcbe00640 1 -- 172.21.15.103:0/1877574778 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fafc4004870 con 0x7fafd40cd610 2024-09-10T22:39:13.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.683+0000 7fafcbe00640 1 --2- 172.21.15.103:0/1877574778 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafb4072690 0x7fafb4074b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.683+0000 7fafcbe00640 1 -- 172.21.15.103:0/1877574778 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fafc4130500 con 0x7fafd40cd610 2024-09-10T22:39:13.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.683+0000 7ff7d1e00640 1 Processor -- start 2024-09-10T22:39:13.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.683+0000 7fafd3e00640 1 --2- 172.21.15.103:0/1877574778 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafb4072690 0x7fafb4074b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.683+0000 7ff7d1e00640 1 -- start start 2024-09-10T22:39:13.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.683+0000 7ff7d1e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7cc06fba0 0x7ff7cc14c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7d1e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7cc157f30 0x7ff7cc14e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7d1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7cc15e660 0x7ff7cc0b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7d0a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7cc06fba0 0x7ff7cc14c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7d0a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7cc06fba0 0x7ff7cc14c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:43228/0 (socket says 172.21.15.103:43228) 2024-09-10T22:39:13.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7cbe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7cc157f30 0x7ff7cc14e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7cbe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7cc157f30 0x7ff7cc14e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:55158/0 (socket says 172.21.15.103:55158) 2024-09-10T22:39:13.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7fafd3e00640 1 --2- 172.21.15.103:0/1877574778 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafb4072690 0x7fafb4074b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009600 tx=0x7fafc00091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7d0a00640 1 -- 172.21.15.103:0/3561056224 learned_addr learned my addr 172.21.15.103:0/3561056224 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:13.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7d1400640 1 --2- 172.21.15.103:0/3561056224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7cc15e660 0x7ff7cc0b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7d1e00640 1 -- 172.21.15.103:0/3561056224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff7cc06e890 con 0x7ff7cc15e660 2024-09-10T22:39:13.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7d1e00640 1 -- 172.21.15.103:0/3561056224 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff7cc06e710 con 0x7ff7cc06fba0 2024-09-10T22:39:13.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7d1e00640 1 -- 172.21.15.103:0/3561056224 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff7cc06ea10 con 0x7ff7cc157f30 2024-09-10T22:39:13.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7fafcbe00640 1 -- 172.21.15.103:0/1877574778 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fafc4018c10 con 0x7fafd40cd610 2024-09-10T22:39:13.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7cbe00640 1 -- 172.21.15.103:0/3561056224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7cc06fba0 msgr2=0x7ff7cc14c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7cbe00640 1 --2- 172.21.15.103:0/3561056224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7cc06fba0 0x7ff7cc14c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7cbe00640 1 -- 172.21.15.103:0/3561056224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7cc15e660 msgr2=0x7ff7cc0b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7cbe00640 1 --2- 172.21.15.103:0/3561056224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7cc15e660 0x7ff7cc0b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7cbe00640 1 -- 172.21.15.103:0/3561056224 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7cc0b2210 con 0x7ff7cc157f30 2024-09-10T22:39:13.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7d1400640 1 --2- 172.21.15.103:0/3561056224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7cc15e660 0x7ff7cc0b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:39:13.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7d0a00640 1 --2- 172.21.15.103:0/3561056224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7cc06fba0 0x7ff7cc14c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:13.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7cbe00640 1 --2- 172.21.15.103:0/3561056224 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7cc157f30 0x7ff7cc14e2e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80ad000 tx=0x7ff7b8005d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7c8c00640 1 -- 172.21.15.103:0/3561056224 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b80bb030 con 0x7ff7cc157f30 2024-09-10T22:39:13.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7c8c00640 1 -- 172.21.15.103:0/3561056224 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7b80ad8a0 con 0x7ff7cc157f30 2024-09-10T22:39:13.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7c8c00640 1 -- 172.21.15.103:0/3561056224 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b80b2040 con 0x7ff7cc157f30 2024-09-10T22:39:13.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.687+0000 7ff7d1e00640 1 -- 172.21.15.103:0/3561056224 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7cc14da40 con 0x7ff7cc157f30 2024-09-10T22:39:13.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.691+0000 7ff7d1e00640 1 -- 172.21.15.103:0/3561056224 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7cc14e000 con 0x7ff7cc157f30 2024-09-10T22:39:13.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.691+0000 7ff7d1e00640 1 -- 172.21.15.103:0/3561056224 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7cc15e120 con 0x7ff7cc157f30 2024-09-10T22:39:13.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.695+0000 7ff7c8c00640 1 -- 172.21.15.103:0/3561056224 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff7b80c7070 con 0x7ff7cc157f30 2024-09-10T22:39:13.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.699+0000 7ff7c8c00640 1 --2- 172.21.15.103:0/3561056224 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff7ac072610 0x7ff7ac074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:13.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.699+0000 7ff7c8c00640 1 -- 172.21.15.103:0/3561056224 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff7b812d650 con 0x7ff7cc157f30 2024-09-10T22:39:13.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.699+0000 7ff7c8c00640 1 -- 172.21.15.103:0/3561056224 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff7b80c4020 con 0x7ff7cc157f30 2024-09-10T22:39:13.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.707+0000 7ff7d0a00640 1 --2- 172.21.15.103:0/3561056224 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff7ac072610 0x7ff7ac074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:13.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.707+0000 7ff7d0a00640 1 --2- 172.21.15.103:0/3561056224 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff7ac072610 0x7ff7ac074ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0046c0 tx=0x7ff7bc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:13.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.975+0000 7f15cae00640 1 -- 172.21.15.103:0/3337604388 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f159c005590 con 0x7f15c415c7b0 2024-09-10T22:39:13.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.979+0000 7f15bbe00640 1 -- 172.21.15.103:0/3337604388 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f15bc0fb880 con 0x7f15c415c7b0 2024-09-10T22:39:13.982 INFO:teuthology.orchestra.run.smithi103.stdout:64424509449 2024-09-10T22:39:13.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.979+0000 7fa873e00640 1 -- 172.21.15.103:0/716933891 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa874070780 con 0x7fa8740ccb80 2024-09-10T22:39:13.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.983+0000 7fa86b400640 1 -- 172.21.15.103:0/716933891 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa864011070 con 0x7fa8740ccb80 2024-09-10T22:39:13.984 INFO:teuthology.orchestra.run.smithi103.stdout:64424509449 2024-09-10T22:39:13.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.983+0000 7f15cae00640 1 -- 172.21.15.103:0/3337604388 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f15a4072a10 msgr2=0x7f15a4074ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.983+0000 7f15cae00640 1 --2- 172.21.15.103:0/3337604388 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f15a4072a10 0x7f15a4074ed0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f15b0007fd0 tx=0x7f15b0007dc0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.983+0000 7f15cae00640 1 -- 172.21.15.103:0/3337604388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15c415c7b0 msgr2=0x7f15c415cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.983+0000 7f15cae00640 1 --2- 172.21.15.103:0/3337604388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15c415c7b0 0x7f15c415cc30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00ac90 tx=0x7f15bc005530 comp rx=0 tx=0).stop 2024-09-10T22:39:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.983+0000 7f15cae00640 1 -- 172.21.15.103:0/3337604388 shutdown_connections 2024-09-10T22:39:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.983+0000 7f15cae00640 1 --2- 172.21.15.103:0/3337604388 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f15a4072a10 0x7f15a4074ed0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.983+0000 7f15cae00640 1 --2- 172.21.15.103:0/3337604388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15c415c7b0 0x7f15c415cc30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.983+0000 7f15cae00640 1 --2- 172.21.15.103:0/3337604388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15c4141f90 0x7f15c413ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.983+0000 7f15cae00640 1 --2- 172.21.15.103:0/3337604388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15a80052f0 0x7f15c40a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.983+0000 7f15cae00640 1 -- 172.21.15.103:0/3337604388 >> 172.21.15.103:0/3337604388 conn(0x7f15c406d200 msgr2=0x7f15c4073960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.983+0000 7f15cae00640 1 -- 172.21.15.103:0/3337604388 shutdown_connections 2024-09-10T22:39:13.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.983+0000 7f15cae00640 1 -- 172.21.15.103:0/3337604388 wait complete. 2024-09-10T22:39:13.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.983+0000 7fa873e00640 1 -- 172.21.15.103:0/716933891 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa8540725e0 msgr2=0x7fa854074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.983+0000 7fa873e00640 1 --2- 172.21.15.103:0/716933891 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa8540725e0 0x7fa854074aa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa8600af000 tx=0x7fa86001b080 comp rx=0 tx=0).stop 2024-09-10T22:39:13.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.983+0000 7fa873e00640 1 -- 172.21.15.103:0/716933891 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8740ccb80 msgr2=0x7fa8741fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:13.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.983+0000 7fa873e00640 1 --2- 172.21.15.103:0/716933891 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8740ccb80 0x7fa8741fff30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa864009800 tx=0x7fa864009cc0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.987+0000 7fa873e00640 1 -- 172.21.15.103:0/716933891 shutdown_connections 2024-09-10T22:39:13.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.987+0000 7fa873e00640 1 --2- 172.21.15.103:0/716933891 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa8540725e0 0x7fa854074aa0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.987+0000 7fa873e00640 1 --2- 172.21.15.103:0/716933891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8741ff370 0x7fa8741ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.987+0000 7fa873e00640 1 --2- 172.21.15.103:0/716933891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8740cf620 0x7fa87414bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.987+0000 7fa873e00640 1 --2- 172.21.15.103:0/716933891 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8740ccb80 0x7fa8741fff30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:13.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.987+0000 7fa873e00640 1 -- 172.21.15.103:0/716933891 >> 172.21.15.103:0/716933891 conn(0x7fa87406d3f0 msgr2=0x7fa8740737b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:13.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.987+0000 7fa873e00640 1 -- 172.21.15.103:0/716933891 shutdown_connections 2024-09-10T22:39:13.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.987+0000 7fa873e00640 1 -- 172.21.15.103:0/716933891 wait complete. 2024-09-10T22:39:13.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.991+0000 7f73db400640 1 -- 172.21.15.103:0/3328638132 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f73f00cf400 con 0x7f73f015d490 2024-09-10T22:39:13.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.991+0000 7f244b000640 1 -- 172.21.15.103:0/337620618 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f24440cfc60 con 0x7f244409c900 2024-09-10T22:39:13.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.991+0000 7f73e6000640 1 -- 172.21.15.103:0/3328638132 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f73e00f8440 con 0x7f73f015d490 2024-09-10T22:39:13.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.991+0000 7f2441600640 1 -- 172.21.15.103:0/337620618 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f243805dff0 con 0x7f244409c900 2024-09-10T22:39:13.996 INFO:teuthology.orchestra.run.smithi103.stdout:64424509449 2024-09-10T22:39:13.996 INFO:teuthology.orchestra.run.smithi103.stdout:64424509450 2024-09-10T22:39:14.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.995+0000 7f73db400640 1 -- 172.21.15.103:0/3328638132 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f73d0072660 msgr2=0x7f73d0074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.995+0000 7f73db400640 1 --2- 172.21.15.103:0/3328638132 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f73d0072660 0x7f73d0074b20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f73dc00b3c0 tx=0x7f73dc00d040 comp rx=0 tx=0).stop 2024-09-10T22:39:14.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.995+0000 7f73db400640 1 -- 172.21.15.103:0/3328638132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73f015d490 msgr2=0x7f73f0141a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.995+0000 7f73db400640 1 --2- 172.21.15.103:0/3328638132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73f015d490 0x7f73f0141a60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f73e00aa000 tx=0x7f73e00042e0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f73db400640 1 -- 172.21.15.103:0/3328638132 shutdown_connections 2024-09-10T22:39:14.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f73db400640 1 --2- 172.21.15.103:0/3328638132 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f73d0072660 0x7f73d0074b20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f73db400640 1 --2- 172.21.15.103:0/3328638132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73f015d490 0x7f73f0141a60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f73db400640 1 --2- 172.21.15.103:0/3328638132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73f01433c0 0x7f73f0158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f73db400640 1 --2- 172.21.15.103:0/3328638132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73f00cfb80 0x7f73f0139910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f73db400640 1 -- 172.21.15.103:0/3328638132 >> 172.21.15.103:0/3328638132 conn(0x7f73f006cc00 msgr2=0x7f73f006cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:14.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f244b000640 1 -- 172.21.15.103:0/337620618 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f24240726b0 msgr2=0x7f2424074b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f244b000640 1 --2- 172.21.15.103:0/337620618 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f24240726b0 0x7f2424074b70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f24300af000 tx=0x7f243001b0e0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f244b000640 1 -- 172.21.15.103:0/337620618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f244409c900 msgr2=0x7f24441642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f244b000640 1 --2- 172.21.15.103:0/337620618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f244409c900 0x7f24441642e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f243800c450 tx=0x7f243800c910 comp rx=0 tx=0).stop 2024-09-10T22:39:14.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f73db400640 1 -- 172.21.15.103:0/3328638132 shutdown_connections 2024-09-10T22:39:14.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f73db400640 1 -- 172.21.15.103:0/3328638132 wait complete. 2024-09-10T22:39:14.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f244b000640 1 -- 172.21.15.103:0/337620618 shutdown_connections 2024-09-10T22:39:14.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f244b000640 1 --2- 172.21.15.103:0/337620618 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f24240726b0 0x7f2424074b70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f244b000640 1 --2- 172.21.15.103:0/337620618 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2444165920 0x7f24441618f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f244b000640 1 --2- 172.21.15.103:0/337620618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24440b2f80 0x7f24440ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f244b000640 1 --2- 172.21.15.103:0/337620618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f244409c900 0x7f24441642e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f244b000640 1 -- 172.21.15.103:0/337620618 >> 172.21.15.103:0/337620618 conn(0x7f24440b5540 msgr2=0x7f24440b8890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:14.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f244b000640 1 -- 172.21.15.103:0/337620618 shutdown_connections 2024-09-10T22:39:14.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:13.999+0000 7f244b000640 1 -- 172.21.15.103:0/337620618 wait complete. 2024-09-10T22:39:14.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.003+0000 7f3d0f200640 1 -- 172.21.15.103:0/2963743657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3d100b4030 con 0x7f3d10073fe0 2024-09-10T22:39:14.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.003+0000 7f3d06000640 1 -- 172.21.15.103:0/2963743657 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3d100b4030 con 0x7f3d10073fe0 2024-09-10T22:39:14.009 INFO:teuthology.orchestra.run.smithi103.stdout:55834574857 2024-09-10T22:39:14.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.007+0000 7f3d0f200640 1 -- 172.21.15.103:0/2963743657 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3cf00725e0 msgr2=0x7f3cf0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.007+0000 7f3d0f200640 1 --2- 172.21.15.103:0/2963743657 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3cf00725e0 0x7f3cf0074aa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3d1015b040 tx=0x7f3d00006b60 comp rx=0 tx=0).stop 2024-09-10T22:39:14.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.007+0000 7f3d0f200640 1 -- 172.21.15.103:0/2963743657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d10073fe0 msgr2=0x7f3d10150a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.007+0000 7f3d0f200640 1 --2- 172.21.15.103:0/2963743657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d10073fe0 0x7f3d10150a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009850 tx=0x7f3cfc0a6b50 comp rx=0 tx=0).stop 2024-09-10T22:39:14.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.007+0000 7f3d0f200640 1 -- 172.21.15.103:0/2963743657 shutdown_connections 2024-09-10T22:39:14.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.007+0000 7f3d0f200640 1 --2- 172.21.15.103:0/2963743657 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3cf00725e0 0x7f3cf0074aa0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.007+0000 7f3d0f200640 1 --2- 172.21.15.103:0/2963743657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d10153ef0 0x7f3d10150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.007+0000 7f3d0f200640 1 --2- 172.21.15.103:0/2963743657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d10073fe0 0x7f3d10150a00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.007+0000 7f3d0f200640 1 --2- 172.21.15.103:0/2963743657 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d10070410 0x7f3d100a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.007+0000 7f3d0f200640 1 -- 172.21.15.103:0/2963743657 >> 172.21.15.103:0/2963743657 conn(0x7f3d100b1490 msgr2=0x7f3d1006e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:14.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.011+0000 7f3d0f200640 1 -- 172.21.15.103:0/2963743657 shutdown_connections 2024-09-10T22:39:14.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.011+0000 7f3d0f200640 1 -- 172.21.15.103:0/2963743657 wait complete. 2024-09-10T22:39:14.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.011+0000 7fc6fd600640 1 -- 172.21.15.103:0/3318831678 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc6d0005860 con 0x7fc6f80733e0 2024-09-10T22:39:14.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.011+0000 7fc6eea00640 1 -- 172.21.15.103:0/3318831678 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc6e80638b0 con 0x7fc6f80733e0 2024-09-10T22:39:14.015 INFO:teuthology.orchestra.run.smithi103.stdout:64424509449 2024-09-10T22:39:14.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.015+0000 7fc6fd600640 1 -- 172.21.15.103:0/3318831678 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc6d80727e0 msgr2=0x7fc6d8074ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.015+0000 7fc6fd600640 1 --2- 172.21.15.103:0/3318831678 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc6d80727e0 0x7fc6d8074ca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc6f815ff40 tx=0x7fc6e4009040 comp rx=0 tx=0).stop 2024-09-10T22:39:14.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.015+0000 7fc6fd600640 1 -- 172.21.15.103:0/3318831678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6f80733e0 msgr2=0x7fc6f8149c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.015+0000 7fc6fd600640 1 --2- 172.21.15.103:0/3318831678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6f80733e0 0x7fc6f8149c40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800e9f0 tx=0x7fc6e800eeb0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.015+0000 7fc6fd600640 1 -- 172.21.15.103:0/3318831678 shutdown_connections 2024-09-10T22:39:14.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.015+0000 7fc6fd600640 1 --2- 172.21.15.103:0/3318831678 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc6d80727e0 0x7fc6d8074ca0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.015+0000 7fc6fd600640 1 --2- 172.21.15.103:0/3318831678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f815e400 0x7fc6f8152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.015+0000 7fc6fd600640 1 --2- 172.21.15.103:0/3318831678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6f80b3b00 0x7fc6f81529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.015+0000 7fc6fd600640 1 --2- 172.21.15.103:0/3318831678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6f80733e0 0x7fc6f8149c40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.015+0000 7fc6fd600640 1 -- 172.21.15.103:0/3318831678 >> 172.21.15.103:0/3318831678 conn(0x7fc6f806d200 msgr2=0x7fc6f806f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:14.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.019+0000 7fc6fd600640 1 -- 172.21.15.103:0/3318831678 shutdown_connections 2024-09-10T22:39:14.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.019+0000 7fc6fd600640 1 -- 172.21.15.103:0/3318831678 wait complete. 2024-09-10T22:39:14.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2024-09-10T22:39:14.029 DEBUG:teuthology.parallel:result is None 2024-09-10T22:39:14.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.0 2024-09-10T22:39:14.032 DEBUG:teuthology.parallel:result is None 2024-09-10T22:39:14.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.5 2024-09-10T22:39:14.046 DEBUG:teuthology.parallel:result is None 2024-09-10T22:39:14.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.043+0000 7fafdae00640 1 -- 172.21.15.103:0/1877574778 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fafd40d28c0 con 0x7fafd40cd610 2024-09-10T22:39:14.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.6 2024-09-10T22:39:14.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.043+0000 7fafcbe00640 1 -- 172.21.15.103:0/1877574778 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fafc40fb910 con 0x7fafd40cd610 2024-09-10T22:39:14.047 DEBUG:teuthology.parallel:result is None 2024-09-10T22:39:14.049 INFO:teuthology.orchestra.run.smithi103.stdout:64424509449 2024-09-10T22:39:14.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.047+0000 7fafdae00640 1 -- 172.21.15.103:0/1877574778 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafb4072690 msgr2=0x7fafb4074b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.047+0000 7fafdae00640 1 --2- 172.21.15.103:0/1877574778 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafb4072690 0x7fafb4074b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009600 tx=0x7fafc00091e0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.047+0000 7fafdae00640 1 -- 172.21.15.103:0/1877574778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafd40cd610 msgr2=0x7fafd40cad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.047+0000 7fafdae00640 1 --2- 172.21.15.103:0/1877574778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafd40cd610 0x7fafd40cad30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fafc40af000 tx=0x7fafc4005df0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.047+0000 7fafdae00640 1 -- 172.21.15.103:0/1877574778 shutdown_connections 2024-09-10T22:39:14.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.047+0000 7fafdae00640 1 --2- 172.21.15.103:0/1877574778 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafb4072690 0x7fafb4074b50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.047+0000 7fafdae00640 1 --2- 172.21.15.103:0/1877574778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafd40cd610 0x7fafd40cad30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.047+0000 7fafdae00640 1 --2- 172.21.15.103:0/1877574778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafd40d21a0 0x7fafd415eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.047+0000 7fafdae00640 1 --2- 172.21.15.103:0/1877574778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafd40d1830 0x7fafd41601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.047+0000 7fafdae00640 1 -- 172.21.15.103:0/1877574778 >> 172.21.15.103:0/1877574778 conn(0x7fafd40d3c60 msgr2=0x7fafd40b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:14.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.047+0000 7fafdae00640 1 -- 172.21.15.103:0/1877574778 shutdown_connections 2024-09-10T22:39:14.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.051+0000 7fafdae00640 1 -- 172.21.15.103:0/1877574778 wait complete. 2024-09-10T22:39:14.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-09-10T22:39:14.054 DEBUG:teuthology.parallel:result is None 2024-09-10T22:39:14.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.4 2024-09-10T22:39:14.054 DEBUG:teuthology.parallel:result is None 2024-09-10T22:39:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.051+0000 7ff7d1e00640 1 -- 172.21.15.103:0/3561056224 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff7cc0b1d30 con 0x7ff7cc157f30 2024-09-10T22:39:14.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.055+0000 7ff7c8c00640 1 -- 172.21.15.103:0/3561056224 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff7b80181a0 con 0x7ff7cc157f30 2024-09-10T22:39:14.056 INFO:teuthology.orchestra.run.smithi103.stdout:64424509449 2024-09-10T22:39:14.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.055+0000 7ff7d1e00640 1 -- 172.21.15.103:0/3561056224 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff7ac072610 msgr2=0x7ff7ac074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.055+0000 7ff7d1e00640 1 --2- 172.21.15.103:0/3561056224 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff7ac072610 0x7ff7ac074ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0046c0 tx=0x7ff7bc009040 comp rx=0 tx=0).stop 2024-09-10T22:39:14.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.055+0000 7ff7d1e00640 1 -- 172.21.15.103:0/3561056224 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7cc157f30 msgr2=0x7ff7cc14e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.055+0000 7ff7d1e00640 1 --2- 172.21.15.103:0/3561056224 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7cc157f30 0x7ff7cc14e2e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80ad000 tx=0x7ff7b8005d20 comp rx=0 tx=0).stop 2024-09-10T22:39:14.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.055+0000 7ff7d1e00640 1 -- 172.21.15.103:0/3561056224 shutdown_connections 2024-09-10T22:39:14.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.055+0000 7ff7d1e00640 1 --2- 172.21.15.103:0/3561056224 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff7ac072610 0x7ff7ac074ad0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.055+0000 7ff7d1e00640 1 --2- 172.21.15.103:0/3561056224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7cc15e660 0x7ff7cc0b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.055+0000 7ff7d1e00640 1 --2- 172.21.15.103:0/3561056224 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7cc157f30 0x7ff7cc14e2e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.055+0000 7ff7d1e00640 1 --2- 172.21.15.103:0/3561056224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7cc06fba0 0x7ff7cc14c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.055+0000 7ff7d1e00640 1 -- 172.21.15.103:0/3561056224 >> 172.21.15.103:0/3561056224 conn(0x7ff7cc06cc00 msgr2=0x7ff7cc06ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:14.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.055+0000 7ff7d1e00640 1 -- 172.21.15.103:0/3561056224 shutdown_connections 2024-09-10T22:39:14.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.055+0000 7ff7d1e00640 1 -- 172.21.15.103:0/3561056224 wait complete. 2024-09-10T22:39:14.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.7 2024-09-10T22:39:14.074 DEBUG:teuthology.parallel:result is None 2024-09-10T22:39:14.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2024-09-10T22:39:14.080 DEBUG:teuthology.parallel:result is None 2024-09-10T22:39:14.081 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T22:39:14.081 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:39:14.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faffdc00640 1 -- 172.21.15.103:0/3963524216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faff80d25f0 msgr2=0x7faff80af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faffdc00640 1 --2- 172.21.15.103:0/3963524216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faff80d25f0 0x7faff80af720 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faff80b0ec0 tx=0x7fafe001c770 comp rx=0 tx=0).stop 2024-09-10T22:39:14.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faffdc00640 1 -- 172.21.15.103:0/3963524216 shutdown_connections 2024-09-10T22:39:14.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faffdc00640 1 --2- 172.21.15.103:0/3963524216 >> v2:172.21.15.131:3300/0 conn(0x7faff80717a0 0x7faff80afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faffdc00640 1 --2- 172.21.15.103:0/3963524216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faff80d25f0 0x7faff80af720 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faffdc00640 1 -- 172.21.15.103:0/3963524216 >> 172.21.15.103:0/3963524216 conn(0x7faff80d1ad0 msgr2=0x7faff80d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:14.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faffdc00640 1 -- 172.21.15.103:0/3963524216 shutdown_connections 2024-09-10T22:39:14.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faffdc00640 1 -- 172.21.15.103:0/3963524216 wait complete. 2024-09-10T22:39:14.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faffdc00640 1 Processor -- start 2024-09-10T22:39:14.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faffdc00640 1 -- start start 2024-09-10T22:39:14.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faffdc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faff80717a0 0x7faff80b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:14.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faffdc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faff80cfda0 0x7faff8152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:14.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faffdc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faff80d25f0 0x7faff80b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:14.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faffdc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faff8169000 con 0x7faff80d25f0 2024-09-10T22:39:14.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faffdc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faff8168e80 con 0x7faff80cfda0 2024-09-10T22:39:14.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faffdc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7faff8169180 con 0x7faff80717a0 2024-09-10T22:39:14.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faff7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faff80d25f0 0x7faff80b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:14.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faff7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faff80d25f0 0x7faff80b65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49482/0 (socket says 172.21.15.103:49482) 2024-09-10T22:39:14.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faff7400640 1 -- 172.21.15.103:0/362519542 learned_addr learned my addr 172.21.15.103:0/362519542 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:14.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7fafefe00640 1 --2- 172.21.15.103:0/362519542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faff80cfda0 0x7faff8152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:14.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.263+0000 7faff6a00640 1 --2- 172.21.15.103:0/362519542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faff80717a0 0x7faff80b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:14.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.267+0000 7faff7400640 1 -- 172.21.15.103:0/362519542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faff80717a0 msgr2=0x7faff80b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.267+0000 7faff7400640 1 --2- 172.21.15.103:0/362519542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faff80717a0 0x7faff80b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.267+0000 7faff7400640 1 -- 172.21.15.103:0/362519542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faff80cfda0 msgr2=0x7faff8152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.267+0000 7faff7400640 1 --2- 172.21.15.103:0/362519542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faff80cfda0 0x7faff8152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.267+0000 7faff7400640 1 -- 172.21.15.103:0/362519542 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff81f93d0 con 0x7faff80d25f0 2024-09-10T22:39:14.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.267+0000 7faff7400640 1 --2- 172.21.15.103:0/362519542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faff80d25f0 0x7faff80b65c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faff000daa0 tx=0x7faff000df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:14.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.267+0000 7fafeea00640 1 -- 172.21.15.103:0/362519542 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0017070 con 0x7faff80d25f0 2024-09-10T22:39:14.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.267+0000 7fafeea00640 1 -- 172.21.15.103:0/362519542 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faff0004b30 con 0x7faff80d25f0 2024-09-10T22:39:14.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.267+0000 7fafeea00640 1 -- 172.21.15.103:0/362519542 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0005020 con 0x7faff80d25f0 2024-09-10T22:39:14.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.267+0000 7faffdc00640 1 -- 172.21.15.103:0/362519542 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff81f96b0 con 0x7faff80d25f0 2024-09-10T22:39:14.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.267+0000 7faffdc00640 1 -- 172.21.15.103:0/362519542 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff81f9c70 con 0x7faff80d25f0 2024-09-10T22:39:14.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.267+0000 7faffdc00640 1 -- 172.21.15.103:0/362519542 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faff815eca0 con 0x7faff80d25f0 2024-09-10T22:39:14.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.267+0000 7fafeea00640 1 -- 172.21.15.103:0/362519542 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7faff00051c0 con 0x7faff80d25f0 2024-09-10T22:39:14.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.271+0000 7fafeea00640 1 --2- 172.21.15.103:0/362519542 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafd40725e0 0x7fafd4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:14.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.271+0000 7fafeea00640 1 -- 172.21.15.103:0/362519542 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7faff0093a10 con 0x7faff80d25f0 2024-09-10T22:39:14.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.271+0000 7faff6a00640 1 --2- 172.21.15.103:0/362519542 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafd40725e0 0x7fafd4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:14.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.271+0000 7faff6a00640 1 --2- 172.21.15.103:0/362519542 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafd40725e0 0x7fafd4074aa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faff80c5150 tx=0x7fafe8007e40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:14.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.275+0000 7fafeea00640 1 -- 172.21.15.103:0/362519542 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7faff0020070 con 0x7faff80d25f0 2024-09-10T22:39:14.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.439+0000 7faffdc00640 1 -- 172.21.15.103:0/362519542 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faff81f5b50 con 0x7fafd40725e0 2024-09-10T22:39:14.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.443+0000 7fafeea00640 1 -- 172.21.15.103:0/362519542 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7fafe8003bf0 con 0x7fafd40725e0 2024-09-10T22:39:14.450 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:14.452 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:39:14.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.447+0000 7faffdc00640 1 -- 172.21.15.103:0/362519542 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafd40725e0 msgr2=0x7fafd4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.447+0000 7faffdc00640 1 --2- 172.21.15.103:0/362519542 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafd40725e0 0x7fafd4074aa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faff80c5150 tx=0x7fafe8007e40 comp rx=0 tx=0).stop 2024-09-10T22:39:14.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.447+0000 7faffdc00640 1 -- 172.21.15.103:0/362519542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faff80d25f0 msgr2=0x7faff80b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.447+0000 7faffdc00640 1 --2- 172.21.15.103:0/362519542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faff80d25f0 0x7faff80b65c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faff000daa0 tx=0x7faff000df60 comp rx=0 tx=0).stop 2024-09-10T22:39:14.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.447+0000 7faffdc00640 1 -- 172.21.15.103:0/362519542 shutdown_connections 2024-09-10T22:39:14.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.447+0000 7faffdc00640 1 --2- 172.21.15.103:0/362519542 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafd40725e0 0x7fafd4074aa0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.447+0000 7faffdc00640 1 --2- 172.21.15.103:0/362519542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faff80d25f0 0x7faff80b65c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.447+0000 7faffdc00640 1 --2- 172.21.15.103:0/362519542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faff80cfda0 0x7faff8152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.447+0000 7faffdc00640 1 --2- 172.21.15.103:0/362519542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faff80717a0 0x7faff80b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.447+0000 7faffdc00640 1 -- 172.21.15.103:0/362519542 >> 172.21.15.103:0/362519542 conn(0x7faff80d1ad0 msgr2=0x7faff8157cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:14.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.447+0000 7faffdc00640 1 -- 172.21.15.103:0/362519542 shutdown_connections 2024-09-10T22:39:14.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.447+0000 7faffdc00640 1 -- 172.21.15.103:0/362519542 wait complete. 2024-09-10T22:39:14.469 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-09-10T22:39:13.623269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219696,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755024,"statfs":{"total":773094113280,"available":772869144576,"internally_reserved":0,"allocated":3514368,"data_stored":2074472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003072"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921053+0000","last_change":"2024-09-10T22:38:48.852520+0000","last_active":"2024-09-10T22:38:54.921053+0000","last_peered":"2024-09-10T22:38:54.921053+0000","last_clean":"2024-09-10T22:38:54.921053+0000","last_became_active":"2024-09-10T22:38:48.852277+0000","last_became_peered":"2024-09-10T22:38:48.852277+0000","last_unstale":"2024-09-10T22:38:54.921053+0000","last_undegraded":"2024-09-10T22:38:54.921053+0000","last_fullsized":"2024-09-10T22:38:54.921053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:57.474446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922482+0000","last_change":"2024-09-10T22:38:49.865286+0000","last_active":"2024-09-10T22:38:54.922482+0000","last_peered":"2024-09-10T22:38:54.922482+0000","last_clean":"2024-09-10T22:38:54.922482+0000","last_became_active":"2024-09-10T22:38:49.864978+0000","last_became_peered":"2024-09-10T22:38:49.864978+0000","last_unstale":"2024-09-10T22:38:54.922482+0000","last_undegraded":"2024-09-10T22:38:54.922482+0000","last_fullsized":"2024-09-10T22:38:54.922482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:48.790469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921444+0000","last_change":"2024-09-10T22:38:54.251129+0000","last_active":"2024-09-10T22:38:54.921444+0000","last_peered":"2024-09-10T22:38:54.921444+0000","last_clean":"2024-09-10T22:38:54.921444+0000","last_became_active":"2024-09-10T22:38:54.250166+0000","last_became_peered":"2024-09-10T22:38:54.250166+0000","last_unstale":"2024-09-10T22:38:54.921444+0000","last_undegraded":"2024-09-10T22:38:54.921444+0000","last_fullsized":"2024-09-10T22:38:54.921444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:29.717841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922539+0000","last_change":"2024-09-10T22:38:48.841492+0000","last_active":"2024-09-10T22:38:54.922539+0000","last_peered":"2024-09-10T22:38:54.922539+0000","last_clean":"2024-09-10T22:38:54.922539+0000","last_became_active":"2024-09-10T22:38:48.841173+0000","last_became_peered":"2024-09-10T22:38:48.841173+0000","last_unstale":"2024-09-10T22:38:54.922539+0000","last_undegraded":"2024-09-10T22:38:54.922539+0000","last_fullsized":"2024-09-10T22:38:54.922539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:27.985660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920864+0000","last_change":"2024-09-10T22:38:49.865338+0000","last_active":"2024-09-10T22:38:54.920864+0000","last_peered":"2024-09-10T22:38:54.920864+0000","last_clean":"2024-09-10T22:38:54.920864+0000","last_became_active":"2024-09-10T22:38:49.864649+0000","last_became_peered":"2024-09-10T22:38:49.864649+0000","last_unstale":"2024-09-10T22:38:54.920864+0000","last_undegraded":"2024-09-10T22:38:54.920864+0000","last_fullsized":"2024-09-10T22:38:54.920864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:40.212977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921237+0000","last_change":"2024-09-10T22:38:53.901798+0000","last_active":"2024-09-10T22:38:54.921237+0000","last_peered":"2024-09-10T22:38:54.921237+0000","last_clean":"2024-09-10T22:38:54.921237+0000","last_became_active":"2024-09-10T22:38:53.901092+0000","last_became_peered":"2024-09-10T22:38:53.901092+0000","last_unstale":"2024-09-10T22:38:54.921237+0000","last_undegraded":"2024-09-10T22:38:54.921237+0000","last_fullsized":"2024-09-10T22:38:54.921237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:41.242227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921986+0000","last_change":"2024-09-10T22:38:48.857962+0000","last_active":"2024-09-10T22:38:54.921986+0000","last_peered":"2024-09-10T22:38:54.921986+0000","last_clean":"2024-09-10T22:38:54.921986+0000","last_became_active":"2024-09-10T22:38:48.857774+0000","last_became_peered":"2024-09-10T22:38:48.857774+0000","last_unstale":"2024-09-10T22:38:54.921986+0000","last_undegraded":"2024-09-10T22:38:54.921986+0000","last_fullsized":"2024-09-10T22:38:54.921986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:51.705558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880518+0000","last_change":"2024-09-10T22:38:49.872509+0000","last_active":"2024-09-10T22:38:54.880518+0000","last_peered":"2024-09-10T22:38:54.880518+0000","last_clean":"2024-09-10T22:38:54.880518+0000","last_became_active":"2024-09-10T22:38:49.871924+0000","last_became_peered":"2024-09-10T22:38:49.871924+0000","last_unstale":"2024-09-10T22:38:54.880518+0000","last_undegraded":"2024-09-10T22:38:54.880518+0000","last_fullsized":"2024-09-10T22:38:54.880518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:04.224631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920786+0000","last_change":"2024-09-10T22:38:53.905850+0000","last_active":"2024-09-10T22:38:54.920786+0000","last_peered":"2024-09-10T22:38:54.920786+0000","last_clean":"2024-09-10T22:38:54.920786+0000","last_became_active":"2024-09-10T22:38:53.905409+0000","last_became_peered":"2024-09-10T22:38:53.905409+0000","last_unstale":"2024-09-10T22:38:54.920786+0000","last_undegraded":"2024-09-10T22:38:54.920786+0000","last_fullsized":"2024-09-10T22:38:54.920786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:21.421252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921776+0000","last_change":"2024-09-10T22:38:48.856520+0000","last_active":"2024-09-10T22:38:54.921776+0000","last_peered":"2024-09-10T22:38:54.921776+0000","last_clean":"2024-09-10T22:38:54.921776+0000","last_became_active":"2024-09-10T22:38:48.856155+0000","last_became_peered":"2024-09-10T22:38:48.856155+0000","last_unstale":"2024-09-10T22:38:54.921776+0000","last_undegraded":"2024-09-10T22:38:54.921776+0000","last_fullsized":"2024-09-10T22:38:54.921776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:14.631039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880696+0000","last_change":"2024-09-10T22:38:49.873562+0000","last_active":"2024-09-10T22:38:54.880696+0000","last_peered":"2024-09-10T22:38:54.880696+0000","last_clean":"2024-09-10T22:38:54.880696+0000","last_became_active":"2024-09-10T22:38:49.864062+0000","last_became_peered":"2024-09-10T22:38:49.864062+0000","last_unstale":"2024-09-10T22:38:54.880696+0000","last_undegraded":"2024-09-10T22:38:54.880696+0000","last_fullsized":"2024-09-10T22:38:54.880696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:25.174871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920712+0000","last_change":"2024-09-10T22:38:53.903054+0000","last_active":"2024-09-10T22:38:54.920712+0000","last_peered":"2024-09-10T22:38:54.920712+0000","last_clean":"2024-09-10T22:38:54.920712+0000","last_became_active":"2024-09-10T22:38:53.902428+0000","last_became_peered":"2024-09-10T22:38:53.902428+0000","last_unstale":"2024-09-10T22:38:54.920712+0000","last_undegraded":"2024-09-10T22:38:54.920712+0000","last_fullsized":"2024-09-10T22:38:54.920712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:46.628037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880327+0000","last_change":"2024-09-10T22:38:49.865192+0000","last_active":"2024-09-10T22:38:54.880327+0000","last_peered":"2024-09-10T22:38:54.880327+0000","last_clean":"2024-09-10T22:38:54.880327+0000","last_became_active":"2024-09-10T22:38:49.864716+0000","last_became_peered":"2024-09-10T22:38:49.864716+0000","last_unstale":"2024-09-10T22:38:54.880327+0000","last_undegraded":"2024-09-10T22:38:54.880327+0000","last_fullsized":"2024-09-10T22:38:54.880327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:55.123251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921503+0000","last_change":"2024-09-10T22:38:48.856397+0000","last_active":"2024-09-10T22:38:54.921503+0000","last_peered":"2024-09-10T22:38:54.921503+0000","last_clean":"2024-09-10T22:38:54.921503+0000","last_became_active":"2024-09-10T22:38:48.856073+0000","last_became_peered":"2024-09-10T22:38:48.856073+0000","last_unstale":"2024-09-10T22:38:54.921503+0000","last_undegraded":"2024-09-10T22:38:54.921503+0000","last_fullsized":"2024-09-10T22:38:54.921503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:39.081533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921189+0000","last_change":"2024-09-10T22:38:53.894114+0000","last_active":"2024-09-10T22:38:54.921189+0000","last_peered":"2024-09-10T22:38:54.921189+0000","last_clean":"2024-09-10T22:38:54.921189+0000","last_became_active":"2024-09-10T22:38:53.893814+0000","last_became_peered":"2024-09-10T22:38:53.893814+0000","last_unstale":"2024-09-10T22:38:54.921189+0000","last_undegraded":"2024-09-10T22:38:54.921189+0000","last_fullsized":"2024-09-10T22:38:54.921189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:56.732998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921915+0000","last_change":"2024-09-10T22:38:49.863144+0000","last_active":"2024-09-10T22:38:54.921915+0000","last_peered":"2024-09-10T22:38:54.921915+0000","last_clean":"2024-09-10T22:38:54.921915+0000","last_became_active":"2024-09-10T22:38:49.862085+0000","last_became_peered":"2024-09-10T22:38:49.862085+0000","last_unstale":"2024-09-10T22:38:54.921915+0000","last_undegraded":"2024-09-10T22:38:54.921915+0000","last_fullsized":"2024-09-10T22:38:54.921915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:03.094296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876526+0000","last_change":"2024-09-10T22:38:48.842046+0000","last_active":"2024-09-10T22:38:54.876526+0000","last_peered":"2024-09-10T22:38:54.876526+0000","last_clean":"2024-09-10T22:38:54.876526+0000","last_became_active":"2024-09-10T22:38:48.841395+0000","last_became_peered":"2024-09-10T22:38:48.841395+0000","last_unstale":"2024-09-10T22:38:54.876526+0000","last_undegraded":"2024-09-10T22:38:54.876526+0000","last_fullsized":"2024-09-10T22:38:54.876526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:27.834255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921402+0000","last_change":"2024-09-10T22:38:53.901790+0000","last_active":"2024-09-10T22:38:54.921402+0000","last_peered":"2024-09-10T22:38:54.921402+0000","last_clean":"2024-09-10T22:38:54.921402+0000","last_became_active":"2024-09-10T22:38:53.901365+0000","last_became_peered":"2024-09-10T22:38:53.901365+0000","last_unstale":"2024-09-10T22:38:54.921402+0000","last_undegraded":"2024-09-10T22:38:54.921402+0000","last_fullsized":"2024-09-10T22:38:54.921402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:54.134756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921530+0000","last_change":"2024-09-10T22:38:49.857384+0000","last_active":"2024-09-10T22:38:54.921530+0000","last_peered":"2024-09-10T22:38:54.921530+0000","last_clean":"2024-09-10T22:38:54.921530+0000","last_became_active":"2024-09-10T22:38:49.857072+0000","last_became_peered":"2024-09-10T22:38:49.857072+0000","last_unstale":"2024-09-10T22:38:54.921530+0000","last_undegraded":"2024-09-10T22:38:54.921530+0000","last_fullsized":"2024-09-10T22:38:54.921530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:34.910658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876365+0000","last_change":"2024-09-10T22:38:48.843182+0000","last_active":"2024-09-10T22:38:54.876365+0000","last_peered":"2024-09-10T22:38:54.876365+0000","last_clean":"2024-09-10T22:38:54.876365+0000","last_became_active":"2024-09-10T22:38:48.842923+0000","last_became_peered":"2024-09-10T22:38:48.842923+0000","last_unstale":"2024-09-10T22:38:54.876365+0000","last_undegraded":"2024-09-10T22:38:54.876365+0000","last_fullsized":"2024-09-10T22:38:54.876365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:43.650324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877435+0000","last_change":"2024-09-10T22:38:54.251266+0000","last_active":"2024-09-10T22:38:54.877435+0000","last_peered":"2024-09-10T22:38:54.877435+0000","last_clean":"2024-09-10T22:38:54.877435+0000","last_became_active":"2024-09-10T22:38:54.250869+0000","last_became_peered":"2024-09-10T22:38:54.250869+0000","last_unstale":"2024-09-10T22:38:54.877435+0000","last_undegraded":"2024-09-10T22:38:54.877435+0000","last_fullsized":"2024-09-10T22:38:54.877435+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:41.537209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921172+0000","last_change":"2024-09-10T22:38:49.845466+0000","last_active":"2024-09-10T22:38:54.921172+0000","last_peered":"2024-09-10T22:38:54.921172+0000","last_clean":"2024-09-10T22:38:54.921172+0000","last_became_active":"2024-09-10T22:38:49.844534+0000","last_became_peered":"2024-09-10T22:38:49.844534+0000","last_unstale":"2024-09-10T22:38:54.921172+0000","last_undegraded":"2024-09-10T22:38:54.921172+0000","last_fullsized":"2024-09-10T22:38:54.921172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:51.184856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920528+0000","last_change":"2024-09-10T22:38:48.856827+0000","last_active":"2024-09-10T22:38:54.920528+0000","last_peered":"2024-09-10T22:38:54.920528+0000","last_clean":"2024-09-10T22:38:54.920528+0000","last_became_active":"2024-09-10T22:38:48.856254+0000","last_became_peered":"2024-09-10T22:38:48.856254+0000","last_unstale":"2024-09-10T22:38:54.920528+0000","last_undegraded":"2024-09-10T22:38:54.920528+0000","last_fullsized":"2024-09-10T22:38:54.920528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:50.178089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921261+0000","last_change":"2024-09-10T22:38:53.901780+0000","last_active":"2024-09-10T22:38:54.921261+0000","last_peered":"2024-09-10T22:38:54.921261+0000","last_clean":"2024-09-10T22:38:54.921261+0000","last_became_active":"2024-09-10T22:38:53.901291+0000","last_became_peered":"2024-09-10T22:38:53.901291+0000","last_unstale":"2024-09-10T22:38:54.921261+0000","last_undegraded":"2024-09-10T22:38:54.921261+0000","last_fullsized":"2024-09-10T22:38:54.921261+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:15.947890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921201+0000","last_change":"2024-09-10T22:38:49.851843+0000","last_active":"2024-09-10T22:38:54.921201+0000","last_peered":"2024-09-10T22:38:54.921201+0000","last_clean":"2024-09-10T22:38:54.921201+0000","last_became_active":"2024-09-10T22:38:49.851557+0000","last_became_peered":"2024-09-10T22:38:49.851557+0000","last_unstale":"2024-09-10T22:38:54.921201+0000","last_undegraded":"2024-09-10T22:38:54.921201+0000","last_fullsized":"2024-09-10T22:38:54.921201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:06.748400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881167+0000","last_change":"2024-09-10T22:38:48.853061+0000","last_active":"2024-09-10T22:38:54.881167+0000","last_peered":"2024-09-10T22:38:54.881167+0000","last_clean":"2024-09-10T22:38:54.881167+0000","last_became_active":"2024-09-10T22:38:48.852801+0000","last_became_peered":"2024-09-10T22:38:48.852801+0000","last_unstale":"2024-09-10T22:38:54.881167+0000","last_undegraded":"2024-09-10T22:38:54.881167+0000","last_fullsized":"2024-09-10T22:38:54.881167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:15.095892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920897+0000","last_change":"2024-09-10T22:38:54.251299+0000","last_active":"2024-09-10T22:38:54.920897+0000","last_peered":"2024-09-10T22:38:54.920897+0000","last_clean":"2024-09-10T22:38:54.920897+0000","last_became_active":"2024-09-10T22:38:54.250832+0000","last_became_peered":"2024-09-10T22:38:54.250832+0000","last_unstale":"2024-09-10T22:38:54.920897+0000","last_undegraded":"2024-09-10T22:38:54.920897+0000","last_fullsized":"2024-09-10T22:38:54.920897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:58.412799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922726+0000","last_change":"2024-09-10T22:38:49.861588+0000","last_active":"2024-09-10T22:38:54.922726+0000","last_peered":"2024-09-10T22:38:54.922726+0000","last_clean":"2024-09-10T22:38:54.922726+0000","last_became_active":"2024-09-10T22:38:49.861318+0000","last_became_peered":"2024-09-10T22:38:49.861318+0000","last_unstale":"2024-09-10T22:38:54.922726+0000","last_undegraded":"2024-09-10T22:38:54.922726+0000","last_fullsized":"2024-09-10T22:38:54.922726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:17.481705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876977+0000","last_change":"2024-09-10T22:38:48.837942+0000","last_active":"2024-09-10T22:38:54.876977+0000","last_peered":"2024-09-10T22:38:54.876977+0000","last_clean":"2024-09-10T22:38:54.876977+0000","last_became_active":"2024-09-10T22:38:48.836464+0000","last_became_peered":"2024-09-10T22:38:48.836464+0000","last_unstale":"2024-09-10T22:38:54.876977+0000","last_undegraded":"2024-09-10T22:38:54.876977+0000","last_fullsized":"2024-09-10T22:38:54.876977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:08.401116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920961+0000","last_change":"2024-09-10T22:38:54.247221+0000","last_active":"2024-09-10T22:38:54.920961+0000","last_peered":"2024-09-10T22:38:54.920961+0000","last_clean":"2024-09-10T22:38:54.920961+0000","last_became_active":"2024-09-10T22:38:54.246819+0000","last_became_peered":"2024-09-10T22:38:54.246819+0000","last_unstale":"2024-09-10T22:38:54.920961+0000","last_undegraded":"2024-09-10T22:38:54.920961+0000","last_fullsized":"2024-09-10T22:38:54.920961+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:32.793677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877019+0000","last_change":"2024-09-10T22:38:49.854852+0000","last_active":"2024-09-10T22:38:54.877019+0000","last_peered":"2024-09-10T22:38:54.877019+0000","last_clean":"2024-09-10T22:38:54.877019+0000","last_became_active":"2024-09-10T22:38:49.854524+0000","last_became_peered":"2024-09-10T22:38:49.854524+0000","last_unstale":"2024-09-10T22:38:54.877019+0000","last_undegraded":"2024-09-10T22:38:54.877019+0000","last_fullsized":"2024-09-10T22:38:54.877019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:50.918432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922069+0000","last_change":"2024-09-10T22:38:48.858074+0000","last_active":"2024-09-10T22:38:54.922069+0000","last_peered":"2024-09-10T22:38:54.922069+0000","last_clean":"2024-09-10T22:38:54.922069+0000","last_became_active":"2024-09-10T22:38:48.857790+0000","last_became_peered":"2024-09-10T22:38:48.857790+0000","last_unstale":"2024-09-10T22:38:54.922069+0000","last_undegraded":"2024-09-10T22:38:54.922069+0000","last_fullsized":"2024-09-10T22:38:54.922069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:33.673133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920591+0000","last_change":"2024-09-10T22:38:54.247274+0000","last_active":"2024-09-10T22:38:54.920591+0000","last_peered":"2024-09-10T22:38:54.920591+0000","last_clean":"2024-09-10T22:38:54.920591+0000","last_became_active":"2024-09-10T22:38:54.246824+0000","last_became_peered":"2024-09-10T22:38:54.246824+0000","last_unstale":"2024-09-10T22:38:54.920591+0000","last_undegraded":"2024-09-10T22:38:54.920591+0000","last_fullsized":"2024-09-10T22:38:54.920591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:29.221197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880773+0000","last_change":"2024-09-10T22:38:49.858913+0000","last_active":"2024-09-10T22:38:54.880773+0000","last_peered":"2024-09-10T22:38:54.880773+0000","last_clean":"2024-09-10T22:38:54.880773+0000","last_became_active":"2024-09-10T22:38:49.858622+0000","last_became_peered":"2024-09-10T22:38:49.858622+0000","last_unstale":"2024-09-10T22:38:54.880773+0000","last_undegraded":"2024-09-10T22:38:54.880773+0000","last_fullsized":"2024-09-10T22:38:54.880773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:24:23.510664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877113+0000","last_change":"2024-09-10T22:38:48.839218+0000","last_active":"2024-09-10T22:38:54.877113+0000","last_peered":"2024-09-10T22:38:54.877113+0000","last_clean":"2024-09-10T22:38:54.877113+0000","last_became_active":"2024-09-10T22:38:48.838970+0000","last_became_peered":"2024-09-10T22:38:48.838970+0000","last_unstale":"2024-09-10T22:38:54.877113+0000","last_undegraded":"2024-09-10T22:38:54.877113+0000","last_fullsized":"2024-09-10T22:38:54.877113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:08.395191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876369+0000","last_change":"2024-09-10T22:38:53.898832+0000","last_active":"2024-09-10T22:38:54.876369+0000","last_peered":"2024-09-10T22:38:54.876369+0000","last_clean":"2024-09-10T22:38:54.876369+0000","last_became_active":"2024-09-10T22:38:53.898360+0000","last_became_peered":"2024-09-10T22:38:53.898360+0000","last_unstale":"2024-09-10T22:38:54.876369+0000","last_undegraded":"2024-09-10T22:38:54.876369+0000","last_fullsized":"2024-09-10T22:38:54.876369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:26.747212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921150+0000","last_change":"2024-09-10T22:38:49.852619+0000","last_active":"2024-09-10T22:38:54.921150+0000","last_peered":"2024-09-10T22:38:54.921150+0000","last_clean":"2024-09-10T22:38:54.921150+0000","last_became_active":"2024-09-10T22:38:49.852266+0000","last_became_peered":"2024-09-10T22:38:49.852266+0000","last_unstale":"2024-09-10T22:38:54.921150+0000","last_undegraded":"2024-09-10T22:38:54.921150+0000","last_fullsized":"2024-09-10T22:38:54.921150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:59.442647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881111+0000","last_change":"2024-09-10T22:38:48.851373+0000","last_active":"2024-09-10T22:38:54.881111+0000","last_peered":"2024-09-10T22:38:54.881111+0000","last_clean":"2024-09-10T22:38:54.881111+0000","last_became_active":"2024-09-10T22:38:48.850929+0000","last_became_peered":"2024-09-10T22:38:48.850929+0000","last_unstale":"2024-09-10T22:38:54.881111+0000","last_undegraded":"2024-09-10T22:38:54.881111+0000","last_fullsized":"2024-09-10T22:38:54.881111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:14.631039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877092+0000","last_change":"2024-09-10T22:38:53.905250+0000","last_active":"2024-09-10T22:38:54.877092+0000","last_peered":"2024-09-10T22:38:54.877092+0000","last_clean":"2024-09-10T22:38:54.877092+0000","last_became_active":"2024-09-10T22:38:53.904841+0000","last_became_peered":"2024-09-10T22:38:53.904841+0000","last_unstale":"2024-09-10T22:38:54.877092+0000","last_undegraded":"2024-09-10T22:38:54.877092+0000","last_fullsized":"2024-09-10T22:38:54.877092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:47.327614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876131+0000","last_change":"2024-09-10T22:38:49.852020+0000","last_active":"2024-09-10T22:38:54.876131+0000","last_peered":"2024-09-10T22:38:54.876131+0000","last_clean":"2024-09-10T22:38:54.876131+0000","last_became_active":"2024-09-10T22:38:49.851701+0000","last_became_peered":"2024-09-10T22:38:49.851701+0000","last_unstale":"2024-09-10T22:38:54.876131+0000","last_undegraded":"2024-09-10T22:38:54.876131+0000","last_fullsized":"2024-09-10T22:38:54.876131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:26.280355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.919678+0000","last_change":"2024-09-10T22:38:48.840603+0000","last_active":"2024-09-10T22:38:54.919678+0000","last_peered":"2024-09-10T22:38:54.919678+0000","last_clean":"2024-09-10T22:38:54.919678+0000","last_became_active":"2024-09-10T22:38:48.840005+0000","last_became_peered":"2024-09-10T22:38:48.840005+0000","last_unstale":"2024-09-10T22:38:54.919678+0000","last_undegraded":"2024-09-10T22:38:54.919678+0000","last_fullsized":"2024-09-10T22:38:54.919678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:25.578472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877502+0000","last_change":"2024-09-10T22:38:53.909084+0000","last_active":"2024-09-10T22:38:54.877502+0000","last_peered":"2024-09-10T22:38:54.877502+0000","last_clean":"2024-09-10T22:38:54.877502+0000","last_became_active":"2024-09-10T22:38:53.908638+0000","last_became_peered":"2024-09-10T22:38:53.908638+0000","last_unstale":"2024-09-10T22:38:54.877502+0000","last_undegraded":"2024-09-10T22:38:54.877502+0000","last_fullsized":"2024-09-10T22:38:54.877502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:39.597856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920309+0000","last_change":"2024-09-10T22:38:49.862424+0000","last_active":"2024-09-10T22:38:54.920309+0000","last_peered":"2024-09-10T22:38:54.920309+0000","last_clean":"2024-09-10T22:38:54.920309+0000","last_became_active":"2024-09-10T22:38:49.862139+0000","last_became_peered":"2024-09-10T22:38:49.862139+0000","last_unstale":"2024-09-10T22:38:54.920309+0000","last_undegraded":"2024-09-10T22:38:54.920309+0000","last_fullsized":"2024-09-10T22:38:54.920309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:25.404715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920624+0000","last_change":"2024-09-10T22:38:48.856517+0000","last_active":"2024-09-10T22:38:54.920624+0000","last_peered":"2024-09-10T22:38:54.920624+0000","last_clean":"2024-09-10T22:38:54.920624+0000","last_became_active":"2024-09-10T22:38:48.855941+0000","last_became_peered":"2024-09-10T22:38:48.855941+0000","last_unstale":"2024-09-10T22:38:54.920624+0000","last_undegraded":"2024-09-10T22:38:54.920624+0000","last_fullsized":"2024-09-10T22:38:54.920624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:58.435880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921081+0000","last_change":"2024-09-10T22:38:54.252398+0000","last_active":"2024-09-10T22:38:54.921081+0000","last_peered":"2024-09-10T22:38:54.921081+0000","last_clean":"2024-09-10T22:38:54.921081+0000","last_became_active":"2024-09-10T22:38:54.251445+0000","last_became_peered":"2024-09-10T22:38:54.251445+0000","last_unstale":"2024-09-10T22:38:54.921081+0000","last_undegraded":"2024-09-10T22:38:54.921081+0000","last_fullsized":"2024-09-10T22:38:54.921081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:30.242290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921676+0000","last_change":"2024-09-10T22:38:49.875972+0000","last_active":"2024-09-10T22:38:54.921676+0000","last_peered":"2024-09-10T22:38:54.921676+0000","last_clean":"2024-09-10T22:38:54.921676+0000","last_became_active":"2024-09-10T22:38:49.875696+0000","last_became_peered":"2024-09-10T22:38:49.875696+0000","last_unstale":"2024-09-10T22:38:54.921676+0000","last_undegraded":"2024-09-10T22:38:54.921676+0000","last_fullsized":"2024-09-10T22:38:54.921676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:40.212977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881021+0000","last_change":"2024-09-10T22:38:48.853917+0000","last_active":"2024-09-10T22:38:54.881021+0000","last_peered":"2024-09-10T22:38:54.881021+0000","last_clean":"2024-09-10T22:38:54.881021+0000","last_became_active":"2024-09-10T22:38:48.853608+0000","last_became_peered":"2024-09-10T22:38:48.853608+0000","last_unstale":"2024-09-10T22:38:54.881021+0000","last_undegraded":"2024-09-10T22:38:54.881021+0000","last_fullsized":"2024-09-10T22:38:54.881021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:00.500956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920938+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:38:54.920938+0000","last_peered":"2024-09-10T22:38:54.920938+0000","last_clean":"2024-09-10T22:38:54.920938+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:38:54.920938+0000","last_undegraded":"2024-09-10T22:38:54.920938+0000","last_fullsized":"2024-09-10T22:38:54.920938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880476+0000","last_change":"2024-09-10T22:38:54.250797+0000","last_active":"2024-09-10T22:38:54.880476+0000","last_peered":"2024-09-10T22:38:54.880476+0000","last_clean":"2024-09-10T22:38:54.880476+0000","last_became_active":"2024-09-10T22:38:54.250390+0000","last_became_peered":"2024-09-10T22:38:54.250390+0000","last_unstale":"2024-09-10T22:38:54.880476+0000","last_undegraded":"2024-09-10T22:38:54.880476+0000","last_fullsized":"2024-09-10T22:38:54.880476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:15.947890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921825+0000","last_change":"2024-09-10T22:38:49.876676+0000","last_active":"2024-09-10T22:38:54.921825+0000","last_peered":"2024-09-10T22:38:54.921825+0000","last_clean":"2024-09-10T22:38:54.921825+0000","last_became_active":"2024-09-10T22:38:49.874334+0000","last_became_peered":"2024-09-10T22:38:49.874334+0000","last_unstale":"2024-09-10T22:38:54.921825+0000","last_undegraded":"2024-09-10T22:38:54.921825+0000","last_fullsized":"2024-09-10T22:38:54.921825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:11.901564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920182+0000","last_change":"2024-09-10T22:38:48.851184+0000","last_active":"2024-09-10T22:38:54.920182+0000","last_peered":"2024-09-10T22:38:54.920182+0000","last_clean":"2024-09-10T22:38:54.920182+0000","last_became_active":"2024-09-10T22:38:48.850954+0000","last_became_peered":"2024-09-10T22:38:48.850954+0000","last_unstale":"2024-09-10T22:38:54.920182+0000","last_undegraded":"2024-09-10T22:38:54.920182+0000","last_fullsized":"2024-09-10T22:38:54.920182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:16.521277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880433+0000","last_change":"2024-09-10T22:38:54.247648+0000","last_active":"2024-09-10T22:38:54.880433+0000","last_peered":"2024-09-10T22:38:54.880433+0000","last_clean":"2024-09-10T22:38:54.880433+0000","last_became_active":"2024-09-10T22:38:54.247076+0000","last_became_peered":"2024-09-10T22:38:54.247076+0000","last_unstale":"2024-09-10T22:38:54.880433+0000","last_undegraded":"2024-09-10T22:38:54.880433+0000","last_fullsized":"2024-09-10T22:38:54.880433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:54.134756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880747+0000","last_change":"2024-09-10T22:38:49.872207+0000","last_active":"2024-09-10T22:38:54.880747+0000","last_peered":"2024-09-10T22:38:54.880747+0000","last_clean":"2024-09-10T22:38:54.880747+0000","last_became_active":"2024-09-10T22:38:49.864041+0000","last_became_peered":"2024-09-10T22:38:49.864041+0000","last_unstale":"2024-09-10T22:38:54.880747+0000","last_undegraded":"2024-09-10T22:38:54.880747+0000","last_fullsized":"2024-09-10T22:38:54.880747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:19.210276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876693+0000","last_change":"2024-09-10T22:38:48.845335+0000","last_active":"2024-09-10T22:38:54.876693+0000","last_peered":"2024-09-10T22:38:54.876693+0000","last_clean":"2024-09-10T22:38:54.876693+0000","last_became_active":"2024-09-10T22:38:48.844695+0000","last_became_peered":"2024-09-10T22:38:48.844695+0000","last_unstale":"2024-09-10T22:38:54.876693+0000","last_undegraded":"2024-09-10T22:38:54.876693+0000","last_fullsized":"2024-09-10T22:38:54.876693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:49.033938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920787+0000","last_change":"2024-09-10T22:38:53.903473+0000","last_active":"2024-09-10T22:38:54.920787+0000","last_peered":"2024-09-10T22:38:54.920787+0000","last_clean":"2024-09-10T22:38:54.920787+0000","last_became_active":"2024-09-10T22:38:53.902136+0000","last_became_peered":"2024-09-10T22:38:53.902136+0000","last_unstale":"2024-09-10T22:38:54.920787+0000","last_undegraded":"2024-09-10T22:38:54.920787+0000","last_fullsized":"2024-09-10T22:38:54.920787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:23.256602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922067+0000","last_change":"2024-09-10T22:38:49.873800+0000","last_active":"2024-09-10T22:38:54.922067+0000","last_peered":"2024-09-10T22:38:54.922067+0000","last_clean":"2024-09-10T22:38:54.922067+0000","last_became_active":"2024-09-10T22:38:49.871564+0000","last_became_peered":"2024-09-10T22:38:49.871564+0000","last_unstale":"2024-09-10T22:38:54.922067+0000","last_undegraded":"2024-09-10T22:38:54.922067+0000","last_fullsized":"2024-09-10T22:38:54.922067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:18.712686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920418+0000","last_change":"2024-09-10T22:38:48.840039+0000","last_active":"2024-09-10T22:38:54.920418+0000","last_peered":"2024-09-10T22:38:54.920418+0000","last_clean":"2024-09-10T22:38:54.920418+0000","last_became_active":"2024-09-10T22:38:48.839740+0000","last_became_peered":"2024-09-10T22:38:48.839740+0000","last_unstale":"2024-09-10T22:38:54.920418+0000","last_undegraded":"2024-09-10T22:38:54.920418+0000","last_fullsized":"2024-09-10T22:38:54.920418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:46.742902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879474+0000","last_change":"2024-09-10T22:38:54.250902+0000","last_active":"2024-09-10T22:38:54.879474+0000","last_peered":"2024-09-10T22:38:54.879474+0000","last_clean":"2024-09-10T22:38:54.879474+0000","last_became_active":"2024-09-10T22:38:54.250504+0000","last_became_peered":"2024-09-10T22:38:54.250504+0000","last_unstale":"2024-09-10T22:38:54.879474+0000","last_undegraded":"2024-09-10T22:38:54.879474+0000","last_fullsized":"2024-09-10T22:38:54.879474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:24.190512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922173+0000","last_change":"2024-09-10T22:38:49.870336+0000","last_active":"2024-09-10T22:38:54.922173+0000","last_peered":"2024-09-10T22:38:54.922173+0000","last_clean":"2024-09-10T22:38:54.922173+0000","last_became_active":"2024-09-10T22:38:49.870059+0000","last_became_peered":"2024-09-10T22:38:49.870059+0000","last_unstale":"2024-09-10T22:38:54.922173+0000","last_undegraded":"2024-09-10T22:38:54.922173+0000","last_fullsized":"2024-09-10T22:38:54.922173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:53.628621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921424+0000","last_change":"2024-09-10T22:38:48.843380+0000","last_active":"2024-09-10T22:38:54.921424+0000","last_peered":"2024-09-10T22:38:54.921424+0000","last_clean":"2024-09-10T22:38:54.921424+0000","last_became_active":"2024-09-10T22:38:48.843016+0000","last_became_peered":"2024-09-10T22:38:48.843016+0000","last_unstale":"2024-09-10T22:38:54.921424+0000","last_undegraded":"2024-09-10T22:38:54.921424+0000","last_fullsized":"2024-09-10T22:38:54.921424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:41.102824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920533+0000","last_change":"2024-09-10T22:38:53.903334+0000","last_active":"2024-09-10T22:38:54.920533+0000","last_peered":"2024-09-10T22:38:54.920533+0000","last_clean":"2024-09-10T22:38:54.920533+0000","last_became_active":"2024-09-10T22:38:53.902607+0000","last_became_peered":"2024-09-10T22:38:53.902607+0000","last_unstale":"2024-09-10T22:38:54.920533+0000","last_undegraded":"2024-09-10T22:38:54.920533+0000","last_fullsized":"2024-09-10T22:38:54.920533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:06.243501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921431+0000","last_change":"2024-09-10T22:38:49.864561+0000","last_active":"2024-09-10T22:38:54.921431+0000","last_peered":"2024-09-10T22:38:54.921431+0000","last_clean":"2024-09-10T22:38:54.921431+0000","last_became_active":"2024-09-10T22:38:49.863930+0000","last_became_peered":"2024-09-10T22:38:49.863930+0000","last_unstale":"2024-09-10T22:38:54.921431+0000","last_undegraded":"2024-09-10T22:38:54.921431+0000","last_fullsized":"2024-09-10T22:38:54.921431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:45.857292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.919529+0000","last_change":"2024-09-10T22:38:48.844675+0000","last_active":"2024-09-10T22:38:54.919529+0000","last_peered":"2024-09-10T22:38:54.919529+0000","last_clean":"2024-09-10T22:38:54.919529+0000","last_became_active":"2024-09-10T22:38:48.844321+0000","last_became_peered":"2024-09-10T22:38:48.844321+0000","last_unstale":"2024-09-10T22:38:54.919529+0000","last_undegraded":"2024-09-10T22:38:54.919529+0000","last_fullsized":"2024-09-10T22:38:54.919529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:27.985660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920890+0000","last_change":"2024-09-10T22:38:53.906658+0000","last_active":"2024-09-10T22:38:54.920890+0000","last_peered":"2024-09-10T22:38:54.920890+0000","last_clean":"2024-09-10T22:38:54.920890+0000","last_became_active":"2024-09-10T22:38:53.906243+0000","last_became_peered":"2024-09-10T22:38:53.906243+0000","last_unstale":"2024-09-10T22:38:54.920890+0000","last_undegraded":"2024-09-10T22:38:54.920890+0000","last_fullsized":"2024-09-10T22:38:54.920890+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:16.451902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879773+0000","last_change":"2024-09-10T22:38:49.853280+0000","last_active":"2024-09-10T22:38:54.879773+0000","last_peered":"2024-09-10T22:38:54.879773+0000","last_clean":"2024-09-10T22:38:54.879773+0000","last_became_active":"2024-09-10T22:38:49.853004+0000","last_became_peered":"2024-09-10T22:38:49.853004+0000","last_unstale":"2024-09-10T22:38:54.879773+0000","last_undegraded":"2024-09-10T22:38:54.879773+0000","last_fullsized":"2024-09-10T22:38:54.879773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:31.367854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879963+0000","last_change":"2024-09-10T22:38:48.842684+0000","last_active":"2024-09-10T22:38:54.879963+0000","last_peered":"2024-09-10T22:38:54.879963+0000","last_clean":"2024-09-10T22:38:54.879963+0000","last_became_active":"2024-09-10T22:38:48.842404+0000","last_became_peered":"2024-09-10T22:38:48.842404+0000","last_unstale":"2024-09-10T22:38:54.879963+0000","last_undegraded":"2024-09-10T22:38:54.879963+0000","last_fullsized":"2024-09-10T22:38:54.879963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:50.178089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922637+0000","last_change":"2024-09-10T22:38:54.251473+0000","last_active":"2024-09-10T22:38:54.922637+0000","last_peered":"2024-09-10T22:38:54.922637+0000","last_clean":"2024-09-10T22:38:54.922637+0000","last_became_active":"2024-09-10T22:38:54.250056+0000","last_became_peered":"2024-09-10T22:38:54.250056+0000","last_unstale":"2024-09-10T22:38:54.922637+0000","last_undegraded":"2024-09-10T22:38:54.922637+0000","last_fullsized":"2024-09-10T22:38:54.922637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:37.784629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921312+0000","last_change":"2024-09-10T22:38:49.871550+0000","last_active":"2024-09-10T22:38:54.921312+0000","last_peered":"2024-09-10T22:38:54.921312+0000","last_clean":"2024-09-10T22:38:54.921312+0000","last_became_active":"2024-09-10T22:38:49.870681+0000","last_became_peered":"2024-09-10T22:38:49.870681+0000","last_unstale":"2024-09-10T22:38:54.921312+0000","last_undegraded":"2024-09-10T22:38:54.921312+0000","last_fullsized":"2024-09-10T22:38:54.921312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:50.088430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880116+0000","last_change":"2024-09-10T22:38:48.855410+0000","last_active":"2024-09-10T22:38:54.880116+0000","last_peered":"2024-09-10T22:38:54.880116+0000","last_clean":"2024-09-10T22:38:54.880116+0000","last_became_active":"2024-09-10T22:38:48.855072+0000","last_became_peered":"2024-09-10T22:38:48.855072+0000","last_unstale":"2024-09-10T22:38:54.880116+0000","last_undegraded":"2024-09-10T22:38:54.880116+0000","last_fullsized":"2024-09-10T22:38:54.880116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:58.435880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922141+0000","last_change":"2024-09-10T22:38:54.247975+0000","last_active":"2024-09-10T22:38:54.922141+0000","last_peered":"2024-09-10T22:38:54.922141+0000","last_clean":"2024-09-10T22:38:54.922141+0000","last_became_active":"2024-09-10T22:38:54.246763+0000","last_became_peered":"2024-09-10T22:38:54.246763+0000","last_unstale":"2024-09-10T22:38:54.922141+0000","last_undegraded":"2024-09-10T22:38:54.922141+0000","last_fullsized":"2024-09-10T22:38:54.922141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:28.248826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920626+0000","last_change":"2024-09-10T22:38:49.857923+0000","last_active":"2024-09-10T22:38:54.920626+0000","last_peered":"2024-09-10T22:38:54.920626+0000","last_clean":"2024-09-10T22:38:54.920626+0000","last_became_active":"2024-09-10T22:38:49.855403+0000","last_became_peered":"2024-09-10T22:38:49.855403+0000","last_unstale":"2024-09-10T22:38:54.920626+0000","last_undegraded":"2024-09-10T22:38:54.920626+0000","last_fullsized":"2024-09-10T22:38:54.920626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:23.327063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921037+0000","last_change":"2024-09-10T22:38:48.849925+0000","last_active":"2024-09-10T22:38:54.921037+0000","last_peered":"2024-09-10T22:38:54.921037+0000","last_clean":"2024-09-10T22:38:54.921037+0000","last_became_active":"2024-09-10T22:38:48.849598+0000","last_became_peered":"2024-09-10T22:38:48.849598+0000","last_unstale":"2024-09-10T22:38:54.921037+0000","last_undegraded":"2024-09-10T22:38:54.921037+0000","last_fullsized":"2024-09-10T22:38:54.921037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:52.840320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880603+0000","last_change":"2024-09-10T22:38:54.250860+0000","last_active":"2024-09-10T22:38:54.880603+0000","last_peered":"2024-09-10T22:38:54.880603+0000","last_clean":"2024-09-10T22:38:54.880603+0000","last_became_active":"2024-09-10T22:38:54.250456+0000","last_became_peered":"2024-09-10T22:38:54.250456+0000","last_unstale":"2024-09-10T22:38:54.880603+0000","last_undegraded":"2024-09-10T22:38:54.880603+0000","last_fullsized":"2024-09-10T22:38:54.880603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:59.690022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921718+0000","last_change":"2024-09-10T22:38:49.867772+0000","last_active":"2024-09-10T22:38:54.921718+0000","last_peered":"2024-09-10T22:38:54.921718+0000","last_clean":"2024-09-10T22:38:54.921718+0000","last_became_active":"2024-09-10T22:38:49.867491+0000","last_became_peered":"2024-09-10T22:38:49.867491+0000","last_unstale":"2024-09-10T22:38:54.921718+0000","last_undegraded":"2024-09-10T22:38:54.921718+0000","last_fullsized":"2024-09-10T22:38:54.921718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:37.195901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:39:00.652505+0000","last_change":"2024-09-10T22:38:48.841117+0000","last_active":"2024-09-10T22:39:00.652505+0000","last_peered":"2024-09-10T22:39:00.652505+0000","last_clean":"2024-09-10T22:39:00.652505+0000","last_became_active":"2024-09-10T22:38:48.840707+0000","last_became_peered":"2024-09-10T22:38:48.840707+0000","last_unstale":"2024-09-10T22:39:00.652505+0000","last_undegraded":"2024-09-10T22:39:00.652505+0000","last_fullsized":"2024-09-10T22:39:00.652505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:58.435880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876459+0000","last_change":"2024-09-10T22:38:53.898755+0000","last_active":"2024-09-10T22:38:54.876459+0000","last_peered":"2024-09-10T22:38:54.876459+0000","last_clean":"2024-09-10T22:38:54.876459+0000","last_became_active":"2024-09-10T22:38:53.898182+0000","last_became_peered":"2024-09-10T22:38:53.898182+0000","last_unstale":"2024-09-10T22:38:54.876459+0000","last_undegraded":"2024-09-10T22:38:54.876459+0000","last_fullsized":"2024-09-10T22:38:54.876459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:45.658201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921595+0000","last_change":"2024-09-10T22:38:49.859641+0000","last_active":"2024-09-10T22:38:54.921595+0000","last_peered":"2024-09-10T22:38:54.921595+0000","last_clean":"2024-09-10T22:38:54.921595+0000","last_became_active":"2024-09-10T22:38:49.859208+0000","last_became_peered":"2024-09-10T22:38:49.859208+0000","last_unstale":"2024-09-10T22:38:54.921595+0000","last_undegraded":"2024-09-10T22:38:54.921595+0000","last_fullsized":"2024-09-10T22:38:54.921595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:40.088299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876659+0000","last_change":"2024-09-10T22:38:48.852988+0000","last_active":"2024-09-10T22:38:54.876659+0000","last_peered":"2024-09-10T22:38:54.876659+0000","last_clean":"2024-09-10T22:38:54.876659+0000","last_became_active":"2024-09-10T22:38:48.852717+0000","last_became_peered":"2024-09-10T22:38:48.852717+0000","last_unstale":"2024-09-10T22:38:54.876659+0000","last_undegraded":"2024-09-10T22:38:54.876659+0000","last_fullsized":"2024-09-10T22:38:54.876659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:26.855508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920866+0000","last_change":"2024-09-10T22:38:53.894090+0000","last_active":"2024-09-10T22:38:54.920866+0000","last_peered":"2024-09-10T22:38:54.920866+0000","last_clean":"2024-09-10T22:38:54.920866+0000","last_became_active":"2024-09-10T22:38:53.893574+0000","last_became_peered":"2024-09-10T22:38:53.893574+0000","last_unstale":"2024-09-10T22:38:54.920866+0000","last_undegraded":"2024-09-10T22:38:54.920866+0000","last_fullsized":"2024-09-10T22:38:54.920866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:49.903618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921016+0000","last_change":"2024-09-10T22:38:49.864920+0000","last_active":"2024-09-10T22:38:54.921016+0000","last_peered":"2024-09-10T22:38:54.921016+0000","last_clean":"2024-09-10T22:38:54.921016+0000","last_became_active":"2024-09-10T22:38:49.864424+0000","last_became_peered":"2024-09-10T22:38:49.864424+0000","last_unstale":"2024-09-10T22:38:54.921016+0000","last_undegraded":"2024-09-10T22:38:54.921016+0000","last_fullsized":"2024-09-10T22:38:54.921016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:19.035607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880817+0000","last_change":"2024-09-10T22:38:48.859261+0000","last_active":"2024-09-10T22:38:54.880817+0000","last_peered":"2024-09-10T22:38:54.880817+0000","last_clean":"2024-09-10T22:38:54.880817+0000","last_became_active":"2024-09-10T22:38:48.858966+0000","last_became_peered":"2024-09-10T22:38:48.858966+0000","last_unstale":"2024-09-10T22:38:54.880817+0000","last_undegraded":"2024-09-10T22:38:54.880817+0000","last_fullsized":"2024-09-10T22:38:54.880817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:15.095892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921394+0000","last_change":"2024-09-10T22:38:53.906015+0000","last_active":"2024-09-10T22:38:54.921394+0000","last_peered":"2024-09-10T22:38:54.921394+0000","last_clean":"2024-09-10T22:38:54.921394+0000","last_became_active":"2024-09-10T22:38:53.905650+0000","last_became_peered":"2024-09-10T22:38:53.905650+0000","last_unstale":"2024-09-10T22:38:54.921394+0000","last_undegraded":"2024-09-10T22:38:54.921394+0000","last_fullsized":"2024-09-10T22:38:54.921394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:41.757743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880707+0000","last_change":"2024-09-10T22:38:49.872132+0000","last_active":"2024-09-10T22:38:54.880707+0000","last_peered":"2024-09-10T22:38:54.880707+0000","last_clean":"2024-09-10T22:38:54.880707+0000","last_became_active":"2024-09-10T22:38:49.871810+0000","last_became_peered":"2024-09-10T22:38:49.871810+0000","last_unstale":"2024-09-10T22:38:54.880707+0000","last_undegraded":"2024-09-10T22:38:54.880707+0000","last_fullsized":"2024-09-10T22:38:54.880707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:17.481705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881042+0000","last_change":"2024-09-10T22:38:48.852986+0000","last_active":"2024-09-10T22:38:54.881042+0000","last_peered":"2024-09-10T22:38:54.881042+0000","last_clean":"2024-09-10T22:38:54.881042+0000","last_became_active":"2024-09-10T22:38:48.852519+0000","last_became_peered":"2024-09-10T22:38:48.852519+0000","last_unstale":"2024-09-10T22:38:54.881042+0000","last_undegraded":"2024-09-10T22:38:54.881042+0000","last_fullsized":"2024-09-10T22:38:54.881042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:00.500956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921502+0000","last_change":"2024-09-10T22:38:54.248043+0000","last_active":"2024-09-10T22:38:54.921502+0000","last_peered":"2024-09-10T22:38:54.921502+0000","last_clean":"2024-09-10T22:38:54.921502+0000","last_became_active":"2024-09-10T22:38:54.247585+0000","last_became_peered":"2024-09-10T22:38:54.247585+0000","last_unstale":"2024-09-10T22:38:54.921502+0000","last_undegraded":"2024-09-10T22:38:54.921502+0000","last_fullsized":"2024-09-10T22:38:54.921502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:17.956102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920839+0000","last_change":"2024-09-10T22:38:54.252858+0000","last_active":"2024-09-10T22:38:54.920839+0000","last_peered":"2024-09-10T22:38:54.920839+0000","last_clean":"2024-09-10T22:38:54.920839+0000","last_became_active":"2024-09-10T22:38:54.251257+0000","last_became_peered":"2024-09-10T22:38:54.251257+0000","last_unstale":"2024-09-10T22:38:54.920839+0000","last_undegraded":"2024-09-10T22:38:54.920839+0000","last_fullsized":"2024-09-10T22:38:54.920839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:24:27.556990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876243+0000","last_change":"2024-09-10T22:38:49.856861+0000","last_active":"2024-09-10T22:38:54.876243+0000","last_peered":"2024-09-10T22:38:54.876243+0000","last_clean":"2024-09-10T22:38:54.876243+0000","last_became_active":"2024-09-10T22:38:49.856585+0000","last_became_peered":"2024-09-10T22:38:49.856585+0000","last_unstale":"2024-09-10T22:38:54.876243+0000","last_undegraded":"2024-09-10T22:38:54.876243+0000","last_fullsized":"2024-09-10T22:38:54.876243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:53.022943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879803+0000","last_change":"2024-09-10T22:38:48.845774+0000","last_active":"2024-09-10T22:38:54.879803+0000","last_peered":"2024-09-10T22:38:54.879803+0000","last_clean":"2024-09-10T22:38:54.879803+0000","last_became_active":"2024-09-10T22:38:48.845377+0000","last_became_peered":"2024-09-10T22:38:48.845377+0000","last_unstale":"2024-09-10T22:38:54.879803+0000","last_undegraded":"2024-09-10T22:38:54.879803+0000","last_fullsized":"2024-09-10T22:38:54.879803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:50.178089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880779+0000","last_change":"2024-09-10T22:38:53.902490+0000","last_active":"2024-09-10T22:38:54.880779+0000","last_peered":"2024-09-10T22:38:54.880779+0000","last_clean":"2024-09-10T22:38:54.880779+0000","last_became_active":"2024-09-10T22:38:53.901598+0000","last_became_peered":"2024-09-10T22:38:53.901598+0000","last_unstale":"2024-09-10T22:38:54.880779+0000","last_undegraded":"2024-09-10T22:38:54.880779+0000","last_fullsized":"2024-09-10T22:38:54.880779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:41.242227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921373+0000","last_change":"2024-09-10T22:38:49.863394+0000","last_active":"2024-09-10T22:38:54.921373+0000","last_peered":"2024-09-10T22:38:54.921373+0000","last_clean":"2024-09-10T22:38:54.921373+0000","last_became_active":"2024-09-10T22:38:49.861032+0000","last_became_peered":"2024-09-10T22:38:49.861032+0000","last_unstale":"2024-09-10T22:38:54.921373+0000","last_undegraded":"2024-09-10T22:38:54.921373+0000","last_fullsized":"2024-09-10T22:38:54.921373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:31.367854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921736+0000","last_change":"2024-09-10T22:38:48.836017+0000","last_active":"2024-09-10T22:38:54.921736+0000","last_peered":"2024-09-10T22:38:54.921736+0000","last_clean":"2024-09-10T22:38:54.921736+0000","last_became_active":"2024-09-10T22:38:48.835739+0000","last_became_peered":"2024-09-10T22:38:48.835739+0000","last_unstale":"2024-09-10T22:38:54.921736+0000","last_undegraded":"2024-09-10T22:38:54.921736+0000","last_fullsized":"2024-09-10T22:38:54.921736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:00.479025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880538+0000","last_change":"2024-09-10T22:38:48.843526+0000","last_active":"2024-09-10T22:38:54.880538+0000","last_peered":"2024-09-10T22:38:54.880538+0000","last_clean":"2024-09-10T22:38:54.880538+0000","last_became_active":"2024-09-10T22:38:48.843248+0000","last_became_peered":"2024-09-10T22:38:48.843248+0000","last_unstale":"2024-09-10T22:38:54.880538+0000","last_undegraded":"2024-09-10T22:38:54.880538+0000","last_fullsized":"2024-09-10T22:38:54.880538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:39.081533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920942+0000","last_change":"2024-09-10T22:38:49.854189+0000","last_active":"2024-09-10T22:38:54.920942+0000","last_peered":"2024-09-10T22:38:54.920942+0000","last_clean":"2024-09-10T22:38:54.920942+0000","last_became_active":"2024-09-10T22:38:49.853954+0000","last_became_peered":"2024-09-10T22:38:49.853954+0000","last_unstale":"2024-09-10T22:38:54.920942+0000","last_undegraded":"2024-09-10T22:38:54.920942+0000","last_fullsized":"2024-09-10T22:38:54.920942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:55.123251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.919913+0000","last_change":"2024-09-10T22:38:53.912413+0000","last_active":"2024-09-10T22:38:54.919913+0000","last_peered":"2024-09-10T22:38:54.919913+0000","last_clean":"2024-09-10T22:38:54.919913+0000","last_became_active":"2024-09-10T22:38:53.904237+0000","last_became_peered":"2024-09-10T22:38:53.904237+0000","last_unstale":"2024-09-10T22:38:54.919913+0000","last_undegraded":"2024-09-10T22:38:54.919913+0000","last_fullsized":"2024-09-10T22:38:54.919913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:27.373389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921981+0000","last_change":"2024-09-10T22:38:48.853221+0000","last_active":"2024-09-10T22:38:54.921981+0000","last_peered":"2024-09-10T22:38:54.921981+0000","last_clean":"2024-09-10T22:38:54.921981+0000","last_became_active":"2024-09-10T22:38:48.852950+0000","last_became_peered":"2024-09-10T22:38:48.852950+0000","last_unstale":"2024-09-10T22:38:54.921981+0000","last_undegraded":"2024-09-10T22:38:54.921981+0000","last_fullsized":"2024-09-10T22:38:54.921981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:25.578472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920722+0000","last_change":"2024-09-10T22:38:49.851848+0000","last_active":"2024-09-10T22:38:54.920722+0000","last_peered":"2024-09-10T22:38:54.920722+0000","last_clean":"2024-09-10T22:38:54.920722+0000","last_became_active":"2024-09-10T22:38:49.851614+0000","last_became_peered":"2024-09-10T22:38:49.851614+0000","last_unstale":"2024-09-10T22:38:54.920722+0000","last_undegraded":"2024-09-10T22:38:54.920722+0000","last_fullsized":"2024-09-10T22:38:54.920722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:52.712325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922284+0000","last_change":"2024-09-10T22:38:53.910509+0000","last_active":"2024-09-10T22:38:54.922284+0000","last_peered":"2024-09-10T22:38:54.922284+0000","last_clean":"2024-09-10T22:38:54.922284+0000","last_became_active":"2024-09-10T22:38:53.910132+0000","last_became_peered":"2024-09-10T22:38:53.910132+0000","last_unstale":"2024-09-10T22:38:54.922284+0000","last_undegraded":"2024-09-10T22:38:54.922284+0000","last_fullsized":"2024-09-10T22:38:54.922284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:56.978517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879620+0000","last_change":"2024-09-10T22:38:49.859715+0000","last_active":"2024-09-10T22:38:54.879620+0000","last_peered":"2024-09-10T22:38:54.879620+0000","last_clean":"2024-09-10T22:38:54.879620+0000","last_became_active":"2024-09-10T22:38:49.859460+0000","last_became_peered":"2024-09-10T22:38:49.859460+0000","last_unstale":"2024-09-10T22:38:54.879620+0000","last_undegraded":"2024-09-10T22:38:54.879620+0000","last_fullsized":"2024-09-10T22:38:54.879620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:47.476429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.919633+0000","last_change":"2024-09-10T22:38:49.857017+0000","last_active":"2024-09-10T22:38:54.919633+0000","last_peered":"2024-09-10T22:38:54.919633+0000","last_clean":"2024-09-10T22:38:54.919633+0000","last_became_active":"2024-09-10T22:38:49.856717+0000","last_became_peered":"2024-09-10T22:38:49.856717+0000","last_unstale":"2024-09-10T22:38:54.919633+0000","last_undegraded":"2024-09-10T22:38:54.919633+0000","last_fullsized":"2024-09-10T22:38:54.919633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:40.088299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880065+0000","last_change":"2024-09-10T22:38:49.864344+0000","last_active":"2024-09-10T22:38:54.880065+0000","last_peered":"2024-09-10T22:38:54.880065+0000","last_clean":"2024-09-10T22:38:54.880065+0000","last_became_active":"2024-09-10T22:38:49.863615+0000","last_became_peered":"2024-09-10T22:38:49.863615+0000","last_unstale":"2024-09-10T22:38:54.880065+0000","last_undegraded":"2024-09-10T22:38:54.880065+0000","last_fullsized":"2024-09-10T22:38:54.880065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:17.040028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920749+0000","last_change":"2024-09-10T22:38:49.863316+0000","last_active":"2024-09-10T22:38:54.920749+0000","last_peered":"2024-09-10T22:38:54.920749+0000","last_clean":"2024-09-10T22:38:54.920749+0000","last_became_active":"2024-09-10T22:38:49.860671+0000","last_became_peered":"2024-09-10T22:38:49.860671+0000","last_unstale":"2024-09-10T22:38:54.920749+0000","last_undegraded":"2024-09-10T22:38:54.920749+0000","last_fullsized":"2024-09-10T22:38:54.920749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:31.367854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922304+0000","last_change":"2024-09-10T22:38:49.859296+0000","last_active":"2024-09-10T22:38:54.922304+0000","last_peered":"2024-09-10T22:38:54.922304+0000","last_clean":"2024-09-10T22:38:54.922304+0000","last_became_active":"2024-09-10T22:38:49.859054+0000","last_became_peered":"2024-09-10T22:38:49.859054+0000","last_unstale":"2024-09-10T22:38:54.922304+0000","last_undegraded":"2024-09-10T22:38:54.922304+0000","last_fullsized":"2024-09-10T22:38:54.922304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:06.748400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876558+0000","last_change":"2024-09-10T22:38:49.855782+0000","last_active":"2024-09-10T22:38:54.876558+0000","last_peered":"2024-09-10T22:38:54.876558+0000","last_clean":"2024-09-10T22:38:54.876558+0000","last_became_active":"2024-09-10T22:38:49.855512+0000","last_became_peered":"2024-09-10T22:38:49.855512+0000","last_unstale":"2024-09-10T22:38:54.876558+0000","last_undegraded":"2024-09-10T22:38:54.876558+0000","last_fullsized":"2024-09-10T22:38:54.876558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:36.250426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881513+0000","last_change":"2024-09-10T22:38:49.864470+0000","last_active":"2024-09-10T22:38:54.881513+0000","last_peered":"2024-09-10T22:38:54.881513+0000","last_clean":"2024-09-10T22:38:54.881513+0000","last_became_active":"2024-09-10T22:38:49.864209+0000","last_became_peered":"2024-09-10T22:38:49.864209+0000","last_unstale":"2024-09-10T22:38:54.881513+0000","last_undegraded":"2024-09-10T22:38:54.881513+0000","last_fullsized":"2024-09-10T22:38:54.881513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:19.035607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922630+0000","last_change":"2024-09-10T22:38:49.857545+0000","last_active":"2024-09-10T22:38:54.922630+0000","last_peered":"2024-09-10T22:38:54.922630+0000","last_clean":"2024-09-10T22:38:54.922630+0000","last_became_active":"2024-09-10T22:38:49.857281+0000","last_became_peered":"2024-09-10T22:38:49.857281+0000","last_unstale":"2024-09-10T22:38:54.922630+0000","last_undegraded":"2024-09-10T22:38:54.922630+0000","last_fullsized":"2024-09-10T22:38:54.922630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:04.224631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879697+0000","last_change":"2024-09-10T22:38:49.856408+0000","last_active":"2024-09-10T22:38:54.879697+0000","last_peered":"2024-09-10T22:38:54.879697+0000","last_clean":"2024-09-10T22:38:54.879697+0000","last_became_active":"2024-09-10T22:38:49.856141+0000","last_became_peered":"2024-09-10T22:38:49.856141+0000","last_unstale":"2024-09-10T22:38:54.879697+0000","last_undegraded":"2024-09-10T22:38:54.879697+0000","last_fullsized":"2024-09-10T22:38:54.879697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:42.581712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921683+0000","last_change":"2024-09-10T22:38:49.859369+0000","last_active":"2024-09-10T22:38:54.921683+0000","last_peered":"2024-09-10T22:38:54.921683+0000","last_clean":"2024-09-10T22:38:54.921683+0000","last_became_active":"2024-09-10T22:38:49.859101+0000","last_became_peered":"2024-09-10T22:38:49.859101+0000","last_unstale":"2024-09-10T22:38:54.921683+0000","last_undegraded":"2024-09-10T22:38:54.921683+0000","last_fullsized":"2024-09-10T22:38:54.921683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:55.123251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879955+0000","last_change":"2024-09-10T22:38:49.863959+0000","last_active":"2024-09-10T22:38:54.879955+0000","last_peered":"2024-09-10T22:38:54.879955+0000","last_clean":"2024-09-10T22:38:54.879955+0000","last_became_active":"2024-09-10T22:38:49.860396+0000","last_became_peered":"2024-09-10T22:38:49.860396+0000","last_unstale":"2024-09-10T22:38:54.879955+0000","last_undegraded":"2024-09-10T22:38:54.879955+0000","last_fullsized":"2024-09-10T22:38:54.879955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:48.790469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920595+0000","last_change":"2024-09-10T22:38:49.864151+0000","last_active":"2024-09-10T22:38:54.920595+0000","last_peered":"2024-09-10T22:38:54.920595+0000","last_clean":"2024-09-10T22:38:54.920595+0000","last_became_active":"2024-09-10T22:38:49.863808+0000","last_became_peered":"2024-09-10T22:38:49.863808+0000","last_unstale":"2024-09-10T22:38:54.920595+0000","last_undegraded":"2024-09-10T22:38:54.920595+0000","last_fullsized":"2024-09-10T22:38:54.920595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:09.915981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880880+0000","last_change":"2024-09-10T22:38:49.860196+0000","last_active":"2024-09-10T22:38:54.880880+0000","last_peered":"2024-09-10T22:38:54.880880+0000","last_clean":"2024-09-10T22:38:54.880880+0000","last_became_active":"2024-09-10T22:38:49.858960+0000","last_became_peered":"2024-09-10T22:38:49.858960+0000","last_unstale":"2024-09-10T22:38:54.880880+0000","last_undegraded":"2024-09-10T22:38:54.880880+0000","last_fullsized":"2024-09-10T22:38:54.880880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:07.814853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921985+0000","last_change":"2024-09-10T22:38:49.868433+0000","last_active":"2024-09-10T22:38:54.921985+0000","last_peered":"2024-09-10T22:38:54.921985+0000","last_clean":"2024-09-10T22:38:54.921985+0000","last_became_active":"2024-09-10T22:38:49.868198+0000","last_became_peered":"2024-09-10T22:38:49.868198+0000","last_unstale":"2024-09-10T22:38:54.921985+0000","last_undegraded":"2024-09-10T22:38:54.921985+0000","last_fullsized":"2024-09-10T22:38:54.921985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:06.062397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920326+0000","last_change":"2024-09-10T22:38:49.859841+0000","last_active":"2024-09-10T22:38:54.920326+0000","last_peered":"2024-09-10T22:38:54.920326+0000","last_clean":"2024-09-10T22:38:54.920326+0000","last_became_active":"2024-09-10T22:38:49.859562+0000","last_became_peered":"2024-09-10T22:38:49.859562+0000","last_unstale":"2024-09-10T22:38:54.920326+0000","last_undegraded":"2024-09-10T22:38:54.920326+0000","last_fullsized":"2024-09-10T22:38:54.920326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:52.712325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880988+0000","last_change":"2024-09-10T22:38:49.872678+0000","last_active":"2024-09-10T22:38:54.880988+0000","last_peered":"2024-09-10T22:38:54.880988+0000","last_clean":"2024-09-10T22:38:54.880988+0000","last_became_active":"2024-09-10T22:38:49.865080+0000","last_became_peered":"2024-09-10T22:38:49.865080+0000","last_unstale":"2024-09-10T22:38:54.880988+0000","last_undegraded":"2024-09-10T22:38:54.880988+0000","last_fullsized":"2024-09-10T22:38:54.880988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:12.405576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879563+0000","last_change":"2024-09-10T22:38:49.874375+0000","last_active":"2024-09-10T22:38:54.879563+0000","last_peered":"2024-09-10T22:38:54.879563+0000","last_clean":"2024-09-10T22:38:54.879563+0000","last_became_active":"2024-09-10T22:38:49.864635+0000","last_became_peered":"2024-09-10T22:38:49.864635+0000","last_unstale":"2024-09-10T22:38:54.879563+0000","last_undegraded":"2024-09-10T22:38:54.879563+0000","last_fullsized":"2024-09-10T22:38:54.879563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:06.748400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876261+0000","last_change":"2024-09-10T22:38:49.855866+0000","last_active":"2024-09-10T22:38:54.876261+0000","last_peered":"2024-09-10T22:38:54.876261+0000","last_clean":"2024-09-10T22:38:54.876261+0000","last_became_active":"2024-09-10T22:38:49.855589+0000","last_became_peered":"2024-09-10T22:38:49.855589+0000","last_unstale":"2024-09-10T22:38:54.876261+0000","last_undegraded":"2024-09-10T22:38:54.876261+0000","last_fullsized":"2024-09-10T22:38:54.876261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:01.561974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920523+0000","last_change":"2024-09-10T22:38:49.853285+0000","last_active":"2024-09-10T22:38:54.920523+0000","last_peered":"2024-09-10T22:38:54.920523+0000","last_clean":"2024-09-10T22:38:54.920523+0000","last_became_active":"2024-09-10T22:38:49.853028+0000","last_became_peered":"2024-09-10T22:38:49.853028+0000","last_unstale":"2024-09-10T22:38:54.920523+0000","last_undegraded":"2024-09-10T22:38:54.920523+0000","last_fullsized":"2024-09-10T22:38:54.920523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:47.476429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921891+0000","last_change":"2024-09-10T22:38:49.865621+0000","last_active":"2024-09-10T22:38:54.921891+0000","last_peered":"2024-09-10T22:38:54.921891+0000","last_clean":"2024-09-10T22:38:54.921891+0000","last_became_active":"2024-09-10T22:38:49.865387+0000","last_became_peered":"2024-09-10T22:38:49.865387+0000","last_unstale":"2024-09-10T22:38:54.921891+0000","last_undegraded":"2024-09-10T22:38:54.921891+0000","last_fullsized":"2024-09-10T22:38:54.921891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:19.035607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921609+0000","last_change":"2024-09-10T22:38:49.870354+0000","last_active":"2024-09-10T22:38:54.921609+0000","last_peered":"2024-09-10T22:38:54.921609+0000","last_clean":"2024-09-10T22:38:54.921609+0000","last_became_active":"2024-09-10T22:38:49.870096+0000","last_became_peered":"2024-09-10T22:38:49.870096+0000","last_unstale":"2024-09-10T22:38:54.921609+0000","last_undegraded":"2024-09-10T22:38:54.921609+0000","last_fullsized":"2024-09-10T22:38:54.921609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:15.637806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880712+0000","last_change":"2024-09-10T22:38:49.875540+0000","last_active":"2024-09-10T22:38:54.880712+0000","last_peered":"2024-09-10T22:38:54.880712+0000","last_clean":"2024-09-10T22:38:54.880712+0000","last_became_active":"2024-09-10T22:38:49.875252+0000","last_became_peered":"2024-09-10T22:38:49.875252+0000","last_unstale":"2024-09-10T22:38:54.880712+0000","last_undegraded":"2024-09-10T22:38:54.880712+0000","last_fullsized":"2024-09-10T22:38:54.880712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:34.910658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881419+0000","last_change":"2024-09-10T22:38:49.875982+0000","last_active":"2024-09-10T22:38:54.881419+0000","last_peered":"2024-09-10T22:38:54.881419+0000","last_clean":"2024-09-10T22:38:54.881419+0000","last_became_active":"2024-09-10T22:38:49.875341+0000","last_became_peered":"2024-09-10T22:38:49.875341+0000","last_unstale":"2024-09-10T22:38:54.881419+0000","last_undegraded":"2024-09-10T22:38:54.881419+0000","last_fullsized":"2024-09-10T22:38:54.881419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:06.748400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921957+0000","last_change":"2024-09-10T22:38:49.879221+0000","last_active":"2024-09-10T22:38:54.921957+0000","last_peered":"2024-09-10T22:38:54.921957+0000","last_clean":"2024-09-10T22:38:54.921957+0000","last_became_active":"2024-09-10T22:38:49.878667+0000","last_became_peered":"2024-09-10T22:38:49.878667+0000","last_unstale":"2024-09-10T22:38:54.921957+0000","last_undegraded":"2024-09-10T22:38:54.921957+0000","last_fullsized":"2024-09-10T22:38:54.921957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:17.870564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921273+0000","last_change":"2024-09-10T22:38:49.875937+0000","last_active":"2024-09-10T22:38:54.921273+0000","last_peered":"2024-09-10T22:38:54.921273+0000","last_clean":"2024-09-10T22:38:54.921273+0000","last_became_active":"2024-09-10T22:38:49.875601+0000","last_became_peered":"2024-09-10T22:38:49.875601+0000","last_unstale":"2024-09-10T22:38:54.921273+0000","last_undegraded":"2024-09-10T22:38:54.921273+0000","last_fullsized":"2024-09-10T22:38:54.921273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:47.476429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921312+0000","last_change":"2024-09-10T22:38:49.861791+0000","last_active":"2024-09-10T22:38:54.921312+0000","last_peered":"2024-09-10T22:38:54.921312+0000","last_clean":"2024-09-10T22:38:54.921312+0000","last_became_active":"2024-09-10T22:38:49.861416+0000","last_became_peered":"2024-09-10T22:38:49.861416+0000","last_unstale":"2024-09-10T22:38:54.921312+0000","last_undegraded":"2024-09-10T22:38:54.921312+0000","last_fullsized":"2024-09-10T22:38:54.921312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:52.686672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879849+0000","last_change":"2024-09-10T22:38:49.865136+0000","last_active":"2024-09-10T22:38:54.879849+0000","last_peered":"2024-09-10T22:38:54.879849+0000","last_clean":"2024-09-10T22:38:54.879849+0000","last_became_active":"2024-09-10T22:38:49.863627+0000","last_became_peered":"2024-09-10T22:38:49.863627+0000","last_unstale":"2024-09-10T22:38:54.879849+0000","last_undegraded":"2024-09-10T22:38:54.879849+0000","last_fullsized":"2024-09-10T22:38:54.879849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:03.094296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921124+0000","last_change":"2024-09-10T22:38:49.869098+0000","last_active":"2024-09-10T22:38:54.921124+0000","last_peered":"2024-09-10T22:38:54.921124+0000","last_clean":"2024-09-10T22:38:54.921124+0000","last_became_active":"2024-09-10T22:38:49.868795+0000","last_became_peered":"2024-09-10T22:38:49.868795+0000","last_unstale":"2024-09-10T22:38:54.921124+0000","last_undegraded":"2024-09-10T22:38:54.921124+0000","last_fullsized":"2024-09-10T22:38:54.921124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:54.366473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880168+0000","last_change":"2024-09-10T22:38:49.878358+0000","last_active":"2024-09-10T22:38:54.880168+0000","last_peered":"2024-09-10T22:38:54.880168+0000","last_clean":"2024-09-10T22:38:54.880168+0000","last_became_active":"2024-09-10T22:38:49.874435+0000","last_became_peered":"2024-09-10T22:38:49.874435+0000","last_unstale":"2024-09-10T22:38:54.880168+0000","last_undegraded":"2024-09-10T22:38:54.880168+0000","last_fullsized":"2024-09-10T22:38:54.880168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:02.684980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920702+0000","last_change":"2024-09-10T22:38:49.851801+0000","last_active":"2024-09-10T22:38:54.920702+0000","last_peered":"2024-09-10T22:38:54.920702+0000","last_clean":"2024-09-10T22:38:54.920702+0000","last_became_active":"2024-09-10T22:38:49.851524+0000","last_became_peered":"2024-09-10T22:38:49.851524+0000","last_unstale":"2024-09-10T22:38:54.920702+0000","last_undegraded":"2024-09-10T22:38:54.920702+0000","last_fullsized":"2024-09-10T22:38:54.920702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:34.910658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876927+0000","last_change":"2024-09-10T22:38:49.852964+0000","last_active":"2024-09-10T22:38:54.876927+0000","last_peered":"2024-09-10T22:38:54.876927+0000","last_clean":"2024-09-10T22:38:54.876927+0000","last_became_active":"2024-09-10T22:38:49.852647+0000","last_became_peered":"2024-09-10T22:38:49.852647+0000","last_unstale":"2024-09-10T22:38:54.876927+0000","last_undegraded":"2024-09-10T22:38:54.876927+0000","last_fullsized":"2024-09-10T22:38:54.876927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:16.799449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921778+0000","last_change":"2024-09-10T22:38:49.878950+0000","last_active":"2024-09-10T22:38:54.921778+0000","last_peered":"2024-09-10T22:38:54.921778+0000","last_clean":"2024-09-10T22:38:54.921778+0000","last_became_active":"2024-09-10T22:38:49.874505+0000","last_became_peered":"2024-09-10T22:38:49.874505+0000","last_unstale":"2024-09-10T22:38:54.921778+0000","last_undegraded":"2024-09-10T22:38:54.921778+0000","last_fullsized":"2024-09-10T22:38:54.921778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:46.274751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":880640,"data_stored":701507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":286720,"data_stored":110647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":110683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":282624,"data_stored":110557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":888832,"data_stored":701563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":110717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:39:14.474 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:39:14.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.655+0000 7f2170800640 1 -- 172.21.15.103:0/2746840711 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216815f330 msgr2=0x7f21680cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.655+0000 7f2170800640 1 --2- 172.21.15.103:0/2746840711 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216815f330 0x7f21680cfbc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f215c009840 tx=0x7f215c01d110 comp rx=0 tx=0).stop 2024-09-10T22:39:14.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.655+0000 7f2170800640 1 -- 172.21.15.103:0/2746840711 shutdown_connections 2024-09-10T22:39:14.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.655+0000 7f2170800640 1 --2- 172.21.15.103:0/2746840711 >> v2:172.21.15.131:3300/0 conn(0x7f21680ccaa0 0x7f21680ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.655+0000 7f2170800640 1 --2- 172.21.15.103:0/2746840711 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216815f330 0x7f21680cfbc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.655+0000 7f2170800640 1 -- 172.21.15.103:0/2746840711 >> 172.21.15.103:0/2746840711 conn(0x7f21680d1ab0 msgr2=0x7f21680d1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:14.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.655+0000 7f2170800640 1 -- 172.21.15.103:0/2746840711 shutdown_connections 2024-09-10T22:39:14.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.655+0000 7f2170800640 1 -- 172.21.15.103:0/2746840711 wait complete. 2024-09-10T22:39:14.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.655+0000 7f2170800640 1 Processor -- start 2024-09-10T22:39:14.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.655+0000 7f2170800640 1 -- start start 2024-09-10T22:39:14.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.655+0000 7f2170800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21680b2840 0x7f216814d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:14.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.655+0000 7f2170800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21680ccaa0 0x7f21680aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:14.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.655+0000 7f2170800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216815f330 0x7f21680af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:14.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.655+0000 7f2170800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2168168da0 con 0x7f21680b2840 2024-09-10T22:39:14.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.655+0000 7f2170800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2168168c20 con 0x7f21680ccaa0 2024-09-10T22:39:14.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.655+0000 7f2170800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2168168f20 con 0x7f216815f330 2024-09-10T22:39:14.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f216de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21680b2840 0x7f216814d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:14.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f216de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21680b2840 0x7f216814d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49490/0 (socket says 172.21.15.103:49490) 2024-09-10T22:39:14.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f216de00640 1 -- 172.21.15.103:0/1033751476 learned_addr learned my addr 172.21.15.103:0/1033751476 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f216e800640 1 --2- 172.21.15.103:0/1033751476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216815f330 0x7f21680af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f216d400640 1 --2- 172.21.15.103:0/1033751476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21680ccaa0 0x7f21680aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f216de00640 1 -- 172.21.15.103:0/1033751476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216815f330 msgr2=0x7f21680af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f216de00640 1 --2- 172.21.15.103:0/1033751476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216815f330 0x7f21680af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f216de00640 1 -- 172.21.15.103:0/1033751476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21680ccaa0 msgr2=0x7f21680aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f216de00640 1 --2- 172.21.15.103:0/1033751476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21680ccaa0 0x7f21680aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f216de00640 1 -- 172.21.15.103:0/1033751476 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21680c5a30 con 0x7f21680b2840 2024-09-10T22:39:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f216d400640 1 --2- 172.21.15.103:0/1033751476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21680ccaa0 0x7f21680aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:39:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f216de00640 1 --2- 172.21.15.103:0/1033751476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21680b2840 0x7f216814d2a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f215c000c10 tx=0x7f215c0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f2162000640 1 -- 172.21.15.103:0/1033751476 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c004750 con 0x7f21680b2840 2024-09-10T22:39:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f2162000640 1 -- 172.21.15.103:0/1033751476 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f215c0048f0 con 0x7f21680b2840 2024-09-10T22:39:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f2162000640 1 -- 172.21.15.103:0/1033751476 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c004ce0 con 0x7f21680b2840 2024-09-10T22:39:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f2170800640 1 -- 172.21.15.103:0/1033751476 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f216814c4e0 con 0x7f21680b2840 2024-09-10T22:39:14.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f2170800640 1 -- 172.21.15.103:0/1033751476 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f216814caa0 con 0x7f21680b2840 2024-09-10T22:39:14.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f2170800640 1 -- 172.21.15.103:0/1033751476 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21680ccf50 con 0x7f21680b2840 2024-09-10T22:39:14.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.659+0000 7f2162000640 1 -- 172.21.15.103:0/1033751476 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f215c0a8430 con 0x7f21680b2840 2024-09-10T22:39:14.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.663+0000 7f2162000640 1 --2- 172.21.15.103:0/1033751476 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f214c072610 0x7f214c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:14.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.663+0000 7f2162000640 1 -- 172.21.15.103:0/1033751476 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f215c12d5f0 con 0x7f21680b2840 2024-09-10T22:39:14.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.663+0000 7f216d400640 1 --2- 172.21.15.103:0/1033751476 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f214c072610 0x7f214c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:14.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.663+0000 7f216d400640 1 --2- 172.21.15.103:0/1033751476 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f214c072610 0x7f214c074ad0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f216813eae0 tx=0x7f2158009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:14.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.663+0000 7f2162000640 1 -- 172.21.15.103:0/1033751476 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f215c0c1030 con 0x7f21680b2840 2024-09-10T22:39:14.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.827+0000 7f2170800640 1 -- 172.21.15.103:0/1033751476 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f21680c4f30 con 0x7f214c072610 2024-09-10T22:39:14.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.831+0000 7f2162000640 1 -- 172.21.15.103:0/1033751476 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f21680c4f30 con 0x7f214c072610 2024-09-10T22:39:14.838 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:39:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.835+0000 7f2170800640 1 -- 172.21.15.103:0/1033751476 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f214c072610 msgr2=0x7f214c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.835+0000 7f2170800640 1 --2- 172.21.15.103:0/1033751476 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f214c072610 0x7f214c074ad0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f216813eae0 tx=0x7f2158009040 comp rx=0 tx=0).stop 2024-09-10T22:39:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.835+0000 7f2170800640 1 -- 172.21.15.103:0/1033751476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21680b2840 msgr2=0x7f216814d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.835+0000 7f2170800640 1 --2- 172.21.15.103:0/1033751476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21680b2840 0x7f216814d2a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f215c000c10 tx=0x7f215c0056d0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.835+0000 7f2170800640 1 -- 172.21.15.103:0/1033751476 shutdown_connections 2024-09-10T22:39:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.835+0000 7f2170800640 1 --2- 172.21.15.103:0/1033751476 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f214c072610 0x7f214c074ad0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.835+0000 7f2170800640 1 --2- 172.21.15.103:0/1033751476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216815f330 0x7f21680af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.835+0000 7f2170800640 1 --2- 172.21.15.103:0/1033751476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21680ccaa0 0x7f21680aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.835+0000 7f2170800640 1 --2- 172.21.15.103:0/1033751476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21680b2840 0x7f216814d2a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.835+0000 7f2170800640 1 -- 172.21.15.103:0/1033751476 >> 172.21.15.103:0/1033751476 conn(0x7f21680d1ab0 msgr2=0x7f21680b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.835+0000 7f2170800640 1 -- 172.21.15.103:0/1033751476 shutdown_connections 2024-09-10T22:39:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:14.835+0000 7f2170800640 1 -- 172.21.15.103:0/1033751476 wait complete. 2024-09-10T22:39:14.858 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-09-10T22:39:13.623269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219696,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755024,"statfs":{"total":773094113280,"available":772869144576,"internally_reserved":0,"allocated":3514368,"data_stored":2074472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003072"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921053+0000","last_change":"2024-09-10T22:38:48.852520+0000","last_active":"2024-09-10T22:38:54.921053+0000","last_peered":"2024-09-10T22:38:54.921053+0000","last_clean":"2024-09-10T22:38:54.921053+0000","last_became_active":"2024-09-10T22:38:48.852277+0000","last_became_peered":"2024-09-10T22:38:48.852277+0000","last_unstale":"2024-09-10T22:38:54.921053+0000","last_undegraded":"2024-09-10T22:38:54.921053+0000","last_fullsized":"2024-09-10T22:38:54.921053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:57.474446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922482+0000","last_change":"2024-09-10T22:38:49.865286+0000","last_active":"2024-09-10T22:38:54.922482+0000","last_peered":"2024-09-10T22:38:54.922482+0000","last_clean":"2024-09-10T22:38:54.922482+0000","last_became_active":"2024-09-10T22:38:49.864978+0000","last_became_peered":"2024-09-10T22:38:49.864978+0000","last_unstale":"2024-09-10T22:38:54.922482+0000","last_undegraded":"2024-09-10T22:38:54.922482+0000","last_fullsized":"2024-09-10T22:38:54.922482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:48.790469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921444+0000","last_change":"2024-09-10T22:38:54.251129+0000","last_active":"2024-09-10T22:38:54.921444+0000","last_peered":"2024-09-10T22:38:54.921444+0000","last_clean":"2024-09-10T22:38:54.921444+0000","last_became_active":"2024-09-10T22:38:54.250166+0000","last_became_peered":"2024-09-10T22:38:54.250166+0000","last_unstale":"2024-09-10T22:38:54.921444+0000","last_undegraded":"2024-09-10T22:38:54.921444+0000","last_fullsized":"2024-09-10T22:38:54.921444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:29.717841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922539+0000","last_change":"2024-09-10T22:38:48.841492+0000","last_active":"2024-09-10T22:38:54.922539+0000","last_peered":"2024-09-10T22:38:54.922539+0000","last_clean":"2024-09-10T22:38:54.922539+0000","last_became_active":"2024-09-10T22:38:48.841173+0000","last_became_peered":"2024-09-10T22:38:48.841173+0000","last_unstale":"2024-09-10T22:38:54.922539+0000","last_undegraded":"2024-09-10T22:38:54.922539+0000","last_fullsized":"2024-09-10T22:38:54.922539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:27.985660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920864+0000","last_change":"2024-09-10T22:38:49.865338+0000","last_active":"2024-09-10T22:38:54.920864+0000","last_peered":"2024-09-10T22:38:54.920864+0000","last_clean":"2024-09-10T22:38:54.920864+0000","last_became_active":"2024-09-10T22:38:49.864649+0000","last_became_peered":"2024-09-10T22:38:49.864649+0000","last_unstale":"2024-09-10T22:38:54.920864+0000","last_undegraded":"2024-09-10T22:38:54.920864+0000","last_fullsized":"2024-09-10T22:38:54.920864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:40.212977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921237+0000","last_change":"2024-09-10T22:38:53.901798+0000","last_active":"2024-09-10T22:38:54.921237+0000","last_peered":"2024-09-10T22:38:54.921237+0000","last_clean":"2024-09-10T22:38:54.921237+0000","last_became_active":"2024-09-10T22:38:53.901092+0000","last_became_peered":"2024-09-10T22:38:53.901092+0000","last_unstale":"2024-09-10T22:38:54.921237+0000","last_undegraded":"2024-09-10T22:38:54.921237+0000","last_fullsized":"2024-09-10T22:38:54.921237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:41.242227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921986+0000","last_change":"2024-09-10T22:38:48.857962+0000","last_active":"2024-09-10T22:38:54.921986+0000","last_peered":"2024-09-10T22:38:54.921986+0000","last_clean":"2024-09-10T22:38:54.921986+0000","last_became_active":"2024-09-10T22:38:48.857774+0000","last_became_peered":"2024-09-10T22:38:48.857774+0000","last_unstale":"2024-09-10T22:38:54.921986+0000","last_undegraded":"2024-09-10T22:38:54.921986+0000","last_fullsized":"2024-09-10T22:38:54.921986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:51.705558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880518+0000","last_change":"2024-09-10T22:38:49.872509+0000","last_active":"2024-09-10T22:38:54.880518+0000","last_peered":"2024-09-10T22:38:54.880518+0000","last_clean":"2024-09-10T22:38:54.880518+0000","last_became_active":"2024-09-10T22:38:49.871924+0000","last_became_peered":"2024-09-10T22:38:49.871924+0000","last_unstale":"2024-09-10T22:38:54.880518+0000","last_undegraded":"2024-09-10T22:38:54.880518+0000","last_fullsized":"2024-09-10T22:38:54.880518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:04.224631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920786+0000","last_change":"2024-09-10T22:38:53.905850+0000","last_active":"2024-09-10T22:38:54.920786+0000","last_peered":"2024-09-10T22:38:54.920786+0000","last_clean":"2024-09-10T22:38:54.920786+0000","last_became_active":"2024-09-10T22:38:53.905409+0000","last_became_peered":"2024-09-10T22:38:53.905409+0000","last_unstale":"2024-09-10T22:38:54.920786+0000","last_undegraded":"2024-09-10T22:38:54.920786+0000","last_fullsized":"2024-09-10T22:38:54.920786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:21.421252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921776+0000","last_change":"2024-09-10T22:38:48.856520+0000","last_active":"2024-09-10T22:38:54.921776+0000","last_peered":"2024-09-10T22:38:54.921776+0000","last_clean":"2024-09-10T22:38:54.921776+0000","last_became_active":"2024-09-10T22:38:48.856155+0000","last_became_peered":"2024-09-10T22:38:48.856155+0000","last_unstale":"2024-09-10T22:38:54.921776+0000","last_undegraded":"2024-09-10T22:38:54.921776+0000","last_fullsized":"2024-09-10T22:38:54.921776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:14.631039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880696+0000","last_change":"2024-09-10T22:38:49.873562+0000","last_active":"2024-09-10T22:38:54.880696+0000","last_peered":"2024-09-10T22:38:54.880696+0000","last_clean":"2024-09-10T22:38:54.880696+0000","last_became_active":"2024-09-10T22:38:49.864062+0000","last_became_peered":"2024-09-10T22:38:49.864062+0000","last_unstale":"2024-09-10T22:38:54.880696+0000","last_undegraded":"2024-09-10T22:38:54.880696+0000","last_fullsized":"2024-09-10T22:38:54.880696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:25.174871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920712+0000","last_change":"2024-09-10T22:38:53.903054+0000","last_active":"2024-09-10T22:38:54.920712+0000","last_peered":"2024-09-10T22:38:54.920712+0000","last_clean":"2024-09-10T22:38:54.920712+0000","last_became_active":"2024-09-10T22:38:53.902428+0000","last_became_peered":"2024-09-10T22:38:53.902428+0000","last_unstale":"2024-09-10T22:38:54.920712+0000","last_undegraded":"2024-09-10T22:38:54.920712+0000","last_fullsized":"2024-09-10T22:38:54.920712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:46.628037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880327+0000","last_change":"2024-09-10T22:38:49.865192+0000","last_active":"2024-09-10T22:38:54.880327+0000","last_peered":"2024-09-10T22:38:54.880327+0000","last_clean":"2024-09-10T22:38:54.880327+0000","last_became_active":"2024-09-10T22:38:49.864716+0000","last_became_peered":"2024-09-10T22:38:49.864716+0000","last_unstale":"2024-09-10T22:38:54.880327+0000","last_undegraded":"2024-09-10T22:38:54.880327+0000","last_fullsized":"2024-09-10T22:38:54.880327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:55.123251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921503+0000","last_change":"2024-09-10T22:38:48.856397+0000","last_active":"2024-09-10T22:38:54.921503+0000","last_peered":"2024-09-10T22:38:54.921503+0000","last_clean":"2024-09-10T22:38:54.921503+0000","last_became_active":"2024-09-10T22:38:48.856073+0000","last_became_peered":"2024-09-10T22:38:48.856073+0000","last_unstale":"2024-09-10T22:38:54.921503+0000","last_undegraded":"2024-09-10T22:38:54.921503+0000","last_fullsized":"2024-09-10T22:38:54.921503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:39.081533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921189+0000","last_change":"2024-09-10T22:38:53.894114+0000","last_active":"2024-09-10T22:38:54.921189+0000","last_peered":"2024-09-10T22:38:54.921189+0000","last_clean":"2024-09-10T22:38:54.921189+0000","last_became_active":"2024-09-10T22:38:53.893814+0000","last_became_peered":"2024-09-10T22:38:53.893814+0000","last_unstale":"2024-09-10T22:38:54.921189+0000","last_undegraded":"2024-09-10T22:38:54.921189+0000","last_fullsized":"2024-09-10T22:38:54.921189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:56.732998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921915+0000","last_change":"2024-09-10T22:38:49.863144+0000","last_active":"2024-09-10T22:38:54.921915+0000","last_peered":"2024-09-10T22:38:54.921915+0000","last_clean":"2024-09-10T22:38:54.921915+0000","last_became_active":"2024-09-10T22:38:49.862085+0000","last_became_peered":"2024-09-10T22:38:49.862085+0000","last_unstale":"2024-09-10T22:38:54.921915+0000","last_undegraded":"2024-09-10T22:38:54.921915+0000","last_fullsized":"2024-09-10T22:38:54.921915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:03.094296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876526+0000","last_change":"2024-09-10T22:38:48.842046+0000","last_active":"2024-09-10T22:38:54.876526+0000","last_peered":"2024-09-10T22:38:54.876526+0000","last_clean":"2024-09-10T22:38:54.876526+0000","last_became_active":"2024-09-10T22:38:48.841395+0000","last_became_peered":"2024-09-10T22:38:48.841395+0000","last_unstale":"2024-09-10T22:38:54.876526+0000","last_undegraded":"2024-09-10T22:38:54.876526+0000","last_fullsized":"2024-09-10T22:38:54.876526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:27.834255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921402+0000","last_change":"2024-09-10T22:38:53.901790+0000","last_active":"2024-09-10T22:38:54.921402+0000","last_peered":"2024-09-10T22:38:54.921402+0000","last_clean":"2024-09-10T22:38:54.921402+0000","last_became_active":"2024-09-10T22:38:53.901365+0000","last_became_peered":"2024-09-10T22:38:53.901365+0000","last_unstale":"2024-09-10T22:38:54.921402+0000","last_undegraded":"2024-09-10T22:38:54.921402+0000","last_fullsized":"2024-09-10T22:38:54.921402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:54.134756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921530+0000","last_change":"2024-09-10T22:38:49.857384+0000","last_active":"2024-09-10T22:38:54.921530+0000","last_peered":"2024-09-10T22:38:54.921530+0000","last_clean":"2024-09-10T22:38:54.921530+0000","last_became_active":"2024-09-10T22:38:49.857072+0000","last_became_peered":"2024-09-10T22:38:49.857072+0000","last_unstale":"2024-09-10T22:38:54.921530+0000","last_undegraded":"2024-09-10T22:38:54.921530+0000","last_fullsized":"2024-09-10T22:38:54.921530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:34.910658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876365+0000","last_change":"2024-09-10T22:38:48.843182+0000","last_active":"2024-09-10T22:38:54.876365+0000","last_peered":"2024-09-10T22:38:54.876365+0000","last_clean":"2024-09-10T22:38:54.876365+0000","last_became_active":"2024-09-10T22:38:48.842923+0000","last_became_peered":"2024-09-10T22:38:48.842923+0000","last_unstale":"2024-09-10T22:38:54.876365+0000","last_undegraded":"2024-09-10T22:38:54.876365+0000","last_fullsized":"2024-09-10T22:38:54.876365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:43.650324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877435+0000","last_change":"2024-09-10T22:38:54.251266+0000","last_active":"2024-09-10T22:38:54.877435+0000","last_peered":"2024-09-10T22:38:54.877435+0000","last_clean":"2024-09-10T22:38:54.877435+0000","last_became_active":"2024-09-10T22:38:54.250869+0000","last_became_peered":"2024-09-10T22:38:54.250869+0000","last_unstale":"2024-09-10T22:38:54.877435+0000","last_undegraded":"2024-09-10T22:38:54.877435+0000","last_fullsized":"2024-09-10T22:38:54.877435+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:41.537209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921172+0000","last_change":"2024-09-10T22:38:49.845466+0000","last_active":"2024-09-10T22:38:54.921172+0000","last_peered":"2024-09-10T22:38:54.921172+0000","last_clean":"2024-09-10T22:38:54.921172+0000","last_became_active":"2024-09-10T22:38:49.844534+0000","last_became_peered":"2024-09-10T22:38:49.844534+0000","last_unstale":"2024-09-10T22:38:54.921172+0000","last_undegraded":"2024-09-10T22:38:54.921172+0000","last_fullsized":"2024-09-10T22:38:54.921172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:51.184856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920528+0000","last_change":"2024-09-10T22:38:48.856827+0000","last_active":"2024-09-10T22:38:54.920528+0000","last_peered":"2024-09-10T22:38:54.920528+0000","last_clean":"2024-09-10T22:38:54.920528+0000","last_became_active":"2024-09-10T22:38:48.856254+0000","last_became_peered":"2024-09-10T22:38:48.856254+0000","last_unstale":"2024-09-10T22:38:54.920528+0000","last_undegraded":"2024-09-10T22:38:54.920528+0000","last_fullsized":"2024-09-10T22:38:54.920528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:50.178089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921261+0000","last_change":"2024-09-10T22:38:53.901780+0000","last_active":"2024-09-10T22:38:54.921261+0000","last_peered":"2024-09-10T22:38:54.921261+0000","last_clean":"2024-09-10T22:38:54.921261+0000","last_became_active":"2024-09-10T22:38:53.901291+0000","last_became_peered":"2024-09-10T22:38:53.901291+0000","last_unstale":"2024-09-10T22:38:54.921261+0000","last_undegraded":"2024-09-10T22:38:54.921261+0000","last_fullsized":"2024-09-10T22:38:54.921261+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:15.947890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921201+0000","last_change":"2024-09-10T22:38:49.851843+0000","last_active":"2024-09-10T22:38:54.921201+0000","last_peered":"2024-09-10T22:38:54.921201+0000","last_clean":"2024-09-10T22:38:54.921201+0000","last_became_active":"2024-09-10T22:38:49.851557+0000","last_became_peered":"2024-09-10T22:38:49.851557+0000","last_unstale":"2024-09-10T22:38:54.921201+0000","last_undegraded":"2024-09-10T22:38:54.921201+0000","last_fullsized":"2024-09-10T22:38:54.921201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:06.748400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881167+0000","last_change":"2024-09-10T22:38:48.853061+0000","last_active":"2024-09-10T22:38:54.881167+0000","last_peered":"2024-09-10T22:38:54.881167+0000","last_clean":"2024-09-10T22:38:54.881167+0000","last_became_active":"2024-09-10T22:38:48.852801+0000","last_became_peered":"2024-09-10T22:38:48.852801+0000","last_unstale":"2024-09-10T22:38:54.881167+0000","last_undegraded":"2024-09-10T22:38:54.881167+0000","last_fullsized":"2024-09-10T22:38:54.881167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:15.095892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920897+0000","last_change":"2024-09-10T22:38:54.251299+0000","last_active":"2024-09-10T22:38:54.920897+0000","last_peered":"2024-09-10T22:38:54.920897+0000","last_clean":"2024-09-10T22:38:54.920897+0000","last_became_active":"2024-09-10T22:38:54.250832+0000","last_became_peered":"2024-09-10T22:38:54.250832+0000","last_unstale":"2024-09-10T22:38:54.920897+0000","last_undegraded":"2024-09-10T22:38:54.920897+0000","last_fullsized":"2024-09-10T22:38:54.920897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:58.412799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922726+0000","last_change":"2024-09-10T22:38:49.861588+0000","last_active":"2024-09-10T22:38:54.922726+0000","last_peered":"2024-09-10T22:38:54.922726+0000","last_clean":"2024-09-10T22:38:54.922726+0000","last_became_active":"2024-09-10T22:38:49.861318+0000","last_became_peered":"2024-09-10T22:38:49.861318+0000","last_unstale":"2024-09-10T22:38:54.922726+0000","last_undegraded":"2024-09-10T22:38:54.922726+0000","last_fullsized":"2024-09-10T22:38:54.922726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:17.481705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876977+0000","last_change":"2024-09-10T22:38:48.837942+0000","last_active":"2024-09-10T22:38:54.876977+0000","last_peered":"2024-09-10T22:38:54.876977+0000","last_clean":"2024-09-10T22:38:54.876977+0000","last_became_active":"2024-09-10T22:38:48.836464+0000","last_became_peered":"2024-09-10T22:38:48.836464+0000","last_unstale":"2024-09-10T22:38:54.876977+0000","last_undegraded":"2024-09-10T22:38:54.876977+0000","last_fullsized":"2024-09-10T22:38:54.876977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:08.401116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920961+0000","last_change":"2024-09-10T22:38:54.247221+0000","last_active":"2024-09-10T22:38:54.920961+0000","last_peered":"2024-09-10T22:38:54.920961+0000","last_clean":"2024-09-10T22:38:54.920961+0000","last_became_active":"2024-09-10T22:38:54.246819+0000","last_became_peered":"2024-09-10T22:38:54.246819+0000","last_unstale":"2024-09-10T22:38:54.920961+0000","last_undegraded":"2024-09-10T22:38:54.920961+0000","last_fullsized":"2024-09-10T22:38:54.920961+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:32.793677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877019+0000","last_change":"2024-09-10T22:38:49.854852+0000","last_active":"2024-09-10T22:38:54.877019+0000","last_peered":"2024-09-10T22:38:54.877019+0000","last_clean":"2024-09-10T22:38:54.877019+0000","last_became_active":"2024-09-10T22:38:49.854524+0000","last_became_peered":"2024-09-10T22:38:49.854524+0000","last_unstale":"2024-09-10T22:38:54.877019+0000","last_undegraded":"2024-09-10T22:38:54.877019+0000","last_fullsized":"2024-09-10T22:38:54.877019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:50.918432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922069+0000","last_change":"2024-09-10T22:38:48.858074+0000","last_active":"2024-09-10T22:38:54.922069+0000","last_peered":"2024-09-10T22:38:54.922069+0000","last_clean":"2024-09-10T22:38:54.922069+0000","last_became_active":"2024-09-10T22:38:48.857790+0000","last_became_peered":"2024-09-10T22:38:48.857790+0000","last_unstale":"2024-09-10T22:38:54.922069+0000","last_undegraded":"2024-09-10T22:38:54.922069+0000","last_fullsized":"2024-09-10T22:38:54.922069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:33.673133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920591+0000","last_change":"2024-09-10T22:38:54.247274+0000","last_active":"2024-09-10T22:38:54.920591+0000","last_peered":"2024-09-10T22:38:54.920591+0000","last_clean":"2024-09-10T22:38:54.920591+0000","last_became_active":"2024-09-10T22:38:54.246824+0000","last_became_peered":"2024-09-10T22:38:54.246824+0000","last_unstale":"2024-09-10T22:38:54.920591+0000","last_undegraded":"2024-09-10T22:38:54.920591+0000","last_fullsized":"2024-09-10T22:38:54.920591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:29.221197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880773+0000","last_change":"2024-09-10T22:38:49.858913+0000","last_active":"2024-09-10T22:38:54.880773+0000","last_peered":"2024-09-10T22:38:54.880773+0000","last_clean":"2024-09-10T22:38:54.880773+0000","last_became_active":"2024-09-10T22:38:49.858622+0000","last_became_peered":"2024-09-10T22:38:49.858622+0000","last_unstale":"2024-09-10T22:38:54.880773+0000","last_undegraded":"2024-09-10T22:38:54.880773+0000","last_fullsized":"2024-09-10T22:38:54.880773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:24:23.510664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877113+0000","last_change":"2024-09-10T22:38:48.839218+0000","last_active":"2024-09-10T22:38:54.877113+0000","last_peered":"2024-09-10T22:38:54.877113+0000","last_clean":"2024-09-10T22:38:54.877113+0000","last_became_active":"2024-09-10T22:38:48.838970+0000","last_became_peered":"2024-09-10T22:38:48.838970+0000","last_unstale":"2024-09-10T22:38:54.877113+0000","last_undegraded":"2024-09-10T22:38:54.877113+0000","last_fullsized":"2024-09-10T22:38:54.877113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:08.395191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876369+0000","last_change":"2024-09-10T22:38:53.898832+0000","last_active":"2024-09-10T22:38:54.876369+0000","last_peered":"2024-09-10T22:38:54.876369+0000","last_clean":"2024-09-10T22:38:54.876369+0000","last_became_active":"2024-09-10T22:38:53.898360+0000","last_became_peered":"2024-09-10T22:38:53.898360+0000","last_unstale":"2024-09-10T22:38:54.876369+0000","last_undegraded":"2024-09-10T22:38:54.876369+0000","last_fullsized":"2024-09-10T22:38:54.876369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:26.747212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921150+0000","last_change":"2024-09-10T22:38:49.852619+0000","last_active":"2024-09-10T22:38:54.921150+0000","last_peered":"2024-09-10T22:38:54.921150+0000","last_clean":"2024-09-10T22:38:54.921150+0000","last_became_active":"2024-09-10T22:38:49.852266+0000","last_became_peered":"2024-09-10T22:38:49.852266+0000","last_unstale":"2024-09-10T22:38:54.921150+0000","last_undegraded":"2024-09-10T22:38:54.921150+0000","last_fullsized":"2024-09-10T22:38:54.921150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:59.442647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881111+0000","last_change":"2024-09-10T22:38:48.851373+0000","last_active":"2024-09-10T22:38:54.881111+0000","last_peered":"2024-09-10T22:38:54.881111+0000","last_clean":"2024-09-10T22:38:54.881111+0000","last_became_active":"2024-09-10T22:38:48.850929+0000","last_became_peered":"2024-09-10T22:38:48.850929+0000","last_unstale":"2024-09-10T22:38:54.881111+0000","last_undegraded":"2024-09-10T22:38:54.881111+0000","last_fullsized":"2024-09-10T22:38:54.881111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:14.631039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877092+0000","last_change":"2024-09-10T22:38:53.905250+0000","last_active":"2024-09-10T22:38:54.877092+0000","last_peered":"2024-09-10T22:38:54.877092+0000","last_clean":"2024-09-10T22:38:54.877092+0000","last_became_active":"2024-09-10T22:38:53.904841+0000","last_became_peered":"2024-09-10T22:38:53.904841+0000","last_unstale":"2024-09-10T22:38:54.877092+0000","last_undegraded":"2024-09-10T22:38:54.877092+0000","last_fullsized":"2024-09-10T22:38:54.877092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:47.327614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876131+0000","last_change":"2024-09-10T22:38:49.852020+0000","last_active":"2024-09-10T22:38:54.876131+0000","last_peered":"2024-09-10T22:38:54.876131+0000","last_clean":"2024-09-10T22:38:54.876131+0000","last_became_active":"2024-09-10T22:38:49.851701+0000","last_became_peered":"2024-09-10T22:38:49.851701+0000","last_unstale":"2024-09-10T22:38:54.876131+0000","last_undegraded":"2024-09-10T22:38:54.876131+0000","last_fullsized":"2024-09-10T22:38:54.876131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:26.280355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.919678+0000","last_change":"2024-09-10T22:38:48.840603+0000","last_active":"2024-09-10T22:38:54.919678+0000","last_peered":"2024-09-10T22:38:54.919678+0000","last_clean":"2024-09-10T22:38:54.919678+0000","last_became_active":"2024-09-10T22:38:48.840005+0000","last_became_peered":"2024-09-10T22:38:48.840005+0000","last_unstale":"2024-09-10T22:38:54.919678+0000","last_undegraded":"2024-09-10T22:38:54.919678+0000","last_fullsized":"2024-09-10T22:38:54.919678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:25.578472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.877502+0000","last_change":"2024-09-10T22:38:53.909084+0000","last_active":"2024-09-10T22:38:54.877502+0000","last_peered":"2024-09-10T22:38:54.877502+0000","last_clean":"2024-09-10T22:38:54.877502+0000","last_became_active":"2024-09-10T22:38:53.908638+0000","last_became_peered":"2024-09-10T22:38:53.908638+0000","last_unstale":"2024-09-10T22:38:54.877502+0000","last_undegraded":"2024-09-10T22:38:54.877502+0000","last_fullsized":"2024-09-10T22:38:54.877502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:39.597856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920309+0000","last_change":"2024-09-10T22:38:49.862424+0000","last_active":"2024-09-10T22:38:54.920309+0000","last_peered":"2024-09-10T22:38:54.920309+0000","last_clean":"2024-09-10T22:38:54.920309+0000","last_became_active":"2024-09-10T22:38:49.862139+0000","last_became_peered":"2024-09-10T22:38:49.862139+0000","last_unstale":"2024-09-10T22:38:54.920309+0000","last_undegraded":"2024-09-10T22:38:54.920309+0000","last_fullsized":"2024-09-10T22:38:54.920309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:25.404715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920624+0000","last_change":"2024-09-10T22:38:48.856517+0000","last_active":"2024-09-10T22:38:54.920624+0000","last_peered":"2024-09-10T22:38:54.920624+0000","last_clean":"2024-09-10T22:38:54.920624+0000","last_became_active":"2024-09-10T22:38:48.855941+0000","last_became_peered":"2024-09-10T22:38:48.855941+0000","last_unstale":"2024-09-10T22:38:54.920624+0000","last_undegraded":"2024-09-10T22:38:54.920624+0000","last_fullsized":"2024-09-10T22:38:54.920624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:58.435880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921081+0000","last_change":"2024-09-10T22:38:54.252398+0000","last_active":"2024-09-10T22:38:54.921081+0000","last_peered":"2024-09-10T22:38:54.921081+0000","last_clean":"2024-09-10T22:38:54.921081+0000","last_became_active":"2024-09-10T22:38:54.251445+0000","last_became_peered":"2024-09-10T22:38:54.251445+0000","last_unstale":"2024-09-10T22:38:54.921081+0000","last_undegraded":"2024-09-10T22:38:54.921081+0000","last_fullsized":"2024-09-10T22:38:54.921081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:30.242290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921676+0000","last_change":"2024-09-10T22:38:49.875972+0000","last_active":"2024-09-10T22:38:54.921676+0000","last_peered":"2024-09-10T22:38:54.921676+0000","last_clean":"2024-09-10T22:38:54.921676+0000","last_became_active":"2024-09-10T22:38:49.875696+0000","last_became_peered":"2024-09-10T22:38:49.875696+0000","last_unstale":"2024-09-10T22:38:54.921676+0000","last_undegraded":"2024-09-10T22:38:54.921676+0000","last_fullsized":"2024-09-10T22:38:54.921676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:40.212977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881021+0000","last_change":"2024-09-10T22:38:48.853917+0000","last_active":"2024-09-10T22:38:54.881021+0000","last_peered":"2024-09-10T22:38:54.881021+0000","last_clean":"2024-09-10T22:38:54.881021+0000","last_became_active":"2024-09-10T22:38:48.853608+0000","last_became_peered":"2024-09-10T22:38:48.853608+0000","last_unstale":"2024-09-10T22:38:54.881021+0000","last_undegraded":"2024-09-10T22:38:54.881021+0000","last_fullsized":"2024-09-10T22:38:54.881021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:00.500956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920938+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:38:54.920938+0000","last_peered":"2024-09-10T22:38:54.920938+0000","last_clean":"2024-09-10T22:38:54.920938+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:38:54.920938+0000","last_undegraded":"2024-09-10T22:38:54.920938+0000","last_fullsized":"2024-09-10T22:38:54.920938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880476+0000","last_change":"2024-09-10T22:38:54.250797+0000","last_active":"2024-09-10T22:38:54.880476+0000","last_peered":"2024-09-10T22:38:54.880476+0000","last_clean":"2024-09-10T22:38:54.880476+0000","last_became_active":"2024-09-10T22:38:54.250390+0000","last_became_peered":"2024-09-10T22:38:54.250390+0000","last_unstale":"2024-09-10T22:38:54.880476+0000","last_undegraded":"2024-09-10T22:38:54.880476+0000","last_fullsized":"2024-09-10T22:38:54.880476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:15.947890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921825+0000","last_change":"2024-09-10T22:38:49.876676+0000","last_active":"2024-09-10T22:38:54.921825+0000","last_peered":"2024-09-10T22:38:54.921825+0000","last_clean":"2024-09-10T22:38:54.921825+0000","last_became_active":"2024-09-10T22:38:49.874334+0000","last_became_peered":"2024-09-10T22:38:49.874334+0000","last_unstale":"2024-09-10T22:38:54.921825+0000","last_undegraded":"2024-09-10T22:38:54.921825+0000","last_fullsized":"2024-09-10T22:38:54.921825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:11.901564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920182+0000","last_change":"2024-09-10T22:38:48.851184+0000","last_active":"2024-09-10T22:38:54.920182+0000","last_peered":"2024-09-10T22:38:54.920182+0000","last_clean":"2024-09-10T22:38:54.920182+0000","last_became_active":"2024-09-10T22:38:48.850954+0000","last_became_peered":"2024-09-10T22:38:48.850954+0000","last_unstale":"2024-09-10T22:38:54.920182+0000","last_undegraded":"2024-09-10T22:38:54.920182+0000","last_fullsized":"2024-09-10T22:38:54.920182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:16.521277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880433+0000","last_change":"2024-09-10T22:38:54.247648+0000","last_active":"2024-09-10T22:38:54.880433+0000","last_peered":"2024-09-10T22:38:54.880433+0000","last_clean":"2024-09-10T22:38:54.880433+0000","last_became_active":"2024-09-10T22:38:54.247076+0000","last_became_peered":"2024-09-10T22:38:54.247076+0000","last_unstale":"2024-09-10T22:38:54.880433+0000","last_undegraded":"2024-09-10T22:38:54.880433+0000","last_fullsized":"2024-09-10T22:38:54.880433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:54.134756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880747+0000","last_change":"2024-09-10T22:38:49.872207+0000","last_active":"2024-09-10T22:38:54.880747+0000","last_peered":"2024-09-10T22:38:54.880747+0000","last_clean":"2024-09-10T22:38:54.880747+0000","last_became_active":"2024-09-10T22:38:49.864041+0000","last_became_peered":"2024-09-10T22:38:49.864041+0000","last_unstale":"2024-09-10T22:38:54.880747+0000","last_undegraded":"2024-09-10T22:38:54.880747+0000","last_fullsized":"2024-09-10T22:38:54.880747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:19.210276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876693+0000","last_change":"2024-09-10T22:38:48.845335+0000","last_active":"2024-09-10T22:38:54.876693+0000","last_peered":"2024-09-10T22:38:54.876693+0000","last_clean":"2024-09-10T22:38:54.876693+0000","last_became_active":"2024-09-10T22:38:48.844695+0000","last_became_peered":"2024-09-10T22:38:48.844695+0000","last_unstale":"2024-09-10T22:38:54.876693+0000","last_undegraded":"2024-09-10T22:38:54.876693+0000","last_fullsized":"2024-09-10T22:38:54.876693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:49.033938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920787+0000","last_change":"2024-09-10T22:38:53.903473+0000","last_active":"2024-09-10T22:38:54.920787+0000","last_peered":"2024-09-10T22:38:54.920787+0000","last_clean":"2024-09-10T22:38:54.920787+0000","last_became_active":"2024-09-10T22:38:53.902136+0000","last_became_peered":"2024-09-10T22:38:53.902136+0000","last_unstale":"2024-09-10T22:38:54.920787+0000","last_undegraded":"2024-09-10T22:38:54.920787+0000","last_fullsized":"2024-09-10T22:38:54.920787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:23.256602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922067+0000","last_change":"2024-09-10T22:38:49.873800+0000","last_active":"2024-09-10T22:38:54.922067+0000","last_peered":"2024-09-10T22:38:54.922067+0000","last_clean":"2024-09-10T22:38:54.922067+0000","last_became_active":"2024-09-10T22:38:49.871564+0000","last_became_peered":"2024-09-10T22:38:49.871564+0000","last_unstale":"2024-09-10T22:38:54.922067+0000","last_undegraded":"2024-09-10T22:38:54.922067+0000","last_fullsized":"2024-09-10T22:38:54.922067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:18.712686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920418+0000","last_change":"2024-09-10T22:38:48.840039+0000","last_active":"2024-09-10T22:38:54.920418+0000","last_peered":"2024-09-10T22:38:54.920418+0000","last_clean":"2024-09-10T22:38:54.920418+0000","last_became_active":"2024-09-10T22:38:48.839740+0000","last_became_peered":"2024-09-10T22:38:48.839740+0000","last_unstale":"2024-09-10T22:38:54.920418+0000","last_undegraded":"2024-09-10T22:38:54.920418+0000","last_fullsized":"2024-09-10T22:38:54.920418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:46.742902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879474+0000","last_change":"2024-09-10T22:38:54.250902+0000","last_active":"2024-09-10T22:38:54.879474+0000","last_peered":"2024-09-10T22:38:54.879474+0000","last_clean":"2024-09-10T22:38:54.879474+0000","last_became_active":"2024-09-10T22:38:54.250504+0000","last_became_peered":"2024-09-10T22:38:54.250504+0000","last_unstale":"2024-09-10T22:38:54.879474+0000","last_undegraded":"2024-09-10T22:38:54.879474+0000","last_fullsized":"2024-09-10T22:38:54.879474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:24.190512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922173+0000","last_change":"2024-09-10T22:38:49.870336+0000","last_active":"2024-09-10T22:38:54.922173+0000","last_peered":"2024-09-10T22:38:54.922173+0000","last_clean":"2024-09-10T22:38:54.922173+0000","last_became_active":"2024-09-10T22:38:49.870059+0000","last_became_peered":"2024-09-10T22:38:49.870059+0000","last_unstale":"2024-09-10T22:38:54.922173+0000","last_undegraded":"2024-09-10T22:38:54.922173+0000","last_fullsized":"2024-09-10T22:38:54.922173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:53.628621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921424+0000","last_change":"2024-09-10T22:38:48.843380+0000","last_active":"2024-09-10T22:38:54.921424+0000","last_peered":"2024-09-10T22:38:54.921424+0000","last_clean":"2024-09-10T22:38:54.921424+0000","last_became_active":"2024-09-10T22:38:48.843016+0000","last_became_peered":"2024-09-10T22:38:48.843016+0000","last_unstale":"2024-09-10T22:38:54.921424+0000","last_undegraded":"2024-09-10T22:38:54.921424+0000","last_fullsized":"2024-09-10T22:38:54.921424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:41.102824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920533+0000","last_change":"2024-09-10T22:38:53.903334+0000","last_active":"2024-09-10T22:38:54.920533+0000","last_peered":"2024-09-10T22:38:54.920533+0000","last_clean":"2024-09-10T22:38:54.920533+0000","last_became_active":"2024-09-10T22:38:53.902607+0000","last_became_peered":"2024-09-10T22:38:53.902607+0000","last_unstale":"2024-09-10T22:38:54.920533+0000","last_undegraded":"2024-09-10T22:38:54.920533+0000","last_fullsized":"2024-09-10T22:38:54.920533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:06.243501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921431+0000","last_change":"2024-09-10T22:38:49.864561+0000","last_active":"2024-09-10T22:38:54.921431+0000","last_peered":"2024-09-10T22:38:54.921431+0000","last_clean":"2024-09-10T22:38:54.921431+0000","last_became_active":"2024-09-10T22:38:49.863930+0000","last_became_peered":"2024-09-10T22:38:49.863930+0000","last_unstale":"2024-09-10T22:38:54.921431+0000","last_undegraded":"2024-09-10T22:38:54.921431+0000","last_fullsized":"2024-09-10T22:38:54.921431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:45.857292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.919529+0000","last_change":"2024-09-10T22:38:48.844675+0000","last_active":"2024-09-10T22:38:54.919529+0000","last_peered":"2024-09-10T22:38:54.919529+0000","last_clean":"2024-09-10T22:38:54.919529+0000","last_became_active":"2024-09-10T22:38:48.844321+0000","last_became_peered":"2024-09-10T22:38:48.844321+0000","last_unstale":"2024-09-10T22:38:54.919529+0000","last_undegraded":"2024-09-10T22:38:54.919529+0000","last_fullsized":"2024-09-10T22:38:54.919529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:27.985660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920890+0000","last_change":"2024-09-10T22:38:53.906658+0000","last_active":"2024-09-10T22:38:54.920890+0000","last_peered":"2024-09-10T22:38:54.920890+0000","last_clean":"2024-09-10T22:38:54.920890+0000","last_became_active":"2024-09-10T22:38:53.906243+0000","last_became_peered":"2024-09-10T22:38:53.906243+0000","last_unstale":"2024-09-10T22:38:54.920890+0000","last_undegraded":"2024-09-10T22:38:54.920890+0000","last_fullsized":"2024-09-10T22:38:54.920890+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:16.451902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879773+0000","last_change":"2024-09-10T22:38:49.853280+0000","last_active":"2024-09-10T22:38:54.879773+0000","last_peered":"2024-09-10T22:38:54.879773+0000","last_clean":"2024-09-10T22:38:54.879773+0000","last_became_active":"2024-09-10T22:38:49.853004+0000","last_became_peered":"2024-09-10T22:38:49.853004+0000","last_unstale":"2024-09-10T22:38:54.879773+0000","last_undegraded":"2024-09-10T22:38:54.879773+0000","last_fullsized":"2024-09-10T22:38:54.879773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:31.367854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879963+0000","last_change":"2024-09-10T22:38:48.842684+0000","last_active":"2024-09-10T22:38:54.879963+0000","last_peered":"2024-09-10T22:38:54.879963+0000","last_clean":"2024-09-10T22:38:54.879963+0000","last_became_active":"2024-09-10T22:38:48.842404+0000","last_became_peered":"2024-09-10T22:38:48.842404+0000","last_unstale":"2024-09-10T22:38:54.879963+0000","last_undegraded":"2024-09-10T22:38:54.879963+0000","last_fullsized":"2024-09-10T22:38:54.879963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:50.178089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922637+0000","last_change":"2024-09-10T22:38:54.251473+0000","last_active":"2024-09-10T22:38:54.922637+0000","last_peered":"2024-09-10T22:38:54.922637+0000","last_clean":"2024-09-10T22:38:54.922637+0000","last_became_active":"2024-09-10T22:38:54.250056+0000","last_became_peered":"2024-09-10T22:38:54.250056+0000","last_unstale":"2024-09-10T22:38:54.922637+0000","last_undegraded":"2024-09-10T22:38:54.922637+0000","last_fullsized":"2024-09-10T22:38:54.922637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:37.784629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921312+0000","last_change":"2024-09-10T22:38:49.871550+0000","last_active":"2024-09-10T22:38:54.921312+0000","last_peered":"2024-09-10T22:38:54.921312+0000","last_clean":"2024-09-10T22:38:54.921312+0000","last_became_active":"2024-09-10T22:38:49.870681+0000","last_became_peered":"2024-09-10T22:38:49.870681+0000","last_unstale":"2024-09-10T22:38:54.921312+0000","last_undegraded":"2024-09-10T22:38:54.921312+0000","last_fullsized":"2024-09-10T22:38:54.921312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:50.088430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880116+0000","last_change":"2024-09-10T22:38:48.855410+0000","last_active":"2024-09-10T22:38:54.880116+0000","last_peered":"2024-09-10T22:38:54.880116+0000","last_clean":"2024-09-10T22:38:54.880116+0000","last_became_active":"2024-09-10T22:38:48.855072+0000","last_became_peered":"2024-09-10T22:38:48.855072+0000","last_unstale":"2024-09-10T22:38:54.880116+0000","last_undegraded":"2024-09-10T22:38:54.880116+0000","last_fullsized":"2024-09-10T22:38:54.880116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:58.435880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922141+0000","last_change":"2024-09-10T22:38:54.247975+0000","last_active":"2024-09-10T22:38:54.922141+0000","last_peered":"2024-09-10T22:38:54.922141+0000","last_clean":"2024-09-10T22:38:54.922141+0000","last_became_active":"2024-09-10T22:38:54.246763+0000","last_became_peered":"2024-09-10T22:38:54.246763+0000","last_unstale":"2024-09-10T22:38:54.922141+0000","last_undegraded":"2024-09-10T22:38:54.922141+0000","last_fullsized":"2024-09-10T22:38:54.922141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:28.248826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920626+0000","last_change":"2024-09-10T22:38:49.857923+0000","last_active":"2024-09-10T22:38:54.920626+0000","last_peered":"2024-09-10T22:38:54.920626+0000","last_clean":"2024-09-10T22:38:54.920626+0000","last_became_active":"2024-09-10T22:38:49.855403+0000","last_became_peered":"2024-09-10T22:38:49.855403+0000","last_unstale":"2024-09-10T22:38:54.920626+0000","last_undegraded":"2024-09-10T22:38:54.920626+0000","last_fullsized":"2024-09-10T22:38:54.920626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:23.327063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921037+0000","last_change":"2024-09-10T22:38:48.849925+0000","last_active":"2024-09-10T22:38:54.921037+0000","last_peered":"2024-09-10T22:38:54.921037+0000","last_clean":"2024-09-10T22:38:54.921037+0000","last_became_active":"2024-09-10T22:38:48.849598+0000","last_became_peered":"2024-09-10T22:38:48.849598+0000","last_unstale":"2024-09-10T22:38:54.921037+0000","last_undegraded":"2024-09-10T22:38:54.921037+0000","last_fullsized":"2024-09-10T22:38:54.921037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:52.840320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880603+0000","last_change":"2024-09-10T22:38:54.250860+0000","last_active":"2024-09-10T22:38:54.880603+0000","last_peered":"2024-09-10T22:38:54.880603+0000","last_clean":"2024-09-10T22:38:54.880603+0000","last_became_active":"2024-09-10T22:38:54.250456+0000","last_became_peered":"2024-09-10T22:38:54.250456+0000","last_unstale":"2024-09-10T22:38:54.880603+0000","last_undegraded":"2024-09-10T22:38:54.880603+0000","last_fullsized":"2024-09-10T22:38:54.880603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:59.690022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921718+0000","last_change":"2024-09-10T22:38:49.867772+0000","last_active":"2024-09-10T22:38:54.921718+0000","last_peered":"2024-09-10T22:38:54.921718+0000","last_clean":"2024-09-10T22:38:54.921718+0000","last_became_active":"2024-09-10T22:38:49.867491+0000","last_became_peered":"2024-09-10T22:38:49.867491+0000","last_unstale":"2024-09-10T22:38:54.921718+0000","last_undegraded":"2024-09-10T22:38:54.921718+0000","last_fullsized":"2024-09-10T22:38:54.921718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:37.195901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:39:00.652505+0000","last_change":"2024-09-10T22:38:48.841117+0000","last_active":"2024-09-10T22:39:00.652505+0000","last_peered":"2024-09-10T22:39:00.652505+0000","last_clean":"2024-09-10T22:39:00.652505+0000","last_became_active":"2024-09-10T22:38:48.840707+0000","last_became_peered":"2024-09-10T22:38:48.840707+0000","last_unstale":"2024-09-10T22:39:00.652505+0000","last_undegraded":"2024-09-10T22:39:00.652505+0000","last_fullsized":"2024-09-10T22:39:00.652505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:58.435880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876459+0000","last_change":"2024-09-10T22:38:53.898755+0000","last_active":"2024-09-10T22:38:54.876459+0000","last_peered":"2024-09-10T22:38:54.876459+0000","last_clean":"2024-09-10T22:38:54.876459+0000","last_became_active":"2024-09-10T22:38:53.898182+0000","last_became_peered":"2024-09-10T22:38:53.898182+0000","last_unstale":"2024-09-10T22:38:54.876459+0000","last_undegraded":"2024-09-10T22:38:54.876459+0000","last_fullsized":"2024-09-10T22:38:54.876459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:45.658201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921595+0000","last_change":"2024-09-10T22:38:49.859641+0000","last_active":"2024-09-10T22:38:54.921595+0000","last_peered":"2024-09-10T22:38:54.921595+0000","last_clean":"2024-09-10T22:38:54.921595+0000","last_became_active":"2024-09-10T22:38:49.859208+0000","last_became_peered":"2024-09-10T22:38:49.859208+0000","last_unstale":"2024-09-10T22:38:54.921595+0000","last_undegraded":"2024-09-10T22:38:54.921595+0000","last_fullsized":"2024-09-10T22:38:54.921595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:40.088299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876659+0000","last_change":"2024-09-10T22:38:48.852988+0000","last_active":"2024-09-10T22:38:54.876659+0000","last_peered":"2024-09-10T22:38:54.876659+0000","last_clean":"2024-09-10T22:38:54.876659+0000","last_became_active":"2024-09-10T22:38:48.852717+0000","last_became_peered":"2024-09-10T22:38:48.852717+0000","last_unstale":"2024-09-10T22:38:54.876659+0000","last_undegraded":"2024-09-10T22:38:54.876659+0000","last_fullsized":"2024-09-10T22:38:54.876659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:26.855508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920866+0000","last_change":"2024-09-10T22:38:53.894090+0000","last_active":"2024-09-10T22:38:54.920866+0000","last_peered":"2024-09-10T22:38:54.920866+0000","last_clean":"2024-09-10T22:38:54.920866+0000","last_became_active":"2024-09-10T22:38:53.893574+0000","last_became_peered":"2024-09-10T22:38:53.893574+0000","last_unstale":"2024-09-10T22:38:54.920866+0000","last_undegraded":"2024-09-10T22:38:54.920866+0000","last_fullsized":"2024-09-10T22:38:54.920866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:49.903618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921016+0000","last_change":"2024-09-10T22:38:49.864920+0000","last_active":"2024-09-10T22:38:54.921016+0000","last_peered":"2024-09-10T22:38:54.921016+0000","last_clean":"2024-09-10T22:38:54.921016+0000","last_became_active":"2024-09-10T22:38:49.864424+0000","last_became_peered":"2024-09-10T22:38:49.864424+0000","last_unstale":"2024-09-10T22:38:54.921016+0000","last_undegraded":"2024-09-10T22:38:54.921016+0000","last_fullsized":"2024-09-10T22:38:54.921016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:19.035607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880817+0000","last_change":"2024-09-10T22:38:48.859261+0000","last_active":"2024-09-10T22:38:54.880817+0000","last_peered":"2024-09-10T22:38:54.880817+0000","last_clean":"2024-09-10T22:38:54.880817+0000","last_became_active":"2024-09-10T22:38:48.858966+0000","last_became_peered":"2024-09-10T22:38:48.858966+0000","last_unstale":"2024-09-10T22:38:54.880817+0000","last_undegraded":"2024-09-10T22:38:54.880817+0000","last_fullsized":"2024-09-10T22:38:54.880817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:15.095892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921394+0000","last_change":"2024-09-10T22:38:53.906015+0000","last_active":"2024-09-10T22:38:54.921394+0000","last_peered":"2024-09-10T22:38:54.921394+0000","last_clean":"2024-09-10T22:38:54.921394+0000","last_became_active":"2024-09-10T22:38:53.905650+0000","last_became_peered":"2024-09-10T22:38:53.905650+0000","last_unstale":"2024-09-10T22:38:54.921394+0000","last_undegraded":"2024-09-10T22:38:54.921394+0000","last_fullsized":"2024-09-10T22:38:54.921394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:41.757743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880707+0000","last_change":"2024-09-10T22:38:49.872132+0000","last_active":"2024-09-10T22:38:54.880707+0000","last_peered":"2024-09-10T22:38:54.880707+0000","last_clean":"2024-09-10T22:38:54.880707+0000","last_became_active":"2024-09-10T22:38:49.871810+0000","last_became_peered":"2024-09-10T22:38:49.871810+0000","last_unstale":"2024-09-10T22:38:54.880707+0000","last_undegraded":"2024-09-10T22:38:54.880707+0000","last_fullsized":"2024-09-10T22:38:54.880707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:17.481705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881042+0000","last_change":"2024-09-10T22:38:48.852986+0000","last_active":"2024-09-10T22:38:54.881042+0000","last_peered":"2024-09-10T22:38:54.881042+0000","last_clean":"2024-09-10T22:38:54.881042+0000","last_became_active":"2024-09-10T22:38:48.852519+0000","last_became_peered":"2024-09-10T22:38:48.852519+0000","last_unstale":"2024-09-10T22:38:54.881042+0000","last_undegraded":"2024-09-10T22:38:54.881042+0000","last_fullsized":"2024-09-10T22:38:54.881042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:00.500956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921502+0000","last_change":"2024-09-10T22:38:54.248043+0000","last_active":"2024-09-10T22:38:54.921502+0000","last_peered":"2024-09-10T22:38:54.921502+0000","last_clean":"2024-09-10T22:38:54.921502+0000","last_became_active":"2024-09-10T22:38:54.247585+0000","last_became_peered":"2024-09-10T22:38:54.247585+0000","last_unstale":"2024-09-10T22:38:54.921502+0000","last_undegraded":"2024-09-10T22:38:54.921502+0000","last_fullsized":"2024-09-10T22:38:54.921502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:17.956102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920839+0000","last_change":"2024-09-10T22:38:54.252858+0000","last_active":"2024-09-10T22:38:54.920839+0000","last_peered":"2024-09-10T22:38:54.920839+0000","last_clean":"2024-09-10T22:38:54.920839+0000","last_became_active":"2024-09-10T22:38:54.251257+0000","last_became_peered":"2024-09-10T22:38:54.251257+0000","last_unstale":"2024-09-10T22:38:54.920839+0000","last_undegraded":"2024-09-10T22:38:54.920839+0000","last_fullsized":"2024-09-10T22:38:54.920839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:24:27.556990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876243+0000","last_change":"2024-09-10T22:38:49.856861+0000","last_active":"2024-09-10T22:38:54.876243+0000","last_peered":"2024-09-10T22:38:54.876243+0000","last_clean":"2024-09-10T22:38:54.876243+0000","last_became_active":"2024-09-10T22:38:49.856585+0000","last_became_peered":"2024-09-10T22:38:49.856585+0000","last_unstale":"2024-09-10T22:38:54.876243+0000","last_undegraded":"2024-09-10T22:38:54.876243+0000","last_fullsized":"2024-09-10T22:38:54.876243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:53.022943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879803+0000","last_change":"2024-09-10T22:38:48.845774+0000","last_active":"2024-09-10T22:38:54.879803+0000","last_peered":"2024-09-10T22:38:54.879803+0000","last_clean":"2024-09-10T22:38:54.879803+0000","last_became_active":"2024-09-10T22:38:48.845377+0000","last_became_peered":"2024-09-10T22:38:48.845377+0000","last_unstale":"2024-09-10T22:38:54.879803+0000","last_undegraded":"2024-09-10T22:38:54.879803+0000","last_fullsized":"2024-09-10T22:38:54.879803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:50.178089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880779+0000","last_change":"2024-09-10T22:38:53.902490+0000","last_active":"2024-09-10T22:38:54.880779+0000","last_peered":"2024-09-10T22:38:54.880779+0000","last_clean":"2024-09-10T22:38:54.880779+0000","last_became_active":"2024-09-10T22:38:53.901598+0000","last_became_peered":"2024-09-10T22:38:53.901598+0000","last_unstale":"2024-09-10T22:38:54.880779+0000","last_undegraded":"2024-09-10T22:38:54.880779+0000","last_fullsized":"2024-09-10T22:38:54.880779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:41.242227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921373+0000","last_change":"2024-09-10T22:38:49.863394+0000","last_active":"2024-09-10T22:38:54.921373+0000","last_peered":"2024-09-10T22:38:54.921373+0000","last_clean":"2024-09-10T22:38:54.921373+0000","last_became_active":"2024-09-10T22:38:49.861032+0000","last_became_peered":"2024-09-10T22:38:49.861032+0000","last_unstale":"2024-09-10T22:38:54.921373+0000","last_undegraded":"2024-09-10T22:38:54.921373+0000","last_fullsized":"2024-09-10T22:38:54.921373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:31.367854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921736+0000","last_change":"2024-09-10T22:38:48.836017+0000","last_active":"2024-09-10T22:38:54.921736+0000","last_peered":"2024-09-10T22:38:54.921736+0000","last_clean":"2024-09-10T22:38:54.921736+0000","last_became_active":"2024-09-10T22:38:48.835739+0000","last_became_peered":"2024-09-10T22:38:48.835739+0000","last_unstale":"2024-09-10T22:38:54.921736+0000","last_undegraded":"2024-09-10T22:38:54.921736+0000","last_fullsized":"2024-09-10T22:38:54.921736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:00.479025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880538+0000","last_change":"2024-09-10T22:38:48.843526+0000","last_active":"2024-09-10T22:38:54.880538+0000","last_peered":"2024-09-10T22:38:54.880538+0000","last_clean":"2024-09-10T22:38:54.880538+0000","last_became_active":"2024-09-10T22:38:48.843248+0000","last_became_peered":"2024-09-10T22:38:48.843248+0000","last_unstale":"2024-09-10T22:38:54.880538+0000","last_undegraded":"2024-09-10T22:38:54.880538+0000","last_fullsized":"2024-09-10T22:38:54.880538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:39.081533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920942+0000","last_change":"2024-09-10T22:38:49.854189+0000","last_active":"2024-09-10T22:38:54.920942+0000","last_peered":"2024-09-10T22:38:54.920942+0000","last_clean":"2024-09-10T22:38:54.920942+0000","last_became_active":"2024-09-10T22:38:49.853954+0000","last_became_peered":"2024-09-10T22:38:49.853954+0000","last_unstale":"2024-09-10T22:38:54.920942+0000","last_undegraded":"2024-09-10T22:38:54.920942+0000","last_fullsized":"2024-09-10T22:38:54.920942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:55.123251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.919913+0000","last_change":"2024-09-10T22:38:53.912413+0000","last_active":"2024-09-10T22:38:54.919913+0000","last_peered":"2024-09-10T22:38:54.919913+0000","last_clean":"2024-09-10T22:38:54.919913+0000","last_became_active":"2024-09-10T22:38:53.904237+0000","last_became_peered":"2024-09-10T22:38:53.904237+0000","last_unstale":"2024-09-10T22:38:54.919913+0000","last_undegraded":"2024-09-10T22:38:54.919913+0000","last_fullsized":"2024-09-10T22:38:54.919913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:27.373389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921981+0000","last_change":"2024-09-10T22:38:48.853221+0000","last_active":"2024-09-10T22:38:54.921981+0000","last_peered":"2024-09-10T22:38:54.921981+0000","last_clean":"2024-09-10T22:38:54.921981+0000","last_became_active":"2024-09-10T22:38:48.852950+0000","last_became_peered":"2024-09-10T22:38:48.852950+0000","last_unstale":"2024-09-10T22:38:54.921981+0000","last_undegraded":"2024-09-10T22:38:54.921981+0000","last_fullsized":"2024-09-10T22:38:54.921981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:47.809355+0000","last_clean_scrub_stamp":"2024-09-10T22:38:47.809355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:25.578472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920722+0000","last_change":"2024-09-10T22:38:49.851848+0000","last_active":"2024-09-10T22:38:54.920722+0000","last_peered":"2024-09-10T22:38:54.920722+0000","last_clean":"2024-09-10T22:38:54.920722+0000","last_became_active":"2024-09-10T22:38:49.851614+0000","last_became_peered":"2024-09-10T22:38:49.851614+0000","last_unstale":"2024-09-10T22:38:54.920722+0000","last_undegraded":"2024-09-10T22:38:54.920722+0000","last_fullsized":"2024-09-10T22:38:54.920722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:52.712325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922284+0000","last_change":"2024-09-10T22:38:53.910509+0000","last_active":"2024-09-10T22:38:54.922284+0000","last_peered":"2024-09-10T22:38:54.922284+0000","last_clean":"2024-09-10T22:38:54.922284+0000","last_became_active":"2024-09-10T22:38:53.910132+0000","last_became_peered":"2024-09-10T22:38:53.910132+0000","last_unstale":"2024-09-10T22:38:54.922284+0000","last_undegraded":"2024-09-10T22:38:54.922284+0000","last_fullsized":"2024-09-10T22:38:54.922284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:52.862447+0000","last_clean_scrub_stamp":"2024-09-10T22:38:52.862447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:56.978517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879620+0000","last_change":"2024-09-10T22:38:49.859715+0000","last_active":"2024-09-10T22:38:54.879620+0000","last_peered":"2024-09-10T22:38:54.879620+0000","last_clean":"2024-09-10T22:38:54.879620+0000","last_became_active":"2024-09-10T22:38:49.859460+0000","last_became_peered":"2024-09-10T22:38:49.859460+0000","last_unstale":"2024-09-10T22:38:54.879620+0000","last_undegraded":"2024-09-10T22:38:54.879620+0000","last_fullsized":"2024-09-10T22:38:54.879620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:47.476429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.919633+0000","last_change":"2024-09-10T22:38:49.857017+0000","last_active":"2024-09-10T22:38:54.919633+0000","last_peered":"2024-09-10T22:38:54.919633+0000","last_clean":"2024-09-10T22:38:54.919633+0000","last_became_active":"2024-09-10T22:38:49.856717+0000","last_became_peered":"2024-09-10T22:38:49.856717+0000","last_unstale":"2024-09-10T22:38:54.919633+0000","last_undegraded":"2024-09-10T22:38:54.919633+0000","last_fullsized":"2024-09-10T22:38:54.919633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:40.088299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880065+0000","last_change":"2024-09-10T22:38:49.864344+0000","last_active":"2024-09-10T22:38:54.880065+0000","last_peered":"2024-09-10T22:38:54.880065+0000","last_clean":"2024-09-10T22:38:54.880065+0000","last_became_active":"2024-09-10T22:38:49.863615+0000","last_became_peered":"2024-09-10T22:38:49.863615+0000","last_unstale":"2024-09-10T22:38:54.880065+0000","last_undegraded":"2024-09-10T22:38:54.880065+0000","last_fullsized":"2024-09-10T22:38:54.880065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:17.040028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920749+0000","last_change":"2024-09-10T22:38:49.863316+0000","last_active":"2024-09-10T22:38:54.920749+0000","last_peered":"2024-09-10T22:38:54.920749+0000","last_clean":"2024-09-10T22:38:54.920749+0000","last_became_active":"2024-09-10T22:38:49.860671+0000","last_became_peered":"2024-09-10T22:38:49.860671+0000","last_unstale":"2024-09-10T22:38:54.920749+0000","last_undegraded":"2024-09-10T22:38:54.920749+0000","last_fullsized":"2024-09-10T22:38:54.920749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:31.367854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922304+0000","last_change":"2024-09-10T22:38:49.859296+0000","last_active":"2024-09-10T22:38:54.922304+0000","last_peered":"2024-09-10T22:38:54.922304+0000","last_clean":"2024-09-10T22:38:54.922304+0000","last_became_active":"2024-09-10T22:38:49.859054+0000","last_became_peered":"2024-09-10T22:38:49.859054+0000","last_unstale":"2024-09-10T22:38:54.922304+0000","last_undegraded":"2024-09-10T22:38:54.922304+0000","last_fullsized":"2024-09-10T22:38:54.922304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:06.748400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876558+0000","last_change":"2024-09-10T22:38:49.855782+0000","last_active":"2024-09-10T22:38:54.876558+0000","last_peered":"2024-09-10T22:38:54.876558+0000","last_clean":"2024-09-10T22:38:54.876558+0000","last_became_active":"2024-09-10T22:38:49.855512+0000","last_became_peered":"2024-09-10T22:38:49.855512+0000","last_unstale":"2024-09-10T22:38:54.876558+0000","last_undegraded":"2024-09-10T22:38:54.876558+0000","last_fullsized":"2024-09-10T22:38:54.876558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:36.250426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881513+0000","last_change":"2024-09-10T22:38:49.864470+0000","last_active":"2024-09-10T22:38:54.881513+0000","last_peered":"2024-09-10T22:38:54.881513+0000","last_clean":"2024-09-10T22:38:54.881513+0000","last_became_active":"2024-09-10T22:38:49.864209+0000","last_became_peered":"2024-09-10T22:38:49.864209+0000","last_unstale":"2024-09-10T22:38:54.881513+0000","last_undegraded":"2024-09-10T22:38:54.881513+0000","last_fullsized":"2024-09-10T22:38:54.881513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:19.035607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.922630+0000","last_change":"2024-09-10T22:38:49.857545+0000","last_active":"2024-09-10T22:38:54.922630+0000","last_peered":"2024-09-10T22:38:54.922630+0000","last_clean":"2024-09-10T22:38:54.922630+0000","last_became_active":"2024-09-10T22:38:49.857281+0000","last_became_peered":"2024-09-10T22:38:49.857281+0000","last_unstale":"2024-09-10T22:38:54.922630+0000","last_undegraded":"2024-09-10T22:38:54.922630+0000","last_fullsized":"2024-09-10T22:38:54.922630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:04.224631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879697+0000","last_change":"2024-09-10T22:38:49.856408+0000","last_active":"2024-09-10T22:38:54.879697+0000","last_peered":"2024-09-10T22:38:54.879697+0000","last_clean":"2024-09-10T22:38:54.879697+0000","last_became_active":"2024-09-10T22:38:49.856141+0000","last_became_peered":"2024-09-10T22:38:49.856141+0000","last_unstale":"2024-09-10T22:38:54.879697+0000","last_undegraded":"2024-09-10T22:38:54.879697+0000","last_fullsized":"2024-09-10T22:38:54.879697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:42.581712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921683+0000","last_change":"2024-09-10T22:38:49.859369+0000","last_active":"2024-09-10T22:38:54.921683+0000","last_peered":"2024-09-10T22:38:54.921683+0000","last_clean":"2024-09-10T22:38:54.921683+0000","last_became_active":"2024-09-10T22:38:49.859101+0000","last_became_peered":"2024-09-10T22:38:49.859101+0000","last_unstale":"2024-09-10T22:38:54.921683+0000","last_undegraded":"2024-09-10T22:38:54.921683+0000","last_fullsized":"2024-09-10T22:38:54.921683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:55.123251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879955+0000","last_change":"2024-09-10T22:38:49.863959+0000","last_active":"2024-09-10T22:38:54.879955+0000","last_peered":"2024-09-10T22:38:54.879955+0000","last_clean":"2024-09-10T22:38:54.879955+0000","last_became_active":"2024-09-10T22:38:49.860396+0000","last_became_peered":"2024-09-10T22:38:49.860396+0000","last_unstale":"2024-09-10T22:38:54.879955+0000","last_undegraded":"2024-09-10T22:38:54.879955+0000","last_fullsized":"2024-09-10T22:38:54.879955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:48.790469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920595+0000","last_change":"2024-09-10T22:38:49.864151+0000","last_active":"2024-09-10T22:38:54.920595+0000","last_peered":"2024-09-10T22:38:54.920595+0000","last_clean":"2024-09-10T22:38:54.920595+0000","last_became_active":"2024-09-10T22:38:49.863808+0000","last_became_peered":"2024-09-10T22:38:49.863808+0000","last_unstale":"2024-09-10T22:38:54.920595+0000","last_undegraded":"2024-09-10T22:38:54.920595+0000","last_fullsized":"2024-09-10T22:38:54.920595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:09.915981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880880+0000","last_change":"2024-09-10T22:38:49.860196+0000","last_active":"2024-09-10T22:38:54.880880+0000","last_peered":"2024-09-10T22:38:54.880880+0000","last_clean":"2024-09-10T22:38:54.880880+0000","last_became_active":"2024-09-10T22:38:49.858960+0000","last_became_peered":"2024-09-10T22:38:49.858960+0000","last_unstale":"2024-09-10T22:38:54.880880+0000","last_undegraded":"2024-09-10T22:38:54.880880+0000","last_fullsized":"2024-09-10T22:38:54.880880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:07.814853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921985+0000","last_change":"2024-09-10T22:38:49.868433+0000","last_active":"2024-09-10T22:38:54.921985+0000","last_peered":"2024-09-10T22:38:54.921985+0000","last_clean":"2024-09-10T22:38:54.921985+0000","last_became_active":"2024-09-10T22:38:49.868198+0000","last_became_peered":"2024-09-10T22:38:49.868198+0000","last_unstale":"2024-09-10T22:38:54.921985+0000","last_undegraded":"2024-09-10T22:38:54.921985+0000","last_fullsized":"2024-09-10T22:38:54.921985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:06.062397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920326+0000","last_change":"2024-09-10T22:38:49.859841+0000","last_active":"2024-09-10T22:38:54.920326+0000","last_peered":"2024-09-10T22:38:54.920326+0000","last_clean":"2024-09-10T22:38:54.920326+0000","last_became_active":"2024-09-10T22:38:49.859562+0000","last_became_peered":"2024-09-10T22:38:49.859562+0000","last_unstale":"2024-09-10T22:38:54.920326+0000","last_undegraded":"2024-09-10T22:38:54.920326+0000","last_fullsized":"2024-09-10T22:38:54.920326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:52.712325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880988+0000","last_change":"2024-09-10T22:38:49.872678+0000","last_active":"2024-09-10T22:38:54.880988+0000","last_peered":"2024-09-10T22:38:54.880988+0000","last_clean":"2024-09-10T22:38:54.880988+0000","last_became_active":"2024-09-10T22:38:49.865080+0000","last_became_peered":"2024-09-10T22:38:49.865080+0000","last_unstale":"2024-09-10T22:38:54.880988+0000","last_undegraded":"2024-09-10T22:38:54.880988+0000","last_fullsized":"2024-09-10T22:38:54.880988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:12.405576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879563+0000","last_change":"2024-09-10T22:38:49.874375+0000","last_active":"2024-09-10T22:38:54.879563+0000","last_peered":"2024-09-10T22:38:54.879563+0000","last_clean":"2024-09-10T22:38:54.879563+0000","last_became_active":"2024-09-10T22:38:49.864635+0000","last_became_peered":"2024-09-10T22:38:49.864635+0000","last_unstale":"2024-09-10T22:38:54.879563+0000","last_undegraded":"2024-09-10T22:38:54.879563+0000","last_fullsized":"2024-09-10T22:38:54.879563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:06.748400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876261+0000","last_change":"2024-09-10T22:38:49.855866+0000","last_active":"2024-09-10T22:38:54.876261+0000","last_peered":"2024-09-10T22:38:54.876261+0000","last_clean":"2024-09-10T22:38:54.876261+0000","last_became_active":"2024-09-10T22:38:49.855589+0000","last_became_peered":"2024-09-10T22:38:49.855589+0000","last_unstale":"2024-09-10T22:38:54.876261+0000","last_undegraded":"2024-09-10T22:38:54.876261+0000","last_fullsized":"2024-09-10T22:38:54.876261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:01.561974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920523+0000","last_change":"2024-09-10T22:38:49.853285+0000","last_active":"2024-09-10T22:38:54.920523+0000","last_peered":"2024-09-10T22:38:54.920523+0000","last_clean":"2024-09-10T22:38:54.920523+0000","last_became_active":"2024-09-10T22:38:49.853028+0000","last_became_peered":"2024-09-10T22:38:49.853028+0000","last_unstale":"2024-09-10T22:38:54.920523+0000","last_undegraded":"2024-09-10T22:38:54.920523+0000","last_fullsized":"2024-09-10T22:38:54.920523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:47.476429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921891+0000","last_change":"2024-09-10T22:38:49.865621+0000","last_active":"2024-09-10T22:38:54.921891+0000","last_peered":"2024-09-10T22:38:54.921891+0000","last_clean":"2024-09-10T22:38:54.921891+0000","last_became_active":"2024-09-10T22:38:49.865387+0000","last_became_peered":"2024-09-10T22:38:49.865387+0000","last_unstale":"2024-09-10T22:38:54.921891+0000","last_undegraded":"2024-09-10T22:38:54.921891+0000","last_fullsized":"2024-09-10T22:38:54.921891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:19.035607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921609+0000","last_change":"2024-09-10T22:38:49.870354+0000","last_active":"2024-09-10T22:38:54.921609+0000","last_peered":"2024-09-10T22:38:54.921609+0000","last_clean":"2024-09-10T22:38:54.921609+0000","last_became_active":"2024-09-10T22:38:49.870096+0000","last_became_peered":"2024-09-10T22:38:49.870096+0000","last_unstale":"2024-09-10T22:38:54.921609+0000","last_undegraded":"2024-09-10T22:38:54.921609+0000","last_fullsized":"2024-09-10T22:38:54.921609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:15.637806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880712+0000","last_change":"2024-09-10T22:38:49.875540+0000","last_active":"2024-09-10T22:38:54.880712+0000","last_peered":"2024-09-10T22:38:54.880712+0000","last_clean":"2024-09-10T22:38:54.880712+0000","last_became_active":"2024-09-10T22:38:49.875252+0000","last_became_peered":"2024-09-10T22:38:49.875252+0000","last_unstale":"2024-09-10T22:38:54.880712+0000","last_undegraded":"2024-09-10T22:38:54.880712+0000","last_fullsized":"2024-09-10T22:38:54.880712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:34.910658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.881419+0000","last_change":"2024-09-10T22:38:49.875982+0000","last_active":"2024-09-10T22:38:54.881419+0000","last_peered":"2024-09-10T22:38:54.881419+0000","last_clean":"2024-09-10T22:38:54.881419+0000","last_became_active":"2024-09-10T22:38:49.875341+0000","last_became_peered":"2024-09-10T22:38:49.875341+0000","last_unstale":"2024-09-10T22:38:54.881419+0000","last_undegraded":"2024-09-10T22:38:54.881419+0000","last_fullsized":"2024-09-10T22:38:54.881419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:06.748400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921957+0000","last_change":"2024-09-10T22:38:49.879221+0000","last_active":"2024-09-10T22:38:54.921957+0000","last_peered":"2024-09-10T22:38:54.921957+0000","last_clean":"2024-09-10T22:38:54.921957+0000","last_became_active":"2024-09-10T22:38:49.878667+0000","last_became_peered":"2024-09-10T22:38:49.878667+0000","last_unstale":"2024-09-10T22:38:54.921957+0000","last_undegraded":"2024-09-10T22:38:54.921957+0000","last_fullsized":"2024-09-10T22:38:54.921957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:17.870564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921273+0000","last_change":"2024-09-10T22:38:49.875937+0000","last_active":"2024-09-10T22:38:54.921273+0000","last_peered":"2024-09-10T22:38:54.921273+0000","last_clean":"2024-09-10T22:38:54.921273+0000","last_became_active":"2024-09-10T22:38:49.875601+0000","last_became_peered":"2024-09-10T22:38:49.875601+0000","last_unstale":"2024-09-10T22:38:54.921273+0000","last_undegraded":"2024-09-10T22:38:54.921273+0000","last_fullsized":"2024-09-10T22:38:54.921273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:47.476429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921312+0000","last_change":"2024-09-10T22:38:49.861791+0000","last_active":"2024-09-10T22:38:54.921312+0000","last_peered":"2024-09-10T22:38:54.921312+0000","last_clean":"2024-09-10T22:38:54.921312+0000","last_became_active":"2024-09-10T22:38:49.861416+0000","last_became_peered":"2024-09-10T22:38:49.861416+0000","last_unstale":"2024-09-10T22:38:54.921312+0000","last_undegraded":"2024-09-10T22:38:54.921312+0000","last_fullsized":"2024-09-10T22:38:54.921312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:52.686672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.879849+0000","last_change":"2024-09-10T22:38:49.865136+0000","last_active":"2024-09-10T22:38:54.879849+0000","last_peered":"2024-09-10T22:38:54.879849+0000","last_clean":"2024-09-10T22:38:54.879849+0000","last_became_active":"2024-09-10T22:38:49.863627+0000","last_became_peered":"2024-09-10T22:38:49.863627+0000","last_unstale":"2024-09-10T22:38:54.879849+0000","last_undegraded":"2024-09-10T22:38:54.879849+0000","last_fullsized":"2024-09-10T22:38:54.879849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:03.094296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921124+0000","last_change":"2024-09-10T22:38:49.869098+0000","last_active":"2024-09-10T22:38:54.921124+0000","last_peered":"2024-09-10T22:38:54.921124+0000","last_clean":"2024-09-10T22:38:54.921124+0000","last_became_active":"2024-09-10T22:38:49.868795+0000","last_became_peered":"2024-09-10T22:38:49.868795+0000","last_unstale":"2024-09-10T22:38:54.921124+0000","last_undegraded":"2024-09-10T22:38:54.921124+0000","last_fullsized":"2024-09-10T22:38:54.921124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:54.366473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.880168+0000","last_change":"2024-09-10T22:38:49.878358+0000","last_active":"2024-09-10T22:38:54.880168+0000","last_peered":"2024-09-10T22:38:54.880168+0000","last_clean":"2024-09-10T22:38:54.880168+0000","last_became_active":"2024-09-10T22:38:49.874435+0000","last_became_peered":"2024-09-10T22:38:49.874435+0000","last_unstale":"2024-09-10T22:38:54.880168+0000","last_undegraded":"2024-09-10T22:38:54.880168+0000","last_fullsized":"2024-09-10T22:38:54.880168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:02.684980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.920702+0000","last_change":"2024-09-10T22:38:49.851801+0000","last_active":"2024-09-10T22:38:54.920702+0000","last_peered":"2024-09-10T22:38:54.920702+0000","last_clean":"2024-09-10T22:38:54.920702+0000","last_became_active":"2024-09-10T22:38:49.851524+0000","last_became_peered":"2024-09-10T22:38:49.851524+0000","last_unstale":"2024-09-10T22:38:54.920702+0000","last_undegraded":"2024-09-10T22:38:54.920702+0000","last_fullsized":"2024-09-10T22:38:54.920702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:34.910658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.876927+0000","last_change":"2024-09-10T22:38:49.852964+0000","last_active":"2024-09-10T22:38:54.876927+0000","last_peered":"2024-09-10T22:38:54.876927+0000","last_clean":"2024-09-10T22:38:54.876927+0000","last_became_active":"2024-09-10T22:38:49.852647+0000","last_became_peered":"2024-09-10T22:38:49.852647+0000","last_unstale":"2024-09-10T22:38:54.876927+0000","last_undegraded":"2024-09-10T22:38:54.876927+0000","last_fullsized":"2024-09-10T22:38:54.876927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:16.799449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T22:38:54.921778+0000","last_change":"2024-09-10T22:38:49.878950+0000","last_active":"2024-09-10T22:38:54.921778+0000","last_peered":"2024-09-10T22:38:54.921778+0000","last_clean":"2024-09-10T22:38:54.921778+0000","last_became_active":"2024-09-10T22:38:49.874505+0000","last_became_peered":"2024-09-10T22:38:49.874505+0000","last_unstale":"2024-09-10T22:38:54.921778+0000","last_undegraded":"2024-09-10T22:38:54.921778+0000","last_fullsized":"2024-09-10T22:38:54.921778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:48.816121+0000","last_clean_scrub_stamp":"2024-09-10T22:38:48.816121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:46.274751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":880640,"data_stored":701507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":286720,"data_stored":110647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":110683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":282624,"data_stored":110557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":888832,"data_stored":701563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":110717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:39:14.863 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T22:39:14.863 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T22:39:14.864 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T22:39:14.864 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T22:39:15.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.039+0000 7f3787200640 1 -- 172.21.15.103:0/2145172945 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f378015b9e0 msgr2=0x7f37800cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:15.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.039+0000 7f3787200640 1 --2- 172.21.15.103:0/2145172945 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f378015b9e0 0x7f37800cc970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3770009900 tx=0x7f377001c8e0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f3787200640 1 -- 172.21.15.103:0/2145172945 shutdown_connections 2024-09-10T22:39:15.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f3787200640 1 --2- 172.21.15.103:0/2145172945 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37800ad8f0 0x7f37800cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f3787200640 1 --2- 172.21.15.103:0/2145172945 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f378015b9e0 0x7f37800cc970 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f3787200640 1 -- 172.21.15.103:0/2145172945 >> 172.21.15.103:0/2145172945 conn(0x7f37800b1c00 msgr2=0x7f37800b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:15.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f3787200640 1 -- 172.21.15.103:0/2145172945 shutdown_connections 2024-09-10T22:39:15.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f3787200640 1 -- 172.21.15.103:0/2145172945 wait complete. 2024-09-10T22:39:15.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f3787200640 1 Processor -- start 2024-09-10T22:39:15.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f3787200640 1 -- start start 2024-09-10T22:39:15.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f3787200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37800ad8f0 0x7f3780157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f3787200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37800ae180 0x7f37801fbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f3787200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f378015b9e0 0x7f37801f7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f3787200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3780168ea0 con 0x7f37800ad8f0 2024-09-10T22:39:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f3787200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3780168d20 con 0x7f378015b9e0 2024-09-10T22:39:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f3787200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3780169020 con 0x7f37800ae180 2024-09-10T22:39:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f377fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37800ad8f0 0x7f3780157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f377fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37800ad8f0 0x7f3780157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49512/0 (socket says 172.21.15.103:49512) 2024-09-10T22:39:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f377fe00640 1 -- 172.21.15.103:0/8541255 learned_addr learned my addr 172.21.15.103:0/8541255 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f3777400640 1 --2- 172.21.15.103:0/8541255 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37800ae180 0x7f37801fbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f3785200640 1 --2- 172.21.15.103:0/8541255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f378015b9e0 0x7f37801f7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f377fe00640 1 -- 172.21.15.103:0/8541255 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37800ae180 msgr2=0x7f37801fbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:15.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f377fe00640 1 --2- 172.21.15.103:0/8541255 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37800ae180 0x7f37801fbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f377fe00640 1 -- 172.21.15.103:0/8541255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f378015b9e0 msgr2=0x7f37801f7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:15.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f377fe00640 1 --2- 172.21.15.103:0/8541255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f378015b9e0 0x7f37801f7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f377fe00640 1 -- 172.21.15.103:0/8541255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37801f8100 con 0x7f37800ad8f0 2024-09-10T22:39:15.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f377fe00640 1 --2- 172.21.15.103:0/8541255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37800ad8f0 0x7f3780157e90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3770009850 tx=0x7f3770005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:15.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f377cc00640 1 -- 172.21.15.103:0/8541255 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37700b2040 con 0x7f37800ad8f0 2024-09-10T22:39:15.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f377cc00640 1 -- 172.21.15.103:0/8541255 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37700a5c40 con 0x7f37800ad8f0 2024-09-10T22:39:15.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f377cc00640 1 -- 172.21.15.103:0/8541255 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3770005030 con 0x7f37800ad8f0 2024-09-10T22:39:15.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f3787200640 1 -- 172.21.15.103:0/8541255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37801f83e0 con 0x7f37800ad8f0 2024-09-10T22:39:15.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.043+0000 7f3787200640 1 -- 172.21.15.103:0/8541255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37801f89a0 con 0x7f37800ad8f0 2024-09-10T22:39:15.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.047+0000 7f3787200640 1 -- 172.21.15.103:0/8541255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f378015f470 con 0x7f37800ad8f0 2024-09-10T22:39:15.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.047+0000 7f377cc00640 1 -- 172.21.15.103:0/8541255 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f37700051d0 con 0x7f37800ad8f0 2024-09-10T22:39:15.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.047+0000 7f377cc00640 1 --2- 172.21.15.103:0/8541255 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f375c0725d0 0x7f375c074a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:15.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.047+0000 7f377cc00640 1 -- 172.21.15.103:0/8541255 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f377012d1a0 con 0x7f37800ad8f0 2024-09-10T22:39:15.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.047+0000 7f3777400640 1 --2- 172.21.15.103:0/8541255 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f375c0725d0 0x7f375c074a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:15.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.051+0000 7f3777400640 1 --2- 172.21.15.103:0/8541255 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f375c0725d0 0x7f375c074a90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f37800cfae0 tx=0x7f376800b390 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:15.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.051+0000 7f377cc00640 1 -- 172.21.15.103:0/8541255 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f37700164d0 con 0x7f37800ad8f0 2024-09-10T22:39:15.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.251+0000 7f3787200640 1 -- 172.21.15.103:0/8541255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3780074c80 con 0x7f37800ad8f0 2024-09-10T22:39:15.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.251+0000 7f377cc00640 1 -- 172.21.15.103:0/8541255 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f37700f85d0 con 0x7f37800ad8f0 2024-09-10T22:39:15.253 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:15.253 INFO:teuthology.orchestra.run.smithi103.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T22:39:15.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.251+0000 7f3787200640 1 -- 172.21.15.103:0/8541255 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f375c0725d0 msgr2=0x7f375c074a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:15.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.251+0000 7f3787200640 1 --2- 172.21.15.103:0/8541255 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f375c0725d0 0x7f375c074a90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f37800cfae0 tx=0x7f376800b390 comp rx=0 tx=0).stop 2024-09-10T22:39:15.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.251+0000 7f3787200640 1 -- 172.21.15.103:0/8541255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37800ad8f0 msgr2=0x7f3780157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:15.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.251+0000 7f3787200640 1 --2- 172.21.15.103:0/8541255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37800ad8f0 0x7f3780157e90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3770009850 tx=0x7f3770005760 comp rx=0 tx=0).stop 2024-09-10T22:39:15.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.251+0000 7f3787200640 1 -- 172.21.15.103:0/8541255 shutdown_connections 2024-09-10T22:39:15.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.251+0000 7f3787200640 1 --2- 172.21.15.103:0/8541255 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f375c0725d0 0x7f375c074a90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.251+0000 7f3787200640 1 --2- 172.21.15.103:0/8541255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f378015b9e0 0x7f37801f7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.251+0000 7f3787200640 1 --2- 172.21.15.103:0/8541255 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37800ae180 0x7f37801fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.251+0000 7f3787200640 1 --2- 172.21.15.103:0/8541255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37800ad8f0 0x7f3780157e90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.251+0000 7f3787200640 1 -- 172.21.15.103:0/8541255 >> 172.21.15.103:0/8541255 conn(0x7f37800b1c00 msgr2=0x7f3780073e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:15.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.251+0000 7f3787200640 1 -- 172.21.15.103:0/8541255 shutdown_connections 2024-09-10T22:39:15.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.251+0000 7f3787200640 1 -- 172.21.15.103:0/8541255 wait complete. 2024-09-10T22:39:15.274 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T22:39:15.274 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:39:15.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.411+0000 7f79c3400640 1 -- 172.21.15.103:0/624166985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79bc15c970 msgr2=0x7f79bc072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:15.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.411+0000 7f79c3400640 1 --2- 172.21.15.103:0/624166985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79bc15c970 0x7f79bc072e30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009900 tx=0x7f79a401c820 comp rx=0 tx=0).stop 2024-09-10T22:39:15.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79c3400640 1 -- 172.21.15.103:0/624166985 shutdown_connections 2024-09-10T22:39:15.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79c3400640 1 --2- 172.21.15.103:0/624166985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79bc15c970 0x7f79bc072e30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79c3400640 1 --2- 172.21.15.103:0/624166985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79bc0cc120 0x7f79bc0aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79c3400640 1 -- 172.21.15.103:0/624166985 >> 172.21.15.103:0/624166985 conn(0x7f79bc06cc00 msgr2=0x7f79bc06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:15.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79c3400640 1 -- 172.21.15.103:0/624166985 shutdown_connections 2024-09-10T22:39:15.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79c3400640 1 -- 172.21.15.103:0/624166985 wait complete. 2024-09-10T22:39:15.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79c3400640 1 Processor -- start 2024-09-10T22:39:15.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79c3400640 1 -- start start 2024-09-10T22:39:15.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79c3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79bc0cc120 0x7f79bc14d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79c3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc0cf790 0x7f79bc1536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79c3400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79bc15c970 0x7f79bc153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79c3400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f79bc1690c0 con 0x7f79bc0cf790 2024-09-10T22:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79c3400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f79bc073510 con 0x7f79bc0cc120 2024-09-10T22:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79c3400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f79bc169240 con 0x7f79bc15c970 2024-09-10T22:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79b3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc0cf790 0x7f79bc1536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79b3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc0cf790 0x7f79bc1536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49524/0 (socket says 172.21.15.103:49524) 2024-09-10T22:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79b3e00640 1 -- 172.21.15.103:0/2252328429 learned_addr learned my addr 172.21.15.103:0/2252328429 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79c0a00640 1 --2- 172.21.15.103:0/2252328429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79bc0cc120 0x7f79bc14d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79c1400640 1 --2- 172.21.15.103:0/2252328429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79bc15c970 0x7f79bc153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79b3e00640 1 -- 172.21.15.103:0/2252328429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79bc15c970 msgr2=0x7f79bc153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:15.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79b3e00640 1 --2- 172.21.15.103:0/2252328429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79bc15c970 0x7f79bc153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79b3e00640 1 -- 172.21.15.103:0/2252328429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79bc0cc120 msgr2=0x7f79bc14d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79b3e00640 1 --2- 172.21.15.103:0/2252328429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79bc0cc120 0x7f79bc14d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79b3e00640 1 -- 172.21.15.103:0/2252328429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79bc1fab20 con 0x7f79bc0cf790 2024-09-10T22:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79b3e00640 1 --2- 172.21.15.103:0/2252328429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc0cf790 0x7f79bc1536b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009850 tx=0x7f79a4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79b9600640 1 -- 172.21.15.103:0/2252328429 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a40b2040 con 0x7f79bc0cf790 2024-09-10T22:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.415+0000 7f79b9600640 1 -- 172.21.15.103:0/2252328429 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79a4005030 con 0x7f79bc0cf790 2024-09-10T22:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.419+0000 7f79c3400640 1 -- 172.21.15.103:0/2252328429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79bc1fae00 con 0x7f79bc0cf790 2024-09-10T22:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.419+0000 7f79b9600640 1 -- 172.21.15.103:0/2252328429 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a4005460 con 0x7f79bc0cf790 2024-09-10T22:39:15.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.419+0000 7f79c3400640 1 -- 172.21.15.103:0/2252328429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79bc1fb3c0 con 0x7f79bc0cf790 2024-09-10T22:39:15.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.419+0000 7f79c3400640 1 -- 172.21.15.103:0/2252328429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79bc072e30 con 0x7f79bc0cf790 2024-09-10T22:39:15.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.419+0000 7f79b9600640 1 -- 172.21.15.103:0/2252328429 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f79a40046d0 con 0x7f79bc0cf790 2024-09-10T22:39:15.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.419+0000 7f79b9600640 1 --2- 172.21.15.103:0/2252328429 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7998072610 0x7f7998074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:15.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.419+0000 7f79b9600640 1 -- 172.21.15.103:0/2252328429 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f79a412cc40 con 0x7f79bc0cf790 2024-09-10T22:39:15.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.419+0000 7f79c0a00640 1 --2- 172.21.15.103:0/2252328429 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7998072610 0x7f7998074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:15.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.423+0000 7f79c0a00640 1 --2- 172.21.15.103:0/2252328429 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7998072610 0x7f7998074ad0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009be0 tx=0x7f79ac0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:15.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.423+0000 7f79b9600640 1 -- 172.21.15.103:0/2252328429 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f79a40bc060 con 0x7f79bc0cf790 2024-09-10T22:39:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.623+0000 7f79c3400640 1 -- 172.21.15.103:0/2252328429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79bc0b2bb0 con 0x7f79bc0cf790 2024-09-10T22:39:15.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.623+0000 7f79b9600640 1 -- 172.21.15.103:0/2252328429 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7f79a40164d0 con 0x7f79bc0cf790 2024-09-10T22:39:15.626 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:15.626 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-09-10T22:39:09:926600+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/467299119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":467299119},{"type":"v1","addr":"172.21.15.103:6834","nonce":467299119}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3161095873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3161095873},{"type":"v1","addr":"172.21.15.131:6837","nonce":3161095873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/774650981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":774650981},{"type":"v1","addr":"172.21.15.103:6835","nonce":774650981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:38:49.214867+0000","modified":"2024-09-10T22:39:09.303311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6836/2821479330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2821479330},{"type":"v1","addr":"172.21.15.131:6836","nonce":2821479330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4390,"qdb_cluster":[4390]},"id":1}]} 2024-09-10T22:39:15.626 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-09-10T22:39:15.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.627+0000 7f79c3400640 1 -- 172.21.15.103:0/2252328429 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7998072610 msgr2=0x7f7998074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:15.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.627+0000 7f79c3400640 1 --2- 172.21.15.103:0/2252328429 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7998072610 0x7f7998074ad0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009be0 tx=0x7f79ac0091e0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.627+0000 7f79c3400640 1 -- 172.21.15.103:0/2252328429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc0cf790 msgr2=0x7f79bc1536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:15.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.627+0000 7f79c3400640 1 --2- 172.21.15.103:0/2252328429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc0cf790 0x7f79bc1536b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009850 tx=0x7f79a4004040 comp rx=0 tx=0).stop 2024-09-10T22:39:15.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.627+0000 7f79c3400640 1 -- 172.21.15.103:0/2252328429 shutdown_connections 2024-09-10T22:39:15.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.627+0000 7f79c3400640 1 --2- 172.21.15.103:0/2252328429 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7998072610 0x7f7998074ad0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.627+0000 7f79c3400640 1 --2- 172.21.15.103:0/2252328429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79bc15c970 0x7f79bc153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.627+0000 7f79c3400640 1 --2- 172.21.15.103:0/2252328429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc0cf790 0x7f79bc1536b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.627+0000 7f79c3400640 1 --2- 172.21.15.103:0/2252328429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79bc0cc120 0x7f79bc14d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.627+0000 7f79c3400640 1 -- 172.21.15.103:0/2252328429 >> 172.21.15.103:0/2252328429 conn(0x7f79bc06cc00 msgr2=0x7f79bc152240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:15.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.627+0000 7f79c3400640 1 -- 172.21.15.103:0/2252328429 shutdown_connections 2024-09-10T22:39:15.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.627+0000 7f79c3400640 1 -- 172.21.15.103:0/2252328429 wait complete. 2024-09-10T22:39:15.648 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:39:15.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.783+0000 7fa46c400640 1 -- 172.21.15.103:0/667124765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4640b3320 msgr2=0x7fa464072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:15.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.783+0000 7fa46c400640 1 --2- 172.21.15.103:0/667124765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4640b3320 0x7fa464072500 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa464074960 tx=0x7fa45001c8c0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.783+0000 7fa46c400640 1 -- 172.21.15.103:0/667124765 shutdown_connections 2024-09-10T22:39:15.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.783+0000 7fa46c400640 1 --2- 172.21.15.103:0/667124765 >> v2:172.21.15.131:3300/0 conn(0x7fa464072a40 0x7fa464157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.783+0000 7fa46c400640 1 --2- 172.21.15.103:0/667124765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4640b3320 0x7fa464072500 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.783+0000 7fa46c400640 1 -- 172.21.15.103:0/667124765 >> 172.21.15.103:0/667124765 conn(0x7fa46406cc00 msgr2=0x7fa46406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:15.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.783+0000 7fa46c400640 1 -- 172.21.15.103:0/667124765 shutdown_connections 2024-09-10T22:39:15.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.783+0000 7fa46c400640 1 -- 172.21.15.103:0/667124765 wait complete. 2024-09-10T22:39:15.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa46c400640 1 Processor -- start 2024-09-10T22:39:15.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa46c400640 1 -- start start 2024-09-10T22:39:15.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa46c400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa464072a40 0x7fa46414daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:15.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa46c400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4640b3320 0x7fa464145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:15.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa46c400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4640cf260 0x7fa464146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:15.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa46c400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa46406e7e0 con 0x7fa464072a40 2024-09-10T22:39:15.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa46c400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa464157e30 con 0x7fa4640b3320 2024-09-10T22:39:15.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa46c400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa46406e960 con 0x7fa4640cf260 2024-09-10T22:39:15.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa469a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa464072a40 0x7fa46414daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:15.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa469a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa464072a40 0x7fa46414daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49552/0 (socket says 172.21.15.103:49552) 2024-09-10T22:39:15.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa469a00640 1 -- 172.21.15.103:0/3997947066 learned_addr learned my addr 172.21.15.103:0/3997947066 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:15.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa469000640 1 --2- 172.21.15.103:0/3997947066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4640b3320 0x7fa464145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:15.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa46a400640 1 --2- 172.21.15.103:0/3997947066 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4640cf260 0x7fa464146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:15.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa469a00640 1 -- 172.21.15.103:0/3997947066 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4640cf260 msgr2=0x7fa464146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:15.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa469a00640 1 --2- 172.21.15.103:0/3997947066 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4640cf260 0x7fa464146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa469a00640 1 -- 172.21.15.103:0/3997947066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4640b3320 msgr2=0x7fa464145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:15.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa469a00640 1 --2- 172.21.15.103:0/3997947066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4640b3320 0x7fa464145cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:15.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa469a00640 1 -- 172.21.15.103:0/3997947066 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4640747c0 con 0x7fa464072a40 2024-09-10T22:39:15.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa46a400640 1 --2- 172.21.15.103:0/3997947066 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4640cf260 0x7fa464146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:15.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa469a00640 1 --2- 172.21.15.103:0/3997947066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa464072a40 0x7fa46414daa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa45800c3c0 tx=0x7fa45800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:15.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa461600640 1 -- 172.21.15.103:0/3997947066 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458017070 con 0x7fa464072a40 2024-09-10T22:39:15.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa461600640 1 -- 172.21.15.103:0/3997947066 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4580053c0 con 0x7fa464072a40 2024-09-10T22:39:15.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa461600640 1 -- 172.21.15.103:0/3997947066 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458003860 con 0x7fa464072a40 2024-09-10T22:39:15.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa46c400640 1 -- 172.21.15.103:0/3997947066 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4640aed10 con 0x7fa464072a40 2024-09-10T22:39:15.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.787+0000 7fa46c400640 1 -- 172.21.15.103:0/3997947066 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa464148df0 con 0x7fa464072a40 2024-09-10T22:39:15.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.791+0000 7fa46c400640 1 -- 172.21.15.103:0/3997947066 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa464157090 con 0x7fa464072a40 2024-09-10T22:39:15.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.791+0000 7fa461600640 1 -- 172.21.15.103:0/3997947066 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa458003a00 con 0x7fa464072a40 2024-09-10T22:39:15.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.791+0000 7fa461600640 1 --2- 172.21.15.103:0/3997947066 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa4440725e0 0x7fa444074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:15.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.791+0000 7fa461600640 1 -- 172.21.15.103:0/3997947066 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa458092ae0 con 0x7fa464072a40 2024-09-10T22:39:15.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.791+0000 7fa469000640 1 --2- 172.21.15.103:0/3997947066 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa4440725e0 0x7fa444074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:15.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.791+0000 7fa469000640 1 --2- 172.21.15.103:0/3997947066 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa4440725e0 0x7fa444074aa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa4500af000 tx=0x7fa45001b100 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:15.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.795+0000 7fa461600640 1 -- 172.21.15.103:0/3997947066 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa45805d820 con 0x7fa464072a40 2024-09-10T22:39:15.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.995+0000 7fa46c400640 1 -- 172.21.15.103:0/3997947066 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4641544c0 con 0x7fa464072a40 2024-09-10T22:39:15.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.995+0000 7fa461600640 1 -- 172.21.15.103:0/3997947066 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7fa458062250 con 0x7fa464072a40 2024-09-10T22:39:15.997 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:15.997 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-09-10T22:39:09:926600+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/467299119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":467299119},{"type":"v1","addr":"172.21.15.103:6834","nonce":467299119}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3161095873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3161095873},{"type":"v1","addr":"172.21.15.131:6837","nonce":3161095873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/774650981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":774650981},{"type":"v1","addr":"172.21.15.103:6835","nonce":774650981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:38:49.214867+0000","modified":"2024-09-10T22:39:09.303311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6836/2821479330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2821479330},{"type":"v1","addr":"172.21.15.131:6836","nonce":2821479330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4390,"qdb_cluster":[4390]},"id":1}]} 2024-09-10T22:39:15.997 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-09-10T22:39:15.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.995+0000 7fa46c400640 1 -- 172.21.15.103:0/3997947066 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa4440725e0 msgr2=0x7fa444074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:15.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.995+0000 7fa46c400640 1 --2- 172.21.15.103:0/3997947066 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa4440725e0 0x7fa444074aa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa4500af000 tx=0x7fa45001b100 comp rx=0 tx=0).stop 2024-09-10T22:39:15.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.995+0000 7fa46c400640 1 -- 172.21.15.103:0/3997947066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa464072a40 msgr2=0x7fa46414daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:15.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.995+0000 7fa46c400640 1 --2- 172.21.15.103:0/3997947066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa464072a40 0x7fa46414daa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa45800c3c0 tx=0x7fa45800c880 comp rx=0 tx=0).stop 2024-09-10T22:39:15.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.995+0000 7fa46c400640 1 -- 172.21.15.103:0/3997947066 shutdown_connections 2024-09-10T22:39:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.995+0000 7fa46c400640 1 --2- 172.21.15.103:0/3997947066 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa4440725e0 0x7fa444074aa0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.995+0000 7fa46c400640 1 --2- 172.21.15.103:0/3997947066 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4640cf260 0x7fa464146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.995+0000 7fa46c400640 1 --2- 172.21.15.103:0/3997947066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4640b3320 0x7fa464145cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.995+0000 7fa46c400640 1 --2- 172.21.15.103:0/3997947066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa464072a40 0x7fa46414daa0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.995+0000 7fa46c400640 1 -- 172.21.15.103:0/3997947066 >> 172.21.15.103:0/3997947066 conn(0x7fa46406cc00 msgr2=0x7fa4641549e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.995+0000 7fa46c400640 1 -- 172.21.15.103:0/3997947066 shutdown_connections 2024-09-10T22:39:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:15.995+0000 7fa46c400640 1 -- 172.21.15.103:0/3997947066 wait complete. 2024-09-10T22:39:16.018 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:39:16.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.159+0000 7f3a35200640 1 -- 172.21.15.103:0/1424052973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a14003a80 msgr2=0x7f3a14003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:16.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.159+0000 7f3a35200640 1 --2- 172.21.15.103:0/1424052973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a14003a80 0x7f3a14003ea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000c4a0 tx=0x7f3a2001cfc0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.159+0000 7f3a2fe00640 1 -- 172.21.15.103:0/1424052973 reap_dead start 2024-09-10T22:39:16.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.159+0000 7f3a35200640 1 -- 172.21.15.103:0/1424052973 shutdown_connections 2024-09-10T22:39:16.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.159+0000 7f3a35200640 1 -- 172.21.15.103:0/1424052973 >> 172.21.15.103:0/1424052973 conn(0x7f3a3009a9f0 msgr2=0x7f3a3009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:16.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.159+0000 7f3a35200640 1 -- 172.21.15.103:0/1424052973 shutdown_connections 2024-09-10T22:39:16.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.159+0000 7f3a35200640 1 -- 172.21.15.103:0/1424052973 wait complete. 2024-09-10T22:39:16.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.159+0000 7f3a35200640 1 Processor -- start 2024-09-10T22:39:16.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.159+0000 7f3a35200640 1 -- start start 2024-09-10T22:39:16.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a35200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a14003a80 0x7f3a3015ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:16.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a35200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a300b4ff0 0x7f3a301569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:16.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a35200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a30163640 0x7f3a30163ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:16.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a35200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3a30166480 con 0x7f3a14003a80 2024-09-10T22:39:16.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a35200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3a30166300 con 0x7f3a30163640 2024-09-10T22:39:16.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a35200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3a30166600 con 0x7f3a300b4ff0 2024-09-10T22:39:16.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a2f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a14003a80 0x7f3a3015ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:16.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a2f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a14003a80 0x7f3a3015ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49560/0 (socket says 172.21.15.103:49560) 2024-09-10T22:39:16.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a2f400640 1 -- 172.21.15.103:0/1949883892 learned_addr learned my addr 172.21.15.103:0/1949883892 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:16.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a26a00640 1 --2- 172.21.15.103:0/1949883892 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a300b4ff0 0x7f3a301569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:16.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a2fe00640 1 --2- 172.21.15.103:0/1949883892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a30163640 0x7f3a30163ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:16.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a2f400640 1 -- 172.21.15.103:0/1949883892 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a300b4ff0 msgr2=0x7f3a301569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:16.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a2f400640 1 --2- 172.21.15.103:0/1949883892 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a300b4ff0 0x7f3a301569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a2f400640 1 -- 172.21.15.103:0/1949883892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a30163640 msgr2=0x7f3a30163ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:16.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a2f400640 1 --2- 172.21.15.103:0/1949883892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a30163640 0x7f3a30163ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a2f400640 1 -- 172.21.15.103:0/1949883892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a300b54f0 con 0x7f3a14003a80 2024-09-10T22:39:16.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a2f400640 1 --2- 172.21.15.103:0/1949883892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a14003a80 0x7f3a3015ec80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3a20098970 tx=0x7f3a20001240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:16.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a27e00640 1 -- 172.21.15.103:0/1949883892 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a20001710 con 0x7f3a14003a80 2024-09-10T22:39:16.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a27e00640 1 -- 172.21.15.103:0/1949883892 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a20006e50 con 0x7f3a14003a80 2024-09-10T22:39:16.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a27e00640 1 -- 172.21.15.103:0/1949883892 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a20006090 con 0x7f3a14003a80 2024-09-10T22:39:16.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a35200640 1 -- 172.21.15.103:0/1949883892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a3006e040 con 0x7f3a14003a80 2024-09-10T22:39:16.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a35200640 1 -- 172.21.15.103:0/1949883892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a300b57d0 con 0x7f3a14003a80 2024-09-10T22:39:16.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a35200640 1 -- 172.21.15.103:0/1949883892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a3015bb10 con 0x7f3a14003a80 2024-09-10T22:39:16.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.163+0000 7f3a27e00640 1 -- 172.21.15.103:0/1949883892 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3a20006230 con 0x7f3a14003a80 2024-09-10T22:39:16.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.167+0000 7f3a27e00640 1 --2- 172.21.15.103:0/1949883892 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3a0c072610 0x7f3a0c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:16.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.167+0000 7f3a27e00640 1 -- 172.21.15.103:0/1949883892 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3a2012cdf0 con 0x7f3a14003a80 2024-09-10T22:39:16.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.167+0000 7f3a26a00640 1 --2- 172.21.15.103:0/1949883892 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3a0c072610 0x7f3a0c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:16.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.167+0000 7f3a26a00640 1 --2- 172.21.15.103:0/1949883892 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3a0c072610 0x7f3a0c074ad0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3a3015b410 tx=0x7f3a180091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:16.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.171+0000 7f3a27e00640 1 -- 172.21.15.103:0/1949883892 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3a300b1130 con 0x7f3a14003a80 2024-09-10T22:39:16.204 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:39:16.207 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:39:16.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.339+0000 7f3a35200640 1 -- 172.21.15.103:0/1949883892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a300b05d0 con 0x7f3a14003a80 2024-09-10T22:39:16.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.339+0000 7f3a27e00640 1 -- 172.21.15.103:0/1949883892 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7f3a200f7aa0 con 0x7f3a14003a80 2024-09-10T22:39:16.343 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:16.343 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":27,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:38:54.282386+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:38:47.154691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:38:48.182281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T22:38:51.874808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:39:16.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.343+0000 7f3a35200640 1 -- 172.21.15.103:0/1949883892 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3a0c072610 msgr2=0x7f3a0c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:16.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.343+0000 7f3a35200640 1 --2- 172.21.15.103:0/1949883892 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3a0c072610 0x7f3a0c074ad0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3a3015b410 tx=0x7f3a180091e0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.343+0000 7f3a35200640 1 -- 172.21.15.103:0/1949883892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a14003a80 msgr2=0x7f3a3015ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:16.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.343+0000 7f3a35200640 1 --2- 172.21.15.103:0/1949883892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a14003a80 0x7f3a3015ec80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3a20098970 tx=0x7f3a20001240 comp rx=0 tx=0).stop 2024-09-10T22:39:16.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.343+0000 7f3a35200640 1 -- 172.21.15.103:0/1949883892 shutdown_connections 2024-09-10T22:39:16.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.343+0000 7f3a35200640 1 --2- 172.21.15.103:0/1949883892 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3a0c072610 0x7f3a0c074ad0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.343+0000 7f3a35200640 1 --2- 172.21.15.103:0/1949883892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a30163640 0x7f3a30163ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.343+0000 7f3a35200640 1 --2- 172.21.15.103:0/1949883892 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a300b4ff0 0x7f3a301569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.343+0000 7f3a35200640 1 --2- 172.21.15.103:0/1949883892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a14003a80 0x7f3a3015ec80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.343+0000 7f3a35200640 1 -- 172.21.15.103:0/1949883892 >> 172.21.15.103:0/1949883892 conn(0x7f3a3009a9f0 msgr2=0x7f3a3009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:16.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.343+0000 7f3a35200640 1 -- 172.21.15.103:0/1949883892 shutdown_connections 2024-09-10T22:39:16.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.343+0000 7f3a35200640 1 -- 172.21.15.103:0/1949883892 wait complete. 2024-09-10T22:39:16.365 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:39:16.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9044800640 1 -- 172.21.15.103:0/3365225853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90240052f0 msgr2=0x7f902400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:16.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9044800640 1 --2- 172.21.15.103:0/3365225853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90240052f0 0x7f902400b9d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f903c0cdf40 tx=0x7f903801d5d0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9044800640 1 -- 172.21.15.103:0/3365225853 shutdown_connections 2024-09-10T22:39:16.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9044800640 1 --2- 172.21.15.103:0/3365225853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90240052f0 0x7f902400b9d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9044800640 1 -- 172.21.15.103:0/3365225853 >> 172.21.15.103:0/3365225853 conn(0x7f903c0d1ab0 msgr2=0x7f903c0d1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:16.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9044800640 1 -- 172.21.15.103:0/3365225853 shutdown_connections 2024-09-10T22:39:16.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9044800640 1 -- 172.21.15.103:0/3365225853 wait complete. 2024-09-10T22:39:16.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9044800640 1 Processor -- start 2024-09-10T22:39:16.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9044800640 1 -- start start 2024-09-10T22:39:16.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9044800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90240052f0 0x7f903c1f4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:16.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9044800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f903c15a6a0 0x7f903c153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:16.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9044800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f903c15a070 0x7f903c0af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:16.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9044800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f903c0cfbc0 con 0x7f903c15a6a0 2024-09-10T22:39:16.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9044800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f903c0b2fa0 con 0x7f903c15a070 2024-09-10T22:39:16.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9044800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f903c0cfd40 con 0x7f90240052f0 2024-09-10T22:39:16.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9041400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f903c15a6a0 0x7f903c153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:16.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9041400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f903c15a6a0 0x7f903c153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49570/0 (socket says 172.21.15.103:49570) 2024-09-10T22:39:16.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9041400640 1 -- 172.21.15.103:0/819240524 learned_addr learned my addr 172.21.15.103:0/819240524 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:16.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9042800640 1 --2- 172.21.15.103:0/819240524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f903c15a070 0x7f903c0af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:16.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9041e00640 1 --2- 172.21.15.103:0/819240524 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90240052f0 0x7f903c1f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:16.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9041400640 1 -- 172.21.15.103:0/819240524 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90240052f0 msgr2=0x7f903c1f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:16.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9041400640 1 --2- 172.21.15.103:0/819240524 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90240052f0 0x7f903c1f4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9041400640 1 -- 172.21.15.103:0/819240524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f903c15a070 msgr2=0x7f903c0af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:16.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9041400640 1 --2- 172.21.15.103:0/819240524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f903c15a070 0x7f903c0af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9041400640 1 -- 172.21.15.103:0/819240524 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903c0b5bb0 con 0x7f903c15a6a0 2024-09-10T22:39:16.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.507+0000 7f9041400640 1 --2- 172.21.15.103:0/819240524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f903c15a6a0 0x7f903c153e30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f902c001870 tx=0x7f902c012b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:16.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.511+0000 7f9036000640 1 -- 172.21.15.103:0/819240524 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c010b40 con 0x7f903c15a6a0 2024-09-10T22:39:16.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.511+0000 7f9036000640 1 -- 172.21.15.103:0/819240524 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f902c017030 con 0x7f903c15a6a0 2024-09-10T22:39:16.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.511+0000 7f9044800640 1 -- 172.21.15.103:0/819240524 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f903c0b5e90 con 0x7f903c15a6a0 2024-09-10T22:39:16.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.511+0000 7f9036000640 1 -- 172.21.15.103:0/819240524 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c012e60 con 0x7f903c15a6a0 2024-09-10T22:39:16.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.511+0000 7f9044800640 1 -- 172.21.15.103:0/819240524 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f903c0b6450 con 0x7f903c15a6a0 2024-09-10T22:39:16.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.511+0000 7f9044800640 1 -- 172.21.15.103:0/819240524 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f903c0b6650 con 0x7f903c15a6a0 2024-09-10T22:39:16.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.511+0000 7f9036000640 1 -- 172.21.15.103:0/819240524 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f902c013450 con 0x7f903c15a6a0 2024-09-10T22:39:16.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.511+0000 7f9036000640 1 --2- 172.21.15.103:0/819240524 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f90200725e0 0x7f9020074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:16.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.515+0000 7f9036000640 1 -- 172.21.15.103:0/819240524 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f902c097140 con 0x7f903c15a6a0 2024-09-10T22:39:16.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.515+0000 7f9041e00640 1 --2- 172.21.15.103:0/819240524 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f90200725e0 0x7f9020074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:16.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.515+0000 7f9041e00640 1 --2- 172.21.15.103:0/819240524 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f90200725e0 0x7f9020074aa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9030000c10 tx=0x7f9030006b80 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:16.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.519+0000 7f9036000640 1 -- 172.21.15.103:0/819240524 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f903c0b6650 con 0x7f903c15a6a0 2024-09-10T22:39:16.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.715+0000 7f9044800640 1 -- 172.21.15.103:0/819240524 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f903c0c4f30 con 0x7f903c15a6a0 2024-09-10T22:39:16.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.715+0000 7f9036000640 1 -- 172.21.15.103:0/819240524 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7f902c062440 con 0x7f903c15a6a0 2024-09-10T22:39:16.719 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:16.719 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-09-10T22:39:09:926600+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/467299119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":467299119},{"type":"v1","addr":"172.21.15.103:6834","nonce":467299119}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3161095873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3161095873},{"type":"v1","addr":"172.21.15.131:6837","nonce":3161095873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/774650981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":774650981},{"type":"v1","addr":"172.21.15.103:6835","nonce":774650981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:38:49.214867+0000","modified":"2024-09-10T22:39:09.303311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6836/2821479330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2821479330},{"type":"v1","addr":"172.21.15.131:6836","nonce":2821479330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4390,"qdb_cluster":[4390]},"id":1}]} 2024-09-10T22:39:16.719 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-09-10T22:39:16.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.719+0000 7f9044800640 1 -- 172.21.15.103:0/819240524 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f90200725e0 msgr2=0x7f9020074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:16.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.719+0000 7f9044800640 1 --2- 172.21.15.103:0/819240524 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f90200725e0 0x7f9020074aa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9030000c10 tx=0x7f9030006b80 comp rx=0 tx=0).stop 2024-09-10T22:39:16.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.719+0000 7f9044800640 1 -- 172.21.15.103:0/819240524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f903c15a6a0 msgr2=0x7f903c153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:16.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.719+0000 7f9044800640 1 --2- 172.21.15.103:0/819240524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f903c15a6a0 0x7f903c153e30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f902c001870 tx=0x7f902c012b20 comp rx=0 tx=0).stop 2024-09-10T22:39:16.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.719+0000 7f9044800640 1 -- 172.21.15.103:0/819240524 shutdown_connections 2024-09-10T22:39:16.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.719+0000 7f9044800640 1 --2- 172.21.15.103:0/819240524 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f90200725e0 0x7f9020074aa0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.719+0000 7f9044800640 1 --2- 172.21.15.103:0/819240524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f903c15a070 0x7f903c0af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.719+0000 7f9044800640 1 --2- 172.21.15.103:0/819240524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f903c15a6a0 0x7f903c153e30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.719+0000 7f9044800640 1 --2- 172.21.15.103:0/819240524 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90240052f0 0x7f903c1f4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:16.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.719+0000 7f9044800640 1 -- 172.21.15.103:0/819240524 >> 172.21.15.103:0/819240524 conn(0x7f903c0d1ab0 msgr2=0x7f903c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:16.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.719+0000 7f9044800640 1 -- 172.21.15.103:0/819240524 shutdown_connections 2024-09-10T22:39:16.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:16.719+0000 7f9044800640 1 -- 172.21.15.103:0/819240524 wait complete. 2024-09-10T22:39:17.142 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:38:49.214867+0000', 'modified': '2024-09-10T22:39:09.303311+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4390}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4390': {'gid': 4390, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.131:6836/2821479330', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6834', 'nonce': 2821479330}, {'type': 'v1', 'addr': '172.21.15.131:6836', 'nonce': 2821479330}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4390, 'qdb_cluster': [4390]} 2024-09-10T22:39:17.142 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T22:39:17.142 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-10T22:39:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.283+0000 7f9a7e200640 1 -- 172.21.15.103:0/885524994 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a78072a40 msgr2=0x7f9a78157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.283+0000 7f9a7e200640 1 --2- 172.21.15.103:0/885524994 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a78072a40 0x7f9a78157090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9a780b4f10 tx=0x7f9a7001dc70 comp rx=0 tx=0).stop 2024-09-10T22:39:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.283+0000 7f9a7e200640 1 -- 172.21.15.103:0/885524994 shutdown_connections 2024-09-10T22:39:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.283+0000 7f9a7e200640 1 --2- 172.21.15.103:0/885524994 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a78072a40 0x7f9a78157090 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.283+0000 7f9a7e200640 1 --2- 172.21.15.103:0/885524994 >> v2:172.21.15.131:3300/0 conn(0x7f9a780b3320 0x7f9a78072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.283+0000 7f9a7e200640 1 -- 172.21.15.103:0/885524994 >> 172.21.15.103:0/885524994 conn(0x7f9a7806cc00 msgr2=0x7f9a7806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.283+0000 7f9a7e200640 1 -- 172.21.15.103:0/885524994 shutdown_connections 2024-09-10T22:39:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.283+0000 7f9a7e200640 1 -- 172.21.15.103:0/885524994 wait complete. 2024-09-10T22:39:17.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.283+0000 7f9a7e200640 1 Processor -- start 2024-09-10T22:39:17.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.283+0000 7f9a7e200640 1 -- start start 2024-09-10T22:39:17.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a7e200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a78072a40 0x7f9a78148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:17.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a7e200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a780b3320 0x7f9a780b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:17.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a7e200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a780cf260 0x7f9a781fadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:17.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a7e200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7806e7e0 con 0x7f9a78072a40 2024-09-10T22:39:17.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a7e200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9a78157ed0 con 0x7f9a780cf260 2024-09-10T22:39:17.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a7e200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9a7806e960 con 0x7f9a780b3320 2024-09-10T22:39:17.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a77400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a78072a40 0x7f9a78148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:17.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a77400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a78072a40 0x7f9a78148bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60618/0 (socket says 172.21.15.103:60618) 2024-09-10T22:39:17.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a77400640 1 -- 172.21.15.103:0/1915371215 learned_addr learned my addr 172.21.15.103:0/1915371215 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:17.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a77e00640 1 --2- 172.21.15.103:0/1915371215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a780cf260 0x7f9a781fadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:17.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a6ea00640 1 --2- 172.21.15.103:0/1915371215 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a780b3320 0x7f9a780b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:17.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a77400640 1 -- 172.21.15.103:0/1915371215 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a780b3320 msgr2=0x7f9a780b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:17.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a77400640 1 --2- 172.21.15.103:0/1915371215 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a780b3320 0x7f9a780b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a77400640 1 -- 172.21.15.103:0/1915371215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a780cf260 msgr2=0x7f9a781fadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:17.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a77400640 1 --2- 172.21.15.103:0/1915371215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a780cf260 0x7f9a781fadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a77400640 1 -- 172.21.15.103:0/1915371215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7814b4d0 con 0x7f9a78072a40 2024-09-10T22:39:17.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a6ea00640 1 --2- 172.21.15.103:0/1915371215 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a780b3320 0x7f9a780b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:17.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a77400640 1 --2- 172.21.15.103:0/1915371215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a78072a40 0x7f9a78148bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800c3f0 tx=0x7f9a6800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:17.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a6fe00640 1 -- 172.21.15.103:0/1915371215 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a68017070 con 0x7f9a78072a40 2024-09-10T22:39:17.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a6fe00640 1 -- 172.21.15.103:0/1915371215 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a680053c0 con 0x7f9a78072a40 2024-09-10T22:39:17.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a6fe00640 1 -- 172.21.15.103:0/1915371215 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a68003860 con 0x7f9a78072a40 2024-09-10T22:39:17.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a7e200640 1 -- 172.21.15.103:0/1915371215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7814b7b0 con 0x7f9a78072a40 2024-09-10T22:39:17.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.287+0000 7f9a7e200640 1 -- 172.21.15.103:0/1915371215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a7814bd70 con 0x7f9a78072a40 2024-09-10T22:39:17.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a6fe00640 1 -- 172.21.15.103:0/1915371215 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9a68003a00 con 0x7f9a78072a40 2024-09-10T22:39:17.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a6fe00640 1 --2- 172.21.15.103:0/1915371215 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9a540725e0 0x7f9a54074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:17.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a816cd000 1 Processor -- start 2024-09-10T22:39:17.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a6fe00640 1 -- 172.21.15.103:0/1915371215 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9a68092ae0 con 0x7f9a78072a40 2024-09-10T22:39:17.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a816cd000 1 -- start start 2024-09-10T22:39:17.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a6ea00640 1 --2- 172.21.15.103:0/1915371215 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9a540725e0 0x7f9a54074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:17.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a816cd000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b345d79d0 0x564b345d7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:17.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a816cd000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d82f0 0x564b3458b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:17.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a816cd000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b3458be10 0x564b3458c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:17.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a816cd000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564b344ac3f0 con 0x564b345d82f0 2024-09-10T22:39:17.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a816cd000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x564b343e9b20 con 0x564b345d79d0 2024-09-10T22:39:17.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a816cd000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x564b343d8f50 con 0x564b3458be10 2024-09-10T22:39:17.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a6ea00640 1 --2- 172.21.15.103:0/1915371215 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9a540725e0 0x7f9a54074aa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9a78154db0 tx=0x7f9a600091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:17.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a6ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d82f0 0x564b3458b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:17.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a77400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b345d79d0 0x564b345d7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a6ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d82f0 0x564b3458b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60626/0 (socket says 172.21.15.103:60626) 2024-09-10T22:39:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a77400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b345d79d0 0x564b345d7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:37072/0 (socket says 172.21.15.103:37072) 2024-09-10T22:39:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a6ea00640 1 -- 172.21.15.103:0/1674536306 learned_addr learned my addr 172.21.15.103:0/1674536306 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a77e00640 1 --2- 172.21.15.103:0/1674536306 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b3458be10 0x564b3458c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a77400640 1 -- 172.21.15.103:0/1674536306 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b3458be10 msgr2=0x564b3458c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:39:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a77400640 1 --2- 172.21.15.103:0/1674536306 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b3458be10 0x564b3458c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a77400640 1 -- 172.21.15.103:0/1674536306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d82f0 msgr2=0x564b3458b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:39:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a77400640 1 --2- 172.21.15.103:0/1674536306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d82f0 0x564b3458b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a77400640 1 -- 172.21.15.103:0/1674536306 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b343a0590 con 0x564b345d79d0 2024-09-10T22:39:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a6ea00640 1 --2- 172.21.15.103:0/1674536306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d82f0 0x564b3458b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:39:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a77400640 1 --2- 172.21.15.103:0/1674536306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b345d79d0 0x564b345d7db0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9a68000fc0 tx=0x7f9a6805d0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da738655c326476d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a67e00640 1 -- 172.21.15.103:0/1674536306 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a68066c70 con 0x564b345d79d0 2024-09-10T22:39:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a67e00640 1 -- 172.21.15.103:0/1674536306 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a68062020 con 0x564b345d79d0 2024-09-10T22:39:17.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a67e00640 1 -- 172.21.15.103:0/1674536306 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6805cc80 con 0x564b345d79d0 2024-09-10T22:39:17.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a816cd000 1 -- 172.21.15.103:0/1674536306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b345d79d0 msgr2=0x564b345d7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:17.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a816cd000 1 --2- 172.21.15.103:0/1674536306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b345d79d0 0x564b345d7db0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9a68000fc0 tx=0x7f9a6805d0c0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a816cd000 1 -- 172.21.15.103:0/1674536306 shutdown_connections 2024-09-10T22:39:17.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a816cd000 1 --2- 172.21.15.103:0/1674536306 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b3458be10 0x564b3458c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a816cd000 1 --2- 172.21.15.103:0/1674536306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d82f0 0x564b3458b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a816cd000 1 --2- 172.21.15.103:0/1674536306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b345d79d0 0x564b345d7db0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a816cd000 1 -- 172.21.15.103:0/1674536306 >> 172.21.15.103:0/1674536306 conn(0x564b34475130 msgr2=0x564b345bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:17.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.291+0000 7f9a816cd000 1 -- 172.21.15.103:0/1674536306 shutdown_connections 2024-09-10T22:39:17.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 1 -- 172.21.15.103:0/1674536306 wait complete. 2024-09-10T22:39:17.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 1 -- start start 2024-09-10T22:39:17.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 1 Processor -- start 2024-09-10T22:39:17.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b3458be10 0x564b345b86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:17.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b345d79d0 0x564b345b8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:17.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b345d82f0 0x564b345b93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:17.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564b343735d0 con 0x564b3458be10 2024-09-10T22:39:17.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x564b343dcd60 con 0x564b345d82f0 2024-09-10T22:39:17.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x564b3437f500 con 0x564b345d79d0 2024-09-10T22:39:17.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 10 client.0 _ll_register_callbacks cb 0x564b34383810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:39:17.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a77400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b3458be10 0x564b345b86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:17.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a77400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b3458be10 0x564b345b86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60642/0 (socket says 172.21.15.103:60642) 2024-09-10T22:39:17.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a77400640 1 -- 172.21.15.103:0/428512251 learned_addr learned my addr 172.21.15.103:0/428512251 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:17.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a6ea00640 1 --2- 172.21.15.103:0/428512251 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b345d79d0 0x564b345b8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:17.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a77e00640 1 --2- 172.21.15.103:0/428512251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b345d82f0 0x564b345b93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:17.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a77400640 1 -- 172.21.15.103:0/428512251 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b345d79d0 msgr2=0x564b345b8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:39:17.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a77400640 1 --2- 172.21.15.103:0/428512251 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b345d79d0 0x564b345b8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a77400640 1 -- 172.21.15.103:0/428512251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b345d82f0 msgr2=0x564b345b93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:39:17.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a77400640 1 --2- 172.21.15.103:0/428512251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b345d82f0 0x564b345b93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a77400640 1 -- 172.21.15.103:0/428512251 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b34377170 con 0x564b3458be10 2024-09-10T22:39:17.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a77400640 1 --2- 172.21.15.103:0/428512251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b3458be10 0x564b345b86a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800c3c0 tx=0x7f9a68059cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a16d441195c5a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:17.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a64c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:39:17.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a64c00640 1 -- 172.21.15.103:0/428512251 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a68089e60 con 0x564b3458be10 2024-09-10T22:39:17.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a64c00640 1 -- 172.21.15.103:0/428512251 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9a68064450 con 0x564b3458be10 2024-09-10T22:39:17.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 1 -- 172.21.15.103:0/428512251 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564b343710f0 con 0x564b3458be10 2024-09-10T22:39:17.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a64c00640 1 -- 172.21.15.103:0/428512251 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9a68059e70 con 0x564b3458be10 2024-09-10T22:39:17.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 10 client.4674 fetch_fsmap learned FSMap version 9 2024-09-10T22:39:17.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 1 -- 172.21.15.103:0/428512251 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x564b3445def0 con 0x564b3458be10 2024-09-10T22:39:17.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a64c00640 1 -- 172.21.15.103:0/428512251 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564b343710f0 con 0x564b3458be10 2024-09-10T22:39:17.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a64c00640 1 -- 172.21.15.103:0/428512251 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f9a68082b30 con 0x564b3458be10 2024-09-10T22:39:17.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 10 client.4674 fetch_fsmap finished waiting for FSMap version 9 2024-09-10T22:39:17.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 10 client.4674 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T22:39:17.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 20 client.4674 populate_metadata read hostname 'smithi103' 2024-09-10T22:39:17.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 1 --2- 172.21.15.103:0/428512251 >> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] conn(0x564b345ba0f0 0x564b345e9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:17.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 4 client.4674 mds_command: new command op to 4390 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:39:17.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a816cd000 1 -- 172.21.15.103:0/428512251 --> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b343eba70 con 0x564b345ba0f0 2024-09-10T22:39:17.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.295+0000 7f9a6ea00640 1 --2- 172.21.15.103:0/428512251 >> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] conn(0x564b345ba0f0 0x564b345e9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:17.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.299+0000 7f9a6ea00640 1 --2- 172.21.15.103:0/428512251 >> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] conn(0x564b345ba0f0 0x564b345e9c90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd00861a26c9c658 server_cookie=47d70e7c5094f421 in_seq=0 out_seq=0 2024-09-10T22:39:17.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.299+0000 7f9a64c00640 10 client.4674 ms_handle_connect on v2:172.21.15.131:6834/2821479330 2024-09-10T22:39:17.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.299+0000 7f9a64c00640 1 -- 172.21.15.103:0/428512251 <== mds.0 v2:172.21.15.131:6834/2821479330 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b343eba70 con 0x564b345ba0f0 2024-09-10T22:39:17.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.299+0000 7f9a64c00640 10 client.4674 handle_command_reply: tid=0 2024-09-10T22:39:17.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.299+0000 7f9a816cd000 1 client.4674 shutdown 2024-09-10T22:39:17.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.299+0000 7f9a816cd000 1 -- 172.21.15.103:0/428512251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b3458be10 msgr2=0x564b345b86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:17.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.299+0000 7f9a816cd000 1 --2- 172.21.15.103:0/428512251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b3458be10 0x564b345b86a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800c3c0 tx=0x7f9a68059cc0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.299+0000 7f9a816cd000 1 -- 172.21.15.103:0/428512251 shutdown_connections 2024-09-10T22:39:17.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.299+0000 7f9a816cd000 1 --2- 172.21.15.103:0/428512251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b345d82f0 0x564b345b93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.299+0000 7f9a816cd000 1 --2- 172.21.15.103:0/428512251 >> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] conn(0x564b345ba0f0 0x564b345e9c90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.299+0000 7f9a816cd000 1 --2- 172.21.15.103:0/428512251 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b345d79d0 0x564b345b8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.299+0000 7f9a816cd000 1 --2- 172.21.15.103:0/428512251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b3458be10 0x564b345b86a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.299+0000 7f9a816cd000 1 -- 172.21.15.103:0/428512251 >> 172.21.15.103:0/428512251 conn(0x564b34475130 msgr2=0x564b3458afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:17.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.299+0000 7f9a64c00640 0 client.4674 ms_handle_reset on v2:172.21.15.131:6834/2821479330 2024-09-10T22:39:17.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.299+0000 7f9a816cd000 1 -- 172.21.15.103:0/428512251 shutdown_connections 2024-09-10T22:39:17.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.299+0000 7f9a816cd000 1 -- 172.21.15.103:0/428512251 wait complete. 2024-09-10T22:39:17.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.299+0000 7f9a816cd000 20 client.4674 trim_cache size 0 max 16384 2024-09-10T22:39:17.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 Processor -- start 2024-09-10T22:39:17.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 -- start start 2024-09-10T22:39:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b3458be10 0x564b34649fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b345d79d0 0x564b3464a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d82f0 0x564b3464aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9a78204160 con 0x564b345d82f0 2024-09-10T22:39:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9a782034f0 con 0x564b3458be10 2024-09-10T22:39:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9a78203b40 con 0x564b345d79d0 2024-09-10T22:39:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a77e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d82f0 0x564b3464aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a77e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d82f0 0x564b3464aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60650/0 (socket says 172.21.15.103:60650) 2024-09-10T22:39:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a77e00640 1 -- 172.21.15.103:0/3077707822 learned_addr learned my addr 172.21.15.103:0/3077707822 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a77e00640 1 -- 172.21.15.103:0/3077707822 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b345d79d0 msgr2=0x564b3464a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:39:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a77e00640 1 --2- 172.21.15.103:0/3077707822 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b345d79d0 0x564b3464a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a77e00640 1 -- 172.21.15.103:0/3077707822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b3458be10 msgr2=0x564b34649fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:39:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a77e00640 1 --2- 172.21.15.103:0/3077707822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b3458be10 0x564b34649fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a77e00640 1 -- 172.21.15.103:0/3077707822 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b34434d90 con 0x564b345d82f0 2024-09-10T22:39:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a77e00640 1 --2- 172.21.15.103:0/3077707822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d82f0 0x564b3464aa60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000ace0 tx=0x7f9a7001aa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f64837662560262 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a67400640 1 -- 172.21.15.103:0/3077707822 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a700bf070 con 0x564b345d82f0 2024-09-10T22:39:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a67400640 1 -- 172.21.15.103:0/3077707822 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a70004d40 con 0x564b345d82f0 2024-09-10T22:39:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a67400640 1 -- 172.21.15.103:0/3077707822 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a700b3040 con 0x564b345d82f0 2024-09-10T22:39:17.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 -- 172.21.15.103:0/3077707822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d82f0 msgr2=0x564b3464aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:17.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 --2- 172.21.15.103:0/3077707822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d82f0 0x564b3464aa60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000ace0 tx=0x7f9a7001aa10 comp rx=0 tx=0).stop 2024-09-10T22:39:17.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 -- 172.21.15.103:0/3077707822 shutdown_connections 2024-09-10T22:39:17.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 --2- 172.21.15.103:0/3077707822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d82f0 0x564b3464aa60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 --2- 172.21.15.103:0/3077707822 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b345d79d0 0x564b3464a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 --2- 172.21.15.103:0/3077707822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b3458be10 0x564b34649fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 -- 172.21.15.103:0/3077707822 >> 172.21.15.103:0/3077707822 conn(0x564b34475130 msgr2=0x564b34593ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:17.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 -- 172.21.15.103:0/3077707822 shutdown_connections 2024-09-10T22:39:17.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 -- 172.21.15.103:0/3077707822 wait complete. 2024-09-10T22:39:17.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 -- start start 2024-09-10T22:39:17.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.319+0000 7f9a816cd000 1 Processor -- start 2024-09-10T22:39:17.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b3458be10 0x564b3464dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:17.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d79d0 0x564b3464e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:17.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b345d82f0 0x564b3464e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:17.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564b343735d0 con 0x564b345d79d0 2024-09-10T22:39:17.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x564b343a4ec0 con 0x564b345d82f0 2024-09-10T22:39:17.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x564b343dcd60 con 0x564b3458be10 2024-09-10T22:39:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 10 client.0 _ll_register_callbacks cb 0x7f9a60009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:39:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a6ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d79d0 0x564b3464e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a6ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d79d0 0x564b3464e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60656/0 (socket says 172.21.15.103:60656) 2024-09-10T22:39:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a6ea00640 1 -- 172.21.15.103:0/424488821 learned_addr learned my addr 172.21.15.103:0/424488821 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a77400640 1 --2- 172.21.15.103:0/424488821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b3458be10 0x564b3464dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a77e00640 1 --2- 172.21.15.103:0/424488821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b345d82f0 0x564b3464e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a6ea00640 1 -- 172.21.15.103:0/424488821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b3458be10 msgr2=0x564b3464dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:39:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a6ea00640 1 --2- 172.21.15.103:0/424488821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b3458be10 0x564b3464dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a6ea00640 1 -- 172.21.15.103:0/424488821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b345d82f0 msgr2=0x564b3464e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:39:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a6ea00640 1 --2- 172.21.15.103:0/424488821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b345d82f0 0x564b3464e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a6ea00640 1 -- 172.21.15.103:0/424488821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b3439fa90 con 0x564b345d79d0 2024-09-10T22:39:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a77e00640 1 --2- 172.21.15.103:0/424488821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b345d82f0 0x564b3464e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a6ea00640 1 --2- 172.21.15.103:0/424488821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d79d0 0x564b3464e140 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x564b34390110 tx=0x7f9a60004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c08eb2cab14a34 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a64c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:39:17.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a64c00640 1 -- 172.21.15.103:0/424488821 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a600040f0 con 0x564b345d79d0 2024-09-10T22:39:17.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a64c00640 1 -- 172.21.15.103:0/424488821 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9a60012450 con 0x564b345d79d0 2024-09-10T22:39:17.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 -- 172.21.15.103:0/424488821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a70004d40 con 0x564b345d79d0 2024-09-10T22:39:17.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a64c00640 1 -- 172.21.15.103:0/424488821 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9a60036050 con 0x564b345d79d0 2024-09-10T22:39:17.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 10 client.4680 fetch_fsmap learned FSMap version 9 2024-09-10T22:39:17.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 -- 172.21.15.103:0/424488821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x564b3437e050 con 0x564b345d79d0 2024-09-10T22:39:17.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a64c00640 1 -- 172.21.15.103:0/424488821 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a70004d40 con 0x564b345d79d0 2024-09-10T22:39:17.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a64c00640 1 -- 172.21.15.103:0/424488821 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f9a60039020 con 0x564b345d79d0 2024-09-10T22:39:17.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 10 client.4680 fetch_fsmap finished waiting for FSMap version 9 2024-09-10T22:39:17.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 10 client.4680 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T22:39:17.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 20 client.4680 populate_metadata read hostname 'smithi103' 2024-09-10T22:39:17.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 --2- 172.21.15.103:0/424488821 >> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] conn(0x564b345ed470 0x564b34656e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:17.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 4 client.4680 mds_command: new command op to 4390 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:39:17.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 -- 172.21.15.103:0/424488821 --> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] -- command(tid 0: {"prefix": "status"}) -- 0x564b343e7520 con 0x564b345ed470 2024-09-10T22:39:17.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a77400640 1 --2- 172.21.15.103:0/424488821 >> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] conn(0x564b345ed470 0x564b34656e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:17.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a77400640 1 --2- 172.21.15.103:0/424488821 >> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] conn(0x564b345ed470 0x564b34656e60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5764885d34d8a3c5 server_cookie=b5625220be7567c9 in_seq=0 out_seq=0 2024-09-10T22:39:17.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a64c00640 10 client.4680 ms_handle_connect on v2:172.21.15.131:6834/2821479330 2024-09-10T22:39:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a64c00640 1 -- 172.21.15.103:0/424488821 <== mds.0 v2:172.21.15.131:6834/2821479330 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x564b343e7520 con 0x564b345ed470 2024-09-10T22:39:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a64c00640 10 client.4680 handle_command_reply: tid=0 2024-09-10T22:39:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 client.4680 shutdown 2024-09-10T22:39:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 -- 172.21.15.103:0/424488821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d79d0 msgr2=0x564b3464e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 --2- 172.21.15.103:0/424488821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d79d0 0x564b3464e140 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x564b34390110 tx=0x7f9a60004740 comp rx=0 tx=0).stop 2024-09-10T22:39:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 -- 172.21.15.103:0/424488821 shutdown_connections 2024-09-10T22:39:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 --2- 172.21.15.103:0/424488821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b345d82f0 0x564b3464e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 --2- 172.21.15.103:0/424488821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564b345d79d0 0x564b3464e140 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 --2- 172.21.15.103:0/424488821 >> [v2:172.21.15.131:6834/2821479330,v1:172.21.15.131:6836/2821479330] conn(0x564b345ed470 0x564b34656e60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 --2- 172.21.15.103:0/424488821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b3458be10 0x564b3464dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a816cd000 1 -- 172.21.15.103:0/424488821 >> 172.21.15.103:0/424488821 conn(0x564b34475130 msgr2=0x564b345d65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.323+0000 7f9a64c00640 0 client.4680 ms_handle_reset on v2:172.21.15.131:6834/2821479330 2024-09-10T22:39:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.327+0000 7f9a816cd000 1 -- 172.21.15.103:0/424488821 shutdown_connections 2024-09-10T22:39:17.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.327+0000 7f9a816cd000 1 -- 172.21.15.103:0/424488821 wait complete. 2024-09-10T22:39:17.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.327+0000 7f9a816cd000 20 client.4680 trim_cache size 0 max 16384 2024-09-10T22:39:17.333 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:39:17.333 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:39:17.333 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-10T22:39:17.333 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4390, 2024-09-10T22:39:17.333 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:39:17.333 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:39:17.333 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:39:17.333 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 27.480203651, 2024-09-10T22:39:17.334 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 9, 2024-09-10T22:39:17.334 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 27, 2024-09-10T22:39:17.334 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 27, 2024-09-10T22:39:17.334 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 33.521023653999997 2024-09-10T22:39:17.334 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:39:17.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.327+0000 7f9a7e200640 1 -- 172.21.15.103:0/1915371215 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9a540725e0 msgr2=0x7f9a54074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:17.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.327+0000 7f9a7e200640 1 --2- 172.21.15.103:0/1915371215 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9a540725e0 0x7f9a54074aa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9a78154db0 tx=0x7f9a600091e0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.327+0000 7f9a7e200640 1 -- 172.21.15.103:0/1915371215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a78072a40 msgr2=0x7f9a78148bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:17.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.327+0000 7f9a7e200640 1 --2- 172.21.15.103:0/1915371215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a78072a40 0x7f9a78148bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800c3f0 tx=0x7f9a6800c8b0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.327+0000 7f9a7e200640 1 -- 172.21.15.103:0/1915371215 shutdown_connections 2024-09-10T22:39:17.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.327+0000 7f9a7e200640 1 --2- 172.21.15.103:0/1915371215 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9a540725e0 0x7f9a54074aa0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.327+0000 7f9a7e200640 1 --2- 172.21.15.103:0/1915371215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a780cf260 0x7f9a781fadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.327+0000 7f9a7e200640 1 --2- 172.21.15.103:0/1915371215 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a780b3320 0x7f9a780b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.327+0000 7f9a7e200640 1 --2- 172.21.15.103:0/1915371215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a78072a40 0x7f9a78148bf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:17.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.327+0000 7f9a7e200640 1 -- 172.21.15.103:0/1915371215 >> 172.21.15.103:0/1915371215 conn(0x7f9a7806cc00 msgr2=0x7f9a780aec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:17.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.327+0000 7f9a7e200640 1 -- 172.21.15.103:0/1915371215 shutdown_connections 2024-09-10T22:39:17.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:17.327+0000 7f9a7e200640 1 -- 172.21.15.103:0/1915371215 wait complete. 2024-09-10T22:39:17.347 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-10T22:39:17.357 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-10T22:39:17.358 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-10T22:39:17.358 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-10T22:39:17.358 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T22:39:17.358 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T22:39:17.358 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-10T22:39:17.358 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T22:39:17.358 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T22:39:17.358 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-10T22:39:17.358 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T22:39:17.358 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T22:39:17.359 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-10T22:39:17.359 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T22:39:17.359 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T22:39:17.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:17.359 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-09-10T22:39:17.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:17.369 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2024-09-10T22:39:17.432 INFO:teuthology.orchestra.run.smithi131.stderr:Cannot find device "ceph-brx" 2024-09-10T22:39:17.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:39:17.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:17.435 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-10T22:39:17.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-10T22:39:17.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:17.444 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T22:39:17.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:17.508 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-09-10T22:39:18.026 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-10T22:39:18.026 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T22:39:18.027 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T22:39:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f372be00640 1 -- 172.21.15.103:0/555210453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37240b3320 msgr2=0x7f3724072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f372be00640 1 --2- 172.21.15.103:0/555210453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37240b3320 0x7f3724072500 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3710009900 tx=0x7f371001c8e0 comp rx=0 tx=0).stop 2024-09-10T22:39:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f372be00640 1 -- 172.21.15.103:0/555210453 shutdown_connections 2024-09-10T22:39:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f372be00640 1 --2- 172.21.15.103:0/555210453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37240b3320 0x7f3724072500 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f372be00640 1 -- 172.21.15.103:0/555210453 >> 172.21.15.103:0/555210453 conn(0x7f372406cc00 msgr2=0x7f372406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f372be00640 1 -- 172.21.15.103:0/555210453 shutdown_connections 2024-09-10T22:39:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f372be00640 1 -- 172.21.15.103:0/555210453 wait complete. 2024-09-10T22:39:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f372be00640 1 Processor -- start 2024-09-10T22:39:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f372be00640 1 -- start start 2024-09-10T22:39:18.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f372be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3724072a40 0x7f372414c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:18.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f372be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37240b3320 0x7f372414dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:18.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f372be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37240cf260 0x7f3724149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:18.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f372be00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3724168560 con 0x7f3724072a40 2024-09-10T22:39:18.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f372be00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f37241683e0 con 0x7f37240cf260 2024-09-10T22:39:18.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f372be00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f37241686e0 con 0x7f37240b3320 2024-09-10T22:39:18.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f3729400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3724072a40 0x7f372414c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:18.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f3729400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3724072a40 0x7f372414c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60672/0 (socket says 172.21.15.103:60672) 2024-09-10T22:39:18.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f3729400640 1 -- 172.21.15.103:0/1008265113 learned_addr learned my addr 172.21.15.103:0/1008265113 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:18.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f3728a00640 1 --2- 172.21.15.103:0/1008265113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37240b3320 0x7f372414dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f3729e00640 1 --2- 172.21.15.103:0/1008265113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37240cf260 0x7f3724149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f3729400640 1 -- 172.21.15.103:0/1008265113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37240b3320 msgr2=0x7f372414dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f3729400640 1 --2- 172.21.15.103:0/1008265113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37240b3320 0x7f372414dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f3729400640 1 -- 172.21.15.103:0/1008265113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37240cf260 msgr2=0x7f3724149470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f3729400640 1 --2- 172.21.15.103:0/1008265113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37240cf260 0x7f3724149470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f3729400640 1 -- 172.21.15.103:0/1008265113 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3724159790 con 0x7f3724072a40 2024-09-10T22:39:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f3728a00640 1 --2- 172.21.15.103:0/1008265113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37240b3320 0x7f372414dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f3729e00640 1 --2- 172.21.15.103:0/1008265113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37240cf260 0x7f3724149470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.167+0000 7f3729400640 1 --2- 172.21.15.103:0/1008265113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3724072a40 0x7f372414c2c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f371800c730 tx=0x7f371800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.171+0000 7f3721600640 1 -- 172.21.15.103:0/1008265113 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3718003b80 con 0x7f3724072a40 2024-09-10T22:39:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.171+0000 7f3721600640 1 -- 172.21.15.103:0/1008265113 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3718003d40 con 0x7f3724072a40 2024-09-10T22:39:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.171+0000 7f3721600640 1 -- 172.21.15.103:0/1008265113 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371800aab0 con 0x7f3724072a40 2024-09-10T22:39:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.171+0000 7f372be00640 1 -- 172.21.15.103:0/1008265113 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3724159a70 con 0x7f3724072a40 2024-09-10T22:39:18.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.171+0000 7f372be00640 1 -- 172.21.15.103:0/1008265113 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f372414b840 con 0x7f3724072a40 2024-09-10T22:39:18.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.171+0000 7f372be00640 1 -- 172.21.15.103:0/1008265113 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3724072500 con 0x7f3724072a40 2024-09-10T22:39:18.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.171+0000 7f3721600640 1 -- 172.21.15.103:0/1008265113 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f371800ac50 con 0x7f3724072a40 2024-09-10T22:39:18.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.171+0000 7f3721600640 1 --2- 172.21.15.103:0/1008265113 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f37040725e0 0x7f3704074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:18.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.171+0000 7f3721600640 1 -- 172.21.15.103:0/1008265113 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f37180933c0 con 0x7f3724072a40 2024-09-10T22:39:18.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.175+0000 7f3728a00640 1 --2- 172.21.15.103:0/1008265113 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f37040725e0 0x7f3704074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:18.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.175+0000 7f3728a00640 1 --2- 172.21.15.103:0/1008265113 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f37040725e0 0x7f3704074aa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f37100af000 tx=0x7f371001b120 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:18.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.175+0000 7f3721600640 1 -- 172.21.15.103:0/1008265113 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f371805e750 con 0x7f3724072a40 2024-09-10T22:39:18.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.379+0000 7f372be00640 1 -- 172.21.15.103:0/1008265113 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3724159c40 con 0x7f3724072a40 2024-09-10T22:39:18.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.379+0000 7f3721600640 1 -- 172.21.15.103:0/1008265113 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f3718065e20 con 0x7f3724072a40 2024-09-10T22:39:18.383 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T22:39:18.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.383+0000 7f372be00640 1 -- 172.21.15.103:0/1008265113 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f37040725e0 msgr2=0x7f3704074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:18.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.383+0000 7f372be00640 1 --2- 172.21.15.103:0/1008265113 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f37040725e0 0x7f3704074aa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f37100af000 tx=0x7f371001b120 comp rx=0 tx=0).stop 2024-09-10T22:39:18.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.383+0000 7f372be00640 1 -- 172.21.15.103:0/1008265113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3724072a40 msgr2=0x7f372414c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:18.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.383+0000 7f372be00640 1 --2- 172.21.15.103:0/1008265113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3724072a40 0x7f372414c2c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f371800c730 tx=0x7f371800cbf0 comp rx=0 tx=0).stop 2024-09-10T22:39:18.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.383+0000 7f372be00640 1 -- 172.21.15.103:0/1008265113 shutdown_connections 2024-09-10T22:39:18.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.383+0000 7f372be00640 1 --2- 172.21.15.103:0/1008265113 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f37040725e0 0x7f3704074aa0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:18.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.383+0000 7f372be00640 1 --2- 172.21.15.103:0/1008265113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37240cf260 0x7f3724149470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:18.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.383+0000 7f372be00640 1 --2- 172.21.15.103:0/1008265113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37240b3320 0x7f372414dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:18.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.383+0000 7f372be00640 1 --2- 172.21.15.103:0/1008265113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3724072a40 0x7f372414c2c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:18.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.383+0000 7f372be00640 1 -- 172.21.15.103:0/1008265113 >> 172.21.15.103:0/1008265113 conn(0x7f372406cc00 msgr2=0x7f37240cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:18.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.383+0000 7f372be00640 1 -- 172.21.15.103:0/1008265113 shutdown_connections 2024-09-10T22:39:18.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18.383+0000 7f372be00640 1 -- 172.21.15.103:0/1008265113 wait complete. 2024-09-10T22:39:18.403 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T22:39:18.403 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T22:39:18.403 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-10T22:39:18.403 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T22:39:18.403 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T22:39:18.403 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T22:39:18.403 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T22:39:18.403 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T22:39:18.404 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:39:18.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:18.404 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-10T22:39:18.413 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T22:39:18.413 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T22:39:18.413 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T22:39:18.413 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:18.414 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-10T22:39:18.414 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:18.414 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:39:18.414 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:18.414 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-10T22:39:18.414 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:39:18.414 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:18.414 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-10T22:39:18.414 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:39:18.414 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:18.414 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T22:39:18.414 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:18.414 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-10T22:39:18.414 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42423sec preferred_lft 42423sec 2024-09-10T22:39:18.415 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2024-09-10T22:39:18.415 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:18.415 INFO:teuthology.orchestra.run.smithi103.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T22:39:18.415 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 02:42:c3:dd:ba:ba brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:18.415 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T22:39:18.415 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:18.415 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T22:39:18.415 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:39:18.415 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:39:18.415 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add name ceph-brx type bridge 2024-09-10T22:39:18.416 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr flush dev ceph-brx 2024-09-10T22:39:18.416 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set ceph-brx up 2024-09-10T22:39:18.416 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T22:39:18.416 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:39:18.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:39:18.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:18.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:18.564 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T22:39:18.582 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-10T22:39:18.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:18.584 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-10T22:39:18.638 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-10T22:39:18.638 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T22:39:18.639 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-10T22:39:18.639 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T22:39:18.639 INFO:teuthology.orchestra.run.smithi103.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-10T22:39:18.639 INFO:teuthology.orchestra.run.smithi103.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T22:39:18.639 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T22:39:18.639 INFO:teuthology.orchestra.run.smithi103.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:39:18.639 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:39:18.639 INFO:teuthology.orchestra.run.smithi103.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:39:18.639 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T22:39:18.639 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:39:18.640 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:39:18.640 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T22:39:18.640 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T22:39:18.640 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T22:39:18.640 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:39:18.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:39:18.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:18.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:18.775 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-10T22:39:18.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:18.785 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2024-09-10T22:39:18.839 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:39:18.840 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:39:18.840 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:39:18.840 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T22:39:18.840 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:39:18.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:39:18.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:18.966 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T22:39:18.966 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:39:18.966 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:39:18.966 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T22:39:18.966 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T22:39:18.967 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T22:39:18.967 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T22:39:18.967 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T22:39:18.967 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:39:19.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:39:19.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:19.148 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:39:19.148 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:39:19.148 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-10T22:39:19.148 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T22:39:19.148 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:39:19.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:39:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:19.231 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T22:39:19.231 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:39:19.231 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T22:39:19.287 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:39:19.287 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:39:19.288 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T22:39:19.339 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:39:19.403 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:39:19.460 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:39:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:39:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:39:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:39:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:39:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:39:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:39:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:39:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:39:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:39:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:39:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:39:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:39:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:39:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:39:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:39:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:39:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:39:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:39:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:39:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:39:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:39:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:39:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:39:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:39:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:39:19.463 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:39:19.463 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:39:19.463 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:39:19.463 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:39:19.463 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:39:19.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:19.464 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:39:19.515 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T22:39:19.515 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T22:39:19.562 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:39:19.582 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:39:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:39:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:39:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:39:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:39:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:39:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:39:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:39:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:39:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:39:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:39:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:39:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:39:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:39:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:39:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:39:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:39:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:39:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:39:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:39:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:39:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:39:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:39:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:39:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:39:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:39:19.639 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:39:19.639 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:39:19.639 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:39:19.639 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:39:19.639 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:39:19.639 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:39:19.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:19.640 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:39:19.655 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2024-09-10T22:39:19.651+0000 7fca80b36580 -1 init, newargv = 0x5620d90898c0 newargc=15 2024-09-10T22:39:19.655 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[36249]: starting ceph client 2024-09-10T22:39:19.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[36249]: starting fuse 2024-09-10T22:39:20.764 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:39:20.787 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:39:20.842 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:39:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:39:20.844 INFO:teuthology.orchestra.run.smithi103.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-10T22:39:20.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:20.845 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:39:20.895 INFO:teuthology.orchestra.run.smithi103.stdout:44 2024-09-10T22:39:20.896 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T22:39:20.896 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-09-10T22:39:20.896 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-09-10T22:39:20.896 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-09-10T22:39:20.896 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:39:20.896 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-09-10T22:39:20.896 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:39:20.896 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-09-10T22:39:20.896 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T22:39:20.897 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-09-10T22:39:20.897 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T22:39:20.897 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:39:20.897 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-09-10T22:39:20.897 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-09-10T22:39:20.897 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-09-10T22:39:20.897 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-09-10T22:39:20.897 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:39:20.897 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-09-10T22:39:20.897 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T22:39:20.897 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T22:39:20.897 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T22:39:20.897 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-09-10T22:39:20.897 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-09-10T22:39:20.898 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-09-10T22:39:20.898 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T22:39:20.898 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:39:20.898 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.0")) 2024-09-10T22:39:20.898 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:39:21.028 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.36249.asok 2024-09-10T22:39:21.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:21.039 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.36249.asok 2024-09-10T22:39:21.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:21.039 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.36249.asok status 2024-09-10T22:39:21.214 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:39:21.215 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-09-10T22:39:21.215 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T22:39:21.215 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:39:21.215 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2024-09-10T22:39:21.215 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-09-10T22:39:21.215 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T22:39:21.215 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "36249", 2024-09-10T22:39:21.215 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-09-10T22:39:21.215 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:21.215 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-09-10T22:39:21.215 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-09-10T22:39:21.215 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4698, 2024-09-10T22:39:21.215 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-09-10T22:39:21.216 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-09-10T22:39:21.216 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-09-10T22:39:21.216 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4698 2024-09-10T22:39:21.216 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:21.216 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T22:39:21.216 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T22:39:21.216 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-10T22:39:21.216 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 777441749 2024-09-10T22:39:21.216 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:21.216 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:21.216 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T22:39:21.216 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T22:39:21.216 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-10T22:39:21.216 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 777441749 2024-09-10T22:39:21.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:21.217 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.4698 192.168.0.1:0/777441749", 2024-09-10T22:39:21.217 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/777441749", 2024-09-10T22:39:21.217 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-09-10T22:39:21.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 9, 2024-09-10T22:39:21.217 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 27, 2024-09-10T22:39:21.217 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-09-10T22:39:21.217 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-09-10T22:39:21.217 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-09-10T22:39:21.217 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:39:21.229 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T22:39:21.230 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T22:39:21.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f763de00640 1 -- 172.21.15.103:0/2357948016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76380d2540 msgr2=0x7f76380b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:21.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f763de00640 1 --2- 172.21.15.103:0/2357948016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76380d2540 0x7f76380b1490 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f763815f6f0 tx=0x7f763001cd50 comp rx=0 tx=0).stop 2024-09-10T22:39:21.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f763de00640 1 -- 172.21.15.103:0/2357948016 shutdown_connections 2024-09-10T22:39:21.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f763de00640 1 --2- 172.21.15.103:0/2357948016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76380d2540 0x7f76380b1490 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:21.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f763de00640 1 --2- 172.21.15.103:0/2357948016 >> v2:172.21.15.131:3300/0 conn(0x7f76380d0710 0x7f76380cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:21.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f763de00640 1 -- 172.21.15.103:0/2357948016 >> 172.21.15.103:0/2357948016 conn(0x7f76380d1a20 msgr2=0x7f76380d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:21.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f763de00640 1 -- 172.21.15.103:0/2357948016 shutdown_connections 2024-09-10T22:39:21.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f763de00640 1 -- 172.21.15.103:0/2357948016 wait complete. 2024-09-10T22:39:21.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f763de00640 1 Processor -- start 2024-09-10T22:39:21.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f763de00640 1 -- start start 2024-09-10T22:39:21.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f763de00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76380d0710 0x7f76380c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:21.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f763de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76380d2540 0x7f763815af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:21.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f763de00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f763815bcb0 0x7f76381faf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:21.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f763de00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7638168960 con 0x7f76380d2540 2024-09-10T22:39:21.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f763de00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f76381687e0 con 0x7f763815bcb0 2024-09-10T22:39:21.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f763de00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7638168ae0 con 0x7f76380d0710 2024-09-10T22:39:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f762e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76380d2540 0x7f763815af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f762e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76380d2540 0x7f763815af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60682/0 (socket says 172.21.15.103:60682) 2024-09-10T22:39:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f762e000640 1 -- 172.21.15.103:0/3404590045 learned_addr learned my addr 172.21.15.103:0/3404590045 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f7637400640 1 --2- 172.21.15.103:0/3404590045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f763815bcb0 0x7f76381faf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f7636a00640 1 --2- 172.21.15.103:0/3404590045 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76380d0710 0x7f76380c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f762e000640 1 -- 172.21.15.103:0/3404590045 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76380d0710 msgr2=0x7f76380c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f762e000640 1 --2- 172.21.15.103:0/3404590045 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76380d0710 0x7f76380c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f762e000640 1 -- 172.21.15.103:0/3404590045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f763815bcb0 msgr2=0x7f76381faf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f762e000640 1 --2- 172.21.15.103:0/3404590045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f763815bcb0 0x7f76381faf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f762e000640 1 -- 172.21.15.103:0/3404590045 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76381fb4b0 con 0x7f76380d2540 2024-09-10T22:39:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f762e000640 1 --2- 172.21.15.103:0/3404590045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76380d2540 0x7f763815af40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f762000e940 tx=0x7f762000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:21.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f762fe00640 1 -- 172.21.15.103:0/3404590045 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762000cd80 con 0x7f76380d2540 2024-09-10T22:39:21.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f762fe00640 1 -- 172.21.15.103:0/3404590045 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7620005020 con 0x7f76380d2540 2024-09-10T22:39:21.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.371+0000 7f762fe00640 1 -- 172.21.15.103:0/3404590045 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7620005450 con 0x7f76380d2540 2024-09-10T22:39:21.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.375+0000 7f763de00640 1 -- 172.21.15.103:0/3404590045 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76380cb930 con 0x7f76380d2540 2024-09-10T22:39:21.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.375+0000 7f763de00640 1 -- 172.21.15.103:0/3404590045 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76381fa770 con 0x7f76380d2540 2024-09-10T22:39:21.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.375+0000 7f763de00640 1 -- 172.21.15.103:0/3404590045 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76380cf5f0 con 0x7f76380d2540 2024-09-10T22:39:21.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.375+0000 7f762fe00640 1 -- 172.21.15.103:0/3404590045 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f76200047b0 con 0x7f76380d2540 2024-09-10T22:39:21.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.375+0000 7f762fe00640 1 --2- 172.21.15.103:0/3404590045 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76140725e0 0x7f7614074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:21.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.375+0000 7f762fe00640 1 -- 172.21.15.103:0/3404590045 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7620094090 con 0x7f76380d2540 2024-09-10T22:39:21.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.375+0000 7f7636a00640 1 --2- 172.21.15.103:0/3404590045 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76140725e0 0x7f7614074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:21.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.379+0000 7f7636a00640 1 --2- 172.21.15.103:0/3404590045 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76140725e0 0x7f7614074aa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7628001650 tx=0x7f7628009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:21.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.379+0000 7f762fe00640 1 -- 172.21.15.103:0/3404590045 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f762005f390 con 0x7f76380d2540 2024-09-10T22:39:21.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.579+0000 7f763de00640 1 -- 172.21.15.103:0/3404590045 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f76380723d0 con 0x7f76380d2540 2024-09-10T22:39:21.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.583+0000 7f762fe00640 1 -- 172.21.15.103:0/3404590045 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f762005ec90 con 0x7f76380d2540 2024-09-10T22:39:21.584 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T22:39:21.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.583+0000 7f763de00640 1 -- 172.21.15.103:0/3404590045 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76140725e0 msgr2=0x7f7614074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:21.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.583+0000 7f763de00640 1 --2- 172.21.15.103:0/3404590045 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76140725e0 0x7f7614074aa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7628001650 tx=0x7f7628009040 comp rx=0 tx=0).stop 2024-09-10T22:39:21.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.583+0000 7f763de00640 1 -- 172.21.15.103:0/3404590045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76380d2540 msgr2=0x7f763815af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:21.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.583+0000 7f763de00640 1 --2- 172.21.15.103:0/3404590045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76380d2540 0x7f763815af40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f762000e940 tx=0x7f762000ee00 comp rx=0 tx=0).stop 2024-09-10T22:39:21.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.583+0000 7f763de00640 1 -- 172.21.15.103:0/3404590045 shutdown_connections 2024-09-10T22:39:21.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.583+0000 7f763de00640 1 --2- 172.21.15.103:0/3404590045 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76140725e0 0x7f7614074aa0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:21.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.583+0000 7f763de00640 1 --2- 172.21.15.103:0/3404590045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f763815bcb0 0x7f76381faf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:21.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.583+0000 7f763de00640 1 --2- 172.21.15.103:0/3404590045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76380d2540 0x7f763815af40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:21.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.583+0000 7f763de00640 1 --2- 172.21.15.103:0/3404590045 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76380d0710 0x7f76380c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:21.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.583+0000 7f763de00640 1 -- 172.21.15.103:0/3404590045 >> 172.21.15.103:0/3404590045 conn(0x7f76380d1a20 msgr2=0x7f76380d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:21.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.583+0000 7f763de00640 1 -- 172.21.15.103:0/3404590045 shutdown_connections 2024-09-10T22:39:21.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21.583+0000 7f763de00640 1 -- 172.21.15.103:0/3404590045 wait complete. 2024-09-10T22:39:21.604 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T22:39:21.604 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T22:39:21.604 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-10T22:39:21.604 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-10T22:39:21.605 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T22:39:21.605 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T22:39:21.605 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T22:39:21.605 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T22:39:21.605 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-10T22:39:21.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:21.605 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-10T22:39:21.614 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T22:39:21.614 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T22:39:21.614 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T22:39:21.614 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:21.614 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-10T22:39:21.614 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:21.614 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:39:21.614 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:21.614 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-10T22:39:21.615 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:39:21.615 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:21.615 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-10T22:39:21.615 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:39:21.615 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:21.615 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T22:39:21.615 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:21.615 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-10T22:39:21.615 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42420sec preferred_lft 42420sec 2024-09-10T22:39:21.615 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2024-09-10T22:39:21.615 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:21.615 INFO:teuthology.orchestra.run.smithi103.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T22:39:21.615 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 02:42:c3:dd:ba:ba brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:21.616 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T22:39:21.616 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:21.616 INFO:teuthology.orchestra.run.smithi103.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T22:39:21.616 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:21.616 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T22:39:21.616 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:21.616 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T22:39:21.616 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:21.616 INFO:teuthology.orchestra.run.smithi103.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T22:39:21.616 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:39:21.616 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T22:39:21.616 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:21.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:21.617 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T22:39:21.680 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-10T22:39:21.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:21.682 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-10T22:39:21.738 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-10T22:39:21.738 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T22:39:21.738 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-10T22:39:21.739 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T22:39:21.739 INFO:teuthology.orchestra.run.smithi103.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-10T22:39:21.739 INFO:teuthology.orchestra.run.smithi103.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T22:39:21.739 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T22:39:21.739 INFO:teuthology.orchestra.run.smithi103.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:39:21.739 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:39:21.739 INFO:teuthology.orchestra.run.smithi103.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:39:21.739 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T22:39:21.739 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:39:21.739 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:39:21.739 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T22:39:21.740 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T22:39:21.740 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T22:39:21.740 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:39:21.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:39:21.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:21.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:21.878 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-10T22:39:21.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T22:39:21.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:21.929 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2024-09-10T22:39:21.979 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-10T22:39:21.980 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:39:21.980 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:39:21.980 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:39:21.980 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-10T22:39:21.980 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:39:22.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:39:22.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:22.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:22.105 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T22:39:22.167 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T22:39:22.167 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T22:39:22.167 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T22:39:22.167 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:22.168 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-10T22:39:22.168 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:22.168 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T22:39:22.168 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 72:8e:68:92:6a:17 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T22:39:22.168 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T22:39:22.168 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:22.168 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::708e:68ff:fe92:6a17/64 scope link 2024-09-10T22:39:22.168 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:22.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:22.169 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T22:39:22.232 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T22:39:22.232 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T22:39:22.232 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T22:39:22.232 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:22.232 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-10T22:39:22.232 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:22.233 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T22:39:22.233 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 72:8e:68:92:6a:17 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T22:39:22.233 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T22:39:22.233 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:22.233 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::708e:68ff:fe92:6a17/64 scope link 2024-09-10T22:39:22.233 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:22.234 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-10T22:39:22.234 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:39:22.234 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:39:22.235 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-10T22:39:22.235 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T22:39:22.235 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-10T22:39:22.235 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-10T22:39:22.235 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-10T22:39:22.235 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:39:22.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:39:22.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:22.413 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:39:22.413 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:39:22.413 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.1 up 2024-09-10T22:39:22.413 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T22:39:22.413 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:39:22.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:39:22.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:22.494 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-10T22:39:22.494 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:39:22.495 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-10T22:39:22.543 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-10T22:39:22.544 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:39:22.544 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-10T22:39:22.599 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:39:22.663 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:39:22.716 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:39:22.716 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:39:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:39:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:39:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:39:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:39:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:39:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:39:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:39:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:39:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:39:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:39:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:39:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:39:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:39:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:39:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:39:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:39:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:39:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:39:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:39:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:39:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:39:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:39:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:39:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:39:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:39:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:39:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:39:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:39:22.719 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:39:22.719 INFO:teuthology.orchestra.run.smithi103.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-10T22:39:22.719 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:39:22.719 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:39:22.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:22.720 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:39:22.771 INFO:teuthology.orchestra.run.smithi103.stdout:44 2024-09-10T22:39:22.771 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-09-10T22:39:22.771 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-10T22:39:22.818 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:39:22.838 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:39:22.889 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:39:22.889 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:39:22.889 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:39:22.889 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:39:22.889 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:39:22.889 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:39:22.889 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:39:22.889 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:39:22.890 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:39:22.890 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:39:22.890 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:39:22.890 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:39:22.890 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:39:22.890 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:39:22.890 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:39:22.890 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:39:22.890 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:39:22.890 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:39:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:39:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:39:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:39:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:39:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:39:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:39:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:39:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:39:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:39:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:39:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:39:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:39:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:39:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-10T22:39:22.892 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:39:22.892 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:39:22.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:22.893 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:39:22.912 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi103.stderr:2024-09-10T22:39:22.911+0000 7fe6e09ce580 -1 init, newargv = 0x55bdc979ad00 newargc=15 2024-09-10T22:39:22.912 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi103.stderr:ceph-fuse[36394]: starting ceph client 2024-09-10T22:39:22.919 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi103.stderr:ceph-fuse[36394]: starting fuse 2024-09-10T22:39:22.920 INFO:teuthology.orchestra.run.smithi103.stdout:44 2024-09-10T22:39:22.920 INFO:teuthology.orchestra.run.smithi103.stdout:45 2024-09-10T22:39:22.921 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-09-10T22:39:22.921 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-09-10T22:39:22.921 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-09-10T22:39:22.921 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-09-10T22:39:22.921 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:39:22.921 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-09-10T22:39:22.921 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:39:22.921 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-09-10T22:39:22.921 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-10T22:39:22.921 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-09-10T22:39:22.921 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-10T22:39:22.922 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:39:22.922 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-09-10T22:39:22.922 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-09-10T22:39:22.922 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-09-10T22:39:22.922 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-09-10T22:39:22.922 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:39:22.922 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-09-10T22:39:22.922 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T22:39:22.922 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T22:39:22.922 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T22:39:22.922 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-09-10T22:39:22.922 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-09-10T22:39:22.922 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-09-10T22:39:22.922 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T22:39:22.923 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:39:22.923 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.2")) 2024-09-10T22:39:22.923 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:39:23.045 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.2.36394.asok 2024-09-10T22:39:23.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:23.056 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.36394.asok 2024-09-10T22:39:23.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:23.056 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.36394.asok status 2024-09-10T22:39:23.229 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:39:23.230 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-09-10T22:39:23.230 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T22:39:23.230 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:39:23.230 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "2", 2024-09-10T22:39:23.230 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-09-10T22:39:23.230 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-10T22:39:23.230 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "36394", 2024-09-10T22:39:23.230 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-09-10T22:39:23.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:23.230 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-09-10T22:39:23.230 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-09-10T22:39:23.230 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4710, 2024-09-10T22:39:23.230 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-09-10T22:39:23.230 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-09-10T22:39:23.231 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-09-10T22:39:23.231 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4710 2024-09-10T22:39:23.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:23.231 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T22:39:23.231 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T22:39:23.231 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2024-09-10T22:39:23.231 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3634278086 2024-09-10T22:39:23.231 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:23.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:23.231 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T22:39:23.231 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T22:39:23.231 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2024-09-10T22:39:23.231 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3634278086 2024-09-10T22:39:23.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:23.232 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.4710 192.168.0.2:0/3634278086", 2024-09-10T22:39:23.232 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.2:0/3634278086", 2024-09-10T22:39:23.232 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-09-10T22:39:23.232 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 9, 2024-09-10T22:39:23.232 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 27, 2024-09-10T22:39:23.232 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-09-10T22:39:23.232 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-09-10T22:39:23.232 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-09-10T22:39:23.232 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:39:23.244 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T22:39:23.245 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T22:39:23.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.383+0000 7f56eb800640 1 -- 172.21.15.103:0/2308223851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56e40cfda0 msgr2=0x7f56e415eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:23.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.383+0000 7f56eb800640 1 --2- 172.21.15.103:0/2308223851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56e40cfda0 0x7f56e415eca0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009840 tx=0x7f56d401c6d0 comp rx=0 tx=0).stop 2024-09-10T22:39:23.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.383+0000 7f56eb800640 1 -- 172.21.15.103:0/2308223851 shutdown_connections 2024-09-10T22:39:23.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.383+0000 7f56eb800640 1 --2- 172.21.15.103:0/2308223851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56e40cfda0 0x7f56e415eca0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:23.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.383+0000 7f56eb800640 1 -- 172.21.15.103:0/2308223851 >> 172.21.15.103:0/2308223851 conn(0x7f56e40d1ad0 msgr2=0x7f56e40d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:23.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.383+0000 7f56eb800640 1 -- 172.21.15.103:0/2308223851 shutdown_connections 2024-09-10T22:39:23.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.383+0000 7f56eb800640 1 -- 172.21.15.103:0/2308223851 wait complete. 2024-09-10T22:39:23.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56eb800640 1 Processor -- start 2024-09-10T22:39:23.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56eb800640 1 -- start start 2024-09-10T22:39:23.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56eb800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e40717a0 0x7f56e415e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:23.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56eb800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56e40cfda0 0x7f56e40ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:23.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56eb800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56e40d25f0 0x7f56e40c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:23.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56eb800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f56e416a330 con 0x7f56e40cfda0 2024-09-10T22:39:23.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56eb800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f56e416a1b0 con 0x7f56e40d25f0 2024-09-10T22:39:23.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56eb800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f56e416a4b0 con 0x7f56e40717a0 2024-09-10T22:39:23.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56dbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56e40cfda0 0x7f56e40ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:23.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56dbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56e40cfda0 0x7f56e40ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60700/0 (socket says 172.21.15.103:60700) 2024-09-10T22:39:23.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56dbe00640 1 -- 172.21.15.103:0/4033201699 learned_addr learned my addr 172.21.15.103:0/4033201699 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:23.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56e9800640 1 --2- 172.21.15.103:0/4033201699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56e40d25f0 0x7f56e40c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:23.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56e8e00640 1 --2- 172.21.15.103:0/4033201699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e40717a0 0x7f56e415e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:23.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56dbe00640 1 -- 172.21.15.103:0/4033201699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e40717a0 msgr2=0x7f56e415e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:23.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56dbe00640 1 --2- 172.21.15.103:0/4033201699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e40717a0 0x7f56e415e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:23.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56dbe00640 1 -- 172.21.15.103:0/4033201699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56e40d25f0 msgr2=0x7f56e40c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:23.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56dbe00640 1 --2- 172.21.15.103:0/4033201699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56e40d25f0 0x7f56e40c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:23.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56dbe00640 1 -- 172.21.15.103:0/4033201699 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e40cd810 con 0x7f56e40cfda0 2024-09-10T22:39:23.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56dbe00640 1 --2- 172.21.15.103:0/4033201699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56e40cfda0 0x7f56e40ccda0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00b410 tx=0x7f56cc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:23.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56e1600640 1 -- 172.21.15.103:0/4033201699 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc015030 con 0x7f56e40cfda0 2024-09-10T22:39:23.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56e1600640 1 -- 172.21.15.103:0/4033201699 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56cc004020 con 0x7f56e40cfda0 2024-09-10T22:39:23.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56e1600640 1 -- 172.21.15.103:0/4033201699 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc004470 con 0x7f56e40cfda0 2024-09-10T22:39:23.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56eb800640 1 -- 172.21.15.103:0/4033201699 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e40cdaf0 con 0x7f56e40cfda0 2024-09-10T22:39:23.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.387+0000 7f56eb800640 1 -- 172.21.15.103:0/4033201699 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e40b1570 con 0x7f56e40cfda0 2024-09-10T22:39:23.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.391+0000 7f56eb800640 1 -- 172.21.15.103:0/4033201699 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e415eca0 con 0x7f56e40cfda0 2024-09-10T22:39:23.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.391+0000 7f56e1600640 1 -- 172.21.15.103:0/4033201699 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f56cc022060 con 0x7f56e40cfda0 2024-09-10T22:39:23.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.391+0000 7f56e1600640 1 --2- 172.21.15.103:0/4033201699 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f56c00725e0 0x7f56c0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:23.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.391+0000 7f56e1600640 1 -- 172.21.15.103:0/4033201699 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f56cc0932a0 con 0x7f56e40cfda0 2024-09-10T22:39:23.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.391+0000 7f56e8e00640 1 --2- 172.21.15.103:0/4033201699 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f56c00725e0 0x7f56c0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:23.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.391+0000 7f56e8e00640 1 --2- 172.21.15.103:0/4033201699 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f56c00725e0 0x7f56c0074aa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f56d40af000 tx=0x7f56d401af10 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:23.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.395+0000 7f56e1600640 1 -- 172.21.15.103:0/4033201699 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f56cc05e160 con 0x7f56e40cfda0 2024-09-10T22:39:23.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.595+0000 7f56eb800640 1 -- 172.21.15.103:0/4033201699 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f56e415b2b0 con 0x7f56e40cfda0 2024-09-10T22:39:23.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.595+0000 7f56e1600640 1 -- 172.21.15.103:0/4033201699 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f56cc062b90 con 0x7f56e40cfda0 2024-09-10T22:39:23.597 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T22:39:23.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.595+0000 7f56eb800640 1 -- 172.21.15.103:0/4033201699 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f56c00725e0 msgr2=0x7f56c0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:23.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.595+0000 7f56eb800640 1 --2- 172.21.15.103:0/4033201699 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f56c00725e0 0x7f56c0074aa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f56d40af000 tx=0x7f56d401af10 comp rx=0 tx=0).stop 2024-09-10T22:39:23.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.595+0000 7f56eb800640 1 -- 172.21.15.103:0/4033201699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56e40cfda0 msgr2=0x7f56e40ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:23.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.595+0000 7f56eb800640 1 --2- 172.21.15.103:0/4033201699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56e40cfda0 0x7f56e40ccda0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00b410 tx=0x7f56cc00b8d0 comp rx=0 tx=0).stop 2024-09-10T22:39:23.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.595+0000 7f56eb800640 1 -- 172.21.15.103:0/4033201699 shutdown_connections 2024-09-10T22:39:23.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.595+0000 7f56eb800640 1 --2- 172.21.15.103:0/4033201699 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f56c00725e0 0x7f56c0074aa0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:23.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.595+0000 7f56eb800640 1 --2- 172.21.15.103:0/4033201699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56e40d25f0 0x7f56e40c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:23.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.595+0000 7f56eb800640 1 --2- 172.21.15.103:0/4033201699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56e40cfda0 0x7f56e40ccda0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:23.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.595+0000 7f56eb800640 1 --2- 172.21.15.103:0/4033201699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e40717a0 0x7f56e415e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:23.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.595+0000 7f56eb800640 1 -- 172.21.15.103:0/4033201699 >> 172.21.15.103:0/4033201699 conn(0x7f56e40d1ad0 msgr2=0x7f56e40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:23.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.595+0000 7f56eb800640 1 -- 172.21.15.103:0/4033201699 shutdown_connections 2024-09-10T22:39:23.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:23.595+0000 7f56eb800640 1 -- 172.21.15.103:0/4033201699 wait complete. 2024-09-10T22:39:23.620 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T22:39:23.620 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T22:39:23.620 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2024-09-10T22:39:23.620 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T22:39:23.620 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T22:39:23.620 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T22:39:23.620 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T22:39:23.620 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T22:39:23.620 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T22:39:23.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:23.621 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2024-09-10T22:39:23.630 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T22:39:23.631 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T22:39:23.631 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T22:39:23.631 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:23.631 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-09-10T22:39:23.631 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:23.631 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:39:23.631 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:23.631 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2024-09-10T22:39:23.631 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:39:23.631 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:23.631 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2024-09-10T22:39:23.631 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:39:23.631 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:23.632 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T22:39:23.632 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:23.632 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-10T22:39:23.632 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42402sec preferred_lft 42402sec 2024-09-10T22:39:23.632 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2024-09-10T22:39:23.632 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:23.632 INFO:teuthology.orchestra.run.smithi131.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T22:39:23.632 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 02:42:f1:15:16:33 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:23.632 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T22:39:23.632 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:23.633 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T22:39:23.633 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:39:23.633 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-10T22:39:23.633 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add name ceph-brx type bridge 2024-09-10T22:39:23.633 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr flush dev ceph-brx 2024-09-10T22:39:23.634 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set ceph-brx up 2024-09-10T22:39:23.634 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T22:39:23.634 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-10T22:39:23.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:39:23.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:23.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:23.803 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T22:39:23.822 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-09-10T22:39:23.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:23.825 DEBUG:teuthology.orchestra.run.smithi131:> route 2024-09-10T22:39:23.909 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2024-09-10T22:39:23.909 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T22:39:23.909 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-10T22:39:23.909 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T22:39:23.909 INFO:teuthology.orchestra.run.smithi131.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-10T22:39:23.909 INFO:teuthology.orchestra.run.smithi131.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T22:39:23.910 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T22:39:23.910 INFO:teuthology.orchestra.run.smithi131.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:39:23.910 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:39:23.910 INFO:teuthology.orchestra.run.smithi131.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:39:23.910 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T22:39:23.910 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:39:23.910 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-10T22:39:23.910 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T22:39:23.910 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T22:39:23.910 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T22:39:23.911 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-10T22:39:23.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:39:24.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:24.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:24.045 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-09-10T22:39:24.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:24.054 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list-id 2024-09-10T22:39:24.106 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:39:24.106 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-10T22:39:24.106 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T22:39:24.106 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-10T22:39:24.106 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-10T22:39:24.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:39:24.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:24.232 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-10T22:39:24.232 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:39:24.232 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-10T22:39:24.233 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-10T22:39:24.233 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T22:39:24.233 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-10T22:39:24.233 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-10T22:39:24.233 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-10T22:39:24.233 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-10T22:39:24.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:39:24.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:24.394 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:39:24.394 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-10T22:39:24.394 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2024-09-10T22:39:24.394 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T22:39:24.394 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-10T22:39:24.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:39:24.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:24.520 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-10T22:39:24.520 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:39:24.521 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T22:39:24.529 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T22:39:24.529 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:39:24.529 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T22:39:24.581 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-09-10T22:39:24.645 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:39:24.699 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-09-10T22:39:24.699 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-09-10T22:39:24.699 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-09-10T22:39:24.699 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-09-10T22:39:24.699 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-09-10T22:39:24.699 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-09-10T22:39:24.699 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-09-10T22:39:24.699 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-09-10T22:39:24.699 INFO:teuthology.orchestra.run.smithi131.stdout:/run/lock 2024-09-10T22:39:24.699 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-09-10T22:39:24.699 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-09-10T22:39:24.700 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-09-10T22:39:24.700 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:39:24.700 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-09-10T22:39:24.700 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-09-10T22:39:24.700 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-09-10T22:39:24.700 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-09-10T22:39:24.700 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/fs/nfsd 2024-09-10T22:39:24.700 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-09-10T22:39:24.700 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-09-10T22:39:24.700 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:39:24.700 INFO:teuthology.orchestra.run.smithi131.stdout:/run/rpc_pipefs 2024-09-10T22:39:24.700 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-09-10T22:39:24.701 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-09-10T22:39:24.701 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T22:39:24.701 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T22:39:24.701 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T22:39:24.701 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T22:39:24.701 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-09-10T22:39:24.701 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T22:39:24.701 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T22:39:24.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:24.702 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-09-10T22:39:24.753 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T22:39:24.754 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-10T22:39:24.800 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-09-10T22:39:24.821 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:39:24.872 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-09-10T22:39:24.872 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-09-10T22:39:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-09-10T22:39:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-09-10T22:39:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-09-10T22:39:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-09-10T22:39:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-09-10T22:39:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-09-10T22:39:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:/run/lock 2024-09-10T22:39:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-09-10T22:39:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-09-10T22:39:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-09-10T22:39:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:39:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-09-10T22:39:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-09-10T22:39:24.874 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-09-10T22:39:24.874 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-09-10T22:39:24.874 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/fs/nfsd 2024-09-10T22:39:24.874 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-09-10T22:39:24.874 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-09-10T22:39:24.874 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:39:24.874 INFO:teuthology.orchestra.run.smithi131.stdout:/run/rpc_pipefs 2024-09-10T22:39:24.874 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-09-10T22:39:24.874 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-09-10T22:39:24.874 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T22:39:24.874 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T22:39:24.874 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T22:39:24.874 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T22:39:24.874 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-09-10T22:39:24.875 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T22:39:24.875 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T22:39:24.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:24.876 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-09-10T22:39:24.895 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi131.stderr:2024-09-10T22:39:24.891+0000 7f16bc818580 -1 init, newargv = 0x55a9e3b65a60 newargc=15 2024-09-10T22:39:24.895 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi131.stderr:ceph-fuse[34761]: starting ceph client 2024-09-10T22:39:24.904 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi131.stderr:ceph-fuse[34761]: starting fuse 2024-09-10T22:39:26.005 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-09-10T22:39:26.029 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:39:26.080 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-09-10T22:39:26.080 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-09-10T22:39:26.080 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-09-10T22:39:26.080 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-09-10T22:39:26.080 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-09-10T22:39:26.080 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-09-10T22:39:26.080 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-09-10T22:39:26.080 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-09-10T22:39:26.080 INFO:teuthology.orchestra.run.smithi131.stdout:/run/lock 2024-09-10T22:39:26.080 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-09-10T22:39:26.080 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-09-10T22:39:26.081 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-09-10T22:39:26.081 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:39:26.081 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-09-10T22:39:26.081 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-09-10T22:39:26.081 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-09-10T22:39:26.081 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-09-10T22:39:26.081 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/fs/nfsd 2024-09-10T22:39:26.081 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-09-10T22:39:26.081 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-09-10T22:39:26.081 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:39:26.081 INFO:teuthology.orchestra.run.smithi131.stdout:/run/rpc_pipefs 2024-09-10T22:39:26.081 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-09-10T22:39:26.081 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-09-10T22:39:26.081 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T22:39:26.082 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T22:39:26.082 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T22:39:26.082 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T22:39:26.082 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-09-10T22:39:26.082 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T22:39:26.082 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T22:39:26.082 INFO:teuthology.orchestra.run.smithi131.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-10T22:39:26.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:26.083 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-09-10T22:39:26.134 INFO:teuthology.orchestra.run.smithi131.stdout:44 2024-09-10T22:39:26.134 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T22:39:26.134 DEBUG:teuthology.orchestra.run.smithi131:> sudo stdin-killer -- python3 -c ' 2024-09-10T22:39:26.134 DEBUG:teuthology.orchestra.run.smithi131:> import glob 2024-09-10T22:39:26.134 DEBUG:teuthology.orchestra.run.smithi131:> import re 2024-09-10T22:39:26.135 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-09-10T22:39:26.135 DEBUG:teuthology.orchestra.run.smithi131:> import subprocess 2024-09-10T22:39:26.135 DEBUG:teuthology.orchestra.run.smithi131:> 2024-09-10T22:39:26.135 DEBUG:teuthology.orchestra.run.smithi131:> def _find_admin_socket(client_name): 2024-09-10T22:39:26.135 DEBUG:teuthology.orchestra.run.smithi131:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-10T22:39:26.135 DEBUG:teuthology.orchestra.run.smithi131:> files = glob.glob(asok_path) 2024-09-10T22:39:26.135 DEBUG:teuthology.orchestra.run.smithi131:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-10T22:39:26.135 DEBUG:teuthology.orchestra.run.smithi131:> 2024-09-10T22:39:26.135 DEBUG:teuthology.orchestra.run.smithi131:> # Given a non-glob path, it better be there 2024-09-10T22:39:26.135 DEBUG:teuthology.orchestra.run.smithi131:> if "*" not in asok_path: 2024-09-10T22:39:26.135 DEBUG:teuthology.orchestra.run.smithi131:> assert(len(files) == 1) 2024-09-10T22:39:26.136 DEBUG:teuthology.orchestra.run.smithi131:> return files[0] 2024-09-10T22:39:26.136 DEBUG:teuthology.orchestra.run.smithi131:> 2024-09-10T22:39:26.136 DEBUG:teuthology.orchestra.run.smithi131:> for f in files: 2024-09-10T22:39:26.136 DEBUG:teuthology.orchestra.run.smithi131:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T22:39:26.136 DEBUG:teuthology.orchestra.run.smithi131:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T22:39:26.136 DEBUG:teuthology.orchestra.run.smithi131:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T22:39:26.136 DEBUG:teuthology.orchestra.run.smithi131:> contents = proc_f.read() 2024-09-10T22:39:26.136 DEBUG:teuthology.orchestra.run.smithi131:> if mountpoint in contents: 2024-09-10T22:39:26.136 DEBUG:teuthology.orchestra.run.smithi131:> return f 2024-09-10T22:39:26.136 DEBUG:teuthology.orchestra.run.smithi131:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T22:39:26.136 DEBUG:teuthology.orchestra.run.smithi131:> 2024-09-10T22:39:26.136 DEBUG:teuthology.orchestra.run.smithi131:> print(_find_admin_socket("client.1")) 2024-09-10T22:39:26.136 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-09-10T22:39:26.264 INFO:teuthology.orchestra.run.smithi131.stdout:/var/run/ceph/ceph-client.1.34761.asok 2024-09-10T22:39:26.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:26.275 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.34761.asok 2024-09-10T22:39:26.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:26.275 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.34761.asok status 2024-09-10T22:39:26.445 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-09-10T22:39:26.445 INFO:teuthology.orchestra.run.smithi131.stdout: "metadata": { 2024-09-10T22:39:26.445 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T22:39:26.446 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:39:26.446 INFO:teuthology.orchestra.run.smithi131.stdout: "entity_id": "1", 2024-09-10T22:39:26.446 INFO:teuthology.orchestra.run.smithi131.stdout: "hostname": "smithi131", 2024-09-10T22:39:26.446 INFO:teuthology.orchestra.run.smithi131.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-10T22:39:26.446 INFO:teuthology.orchestra.run.smithi131.stdout: "pid": "34761", 2024-09-10T22:39:26.446 INFO:teuthology.orchestra.run.smithi131.stdout: "root": "/" 2024-09-10T22:39:26.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-10T22:39:26.446 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_count": 0, 2024-09-10T22:39:26.446 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_pinned_count": 0, 2024-09-10T22:39:26.446 INFO:teuthology.orchestra.run.smithi131.stdout: "id": 4598, 2024-09-10T22:39:26.446 INFO:teuthology.orchestra.run.smithi131.stdout: "inst": { 2024-09-10T22:39:26.446 INFO:teuthology.orchestra.run.smithi131.stdout: "name": { 2024-09-10T22:39:26.446 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "client", 2024-09-10T22:39:26.447 INFO:teuthology.orchestra.run.smithi131.stdout: "num": 4598 2024-09-10T22:39:26.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-10T22:39:26.447 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-09-10T22:39:26.447 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-09-10T22:39:26.447 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.1:0", 2024-09-10T22:39:26.447 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 480656285 2024-09-10T22:39:26.447 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-10T22:39:26.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-10T22:39:26.447 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-09-10T22:39:26.447 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-09-10T22:39:26.447 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.1:0", 2024-09-10T22:39:26.447 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 480656285 2024-09-10T22:39:26.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-10T22:39:26.447 INFO:teuthology.orchestra.run.smithi131.stdout: "inst_str": "client.4598 192.168.0.1:0/480656285", 2024-09-10T22:39:26.448 INFO:teuthology.orchestra.run.smithi131.stdout: "addr_str": "192.168.0.1:0/480656285", 2024-09-10T22:39:26.448 INFO:teuthology.orchestra.run.smithi131.stdout: "inode_count": 1, 2024-09-10T22:39:26.448 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_epoch": 9, 2024-09-10T22:39:26.448 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch": 27, 2024-09-10T22:39:26.448 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch_barrier": 0, 2024-09-10T22:39:26.448 INFO:teuthology.orchestra.run.smithi131.stdout: "blocklisted": false, 2024-09-10T22:39:26.448 INFO:teuthology.orchestra.run.smithi131.stdout: "fs_name": "cephfs" 2024-09-10T22:39:26.448 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-09-10T22:39:26.460 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T22:39:26.460 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T22:39:26.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d9ce00640 1 -- 172.21.15.103:0/875165400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d980cd500 msgr2=0x7f8d9815f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:26.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d9ce00640 1 --2- 172.21.15.103:0/875165400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d980cd500 0x7f8d9815f890 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009c80 tx=0x7f8d9001cda0 comp rx=0 tx=0).stop 2024-09-10T22:39:26.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d9ce00640 1 -- 172.21.15.103:0/875165400 shutdown_connections 2024-09-10T22:39:26.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d9ce00640 1 --2- 172.21.15.103:0/875165400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d980cd500 0x7f8d9815f890 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:26.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d9ce00640 1 --2- 172.21.15.103:0/875165400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d980cdd00 0x7f8d980ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:26.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d9ce00640 1 -- 172.21.15.103:0/875165400 >> 172.21.15.103:0/875165400 conn(0x7f8d980d1a20 msgr2=0x7f8d980d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:26.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d9ce00640 1 -- 172.21.15.103:0/875165400 shutdown_connections 2024-09-10T22:39:26.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d9ce00640 1 -- 172.21.15.103:0/875165400 wait complete. 2024-09-10T22:39:26.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d9ce00640 1 Processor -- start 2024-09-10T22:39:26.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d9ce00640 1 -- start start 2024-09-10T22:39:26.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d9ce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d980cd500 0x7f8d98159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:26.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d9ce00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d980cdd00 0x7f8d98158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:26.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d9ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d9815f1a0 0x7f8d981659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:26.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d9ce00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8d98168f60 con 0x7f8d9815f1a0 2024-09-10T22:39:26.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d9ce00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8d98168de0 con 0x7f8d980cd500 2024-09-10T22:39:26.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d9ce00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8d981690e0 con 0x7f8d980cdd00 2024-09-10T22:39:26.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d95e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d980cd500 0x7f8d98159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:26.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d96800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d9815f1a0 0x7f8d981659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:26.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d96800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d9815f1a0 0x7f8d981659e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60728/0 (socket says 172.21.15.103:60728) 2024-09-10T22:39:26.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d96800640 1 -- 172.21.15.103:0/993148104 learned_addr learned my addr 172.21.15.103:0/993148104 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:26.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d95e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d980cd500 0x7f8d98159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:37136/0 (socket says 172.21.15.103:37136) 2024-09-10T22:39:26.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d8d400640 1 --2- 172.21.15.103:0/993148104 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d980cdd00 0x7f8d98158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:26.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d96800640 1 -- 172.21.15.103:0/993148104 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d980cdd00 msgr2=0x7f8d98158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:26.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d96800640 1 --2- 172.21.15.103:0/993148104 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d980cdd00 0x7f8d98158640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:26.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d96800640 1 -- 172.21.15.103:0/993148104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d980cd500 msgr2=0x7f8d98159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:26.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d96800640 1 --2- 172.21.15.103:0/993148104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d980cd500 0x7f8d98159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:26.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.611+0000 7f8d96800640 1 -- 172.21.15.103:0/993148104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9815a890 con 0x7f8d9815f1a0 2024-09-10T22:39:26.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.615+0000 7f8d96800640 1 --2- 172.21.15.103:0/993148104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d9815f1a0 0x7f8d981659e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009bd0 tx=0x7f8d90009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:26.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.615+0000 7f8d8ea00640 1 -- 172.21.15.103:0/993148104 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d900bb070 con 0x7f8d9815f1a0 2024-09-10T22:39:26.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.615+0000 7f8d8ea00640 1 -- 172.21.15.103:0/993148104 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d90004d10 con 0x7f8d9815f1a0 2024-09-10T22:39:26.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.615+0000 7f8d8ea00640 1 -- 172.21.15.103:0/993148104 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d900b2040 con 0x7f8d9815f1a0 2024-09-10T22:39:26.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.615+0000 7f8d9ce00640 1 -- 172.21.15.103:0/993148104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d9815a5b0 con 0x7f8d9815f1a0 2024-09-10T22:39:26.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.615+0000 7f8d9ce00640 1 -- 172.21.15.103:0/993148104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d981651e0 con 0x7f8d9815f1a0 2024-09-10T22:39:26.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.615+0000 7f8d9ce00640 1 -- 172.21.15.103:0/993148104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d9815f890 con 0x7f8d9815f1a0 2024-09-10T22:39:26.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.619+0000 7f8d8ea00640 1 -- 172.21.15.103:0/993148104 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8d900b5030 con 0x7f8d9815f1a0 2024-09-10T22:39:26.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.619+0000 7f8d8ea00640 1 --2- 172.21.15.103:0/993148104 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8d740725e0 0x7f8d74074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:26.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.619+0000 7f8d8ea00640 1 -- 172.21.15.103:0/993148104 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8d9012d0a0 con 0x7f8d9815f1a0 2024-09-10T22:39:26.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.619+0000 7f8d95e00640 1 --2- 172.21.15.103:0/993148104 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8d740725e0 0x7f8d74074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:26.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.619+0000 7f8d95e00640 1 --2- 172.21.15.103:0/993148104 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8d740725e0 0x7f8d74074aa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8d88007fd0 tx=0x7f8d88009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:26.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.623+0000 7f8d8ea00640 1 -- 172.21.15.103:0/993148104 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8d9815a890 con 0x7f8d9815f1a0 2024-09-10T22:39:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.823+0000 7f8d9ce00640 1 -- 172.21.15.103:0/993148104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8d980af500 con 0x7f8d9815f1a0 2024-09-10T22:39:26.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.827+0000 7f8d8ea00640 1 -- 172.21.15.103:0/993148104 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f8d90016990 con 0x7f8d9815f1a0 2024-09-10T22:39:26.828 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T22:39:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.827+0000 7f8d9ce00640 1 -- 172.21.15.103:0/993148104 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8d740725e0 msgr2=0x7f8d74074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.827+0000 7f8d9ce00640 1 --2- 172.21.15.103:0/993148104 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8d740725e0 0x7f8d74074aa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8d88007fd0 tx=0x7f8d88009040 comp rx=0 tx=0).stop 2024-09-10T22:39:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.827+0000 7f8d9ce00640 1 -- 172.21.15.103:0/993148104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d9815f1a0 msgr2=0x7f8d981659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.827+0000 7f8d9ce00640 1 --2- 172.21.15.103:0/993148104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d9815f1a0 0x7f8d981659e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009bd0 tx=0x7f8d90009390 comp rx=0 tx=0).stop 2024-09-10T22:39:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.827+0000 7f8d9ce00640 1 -- 172.21.15.103:0/993148104 shutdown_connections 2024-09-10T22:39:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.827+0000 7f8d9ce00640 1 --2- 172.21.15.103:0/993148104 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8d740725e0 0x7f8d74074aa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.827+0000 7f8d9ce00640 1 --2- 172.21.15.103:0/993148104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d9815f1a0 0x7f8d981659e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.827+0000 7f8d9ce00640 1 --2- 172.21.15.103:0/993148104 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d980cdd00 0x7f8d98158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.827+0000 7f8d9ce00640 1 --2- 172.21.15.103:0/993148104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d980cd500 0x7f8d98159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.827+0000 7f8d9ce00640 1 -- 172.21.15.103:0/993148104 >> 172.21.15.103:0/993148104 conn(0x7f8d980d1a20 msgr2=0x7f8d98071420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.827+0000 7f8d9ce00640 1 -- 172.21.15.103:0/993148104 shutdown_connections 2024-09-10T22:39:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:26.827+0000 7f8d9ce00640 1 -- 172.21.15.103:0/993148104 wait complete. 2024-09-10T22:39:26.850 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T22:39:26.850 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T22:39:26.850 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2024-09-10T22:39:26.850 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-10T22:39:26.850 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T22:39:26.850 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T22:39:26.850 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T22:39:26.850 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T22:39:26.850 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-10T22:39:26.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:26.851 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2024-09-10T22:39:26.860 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T22:39:26.860 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T22:39:26.860 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T22:39:26.860 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:26.860 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-09-10T22:39:26.860 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:26.860 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:39:26.860 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:26.861 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2024-09-10T22:39:26.861 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:39:26.861 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:26.861 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2024-09-10T22:39:26.861 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:39:26.861 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:26.861 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T22:39:26.861 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:26.861 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-10T22:39:26.861 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42399sec preferred_lft 42399sec 2024-09-10T22:39:26.861 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2024-09-10T22:39:26.861 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:26.861 INFO:teuthology.orchestra.run.smithi131.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T22:39:26.861 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 02:42:f1:15:16:33 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:26.862 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T22:39:26.862 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:26.862 INFO:teuthology.orchestra.run.smithi131.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T22:39:26.862 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T22:39:26.862 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T22:39:26.862 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:26.862 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T22:39:26.862 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:26.862 INFO:teuthology.orchestra.run.smithi131.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T22:39:26.862 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T22:39:26.862 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T22:39:26.862 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:26.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:26.863 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T22:39:26.923 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-09-10T22:39:26.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:26.925 DEBUG:teuthology.orchestra.run.smithi131:> route 2024-09-10T22:39:26.981 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2024-09-10T22:39:26.981 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T22:39:26.981 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-10T22:39:26.981 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T22:39:26.981 INFO:teuthology.orchestra.run.smithi131.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-10T22:39:26.982 INFO:teuthology.orchestra.run.smithi131.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T22:39:26.982 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T22:39:26.982 INFO:teuthology.orchestra.run.smithi131.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:39:26.982 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:39:26.982 INFO:teuthology.orchestra.run.smithi131.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:39:26.982 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T22:39:26.982 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:39:26.982 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-10T22:39:26.982 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T22:39:26.982 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T22:39:26.982 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T22:39:26.983 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-10T22:39:27.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:39:27.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:27.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:27.116 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-09-10T22:39:27.125 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T22:39:27.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:27.126 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list-id 2024-09-10T22:39:27.174 INFO:teuthology.orchestra.run.smithi131.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-10T22:39:27.174 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:39:27.174 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-10T22:39:27.174 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T22:39:27.174 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-10T22:39:27.174 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-10T22:39:27.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:39:27.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:27.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:27.303 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T22:39:27.323 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T22:39:27.324 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T22:39:27.324 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T22:39:27.324 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:27.324 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-09-10T22:39:27.324 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:27.324 INFO:teuthology.orchestra.run.smithi131.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T22:39:27.324 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 12:2a:37:85:85:af brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T22:39:27.324 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T22:39:27.324 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:27.324 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::102a:37ff:fe85:85af/64 scope link 2024-09-10T22:39:27.325 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:27.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:27.326 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T22:39:27.389 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T22:39:27.389 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T22:39:27.389 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T22:39:27.389 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:27.389 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-09-10T22:39:27.389 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:27.389 INFO:teuthology.orchestra.run.smithi131.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T22:39:27.391 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 12:2a:37:85:85:af brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T22:39:27.392 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T22:39:27.392 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:27.392 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::102a:37ff:fe85:85af/64 scope link 2024-09-10T22:39:27.392 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:39:27.393 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-10T22:39:27.393 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:39:27.393 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-10T22:39:27.393 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-10T22:39:27.393 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T22:39:27.393 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-10T22:39:27.393 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-10T22:39:27.393 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-10T22:39:27.393 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-10T22:39:27.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:39:27.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:27.571 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:39:27.572 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-10T22:39:27.572 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.1 up 2024-09-10T22:39:27.572 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T22:39:27.572 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-10T22:39:27.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:39:27.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:27.696 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-10T22:39:27.696 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:39:27.697 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-10T22:39:27.705 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-10T22:39:27.705 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:39:27.705 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-10T22:39:27.754 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-09-10T22:39:27.818 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:39:27.871 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-09-10T22:39:27.871 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-09-10T22:39:27.871 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-09-10T22:39:27.871 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-09-10T22:39:27.871 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-09-10T22:39:27.872 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-09-10T22:39:27.872 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-09-10T22:39:27.872 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-09-10T22:39:27.872 INFO:teuthology.orchestra.run.smithi131.stdout:/run/lock 2024-09-10T22:39:27.872 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-09-10T22:39:27.872 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-09-10T22:39:27.872 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-09-10T22:39:27.872 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:39:27.872 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-09-10T22:39:27.872 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-09-10T22:39:27.872 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-09-10T22:39:27.872 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-09-10T22:39:27.872 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/fs/nfsd 2024-09-10T22:39:27.873 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-09-10T22:39:27.873 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-09-10T22:39:27.873 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:39:27.873 INFO:teuthology.orchestra.run.smithi131.stdout:/run/rpc_pipefs 2024-09-10T22:39:27.873 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-09-10T22:39:27.873 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-09-10T22:39:27.873 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T22:39:27.873 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T22:39:27.873 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T22:39:27.873 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T22:39:27.873 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-09-10T22:39:27.873 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T22:39:27.874 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T22:39:27.874 INFO:teuthology.orchestra.run.smithi131.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-10T22:39:27.874 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T22:39:27.874 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T22:39:27.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:27.875 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-09-10T22:39:27.925 INFO:teuthology.orchestra.run.smithi131.stdout:44 2024-09-10T22:39:27.926 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-09-10T22:39:27.926 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-10T22:39:27.968 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-09-10T22:39:27.988 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:39:28.043 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-09-10T22:39:28.043 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-09-10T22:39:28.044 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-09-10T22:39:28.044 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-09-10T22:39:28.044 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-09-10T22:39:28.044 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-09-10T22:39:28.044 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-09-10T22:39:28.044 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-09-10T22:39:28.044 INFO:teuthology.orchestra.run.smithi131.stdout:/run/lock 2024-09-10T22:39:28.044 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-09-10T22:39:28.044 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-09-10T22:39:28.044 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-09-10T22:39:28.044 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:39:28.044 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-09-10T22:39:28.044 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-09-10T22:39:28.045 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-09-10T22:39:28.045 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-09-10T22:39:28.045 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/fs/nfsd 2024-09-10T22:39:28.045 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-09-10T22:39:28.045 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-09-10T22:39:28.045 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:39:28.045 INFO:teuthology.orchestra.run.smithi131.stdout:/run/rpc_pipefs 2024-09-10T22:39:28.045 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-09-10T22:39:28.045 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-09-10T22:39:28.045 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T22:39:28.045 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T22:39:28.045 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T22:39:28.045 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T22:39:28.046 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-09-10T22:39:28.046 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T22:39:28.046 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T22:39:28.046 INFO:teuthology.orchestra.run.smithi131.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-10T22:39:28.046 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T22:39:28.046 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T22:39:28.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:28.047 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-09-10T22:39:28.063 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi131.stderr:2024-09-10T22:39:28.059+0000 7f6e2fba0580 -1 init, newargv = 0x562a54828a80 newargc=15 2024-09-10T22:39:28.064 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi131.stderr:ceph-fuse[34880]: starting ceph client 2024-09-10T22:39:28.071 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi131.stderr:ceph-fuse[34880]: starting fuse 2024-09-10T22:39:28.072 INFO:teuthology.orchestra.run.smithi131.stdout:44 2024-09-10T22:39:28.072 INFO:teuthology.orchestra.run.smithi131.stdout:45 2024-09-10T22:39:28.072 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-09-10T22:39:28.072 DEBUG:teuthology.orchestra.run.smithi131:> sudo stdin-killer -- python3 -c ' 2024-09-10T22:39:28.073 DEBUG:teuthology.orchestra.run.smithi131:> import glob 2024-09-10T22:39:28.073 DEBUG:teuthology.orchestra.run.smithi131:> import re 2024-09-10T22:39:28.073 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-09-10T22:39:28.073 DEBUG:teuthology.orchestra.run.smithi131:> import subprocess 2024-09-10T22:39:28.073 DEBUG:teuthology.orchestra.run.smithi131:> 2024-09-10T22:39:28.073 DEBUG:teuthology.orchestra.run.smithi131:> def _find_admin_socket(client_name): 2024-09-10T22:39:28.073 DEBUG:teuthology.orchestra.run.smithi131:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-10T22:39:28.073 DEBUG:teuthology.orchestra.run.smithi131:> files = glob.glob(asok_path) 2024-09-10T22:39:28.073 DEBUG:teuthology.orchestra.run.smithi131:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-10T22:39:28.073 DEBUG:teuthology.orchestra.run.smithi131:> 2024-09-10T22:39:28.073 DEBUG:teuthology.orchestra.run.smithi131:> # Given a non-glob path, it better be there 2024-09-10T22:39:28.073 DEBUG:teuthology.orchestra.run.smithi131:> if "*" not in asok_path: 2024-09-10T22:39:28.073 DEBUG:teuthology.orchestra.run.smithi131:> assert(len(files) == 1) 2024-09-10T22:39:28.073 DEBUG:teuthology.orchestra.run.smithi131:> return files[0] 2024-09-10T22:39:28.074 DEBUG:teuthology.orchestra.run.smithi131:> 2024-09-10T22:39:28.074 DEBUG:teuthology.orchestra.run.smithi131:> for f in files: 2024-09-10T22:39:28.074 DEBUG:teuthology.orchestra.run.smithi131:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T22:39:28.074 DEBUG:teuthology.orchestra.run.smithi131:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T22:39:28.074 DEBUG:teuthology.orchestra.run.smithi131:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T22:39:28.074 DEBUG:teuthology.orchestra.run.smithi131:> contents = proc_f.read() 2024-09-10T22:39:28.074 DEBUG:teuthology.orchestra.run.smithi131:> if mountpoint in contents: 2024-09-10T22:39:28.074 DEBUG:teuthology.orchestra.run.smithi131:> return f 2024-09-10T22:39:28.074 DEBUG:teuthology.orchestra.run.smithi131:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T22:39:28.074 DEBUG:teuthology.orchestra.run.smithi131:> 2024-09-10T22:39:28.074 DEBUG:teuthology.orchestra.run.smithi131:> print(_find_admin_socket("client.3")) 2024-09-10T22:39:28.074 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-09-10T22:39:28.198 INFO:teuthology.orchestra.run.smithi131.stdout:/var/run/ceph/ceph-client.3.34880.asok 2024-09-10T22:39:28.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-10T22:39:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:39:28.209 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.34880.asok 2024-09-10T22:39:28.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:28.209 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.34880.asok status 2024-09-10T22:39:28.379 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-09-10T22:39:28.379 INFO:teuthology.orchestra.run.smithi131.stdout: "metadata": { 2024-09-10T22:39:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T22:39:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:39:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "entity_id": "3", 2024-09-10T22:39:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "hostname": "smithi131", 2024-09-10T22:39:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-10T22:39:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "pid": "34880", 2024-09-10T22:39:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "root": "/" 2024-09-10T22:39:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-10T22:39:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_count": 0, 2024-09-10T22:39:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_pinned_count": 0, 2024-09-10T22:39:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "id": 4610, 2024-09-10T22:39:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "inst": { 2024-09-10T22:39:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "name": { 2024-09-10T22:39:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "client", 2024-09-10T22:39:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: "num": 4610 2024-09-10T22:39:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-10T22:39:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-09-10T22:39:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-09-10T22:39:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.2:0", 2024-09-10T22:39:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 218401096 2024-09-10T22:39:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-10T22:39:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-10T22:39:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-09-10T22:39:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-09-10T22:39:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.2:0", 2024-09-10T22:39:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 218401096 2024-09-10T22:39:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-10T22:39:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: "inst_str": "client.4610 192.168.0.2:0/218401096", 2024-09-10T22:39:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: "addr_str": "192.168.0.2:0/218401096", 2024-09-10T22:39:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: "inode_count": 1, 2024-09-10T22:39:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_epoch": 9, 2024-09-10T22:39:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch": 27, 2024-09-10T22:39:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch_barrier": 0, 2024-09-10T22:39:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: "blocklisted": false, 2024-09-10T22:39:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: "fs_name": "cephfs" 2024-09-10T22:39:28.382 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-09-10T22:39:28.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:28.394 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-09-10T22:39:28.394 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T22:39:28.404 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-09-10T22:39:28.405 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T22:39:28.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:28.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T22:39:28.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:28.469 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-09-10T22:39:28.469 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-10T22:39:28.524 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-09-10T22:39:28.525 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-10T22:39:28.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:28.525 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-10T22:39:28.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:28.589 DEBUG:teuthology.orchestra.run.smithi131:> stat --file-system '--printf=%T 2024-09-10T22:39:28.589 DEBUG:teuthology.orchestra.run.smithi131:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-10T22:39:28.598 INFO:teuthology.orchestra.run.smithi131.stdout:fuseblk 2024-09-10T22:39:28.599 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-10T22:39:28.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:28.599 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T22:39:28.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:28.662 DEBUG:teuthology.orchestra.run.smithi131:> stat --file-system '--printf=%T 2024-09-10T22:39:28.662 DEBUG:teuthology.orchestra.run.smithi131:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-10T22:39:28.710 INFO:teuthology.orchestra.run.smithi131.stdout:fuseblk 2024-09-10T22:39:28.710 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-10T22:39:28.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:28.711 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-10T22:39:28.777 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-10T22:39:28.811 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_multimds_misc.TestScrub2) 2024-09-10T22:39:28.812 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:39:28.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.963+0000 7f075ee00640 1 -- 172.21.15.103:0/1391785943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f075815a020 msgr2=0x7f073c004b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:28.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.963+0000 7f075ee00640 1 --2- 172.21.15.103:0/1391785943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f075815a020 0x7f073c004b00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0748009b30 tx=0x7f074801d220 comp rx=0 tx=0).stop 2024-09-10T22:39:28.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.963+0000 7f075ce00640 1 -- 172.21.15.103:0/1391785943 reap_dead start 2024-09-10T22:39:28.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.963+0000 7f075ee00640 1 -- 172.21.15.103:0/1391785943 shutdown_connections 2024-09-10T22:39:28.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.963+0000 7f075ee00640 1 -- 172.21.15.103:0/1391785943 >> 172.21.15.103:0/1391785943 conn(0x7f07580d01a0 msgr2=0x7f07580d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:28.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.963+0000 7f075ee00640 1 -- 172.21.15.103:0/1391785943 shutdown_connections 2024-09-10T22:39:28.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.963+0000 7f075ee00640 1 -- 172.21.15.103:0/1391785943 wait complete. 2024-09-10T22:39:28.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f075ee00640 1 Processor -- start 2024-09-10T22:39:28.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f075ee00640 1 -- start start 2024-09-10T22:39:28.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f075ee00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f075815a020 0x7f0758157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:28.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f075ee00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0758158b00 0x7f075809db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:28.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f075ee00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07580b53d0 0x7f07580b5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:28.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f075ee00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f07580cf580 con 0x7f075815a020 2024-09-10T22:39:28.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f075ee00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f07580cf400 con 0x7f0758158b00 2024-09-10T22:39:28.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f075ee00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f07580cf700 con 0x7f07580b53d0 2024-09-10T22:39:28.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f0757e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f075815a020 0x7f0758157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:28.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f0757e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f075815a020 0x7f0758157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42048/0 (socket says 172.21.15.103:42048) 2024-09-10T22:39:28.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f0757e00640 1 -- 172.21.15.103:0/185940410 learned_addr learned my addr 172.21.15.103:0/185940410 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:28.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f075ce00640 1 --2- 172.21.15.103:0/185940410 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07580b53d0 0x7f07580b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:28.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f074f400640 1 --2- 172.21.15.103:0/185940410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0758158b00 0x7f075809db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:28.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f0757e00640 1 -- 172.21.15.103:0/185940410 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07580b53d0 msgr2=0x7f07580b5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:28.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f0757e00640 1 --2- 172.21.15.103:0/185940410 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07580b53d0 0x7f07580b5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:28.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f0757e00640 1 -- 172.21.15.103:0/185940410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0758158b00 msgr2=0x7f075809db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:28.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f0757e00640 1 --2- 172.21.15.103:0/185940410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0758158b00 0x7f075809db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:28.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f0757e00640 1 -- 172.21.15.103:0/185940410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0758146660 con 0x7f075815a020 2024-09-10T22:39:28.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f0757e00640 1 --2- 172.21.15.103:0/185940410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f075815a020 0x7f0758157ce0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f07480af040 tx=0x7f074801ba60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:28.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f0754c00640 1 -- 172.21.15.103:0/185940410 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07480b1040 con 0x7f075815a020 2024-09-10T22:39:28.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f0754c00640 1 -- 172.21.15.103:0/185940410 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07480bb070 con 0x7f075815a020 2024-09-10T22:39:28.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f075ee00640 1 -- 172.21.15.103:0/185940410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0758146940 con 0x7f075815a020 2024-09-10T22:39:28.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f0754c00640 1 -- 172.21.15.103:0/185940410 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748009730 con 0x7f075815a020 2024-09-10T22:39:28.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.967+0000 7f075ee00640 1 -- 172.21.15.103:0/185940410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0758146f00 con 0x7f075815a020 2024-09-10T22:39:28.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.971+0000 7f075ee00640 1 -- 172.21.15.103:0/185940410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f075815a6d0 con 0x7f075815a020 2024-09-10T22:39:28.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.971+0000 7f0754c00640 1 -- 172.21.15.103:0/185940410 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0748004290 con 0x7f075815a020 2024-09-10T22:39:28.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.971+0000 7f0754c00640 1 --2- 172.21.15.103:0/185940410 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07340725e0 0x7f0734074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:28.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.971+0000 7f0754c00640 1 -- 172.21.15.103:0/185940410 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f074812e330 con 0x7f075815a020 2024-09-10T22:39:28.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.971+0000 7f074f400640 1 --2- 172.21.15.103:0/185940410 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07340725e0 0x7f0734074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:28.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.971+0000 7f074f400640 1 --2- 172.21.15.103:0/185940410 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07340725e0 0x7f0734074aa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f07581ebe50 tx=0x7f0740006bf0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:28.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:28.975+0000 7f0754c00640 1 -- 172.21.15.103:0/185940410 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0748016f60 con 0x7f075815a020 2024-09-10T22:39:29.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.143+0000 7f075ee00640 1 -- 172.21.15.103:0/185940410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07580747a0 con 0x7f075815a020 2024-09-10T22:39:29.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.143+0000 7f0754c00640 1 -- 172.21.15.103:0/185940410 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18658 (secure 0 0 0) 0x7f07480f8fe0 con 0x7f075815a020 2024-09-10T22:39:29.148 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:29.148 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":27,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:38:54.282386+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:38:47.154691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:38:48.182281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T22:38:51.874808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:39:29.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.147+0000 7f075ee00640 1 -- 172.21.15.103:0/185940410 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07340725e0 msgr2=0x7f0734074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:29.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.147+0000 7f075ee00640 1 --2- 172.21.15.103:0/185940410 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07340725e0 0x7f0734074aa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f07581ebe50 tx=0x7f0740006bf0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.147+0000 7f075ee00640 1 -- 172.21.15.103:0/185940410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f075815a020 msgr2=0x7f0758157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:29.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.147+0000 7f075ee00640 1 --2- 172.21.15.103:0/185940410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f075815a020 0x7f0758157ce0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f07480af040 tx=0x7f074801ba60 comp rx=0 tx=0).stop 2024-09-10T22:39:29.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.147+0000 7f075ee00640 1 -- 172.21.15.103:0/185940410 shutdown_connections 2024-09-10T22:39:29.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.147+0000 7f075ee00640 1 --2- 172.21.15.103:0/185940410 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07340725e0 0x7f0734074aa0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.147+0000 7f075ee00640 1 --2- 172.21.15.103:0/185940410 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07580b53d0 0x7f07580b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.147+0000 7f075ee00640 1 --2- 172.21.15.103:0/185940410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0758158b00 0x7f075809db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.147+0000 7f075ee00640 1 --2- 172.21.15.103:0/185940410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f075815a020 0x7f0758157ce0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.147+0000 7f075ee00640 1 -- 172.21.15.103:0/185940410 >> 172.21.15.103:0/185940410 conn(0x7f07580d01a0 msgr2=0x7f07580b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:29.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.147+0000 7f075ee00640 1 -- 172.21.15.103:0/185940410 shutdown_connections 2024-09-10T22:39:29.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.147+0000 7f075ee00640 1 -- 172.21.15.103:0/185940410 wait complete. 2024-09-10T22:39:29.170 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T22:38:39.639064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T22:38:47.154691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T22:38:48.182281+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-10T22:38:51.874808+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-10T22:39:29.171 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T22:39:29.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.311+0000 7f10f7600640 1 -- 172.21.15.103:0/2944338220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f006f0c0 msgr2=0x7f10f0073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:29.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.311+0000 7f10f7600640 1 --2- 172.21.15.103:0/2944338220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f006f0c0 0x7f10f0073610 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f10f006eae0 tx=0x7f10dc01c8c0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.311+0000 7f10f7600640 1 -- 172.21.15.103:0/2944338220 shutdown_connections 2024-09-10T22:39:29.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.311+0000 7f10f7600640 1 --2- 172.21.15.103:0/2944338220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10f00cfdd0 0x7f10f0073b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.311+0000 7f10f7600640 1 --2- 172.21.15.103:0/2944338220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f006f0c0 0x7f10f0073610 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.311+0000 7f10f7600640 1 --2- 172.21.15.103:0/2944338220 >> v2:172.21.15.131:3300/0 conn(0x7f10f00cf9f0 0x7f10f006eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.311+0000 7f10f7600640 1 -- 172.21.15.103:0/2944338220 >> 172.21.15.103:0/2944338220 conn(0x7f10f006cc00 msgr2=0x7f10f006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:29.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.311+0000 7f10f7600640 1 -- 172.21.15.103:0/2944338220 shutdown_connections 2024-09-10T22:39:29.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.311+0000 7f10f7600640 1 -- 172.21.15.103:0/2944338220 wait complete. 2024-09-10T22:39:29.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f7600640 1 Processor -- start 2024-09-10T22:39:29.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f7600640 1 -- start start 2024-09-10T22:39:29.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f7600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10f006f0c0 0x7f10f0149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:29.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f7600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10f00cf9f0 0x7f10f01f8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:29.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f7600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f00cfdd0 0x7f10f014c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:29.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f7600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f10f00ccab0 con 0x7f10f00cfdd0 2024-09-10T22:39:29.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f7600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f10f00cc930 con 0x7f10f00cf9f0 2024-09-10T22:39:29.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f7600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f10f00ccc30 con 0x7f10f006f0c0 2024-09-10T22:39:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f00cfdd0 0x7f10f014c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f00cfdd0 0x7f10f014c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42058/0 (socket says 172.21.15.103:42058) 2024-09-10T22:39:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f5600640 1 -- 172.21.15.103:0/2330048478 learned_addr learned my addr 172.21.15.103:0/2330048478 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f4c00640 1 --2- 172.21.15.103:0/2330048478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10f006f0c0 0x7f10f0149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10efe00640 1 --2- 172.21.15.103:0/2330048478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10f00cf9f0 0x7f10f01f8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f5600640 1 -- 172.21.15.103:0/2330048478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10f006f0c0 msgr2=0x7f10f0149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f5600640 1 --2- 172.21.15.103:0/2330048478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10f006f0c0 0x7f10f0149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f5600640 1 -- 172.21.15.103:0/2330048478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10f00cf9f0 msgr2=0x7f10f01f8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f5600640 1 --2- 172.21.15.103:0/2330048478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10f00cf9f0 0x7f10f01f8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f5600640 1 -- 172.21.15.103:0/2330048478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f015c480 con 0x7f10f00cfdd0 2024-09-10T22:39:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f5600640 1 --2- 172.21.15.103:0/2330048478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f00cfdd0 0x7f10f014c610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f10e800ea80 tx=0x7f10e800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10ecc00640 1 -- 172.21.15.103:0/2330048478 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8004b30 con 0x7f10f00cfdd0 2024-09-10T22:39:29.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10ecc00640 1 -- 172.21.15.103:0/2330048478 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10e8004cf0 con 0x7f10f00cfdd0 2024-09-10T22:39:29.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f7600640 1 -- 172.21.15.103:0/2330048478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f015c760 con 0x7f10f00cfdd0 2024-09-10T22:39:29.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10ecc00640 1 -- 172.21.15.103:0/2330048478 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8005280 con 0x7f10f00cfdd0 2024-09-10T22:39:29.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.315+0000 7f10f7600640 1 -- 172.21.15.103:0/2330048478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f01f56f0 con 0x7f10f00cfdd0 2024-09-10T22:39:29.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.319+0000 7f10f7600640 1 -- 172.21.15.103:0/2330048478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f006eb80 con 0x7f10f00cfdd0 2024-09-10T22:39:29.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.319+0000 7f10ecc00640 1 -- 172.21.15.103:0/2330048478 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f10e8005420 con 0x7f10f00cfdd0 2024-09-10T22:39:29.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.319+0000 7f10ecc00640 1 --2- 172.21.15.103:0/2330048478 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f10d00725e0 0x7f10d0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:29.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.319+0000 7f10ecc00640 1 -- 172.21.15.103:0/2330048478 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f10e80940e0 con 0x7f10f00cfdd0 2024-09-10T22:39:29.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.319+0000 7f10f4c00640 1 --2- 172.21.15.103:0/2330048478 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f10d00725e0 0x7f10d0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:29.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.319+0000 7f10f4c00640 1 --2- 172.21.15.103:0/2330048478 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f10d00725e0 0x7f10d0074aa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009be0 tx=0x7f10e40091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:29.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.323+0000 7f10ecc00640 1 -- 172.21.15.103:0/2330048478 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f10e805ed90 con 0x7f10f00cfdd0 2024-09-10T22:39:29.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.491+0000 7f10f7600640 1 -- 172.21.15.103:0/2330048478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f10f00b3590 con 0x7f10f00cfdd0 2024-09-10T22:39:29.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.495+0000 7f10ecc00640 1 -- 172.21.15.103:0/2330048478 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f10e80637c0 con 0x7f10f00cfdd0 2024-09-10T22:39:29.496 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-09-10T22:39:29.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.495+0000 7f10f7600640 1 -- 172.21.15.103:0/2330048478 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f10d00725e0 msgr2=0x7f10d0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:29.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.495+0000 7f10f7600640 1 --2- 172.21.15.103:0/2330048478 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f10d00725e0 0x7f10d0074aa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009be0 tx=0x7f10e40091e0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.495+0000 7f10f7600640 1 -- 172.21.15.103:0/2330048478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f00cfdd0 msgr2=0x7f10f014c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:29.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.495+0000 7f10f7600640 1 --2- 172.21.15.103:0/2330048478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f00cfdd0 0x7f10f014c610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f10e800ea80 tx=0x7f10e800ef40 comp rx=0 tx=0).stop 2024-09-10T22:39:29.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.495+0000 7f10f7600640 1 -- 172.21.15.103:0/2330048478 shutdown_connections 2024-09-10T22:39:29.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.495+0000 7f10f7600640 1 --2- 172.21.15.103:0/2330048478 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f10d00725e0 0x7f10d0074aa0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.495+0000 7f10f7600640 1 --2- 172.21.15.103:0/2330048478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f00cfdd0 0x7f10f014c610 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.495+0000 7f10f7600640 1 --2- 172.21.15.103:0/2330048478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10f00cf9f0 0x7f10f01f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.495+0000 7f10f7600640 1 --2- 172.21.15.103:0/2330048478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10f006f0c0 0x7f10f0149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.495+0000 7f10f7600640 1 -- 172.21.15.103:0/2330048478 >> 172.21.15.103:0/2330048478 conn(0x7f10f006cc00 msgr2=0x7f10f00ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:29.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.495+0000 7f10f7600640 1 -- 172.21.15.103:0/2330048478 shutdown_connections 2024-09-10T22:39:29.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.495+0000 7f10f7600640 1 -- 172.21.15.103:0/2330048478 wait complete. 2024-09-10T22:39:29.517 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T22:39:29.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.659+0000 7f72fd800640 1 -- 172.21.15.103:0/580096453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72f80b3320 msgr2=0x7f72f8072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:29.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.659+0000 7f72fd800640 1 --2- 172.21.15.103:0/580096453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72f80b3320 0x7f72f8072500 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72e400a950 tx=0x7f72e401db70 comp rx=0 tx=0).stop 2024-09-10T22:39:29.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.659+0000 7f72fd800640 1 -- 172.21.15.103:0/580096453 shutdown_connections 2024-09-10T22:39:29.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.659+0000 7f72fd800640 1 --2- 172.21.15.103:0/580096453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72f8072a40 0x7f72f8157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.659+0000 7f72fd800640 1 --2- 172.21.15.103:0/580096453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72f80b3320 0x7f72f8072500 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.659+0000 7f72fd800640 1 -- 172.21.15.103:0/580096453 >> 172.21.15.103:0/580096453 conn(0x7f72f806cc00 msgr2=0x7f72f806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:29.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.659+0000 7f72fd800640 1 -- 172.21.15.103:0/580096453 shutdown_connections 2024-09-10T22:39:29.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.659+0000 7f72fd800640 1 -- 172.21.15.103:0/580096453 wait complete. 2024-09-10T22:39:29.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.659+0000 7f72fd800640 1 Processor -- start 2024-09-10T22:39:29.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72fd800640 1 -- start start 2024-09-10T22:39:29.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72fd800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72f8072a40 0x7f72f8147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:29.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72fd800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72f80b3320 0x7f72f81fb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:29.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72fd800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72f80cf260 0x7f72f80ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:29.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72fd800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f72f806e960 con 0x7f72f8072a40 2024-09-10T22:39:29.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72fd800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f72f806e7e0 con 0x7f72f80cf260 2024-09-10T22:39:29.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72fd800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f72f806eae0 con 0x7f72f80b3320 2024-09-10T22:39:29.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72f6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72f8072a40 0x7f72f8147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:29.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72f6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72f8072a40 0x7f72f8147e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42076/0 (socket says 172.21.15.103:42076) 2024-09-10T22:39:29.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72f6a00640 1 -- 172.21.15.103:0/3210991296 learned_addr learned my addr 172.21.15.103:0/3210991296 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:29.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72f6000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72f80b3320 0x7f72f81fb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:29.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72f7400640 1 --2- 172.21.15.103:0/3210991296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72f80cf260 0x7f72f80ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:29.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72f6a00640 1 -- 172.21.15.103:0/3210991296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72f80b3320 msgr2=0x7f72f81fb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:29.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72f6a00640 1 --2- 172.21.15.103:0/3210991296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72f80b3320 0x7f72f81fb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72f6a00640 1 -- 172.21.15.103:0/3210991296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72f80cf260 msgr2=0x7f72f80ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:29.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72f6a00640 1 --2- 172.21.15.103:0/3210991296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72f80cf260 0x7f72f80ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72f6a00640 1 -- 172.21.15.103:0/3210991296 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f814ecf0 con 0x7f72f8072a40 2024-09-10T22:39:29.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72f6a00640 1 --2- 172.21.15.103:0/3210991296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72f8072a40 0x7f72f8147e50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f72e800cb40 tx=0x7f72e800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:29.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72eea00640 1 -- 172.21.15.103:0/3210991296 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8016020 con 0x7f72f8072a40 2024-09-10T22:39:29.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72eea00640 1 -- 172.21.15.103:0/3210991296 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72e800a950 con 0x7f72f8072a40 2024-09-10T22:39:29.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72eea00640 1 -- 172.21.15.103:0/3210991296 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e800ada0 con 0x7f72f8072a40 2024-09-10T22:39:29.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72fd800640 1 -- 172.21.15.103:0/3210991296 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f814ef90 con 0x7f72f8072a40 2024-09-10T22:39:29.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72fd800640 1 -- 172.21.15.103:0/3210991296 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f81f8680 con 0x7f72f8072a40 2024-09-10T22:39:29.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.663+0000 7f72fd800640 1 -- 172.21.15.103:0/3210991296 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f8157090 con 0x7f72f8072a40 2024-09-10T22:39:29.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.667+0000 7f72eea00640 1 -- 172.21.15.103:0/3210991296 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f72e8012420 con 0x7f72f8072a40 2024-09-10T22:39:29.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.667+0000 7f72eea00640 1 --2- 172.21.15.103:0/3210991296 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f72d80725e0 0x7f72d8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:29.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.667+0000 7f72eea00640 1 -- 172.21.15.103:0/3210991296 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f72e80939e0 con 0x7f72f8072a40 2024-09-10T22:39:29.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.667+0000 7f72f6000640 1 --2- 172.21.15.103:0/3210991296 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f72d80725e0 0x7f72d8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:29.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.667+0000 7f72f6000640 1 --2- 172.21.15.103:0/3210991296 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f72d80725e0 0x7f72d8074aa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f72e40b0000 tx=0x7f72e401c3b0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:29.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.671+0000 7f72eea00640 1 -- 172.21.15.103:0/3210991296 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f72e8020020 con 0x7f72f8072a40 2024-09-10T22:39:29.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.835+0000 7f72fd800640 1 -- 172.21.15.103:0/3210991296 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f72f8152330 con 0x7f72f8072a40 2024-09-10T22:39:29.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.835+0000 7f72eea00640 1 -- 172.21.15.103:0/3210991296 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f72e805ed70 con 0x7f72f8072a40 2024-09-10T22:39:29.840 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2024-09-10T22:39:29.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.835+0000 7f72fd800640 1 -- 172.21.15.103:0/3210991296 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f72d80725e0 msgr2=0x7f72d8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:29.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.835+0000 7f72fd800640 1 --2- 172.21.15.103:0/3210991296 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f72d80725e0 0x7f72d8074aa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f72e40b0000 tx=0x7f72e401c3b0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.835+0000 7f72fd800640 1 -- 172.21.15.103:0/3210991296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72f8072a40 msgr2=0x7f72f8147e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:29.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.835+0000 7f72fd800640 1 --2- 172.21.15.103:0/3210991296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72f8072a40 0x7f72f8147e50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f72e800cb40 tx=0x7f72e800cb70 comp rx=0 tx=0).stop 2024-09-10T22:39:29.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.835+0000 7f72fd800640 1 -- 172.21.15.103:0/3210991296 shutdown_connections 2024-09-10T22:39:29.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.835+0000 7f72fd800640 1 --2- 172.21.15.103:0/3210991296 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f72d80725e0 0x7f72d8074aa0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.835+0000 7f72fd800640 1 --2- 172.21.15.103:0/3210991296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72f80cf260 0x7f72f80ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.835+0000 7f72fd800640 1 --2- 172.21.15.103:0/3210991296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72f80b3320 0x7f72f81fb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.835+0000 7f72fd800640 1 --2- 172.21.15.103:0/3210991296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72f8072a40 0x7f72f8147e50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:29.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.835+0000 7f72fd800640 1 -- 172.21.15.103:0/3210991296 >> 172.21.15.103:0/3210991296 conn(0x7f72f806cc00 msgr2=0x7f72f8156280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:29.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.839+0000 7f72fd800640 1 -- 172.21.15.103:0/3210991296 shutdown_connections 2024-09-10T22:39:29.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:29.839+0000 7f72fd800640 1 -- 172.21.15.103:0/3210991296 wait complete. 2024-09-10T22:39:29.860 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T22:39:30.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.003+0000 7f5f4ec00640 1 -- 172.21.15.103:0/1901738515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f4815be30 msgr2=0x7f5f480ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:30.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.003+0000 7f5f4ec00640 1 --2- 172.21.15.103:0/1901738515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f4815be30 0x7f5f480ce0c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009bf0 tx=0x7f5f3801cb50 comp rx=0 tx=0).stop 2024-09-10T22:39:30.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.003+0000 7f5f4ec00640 1 -- 172.21.15.103:0/1901738515 shutdown_connections 2024-09-10T22:39:30.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.003+0000 7f5f4ec00640 1 --2- 172.21.15.103:0/1901738515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f4815be30 0x7f5f480ce0c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.003+0000 7f5f4ec00640 1 -- 172.21.15.103:0/1901738515 >> 172.21.15.103:0/1901738515 conn(0x7f5f480d1ac0 msgr2=0x7f5f480d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:30.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.003+0000 7f5f4ec00640 1 -- 172.21.15.103:0/1901738515 shutdown_connections 2024-09-10T22:39:30.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.003+0000 7f5f4ec00640 1 -- 172.21.15.103:0/1901738515 wait complete. 2024-09-10T22:39:30.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f4ec00640 1 Processor -- start 2024-09-10T22:39:30.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f4ec00640 1 -- start start 2024-09-10T22:39:30.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f4ec00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f480ae9c0 0x7f5f4814a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:30.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f4ec00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f480b09c0 0x7f5f48149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:30.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f4ec00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f4815be30 0x7f5f480b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:30.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f4ec00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5f48169e00 con 0x7f5f480ae9c0 2024-09-10T22:39:30.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f4ec00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5f48169c80 con 0x7f5f480b09c0 2024-09-10T22:39:30.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f4ec00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5f48169f80 con 0x7f5f4815be30 2024-09-10T22:39:30.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f47e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f480ae9c0 0x7f5f4814a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:30.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f47e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f480ae9c0 0x7f5f4814a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42084/0 (socket says 172.21.15.103:42084) 2024-09-10T22:39:30.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f47e00640 1 -- 172.21.15.103:0/1195785757 learned_addr learned my addr 172.21.15.103:0/1195785757 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:30.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f3f400640 1 --2- 172.21.15.103:0/1195785757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f480b09c0 0x7f5f48149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:30.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f4cc00640 1 --2- 172.21.15.103:0/1195785757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f4815be30 0x7f5f480b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:30.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f47e00640 1 -- 172.21.15.103:0/1195785757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f4815be30 msgr2=0x7f5f480b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:30.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f47e00640 1 --2- 172.21.15.103:0/1195785757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f4815be30 0x7f5f480b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f47e00640 1 -- 172.21.15.103:0/1195785757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f480b09c0 msgr2=0x7f5f48149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:30.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f47e00640 1 --2- 172.21.15.103:0/1195785757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f480b09c0 0x7f5f48149a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f47e00640 1 -- 172.21.15.103:0/1195785757 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f480c6600 con 0x7f5f480ae9c0 2024-09-10T22:39:30.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f47e00640 1 --2- 172.21.15.103:0/1195785757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f480ae9c0 0x7f5f4814a2b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5f38019760 tx=0x7f5f38009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:30.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f44c00640 1 -- 172.21.15.103:0/1195785757 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f380b2040 con 0x7f5f480ae9c0 2024-09-10T22:39:30.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f44c00640 1 -- 172.21.15.103:0/1195785757 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f38003a70 con 0x7f5f480ae9c0 2024-09-10T22:39:30.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f4ec00640 1 -- 172.21.15.103:0/1195785757 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f480c5840 con 0x7f5f480ae9c0 2024-09-10T22:39:30.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f44c00640 1 -- 172.21.15.103:0/1195785757 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f38003e20 con 0x7f5f480ae9c0 2024-09-10T22:39:30.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f4ec00640 1 -- 172.21.15.103:0/1195785757 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f480c5e00 con 0x7f5f480ae9c0 2024-09-10T22:39:30.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.007+0000 7f5f4ec00640 1 -- 172.21.15.103:0/1195785757 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f480aee70 con 0x7f5f480ae9c0 2024-09-10T22:39:30.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.011+0000 7f5f44c00640 1 -- 172.21.15.103:0/1195785757 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5f380b5070 con 0x7f5f480ae9c0 2024-09-10T22:39:30.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.011+0000 7f5f44c00640 1 --2- 172.21.15.103:0/1195785757 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5f240725e0 0x7f5f24074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:30.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.011+0000 7f5f44c00640 1 -- 172.21.15.103:0/1195785757 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5f3812d010 con 0x7f5f480ae9c0 2024-09-10T22:39:30.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.011+0000 7f5f3f400640 1 --2- 172.21.15.103:0/1195785757 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5f240725e0 0x7f5f24074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:30.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.011+0000 7f5f3f400640 1 --2- 172.21.15.103:0/1195785757 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5f240725e0 0x7f5f24074aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5f30007fd0 tx=0x7f5f30009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:30.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.015+0000 7f5f44c00640 1 -- 172.21.15.103:0/1195785757 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5f380c4020 con 0x7f5f480ae9c0 2024-09-10T22:39:30.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.187+0000 7f5f4ec00640 1 -- 172.21.15.103:0/1195785757 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5f48154330 con 0x7f5f480ae9c0 2024-09-10T22:39:30.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.187+0000 7f5f44c00640 1 -- 172.21.15.103:0/1195785757 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f5f380167d0 con 0x7f5f480ae9c0 2024-09-10T22:39:30.191 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 64 2024-09-10T22:39:30.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.191+0000 7f5f4ec00640 1 -- 172.21.15.103:0/1195785757 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5f240725e0 msgr2=0x7f5f24074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:30.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.191+0000 7f5f4ec00640 1 --2- 172.21.15.103:0/1195785757 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5f240725e0 0x7f5f24074aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5f30007fd0 tx=0x7f5f30009040 comp rx=0 tx=0).stop 2024-09-10T22:39:30.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.191+0000 7f5f4ec00640 1 -- 172.21.15.103:0/1195785757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f480ae9c0 msgr2=0x7f5f4814a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:30.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.191+0000 7f5f4ec00640 1 --2- 172.21.15.103:0/1195785757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f480ae9c0 0x7f5f4814a2b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5f38019760 tx=0x7f5f38009280 comp rx=0 tx=0).stop 2024-09-10T22:39:30.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.191+0000 7f5f4ec00640 1 -- 172.21.15.103:0/1195785757 shutdown_connections 2024-09-10T22:39:30.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.191+0000 7f5f4ec00640 1 --2- 172.21.15.103:0/1195785757 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5f240725e0 0x7f5f24074aa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.191+0000 7f5f4ec00640 1 --2- 172.21.15.103:0/1195785757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f4815be30 0x7f5f480b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.191+0000 7f5f4ec00640 1 --2- 172.21.15.103:0/1195785757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f480b09c0 0x7f5f48149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.191+0000 7f5f4ec00640 1 --2- 172.21.15.103:0/1195785757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f480ae9c0 0x7f5f4814a2b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.191+0000 7f5f4ec00640 1 -- 172.21.15.103:0/1195785757 >> 172.21.15.103:0/1195785757 conn(0x7f5f480d1ac0 msgr2=0x7f5f48154830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:30.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.191+0000 7f5f4ec00640 1 -- 172.21.15.103:0/1195785757 shutdown_connections 2024-09-10T22:39:30.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.191+0000 7f5f4ec00640 1 -- 172.21.15.103:0/1195785757 wait complete. 2024-09-10T22:39:30.213 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-10T22:39:30.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.355+0000 7f6b4d200640 1 -- 172.21.15.103:0/572157820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b4815f330 msgr2=0x7f6b480cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:30.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.355+0000 7f6b4d200640 1 --2- 172.21.15.103:0/572157820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b4815f330 0x7f6b480cfbc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009900 tx=0x7f6b3801c850 comp rx=0 tx=0).stop 2024-09-10T22:39:30.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.355+0000 7f6b4d200640 1 -- 172.21.15.103:0/572157820 shutdown_connections 2024-09-10T22:39:30.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.355+0000 7f6b4d200640 1 --2- 172.21.15.103:0/572157820 >> v2:172.21.15.131:3300/0 conn(0x7f6b480ccaa0 0x7f6b480ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.355+0000 7f6b4d200640 1 --2- 172.21.15.103:0/572157820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b4815f330 0x7f6b480cfbc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.355+0000 7f6b4d200640 1 -- 172.21.15.103:0/572157820 >> 172.21.15.103:0/572157820 conn(0x7f6b480d1ab0 msgr2=0x7f6b480d1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:30.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.355+0000 7f6b4d200640 1 -- 172.21.15.103:0/572157820 shutdown_connections 2024-09-10T22:39:30.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.355+0000 7f6b4d200640 1 -- 172.21.15.103:0/572157820 wait complete. 2024-09-10T22:39:30.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.355+0000 7f6b4d200640 1 Processor -- start 2024-09-10T22:39:30.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b4d200640 1 -- start start 2024-09-10T22:39:30.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b4d200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b480b2840 0x7f6b480c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:30.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b4d200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b480ccaa0 0x7f6b48163e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:30.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b4d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4815f330 0x7f6b481fb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:30.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b4d200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6b48168e50 con 0x7f6b4815f330 2024-09-10T22:39:30.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b4d200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6b48168cd0 con 0x7f6b480b2840 2024-09-10T22:39:30.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b4d200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6b48168fd0 con 0x7f6b480ccaa0 2024-09-10T22:39:30.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b46800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4815f330 0x7f6b481fb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:30.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b46800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4815f330 0x7f6b481fb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42094/0 (socket says 172.21.15.103:42094) 2024-09-10T22:39:30.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b46800640 1 -- 172.21.15.103:0/427768222 learned_addr learned my addr 172.21.15.103:0/427768222 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b45e00640 1 --2- 172.21.15.103:0/427768222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b480b2840 0x7f6b480c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b45400640 1 --2- 172.21.15.103:0/427768222 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b480ccaa0 0x7f6b48163e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b46800640 1 -- 172.21.15.103:0/427768222 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b480ccaa0 msgr2=0x7f6b48163e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b46800640 1 --2- 172.21.15.103:0/427768222 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b480ccaa0 0x7f6b48163e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b46800640 1 -- 172.21.15.103:0/427768222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b480b2840 msgr2=0x7f6b480c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b46800640 1 --2- 172.21.15.103:0/427768222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b480b2840 0x7f6b480c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b46800640 1 -- 172.21.15.103:0/427768222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b481643c0 con 0x7f6b4815f330 2024-09-10T22:39:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b46800640 1 --2- 172.21.15.103:0/427768222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4815f330 0x7f6b481fb890 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000eb20 tx=0x7f6b4000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:30.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b3e000640 1 -- 172.21.15.103:0/427768222 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40004b30 con 0x7f6b4815f330 2024-09-10T22:39:30.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b3e000640 1 -- 172.21.15.103:0/427768222 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b40004cf0 con 0x7f6b4815f330 2024-09-10T22:39:30.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b3e000640 1 -- 172.21.15.103:0/427768222 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40005280 con 0x7f6b4815f330 2024-09-10T22:39:30.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b4d200640 1 -- 172.21.15.103:0/427768222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b48165a60 con 0x7f6b4815f330 2024-09-10T22:39:30.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b4d200640 1 -- 172.21.15.103:0/427768222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b48166020 con 0x7f6b4815f330 2024-09-10T22:39:30.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.359+0000 7f6b4d200640 1 -- 172.21.15.103:0/427768222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b480ccf50 con 0x7f6b4815f330 2024-09-10T22:39:30.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.363+0000 7f6b3e000640 1 -- 172.21.15.103:0/427768222 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6b40005420 con 0x7f6b4815f330 2024-09-10T22:39:30.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.363+0000 7f6b3e000640 1 --2- 172.21.15.103:0/427768222 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6b28072610 0x7f6b28074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:30.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.363+0000 7f6b3e000640 1 -- 172.21.15.103:0/427768222 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f6b40094170 con 0x7f6b4815f330 2024-09-10T22:39:30.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.363+0000 7f6b45e00640 1 --2- 172.21.15.103:0/427768222 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6b28072610 0x7f6b28074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:30.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.363+0000 7f6b45e00640 1 --2- 172.21.15.103:0/427768222 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6b28072610 0x7f6b28074ad0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6b380af000 tx=0x7f6b3801b090 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:30.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.367+0000 7f6b3e000640 1 -- 172.21.15.103:0/427768222 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6b4005edf0 con 0x7f6b4815f330 2024-09-10T22:39:30.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.531+0000 7f6b4d200640 1 -- 172.21.15.103:0/427768222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6b480c4f30 con 0x7f6b4815f330 2024-09-10T22:39:30.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.531+0000 7f6b3e000640 1 -- 172.21.15.103:0/427768222 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7f6b40063820 con 0x7f6b4815f330 2024-09-10T22:39:30.534 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2024-09-10T22:39:30.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.531+0000 7f6b4d200640 1 -- 172.21.15.103:0/427768222 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6b28072610 msgr2=0x7f6b28074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:30.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.531+0000 7f6b4d200640 1 --2- 172.21.15.103:0/427768222 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6b28072610 0x7f6b28074ad0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6b380af000 tx=0x7f6b3801b090 comp rx=0 tx=0).stop 2024-09-10T22:39:30.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.531+0000 7f6b4d200640 1 -- 172.21.15.103:0/427768222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4815f330 msgr2=0x7f6b481fb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:30.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.531+0000 7f6b4d200640 1 --2- 172.21.15.103:0/427768222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4815f330 0x7f6b481fb890 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000eb20 tx=0x7f6b4000c2d0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.531+0000 7f6b4d200640 1 -- 172.21.15.103:0/427768222 shutdown_connections 2024-09-10T22:39:30.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.531+0000 7f6b4d200640 1 --2- 172.21.15.103:0/427768222 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6b28072610 0x7f6b28074ad0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.531+0000 7f6b4d200640 1 --2- 172.21.15.103:0/427768222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4815f330 0x7f6b481fb890 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.531+0000 7f6b4d200640 1 --2- 172.21.15.103:0/427768222 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b480ccaa0 0x7f6b48163e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.531+0000 7f6b4d200640 1 --2- 172.21.15.103:0/427768222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b480b2840 0x7f6b480c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.531+0000 7f6b4d200640 1 -- 172.21.15.103:0/427768222 >> 172.21.15.103:0/427768222 conn(0x7f6b480d1ab0 msgr2=0x7f6b480ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:30.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.531+0000 7f6b4d200640 1 -- 172.21.15.103:0/427768222 shutdown_connections 2024-09-10T22:39:30.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.531+0000 7f6b4d200640 1 -- 172.21.15.103:0/427768222 wait complete. 2024-09-10T22:39:30.555 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag' 2024-09-10T22:39:30.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.695+0000 7fafe8000640 1 -- 172.21.15.103:0/3600301410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafe015bcb0 msgr2=0x7fafe00cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:30.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.695+0000 7fafe8000640 1 --2- 172.21.15.103:0/3600301410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafe015bcb0 0x7fafe00cf5f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009840 tx=0x7fafd401c7f0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.695+0000 7fafe8000640 1 -- 172.21.15.103:0/3600301410 shutdown_connections 2024-09-10T22:39:30.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.695+0000 7fafe8000640 1 --2- 172.21.15.103:0/3600301410 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafe00d0710 0x7fafe00b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.695+0000 7fafe8000640 1 --2- 172.21.15.103:0/3600301410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafe015bcb0 0x7fafe00cf5f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.695+0000 7fafe8000640 1 -- 172.21.15.103:0/3600301410 >> 172.21.15.103:0/3600301410 conn(0x7fafe00d1a20 msgr2=0x7fafe00d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:30.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.695+0000 7fafe8000640 1 -- 172.21.15.103:0/3600301410 shutdown_connections 2024-09-10T22:39:30.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.695+0000 7fafe8000640 1 -- 172.21.15.103:0/3600301410 wait complete. 2024-09-10T22:39:30.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.695+0000 7fafe8000640 1 Processor -- start 2024-09-10T22:39:30.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.695+0000 7fafe8000640 1 -- start start 2024-09-10T22:39:30.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe8000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafe00d0710 0x7fafe014ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:30.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe8000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafe00d2540 0x7fafe006dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:30.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe8000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafe015bcb0 0x7fafe00c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:30.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe8000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fafe0168960 con 0x7fafe00d2540 2024-09-10T22:39:30.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe8000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fafe01687e0 con 0x7fafe015bcb0 2024-09-10T22:39:30.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe8000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fafe0168ae0 con 0x7fafe00d0710 2024-09-10T22:39:30.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe4c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafe00d2540 0x7fafe006dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe4c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafe00d2540 0x7fafe006dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42106/0 (socket says 172.21.15.103:42106) 2024-09-10T22:39:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe4c00640 1 -- 172.21.15.103:0/3367689427 learned_addr learned my addr 172.21.15.103:0/3367689427 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe5600640 1 --2- 172.21.15.103:0/3367689427 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafe00d0710 0x7fafe014ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe6000640 1 --2- 172.21.15.103:0/3367689427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafe015bcb0 0x7fafe00c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe4c00640 1 -- 172.21.15.103:0/3367689427 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafe00d0710 msgr2=0x7fafe014ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe4c00640 1 --2- 172.21.15.103:0/3367689427 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafe00d0710 0x7fafe014ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe4c00640 1 -- 172.21.15.103:0/3367689427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafe015bcb0 msgr2=0x7fafe00c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe4c00640 1 --2- 172.21.15.103:0/3367689427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafe015bcb0 0x7fafe00c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe4c00640 1 -- 172.21.15.103:0/3367689427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe014f200 con 0x7fafe00d2540 2024-09-10T22:39:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe6000640 1 --2- 172.21.15.103:0/3367689427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafe015bcb0 0x7fafe00c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe4c00640 1 --2- 172.21.15.103:0/3367689427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafe00d2540 0x7fafe006dd10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00c420 tx=0x7fafcc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafdd600640 1 -- 172.21.15.103:0/3367689427 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc017070 con 0x7fafe00d2540 2024-09-10T22:39:30.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafdd600640 1 -- 172.21.15.103:0/3367689427 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafcc003600 con 0x7fafe00d2540 2024-09-10T22:39:30.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafdd600640 1 -- 172.21.15.103:0/3367689427 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc003a50 con 0x7fafe00d2540 2024-09-10T22:39:30.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe8000640 1 -- 172.21.15.103:0/3367689427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafe00c9570 con 0x7fafe00d2540 2024-09-10T22:39:30.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe8000640 1 -- 172.21.15.103:0/3367689427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafe00c6400 con 0x7fafe00d2540 2024-09-10T22:39:30.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafe8000640 1 -- 172.21.15.103:0/3367689427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafe00b1490 con 0x7fafe00d2540 2024-09-10T22:39:30.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.699+0000 7fafdd600640 1 -- 172.21.15.103:0/3367689427 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fafcc003bf0 con 0x7fafe00d2540 2024-09-10T22:39:30.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.703+0000 7fafdd600640 1 --2- 172.21.15.103:0/3367689427 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafc00725e0 0x7fafc0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:30.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.703+0000 7fafdd600640 1 -- 172.21.15.103:0/3367689427 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fafcc092b40 con 0x7fafe00d2540 2024-09-10T22:39:30.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.703+0000 7fafe5600640 1 --2- 172.21.15.103:0/3367689427 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafc00725e0 0x7fafc0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:30.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.703+0000 7fafe5600640 1 --2- 172.21.15.103:0/3367689427 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafc00725e0 0x7fafc0074aa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fafd40af000 tx=0x7fafd401b030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:30.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.707+0000 7fafdd600640 1 -- 172.21.15.103:0/3367689427 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fafcc05d7c0 con 0x7fafe00d2540 2024-09-10T22:39:30.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:30.931+0000 7fafe8000640 1 -- 172.21.15.103:0/3367689427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]} v 0) -- 0x7fafe00b3bd0 con 0x7fafe00d2540 2024-09-10T22:39:31.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.031+0000 7fafdd600640 1 -- 172.21.15.103:0/3367689427 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]}]=0 v59) ==== 139+0+0 (secure 0 0 0) 0x7fafcc0621f0 con 0x7fafe00d2540 2024-09-10T22:39:31.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.035+0000 7fafe8000640 1 -- 172.21.15.103:0/3367689427 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafc00725e0 msgr2=0x7fafc0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:31.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.035+0000 7fafe8000640 1 --2- 172.21.15.103:0/3367689427 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafc00725e0 0x7fafc0074aa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fafd40af000 tx=0x7fafd401b030 comp rx=0 tx=0).stop 2024-09-10T22:39:31.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.035+0000 7fafe8000640 1 -- 172.21.15.103:0/3367689427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafe00d2540 msgr2=0x7fafe006dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:31.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.035+0000 7fafe8000640 1 --2- 172.21.15.103:0/3367689427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafe00d2540 0x7fafe006dd10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00c420 tx=0x7fafcc00c8e0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.035+0000 7fafe8000640 1 -- 172.21.15.103:0/3367689427 shutdown_connections 2024-09-10T22:39:31.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.035+0000 7fafe8000640 1 --2- 172.21.15.103:0/3367689427 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafc00725e0 0x7fafc0074aa0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.035+0000 7fafe8000640 1 --2- 172.21.15.103:0/3367689427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafe015bcb0 0x7fafe00c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.035+0000 7fafe8000640 1 --2- 172.21.15.103:0/3367689427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafe00d2540 0x7fafe006dd10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.035+0000 7fafe8000640 1 --2- 172.21.15.103:0/3367689427 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafe00d0710 0x7fafe014ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.035+0000 7fafe8000640 1 -- 172.21.15.103:0/3367689427 >> 172.21.15.103:0/3367689427 conn(0x7fafe00d1a20 msgr2=0x7fafe00b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:31.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.035+0000 7fafe8000640 1 -- 172.21.15.103:0/3367689427 shutdown_connections 2024-09-10T22:39:31.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.035+0000 7fafe8000640 1 -- 172.21.15.103:0/3367689427 wait complete. 2024-09-10T22:39:31.059 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T22:39:31.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd28d200640 1 -- 172.21.15.103:0/516167623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2880cf260 msgr2=0x7fd2880b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:31.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd28d200640 1 --2- 172.21.15.103:0/516167623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2880cf260 0x7fd2880b2c10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd2880b4f10 tx=0x7fd27801cd80 comp rx=0 tx=0).stop 2024-09-10T22:39:31.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd28d200640 1 -- 172.21.15.103:0/516167623 shutdown_connections 2024-09-10T22:39:31.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd28d200640 1 --2- 172.21.15.103:0/516167623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd288072a40 0x7fd288157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd28d200640 1 --2- 172.21.15.103:0/516167623 >> v2:172.21.15.131:3300/0 conn(0x7fd2880b3150 0x7fd288072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd28d200640 1 --2- 172.21.15.103:0/516167623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2880cf260 0x7fd2880b2c10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd28d200640 1 -- 172.21.15.103:0/516167623 >> 172.21.15.103:0/516167623 conn(0x7fd28806cc00 msgr2=0x7fd28806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:31.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd28d200640 1 -- 172.21.15.103:0/516167623 shutdown_connections 2024-09-10T22:39:31.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd28d200640 1 -- 172.21.15.103:0/516167623 wait complete. 2024-09-10T22:39:31.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd28d200640 1 Processor -- start 2024-09-10T22:39:31.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd28d200640 1 -- start start 2024-09-10T22:39:31.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd28d200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd288072a40 0x7fd288150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:31.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd28d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2880b3150 0x7fd2881f82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:31.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd28d200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2880cf260 0x7fd2881f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:31.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd28d200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd288157d20 con 0x7fd2880b3150 2024-09-10T22:39:31.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd28d200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd288157ba0 con 0x7fd288072a40 2024-09-10T22:39:31.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd28d200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd288157ea0 con 0x7fd2880cf260 2024-09-10T22:39:31.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd27d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2880b3150 0x7fd2881f82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:31.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd27d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2880b3150 0x7fd2881f82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42126/0 (socket says 172.21.15.103:42126) 2024-09-10T22:39:31.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd27d400640 1 -- 172.21.15.103:0/1756524372 learned_addr learned my addr 172.21.15.103:0/1756524372 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:31.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd285e00640 1 --2- 172.21.15.103:0/1756524372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd288072a40 0x7fd288150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:31.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd286800640 1 --2- 172.21.15.103:0/1756524372 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2880cf260 0x7fd2881f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:31.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd27d400640 1 -- 172.21.15.103:0/1756524372 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2880cf260 msgr2=0x7fd2881f87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:31.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd27d400640 1 --2- 172.21.15.103:0/1756524372 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2880cf260 0x7fd2881f87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd27d400640 1 -- 172.21.15.103:0/1756524372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd288072a40 msgr2=0x7fd288150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:31.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd27d400640 1 --2- 172.21.15.103:0/1756524372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd288072a40 0x7fd288150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.203+0000 7fd27d400640 1 -- 172.21.15.103:0/1756524372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2881f8f70 con 0x7fd2880b3150 2024-09-10T22:39:31.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.207+0000 7fd27d400640 1 --2- 172.21.15.103:0/1756524372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2880b3150 0x7fd2881f82a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd27000d950 tx=0x7fd27000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:31.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.207+0000 7fd27ea00640 1 -- 172.21.15.103:0/1756524372 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270017070 con 0x7fd2880b3150 2024-09-10T22:39:31.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.207+0000 7fd27ea00640 1 -- 172.21.15.103:0/1756524372 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd270009d20 con 0x7fd2880b3150 2024-09-10T22:39:31.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.207+0000 7fd28d200640 1 -- 172.21.15.103:0/1756524372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2881f7a50 con 0x7fd2880b3150 2024-09-10T22:39:31.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.207+0000 7fd27ea00640 1 -- 172.21.15.103:0/1756524372 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2700106c0 con 0x7fd2880b3150 2024-09-10T22:39:31.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.207+0000 7fd28d200640 1 -- 172.21.15.103:0/1756524372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd288150ca0 con 0x7fd2880b3150 2024-09-10T22:39:31.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.207+0000 7fd28d200640 1 -- 172.21.15.103:0/1756524372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd288072500 con 0x7fd2880b3150 2024-09-10T22:39:31.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.207+0000 7fd27ea00640 1 -- 172.21.15.103:0/1756524372 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd270010860 con 0x7fd2880b3150 2024-09-10T22:39:31.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.207+0000 7fd27ea00640 1 --2- 172.21.15.103:0/1756524372 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2640725e0 0x7fd264074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:31.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.207+0000 7fd27ea00640 1 -- 172.21.15.103:0/1756524372 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fd2700939f0 con 0x7fd2880b3150 2024-09-10T22:39:31.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.211+0000 7fd285e00640 1 --2- 172.21.15.103:0/1756524372 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2640725e0 0x7fd264074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:31.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.211+0000 7fd285e00640 1 --2- 172.21.15.103:0/1756524372 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2640725e0 0x7fd264074aa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd2780af000 tx=0x7fd27801b5c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:31.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.211+0000 7fd27ea00640 1 -- 172.21.15.103:0/1756524372 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd27005e670 con 0x7fd2880b3150 2024-09-10T22:39:31.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.379+0000 7fd28d200640 1 -- 172.21.15.103:0/1756524372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fd288070410 con 0x7fd2880b3150 2024-09-10T22:39:31.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.379+0000 7fd27ea00640 1 -- 172.21.15.103:0/1756524372 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v27) ==== 59+0+1998 (secure 0 0 0) 0x7fd2700630a0 con 0x7fd2880b3150 2024-09-10T22:39:31.383 INFO:teuthology.orchestra.run.smithi103.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T22:39:31.383 INFO:teuthology.orchestra.run.smithi103.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T22:39:31.383 INFO:teuthology.orchestra.run.smithi103.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T22:39:31.383 INFO:teuthology.orchestra.run.smithi103.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T22:39:31.383 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4853.781452 2024-09-10T22:39:31.383 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 8222.655229 2024-09-10T22:39:31.383 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4587.934032 2024-09-10T22:39:31.383 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4814.972817 2024-09-10T22:39:31.383 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3485.951614 2024-09-10T22:39:31.383 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3821.456289 2024-09-10T22:39:31.384 INFO:teuthology.orchestra.run.smithi103.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3533.610209 2024-09-10T22:39:31.384 INFO:teuthology.orchestra.run.smithi103.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3752.830807 2024-09-10T22:39:31.384 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced debug_mds 20/20 2024-09-10T22:39:31.384 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T22:39:31.384 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced debug_ms 2/2 2024-09-10T22:39:31.384 INFO:teuthology.orchestra.run.smithi103.stdout:mds dev mds_debug_frag true 2024-09-10T22:39:31.384 INFO:teuthology.orchestra.run.smithi103.stdout:mds dev mds_debug_scatterstat true 2024-09-10T22:39:31.384 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T22:39:31.384 INFO:teuthology.orchestra.run.smithi103.stdout:mds dev mds_verify_scatter true 2024-09-10T22:39:31.384 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T22:39:31.384 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T22:39:31.384 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T22:39:31.384 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced client_mount_timeout 600 2024-09-10T22:39:31.384 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced debug_client 20/20 2024-09-10T22:39:31.385 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced debug_ms 1/1 2024-09-10T22:39:31.385 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T22:39:31.385 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T22:39:31.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.383+0000 7fd28d200640 1 -- 172.21.15.103:0/1756524372 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2640725e0 msgr2=0x7fd264074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:31.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.383+0000 7fd28d200640 1 --2- 172.21.15.103:0/1756524372 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2640725e0 0x7fd264074aa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd2780af000 tx=0x7fd27801b5c0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.383+0000 7fd28d200640 1 -- 172.21.15.103:0/1756524372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2880b3150 msgr2=0x7fd2881f82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:31.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.383+0000 7fd28d200640 1 --2- 172.21.15.103:0/1756524372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2880b3150 0x7fd2881f82a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd27000d950 tx=0x7fd27000de10 comp rx=0 tx=0).stop 2024-09-10T22:39:31.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.383+0000 7fd28d200640 1 -- 172.21.15.103:0/1756524372 shutdown_connections 2024-09-10T22:39:31.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.383+0000 7fd28d200640 1 --2- 172.21.15.103:0/1756524372 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2640725e0 0x7fd264074aa0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.383+0000 7fd28d200640 1 --2- 172.21.15.103:0/1756524372 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2880cf260 0x7fd2881f87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.383+0000 7fd28d200640 1 --2- 172.21.15.103:0/1756524372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2880b3150 0x7fd2881f82a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.383+0000 7fd28d200640 1 --2- 172.21.15.103:0/1756524372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd288072a40 0x7fd288150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.383+0000 7fd28d200640 1 -- 172.21.15.103:0/1756524372 >> 172.21.15.103:0/1756524372 conn(0x7fd28806cc00 msgr2=0x7fd2880b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:31.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.383+0000 7fd28d200640 1 -- 172.21.15.103:0/1756524372 shutdown_connections 2024-09-10T22:39:31.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.383+0000 7fd28d200640 1 -- 172.21.15.103:0/1756524372 wait complete. 2024-09-10T22:39:31.403 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T22:39:31.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2366000640 1 -- 172.21.15.103:0/831685475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23600aeb40 msgr2=0x7f2360072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:31.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2366000640 1 --2- 172.21.15.103:0/831685475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23600aeb40 0x7f2360072e30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f23600744a0 tx=0x7f234801c830 comp rx=0 tx=0).stop 2024-09-10T22:39:31.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2366000640 1 -- 172.21.15.103:0/831685475 shutdown_connections 2024-09-10T22:39:31.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2366000640 1 --2- 172.21.15.103:0/831685475 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23600cf790 0x7f23600cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2366000640 1 --2- 172.21.15.103:0/831685475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23600aeb40 0x7f2360072e30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2366000640 1 -- 172.21.15.103:0/831685475 >> 172.21.15.103:0/831685475 conn(0x7f236006cc00 msgr2=0x7f236006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:31.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2366000640 1 -- 172.21.15.103:0/831685475 shutdown_connections 2024-09-10T22:39:31.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2366000640 1 -- 172.21.15.103:0/831685475 wait complete. 2024-09-10T22:39:31.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2366000640 1 Processor -- start 2024-09-10T22:39:31.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2366000640 1 -- start start 2024-09-10T22:39:31.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2366000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23600aeb40 0x7f23601fb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:31.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2366000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23600cc120 0x7f23600adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:31.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2366000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23600cf790 0x7f2360148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:31.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2366000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2360168bd0 con 0x7f23600cc120 2024-09-10T22:39:31.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2366000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2360168a50 con 0x7f23600cf790 2024-09-10T22:39:31.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2366000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2360168d50 con 0x7f23600aeb40 2024-09-10T22:39:31.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2356a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23600cc120 0x7f23600adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:31.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2356a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23600cc120 0x7f23600adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42150/0 (socket says 172.21.15.103:42150) 2024-09-10T22:39:31.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2356a00640 1 -- 172.21.15.103:0/1698860597 learned_addr learned my addr 172.21.15.103:0/1698860597 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:31.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2356a00640 1 -- 172.21.15.103:0/1698860597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23600aeb40 msgr2=0x7f23601fb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:31.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2356a00640 1 --2- 172.21.15.103:0/1698860597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23600aeb40 0x7f23601fb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2356a00640 1 -- 172.21.15.103:0/1698860597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23600cf790 msgr2=0x7f2360148e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:31.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2356a00640 1 --2- 172.21.15.103:0/1698860597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23600cf790 0x7f2360148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.547+0000 7f2356a00640 1 -- 172.21.15.103:0/1698860597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23601fba20 con 0x7f23600cc120 2024-09-10T22:39:31.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.551+0000 7f2356a00640 1 --2- 172.21.15.103:0/1698860597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23600cc120 0x7f23600adac0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f23480b0040 tx=0x7f23480a5600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:31.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.551+0000 7f2357e00640 1 -- 172.21.15.103:0/1698860597 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23480b2040 con 0x7f23600cc120 2024-09-10T22:39:31.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.551+0000 7f2357e00640 1 -- 172.21.15.103:0/1698860597 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2348004470 con 0x7f23600cc120 2024-09-10T22:39:31.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.551+0000 7f2357e00640 1 -- 172.21.15.103:0/1698860597 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23480052d0 con 0x7f23600cc120 2024-09-10T22:39:31.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.551+0000 7f2366000640 1 -- 172.21.15.103:0/1698860597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23601598c0 con 0x7f23600cc120 2024-09-10T22:39:31.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.551+0000 7f2366000640 1 -- 172.21.15.103:0/1698860597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23601face0 con 0x7f23600cc120 2024-09-10T22:39:31.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.551+0000 7f2366000640 1 -- 172.21.15.103:0/1698860597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f236015ffb0 con 0x7f23600cc120 2024-09-10T22:39:31.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.551+0000 7f2357e00640 1 -- 172.21.15.103:0/1698860597 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2348005470 con 0x7f23600cc120 2024-09-10T22:39:31.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.551+0000 7f2357e00640 1 --2- 172.21.15.103:0/1698860597 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f233c0725e0 0x7f233c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:31.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.555+0000 7f2357e00640 1 -- 172.21.15.103:0/1698860597 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f234812d380 con 0x7f23600cc120 2024-09-10T22:39:31.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.555+0000 7f235f400640 1 --2- 172.21.15.103:0/1698860597 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f233c0725e0 0x7f233c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:31.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.555+0000 7f235f400640 1 --2- 172.21.15.103:0/1698860597 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f233c0725e0 0x7f233c074aa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2350007fd0 tx=0x7f2350007d40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:31.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.555+0000 7f2357e00640 1 -- 172.21.15.103:0/1698860597 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f23480164b0 con 0x7f23600cc120 2024-09-10T22:39:31.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.723+0000 7f2366000640 1 -- 172.21.15.103:0/1698860597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2360075df0 con 0x7f23600cc120 2024-09-10T22:39:31.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.727+0000 7f2357e00640 1 -- 172.21.15.103:0/1698860597 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f23480f85d0 con 0x7f23600cc120 2024-09-10T22:39:31.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.727+0000 7f2366000640 1 -- 172.21.15.103:0/1698860597 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f233c0725e0 msgr2=0x7f233c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:31.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.727+0000 7f2366000640 1 --2- 172.21.15.103:0/1698860597 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f233c0725e0 0x7f233c074aa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2350007fd0 tx=0x7f2350007d40 comp rx=0 tx=0).stop 2024-09-10T22:39:31.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.727+0000 7f2366000640 1 -- 172.21.15.103:0/1698860597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23600cc120 msgr2=0x7f23600adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:31.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.727+0000 7f2366000640 1 --2- 172.21.15.103:0/1698860597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23600cc120 0x7f23600adac0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f23480b0040 tx=0x7f23480a5600 comp rx=0 tx=0).stop 2024-09-10T22:39:31.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.727+0000 7f2366000640 1 -- 172.21.15.103:0/1698860597 shutdown_connections 2024-09-10T22:39:31.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.727+0000 7f2366000640 1 --2- 172.21.15.103:0/1698860597 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f233c0725e0 0x7f233c074aa0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.727+0000 7f2366000640 1 --2- 172.21.15.103:0/1698860597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23600cf790 0x7f2360148e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.727+0000 7f2366000640 1 --2- 172.21.15.103:0/1698860597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23600cc120 0x7f23600adac0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.727+0000 7f2366000640 1 --2- 172.21.15.103:0/1698860597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23600aeb40 0x7f23601fb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:31.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.727+0000 7f2366000640 1 -- 172.21.15.103:0/1698860597 >> 172.21.15.103:0/1698860597 conn(0x7f236006cc00 msgr2=0x7f23600b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:31.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.727+0000 7f2366000640 1 -- 172.21.15.103:0/1698860597 shutdown_connections 2024-09-10T22:39:31.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:31.727+0000 7f2366000640 1 -- 172.21.15.103:0/1698860597 wait complete. 2024-09-10T22:39:31.751 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T22:39:31.751 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:39:31.838 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:39:31.925 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T22:39:31.926 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:39:31.926 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:39:31.934 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:39:31.934 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:39:31.984 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T22:39:32.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.167+0000 7f171a400640 1 -- 172.21.15.103:0/2365464697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17140b09c0 msgr2=0x7f17140ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:32.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.167+0000 7f171a400640 1 --2- 172.21.15.103:0/2365464697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17140b09c0 0x7f17140ce600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f16fc009bc0 tx=0x7f16fc01cb10 comp rx=0 tx=0).stop 2024-09-10T22:39:32.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.167+0000 7f171a400640 1 -- 172.21.15.103:0/2365464697 shutdown_connections 2024-09-10T22:39:32.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.167+0000 7f171a400640 1 --2- 172.21.15.103:0/2365464697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17140b09c0 0x7f17140ce600 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:32.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.167+0000 7f171a400640 1 --2- 172.21.15.103:0/2365464697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f171415be30 0x7f17140ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:32.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.167+0000 7f171a400640 1 -- 172.21.15.103:0/2365464697 >> 172.21.15.103:0/2365464697 conn(0x7f17140d1ac0 msgr2=0x7f17140d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:32.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.167+0000 7f171a400640 1 -- 172.21.15.103:0/2365464697 shutdown_connections 2024-09-10T22:39:32.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.167+0000 7f171a400640 1 -- 172.21.15.103:0/2365464697 wait complete. 2024-09-10T22:39:32.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f171a400640 1 Processor -- start 2024-09-10T22:39:32.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f171a400640 1 -- start start 2024-09-10T22:39:32.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f171a400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17140b09c0 0x7f1714166240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:32.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f171a400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17140ceb40 0x7f17140c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:32.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f171a400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f171415be30 0x7f17140c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:32.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f171a400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1714169160 con 0x7f17140b09c0 2024-09-10T22:39:32.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f171a400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1714168fe0 con 0x7f171415be30 2024-09-10T22:39:32.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f171a400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f17141692e0 con 0x7f17140ceb40 2024-09-10T22:39:32.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f1713400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17140b09c0 0x7f1714166240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:32.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f1713400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17140b09c0 0x7f1714166240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42166/0 (socket says 172.21.15.103:42166) 2024-09-10T22:39:32.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f1713400640 1 -- 172.21.15.103:0/538687004 learned_addr learned my addr 172.21.15.103:0/538687004 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:32.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f170aa00640 1 --2- 172.21.15.103:0/538687004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17140ceb40 0x7f17140c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:32.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f1713e00640 1 --2- 172.21.15.103:0/538687004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f171415be30 0x7f17140c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:32.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f1713400640 1 -- 172.21.15.103:0/538687004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17140ceb40 msgr2=0x7f17140c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:32.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f1713400640 1 --2- 172.21.15.103:0/538687004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17140ceb40 0x7f17140c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:32.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f1713400640 1 -- 172.21.15.103:0/538687004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f171415be30 msgr2=0x7f17140c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:32.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f1713400640 1 --2- 172.21.15.103:0/538687004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f171415be30 0x7f17140c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:32.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f1713400640 1 -- 172.21.15.103:0/538687004 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17140c55f0 con 0x7f17140b09c0 2024-09-10T22:39:32.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f1713e00640 1 --2- 172.21.15.103:0/538687004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f171415be30 0x7f17140c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:32.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f1713400640 1 --2- 172.21.15.103:0/538687004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17140b09c0 0x7f1714166240 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f170400d950 tx=0x7f170400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:32.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f170be00640 1 -- 172.21.15.103:0/538687004 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704017070 con 0x7f17140b09c0 2024-09-10T22:39:32.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f170be00640 1 -- 172.21.15.103:0/538687004 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1704009d20 con 0x7f17140b09c0 2024-09-10T22:39:32.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f170be00640 1 -- 172.21.15.103:0/538687004 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17040106c0 con 0x7f17140b09c0 2024-09-10T22:39:32.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f171a400640 1 -- 172.21.15.103:0/538687004 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17140c58d0 con 0x7f17140b09c0 2024-09-10T22:39:32.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.171+0000 7f171a400640 1 -- 172.21.15.103:0/538687004 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17140c5e90 con 0x7f17140b09c0 2024-09-10T22:39:32.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.175+0000 7f171a400640 1 -- 172.21.15.103:0/538687004 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17140cf9c0 con 0x7f17140b09c0 2024-09-10T22:39:32.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.175+0000 7f170be00640 1 -- 172.21.15.103:0/538687004 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1704010860 con 0x7f17140b09c0 2024-09-10T22:39:32.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.175+0000 7f170be00640 1 --2- 172.21.15.103:0/538687004 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16f0072610 0x7f16f0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:32.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.175+0000 7f170be00640 1 -- 172.21.15.103:0/538687004 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f1704093a60 con 0x7f17140b09c0 2024-09-10T22:39:32.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.175+0000 7f170aa00640 1 --2- 172.21.15.103:0/538687004 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16f0072610 0x7f16f0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:32.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.179+0000 7f170aa00640 1 --2- 172.21.15.103:0/538687004 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16f0072610 0x7f16f0074ad0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0af000 tx=0x7f16fc01b350 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:32.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.179+0000 7f170be00640 1 -- 172.21.15.103:0/538687004 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f170405e650 con 0x7f17140b09c0 2024-09-10T22:39:32.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.355+0000 7f171a400640 1 -- 172.21.15.103:0/538687004 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f17140b4d90 con 0x7f17140b09c0 2024-09-10T22:39:32.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.355+0000 7f170be00640 1 -- 172.21.15.103:0/538687004 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f1704063080 con 0x7f17140b09c0 2024-09-10T22:39:32.359 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T22:39:32.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.359+0000 7f171a400640 1 -- 172.21.15.103:0/538687004 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16f0072610 msgr2=0x7f16f0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:32.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.359+0000 7f171a400640 1 --2- 172.21.15.103:0/538687004 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16f0072610 0x7f16f0074ad0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0af000 tx=0x7f16fc01b350 comp rx=0 tx=0).stop 2024-09-10T22:39:32.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.359+0000 7f171a400640 1 -- 172.21.15.103:0/538687004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17140b09c0 msgr2=0x7f1714166240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:32.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.359+0000 7f171a400640 1 --2- 172.21.15.103:0/538687004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17140b09c0 0x7f1714166240 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f170400d950 tx=0x7f170400de10 comp rx=0 tx=0).stop 2024-09-10T22:39:32.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.359+0000 7f171a400640 1 -- 172.21.15.103:0/538687004 shutdown_connections 2024-09-10T22:39:32.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.359+0000 7f171a400640 1 --2- 172.21.15.103:0/538687004 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16f0072610 0x7f16f0074ad0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:32.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.359+0000 7f171a400640 1 --2- 172.21.15.103:0/538687004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f171415be30 0x7f17140c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:32.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.359+0000 7f171a400640 1 --2- 172.21.15.103:0/538687004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17140ceb40 0x7f17140c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:32.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.359+0000 7f171a400640 1 --2- 172.21.15.103:0/538687004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17140b09c0 0x7f1714166240 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:32.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.359+0000 7f171a400640 1 -- 172.21.15.103:0/538687004 >> 172.21.15.103:0/538687004 conn(0x7f17140d1ac0 msgr2=0x7f17140d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:32.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.359+0000 7f171a400640 1 -- 172.21.15.103:0/538687004 shutdown_connections 2024-09-10T22:39:32.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.359+0000 7f171a400640 1 -- 172.21.15.103:0/538687004 wait complete. 2024-09-10T22:39:32.380 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:39:32.381 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:39:32.390 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T22:39:32.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.567+0000 7fcc72600640 1 -- 172.21.15.103:0/169408690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc6c0cd500 msgr2=0x7fcc6c15f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:32.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.567+0000 7fcc72600640 1 --2- 172.21.15.103:0/169408690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc6c0cd500 0x7fcc6c15f890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcc64009900 tx=0x7fcc6401c8e0 comp rx=0 tx=0).stop 2024-09-10T22:39:32.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.567+0000 7fcc72600640 1 -- 172.21.15.103:0/169408690 shutdown_connections 2024-09-10T22:39:32.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.567+0000 7fcc72600640 1 --2- 172.21.15.103:0/169408690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc6c0cd500 0x7fcc6c15f890 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:32.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.567+0000 7fcc72600640 1 --2- 172.21.15.103:0/169408690 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc6c0cdd00 0x7fcc6c0ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:32.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.567+0000 7fcc72600640 1 -- 172.21.15.103:0/169408690 >> 172.21.15.103:0/169408690 conn(0x7fcc6c0d1a20 msgr2=0x7fcc6c0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:32.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc72600640 1 -- 172.21.15.103:0/169408690 shutdown_connections 2024-09-10T22:39:32.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc72600640 1 -- 172.21.15.103:0/169408690 wait complete. 2024-09-10T22:39:32.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc72600640 1 Processor -- start 2024-09-10T22:39:32.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc72600640 1 -- start start 2024-09-10T22:39:32.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc72600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc6c0cd500 0x7fcc6c0c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:32.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc72600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc6c0cdd00 0x7fcc6c156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:32.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc72600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc6c15f1a0 0x7fcc6c0b6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:32.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc72600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c168f60 con 0x7fcc6c0cd500 2024-09-10T22:39:32.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc72600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c168de0 con 0x7fcc6c0cdd00 2024-09-10T22:39:32.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc72600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcc6c1690e0 con 0x7fcc6c15f1a0 2024-09-10T22:39:32.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc6b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc6c0cd500 0x7fcc6c0c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:32.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc6b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc6c0cd500 0x7fcc6c0c8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42178/0 (socket says 172.21.15.103:42178) 2024-09-10T22:39:32.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc6b400640 1 -- 172.21.15.103:0/2698219944 learned_addr learned my addr 172.21.15.103:0/2698219944 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:32.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc62a00640 1 --2- 172.21.15.103:0/2698219944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc6c0cdd00 0x7fcc6c156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:32.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc6be00640 1 --2- 172.21.15.103:0/2698219944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc6c15f1a0 0x7fcc6c0b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:32.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc6b400640 1 -- 172.21.15.103:0/2698219944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc6c15f1a0 msgr2=0x7fcc6c0b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:32.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc6b400640 1 --2- 172.21.15.103:0/2698219944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc6c15f1a0 0x7fcc6c0b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:32.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc6b400640 1 -- 172.21.15.103:0/2698219944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc6c0cdd00 msgr2=0x7fcc6c156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:32.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc6b400640 1 --2- 172.21.15.103:0/2698219944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc6c0cdd00 0x7fcc6c156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:32.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc6b400640 1 -- 172.21.15.103:0/2698219944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6c165c70 con 0x7fcc6c0cd500 2024-09-10T22:39:32.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc62a00640 1 --2- 172.21.15.103:0/2698219944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc6c0cdd00 0x7fcc6c156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:32.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc6b400640 1 --2- 172.21.15.103:0/2698219944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc6c0cd500 0x7fcc6c0c8d60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c00c730 tx=0x7fcc5c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:32.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc63e00640 1 -- 172.21.15.103:0/2698219944 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c003b80 con 0x7fcc6c0cd500 2024-09-10T22:39:32.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc63e00640 1 -- 172.21.15.103:0/2698219944 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc5c003d40 con 0x7fcc6c0cd500 2024-09-10T22:39:32.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc72600640 1 -- 172.21.15.103:0/2698219944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc6c15cd00 con 0x7fcc6c0cd500 2024-09-10T22:39:32.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc63e00640 1 -- 172.21.15.103:0/2698219944 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c00aab0 con 0x7fcc6c0cd500 2024-09-10T22:39:32.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.571+0000 7fcc72600640 1 -- 172.21.15.103:0/2698219944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc6c15d2c0 con 0x7fcc6c0cd500 2024-09-10T22:39:32.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.575+0000 7fcc72600640 1 -- 172.21.15.103:0/2698219944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc6c15f890 con 0x7fcc6c0cd500 2024-09-10T22:39:32.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.575+0000 7fcc63e00640 1 -- 172.21.15.103:0/2698219944 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcc5c00ac50 con 0x7fcc6c0cd500 2024-09-10T22:39:32.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.575+0000 7fcc63e00640 1 --2- 172.21.15.103:0/2698219944 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcc480725e0 0x7fcc48074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:32.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.575+0000 7fcc63e00640 1 -- 172.21.15.103:0/2698219944 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fcc5c093480 con 0x7fcc6c0cd500 2024-09-10T22:39:32.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.575+0000 7fcc62a00640 1 --2- 172.21.15.103:0/2698219944 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcc480725e0 0x7fcc48074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:32.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.575+0000 7fcc62a00640 1 --2- 172.21.15.103:0/2698219944 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcc480725e0 0x7fcc48074aa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcc540058d0 tx=0x7fcc54005860 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:32.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.579+0000 7fcc63e00640 1 -- 172.21.15.103:0/2698219944 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcc5c05e750 con 0x7fcc6c0cd500 2024-09-10T22:39:32.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.755+0000 7fcc72600640 1 -- 172.21.15.103:0/2698219944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcc6c0afb70 con 0x7fcc6c0cd500 2024-09-10T22:39:32.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.755+0000 7fcc63e00640 1 -- 172.21.15.103:0/2698219944 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fcc5c065e20 con 0x7fcc6c0cd500 2024-09-10T22:39:32.760 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T22:39:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.759+0000 7fcc72600640 1 -- 172.21.15.103:0/2698219944 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcc480725e0 msgr2=0x7fcc48074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.759+0000 7fcc72600640 1 --2- 172.21.15.103:0/2698219944 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcc480725e0 0x7fcc48074aa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcc540058d0 tx=0x7fcc54005860 comp rx=0 tx=0).stop 2024-09-10T22:39:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.759+0000 7fcc72600640 1 -- 172.21.15.103:0/2698219944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc6c0cd500 msgr2=0x7fcc6c0c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.759+0000 7fcc72600640 1 --2- 172.21.15.103:0/2698219944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc6c0cd500 0x7fcc6c0c8d60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c00c730 tx=0x7fcc5c00cbf0 comp rx=0 tx=0).stop 2024-09-10T22:39:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.759+0000 7fcc72600640 1 -- 172.21.15.103:0/2698219944 shutdown_connections 2024-09-10T22:39:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.759+0000 7fcc72600640 1 --2- 172.21.15.103:0/2698219944 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcc480725e0 0x7fcc48074aa0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.759+0000 7fcc72600640 1 --2- 172.21.15.103:0/2698219944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc6c15f1a0 0x7fcc6c0b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.759+0000 7fcc72600640 1 --2- 172.21.15.103:0/2698219944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc6c0cdd00 0x7fcc6c156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.759+0000 7fcc72600640 1 --2- 172.21.15.103:0/2698219944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc6c0cd500 0x7fcc6c0c8d60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.759+0000 7fcc72600640 1 -- 172.21.15.103:0/2698219944 >> 172.21.15.103:0/2698219944 conn(0x7fcc6c0d1a20 msgr2=0x7fcc6c0aede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.759+0000 7fcc72600640 1 -- 172.21.15.103:0/2698219944 shutdown_connections 2024-09-10T22:39:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:32.759+0000 7fcc72600640 1 -- 172.21.15.103:0/2698219944 wait complete. 2024-09-10T22:39:32.781 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-09-10T22:39:32.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:32.781 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T22:39:32.801 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:39:32.802 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:39:32.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:32.802 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T22:39:32.856 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:39:32.856 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:39:32.865 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:39:32.865 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:39:32.914 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T22:39:33.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f929e800640 1 -- 172.21.15.103:0/3989315472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92980b0680 msgr2=0x7f929806cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:33.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f929e800640 1 --2- 172.21.15.103:0/3989315472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92980b0680 0x7f929806cc00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9298072610 tx=0x7f929001cb40 comp rx=0 tx=0).stop 2024-09-10T22:39:33.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f929e800640 1 -- 172.21.15.103:0/3989315472 shutdown_connections 2024-09-10T22:39:33.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f929e800640 1 --2- 172.21.15.103:0/3989315472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92980b0680 0x7f929806cc00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f929e800640 1 --2- 172.21.15.103:0/3989315472 >> v2:172.21.15.131:3300/0 conn(0x7f92981582c0 0x7f92980b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f929e800640 1 -- 172.21.15.103:0/3989315472 >> 172.21.15.103:0/3989315472 conn(0x7f92980b4ed0 msgr2=0x7f92980b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:33.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f929e800640 1 -- 172.21.15.103:0/3989315472 shutdown_connections 2024-09-10T22:39:33.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f929e800640 1 -- 172.21.15.103:0/3989315472 wait complete. 2024-09-10T22:39:33.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f929e800640 1 Processor -- start 2024-09-10T22:39:33.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f929e800640 1 -- start start 2024-09-10T22:39:33.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f929e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92980b0680 0x7f9298099430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:33.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f929e800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92980b5ca0 0x7f929814a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:33.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f929e800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92981582c0 0x7f929814ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:33.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f929e800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9298167c20 con 0x7f92980b0680 2024-09-10T22:39:33.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f929e800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9298167aa0 con 0x7f92980b5ca0 2024-09-10T22:39:33.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f929e800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9298167da0 con 0x7f92981582c0 2024-09-10T22:39:33.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f9297400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92980b0680 0x7f9298099430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:33.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f9297400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92980b0680 0x7f9298099430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42196/0 (socket says 172.21.15.103:42196) 2024-09-10T22:39:33.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f9297400640 1 -- 172.21.15.103:0/2628758846 learned_addr learned my addr 172.21.15.103:0/2628758846 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:33.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f9297400640 1 -- 172.21.15.103:0/2628758846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92981582c0 msgr2=0x7f929814ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:33.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f9297400640 1 --2- 172.21.15.103:0/2628758846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92981582c0 0x7f929814ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f9297400640 1 -- 172.21.15.103:0/2628758846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92980b5ca0 msgr2=0x7f929814a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:33.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f9297400640 1 --2- 172.21.15.103:0/2628758846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92980b5ca0 0x7f929814a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.055+0000 7f9297400640 1 -- 172.21.15.103:0/2628758846 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f929814bc80 con 0x7f92980b0680 2024-09-10T22:39:33.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.059+0000 7f9297400640 1 --2- 172.21.15.103:0/2628758846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92980b0680 0x7f9298099430 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f928800e7a0 tx=0x7f928800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:33.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.059+0000 7f928f400640 1 -- 172.21.15.103:0/2628758846 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928800ccc0 con 0x7f92980b0680 2024-09-10T22:39:33.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.059+0000 7f928f400640 1 -- 172.21.15.103:0/2628758846 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9288010430 con 0x7f92980b0680 2024-09-10T22:39:33.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.059+0000 7f928f400640 1 -- 172.21.15.103:0/2628758846 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9288010860 con 0x7f92980b0680 2024-09-10T22:39:33.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.059+0000 7f929e800640 1 -- 172.21.15.103:0/2628758846 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f929814bf60 con 0x7f92980b0680 2024-09-10T22:39:33.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.059+0000 7f929e800640 1 -- 172.21.15.103:0/2628758846 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9298099c20 con 0x7f92980b0680 2024-09-10T22:39:33.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.059+0000 7f929e800640 1 -- 172.21.15.103:0/2628758846 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f929806cc00 con 0x7f92980b0680 2024-09-10T22:39:33.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.059+0000 7f928f400640 1 -- 172.21.15.103:0/2628758846 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9288010a00 con 0x7f92980b0680 2024-09-10T22:39:33.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.063+0000 7f928f400640 1 --2- 172.21.15.103:0/2628758846 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9278072610 0x7f9278074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:33.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.063+0000 7f928f400640 1 -- 172.21.15.103:0/2628758846 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f9288093fd0 con 0x7f92980b0680 2024-09-10T22:39:33.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.063+0000 7f9296a00640 1 --2- 172.21.15.103:0/2628758846 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9278072610 0x7f9278074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:33.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.063+0000 7f9296a00640 1 --2- 172.21.15.103:0/2628758846 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9278072610 0x7f9278074ad0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9284007fd0 tx=0x7f92840078e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:33.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.067+0000 7f928f400640 1 -- 172.21.15.103:0/2628758846 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f928805f340 con 0x7f92980b0680 2024-09-10T22:39:33.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.239+0000 7f929e800640 1 -- 172.21.15.103:0/2628758846 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f929815b070 con 0x7f92980b0680 2024-09-10T22:39:33.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.239+0000 7f928f400640 1 -- 172.21.15.103:0/2628758846 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f928805ec40 con 0x7f92980b0680 2024-09-10T22:39:33.243 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T22:39:33.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.243+0000 7f929e800640 1 -- 172.21.15.103:0/2628758846 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9278072610 msgr2=0x7f9278074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:33.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.243+0000 7f929e800640 1 --2- 172.21.15.103:0/2628758846 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9278072610 0x7f9278074ad0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9284007fd0 tx=0x7f92840078e0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.243+0000 7f929e800640 1 -- 172.21.15.103:0/2628758846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92980b0680 msgr2=0x7f9298099430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:33.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.243+0000 7f929e800640 1 --2- 172.21.15.103:0/2628758846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92980b0680 0x7f9298099430 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f928800e7a0 tx=0x7f928800ec60 comp rx=0 tx=0).stop 2024-09-10T22:39:33.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.243+0000 7f929e800640 1 -- 172.21.15.103:0/2628758846 shutdown_connections 2024-09-10T22:39:33.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.243+0000 7f929e800640 1 --2- 172.21.15.103:0/2628758846 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9278072610 0x7f9278074ad0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.243+0000 7f929e800640 1 --2- 172.21.15.103:0/2628758846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92981582c0 0x7f929814ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.243+0000 7f929e800640 1 --2- 172.21.15.103:0/2628758846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92980b5ca0 0x7f929814a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.243+0000 7f929e800640 1 --2- 172.21.15.103:0/2628758846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92980b0680 0x7f9298099430 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.243+0000 7f929e800640 1 -- 172.21.15.103:0/2628758846 >> 172.21.15.103:0/2628758846 conn(0x7f92980b4ed0 msgr2=0x7f92980740c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:33.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.243+0000 7f929e800640 1 -- 172.21.15.103:0/2628758846 shutdown_connections 2024-09-10T22:39:33.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.243+0000 7f929e800640 1 -- 172.21.15.103:0/2628758846 wait complete. 2024-09-10T22:39:33.264 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:39:33.264 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:39:33.274 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T22:39:33.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4f600640 1 -- 172.21.15.103:0/1457009872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d480cf9f0 msgr2=0x7f9d4806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:33.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4f600640 1 --2- 172.21.15.103:0/1457009872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d480cf9f0 0x7f9d4806eb80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9d38009840 tx=0x7f9d3801c820 comp rx=0 tx=0).stop 2024-09-10T22:39:33.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4f600640 1 -- 172.21.15.103:0/1457009872 shutdown_connections 2024-09-10T22:39:33.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4f600640 1 --2- 172.21.15.103:0/1457009872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d480cf9f0 0x7f9d4806eb80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4f600640 1 -- 172.21.15.103:0/1457009872 >> 172.21.15.103:0/1457009872 conn(0x7f9d4806cc00 msgr2=0x7f9d4806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:33.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4f600640 1 -- 172.21.15.103:0/1457009872 shutdown_connections 2024-09-10T22:39:33.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4f600640 1 -- 172.21.15.103:0/1457009872 wait complete. 2024-09-10T22:39:33.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4f600640 1 Processor -- start 2024-09-10T22:39:33.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4f600640 1 -- start start 2024-09-10T22:39:33.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4f600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d4806f0c0 0x7f9d48072760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:33.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4f600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d480cf9f0 0x7f9d48149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:33.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4f600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d480cfdd0 0x7f9d481487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:33.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4f600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9d48168ed0 con 0x7f9d480cfdd0 2024-09-10T22:39:33.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4f600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9d48168d50 con 0x7f9d4806f0c0 2024-09-10T22:39:33.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4f600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9d48169050 con 0x7f9d480cf9f0 2024-09-10T22:39:33.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4d600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d480cfdd0 0x7f9d481487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:33.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4d600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d480cfdd0 0x7f9d481487b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42198/0 (socket says 172.21.15.103:42198) 2024-09-10T22:39:33.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4d600640 1 -- 172.21.15.103:0/2567165552 learned_addr learned my addr 172.21.15.103:0/2567165552 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:33.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d4cc00640 1 --2- 172.21.15.103:0/2567165552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d4806f0c0 0x7f9d48072760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:33.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.415+0000 7f9d3fe00640 1 --2- 172.21.15.103:0/2567165552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d480cf9f0 0x7f9d48149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:33.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.419+0000 7f9d4d600640 1 -- 172.21.15.103:0/2567165552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d480cf9f0 msgr2=0x7f9d48149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:33.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.419+0000 7f9d4d600640 1 --2- 172.21.15.103:0/2567165552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d480cf9f0 0x7f9d48149f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.419+0000 7f9d4d600640 1 -- 172.21.15.103:0/2567165552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d4806f0c0 msgr2=0x7f9d48072760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:33.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.419+0000 7f9d4d600640 1 --2- 172.21.15.103:0/2567165552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d4806f0c0 0x7f9d48072760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.419+0000 7f9d4d600640 1 -- 172.21.15.103:0/2567165552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d48157810 con 0x7f9d480cfdd0 2024-09-10T22:39:33.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.419+0000 7f9d4cc00640 1 --2- 172.21.15.103:0/2567165552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d4806f0c0 0x7f9d48072760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:33.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.419+0000 7f9d4d600640 1 --2- 172.21.15.103:0/2567165552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d480cfdd0 0x7f9d481487b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9d4000ca70 tx=0x7f9d4000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:33.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.419+0000 7f9d45600640 1 -- 172.21.15.103:0/2567165552 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d40016020 con 0x7f9d480cfdd0 2024-09-10T22:39:33.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.419+0000 7f9d45600640 1 -- 172.21.15.103:0/2567165552 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d4000a930 con 0x7f9d480cfdd0 2024-09-10T22:39:33.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.419+0000 7f9d4f600640 1 -- 172.21.15.103:0/2567165552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d48157af0 con 0x7f9d480cfdd0 2024-09-10T22:39:33.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.419+0000 7f9d45600640 1 -- 172.21.15.103:0/2567165552 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4000ad80 con 0x7f9d480cfdd0 2024-09-10T22:39:33.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.419+0000 7f9d4f600640 1 -- 172.21.15.103:0/2567165552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d4814aa40 con 0x7f9d480cfdd0 2024-09-10T22:39:33.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.419+0000 7f9d4f600640 1 -- 172.21.15.103:0/2567165552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d4814ac40 con 0x7f9d480cfdd0 2024-09-10T22:39:33.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.419+0000 7f9d45600640 1 -- 172.21.15.103:0/2567165552 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9d4001a3b0 con 0x7f9d480cfdd0 2024-09-10T22:39:33.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.419+0000 7f9d45600640 1 --2- 172.21.15.103:0/2567165552 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9d240725e0 0x7f9d24074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:33.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.419+0000 7f9d45600640 1 -- 172.21.15.103:0/2567165552 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f9d400938a0 con 0x7f9d480cfdd0 2024-09-10T22:39:33.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.423+0000 7f9d4cc00640 1 --2- 172.21.15.103:0/2567165552 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9d240725e0 0x7f9d24074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:33.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.423+0000 7f9d4cc00640 1 --2- 172.21.15.103:0/2567165552 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9d240725e0 0x7f9d24074aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9d380af000 tx=0x7f9d3801b060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:33.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.423+0000 7f9d45600640 1 -- 172.21.15.103:0/2567165552 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9d4814ac40 con 0x7f9d480cfdd0 2024-09-10T22:39:33.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.599+0000 7f9d4f600640 1 -- 172.21.15.103:0/2567165552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9d4814a830 con 0x7f9d480cfdd0 2024-09-10T22:39:33.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.599+0000 7f9d45600640 1 -- 172.21.15.103:0/2567165552 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f9d40067070 con 0x7f9d480cfdd0 2024-09-10T22:39:33.602 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T22:39:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.603+0000 7f9d4f600640 1 -- 172.21.15.103:0/2567165552 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9d240725e0 msgr2=0x7f9d24074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.603+0000 7f9d4f600640 1 --2- 172.21.15.103:0/2567165552 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9d240725e0 0x7f9d24074aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9d380af000 tx=0x7f9d3801b060 comp rx=0 tx=0).stop 2024-09-10T22:39:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.603+0000 7f9d4f600640 1 -- 172.21.15.103:0/2567165552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d480cfdd0 msgr2=0x7f9d481487b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.603+0000 7f9d4f600640 1 --2- 172.21.15.103:0/2567165552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d480cfdd0 0x7f9d481487b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9d4000ca70 tx=0x7f9d4000cb60 comp rx=0 tx=0).stop 2024-09-10T22:39:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.603+0000 7f9d4f600640 1 -- 172.21.15.103:0/2567165552 shutdown_connections 2024-09-10T22:39:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.603+0000 7f9d4f600640 1 --2- 172.21.15.103:0/2567165552 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9d240725e0 0x7f9d24074aa0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.603+0000 7f9d4f600640 1 --2- 172.21.15.103:0/2567165552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d480cfdd0 0x7f9d481487b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.603+0000 7f9d4f600640 1 --2- 172.21.15.103:0/2567165552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d480cf9f0 0x7f9d48149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.603+0000 7f9d4f600640 1 --2- 172.21.15.103:0/2567165552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d4806f0c0 0x7f9d48072760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.603+0000 7f9d4f600640 1 -- 172.21.15.103:0/2567165552 >> 172.21.15.103:0/2567165552 conn(0x7f9d4806cc00 msgr2=0x7f9d480ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.603+0000 7f9d4f600640 1 -- 172.21.15.103:0/2567165552 shutdown_connections 2024-09-10T22:39:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.603+0000 7f9d4f600640 1 -- 172.21.15.103:0/2567165552 wait complete. 2024-09-10T22:39:33.624 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi131.front.sepia.ceph.com... 2024-09-10T22:39:33.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:33.625 DEBUG:teuthology.orchestra.run.smithi131:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-10T22:39:33.660 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:39:33.661 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-09-10T22:39:33.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:33.661 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T22:39:33.721 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:39:33.721 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:39:33.730 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:39:33.730 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:39:33.779 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T22:39:33.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.963+0000 7fae4c800640 1 -- 172.21.15.103:0/2442383262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae4415de80 msgr2=0x7fae440d0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.963+0000 7fae4c800640 1 --2- 172.21.15.103:0/2442383262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae4415de80 0x7fae440d0700 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fae38009930 tx=0x7fae3801c820 comp rx=0 tx=0).stop 2024-09-10T22:39:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.963+0000 7fae4c800640 1 -- 172.21.15.103:0/2442383262 shutdown_connections 2024-09-10T22:39:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.963+0000 7fae4c800640 1 --2- 172.21.15.103:0/2442383262 >> v2:172.21.15.131:3300/0 conn(0x7fae441624b0 0x7fae44071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.963+0000 7fae4c800640 1 --2- 172.21.15.103:0/2442383262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae4415de80 0x7fae440d0700 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.963+0000 7fae4c800640 1 -- 172.21.15.103:0/2442383262 >> 172.21.15.103:0/2442383262 conn(0x7fae440d1ad0 msgr2=0x7fae440d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.963+0000 7fae4c800640 1 -- 172.21.15.103:0/2442383262 shutdown_connections 2024-09-10T22:39:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.963+0000 7fae4c800640 1 -- 172.21.15.103:0/2442383262 wait complete. 2024-09-10T22:39:33.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.963+0000 7fae4c800640 1 Processor -- start 2024-09-10T22:39:33.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae4c800640 1 -- start start 2024-09-10T22:39:33.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae4c800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae4415de80 0x7fae44160630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:33.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae4c800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae44161960 0x7fae44160b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:33.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae4c800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae441624b0 0x7fae4414a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:33.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae4c800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae4416aca0 con 0x7fae44161960 2024-09-10T22:39:33.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae4c800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fae440724c0 con 0x7fae441624b0 2024-09-10T22:39:33.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae4c800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fae4416ae20 con 0x7fae4415de80 2024-09-10T22:39:33.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae49400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae44161960 0x7fae44160b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:33.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae49400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae44161960 0x7fae44160b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42214/0 (socket says 172.21.15.103:42214) 2024-09-10T22:39:33.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae49400640 1 -- 172.21.15.103:0/283312851 learned_addr learned my addr 172.21.15.103:0/283312851 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:33.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae49e00640 1 --2- 172.21.15.103:0/283312851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae4415de80 0x7fae44160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:33.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae4a800640 1 --2- 172.21.15.103:0/283312851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae441624b0 0x7fae4414a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:33.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae49400640 1 -- 172.21.15.103:0/283312851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae4415de80 msgr2=0x7fae44160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:33.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae49400640 1 --2- 172.21.15.103:0/283312851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae4415de80 0x7fae44160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae49400640 1 -- 172.21.15.103:0/283312851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae441624b0 msgr2=0x7fae4414a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:33.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae49400640 1 --2- 172.21.15.103:0/283312851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae441624b0 0x7fae4414a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:33.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae49400640 1 -- 172.21.15.103:0/283312851 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4409bb10 con 0x7fae44161960 2024-09-10T22:39:33.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae49400640 1 --2- 172.21.15.103:0/283312851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae44161960 0x7fae44160b70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fae3400c400 tx=0x7fae3400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:33.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae3e000640 1 -- 172.21.15.103:0/283312851 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae34017070 con 0x7fae44161960 2024-09-10T22:39:33.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae4c800640 1 -- 172.21.15.103:0/283312851 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae4409bdf0 con 0x7fae44161960 2024-09-10T22:39:33.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae3e000640 1 -- 172.21.15.103:0/283312851 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae340053e0 con 0x7fae44161960 2024-09-10T22:39:33.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae3e000640 1 -- 172.21.15.103:0/283312851 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae34003860 con 0x7fae44161960 2024-09-10T22:39:33.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae4c800640 1 -- 172.21.15.103:0/283312851 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae4409c3b0 con 0x7fae44161960 2024-09-10T22:39:33.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.967+0000 7fae4c800640 1 -- 172.21.15.103:0/283312851 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae440d0700 con 0x7fae44161960 2024-09-10T22:39:33.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.971+0000 7fae3e000640 1 -- 172.21.15.103:0/283312851 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fae34003a00 con 0x7fae44161960 2024-09-10T22:39:33.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.971+0000 7fae3e000640 1 --2- 172.21.15.103:0/283312851 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fae280725e0 0x7fae28074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:33.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.971+0000 7fae3e000640 1 -- 172.21.15.103:0/283312851 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fae34092df0 con 0x7fae44161960 2024-09-10T22:39:33.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.971+0000 7fae49e00640 1 --2- 172.21.15.103:0/283312851 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fae280725e0 0x7fae28074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:33.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.971+0000 7fae49e00640 1 --2- 172.21.15.103:0/283312851 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fae280725e0 0x7fae28074aa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fae380af000 tx=0x7fae380a7040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:33.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:33.975+0000 7fae3e000640 1 -- 172.21.15.103:0/283312851 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fae34001130 con 0x7fae44161960 2024-09-10T22:39:34.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.151+0000 7fae4c800640 1 -- 172.21.15.103:0/283312851 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fae4406d980 con 0x7fae44161960 2024-09-10T22:39:34.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.155+0000 7fae3e000640 1 -- 172.21.15.103:0/283312851 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fae3405d960 con 0x7fae44161960 2024-09-10T22:39:34.156 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T22:39:34.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.155+0000 7fae4c800640 1 -- 172.21.15.103:0/283312851 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fae280725e0 msgr2=0x7fae28074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:34.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.155+0000 7fae4c800640 1 --2- 172.21.15.103:0/283312851 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fae280725e0 0x7fae28074aa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fae380af000 tx=0x7fae380a7040 comp rx=0 tx=0).stop 2024-09-10T22:39:34.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.155+0000 7fae4c800640 1 -- 172.21.15.103:0/283312851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae44161960 msgr2=0x7fae44160b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:34.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.155+0000 7fae4c800640 1 --2- 172.21.15.103:0/283312851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae44161960 0x7fae44160b70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fae3400c400 tx=0x7fae3400c8c0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.155+0000 7fae4c800640 1 -- 172.21.15.103:0/283312851 shutdown_connections 2024-09-10T22:39:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.155+0000 7fae4c800640 1 --2- 172.21.15.103:0/283312851 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fae280725e0 0x7fae28074aa0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.155+0000 7fae4c800640 1 --2- 172.21.15.103:0/283312851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae441624b0 0x7fae4414a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.155+0000 7fae4c800640 1 --2- 172.21.15.103:0/283312851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae44161960 0x7fae44160b70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.155+0000 7fae4c800640 1 --2- 172.21.15.103:0/283312851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae4415de80 0x7fae44160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.155+0000 7fae4c800640 1 -- 172.21.15.103:0/283312851 >> 172.21.15.103:0/283312851 conn(0x7fae440d1ad0 msgr2=0x7fae440b6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.155+0000 7fae4c800640 1 -- 172.21.15.103:0/283312851 shutdown_connections 2024-09-10T22:39:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.155+0000 7fae4c800640 1 -- 172.21.15.103:0/283312851 wait complete. 2024-09-10T22:39:34.177 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:39:34.177 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:39:34.186 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T22:39:34.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.371+0000 7f6afa200640 1 -- 172.21.15.103:0/4059422737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6af40b3150 msgr2=0x7f6af4072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:34.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.371+0000 7f6afa200640 1 --2- 172.21.15.103:0/4059422737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6af40b3150 0x7f6af4072500 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6af40d0150 tx=0x7f6adc01dbf0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.371+0000 7f6afa200640 1 -- 172.21.15.103:0/4059422737 shutdown_connections 2024-09-10T22:39:34.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.371+0000 7f6afa200640 1 --2- 172.21.15.103:0/4059422737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6af40b3150 0x7f6af4072500 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.371+0000 7f6afa200640 1 --2- 172.21.15.103:0/4059422737 >> v2:172.21.15.131:3300/0 conn(0x7f6af40cf260 0x7f6af40b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.371+0000 7f6afa200640 1 -- 172.21.15.103:0/4059422737 >> 172.21.15.103:0/4059422737 conn(0x7f6af406cc00 msgr2=0x7f6af406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.371+0000 7f6afa200640 1 -- 172.21.15.103:0/4059422737 shutdown_connections 2024-09-10T22:39:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.371+0000 7f6afa200640 1 -- 172.21.15.103:0/4059422737 wait complete. 2024-09-10T22:39:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.371+0000 7f6afa200640 1 Processor -- start 2024-09-10T22:39:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.371+0000 7f6afa200640 1 -- start start 2024-09-10T22:39:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6afa200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6af4072a40 0x7f6af415c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6afa200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6af40b3150 0x7f6af40b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6afa200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6af40cf260 0x7f6af41400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6afa200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6af406e7e0 con 0x7f6af40cf260 2024-09-10T22:39:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6afa200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6af4157e20 con 0x7f6af4072a40 2024-09-10T22:39:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6afa200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6af406e960 con 0x7f6af40b3150 2024-09-10T22:39:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6af3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6af40cf260 0x7f6af41400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6af3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6af40cf260 0x7f6af41400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42228/0 (socket says 172.21.15.103:42228) 2024-09-10T22:39:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6af3e00640 1 -- 172.21.15.103:0/2301857774 learned_addr learned my addr 172.21.15.103:0/2301857774 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6af3400640 1 --2- 172.21.15.103:0/2301857774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6af4072a40 0x7f6af415c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6aebe00640 1 --2- 172.21.15.103:0/2301857774 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6af40b3150 0x7f6af40b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6af3e00640 1 -- 172.21.15.103:0/2301857774 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6af40b3150 msgr2=0x7f6af40b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6af3e00640 1 --2- 172.21.15.103:0/2301857774 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6af40b3150 0x7f6af40b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6af3e00640 1 -- 172.21.15.103:0/2301857774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6af4072a40 msgr2=0x7f6af415c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6af3e00640 1 --2- 172.21.15.103:0/2301857774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6af4072a40 0x7f6af415c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6af3e00640 1 -- 172.21.15.103:0/2301857774 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af414f9f0 con 0x7f6af40cf260 2024-09-10T22:39:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6af3e00640 1 --2- 172.21.15.103:0/2301857774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6af40cf260 0x7f6af41400f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00c730 tx=0x7f6aec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6aeb400640 1 -- 172.21.15.103:0/2301857774 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec003db0 con 0x7f6af40cf260 2024-09-10T22:39:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6aeb400640 1 -- 172.21.15.103:0/2301857774 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6aec00ce40 con 0x7f6af40cf260 2024-09-10T22:39:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6afa200640 1 -- 172.21.15.103:0/2301857774 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6af40b0890 con 0x7f6af40cf260 2024-09-10T22:39:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6aeb400640 1 -- 172.21.15.103:0/2301857774 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec0052d0 con 0x7f6af40cf260 2024-09-10T22:39:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6afa200640 1 -- 172.21.15.103:0/2301857774 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6af40b0e50 con 0x7f6af40cf260 2024-09-10T22:39:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.375+0000 7f6afa200640 1 -- 172.21.15.103:0/2301857774 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6af4072500 con 0x7f6af40cf260 2024-09-10T22:39:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.379+0000 7f6aeb400640 1 -- 172.21.15.103:0/2301857774 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6aec005470 con 0x7f6af40cf260 2024-09-10T22:39:34.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.379+0000 7f6aeb400640 1 --2- 172.21.15.103:0/2301857774 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6ad0072610 0x7f6ad0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:34.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.379+0000 7f6aeb400640 1 -- 172.21.15.103:0/2301857774 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f6aec0932b0 con 0x7f6af40cf260 2024-09-10T22:39:34.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.379+0000 7f6af3400640 1 --2- 172.21.15.103:0/2301857774 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6ad0072610 0x7f6ad0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:34.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.379+0000 7f6af3400640 1 --2- 172.21.15.103:0/2301857774 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6ad0072610 0x7f6ad0074ad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009b40 tx=0x7f6ae40091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:34.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.383+0000 7f6aeb400640 1 -- 172.21.15.103:0/2301857774 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6aec05df30 con 0x7f6af40cf260 2024-09-10T22:39:34.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.555+0000 7f6afa200640 1 -- 172.21.15.103:0/2301857774 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6af40b1e70 con 0x7f6af40cf260 2024-09-10T22:39:34.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.555+0000 7f6aeb400640 1 -- 172.21.15.103:0/2301857774 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f6aec062960 con 0x7f6af40cf260 2024-09-10T22:39:34.559 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T22:39:34.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.559+0000 7f6afa200640 1 -- 172.21.15.103:0/2301857774 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6ad0072610 msgr2=0x7f6ad0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:34.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.559+0000 7f6afa200640 1 --2- 172.21.15.103:0/2301857774 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6ad0072610 0x7f6ad0074ad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009b40 tx=0x7f6ae40091e0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.559+0000 7f6afa200640 1 -- 172.21.15.103:0/2301857774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6af40cf260 msgr2=0x7f6af41400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:34.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.559+0000 7f6afa200640 1 --2- 172.21.15.103:0/2301857774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6af40cf260 0x7f6af41400f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00c730 tx=0x7f6aec00cbf0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.559+0000 7f6afa200640 1 -- 172.21.15.103:0/2301857774 shutdown_connections 2024-09-10T22:39:34.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.559+0000 7f6afa200640 1 --2- 172.21.15.103:0/2301857774 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6ad0072610 0x7f6ad0074ad0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.559+0000 7f6afa200640 1 --2- 172.21.15.103:0/2301857774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6af40cf260 0x7f6af41400f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.559+0000 7f6afa200640 1 --2- 172.21.15.103:0/2301857774 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6af40b3150 0x7f6af40b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.559+0000 7f6afa200640 1 --2- 172.21.15.103:0/2301857774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6af4072a40 0x7f6af415c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.559+0000 7f6afa200640 1 -- 172.21.15.103:0/2301857774 >> 172.21.15.103:0/2301857774 conn(0x7f6af406cc00 msgr2=0x7f6af41514f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:34.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.559+0000 7f6afa200640 1 -- 172.21.15.103:0/2301857774 shutdown_connections 2024-09-10T22:39:34.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.559+0000 7f6afa200640 1 -- 172.21.15.103:0/2301857774 wait complete. 2024-09-10T22:39:34.580 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-09-10T22:39:34.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:34.581 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-10T22:39:34.600 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:39:34.601 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:39:34.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:34.601 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-10T22:39:34.652 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:39:34.652 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:39:34.662 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:39:34.662 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:39:34.711 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T22:39:34.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3062800640 1 -- 172.21.15.103:0/4211085974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f305c0cc120 msgr2=0x7f305c0aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:34.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3062800640 1 --2- 172.21.15.103:0/4211085974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f305c0cc120 0x7f305c0aeb40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f305c0d0870 tx=0x7f304c01ccf0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3062800640 1 -- 172.21.15.103:0/4211085974 shutdown_connections 2024-09-10T22:39:34.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3062800640 1 --2- 172.21.15.103:0/4211085974 >> v2:172.21.15.131:3300/0 conn(0x7f305c0cf790 0x7f305c0cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3062800640 1 --2- 172.21.15.103:0/4211085974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f305c0cc120 0x7f305c0aeb40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3062800640 1 -- 172.21.15.103:0/4211085974 >> 172.21.15.103:0/4211085974 conn(0x7f305c06cc00 msgr2=0x7f305c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:34.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3062800640 1 -- 172.21.15.103:0/4211085974 shutdown_connections 2024-09-10T22:39:34.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3062800640 1 -- 172.21.15.103:0/4211085974 wait complete. 2024-09-10T22:39:34.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3062800640 1 Processor -- start 2024-09-10T22:39:34.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3062800640 1 -- start start 2024-09-10T22:39:34.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3062800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f305c0cc120 0x7f305c161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:34.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3062800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f305c0cf790 0x7f305c1f94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:34.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3062800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f305c15c970 0x7f305c142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:34.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3062800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f305c168b40 con 0x7f305c0cf790 2024-09-10T22:39:34.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3062800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f305c1689c0 con 0x7f305c15c970 2024-09-10T22:39:34.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3062800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f305c168cc0 con 0x7f305c0cc120 2024-09-10T22:39:34.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3052a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f305c0cf790 0x7f305c1f94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:34.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3052a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f305c0cf790 0x7f305c1f94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42260/0 (socket says 172.21.15.103:42260) 2024-09-10T22:39:34.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f3052a00640 1 -- 172.21.15.103:0/27217750 learned_addr learned my addr 172.21.15.103:0/27217750 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:34.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f305be00640 1 --2- 172.21.15.103:0/27217750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f305c15c970 0x7f305c142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.851+0000 7f305b400640 1 --2- 172.21.15.103:0/27217750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f305c0cc120 0x7f305c161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.855+0000 7f3052a00640 1 -- 172.21.15.103:0/27217750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f305c0cc120 msgr2=0x7f305c161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.855+0000 7f3052a00640 1 --2- 172.21.15.103:0/27217750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f305c0cc120 0x7f305c161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.855+0000 7f3052a00640 1 -- 172.21.15.103:0/27217750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f305c15c970 msgr2=0x7f305c142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.855+0000 7f3052a00640 1 --2- 172.21.15.103:0/27217750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f305c15c970 0x7f305c142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.855+0000 7f3052a00640 1 -- 172.21.15.103:0/27217750 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305c157670 con 0x7f305c0cf790 2024-09-10T22:39:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.855+0000 7f305be00640 1 --2- 172.21.15.103:0/27217750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f305c15c970 0x7f305c142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.855+0000 7f3052a00640 1 --2- 172.21.15.103:0/27217750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f305c0cf790 0x7f305c1f94b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f304400c3f0 tx=0x7f304400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.855+0000 7f3053e00640 1 -- 172.21.15.103:0/27217750 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3044017070 con 0x7f305c0cf790 2024-09-10T22:39:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.855+0000 7f3053e00640 1 -- 172.21.15.103:0/27217750 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30440053c0 con 0x7f305c0cf790 2024-09-10T22:39:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.855+0000 7f3062800640 1 -- 172.21.15.103:0/27217750 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f305c161d30 con 0x7f305c0cf790 2024-09-10T22:39:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.855+0000 7f3053e00640 1 -- 172.21.15.103:0/27217750 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3044003860 con 0x7f305c0cf790 2024-09-10T22:39:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.855+0000 7f3062800640 1 -- 172.21.15.103:0/27217750 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f305c1622f0 con 0x7f305c0cf790 2024-09-10T22:39:34.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.855+0000 7f3062800640 1 -- 172.21.15.103:0/27217750 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f305c0cfc20 con 0x7f305c0cf790 2024-09-10T22:39:34.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.855+0000 7f3053e00640 1 -- 172.21.15.103:0/27217750 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3044003a00 con 0x7f305c0cf790 2024-09-10T22:39:34.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.855+0000 7f3053e00640 1 --2- 172.21.15.103:0/27217750 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f30380725e0 0x7f3038074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:34.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.855+0000 7f3053e00640 1 -- 172.21.15.103:0/27217750 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f3044092cc0 con 0x7f305c0cf790 2024-09-10T22:39:34.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.859+0000 7f305b400640 1 --2- 172.21.15.103:0/27217750 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f30380725e0 0x7f3038074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:34.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.859+0000 7f305b400640 1 --2- 172.21.15.103:0/27217750 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f30380725e0 0x7f3038074aa0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f304c0af000 tx=0x7f304c01b530 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:34.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:34.859+0000 7f3053e00640 1 -- 172.21.15.103:0/27217750 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3044099080 con 0x7f305c0cf790 2024-09-10T22:39:35.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.035+0000 7f3062800640 1 -- 172.21.15.103:0/27217750 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f305c068e80 con 0x7f305c0cf790 2024-09-10T22:39:35.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.035+0000 7f3053e00640 1 -- 172.21.15.103:0/27217750 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f304405df00 con 0x7f305c0cf790 2024-09-10T22:39:35.040 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T22:39:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.039+0000 7f3062800640 1 -- 172.21.15.103:0/27217750 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f30380725e0 msgr2=0x7f3038074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.039+0000 7f3062800640 1 --2- 172.21.15.103:0/27217750 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f30380725e0 0x7f3038074aa0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f304c0af000 tx=0x7f304c01b530 comp rx=0 tx=0).stop 2024-09-10T22:39:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.039+0000 7f3062800640 1 -- 172.21.15.103:0/27217750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f305c0cf790 msgr2=0x7f305c1f94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.039+0000 7f3062800640 1 --2- 172.21.15.103:0/27217750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f305c0cf790 0x7f305c1f94b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f304400c3f0 tx=0x7f304400c8b0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.039+0000 7f3062800640 1 -- 172.21.15.103:0/27217750 shutdown_connections 2024-09-10T22:39:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.039+0000 7f3062800640 1 --2- 172.21.15.103:0/27217750 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f30380725e0 0x7f3038074aa0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.039+0000 7f3062800640 1 --2- 172.21.15.103:0/27217750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f305c15c970 0x7f305c142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.039+0000 7f3062800640 1 --2- 172.21.15.103:0/27217750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f305c0cf790 0x7f305c1f94b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.039+0000 7f3062800640 1 --2- 172.21.15.103:0/27217750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f305c0cc120 0x7f305c161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.039+0000 7f3062800640 1 -- 172.21.15.103:0/27217750 >> 172.21.15.103:0/27217750 conn(0x7f305c06cc00 msgr2=0x7f305c0b1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:35.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.039+0000 7f3062800640 1 -- 172.21.15.103:0/27217750 shutdown_connections 2024-09-10T22:39:35.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.039+0000 7f3062800640 1 -- 172.21.15.103:0/27217750 wait complete. 2024-09-10T22:39:35.062 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:39:35.062 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:39:35.071 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T22:39:35.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.211+0000 7f42fa200640 1 -- 172.21.15.103:0/3705353267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42d8004d50 msgr2=0x7f42d80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:35.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.211+0000 7f42fa200640 1 --2- 172.21.15.103:0/3705353267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42d8004d50 0x7f42d80051d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c2e0 tx=0x7f42ec01f720 comp rx=0 tx=0).stop 2024-09-10T22:39:35.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.211+0000 7f42f3e00640 1 -- 172.21.15.103:0/3705353267 reap_dead start 2024-09-10T22:39:35.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.211+0000 7f42fa200640 1 -- 172.21.15.103:0/3705353267 shutdown_connections 2024-09-10T22:39:35.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.211+0000 7f42fa200640 1 -- 172.21.15.103:0/3705353267 >> 172.21.15.103:0/3705353267 conn(0x7f42f406cc00 msgr2=0x7f42f406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:35.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.211+0000 7f42fa200640 1 -- 172.21.15.103:0/3705353267 shutdown_connections 2024-09-10T22:39:35.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.211+0000 7f42fa200640 1 -- 172.21.15.103:0/3705353267 wait complete. 2024-09-10T22:39:35.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.211+0000 7f42fa200640 1 Processor -- start 2024-09-10T22:39:35.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.211+0000 7f42fa200640 1 -- start start 2024-09-10T22:39:35.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42fa200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42d8004d50 0x7f42f4150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:35.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42fa200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42f41e7e90 0x7f42f4153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42fa200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42f41e8310 0x7f42f4153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42fa200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f42f40cfda0 con 0x7f42f41e7e90 2024-09-10T22:39:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42fa200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f42f40cfc20 con 0x7f42d8004d50 2024-09-10T22:39:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42fa200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f42f40cff20 con 0x7f42f41e8310 2024-09-10T22:39:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42eaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42f41e7e90 0x7f42f4153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42eaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42f41e7e90 0x7f42f4153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42278/0 (socket says 172.21.15.103:42278) 2024-09-10T22:39:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42eaa00640 1 -- 172.21.15.103:0/3659821714 learned_addr learned my addr 172.21.15.103:0/3659821714 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42eaa00640 1 -- 172.21.15.103:0/3659821714 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42f41e8310 msgr2=0x7f42f4153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42eaa00640 1 --2- 172.21.15.103:0/3659821714 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42f41e8310 0x7f42f4153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42eaa00640 1 -- 172.21.15.103:0/3659821714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42d8004d50 msgr2=0x7f42f4150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42f3400640 1 --2- 172.21.15.103:0/3659821714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42d8004d50 0x7f42f4150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:35.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42eaa00640 1 --2- 172.21.15.103:0/3659821714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42d8004d50 0x7f42f4150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42eaa00640 1 -- 172.21.15.103:0/3659821714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f41f44d0 con 0x7f42f41e7e90 2024-09-10T22:39:35.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42f3400640 1 --2- 172.21.15.103:0/3659821714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42d8004d50 0x7f42f4150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:39:35.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42eaa00640 1 --2- 172.21.15.103:0/3659821714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42f41e7e90 0x7f42f4153110 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f42dc003f10 tx=0x7f42dc00b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:35.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42ebe00640 1 -- 172.21.15.103:0/3659821714 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42dc005220 con 0x7f42f41e7e90 2024-09-10T22:39:35.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42ebe00640 1 -- 172.21.15.103:0/3659821714 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42dc0053c0 con 0x7f42f41e7e90 2024-09-10T22:39:35.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42ebe00640 1 -- 172.21.15.103:0/3659821714 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42dc0047b0 con 0x7f42f41e7e90 2024-09-10T22:39:35.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42fa200640 1 -- 172.21.15.103:0/3659821714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f41f4750 con 0x7f42f41e7e90 2024-09-10T22:39:35.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42fa200640 1 -- 172.21.15.103:0/3659821714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f41f4d10 con 0x7f42f41e7e90 2024-09-10T22:39:35.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42fa200640 1 -- 172.21.15.103:0/3659821714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f40b46a0 con 0x7f42f41e7e90 2024-09-10T22:39:35.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.215+0000 7f42ebe00640 1 -- 172.21.15.103:0/3659821714 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f42dc004970 con 0x7f42f41e7e90 2024-09-10T22:39:35.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.219+0000 7f42ebe00640 1 --2- 172.21.15.103:0/3659821714 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f42d0072610 0x7f42d0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:35.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.219+0000 7f42ebe00640 1 -- 172.21.15.103:0/3659821714 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f42dc094060 con 0x7f42f41e7e90 2024-09-10T22:39:35.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.219+0000 7f42f3400640 1 --2- 172.21.15.103:0/3659821714 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f42d0072610 0x7f42d0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:35.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.219+0000 7f42f3400640 1 --2- 172.21.15.103:0/3659821714 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f42d0072610 0x7f42d0074ad0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42f4154fb0 tx=0x7f42e4006f00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.223+0000 7f42ebe00640 1 -- 172.21.15.103:0/3659821714 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f42f41f44d0 con 0x7f42f41e7e90 2024-09-10T22:39:35.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.395+0000 7f42fa200640 1 -- 172.21.15.103:0/3659821714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f42f40b2c20 con 0x7f42f41e7e90 2024-09-10T22:39:35.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.399+0000 7f42ebe00640 1 -- 172.21.15.103:0/3659821714 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f42dc05f330 con 0x7f42f41e7e90 2024-09-10T22:39:35.400 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T22:39:35.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.399+0000 7f42fa200640 1 -- 172.21.15.103:0/3659821714 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f42d0072610 msgr2=0x7f42d0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:35.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.399+0000 7f42fa200640 1 --2- 172.21.15.103:0/3659821714 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f42d0072610 0x7f42d0074ad0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42f4154fb0 tx=0x7f42e4006f00 comp rx=0 tx=0).stop 2024-09-10T22:39:35.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.399+0000 7f42fa200640 1 -- 172.21.15.103:0/3659821714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42f41e7e90 msgr2=0x7f42f4153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:35.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.399+0000 7f42fa200640 1 --2- 172.21.15.103:0/3659821714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42f41e7e90 0x7f42f4153110 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f42dc003f10 tx=0x7f42dc00b9c0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.399+0000 7f42fa200640 1 -- 172.21.15.103:0/3659821714 shutdown_connections 2024-09-10T22:39:35.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.399+0000 7f42fa200640 1 --2- 172.21.15.103:0/3659821714 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f42d0072610 0x7f42d0074ad0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.399+0000 7f42fa200640 1 --2- 172.21.15.103:0/3659821714 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42f41e8310 0x7f42f4153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.399+0000 7f42fa200640 1 --2- 172.21.15.103:0/3659821714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42f41e7e90 0x7f42f4153110 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.399+0000 7f42fa200640 1 --2- 172.21.15.103:0/3659821714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42d8004d50 0x7f42f4150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.399+0000 7f42fa200640 1 -- 172.21.15.103:0/3659821714 >> 172.21.15.103:0/3659821714 conn(0x7f42f406cc00 msgr2=0x7f42f4068990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:35.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.399+0000 7f42fa200640 1 -- 172.21.15.103:0/3659821714 shutdown_connections 2024-09-10T22:39:35.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.399+0000 7f42fa200640 1 -- 172.21.15.103:0/3659821714 wait complete. 2024-09-10T22:39:35.421 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi131.front.sepia.ceph.com... 2024-09-10T22:39:35.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:35.421 DEBUG:teuthology.orchestra.run.smithi131:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-10T22:39:35.443 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:39:35.443 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-09-10T22:39:35.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:39:35.443 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-10T22:39:35.496 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T22:39:35.496 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:39:35.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.635+0000 7fc6f6000640 1 -- 172.21.15.103:0/3496966586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f015b640 msgr2=0x7fc6f00cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:35.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.635+0000 7fc6f6000640 1 --2- 172.21.15.103:0/3496966586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f015b640 0x7fc6f00cf480 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0075280 tx=0x7fc6e401c770 comp rx=0 tx=0).stop 2024-09-10T22:39:35.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.635+0000 7fc6f6000640 1 -- 172.21.15.103:0/3496966586 shutdown_connections 2024-09-10T22:39:35.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.635+0000 7fc6f6000640 1 --2- 172.21.15.103:0/3496966586 >> v2:172.21.15.131:3300/0 conn(0x7fc6f00d1640 0x7fc6f00d1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.635+0000 7fc6f6000640 1 --2- 172.21.15.103:0/3496966586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f015b640 0x7fc6f00cf480 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.635+0000 7fc6f6000640 1 -- 172.21.15.103:0/3496966586 >> 172.21.15.103:0/3496966586 conn(0x7fc6f009a9f0 msgr2=0x7fc6f009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:35.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.635+0000 7fc6f6000640 1 -- 172.21.15.103:0/3496966586 shutdown_connections 2024-09-10T22:39:35.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.635+0000 7fc6f6000640 1 -- 172.21.15.103:0/3496966586 wait complete. 2024-09-10T22:39:35.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.635+0000 7fc6f6000640 1 Processor -- start 2024-09-10T22:39:35.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.635+0000 7fc6f6000640 1 -- start start 2024-09-10T22:39:35.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f6000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6f00d1640 0x7fc6f0153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:35.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f6000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6f015b640 0x7fc6f00c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:35.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f6000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f015ba20 0x7fc6f014ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:35.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f6000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f01683f0 con 0x7fc6f015ba20 2024-09-10T22:39:35.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f6000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f00ccc40 con 0x7fc6f015b640 2024-09-10T22:39:35.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f6000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f0168570 con 0x7fc6f00d1640 2024-09-10T22:39:35.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f015ba20 0x7fc6f014ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:35.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f015ba20 0x7fc6f014ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42306/0 (socket says 172.21.15.103:42306) 2024-09-10T22:39:35.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f5600640 1 -- 172.21.15.103:0/3453447543 learned_addr learned my addr 172.21.15.103:0/3453447543 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:35.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f4c00640 1 --2- 172.21.15.103:0/3453447543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6f00d1640 0x7fc6f0153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:35.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6efe00640 1 --2- 172.21.15.103:0/3453447543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6f015b640 0x7fc6f00c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:35.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f5600640 1 -- 172.21.15.103:0/3453447543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6f00d1640 msgr2=0x7fc6f0153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:35.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f5600640 1 --2- 172.21.15.103:0/3453447543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6f00d1640 0x7fc6f0153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f5600640 1 -- 172.21.15.103:0/3453447543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6f015b640 msgr2=0x7fc6f00c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:35.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f5600640 1 --2- 172.21.15.103:0/3453447543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6f015b640 0x7fc6f00c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f5600640 1 -- 172.21.15.103:0/3453447543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f014b260 con 0x7fc6f015ba20 2024-09-10T22:39:35.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6efe00640 1 --2- 172.21.15.103:0/3453447543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6f015b640 0x7fc6f00c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:35.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f5600640 1 --2- 172.21.15.103:0/3453447543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f015ba20 0x7fc6f014ad20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800b9a0 tx=0x7fc6e800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:35.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6ecc00640 1 -- 172.21.15.103:0/3453447543 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8019070 con 0x7fc6f015ba20 2024-09-10T22:39:35.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6ecc00640 1 -- 172.21.15.103:0/3453447543 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6e800ccb0 con 0x7fc6f015ba20 2024-09-10T22:39:35.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f6000640 1 -- 172.21.15.103:0/3453447543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f00c5b50 con 0x7fc6f015ba20 2024-09-10T22:39:35.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6ecc00640 1 -- 172.21.15.103:0/3453447543 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e80146a0 con 0x7fc6f015ba20 2024-09-10T22:39:35.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f6000640 1 -- 172.21.15.103:0/3453447543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f00c6110 con 0x7fc6f015ba20 2024-09-10T22:39:35.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6f6000640 1 -- 172.21.15.103:0/3453447543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f00d1a20 con 0x7fc6f015ba20 2024-09-10T22:39:35.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.639+0000 7fc6ecc00640 1 -- 172.21.15.103:0/3453447543 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc6e801d3b0 con 0x7fc6f015ba20 2024-09-10T22:39:35.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.643+0000 7fc6ecc00640 1 --2- 172.21.15.103:0/3453447543 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc6d00725e0 0x7fc6d0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:35.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.643+0000 7fc6ecc00640 1 -- 172.21.15.103:0/3453447543 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fc6e8093670 con 0x7fc6f015ba20 2024-09-10T22:39:35.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.643+0000 7fc6f4c00640 1 --2- 172.21.15.103:0/3453447543 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc6d00725e0 0x7fc6d0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:35.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.643+0000 7fc6f4c00640 1 --2- 172.21.15.103:0/3453447543 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc6d00725e0 0x7fc6d0074aa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40af000 tx=0x7fc6e401afb0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.647+0000 7fc6ecc00640 1 -- 172.21.15.103:0/3453447543 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc6e805e260 con 0x7fc6f015ba20 2024-09-10T22:39:35.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.847+0000 7fc6f6000640 1 -- 172.21.15.103:0/3453447543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6f006e090 con 0x7fc6f015ba20 2024-09-10T22:39:35.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.847+0000 7fc6ecc00640 1 -- 172.21.15.103:0/3453447543 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7fc6e8063e20 con 0x7fc6f015ba20 2024-09-10T22:39:35.852 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:35.852 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-09-10T22:39:09:926600+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/467299119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":467299119},{"type":"v1","addr":"172.21.15.103:6834","nonce":467299119}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3161095873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3161095873},{"type":"v1","addr":"172.21.15.131:6837","nonce":3161095873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/774650981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":774650981},{"type":"v1","addr":"172.21.15.103:6835","nonce":774650981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:38:49.214867+0000","modified":"2024-09-10T22:39:09.303311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6836/2821479330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2821479330},{"type":"v1","addr":"172.21.15.131:6836","nonce":2821479330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4390,"qdb_cluster":[4390]},"id":1}]} 2024-09-10T22:39:35.852 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-09-10T22:39:35.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.851+0000 7fc6f6000640 1 -- 172.21.15.103:0/3453447543 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc6d00725e0 msgr2=0x7fc6d0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:35.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.851+0000 7fc6f6000640 1 --2- 172.21.15.103:0/3453447543 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc6d00725e0 0x7fc6d0074aa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40af000 tx=0x7fc6e401afb0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.851+0000 7fc6f6000640 1 -- 172.21.15.103:0/3453447543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f015ba20 msgr2=0x7fc6f014ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:35.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.851+0000 7fc6f6000640 1 --2- 172.21.15.103:0/3453447543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f015ba20 0x7fc6f014ad20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800b9a0 tx=0x7fc6e800be60 comp rx=0 tx=0).stop 2024-09-10T22:39:35.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.851+0000 7fc6f6000640 1 -- 172.21.15.103:0/3453447543 shutdown_connections 2024-09-10T22:39:35.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.851+0000 7fc6f6000640 1 --2- 172.21.15.103:0/3453447543 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc6d00725e0 0x7fc6d0074aa0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.851+0000 7fc6f6000640 1 --2- 172.21.15.103:0/3453447543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f015ba20 0x7fc6f014ad20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.851+0000 7fc6f6000640 1 --2- 172.21.15.103:0/3453447543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6f015b640 0x7fc6f00c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.851+0000 7fc6f6000640 1 --2- 172.21.15.103:0/3453447543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6f00d1640 0x7fc6f0153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:35.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.851+0000 7fc6f6000640 1 -- 172.21.15.103:0/3453447543 >> 172.21.15.103:0/3453447543 conn(0x7fc6f009a9f0 msgr2=0x7fc6f0159a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:35.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.851+0000 7fc6f6000640 1 -- 172.21.15.103:0/3453447543 shutdown_connections 2024-09-10T22:39:35.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:35.851+0000 7fc6f6000640 1 -- 172.21.15.103:0/3453447543 wait complete. 2024-09-10T22:39:35.873 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:39:36.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.011+0000 7fa9e1e00640 1 -- 172.21.15.103:0/3509415149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9dc15f330 msgr2=0x7fa9dc0cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:36.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.011+0000 7fa9e1e00640 1 --2- 172.21.15.103:0/3509415149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9dc15f330 0x7fa9dc0cfbc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009900 tx=0x7fa9cc01c850 comp rx=0 tx=0).stop 2024-09-10T22:39:36.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.011+0000 7fa9e1e00640 1 -- 172.21.15.103:0/3509415149 shutdown_connections 2024-09-10T22:39:36.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.011+0000 7fa9e1e00640 1 --2- 172.21.15.103:0/3509415149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9dc0b2840 0x7fa9dc0d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.011+0000 7fa9e1e00640 1 --2- 172.21.15.103:0/3509415149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9dc15f330 0x7fa9dc0cfbc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.011+0000 7fa9e1e00640 1 -- 172.21.15.103:0/3509415149 >> 172.21.15.103:0/3509415149 conn(0x7fa9dc0d1ab0 msgr2=0x7fa9dc0d1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:36.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.011+0000 7fa9e1e00640 1 -- 172.21.15.103:0/3509415149 shutdown_connections 2024-09-10T22:39:36.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.011+0000 7fa9e1e00640 1 -- 172.21.15.103:0/3509415149 wait complete. 2024-09-10T22:39:36.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.011+0000 7fa9e1e00640 1 Processor -- start 2024-09-10T22:39:36.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.011+0000 7fa9e1e00640 1 -- start start 2024-09-10T22:39:36.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9e1e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9dc0b2840 0x7fa9dc159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:36.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9e1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9dc0d0640 0x7fa9dc156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:36.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9e1e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9dc15f330 0x7fa9dc0c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:36.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9e1e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc1690d0 con 0x7fa9dc0d0640 2024-09-10T22:39:36.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9e1e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc168f50 con 0x7fa9dc0b2840 2024-09-10T22:39:36.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9e1e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa9dc169250 con 0x7fa9dc15f330 2024-09-10T22:39:36.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9d3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9dc0d0640 0x7fa9dc156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:36.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9d3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9dc0d0640 0x7fa9dc156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42310/0 (socket says 172.21.15.103:42310) 2024-09-10T22:39:36.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9d3e00640 1 -- 172.21.15.103:0/711746869 learned_addr learned my addr 172.21.15.103:0/711746869 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:36.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9daa00640 1 --2- 172.21.15.103:0/711746869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9dc0b2840 0x7fa9dc159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:36.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9db400640 1 --2- 172.21.15.103:0/711746869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9dc15f330 0x7fa9dc0c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:36.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9d3e00640 1 -- 172.21.15.103:0/711746869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9dc15f330 msgr2=0x7fa9dc0c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:36.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9d3e00640 1 --2- 172.21.15.103:0/711746869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9dc15f330 0x7fa9dc0c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9d3e00640 1 -- 172.21.15.103:0/711746869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9dc0b2840 msgr2=0x7fa9dc159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:36.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9d3e00640 1 --2- 172.21.15.103:0/711746869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9dc0b2840 0x7fa9dc159590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9d3e00640 1 -- 172.21.15.103:0/711746869 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9dc1f5c40 con 0x7fa9dc0d0640 2024-09-10T22:39:36.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9db400640 1 --2- 172.21.15.103:0/711746869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9dc15f330 0x7fa9dc0c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:39:36.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9d3e00640 1 --2- 172.21.15.103:0/711746869 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9dc0d0640 0x7fa9dc156a20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400e9c0 tx=0x7fa9c400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:36.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9d3400640 1 -- 172.21.15.103:0/711746869 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c400cd20 con 0x7fa9dc0d0640 2024-09-10T22:39:36.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9e1e00640 1 -- 172.21.15.103:0/711746869 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9dc159ad0 con 0x7fa9dc0d0640 2024-09-10T22:39:36.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9d3400640 1 -- 172.21.15.103:0/711746869 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9c4004020 con 0x7fa9dc0d0640 2024-09-10T22:39:36.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9d3400640 1 -- 172.21.15.103:0/711746869 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4004450 con 0x7fa9dc0d0640 2024-09-10T22:39:36.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9e1e00640 1 -- 172.21.15.103:0/711746869 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9dc157d60 con 0x7fa9dc0d0640 2024-09-10T22:39:36.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.015+0000 7fa9e1e00640 1 -- 172.21.15.103:0/711746869 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9dc0c4f30 con 0x7fa9dc0d0640 2024-09-10T22:39:36.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.019+0000 7fa9d3400640 1 -- 172.21.15.103:0/711746869 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa9c4003600 con 0x7fa9dc0d0640 2024-09-10T22:39:36.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.019+0000 7fa9d3400640 1 --2- 172.21.15.103:0/711746869 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa9b8072610 0x7fa9b8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:36.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.019+0000 7fa9d3400640 1 -- 172.21.15.103:0/711746869 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fa9c4094250 con 0x7fa9dc0d0640 2024-09-10T22:39:36.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.019+0000 7fa9daa00640 1 --2- 172.21.15.103:0/711746869 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa9b8072610 0x7fa9b8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:36.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.019+0000 7fa9daa00640 1 --2- 172.21.15.103:0/711746869 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa9b8072610 0x7fa9b8074ad0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0af000 tx=0x7fa9cc01b090 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:36.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.023+0000 7fa9d3400640 1 -- 172.21.15.103:0/711746869 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa9c405f410 con 0x7fa9dc0d0640 2024-09-10T22:39:36.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.223+0000 7fa9e1e00640 1 -- 172.21.15.103:0/711746869 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9dc15c040 con 0x7fa9dc0d0640 2024-09-10T22:39:36.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.223+0000 7fa9d3400640 1 -- 172.21.15.103:0/711746869 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7fa9c405ed10 con 0x7fa9dc0d0640 2024-09-10T22:39:36.225 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:36.225 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-09-10T22:39:09:926600+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/467299119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":467299119},{"type":"v1","addr":"172.21.15.103:6834","nonce":467299119}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3161095873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3161095873},{"type":"v1","addr":"172.21.15.131:6837","nonce":3161095873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/774650981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":774650981},{"type":"v1","addr":"172.21.15.103:6835","nonce":774650981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:38:49.214867+0000","modified":"2024-09-10T22:39:09.303311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6836/2821479330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2821479330},{"type":"v1","addr":"172.21.15.131:6836","nonce":2821479330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4390,"qdb_cluster":[4390]},"id":1}]} 2024-09-10T22:39:36.226 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-09-10T22:39:36.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.223+0000 7fa9e1e00640 1 -- 172.21.15.103:0/711746869 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa9b8072610 msgr2=0x7fa9b8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:36.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.223+0000 7fa9e1e00640 1 --2- 172.21.15.103:0/711746869 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa9b8072610 0x7fa9b8074ad0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0af000 tx=0x7fa9cc01b090 comp rx=0 tx=0).stop 2024-09-10T22:39:36.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.223+0000 7fa9e1e00640 1 -- 172.21.15.103:0/711746869 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9dc0d0640 msgr2=0x7fa9dc156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:36.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.223+0000 7fa9e1e00640 1 --2- 172.21.15.103:0/711746869 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9dc0d0640 0x7fa9dc156a20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400e9c0 tx=0x7fa9c400ee80 comp rx=0 tx=0).stop 2024-09-10T22:39:36.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.223+0000 7fa9e1e00640 1 -- 172.21.15.103:0/711746869 shutdown_connections 2024-09-10T22:39:36.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.223+0000 7fa9e1e00640 1 --2- 172.21.15.103:0/711746869 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa9b8072610 0x7fa9b8074ad0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.223+0000 7fa9e1e00640 1 --2- 172.21.15.103:0/711746869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9dc15f330 0x7fa9dc0c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.223+0000 7fa9e1e00640 1 --2- 172.21.15.103:0/711746869 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9dc0d0640 0x7fa9dc156a20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.223+0000 7fa9e1e00640 1 --2- 172.21.15.103:0/711746869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9dc0b2840 0x7fa9dc159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.223+0000 7fa9e1e00640 1 -- 172.21.15.103:0/711746869 >> 172.21.15.103:0/711746869 conn(0x7fa9dc0d1ab0 msgr2=0x7fa9dc071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:36.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.223+0000 7fa9e1e00640 1 -- 172.21.15.103:0/711746869 shutdown_connections 2024-09-10T22:39:36.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.223+0000 7fa9e1e00640 1 -- 172.21.15.103:0/711746869 wait complete. 2024-09-10T22:39:36.247 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:39:36.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.387+0000 7f7faae00640 1 -- 172.21.15.103:0/4092230444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f88003a40 msgr2=0x7f7f88003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:36.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.387+0000 7f7faae00640 1 --2- 172.21.15.103:0/4092230444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f88003a40 0x7f7f88003e60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7f94001dc0 tx=0x7f7f9401ca70 comp rx=0 tx=0).stop 2024-09-10T22:39:36.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.387+0000 7f7fa8e00640 1 -- 172.21.15.103:0/4092230444 reap_dead start 2024-09-10T22:39:36.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.387+0000 7f7faae00640 1 -- 172.21.15.103:0/4092230444 shutdown_connections 2024-09-10T22:39:36.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.387+0000 7f7faae00640 1 -- 172.21.15.103:0/4092230444 >> 172.21.15.103:0/4092230444 conn(0x7f7fa406cc00 msgr2=0x7f7fa406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:36.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.387+0000 7f7faae00640 1 -- 172.21.15.103:0/4092230444 shutdown_connections 2024-09-10T22:39:36.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.387+0000 7f7faae00640 1 -- 172.21.15.103:0/4092230444 wait complete. 2024-09-10T22:39:36.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.387+0000 7f7faae00640 1 Processor -- start 2024-09-10T22:39:36.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.387+0000 7f7faae00640 1 -- start start 2024-09-10T22:39:36.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7faae00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f88003a40 0x7f7fa413f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:36.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7faae00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fa413c780 0x7f7fa41563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:36.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7faae00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fa413cc00 0x7f7fa41568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:36.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7faae00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa4157a10 con 0x7f7f88003a40 2024-09-10T22:39:36.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7faae00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa4157890 con 0x7f7fa413cc00 2024-09-10T22:39:36.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7faae00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa4157b90 con 0x7f7fa413c780 2024-09-10T22:39:36.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7fa3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f88003a40 0x7f7fa413f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:36.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7fa3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f88003a40 0x7f7fa413f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42318/0 (socket says 172.21.15.103:42318) 2024-09-10T22:39:36.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7fa3e00640 1 -- 172.21.15.103:0/1719842442 learned_addr learned my addr 172.21.15.103:0/1719842442 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:36.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7f9b400640 1 --2- 172.21.15.103:0/1719842442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fa413c780 0x7f7fa41563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7fa8e00640 1 --2- 172.21.15.103:0/1719842442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fa413cc00 0x7f7fa41568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7fa3e00640 1 -- 172.21.15.103:0/1719842442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fa413c780 msgr2=0x7f7fa41563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7fa3e00640 1 --2- 172.21.15.103:0/1719842442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fa413c780 0x7f7fa41563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7fa3e00640 1 -- 172.21.15.103:0/1719842442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fa413cc00 msgr2=0x7f7fa41568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7fa3e00640 1 --2- 172.21.15.103:0/1719842442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fa413cc00 0x7f7fa41568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7fa3e00640 1 -- 172.21.15.103:0/1719842442 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa413eac0 con 0x7f7f88003a40 2024-09-10T22:39:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7fa8e00640 1 --2- 172.21.15.103:0/1719842442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fa413cc00 0x7f7fa41568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7fa3e00640 1 --2- 172.21.15.103:0/1719842442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f88003a40 0x7f7fa413f580 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7f94006040 tx=0x7f7f94006d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7fa0c00640 1 -- 172.21.15.103:0/1719842442 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f940a58d0 con 0x7f7f88003a40 2024-09-10T22:39:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7fa0c00640 1 -- 172.21.15.103:0/1719842442 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f940a5b60 con 0x7f7f88003a40 2024-09-10T22:39:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7fa0c00640 1 -- 172.21.15.103:0/1719842442 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f940060d0 con 0x7f7f88003a40 2024-09-10T22:39:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7faae00640 1 -- 172.21.15.103:0/1719842442 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa41f84f0 con 0x7f7f88003a40 2024-09-10T22:39:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7faae00640 1 -- 172.21.15.103:0/1719842442 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa413f060 con 0x7f7f88003a40 2024-09-10T22:39:36.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7faae00640 1 -- 172.21.15.103:0/1719842442 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fa4072500 con 0x7f7f88003a40 2024-09-10T22:39:36.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.391+0000 7f7fa0c00640 1 -- 172.21.15.103:0/1719842442 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7f940b6020 con 0x7f7f88003a40 2024-09-10T22:39:36.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.395+0000 7f7fa0c00640 1 --2- 172.21.15.103:0/1719842442 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7f800725e0 0x7f7f80074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:36.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.395+0000 7f7fa0c00640 1 -- 172.21.15.103:0/1719842442 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f7f9412ce70 con 0x7f7f88003a40 2024-09-10T22:39:36.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.395+0000 7f7f9b400640 1 --2- 172.21.15.103:0/1719842442 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7f800725e0 0x7f7f80074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:36.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.395+0000 7f7f9b400640 1 --2- 172.21.15.103:0/1719842442 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7f800725e0 0x7f7f80074aa0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4158ad0 tx=0x7f7f8c0067b0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:36.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.399+0000 7f7fa0c00640 1 -- 172.21.15.103:0/1719842442 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7f940167d0 con 0x7f7f88003a40 2024-09-10T22:39:36.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.563+0000 7f7faae00640 1 -- 172.21.15.103:0/1719842442 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7fa415bce0 con 0x7f7f88003a40 2024-09-10T22:39:36.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.567+0000 7f7fa0c00640 1 -- 172.21.15.103:0/1719842442 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+19045 (secure 0 0 0) 0x7f7f94129a80 con 0x7f7f88003a40 2024-09-10T22:39:36.569 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:36.569 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":29,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:39:31.022468+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:38:47.154691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:38:48.182281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T22:38:51.874808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:39:36.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.567+0000 7f7faae00640 1 -- 172.21.15.103:0/1719842442 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7f800725e0 msgr2=0x7f7f80074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:36.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.567+0000 7f7faae00640 1 --2- 172.21.15.103:0/1719842442 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7f800725e0 0x7f7f80074aa0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4158ad0 tx=0x7f7f8c0067b0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.567+0000 7f7faae00640 1 -- 172.21.15.103:0/1719842442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f88003a40 msgr2=0x7f7fa413f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:36.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.567+0000 7f7faae00640 1 --2- 172.21.15.103:0/1719842442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f88003a40 0x7f7fa413f580 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7f94006040 tx=0x7f7f94006d30 comp rx=0 tx=0).stop 2024-09-10T22:39:36.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.567+0000 7f7faae00640 1 -- 172.21.15.103:0/1719842442 shutdown_connections 2024-09-10T22:39:36.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.567+0000 7f7faae00640 1 --2- 172.21.15.103:0/1719842442 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7f800725e0 0x7f7f80074aa0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.567+0000 7f7faae00640 1 --2- 172.21.15.103:0/1719842442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fa413cc00 0x7f7fa41568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.567+0000 7f7faae00640 1 --2- 172.21.15.103:0/1719842442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fa413c780 0x7f7fa41563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.567+0000 7f7faae00640 1 --2- 172.21.15.103:0/1719842442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f88003a40 0x7f7fa413f580 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.567+0000 7f7faae00640 1 -- 172.21.15.103:0/1719842442 >> 172.21.15.103:0/1719842442 conn(0x7f7fa406cc00 msgr2=0x7f7fa4142530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:36.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.567+0000 7f7faae00640 1 -- 172.21.15.103:0/1719842442 shutdown_connections 2024-09-10T22:39:36.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.567+0000 7f7faae00640 1 -- 172.21.15.103:0/1719842442 wait complete. 2024-09-10T22:39:36.593 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T22:39:36.593 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:39:36.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.731+0000 7fcaf1200640 1 -- 172.21.15.103:0/2195707678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaec150a50 msgr2=0x7fcaec15aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:36.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.731+0000 7fcaf1200640 1 --2- 172.21.15.103:0/2195707678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaec150a50 0x7fcaec15aa50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00b3f0 tx=0x7fcadc01d180 comp rx=0 tx=0).stop 2024-09-10T22:39:36.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.731+0000 7fcaf1200640 1 -- 172.21.15.103:0/2195707678 shutdown_connections 2024-09-10T22:39:36.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.731+0000 7fcaf1200640 1 --2- 172.21.15.103:0/2195707678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaec150a50 0x7fcaec15aa50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.731+0000 7fcaf1200640 1 -- 172.21.15.103:0/2195707678 >> 172.21.15.103:0/2195707678 conn(0x7fcaec06cc00 msgr2=0x7fcaec06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:36.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.731+0000 7fcaf1200640 1 -- 172.21.15.103:0/2195707678 shutdown_connections 2024-09-10T22:39:36.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.731+0000 7fcaf1200640 1 -- 172.21.15.103:0/2195707678 wait complete. 2024-09-10T22:39:36.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.731+0000 7fcaf1200640 1 Processor -- start 2024-09-10T22:39:36.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.731+0000 7fcaf1200640 1 -- start start 2024-09-10T22:39:36.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcaf1200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcaec073c30 0x7fcaec13ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:36.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcaf1200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaec0b4b20 0x7fcaec0ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:36.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcaf1200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcaec150a50 0x7fcaec1420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:36.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcaf1200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcaec169160 con 0x7fcaec0b4b20 2024-09-10T22:39:36.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcaf1200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcaec074560 con 0x7fcaec073c30 2024-09-10T22:39:36.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcaf1200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcaec1692e0 con 0x7fcaec150a50 2024-09-10T22:39:36.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcae1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaec0b4b20 0x7fcaec0ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:36.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcae1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaec0b4b20 0x7fcaec0ad1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48340/0 (socket says 172.21.15.103:48340) 2024-09-10T22:39:36.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcae1400640 1 -- 172.21.15.103:0/4230730963 learned_addr learned my addr 172.21.15.103:0/4230730963 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:36.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcae9e00640 1 --2- 172.21.15.103:0/4230730963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcaec073c30 0x7fcaec13ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:36.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcaea800640 1 --2- 172.21.15.103:0/4230730963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcaec150a50 0x7fcaec1420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:36.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcae1400640 1 -- 172.21.15.103:0/4230730963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcaec150a50 msgr2=0x7fcaec1420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:36.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcae1400640 1 --2- 172.21.15.103:0/4230730963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcaec150a50 0x7fcaec1420d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcae1400640 1 -- 172.21.15.103:0/4230730963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcaec073c30 msgr2=0x7fcaec13ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:36.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcae1400640 1 --2- 172.21.15.103:0/4230730963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcaec073c30 0x7fcaec13ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcae1400640 1 -- 172.21.15.103:0/4230730963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaec13d520 con 0x7fcaec0b4b20 2024-09-10T22:39:36.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcae1400640 1 --2- 172.21.15.103:0/4230730963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaec0b4b20 0x7fcaec0ad1c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcad400c400 tx=0x7fcad400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:36.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcae2a00640 1 -- 172.21.15.103:0/4230730963 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4017070 con 0x7fcaec0b4b20 2024-09-10T22:39:36.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcae2a00640 1 -- 172.21.15.103:0/4230730963 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcad40053e0 con 0x7fcaec0b4b20 2024-09-10T22:39:36.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcae2a00640 1 -- 172.21.15.103:0/4230730963 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4003860 con 0x7fcaec0b4b20 2024-09-10T22:39:36.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcaf1200640 1 -- 172.21.15.103:0/4230730963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaec13d800 con 0x7fcaec0b4b20 2024-09-10T22:39:36.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcaf1200640 1 -- 172.21.15.103:0/4230730963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaec13ddc0 con 0x7fcaec0b4b20 2024-09-10T22:39:36.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcaf1200640 1 -- 172.21.15.103:0/4230730963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaec15aa50 con 0x7fcaec0b4b20 2024-09-10T22:39:36.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.735+0000 7fcae2a00640 1 -- 172.21.15.103:0/4230730963 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcad4003a00 con 0x7fcaec0b4b20 2024-09-10T22:39:36.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.739+0000 7fcae2a00640 1 --2- 172.21.15.103:0/4230730963 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcac80725e0 0x7fcac8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:36.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.739+0000 7fcae2a00640 1 -- 172.21.15.103:0/4230730963 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fcad4092cc0 con 0x7fcaec0b4b20 2024-09-10T22:39:36.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.739+0000 7fcae9e00640 1 --2- 172.21.15.103:0/4230730963 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcac80725e0 0x7fcac8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:36.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.739+0000 7fcae9e00640 1 --2- 172.21.15.103:0/4230730963 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcac80725e0 0x7fcac8074aa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0ae000 tx=0x7fcadc01b9c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:36.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.743+0000 7fcae2a00640 1 -- 172.21.15.103:0/4230730963 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcad4001130 con 0x7fcaec0b4b20 2024-09-10T22:39:36.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.939+0000 7fcaf1200640 1 -- 172.21.15.103:0/4230730963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcaec0ad700 con 0x7fcaec0b4b20 2024-09-10T22:39:36.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.943+0000 7fcae2a00640 1 -- 172.21.15.103:0/4230730963 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7fcad405d960 con 0x7fcaec0b4b20 2024-09-10T22:39:36.944 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:36.944 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-09-10T22:39:09:926600+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/467299119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":467299119},{"type":"v1","addr":"172.21.15.103:6834","nonce":467299119}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3161095873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3161095873},{"type":"v1","addr":"172.21.15.131:6837","nonce":3161095873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/774650981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":774650981},{"type":"v1","addr":"172.21.15.103:6835","nonce":774650981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:38:49.214867+0000","modified":"2024-09-10T22:39:09.303311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6836/2821479330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2821479330},{"type":"v1","addr":"172.21.15.131:6836","nonce":2821479330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4390,"qdb_cluster":[4390]},"id":1}]} 2024-09-10T22:39:36.945 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-09-10T22:39:36.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.943+0000 7fcaf1200640 1 -- 172.21.15.103:0/4230730963 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcac80725e0 msgr2=0x7fcac8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:36.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.943+0000 7fcaf1200640 1 --2- 172.21.15.103:0/4230730963 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcac80725e0 0x7fcac8074aa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0ae000 tx=0x7fcadc01b9c0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.943+0000 7fcaf1200640 1 -- 172.21.15.103:0/4230730963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaec0b4b20 msgr2=0x7fcaec0ad1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:36.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.943+0000 7fcaf1200640 1 --2- 172.21.15.103:0/4230730963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaec0b4b20 0x7fcaec0ad1c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcad400c400 tx=0x7fcad400c8c0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.943+0000 7fcaf1200640 1 -- 172.21.15.103:0/4230730963 shutdown_connections 2024-09-10T22:39:36.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.943+0000 7fcaf1200640 1 --2- 172.21.15.103:0/4230730963 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcac80725e0 0x7fcac8074aa0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.943+0000 7fcaf1200640 1 --2- 172.21.15.103:0/4230730963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcaec150a50 0x7fcaec1420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.943+0000 7fcaf1200640 1 --2- 172.21.15.103:0/4230730963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaec0b4b20 0x7fcaec0ad1c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.943+0000 7fcaf1200640 1 --2- 172.21.15.103:0/4230730963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcaec073c30 0x7fcaec13ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:36.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.943+0000 7fcaf1200640 1 -- 172.21.15.103:0/4230730963 >> 172.21.15.103:0/4230730963 conn(0x7fcaec06cc00 msgr2=0x7fcaec1533f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:36.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.943+0000 7fcaf1200640 1 -- 172.21.15.103:0/4230730963 shutdown_connections 2024-09-10T22:39:36.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:36.943+0000 7fcaf1200640 1 -- 172.21.15.103:0/4230730963 wait complete. 2024-09-10T22:39:36.966 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:39:37.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.107+0000 7fc7f4c00640 1 -- 172.21.15.103:0/860902048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7d4004220 msgr2=0x7fc7d4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:37.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.107+0000 7fc7f4c00640 1 --2- 172.21.15.103:0/860902048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7d4004220 0x7fc7d4004810 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80017d0 tx=0x7fc7d801c890 comp rx=0 tx=0).stop 2024-09-10T22:39:37.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.107+0000 7fc7ee800640 1 -- 172.21.15.103:0/860902048 reap_dead start 2024-09-10T22:39:37.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.107+0000 7fc7f4c00640 1 -- 172.21.15.103:0/860902048 shutdown_connections 2024-09-10T22:39:37.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.107+0000 7fc7f4c00640 1 -- 172.21.15.103:0/860902048 >> 172.21.15.103:0/860902048 conn(0x7fc7f00d1ac0 msgr2=0x7fc7f00d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:37.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.107+0000 7fc7f4c00640 1 -- 172.21.15.103:0/860902048 shutdown_connections 2024-09-10T22:39:37.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.107+0000 7fc7f4c00640 1 -- 172.21.15.103:0/860902048 wait complete. 2024-09-10T22:39:37.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.107+0000 7fc7f4c00640 1 Processor -- start 2024-09-10T22:39:37.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.107+0000 7fc7f4c00640 1 -- start start 2024-09-10T22:39:37.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7f4c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7d4004220 0x7fc7f0158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:37.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7f4c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7f0158d20 0x7fc7f00caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:37.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7f4c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7f01fb750 0x7fc7f0070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:37.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7f4c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f0167c70 con 0x7fc7f0158d20 2024-09-10T22:39:37.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7f4c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f00cef50 con 0x7fc7d4004220 2024-09-10T22:39:37.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7f4c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f0167df0 con 0x7fc7f01fb750 2024-09-10T22:39:37.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7e5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7f0158d20 0x7fc7f00caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:37.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7e5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7f0158d20 0x7fc7f00caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48356/0 (socket says 172.21.15.103:48356) 2024-09-10T22:39:37.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7e5400640 1 -- 172.21.15.103:0/1817186323 learned_addr learned my addr 172.21.15.103:0/1817186323 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7ede00640 1 --2- 172.21.15.103:0/1817186323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7d4004220 0x7fc7f0158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7ee800640 1 --2- 172.21.15.103:0/1817186323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7f01fb750 0x7fc7f0070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7e5400640 1 -- 172.21.15.103:0/1817186323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7f01fb750 msgr2=0x7fc7f0070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7e5400640 1 --2- 172.21.15.103:0/1817186323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7f01fb750 0x7fc7f0070600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7e5400640 1 -- 172.21.15.103:0/1817186323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7d4004220 msgr2=0x7fc7f0158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7e5400640 1 --2- 172.21.15.103:0/1817186323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7d4004220 0x7fc7f0158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7e5400640 1 -- 172.21.15.103:0/1817186323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f00cb5a0 con 0x7fc7f0158d20 2024-09-10T22:39:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7ede00640 1 --2- 172.21.15.103:0/1817186323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7d4004220 0x7fc7f0158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7e5400640 1 --2- 172.21.15.103:0/1817186323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7f0158d20 0x7fc7f00caca0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80ac040 tx=0x7fc7d8003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7e6a00640 1 -- 172.21.15.103:0/1817186323 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d80ae040 con 0x7fc7f0158d20 2024-09-10T22:39:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7e6a00640 1 -- 172.21.15.103:0/1817186323 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7d80b8070 con 0x7fc7f0158d20 2024-09-10T22:39:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7e6a00640 1 -- 172.21.15.103:0/1817186323 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8001420 con 0x7fc7f0158d20 2024-09-10T22:39:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7f4c00640 1 -- 172.21.15.103:0/1817186323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f01fac70 con 0x7fc7f0158d20 2024-09-10T22:39:37.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7f4c00640 1 -- 172.21.15.103:0/1817186323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f01589b0 con 0x7fc7f0158d20 2024-09-10T22:39:37.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.111+0000 7fc7f4c00640 1 -- 172.21.15.103:0/1817186323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f00aee70 con 0x7fc7f0158d20 2024-09-10T22:39:37.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.115+0000 7fc7e6a00640 1 -- 172.21.15.103:0/1817186323 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc7d80a86c0 con 0x7fc7f0158d20 2024-09-10T22:39:37.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.115+0000 7fc7e6a00640 1 --2- 172.21.15.103:0/1817186323 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc7cc072610 0x7fc7cc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:37.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.115+0000 7fc7e6a00640 1 -- 172.21.15.103:0/1817186323 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fc7d812d510 con 0x7fc7f0158d20 2024-09-10T22:39:37.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.115+0000 7fc7ede00640 1 --2- 172.21.15.103:0/1817186323 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc7cc072610 0x7fc7cc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:37.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.115+0000 7fc7ede00640 1 --2- 172.21.15.103:0/1817186323 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc7cc072610 0x7fc7cc074ad0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009b80 tx=0x7fc7e00091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:37.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.119+0000 7fc7e6a00640 1 -- 172.21.15.103:0/1817186323 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc7d80165f0 con 0x7fc7f0158d20 2024-09-10T22:39:37.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.315+0000 7fc7f4c00640 1 -- 172.21.15.103:0/1817186323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7f0068dd0 con 0x7fc7f0158d20 2024-09-10T22:39:37.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.315+0000 7fc7e6a00640 1 -- 172.21.15.103:0/1817186323 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7fc7d80f8880 con 0x7fc7f0158d20 2024-09-10T22:39:37.319 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:37.319 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-09-10T22:39:09:926600+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/467299119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":467299119},{"type":"v1","addr":"172.21.15.103:6834","nonce":467299119}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3161095873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3161095873},{"type":"v1","addr":"172.21.15.131:6837","nonce":3161095873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/774650981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":774650981},{"type":"v1","addr":"172.21.15.103:6835","nonce":774650981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:38:49.214867+0000","modified":"2024-09-10T22:39:09.303311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4390":{"gid":4390,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6836/2821479330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2821479330},{"type":"v1","addr":"172.21.15.131:6836","nonce":2821479330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4390,"qdb_cluster":[4390]},"id":1}]} 2024-09-10T22:39:37.319 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-09-10T22:39:37.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.319+0000 7fc7f4c00640 1 -- 172.21.15.103:0/1817186323 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc7cc072610 msgr2=0x7fc7cc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:37.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.319+0000 7fc7f4c00640 1 --2- 172.21.15.103:0/1817186323 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc7cc072610 0x7fc7cc074ad0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009b80 tx=0x7fc7e00091e0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.319+0000 7fc7f4c00640 1 -- 172.21.15.103:0/1817186323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7f0158d20 msgr2=0x7fc7f00caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:37.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.319+0000 7fc7f4c00640 1 --2- 172.21.15.103:0/1817186323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7f0158d20 0x7fc7f00caca0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80ac040 tx=0x7fc7d8003c60 comp rx=0 tx=0).stop 2024-09-10T22:39:37.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.319+0000 7fc7f4c00640 1 -- 172.21.15.103:0/1817186323 shutdown_connections 2024-09-10T22:39:37.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.319+0000 7fc7f4c00640 1 --2- 172.21.15.103:0/1817186323 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc7cc072610 0x7fc7cc074ad0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.319+0000 7fc7f4c00640 1 --2- 172.21.15.103:0/1817186323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7f01fb750 0x7fc7f0070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.319+0000 7fc7f4c00640 1 --2- 172.21.15.103:0/1817186323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7f0158d20 0x7fc7f00caca0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.319+0000 7fc7f4c00640 1 --2- 172.21.15.103:0/1817186323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7d4004220 0x7fc7f0158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.319+0000 7fc7f4c00640 1 -- 172.21.15.103:0/1817186323 >> 172.21.15.103:0/1817186323 conn(0x7fc7f00d1ac0 msgr2=0x7fc7f015ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:37.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.319+0000 7fc7f4c00640 1 -- 172.21.15.103:0/1817186323 shutdown_connections 2024-09-10T22:39:37.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.319+0000 7fc7f4c00640 1 -- 172.21.15.103:0/1817186323 wait complete. 2024-09-10T22:39:37.341 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:39:37.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.479+0000 7f74c8800640 1 -- 172.21.15.103:0/3401428730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74c00ae9c0 msgr2=0x7f74c00aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:37.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.479+0000 7f74c8800640 1 --2- 172.21.15.103:0/3401428730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74c00ae9c0 0x7f74c00aee70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009bc0 tx=0x7f74bc01cb10 comp rx=0 tx=0).stop 2024-09-10T22:39:37.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.479+0000 7f74c8800640 1 -- 172.21.15.103:0/3401428730 shutdown_connections 2024-09-10T22:39:37.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.479+0000 7f74c8800640 1 --2- 172.21.15.103:0/3401428730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74c00ae9c0 0x7f74c00aee70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.479+0000 7f74c8800640 1 --2- 172.21.15.103:0/3401428730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74c015be30 0x7f74c00ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.479+0000 7f74c8800640 1 -- 172.21.15.103:0/3401428730 >> 172.21.15.103:0/3401428730 conn(0x7f74c00d1ac0 msgr2=0x7f74c00d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:37.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.479+0000 7f74c8800640 1 -- 172.21.15.103:0/3401428730 shutdown_connections 2024-09-10T22:39:37.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.479+0000 7f74c8800640 1 -- 172.21.15.103:0/3401428730 wait complete. 2024-09-10T22:39:37.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.479+0000 7f74c8800640 1 Processor -- start 2024-09-10T22:39:37.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.479+0000 7f74c8800640 1 -- start start 2024-09-10T22:39:37.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c8800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c00ae9c0 0x7f74c01f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:37.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c8800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74c00b09c0 0x7f74c015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:37.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c8800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74c015be30 0x7f74c01590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:37.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c8800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f74c0168df0 con 0x7f74c00ae9c0 2024-09-10T22:39:37.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c8800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f74c0168c70 con 0x7f74c015be30 2024-09-10T22:39:37.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c8800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f74c0168f70 con 0x7f74c00b09c0 2024-09-10T22:39:37.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c00ae9c0 0x7f74c01f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:37.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c00ae9c0 0x7f74c01f5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48364/0 (socket says 172.21.15.103:48364) 2024-09-10T22:39:37.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c5e00640 1 -- 172.21.15.103:0/4030006850 learned_addr learned my addr 172.21.15.103:0/4030006850 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:37.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c5400640 1 --2- 172.21.15.103:0/4030006850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74c00b09c0 0x7f74c015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:37.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c6800640 1 --2- 172.21.15.103:0/4030006850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74c015be30 0x7f74c01590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:37.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c5e00640 1 -- 172.21.15.103:0/4030006850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74c00b09c0 msgr2=0x7f74c015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:37.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c5e00640 1 --2- 172.21.15.103:0/4030006850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74c00b09c0 0x7f74c015b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c5e00640 1 -- 172.21.15.103:0/4030006850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74c015be30 msgr2=0x7f74c01590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:37.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c5e00640 1 --2- 172.21.15.103:0/4030006850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74c015be30 0x7f74c01590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c5e00640 1 -- 172.21.15.103:0/4030006850 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c0159620 con 0x7f74c00ae9c0 2024-09-10T22:39:37.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c5400640 1 --2- 172.21.15.103:0/4030006850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74c00b09c0 0x7f74c015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:37.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c5e00640 1 --2- 172.21.15.103:0/4030006850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c00ae9c0 0x7f74c01f5320 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f74b400e7a0 tx=0x7f74b400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:37.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74ba000640 1 -- 172.21.15.103:0/4030006850 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b400ccc0 con 0x7f74c00ae9c0 2024-09-10T22:39:37.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74ba000640 1 -- 172.21.15.103:0/4030006850 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74b4010430 con 0x7f74c00ae9c0 2024-09-10T22:39:37.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74ba000640 1 -- 172.21.15.103:0/4030006850 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4010860 con 0x7f74c00ae9c0 2024-09-10T22:39:37.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c8800640 1 -- 172.21.15.103:0/4030006850 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c01f9270 con 0x7f74c00ae9c0 2024-09-10T22:39:37.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c8800640 1 -- 172.21.15.103:0/4030006850 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c00c8cc0 con 0x7f74c00ae9c0 2024-09-10T22:39:37.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.483+0000 7f74c8800640 1 -- 172.21.15.103:0/4030006850 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c00aee70 con 0x7f74c00ae9c0 2024-09-10T22:39:37.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.487+0000 7f74ba000640 1 -- 172.21.15.103:0/4030006850 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f74b4010a00 con 0x7f74c00ae9c0 2024-09-10T22:39:37.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.487+0000 7f74ba000640 1 --2- 172.21.15.103:0/4030006850 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f74a4072610 0x7f74a4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:37.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.487+0000 7f74ba000640 1 -- 172.21.15.103:0/4030006850 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f74b4094000 con 0x7f74c00ae9c0 2024-09-10T22:39:37.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.487+0000 7f74c5400640 1 --2- 172.21.15.103:0/4030006850 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f74a4072610 0x7f74a4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:37.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.487+0000 7f74c5400640 1 --2- 172.21.15.103:0/4030006850 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f74a4072610 0x7f74a4074ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f74c00b1f70 tx=0x7f74b0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:37.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.491+0000 7f74ba000640 1 -- 172.21.15.103:0/4030006850 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f74c01f9270 con 0x7f74c00ae9c0 2024-09-10T22:39:37.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.659+0000 7f74c8800640 1 -- 172.21.15.103:0/4030006850 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74c01f94f0 con 0x7f74c00ae9c0 2024-09-10T22:39:37.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.659+0000 7f74ba000640 1 -- 172.21.15.103:0/4030006850 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+19045 (secure 0 0 0) 0x7f74b405eca0 con 0x7f74c00ae9c0 2024-09-10T22:39:37.663 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:37.663 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":29,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:39:31.022468+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:38:47.154691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:38:48.182281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T22:38:51.874808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:39:37.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.663+0000 7f74c8800640 1 -- 172.21.15.103:0/4030006850 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f74a4072610 msgr2=0x7f74a4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:37.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.663+0000 7f74c8800640 1 --2- 172.21.15.103:0/4030006850 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f74a4072610 0x7f74a4074ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f74c00b1f70 tx=0x7f74b0009040 comp rx=0 tx=0).stop 2024-09-10T22:39:37.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.663+0000 7f74c8800640 1 -- 172.21.15.103:0/4030006850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c00ae9c0 msgr2=0x7f74c01f5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:37.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.663+0000 7f74c8800640 1 --2- 172.21.15.103:0/4030006850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c00ae9c0 0x7f74c01f5320 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f74b400e7a0 tx=0x7f74b400ec60 comp rx=0 tx=0).stop 2024-09-10T22:39:37.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.663+0000 7f74c8800640 1 -- 172.21.15.103:0/4030006850 shutdown_connections 2024-09-10T22:39:37.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.663+0000 7f74c8800640 1 --2- 172.21.15.103:0/4030006850 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f74a4072610 0x7f74a4074ad0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.663+0000 7f74c8800640 1 --2- 172.21.15.103:0/4030006850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74c015be30 0x7f74c01590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.663+0000 7f74c8800640 1 --2- 172.21.15.103:0/4030006850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74c00b09c0 0x7f74c015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.663+0000 7f74c8800640 1 --2- 172.21.15.103:0/4030006850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c00ae9c0 0x7f74c01f5320 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.663+0000 7f74c8800640 1 -- 172.21.15.103:0/4030006850 >> 172.21.15.103:0/4030006850 conn(0x7f74c00d1ac0 msgr2=0x7f74c00b6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:37.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.663+0000 7f74c8800640 1 -- 172.21.15.103:0/4030006850 shutdown_connections 2024-09-10T22:39:37.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.663+0000 7f74c8800640 1 -- 172.21.15.103:0/4030006850 wait complete. 2024-09-10T22:39:37.686 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T22:39:37.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.823+0000 7f45f4c00640 1 -- 172.21.15.103:0/429312999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f00cf260 msgr2=0x7f45f00b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:37.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.823+0000 7f45f4c00640 1 --2- 172.21.15.103:0/429312999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f00cf260 0x7f45f00b2c10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009c80 tx=0x7f45e001cda0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.823+0000 7f45f4c00640 1 -- 172.21.15.103:0/429312999 shutdown_connections 2024-09-10T22:39:37.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.823+0000 7f45f4c00640 1 --2- 172.21.15.103:0/429312999 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45f00b3150 0x7f45f0072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.823+0000 7f45f4c00640 1 --2- 172.21.15.103:0/429312999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f00cf260 0x7f45f00b2c10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.823+0000 7f45f4c00640 1 -- 172.21.15.103:0/429312999 >> 172.21.15.103:0/429312999 conn(0x7f45f006cc00 msgr2=0x7f45f006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.823+0000 7f45f4c00640 1 -- 172.21.15.103:0/429312999 shutdown_connections 2024-09-10T22:39:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.823+0000 7f45f4c00640 1 -- 172.21.15.103:0/429312999 wait complete. 2024-09-10T22:39:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45f4c00640 1 Processor -- start 2024-09-10T22:39:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45f4c00640 1 -- start start 2024-09-10T22:39:37.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45f4c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45f0072a40 0x7f45f00a9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:37.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45f4c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45f00b3150 0x7f45f0155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:37.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45f4c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f00cf260 0x7f45f014bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:37.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45f4c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f45f006f0f0 con 0x7f45f00cf260 2024-09-10T22:39:37.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45f4c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f45f006ef70 con 0x7f45f0072a40 2024-09-10T22:39:37.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45f4c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f45f006f270 con 0x7f45f00b3150 2024-09-10T22:39:37.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45ee800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f00cf260 0x7f45f014bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:37.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45ee800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f00cf260 0x7f45f014bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48384/0 (socket says 172.21.15.103:48384) 2024-09-10T22:39:37.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45ee800640 1 -- 172.21.15.103:0/3299370872 learned_addr learned my addr 172.21.15.103:0/3299370872 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:37.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45ede00640 1 --2- 172.21.15.103:0/3299370872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45f0072a40 0x7f45f00a9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:37.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45e5400640 1 --2- 172.21.15.103:0/3299370872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45f00b3150 0x7f45f0155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:37.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45ee800640 1 -- 172.21.15.103:0/3299370872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45f00b3150 msgr2=0x7f45f0155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:37.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45ee800640 1 --2- 172.21.15.103:0/3299370872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45f00b3150 0x7f45f0155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45ee800640 1 -- 172.21.15.103:0/3299370872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45f0072a40 msgr2=0x7f45f00a9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:37.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45ee800640 1 --2- 172.21.15.103:0/3299370872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45f0072a40 0x7f45f00a9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:37.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45ee800640 1 -- 172.21.15.103:0/3299370872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f00a99c0 con 0x7f45f00cf260 2024-09-10T22:39:37.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45e5400640 1 --2- 172.21.15.103:0/3299370872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45f00b3150 0x7f45f0155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:37.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45ee800640 1 --2- 172.21.15.103:0/3299370872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f00cf260 0x7f45f014bec0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f45e800c3c0 tx=0x7f45e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:37.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45e6a00640 1 -- 172.21.15.103:0/3299370872 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e8011790 con 0x7f45f00cf260 2024-09-10T22:39:37.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45e6a00640 1 -- 172.21.15.103:0/3299370872 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45e8017070 con 0x7f45f00cf260 2024-09-10T22:39:37.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45e6a00640 1 -- 172.21.15.103:0/3299370872 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e8011cc0 con 0x7f45f00cf260 2024-09-10T22:39:37.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45f4c00640 1 -- 172.21.15.103:0/3299370872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f00ac5b0 con 0x7f45f00cf260 2024-09-10T22:39:37.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.827+0000 7f45f4c00640 1 -- 172.21.15.103:0/3299370872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f00acb70 con 0x7f45f00cf260 2024-09-10T22:39:37.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.831+0000 7f45f4c00640 1 -- 172.21.15.103:0/3299370872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f00acd70 con 0x7f45f00cf260 2024-09-10T22:39:37.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.831+0000 7f45e6a00640 1 -- 172.21.15.103:0/3299370872 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f45e801c460 con 0x7f45f00cf260 2024-09-10T22:39:37.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.831+0000 7f45e6a00640 1 --2- 172.21.15.103:0/3299370872 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f45cc0725e0 0x7f45cc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:37.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.831+0000 7f45e6a00640 1 -- 172.21.15.103:0/3299370872 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f45e8093440 con 0x7f45f00cf260 2024-09-10T22:39:37.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.831+0000 7f45ede00640 1 --2- 172.21.15.103:0/3299370872 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f45cc0725e0 0x7f45cc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:37.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.831+0000 7f45ede00640 1 --2- 172.21.15.103:0/3299370872 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f45cc0725e0 0x7f45cc074aa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f45e00af000 tx=0x7f45e001b5e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:37.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:37.835+0000 7f45e6a00640 1 -- 172.21.15.103:0/3299370872 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f45e805e710 con 0x7f45f00cf260 2024-09-10T22:39:38.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.035+0000 7f45f4c00640 1 -- 172.21.15.103:0/3299370872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f45f0075df0 con 0x7f45f00cf260 2024-09-10T22:39:38.039 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-10T22:39:38.035+0000 7fb5aba00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:39:38.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.039+0000 7f45e6a00640 1 -- 172.21.15.103:0/3299370872 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f45e805e010 con 0x7f45f00cf260 2024-09-10T22:39:38.041 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T22:39:38.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.039+0000 7f45f4c00640 1 -- 172.21.15.103:0/3299370872 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f45cc0725e0 msgr2=0x7f45cc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:38.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.039+0000 7f45f4c00640 1 --2- 172.21.15.103:0/3299370872 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f45cc0725e0 0x7f45cc074aa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f45e00af000 tx=0x7f45e001b5e0 comp rx=0 tx=0).stop 2024-09-10T22:39:38.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.039+0000 7f45f4c00640 1 -- 172.21.15.103:0/3299370872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f00cf260 msgr2=0x7f45f014bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:38.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.039+0000 7f45f4c00640 1 --2- 172.21.15.103:0/3299370872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f00cf260 0x7f45f014bec0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f45e800c3c0 tx=0x7f45e800c880 comp rx=0 tx=0).stop 2024-09-10T22:39:38.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.039+0000 7f45f4c00640 1 -- 172.21.15.103:0/3299370872 shutdown_connections 2024-09-10T22:39:38.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.039+0000 7f45f4c00640 1 --2- 172.21.15.103:0/3299370872 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f45cc0725e0 0x7f45cc074aa0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:38.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.039+0000 7f45f4c00640 1 --2- 172.21.15.103:0/3299370872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f00cf260 0x7f45f014bec0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:38.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.039+0000 7f45f4c00640 1 --2- 172.21.15.103:0/3299370872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45f00b3150 0x7f45f0155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:38.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.039+0000 7f45f4c00640 1 --2- 172.21.15.103:0/3299370872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45f0072a40 0x7f45f00a9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:38.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.039+0000 7f45f4c00640 1 -- 172.21.15.103:0/3299370872 >> 172.21.15.103:0/3299370872 conn(0x7f45f006cc00 msgr2=0x7f45f00b16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:38.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.039+0000 7f45f4c00640 1 -- 172.21.15.103:0/3299370872 shutdown_connections 2024-09-10T22:39:38.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.039+0000 7f45f4c00640 1 -- 172.21.15.103:0/3299370872 wait complete. 2024-09-10T22:39:38.055 INFO:tasks.ceph.mds.b.smithi131.stderr: -3553> 2024-09-10T22:38:54.804+0000 7f70c4800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T22:39:38.063 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T22:39:38.109 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2024-09-10T22:39:38.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.203+0000 7f2c4bc00640 1 -- 172.21.15.103:0/3095740439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c4415c970 msgr2=0x7f2c44072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:38.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.203+0000 7f2c4bc00640 1 --2- 172.21.15.103:0/3095740439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c4415c970 0x7f2c44072e30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009840 tx=0x7f2c3001c760 comp rx=0 tx=0).stop 2024-09-10T22:39:38.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.203+0000 7f2c4bc00640 1 -- 172.21.15.103:0/3095740439 shutdown_connections 2024-09-10T22:39:38.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.203+0000 7f2c4bc00640 1 --2- 172.21.15.103:0/3095740439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c4415c970 0x7f2c44072e30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:38.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.203+0000 7f2c4bc00640 1 --2- 172.21.15.103:0/3095740439 >> v2:172.21.15.131:3300/0 conn(0x7f2c440cc120 0x7f2c440aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:38.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.203+0000 7f2c4bc00640 1 -- 172.21.15.103:0/3095740439 >> 172.21.15.103:0/3095740439 conn(0x7f2c4406cc00 msgr2=0x7f2c4406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:38.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c4bc00640 1 -- 172.21.15.103:0/3095740439 shutdown_connections 2024-09-10T22:39:38.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c4bc00640 1 -- 172.21.15.103:0/3095740439 wait complete. 2024-09-10T22:39:38.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c4bc00640 1 Processor -- start 2024-09-10T22:39:38.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c4bc00640 1 -- start start 2024-09-10T22:39:38.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c4bc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c440cc120 0x7f2c44150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:38.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c4bc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c440cf790 0x7f2c441537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:38.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c4bc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c4415c970 0x7f2c44157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:38.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c4bc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2c441690c0 con 0x7f2c4415c970 2024-09-10T22:39:38.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c4bc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2c44073510 con 0x7f2c440cc120 2024-09-10T22:39:38.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c4bc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2c44169240 con 0x7f2c440cf790 2024-09-10T22:39:38.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c49c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c4415c970 0x7f2c44157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:38.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c49c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c4415c970 0x7f2c44157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48398/0 (socket says 172.21.15.103:48398) 2024-09-10T22:39:38.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c49c00640 1 -- 172.21.15.103:0/3288076777 learned_addr learned my addr 172.21.15.103:0/3288076777 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:38.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c49200640 1 --2- 172.21.15.103:0/3288076777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c440cc120 0x7f2c44150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:38.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c43e00640 1 --2- 172.21.15.103:0/3288076777 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c440cf790 0x7f2c441537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:38.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c49c00640 1 -- 172.21.15.103:0/3288076777 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c440cf790 msgr2=0x7f2c441537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:38.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c49c00640 1 --2- 172.21.15.103:0/3288076777 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c440cf790 0x7f2c441537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:38.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c49c00640 1 -- 172.21.15.103:0/3288076777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c440cc120 msgr2=0x7f2c44150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:38.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c49c00640 1 --2- 172.21.15.103:0/3288076777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c440cc120 0x7f2c44150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:38.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c49c00640 1 -- 172.21.15.103:0/3288076777 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c44150dd0 con 0x7f2c4415c970 2024-09-10T22:39:38.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c49200640 1 --2- 172.21.15.103:0/3288076777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c440cc120 0x7f2c44150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:38.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c49c00640 1 --2- 172.21.15.103:0/3288076777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c4415c970 0x7f2c44157640 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00cbc0 tx=0x7f2c3c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:38.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.207+0000 7f2c40c00640 1 -- 172.21.15.103:0/3288076777 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c016020 con 0x7f2c4415c970 2024-09-10T22:39:38.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.211+0000 7f2c40c00640 1 -- 172.21.15.103:0/3288076777 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c3c00ab00 con 0x7f2c4415c970 2024-09-10T22:39:38.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.211+0000 7f2c4bc00640 1 -- 172.21.15.103:0/3288076777 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c441510b0 con 0x7f2c4415c970 2024-09-10T22:39:38.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.211+0000 7f2c40c00640 1 -- 172.21.15.103:0/3288076777 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c012420 con 0x7f2c4415c970 2024-09-10T22:39:38.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.211+0000 7f2c4bc00640 1 -- 172.21.15.103:0/3288076777 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c44151670 con 0x7f2c4415c970 2024-09-10T22:39:38.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.211+0000 7f2c4bc00640 1 -- 172.21.15.103:0/3288076777 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c44072e30 con 0x7f2c4415c970 2024-09-10T22:39:38.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.211+0000 7f2c40c00640 1 -- 172.21.15.103:0/3288076777 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2c3c0125c0 con 0x7f2c4415c970 2024-09-10T22:39:38.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.211+0000 7f2c40c00640 1 --2- 172.21.15.103:0/3288076777 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2c240725e0 0x7f2c24074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:38.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.211+0000 7f2c40c00640 1 -- 172.21.15.103:0/3288076777 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6821+0+0 (secure 0 0 0) 0x7f2c3c093df0 con 0x7f2c4415c970 2024-09-10T22:39:38.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.211+0000 7f2c49200640 1 --2- 172.21.15.103:0/3288076777 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2c240725e0 0x7f2c24074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:38.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.215+0000 7f2c49200640 1 --2- 172.21.15.103:0/3288076777 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2c240725e0 0x7f2c24074aa0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2c441f8820 tx=0x7f2c340091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:38.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.215+0000 7f2c40c00640 1 -- 172.21.15.103:0/3288076777 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2c3c020020 con 0x7f2c4415c970 2024-09-10T22:39:38.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:38.415+0000 7f2c4bc00640 1 -- 172.21.15.103:0/3288076777 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2c44151840 con 0x7f2c4415c970 2024-09-10T22:39:39.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.074+0000 7f2c40c00640 1 -- 172.21.15.103:0/3288076777 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f2c44151840 con 0x7f2c4415c970 2024-09-10T22:39:39.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.078+0000 7f2c4bc00640 1 -- 172.21.15.103:0/3288076777 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2c240725e0 msgr2=0x7f2c24074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:39.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.078+0000 7f2c4bc00640 1 --2- 172.21.15.103:0/3288076777 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2c240725e0 0x7f2c24074aa0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2c441f8820 tx=0x7f2c340091e0 comp rx=0 tx=0).stop 2024-09-10T22:39:39.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.078+0000 7f2c4bc00640 1 -- 172.21.15.103:0/3288076777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c4415c970 msgr2=0x7f2c44157640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:39.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.078+0000 7f2c4bc00640 1 --2- 172.21.15.103:0/3288076777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c4415c970 0x7f2c44157640 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00cbc0 tx=0x7f2c3c00ccb0 comp rx=0 tx=0).stop 2024-09-10T22:39:39.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.078+0000 7f2c4bc00640 1 -- 172.21.15.103:0/3288076777 shutdown_connections 2024-09-10T22:39:39.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.078+0000 7f2c4bc00640 1 --2- 172.21.15.103:0/3288076777 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2c240725e0 0x7f2c24074aa0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:39.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.078+0000 7f2c4bc00640 1 --2- 172.21.15.103:0/3288076777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c4415c970 0x7f2c44157640 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:39.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.078+0000 7f2c4bc00640 1 --2- 172.21.15.103:0/3288076777 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c440cf790 0x7f2c441537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:39.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.078+0000 7f2c4bc00640 1 --2- 172.21.15.103:0/3288076777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c440cc120 0x7f2c44150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:39.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.078+0000 7f2c4bc00640 1 -- 172.21.15.103:0/3288076777 >> 172.21.15.103:0/3288076777 conn(0x7f2c4406cc00 msgr2=0x7f2c440afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:39.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.078+0000 7f2c4bc00640 1 -- 172.21.15.103:0/3288076777 shutdown_connections 2024-09-10T22:39:39.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.078+0000 7f2c4bc00640 1 -- 172.21.15.103:0/3288076777 wait complete. 2024-09-10T22:39:39.101 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T22:39:39.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.246+0000 7fcca1000640 1 -- 172.21.15.103:0/1364443205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc80003fe0 msgr2=0x7fcc80004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:39.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.246+0000 7fcca1000640 1 --2- 172.21.15.103:0/1364443205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc80003fe0 0x7fcc80004810 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcc8400c2e0 tx=0x7fcc8401cf50 comp rx=0 tx=0).stop 2024-09-10T22:39:39.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.246+0000 7fcc9a800640 1 -- 172.21.15.103:0/1364443205 reap_dead start 2024-09-10T22:39:39.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.246+0000 7fcca1000640 1 -- 172.21.15.103:0/1364443205 shutdown_connections 2024-09-10T22:39:39.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.246+0000 7fcca1000640 1 -- 172.21.15.103:0/1364443205 >> 172.21.15.103:0/1364443205 conn(0x7fcc9c06cc00 msgr2=0x7fcc9c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:39.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.246+0000 7fcca1000640 1 -- 172.21.15.103:0/1364443205 shutdown_connections 2024-09-10T22:39:39.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.246+0000 7fcca1000640 1 -- 172.21.15.103:0/1364443205 wait complete. 2024-09-10T22:39:39.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.246+0000 7fcca1000640 1 Processor -- start 2024-09-10T22:39:39.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.246+0000 7fcca1000640 1 -- start start 2024-09-10T22:39:39.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcca1000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc80003fe0 0x7fcc9c1fb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:39.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcca1000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc9c0af500 0x7fcc9c1f7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:39.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcca1000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9c15e640 0x7fcc9c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:39.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcca1000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9c1668a0 con 0x7fcc80003fe0 2024-09-10T22:39:39.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcca1000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9c0d00c0 con 0x7fcc9c15e640 2024-09-10T22:39:39.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcca1000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcc9c166a20 con 0x7fcc9c0af500 2024-09-10T22:39:39.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcc99e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc80003fe0 0x7fcc9c1fb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:39.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcc99e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc80003fe0 0x7fcc9c1fb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48424/0 (socket says 172.21.15.103:48424) 2024-09-10T22:39:39.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcc99e00640 1 -- 172.21.15.103:0/4192691802 learned_addr learned my addr 172.21.15.103:0/4192691802 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:39.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcc9a800640 1 --2- 172.21.15.103:0/4192691802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9c15e640 0x7fcc9c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:39.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcc91400640 1 --2- 172.21.15.103:0/4192691802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc9c0af500 0x7fcc9c1f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:39.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcc99e00640 1 -- 172.21.15.103:0/4192691802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc9c0af500 msgr2=0x7fcc9c1f7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:39.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcc99e00640 1 --2- 172.21.15.103:0/4192691802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc9c0af500 0x7fcc9c1f7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:39.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcc99e00640 1 -- 172.21.15.103:0/4192691802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9c15e640 msgr2=0x7fcc9c15eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:39.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcc99e00640 1 --2- 172.21.15.103:0/4192691802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9c15e640 0x7fcc9c15eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:39.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcc99e00640 1 -- 172.21.15.103:0/4192691802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9c1fbdf0 con 0x7fcc80003fe0 2024-09-10T22:39:39.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcc9a800640 1 --2- 172.21.15.103:0/4192691802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9c15e640 0x7fcc9c15eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:39.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcc99e00640 1 --2- 172.21.15.103:0/4192691802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc80003fe0 0x7fcc9c1fb8b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c011ae0 tx=0x7fcc8c009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:39.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcc92a00640 1 -- 172.21.15.103:0/4192691802 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c00fcd0 con 0x7fcc80003fe0 2024-09-10T22:39:39.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcc92a00640 1 -- 172.21.15.103:0/4192691802 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc8c00fe70 con 0x7fcc80003fe0 2024-09-10T22:39:39.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcca1000640 1 -- 172.21.15.103:0/4192691802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc9c1544e0 con 0x7fcc80003fe0 2024-09-10T22:39:39.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcc92a00640 1 -- 172.21.15.103:0/4192691802 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c004260 con 0x7fcc80003fe0 2024-09-10T22:39:39.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcca1000640 1 -- 172.21.15.103:0/4192691802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc9c155f20 con 0x7fcc80003fe0 2024-09-10T22:39:39.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.250+0000 7fcca1000640 1 -- 172.21.15.103:0/4192691802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc9c0aeb40 con 0x7fcc80003fe0 2024-09-10T22:39:39.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.254+0000 7fcc92a00640 1 -- 172.21.15.103:0/4192691802 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcc8c003600 con 0x7fcc80003fe0 2024-09-10T22:39:39.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.254+0000 7fcc92a00640 1 --2- 172.21.15.103:0/4192691802 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcc78072610 0x7fcc78074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:39.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.254+0000 7fcc92a00640 1 -- 172.21.15.103:0/4192691802 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6821+0+0 (secure 0 0 0) 0x7fcc8c094140 con 0x7fcc80003fe0 2024-09-10T22:39:39.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.254+0000 7fcc91400640 1 --2- 172.21.15.103:0/4192691802 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcc78072610 0x7fcc78074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:39.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.254+0000 7fcc91400640 1 --2- 172.21.15.103:0/4192691802 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcc78072610 0x7fcc78074ad0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcc840ac000 tx=0x7fcc84019d90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:39.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.258+0000 7fcc92a00640 1 -- 172.21.15.103:0/4192691802 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcc9c1fbdf0 con 0x7fcc80003fe0 2024-09-10T22:39:39.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:39.426+0000 7fcca1000640 1 -- 172.21.15.103:0/4192691802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcc9c15e120 con 0x7fcc80003fe0 2024-09-10T22:39:40.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.078+0000 7fcc92a00640 1 -- 172.21.15.103:0/4192691802 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) ==== 181+0+0 (secure 0 0 0) 0x7fcc8c05f3c0 con 0x7fcc80003fe0 2024-09-10T22:39:40.083 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2024-09-10T22:39:40.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.082+0000 7fcca1000640 1 -- 172.21.15.103:0/4192691802 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcc78072610 msgr2=0x7fcc78074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:40.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.082+0000 7fcca1000640 1 --2- 172.21.15.103:0/4192691802 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcc78072610 0x7fcc78074ad0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcc840ac000 tx=0x7fcc84019d90 comp rx=0 tx=0).stop 2024-09-10T22:39:40.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.082+0000 7fcca1000640 1 -- 172.21.15.103:0/4192691802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc80003fe0 msgr2=0x7fcc9c1fb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:40.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.082+0000 7fcca1000640 1 --2- 172.21.15.103:0/4192691802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc80003fe0 0x7fcc9c1fb8b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c011ae0 tx=0x7fcc8c009f20 comp rx=0 tx=0).stop 2024-09-10T22:39:40.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.082+0000 7fcca1000640 1 -- 172.21.15.103:0/4192691802 shutdown_connections 2024-09-10T22:39:40.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.082+0000 7fcca1000640 1 --2- 172.21.15.103:0/4192691802 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcc78072610 0x7fcc78074ad0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:40.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.082+0000 7fcca1000640 1 --2- 172.21.15.103:0/4192691802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9c15e640 0x7fcc9c15eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:40.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.082+0000 7fcca1000640 1 --2- 172.21.15.103:0/4192691802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc9c0af500 0x7fcc9c1f7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:40.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.082+0000 7fcca1000640 1 --2- 172.21.15.103:0/4192691802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc80003fe0 0x7fcc9c1fb8b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:40.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.082+0000 7fcca1000640 1 -- 172.21.15.103:0/4192691802 >> 172.21.15.103:0/4192691802 conn(0x7fcc9c06cc00 msgr2=0x7fcc9c06fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:40.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.082+0000 7fcca1000640 1 -- 172.21.15.103:0/4192691802 shutdown_connections 2024-09-10T22:39:40.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.086+0000 7fcca1000640 1 -- 172.21.15.103:0/4192691802 wait complete. 2024-09-10T22:39:40.111 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T22:39:40.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.254+0000 7fa164000640 1 -- 172.21.15.103:0/3743835576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa15c0cd080 msgr2=0x7fa15c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:40.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.254+0000 7fa164000640 1 --2- 172.21.15.103:0/3743835576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa15c0cd080 0x7fa15c06d1c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa15c0cd820 tx=0x7fa14801c800 comp rx=0 tx=0).stop 2024-09-10T22:39:40.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.254+0000 7fa164000640 1 -- 172.21.15.103:0/3743835576 shutdown_connections 2024-09-10T22:39:40.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.254+0000 7fa164000640 1 --2- 172.21.15.103:0/3743835576 >> v2:172.21.15.131:3300/0 conn(0x7fa15c0ad8f0 0x7fa15c06d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:40.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.254+0000 7fa164000640 1 --2- 172.21.15.103:0/3743835576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa15c0cd080 0x7fa15c06d1c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:40.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.254+0000 7fa164000640 1 -- 172.21.15.103:0/3743835576 >> 172.21.15.103:0/3743835576 conn(0x7fa15c0b1c00 msgr2=0x7fa15c0b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:40.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.254+0000 7fa164000640 1 -- 172.21.15.103:0/3743835576 shutdown_connections 2024-09-10T22:39:40.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.254+0000 7fa164000640 1 -- 172.21.15.103:0/3743835576 wait complete. 2024-09-10T22:39:40.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa164000640 1 Processor -- start 2024-09-10T22:39:40.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa164000640 1 -- start start 2024-09-10T22:39:40.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa164000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa15c0ad8f0 0x7fa15c0c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:40.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa164000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa15c0cd080 0x7fa15c0cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:40.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa164000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa15c15b9e0 0x7fa15c0ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:40.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa164000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c168f90 con 0x7fa15c0cd080 2024-09-10T22:39:40.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa164000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c168e10 con 0x7fa15c0ad8f0 2024-09-10T22:39:40.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa164000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa15c169110 con 0x7fa15c15b9e0 2024-09-10T22:39:40.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa160c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa15c0cd080 0x7fa15c0cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:40.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa160c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa15c0cd080 0x7fa15c0cbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48442/0 (socket says 172.21.15.103:48442) 2024-09-10T22:39:40.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa160c00640 1 -- 172.21.15.103:0/1248641363 learned_addr learned my addr 172.21.15.103:0/1248641363 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:40.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa162000640 1 --2- 172.21.15.103:0/1248641363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa15c15b9e0 0x7fa15c0ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:40.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa161600640 1 --2- 172.21.15.103:0/1248641363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa15c0ad8f0 0x7fa15c0c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:40.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa160c00640 1 -- 172.21.15.103:0/1248641363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa15c15b9e0 msgr2=0x7fa15c0ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:40.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa160c00640 1 --2- 172.21.15.103:0/1248641363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa15c15b9e0 0x7fa15c0ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:40.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa160c00640 1 -- 172.21.15.103:0/1248641363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa15c0ad8f0 msgr2=0x7fa15c0c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:40.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa160c00640 1 --2- 172.21.15.103:0/1248641363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa15c0ad8f0 0x7fa15c0c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:40.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa160c00640 1 -- 172.21.15.103:0/1248641363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15c156500 con 0x7fa15c0cd080 2024-09-10T22:39:40.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa161600640 1 --2- 172.21.15.103:0/1248641363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa15c0ad8f0 0x7fa15c0c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:39:40.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa160c00640 1 --2- 172.21.15.103:0/1248641363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa15c0cd080 0x7fa15c0cbc90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa148000c10 tx=0x7fa148004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:40.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa159600640 1 -- 172.21.15.103:0/1248641363 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa148004430 con 0x7fa15c0cd080 2024-09-10T22:39:40.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa159600640 1 -- 172.21.15.103:0/1248641363 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1480c0070 con 0x7fa15c0cd080 2024-09-10T22:39:40.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa159600640 1 -- 172.21.15.103:0/1248641363 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa148003930 con 0x7fa15c0cd080 2024-09-10T22:39:40.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa164000640 1 -- 172.21.15.103:0/1248641363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa15c1567e0 con 0x7fa15c0cd080 2024-09-10T22:39:40.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa164000640 1 -- 172.21.15.103:0/1248641363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa15c156da0 con 0x7fa15c0cd080 2024-09-10T22:39:40.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.258+0000 7fa164000640 1 -- 172.21.15.103:0/1248641363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa15c0cc970 con 0x7fa15c0cd080 2024-09-10T22:39:40.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.262+0000 7fa159600640 1 -- 172.21.15.103:0/1248641363 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa148003ad0 con 0x7fa15c0cd080 2024-09-10T22:39:40.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.262+0000 7fa159600640 1 --2- 172.21.15.103:0/1248641363 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa13c072610 0x7fa13c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:40.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.262+0000 7fa159600640 1 -- 172.21.15.103:0/1248641363 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6383+0+0 (secure 0 0 0) 0x7fa14812e8d0 con 0x7fa15c0cd080 2024-09-10T22:39:40.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.262+0000 7fa161600640 1 --2- 172.21.15.103:0/1248641363 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa13c072610 0x7fa13c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:40.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.262+0000 7fa161600640 1 --2- 172.21.15.103:0/1248641363 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa13c072610 0x7fa13c074ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa150002100 tx=0x7fa150009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:40.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.266+0000 7fa159600640 1 -- 172.21.15.103:0/1248641363 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa1480163f0 con 0x7fa15c0cd080 2024-09-10T22:39:40.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:40.434+0000 7fa164000640 1 -- 172.21.15.103:0/1248641363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa15c158da0 con 0x7fa15c0cd080 2024-09-10T22:39:41.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.082+0000 7fa159600640 1 -- 172.21.15.103:0/1248641363 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) ==== 169+0+0 (secure 0 0 0) 0x7fa1480f9c70 con 0x7fa15c0cd080 2024-09-10T22:39:41.086 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2024-09-10T22:39:41.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.086+0000 7fa164000640 1 -- 172.21.15.103:0/1248641363 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa13c072610 msgr2=0x7fa13c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:41.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.086+0000 7fa164000640 1 --2- 172.21.15.103:0/1248641363 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa13c072610 0x7fa13c074ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa150002100 tx=0x7fa150009040 comp rx=0 tx=0).stop 2024-09-10T22:39:41.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.086+0000 7fa164000640 1 -- 172.21.15.103:0/1248641363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa15c0cd080 msgr2=0x7fa15c0cbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:41.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.086+0000 7fa164000640 1 --2- 172.21.15.103:0/1248641363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa15c0cd080 0x7fa15c0cbc90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa148000c10 tx=0x7fa148004040 comp rx=0 tx=0).stop 2024-09-10T22:39:41.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.086+0000 7fa164000640 1 -- 172.21.15.103:0/1248641363 shutdown_connections 2024-09-10T22:39:41.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.086+0000 7fa164000640 1 --2- 172.21.15.103:0/1248641363 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa13c072610 0x7fa13c074ad0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:41.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.086+0000 7fa164000640 1 --2- 172.21.15.103:0/1248641363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa15c15b9e0 0x7fa15c0ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:41.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.086+0000 7fa164000640 1 --2- 172.21.15.103:0/1248641363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa15c0cd080 0x7fa15c0cbc90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:41.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.086+0000 7fa164000640 1 --2- 172.21.15.103:0/1248641363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa15c0ad8f0 0x7fa15c0c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:41.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.086+0000 7fa164000640 1 -- 172.21.15.103:0/1248641363 >> 172.21.15.103:0/1248641363 conn(0x7fa15c0b1c00 msgr2=0x7fa15c06faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:41.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.086+0000 7fa164000640 1 -- 172.21.15.103:0/1248641363 shutdown_connections 2024-09-10T22:39:41.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.086+0000 7fa164000640 1 -- 172.21.15.103:0/1248641363 wait complete. 2024-09-10T22:39:41.115 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-10T22:39:41.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.262+0000 7f950ce00640 1 -- 172.21.15.103:0/270303892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94ec004810 msgr2=0x7f94ec004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:41.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.262+0000 7f950ce00640 1 --2- 172.21.15.103:0/270303892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94ec004810 0x7f94ec004c90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f94f4001770 tx=0x7f94f401c860 comp rx=0 tx=0).stop 2024-09-10T22:39:41.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.262+0000 7f9507e00640 1 -- 172.21.15.103:0/270303892 reap_dead start 2024-09-10T22:39:41.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.262+0000 7f950ce00640 1 -- 172.21.15.103:0/270303892 shutdown_connections 2024-09-10T22:39:41.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.262+0000 7f950ce00640 1 -- 172.21.15.103:0/270303892 >> 172.21.15.103:0/270303892 conn(0x7f95080cff60 msgr2=0x7f95080d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:41.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.262+0000 7f950ce00640 1 -- 172.21.15.103:0/270303892 shutdown_connections 2024-09-10T22:39:41.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.262+0000 7f950ce00640 1 -- 172.21.15.103:0/270303892 wait complete. 2024-09-10T22:39:41.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f950ce00640 1 Processor -- start 2024-09-10T22:39:41.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f950ce00640 1 -- start start 2024-09-10T22:39:41.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f950ce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94ec004810 0x7f9508072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:41.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f950ce00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9508074850 0x7f95080cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:41.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f950ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95081658d0 0x7f9508165cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:41.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f950ce00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9508166a70 con 0x7f95081658d0 2024-09-10T22:39:41.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f950ce00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f95081668f0 con 0x7f94ec004810 2024-09-10T22:39:41.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f950ce00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9508166bf0 con 0x7f9508074850 2024-09-10T22:39:41.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f9507e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95081658d0 0x7f9508165cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:41.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f9507e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95081658d0 0x7f9508165cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48462/0 (socket says 172.21.15.103:48462) 2024-09-10T22:39:41.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f9507e00640 1 -- 172.21.15.103:0/1346912168 learned_addr learned my addr 172.21.15.103:0/1346912168 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:41.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f9507400640 1 --2- 172.21.15.103:0/1346912168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94ec004810 0x7f9508072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:41.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f9506a00640 1 --2- 172.21.15.103:0/1346912168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9508074850 0x7f95080cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:41.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f9507e00640 1 -- 172.21.15.103:0/1346912168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9508074850 msgr2=0x7f95080cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:41.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f9507e00640 1 --2- 172.21.15.103:0/1346912168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9508074850 0x7f95080cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:41.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f9507e00640 1 -- 172.21.15.103:0/1346912168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94ec004810 msgr2=0x7f9508072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:41.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f9507e00640 1 --2- 172.21.15.103:0/1346912168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94ec004810 0x7f9508072ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:41.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f9507e00640 1 -- 172.21.15.103:0/1346912168 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9508166230 con 0x7f95081658d0 2024-09-10T22:39:41.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f9507400640 1 --2- 172.21.15.103:0/1346912168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94ec004810 0x7f9508072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:39:41.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f9507e00640 1 --2- 172.21.15.103:0/1346912168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95081658d0 0x7f9508165cf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f95080c5fb0 tx=0x7f9500003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:41.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f94ff400640 1 -- 172.21.15.103:0/1346912168 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9500015070 con 0x7f95081658d0 2024-09-10T22:39:41.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f94ff400640 1 -- 172.21.15.103:0/1346912168 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9500011900 con 0x7f95081658d0 2024-09-10T22:39:41.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f950ce00640 1 -- 172.21.15.103:0/1346912168 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9508153da0 con 0x7f95081658d0 2024-09-10T22:39:41.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.266+0000 7f94ff400640 1 -- 172.21.15.103:0/1346912168 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f8009730 con 0x7f95081658d0 2024-09-10T22:39:41.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.270+0000 7f950ce00640 1 -- 172.21.15.103:0/1346912168 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9508154360 con 0x7f95081658d0 2024-09-10T22:39:41.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.270+0000 7f950ce00640 1 -- 172.21.15.103:0/1346912168 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95081511a0 con 0x7f95081658d0 2024-09-10T22:39:41.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.270+0000 7f94ff400640 1 -- 172.21.15.103:0/1346912168 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f95000103c0 con 0x7f95081658d0 2024-09-10T22:39:41.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.270+0000 7f94ff400640 1 --2- 172.21.15.103:0/1346912168 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f94e80725e0 0x7f94e8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:41.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.270+0000 7f94ff400640 1 -- 172.21.15.103:0/1346912168 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5853+0+0 (secure 0 0 0) 0x7f95000940e0 con 0x7f95081658d0 2024-09-10T22:39:41.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.270+0000 7f9507400640 1 --2- 172.21.15.103:0/1346912168 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f94e80725e0 0x7f94e8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:41.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.270+0000 7f9507400640 1 --2- 172.21.15.103:0/1346912168 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f94e80725e0 0x7f94e8074aa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f94f8012640 tx=0x7f94f80091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:41.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.274+0000 7f94ff400640 1 -- 172.21.15.103:0/1346912168 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f950815acf0 con 0x7f95081658d0 2024-09-10T22:39:41.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:41.442+0000 7f950ce00640 1 -- 172.21.15.103:0/1346912168 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9508159c40 con 0x7f95081658d0 2024-09-10T22:39:42.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:42.098+0000 7f94ff400640 1 -- 172.21.15.103:0/1346912168 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) ==== 178+0+0 (secure 0 0 0) 0x7f950005f0d0 con 0x7f95081658d0 2024-09-10T22:39:42.102 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data_ec' removed 2024-09-10T22:39:42.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:42.102+0000 7f950ce00640 1 -- 172.21.15.103:0/1346912168 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f94e80725e0 msgr2=0x7f94e8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:42.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:42.102+0000 7f950ce00640 1 --2- 172.21.15.103:0/1346912168 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f94e80725e0 0x7f94e8074aa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f94f8012640 tx=0x7f94f80091e0 comp rx=0 tx=0).stop 2024-09-10T22:39:42.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:42.102+0000 7f950ce00640 1 -- 172.21.15.103:0/1346912168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95081658d0 msgr2=0x7f9508165cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:42.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:42.102+0000 7f950ce00640 1 --2- 172.21.15.103:0/1346912168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95081658d0 0x7f9508165cf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f95080c5fb0 tx=0x7f9500003f90 comp rx=0 tx=0).stop 2024-09-10T22:39:42.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:42.102+0000 7f950ce00640 1 -- 172.21.15.103:0/1346912168 shutdown_connections 2024-09-10T22:39:42.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:42.102+0000 7f950ce00640 1 --2- 172.21.15.103:0/1346912168 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f94e80725e0 0x7f94e8074aa0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:42.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:42.102+0000 7f950ce00640 1 --2- 172.21.15.103:0/1346912168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95081658d0 0x7f9508165cf0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:42.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:42.102+0000 7f950ce00640 1 --2- 172.21.15.103:0/1346912168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9508074850 0x7f95080cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:42.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:42.102+0000 7f950ce00640 1 --2- 172.21.15.103:0/1346912168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94ec004810 0x7f9508072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:42.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:42.102+0000 7f950ce00640 1 -- 172.21.15.103:0/1346912168 >> 172.21.15.103:0/1346912168 conn(0x7f95080cff60 msgr2=0x7f950815f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:42.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:42.102+0000 7f950ce00640 1 -- 172.21.15.103:0/1346912168 shutdown_connections 2024-09-10T22:39:42.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:42.102+0000 7f950ce00640 1 -- 172.21.15.103:0/1346912168 wait complete. 2024-09-10T22:39:42.133 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T22:39:42.133 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T22:39:42.133 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T22:39:42.133 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:39:42.133 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T22:39:42.133 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T22:39:42.134 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T22:39:42.134 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:39:42.134 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T22:39:42.134 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T22:39:42.134 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T22:39:42.134 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:39:42.134 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T22:39:42.135 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T22:39:42.135 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T22:39:42.135 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:39:42.146 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T22:39:42.334 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T22:39:42.382 INFO:tasks.ceph.mds.a:Started 2024-09-10T22:39:42.382 DEBUG:teuthology.parallel:result is None 2024-09-10T22:39:42.466 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-09-10T22:39:46.444 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:39:46.448 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:39:46.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-10T22:39:46.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-10T22:39:46.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-10T22:39:48.335 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T22:39:48.336 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T22:39:48.336 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T22:39:48.336 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T22:39:48.337 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T22:39:48.337 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T22:39:48.340 INFO:tasks.ceph.mds.b:Started 2024-09-10T22:39:48.340 DEBUG:teuthology.parallel:result is None 2024-09-10T22:39:48.341 INFO:tasks.ceph.mds.c:Started 2024-09-10T22:39:48.341 DEBUG:teuthology.parallel:result is None 2024-09-10T22:39:48.342 INFO:tasks.ceph.mds.d:Started 2024-09-10T22:39:48.342 DEBUG:teuthology.parallel:result is None 2024-09-10T22:39:48.342 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T22:39:48.434 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2024-09-10T22:39:48.434 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-09-10T22:39:48.435 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2024-09-10T22:39:48.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe44be00640 1 -- 172.21.15.103:0/1578505012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4440b3150 msgr2=0x7fe444072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:48.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe44be00640 1 --2- 172.21.15.103:0/1578505012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4440b3150 0x7fe444072500 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe444070730 tx=0x7fe43001c8c0 comp rx=0 tx=0).stop 2024-09-10T22:39:48.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe44be00640 1 -- 172.21.15.103:0/1578505012 shutdown_connections 2024-09-10T22:39:48.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe44be00640 1 --2- 172.21.15.103:0/1578505012 >> v2:172.21.15.131:3300/0 conn(0x7fe444072a40 0x7fe444157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:48.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe44be00640 1 --2- 172.21.15.103:0/1578505012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4440b3150 0x7fe444072500 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:48.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe44be00640 1 --2- 172.21.15.103:0/1578505012 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4440cf260 0x7fe4440b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:48.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe44be00640 1 -- 172.21.15.103:0/1578505012 >> 172.21.15.103:0/1578505012 conn(0x7fe44406cc00 msgr2=0x7fe44406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:48.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe44be00640 1 -- 172.21.15.103:0/1578505012 shutdown_connections 2024-09-10T22:39:48.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe44be00640 1 -- 172.21.15.103:0/1578505012 wait complete. 2024-09-10T22:39:48.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe44be00640 1 Processor -- start 2024-09-10T22:39:48.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe44be00640 1 -- start start 2024-09-10T22:39:48.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe44be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe444072a40 0x7fe44406ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:48.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe44be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4440b3150 0x7fe444144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:48.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe44be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4440cf260 0x7fe444145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:48.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe44be00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe444157a10 con 0x7fe4440b3150 2024-09-10T22:39:48.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe44be00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe444157890 con 0x7fe444072a40 2024-09-10T22:39:48.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe44be00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe444157b90 con 0x7fe4440cf260 2024-09-10T22:39:48.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe448a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4440b3150 0x7fe444144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:48.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe448a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4440b3150 0x7fe444144ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57124/0 (socket says 172.21.15.103:57124) 2024-09-10T22:39:48.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe448a00640 1 -- 172.21.15.103:0/2043837045 learned_addr learned my addr 172.21.15.103:0/2043837045 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:48.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe449400640 1 --2- 172.21.15.103:0/2043837045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe444072a40 0x7fe44406ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:48.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe449e00640 1 --2- 172.21.15.103:0/2043837045 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4440cf260 0x7fe444145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:48.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe448a00640 1 -- 172.21.15.103:0/2043837045 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4440cf260 msgr2=0x7fe444145420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:48.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe448a00640 1 --2- 172.21.15.103:0/2043837045 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4440cf260 0x7fe444145420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:48.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe448a00640 1 -- 172.21.15.103:0/2043837045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe444072a40 msgr2=0x7fe44406ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:48.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe448a00640 1 --2- 172.21.15.103:0/2043837045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe444072a40 0x7fe44406ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:48.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe448a00640 1 -- 172.21.15.103:0/2043837045 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe444153340 con 0x7fe4440b3150 2024-09-10T22:39:48.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.494+0000 7fe449e00640 1 --2- 172.21.15.103:0/2043837045 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4440cf260 0x7fe444145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:48.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.498+0000 7fe448a00640 1 --2- 172.21.15.103:0/2043837045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4440b3150 0x7fe444144ee0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe4300b0040 tx=0x7fe4300a5630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:48.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.498+0000 7fe441600640 1 -- 172.21.15.103:0/2043837045 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4300b2040 con 0x7fe4440b3150 2024-09-10T22:39:48.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.498+0000 7fe441600640 1 -- 172.21.15.103:0/2043837045 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4300043a0 con 0x7fe4440b3150 2024-09-10T22:39:48.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.498+0000 7fe44be00640 1 -- 172.21.15.103:0/2043837045 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe444153620 con 0x7fe4440b3150 2024-09-10T22:39:48.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.498+0000 7fe441600640 1 -- 172.21.15.103:0/2043837045 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe430005290 con 0x7fe4440b3150 2024-09-10T22:39:48.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.498+0000 7fe44be00640 1 -- 172.21.15.103:0/2043837045 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe44415d6a0 con 0x7fe4440b3150 2024-09-10T22:39:48.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.498+0000 7fe44be00640 1 -- 172.21.15.103:0/2043837045 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe444072500 con 0x7fe4440b3150 2024-09-10T22:39:48.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.498+0000 7fe441600640 1 -- 172.21.15.103:0/2043837045 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe430005430 con 0x7fe4440b3150 2024-09-10T22:39:48.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.498+0000 7fe441600640 1 --2- 172.21.15.103:0/2043837045 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4240725e0 0x7fe424074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:48.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.498+0000 7fe441600640 1 -- 172.21.15.103:0/2043837045 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5335+0+0 (secure 0 0 0) 0x7fe43012cc60 con 0x7fe4440b3150 2024-09-10T22:39:48.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.502+0000 7fe449400640 1 --2- 172.21.15.103:0/2043837045 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4240725e0 0x7fe424074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:48.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.502+0000 7fe449400640 1 --2- 172.21.15.103:0/2043837045 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4240725e0 0x7fe424074aa0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe438004630 tx=0x7fe43800b2e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:48.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.502+0000 7fe441600640 1 -- 172.21.15.103:0/2043837045 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe4300164b0 con 0x7fe4440b3150 2024-09-10T22:39:48.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:48.682+0000 7fe44be00640 1 -- 172.21.15.103:0/2043837045 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe444154d40 con 0x7fe4440b3150 2024-09-10T22:39:49.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.134+0000 7fe441600640 1 -- 172.21.15.103:0/2043837045 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v36) ==== 97+0+0 (secure 0 0 0) 0x7fe4300f8420 con 0x7fe4440b3150 2024-09-10T22:39:49.137 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blocklist entries 2024-09-10T22:39:49.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.134+0000 7fe44be00640 1 -- 172.21.15.103:0/2043837045 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4240725e0 msgr2=0x7fe424074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:49.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.134+0000 7fe44be00640 1 --2- 172.21.15.103:0/2043837045 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4240725e0 0x7fe424074aa0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe438004630 tx=0x7fe43800b2e0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.134+0000 7fe44be00640 1 -- 172.21.15.103:0/2043837045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4440b3150 msgr2=0x7fe444144ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.134+0000 7fe44be00640 1 --2- 172.21.15.103:0/2043837045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4440b3150 0x7fe444144ee0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe4300b0040 tx=0x7fe4300a5630 comp rx=0 tx=0).stop 2024-09-10T22:39:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.134+0000 7fe44be00640 1 -- 172.21.15.103:0/2043837045 shutdown_connections 2024-09-10T22:39:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.134+0000 7fe44be00640 1 --2- 172.21.15.103:0/2043837045 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4240725e0 0x7fe424074aa0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.134+0000 7fe44be00640 1 --2- 172.21.15.103:0/2043837045 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4440cf260 0x7fe444145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.134+0000 7fe44be00640 1 --2- 172.21.15.103:0/2043837045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4440b3150 0x7fe444144ee0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.134+0000 7fe44be00640 1 --2- 172.21.15.103:0/2043837045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe444072a40 0x7fe44406ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.134+0000 7fe44be00640 1 -- 172.21.15.103:0/2043837045 >> 172.21.15.103:0/2043837045 conn(0x7fe44406cc00 msgr2=0x7fe44415aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.138+0000 7fe44be00640 1 -- 172.21.15.103:0/2043837045 shutdown_connections 2024-09-10T22:39:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.138+0000 7fe44be00640 1 -- 172.21.15.103:0/2043837045 wait complete. 2024-09-10T22:39:49.161 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T22:39:49.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.298+0000 7f0f9ce00640 1 -- 172.21.15.103:0/2117845249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f7c004da0 msgr2=0x7f0f7c005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:49.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.298+0000 7f0f9ce00640 1 --2- 172.21.15.103:0/2117845249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f7c004da0 0x7f0f7c005220 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0f90001860 tx=0x7f0f9001c8e0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.298+0000 7f0f96800640 1 -- 172.21.15.103:0/2117845249 reap_dead start 2024-09-10T22:39:49.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.298+0000 7f0f9ce00640 1 -- 172.21.15.103:0/2117845249 shutdown_connections 2024-09-10T22:39:49.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.298+0000 7f0f9ce00640 1 -- 172.21.15.103:0/2117845249 >> 172.21.15.103:0/2117845249 conn(0x7f0f9806cc00 msgr2=0x7f0f9806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:49.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.298+0000 7f0f9ce00640 1 -- 172.21.15.103:0/2117845249 shutdown_connections 2024-09-10T22:39:49.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.298+0000 7f0f9ce00640 1 -- 172.21.15.103:0/2117845249 wait complete. 2024-09-10T22:39:49.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f9ce00640 1 Processor -- start 2024-09-10T22:39:49.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f9ce00640 1 -- start start 2024-09-10T22:39:49.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f9ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f7c004da0 0x7f0f9813fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:49.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f9ce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f981f7ce0 0x7f0f981f8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:49.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f9ce00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f98141f60 0x7f0f981423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:49.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f9ce00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0f98072680 con 0x7f0f7c004da0 2024-09-10T22:39:49.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f9ce00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0f98072500 con 0x7f0f981f7ce0 2024-09-10T22:39:49.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f9ce00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0f98072800 con 0x7f0f98141f60 2024-09-10T22:39:49.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f95e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f7c004da0 0x7f0f9813fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:49.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f95400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f981f7ce0 0x7f0f981f8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:49.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f95e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f7c004da0 0x7f0f9813fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57142/0 (socket says 172.21.15.103:57142) 2024-09-10T22:39:49.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f95e00640 1 -- 172.21.15.103:0/3045575978 learned_addr learned my addr 172.21.15.103:0/3045575978 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:49.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f96800640 1 --2- 172.21.15.103:0/3045575978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f98141f60 0x7f0f981423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:49.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f95400640 1 -- 172.21.15.103:0/3045575978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f98141f60 msgr2=0x7f0f981423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:49.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f95400640 1 --2- 172.21.15.103:0/3045575978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f98141f60 0x7f0f981423e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f95400640 1 -- 172.21.15.103:0/3045575978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f7c004da0 msgr2=0x7f0f9813fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:49.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f95400640 1 --2- 172.21.15.103:0/3045575978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f7c004da0 0x7f0f9813fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f95400640 1 -- 172.21.15.103:0/3045575978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f981f8b10 con 0x7f0f981f7ce0 2024-09-10T22:39:49.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f95e00640 1 --2- 172.21.15.103:0/3045575978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f7c004da0 0x7f0f9813fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:39:49.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f95400640 1 --2- 172.21.15.103:0/3045575978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f981f7ce0 0x7f0f981f8140 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0f980b4f10 tx=0x7f0f8400eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:49.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.302+0000 7f0f8e000640 1 -- 172.21.15.103:0/3045575978 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f84004260 con 0x7f0f981f7ce0 2024-09-10T22:39:49.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.306+0000 7f0f8e000640 1 -- 172.21.15.103:0/3045575978 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f84004400 con 0x7f0f981f7ce0 2024-09-10T22:39:49.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.306+0000 7f0f8e000640 1 -- 172.21.15.103:0/3045575978 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8400dc20 con 0x7f0f981f7ce0 2024-09-10T22:39:49.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.306+0000 7f0f9ce00640 1 -- 172.21.15.103:0/3045575978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f9815be90 con 0x7f0f981f7ce0 2024-09-10T22:39:49.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.306+0000 7f0f9ce00640 1 -- 172.21.15.103:0/3045575978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f9815c450 con 0x7f0f981f7ce0 2024-09-10T22:39:49.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.306+0000 7f0f9ce00640 1 -- 172.21.15.103:0/3045575978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f980cfaf0 con 0x7f0f981f7ce0 2024-09-10T22:39:49.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.306+0000 7f0f8e000640 1 -- 172.21.15.103:0/3045575978 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0f8400b040 con 0x7f0f981f7ce0 2024-09-10T22:39:49.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.306+0000 7f0f8e000640 1 --2- 172.21.15.103:0/3045575978 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f780725e0 0x7f0f78074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:49.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.306+0000 7f0f8e000640 1 -- 172.21.15.103:0/3045575978 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f0f84093ba0 con 0x7f0f981f7ce0 2024-09-10T22:39:49.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.306+0000 7f0f95e00640 1 --2- 172.21.15.103:0/3045575978 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f780725e0 0x7f0f78074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:49.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.310+0000 7f0f95e00640 1 --2- 172.21.15.103:0/3045575978 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f780725e0 0x7f0f78074aa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0f88006aa0 tx=0x7f0f88006f60 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:49.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.310+0000 7f0f8e000640 1 -- 172.21.15.103:0/3045575978 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0f84093e20 con 0x7f0f981f7ce0 2024-09-10T22:39:49.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.534+0000 7f0f9ce00640 1 -- 172.21.15.103:0/3045575978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f0f980b0d80 con 0x7f0f981f7ce0 2024-09-10T22:39:49.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.538+0000 7f0f8e000640 1 -- 172.21.15.103:0/3045575978 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7f0f8405edd0 con 0x7f0f981f7ce0 2024-09-10T22:39:49.540 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:49.540 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:39:49.540 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2024-09-10T22:39:49.541 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.541 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2024-09-10T22:39:49.541 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmh8HQHBAAZlp4CnHLegqhgWrgXoyltw==", 2024-09-10T22:39:49.541 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.541 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:39:49.541 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:39:49.541 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:39:49.541 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:39:49.541 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.541 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.541 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2024-09-10T22:39:49.541 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmpYUNKRAAstv0pZDy3081UKcsSWnWIg==", 2024-09-10T22:39:49.541 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.542 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:39:49.542 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:39:49.542 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:39:49.542 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:39:49.542 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.542 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.542 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.542 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.c", 2024-09-10T22:39:49.542 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBm8I0TJBAAmW480qKYYrolVm7+SlJ97w==", 2024-09-10T22:39:49.542 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.542 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:39:49.542 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:39:49.542 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:39:49.542 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:39:49.543 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.543 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.d", 2024-09-10T22:39:49.543 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmB55uMBAA1VqVuUEAk1i2LFBoZXiRmA==", 2024-09-10T22:39:49.543 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.543 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:39:49.543 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:39:49.543 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:39:49.543 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:39:49.543 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.543 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2024-09-10T22:39:49.544 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA/yuBm+fNzNRAAwt8IZXd3mcEh5UbXc924UQ==", 2024-09-10T22:39:49.544 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.544 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:39:49.544 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:39:49.544 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:39:49.544 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.544 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.544 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2024-09-10T22:39:49.544 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBDyuBmNBfvDhAAcBNATtrJNZ4RFzYXqWt2pg==", 2024-09-10T22:39:49.544 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.544 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:39:49.544 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:39:49.544 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:39:49.545 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.545 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.545 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.545 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2024-09-10T22:39:49.545 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBGyuBmJD9HJBAAgq8tqoeDT8WNr7pMxQCCJw==", 2024-09-10T22:39:49.545 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.545 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:39:49.545 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:39:49.545 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:39:49.545 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.545 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.545 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.545 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2024-09-10T22:39:49.546 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBJyuBmzxWIOhAA4yOLmTZAY0MRLj+w3mhCeQ==", 2024-09-10T22:39:49.546 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.546 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:39:49.546 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:39:49.546 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:39:49.546 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.546 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.546 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.546 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2024-09-10T22:39:49.546 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBQyuBm3pi6ABAAnwu13uYkLRJuU5y+DE2Isw==", 2024-09-10T22:39:49.546 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.546 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:39:49.546 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:39:49.547 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:39:49.547 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.547 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2024-09-10T22:39:49.547 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBTyuBmkaPVFhAALlwgsnQ/dUJVLTK2iAh6Ww==", 2024-09-10T22:39:49.547 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.547 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:39:49.547 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:39:49.547 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:39:49.547 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.548 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2024-09-10T22:39:49.548 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBWyuBmL2kKKxAAbxeyAuzd994tvNfKKs+WIA==", 2024-09-10T22:39:49.548 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.548 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:39:49.548 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:39:49.548 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:39:49.548 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.548 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.549 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2024-09-10T22:39:49.549 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBayuBmUmSwBBAAWTFVgtYXlyEI+rJzGIM+Aw==", 2024-09-10T22:39:49.549 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.549 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:39:49.549 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:39:49.549 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:39:49.549 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.549 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.549 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2024-09-10T22:39:49.549 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmtOhZNBAAeszxWpV60NIn/zOInT5Zzw==", 2024-09-10T22:39:49.549 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.549 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:39:49.549 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:39:49.550 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:39:49.550 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:39:49.550 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.550 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.550 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2024-09-10T22:39:49.550 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9yuBmu20iAhAASacT/hh3sxW1XU/XD6uDjA==", 2024-09-10T22:39:49.550 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.550 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:39:49.550 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:39:49.550 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:39:49.550 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:39:49.550 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.551 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.551 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2024-09-10T22:39:49.551 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmd1E5OhAAfidEn8dwfGna8gwefsYtUg==", 2024-09-10T22:39:49.551 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.551 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:39:49.551 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:39:49.551 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:39:49.551 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:39:49.551 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.551 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.551 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.551 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2024-09-10T22:39:49.551 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9yuBmGGhVCBAAAs3y0cfqMN0t0/PTNsVEQw==", 2024-09-10T22:39:49.551 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.552 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:39:49.552 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:39:49.552 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:39:49.552 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:39:49.552 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.552 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.552 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.552 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2024-09-10T22:39:49.553 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmsY75ABAAYeEF+hTiVUtmqzwU0IIpjA==", 2024-09-10T22:39:49.553 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.553 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-09-10T22:39:49.553 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:39:49.553 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:39:49.553 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:39:49.553 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.553 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.553 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.bootstrap-mds", 2024-09-10T22:39:49.553 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBgyuBmgCSHERAAjOJ0JJQOuq4Rmb5eRGzolw==", 2024-09-10T22:39:49.553 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.553 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile bootstrap-mds" 2024-09-10T22:39:49.553 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.554 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.bootstrap-mgr", 2024-09-10T22:39:49.554 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBgyuBmqjeHERAAv5PhM2YvW7ibhgwbfdMZ3g==", 2024-09-10T22:39:49.554 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.554 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-10T22:39:49.554 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.554 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.bootstrap-osd", 2024-09-10T22:39:49.554 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBgyuBmNUeHERAAYvxHAVfIZjALa9evgJe4FA==", 2024-09-10T22:39:49.554 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.554 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile bootstrap-osd" 2024-09-10T22:39:49.554 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.555 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.555 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.bootstrap-rbd", 2024-09-10T22:39:49.555 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBgyuBm2FqHERAAddzNncN51d1qA3D1Ia7yPg==", 2024-09-10T22:39:49.555 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.555 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-10T22:39:49.555 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.555 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.555 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-10T22:39:49.556 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBgyuBmG2qHERAAEvAACJDAJ+bcnTiacQR1cw==", 2024-09-10T22:39:49.556 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.556 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-10T22:39:49.556 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.556 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.bootstrap-rgw", 2024-09-10T22:39:49.556 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBgyuBm7XmHERAAbc6BobrkBZbXF6114S+/bA==", 2024-09-10T22:39:49.556 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.556 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-10T22:39:49.556 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.557 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2024-09-10T22:39:49.557 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmghJQGBAAXvlC58nhT9H/c71/ToGCSw==", 2024-09-10T22:39:49.557 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.557 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-09-10T22:39:49.557 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2024-09-10T22:39:49.557 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:39:49.557 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:39:49.557 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:49.557 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2024-09-10T22:39:49.557 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBma9x+FBAAQrKkw3eGcKnLxSqVz/DHJQ==", 2024-09-10T22:39:49.557 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:39:49.557 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-09-10T22:39:49.557 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2024-09-10T22:39:49.558 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:39:49.558 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.558 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:49.558 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T22:39:49.558 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:39:49.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.538+0000 7f0f9ce00640 1 -- 172.21.15.103:0/3045575978 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f780725e0 msgr2=0x7f0f78074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:49.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.538+0000 7f0f9ce00640 1 --2- 172.21.15.103:0/3045575978 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f780725e0 0x7f0f78074aa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0f88006aa0 tx=0x7f0f88006f60 comp rx=0 tx=0).stop 2024-09-10T22:39:49.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.538+0000 7f0f9ce00640 1 -- 172.21.15.103:0/3045575978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f981f7ce0 msgr2=0x7f0f981f8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:49.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.538+0000 7f0f9ce00640 1 --2- 172.21.15.103:0/3045575978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f981f7ce0 0x7f0f981f8140 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0f980b4f10 tx=0x7f0f8400eed0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.538+0000 7f0f9ce00640 1 -- 172.21.15.103:0/3045575978 shutdown_connections 2024-09-10T22:39:49.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.538+0000 7f0f9ce00640 1 --2- 172.21.15.103:0/3045575978 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f780725e0 0x7f0f78074aa0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.538+0000 7f0f9ce00640 1 --2- 172.21.15.103:0/3045575978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f98141f60 0x7f0f981423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.538+0000 7f0f9ce00640 1 --2- 172.21.15.103:0/3045575978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f981f7ce0 0x7f0f981f8140 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.538+0000 7f0f9ce00640 1 --2- 172.21.15.103:0/3045575978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f7c004da0 0x7f0f9813fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.538+0000 7f0f9ce00640 1 -- 172.21.15.103:0/3045575978 >> 172.21.15.103:0/3045575978 conn(0x7f0f9806cc00 msgr2=0x7f0f98159360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.538+0000 7f0f9ce00640 1 -- 172.21.15.103:0/3045575978 shutdown_connections 2024-09-10T22:39:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.538+0000 7f0f9ce00640 1 -- 172.21.15.103:0/3045575978 wait complete. 2024-09-10T22:39:49.561 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-10T22:39:49.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82dda00640 1 -- 172.21.15.103:0/3258531316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82bc004810 msgr2=0x7f82bc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:49.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82dda00640 1 --2- 172.21.15.103:0/3258531316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82bc004810 0x7f82bc004c90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f82c000c310 tx=0x7f82c001f680 comp rx=0 tx=0).stop 2024-09-10T22:39:49.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82dda00640 1 -- 172.21.15.103:0/3258531316 shutdown_connections 2024-09-10T22:39:49.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82dda00640 1 --2- 172.21.15.103:0/3258531316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82bc004810 0x7f82bc004c90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82dda00640 1 -- 172.21.15.103:0/3258531316 >> 172.21.15.103:0/3258531316 conn(0x7f82d806cc00 msgr2=0x7f82d806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:49.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82dda00640 1 -- 172.21.15.103:0/3258531316 shutdown_connections 2024-09-10T22:39:49.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82dda00640 1 -- 172.21.15.103:0/3258531316 wait complete. 2024-09-10T22:39:49.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82dda00640 1 Processor -- start 2024-09-10T22:39:49.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82dda00640 1 -- start start 2024-09-10T22:39:49.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82dda00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82bc004810 0x7f82d8156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:49.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82dda00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d81e9460 0x7f82d8155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:49.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82dda00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82d8157b50 0x7f82d81eb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:49.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82dda00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f82d806ef60 con 0x7f82bc004810 2024-09-10T22:39:49.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82dda00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f82d806ede0 con 0x7f82d81e9460 2024-09-10T22:39:49.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82dda00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f82d806f0e0 con 0x7f82d8157b50 2024-09-10T22:39:49.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82d6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82bc004810 0x7f82d8156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:49.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82d6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82bc004810 0x7f82d8156e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57158/0 (socket says 172.21.15.103:57158) 2024-09-10T22:39:49.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82d6a00640 1 -- 172.21.15.103:0/853785784 learned_addr learned my addr 172.21.15.103:0/853785784 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:49.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82d7400640 1 --2- 172.21.15.103:0/853785784 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82d8157b50 0x7f82d81eb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:49.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82d6a00640 1 -- 172.21.15.103:0/853785784 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82d8157b50 msgr2=0x7f82d81eb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:49.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82ce000640 1 --2- 172.21.15.103:0/853785784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d81e9460 0x7f82d8155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:49.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82d6a00640 1 --2- 172.21.15.103:0/853785784 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82d8157b50 0x7f82d81eb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82d6a00640 1 -- 172.21.15.103:0/853785784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d81e9460 msgr2=0x7f82d8155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:49.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82d6a00640 1 --2- 172.21.15.103:0/853785784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d81e9460 0x7f82d8155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82d6a00640 1 -- 172.21.15.103:0/853785784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d81f4d20 con 0x7f82bc004810 2024-09-10T22:39:49.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82ce000640 1 --2- 172.21.15.103:0/853785784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d81e9460 0x7f82d8155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:39:49.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.702+0000 7f82d7400640 1 --2- 172.21.15.103:0/853785784 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82d8157b50 0x7f82d81eb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:39:49.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.706+0000 7f82d6a00640 1 --2- 172.21.15.103:0/853785784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82bc004810 0x7f82d8156e60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f82c8002200 tx=0x7f82c80064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:49.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.706+0000 7f82cf400640 1 -- 172.21.15.103:0/853785784 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c8015070 con 0x7f82bc004810 2024-09-10T22:39:49.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.706+0000 7f82cf400640 1 -- 172.21.15.103:0/853785784 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82c800fa60 con 0x7f82bc004810 2024-09-10T22:39:49.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.706+0000 7f82cf400640 1 -- 172.21.15.103:0/853785784 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c8011430 con 0x7f82bc004810 2024-09-10T22:39:49.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.706+0000 7f82dda00640 1 -- 172.21.15.103:0/853785784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d81f5000 con 0x7f82bc004810 2024-09-10T22:39:49.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.706+0000 7f82dda00640 1 -- 172.21.15.103:0/853785784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d81f55c0 con 0x7f82bc004810 2024-09-10T22:39:49.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.706+0000 7f82dda00640 1 -- 172.21.15.103:0/853785784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d80736f0 con 0x7f82bc004810 2024-09-10T22:39:49.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.706+0000 7f82cf400640 1 -- 172.21.15.103:0/853785784 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f82c80115d0 con 0x7f82bc004810 2024-09-10T22:39:49.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.706+0000 7f82cf400640 1 --2- 172.21.15.103:0/853785784 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f82b4072610 0x7f82b4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:49.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.710+0000 7f82cf400640 1 -- 172.21.15.103:0/853785784 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f82c8093f10 con 0x7f82bc004810 2024-09-10T22:39:49.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.710+0000 7f82ce000640 1 --2- 172.21.15.103:0/853785784 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f82b4072610 0x7f82b4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:49.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.710+0000 7f82ce000640 1 --2- 172.21.15.103:0/853785784 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f82b4072610 0x7f82b4074ad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f82c00b0000 tx=0x7f82c001c4c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:49.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.714+0000 7f82cf400640 1 -- 172.21.15.103:0/853785784 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f82c805f710 con 0x7f82bc004810 2024-09-10T22:39:49.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.934+0000 7f82dda00640 1 -- 172.21.15.103:0/853785784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f82d806ae30 con 0x7f82bc004810 2024-09-10T22:39:49.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.938+0000 7f82cf400640 1 -- 172.21.15.103:0/853785784 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f82c805f010 con 0x7f82bc004810 2024-09-10T22:39:49.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.942+0000 7f82dda00640 1 -- 172.21.15.103:0/853785784 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f82b4072610 msgr2=0x7f82b4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:49.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.942+0000 7f82dda00640 1 --2- 172.21.15.103:0/853785784 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f82b4072610 0x7f82b4074ad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f82c00b0000 tx=0x7f82c001c4c0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.942+0000 7f82dda00640 1 -- 172.21.15.103:0/853785784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82bc004810 msgr2=0x7f82d8156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:49.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.942+0000 7f82dda00640 1 --2- 172.21.15.103:0/853785784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82bc004810 0x7f82d8156e60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f82c8002200 tx=0x7f82c80064f0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.942+0000 7f82dda00640 1 -- 172.21.15.103:0/853785784 shutdown_connections 2024-09-10T22:39:49.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.942+0000 7f82dda00640 1 --2- 172.21.15.103:0/853785784 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f82b4072610 0x7f82b4074ad0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.942+0000 7f82dda00640 1 --2- 172.21.15.103:0/853785784 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82d8157b50 0x7f82d81eb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.942+0000 7f82dda00640 1 --2- 172.21.15.103:0/853785784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d81e9460 0x7f82d8155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.942+0000 7f82dda00640 1 --2- 172.21.15.103:0/853785784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82bc004810 0x7f82d8156e60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:49.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.942+0000 7f82dda00640 1 -- 172.21.15.103:0/853785784 >> 172.21.15.103:0/853785784 conn(0x7f82d806cc00 msgr2=0x7f82d8072500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:49.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.942+0000 7f82dda00640 1 -- 172.21.15.103:0/853785784 shutdown_connections 2024-09-10T22:39:49.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:49.942+0000 7f82dda00640 1 -- 172.21.15.103:0/853785784 wait complete. 2024-09-10T22:39:49.964 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-10T22:39:50.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.102+0000 7f4ef0400640 1 -- 172.21.15.103:0/1922202975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80b09c0 msgr2=0x7f4ee80ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:50.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.102+0000 7f4ef0400640 1 --2- 172.21.15.103:0/1922202975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80b09c0 0x7f4ee80ce7d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80d1590 tx=0x7f4ed401c830 comp rx=0 tx=0).stop 2024-09-10T22:39:50.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.102+0000 7f4ef0400640 1 -- 172.21.15.103:0/1922202975 shutdown_connections 2024-09-10T22:39:50.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.102+0000 7f4ef0400640 1 --2- 172.21.15.103:0/1922202975 >> v2:172.21.15.131:3300/0 conn(0x7f4ee80ae9c0 0x7f4ee80aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.102+0000 7f4ef0400640 1 --2- 172.21.15.103:0/1922202975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80b09c0 0x7f4ee80ce7d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.102+0000 7f4ef0400640 1 -- 172.21.15.103:0/1922202975 >> 172.21.15.103:0/1922202975 conn(0x7f4ee80d1ac0 msgr2=0x7f4ee80d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:50.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.102+0000 7f4ef0400640 1 -- 172.21.15.103:0/1922202975 shutdown_connections 2024-09-10T22:39:50.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.102+0000 7f4ef0400640 1 -- 172.21.15.103:0/1922202975 wait complete. 2024-09-10T22:39:50.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.102+0000 7f4ef0400640 1 Processor -- start 2024-09-10T22:39:50.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.102+0000 7f4ef0400640 1 -- start start 2024-09-10T22:39:50.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4ef0400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee80ae9c0 0x7f4ee8070c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:50.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4ef0400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee80b09c0 0x7f4ee8071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:50.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4ef0400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee815be30 0x7f4ee8143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:50.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4ef0400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee8168c70 con 0x7f4ee815be30 2024-09-10T22:39:50.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4ef0400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee80cef50 con 0x7f4ee80ae9c0 2024-09-10T22:39:50.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4ef0400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4ee8168df0 con 0x7f4ee80b09c0 2024-09-10T22:39:50.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4eee400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee815be30 0x7f4ee8143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:50.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4eee400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee815be30 0x7f4ee8143ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57182/0 (socket says 172.21.15.103:57182) 2024-09-10T22:39:50.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4eee400640 1 -- 172.21.15.103:0/1584662032 learned_addr learned my addr 172.21.15.103:0/1584662032 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:50.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4eeda00640 1 --2- 172.21.15.103:0/1584662032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee80ae9c0 0x7f4ee8070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:50.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4eed000640 1 --2- 172.21.15.103:0/1584662032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee80b09c0 0x7f4ee8071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:50.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4eee400640 1 -- 172.21.15.103:0/1584662032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee80b09c0 msgr2=0x7f4ee8071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:50.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4eee400640 1 --2- 172.21.15.103:0/1584662032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee80b09c0 0x7f4ee8071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4eee400640 1 -- 172.21.15.103:0/1584662032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee80ae9c0 msgr2=0x7f4ee8070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:50.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4eee400640 1 --2- 172.21.15.103:0/1584662032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee80ae9c0 0x7f4ee8070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4eee400640 1 -- 172.21.15.103:0/1584662032 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee80cba30 con 0x7f4ee815be30 2024-09-10T22:39:50.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4eee400640 1 --2- 172.21.15.103:0/1584662032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee815be30 0x7f4ee8143ff0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000cce0 tx=0x7f4ee000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:50.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4ee5600640 1 -- 172.21.15.103:0/1584662032 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee000f450 con 0x7f4ee815be30 2024-09-10T22:39:50.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4ee5600640 1 -- 172.21.15.103:0/1584662032 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ee000f700 con 0x7f4ee815be30 2024-09-10T22:39:50.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4ee5600640 1 -- 172.21.15.103:0/1584662032 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee000fb50 con 0x7f4ee815be30 2024-09-10T22:39:50.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4ef0400640 1 -- 172.21.15.103:0/1584662032 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee81f8d40 con 0x7f4ee815be30 2024-09-10T22:39:50.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4ef0400640 1 -- 172.21.15.103:0/1584662032 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee81f9300 con 0x7f4ee815be30 2024-09-10T22:39:50.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.106+0000 7f4ef0400640 1 -- 172.21.15.103:0/1584662032 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ee80aee10 con 0x7f4ee815be30 2024-09-10T22:39:50.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.110+0000 7f4ee5600640 1 -- 172.21.15.103:0/1584662032 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4ee000e3b0 con 0x7f4ee815be30 2024-09-10T22:39:50.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.110+0000 7f4ee5600640 1 --2- 172.21.15.103:0/1584662032 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4ec80725e0 0x7f4ec8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:50.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.110+0000 7f4ee5600640 1 -- 172.21.15.103:0/1584662032 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f4ee0093b80 con 0x7f4ee815be30 2024-09-10T22:39:50.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.110+0000 7f4eeda00640 1 --2- 172.21.15.103:0/1584662032 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4ec80725e0 0x7f4ec8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:50.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.110+0000 7f4eeda00640 1 --2- 172.21.15.103:0/1584662032 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4ec80725e0 0x7f4ec8074aa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80d2a20 tx=0x7f4edc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:50.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.114+0000 7f4ee5600640 1 -- 172.21.15.103:0/1584662032 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4ee0014030 con 0x7f4ee815be30 2024-09-10T22:39:50.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.346+0000 7f4ef0400640 1 -- 172.21.15.103:0/1584662032 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f4ee8159340 con 0x7f4ee815be30 2024-09-10T22:39:50.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.350+0000 7f4ee5600640 1 -- 172.21.15.103:0/1584662032 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f4ee005ed30 con 0x7f4ee815be30 2024-09-10T22:39:50.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.350+0000 7f4ef0400640 1 -- 172.21.15.103:0/1584662032 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4ec80725e0 msgr2=0x7f4ec8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:50.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.350+0000 7f4ef0400640 1 --2- 172.21.15.103:0/1584662032 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4ec80725e0 0x7f4ec8074aa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80d2a20 tx=0x7f4edc009040 comp rx=0 tx=0).stop 2024-09-10T22:39:50.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.350+0000 7f4ef0400640 1 -- 172.21.15.103:0/1584662032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee815be30 msgr2=0x7f4ee8143ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:50.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.350+0000 7f4ef0400640 1 --2- 172.21.15.103:0/1584662032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee815be30 0x7f4ee8143ff0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000cce0 tx=0x7f4ee000a620 comp rx=0 tx=0).stop 2024-09-10T22:39:50.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.350+0000 7f4ef0400640 1 -- 172.21.15.103:0/1584662032 shutdown_connections 2024-09-10T22:39:50.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.350+0000 7f4ef0400640 1 --2- 172.21.15.103:0/1584662032 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4ec80725e0 0x7f4ec8074aa0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.350+0000 7f4ef0400640 1 --2- 172.21.15.103:0/1584662032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee815be30 0x7f4ee8143ff0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.350+0000 7f4ef0400640 1 --2- 172.21.15.103:0/1584662032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee80b09c0 0x7f4ee8071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.350+0000 7f4ef0400640 1 --2- 172.21.15.103:0/1584662032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee80ae9c0 0x7f4ee8070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.350+0000 7f4ef0400640 1 -- 172.21.15.103:0/1584662032 >> 172.21.15.103:0/1584662032 conn(0x7f4ee80d1ac0 msgr2=0x7f4ee80b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:50.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.354+0000 7f4ef0400640 1 -- 172.21.15.103:0/1584662032 shutdown_connections 2024-09-10T22:39:50.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.354+0000 7f4ef0400640 1 -- 172.21.15.103:0/1584662032 wait complete. 2024-09-10T22:39:50.376 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-10T22:39:50.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.514+0000 7f0575800640 1 -- 172.21.15.103:0/1397376875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f057015be30 msgr2=0x7f05700ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:50.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.514+0000 7f0575800640 1 --2- 172.21.15.103:0/1397376875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f057015be30 0x7f05700ce0c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0560009840 tx=0x7f056001c790 comp rx=0 tx=0).stop 2024-09-10T22:39:50.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.514+0000 7f0575800640 1 -- 172.21.15.103:0/1397376875 shutdown_connections 2024-09-10T22:39:50.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.514+0000 7f0575800640 1 --2- 172.21.15.103:0/1397376875 >> v2:172.21.15.131:3300/0 conn(0x7f05700b09c0 0x7f05700ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.514+0000 7f0575800640 1 --2- 172.21.15.103:0/1397376875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f057015be30 0x7f05700ce0c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.514+0000 7f0575800640 1 -- 172.21.15.103:0/1397376875 >> 172.21.15.103:0/1397376875 conn(0x7f05700d1ac0 msgr2=0x7f05700d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:50.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.514+0000 7f0575800640 1 -- 172.21.15.103:0/1397376875 shutdown_connections 2024-09-10T22:39:50.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.514+0000 7f0575800640 1 -- 172.21.15.103:0/1397376875 wait complete. 2024-09-10T22:39:50.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f0575800640 1 Processor -- start 2024-09-10T22:39:50.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f0575800640 1 -- start start 2024-09-10T22:39:50.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f0575800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05700b09c0 0x7f0570151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:50.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f0575800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05700ceb40 0x7f0570153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:50.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f0575800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f057015be30 0x7f0570153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:50.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f0575800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f05701690c0 con 0x7f05700ceb40 2024-09-10T22:39:50.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f0575800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0570168f40 con 0x7f057015be30 2024-09-10T22:39:50.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f0575800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0570169240 con 0x7f05700b09c0 2024-09-10T22:39:50.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f056e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05700ceb40 0x7f0570153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:50.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f056e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05700ceb40 0x7f0570153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57186/0 (socket says 172.21.15.103:57186) 2024-09-10T22:39:50.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f056e000640 1 -- 172.21.15.103:0/2901364297 learned_addr learned my addr 172.21.15.103:0/2901364297 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:50.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f056ea00640 1 --2- 172.21.15.103:0/2901364297 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05700b09c0 0x7f0570151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:50.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f056f400640 1 --2- 172.21.15.103:0/2901364297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f057015be30 0x7f0570153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:50.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f056e000640 1 -- 172.21.15.103:0/2901364297 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05700b09c0 msgr2=0x7f0570151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:50.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f056e000640 1 --2- 172.21.15.103:0/2901364297 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05700b09c0 0x7f0570151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f056e000640 1 -- 172.21.15.103:0/2901364297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f057015be30 msgr2=0x7f0570153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:50.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f056e000640 1 --2- 172.21.15.103:0/2901364297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f057015be30 0x7f0570153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f056e000640 1 -- 172.21.15.103:0/2901364297 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0570151cd0 con 0x7f05700ceb40 2024-09-10T22:39:50.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f056e000640 1 --2- 172.21.15.103:0/2901364297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05700ceb40 0x7f0570153ab0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f055c00e9c0 tx=0x7f055c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:50.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f0566a00640 1 -- 172.21.15.103:0/2901364297 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c00cde0 con 0x7f05700ceb40 2024-09-10T22:39:50.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f0566a00640 1 -- 172.21.15.103:0/2901364297 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f055c010520 con 0x7f05700ceb40 2024-09-10T22:39:50.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f0575800640 1 -- 172.21.15.103:0/2901364297 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05700b22f0 con 0x7f05700ceb40 2024-09-10T22:39:50.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f0566a00640 1 -- 172.21.15.103:0/2901364297 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c010970 con 0x7f05700ceb40 2024-09-10T22:39:50.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.518+0000 7f0575800640 1 -- 172.21.15.103:0/2901364297 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05700b28b0 con 0x7f05700ceb40 2024-09-10T22:39:50.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.522+0000 7f0575800640 1 -- 172.21.15.103:0/2901364297 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05700cf9c0 con 0x7f05700ceb40 2024-09-10T22:39:50.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.522+0000 7f0566a00640 1 -- 172.21.15.103:0/2901364297 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f055c010b10 con 0x7f05700ceb40 2024-09-10T22:39:50.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.522+0000 7f0566a00640 1 --2- 172.21.15.103:0/2901364297 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05500725e0 0x7f0550074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:50.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.522+0000 7f0566a00640 1 -- 172.21.15.103:0/2901364297 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f055c093bd0 con 0x7f05700ceb40 2024-09-10T22:39:50.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.522+0000 7f056ea00640 1 --2- 172.21.15.103:0/2901364297 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05500725e0 0x7f0550074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:50.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.526+0000 7f056ea00640 1 --2- 172.21.15.103:0/2901364297 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05500725e0 0x7f0550074aa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f05600ae000 tx=0x7f056001afd0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:50.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.526+0000 7f0566a00640 1 -- 172.21.15.103:0/2901364297 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f055c05ed80 con 0x7f05700ceb40 2024-09-10T22:39:50.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.750+0000 7f0575800640 1 -- 172.21.15.103:0/2901364297 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f05701553e0 con 0x7f05700ceb40 2024-09-10T22:39:50.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.754+0000 7f0566a00640 1 -- 172.21.15.103:0/2901364297 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f055c0637b0 con 0x7f05700ceb40 2024-09-10T22:39:50.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.754+0000 7f0575800640 1 -- 172.21.15.103:0/2901364297 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05500725e0 msgr2=0x7f0550074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:50.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.754+0000 7f0575800640 1 --2- 172.21.15.103:0/2901364297 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05500725e0 0x7f0550074aa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f05600ae000 tx=0x7f056001afd0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.754+0000 7f0575800640 1 -- 172.21.15.103:0/2901364297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05700ceb40 msgr2=0x7f0570153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:50.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.754+0000 7f0575800640 1 --2- 172.21.15.103:0/2901364297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05700ceb40 0x7f0570153ab0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f055c00e9c0 tx=0x7f055c00ee80 comp rx=0 tx=0).stop 2024-09-10T22:39:50.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.754+0000 7f0575800640 1 -- 172.21.15.103:0/2901364297 shutdown_connections 2024-09-10T22:39:50.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.754+0000 7f0575800640 1 --2- 172.21.15.103:0/2901364297 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05500725e0 0x7f0550074aa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.754+0000 7f0575800640 1 --2- 172.21.15.103:0/2901364297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f057015be30 0x7f0570153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.754+0000 7f0575800640 1 --2- 172.21.15.103:0/2901364297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05700ceb40 0x7f0570153ab0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.754+0000 7f0575800640 1 --2- 172.21.15.103:0/2901364297 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05700b09c0 0x7f0570151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.754+0000 7f0575800640 1 -- 172.21.15.103:0/2901364297 >> 172.21.15.103:0/2901364297 conn(0x7f05700d1ac0 msgr2=0x7f05700b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:50.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.754+0000 7f0575800640 1 -- 172.21.15.103:0/2901364297 shutdown_connections 2024-09-10T22:39:50.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.754+0000 7f0575800640 1 -- 172.21.15.103:0/2901364297 wait complete. 2024-09-10T22:39:50.779 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-10T22:39:50.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.918+0000 7fa680a00640 1 -- 172.21.15.103:0/1732798240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa660004d50 msgr2=0x7fa6600051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:50.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.918+0000 7fa680a00640 1 --2- 172.21.15.103:0/1732798240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa660004d50 0x7fa6600051d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa674009ee0 tx=0x7fa67401d5f0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.918+0000 7fa67b200640 1 -- 172.21.15.103:0/1732798240 reap_dead start 2024-09-10T22:39:50.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.918+0000 7fa680a00640 1 -- 172.21.15.103:0/1732798240 shutdown_connections 2024-09-10T22:39:50.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.918+0000 7fa680a00640 1 -- 172.21.15.103:0/1732798240 >> 172.21.15.103:0/1732798240 conn(0x7fa67c0d18f0 msgr2=0x7fa67c0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:50.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.918+0000 7fa680a00640 1 -- 172.21.15.103:0/1732798240 shutdown_connections 2024-09-10T22:39:50.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.918+0000 7fa680a00640 1 -- 172.21.15.103:0/1732798240 wait complete. 2024-09-10T22:39:50.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.918+0000 7fa680a00640 1 Processor -- start 2024-09-10T22:39:50.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.918+0000 7fa680a00640 1 -- start start 2024-09-10T22:39:50.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa680a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa660004d50 0x7fa67c0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:50.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa680a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa67c15be30 0x7fa67c15b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:50.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa680a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa67c14ede0 0x7fa67c163a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:50.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa680a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c1648a0 con 0x7fa660004d50 2024-09-10T22:39:50.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa680a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c164720 con 0x7fa67c14ede0 2024-09-10T22:39:50.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa680a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa67c164a20 con 0x7fa67c15be30 2024-09-10T22:39:50.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa67a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa660004d50 0x7fa67c0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:50.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa67a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa660004d50 0x7fa67c0c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57200/0 (socket says 172.21.15.103:57200) 2024-09-10T22:39:50.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa67a800640 1 -- 172.21.15.103:0/2458759822 learned_addr learned my addr 172.21.15.103:0/2458759822 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:50.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa673e00640 1 --2- 172.21.15.103:0/2458759822 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa67c15be30 0x7fa67c15b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:50.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa67b200640 1 --2- 172.21.15.103:0/2458759822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa67c14ede0 0x7fa67c163a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:50.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa67a800640 1 -- 172.21.15.103:0/2458759822 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa67c15be30 msgr2=0x7fa67c15b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:50.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa67a800640 1 --2- 172.21.15.103:0/2458759822 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa67c15be30 0x7fa67c15b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa67a800640 1 -- 172.21.15.103:0/2458759822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa67c14ede0 msgr2=0x7fa67c163a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:50.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa67a800640 1 --2- 172.21.15.103:0/2458759822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa67c14ede0 0x7fa67c163a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:50.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa67a800640 1 -- 172.21.15.103:0/2458759822 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c14f260 con 0x7fa660004d50 2024-09-10T22:39:50.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa67a800640 1 --2- 172.21.15.103:0/2458759822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa660004d50 0x7fa67c0c9ce0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0066b0 tx=0x7fa66c0039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:50.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa672a00640 1 -- 172.21.15.103:0/2458759822 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c015070 con 0x7fa660004d50 2024-09-10T22:39:50.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa672a00640 1 -- 172.21.15.103:0/2458759822 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa66c011900 con 0x7fa660004d50 2024-09-10T22:39:50.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa672a00640 1 -- 172.21.15.103:0/2458759822 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c011d50 con 0x7fa660004d50 2024-09-10T22:39:50.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa680a00640 1 -- 172.21.15.103:0/2458759822 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa67c0b52d0 con 0x7fa660004d50 2024-09-10T22:39:50.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa680a00640 1 -- 172.21.15.103:0/2458759822 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa67c0b5890 con 0x7fa660004d50 2024-09-10T22:39:50.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.922+0000 7fa680a00640 1 -- 172.21.15.103:0/2458759822 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa67c0affd0 con 0x7fa660004d50 2024-09-10T22:39:50.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.926+0000 7fa672a00640 1 -- 172.21.15.103:0/2458759822 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa66c010420 con 0x7fa660004d50 2024-09-10T22:39:50.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.926+0000 7fa672a00640 1 --2- 172.21.15.103:0/2458759822 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6580725e0 0x7fa658074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:50.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.926+0000 7fa672a00640 1 -- 172.21.15.103:0/2458759822 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7fa66c093d60 con 0x7fa660004d50 2024-09-10T22:39:50.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.926+0000 7fa673e00640 1 --2- 172.21.15.103:0/2458759822 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6580725e0 0x7fa658074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:50.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.926+0000 7fa673e00640 1 --2- 172.21.15.103:0/2458759822 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6580725e0 0x7fa658074aa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa664000c10 tx=0x7fa664006b20 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:50.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:50.930+0000 7fa672a00640 1 -- 172.21.15.103:0/2458759822 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa66c05f6b0 con 0x7fa660004d50 2024-09-10T22:39:51.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.154+0000 7fa680a00640 1 -- 172.21.15.103:0/2458759822 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fa67c0d02c0 con 0x7fa660004d50 2024-09-10T22:39:51.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.158+0000 7fa672a00640 1 -- 172.21.15.103:0/2458759822 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fa66c05efb0 con 0x7fa660004d50 2024-09-10T22:39:51.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.162+0000 7fa680a00640 1 -- 172.21.15.103:0/2458759822 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6580725e0 msgr2=0x7fa658074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:51.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.162+0000 7fa680a00640 1 --2- 172.21.15.103:0/2458759822 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6580725e0 0x7fa658074aa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa664000c10 tx=0x7fa664006b20 comp rx=0 tx=0).stop 2024-09-10T22:39:51.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.162+0000 7fa680a00640 1 -- 172.21.15.103:0/2458759822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa660004d50 msgr2=0x7fa67c0c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:51.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.162+0000 7fa680a00640 1 --2- 172.21.15.103:0/2458759822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa660004d50 0x7fa67c0c9ce0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0066b0 tx=0x7fa66c0039d0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.162+0000 7fa680a00640 1 -- 172.21.15.103:0/2458759822 shutdown_connections 2024-09-10T22:39:51.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.162+0000 7fa680a00640 1 --2- 172.21.15.103:0/2458759822 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6580725e0 0x7fa658074aa0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.162+0000 7fa680a00640 1 --2- 172.21.15.103:0/2458759822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa67c14ede0 0x7fa67c163a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.162+0000 7fa680a00640 1 --2- 172.21.15.103:0/2458759822 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa67c15be30 0x7fa67c15b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.162+0000 7fa680a00640 1 --2- 172.21.15.103:0/2458759822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa660004d50 0x7fa67c0c9ce0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.162+0000 7fa680a00640 1 -- 172.21.15.103:0/2458759822 >> 172.21.15.103:0/2458759822 conn(0x7fa67c0d18f0 msgr2=0x7fa67c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:51.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.162+0000 7fa680a00640 1 -- 172.21.15.103:0/2458759822 shutdown_connections 2024-09-10T22:39:51.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.162+0000 7fa680a00640 1 -- 172.21.15.103:0/2458759822 wait complete. 2024-09-10T22:39:51.183 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-10T22:39:51.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb6ea00640 1 -- 172.21.15.103:0/222224525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb680cf260 msgr2=0x7feb680b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:51.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb6ea00640 1 --2- 172.21.15.103:0/222224525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb680cf260 0x7feb680b2c10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feb68074960 tx=0x7feb5801dc70 comp rx=0 tx=0).stop 2024-09-10T22:39:51.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb6ea00640 1 -- 172.21.15.103:0/222224525 shutdown_connections 2024-09-10T22:39:51.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb6ea00640 1 --2- 172.21.15.103:0/222224525 >> v2:172.21.15.131:3300/0 conn(0x7feb68072c10 0x7feb68157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb6ea00640 1 --2- 172.21.15.103:0/222224525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb680cf260 0x7feb680b2c10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb6ea00640 1 -- 172.21.15.103:0/222224525 >> 172.21.15.103:0/222224525 conn(0x7feb6806cc00 msgr2=0x7feb6806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:51.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb6ea00640 1 -- 172.21.15.103:0/222224525 shutdown_connections 2024-09-10T22:39:51.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb6ea00640 1 -- 172.21.15.103:0/222224525 wait complete. 2024-09-10T22:39:51.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb6ea00640 1 Processor -- start 2024-09-10T22:39:51.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb6ea00640 1 -- start start 2024-09-10T22:39:51.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb6ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb68072c10 0x7feb680b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:51.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb6ea00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb680b3150 0x7feb68149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:51.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb6ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb680cf260 0x7feb680b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:51.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb6ea00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feb6806e980 con 0x7feb68072c10 2024-09-10T22:39:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb6ea00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feb6806e800 con 0x7feb680cf260 2024-09-10T22:39:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb6ea00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7feb6806eb00 con 0x7feb680b3150 2024-09-10T22:39:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb67e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb68072c10 0x7feb680b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb67e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb68072c10 0x7feb680b11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57220/0 (socket says 172.21.15.103:57220) 2024-09-10T22:39:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb67e00640 1 -- 172.21.15.103:0/1019145059 learned_addr learned my addr 172.21.15.103:0/1019145059 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb5f400640 1 --2- 172.21.15.103:0/1019145059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb680b3150 0x7feb68149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb6ca00640 1 --2- 172.21.15.103:0/1019145059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb680cf260 0x7feb680b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb67e00640 1 -- 172.21.15.103:0/1019145059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb680b3150 msgr2=0x7feb68149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb67e00640 1 --2- 172.21.15.103:0/1019145059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb680b3150 0x7feb68149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb67e00640 1 -- 172.21.15.103:0/1019145059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb680cf260 msgr2=0x7feb680b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb67e00640 1 --2- 172.21.15.103:0/1019145059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb680cf260 0x7feb680b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb67e00640 1 -- 172.21.15.103:0/1019145059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb680af5f0 con 0x7feb68072c10 2024-09-10T22:39:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb5f400640 1 --2- 172.21.15.103:0/1019145059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb680b3150 0x7feb68149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:39:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.322+0000 7feb6ca00640 1 --2- 172.21.15.103:0/1019145059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb680cf260 0x7feb680b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:39:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.326+0000 7feb67e00640 1 --2- 172.21.15.103:0/1019145059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb68072c10 0x7feb680b11d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feb58000f90 tx=0x7feb580a6890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.326+0000 7feb64c00640 1 -- 172.21.15.103:0/1019145059 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb580bd070 con 0x7feb68072c10 2024-09-10T22:39:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.326+0000 7feb64c00640 1 -- 172.21.15.103:0/1019145059 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb58004e00 con 0x7feb68072c10 2024-09-10T22:39:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.326+0000 7feb64c00640 1 -- 172.21.15.103:0/1019145059 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb580b3040 con 0x7feb68072c10 2024-09-10T22:39:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.326+0000 7feb6ea00640 1 -- 172.21.15.103:0/1019145059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb680af8d0 con 0x7feb68072c10 2024-09-10T22:39:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.326+0000 7feb6ea00640 1 -- 172.21.15.103:0/1019145059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb680afe90 con 0x7feb68072c10 2024-09-10T22:39:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.326+0000 7feb6ea00640 1 -- 172.21.15.103:0/1019145059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb68157090 con 0x7feb68072c10 2024-09-10T22:39:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.326+0000 7feb64c00640 1 -- 172.21.15.103:0/1019145059 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7feb58004320 con 0x7feb68072c10 2024-09-10T22:39:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.326+0000 7feb64c00640 1 --2- 172.21.15.103:0/1019145059 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feb440725e0 0x7feb44074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.326+0000 7feb64c00640 1 -- 172.21.15.103:0/1019145059 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7feb5812cf50 con 0x7feb68072c10 2024-09-10T22:39:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.330+0000 7feb5f400640 1 --2- 172.21.15.103:0/1019145059 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feb440725e0 0x7feb44074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:51.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.330+0000 7feb5f400640 1 --2- 172.21.15.103:0/1019145059 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feb440725e0 0x7feb44074aa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feb680b1710 tx=0x7feb50009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:51.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.330+0000 7feb64c00640 1 -- 172.21.15.103:0/1019145059 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7feb58017860 con 0x7feb68072c10 2024-09-10T22:39:51.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.554+0000 7feb6ea00640 1 -- 172.21.15.103:0/1019145059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7feb68159cc0 con 0x7feb68072c10 2024-09-10T22:39:51.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.558+0000 7feb64c00640 1 -- 172.21.15.103:0/1019145059 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7feb580f8880 con 0x7feb68072c10 2024-09-10T22:39:51.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.558+0000 7feb6ea00640 1 -- 172.21.15.103:0/1019145059 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feb440725e0 msgr2=0x7feb44074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:51.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.558+0000 7feb6ea00640 1 --2- 172.21.15.103:0/1019145059 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feb440725e0 0x7feb44074aa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feb680b1710 tx=0x7feb50009040 comp rx=0 tx=0).stop 2024-09-10T22:39:51.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.558+0000 7feb6ea00640 1 -- 172.21.15.103:0/1019145059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb68072c10 msgr2=0x7feb680b11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:51.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.558+0000 7feb6ea00640 1 --2- 172.21.15.103:0/1019145059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb68072c10 0x7feb680b11d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feb58000f90 tx=0x7feb580a6890 comp rx=0 tx=0).stop 2024-09-10T22:39:51.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.558+0000 7feb6ea00640 1 -- 172.21.15.103:0/1019145059 shutdown_connections 2024-09-10T22:39:51.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.558+0000 7feb6ea00640 1 --2- 172.21.15.103:0/1019145059 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feb440725e0 0x7feb44074aa0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.558+0000 7feb6ea00640 1 --2- 172.21.15.103:0/1019145059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb680cf260 0x7feb680b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.558+0000 7feb6ea00640 1 --2- 172.21.15.103:0/1019145059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb680b3150 0x7feb68149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.558+0000 7feb6ea00640 1 --2- 172.21.15.103:0/1019145059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb68072c10 0x7feb680b11d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.558+0000 7feb6ea00640 1 -- 172.21.15.103:0/1019145059 >> 172.21.15.103:0/1019145059 conn(0x7feb6806cc00 msgr2=0x7feb680aeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:51.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.558+0000 7feb6ea00640 1 -- 172.21.15.103:0/1019145059 shutdown_connections 2024-09-10T22:39:51.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.558+0000 7feb6ea00640 1 -- 172.21.15.103:0/1019145059 wait complete. 2024-09-10T22:39:51.582 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-10T22:39:51.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.722+0000 7f79c0a00640 1 -- 172.21.15.103:0/3234762152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79bc0cfdd0 msgr2=0x7f79bc15eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:51.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.722+0000 7f79c0a00640 1 --2- 172.21.15.103:0/3234762152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79bc0cfdd0 0x7f79bc15eda0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009840 tx=0x7f79a401c820 comp rx=0 tx=0).stop 2024-09-10T22:39:51.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.722+0000 7f79c0a00640 1 -- 172.21.15.103:0/3234762152 shutdown_connections 2024-09-10T22:39:51.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.722+0000 7f79c0a00640 1 --2- 172.21.15.103:0/3234762152 >> v2:172.21.15.131:3300/0 conn(0x7f79bc15f2e0 0x7f79bc15f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.722+0000 7f79c0a00640 1 --2- 172.21.15.103:0/3234762152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79bc0cfdd0 0x7f79bc15eda0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.722+0000 7f79c0a00640 1 -- 172.21.15.103:0/3234762152 >> 172.21.15.103:0/3234762152 conn(0x7f79bc06cc00 msgr2=0x7f79bc06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:51.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.722+0000 7f79c0a00640 1 -- 172.21.15.103:0/3234762152 shutdown_connections 2024-09-10T22:39:51.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.722+0000 7f79c0a00640 1 -- 172.21.15.103:0/3234762152 wait complete. 2024-09-10T22:39:51.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.722+0000 7f79c0a00640 1 Processor -- start 2024-09-10T22:39:51.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.722+0000 7f79c0a00640 1 -- start start 2024-09-10T22:39:51.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79c0a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79bc0cf9f0 0x7f79bc15d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:51.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79c0a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc0cfdd0 0x7f79bc15caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:51.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79c0a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79bc15f2e0 0x7f79bc150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79c0a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f79bc0cd770 con 0x7f79bc0cfdd0 2024-09-10T22:39:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79c0a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f79bc0cd5f0 con 0x7f79bc15f2e0 2024-09-10T22:39:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79c0a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f79bc0cd8f0 con 0x7f79bc0cf9f0 2024-09-10T22:39:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79b1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc0cfdd0 0x7f79bc15caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79b1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc0cfdd0 0x7f79bc15caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57224/0 (socket says 172.21.15.103:57224) 2024-09-10T22:39:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79b1400640 1 -- 172.21.15.103:0/4182744301 learned_addr learned my addr 172.21.15.103:0/4182744301 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79b9e00640 1 --2- 172.21.15.103:0/4182744301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79bc0cf9f0 0x7f79bc15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79ba800640 1 --2- 172.21.15.103:0/4182744301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79bc15f2e0 0x7f79bc150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79b1400640 1 -- 172.21.15.103:0/4182744301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79bc0cf9f0 msgr2=0x7f79bc15d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79b1400640 1 --2- 172.21.15.103:0/4182744301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79bc0cf9f0 0x7f79bc15d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79b1400640 1 -- 172.21.15.103:0/4182744301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79bc15f2e0 msgr2=0x7f79bc150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79b1400640 1 --2- 172.21.15.103:0/4182744301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79bc15f2e0 0x7f79bc150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79b1400640 1 -- 172.21.15.103:0/4182744301 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79bc15e470 con 0x7f79bc0cfdd0 2024-09-10T22:39:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79ba800640 1 --2- 172.21.15.103:0/4182744301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79bc15f2e0 0x7f79bc150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79b1400640 1 --2- 172.21.15.103:0/4182744301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc0cfdd0 0x7f79bc15caf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009790 tx=0x7f79a40a66d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79b2a00640 1 -- 172.21.15.103:0/4182744301 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a40040c0 con 0x7f79bc0cfdd0 2024-09-10T22:39:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79b2a00640 1 -- 172.21.15.103:0/4182744301 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79a4004350 con 0x7f79bc0cfdd0 2024-09-10T22:39:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79b2a00640 1 -- 172.21.15.103:0/4182744301 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a4005280 con 0x7f79bc0cfdd0 2024-09-10T22:39:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79c0a00640 1 -- 172.21.15.103:0/4182744301 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79bc15e750 con 0x7f79bc0cfdd0 2024-09-10T22:39:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79c0a00640 1 -- 172.21.15.103:0/4182744301 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79bc15db30 con 0x7f79bc0cfdd0 2024-09-10T22:39:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79c0a00640 1 -- 172.21.15.103:0/4182744301 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79bc15eda0 con 0x7f79bc0cfdd0 2024-09-10T22:39:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.726+0000 7f79b2a00640 1 -- 172.21.15.103:0/4182744301 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f79a40046d0 con 0x7f79bc0cfdd0 2024-09-10T22:39:51.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.730+0000 7f79b2a00640 1 --2- 172.21.15.103:0/4182744301 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f79980725e0 0x7f7998074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:51.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.730+0000 7f79b2a00640 1 -- 172.21.15.103:0/4182744301 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f79a412e030 con 0x7f79bc0cfdd0 2024-09-10T22:39:51.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.730+0000 7f79b9e00640 1 --2- 172.21.15.103:0/4182744301 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f79980725e0 0x7f7998074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:51.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.730+0000 7f79b9e00640 1 --2- 172.21.15.103:0/4182744301 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f79980725e0 0x7f7998074aa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f79ac001690 tx=0x7f79ac009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:51.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.734+0000 7f79b2a00640 1 -- 172.21.15.103:0/4182744301 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f79a4016410 con 0x7f79bc0cfdd0 2024-09-10T22:39:51.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.954+0000 7f79c0a00640 1 -- 172.21.15.103:0/4182744301 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f79bc072630 con 0x7f79bc0cfdd0 2024-09-10T22:39:51.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.958+0000 7f79b2a00640 1 -- 172.21.15.103:0/4182744301 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f79a40ad3d0 con 0x7f79bc0cfdd0 2024-09-10T22:39:51.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.962+0000 7f79c0a00640 1 -- 172.21.15.103:0/4182744301 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f79980725e0 msgr2=0x7f7998074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:51.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.962+0000 7f79c0a00640 1 --2- 172.21.15.103:0/4182744301 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f79980725e0 0x7f7998074aa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f79ac001690 tx=0x7f79ac009040 comp rx=0 tx=0).stop 2024-09-10T22:39:51.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.962+0000 7f79c0a00640 1 -- 172.21.15.103:0/4182744301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc0cfdd0 msgr2=0x7f79bc15caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:51.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.962+0000 7f79c0a00640 1 --2- 172.21.15.103:0/4182744301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc0cfdd0 0x7f79bc15caf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009790 tx=0x7f79a40a66d0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.962+0000 7f79c0a00640 1 -- 172.21.15.103:0/4182744301 shutdown_connections 2024-09-10T22:39:51.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.962+0000 7f79c0a00640 1 --2- 172.21.15.103:0/4182744301 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f79980725e0 0x7f7998074aa0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.962+0000 7f79c0a00640 1 --2- 172.21.15.103:0/4182744301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79bc15f2e0 0x7f79bc150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.962+0000 7f79c0a00640 1 --2- 172.21.15.103:0/4182744301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc0cfdd0 0x7f79bc15caf0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.962+0000 7f79c0a00640 1 --2- 172.21.15.103:0/4182744301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79bc0cf9f0 0x7f79bc15d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:51.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.962+0000 7f79c0a00640 1 -- 172.21.15.103:0/4182744301 >> 172.21.15.103:0/4182744301 conn(0x7f79bc06cc00 msgr2=0x7f79bc158e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:51.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.962+0000 7f79c0a00640 1 -- 172.21.15.103:0/4182744301 shutdown_connections 2024-09-10T22:39:51.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:51.962+0000 7f79c0a00640 1 -- 172.21.15.103:0/4182744301 wait complete. 2024-09-10T22:39:51.983 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T22:39:52.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.118+0000 7f7243000640 1 -- 172.21.15.103:0/3641276534 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f723c0cdd00 msgr2=0x7f723c0ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:52.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.118+0000 7f7243000640 1 --2- 172.21.15.103:0/3641276534 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f723c0cdd00 0x7f723c0ae7f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7224009900 tx=0x7f722401c8e0 comp rx=0 tx=0).stop 2024-09-10T22:39:52.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.118+0000 7f7243000640 1 -- 172.21.15.103:0/3641276534 shutdown_connections 2024-09-10T22:39:52.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.118+0000 7f7243000640 1 --2- 172.21.15.103:0/3641276534 >> v2:172.21.15.131:3300/0 conn(0x7f723c0cd500 0x7f723c15f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:52.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.118+0000 7f7243000640 1 --2- 172.21.15.103:0/3641276534 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f723c0cdd00 0x7f723c0ae7f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:52.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.118+0000 7f7243000640 1 -- 172.21.15.103:0/3641276534 >> 172.21.15.103:0/3641276534 conn(0x7f723c0d1a20 msgr2=0x7f723c0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:52.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.118+0000 7f7243000640 1 -- 172.21.15.103:0/3641276534 shutdown_connections 2024-09-10T22:39:52.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.118+0000 7f7243000640 1 -- 172.21.15.103:0/3641276534 wait complete. 2024-09-10T22:39:52.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7243000640 1 Processor -- start 2024-09-10T22:39:52.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7243000640 1 -- start start 2024-09-10T22:39:52.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7243000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f723c0cd500 0x7f723c06dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:52.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7243000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f723c0cdd00 0x7f723c1f8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:52.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7243000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f723c15f1a0 0x7f723c155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:52.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7243000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f723c168f60 con 0x7f723c0cdd00 2024-09-10T22:39:52.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7243000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f723c168de0 con 0x7f723c15f1a0 2024-09-10T22:39:52.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7243000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f723c1690e0 con 0x7f723c0cd500 2024-09-10T22:39:52.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7233400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f723c0cdd00 0x7f723c1f8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:52.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f723be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f723c0cd500 0x7f723c06dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:52.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7233400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f723c0cdd00 0x7f723c1f8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57226/0 (socket says 172.21.15.103:57226) 2024-09-10T22:39:52.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7233400640 1 -- 172.21.15.103:0/2026296871 learned_addr learned my addr 172.21.15.103:0/2026296871 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:52.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7241000640 1 --2- 172.21.15.103:0/2026296871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f723c15f1a0 0x7f723c155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:52.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7233400640 1 -- 172.21.15.103:0/2026296871 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f723c0cd500 msgr2=0x7f723c06dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:52.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7233400640 1 --2- 172.21.15.103:0/2026296871 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f723c0cd500 0x7f723c06dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:52.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7233400640 1 -- 172.21.15.103:0/2026296871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f723c15f1a0 msgr2=0x7f723c155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:52.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7233400640 1 --2- 172.21.15.103:0/2026296871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f723c15f1a0 0x7f723c155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:52.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7233400640 1 -- 172.21.15.103:0/2026296871 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723c1f90c0 con 0x7f723c0cdd00 2024-09-10T22:39:52.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7241000640 1 --2- 172.21.15.103:0/2026296871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f723c15f1a0 0x7f723c155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:52.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7233400640 1 --2- 172.21.15.103:0/2026296871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f723c0cdd00 0x7f723c1f8b80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f72240b0040 tx=0x7f72240a55a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:52.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.122+0000 7f7238c00640 1 -- 172.21.15.103:0/2026296871 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72240b2040 con 0x7f723c0cdd00 2024-09-10T22:39:52.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.126+0000 7f7238c00640 1 -- 172.21.15.103:0/2026296871 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7224004470 con 0x7f723c0cdd00 2024-09-10T22:39:52.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.126+0000 7f7238c00640 1 -- 172.21.15.103:0/2026296871 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7224005290 con 0x7f723c0cdd00 2024-09-10T22:39:52.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.126+0000 7f7243000640 1 -- 172.21.15.103:0/2026296871 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723c06e2f0 con 0x7f723c0cdd00 2024-09-10T22:39:52.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.126+0000 7f7243000640 1 -- 172.21.15.103:0/2026296871 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f723c06e8b0 con 0x7f723c0cdd00 2024-09-10T22:39:52.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.126+0000 7f7243000640 1 -- 172.21.15.103:0/2026296871 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f723c15f890 con 0x7f723c0cdd00 2024-09-10T22:39:52.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.126+0000 7f7238c00640 1 -- 172.21.15.103:0/2026296871 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7224005430 con 0x7f723c0cdd00 2024-09-10T22:39:52.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.126+0000 7f7238c00640 1 --2- 172.21.15.103:0/2026296871 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f72180725e0 0x7f7218074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:52.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.126+0000 7f7238c00640 1 -- 172.21.15.103:0/2026296871 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f722412c760 con 0x7f723c0cdd00 2024-09-10T22:39:52.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.130+0000 7f723be00640 1 --2- 172.21.15.103:0/2026296871 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f72180725e0 0x7f7218074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:52.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.130+0000 7f723be00640 1 --2- 172.21.15.103:0/2026296871 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f72180725e0 0x7f7218074aa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f723c0723c0 tx=0x7f722c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:52.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.130+0000 7f7238c00640 1 -- 172.21.15.103:0/2026296871 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f723c1f90c0 con 0x7f723c0cdd00 2024-09-10T22:39:52.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.302+0000 7f7243000640 1 -- 172.21.15.103:0/2026296871 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f723c15e5d0 con 0x7f723c0cdd00 2024-09-10T22:39:52.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.302+0000 7f7238c00640 1 -- 172.21.15.103:0/2026296871 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) ==== 84+0+65 (secure 0 0 0) 0x7f72240164d0 con 0x7f723c0cdd00 2024-09-10T22:39:52.308 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:52.308 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-09-10T22:39:52.308 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:39:52.308 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2024-09-10T22:39:52.308 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": ".mgr" 2024-09-10T22:39:52.308 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:39:52.308 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-09-10T22:39:52.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.306+0000 7f7243000640 1 -- 172.21.15.103:0/2026296871 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f72180725e0 msgr2=0x7f7218074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:52.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.306+0000 7f7243000640 1 --2- 172.21.15.103:0/2026296871 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f72180725e0 0x7f7218074aa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f723c0723c0 tx=0x7f722c009040 comp rx=0 tx=0).stop 2024-09-10T22:39:52.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.306+0000 7f7243000640 1 -- 172.21.15.103:0/2026296871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f723c0cdd00 msgr2=0x7f723c1f8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:52.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.306+0000 7f7243000640 1 --2- 172.21.15.103:0/2026296871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f723c0cdd00 0x7f723c1f8b80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f72240b0040 tx=0x7f72240a55a0 comp rx=0 tx=0).stop 2024-09-10T22:39:52.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.306+0000 7f7243000640 1 -- 172.21.15.103:0/2026296871 shutdown_connections 2024-09-10T22:39:52.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.306+0000 7f7243000640 1 --2- 172.21.15.103:0/2026296871 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f72180725e0 0x7f7218074aa0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:52.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.306+0000 7f7243000640 1 --2- 172.21.15.103:0/2026296871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f723c15f1a0 0x7f723c155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:52.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.306+0000 7f7243000640 1 --2- 172.21.15.103:0/2026296871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f723c0cdd00 0x7f723c1f8b80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:52.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.306+0000 7f7243000640 1 --2- 172.21.15.103:0/2026296871 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f723c0cd500 0x7f723c06dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:52.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.306+0000 7f7243000640 1 -- 172.21.15.103:0/2026296871 >> 172.21.15.103:0/2026296871 conn(0x7f723c0d1a20 msgr2=0x7f723c165c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:52.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.306+0000 7f7243000640 1 -- 172.21.15.103:0/2026296871 shutdown_connections 2024-09-10T22:39:52.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.306+0000 7f7243000640 1 -- 172.21.15.103:0/2026296871 wait complete. 2024-09-10T22:39:52.329 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T22:39:52.329 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T22:39:52.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.470+0000 7f1951400640 1 -- 172.21.15.103:0/1419944644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f194c073c30 msgr2=0x7f194c0740e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:52.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.470+0000 7f1951400640 1 --2- 172.21.15.103:0/1419944644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f194c073c30 0x7f194c0740e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f194c0b46d0 tx=0x7f194401caf0 comp rx=0 tx=0).stop 2024-09-10T22:39:52.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.470+0000 7f1951400640 1 -- 172.21.15.103:0/1419944644 shutdown_connections 2024-09-10T22:39:52.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.470+0000 7f1951400640 1 --2- 172.21.15.103:0/1419944644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f194c073c30 0x7f194c0740e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:52.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.470+0000 7f1951400640 1 --2- 172.21.15.103:0/1419944644 >> v2:172.21.15.131:3300/0 conn(0x7f194c0b4b20 0x7f194c15d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:52.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.470+0000 7f1951400640 1 -- 172.21.15.103:0/1419944644 >> 172.21.15.103:0/1419944644 conn(0x7f194c06cc00 msgr2=0x7f194c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:52.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.470+0000 7f1951400640 1 -- 172.21.15.103:0/1419944644 shutdown_connections 2024-09-10T22:39:52.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.470+0000 7f1951400640 1 -- 172.21.15.103:0/1419944644 wait complete. 2024-09-10T22:39:52.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1951400640 1 Processor -- start 2024-09-10T22:39:52.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1951400640 1 -- start start 2024-09-10T22:39:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1951400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f194c073c30 0x7f194c153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1951400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f194c0b4b20 0x7f194c13f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1951400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f194c150a50 0x7f194c13fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1951400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f194c166bc0 con 0x7f194c0b4b20 2024-09-10T22:39:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1951400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f194c166a40 con 0x7f194c073c30 2024-09-10T22:39:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1951400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f194c166d40 con 0x7f194c150a50 2024-09-10T22:39:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1949e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f194c0b4b20 0x7f194c13f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1949e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f194c0b4b20 0x7f194c13f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57252/0 (socket says 172.21.15.103:57252) 2024-09-10T22:39:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1949e00640 1 -- 172.21.15.103:0/1425466140 learned_addr learned my addr 172.21.15.103:0/1425466140 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f194a800640 1 --2- 172.21.15.103:0/1425466140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f194c073c30 0x7f194c153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f194b200640 1 --2- 172.21.15.103:0/1425466140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f194c150a50 0x7f194c13fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1949e00640 1 -- 172.21.15.103:0/1425466140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f194c150a50 msgr2=0x7f194c13fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:52.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1949e00640 1 --2- 172.21.15.103:0/1425466140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f194c150a50 0x7f194c13fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:52.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1949e00640 1 -- 172.21.15.103:0/1425466140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f194c073c30 msgr2=0x7f194c153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:52.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1949e00640 1 --2- 172.21.15.103:0/1425466140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f194c073c30 0x7f194c153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:52.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1949e00640 1 -- 172.21.15.103:0/1425466140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194c143c30 con 0x7f194c0b4b20 2024-09-10T22:39:52.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1949e00640 1 --2- 172.21.15.103:0/1425466140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f194c0b4b20 0x7f194c13f920 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1938005d10 tx=0x7f193800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:52.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1942a00640 1 -- 172.21.15.103:0/1425466140 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193800de60 con 0x7f194c0b4b20 2024-09-10T22:39:52.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1942a00640 1 -- 172.21.15.103:0/1425466140 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f193800ae50 con 0x7f194c0b4b20 2024-09-10T22:39:52.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1942a00640 1 -- 172.21.15.103:0/1425466140 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19380055b0 con 0x7f194c0b4b20 2024-09-10T22:39:52.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1951400640 1 -- 172.21.15.103:0/1425466140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f194c140770 con 0x7f194c0b4b20 2024-09-10T22:39:52.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1951400640 1 -- 172.21.15.103:0/1425466140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f194c13db70 con 0x7f194c0b4b20 2024-09-10T22:39:52.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.474+0000 7f1951400640 1 -- 172.21.15.103:0/1425466140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f194c0740e0 con 0x7f194c0b4b20 2024-09-10T22:39:52.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.478+0000 7f1942a00640 1 -- 172.21.15.103:0/1425466140 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f193800b040 con 0x7f194c0b4b20 2024-09-10T22:39:52.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.478+0000 7f1942a00640 1 --2- 172.21.15.103:0/1425466140 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f192c072610 0x7f192c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.478+0000 7f1942a00640 1 -- 172.21.15.103:0/1425466140 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f1938093320 con 0x7f194c0b4b20 2024-09-10T22:39:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.478+0000 7f194a800640 1 --2- 172.21.15.103:0/1425466140 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f192c072610 0x7f192c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:52.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.478+0000 7f194a800640 1 --2- 172.21.15.103:0/1425466140 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f192c072610 0x7f192c074ad0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f193c007fd0 tx=0x7f193c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:52.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.482+0000 7f1942a00640 1 -- 172.21.15.103:0/1425466140 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f193805e560 con 0x7f194c0b4b20 2024-09-10T22:39:52.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:52.646+0000 7f1951400640 1 -- 172.21.15.103:0/1425466140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f194c0cf9b0 con 0x7f194c0b4b20 2024-09-10T22:39:53.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-10T22:39:53.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-10T22:39:53.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-10T22:39:53.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.562+0000 7f1942a00640 1 -- 172.21.15.103:0/1425466140 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) ==== 138+0+0 (secure 0 0 0) 0x7f19380672d0 con 0x7f194c0b4b20 2024-09-10T22:39:53.566 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2024-09-10T22:39:53.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.566+0000 7f1951400640 1 -- 172.21.15.103:0/1425466140 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f192c072610 msgr2=0x7f192c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:53.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.566+0000 7f1951400640 1 --2- 172.21.15.103:0/1425466140 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f192c072610 0x7f192c074ad0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f193c007fd0 tx=0x7f193c009040 comp rx=0 tx=0).stop 2024-09-10T22:39:53.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.566+0000 7f1951400640 1 -- 172.21.15.103:0/1425466140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f194c0b4b20 msgr2=0x7f194c13f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:53.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.566+0000 7f1951400640 1 --2- 172.21.15.103:0/1425466140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f194c0b4b20 0x7f194c13f920 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1938005d10 tx=0x7f193800a620 comp rx=0 tx=0).stop 2024-09-10T22:39:53.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.566+0000 7f1951400640 1 -- 172.21.15.103:0/1425466140 shutdown_connections 2024-09-10T22:39:53.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.566+0000 7f1951400640 1 --2- 172.21.15.103:0/1425466140 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f192c072610 0x7f192c074ad0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:53.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.566+0000 7f1951400640 1 --2- 172.21.15.103:0/1425466140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f194c150a50 0x7f194c13fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:53.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.566+0000 7f1951400640 1 --2- 172.21.15.103:0/1425466140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f194c0b4b20 0x7f194c13f920 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:53.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.566+0000 7f1951400640 1 --2- 172.21.15.103:0/1425466140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f194c073c30 0x7f194c153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:53.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.566+0000 7f1951400640 1 -- 172.21.15.103:0/1425466140 >> 172.21.15.103:0/1425466140 conn(0x7f194c06cc00 msgr2=0x7f194c150020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:53.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.566+0000 7f1951400640 1 -- 172.21.15.103:0/1425466140 shutdown_connections 2024-09-10T22:39:53.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.566+0000 7f1951400640 1 -- 172.21.15.103:0/1425466140 wait complete. 2024-09-10T22:39:53.598 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T22:39:53.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.746+0000 7f63b7e00640 1 -- 172.21.15.103:0/404877554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63b0161630 msgr2=0x7f63b00cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:53.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.746+0000 7f63b7e00640 1 --2- 172.21.15.103:0/404877554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63b0161630 0x7f63b00cf690 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009840 tx=0x7f63a401c790 comp rx=0 tx=0).stop 2024-09-10T22:39:53.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.746+0000 7f63b7e00640 1 -- 172.21.15.103:0/404877554 shutdown_connections 2024-09-10T22:39:53.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.746+0000 7f63b7e00640 1 --2- 172.21.15.103:0/404877554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63b00b3ae0 0x7f63b00d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:53.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.746+0000 7f63b7e00640 1 --2- 172.21.15.103:0/404877554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63b0161630 0x7f63b00cf690 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:53.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.746+0000 7f63b7e00640 1 -- 172.21.15.103:0/404877554 >> 172.21.15.103:0/404877554 conn(0x7f63b00d3d40 msgr2=0x7f63b00d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:53.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.746+0000 7f63b7e00640 1 -- 172.21.15.103:0/404877554 shutdown_connections 2024-09-10T22:39:53.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.746+0000 7f63b7e00640 1 -- 172.21.15.103:0/404877554 wait complete. 2024-09-10T22:39:53.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.746+0000 7f63b7e00640 1 Processor -- start 2024-09-10T22:39:53.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.746+0000 7f63b7e00640 1 -- start start 2024-09-10T22:39:53.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.746+0000 7f63b7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63b00b2e80 0x7f63b015dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:53.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.746+0000 7f63b7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63b00b3ae0 0x7f63b015e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:53.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.746+0000 7f63b7e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63b0161630 0x7f63b015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:53.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63b7e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f63b016ada0 con 0x7f63b00b3ae0 2024-09-10T22:39:53.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63b7e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f63b00d04e0 con 0x7f63b00b2e80 2024-09-10T22:39:53.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63b7e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f63b016af20 con 0x7f63b0161630 2024-09-10T22:39:53.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63b4a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63b00b3ae0 0x7f63b015e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:53.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63b4a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63b00b3ae0 0x7f63b015e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57266/0 (socket says 172.21.15.103:57266) 2024-09-10T22:39:53.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63b4a00640 1 -- 172.21.15.103:0/275943755 learned_addr learned my addr 172.21.15.103:0/275943755 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:53.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63b5400640 1 --2- 172.21.15.103:0/275943755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63b00b2e80 0x7f63b015dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:53.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63b5e00640 1 --2- 172.21.15.103:0/275943755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63b0161630 0x7f63b015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:53.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63b4a00640 1 -- 172.21.15.103:0/275943755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63b0161630 msgr2=0x7f63b015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:53.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63b4a00640 1 --2- 172.21.15.103:0/275943755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63b0161630 0x7f63b015b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:53.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63b4a00640 1 -- 172.21.15.103:0/275943755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63b00b2e80 msgr2=0x7f63b015dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:53.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63b4a00640 1 --2- 172.21.15.103:0/275943755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63b00b2e80 0x7f63b015dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:53.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63b4a00640 1 -- 172.21.15.103:0/275943755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b0157560 con 0x7f63b00b3ae0 2024-09-10T22:39:53.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63b4a00640 1 --2- 172.21.15.103:0/275943755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63b00b3ae0 0x7f63b015e510 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f639c00c430 tx=0x7f639c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:53.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63ad600640 1 -- 172.21.15.103:0/275943755 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c017070 con 0x7f63b00b3ae0 2024-09-10T22:39:53.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63ad600640 1 -- 172.21.15.103:0/275943755 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f639c003600 con 0x7f63b00b3ae0 2024-09-10T22:39:53.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63ad600640 1 -- 172.21.15.103:0/275943755 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c003a50 con 0x7f63b00b3ae0 2024-09-10T22:39:53.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63b7e00640 1 -- 172.21.15.103:0/275943755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b0157840 con 0x7f63b00b3ae0 2024-09-10T22:39:53.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63b7e00640 1 -- 172.21.15.103:0/275943755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b0157e00 con 0x7f63b00b3ae0 2024-09-10T22:39:53.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63b7e00640 1 -- 172.21.15.103:0/275943755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b00d0750 con 0x7f63b00b3ae0 2024-09-10T22:39:53.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.750+0000 7f63ad600640 1 -- 172.21.15.103:0/275943755 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f639c003bf0 con 0x7f63b00b3ae0 2024-09-10T22:39:53.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.754+0000 7f63ad600640 1 --2- 172.21.15.103:0/275943755 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f63900725e0 0x7f6390074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:53.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.754+0000 7f63ad600640 1 -- 172.21.15.103:0/275943755 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5619+0+0 (secure 0 0 0) 0x7f639c092c60 con 0x7f63b00b3ae0 2024-09-10T22:39:53.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.754+0000 7f63b5400640 1 --2- 172.21.15.103:0/275943755 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f63900725e0 0x7f6390074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:53.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.754+0000 7f63b5400640 1 --2- 172.21.15.103:0/275943755 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f63900725e0 0x7f6390074aa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f63a40af000 tx=0x7f63a401afd0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:53.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.754+0000 7f63ad600640 1 -- 172.21.15.103:0/275943755 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f639c021020 con 0x7f63b00b3ae0 2024-09-10T22:39:53.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:53.922+0000 7f63b7e00640 1 -- 172.21.15.103:0/275943755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f63b0158cd0 con 0x7f63b00b3ae0 2024-09-10T22:39:54.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.566+0000 7f63ad600640 1 -- 172.21.15.103:0/275943755 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) ==== 170+0+0 (secure 0 0 0) 0x7f639c05dd20 con 0x7f63b00b3ae0 2024-09-10T22:39:54.573 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2024-09-10T22:39:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.570+0000 7f63b7e00640 1 -- 172.21.15.103:0/275943755 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f63900725e0 msgr2=0x7f6390074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.570+0000 7f63b7e00640 1 --2- 172.21.15.103:0/275943755 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f63900725e0 0x7f6390074aa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f63a40af000 tx=0x7f63a401afd0 comp rx=0 tx=0).stop 2024-09-10T22:39:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.570+0000 7f63b7e00640 1 -- 172.21.15.103:0/275943755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63b00b3ae0 msgr2=0x7f63b015e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.570+0000 7f63b7e00640 1 --2- 172.21.15.103:0/275943755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63b00b3ae0 0x7f63b015e510 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f639c00c430 tx=0x7f639c00c8f0 comp rx=0 tx=0).stop 2024-09-10T22:39:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.570+0000 7f63b7e00640 1 -- 172.21.15.103:0/275943755 shutdown_connections 2024-09-10T22:39:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.570+0000 7f63b7e00640 1 --2- 172.21.15.103:0/275943755 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f63900725e0 0x7f6390074aa0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.570+0000 7f63b7e00640 1 --2- 172.21.15.103:0/275943755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63b0161630 0x7f63b015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.570+0000 7f63b7e00640 1 --2- 172.21.15.103:0/275943755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63b00b3ae0 0x7f63b015e510 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.570+0000 7f63b7e00640 1 --2- 172.21.15.103:0/275943755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63b00b2e80 0x7f63b015dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.570+0000 7f63b7e00640 1 -- 172.21.15.103:0/275943755 >> 172.21.15.103:0/275943755 conn(0x7f63b00d3d40 msgr2=0x7f63b00ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.570+0000 7f63b7e00640 1 -- 172.21.15.103:0/275943755 shutdown_connections 2024-09-10T22:39:54.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.574+0000 7f63b7e00640 1 -- 172.21.15.103:0/275943755 wait complete. 2024-09-10T22:39:54.621 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T22:39:54.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a45a00640 1 -- 172.21.15.103:0/2464601790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a24003a10 msgr2=0x7f6a24003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:54.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a45a00640 1 --2- 172.21.15.103:0/2464601790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a24003a10 0x7f6a24003e30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6a30009b60 tx=0x7f6a3001d270 comp rx=0 tx=0).stop 2024-09-10T22:39:54.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a3f400640 1 -- 172.21.15.103:0/2464601790 reap_dead start 2024-09-10T22:39:54.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a45a00640 1 -- 172.21.15.103:0/2464601790 shutdown_connections 2024-09-10T22:39:54.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a45a00640 1 -- 172.21.15.103:0/2464601790 >> 172.21.15.103:0/2464601790 conn(0x7f6a4006cc00 msgr2=0x7f6a4006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:54.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a45a00640 1 -- 172.21.15.103:0/2464601790 shutdown_connections 2024-09-10T22:39:54.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a45a00640 1 -- 172.21.15.103:0/2464601790 wait complete. 2024-09-10T22:39:54.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a45a00640 1 Processor -- start 2024-09-10T22:39:54.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a45a00640 1 -- start start 2024-09-10T22:39:54.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a45a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a24003a10 0x7f6a401450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a45a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a401ece50 0x7f6a401ed2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a45a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a401e84b0 0x7f6a401e8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a45a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6a400cd5b0 con 0x7f6a401ece50 2024-09-10T22:39:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a45a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6a400cd430 con 0x7f6a401e84b0 2024-09-10T22:39:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a45a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6a400cd730 con 0x7f6a24003a10 2024-09-10T22:39:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a37e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a401ece50 0x7f6a401ed2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a37e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a401ece50 0x7f6a401ed2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57286/0 (socket says 172.21.15.103:57286) 2024-09-10T22:39:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a3ea00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a24003a10 0x7f6a401450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.766+0000 7f6a37e00640 1 -- 172.21.15.103:0/2323091307 learned_addr learned my addr 172.21.15.103:0/2323091307 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.770+0000 7f6a3f400640 1 --2- 172.21.15.103:0/2323091307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a401e84b0 0x7f6a401e8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.770+0000 7f6a37e00640 1 -- 172.21.15.103:0/2323091307 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a24003a10 msgr2=0x7f6a401450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.770+0000 7f6a37e00640 1 --2- 172.21.15.103:0/2323091307 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a24003a10 0x7f6a401450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.770+0000 7f6a37e00640 1 -- 172.21.15.103:0/2323091307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a401e84b0 msgr2=0x7f6a401e8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:54.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.770+0000 7f6a37e00640 1 --2- 172.21.15.103:0/2323091307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a401e84b0 0x7f6a401e8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:54.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.770+0000 7f6a37e00640 1 -- 172.21.15.103:0/2323091307 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a40152a50 con 0x7f6a401ece50 2024-09-10T22:39:54.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.770+0000 7f6a3f400640 1 --2- 172.21.15.103:0/2323091307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a401e84b0 0x7f6a401e8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:54.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.770+0000 7f6a37e00640 1 --2- 172.21.15.103:0/2323091307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a401ece50 0x7f6a401ed2b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6a28006680 tx=0x7f6a280039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:54.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.770+0000 7f6a36a00640 1 -- 172.21.15.103:0/2323091307 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a28015070 con 0x7f6a401ece50 2024-09-10T22:39:54.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.770+0000 7f6a36a00640 1 -- 172.21.15.103:0/2323091307 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a28011900 con 0x7f6a401ece50 2024-09-10T22:39:54.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.770+0000 7f6a36a00640 1 -- 172.21.15.103:0/2323091307 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a28011d50 con 0x7f6a401ece50 2024-09-10T22:39:54.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.770+0000 7f6a45a00640 1 -- 172.21.15.103:0/2323091307 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a40152d30 con 0x7f6a401ece50 2024-09-10T22:39:54.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.770+0000 7f6a45a00640 1 -- 172.21.15.103:0/2323091307 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a401532f0 con 0x7f6a401ece50 2024-09-10T22:39:54.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.770+0000 7f6a45a00640 1 -- 172.21.15.103:0/2323091307 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a401ed7f0 con 0x7f6a401ece50 2024-09-10T22:39:54.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.770+0000 7f6a36a00640 1 -- 172.21.15.103:0/2323091307 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6a280103c0 con 0x7f6a401ece50 2024-09-10T22:39:54.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.770+0000 7f6a36a00640 1 --2- 172.21.15.103:0/2323091307 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6a1c0725e0 0x7f6a1c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:54.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.774+0000 7f6a36a00640 1 -- 172.21.15.103:0/2323091307 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6001+0+0 (secure 0 0 0) 0x7f6a280943a0 con 0x7f6a401ece50 2024-09-10T22:39:54.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.774+0000 7f6a3ea00640 1 --2- 172.21.15.103:0/2323091307 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6a1c0725e0 0x7f6a1c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:54.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.774+0000 7f6a3ea00640 1 --2- 172.21.15.103:0/2323091307 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6a1c0725e0 0x7f6a1c074aa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6a300ae000 tx=0x7f6a3001a010 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:54.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.778+0000 7f6a36a00640 1 -- 172.21.15.103:0/2323091307 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6a2805f2f0 con 0x7f6a401ece50 2024-09-10T22:39:54.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:54.974+0000 7f6a45a00640 1 -- 172.21.15.103:0/2323091307 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6a40073610 con 0x7f6a401ece50 2024-09-10T22:39:55.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.570+0000 7f6a36a00640 1 -- 172.21.15.103:0/2323091307 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v15) ==== 172+0+0 (secure 0 0 0) 0x7f6a28063d20 con 0x7f6a401ece50 2024-09-10T22:39:55.575 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 5 and data pool 6 2024-09-10T22:39:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.574+0000 7f6a45a00640 1 -- 172.21.15.103:0/2323091307 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6a1c0725e0 msgr2=0x7f6a1c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.574+0000 7f6a45a00640 1 --2- 172.21.15.103:0/2323091307 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6a1c0725e0 0x7f6a1c074aa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6a300ae000 tx=0x7f6a3001a010 comp rx=0 tx=0).stop 2024-09-10T22:39:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.574+0000 7f6a45a00640 1 -- 172.21.15.103:0/2323091307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a401ece50 msgr2=0x7f6a401ed2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.574+0000 7f6a45a00640 1 --2- 172.21.15.103:0/2323091307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a401ece50 0x7f6a401ed2b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6a28006680 tx=0x7f6a280039d0 comp rx=0 tx=0).stop 2024-09-10T22:39:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.574+0000 7f6a45a00640 1 -- 172.21.15.103:0/2323091307 shutdown_connections 2024-09-10T22:39:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.574+0000 7f6a45a00640 1 --2- 172.21.15.103:0/2323091307 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6a1c0725e0 0x7f6a1c074aa0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.574+0000 7f6a45a00640 1 --2- 172.21.15.103:0/2323091307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a401e84b0 0x7f6a401e8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.574+0000 7f6a45a00640 1 --2- 172.21.15.103:0/2323091307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a401ece50 0x7f6a401ed2b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.574+0000 7f6a45a00640 1 --2- 172.21.15.103:0/2323091307 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a24003a10 0x7f6a401450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.574+0000 7f6a45a00640 1 -- 172.21.15.103:0/2323091307 >> 172.21.15.103:0/2323091307 conn(0x7f6a4006cc00 msgr2=0x7f6a401584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:55.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.574+0000 7f6a45a00640 1 -- 172.21.15.103:0/2323091307 shutdown_connections 2024-09-10T22:39:55.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.574+0000 7f6a45a00640 1 -- 172.21.15.103:0/2323091307 wait complete. 2024-09-10T22:39:55.623 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:39:55.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.762+0000 7fd4f5a00640 1 -- 172.21.15.103:0/1437099549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4f00b09c0 msgr2=0x7fd4f00ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:55.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.762+0000 7fd4f5a00640 1 --2- 172.21.15.103:0/1437099549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4f00b09c0 0x7fd4f00ce7d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00d1590 tx=0x7fd4dc01c770 comp rx=0 tx=0).stop 2024-09-10T22:39:55.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.762+0000 7fd4f5a00640 1 -- 172.21.15.103:0/1437099549 shutdown_connections 2024-09-10T22:39:55.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.762+0000 7fd4f5a00640 1 --2- 172.21.15.103:0/1437099549 >> v2:172.21.15.131:3300/0 conn(0x7fd4f00ae9c0 0x7fd4f00aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:55.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.762+0000 7fd4f5a00640 1 --2- 172.21.15.103:0/1437099549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4f00b09c0 0x7fd4f00ce7d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:55.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.762+0000 7fd4f5a00640 1 -- 172.21.15.103:0/1437099549 >> 172.21.15.103:0/1437099549 conn(0x7fd4f00d1ac0 msgr2=0x7fd4f00d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:55.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.762+0000 7fd4f5a00640 1 -- 172.21.15.103:0/1437099549 shutdown_connections 2024-09-10T22:39:55.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.762+0000 7fd4f5a00640 1 -- 172.21.15.103:0/1437099549 wait complete. 2024-09-10T22:39:55.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.762+0000 7fd4f5a00640 1 Processor -- start 2024-09-10T22:39:55.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.762+0000 7fd4f5a00640 1 -- start start 2024-09-10T22:39:55.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4f5a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4f00ae9c0 0x7fd4f00b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:55.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4f5a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4f00b09c0 0x7fd4f015ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:55.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4f5a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4f015be30 0x7fd4f014fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:55.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4f5a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0168be0 con 0x7fd4f00b09c0 2024-09-10T22:39:55.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4f5a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0168a60 con 0x7fd4f015be30 2024-09-10T22:39:55.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4f5a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f0168d60 con 0x7fd4f00ae9c0 2024-09-10T22:39:55.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4ee000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4f00b09c0 0x7fd4f015ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:55.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4ee000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4f00b09c0 0x7fd4f015ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57298/0 (socket says 172.21.15.103:57298) 2024-09-10T22:39:55.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4ee000640 1 -- 172.21.15.103:0/3310281279 learned_addr learned my addr 172.21.15.103:0/3310281279 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:55.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4ef400640 1 --2- 172.21.15.103:0/3310281279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4f015be30 0x7fd4f014fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:55.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4eea00640 1 --2- 172.21.15.103:0/3310281279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4f00ae9c0 0x7fd4f00b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:55.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4ee000640 1 -- 172.21.15.103:0/3310281279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4f00ae9c0 msgr2=0x7fd4f00b74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:55.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4ee000640 1 --2- 172.21.15.103:0/3310281279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4f00ae9c0 0x7fd4f00b74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:55.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4ee000640 1 -- 172.21.15.103:0/3310281279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4f015be30 msgr2=0x7fd4f014fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:55.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4ee000640 1 --2- 172.21.15.103:0/3310281279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4f015be30 0x7fd4f014fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:55.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4ee000640 1 -- 172.21.15.103:0/3310281279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f015b050 con 0x7fd4f00b09c0 2024-09-10T22:39:55.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4ef400640 1 --2- 172.21.15.103:0/3310281279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4f015be30 0x7fd4f014fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:55.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4ee000640 1 --2- 172.21.15.103:0/3310281279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4f00b09c0 0x7fd4f015ab10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc01cc50 tx=0x7fd4dc005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:55.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4e6a00640 1 -- 172.21.15.103:0/3310281279 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0bb070 con 0x7fd4f00b09c0 2024-09-10T22:39:55.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4e6a00640 1 -- 172.21.15.103:0/3310281279 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4dc004330 con 0x7fd4f00b09c0 2024-09-10T22:39:55.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4f5a00640 1 -- 172.21.15.103:0/3310281279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f015b2d0 con 0x7fd4f00b09c0 2024-09-10T22:39:55.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4e6a00640 1 -- 172.21.15.103:0/3310281279 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0b2040 con 0x7fd4f00b09c0 2024-09-10T22:39:55.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4f5a00640 1 -- 172.21.15.103:0/3310281279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f006e090 con 0x7fd4f00b09c0 2024-09-10T22:39:55.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4f5a00640 1 -- 172.21.15.103:0/3310281279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f00aee10 con 0x7fd4f00b09c0 2024-09-10T22:39:55.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.766+0000 7fd4e6a00640 1 -- 172.21.15.103:0/3310281279 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd4dc0b5070 con 0x7fd4f00b09c0 2024-09-10T22:39:55.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.770+0000 7fd4e6a00640 1 --2- 172.21.15.103:0/3310281279 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4d00725e0 0x7fd4d0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:55.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.770+0000 7fd4e6a00640 1 -- 172.21.15.103:0/3310281279 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fd4dc12cde0 con 0x7fd4f00b09c0 2024-09-10T22:39:55.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.770+0000 7fd4eea00640 1 --2- 172.21.15.103:0/3310281279 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4d00725e0 0x7fd4d0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:55.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.770+0000 7fd4eea00640 1 --2- 172.21.15.103:0/3310281279 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4d00725e0 0x7fd4d0074aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0000f70 tx=0x7fd4e0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:55.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.774+0000 7fd4e6a00640 1 -- 172.21.15.103:0/3310281279 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd4f015b050 con 0x7fd4f00b09c0 2024-09-10T22:39:55.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.942+0000 7fd4f5a00640 1 -- 172.21.15.103:0/3310281279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4f006ae30 con 0x7fd4f00b09c0 2024-09-10T22:39:55.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.942+0000 7fd4e6a00640 1 -- 172.21.15.103:0/3310281279 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17075 (secure 0 0 0) 0x7fd4dc0163f0 con 0x7fd4f00b09c0 2024-09-10T22:39:55.946 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:55.946 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":40,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:39:54.979272+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:39:52.660431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T22:39:53.935665+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:39:55.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.942+0000 7fd4f5a00640 1 -- 172.21.15.103:0/3310281279 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4d00725e0 msgr2=0x7fd4d0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:55.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.942+0000 7fd4f5a00640 1 --2- 172.21.15.103:0/3310281279 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4d00725e0 0x7fd4d0074aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0000f70 tx=0x7fd4e0009040 comp rx=0 tx=0).stop 2024-09-10T22:39:55.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.942+0000 7fd4f5a00640 1 -- 172.21.15.103:0/3310281279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4f00b09c0 msgr2=0x7fd4f015ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:55.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.942+0000 7fd4f5a00640 1 --2- 172.21.15.103:0/3310281279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4f00b09c0 0x7fd4f015ab10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc01cc50 tx=0x7fd4dc005db0 comp rx=0 tx=0).stop 2024-09-10T22:39:55.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.942+0000 7fd4f5a00640 1 -- 172.21.15.103:0/3310281279 shutdown_connections 2024-09-10T22:39:55.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.942+0000 7fd4f5a00640 1 --2- 172.21.15.103:0/3310281279 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4d00725e0 0x7fd4d0074aa0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:55.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.942+0000 7fd4f5a00640 1 --2- 172.21.15.103:0/3310281279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4f015be30 0x7fd4f014fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:55.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.942+0000 7fd4f5a00640 1 --2- 172.21.15.103:0/3310281279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4f00b09c0 0x7fd4f015ab10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:55.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.942+0000 7fd4f5a00640 1 --2- 172.21.15.103:0/3310281279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4f00ae9c0 0x7fd4f00b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:55.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.942+0000 7fd4f5a00640 1 -- 172.21.15.103:0/3310281279 >> 172.21.15.103:0/3310281279 conn(0x7fd4f00d1ac0 msgr2=0x7fd4f0158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:55.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.942+0000 7fd4f5a00640 1 -- 172.21.15.103:0/3310281279 shutdown_connections 2024-09-10T22:39:55.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:55.942+0000 7fd4f5a00640 1 -- 172.21.15.103:0/3310281279 wait complete. 2024-09-10T22:39:55.967 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:39:56.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.102+0000 7f7817600640 1 -- 172.21.15.103:0/1150969059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78100b3150 msgr2=0x7f7810072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:56.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.102+0000 7f7817600640 1 --2- 172.21.15.103:0/1150969059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78100b3150 0x7f7810072500 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7810070730 tx=0x7f77fc01c8c0 comp rx=0 tx=0).stop 2024-09-10T22:39:56.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.102+0000 7f7817600640 1 -- 172.21.15.103:0/1150969059 shutdown_connections 2024-09-10T22:39:56.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.102+0000 7f7817600640 1 --2- 172.21.15.103:0/1150969059 >> v2:172.21.15.131:3300/0 conn(0x7f7810072a40 0x7f7810157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:56.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.102+0000 7f7817600640 1 --2- 172.21.15.103:0/1150969059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78100b3150 0x7f7810072500 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:56.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.102+0000 7f7817600640 1 --2- 172.21.15.103:0/1150969059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78100cf260 0x7f78100b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:56.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.102+0000 7f7817600640 1 -- 172.21.15.103:0/1150969059 >> 172.21.15.103:0/1150969059 conn(0x7f781006cc00 msgr2=0x7f781006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:56.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.102+0000 7f7817600640 1 -- 172.21.15.103:0/1150969059 shutdown_connections 2024-09-10T22:39:56.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.102+0000 7f7817600640 1 -- 172.21.15.103:0/1150969059 wait complete. 2024-09-10T22:39:56.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f7817600640 1 Processor -- start 2024-09-10T22:39:56.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f7817600640 1 -- start start 2024-09-10T22:39:56.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f7817600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7810072a40 0x7f781013d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:56.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f7817600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78100b3150 0x7f7810153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:56.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f7817600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78100cf260 0x7f7810154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:56.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f7817600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f781015dab0 con 0x7f78100b3150 2024-09-10T22:39:56.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f7817600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f78100cfe80 con 0x7f7810072a40 2024-09-10T22:39:56.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f7817600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f781015dc30 con 0x7f78100cf260 2024-09-10T22:39:56.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f780fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78100b3150 0x7f7810153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:56.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f780fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78100b3150 0x7f7810153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57312/0 (socket says 172.21.15.103:57312) 2024-09-10T22:39:56.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f780fe00640 1 -- 172.21.15.103:0/3398697032 learned_addr learned my addr 172.21.15.103:0/3398697032 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:56.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f7814c00640 1 --2- 172.21.15.103:0/3398697032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7810072a40 0x7f781013d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:56.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f7815600640 1 --2- 172.21.15.103:0/3398697032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78100cf260 0x7f7810154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:56.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f780fe00640 1 -- 172.21.15.103:0/3398697032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78100cf260 msgr2=0x7f7810154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:56.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f780fe00640 1 --2- 172.21.15.103:0/3398697032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78100cf260 0x7f7810154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:56.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f780fe00640 1 -- 172.21.15.103:0/3398697032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7810072a40 msgr2=0x7f781013d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:56.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f780fe00640 1 --2- 172.21.15.103:0/3398697032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7810072a40 0x7f781013d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:56.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f780fe00640 1 -- 172.21.15.103:0/3398697032 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f781013d730 con 0x7f78100b3150 2024-09-10T22:39:56.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f7815600640 1 --2- 172.21.15.103:0/3398697032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78100cf260 0x7f7810154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:39:56.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f780fe00640 1 --2- 172.21.15.103:0/3398697032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78100b3150 0x7f7810153dd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f77fc01af70 tx=0x7f77fc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:56.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f780cc00640 1 -- 172.21.15.103:0/3398697032 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0b2040 con 0x7f78100b3150 2024-09-10T22:39:56.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f780cc00640 1 -- 172.21.15.103:0/3398697032 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77fc005030 con 0x7f78100b3150 2024-09-10T22:39:56.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f780cc00640 1 -- 172.21.15.103:0/3398697032 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc005480 con 0x7f78100b3150 2024-09-10T22:39:56.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f7817600640 1 -- 172.21.15.103:0/3398697032 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7810154990 con 0x7f78100b3150 2024-09-10T22:39:56.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f7817600640 1 -- 172.21.15.103:0/3398697032 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f781013dc60 con 0x7f78100b3150 2024-09-10T22:39:56.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.106+0000 7f7817600640 1 -- 172.21.15.103:0/3398697032 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7810072500 con 0x7f78100b3150 2024-09-10T22:39:56.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.110+0000 7f780cc00640 1 -- 172.21.15.103:0/3398697032 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f77fc0046d0 con 0x7f78100b3150 2024-09-10T22:39:56.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.110+0000 7f780cc00640 1 --2- 172.21.15.103:0/3398697032 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f77f00725e0 0x7f77f0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:56.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.110+0000 7f780cc00640 1 -- 172.21.15.103:0/3398697032 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f77fc12cd10 con 0x7f78100b3150 2024-09-10T22:39:56.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.110+0000 7f7814c00640 1 --2- 172.21.15.103:0/3398697032 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f77f00725e0 0x7f77f0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:56.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.110+0000 7f7814c00640 1 --2- 172.21.15.103:0/3398697032 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f77f00725e0 0x7f77f0074aa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7800005fd0 tx=0x7f780000a780 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:56.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.114+0000 7f780cc00640 1 -- 172.21.15.103:0/3398697032 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f77fc132020 con 0x7f78100b3150 2024-09-10T22:39:56.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.278+0000 7f7817600640 1 -- 172.21.15.103:0/3398697032 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78101563e0 con 0x7f78100b3150 2024-09-10T22:39:56.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.282+0000 7f780cc00640 1 -- 172.21.15.103:0/3398697032 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17075 (secure 0 0 0) 0x7f77fc1292d0 con 0x7f78100b3150 2024-09-10T22:39:56.285 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:56.285 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":40,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:39:54.979272+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:39:52.660431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T22:39:53.935665+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:39:56.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.282+0000 7f7817600640 1 -- 172.21.15.103:0/3398697032 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f77f00725e0 msgr2=0x7f77f0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:56.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.282+0000 7f7817600640 1 --2- 172.21.15.103:0/3398697032 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f77f00725e0 0x7f77f0074aa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7800005fd0 tx=0x7f780000a780 comp rx=0 tx=0).stop 2024-09-10T22:39:56.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.282+0000 7f7817600640 1 -- 172.21.15.103:0/3398697032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78100b3150 msgr2=0x7f7810153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:56.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.282+0000 7f7817600640 1 --2- 172.21.15.103:0/3398697032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78100b3150 0x7f7810153dd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f77fc01af70 tx=0x7f77fc004040 comp rx=0 tx=0).stop 2024-09-10T22:39:56.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.282+0000 7f7817600640 1 -- 172.21.15.103:0/3398697032 shutdown_connections 2024-09-10T22:39:56.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.282+0000 7f7817600640 1 --2- 172.21.15.103:0/3398697032 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f77f00725e0 0x7f77f0074aa0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:56.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.282+0000 7f7817600640 1 --2- 172.21.15.103:0/3398697032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78100cf260 0x7f7810154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:56.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.282+0000 7f7817600640 1 --2- 172.21.15.103:0/3398697032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78100b3150 0x7f7810153dd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:56.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.282+0000 7f7817600640 1 --2- 172.21.15.103:0/3398697032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7810072a40 0x7f781013d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:56.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.282+0000 7f7817600640 1 -- 172.21.15.103:0/3398697032 >> 172.21.15.103:0/3398697032 conn(0x7f781006cc00 msgr2=0x7f7810159670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:56.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.282+0000 7f7817600640 1 -- 172.21.15.103:0/3398697032 shutdown_connections 2024-09-10T22:39:56.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.282+0000 7f7817600640 1 -- 172.21.15.103:0/3398697032 wait complete. 2024-09-10T22:39:56.307 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T22:39:56.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.450+0000 7f56c1200640 1 -- 172.21.15.103:0/3642935845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56a0003d30 msgr2=0x7f56a0004130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:56.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.450+0000 7f56c1200640 1 --2- 172.21.15.103:0/3642935845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56a0003d30 0x7f56a0004130 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f56ac001f50 tx=0x7f56ac01cc40 comp rx=0 tx=0).stop 2024-09-10T22:39:56.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.450+0000 7f56bbe00640 1 -- 172.21.15.103:0/3642935845 reap_dead start 2024-09-10T22:39:56.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.450+0000 7f56c1200640 1 -- 172.21.15.103:0/3642935845 shutdown_connections 2024-09-10T22:39:56.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.450+0000 7f56c1200640 1 -- 172.21.15.103:0/3642935845 >> 172.21.15.103:0/3642935845 conn(0x7f56bc0d18f0 msgr2=0x7f56bc0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:56.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.450+0000 7f56c1200640 1 -- 172.21.15.103:0/3642935845 shutdown_connections 2024-09-10T22:39:56.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.450+0000 7f56c1200640 1 -- 172.21.15.103:0/3642935845 wait complete. 2024-09-10T22:39:56.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.450+0000 7f56c1200640 1 Processor -- start 2024-09-10T22:39:56.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.450+0000 7f56c1200640 1 -- start start 2024-09-10T22:39:56.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.450+0000 7f56c1200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56a0003d30 0x7f56bc06e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:56.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56c1200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56bc0b6e00 0x7f56bc151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:56.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56c1200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56bc156ed0 0x7f56bc157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:56.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56c1200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc167b20 con 0x7f56bc156ed0 2024-09-10T22:39:56.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56c1200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc1679a0 con 0x7f56a0003d30 2024-09-10T22:39:56.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56c1200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f56bc167ca0 con 0x7f56bc0b6e00 2024-09-10T22:39:56.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56bbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56bc156ed0 0x7f56bc157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:56.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56bbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56bc156ed0 0x7f56bc157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57322/0 (socket says 172.21.15.103:57322) 2024-09-10T22:39:56.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56bbe00640 1 -- 172.21.15.103:0/1353440110 learned_addr learned my addr 172.21.15.103:0/1353440110 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:56.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56bb400640 1 --2- 172.21.15.103:0/1353440110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56a0003d30 0x7f56bc06e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:56.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56b2a00640 1 --2- 172.21.15.103:0/1353440110 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56bc0b6e00 0x7f56bc151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:56.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56bbe00640 1 -- 172.21.15.103:0/1353440110 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56bc0b6e00 msgr2=0x7f56bc151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:56.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56bbe00640 1 --2- 172.21.15.103:0/1353440110 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56bc0b6e00 0x7f56bc151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:56.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56bbe00640 1 -- 172.21.15.103:0/1353440110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56a0003d30 msgr2=0x7f56bc06e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:56.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56bbe00640 1 --2- 172.21.15.103:0/1353440110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56a0003d30 0x7f56bc06e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:56.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56bbe00640 1 -- 172.21.15.103:0/1353440110 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56bc06ec60 con 0x7f56bc156ed0 2024-09-10T22:39:56.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56b2a00640 1 --2- 172.21.15.103:0/1353440110 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56bc0b6e00 0x7f56bc151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:56.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56bb400640 1 --2- 172.21.15.103:0/1353440110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56a0003d30 0x7f56bc06e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:56.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56bbe00640 1 --2- 172.21.15.103:0/1353440110 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56bc156ed0 0x7f56bc157360 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f56bc074690 tx=0x7f56b40039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:56.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56b3e00640 1 -- 172.21.15.103:0/1353440110 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b4015070 con 0x7f56bc156ed0 2024-09-10T22:39:56.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56b3e00640 1 -- 172.21.15.103:0/1353440110 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56b4011880 con 0x7f56bc156ed0 2024-09-10T22:39:56.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56b3e00640 1 -- 172.21.15.103:0/1353440110 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b4011cd0 con 0x7f56bc156ed0 2024-09-10T22:39:56.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56c1200640 1 -- 172.21.15.103:0/1353440110 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56bc06f1e0 con 0x7f56bc156ed0 2024-09-10T22:39:56.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56c1200640 1 -- 172.21.15.103:0/1353440110 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56bc150e40 con 0x7f56bc156ed0 2024-09-10T22:39:56.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56c1200640 1 -- 172.21.15.103:0/1353440110 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56bc070430 con 0x7f56bc156ed0 2024-09-10T22:39:56.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.454+0000 7f56b3e00640 1 -- 172.21.15.103:0/1353440110 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f56b40103c0 con 0x7f56bc156ed0 2024-09-10T22:39:56.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.458+0000 7f56b3e00640 1 --2- 172.21.15.103:0/1353440110 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f56980725e0 0x7f5698074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:56.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.458+0000 7f56b3e00640 1 -- 172.21.15.103:0/1353440110 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f56b40940d0 con 0x7f56bc156ed0 2024-09-10T22:39:56.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.458+0000 7f56bb400640 1 --2- 172.21.15.103:0/1353440110 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f56980725e0 0x7f5698074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:56.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.458+0000 7f56bb400640 1 --2- 172.21.15.103:0/1353440110 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f56980725e0 0x7f5698074aa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0a9000 tx=0x7f56ac019a80 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:56.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.462+0000 7f56b3e00640 1 -- 172.21.15.103:0/1353440110 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f56b405f610 con 0x7f56bc156ed0 2024-09-10T22:39:56.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:56.670+0000 7f56c1200640 1 -- 172.21.15.103:0/1353440110 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f56bc06f620 con 0x7f56bc156ed0 2024-09-10T22:39:57.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.606+0000 7f56b3e00640 1 -- 172.21.15.103:0/1353440110 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f56b405ef10 con 0x7f56bc156ed0 2024-09-10T22:39:57.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.606+0000 7f56c1200640 1 -- 172.21.15.103:0/1353440110 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f56980725e0 msgr2=0x7f5698074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:57.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.606+0000 7f56c1200640 1 --2- 172.21.15.103:0/1353440110 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f56980725e0 0x7f5698074aa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0a9000 tx=0x7f56ac019a80 comp rx=0 tx=0).stop 2024-09-10T22:39:57.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.606+0000 7f56c1200640 1 -- 172.21.15.103:0/1353440110 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56bc156ed0 msgr2=0x7f56bc157360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:57.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.606+0000 7f56c1200640 1 --2- 172.21.15.103:0/1353440110 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56bc156ed0 0x7f56bc157360 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f56bc074690 tx=0x7f56b40039d0 comp rx=0 tx=0).stop 2024-09-10T22:39:57.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.606+0000 7f56c1200640 1 -- 172.21.15.103:0/1353440110 shutdown_connections 2024-09-10T22:39:57.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.606+0000 7f56c1200640 1 --2- 172.21.15.103:0/1353440110 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f56980725e0 0x7f5698074aa0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:57.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.606+0000 7f56c1200640 1 --2- 172.21.15.103:0/1353440110 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56bc156ed0 0x7f56bc157360 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:57.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.606+0000 7f56c1200640 1 --2- 172.21.15.103:0/1353440110 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56bc0b6e00 0x7f56bc151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:57.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.606+0000 7f56c1200640 1 --2- 172.21.15.103:0/1353440110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56a0003d30 0x7f56bc06e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:57.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.606+0000 7f56c1200640 1 -- 172.21.15.103:0/1353440110 >> 172.21.15.103:0/1353440110 conn(0x7f56bc0d18f0 msgr2=0x7f56bc0ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:57.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.606+0000 7f56c1200640 1 -- 172.21.15.103:0/1353440110 shutdown_connections 2024-09-10T22:39:57.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.606+0000 7f56c1200640 1 -- 172.21.15.103:0/1353440110 wait complete. 2024-09-10T22:39:57.645 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T22:39:57.645 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T22:39:57.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efebf600640 1 -- 172.21.15.103:0/2597909275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb815bcb0 msgr2=0x7efeb80cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:57.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efebf600640 1 --2- 172.21.15.103:0/2597909275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb815bcb0 0x7efeb80cf5f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efea8009bc0 tx=0x7efea801cb70 comp rx=0 tx=0).stop 2024-09-10T22:39:57.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efebf600640 1 -- 172.21.15.103:0/2597909275 shutdown_connections 2024-09-10T22:39:57.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efebf600640 1 --2- 172.21.15.103:0/2597909275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efeb80d0710 0x7efeb80b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:57.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efebf600640 1 --2- 172.21.15.103:0/2597909275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb815bcb0 0x7efeb80cf5f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:57.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efebf600640 1 -- 172.21.15.103:0/2597909275 >> 172.21.15.103:0/2597909275 conn(0x7efeb80d1a20 msgr2=0x7efeb80d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:57.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efebf600640 1 -- 172.21.15.103:0/2597909275 shutdown_connections 2024-09-10T22:39:57.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efebf600640 1 -- 172.21.15.103:0/2597909275 wait complete. 2024-09-10T22:39:57.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efebf600640 1 Processor -- start 2024-09-10T22:39:57.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efebf600640 1 -- start start 2024-09-10T22:39:57.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efebf600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efeb80d0710 0x7efeb814bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:57.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efebf600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb80d2540 0x7efeb80b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:57.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efebf600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efeb815bcb0 0x7efeb806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:57.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efebf600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8168960 con 0x7efeb80d2540 2024-09-10T22:39:57.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efebf600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81687e0 con 0x7efeb815bcb0 2024-09-10T22:39:57.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efebf600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7efeb8168ae0 con 0x7efeb80d0710 2024-09-10T22:39:57.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efeb7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb80d2540 0x7efeb80b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:57.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efeb7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb80d2540 0x7efeb80b4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43022/0 (socket says 172.21.15.103:43022) 2024-09-10T22:39:57.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.790+0000 7efeb7e00640 1 -- 172.21.15.103:0/1032086935 learned_addr learned my addr 172.21.15.103:0/1032086935 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:57.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efebcc00640 1 --2- 172.21.15.103:0/1032086935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efeb80d0710 0x7efeb814bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:57.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efebd600640 1 --2- 172.21.15.103:0/1032086935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efeb815bcb0 0x7efeb806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:57.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efeb7e00640 1 -- 172.21.15.103:0/1032086935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efeb80d0710 msgr2=0x7efeb814bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:57.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efeb7e00640 1 --2- 172.21.15.103:0/1032086935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efeb80d0710 0x7efeb814bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:57.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efeb7e00640 1 -- 172.21.15.103:0/1032086935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efeb815bcb0 msgr2=0x7efeb806e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:57.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efeb7e00640 1 --2- 172.21.15.103:0/1032086935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efeb815bcb0 0x7efeb806e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:57.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efeb7e00640 1 -- 172.21.15.103:0/1032086935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb80b50c0 con 0x7efeb80d2540 2024-09-10T22:39:57.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efebcc00640 1 --2- 172.21.15.103:0/1032086935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efeb80d0710 0x7efeb814bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:39:57.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efebd600640 1 --2- 172.21.15.103:0/1032086935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efeb815bcb0 0x7efeb806e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:39:57.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efeb7e00640 1 --2- 172.21.15.103:0/1032086935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb80d2540 0x7efeb80b4870 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efea400c4b0 tx=0x7efea400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:57.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efeb4c00640 1 -- 172.21.15.103:0/1032086935 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4016020 con 0x7efeb80d2540 2024-09-10T22:39:57.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efeb4c00640 1 -- 172.21.15.103:0/1032086935 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efea4012920 con 0x7efeb80d2540 2024-09-10T22:39:57.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efeb4c00640 1 -- 172.21.15.103:0/1032086935 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4012d90 con 0x7efeb80d2540 2024-09-10T22:39:57.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efebf600640 1 -- 172.21.15.103:0/1032086935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb80b53a0 con 0x7efeb80d2540 2024-09-10T22:39:57.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efebf600640 1 -- 172.21.15.103:0/1032086935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb80b5960 con 0x7efeb80d2540 2024-09-10T22:39:57.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efebf600640 1 -- 172.21.15.103:0/1032086935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb80b1490 con 0x7efeb80d2540 2024-09-10T22:39:57.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efeb4c00640 1 -- 172.21.15.103:0/1032086935 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7efea401a3b0 con 0x7efeb80d2540 2024-09-10T22:39:57.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efeb4c00640 1 --2- 172.21.15.103:0/1032086935 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efe980725e0 0x7efe98074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:57.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.794+0000 7efeb4c00640 1 -- 172.21.15.103:0/1032086935 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7efea4093390 con 0x7efeb80d2540 2024-09-10T22:39:57.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.798+0000 7efebcc00640 1 --2- 172.21.15.103:0/1032086935 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efe980725e0 0x7efe98074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:57.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.798+0000 7efebcc00640 1 --2- 172.21.15.103:0/1032086935 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efe980725e0 0x7efe98074aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efea80af000 tx=0x7efea801b3b0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:57.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.802+0000 7efeb4c00640 1 -- 172.21.15.103:0/1032086935 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7efea4020030 con 0x7efeb80d2540 2024-09-10T22:39:58.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:57.998+0000 7efebf600640 1 -- 172.21.15.103:0/1032086935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7efeb80af800 con 0x7efeb80d2540 2024-09-10T22:39:58.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.610+0000 7efeb4c00640 1 -- 172.21.15.103:0/1032086935 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v19) ==== 122+0+0 (secure 0 0 0) 0x7efea405e8e0 con 0x7efeb80d2540 2024-09-10T22:39:58.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.614+0000 7efebf600640 1 -- 172.21.15.103:0/1032086935 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efe980725e0 msgr2=0x7efe98074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:58.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.614+0000 7efebf600640 1 --2- 172.21.15.103:0/1032086935 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efe980725e0 0x7efe98074aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efea80af000 tx=0x7efea801b3b0 comp rx=0 tx=0).stop 2024-09-10T22:39:58.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.614+0000 7efebf600640 1 -- 172.21.15.103:0/1032086935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb80d2540 msgr2=0x7efeb80b4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:58.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.614+0000 7efebf600640 1 --2- 172.21.15.103:0/1032086935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb80d2540 0x7efeb80b4870 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efea400c4b0 tx=0x7efea400c970 comp rx=0 tx=0).stop 2024-09-10T22:39:58.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.614+0000 7efebf600640 1 -- 172.21.15.103:0/1032086935 shutdown_connections 2024-09-10T22:39:58.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.614+0000 7efebf600640 1 --2- 172.21.15.103:0/1032086935 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efe980725e0 0x7efe98074aa0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:58.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.614+0000 7efebf600640 1 --2- 172.21.15.103:0/1032086935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efeb815bcb0 0x7efeb806e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:58.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.614+0000 7efebf600640 1 --2- 172.21.15.103:0/1032086935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb80d2540 0x7efeb80b4870 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:58.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.614+0000 7efebf600640 1 --2- 172.21.15.103:0/1032086935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efeb80d0710 0x7efeb814bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:58.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.614+0000 7efebf600640 1 -- 172.21.15.103:0/1032086935 >> 172.21.15.103:0/1032086935 conn(0x7efeb80d1a20 msgr2=0x7efeb80d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:58.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.614+0000 7efebf600640 1 -- 172.21.15.103:0/1032086935 shutdown_connections 2024-09-10T22:39:58.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.614+0000 7efebf600640 1 -- 172.21.15.103:0/1032086935 wait complete. 2024-09-10T22:39:58.639 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T22:39:58.639 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:39:58.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf03e00640 1 -- 172.21.15.103:0/3226279051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf0415f0e0 msgr2=0x7fcf040d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:58.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf03e00640 1 --2- 172.21.15.103:0/3226279051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf0415f0e0 0x7fcf040d1280 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009900 tx=0x7fcef401c850 comp rx=0 tx=0).stop 2024-09-10T22:39:58.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf03e00640 1 -- 172.21.15.103:0/3226279051 shutdown_connections 2024-09-10T22:39:58.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf03e00640 1 --2- 172.21.15.103:0/3226279051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf0415f0e0 0x7fcf040d1280 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:58.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf03e00640 1 -- 172.21.15.103:0/3226279051 >> 172.21.15.103:0/3226279051 conn(0x7fcf040d18d0 msgr2=0x7fcf040d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:58.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf03e00640 1 -- 172.21.15.103:0/3226279051 shutdown_connections 2024-09-10T22:39:58.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf03e00640 1 -- 172.21.15.103:0/3226279051 wait complete. 2024-09-10T22:39:58.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf03e00640 1 Processor -- start 2024-09-10T22:39:58.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf03e00640 1 -- start start 2024-09-10T22:39:58.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf03e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf04070b40 0x7fcf0415ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:58.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf03e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf040d23f0 0x7fcf040b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:58.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf03e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf0415f0e0 0x7fcf040c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:58.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf03e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcf04169e00 con 0x7fcf040d23f0 2024-09-10T22:39:58.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf03e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcf04169c80 con 0x7fcf0415f0e0 2024-09-10T22:39:58.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf03e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcf04169f80 con 0x7fcf04070b40 2024-09-10T22:39:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf02000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf040d23f0 0x7fcf040b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf02000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf040d23f0 0x7fcf040b2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43032/0 (socket says 172.21.15.103:43032) 2024-09-10T22:39:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf02000640 1 -- 172.21.15.103:0/570989744 learned_addr learned my addr 172.21.15.103:0/570989744 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf02a00640 1 --2- 172.21.15.103:0/570989744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf04070b40 0x7fcf0415ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.778+0000 7fcf03400640 1 --2- 172.21.15.103:0/570989744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf0415f0e0 0x7fcf040c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.782+0000 7fcf02000640 1 -- 172.21.15.103:0/570989744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf04070b40 msgr2=0x7fcf0415ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.782+0000 7fcf02000640 1 --2- 172.21.15.103:0/570989744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf04070b40 0x7fcf0415ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.782+0000 7fcf02000640 1 -- 172.21.15.103:0/570989744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf0415f0e0 msgr2=0x7fcf040c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.782+0000 7fcf02000640 1 --2- 172.21.15.103:0/570989744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf0415f0e0 0x7fcf040c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.782+0000 7fcf02000640 1 -- 172.21.15.103:0/570989744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf040c8ea0 con 0x7fcf040d23f0 2024-09-10T22:39:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.782+0000 7fcf02a00640 1 --2- 172.21.15.103:0/570989744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf04070b40 0x7fcf0415ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.782+0000 7fcf02000640 1 --2- 172.21.15.103:0/570989744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf040d23f0 0x7fcf040b2c30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcef000c450 tx=0x7fcef000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:58.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.782+0000 7fcefaa00640 1 -- 172.21.15.103:0/570989744 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef0017070 con 0x7fcf040d23f0 2024-09-10T22:39:58.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.782+0000 7fcefaa00640 1 -- 172.21.15.103:0/570989744 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcef0003600 con 0x7fcf040d23f0 2024-09-10T22:39:58.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.782+0000 7fcefaa00640 1 -- 172.21.15.103:0/570989744 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef0003a50 con 0x7fcf040d23f0 2024-09-10T22:39:58.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.782+0000 7fcf03e00640 1 -- 172.21.15.103:0/570989744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf040c91e0 con 0x7fcf040d23f0 2024-09-10T22:39:58.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.782+0000 7fcf03e00640 1 -- 172.21.15.103:0/570989744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf040c9a20 con 0x7fcf040d23f0 2024-09-10T22:39:58.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.782+0000 7fcf03e00640 1 -- 172.21.15.103:0/570989744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf040c9c20 con 0x7fcf040d23f0 2024-09-10T22:39:58.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.782+0000 7fcefaa00640 1 -- 172.21.15.103:0/570989744 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcef0003bf0 con 0x7fcf040d23f0 2024-09-10T22:39:58.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.782+0000 7fcefaa00640 1 --2- 172.21.15.103:0/570989744 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcee40725e0 0x7fcee4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:58.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.782+0000 7fcefaa00640 1 -- 172.21.15.103:0/570989744 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fcef0092b70 con 0x7fcf040d23f0 2024-09-10T22:39:58.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.786+0000 7fcf02a00640 1 --2- 172.21.15.103:0/570989744 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcee40725e0 0x7fcee4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:58.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.786+0000 7fcf02a00640 1 --2- 172.21.15.103:0/570989744 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcee40725e0 0x7fcee4074aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcef40af000 tx=0x7fcef401b090 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:58.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.786+0000 7fcefaa00640 1 -- 172.21.15.103:0/570989744 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcf040c9c20 con 0x7fcf040d23f0 2024-09-10T22:39:58.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.982+0000 7fcf03e00640 1 -- 172.21.15.103:0/570989744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf040d1280 con 0x7fcf040d23f0 2024-09-10T22:39:58.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.982+0000 7fcefaa00640 1 -- 172.21.15.103:0/570989744 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5235 (secure 0 0 0) 0x7fcf040c91e0 con 0x7fcf040d23f0 2024-09-10T22:39:58.988 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:58.988 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":19,"btime":"2024-09-10T22:39:58:609166+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/3313045987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3313045987},{"type":"v1","addr":"172.21.15.131:6836","nonce":3313045987}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":4754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/1068577002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1068577002},{"type":"v1","addr":"172.21.15.131:6837","nonce":1068577002}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/4043692269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4043692269},{"type":"v1","addr":"172.21.15.103:6833","nonce":4043692269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:39:54.979240+0000","modified":"2024-09-10T22:39:58.002325+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4941},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4941":{"gid":4941,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/1194009116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1194009116},{"type":"v1","addr":"172.21.15.103:6835","nonce":1194009116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4941,"qdb_cluster":[4941]},"id":2}]} 2024-09-10T22:39:58.988 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 19 2024-09-10T22:39:58.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.986+0000 7fcf03e00640 1 -- 172.21.15.103:0/570989744 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcee40725e0 msgr2=0x7fcee4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:58.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.986+0000 7fcf03e00640 1 --2- 172.21.15.103:0/570989744 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcee40725e0 0x7fcee4074aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcef40af000 tx=0x7fcef401b090 comp rx=0 tx=0).stop 2024-09-10T22:39:58.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.986+0000 7fcf03e00640 1 -- 172.21.15.103:0/570989744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf040d23f0 msgr2=0x7fcf040b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:58.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.986+0000 7fcf03e00640 1 --2- 172.21.15.103:0/570989744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf040d23f0 0x7fcf040b2c30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcef000c450 tx=0x7fcef000c910 comp rx=0 tx=0).stop 2024-09-10T22:39:58.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.986+0000 7fcf03e00640 1 -- 172.21.15.103:0/570989744 shutdown_connections 2024-09-10T22:39:58.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.986+0000 7fcf03e00640 1 --2- 172.21.15.103:0/570989744 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcee40725e0 0x7fcee4074aa0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:58.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.986+0000 7fcf03e00640 1 --2- 172.21.15.103:0/570989744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf0415f0e0 0x7fcf040c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:58.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.986+0000 7fcf03e00640 1 --2- 172.21.15.103:0/570989744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf040d23f0 0x7fcf040b2c30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:58.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.986+0000 7fcf03e00640 1 --2- 172.21.15.103:0/570989744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf04070b40 0x7fcf0415ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:58.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.986+0000 7fcf03e00640 1 -- 172.21.15.103:0/570989744 >> 172.21.15.103:0/570989744 conn(0x7fcf040d18d0 msgr2=0x7fcf04070430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:58.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.986+0000 7fcf03e00640 1 -- 172.21.15.103:0/570989744 shutdown_connections 2024-09-10T22:39:58.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:58.986+0000 7fcf03e00640 1 -- 172.21.15.103:0/570989744 wait complete. 2024-09-10T22:39:59.010 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:39:59.136 INFO:tasks.ceph.mds.c.smithi103.stderr:2024-09-10T22:39:59.130+0000 7f4c6ea00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T22:39:59.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd855a00640 1 -- 172.21.15.103:0/452997327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd85015f1a0 msgr2=0x7fd8500ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:59.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd855a00640 1 --2- 172.21.15.103:0/452997327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd85015f1a0 0x7fd8500ae7f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd840009840 tx=0x7fd84001c820 comp rx=0 tx=0).stop 2024-09-10T22:39:59.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd855a00640 1 -- 172.21.15.103:0/452997327 shutdown_connections 2024-09-10T22:39:59.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd855a00640 1 --2- 172.21.15.103:0/452997327 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8500cd500 0x7fd85015f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:59.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd855a00640 1 --2- 172.21.15.103:0/452997327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd85015f1a0 0x7fd8500ae7f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:59.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd855a00640 1 -- 172.21.15.103:0/452997327 >> 172.21.15.103:0/452997327 conn(0x7fd8500d1a20 msgr2=0x7fd8500d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:59.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd855a00640 1 -- 172.21.15.103:0/452997327 shutdown_connections 2024-09-10T22:39:59.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd855a00640 1 -- 172.21.15.103:0/452997327 wait complete. 2024-09-10T22:39:59.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd855a00640 1 Processor -- start 2024-09-10T22:39:59.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd855a00640 1 -- start start 2024-09-10T22:39:59.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd855a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8500cd500 0x7fd8500b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:59.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd855a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8500cdd00 0x7fd850152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:59.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd855a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd85015f1a0 0x7fd8500c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:59.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd855a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd850168de0 con 0x7fd8500cdd00 2024-09-10T22:39:59.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd855a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd8500cdb20 con 0x7fd85015f1a0 2024-09-10T22:39:59.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd855a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd850168f60 con 0x7fd8500cd500 2024-09-10T22:39:59.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd846000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8500cdd00 0x7fd850152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:59.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd846000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8500cdd00 0x7fd850152180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43036/0 (socket says 172.21.15.103:43036) 2024-09-10T22:39:59.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd846000640 1 -- 172.21.15.103:0/3099457176 learned_addr learned my addr 172.21.15.103:0/3099457176 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:59.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd84f400640 1 --2- 172.21.15.103:0/3099457176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd85015f1a0 0x7fd8500c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:59.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd84ea00640 1 --2- 172.21.15.103:0/3099457176 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8500cd500 0x7fd8500b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:59.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd846000640 1 -- 172.21.15.103:0/3099457176 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8500cd500 msgr2=0x7fd8500b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:59.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd846000640 1 --2- 172.21.15.103:0/3099457176 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8500cd500 0x7fd8500b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:59.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd846000640 1 -- 172.21.15.103:0/3099457176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd85015f1a0 msgr2=0x7fd8500c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:59.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd846000640 1 --2- 172.21.15.103:0/3099457176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd85015f1a0 0x7fd8500c42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:59.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd846000640 1 -- 172.21.15.103:0/3099457176 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd850152c80 con 0x7fd8500cdd00 2024-09-10T22:39:59.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd84f400640 1 --2- 172.21.15.103:0/3099457176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd85015f1a0 0x7fd8500c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:59.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.150+0000 7fd84ea00640 1 --2- 172.21.15.103:0/3099457176 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8500cd500 0x7fd8500b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:59.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.154+0000 7fd846000640 1 --2- 172.21.15.103:0/3099457176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8500cdd00 0x7fd850152180 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd83800c490 tx=0x7fd83800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:59.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.154+0000 7fd847400640 1 -- 172.21.15.103:0/3099457176 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd838016020 con 0x7fd8500cdd00 2024-09-10T22:39:59.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.154+0000 7fd847400640 1 -- 172.21.15.103:0/3099457176 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd838012940 con 0x7fd8500cdd00 2024-09-10T22:39:59.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.154+0000 7fd847400640 1 -- 172.21.15.103:0/3099457176 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd838012d90 con 0x7fd8500cdd00 2024-09-10T22:39:59.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.154+0000 7fd855a00640 1 -- 172.21.15.103:0/3099457176 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd850152f60 con 0x7fd8500cdd00 2024-09-10T22:39:59.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.154+0000 7fd855a00640 1 -- 172.21.15.103:0/3099457176 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd850153520 con 0x7fd8500cdd00 2024-09-10T22:39:59.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.154+0000 7fd855a00640 1 -- 172.21.15.103:0/3099457176 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd85015f890 con 0x7fd8500cdd00 2024-09-10T22:39:59.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.154+0000 7fd847400640 1 -- 172.21.15.103:0/3099457176 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd83801b400 con 0x7fd8500cdd00 2024-09-10T22:39:59.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.154+0000 7fd847400640 1 --2- 172.21.15.103:0/3099457176 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd82c0725e0 0x7fd82c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:59.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.154+0000 7fd847400640 1 -- 172.21.15.103:0/3099457176 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fd838093710 con 0x7fd8500cdd00 2024-09-10T22:39:59.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.154+0000 7fd84ea00640 1 --2- 172.21.15.103:0/3099457176 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd82c0725e0 0x7fd82c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:59.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.158+0000 7fd84ea00640 1 --2- 172.21.15.103:0/3099457176 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd82c0725e0 0x7fd82c074aa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd8400af000 tx=0x7fd84001b060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:59.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.158+0000 7fd847400640 1 -- 172.21.15.103:0/3099457176 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd838020020 con 0x7fd8500cdd00 2024-09-10T22:39:59.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.326+0000 7fd855a00640 1 -- 172.21.15.103:0/3099457176 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8500b0490 con 0x7fd8500cdd00 2024-09-10T22:39:59.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.326+0000 7fd847400640 1 -- 172.21.15.103:0/3099457176 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+17062 (secure 0 0 0) 0x7fd83805ed20 con 0x7fd8500cdd00 2024-09-10T22:39:59.331 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:59.331 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:39:56.589776+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:39:52.660431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T22:39:53.935665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:39:59.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.330+0000 7fd855a00640 1 -- 172.21.15.103:0/3099457176 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd82c0725e0 msgr2=0x7fd82c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:59.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.330+0000 7fd855a00640 1 --2- 172.21.15.103:0/3099457176 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd82c0725e0 0x7fd82c074aa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd8400af000 tx=0x7fd84001b060 comp rx=0 tx=0).stop 2024-09-10T22:39:59.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.330+0000 7fd855a00640 1 -- 172.21.15.103:0/3099457176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8500cdd00 msgr2=0x7fd850152180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:59.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.330+0000 7fd855a00640 1 --2- 172.21.15.103:0/3099457176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8500cdd00 0x7fd850152180 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd83800c490 tx=0x7fd83800c950 comp rx=0 tx=0).stop 2024-09-10T22:39:59.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.330+0000 7fd855a00640 1 -- 172.21.15.103:0/3099457176 shutdown_connections 2024-09-10T22:39:59.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.330+0000 7fd855a00640 1 --2- 172.21.15.103:0/3099457176 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd82c0725e0 0x7fd82c074aa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:59.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.330+0000 7fd855a00640 1 --2- 172.21.15.103:0/3099457176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd85015f1a0 0x7fd8500c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:59.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.330+0000 7fd855a00640 1 --2- 172.21.15.103:0/3099457176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8500cdd00 0x7fd850152180 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:59.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.330+0000 7fd855a00640 1 --2- 172.21.15.103:0/3099457176 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8500cd500 0x7fd8500b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:59.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.330+0000 7fd855a00640 1 -- 172.21.15.103:0/3099457176 >> 172.21.15.103:0/3099457176 conn(0x7fd8500d1a20 msgr2=0x7fd8500d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:59.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.330+0000 7fd855a00640 1 -- 172.21.15.103:0/3099457176 shutdown_connections 2024-09-10T22:39:59.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.330+0000 7fd855a00640 1 -- 172.21.15.103:0/3099457176 wait complete. 2024-09-10T22:39:59.358 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T22:39:59.358 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:39:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87aee00640 1 -- 172.21.15.103:0/599441324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f878c0039f0 msgr2=0x7f878c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87aee00640 1 --2- 172.21.15.103:0/599441324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f878c0039f0 0x7f878c003dd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8798009b70 tx=0x7f879801d220 comp rx=0 tx=0).stop 2024-09-10T22:39:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87ace00640 1 -- 172.21.15.103:0/599441324 reap_dead start 2024-09-10T22:39:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87aee00640 1 -- 172.21.15.103:0/599441324 shutdown_connections 2024-09-10T22:39:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87aee00640 1 -- 172.21.15.103:0/599441324 >> 172.21.15.103:0/599441324 conn(0x7f87a806cc00 msgr2=0x7f87a806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87aee00640 1 -- 172.21.15.103:0/599441324 shutdown_connections 2024-09-10T22:39:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87aee00640 1 -- 172.21.15.103:0/599441324 wait complete. 2024-09-10T22:39:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87aee00640 1 Processor -- start 2024-09-10T22:39:59.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87aee00640 1 -- start start 2024-09-10T22:39:59.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87aee00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f878c0039f0 0x7f87a81f8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:59.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87aee00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87a80b2000 0x7f87a8150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:59.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87aee00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87a8156280 0x7f87a8156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87aee00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f87a80cff50 con 0x7f878c0039f0 2024-09-10T22:39:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87aee00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f87a80cfdd0 con 0x7f87a8156280 2024-09-10T22:39:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87aee00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f87a80d00d0 con 0x7f87a80b2000 2024-09-10T22:39:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87a7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f878c0039f0 0x7f87a81f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87a7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f878c0039f0 0x7f87a81f8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43058/0 (socket says 172.21.15.103:43058) 2024-09-10T22:39:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87a7e00640 1 -- 172.21.15.103:0/2629390514 learned_addr learned my addr 172.21.15.103:0/2629390514 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87a7400640 1 --2- 172.21.15.103:0/2629390514 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87a80b2000 0x7f87a8150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.498+0000 7f87ace00640 1 --2- 172.21.15.103:0/2629390514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87a8156280 0x7f87a8156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.502+0000 7f87a7e00640 1 -- 172.21.15.103:0/2629390514 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87a80b2000 msgr2=0x7f87a8150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.502+0000 7f87a7e00640 1 --2- 172.21.15.103:0/2629390514 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87a80b2000 0x7f87a8150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.502+0000 7f87a7e00640 1 -- 172.21.15.103:0/2629390514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87a8156280 msgr2=0x7f87a8156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.502+0000 7f87a7e00640 1 --2- 172.21.15.103:0/2629390514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87a8156280 0x7f87a8156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.502+0000 7f87a7e00640 1 -- 172.21.15.103:0/2629390514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a81530b0 con 0x7f878c0039f0 2024-09-10T22:39:59.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.502+0000 7f87ace00640 1 --2- 172.21.15.103:0/2629390514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87a8156280 0x7f87a8156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:39:59.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.502+0000 7f87a7e00640 1 --2- 172.21.15.103:0/2629390514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f878c0039f0 0x7f87a81f8240 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8798009b70 tx=0x7f87980050a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:59.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.502+0000 7f879fe00640 1 -- 172.21.15.103:0/2629390514 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87980bb030 con 0x7f878c0039f0 2024-09-10T22:39:59.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.502+0000 7f879fe00640 1 -- 172.21.15.103:0/2629390514 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8798004900 con 0x7f878c0039f0 2024-09-10T22:39:59.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.502+0000 7f879fe00640 1 -- 172.21.15.103:0/2629390514 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8798004d30 con 0x7f878c0039f0 2024-09-10T22:39:59.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.502+0000 7f87aee00640 1 -- 172.21.15.103:0/2629390514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87a8153390 con 0x7f878c0039f0 2024-09-10T22:39:59.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.502+0000 7f87aee00640 1 -- 172.21.15.103:0/2629390514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87a815a610 con 0x7f878c0039f0 2024-09-10T22:39:59.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.502+0000 7f87aee00640 1 -- 172.21.15.103:0/2629390514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87a80b2870 con 0x7f878c0039f0 2024-09-10T22:39:59.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.502+0000 7f879fe00640 1 -- 172.21.15.103:0/2629390514 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f87980b7440 con 0x7f878c0039f0 2024-09-10T22:39:59.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.502+0000 7f879fe00640 1 --2- 172.21.15.103:0/2629390514 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f87880725e0 0x7f8788074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:59.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.506+0000 7f879fe00640 1 -- 172.21.15.103:0/2629390514 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f879812ea10 con 0x7f878c0039f0 2024-09-10T22:39:59.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.506+0000 7f87a7400640 1 --2- 172.21.15.103:0/2629390514 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f87880725e0 0x7f8788074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:59.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.506+0000 7f87a7400640 1 --2- 172.21.15.103:0/2629390514 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f87880725e0 0x7f8788074aa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8794006fd0 tx=0x7f8794006d70 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:59.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.506+0000 7f879fe00640 1 -- 172.21.15.103:0/2629390514 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8798016fa0 con 0x7f878c0039f0 2024-09-10T22:39:59.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.670+0000 7f87aee00640 1 -- 172.21.15.103:0/2629390514 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f87a815c050 con 0x7f87880725e0 2024-09-10T22:39:59.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.678+0000 7f879fe00640 1 -- 172.21.15.103:0/2629390514 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7f87a815c050 con 0x7f87880725e0 2024-09-10T22:39:59.686 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:39:59.688 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:39:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.678+0000 7f87aee00640 1 -- 172.21.15.103:0/2629390514 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f87880725e0 msgr2=0x7f8788074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.678+0000 7f87aee00640 1 --2- 172.21.15.103:0/2629390514 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f87880725e0 0x7f8788074aa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8794006fd0 tx=0x7f8794006d70 comp rx=0 tx=0).stop 2024-09-10T22:39:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.678+0000 7f87aee00640 1 -- 172.21.15.103:0/2629390514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f878c0039f0 msgr2=0x7f87a81f8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.678+0000 7f87aee00640 1 --2- 172.21.15.103:0/2629390514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f878c0039f0 0x7f87a81f8240 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8798009b70 tx=0x7f87980050a0 comp rx=0 tx=0).stop 2024-09-10T22:39:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.678+0000 7f87aee00640 1 -- 172.21.15.103:0/2629390514 shutdown_connections 2024-09-10T22:39:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.678+0000 7f87aee00640 1 --2- 172.21.15.103:0/2629390514 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f87880725e0 0x7f8788074aa0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.678+0000 7f87aee00640 1 --2- 172.21.15.103:0/2629390514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87a8156280 0x7f87a8156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.678+0000 7f87aee00640 1 --2- 172.21.15.103:0/2629390514 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87a80b2000 0x7f87a8150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.678+0000 7f87aee00640 1 --2- 172.21.15.103:0/2629390514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f878c0039f0 0x7f87a81f8240 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:59.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.678+0000 7f87aee00640 1 -- 172.21.15.103:0/2629390514 >> 172.21.15.103:0/2629390514 conn(0x7f87a806cc00 msgr2=0x7f87a806ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:59.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.678+0000 7f87aee00640 1 -- 172.21.15.103:0/2629390514 shutdown_connections 2024-09-10T22:39:59.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.678+0000 7f87aee00640 1 -- 172.21.15.103:0/2629390514 wait complete. 2024-09-10T22:39:59.703 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-09-10T22:39:59.634571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221092,"kb_used_data":4848,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753628,"statfs":{"total":773094113280,"available":772867715072,"internally_reserved":0,"allocated":4964352,"data_stored":2775492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000974"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602494+0000","last_change":"2024-09-10T22:39:55.605188+0000","last_active":"2024-09-10T22:39:56.602494+0000","last_peered":"2024-09-10T22:39:56.602494+0000","last_clean":"2024-09-10T22:39:56.602494+0000","last_became_active":"2024-09-10T22:39:55.603566+0000","last_became_peered":"2024-09-10T22:39:55.603566+0000","last_unstale":"2024-09-10T22:39:56.602494+0000","last_undegraded":"2024-09-10T22:39:56.602494+0000","last_fullsized":"2024-09-10T22:39:56.602494+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:17:43.775795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602666+0000","last_change":"2024-09-10T22:39:55.609270+0000","last_active":"2024-09-10T22:39:56.602666+0000","last_peered":"2024-09-10T22:39:56.602666+0000","last_clean":"2024-09-10T22:39:56.602666+0000","last_became_active":"2024-09-10T22:39:55.609026+0000","last_became_peered":"2024-09-10T22:39:55.609026+0000","last_unstale":"2024-09-10T22:39:56.602666+0000","last_undegraded":"2024-09-10T22:39:56.602666+0000","last_fullsized":"2024-09-10T22:39:56.602666+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:39.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051749+0000","last_change":"2024-09-10T22:39:55.609924+0000","last_active":"2024-09-10T22:39:58.051749+0000","last_peered":"2024-09-10T22:39:58.051749+0000","last_clean":"2024-09-10T22:39:58.051749+0000","last_became_active":"2024-09-10T22:39:55.609660+0000","last_became_peered":"2024-09-10T22:39:55.609660+0000","last_unstale":"2024-09-10T22:39:58.051749+0000","last_undegraded":"2024-09-10T22:39:58.051749+0000","last_fullsized":"2024-09-10T22:39:58.051749+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:11.717529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.584789+0000","last_change":"2024-09-10T22:39:55.621855+0000","last_active":"2024-09-10T22:39:57.584789+0000","last_peered":"2024-09-10T22:39:57.584789+0000","last_clean":"2024-09-10T22:39:57.584789+0000","last_became_active":"2024-09-10T22:39:55.621561+0000","last_became_peered":"2024-09-10T22:39:55.621561+0000","last_unstale":"2024-09-10T22:39:57.584789+0000","last_undegraded":"2024-09-10T22:39:57.584789+0000","last_fullsized":"2024-09-10T22:39:57.584789+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:06.440429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.584768+0000","last_change":"2024-09-10T22:39:55.620345+0000","last_active":"2024-09-10T22:39:57.584768+0000","last_peered":"2024-09-10T22:39:57.584768+0000","last_clean":"2024-09-10T22:39:57.584768+0000","last_became_active":"2024-09-10T22:39:55.620025+0000","last_became_peered":"2024-09-10T22:39:55.620025+0000","last_unstale":"2024-09-10T22:39:57.584768+0000","last_undegraded":"2024-09-10T22:39:57.584768+0000","last_fullsized":"2024-09-10T22:39:57.584768+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:07.598316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.620548+0000","last_change":"2024-09-10T22:39:55.613543+0000","last_active":"2024-09-10T22:39:55.620548+0000","last_peered":"2024-09-10T22:39:55.620548+0000","last_clean":"2024-09-10T22:39:55.620548+0000","last_became_active":"2024-09-10T22:39:55.613277+0000","last_became_peered":"2024-09-10T22:39:55.613277+0000","last_unstale":"2024-09-10T22:39:55.620548+0000","last_undegraded":"2024-09-10T22:39:55.620548+0000","last_fullsized":"2024-09-10T22:39:55.620548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:20.332196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.587572+0000","last_change":"2024-09-10T22:39:55.594323+0000","last_active":"2024-09-10T22:39:57.587572+0000","last_peered":"2024-09-10T22:39:57.587572+0000","last_clean":"2024-09-10T22:39:57.587572+0000","last_became_active":"2024-09-10T22:39:55.594051+0000","last_became_peered":"2024-09-10T22:39:55.594051+0000","last_unstale":"2024-09-10T22:39:57.587572+0000","last_undegraded":"2024-09-10T22:39:57.587572+0000","last_fullsized":"2024-09-10T22:39:57.587572+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:00.484294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.601888+0000","last_change":"2024-09-10T22:39:55.592578+0000","last_active":"2024-09-10T22:39:56.601888+0000","last_peered":"2024-09-10T22:39:56.601888+0000","last_clean":"2024-09-10T22:39:56.601888+0000","last_became_active":"2024-09-10T22:39:55.592328+0000","last_became_peered":"2024-09-10T22:39:55.592328+0000","last_unstale":"2024-09-10T22:39:56.601888+0000","last_undegraded":"2024-09-10T22:39:56.601888+0000","last_fullsized":"2024-09-10T22:39:56.601888+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:10.930758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051820+0000","last_change":"2024-09-10T22:39:55.609987+0000","last_active":"2024-09-10T22:39:58.051820+0000","last_peered":"2024-09-10T22:39:58.051820+0000","last_clean":"2024-09-10T22:39:58.051820+0000","last_became_active":"2024-09-10T22:39:55.609686+0000","last_became_peered":"2024-09-10T22:39:55.609686+0000","last_unstale":"2024-09-10T22:39:58.051820+0000","last_undegraded":"2024-09-10T22:39:58.051820+0000","last_fullsized":"2024-09-10T22:39:58.051820+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:25.398537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.588020+0000","last_change":"2024-09-10T22:39:55.604433+0000","last_active":"2024-09-10T22:39:57.588020+0000","last_peered":"2024-09-10T22:39:57.588020+0000","last_clean":"2024-09-10T22:39:57.588020+0000","last_became_active":"2024-09-10T22:39:55.594486+0000","last_became_peered":"2024-09-10T22:39:55.594486+0000","last_unstale":"2024-09-10T22:39:57.588020+0000","last_undegraded":"2024-09-10T22:39:57.588020+0000","last_fullsized":"2024-09-10T22:39:57.588020+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:17.577141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.588143+0000","last_change":"2024-09-10T22:39:55.593373+0000","last_active":"2024-09-10T22:39:57.588143+0000","last_peered":"2024-09-10T22:39:57.588143+0000","last_clean":"2024-09-10T22:39:57.588143+0000","last_became_active":"2024-09-10T22:39:55.593121+0000","last_became_peered":"2024-09-10T22:39:55.593121+0000","last_unstale":"2024-09-10T22:39:57.588143+0000","last_undegraded":"2024-09-10T22:39:57.588143+0000","last_fullsized":"2024-09-10T22:39:57.588143+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:01.267190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051514+0000","last_change":"2024-09-10T22:39:55.606925+0000","last_active":"2024-09-10T22:39:58.051514+0000","last_peered":"2024-09-10T22:39:58.051514+0000","last_clean":"2024-09-10T22:39:58.051514+0000","last_became_active":"2024-09-10T22:39:55.606587+0000","last_became_peered":"2024-09-10T22:39:55.606587+0000","last_unstale":"2024-09-10T22:39:58.051514+0000","last_undegraded":"2024-09-10T22:39:58.051514+0000","last_fullsized":"2024-09-10T22:39:58.051514+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:11.626597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.587726+0000","last_change":"2024-09-10T22:39:55.605993+0000","last_active":"2024-09-10T22:39:57.587726+0000","last_peered":"2024-09-10T22:39:57.587726+0000","last_clean":"2024-09-10T22:39:57.587726+0000","last_became_active":"2024-09-10T22:39:55.605681+0000","last_became_peered":"2024-09-10T22:39:55.605681+0000","last_unstale":"2024-09-10T22:39:57.587726+0000","last_undegraded":"2024-09-10T22:39:57.587726+0000","last_fullsized":"2024-09-10T22:39:57.587726+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:00.608499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.750813+0000","last_change":"2024-09-10T22:39:55.597655+0000","last_active":"2024-09-10T22:39:58.750813+0000","last_peered":"2024-09-10T22:39:58.750813+0000","last_clean":"2024-09-10T22:39:58.750813+0000","last_became_active":"2024-09-10T22:39:55.597376+0000","last_became_peered":"2024-09-10T22:39:55.597376+0000","last_unstale":"2024-09-10T22:39:58.750813+0000","last_undegraded":"2024-09-10T22:39:58.750813+0000","last_fullsized":"2024-09-10T22:39:58.750813+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:40.987411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.587600+0000","last_change":"2024-09-10T22:39:55.609344+0000","last_active":"2024-09-10T22:39:57.587600+0000","last_peered":"2024-09-10T22:39:57.587600+0000","last_clean":"2024-09-10T22:39:57.587600+0000","last_became_active":"2024-09-10T22:39:55.609076+0000","last_became_peered":"2024-09-10T22:39:55.609076+0000","last_unstale":"2024-09-10T22:39:57.587600+0000","last_undegraded":"2024-09-10T22:39:57.587600+0000","last_fullsized":"2024-09-10T22:39:57.587600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:25.897503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605323+0000","last_change":"2024-09-10T22:39:55.616493+0000","last_active":"2024-09-10T22:39:56.605323+0000","last_peered":"2024-09-10T22:39:56.605323+0000","last_clean":"2024-09-10T22:39:56.605323+0000","last_became_active":"2024-09-10T22:39:55.611365+0000","last_became_peered":"2024-09-10T22:39:55.611365+0000","last_unstale":"2024-09-10T22:39:56.605323+0000","last_undegraded":"2024-09-10T22:39:56.605323+0000","last_fullsized":"2024-09-10T22:39:56.605323+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:29.934893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.606153+0000","last_change":"2024-09-10T22:39:55.611144+0000","last_active":"2024-09-10T22:39:56.606153+0000","last_peered":"2024-09-10T22:39:56.606153+0000","last_clean":"2024-09-10T22:39:56.606153+0000","last_became_active":"2024-09-10T22:39:55.610859+0000","last_became_peered":"2024-09-10T22:39:55.610859+0000","last_unstale":"2024-09-10T22:39:56.606153+0000","last_undegraded":"2024-09-10T22:39:56.606153+0000","last_fullsized":"2024-09-10T22:39:56.606153+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:00.608499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.130903+0000","last_change":"2024-09-10T22:39:55.600977+0000","last_active":"2024-09-10T22:39:58.130903+0000","last_peered":"2024-09-10T22:39:58.130903+0000","last_clean":"2024-09-10T22:39:58.130903+0000","last_became_active":"2024-09-10T22:39:55.600705+0000","last_became_peered":"2024-09-10T22:39:55.600705+0000","last_unstale":"2024-09-10T22:39:58.130903+0000","last_undegraded":"2024-09-10T22:39:58.130903+0000","last_fullsized":"2024-09-10T22:39:58.130903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:44.244140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.584951+0000","last_change":"2024-09-10T22:39:55.607359+0000","last_active":"2024-09-10T22:39:57.584951+0000","last_peered":"2024-09-10T22:39:57.584951+0000","last_clean":"2024-09-10T22:39:57.584951+0000","last_became_active":"2024-09-10T22:39:55.607191+0000","last_became_peered":"2024-09-10T22:39:55.607191+0000","last_unstale":"2024-09-10T22:39:57.584951+0000","last_undegraded":"2024-09-10T22:39:57.584951+0000","last_fullsized":"2024-09-10T22:39:57.584951+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:28.646381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.130730+0000","last_change":"2024-09-10T22:39:55.600013+0000","last_active":"2024-09-10T22:39:58.130730+0000","last_peered":"2024-09-10T22:39:58.130730+0000","last_clean":"2024-09-10T22:39:58.130730+0000","last_became_active":"2024-09-10T22:39:55.599719+0000","last_became_peered":"2024-09-10T22:39:55.599719+0000","last_unstale":"2024-09-10T22:39:58.130730+0000","last_undegraded":"2024-09-10T22:39:58.130730+0000","last_fullsized":"2024-09-10T22:39:58.130730+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:05.012882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.587842+0000","last_change":"2024-09-10T22:39:55.606581+0000","last_active":"2024-09-10T22:39:57.587842+0000","last_peered":"2024-09-10T22:39:57.587842+0000","last_clean":"2024-09-10T22:39:57.587842+0000","last_became_active":"2024-09-10T22:39:55.606277+0000","last_became_peered":"2024-09-10T22:39:55.606277+0000","last_unstale":"2024-09-10T22:39:57.587842+0000","last_undegraded":"2024-09-10T22:39:57.587842+0000","last_fullsized":"2024-09-10T22:39:57.587842+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:25.401506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.751253+0000","last_change":"2024-09-10T22:39:55.613631+0000","last_active":"2024-09-10T22:39:58.751253+0000","last_peered":"2024-09-10T22:39:58.751253+0000","last_clean":"2024-09-10T22:39:58.751253+0000","last_became_active":"2024-09-10T22:39:55.613213+0000","last_became_peered":"2024-09-10T22:39:55.613213+0000","last_unstale":"2024-09-10T22:39:58.751253+0000","last_undegraded":"2024-09-10T22:39:58.751253+0000","last_fullsized":"2024-09-10T22:39:58.751253+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:04.716824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605700+0000","last_change":"2024-09-10T22:39:55.610110+0000","last_active":"2024-09-10T22:39:56.605700+0000","last_peered":"2024-09-10T22:39:56.605700+0000","last_clean":"2024-09-10T22:39:56.605700+0000","last_became_active":"2024-09-10T22:39:55.609807+0000","last_became_peered":"2024-09-10T22:39:55.609807+0000","last_unstale":"2024-09-10T22:39:56.605700+0000","last_undegraded":"2024-09-10T22:39:56.605700+0000","last_fullsized":"2024-09-10T22:39:56.605700+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:11.717529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.584574+0000","last_change":"2024-09-10T22:39:55.619249+0000","last_active":"2024-09-10T22:39:57.584574+0000","last_peered":"2024-09-10T22:39:57.584574+0000","last_clean":"2024-09-10T22:39:57.584574+0000","last_became_active":"2024-09-10T22:39:55.618806+0000","last_became_peered":"2024-09-10T22:39:55.618806+0000","last_unstale":"2024-09-10T22:39:57.584574+0000","last_undegraded":"2024-09-10T22:39:57.584574+0000","last_fullsized":"2024-09-10T22:39:57.584574+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:04:43.587173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.130887+0000","last_change":"2024-09-10T22:39:55.598969+0000","last_active":"2024-09-10T22:39:58.130887+0000","last_peered":"2024-09-10T22:39:58.130887+0000","last_clean":"2024-09-10T22:39:58.130887+0000","last_became_active":"2024-09-10T22:39:55.598527+0000","last_became_peered":"2024-09-10T22:39:55.598527+0000","last_unstale":"2024-09-10T22:39:58.130887+0000","last_undegraded":"2024-09-10T22:39:58.130887+0000","last_fullsized":"2024-09-10T22:39:58.130887+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:04.716824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.620670+0000","last_change":"2024-09-10T22:39:55.614140+0000","last_active":"2024-09-10T22:39:55.620670+0000","last_peered":"2024-09-10T22:39:55.620670+0000","last_clean":"2024-09-10T22:39:55.620670+0000","last_became_active":"2024-09-10T22:39:55.613970+0000","last_became_peered":"2024-09-10T22:39:55.613970+0000","last_unstale":"2024-09-10T22:39:55.620670+0000","last_undegraded":"2024-09-10T22:39:55.620670+0000","last_fullsized":"2024-09-10T22:39:55.620670+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:22.046972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.130893+0000","last_change":"2024-09-10T22:39:55.603152+0000","last_active":"2024-09-10T22:39:58.130893+0000","last_peered":"2024-09-10T22:39:58.130893+0000","last_clean":"2024-09-10T22:39:58.130893+0000","last_became_active":"2024-09-10T22:39:55.602852+0000","last_became_peered":"2024-09-10T22:39:55.602852+0000","last_unstale":"2024-09-10T22:39:58.130893+0000","last_undegraded":"2024-09-10T22:39:58.130893+0000","last_fullsized":"2024-09-10T22:39:58.130893+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:43.919976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.587910+0000","last_change":"2024-09-10T22:39:55.599762+0000","last_active":"2024-09-10T22:39:57.587910+0000","last_peered":"2024-09-10T22:39:57.587910+0000","last_clean":"2024-09-10T22:39:57.587910+0000","last_became_active":"2024-09-10T22:39:55.599478+0000","last_became_peered":"2024-09-10T22:39:55.599478+0000","last_unstale":"2024-09-10T22:39:57.587910+0000","last_undegraded":"2024-09-10T22:39:57.587910+0000","last_fullsized":"2024-09-10T22:39:57.587910+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:11.348940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.130602+0000","last_change":"2024-09-10T22:39:55.614461+0000","last_active":"2024-09-10T22:39:58.130602+0000","last_peered":"2024-09-10T22:39:58.130602+0000","last_clean":"2024-09-10T22:39:58.130602+0000","last_became_active":"2024-09-10T22:39:55.614107+0000","last_became_peered":"2024-09-10T22:39:55.614107+0000","last_unstale":"2024-09-10T22:39:58.130602+0000","last_undegraded":"2024-09-10T22:39:58.130602+0000","last_fullsized":"2024-09-10T22:39:58.130602+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:56.065230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.130510+0000","last_change":"2024-09-10T22:39:55.596113+0000","last_active":"2024-09-10T22:39:58.130510+0000","last_peered":"2024-09-10T22:39:58.130510+0000","last_clean":"2024-09-10T22:39:58.130510+0000","last_became_active":"2024-09-10T22:39:55.595891+0000","last_became_peered":"2024-09-10T22:39:55.595891+0000","last_unstale":"2024-09-10T22:39:58.130510+0000","last_undegraded":"2024-09-10T22:39:58.130510+0000","last_fullsized":"2024-09-10T22:39:58.130510+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:20.279327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605970+0000","last_change":"2024-09-10T22:39:55.610875+0000","last_active":"2024-09-10T22:39:56.605970+0000","last_peered":"2024-09-10T22:39:56.605970+0000","last_clean":"2024-09-10T22:39:56.605970+0000","last_became_active":"2024-09-10T22:39:55.610519+0000","last_became_peered":"2024-09-10T22:39:55.610519+0000","last_unstale":"2024-09-10T22:39:56.605970+0000","last_undegraded":"2024-09-10T22:39:56.605970+0000","last_fullsized":"2024-09-10T22:39:56.605970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:46.738415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.618758+0000","last_change":"2024-09-10T22:39:55.610369+0000","last_active":"2024-09-10T22:39:55.618758+0000","last_peered":"2024-09-10T22:39:55.618758+0000","last_clean":"2024-09-10T22:39:55.618758+0000","last_became_active":"2024-09-10T22:39:55.610100+0000","last_became_peered":"2024-09-10T22:39:55.610100+0000","last_unstale":"2024-09-10T22:39:55.618758+0000","last_undegraded":"2024-09-10T22:39:55.618758+0000","last_fullsized":"2024-09-10T22:39:55.618758+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:22.225253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.606099+0000","last_change":"2024-09-10T22:39:55.612453+0000","last_active":"2024-09-10T22:39:56.606099+0000","last_peered":"2024-09-10T22:39:56.606099+0000","last_clean":"2024-09-10T22:39:56.606099+0000","last_became_active":"2024-09-10T22:39:55.612219+0000","last_became_peered":"2024-09-10T22:39:55.612219+0000","last_unstale":"2024-09-10T22:39:56.606099+0000","last_undegraded":"2024-09-10T22:39:56.606099+0000","last_fullsized":"2024-09-10T22:39:56.606099+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:25.897503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.130832+0000","last_change":"2024-09-10T22:39:54.606683+0000","last_active":"2024-09-10T22:39:58.130832+0000","last_peered":"2024-09-10T22:39:58.130832+0000","last_clean":"2024-09-10T22:39:58.130832+0000","last_became_active":"2024-09-10T22:39:54.606386+0000","last_became_peered":"2024-09-10T22:39:54.606386+0000","last_unstale":"2024-09-10T22:39:58.130832+0000","last_undegraded":"2024-09-10T22:39:58.130832+0000","last_fullsized":"2024-09-10T22:39:58.130832+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:06.595455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.620591+0000","last_change":"2024-09-10T22:39:55.613801+0000","last_active":"2024-09-10T22:39:55.620591+0000","last_peered":"2024-09-10T22:39:55.620591+0000","last_clean":"2024-09-10T22:39:55.620591+0000","last_became_active":"2024-09-10T22:39:55.613544+0000","last_became_peered":"2024-09-10T22:39:55.613544+0000","last_unstale":"2024-09-10T22:39:55.620591+0000","last_undegraded":"2024-09-10T22:39:55.620591+0000","last_fullsized":"2024-09-10T22:39:55.620591+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:29.775742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051629+0000","last_change":"2024-09-10T22:39:54.595062+0000","last_active":"2024-09-10T22:39:58.051629+0000","last_peered":"2024-09-10T22:39:58.051629+0000","last_clean":"2024-09-10T22:39:58.051629+0000","last_became_active":"2024-09-10T22:39:54.594701+0000","last_became_peered":"2024-09-10T22:39:54.594701+0000","last_unstale":"2024-09-10T22:39:58.051629+0000","last_undegraded":"2024-09-10T22:39:58.051629+0000","last_fullsized":"2024-09-10T22:39:58.051629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:35.346193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.751423+0000","last_change":"2024-09-10T22:39:55.599762+0000","last_active":"2024-09-10T22:39:58.751423+0000","last_peered":"2024-09-10T22:39:58.751423+0000","last_clean":"2024-09-10T22:39:58.751423+0000","last_became_active":"2024-09-10T22:39:55.599502+0000","last_became_peered":"2024-09-10T22:39:55.599502+0000","last_unstale":"2024-09-10T22:39:58.751423+0000","last_undegraded":"2024-09-10T22:39:58.751423+0000","last_fullsized":"2024-09-10T22:39:58.751423+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:54.770808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.615962+0000","last_change":"2024-09-10T22:39:54.584676+0000","last_active":"2024-09-10T22:39:55.615962+0000","last_peered":"2024-09-10T22:39:55.615962+0000","last_clean":"2024-09-10T22:39:55.615962+0000","last_became_active":"2024-09-10T22:39:54.584422+0000","last_became_peered":"2024-09-10T22:39:54.584422+0000","last_unstale":"2024-09-10T22:39:55.615962+0000","last_undegraded":"2024-09-10T22:39:55.615962+0000","last_fullsized":"2024-09-10T22:39:55.615962+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:12.047159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602445+0000","last_change":"2024-09-10T22:39:55.604482+0000","last_active":"2024-09-10T22:39:56.602445+0000","last_peered":"2024-09-10T22:39:56.602445+0000","last_clean":"2024-09-10T22:39:56.602445+0000","last_became_active":"2024-09-10T22:39:55.599105+0000","last_became_peered":"2024-09-10T22:39:55.599105+0000","last_unstale":"2024-09-10T22:39:56.602445+0000","last_undegraded":"2024-09-10T22:39:56.602445+0000","last_fullsized":"2024-09-10T22:39:56.602445+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:01.062801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.750986+0000","last_change":"2024-09-10T22:39:54.597031+0000","last_active":"2024-09-10T22:39:58.750986+0000","last_peered":"2024-09-10T22:39:58.750986+0000","last_clean":"2024-09-10T22:39:58.750986+0000","last_became_active":"2024-09-10T22:39:54.596099+0000","last_became_peered":"2024-09-10T22:39:54.596099+0000","last_unstale":"2024-09-10T22:39:58.750986+0000","last_undegraded":"2024-09-10T22:39:58.750986+0000","last_fullsized":"2024-09-10T22:39:58.750986+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:47.396792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051484+0000","last_change":"2024-09-10T22:39:55.606300+0000","last_active":"2024-09-10T22:39:58.051484+0000","last_peered":"2024-09-10T22:39:58.051484+0000","last_clean":"2024-09-10T22:39:58.051484+0000","last_became_active":"2024-09-10T22:39:55.606052+0000","last_became_peered":"2024-09-10T22:39:55.606052+0000","last_unstale":"2024-09-10T22:39:58.051484+0000","last_undegraded":"2024-09-10T22:39:58.051484+0000","last_fullsized":"2024-09-10T22:39:58.051484+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:47.570854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.587843+0000","last_change":"2024-09-10T22:39:54.600519+0000","last_active":"2024-09-10T22:39:57.587843+0000","last_peered":"2024-09-10T22:39:57.587843+0000","last_clean":"2024-09-10T22:39:57.587843+0000","last_became_active":"2024-09-10T22:39:54.600160+0000","last_became_peered":"2024-09-10T22:39:54.600160+0000","last_unstale":"2024-09-10T22:39:57.587843+0000","last_undegraded":"2024-09-10T22:39:57.587843+0000","last_fullsized":"2024-09-10T22:39:57.587843+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:19.276466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.587920+0000","last_change":"2024-09-10T22:39:55.607174+0000","last_active":"2024-09-10T22:39:57.587920+0000","last_peered":"2024-09-10T22:39:57.587920+0000","last_clean":"2024-09-10T22:39:57.587920+0000","last_became_active":"2024-09-10T22:39:55.606495+0000","last_became_peered":"2024-09-10T22:39:55.606495+0000","last_unstale":"2024-09-10T22:39:57.587920+0000","last_undegraded":"2024-09-10T22:39:57.587920+0000","last_fullsized":"2024-09-10T22:39:57.587920+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:24.572686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605503+0000","last_change":"2024-09-10T22:39:54.600314+0000","last_active":"2024-09-10T22:39:56.605503+0000","last_peered":"2024-09-10T22:39:56.605503+0000","last_clean":"2024-09-10T22:39:56.605503+0000","last_became_active":"2024-09-10T22:39:54.600042+0000","last_became_peered":"2024-09-10T22:39:54.600042+0000","last_unstale":"2024-09-10T22:39:56.605503+0000","last_undegraded":"2024-09-10T22:39:56.605503+0000","last_fullsized":"2024-09-10T22:39:56.605503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:19.276466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.751302+0000","last_change":"2024-09-10T22:39:55.597628+0000","last_active":"2024-09-10T22:39:58.751302+0000","last_peered":"2024-09-10T22:39:58.751302+0000","last_clean":"2024-09-10T22:39:58.751302+0000","last_became_active":"2024-09-10T22:39:55.597328+0000","last_became_peered":"2024-09-10T22:39:55.597328+0000","last_unstale":"2024-09-10T22:39:58.751302+0000","last_undegraded":"2024-09-10T22:39:58.751302+0000","last_fullsized":"2024-09-10T22:39:58.751302+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:31.248343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.589408+0000","last_change":"2024-09-10T22:39:54.593735+0000","last_active":"2024-09-10T22:39:55.589408+0000","last_peered":"2024-09-10T22:39:55.589408+0000","last_clean":"2024-09-10T22:39:55.589408+0000","last_became_active":"2024-09-10T22:39:54.593304+0000","last_became_peered":"2024-09-10T22:39:54.593304+0000","last_unstale":"2024-09-10T22:39:55.589408+0000","last_undegraded":"2024-09-10T22:39:55.589408+0000","last_fullsized":"2024-09-10T22:39:55.589408+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:13.962758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.601972+0000","last_change":"2024-09-10T22:39:55.605851+0000","last_active":"2024-09-10T22:39:56.601972+0000","last_peered":"2024-09-10T22:39:56.601972+0000","last_clean":"2024-09-10T22:39:56.601972+0000","last_became_active":"2024-09-10T22:39:55.605294+0000","last_became_peered":"2024-09-10T22:39:55.605294+0000","last_unstale":"2024-09-10T22:39:56.601972+0000","last_undegraded":"2024-09-10T22:39:56.601972+0000","last_fullsized":"2024-09-10T22:39:56.601972+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:15.251061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.750592+0000","last_change":"2024-09-10T22:39:54.604411+0000","last_active":"2024-09-10T22:39:58.750592+0000","last_peered":"2024-09-10T22:39:58.750592+0000","last_clean":"2024-09-10T22:39:58.750592+0000","last_became_active":"2024-09-10T22:39:54.604168+0000","last_became_peered":"2024-09-10T22:39:54.604168+0000","last_unstale":"2024-09-10T22:39:58.750592+0000","last_undegraded":"2024-09-10T22:39:58.750592+0000","last_fullsized":"2024-09-10T22:39:58.750592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:35.043433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.584922+0000","last_change":"2024-09-10T22:39:55.616542+0000","last_active":"2024-09-10T22:39:57.584922+0000","last_peered":"2024-09-10T22:39:57.584922+0000","last_clean":"2024-09-10T22:39:57.584922+0000","last_became_active":"2024-09-10T22:39:55.616285+0000","last_became_peered":"2024-09-10T22:39:55.616285+0000","last_unstale":"2024-09-10T22:39:57.584922+0000","last_undegraded":"2024-09-10T22:39:57.584922+0000","last_fullsized":"2024-09-10T22:39:57.584922+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:23.094216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602516+0000","last_change":"2024-09-10T22:39:54.591616+0000","last_active":"2024-09-10T22:39:56.602516+0000","last_peered":"2024-09-10T22:39:56.602516+0000","last_clean":"2024-09-10T22:39:56.602516+0000","last_became_active":"2024-09-10T22:39:54.591368+0000","last_became_peered":"2024-09-10T22:39:54.591368+0000","last_unstale":"2024-09-10T22:39:56.602516+0000","last_undegraded":"2024-09-10T22:39:56.602516+0000","last_fullsized":"2024-09-10T22:39:56.602516+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:52.734738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605704+0000","last_change":"2024-09-10T22:39:55.610284+0000","last_active":"2024-09-10T22:39:56.605704+0000","last_peered":"2024-09-10T22:39:56.605704+0000","last_clean":"2024-09-10T22:39:56.605704+0000","last_became_active":"2024-09-10T22:39:55.609251+0000","last_became_peered":"2024-09-10T22:39:55.609251+0000","last_unstale":"2024-09-10T22:39:56.605704+0000","last_undegraded":"2024-09-10T22:39:56.605704+0000","last_fullsized":"2024-09-10T22:39:56.605704+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:27.578026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.588106+0000","last_change":"2024-09-10T22:39:54.598579+0000","last_active":"2024-09-10T22:39:57.588106+0000","last_peered":"2024-09-10T22:39:57.588106+0000","last_clean":"2024-09-10T22:39:57.588106+0000","last_became_active":"2024-09-10T22:39:54.598184+0000","last_became_peered":"2024-09-10T22:39:54.598184+0000","last_unstale":"2024-09-10T22:39:57.588106+0000","last_undegraded":"2024-09-10T22:39:57.588106+0000","last_fullsized":"2024-09-10T22:39:57.588106+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:42.917115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051565+0000","last_change":"2024-09-10T22:39:55.596504+0000","last_active":"2024-09-10T22:39:58.051565+0000","last_peered":"2024-09-10T22:39:58.051565+0000","last_clean":"2024-09-10T22:39:58.051565+0000","last_became_active":"2024-09-10T22:39:55.596227+0000","last_became_peered":"2024-09-10T22:39:55.596227+0000","last_unstale":"2024-09-10T22:39:58.051565+0000","last_undegraded":"2024-09-10T22:39:58.051565+0000","last_fullsized":"2024-09-10T22:39:58.051565+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:01.872744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.588232+0000","last_change":"2024-09-10T22:39:54.596108+0000","last_active":"2024-09-10T22:39:57.588232+0000","last_peered":"2024-09-10T22:39:57.588232+0000","last_clean":"2024-09-10T22:39:57.588232+0000","last_became_active":"2024-09-10T22:39:54.595828+0000","last_became_peered":"2024-09-10T22:39:54.595828+0000","last_unstale":"2024-09-10T22:39:57.588232+0000","last_undegraded":"2024-09-10T22:39:57.588232+0000","last_fullsized":"2024-09-10T22:39:57.588232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:53.572295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.751403+0000","last_change":"2024-09-10T22:39:55.613306+0000","last_active":"2024-09-10T22:39:58.751403+0000","last_peered":"2024-09-10T22:39:58.751403+0000","last_clean":"2024-09-10T22:39:58.751403+0000","last_became_active":"2024-09-10T22:39:55.610844+0000","last_became_peered":"2024-09-10T22:39:55.610844+0000","last_unstale":"2024-09-10T22:39:58.751403+0000","last_undegraded":"2024-09-10T22:39:58.751403+0000","last_fullsized":"2024-09-10T22:39:58.751403+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:47.570854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602207+0000","last_change":"2024-09-10T22:39:54.597202+0000","last_active":"2024-09-10T22:39:56.602207+0000","last_peered":"2024-09-10T22:39:56.602207+0000","last_clean":"2024-09-10T22:39:56.602207+0000","last_became_active":"2024-09-10T22:39:54.596846+0000","last_became_peered":"2024-09-10T22:39:54.596846+0000","last_unstale":"2024-09-10T22:39:56.602207+0000","last_undegraded":"2024-09-10T22:39:56.602207+0000","last_fullsized":"2024-09-10T22:39:56.602207+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:42.917115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051699+0000","last_change":"2024-09-10T22:39:55.610630+0000","last_active":"2024-09-10T22:39:58.051699+0000","last_peered":"2024-09-10T22:39:58.051699+0000","last_clean":"2024-09-10T22:39:58.051699+0000","last_became_active":"2024-09-10T22:39:55.609562+0000","last_became_peered":"2024-09-10T22:39:55.609562+0000","last_unstale":"2024-09-10T22:39:58.051699+0000","last_undegraded":"2024-09-10T22:39:58.051699+0000","last_fullsized":"2024-09-10T22:39:58.051699+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:32.827317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602259+0000","last_change":"2024-09-10T22:39:54.591006+0000","last_active":"2024-09-10T22:39:56.602259+0000","last_peered":"2024-09-10T22:39:56.602259+0000","last_clean":"2024-09-10T22:39:56.602259+0000","last_became_active":"2024-09-10T22:39:54.590723+0000","last_became_peered":"2024-09-10T22:39:54.590723+0000","last_unstale":"2024-09-10T22:39:56.602259+0000","last_undegraded":"2024-09-10T22:39:56.602259+0000","last_fullsized":"2024-09-10T22:39:56.602259+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:36.341376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602038+0000","last_change":"2024-09-10T22:39:55.598525+0000","last_active":"2024-09-10T22:39:56.602038+0000","last_peered":"2024-09-10T22:39:56.602038+0000","last_clean":"2024-09-10T22:39:56.602038+0000","last_became_active":"2024-09-10T22:39:55.598260+0000","last_became_peered":"2024-09-10T22:39:55.598260+0000","last_unstale":"2024-09-10T22:39:56.602038+0000","last_undegraded":"2024-09-10T22:39:56.602038+0000","last_fullsized":"2024-09-10T22:39:56.602038+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:34.666995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.588100+0000","last_change":"2024-09-10T22:39:54.593541+0000","last_active":"2024-09-10T22:39:55.588100+0000","last_peered":"2024-09-10T22:39:55.588100+0000","last_clean":"2024-09-10T22:39:55.588100+0000","last_became_active":"2024-09-10T22:39:54.593236+0000","last_became_peered":"2024-09-10T22:39:54.593236+0000","last_unstale":"2024-09-10T22:39:55.588100+0000","last_undegraded":"2024-09-10T22:39:55.588100+0000","last_fullsized":"2024-09-10T22:39:55.588100+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:58.849464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.606108+0000","last_change":"2024-09-10T22:39:55.617166+0000","last_active":"2024-09-10T22:39:56.606108+0000","last_peered":"2024-09-10T22:39:56.606108+0000","last_clean":"2024-09-10T22:39:56.606108+0000","last_became_active":"2024-09-10T22:39:55.616857+0000","last_became_peered":"2024-09-10T22:39:55.616857+0000","last_unstale":"2024-09-10T22:39:56.606108+0000","last_undegraded":"2024-09-10T22:39:56.606108+0000","last_fullsized":"2024-09-10T22:39:56.606108+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:10.930758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.130269+0000","last_change":"2024-09-10T22:39:54.608957+0000","last_active":"2024-09-10T22:39:58.130269+0000","last_peered":"2024-09-10T22:39:58.130269+0000","last_clean":"2024-09-10T22:39:58.130269+0000","last_became_active":"2024-09-10T22:39:54.608678+0000","last_became_peered":"2024-09-10T22:39:54.608678+0000","last_unstale":"2024-09-10T22:39:58.130269+0000","last_undegraded":"2024-09-10T22:39:58.130269+0000","last_fullsized":"2024-09-10T22:39:58.130269+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:05.437568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602739+0000","last_change":"2024-09-10T22:39:55.597828+0000","last_active":"2024-09-10T22:39:56.602739+0000","last_peered":"2024-09-10T22:39:56.602739+0000","last_clean":"2024-09-10T22:39:56.602739+0000","last_became_active":"2024-09-10T22:39:55.597544+0000","last_became_peered":"2024-09-10T22:39:55.597544+0000","last_unstale":"2024-09-10T22:39:56.602739+0000","last_undegraded":"2024-09-10T22:39:56.602739+0000","last_fullsized":"2024-09-10T22:39:56.602739+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:35.551542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605233+0000","last_change":"2024-09-10T22:39:54.599385+0000","last_active":"2024-09-10T22:39:56.605233+0000","last_peered":"2024-09-10T22:39:56.605233+0000","last_clean":"2024-09-10T22:39:56.605233+0000","last_became_active":"2024-09-10T22:39:54.599054+0000","last_became_peered":"2024-09-10T22:39:54.599054+0000","last_unstale":"2024-09-10T22:39:56.605233+0000","last_undegraded":"2024-09-10T22:39:56.605233+0000","last_fullsized":"2024-09-10T22:39:56.605233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:35.346193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602354+0000","last_change":"2024-09-10T22:39:55.601591+0000","last_active":"2024-09-10T22:39:56.602354+0000","last_peered":"2024-09-10T22:39:56.602354+0000","last_clean":"2024-09-10T22:39:56.602354+0000","last_became_active":"2024-09-10T22:39:55.601308+0000","last_became_peered":"2024-09-10T22:39:55.601308+0000","last_unstale":"2024-09-10T22:39:56.602354+0000","last_undegraded":"2024-09-10T22:39:56.602354+0000","last_fullsized":"2024-09-10T22:39:56.602354+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:24.572686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.588188+0000","last_change":"2024-09-10T22:39:54.594532+0000","last_active":"2024-09-10T22:39:57.588188+0000","last_peered":"2024-09-10T22:39:57.588188+0000","last_clean":"2024-09-10T22:39:57.588188+0000","last_became_active":"2024-09-10T22:39:54.594210+0000","last_became_peered":"2024-09-10T22:39:54.594210+0000","last_unstale":"2024-09-10T22:39:57.588188+0000","last_undegraded":"2024-09-10T22:39:57.588188+0000","last_fullsized":"2024-09-10T22:39:57.588188+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:55.062369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.588225+0000","last_change":"2024-09-10T22:39:55.607077+0000","last_active":"2024-09-10T22:39:57.588225+0000","last_peered":"2024-09-10T22:39:57.588225+0000","last_clean":"2024-09-10T22:39:57.588225+0000","last_became_active":"2024-09-10T22:39:55.606211+0000","last_became_peered":"2024-09-10T22:39:55.606211+0000","last_unstale":"2024-09-10T22:39:57.588225+0000","last_undegraded":"2024-09-10T22:39:57.588225+0000","last_fullsized":"2024-09-10T22:39:57.588225+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:00.835994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.751432+0000","last_change":"2024-09-10T22:39:54.593196+0000","last_active":"2024-09-10T22:39:58.751432+0000","last_peered":"2024-09-10T22:39:58.751432+0000","last_clean":"2024-09-10T22:39:58.751432+0000","last_became_active":"2024-09-10T22:39:54.592842+0000","last_became_peered":"2024-09-10T22:39:54.592842+0000","last_unstale":"2024-09-10T22:39:58.751432+0000","last_undegraded":"2024-09-10T22:39:58.751432+0000","last_fullsized":"2024-09-10T22:39:58.751432+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:04.054085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.751367+0000","last_change":"2024-09-10T22:39:55.593841+0000","last_active":"2024-09-10T22:39:58.751367+0000","last_peered":"2024-09-10T22:39:58.751367+0000","last_clean":"2024-09-10T22:39:58.751367+0000","last_became_active":"2024-09-10T22:39:55.593392+0000","last_became_peered":"2024-09-10T22:39:55.593392+0000","last_unstale":"2024-09-10T22:39:58.751367+0000","last_undegraded":"2024-09-10T22:39:58.751367+0000","last_fullsized":"2024-09-10T22:39:58.751367+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:18.824112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.584808+0000","last_change":"2024-09-10T22:39:54.594511+0000","last_active":"2024-09-10T22:39:57.584808+0000","last_peered":"2024-09-10T22:39:57.584808+0000","last_clean":"2024-09-10T22:39:57.584808+0000","last_became_active":"2024-09-10T22:39:54.594250+0000","last_became_peered":"2024-09-10T22:39:54.594250+0000","last_unstale":"2024-09-10T22:39:57.584808+0000","last_undegraded":"2024-09-10T22:39:57.584808+0000","last_fullsized":"2024-09-10T22:39:57.584808+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:23.460102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.585044+0000","last_change":"2024-09-10T22:39:55.613008+0000","last_active":"2024-09-10T22:39:57.585044+0000","last_peered":"2024-09-10T22:39:57.585044+0000","last_clean":"2024-09-10T22:39:57.585044+0000","last_became_active":"2024-09-10T22:39:55.612731+0000","last_became_peered":"2024-09-10T22:39:55.612731+0000","last_unstale":"2024-09-10T22:39:57.585044+0000","last_undegraded":"2024-09-10T22:39:57.585044+0000","last_fullsized":"2024-09-10T22:39:57.585044+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:12.874695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.587241+0000","last_change":"2024-09-10T22:39:54.583703+0000","last_active":"2024-09-10T22:39:55.587241+0000","last_peered":"2024-09-10T22:39:55.587241+0000","last_clean":"2024-09-10T22:39:55.587241+0000","last_became_active":"2024-09-10T22:39:54.583419+0000","last_became_peered":"2024-09-10T22:39:54.583419+0000","last_unstale":"2024-09-10T22:39:55.587241+0000","last_undegraded":"2024-09-10T22:39:55.587241+0000","last_fullsized":"2024-09-10T22:39:55.587241+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:59.535764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.606072+0000","last_change":"2024-09-10T22:39:55.610788+0000","last_active":"2024-09-10T22:39:56.606072+0000","last_peered":"2024-09-10T22:39:56.606072+0000","last_clean":"2024-09-10T22:39:56.606072+0000","last_became_active":"2024-09-10T22:39:55.610457+0000","last_became_peered":"2024-09-10T22:39:55.610457+0000","last_unstale":"2024-09-10T22:39:56.606072+0000","last_undegraded":"2024-09-10T22:39:56.606072+0000","last_fullsized":"2024-09-10T22:39:56.606072+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:00.484294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.584502+0000","last_change":"2024-09-10T22:39:54.594728+0000","last_active":"2024-09-10T22:39:57.584502+0000","last_peered":"2024-09-10T22:39:57.584502+0000","last_clean":"2024-09-10T22:39:57.584502+0000","last_became_active":"2024-09-10T22:39:54.594416+0000","last_became_peered":"2024-09-10T22:39:54.594416+0000","last_unstale":"2024-09-10T22:39:57.584502+0000","last_undegraded":"2024-09-10T22:39:57.584502+0000","last_fullsized":"2024-09-10T22:39:57.584502+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:17.037897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051497+0000","last_change":"2024-09-10T22:39:55.596894+0000","last_active":"2024-09-10T22:39:58.051497+0000","last_peered":"2024-09-10T22:39:58.051497+0000","last_clean":"2024-09-10T22:39:58.051497+0000","last_became_active":"2024-09-10T22:39:55.596586+0000","last_became_peered":"2024-09-10T22:39:55.596586+0000","last_unstale":"2024-09-10T22:39:58.051497+0000","last_undegraded":"2024-09-10T22:39:58.051497+0000","last_fullsized":"2024-09-10T22:39:58.051497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:54.770808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.584466+0000","last_change":"2024-09-10T22:39:54.591519+0000","last_active":"2024-09-10T22:39:57.584466+0000","last_peered":"2024-09-10T22:39:57.584466+0000","last_clean":"2024-09-10T22:39:57.584466+0000","last_became_active":"2024-09-10T22:39:54.591318+0000","last_became_peered":"2024-09-10T22:39:54.591318+0000","last_unstale":"2024-09-10T22:39:57.584466+0000","last_undegraded":"2024-09-10T22:39:57.584466+0000","last_fullsized":"2024-09-10T22:39:57.584466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:00.391113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.587670+0000","last_change":"2024-09-10T22:39:55.595411+0000","last_active":"2024-09-10T22:39:57.587670+0000","last_peered":"2024-09-10T22:39:57.587670+0000","last_clean":"2024-09-10T22:39:57.587670+0000","last_became_active":"2024-09-10T22:39:55.595150+0000","last_became_peered":"2024-09-10T22:39:55.595150+0000","last_unstale":"2024-09-10T22:39:57.587670+0000","last_undegraded":"2024-09-10T22:39:57.587670+0000","last_fullsized":"2024-09-10T22:39:57.587670+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:34.658258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605783+0000","last_change":"2024-09-10T22:39:54.606738+0000","last_active":"2024-09-10T22:39:56.605783+0000","last_peered":"2024-09-10T22:39:56.605783+0000","last_clean":"2024-09-10T22:39:56.605783+0000","last_became_active":"2024-09-10T22:39:54.606232+0000","last_became_peered":"2024-09-10T22:39:54.606232+0000","last_unstale":"2024-09-10T22:39:56.605783+0000","last_undegraded":"2024-09-10T22:39:56.605783+0000","last_fullsized":"2024-09-10T22:39:56.605783+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:53.262935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602196+0000","last_change":"2024-09-10T22:39:55.606120+0000","last_active":"2024-09-10T22:39:56.602196+0000","last_peered":"2024-09-10T22:39:56.602196+0000","last_clean":"2024-09-10T22:39:56.602196+0000","last_became_active":"2024-09-10T22:39:55.605619+0000","last_became_peered":"2024-09-10T22:39:55.605619+0000","last_unstale":"2024-09-10T22:39:56.602196+0000","last_undegraded":"2024-09-10T22:39:56.602196+0000","last_fullsized":"2024-09-10T22:39:56.602196+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:43.386337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.584358+0000","last_change":"2024-09-10T22:39:54.596552+0000","last_active":"2024-09-10T22:39:57.584358+0000","last_peered":"2024-09-10T22:39:57.584358+0000","last_clean":"2024-09-10T22:39:57.584358+0000","last_became_active":"2024-09-10T22:39:54.596213+0000","last_became_peered":"2024-09-10T22:39:54.596213+0000","last_unstale":"2024-09-10T22:39:57.584358+0000","last_undegraded":"2024-09-10T22:39:57.584358+0000","last_fullsized":"2024-09-10T22:39:57.584358+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:10.809813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.620678+0000","last_change":"2024-09-10T22:39:55.614302+0000","last_active":"2024-09-10T22:39:55.620678+0000","last_peered":"2024-09-10T22:39:55.620678+0000","last_clean":"2024-09-10T22:39:55.620678+0000","last_became_active":"2024-09-10T22:39:55.614021+0000","last_became_peered":"2024-09-10T22:39:55.614021+0000","last_unstale":"2024-09-10T22:39:55.620678+0000","last_undegraded":"2024-09-10T22:39:55.620678+0000","last_fullsized":"2024-09-10T22:39:55.620678+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:25.084812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.588335+0000","last_change":"2024-09-10T22:39:54.600593+0000","last_active":"2024-09-10T22:39:57.588335+0000","last_peered":"2024-09-10T22:39:57.588335+0000","last_clean":"2024-09-10T22:39:57.588335+0000","last_became_active":"2024-09-10T22:39:54.600190+0000","last_became_peered":"2024-09-10T22:39:54.600190+0000","last_unstale":"2024-09-10T22:39:57.588335+0000","last_undegraded":"2024-09-10T22:39:57.588335+0000","last_fullsized":"2024-09-10T22:39:57.588335+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:04.010021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605944+0000","last_change":"2024-09-10T22:39:55.610582+0000","last_active":"2024-09-10T22:39:56.605944+0000","last_peered":"2024-09-10T22:39:56.605944+0000","last_clean":"2024-09-10T22:39:56.605944+0000","last_became_active":"2024-09-10T22:39:55.609999+0000","last_became_peered":"2024-09-10T22:39:55.609999+0000","last_unstale":"2024-09-10T22:39:56.605944+0000","last_undegraded":"2024-09-10T22:39:56.605944+0000","last_fullsized":"2024-09-10T22:39:56.605944+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:30.355578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.585028+0000","last_change":"2024-09-10T22:39:54.597434+0000","last_active":"2024-09-10T22:39:57.585028+0000","last_peered":"2024-09-10T22:39:57.585028+0000","last_clean":"2024-09-10T22:39:57.585028+0000","last_became_active":"2024-09-10T22:39:54.597051+0000","last_became_peered":"2024-09-10T22:39:54.597051+0000","last_unstale":"2024-09-10T22:39:57.585028+0000","last_undegraded":"2024-09-10T22:39:57.585028+0000","last_fullsized":"2024-09-10T22:39:57.585028+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:24.891603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602778+0000","last_change":"2024-09-10T22:39:55.589343+0000","last_active":"2024-09-10T22:39:56.602778+0000","last_peered":"2024-09-10T22:39:56.602778+0000","last_clean":"2024-09-10T22:39:56.602778+0000","last_became_active":"2024-09-10T22:39:55.589050+0000","last_became_peered":"2024-09-10T22:39:55.589050+0000","last_unstale":"2024-09-10T22:39:56.602778+0000","last_undegraded":"2024-09-10T22:39:56.602778+0000","last_fullsized":"2024-09-10T22:39:56.602778+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:36.204468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051592+0000","last_change":"2024-09-10T22:39:54.599281+0000","last_active":"2024-09-10T22:39:58.051592+0000","last_peered":"2024-09-10T22:39:58.051592+0000","last_clean":"2024-09-10T22:39:58.051592+0000","last_became_active":"2024-09-10T22:39:54.598952+0000","last_became_peered":"2024-09-10T22:39:54.598952+0000","last_unstale":"2024-09-10T22:39:58.051592+0000","last_undegraded":"2024-09-10T22:39:58.051592+0000","last_fullsized":"2024-09-10T22:39:58.051592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:50.596905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051801+0000","last_change":"2024-09-10T22:39:55.594745+0000","last_active":"2024-09-10T22:39:58.051801+0000","last_peered":"2024-09-10T22:39:58.051801+0000","last_clean":"2024-09-10T22:39:58.051801+0000","last_became_active":"2024-09-10T22:39:55.594384+0000","last_became_peered":"2024-09-10T22:39:55.594384+0000","last_unstale":"2024-09-10T22:39:58.051801+0000","last_undegraded":"2024-09-10T22:39:58.051801+0000","last_fullsized":"2024-09-10T22:39:58.051801+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:24.611413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051495+0000","last_change":"2024-09-10T22:39:54.603890+0000","last_active":"2024-09-10T22:39:58.051495+0000","last_peered":"2024-09-10T22:39:58.051495+0000","last_clean":"2024-09-10T22:39:58.051495+0000","last_became_active":"2024-09-10T22:39:54.603411+0000","last_became_peered":"2024-09-10T22:39:54.603411+0000","last_unstale":"2024-09-10T22:39:58.051495+0000","last_undegraded":"2024-09-10T22:39:58.051495+0000","last_fullsized":"2024-09-10T22:39:58.051495+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:57.540085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.615852+0000","last_change":"2024-09-10T22:39:55.606593+0000","last_active":"2024-09-10T22:39:55.615852+0000","last_peered":"2024-09-10T22:39:55.615852+0000","last_clean":"2024-09-10T22:39:55.615852+0000","last_became_active":"2024-09-10T22:39:55.604802+0000","last_became_peered":"2024-09-10T22:39:55.604802+0000","last_unstale":"2024-09-10T22:39:55.615852+0000","last_undegraded":"2024-09-10T22:39:55.615852+0000","last_fullsized":"2024-09-10T22:39:55.615852+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:59.878431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.130362+0000","last_change":"2024-09-10T22:39:54.598982+0000","last_active":"2024-09-10T22:39:58.130362+0000","last_peered":"2024-09-10T22:39:58.130362+0000","last_clean":"2024-09-10T22:39:58.130362+0000","last_became_active":"2024-09-10T22:39:54.598502+0000","last_became_peered":"2024-09-10T22:39:54.598502+0000","last_unstale":"2024-09-10T22:39:58.130362+0000","last_undegraded":"2024-09-10T22:39:58.130362+0000","last_fullsized":"2024-09-10T22:39:58.130362+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:04:42.584312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.750888+0000","last_change":"2024-09-10T22:39:55.589092+0000","last_active":"2024-09-10T22:39:58.750888+0000","last_peered":"2024-09-10T22:39:58.750888+0000","last_clean":"2024-09-10T22:39:58.750888+0000","last_became_active":"2024-09-10T22:39:55.588718+0000","last_became_peered":"2024-09-10T22:39:55.588718+0000","last_unstale":"2024-09-10T22:39:58.750888+0000","last_undegraded":"2024-09-10T22:39:58.750888+0000","last_fullsized":"2024-09-10T22:39:58.750888+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:44.244140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.750596+0000","last_change":"2024-09-10T22:39:54.596304+0000","last_active":"2024-09-10T22:39:58.750596+0000","last_peered":"2024-09-10T22:39:58.750596+0000","last_clean":"2024-09-10T22:39:58.750596+0000","last_became_active":"2024-09-10T22:39:54.596018+0000","last_became_peered":"2024-09-10T22:39:54.596018+0000","last_unstale":"2024-09-10T22:39:58.750596+0000","last_undegraded":"2024-09-10T22:39:58.750596+0000","last_fullsized":"2024-09-10T22:39:58.750596+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:34.492011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.606260+0000","last_change":"2024-09-10T22:39:55.612905+0000","last_active":"2024-09-10T22:39:56.606260+0000","last_peered":"2024-09-10T22:39:56.606260+0000","last_clean":"2024-09-10T22:39:56.606260+0000","last_became_active":"2024-09-10T22:39:55.612450+0000","last_became_peered":"2024-09-10T22:39:55.612450+0000","last_unstale":"2024-09-10T22:39:56.606260+0000","last_undegraded":"2024-09-10T22:39:56.606260+0000","last_fullsized":"2024-09-10T22:39:56.606260+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:25.401506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.601822+0000","last_change":"2024-09-10T22:39:54.593069+0000","last_active":"2024-09-10T22:39:56.601822+0000","last_peered":"2024-09-10T22:39:56.601822+0000","last_clean":"2024-09-10T22:39:56.601822+0000","last_became_active":"2024-09-10T22:39:54.592765+0000","last_became_peered":"2024-09-10T22:39:54.592765+0000","last_unstale":"2024-09-10T22:39:56.601822+0000","last_undegraded":"2024-09-10T22:39:56.601822+0000","last_fullsized":"2024-09-10T22:39:56.601822+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:53.572295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.588271+0000","last_change":"2024-09-10T22:39:55.613741+0000","last_active":"2024-09-10T22:39:57.588271+0000","last_peered":"2024-09-10T22:39:57.588271+0000","last_clean":"2024-09-10T22:39:57.588271+0000","last_became_active":"2024-09-10T22:39:55.613408+0000","last_became_peered":"2024-09-10T22:39:55.613408+0000","last_unstale":"2024-09-10T22:39:57.588271+0000","last_undegraded":"2024-09-10T22:39:57.588271+0000","last_fullsized":"2024-09-10T22:39:57.588271+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:46.415739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605756+0000","last_change":"2024-09-10T22:39:54.601169+0000","last_active":"2024-09-10T22:39:56.605756+0000","last_peered":"2024-09-10T22:39:56.605756+0000","last_clean":"2024-09-10T22:39:56.605756+0000","last_became_active":"2024-09-10T22:39:54.600890+0000","last_became_peered":"2024-09-10T22:39:54.600890+0000","last_unstale":"2024-09-10T22:39:56.605756+0000","last_undegraded":"2024-09-10T22:39:56.605756+0000","last_fullsized":"2024-09-10T22:39:56.605756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:50.596905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":146,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605417+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:39:56.605417+0000","last_peered":"2024-09-10T22:39:56.605417+0000","last_clean":"2024-09-10T22:39:56.605417+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:39:56.605417+0000","last_undegraded":"2024-09-10T22:39:56.605417+0000","last_fullsized":"2024-09-10T22:39:56.605417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":792465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":200997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":475136,"data_stored":200527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":194327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":483328,"data_stored":202061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":200485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":790817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":193813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:39:59.709 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:39:59.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.882+0000 7f4c32200640 1 -- 172.21.15.103:0/444832330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2c0cf790 msgr2=0x7f4c2c0cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:59.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.882+0000 7f4c32200640 1 --2- 172.21.15.103:0/444832330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2c0cf790 0x7f4c2c0cfc20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009900 tx=0x7f4c2401c850 comp rx=0 tx=0).stop 2024-09-10T22:39:59.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.882+0000 7f4c32200640 1 -- 172.21.15.103:0/444832330 shutdown_connections 2024-09-10T22:39:59.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.882+0000 7f4c32200640 1 --2- 172.21.15.103:0/444832330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2c0cf790 0x7f4c2c0cfc20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:59.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.882+0000 7f4c32200640 1 -- 172.21.15.103:0/444832330 >> 172.21.15.103:0/444832330 conn(0x7f4c2c06cc00 msgr2=0x7f4c2c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:39:59.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.882+0000 7f4c32200640 1 -- 172.21.15.103:0/444832330 shutdown_connections 2024-09-10T22:39:59.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.882+0000 7f4c32200640 1 -- 172.21.15.103:0/444832330 wait complete. 2024-09-10T22:39:59.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.882+0000 7f4c32200640 1 Processor -- start 2024-09-10T22:39:59.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.882+0000 7f4c32200640 1 -- start start 2024-09-10T22:39:59.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.882+0000 7f4c32200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2c0aeb40 0x7f4c2c1fb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:59.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.882+0000 7f4c32200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c2c0cc120 0x7f4c2c141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:59.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.882+0000 7f4c32200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c2c0cf790 0x7f4c2c15adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:59.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.882+0000 7f4c32200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c169db0 con 0x7f4c2c0aeb40 2024-09-10T22:39:59.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.882+0000 7f4c32200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c169c30 con 0x7f4c2c0cf790 2024-09-10T22:39:59.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.882+0000 7f4c32200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4c2c169f30 con 0x7f4c2c0cc120 2024-09-10T22:39:59.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.882+0000 7f4c2b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2c0aeb40 0x7f4c2c1fb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:59.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.882+0000 7f4c2b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2c0aeb40 0x7f4c2c1fb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43084/0 (socket says 172.21.15.103:43084) 2024-09-10T22:39:59.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.882+0000 7f4c2b400640 1 -- 172.21.15.103:0/229731538 learned_addr learned my addr 172.21.15.103:0/229731538 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:39:59.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.886+0000 7f4c2be00640 1 --2- 172.21.15.103:0/229731538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c2c0cf790 0x7f4c2c15adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:59.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.886+0000 7f4c22a00640 1 --2- 172.21.15.103:0/229731538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c2c0cc120 0x7f4c2c141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:59.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.886+0000 7f4c2b400640 1 -- 172.21.15.103:0/229731538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c2c0cc120 msgr2=0x7f4c2c141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:59.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.886+0000 7f4c2b400640 1 --2- 172.21.15.103:0/229731538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c2c0cc120 0x7f4c2c141000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:59.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.886+0000 7f4c2b400640 1 -- 172.21.15.103:0/229731538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c2c0cf790 msgr2=0x7f4c2c15adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:39:59.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.886+0000 7f4c2b400640 1 --2- 172.21.15.103:0/229731538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c2c0cf790 0x7f4c2c15adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:39:59.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.886+0000 7f4c2b400640 1 -- 172.21.15.103:0/229731538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2c1fba80 con 0x7f4c2c0aeb40 2024-09-10T22:39:59.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.886+0000 7f4c2b400640 1 --2- 172.21.15.103:0/229731538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2c0aeb40 0x7f4c2c1fb540 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00c530 tx=0x7f4c1c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:59.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.886+0000 7f4c23e00640 1 -- 172.21.15.103:0/229731538 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c017070 con 0x7f4c2c0aeb40 2024-09-10T22:39:59.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.886+0000 7f4c23e00640 1 -- 172.21.15.103:0/229731538 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c1c0053c0 con 0x7f4c2c0aeb40 2024-09-10T22:39:59.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.886+0000 7f4c23e00640 1 -- 172.21.15.103:0/229731538 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c012890 con 0x7f4c2c0aeb40 2024-09-10T22:39:59.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.886+0000 7f4c32200640 1 -- 172.21.15.103:0/229731538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c2c06f590 con 0x7f4c2c0aeb40 2024-09-10T22:39:59.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.886+0000 7f4c32200640 1 -- 172.21.15.103:0/229731538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c2c06fb50 con 0x7f4c2c0aeb40 2024-09-10T22:39:59.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.886+0000 7f4c32200640 1 -- 172.21.15.103:0/229731538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c2c0cfc20 con 0x7f4c2c0aeb40 2024-09-10T22:39:59.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.886+0000 7f4c23e00640 1 -- 172.21.15.103:0/229731538 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4c1c003600 con 0x7f4c2c0aeb40 2024-09-10T22:39:59.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.886+0000 7f4c23e00640 1 --2- 172.21.15.103:0/229731538 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4c080725e0 0x7f4c08074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:39:59.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.890+0000 7f4c23e00640 1 -- 172.21.15.103:0/229731538 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f4c1c0929d0 con 0x7f4c2c0aeb40 2024-09-10T22:39:59.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.890+0000 7f4c22a00640 1 --2- 172.21.15.103:0/229731538 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4c080725e0 0x7f4c08074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:39:59.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.890+0000 7f4c22a00640 1 --2- 172.21.15.103:0/229731538 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4c080725e0 0x7f4c08074aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c1faa90 tx=0x7f4c14009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:39:59.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:39:59.890+0000 7f4c23e00640 1 -- 172.21.15.103:0/229731538 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4c2c1fba80 con 0x7f4c2c0aeb40 2024-09-10T22:40:00.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.058+0000 7f4c32200640 1 -- 172.21.15.103:0/229731538 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c2c0ce9f0 con 0x7f4c080725e0 2024-09-10T22:40:00.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.062+0000 7f4c23e00640 1 -- 172.21.15.103:0/229731538 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7f4c2c0ce9f0 con 0x7f4c080725e0 2024-09-10T22:40:00.069 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:40:00.071 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:40:00.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.066+0000 7f4c32200640 1 -- 172.21.15.103:0/229731538 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4c080725e0 msgr2=0x7f4c08074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:00.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.066+0000 7f4c32200640 1 --2- 172.21.15.103:0/229731538 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4c080725e0 0x7f4c08074aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c1faa90 tx=0x7f4c14009040 comp rx=0 tx=0).stop 2024-09-10T22:40:00.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.066+0000 7f4c32200640 1 -- 172.21.15.103:0/229731538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2c0aeb40 msgr2=0x7f4c2c1fb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:00.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.066+0000 7f4c32200640 1 --2- 172.21.15.103:0/229731538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2c0aeb40 0x7f4c2c1fb540 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00c530 tx=0x7f4c1c00c9f0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.066+0000 7f4c32200640 1 -- 172.21.15.103:0/229731538 shutdown_connections 2024-09-10T22:40:00.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.066+0000 7f4c32200640 1 --2- 172.21.15.103:0/229731538 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4c080725e0 0x7f4c08074aa0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.066+0000 7f4c32200640 1 --2- 172.21.15.103:0/229731538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c2c0cf790 0x7f4c2c15adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.066+0000 7f4c32200640 1 --2- 172.21.15.103:0/229731538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c2c0cc120 0x7f4c2c141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.066+0000 7f4c32200640 1 --2- 172.21.15.103:0/229731538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2c0aeb40 0x7f4c2c1fb540 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.066+0000 7f4c32200640 1 -- 172.21.15.103:0/229731538 >> 172.21.15.103:0/229731538 conn(0x7f4c2c06cc00 msgr2=0x7f4c2c0b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:00.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.066+0000 7f4c32200640 1 -- 172.21.15.103:0/229731538 shutdown_connections 2024-09-10T22:40:00.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.066+0000 7f4c32200640 1 -- 172.21.15.103:0/229731538 wait complete. 2024-09-10T22:40:00.090 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-09-10T22:39:59.634571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221092,"kb_used_data":4848,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753628,"statfs":{"total":773094113280,"available":772867715072,"internally_reserved":0,"allocated":4964352,"data_stored":2775492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000974"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602494+0000","last_change":"2024-09-10T22:39:55.605188+0000","last_active":"2024-09-10T22:39:56.602494+0000","last_peered":"2024-09-10T22:39:56.602494+0000","last_clean":"2024-09-10T22:39:56.602494+0000","last_became_active":"2024-09-10T22:39:55.603566+0000","last_became_peered":"2024-09-10T22:39:55.603566+0000","last_unstale":"2024-09-10T22:39:56.602494+0000","last_undegraded":"2024-09-10T22:39:56.602494+0000","last_fullsized":"2024-09-10T22:39:56.602494+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:17:43.775795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602666+0000","last_change":"2024-09-10T22:39:55.609270+0000","last_active":"2024-09-10T22:39:56.602666+0000","last_peered":"2024-09-10T22:39:56.602666+0000","last_clean":"2024-09-10T22:39:56.602666+0000","last_became_active":"2024-09-10T22:39:55.609026+0000","last_became_peered":"2024-09-10T22:39:55.609026+0000","last_unstale":"2024-09-10T22:39:56.602666+0000","last_undegraded":"2024-09-10T22:39:56.602666+0000","last_fullsized":"2024-09-10T22:39:56.602666+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:39.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051749+0000","last_change":"2024-09-10T22:39:55.609924+0000","last_active":"2024-09-10T22:39:58.051749+0000","last_peered":"2024-09-10T22:39:58.051749+0000","last_clean":"2024-09-10T22:39:58.051749+0000","last_became_active":"2024-09-10T22:39:55.609660+0000","last_became_peered":"2024-09-10T22:39:55.609660+0000","last_unstale":"2024-09-10T22:39:58.051749+0000","last_undegraded":"2024-09-10T22:39:58.051749+0000","last_fullsized":"2024-09-10T22:39:58.051749+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:11.717529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.584789+0000","last_change":"2024-09-10T22:39:55.621855+0000","last_active":"2024-09-10T22:39:57.584789+0000","last_peered":"2024-09-10T22:39:57.584789+0000","last_clean":"2024-09-10T22:39:57.584789+0000","last_became_active":"2024-09-10T22:39:55.621561+0000","last_became_peered":"2024-09-10T22:39:55.621561+0000","last_unstale":"2024-09-10T22:39:57.584789+0000","last_undegraded":"2024-09-10T22:39:57.584789+0000","last_fullsized":"2024-09-10T22:39:57.584789+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:06.440429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.584768+0000","last_change":"2024-09-10T22:39:55.620345+0000","last_active":"2024-09-10T22:39:57.584768+0000","last_peered":"2024-09-10T22:39:57.584768+0000","last_clean":"2024-09-10T22:39:57.584768+0000","last_became_active":"2024-09-10T22:39:55.620025+0000","last_became_peered":"2024-09-10T22:39:55.620025+0000","last_unstale":"2024-09-10T22:39:57.584768+0000","last_undegraded":"2024-09-10T22:39:57.584768+0000","last_fullsized":"2024-09-10T22:39:57.584768+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:07.598316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.620548+0000","last_change":"2024-09-10T22:39:55.613543+0000","last_active":"2024-09-10T22:39:55.620548+0000","last_peered":"2024-09-10T22:39:55.620548+0000","last_clean":"2024-09-10T22:39:55.620548+0000","last_became_active":"2024-09-10T22:39:55.613277+0000","last_became_peered":"2024-09-10T22:39:55.613277+0000","last_unstale":"2024-09-10T22:39:55.620548+0000","last_undegraded":"2024-09-10T22:39:55.620548+0000","last_fullsized":"2024-09-10T22:39:55.620548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:20.332196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.587572+0000","last_change":"2024-09-10T22:39:55.594323+0000","last_active":"2024-09-10T22:39:57.587572+0000","last_peered":"2024-09-10T22:39:57.587572+0000","last_clean":"2024-09-10T22:39:57.587572+0000","last_became_active":"2024-09-10T22:39:55.594051+0000","last_became_peered":"2024-09-10T22:39:55.594051+0000","last_unstale":"2024-09-10T22:39:57.587572+0000","last_undegraded":"2024-09-10T22:39:57.587572+0000","last_fullsized":"2024-09-10T22:39:57.587572+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:00.484294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.601888+0000","last_change":"2024-09-10T22:39:55.592578+0000","last_active":"2024-09-10T22:39:56.601888+0000","last_peered":"2024-09-10T22:39:56.601888+0000","last_clean":"2024-09-10T22:39:56.601888+0000","last_became_active":"2024-09-10T22:39:55.592328+0000","last_became_peered":"2024-09-10T22:39:55.592328+0000","last_unstale":"2024-09-10T22:39:56.601888+0000","last_undegraded":"2024-09-10T22:39:56.601888+0000","last_fullsized":"2024-09-10T22:39:56.601888+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:10.930758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051820+0000","last_change":"2024-09-10T22:39:55.609987+0000","last_active":"2024-09-10T22:39:58.051820+0000","last_peered":"2024-09-10T22:39:58.051820+0000","last_clean":"2024-09-10T22:39:58.051820+0000","last_became_active":"2024-09-10T22:39:55.609686+0000","last_became_peered":"2024-09-10T22:39:55.609686+0000","last_unstale":"2024-09-10T22:39:58.051820+0000","last_undegraded":"2024-09-10T22:39:58.051820+0000","last_fullsized":"2024-09-10T22:39:58.051820+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:25.398537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.588020+0000","last_change":"2024-09-10T22:39:55.604433+0000","last_active":"2024-09-10T22:39:57.588020+0000","last_peered":"2024-09-10T22:39:57.588020+0000","last_clean":"2024-09-10T22:39:57.588020+0000","last_became_active":"2024-09-10T22:39:55.594486+0000","last_became_peered":"2024-09-10T22:39:55.594486+0000","last_unstale":"2024-09-10T22:39:57.588020+0000","last_undegraded":"2024-09-10T22:39:57.588020+0000","last_fullsized":"2024-09-10T22:39:57.588020+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:17.577141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.588143+0000","last_change":"2024-09-10T22:39:55.593373+0000","last_active":"2024-09-10T22:39:57.588143+0000","last_peered":"2024-09-10T22:39:57.588143+0000","last_clean":"2024-09-10T22:39:57.588143+0000","last_became_active":"2024-09-10T22:39:55.593121+0000","last_became_peered":"2024-09-10T22:39:55.593121+0000","last_unstale":"2024-09-10T22:39:57.588143+0000","last_undegraded":"2024-09-10T22:39:57.588143+0000","last_fullsized":"2024-09-10T22:39:57.588143+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:01.267190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051514+0000","last_change":"2024-09-10T22:39:55.606925+0000","last_active":"2024-09-10T22:39:58.051514+0000","last_peered":"2024-09-10T22:39:58.051514+0000","last_clean":"2024-09-10T22:39:58.051514+0000","last_became_active":"2024-09-10T22:39:55.606587+0000","last_became_peered":"2024-09-10T22:39:55.606587+0000","last_unstale":"2024-09-10T22:39:58.051514+0000","last_undegraded":"2024-09-10T22:39:58.051514+0000","last_fullsized":"2024-09-10T22:39:58.051514+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:11.626597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.587726+0000","last_change":"2024-09-10T22:39:55.605993+0000","last_active":"2024-09-10T22:39:57.587726+0000","last_peered":"2024-09-10T22:39:57.587726+0000","last_clean":"2024-09-10T22:39:57.587726+0000","last_became_active":"2024-09-10T22:39:55.605681+0000","last_became_peered":"2024-09-10T22:39:55.605681+0000","last_unstale":"2024-09-10T22:39:57.587726+0000","last_undegraded":"2024-09-10T22:39:57.587726+0000","last_fullsized":"2024-09-10T22:39:57.587726+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:00.608499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.750813+0000","last_change":"2024-09-10T22:39:55.597655+0000","last_active":"2024-09-10T22:39:58.750813+0000","last_peered":"2024-09-10T22:39:58.750813+0000","last_clean":"2024-09-10T22:39:58.750813+0000","last_became_active":"2024-09-10T22:39:55.597376+0000","last_became_peered":"2024-09-10T22:39:55.597376+0000","last_unstale":"2024-09-10T22:39:58.750813+0000","last_undegraded":"2024-09-10T22:39:58.750813+0000","last_fullsized":"2024-09-10T22:39:58.750813+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:40.987411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.587600+0000","last_change":"2024-09-10T22:39:55.609344+0000","last_active":"2024-09-10T22:39:57.587600+0000","last_peered":"2024-09-10T22:39:57.587600+0000","last_clean":"2024-09-10T22:39:57.587600+0000","last_became_active":"2024-09-10T22:39:55.609076+0000","last_became_peered":"2024-09-10T22:39:55.609076+0000","last_unstale":"2024-09-10T22:39:57.587600+0000","last_undegraded":"2024-09-10T22:39:57.587600+0000","last_fullsized":"2024-09-10T22:39:57.587600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:25.897503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605323+0000","last_change":"2024-09-10T22:39:55.616493+0000","last_active":"2024-09-10T22:39:56.605323+0000","last_peered":"2024-09-10T22:39:56.605323+0000","last_clean":"2024-09-10T22:39:56.605323+0000","last_became_active":"2024-09-10T22:39:55.611365+0000","last_became_peered":"2024-09-10T22:39:55.611365+0000","last_unstale":"2024-09-10T22:39:56.605323+0000","last_undegraded":"2024-09-10T22:39:56.605323+0000","last_fullsized":"2024-09-10T22:39:56.605323+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:29.934893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.606153+0000","last_change":"2024-09-10T22:39:55.611144+0000","last_active":"2024-09-10T22:39:56.606153+0000","last_peered":"2024-09-10T22:39:56.606153+0000","last_clean":"2024-09-10T22:39:56.606153+0000","last_became_active":"2024-09-10T22:39:55.610859+0000","last_became_peered":"2024-09-10T22:39:55.610859+0000","last_unstale":"2024-09-10T22:39:56.606153+0000","last_undegraded":"2024-09-10T22:39:56.606153+0000","last_fullsized":"2024-09-10T22:39:56.606153+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:00.608499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.130903+0000","last_change":"2024-09-10T22:39:55.600977+0000","last_active":"2024-09-10T22:39:58.130903+0000","last_peered":"2024-09-10T22:39:58.130903+0000","last_clean":"2024-09-10T22:39:58.130903+0000","last_became_active":"2024-09-10T22:39:55.600705+0000","last_became_peered":"2024-09-10T22:39:55.600705+0000","last_unstale":"2024-09-10T22:39:58.130903+0000","last_undegraded":"2024-09-10T22:39:58.130903+0000","last_fullsized":"2024-09-10T22:39:58.130903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:44.244140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.584951+0000","last_change":"2024-09-10T22:39:55.607359+0000","last_active":"2024-09-10T22:39:57.584951+0000","last_peered":"2024-09-10T22:39:57.584951+0000","last_clean":"2024-09-10T22:39:57.584951+0000","last_became_active":"2024-09-10T22:39:55.607191+0000","last_became_peered":"2024-09-10T22:39:55.607191+0000","last_unstale":"2024-09-10T22:39:57.584951+0000","last_undegraded":"2024-09-10T22:39:57.584951+0000","last_fullsized":"2024-09-10T22:39:57.584951+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:28.646381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.130730+0000","last_change":"2024-09-10T22:39:55.600013+0000","last_active":"2024-09-10T22:39:58.130730+0000","last_peered":"2024-09-10T22:39:58.130730+0000","last_clean":"2024-09-10T22:39:58.130730+0000","last_became_active":"2024-09-10T22:39:55.599719+0000","last_became_peered":"2024-09-10T22:39:55.599719+0000","last_unstale":"2024-09-10T22:39:58.130730+0000","last_undegraded":"2024-09-10T22:39:58.130730+0000","last_fullsized":"2024-09-10T22:39:58.130730+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:05.012882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.587842+0000","last_change":"2024-09-10T22:39:55.606581+0000","last_active":"2024-09-10T22:39:57.587842+0000","last_peered":"2024-09-10T22:39:57.587842+0000","last_clean":"2024-09-10T22:39:57.587842+0000","last_became_active":"2024-09-10T22:39:55.606277+0000","last_became_peered":"2024-09-10T22:39:55.606277+0000","last_unstale":"2024-09-10T22:39:57.587842+0000","last_undegraded":"2024-09-10T22:39:57.587842+0000","last_fullsized":"2024-09-10T22:39:57.587842+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:25.401506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.751253+0000","last_change":"2024-09-10T22:39:55.613631+0000","last_active":"2024-09-10T22:39:58.751253+0000","last_peered":"2024-09-10T22:39:58.751253+0000","last_clean":"2024-09-10T22:39:58.751253+0000","last_became_active":"2024-09-10T22:39:55.613213+0000","last_became_peered":"2024-09-10T22:39:55.613213+0000","last_unstale":"2024-09-10T22:39:58.751253+0000","last_undegraded":"2024-09-10T22:39:58.751253+0000","last_fullsized":"2024-09-10T22:39:58.751253+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:04.716824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605700+0000","last_change":"2024-09-10T22:39:55.610110+0000","last_active":"2024-09-10T22:39:56.605700+0000","last_peered":"2024-09-10T22:39:56.605700+0000","last_clean":"2024-09-10T22:39:56.605700+0000","last_became_active":"2024-09-10T22:39:55.609807+0000","last_became_peered":"2024-09-10T22:39:55.609807+0000","last_unstale":"2024-09-10T22:39:56.605700+0000","last_undegraded":"2024-09-10T22:39:56.605700+0000","last_fullsized":"2024-09-10T22:39:56.605700+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:11.717529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.584574+0000","last_change":"2024-09-10T22:39:55.619249+0000","last_active":"2024-09-10T22:39:57.584574+0000","last_peered":"2024-09-10T22:39:57.584574+0000","last_clean":"2024-09-10T22:39:57.584574+0000","last_became_active":"2024-09-10T22:39:55.618806+0000","last_became_peered":"2024-09-10T22:39:55.618806+0000","last_unstale":"2024-09-10T22:39:57.584574+0000","last_undegraded":"2024-09-10T22:39:57.584574+0000","last_fullsized":"2024-09-10T22:39:57.584574+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:04:43.587173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.130887+0000","last_change":"2024-09-10T22:39:55.598969+0000","last_active":"2024-09-10T22:39:58.130887+0000","last_peered":"2024-09-10T22:39:58.130887+0000","last_clean":"2024-09-10T22:39:58.130887+0000","last_became_active":"2024-09-10T22:39:55.598527+0000","last_became_peered":"2024-09-10T22:39:55.598527+0000","last_unstale":"2024-09-10T22:39:58.130887+0000","last_undegraded":"2024-09-10T22:39:58.130887+0000","last_fullsized":"2024-09-10T22:39:58.130887+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:04.716824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.620670+0000","last_change":"2024-09-10T22:39:55.614140+0000","last_active":"2024-09-10T22:39:55.620670+0000","last_peered":"2024-09-10T22:39:55.620670+0000","last_clean":"2024-09-10T22:39:55.620670+0000","last_became_active":"2024-09-10T22:39:55.613970+0000","last_became_peered":"2024-09-10T22:39:55.613970+0000","last_unstale":"2024-09-10T22:39:55.620670+0000","last_undegraded":"2024-09-10T22:39:55.620670+0000","last_fullsized":"2024-09-10T22:39:55.620670+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:22.046972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.130893+0000","last_change":"2024-09-10T22:39:55.603152+0000","last_active":"2024-09-10T22:39:58.130893+0000","last_peered":"2024-09-10T22:39:58.130893+0000","last_clean":"2024-09-10T22:39:58.130893+0000","last_became_active":"2024-09-10T22:39:55.602852+0000","last_became_peered":"2024-09-10T22:39:55.602852+0000","last_unstale":"2024-09-10T22:39:58.130893+0000","last_undegraded":"2024-09-10T22:39:58.130893+0000","last_fullsized":"2024-09-10T22:39:58.130893+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:43.919976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.587910+0000","last_change":"2024-09-10T22:39:55.599762+0000","last_active":"2024-09-10T22:39:57.587910+0000","last_peered":"2024-09-10T22:39:57.587910+0000","last_clean":"2024-09-10T22:39:57.587910+0000","last_became_active":"2024-09-10T22:39:55.599478+0000","last_became_peered":"2024-09-10T22:39:55.599478+0000","last_unstale":"2024-09-10T22:39:57.587910+0000","last_undegraded":"2024-09-10T22:39:57.587910+0000","last_fullsized":"2024-09-10T22:39:57.587910+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:11.348940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.130602+0000","last_change":"2024-09-10T22:39:55.614461+0000","last_active":"2024-09-10T22:39:58.130602+0000","last_peered":"2024-09-10T22:39:58.130602+0000","last_clean":"2024-09-10T22:39:58.130602+0000","last_became_active":"2024-09-10T22:39:55.614107+0000","last_became_peered":"2024-09-10T22:39:55.614107+0000","last_unstale":"2024-09-10T22:39:58.130602+0000","last_undegraded":"2024-09-10T22:39:58.130602+0000","last_fullsized":"2024-09-10T22:39:58.130602+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:56.065230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.130510+0000","last_change":"2024-09-10T22:39:55.596113+0000","last_active":"2024-09-10T22:39:58.130510+0000","last_peered":"2024-09-10T22:39:58.130510+0000","last_clean":"2024-09-10T22:39:58.130510+0000","last_became_active":"2024-09-10T22:39:55.595891+0000","last_became_peered":"2024-09-10T22:39:55.595891+0000","last_unstale":"2024-09-10T22:39:58.130510+0000","last_undegraded":"2024-09-10T22:39:58.130510+0000","last_fullsized":"2024-09-10T22:39:58.130510+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:20.279327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605970+0000","last_change":"2024-09-10T22:39:55.610875+0000","last_active":"2024-09-10T22:39:56.605970+0000","last_peered":"2024-09-10T22:39:56.605970+0000","last_clean":"2024-09-10T22:39:56.605970+0000","last_became_active":"2024-09-10T22:39:55.610519+0000","last_became_peered":"2024-09-10T22:39:55.610519+0000","last_unstale":"2024-09-10T22:39:56.605970+0000","last_undegraded":"2024-09-10T22:39:56.605970+0000","last_fullsized":"2024-09-10T22:39:56.605970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:46.738415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.618758+0000","last_change":"2024-09-10T22:39:55.610369+0000","last_active":"2024-09-10T22:39:55.618758+0000","last_peered":"2024-09-10T22:39:55.618758+0000","last_clean":"2024-09-10T22:39:55.618758+0000","last_became_active":"2024-09-10T22:39:55.610100+0000","last_became_peered":"2024-09-10T22:39:55.610100+0000","last_unstale":"2024-09-10T22:39:55.618758+0000","last_undegraded":"2024-09-10T22:39:55.618758+0000","last_fullsized":"2024-09-10T22:39:55.618758+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:22.225253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.606099+0000","last_change":"2024-09-10T22:39:55.612453+0000","last_active":"2024-09-10T22:39:56.606099+0000","last_peered":"2024-09-10T22:39:56.606099+0000","last_clean":"2024-09-10T22:39:56.606099+0000","last_became_active":"2024-09-10T22:39:55.612219+0000","last_became_peered":"2024-09-10T22:39:55.612219+0000","last_unstale":"2024-09-10T22:39:56.606099+0000","last_undegraded":"2024-09-10T22:39:56.606099+0000","last_fullsized":"2024-09-10T22:39:56.606099+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:25.897503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.130832+0000","last_change":"2024-09-10T22:39:54.606683+0000","last_active":"2024-09-10T22:39:58.130832+0000","last_peered":"2024-09-10T22:39:58.130832+0000","last_clean":"2024-09-10T22:39:58.130832+0000","last_became_active":"2024-09-10T22:39:54.606386+0000","last_became_peered":"2024-09-10T22:39:54.606386+0000","last_unstale":"2024-09-10T22:39:58.130832+0000","last_undegraded":"2024-09-10T22:39:58.130832+0000","last_fullsized":"2024-09-10T22:39:58.130832+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:06.595455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.620591+0000","last_change":"2024-09-10T22:39:55.613801+0000","last_active":"2024-09-10T22:39:55.620591+0000","last_peered":"2024-09-10T22:39:55.620591+0000","last_clean":"2024-09-10T22:39:55.620591+0000","last_became_active":"2024-09-10T22:39:55.613544+0000","last_became_peered":"2024-09-10T22:39:55.613544+0000","last_unstale":"2024-09-10T22:39:55.620591+0000","last_undegraded":"2024-09-10T22:39:55.620591+0000","last_fullsized":"2024-09-10T22:39:55.620591+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:29.775742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051629+0000","last_change":"2024-09-10T22:39:54.595062+0000","last_active":"2024-09-10T22:39:58.051629+0000","last_peered":"2024-09-10T22:39:58.051629+0000","last_clean":"2024-09-10T22:39:58.051629+0000","last_became_active":"2024-09-10T22:39:54.594701+0000","last_became_peered":"2024-09-10T22:39:54.594701+0000","last_unstale":"2024-09-10T22:39:58.051629+0000","last_undegraded":"2024-09-10T22:39:58.051629+0000","last_fullsized":"2024-09-10T22:39:58.051629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:35.346193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.751423+0000","last_change":"2024-09-10T22:39:55.599762+0000","last_active":"2024-09-10T22:39:58.751423+0000","last_peered":"2024-09-10T22:39:58.751423+0000","last_clean":"2024-09-10T22:39:58.751423+0000","last_became_active":"2024-09-10T22:39:55.599502+0000","last_became_peered":"2024-09-10T22:39:55.599502+0000","last_unstale":"2024-09-10T22:39:58.751423+0000","last_undegraded":"2024-09-10T22:39:58.751423+0000","last_fullsized":"2024-09-10T22:39:58.751423+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:54.770808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.615962+0000","last_change":"2024-09-10T22:39:54.584676+0000","last_active":"2024-09-10T22:39:55.615962+0000","last_peered":"2024-09-10T22:39:55.615962+0000","last_clean":"2024-09-10T22:39:55.615962+0000","last_became_active":"2024-09-10T22:39:54.584422+0000","last_became_peered":"2024-09-10T22:39:54.584422+0000","last_unstale":"2024-09-10T22:39:55.615962+0000","last_undegraded":"2024-09-10T22:39:55.615962+0000","last_fullsized":"2024-09-10T22:39:55.615962+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:12.047159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602445+0000","last_change":"2024-09-10T22:39:55.604482+0000","last_active":"2024-09-10T22:39:56.602445+0000","last_peered":"2024-09-10T22:39:56.602445+0000","last_clean":"2024-09-10T22:39:56.602445+0000","last_became_active":"2024-09-10T22:39:55.599105+0000","last_became_peered":"2024-09-10T22:39:55.599105+0000","last_unstale":"2024-09-10T22:39:56.602445+0000","last_undegraded":"2024-09-10T22:39:56.602445+0000","last_fullsized":"2024-09-10T22:39:56.602445+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:01.062801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.750986+0000","last_change":"2024-09-10T22:39:54.597031+0000","last_active":"2024-09-10T22:39:58.750986+0000","last_peered":"2024-09-10T22:39:58.750986+0000","last_clean":"2024-09-10T22:39:58.750986+0000","last_became_active":"2024-09-10T22:39:54.596099+0000","last_became_peered":"2024-09-10T22:39:54.596099+0000","last_unstale":"2024-09-10T22:39:58.750986+0000","last_undegraded":"2024-09-10T22:39:58.750986+0000","last_fullsized":"2024-09-10T22:39:58.750986+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:47.396792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051484+0000","last_change":"2024-09-10T22:39:55.606300+0000","last_active":"2024-09-10T22:39:58.051484+0000","last_peered":"2024-09-10T22:39:58.051484+0000","last_clean":"2024-09-10T22:39:58.051484+0000","last_became_active":"2024-09-10T22:39:55.606052+0000","last_became_peered":"2024-09-10T22:39:55.606052+0000","last_unstale":"2024-09-10T22:39:58.051484+0000","last_undegraded":"2024-09-10T22:39:58.051484+0000","last_fullsized":"2024-09-10T22:39:58.051484+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:47.570854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.587843+0000","last_change":"2024-09-10T22:39:54.600519+0000","last_active":"2024-09-10T22:39:57.587843+0000","last_peered":"2024-09-10T22:39:57.587843+0000","last_clean":"2024-09-10T22:39:57.587843+0000","last_became_active":"2024-09-10T22:39:54.600160+0000","last_became_peered":"2024-09-10T22:39:54.600160+0000","last_unstale":"2024-09-10T22:39:57.587843+0000","last_undegraded":"2024-09-10T22:39:57.587843+0000","last_fullsized":"2024-09-10T22:39:57.587843+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:19.276466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.587920+0000","last_change":"2024-09-10T22:39:55.607174+0000","last_active":"2024-09-10T22:39:57.587920+0000","last_peered":"2024-09-10T22:39:57.587920+0000","last_clean":"2024-09-10T22:39:57.587920+0000","last_became_active":"2024-09-10T22:39:55.606495+0000","last_became_peered":"2024-09-10T22:39:55.606495+0000","last_unstale":"2024-09-10T22:39:57.587920+0000","last_undegraded":"2024-09-10T22:39:57.587920+0000","last_fullsized":"2024-09-10T22:39:57.587920+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:24.572686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605503+0000","last_change":"2024-09-10T22:39:54.600314+0000","last_active":"2024-09-10T22:39:56.605503+0000","last_peered":"2024-09-10T22:39:56.605503+0000","last_clean":"2024-09-10T22:39:56.605503+0000","last_became_active":"2024-09-10T22:39:54.600042+0000","last_became_peered":"2024-09-10T22:39:54.600042+0000","last_unstale":"2024-09-10T22:39:56.605503+0000","last_undegraded":"2024-09-10T22:39:56.605503+0000","last_fullsized":"2024-09-10T22:39:56.605503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:19.276466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.751302+0000","last_change":"2024-09-10T22:39:55.597628+0000","last_active":"2024-09-10T22:39:58.751302+0000","last_peered":"2024-09-10T22:39:58.751302+0000","last_clean":"2024-09-10T22:39:58.751302+0000","last_became_active":"2024-09-10T22:39:55.597328+0000","last_became_peered":"2024-09-10T22:39:55.597328+0000","last_unstale":"2024-09-10T22:39:58.751302+0000","last_undegraded":"2024-09-10T22:39:58.751302+0000","last_fullsized":"2024-09-10T22:39:58.751302+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:31.248343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.589408+0000","last_change":"2024-09-10T22:39:54.593735+0000","last_active":"2024-09-10T22:39:55.589408+0000","last_peered":"2024-09-10T22:39:55.589408+0000","last_clean":"2024-09-10T22:39:55.589408+0000","last_became_active":"2024-09-10T22:39:54.593304+0000","last_became_peered":"2024-09-10T22:39:54.593304+0000","last_unstale":"2024-09-10T22:39:55.589408+0000","last_undegraded":"2024-09-10T22:39:55.589408+0000","last_fullsized":"2024-09-10T22:39:55.589408+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:13.962758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.601972+0000","last_change":"2024-09-10T22:39:55.605851+0000","last_active":"2024-09-10T22:39:56.601972+0000","last_peered":"2024-09-10T22:39:56.601972+0000","last_clean":"2024-09-10T22:39:56.601972+0000","last_became_active":"2024-09-10T22:39:55.605294+0000","last_became_peered":"2024-09-10T22:39:55.605294+0000","last_unstale":"2024-09-10T22:39:56.601972+0000","last_undegraded":"2024-09-10T22:39:56.601972+0000","last_fullsized":"2024-09-10T22:39:56.601972+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:15.251061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.750592+0000","last_change":"2024-09-10T22:39:54.604411+0000","last_active":"2024-09-10T22:39:58.750592+0000","last_peered":"2024-09-10T22:39:58.750592+0000","last_clean":"2024-09-10T22:39:58.750592+0000","last_became_active":"2024-09-10T22:39:54.604168+0000","last_became_peered":"2024-09-10T22:39:54.604168+0000","last_unstale":"2024-09-10T22:39:58.750592+0000","last_undegraded":"2024-09-10T22:39:58.750592+0000","last_fullsized":"2024-09-10T22:39:58.750592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:35.043433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.584922+0000","last_change":"2024-09-10T22:39:55.616542+0000","last_active":"2024-09-10T22:39:57.584922+0000","last_peered":"2024-09-10T22:39:57.584922+0000","last_clean":"2024-09-10T22:39:57.584922+0000","last_became_active":"2024-09-10T22:39:55.616285+0000","last_became_peered":"2024-09-10T22:39:55.616285+0000","last_unstale":"2024-09-10T22:39:57.584922+0000","last_undegraded":"2024-09-10T22:39:57.584922+0000","last_fullsized":"2024-09-10T22:39:57.584922+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:23.094216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602516+0000","last_change":"2024-09-10T22:39:54.591616+0000","last_active":"2024-09-10T22:39:56.602516+0000","last_peered":"2024-09-10T22:39:56.602516+0000","last_clean":"2024-09-10T22:39:56.602516+0000","last_became_active":"2024-09-10T22:39:54.591368+0000","last_became_peered":"2024-09-10T22:39:54.591368+0000","last_unstale":"2024-09-10T22:39:56.602516+0000","last_undegraded":"2024-09-10T22:39:56.602516+0000","last_fullsized":"2024-09-10T22:39:56.602516+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:52.734738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605704+0000","last_change":"2024-09-10T22:39:55.610284+0000","last_active":"2024-09-10T22:39:56.605704+0000","last_peered":"2024-09-10T22:39:56.605704+0000","last_clean":"2024-09-10T22:39:56.605704+0000","last_became_active":"2024-09-10T22:39:55.609251+0000","last_became_peered":"2024-09-10T22:39:55.609251+0000","last_unstale":"2024-09-10T22:39:56.605704+0000","last_undegraded":"2024-09-10T22:39:56.605704+0000","last_fullsized":"2024-09-10T22:39:56.605704+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:27.578026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.588106+0000","last_change":"2024-09-10T22:39:54.598579+0000","last_active":"2024-09-10T22:39:57.588106+0000","last_peered":"2024-09-10T22:39:57.588106+0000","last_clean":"2024-09-10T22:39:57.588106+0000","last_became_active":"2024-09-10T22:39:54.598184+0000","last_became_peered":"2024-09-10T22:39:54.598184+0000","last_unstale":"2024-09-10T22:39:57.588106+0000","last_undegraded":"2024-09-10T22:39:57.588106+0000","last_fullsized":"2024-09-10T22:39:57.588106+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:42.917115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051565+0000","last_change":"2024-09-10T22:39:55.596504+0000","last_active":"2024-09-10T22:39:58.051565+0000","last_peered":"2024-09-10T22:39:58.051565+0000","last_clean":"2024-09-10T22:39:58.051565+0000","last_became_active":"2024-09-10T22:39:55.596227+0000","last_became_peered":"2024-09-10T22:39:55.596227+0000","last_unstale":"2024-09-10T22:39:58.051565+0000","last_undegraded":"2024-09-10T22:39:58.051565+0000","last_fullsized":"2024-09-10T22:39:58.051565+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:01.872744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.588232+0000","last_change":"2024-09-10T22:39:54.596108+0000","last_active":"2024-09-10T22:39:57.588232+0000","last_peered":"2024-09-10T22:39:57.588232+0000","last_clean":"2024-09-10T22:39:57.588232+0000","last_became_active":"2024-09-10T22:39:54.595828+0000","last_became_peered":"2024-09-10T22:39:54.595828+0000","last_unstale":"2024-09-10T22:39:57.588232+0000","last_undegraded":"2024-09-10T22:39:57.588232+0000","last_fullsized":"2024-09-10T22:39:57.588232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:53.572295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.751403+0000","last_change":"2024-09-10T22:39:55.613306+0000","last_active":"2024-09-10T22:39:58.751403+0000","last_peered":"2024-09-10T22:39:58.751403+0000","last_clean":"2024-09-10T22:39:58.751403+0000","last_became_active":"2024-09-10T22:39:55.610844+0000","last_became_peered":"2024-09-10T22:39:55.610844+0000","last_unstale":"2024-09-10T22:39:58.751403+0000","last_undegraded":"2024-09-10T22:39:58.751403+0000","last_fullsized":"2024-09-10T22:39:58.751403+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:47.570854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602207+0000","last_change":"2024-09-10T22:39:54.597202+0000","last_active":"2024-09-10T22:39:56.602207+0000","last_peered":"2024-09-10T22:39:56.602207+0000","last_clean":"2024-09-10T22:39:56.602207+0000","last_became_active":"2024-09-10T22:39:54.596846+0000","last_became_peered":"2024-09-10T22:39:54.596846+0000","last_unstale":"2024-09-10T22:39:56.602207+0000","last_undegraded":"2024-09-10T22:39:56.602207+0000","last_fullsized":"2024-09-10T22:39:56.602207+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:42.917115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051699+0000","last_change":"2024-09-10T22:39:55.610630+0000","last_active":"2024-09-10T22:39:58.051699+0000","last_peered":"2024-09-10T22:39:58.051699+0000","last_clean":"2024-09-10T22:39:58.051699+0000","last_became_active":"2024-09-10T22:39:55.609562+0000","last_became_peered":"2024-09-10T22:39:55.609562+0000","last_unstale":"2024-09-10T22:39:58.051699+0000","last_undegraded":"2024-09-10T22:39:58.051699+0000","last_fullsized":"2024-09-10T22:39:58.051699+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:32.827317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602259+0000","last_change":"2024-09-10T22:39:54.591006+0000","last_active":"2024-09-10T22:39:56.602259+0000","last_peered":"2024-09-10T22:39:56.602259+0000","last_clean":"2024-09-10T22:39:56.602259+0000","last_became_active":"2024-09-10T22:39:54.590723+0000","last_became_peered":"2024-09-10T22:39:54.590723+0000","last_unstale":"2024-09-10T22:39:56.602259+0000","last_undegraded":"2024-09-10T22:39:56.602259+0000","last_fullsized":"2024-09-10T22:39:56.602259+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:36.341376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602038+0000","last_change":"2024-09-10T22:39:55.598525+0000","last_active":"2024-09-10T22:39:56.602038+0000","last_peered":"2024-09-10T22:39:56.602038+0000","last_clean":"2024-09-10T22:39:56.602038+0000","last_became_active":"2024-09-10T22:39:55.598260+0000","last_became_peered":"2024-09-10T22:39:55.598260+0000","last_unstale":"2024-09-10T22:39:56.602038+0000","last_undegraded":"2024-09-10T22:39:56.602038+0000","last_fullsized":"2024-09-10T22:39:56.602038+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:34.666995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.588100+0000","last_change":"2024-09-10T22:39:54.593541+0000","last_active":"2024-09-10T22:39:55.588100+0000","last_peered":"2024-09-10T22:39:55.588100+0000","last_clean":"2024-09-10T22:39:55.588100+0000","last_became_active":"2024-09-10T22:39:54.593236+0000","last_became_peered":"2024-09-10T22:39:54.593236+0000","last_unstale":"2024-09-10T22:39:55.588100+0000","last_undegraded":"2024-09-10T22:39:55.588100+0000","last_fullsized":"2024-09-10T22:39:55.588100+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:58.849464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.606108+0000","last_change":"2024-09-10T22:39:55.617166+0000","last_active":"2024-09-10T22:39:56.606108+0000","last_peered":"2024-09-10T22:39:56.606108+0000","last_clean":"2024-09-10T22:39:56.606108+0000","last_became_active":"2024-09-10T22:39:55.616857+0000","last_became_peered":"2024-09-10T22:39:55.616857+0000","last_unstale":"2024-09-10T22:39:56.606108+0000","last_undegraded":"2024-09-10T22:39:56.606108+0000","last_fullsized":"2024-09-10T22:39:56.606108+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:10.930758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.130269+0000","last_change":"2024-09-10T22:39:54.608957+0000","last_active":"2024-09-10T22:39:58.130269+0000","last_peered":"2024-09-10T22:39:58.130269+0000","last_clean":"2024-09-10T22:39:58.130269+0000","last_became_active":"2024-09-10T22:39:54.608678+0000","last_became_peered":"2024-09-10T22:39:54.608678+0000","last_unstale":"2024-09-10T22:39:58.130269+0000","last_undegraded":"2024-09-10T22:39:58.130269+0000","last_fullsized":"2024-09-10T22:39:58.130269+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:05.437568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602739+0000","last_change":"2024-09-10T22:39:55.597828+0000","last_active":"2024-09-10T22:39:56.602739+0000","last_peered":"2024-09-10T22:39:56.602739+0000","last_clean":"2024-09-10T22:39:56.602739+0000","last_became_active":"2024-09-10T22:39:55.597544+0000","last_became_peered":"2024-09-10T22:39:55.597544+0000","last_unstale":"2024-09-10T22:39:56.602739+0000","last_undegraded":"2024-09-10T22:39:56.602739+0000","last_fullsized":"2024-09-10T22:39:56.602739+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:35.551542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605233+0000","last_change":"2024-09-10T22:39:54.599385+0000","last_active":"2024-09-10T22:39:56.605233+0000","last_peered":"2024-09-10T22:39:56.605233+0000","last_clean":"2024-09-10T22:39:56.605233+0000","last_became_active":"2024-09-10T22:39:54.599054+0000","last_became_peered":"2024-09-10T22:39:54.599054+0000","last_unstale":"2024-09-10T22:39:56.605233+0000","last_undegraded":"2024-09-10T22:39:56.605233+0000","last_fullsized":"2024-09-10T22:39:56.605233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:35.346193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602354+0000","last_change":"2024-09-10T22:39:55.601591+0000","last_active":"2024-09-10T22:39:56.602354+0000","last_peered":"2024-09-10T22:39:56.602354+0000","last_clean":"2024-09-10T22:39:56.602354+0000","last_became_active":"2024-09-10T22:39:55.601308+0000","last_became_peered":"2024-09-10T22:39:55.601308+0000","last_unstale":"2024-09-10T22:39:56.602354+0000","last_undegraded":"2024-09-10T22:39:56.602354+0000","last_fullsized":"2024-09-10T22:39:56.602354+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:24.572686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.588188+0000","last_change":"2024-09-10T22:39:54.594532+0000","last_active":"2024-09-10T22:39:57.588188+0000","last_peered":"2024-09-10T22:39:57.588188+0000","last_clean":"2024-09-10T22:39:57.588188+0000","last_became_active":"2024-09-10T22:39:54.594210+0000","last_became_peered":"2024-09-10T22:39:54.594210+0000","last_unstale":"2024-09-10T22:39:57.588188+0000","last_undegraded":"2024-09-10T22:39:57.588188+0000","last_fullsized":"2024-09-10T22:39:57.588188+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:55.062369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.588225+0000","last_change":"2024-09-10T22:39:55.607077+0000","last_active":"2024-09-10T22:39:57.588225+0000","last_peered":"2024-09-10T22:39:57.588225+0000","last_clean":"2024-09-10T22:39:57.588225+0000","last_became_active":"2024-09-10T22:39:55.606211+0000","last_became_peered":"2024-09-10T22:39:55.606211+0000","last_unstale":"2024-09-10T22:39:57.588225+0000","last_undegraded":"2024-09-10T22:39:57.588225+0000","last_fullsized":"2024-09-10T22:39:57.588225+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:00.835994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.751432+0000","last_change":"2024-09-10T22:39:54.593196+0000","last_active":"2024-09-10T22:39:58.751432+0000","last_peered":"2024-09-10T22:39:58.751432+0000","last_clean":"2024-09-10T22:39:58.751432+0000","last_became_active":"2024-09-10T22:39:54.592842+0000","last_became_peered":"2024-09-10T22:39:54.592842+0000","last_unstale":"2024-09-10T22:39:58.751432+0000","last_undegraded":"2024-09-10T22:39:58.751432+0000","last_fullsized":"2024-09-10T22:39:58.751432+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:04.054085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.751367+0000","last_change":"2024-09-10T22:39:55.593841+0000","last_active":"2024-09-10T22:39:58.751367+0000","last_peered":"2024-09-10T22:39:58.751367+0000","last_clean":"2024-09-10T22:39:58.751367+0000","last_became_active":"2024-09-10T22:39:55.593392+0000","last_became_peered":"2024-09-10T22:39:55.593392+0000","last_unstale":"2024-09-10T22:39:58.751367+0000","last_undegraded":"2024-09-10T22:39:58.751367+0000","last_fullsized":"2024-09-10T22:39:58.751367+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:18.824112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.584808+0000","last_change":"2024-09-10T22:39:54.594511+0000","last_active":"2024-09-10T22:39:57.584808+0000","last_peered":"2024-09-10T22:39:57.584808+0000","last_clean":"2024-09-10T22:39:57.584808+0000","last_became_active":"2024-09-10T22:39:54.594250+0000","last_became_peered":"2024-09-10T22:39:54.594250+0000","last_unstale":"2024-09-10T22:39:57.584808+0000","last_undegraded":"2024-09-10T22:39:57.584808+0000","last_fullsized":"2024-09-10T22:39:57.584808+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:23.460102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.585044+0000","last_change":"2024-09-10T22:39:55.613008+0000","last_active":"2024-09-10T22:39:57.585044+0000","last_peered":"2024-09-10T22:39:57.585044+0000","last_clean":"2024-09-10T22:39:57.585044+0000","last_became_active":"2024-09-10T22:39:55.612731+0000","last_became_peered":"2024-09-10T22:39:55.612731+0000","last_unstale":"2024-09-10T22:39:57.585044+0000","last_undegraded":"2024-09-10T22:39:57.585044+0000","last_fullsized":"2024-09-10T22:39:57.585044+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:12.874695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.587241+0000","last_change":"2024-09-10T22:39:54.583703+0000","last_active":"2024-09-10T22:39:55.587241+0000","last_peered":"2024-09-10T22:39:55.587241+0000","last_clean":"2024-09-10T22:39:55.587241+0000","last_became_active":"2024-09-10T22:39:54.583419+0000","last_became_peered":"2024-09-10T22:39:54.583419+0000","last_unstale":"2024-09-10T22:39:55.587241+0000","last_undegraded":"2024-09-10T22:39:55.587241+0000","last_fullsized":"2024-09-10T22:39:55.587241+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:59.535764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.606072+0000","last_change":"2024-09-10T22:39:55.610788+0000","last_active":"2024-09-10T22:39:56.606072+0000","last_peered":"2024-09-10T22:39:56.606072+0000","last_clean":"2024-09-10T22:39:56.606072+0000","last_became_active":"2024-09-10T22:39:55.610457+0000","last_became_peered":"2024-09-10T22:39:55.610457+0000","last_unstale":"2024-09-10T22:39:56.606072+0000","last_undegraded":"2024-09-10T22:39:56.606072+0000","last_fullsized":"2024-09-10T22:39:56.606072+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:00.484294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.584502+0000","last_change":"2024-09-10T22:39:54.594728+0000","last_active":"2024-09-10T22:39:57.584502+0000","last_peered":"2024-09-10T22:39:57.584502+0000","last_clean":"2024-09-10T22:39:57.584502+0000","last_became_active":"2024-09-10T22:39:54.594416+0000","last_became_peered":"2024-09-10T22:39:54.594416+0000","last_unstale":"2024-09-10T22:39:57.584502+0000","last_undegraded":"2024-09-10T22:39:57.584502+0000","last_fullsized":"2024-09-10T22:39:57.584502+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:17.037897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051497+0000","last_change":"2024-09-10T22:39:55.596894+0000","last_active":"2024-09-10T22:39:58.051497+0000","last_peered":"2024-09-10T22:39:58.051497+0000","last_clean":"2024-09-10T22:39:58.051497+0000","last_became_active":"2024-09-10T22:39:55.596586+0000","last_became_peered":"2024-09-10T22:39:55.596586+0000","last_unstale":"2024-09-10T22:39:58.051497+0000","last_undegraded":"2024-09-10T22:39:58.051497+0000","last_fullsized":"2024-09-10T22:39:58.051497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:54.770808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.584466+0000","last_change":"2024-09-10T22:39:54.591519+0000","last_active":"2024-09-10T22:39:57.584466+0000","last_peered":"2024-09-10T22:39:57.584466+0000","last_clean":"2024-09-10T22:39:57.584466+0000","last_became_active":"2024-09-10T22:39:54.591318+0000","last_became_peered":"2024-09-10T22:39:54.591318+0000","last_unstale":"2024-09-10T22:39:57.584466+0000","last_undegraded":"2024-09-10T22:39:57.584466+0000","last_fullsized":"2024-09-10T22:39:57.584466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:00.391113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.587670+0000","last_change":"2024-09-10T22:39:55.595411+0000","last_active":"2024-09-10T22:39:57.587670+0000","last_peered":"2024-09-10T22:39:57.587670+0000","last_clean":"2024-09-10T22:39:57.587670+0000","last_became_active":"2024-09-10T22:39:55.595150+0000","last_became_peered":"2024-09-10T22:39:55.595150+0000","last_unstale":"2024-09-10T22:39:57.587670+0000","last_undegraded":"2024-09-10T22:39:57.587670+0000","last_fullsized":"2024-09-10T22:39:57.587670+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:34.658258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605783+0000","last_change":"2024-09-10T22:39:54.606738+0000","last_active":"2024-09-10T22:39:56.605783+0000","last_peered":"2024-09-10T22:39:56.605783+0000","last_clean":"2024-09-10T22:39:56.605783+0000","last_became_active":"2024-09-10T22:39:54.606232+0000","last_became_peered":"2024-09-10T22:39:54.606232+0000","last_unstale":"2024-09-10T22:39:56.605783+0000","last_undegraded":"2024-09-10T22:39:56.605783+0000","last_fullsized":"2024-09-10T22:39:56.605783+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:53.262935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602196+0000","last_change":"2024-09-10T22:39:55.606120+0000","last_active":"2024-09-10T22:39:56.602196+0000","last_peered":"2024-09-10T22:39:56.602196+0000","last_clean":"2024-09-10T22:39:56.602196+0000","last_became_active":"2024-09-10T22:39:55.605619+0000","last_became_peered":"2024-09-10T22:39:55.605619+0000","last_unstale":"2024-09-10T22:39:56.602196+0000","last_undegraded":"2024-09-10T22:39:56.602196+0000","last_fullsized":"2024-09-10T22:39:56.602196+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:43.386337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.584358+0000","last_change":"2024-09-10T22:39:54.596552+0000","last_active":"2024-09-10T22:39:57.584358+0000","last_peered":"2024-09-10T22:39:57.584358+0000","last_clean":"2024-09-10T22:39:57.584358+0000","last_became_active":"2024-09-10T22:39:54.596213+0000","last_became_peered":"2024-09-10T22:39:54.596213+0000","last_unstale":"2024-09-10T22:39:57.584358+0000","last_undegraded":"2024-09-10T22:39:57.584358+0000","last_fullsized":"2024-09-10T22:39:57.584358+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:10.809813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.620678+0000","last_change":"2024-09-10T22:39:55.614302+0000","last_active":"2024-09-10T22:39:55.620678+0000","last_peered":"2024-09-10T22:39:55.620678+0000","last_clean":"2024-09-10T22:39:55.620678+0000","last_became_active":"2024-09-10T22:39:55.614021+0000","last_became_peered":"2024-09-10T22:39:55.614021+0000","last_unstale":"2024-09-10T22:39:55.620678+0000","last_undegraded":"2024-09-10T22:39:55.620678+0000","last_fullsized":"2024-09-10T22:39:55.620678+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:25.084812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.588335+0000","last_change":"2024-09-10T22:39:54.600593+0000","last_active":"2024-09-10T22:39:57.588335+0000","last_peered":"2024-09-10T22:39:57.588335+0000","last_clean":"2024-09-10T22:39:57.588335+0000","last_became_active":"2024-09-10T22:39:54.600190+0000","last_became_peered":"2024-09-10T22:39:54.600190+0000","last_unstale":"2024-09-10T22:39:57.588335+0000","last_undegraded":"2024-09-10T22:39:57.588335+0000","last_fullsized":"2024-09-10T22:39:57.588335+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:04.010021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605944+0000","last_change":"2024-09-10T22:39:55.610582+0000","last_active":"2024-09-10T22:39:56.605944+0000","last_peered":"2024-09-10T22:39:56.605944+0000","last_clean":"2024-09-10T22:39:56.605944+0000","last_became_active":"2024-09-10T22:39:55.609999+0000","last_became_peered":"2024-09-10T22:39:55.609999+0000","last_unstale":"2024-09-10T22:39:56.605944+0000","last_undegraded":"2024-09-10T22:39:56.605944+0000","last_fullsized":"2024-09-10T22:39:56.605944+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:30.355578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.585028+0000","last_change":"2024-09-10T22:39:54.597434+0000","last_active":"2024-09-10T22:39:57.585028+0000","last_peered":"2024-09-10T22:39:57.585028+0000","last_clean":"2024-09-10T22:39:57.585028+0000","last_became_active":"2024-09-10T22:39:54.597051+0000","last_became_peered":"2024-09-10T22:39:54.597051+0000","last_unstale":"2024-09-10T22:39:57.585028+0000","last_undegraded":"2024-09-10T22:39:57.585028+0000","last_fullsized":"2024-09-10T22:39:57.585028+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:24.891603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.602778+0000","last_change":"2024-09-10T22:39:55.589343+0000","last_active":"2024-09-10T22:39:56.602778+0000","last_peered":"2024-09-10T22:39:56.602778+0000","last_clean":"2024-09-10T22:39:56.602778+0000","last_became_active":"2024-09-10T22:39:55.589050+0000","last_became_peered":"2024-09-10T22:39:55.589050+0000","last_unstale":"2024-09-10T22:39:56.602778+0000","last_undegraded":"2024-09-10T22:39:56.602778+0000","last_fullsized":"2024-09-10T22:39:56.602778+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:36.204468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051592+0000","last_change":"2024-09-10T22:39:54.599281+0000","last_active":"2024-09-10T22:39:58.051592+0000","last_peered":"2024-09-10T22:39:58.051592+0000","last_clean":"2024-09-10T22:39:58.051592+0000","last_became_active":"2024-09-10T22:39:54.598952+0000","last_became_peered":"2024-09-10T22:39:54.598952+0000","last_unstale":"2024-09-10T22:39:58.051592+0000","last_undegraded":"2024-09-10T22:39:58.051592+0000","last_fullsized":"2024-09-10T22:39:58.051592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:50.596905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051801+0000","last_change":"2024-09-10T22:39:55.594745+0000","last_active":"2024-09-10T22:39:58.051801+0000","last_peered":"2024-09-10T22:39:58.051801+0000","last_clean":"2024-09-10T22:39:58.051801+0000","last_became_active":"2024-09-10T22:39:55.594384+0000","last_became_peered":"2024-09-10T22:39:55.594384+0000","last_unstale":"2024-09-10T22:39:58.051801+0000","last_undegraded":"2024-09-10T22:39:58.051801+0000","last_fullsized":"2024-09-10T22:39:58.051801+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:24.611413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.051495+0000","last_change":"2024-09-10T22:39:54.603890+0000","last_active":"2024-09-10T22:39:58.051495+0000","last_peered":"2024-09-10T22:39:58.051495+0000","last_clean":"2024-09-10T22:39:58.051495+0000","last_became_active":"2024-09-10T22:39:54.603411+0000","last_became_peered":"2024-09-10T22:39:54.603411+0000","last_unstale":"2024-09-10T22:39:58.051495+0000","last_undegraded":"2024-09-10T22:39:58.051495+0000","last_fullsized":"2024-09-10T22:39:58.051495+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:57.540085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T22:39:55.615852+0000","last_change":"2024-09-10T22:39:55.606593+0000","last_active":"2024-09-10T22:39:55.615852+0000","last_peered":"2024-09-10T22:39:55.615852+0000","last_clean":"2024-09-10T22:39:55.615852+0000","last_became_active":"2024-09-10T22:39:55.604802+0000","last_became_peered":"2024-09-10T22:39:55.604802+0000","last_unstale":"2024-09-10T22:39:55.615852+0000","last_undegraded":"2024-09-10T22:39:55.615852+0000","last_fullsized":"2024-09-10T22:39:55.615852+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:59.878431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.130362+0000","last_change":"2024-09-10T22:39:54.598982+0000","last_active":"2024-09-10T22:39:58.130362+0000","last_peered":"2024-09-10T22:39:58.130362+0000","last_clean":"2024-09-10T22:39:58.130362+0000","last_became_active":"2024-09-10T22:39:54.598502+0000","last_became_peered":"2024-09-10T22:39:54.598502+0000","last_unstale":"2024-09-10T22:39:58.130362+0000","last_undegraded":"2024-09-10T22:39:58.130362+0000","last_fullsized":"2024-09-10T22:39:58.130362+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:04:42.584312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.750888+0000","last_change":"2024-09-10T22:39:55.589092+0000","last_active":"2024-09-10T22:39:58.750888+0000","last_peered":"2024-09-10T22:39:58.750888+0000","last_clean":"2024-09-10T22:39:58.750888+0000","last_became_active":"2024-09-10T22:39:55.588718+0000","last_became_peered":"2024-09-10T22:39:55.588718+0000","last_unstale":"2024-09-10T22:39:58.750888+0000","last_undegraded":"2024-09-10T22:39:58.750888+0000","last_fullsized":"2024-09-10T22:39:58.750888+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:44.244140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:58.750596+0000","last_change":"2024-09-10T22:39:54.596304+0000","last_active":"2024-09-10T22:39:58.750596+0000","last_peered":"2024-09-10T22:39:58.750596+0000","last_clean":"2024-09-10T22:39:58.750596+0000","last_became_active":"2024-09-10T22:39:54.596018+0000","last_became_peered":"2024-09-10T22:39:54.596018+0000","last_unstale":"2024-09-10T22:39:58.750596+0000","last_undegraded":"2024-09-10T22:39:58.750596+0000","last_fullsized":"2024-09-10T22:39:58.750596+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:34.492011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.606260+0000","last_change":"2024-09-10T22:39:55.612905+0000","last_active":"2024-09-10T22:39:56.606260+0000","last_peered":"2024-09-10T22:39:56.606260+0000","last_clean":"2024-09-10T22:39:56.606260+0000","last_became_active":"2024-09-10T22:39:55.612450+0000","last_became_peered":"2024-09-10T22:39:55.612450+0000","last_unstale":"2024-09-10T22:39:56.606260+0000","last_undegraded":"2024-09-10T22:39:56.606260+0000","last_fullsized":"2024-09-10T22:39:56.606260+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:25.401506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.601822+0000","last_change":"2024-09-10T22:39:54.593069+0000","last_active":"2024-09-10T22:39:56.601822+0000","last_peered":"2024-09-10T22:39:56.601822+0000","last_clean":"2024-09-10T22:39:56.601822+0000","last_became_active":"2024-09-10T22:39:54.592765+0000","last_became_peered":"2024-09-10T22:39:54.592765+0000","last_unstale":"2024-09-10T22:39:56.601822+0000","last_undegraded":"2024-09-10T22:39:56.601822+0000","last_fullsized":"2024-09-10T22:39:56.601822+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:53.572295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:57.588271+0000","last_change":"2024-09-10T22:39:55.613741+0000","last_active":"2024-09-10T22:39:57.588271+0000","last_peered":"2024-09-10T22:39:57.588271+0000","last_clean":"2024-09-10T22:39:57.588271+0000","last_became_active":"2024-09-10T22:39:55.613408+0000","last_became_peered":"2024-09-10T22:39:55.613408+0000","last_unstale":"2024-09-10T22:39:57.588271+0000","last_undegraded":"2024-09-10T22:39:57.588271+0000","last_fullsized":"2024-09-10T22:39:57.588271+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:54.566398+0000","last_clean_scrub_stamp":"2024-09-10T22:39:54.566398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:46.415739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605756+0000","last_change":"2024-09-10T22:39:54.601169+0000","last_active":"2024-09-10T22:39:56.605756+0000","last_peered":"2024-09-10T22:39:56.605756+0000","last_clean":"2024-09-10T22:39:56.605756+0000","last_became_active":"2024-09-10T22:39:54.600890+0000","last_became_peered":"2024-09-10T22:39:54.600890+0000","last_unstale":"2024-09-10T22:39:56.605756+0000","last_undegraded":"2024-09-10T22:39:56.605756+0000","last_fullsized":"2024-09-10T22:39:56.605756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:39:53.563538+0000","last_clean_scrub_stamp":"2024-09-10T22:39:53.563538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:50.596905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":146,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T22:39:56.605417+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:39:56.605417+0000","last_peered":"2024-09-10T22:39:56.605417+0000","last_clean":"2024-09-10T22:39:56.605417+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:39:56.605417+0000","last_undegraded":"2024-09-10T22:39:56.605417+0000","last_fullsized":"2024-09-10T22:39:56.605417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":792465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":200997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":475136,"data_stored":200527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":194327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":483328,"data_stored":202061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":200485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":790817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":193813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:40:00.094 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T22:40:00.094 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T22:40:00.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.274+0000 7ff956600640 1 -- 172.21.15.103:0/102148195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9500cd960 msgr2=0x7ff950168ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:00.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.274+0000 7ff956600640 1 --2- 172.21.15.103:0/102148195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9500cd960 0x7ff950168ab0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff948009bc0 tx=0x7ff94801cba0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.274+0000 7ff956600640 1 -- 172.21.15.103:0/102148195 shutdown_connections 2024-09-10T22:40:00.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.274+0000 7ff956600640 1 --2- 172.21.15.103:0/102148195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9500cd960 0x7ff950168ab0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.274+0000 7ff956600640 1 -- 172.21.15.103:0/102148195 >> 172.21.15.103:0/102148195 conn(0x7ff9500d1ad0 msgr2=0x7ff9500d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:00.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.274+0000 7ff956600640 1 -- 172.21.15.103:0/102148195 shutdown_connections 2024-09-10T22:40:00.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.274+0000 7ff956600640 1 -- 172.21.15.103:0/102148195 wait complete. 2024-09-10T22:40:00.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff956600640 1 Processor -- start 2024-09-10T22:40:00.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff956600640 1 -- start start 2024-09-10T22:40:00.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff956600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9500cd960 0x7ff950153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:00.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff956600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9500d13a0 0x7ff9500b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:00.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff956600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9501612e0 0x7ff9500b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:00.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff956600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff95016bd00 con 0x7ff9500d13a0 2024-09-10T22:40:00.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff956600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff95016bb80 con 0x7ff9501612e0 2024-09-10T22:40:00.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff956600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff95016be80 con 0x7ff9500cd960 2024-09-10T22:40:00.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff946a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9500d13a0 0x7ff9500b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:00.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff946a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9500d13a0 0x7ff9500b1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43088/0 (socket says 172.21.15.103:43088) 2024-09-10T22:40:00.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff946a00640 1 -- 172.21.15.103:0/3135725849 learned_addr learned my addr 172.21.15.103:0/3135725849 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:00.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff94fe00640 1 --2- 172.21.15.103:0/3135725849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9501612e0 0x7ff9500b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:00.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff94f400640 1 --2- 172.21.15.103:0/3135725849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9500cd960 0x7ff950153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:00.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff946a00640 1 -- 172.21.15.103:0/3135725849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9500cd960 msgr2=0x7ff950153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:00.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff946a00640 1 --2- 172.21.15.103:0/3135725849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9500cd960 0x7ff950153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff946a00640 1 -- 172.21.15.103:0/3135725849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9501612e0 msgr2=0x7ff9500b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:00.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff946a00640 1 --2- 172.21.15.103:0/3135725849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9501612e0 0x7ff9500b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff946a00640 1 -- 172.21.15.103:0/3135725849 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9500c85c0 con 0x7ff9500d13a0 2024-09-10T22:40:00.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff946a00640 1 --2- 172.21.15.103:0/3135725849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9500d13a0 0x7ff9500b1f70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff93800c500 tx=0x7ff93800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:00.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff947e00640 1 -- 172.21.15.103:0/3135725849 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9380052d0 con 0x7ff9500d13a0 2024-09-10T22:40:00.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff947e00640 1 -- 172.21.15.103:0/3135725849 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff938005490 con 0x7ff9500d13a0 2024-09-10T22:40:00.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff947e00640 1 -- 172.21.15.103:0/3135725849 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff938012870 con 0x7ff9500d13a0 2024-09-10T22:40:00.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff956600640 1 -- 172.21.15.103:0/3135725849 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9500b49c0 con 0x7ff9500d13a0 2024-09-10T22:40:00.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.278+0000 7ff956600640 1 -- 172.21.15.103:0/3135725849 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9500b4f80 con 0x7ff9500d13a0 2024-09-10T22:40:00.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.282+0000 7ff956600640 1 -- 172.21.15.103:0/3135725849 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9500cc950 con 0x7ff9500d13a0 2024-09-10T22:40:00.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.282+0000 7ff947e00640 1 -- 172.21.15.103:0/3135725849 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff938012a10 con 0x7ff9500d13a0 2024-09-10T22:40:00.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.282+0000 7ff947e00640 1 --2- 172.21.15.103:0/3135725849 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff92c072610 0x7ff92c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:00.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.282+0000 7ff947e00640 1 -- 172.21.15.103:0/3135725849 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7ff938092ec0 con 0x7ff9500d13a0 2024-09-10T22:40:00.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.282+0000 7ff94f400640 1 --2- 172.21.15.103:0/3135725849 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff92c072610 0x7ff92c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:00.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.282+0000 7ff94f400640 1 --2- 172.21.15.103:0/3135725849 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff92c072610 0x7ff92c074ad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff940007f30 tx=0x7ff940007ec0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:00.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.286+0000 7ff947e00640 1 -- 172.21.15.103:0/3135725849 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff93805ddb0 con 0x7ff9500d13a0 2024-09-10T22:40:00.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.510+0000 7ff956600640 1 -- 172.21.15.103:0/3135725849 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff95006ae30 con 0x7ff9500d13a0 2024-09-10T22:40:00.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.514+0000 7ff947e00640 1 -- 172.21.15.103:0/3135725849 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7ff9380627e0 con 0x7ff9500d13a0 2024-09-10T22:40:00.517 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-09-10T22:40:00.517 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA8yuBmtOhZNBAAeszxWpV60NIn/zOInT5Zzw== 2024-09-10T22:40:00.517 INFO:teuthology.orchestra.run.smithi103.stdout: caps mds = "allow" 2024-09-10T22:40:00.517 INFO:teuthology.orchestra.run.smithi103.stdout: caps mon = "allow r" 2024-09-10T22:40:00.517 INFO:teuthology.orchestra.run.smithi103.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T22:40:00.517 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2024-09-10T22:40:00.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.514+0000 7ff956600640 1 -- 172.21.15.103:0/3135725849 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff92c072610 msgr2=0x7ff92c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:00.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.514+0000 7ff956600640 1 --2- 172.21.15.103:0/3135725849 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff92c072610 0x7ff92c074ad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff940007f30 tx=0x7ff940007ec0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.514+0000 7ff956600640 1 -- 172.21.15.103:0/3135725849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9500d13a0 msgr2=0x7ff9500b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:00.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.514+0000 7ff956600640 1 --2- 172.21.15.103:0/3135725849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9500d13a0 0x7ff9500b1f70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff93800c500 tx=0x7ff93800c9c0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.514+0000 7ff956600640 1 -- 172.21.15.103:0/3135725849 shutdown_connections 2024-09-10T22:40:00.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.514+0000 7ff956600640 1 --2- 172.21.15.103:0/3135725849 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff92c072610 0x7ff92c074ad0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.514+0000 7ff956600640 1 --2- 172.21.15.103:0/3135725849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9501612e0 0x7ff9500b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.514+0000 7ff956600640 1 --2- 172.21.15.103:0/3135725849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9500d13a0 0x7ff9500b1f70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.514+0000 7ff956600640 1 --2- 172.21.15.103:0/3135725849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9500cd960 0x7ff950153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.514+0000 7ff956600640 1 -- 172.21.15.103:0/3135725849 >> 172.21.15.103:0/3135725849 conn(0x7ff9500d1ad0 msgr2=0x7ff9500cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:00.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.514+0000 7ff956600640 1 -- 172.21.15.103:0/3135725849 shutdown_connections 2024-09-10T22:40:00.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.514+0000 7ff956600640 1 -- 172.21.15.103:0/3135725849 wait complete. 2024-09-10T22:40:00.539 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:40:00.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.678+0000 7f37ee200640 1 -- 172.21.15.103:0/1070334037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37e80d2540 msgr2=0x7f37e80b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:00.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.678+0000 7f37ee200640 1 --2- 172.21.15.103:0/1070334037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37e80d2540 0x7f37e80b1490 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f37e0009c80 tx=0x7f37e001cd70 comp rx=0 tx=0).stop 2024-09-10T22:40:00.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.678+0000 7f37ee200640 1 -- 172.21.15.103:0/1070334037 shutdown_connections 2024-09-10T22:40:00.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.678+0000 7f37ee200640 1 --2- 172.21.15.103:0/1070334037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37e80d2540 0x7f37e80b1490 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.678+0000 7f37ee200640 1 --2- 172.21.15.103:0/1070334037 >> v2:172.21.15.131:3300/0 conn(0x7f37e80d0710 0x7f37e80cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.678+0000 7f37ee200640 1 -- 172.21.15.103:0/1070334037 >> 172.21.15.103:0/1070334037 conn(0x7f37e80d1a20 msgr2=0x7f37e80d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:00.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.678+0000 7f37ee200640 1 -- 172.21.15.103:0/1070334037 shutdown_connections 2024-09-10T22:40:00.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.678+0000 7f37ee200640 1 -- 172.21.15.103:0/1070334037 wait complete. 2024-09-10T22:40:00.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37ee200640 1 Processor -- start 2024-09-10T22:40:00.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37ee200640 1 -- start start 2024-09-10T22:40:00.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37ee200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37e80d0710 0x7f37e81f8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:00.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37ee200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37e80d2540 0x7f37e81551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:00.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37ee200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37e815bcb0 0x7f37e815ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:00.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37ee200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f37e8168960 con 0x7f37e815bcb0 2024-09-10T22:40:00.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37ee200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f37e81687e0 con 0x7f37e80d2540 2024-09-10T22:40:00.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37ee200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f37e8168ae0 con 0x7f37e80d0710 2024-09-10T22:40:00.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37e7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37e815bcb0 0x7f37e815ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:00.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37e7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37e815bcb0 0x7f37e815ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43104/0 (socket says 172.21.15.103:43104) 2024-09-10T22:40:00.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37e7e00640 1 -- 172.21.15.103:0/2947389035 learned_addr learned my addr 172.21.15.103:0/2947389035 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:00.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37e7400640 1 --2- 172.21.15.103:0/2947389035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37e80d0710 0x7f37e81f8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:00.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37dea00640 1 --2- 172.21.15.103:0/2947389035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37e80d2540 0x7f37e81551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:00.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37e7e00640 1 -- 172.21.15.103:0/2947389035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37e80d0710 msgr2=0x7f37e81f8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:00.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37e7e00640 1 --2- 172.21.15.103:0/2947389035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37e80d0710 0x7f37e81f8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37e7e00640 1 -- 172.21.15.103:0/2947389035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37e80d2540 msgr2=0x7f37e81551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:00.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37e7e00640 1 --2- 172.21.15.103:0/2947389035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37e80d2540 0x7f37e81551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37e7e00640 1 -- 172.21.15.103:0/2947389035 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e81f9030 con 0x7f37e815bcb0 2024-09-10T22:40:00.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.682+0000 7f37e7e00640 1 --2- 172.21.15.103:0/2947389035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37e815bcb0 0x7f37e815ab20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f37e0009bd0 tx=0x7f37e00092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:00.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.686+0000 7f37dfe00640 1 -- 172.21.15.103:0/2947389035 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e00bb070 con 0x7f37e815bcb0 2024-09-10T22:40:00.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.686+0000 7f37dfe00640 1 -- 172.21.15.103:0/2947389035 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37e0004d40 con 0x7f37e815bcb0 2024-09-10T22:40:00.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.686+0000 7f37ee200640 1 -- 172.21.15.103:0/2947389035 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e80cad10 con 0x7f37e815bcb0 2024-09-10T22:40:00.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.686+0000 7f37dfe00640 1 -- 172.21.15.103:0/2947389035 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e00b2040 con 0x7f37e815bcb0 2024-09-10T22:40:00.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.686+0000 7f37ee200640 1 -- 172.21.15.103:0/2947389035 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e80cb580 con 0x7f37e815bcb0 2024-09-10T22:40:00.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.686+0000 7f37ee200640 1 -- 172.21.15.103:0/2947389035 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37e80cf5f0 con 0x7f37e815bcb0 2024-09-10T22:40:00.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.686+0000 7f37dfe00640 1 -- 172.21.15.103:0/2947389035 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f37e00b5030 con 0x7f37e815bcb0 2024-09-10T22:40:00.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.686+0000 7f37dfe00640 1 --2- 172.21.15.103:0/2947389035 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f37c40725e0 0x7f37c4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:00.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.686+0000 7f37dfe00640 1 -- 172.21.15.103:0/2947389035 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f37e012d080 con 0x7f37e815bcb0 2024-09-10T22:40:00.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.686+0000 7f37e7400640 1 --2- 172.21.15.103:0/2947389035 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f37c40725e0 0x7f37c4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:00.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.690+0000 7f37e7400640 1 --2- 172.21.15.103:0/2947389035 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f37c40725e0 0x7f37c4074aa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f37d8007fd0 tx=0x7f37d8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:00.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.690+0000 7f37dfe00640 1 -- 172.21.15.103:0/2947389035 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f37e81f9030 con 0x7f37e815bcb0 2024-09-10T22:40:00.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.890+0000 7f37ee200640 1 -- 172.21.15.103:0/2947389035 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37e8155710 con 0x7f37e815bcb0 2024-09-10T22:40:00.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.890+0000 7f37dfe00640 1 -- 172.21.15.103:0/2947389035 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5235 (secure 0 0 0) 0x7f37e0016990 con 0x7f37e815bcb0 2024-09-10T22:40:00.895 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:40:00.896 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":19,"btime":"2024-09-10T22:39:58:609166+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/3313045987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3313045987},{"type":"v1","addr":"172.21.15.131:6836","nonce":3313045987}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":4754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/1068577002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1068577002},{"type":"v1","addr":"172.21.15.131:6837","nonce":1068577002}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/4043692269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4043692269},{"type":"v1","addr":"172.21.15.103:6833","nonce":4043692269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:39:54.979240+0000","modified":"2024-09-10T22:39:58.002325+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4941},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4941":{"gid":4941,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/1194009116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1194009116},{"type":"v1","addr":"172.21.15.103:6835","nonce":1194009116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4941,"qdb_cluster":[4941]},"id":2}]} 2024-09-10T22:40:00.896 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 19 2024-09-10T22:40:00.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.894+0000 7f37ee200640 1 -- 172.21.15.103:0/2947389035 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f37c40725e0 msgr2=0x7f37c4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:00.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.894+0000 7f37ee200640 1 --2- 172.21.15.103:0/2947389035 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f37c40725e0 0x7f37c4074aa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f37d8007fd0 tx=0x7f37d8009040 comp rx=0 tx=0).stop 2024-09-10T22:40:00.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.894+0000 7f37ee200640 1 -- 172.21.15.103:0/2947389035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37e815bcb0 msgr2=0x7f37e815ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:00.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.894+0000 7f37ee200640 1 --2- 172.21.15.103:0/2947389035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37e815bcb0 0x7f37e815ab20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f37e0009bd0 tx=0x7f37e00092e0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.894+0000 7f37ee200640 1 -- 172.21.15.103:0/2947389035 shutdown_connections 2024-09-10T22:40:00.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.894+0000 7f37ee200640 1 --2- 172.21.15.103:0/2947389035 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f37c40725e0 0x7f37c4074aa0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.894+0000 7f37ee200640 1 --2- 172.21.15.103:0/2947389035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37e815bcb0 0x7f37e815ab20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.894+0000 7f37ee200640 1 --2- 172.21.15.103:0/2947389035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37e80d2540 0x7f37e81551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.894+0000 7f37ee200640 1 --2- 172.21.15.103:0/2947389035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37e80d0710 0x7f37e81f8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:00.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.894+0000 7f37ee200640 1 -- 172.21.15.103:0/2947389035 >> 172.21.15.103:0/2947389035 conn(0x7f37e80d1a20 msgr2=0x7f37e80d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:00.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.894+0000 7f37ee200640 1 -- 172.21.15.103:0/2947389035 shutdown_connections 2024-09-10T22:40:00.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:00.894+0000 7f37ee200640 1 -- 172.21.15.103:0/2947389035 wait complete. 2024-09-10T22:40:01.319 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:39:54.979240+0000', 'modified': '2024-09-10T22:39:58.002325+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4941}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4941': {'gid': 4941, 'name': 'c', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/1194009116', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6834', 'nonce': 1194009116}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 1194009116}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4941, 'qdb_cluster': [4941]} 2024-09-10T22:40:01.319 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T22:40:01.320 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T22:40:01.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.458+0000 7fe33fe00640 1 -- 172.21.15.103:0/1304529766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe324003ad0 msgr2=0x7fe324003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:01.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.458+0000 7fe33fe00640 1 --2- 172.21.15.103:0/1304529766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe324003ad0 0x7fe324003ef0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe330009b30 tx=0x7fe33001d220 comp rx=0 tx=0).stop 2024-09-10T22:40:01.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.458+0000 7fe33f400640 1 -- 172.21.15.103:0/1304529766 reap_dead start 2024-09-10T22:40:01.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.458+0000 7fe33fe00640 1 -- 172.21.15.103:0/1304529766 shutdown_connections 2024-09-10T22:40:01.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.458+0000 7fe33fe00640 1 -- 172.21.15.103:0/1304529766 >> 172.21.15.103:0/1304529766 conn(0x7fe3400cc950 msgr2=0x7fe3400ccd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:01.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.458+0000 7fe33fe00640 1 -- 172.21.15.103:0/1304529766 shutdown_connections 2024-09-10T22:40:01.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.458+0000 7fe33fe00640 1 -- 172.21.15.103:0/1304529766 wait complete. 2024-09-10T22:40:01.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33fe00640 1 Processor -- start 2024-09-10T22:40:01.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33fe00640 1 -- start start 2024-09-10T22:40:01.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe324003ad0 0x7fe3401f8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33fe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe340146b70 0x7fe340146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3400c9af0 0x7fe340150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33fe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe34006f020 con 0x7fe324003ad0 2024-09-10T22:40:01.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33fe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe34006eea0 con 0x7fe3400c9af0 2024-09-10T22:40:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33fe00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe34006f1a0 con 0x7fe340146b70 2024-09-10T22:40:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe324003ad0 0x7fe3401f8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe324003ad0 0x7fe3401f8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43120/0 (socket says 172.21.15.103:43120) 2024-09-10T22:40:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33ea00640 1 -- 172.21.15.103:0/2351542357 learned_addr learned my addr 172.21.15.103:0/2351542357 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33e000640 1 --2- 172.21.15.103:0/2351542357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe340146b70 0x7fe340146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33f400640 1 --2- 172.21.15.103:0/2351542357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3400c9af0 0x7fe340150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33ea00640 1 -- 172.21.15.103:0/2351542357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe340146b70 msgr2=0x7fe340146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33ea00640 1 --2- 172.21.15.103:0/2351542357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe340146b70 0x7fe340146280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33ea00640 1 -- 172.21.15.103:0/2351542357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3400c9af0 msgr2=0x7fe340150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33ea00640 1 --2- 172.21.15.103:0/2351542357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3400c9af0 0x7fe340150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33ea00640 1 -- 172.21.15.103:0/2351542357 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3400b39f0 con 0x7fe324003ad0 2024-09-10T22:40:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33ea00640 1 --2- 172.21.15.103:0/2351542357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe324003ad0 0x7fe3401f8270 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe3300af040 tx=0x7fe330005600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:01.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe336a00640 1 -- 172.21.15.103:0/2351542357 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3300b1040 con 0x7fe324003ad0 2024-09-10T22:40:01.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe336a00640 1 -- 172.21.15.103:0/2351542357 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe330004130 con 0x7fe324003ad0 2024-09-10T22:40:01.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe336a00640 1 -- 172.21.15.103:0/2351542357 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3300046d0 con 0x7fe324003ad0 2024-09-10T22:40:01.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.462+0000 7fe33fe00640 1 -- 172.21.15.103:0/2351542357 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3401f7a70 con 0x7fe324003ad0 2024-09-10T22:40:01.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.466+0000 7fe33fe00640 1 -- 172.21.15.103:0/2351542357 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3401f87b0 con 0x7fe324003ad0 2024-09-10T22:40:01.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.466+0000 7fe336a00640 1 -- 172.21.15.103:0/2351542357 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe330004870 con 0x7fe324003ad0 2024-09-10T22:40:01.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.466+0000 7fe336a00640 1 --2- 172.21.15.103:0/2351542357 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe3200725e0 0x7fe320074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.466+0000 7fe336a00640 1 -- 172.21.15.103:0/2351542357 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fe33012d730 con 0x7fe324003ad0 2024-09-10T22:40:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.466+0000 7fe348ff0000 1 Processor -- start 2024-09-10T22:40:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.466+0000 7fe33e000640 1 --2- 172.21.15.103:0/2351542357 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe3200725e0 0x7fe320074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.466+0000 7fe348ff0000 1 -- start start 2024-09-10T22:40:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.466+0000 7fe33e000640 1 --2- 172.21.15.103:0/2351542357 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe3200725e0 0x7fe320074aa0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe340151370 tx=0x7fe32c0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639152459d0 0x563915245db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639152462f0 0x5639151f98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639151f9e10 0x5639151fa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56391511a3f0 con 0x5639151f9e10 2024-09-10T22:40:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563915057b20 con 0x5639152459d0 2024-09-10T22:40:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563915046f50 con 0x5639152462f0 2024-09-10T22:40:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe33f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639151f9e10 0x5639151fa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe33e000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639152462f0 0x5639151f98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe33f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639151f9e10 0x5639151fa1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43134/0 (socket says 172.21.15.103:43134) 2024-09-10T22:40:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe33ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639152459d0 0x563915245db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe33f400640 1 -- 172.21.15.103:0/1376033309 learned_addr learned my addr 172.21.15.103:0/1376033309 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe33f400640 1 -- 172.21.15.103:0/1376033309 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639152462f0 msgr2=0x5639151f98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe33f400640 1 --2- 172.21.15.103:0/1376033309 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639152462f0 0x5639151f98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe33f400640 1 -- 172.21.15.103:0/1376033309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639152459d0 msgr2=0x563915245db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe33f400640 1 --2- 172.21.15.103:0/1376033309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639152459d0 0x563915245db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe33f400640 1 -- 172.21.15.103:0/1376033309 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391500e590 con 0x5639151f9e10 2024-09-10T22:40:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe33f400640 1 --2- 172.21.15.103:0/1376033309 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639151f9e10 0x5639151fa1f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe340074110 tx=0x7fe338004d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9602551a8e3b8e93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe32b400640 1 -- 172.21.15.103:0/1376033309 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338006780 con 0x5639151f9e10 2024-09-10T22:40:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe32b400640 1 -- 172.21.15.103:0/1376033309 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe338016070 con 0x5639151f9e10 2024-09-10T22:40:01.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe32b400640 1 -- 172.21.15.103:0/1376033309 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3380126a0 con 0x5639151f9e10 2024-09-10T22:40:01.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 -- 172.21.15.103:0/1376033309 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639151f9e10 msgr2=0x5639151fa1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:01.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 --2- 172.21.15.103:0/1376033309 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639151f9e10 0x5639151fa1f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe340074110 tx=0x7fe338004d60 comp rx=0 tx=0).stop 2024-09-10T22:40:01.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 -- 172.21.15.103:0/1376033309 shutdown_connections 2024-09-10T22:40:01.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 --2- 172.21.15.103:0/1376033309 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639151f9e10 0x5639151fa1f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 --2- 172.21.15.103:0/1376033309 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639152462f0 0x5639151f98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 --2- 172.21.15.103:0/1376033309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639152459d0 0x563915245db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 -- 172.21.15.103:0/1376033309 >> 172.21.15.103:0/1376033309 conn(0x5639150e3130 msgr2=0x563915228e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:01.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 -- 172.21.15.103:0/1376033309 shutdown_connections 2024-09-10T22:40:01.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 -- 172.21.15.103:0/1376033309 wait complete. 2024-09-10T22:40:01.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 -- start start 2024-09-10T22:40:01.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 Processor -- start 2024-09-10T22:40:01.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639151f9e10 0x5639152266a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639152459d0 0x563915226e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 0x5639152273b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563914fe15d0 con 0x5639152462f0 2024-09-10T22:40:01.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56391504ad60 con 0x5639152459d0 2024-09-10T22:40:01.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563914fed500 con 0x5639151f9e10 2024-09-10T22:40:01.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.470+0000 7fe348ff0000 10 client.0 _ll_register_callbacks cb 0x563914ff1810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:01.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe33f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 0x5639152273b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe33f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 0x5639152273b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43136/0 (socket says 172.21.15.103:43136) 2024-09-10T22:40:01.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe33e000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639152459d0 0x563915226e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe33f400640 1 -- 172.21.15.103:0/2763450832 learned_addr learned my addr 172.21.15.103:0/2763450832 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:01.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe33ea00640 1 --2- 172.21.15.103:0/2763450832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639151f9e10 0x5639152266a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe33f400640 1 -- 172.21.15.103:0/2763450832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639151f9e10 msgr2=0x5639152266a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:01.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe33f400640 1 --2- 172.21.15.103:0/2763450832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639151f9e10 0x5639152266a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe33f400640 1 -- 172.21.15.103:0/2763450832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639152459d0 msgr2=0x563915226e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:01.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe33f400640 1 --2- 172.21.15.103:0/2763450832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639152459d0 0x563915226e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe33f400640 1 -- 172.21.15.103:0/2763450832 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563914fe5170 con 0x5639152462f0 2024-09-10T22:40:01.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe33e000640 1 --2- 172.21.15.103:0/2763450832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639152459d0 0x563915226e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:40:01.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe33f400640 1 --2- 172.21.15.103:0/2763450832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 0x5639152273b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe3400692d0 tx=0x7fe3380067b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5da968a2c3bcf63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:01.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe31fe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:01.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe31fe00640 1 -- 172.21.15.103:0/2763450832 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33801b460 con 0x5639152462f0 2024-09-10T22:40:01.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe31fe00640 1 -- 172.21.15.103:0/2763450832 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fe338028c60 con 0x5639152462f0 2024-09-10T22:40:01.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 1 -- 172.21.15.103:0/2763450832 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563914fdf0f0 con 0x5639152462f0 2024-09-10T22:40:01.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe31fe00640 1 -- 172.21.15.103:0/2763450832 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe338028e60 con 0x5639152462f0 2024-09-10T22:40:01.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 10 client.5097 fetch_fsmap learned FSMap version 19 2024-09-10T22:40:01.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 1 -- 172.21.15.103:0/2763450832 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5639150cbef0 con 0x5639152462f0 2024-09-10T22:40:01.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe31fe00640 1 -- 172.21.15.103:0/2763450832 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563914fdf0f0 con 0x5639152462f0 2024-09-10T22:40:01.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe31fe00640 1 -- 172.21.15.103:0/2763450832 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 19) ==== 3502+0+0 (secure 0 0 0) 0x7fe33802f050 con 0x5639152462f0 2024-09-10T22:40:01.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 10 client.5097 fetch_fsmap finished waiting for FSMap version 19 2024-09-10T22:40:01.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 10 client.5097 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:40:01.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 20 client.5097 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:01.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 1 --2- 172.21.15.103:0/2763450832 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5639152280f0 0x563915257c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 4 client.5097 mds_command: new command op to 4941 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:40:01.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 1 -- 172.21.15.103:0/2763450832 --> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563915059a70 con 0x5639152280f0 2024-09-10T22:40:01.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe33ea00640 1 --2- 172.21.15.103:0/2763450832 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5639152280f0 0x563915257c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe33ea00640 1 --2- 172.21.15.103:0/2763450832 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5639152280f0 0x563915257c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e6c91defa07fa7 server_cookie=e7e06e325f47306f in_seq=0 out_seq=0 2024-09-10T22:40:01.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe31fe00640 10 client.5097 ms_handle_connect on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:01.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe31fe00640 1 -- 172.21.15.103:0/2763450832 <== mds.0 v2:172.21.15.103:6834/1194009116 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563915059a70 con 0x5639152280f0 2024-09-10T22:40:01.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe31fe00640 10 client.5097 handle_command_reply: tid=0 2024-09-10T22:40:01.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 1 client.5097 shutdown 2024-09-10T22:40:01.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 1 -- 172.21.15.103:0/2763450832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 msgr2=0x5639152273b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:01.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 1 --2- 172.21.15.103:0/2763450832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 0x5639152273b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe3400692d0 tx=0x7fe3380067b0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 1 -- 172.21.15.103:0/2763450832 shutdown_connections 2024-09-10T22:40:01.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 1 --2- 172.21.15.103:0/2763450832 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5639152280f0 0x563915257c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 1 --2- 172.21.15.103:0/2763450832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 0x5639152273b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 1 --2- 172.21.15.103:0/2763450832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639152459d0 0x563915226e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe31fe00640 0 client.5097 ms_handle_reset on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:01.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 1 --2- 172.21.15.103:0/2763450832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639151f9e10 0x5639152266a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 1 -- 172.21.15.103:0/2763450832 >> 172.21.15.103:0/2763450832 conn(0x5639150e3130 msgr2=0x5639151f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:01.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.474+0000 7fe348ff0000 1 -- 172.21.15.103:0/2763450832 shutdown_connections 2024-09-10T22:40:01.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.478+0000 7fe348ff0000 1 -- 172.21.15.103:0/2763450832 wait complete. 2024-09-10T22:40:01.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.478+0000 7fe348ff0000 20 client.5097 trim_cache size 0 max 16384 2024-09-10T22:40:01.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe348ff0000 1 Processor -- start 2024-09-10T22:40:01.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe348ff0000 1 -- start start 2024-09-10T22:40:01.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe348ff0000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639151f9e10 0x5639152b7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe348ff0000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639152459d0 0x5639152b8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe348ff0000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 0x5639152b8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe348ff0000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe340204ba0 con 0x5639152462f0 2024-09-10T22:40:01.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe348ff0000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe3401fb860 con 0x5639151f9e10 2024-09-10T22:40:01.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe348ff0000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe3401558d0 con 0x5639152459d0 2024-09-10T22:40:01.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe33f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 0x5639152b8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe33f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 0x5639152b8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43150/0 (socket says 172.21.15.103:43150) 2024-09-10T22:40:01.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe33f400640 1 -- 172.21.15.103:0/2708130106 learned_addr learned my addr 172.21.15.103:0/2708130106 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:01.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe33ea00640 1 --2- 172.21.15.103:0/2708130106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639151f9e10 0x5639152b7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe33e000640 1 --2- 172.21.15.103:0/2708130106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639152459d0 0x5639152b8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe33f400640 1 -- 172.21.15.103:0/2708130106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639152459d0 msgr2=0x5639152b8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:01.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe33f400640 1 --2- 172.21.15.103:0/2708130106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639152459d0 0x5639152b8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe33f400640 1 -- 172.21.15.103:0/2708130106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639151f9e10 msgr2=0x5639152b7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:01.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe33f400640 1 --2- 172.21.15.103:0/2708130106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639151f9e10 0x5639152b7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe33f400640 1 -- 172.21.15.103:0/2708130106 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639150a2d90 con 0x5639152462f0 2024-09-10T22:40:01.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.494+0000 7fe33e000640 1 --2- 172.21.15.103:0/2708130106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639152459d0 0x5639152b8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:40:01.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe33f400640 1 --2- 172.21.15.103:0/2708130106 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 0x5639152b8850 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe33801b6a0 tx=0x7fe33801b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b774ccc9ccff1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:01.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe32aa00640 1 -- 172.21.15.103:0/2708130106 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33801b7a0 con 0x5639152462f0 2024-09-10T22:40:01.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe32aa00640 1 -- 172.21.15.103:0/2708130106 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe338016050 con 0x5639152462f0 2024-09-10T22:40:01.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe32aa00640 1 -- 172.21.15.103:0/2708130106 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33801b9a0 con 0x5639152462f0 2024-09-10T22:40:01.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe348ff0000 1 -- 172.21.15.103:0/2708130106 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 msgr2=0x5639152b8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:01.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe348ff0000 1 --2- 172.21.15.103:0/2708130106 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 0x5639152b8850 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe33801b6a0 tx=0x7fe33801b6d0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe348ff0000 1 -- 172.21.15.103:0/2708130106 shutdown_connections 2024-09-10T22:40:01.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe348ff0000 1 --2- 172.21.15.103:0/2708130106 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 0x5639152b8850 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe348ff0000 1 --2- 172.21.15.103:0/2708130106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639152459d0 0x5639152b8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe348ff0000 1 --2- 172.21.15.103:0/2708130106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639151f9e10 0x5639152b7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe348ff0000 1 -- 172.21.15.103:0/2708130106 >> 172.21.15.103:0/2708130106 conn(0x5639150e3130 msgr2=0x563915201a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:01.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe348ff0000 1 -- 172.21.15.103:0/2708130106 shutdown_connections 2024-09-10T22:40:01.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe348ff0000 1 -- 172.21.15.103:0/2708130106 wait complete. 2024-09-10T22:40:01.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe348ff0000 1 -- start start 2024-09-10T22:40:01.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe348ff0000 1 Processor -- start 2024-09-10T22:40:01.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe348ff0000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639151f9e10 0x5639152bbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe348ff0000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639152459d0 0x5639152bc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe348ff0000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 0x5639152bc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe348ff0000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56391525cce0 con 0x5639152462f0 2024-09-10T22:40:01.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe348ff0000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5639150568f0 con 0x5639151f9e10 2024-09-10T22:40:01.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe348ff0000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5639150cba60 con 0x5639152459d0 2024-09-10T22:40:01.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe348ff0000 10 client.0 _ll_register_callbacks cb 0x7fe338004f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:01.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe33f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 0x5639152bc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe33e000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639152459d0 0x5639152bc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe33f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 0x5639152bc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43166/0 (socket says 172.21.15.103:43166) 2024-09-10T22:40:01.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe33f400640 1 -- 172.21.15.103:0/3772200098 learned_addr learned my addr 172.21.15.103:0/3772200098 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:01.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe33ea00640 1 --2- 172.21.15.103:0/3772200098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639151f9e10 0x5639152bbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe33f400640 1 -- 172.21.15.103:0/3772200098 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639152459d0 msgr2=0x5639152bc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:01.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe33f400640 1 --2- 172.21.15.103:0/3772200098 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639152459d0 0x5639152bc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe33f400640 1 -- 172.21.15.103:0/3772200098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639151f9e10 msgr2=0x5639152bbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:01.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe33f400640 1 --2- 172.21.15.103:0/3772200098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639151f9e10 0x5639152bbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe33f400640 1 -- 172.21.15.103:0/3772200098 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56391500da90 con 0x5639152462f0 2024-09-10T22:40:01.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe33f400640 1 --2- 172.21.15.103:0/3772200098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 0x5639152bc680 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe338006ce0 tx=0x7fe33801ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b461ab80216120 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:01.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.498+0000 7fe31fe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:01.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe31fe00640 1 -- 172.21.15.103:0/3772200098 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338031680 con 0x5639152462f0 2024-09-10T22:40:01.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe31fe00640 1 -- 172.21.15.103:0/3772200098 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fe338023070 con 0x5639152462f0 2024-09-10T22:40:01.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 1 -- 172.21.15.103:0/3772200098 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe338016050 con 0x5639152462f0 2024-09-10T22:40:01.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe31fe00640 1 -- 172.21.15.103:0/3772200098 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe338041050 con 0x5639152462f0 2024-09-10T22:40:01.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 10 client.5103 fetch_fsmap learned FSMap version 19 2024-09-10T22:40:01.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 1 -- 172.21.15.103:0/3772200098 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x563914fec050 con 0x5639152462f0 2024-09-10T22:40:01.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe31fe00640 1 -- 172.21.15.103:0/3772200098 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe338016050 con 0x5639152462f0 2024-09-10T22:40:01.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe31fe00640 1 -- 172.21.15.103:0/3772200098 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 19) ==== 3502+0+0 (secure 0 0 0) 0x7fe338044020 con 0x5639152462f0 2024-09-10T22:40:01.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 10 client.5103 fetch_fsmap finished waiting for FSMap version 19 2024-09-10T22:40:01.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 10 client.5103 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:40:01.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 20 client.5103 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:01.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 1 --2- 172.21.15.103:0/3772200098 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x563915259c10 0x563915259ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 4 client.5103 mds_command: new command op to 4941 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:40:01.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 1 -- 172.21.15.103:0/3772200098 --> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] -- command(tid 0: {"prefix": "status"}) -- 0x563915055520 con 0x563915259c10 2024-09-10T22:40:01.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe33ea00640 1 --2- 172.21.15.103:0/3772200098 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x563915259c10 0x563915259ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe33ea00640 1 --2- 172.21.15.103:0/3772200098 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x563915259c10 0x563915259ff0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cae74f2f04655134 server_cookie=a02c45adf4769e23 in_seq=0 out_seq=0 2024-09-10T22:40:01.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe31fe00640 10 client.5103 ms_handle_connect on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:01.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe31fe00640 1 -- 172.21.15.103:0/3772200098 <== mds.0 v2:172.21.15.103:6834/1194009116 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x563915055520 con 0x563915259c10 2024-09-10T22:40:01.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe31fe00640 10 client.5103 handle_command_reply: tid=0 2024-09-10T22:40:01.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 1 client.5103 shutdown 2024-09-10T22:40:01.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 1 -- 172.21.15.103:0/3772200098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 msgr2=0x5639152bc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:01.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 1 --2- 172.21.15.103:0/3772200098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 0x5639152bc680 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe338006ce0 tx=0x7fe33801ce30 comp rx=0 tx=0).stop 2024-09-10T22:40:01.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 1 -- 172.21.15.103:0/3772200098 shutdown_connections 2024-09-10T22:40:01.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 1 --2- 172.21.15.103:0/3772200098 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x563915259c10 0x563915259ff0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 1 --2- 172.21.15.103:0/3772200098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639152462f0 0x5639152bc680 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 1 --2- 172.21.15.103:0/3772200098 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639152459d0 0x5639152bc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe31fe00640 0 client.5103 ms_handle_reset on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:01.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 1 --2- 172.21.15.103:0/3772200098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639151f9e10 0x5639152bbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 1 -- 172.21.15.103:0/3772200098 >> 172.21.15.103:0/3772200098 conn(0x5639150e3130 msgr2=0x563915201a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:01.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 1 -- 172.21.15.103:0/3772200098 shutdown_connections 2024-09-10T22:40:01.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 1 -- 172.21.15.103:0/3772200098 wait complete. 2024-09-10T22:40:01.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe348ff0000 20 client.5103 trim_cache size 0 max 16384 2024-09-10T22:40:01.511 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:40:01.511 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:40:01.512 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-10T22:40:01.512 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4941, 2024-09-10T22:40:01.512 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:40:01.512 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:40:01.512 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:40:01.512 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 5.9303587860000002, 2024-09-10T22:40:01.512 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 19, 2024-09-10T22:40:01.512 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 41, 2024-09-10T22:40:01.512 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 41, 2024-09-10T22:40:01.512 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 13.06855565 2024-09-10T22:40:01.512 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:40:01.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe33fe00640 1 -- 172.21.15.103:0/2351542357 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe3200725e0 msgr2=0x7fe320074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:01.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe33fe00640 1 --2- 172.21.15.103:0/2351542357 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe3200725e0 0x7fe320074aa0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe340151370 tx=0x7fe32c0091e0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe33fe00640 1 -- 172.21.15.103:0/2351542357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe324003ad0 msgr2=0x7fe3401f8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:01.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe33fe00640 1 --2- 172.21.15.103:0/2351542357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe324003ad0 0x7fe3401f8270 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe3300af040 tx=0x7fe330005600 comp rx=0 tx=0).stop 2024-09-10T22:40:01.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe33fe00640 1 -- 172.21.15.103:0/2351542357 shutdown_connections 2024-09-10T22:40:01.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe33fe00640 1 --2- 172.21.15.103:0/2351542357 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe3200725e0 0x7fe320074aa0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe33fe00640 1 --2- 172.21.15.103:0/2351542357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3400c9af0 0x7fe340150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe33fe00640 1 --2- 172.21.15.103:0/2351542357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe340146b70 0x7fe340146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe33fe00640 1 --2- 172.21.15.103:0/2351542357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe324003ad0 0x7fe3401f8270 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe33fe00640 1 -- 172.21.15.103:0/2351542357 >> 172.21.15.103:0/2351542357 conn(0x7fe3400cc950 msgr2=0x7fe3400735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:01.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe33fe00640 1 -- 172.21.15.103:0/2351542357 shutdown_connections 2024-09-10T22:40:01.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.502+0000 7fe33fe00640 1 -- 172.21.15.103:0/2351542357 wait complete. 2024-09-10T22:40:01.526 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T22:40:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef68400640 1 -- 172.21.15.103:0/1984316766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef48004810 msgr2=0x7fef48004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef68400640 1 --2- 172.21.15.103:0/1984316766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef48004810 0x7fef48004c90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009b60 tx=0x7fef4c01d270 comp rx=0 tx=0).stop 2024-09-10T22:40:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef68400640 1 -- 172.21.15.103:0/1984316766 shutdown_connections 2024-09-10T22:40:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef68400640 1 --2- 172.21.15.103:0/1984316766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef48004810 0x7fef48004c90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef68400640 1 -- 172.21.15.103:0/1984316766 >> 172.21.15.103:0/1984316766 conn(0x7fef6006cc00 msgr2=0x7fef6006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef68400640 1 -- 172.21.15.103:0/1984316766 shutdown_connections 2024-09-10T22:40:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef68400640 1 -- 172.21.15.103:0/1984316766 wait complete. 2024-09-10T22:40:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef68400640 1 Processor -- start 2024-09-10T22:40:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef68400640 1 -- start start 2024-09-10T22:40:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef68400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef48004810 0x7fef600b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef68400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef600b1bf0 0x7fef60154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef68400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef601574a0 0x7fef60157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef68400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fef600d00c0 con 0x7fef48004810 2024-09-10T22:40:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef68400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fef600cff40 con 0x7fef600b1bf0 2024-09-10T22:40:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef68400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fef6015c970 con 0x7fef601574a0 2024-09-10T22:40:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef65a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef48004810 0x7fef600b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef65a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef48004810 0x7fef600b03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43178/0 (socket says 172.21.15.103:43178) 2024-09-10T22:40:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef65a00640 1 -- 172.21.15.103:0/3767509095 learned_addr learned my addr 172.21.15.103:0/3767509095 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef65000640 1 --2- 172.21.15.103:0/3767509095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef600b1bf0 0x7fef60154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef66400640 1 --2- 172.21.15.103:0/3767509095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef601574a0 0x7fef60157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef65a00640 1 -- 172.21.15.103:0/3767509095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef601574a0 msgr2=0x7fef60157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef65a00640 1 --2- 172.21.15.103:0/3767509095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef601574a0 0x7fef60157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef65a00640 1 -- 172.21.15.103:0/3767509095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef600b1bf0 msgr2=0x7fef60154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef65a00640 1 --2- 172.21.15.103:0/3767509095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef600b1bf0 0x7fef60154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef65a00640 1 -- 172.21.15.103:0/3767509095 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef600cb6f0 con 0x7fef48004810 2024-09-10T22:40:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.666+0000 7fef66400640 1 --2- 172.21.15.103:0/3767509095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef601574a0 0x7fef60157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:40:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.670+0000 7fef65a00640 1 --2- 172.21.15.103:0/3767509095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef48004810 0x7fef600b03c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fef5400afa0 tx=0x7fef5400e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.670+0000 7fef5d600640 1 -- 172.21.15.103:0/3767509095 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54016070 con 0x7fef48004810 2024-09-10T22:40:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.670+0000 7fef5d600640 1 -- 172.21.15.103:0/3767509095 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef54003600 con 0x7fef48004810 2024-09-10T22:40:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.670+0000 7fef68400640 1 -- 172.21.15.103:0/3767509095 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef600b0a50 con 0x7fef48004810 2024-09-10T22:40:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.670+0000 7fef5d600640 1 -- 172.21.15.103:0/3767509095 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54003a30 con 0x7fef48004810 2024-09-10T22:40:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.670+0000 7fef68400640 1 -- 172.21.15.103:0/3767509095 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef600b1010 con 0x7fef48004810 2024-09-10T22:40:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.670+0000 7fef68400640 1 -- 172.21.15.103:0/3767509095 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef60072e30 con 0x7fef48004810 2024-09-10T22:40:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.670+0000 7fef5d600640 1 -- 172.21.15.103:0/3767509095 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fef54003bd0 con 0x7fef48004810 2024-09-10T22:40:01.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.670+0000 7fef5d600640 1 --2- 172.21.15.103:0/3767509095 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fef400725e0 0x7fef40074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:01.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.674+0000 7fef5d600640 1 -- 172.21.15.103:0/3767509095 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fef540974e0 con 0x7fef48004810 2024-09-10T22:40:01.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.674+0000 7fef65000640 1 --2- 172.21.15.103:0/3767509095 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fef400725e0 0x7fef40074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:01.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.674+0000 7fef65000640 1 --2- 172.21.15.103:0/3767509095 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fef400725e0 0x7fef40074aa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0ae000 tx=0x7fef4c01a010 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:01.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.678+0000 7fef5d600640 1 -- 172.21.15.103:0/3767509095 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fef54062a20 con 0x7fef48004810 2024-09-10T22:40:01.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.874+0000 7fef68400640 1 -- 172.21.15.103:0/3767509095 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fef6006d110 con 0x7fef48004810 2024-09-10T22:40:01.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.878+0000 7fef5d600640 1 -- 172.21.15.103:0/3767509095 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) ==== 53+0+73 (secure 0 0 0) 0x7fef54062320 con 0x7fef48004810 2024-09-10T22:40:01.880 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T22:40:01.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.878+0000 7fef68400640 1 -- 172.21.15.103:0/3767509095 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fef400725e0 msgr2=0x7fef40074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:01.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.878+0000 7fef68400640 1 --2- 172.21.15.103:0/3767509095 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fef400725e0 0x7fef40074aa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0ae000 tx=0x7fef4c01a010 comp rx=0 tx=0).stop 2024-09-10T22:40:01.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.878+0000 7fef68400640 1 -- 172.21.15.103:0/3767509095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef48004810 msgr2=0x7fef600b03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:01.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.878+0000 7fef68400640 1 --2- 172.21.15.103:0/3767509095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef48004810 0x7fef600b03c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fef5400afa0 tx=0x7fef5400e770 comp rx=0 tx=0).stop 2024-09-10T22:40:01.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.878+0000 7fef68400640 1 -- 172.21.15.103:0/3767509095 shutdown_connections 2024-09-10T22:40:01.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.878+0000 7fef68400640 1 --2- 172.21.15.103:0/3767509095 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fef400725e0 0x7fef40074aa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.878+0000 7fef68400640 1 --2- 172.21.15.103:0/3767509095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef601574a0 0x7fef60157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.878+0000 7fef68400640 1 --2- 172.21.15.103:0/3767509095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef600b1bf0 0x7fef60154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.878+0000 7fef68400640 1 --2- 172.21.15.103:0/3767509095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef48004810 0x7fef600b03c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:01.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.878+0000 7fef68400640 1 -- 172.21.15.103:0/3767509095 >> 172.21.15.103:0/3767509095 conn(0x7fef6006cc00 msgr2=0x7fef600cdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:01.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.878+0000 7fef68400640 1 -- 172.21.15.103:0/3767509095 shutdown_connections 2024-09-10T22:40:01.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:01.878+0000 7fef68400640 1 -- 172.21.15.103:0/3767509095 wait complete. 2024-09-10T22:40:01.902 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T22:40:01.902 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T22:40:01.902 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-10T22:40:01.902 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T22:40:01.902 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T22:40:01.902 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T22:40:01.902 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T22:40:01.902 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T22:40:01.902 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:40:01.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:01.903 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-10T22:40:01.912 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T22:40:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T22:40:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T22:40:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:40:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-10T22:40:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:40:01.913 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:40:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:40:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-10T22:40:01.913 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:40:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:40:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-10T22:40:01.913 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:40:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-10T22:40:01.914 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T22:40:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-10T22:40:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-10T22:40:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42380sec preferred_lft 42380sec 2024-09-10T22:40:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2024-09-10T22:40:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:40:01.914 INFO:teuthology.orchestra.run.smithi103.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T22:40:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 02:42:c3:dd:ba:ba brd ff:ff:ff:ff:ff:ff 2024-09-10T22:40:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T22:40:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:40:01.914 INFO:teuthology.orchestra.run.smithi103.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T22:40:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T22:40:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T22:40:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:40:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T22:40:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:40:01.915 INFO:teuthology.orchestra.run.smithi103.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T22:40:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:40:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T22:40:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:40:01.915 INFO:teuthology.orchestra.run.smithi103.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T22:40:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:40:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T22:40:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:40:01.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:01.916 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T22:40:01.973 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-10T22:40:01.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:01.975 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-10T22:40:02.027 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-10T22:40:02.027 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T22:40:02.027 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-10T22:40:02.027 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T22:40:02.028 INFO:teuthology.orchestra.run.smithi103.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-10T22:40:02.028 INFO:teuthology.orchestra.run.smithi103.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T22:40:02.028 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T22:40:02.028 INFO:teuthology.orchestra.run.smithi103.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:40:02.028 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:40:02.028 INFO:teuthology.orchestra.run.smithi103.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:40:02.028 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T22:40:02.028 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:40:02.028 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:40:02.029 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T22:40:02.029 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T22:40:02.029 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T22:40:02.029 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:40:02.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:40:02.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:40:02.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:02.165 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-10T22:40:02.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T22:40:02.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T22:40:02.174 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:40:02.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:02.175 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-10T22:40:02.235 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T22:40:02.235 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:40:02.235 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T22:40:02.284 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:40:02.284 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:40:02.284 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T22:40:02.337 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:40:02.400 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:40:02.457 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:40:02.457 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:40:02.457 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:40:02.457 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:40:02.458 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:40:02.458 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:40:02.458 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:40:02.458 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:40:02.458 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:40:02.458 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:40:02.458 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:40:02.458 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:40:02.458 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:40:02.458 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:40:02.458 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:40:02.458 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:40:02.458 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:40:02.458 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:40:02.459 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:40:02.459 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:40:02.459 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:40:02.459 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:40:02.459 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:40:02.459 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:40:02.459 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:40:02.459 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:40:02.459 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:40:02.459 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:40:02.459 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:40:02.459 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:40:02.459 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:40:02.459 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:40:02.459 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:40:02.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:02.460 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:40:02.512 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T22:40:02.512 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T22:40:02.555 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:40:02.575 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:40:02.630 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:40:02.630 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:40:02.630 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:40:02.630 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:40:02.630 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:40:02.630 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:40:02.630 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:40:02.630 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:40:02.631 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:40:02.631 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:40:02.631 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:40:02.631 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:40:02.631 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:40:02.631 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:40:02.631 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:40:02.631 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:40:02.631 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:40:02.631 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:40:02.631 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:40:02.631 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:40:02.631 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:40:02.631 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:40:02.632 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:40:02.632 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:40:02.632 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:40:02.632 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:40:02.632 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:40:02.632 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:40:02.632 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:40:02.632 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:40:02.632 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:40:02.632 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:40:02.632 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:40:02.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:02.633 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:40:02.653 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2024-09-10T22:40:02.650+0000 7f4db41f8580 -1 init, newargv = 0x5585619a2ae0 newargc=15 2024-09-10T22:40:02.653 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[37962]: starting ceph client 2024-09-10T22:40:02.660 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[37962]: starting fuse 2024-09-10T22:40:02.663 INFO:teuthology.orchestra.run.smithi103.stdout:44 2024-09-10T22:40:02.663 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T22:40:02.663 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-09-10T22:40:02.663 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-09-10T22:40:02.663 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-09-10T22:40:02.663 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:40:02.663 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-09-10T22:40:02.664 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:40:02.664 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-09-10T22:40:02.664 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T22:40:02.664 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-09-10T22:40:02.664 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T22:40:02.664 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:40:02.664 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-09-10T22:40:02.664 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-09-10T22:40:02.664 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-09-10T22:40:02.664 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-09-10T22:40:02.664 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:40:02.664 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-09-10T22:40:02.664 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T22:40:02.664 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T22:40:02.665 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T22:40:02.665 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-09-10T22:40:02.665 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-09-10T22:40:02.665 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-09-10T22:40:02.665 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T22:40:02.665 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:40:02.665 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.0")) 2024-09-10T22:40:02.665 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:40:02.788 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.37962.asok 2024-09-10T22:40:02.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:40:02.799 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37962.asok 2024-09-10T22:40:02.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:02.799 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37962.asok status 2024-09-10T22:40:02.971 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:40:02.971 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-09-10T22:40:02.971 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T22:40:02.971 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:40:02.971 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2024-09-10T22:40:02.971 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-09-10T22:40:02.971 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T22:40:02.971 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "37962", 2024-09-10T22:40:02.972 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-09-10T22:40:02.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:40:02.972 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-09-10T22:40:02.972 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-09-10T22:40:02.972 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5115, 2024-09-10T22:40:02.972 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-09-10T22:40:02.972 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-09-10T22:40:02.972 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-09-10T22:40:02.972 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5115 2024-09-10T22:40:02.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:40:02.972 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T22:40:02.972 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T22:40:02.972 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-10T22:40:02.972 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 735120355 2024-09-10T22:40:02.973 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:40:02.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:40:02.973 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T22:40:02.973 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T22:40:02.973 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-10T22:40:02.973 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 735120355 2024-09-10T22:40:02.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:40:02.973 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.5115 192.168.0.1:0/735120355", 2024-09-10T22:40:02.973 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/735120355", 2024-09-10T22:40:02.973 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-09-10T22:40:02.973 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 19, 2024-09-10T22:40:02.973 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 41, 2024-09-10T22:40:02.973 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-09-10T22:40:02.973 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-09-10T22:40:02.974 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-09-10T22:40:02.974 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:40:02.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:02.986 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-09-10T22:40:02.986 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T22:40:02.995 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-09-10T22:40:02.996 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T22:40:02.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:02.996 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T22:40:03.055 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-10T22:40:03.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae89400640 1 -- 172.21.15.103:0/3502387382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae68005240 msgr2=0x7fae6800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:03.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae89400640 1 --2- 172.21.15.103:0/3502387382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae68005240 0x7fae6800b9d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00c640 tx=0x7fae7c01f960 comp rx=0 tx=0).stop 2024-09-10T22:40:03.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae89400640 1 -- 172.21.15.103:0/3502387382 shutdown_connections 2024-09-10T22:40:03.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae89400640 1 --2- 172.21.15.103:0/3502387382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae68005240 0x7fae6800b9d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:03.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae89400640 1 -- 172.21.15.103:0/3502387382 >> 172.21.15.103:0/3502387382 conn(0x7fae8406cc00 msgr2=0x7fae8406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:03.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae89400640 1 -- 172.21.15.103:0/3502387382 shutdown_connections 2024-09-10T22:40:03.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae89400640 1 -- 172.21.15.103:0/3502387382 wait complete. 2024-09-10T22:40:03.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae89400640 1 Processor -- start 2024-09-10T22:40:03.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae89400640 1 -- start start 2024-09-10T22:40:03.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae89400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae68005240 0x7fae84141780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:03.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae89400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae84150090 0x7fae84150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:03.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae89400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae8413ec60 0x7fae84155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:03.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae89400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae8406ed00 con 0x7fae68005240 2024-09-10T22:40:03.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae89400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fae8406eb80 con 0x7fae84150090 2024-09-10T22:40:03.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae89400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fae8406ee80 con 0x7fae8413ec60 2024-09-10T22:40:03.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae82800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae68005240 0x7fae84141780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:03.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae82800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae68005240 0x7fae84141780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43206/0 (socket says 172.21.15.103:43206) 2024-09-10T22:40:03.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae82800640 1 -- 172.21.15.103:0/2015825001 learned_addr learned my addr 172.21.15.103:0/2015825001 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:03.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae79e00640 1 --2- 172.21.15.103:0/2015825001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae84150090 0x7fae84150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:03.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.238+0000 7fae83200640 1 --2- 172.21.15.103:0/2015825001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae8413ec60 0x7fae84155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:03.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.242+0000 7fae82800640 1 -- 172.21.15.103:0/2015825001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae8413ec60 msgr2=0x7fae84155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:03.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.242+0000 7fae82800640 1 --2- 172.21.15.103:0/2015825001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae8413ec60 0x7fae84155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:03.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.242+0000 7fae82800640 1 -- 172.21.15.103:0/2015825001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae84150090 msgr2=0x7fae84150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:03.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.242+0000 7fae82800640 1 --2- 172.21.15.103:0/2015825001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae84150090 0x7fae84150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:03.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.242+0000 7fae82800640 1 -- 172.21.15.103:0/2015825001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae84141cc0 con 0x7fae68005240 2024-09-10T22:40:03.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.242+0000 7fae83200640 1 --2- 172.21.15.103:0/2015825001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae8413ec60 0x7fae84155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:40:03.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.242+0000 7fae82800640 1 --2- 172.21.15.103:0/2015825001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae68005240 0x7fae84141780 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fae74011ab0 tx=0x7fae74011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:03.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.242+0000 7fae7b400640 1 -- 172.21.15.103:0/2015825001 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7400fe70 con 0x7fae68005240 2024-09-10T22:40:03.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.242+0000 7fae7b400640 1 -- 172.21.15.103:0/2015825001 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae74016070 con 0x7fae68005240 2024-09-10T22:40:03.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.242+0000 7fae7b400640 1 -- 172.21.15.103:0/2015825001 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74012760 con 0x7fae68005240 2024-09-10T22:40:03.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.242+0000 7fae89400640 1 -- 172.21.15.103:0/2015825001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae84151330 con 0x7fae68005240 2024-09-10T22:40:03.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.242+0000 7fae89400640 1 -- 172.21.15.103:0/2015825001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae841518f0 con 0x7fae68005240 2024-09-10T22:40:03.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.242+0000 7fae89400640 1 -- 172.21.15.103:0/2015825001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae84073990 con 0x7fae68005240 2024-09-10T22:40:03.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.242+0000 7fae7b400640 1 -- 172.21.15.103:0/2015825001 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fae74012900 con 0x7fae68005240 2024-09-10T22:40:03.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.242+0000 7fae7b400640 1 --2- 172.21.15.103:0/2015825001 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fae600725e0 0x7fae60074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:03.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.242+0000 7fae7b400640 1 -- 172.21.15.103:0/2015825001 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fae740940a0 con 0x7fae68005240 2024-09-10T22:40:03.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.246+0000 7fae79e00640 1 --2- 172.21.15.103:0/2015825001 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fae600725e0 0x7fae60074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:03.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.246+0000 7fae79e00640 1 --2- 172.21.15.103:0/2015825001 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fae600725e0 0x7fae60074aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fae840cb530 tx=0x7fae6c006b20 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:03.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.246+0000 7fae7b400640 1 -- 172.21.15.103:0/2015825001 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fae7405ef00 con 0x7fae68005240 2024-09-10T22:40:03.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.446+0000 7fae89400640 1 -- 172.21.15.103:0/2015825001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fae8406d490 con 0x7fae68005240 2024-09-10T22:40:03.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.634+0000 7fae7b400640 1 -- 172.21.15.103:0/2015825001 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v20) ==== 105+0+0 (secure 0 0 0) 0x7fae74063930 con 0x7fae68005240 2024-09-10T22:40:03.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.634+0000 7fae89400640 1 -- 172.21.15.103:0/2015825001 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fae600725e0 msgr2=0x7fae60074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:03.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.634+0000 7fae89400640 1 --2- 172.21.15.103:0/2015825001 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fae600725e0 0x7fae60074aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fae840cb530 tx=0x7fae6c006b20 comp rx=0 tx=0).stop 2024-09-10T22:40:03.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.634+0000 7fae89400640 1 -- 172.21.15.103:0/2015825001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae68005240 msgr2=0x7fae84141780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:03.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.634+0000 7fae89400640 1 --2- 172.21.15.103:0/2015825001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae68005240 0x7fae84141780 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fae74011ab0 tx=0x7fae74011f70 comp rx=0 tx=0).stop 2024-09-10T22:40:03.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.634+0000 7fae89400640 1 -- 172.21.15.103:0/2015825001 shutdown_connections 2024-09-10T22:40:03.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.634+0000 7fae89400640 1 --2- 172.21.15.103:0/2015825001 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fae600725e0 0x7fae60074aa0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:03.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.634+0000 7fae89400640 1 --2- 172.21.15.103:0/2015825001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae8413ec60 0x7fae84155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:03.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.634+0000 7fae89400640 1 --2- 172.21.15.103:0/2015825001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae84150090 0x7fae84150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:03.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.634+0000 7fae89400640 1 --2- 172.21.15.103:0/2015825001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae68005240 0x7fae84141780 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:03.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.634+0000 7fae89400640 1 -- 172.21.15.103:0/2015825001 >> 172.21.15.103:0/2015825001 conn(0x7fae8406cc00 msgr2=0x7fae840ce420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:03.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.634+0000 7fae89400640 1 -- 172.21.15.103:0/2015825001 shutdown_connections 2024-09-10T22:40:03.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.634+0000 7fae89400640 1 -- 172.21.15.103:0/2015825001 wait complete. 2024-09-10T22:40:03.670 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:40:03.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.806+0000 7f078a200640 1 -- 172.21.15.103:0/3381190410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07840cf3b0 msgr2=0x7f078406df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:03.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.806+0000 7f078a200640 1 --2- 172.21.15.103:0/3381190410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07840cf3b0 0x7f078406df40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f078415e3c0 tx=0x7f077401c8a0 comp rx=0 tx=0).stop 2024-09-10T22:40:03.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.806+0000 7f078a200640 1 -- 172.21.15.103:0/3381190410 shutdown_connections 2024-09-10T22:40:03.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.806+0000 7f078a200640 1 --2- 172.21.15.103:0/3381190410 >> v2:172.21.15.131:3300/0 conn(0x7f07840c61b0 0x7f07840c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:03.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.806+0000 7f078a200640 1 --2- 172.21.15.103:0/3381190410 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f078415d9f0 0x7f07840ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:03.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.806+0000 7f078a200640 1 --2- 172.21.15.103:0/3381190410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07840cf3b0 0x7f078406df40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:03.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.806+0000 7f078a200640 1 -- 172.21.15.103:0/3381190410 >> 172.21.15.103:0/3381190410 conn(0x7f07840cff60 msgr2=0x7f07840d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:03.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.806+0000 7f078a200640 1 -- 172.21.15.103:0/3381190410 shutdown_connections 2024-09-10T22:40:03.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.806+0000 7f078a200640 1 -- 172.21.15.103:0/3381190410 wait complete. 2024-09-10T22:40:03.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f078a200640 1 Processor -- start 2024-09-10T22:40:03.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f078a200640 1 -- start start 2024-09-10T22:40:03.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f078a200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07840c61b0 0x7f078409d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:03.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f078a200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07840cf3b0 0x7f0784073510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:03.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f078a200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f078415d9f0 0x7f07840c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:03.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f078a200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f078406d490 con 0x7f078415d9f0 2024-09-10T22:40:03.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f078a200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f078406d310 con 0x7f07840cf3b0 2024-09-10T22:40:03.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f078a200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f078406d610 con 0x7f07840c61b0 2024-09-10T22:40:03.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f0789800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f078415d9f0 0x7f07840c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:03.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f0789800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f078415d9f0 0x7f07840c97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43224/0 (socket says 172.21.15.103:43224) 2024-09-10T22:40:03.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f0789800640 1 -- 172.21.15.103:0/3521005298 learned_addr learned my addr 172.21.15.103:0/3521005298 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:03.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f077be00640 1 --2- 172.21.15.103:0/3521005298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07840cf3b0 0x7f0784073510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:03.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f0788e00640 1 --2- 172.21.15.103:0/3521005298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07840c61b0 0x7f078409d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:03.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f0789800640 1 -- 172.21.15.103:0/3521005298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07840c61b0 msgr2=0x7f078409d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:03.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f0789800640 1 --2- 172.21.15.103:0/3521005298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07840c61b0 0x7f078409d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:03.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f0789800640 1 -- 172.21.15.103:0/3521005298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07840cf3b0 msgr2=0x7f0784073510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:03.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f0789800640 1 --2- 172.21.15.103:0/3521005298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07840cf3b0 0x7f0784073510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:03.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f0789800640 1 -- 172.21.15.103:0/3521005298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0784073c80 con 0x7f078415d9f0 2024-09-10T22:40:03.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f0789800640 1 --2- 172.21.15.103:0/3521005298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f078415d9f0 0x7f07840c97c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f077c00e9c0 tx=0x7f077c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:03.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f0781600640 1 -- 172.21.15.103:0/3521005298 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077c004d30 con 0x7f078415d9f0 2024-09-10T22:40:03.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f0781600640 1 -- 172.21.15.103:0/3521005298 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f077c00cb20 con 0x7f078415d9f0 2024-09-10T22:40:03.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f078a200640 1 -- 172.21.15.103:0/3521005298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0784073f60 con 0x7f078415d9f0 2024-09-10T22:40:03.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f0781600640 1 -- 172.21.15.103:0/3521005298 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077c005020 con 0x7f078415d9f0 2024-09-10T22:40:03.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.810+0000 7f078a200640 1 -- 172.21.15.103:0/3521005298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f078409ab90 con 0x7f078415d9f0 2024-09-10T22:40:03.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.814+0000 7f078a200640 1 -- 172.21.15.103:0/3521005298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f078406df40 con 0x7f078415d9f0 2024-09-10T22:40:03.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.814+0000 7f0781600640 1 -- 172.21.15.103:0/3521005298 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f077c00f040 con 0x7f078415d9f0 2024-09-10T22:40:03.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.814+0000 7f0781600640 1 --2- 172.21.15.103:0/3521005298 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07600725e0 0x7f0760074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:03.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.814+0000 7f0781600640 1 -- 172.21.15.103:0/3521005298 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f077c093940 con 0x7f078415d9f0 2024-09-10T22:40:03.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.814+0000 7f0788e00640 1 --2- 172.21.15.103:0/3521005298 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07600725e0 0x7f0760074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:03.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.818+0000 7f0788e00640 1 --2- 172.21.15.103:0/3521005298 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07600725e0 0x7f0760074aa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f07740af000 tx=0x7f077401b0e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:03.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:03.818+0000 7f0781600640 1 -- 172.21.15.103:0/3521005298 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f077c016030 con 0x7f078415d9f0 2024-09-10T22:40:04.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:04.018+0000 7f078a200640 1 -- 172.21.15.103:0/3521005298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f078409ad60 con 0x7f078415d9f0 2024-09-10T22:40:04.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:04.018+0000 7f0781600640 1 -- 172.21.15.103:0/3521005298 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5251 (secure 0 0 0) 0x7f077c05e820 con 0x7f078415d9f0 2024-09-10T22:40:04.022 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:40:04.023 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":21,"btime":"2024-09-10T22:40:03:639888+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/3313045987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3313045987},{"type":"v1","addr":"172.21.15.131:6836","nonce":3313045987}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":4754,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/1068577002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1068577002},{"type":"v1","addr":"172.21.15.131:6837","nonce":1068577002}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:39:54.979240+0000","modified":"2024-09-10T22:40:03.639876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4941,"mds_1":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":1,"incarnation":21,"state":"up:creating","state_seq":1,"addr":"172.21.15.103:6833/4043692269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4043692269},{"type":"v1","addr":"172.21.15.103:6833","nonce":4043692269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4941":{"gid":4941,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/1194009116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1194009116},{"type":"v1","addr":"172.21.15.103:6835","nonce":1194009116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4941,"qdb_cluster":[4941]},"id":2}]} 2024-09-10T22:40:04.023 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 21 2024-09-10T22:40:04.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:04.018+0000 7f078a200640 1 -- 172.21.15.103:0/3521005298 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07600725e0 msgr2=0x7f0760074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:04.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:04.018+0000 7f078a200640 1 --2- 172.21.15.103:0/3521005298 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07600725e0 0x7f0760074aa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f07740af000 tx=0x7f077401b0e0 comp rx=0 tx=0).stop 2024-09-10T22:40:04.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:04.018+0000 7f078a200640 1 -- 172.21.15.103:0/3521005298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f078415d9f0 msgr2=0x7f07840c97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:04.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:04.018+0000 7f078a200640 1 --2- 172.21.15.103:0/3521005298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f078415d9f0 0x7f07840c97c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f077c00e9c0 tx=0x7f077c00ee80 comp rx=0 tx=0).stop 2024-09-10T22:40:04.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:04.018+0000 7f078a200640 1 -- 172.21.15.103:0/3521005298 shutdown_connections 2024-09-10T22:40:04.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:04.018+0000 7f078a200640 1 --2- 172.21.15.103:0/3521005298 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07600725e0 0x7f0760074aa0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:04.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:04.018+0000 7f078a200640 1 --2- 172.21.15.103:0/3521005298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f078415d9f0 0x7f07840c97c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:04.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:04.018+0000 7f078a200640 1 --2- 172.21.15.103:0/3521005298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07840cf3b0 0x7f0784073510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:04.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:04.018+0000 7f078a200640 1 --2- 172.21.15.103:0/3521005298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07840c61b0 0x7f078409d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:04.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:04.022+0000 7f078a200640 1 -- 172.21.15.103:0/3521005298 >> 172.21.15.103:0/3521005298 conn(0x7f07840cff60 msgr2=0x7f07840b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:04.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:04.022+0000 7f078a200640 1 -- 172.21.15.103:0/3521005298 shutdown_connections 2024-09-10T22:40:04.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:04.022+0000 7f078a200640 1 -- 172.21.15.103:0/3521005298 wait complete. 2024-09-10T22:40:04.448 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:39:54.979240+0000', 'modified': '2024-09-10T22:40:03.639876+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 4941, 'mds_1': 4920}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4920': {'gid': 4920, 'name': 'a', 'rank': 1, 'incarnation': 21, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.103:6833/4043692269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6832', 'nonce': 4043692269}, {'type': 'v1', 'addr': '172.21.15.103:6833', 'nonce': 4043692269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4941': {'gid': 4941, 'name': 'c', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/1194009116', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6834', 'nonce': 1194009116}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 1194009116}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4941, 'qdb_cluster': [4941]} 2024-09-10T22:40:04.448 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4920:up:creating 2024-09-10T22:40:05.449 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:40:05.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd291200640 1 -- 172.21.15.103:0/3996729444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd270004810 msgr2=0x7fd270004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:05.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd291200640 1 --2- 172.21.15.103:0/3996729444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd270004810 0x7fd270004c90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd274001890 tx=0x7fd27401f030 comp rx=0 tx=0).stop 2024-09-10T22:40:05.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd28a800640 1 -- 172.21.15.103:0/3996729444 reap_dead start 2024-09-10T22:40:05.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd291200640 1 -- 172.21.15.103:0/3996729444 shutdown_connections 2024-09-10T22:40:05.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd291200640 1 -- 172.21.15.103:0/3996729444 >> 172.21.15.103:0/3996729444 conn(0x7fd28c06cc00 msgr2=0x7fd28c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:05.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd291200640 1 -- 172.21.15.103:0/3996729444 shutdown_connections 2024-09-10T22:40:05.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd291200640 1 -- 172.21.15.103:0/3996729444 wait complete. 2024-09-10T22:40:05.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd291200640 1 Processor -- start 2024-09-10T22:40:05.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd291200640 1 -- start start 2024-09-10T22:40:05.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd291200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd270004810 0x7fd28c1f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:05.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd291200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd28c140d70 0x7fd28c148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:05.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd291200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd28c14c770 0x7fd28c14cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:05.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd291200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c15f630 con 0x7fd28c14c770 2024-09-10T22:40:05.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd291200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c15f4b0 con 0x7fd270004810 2024-09-10T22:40:05.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd291200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd28c15f7b0 con 0x7fd28c140d70 2024-09-10T22:40:05.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd28a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd28c14c770 0x7fd28c14cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:05.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd28a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd28c14c770 0x7fd28c14cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43248/0 (socket says 172.21.15.103:43248) 2024-09-10T22:40:05.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd28a800640 1 -- 172.21.15.103:0/929186417 learned_addr learned my addr 172.21.15.103:0/929186417 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:05.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd283e00640 1 --2- 172.21.15.103:0/929186417 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd28c140d70 0x7fd28c148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:05.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.598+0000 7fd289e00640 1 --2- 172.21.15.103:0/929186417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd270004810 0x7fd28c1f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:05.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.602+0000 7fd28a800640 1 -- 172.21.15.103:0/929186417 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd28c140d70 msgr2=0x7fd28c148d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:05.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.602+0000 7fd28a800640 1 --2- 172.21.15.103:0/929186417 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd28c140d70 0x7fd28c148d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:05.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.602+0000 7fd28a800640 1 -- 172.21.15.103:0/929186417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd270004810 msgr2=0x7fd28c1f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:05.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.602+0000 7fd28a800640 1 --2- 172.21.15.103:0/929186417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd270004810 0x7fd28c1f78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:05.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.602+0000 7fd28a800640 1 -- 172.21.15.103:0/929186417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c0b2330 con 0x7fd28c14c770 2024-09-10T22:40:05.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.602+0000 7fd289e00640 1 --2- 172.21.15.103:0/929186417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd270004810 0x7fd28c1f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:40:05.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.602+0000 7fd283e00640 1 --2- 172.21.15.103:0/929186417 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd28c140d70 0x7fd28c148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:40:05.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.602+0000 7fd28a800640 1 --2- 172.21.15.103:0/929186417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd28c14c770 0x7fd28c14cbf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0cc440 tx=0x7fd28400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:05.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.602+0000 7fd282000640 1 -- 172.21.15.103:0/929186417 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284004b30 con 0x7fd28c14c770 2024-09-10T22:40:05.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.602+0000 7fd282000640 1 -- 172.21.15.103:0/929186417 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd284004cd0 con 0x7fd28c14c770 2024-09-10T22:40:05.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.602+0000 7fd282000640 1 -- 172.21.15.103:0/929186417 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284003be0 con 0x7fd28c14c770 2024-09-10T22:40:05.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.602+0000 7fd291200640 1 -- 172.21.15.103:0/929186417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd28c0b2050 con 0x7fd28c14c770 2024-09-10T22:40:05.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.602+0000 7fd291200640 1 -- 172.21.15.103:0/929186417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd28c148870 con 0x7fd28c14c770 2024-09-10T22:40:05.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.602+0000 7fd291200640 1 -- 172.21.15.103:0/929186417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd28c0b1dc0 con 0x7fd28c14c770 2024-09-10T22:40:05.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.602+0000 7fd282000640 1 -- 172.21.15.103:0/929186417 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd284021060 con 0x7fd28c14c770 2024-09-10T22:40:05.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.606+0000 7fd282000640 1 --2- 172.21.15.103:0/929186417 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2680725e0 0x7fd268074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:05.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.606+0000 7fd282000640 1 -- 172.21.15.103:0/929186417 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fd284093540 con 0x7fd28c14c770 2024-09-10T22:40:05.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.606+0000 7fd289e00640 1 --2- 172.21.15.103:0/929186417 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2680725e0 0x7fd268074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:05.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.606+0000 7fd289e00640 1 --2- 172.21.15.103:0/929186417 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2680725e0 0x7fd268074aa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd27c001250 tx=0x7fd27c0011a0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:05.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.610+0000 7fd282000640 1 -- 172.21.15.103:0/929186417 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd28405e9f0 con 0x7fd28c14c770 2024-09-10T22:40:05.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.810+0000 7fd291200640 1 -- 172.21.15.103:0/929186417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd28c06eb80 con 0x7fd28c14c770 2024-09-10T22:40:05.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.810+0000 7fd282000640 1 -- 172.21.15.103:0/929186417 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5273 (secure 0 0 0) 0x7fd28405e2f0 con 0x7fd28c14c770 2024-09-10T22:40:05.814 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:40:05.814 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"btime":"2024-09-10T22:40:05:653070+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/3313045987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3313045987},{"type":"v1","addr":"172.21.15.131:6836","nonce":3313045987}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:39:54.979240+0000","modified":"2024-09-10T22:40:05.653066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4941,"mds_1":4920,"mds_2":4754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4754":{"gid":4754,"name":"d","rank":2,"incarnation":23,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6837/1068577002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1068577002},{"type":"v1","addr":"172.21.15.131:6837","nonce":1068577002}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4920":{"gid":4920,"name":"a","rank":1,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.103:6833/4043692269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4043692269},{"type":"v1","addr":"172.21.15.103:6833","nonce":4043692269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4941":{"gid":4941,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/1194009116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1194009116},{"type":"v1","addr":"172.21.15.103:6835","nonce":1194009116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4941,"qdb_cluster":[4754,4920,4941]},"id":2}]} 2024-09-10T22:40:05.814 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 24 2024-09-10T22:40:05.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.810+0000 7fd291200640 1 -- 172.21.15.103:0/929186417 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2680725e0 msgr2=0x7fd268074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:05.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.810+0000 7fd291200640 1 --2- 172.21.15.103:0/929186417 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2680725e0 0x7fd268074aa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd27c001250 tx=0x7fd27c0011a0 comp rx=0 tx=0).stop 2024-09-10T22:40:05.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.810+0000 7fd291200640 1 -- 172.21.15.103:0/929186417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd28c14c770 msgr2=0x7fd28c14cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:05.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.810+0000 7fd291200640 1 --2- 172.21.15.103:0/929186417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd28c14c770 0x7fd28c14cbf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0cc440 tx=0x7fd28400f3c0 comp rx=0 tx=0).stop 2024-09-10T22:40:05.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.810+0000 7fd291200640 1 -- 172.21.15.103:0/929186417 shutdown_connections 2024-09-10T22:40:05.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.810+0000 7fd291200640 1 --2- 172.21.15.103:0/929186417 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2680725e0 0x7fd268074aa0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:05.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.810+0000 7fd291200640 1 --2- 172.21.15.103:0/929186417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd28c14c770 0x7fd28c14cbf0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:05.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.810+0000 7fd291200640 1 --2- 172.21.15.103:0/929186417 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd28c140d70 0x7fd28c148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:05.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.810+0000 7fd291200640 1 --2- 172.21.15.103:0/929186417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd270004810 0x7fd28c1f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:05.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.810+0000 7fd291200640 1 -- 172.21.15.103:0/929186417 >> 172.21.15.103:0/929186417 conn(0x7fd28c06cc00 msgr2=0x7fd28c158c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:05.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.810+0000 7fd291200640 1 -- 172.21.15.103:0/929186417 shutdown_connections 2024-09-10T22:40:05.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:05.810+0000 7fd291200640 1 -- 172.21.15.103:0/929186417 wait complete. 2024-09-10T22:40:06.239 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:39:54.979240+0000', 'modified': '2024-09-10T22:40:05.653066+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4941, 'mds_1': 4920, 'mds_2': 4754}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4754': {'gid': 4754, 'name': 'd', 'rank': 2, 'incarnation': 23, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.131:6837/1068577002', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6835', 'nonce': 1068577002}, {'type': 'v1', 'addr': '172.21.15.131:6837', 'nonce': 1068577002}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4920': {'gid': 4920, 'name': 'a', 'rank': 1, 'incarnation': 21, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.103:6833/4043692269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6832', 'nonce': 4043692269}, {'type': 'v1', 'addr': '172.21.15.103:6833', 'nonce': 4043692269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4941': {'gid': 4941, 'name': 'c', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/1194009116', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6834', 'nonce': 1194009116}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 1194009116}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4941, 'qdb_cluster': [4754, 4920, 4941]} 2024-09-10T22:40:06.239 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T22:40:06.239 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T22:40:06.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ee3c00640 1 -- 172.21.15.103:0/2316090955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0edc0cd500 msgr2=0x7f0edc15f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ee3c00640 1 --2- 172.21.15.103:0/2316090955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0edc0cd500 0x7f0edc15f890 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009c80 tx=0x7f0ed401cda0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ee3c00640 1 -- 172.21.15.103:0/2316090955 shutdown_connections 2024-09-10T22:40:06.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ee3c00640 1 --2- 172.21.15.103:0/2316090955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0edc0cd500 0x7f0edc15f890 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ee3c00640 1 --2- 172.21.15.103:0/2316090955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0edc15f1a0 0x7f0edc0ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ee3c00640 1 -- 172.21.15.103:0/2316090955 >> 172.21.15.103:0/2316090955 conn(0x7f0edc0d1a20 msgr2=0x7f0edc0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ee3c00640 1 -- 172.21.15.103:0/2316090955 shutdown_connections 2024-09-10T22:40:06.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ee3c00640 1 -- 172.21.15.103:0/2316090955 wait complete. 2024-09-10T22:40:06.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ee3c00640 1 Processor -- start 2024-09-10T22:40:06.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ee3c00640 1 -- start start 2024-09-10T22:40:06.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ee3c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0edc0cd500 0x7f0edc1f9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ee3c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0edc0cdd00 0x7f0edc158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ee3c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0edc15f1a0 0x7f0edc0b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ee3c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0edc168f60 con 0x7f0edc0cdd00 2024-09-10T22:40:06.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ee3c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0edc168de0 con 0x7f0edc15f1a0 2024-09-10T22:40:06.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ee3c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0edc1690e0 con 0x7f0edc0cd500 2024-09-10T22:40:06.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ed3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0edc0cdd00 0x7f0edc158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ed3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0edc0cdd00 0x7f0edc158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43266/0 (socket says 172.21.15.103:43266) 2024-09-10T22:40:06.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.382+0000 7f0ed3e00640 1 -- 172.21.15.103:0/3714553967 learned_addr learned my addr 172.21.15.103:0/3714553967 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:06.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.386+0000 7f0ee1200640 1 --2- 172.21.15.103:0/3714553967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0edc0cd500 0x7f0edc1f9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.386+0000 7f0ee1c00640 1 --2- 172.21.15.103:0/3714553967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0edc15f1a0 0x7f0edc0b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.386+0000 7f0ed3e00640 1 -- 172.21.15.103:0/3714553967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0edc0cd500 msgr2=0x7f0edc1f9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.386+0000 7f0ed3e00640 1 --2- 172.21.15.103:0/3714553967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0edc0cd500 0x7f0edc1f9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.386+0000 7f0ed3e00640 1 -- 172.21.15.103:0/3714553967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0edc15f1a0 msgr2=0x7f0edc0b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.386+0000 7f0ed3e00640 1 --2- 172.21.15.103:0/3714553967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0edc15f1a0 0x7f0edc0b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.386+0000 7f0ed3e00640 1 -- 172.21.15.103:0/3714553967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0edc1f9b80 con 0x7f0edc0cdd00 2024-09-10T22:40:06.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.386+0000 7f0ed3e00640 1 --2- 172.21.15.103:0/3714553967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0edc0cdd00 0x7f0edc158af0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400c400 tx=0x7f0ec400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:06.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.386+0000 7f0ed9600640 1 -- 172.21.15.103:0/3714553967 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4017070 con 0x7f0edc0cdd00 2024-09-10T22:40:06.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.386+0000 7f0ed9600640 1 -- 172.21.15.103:0/3714553967 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ec40053e0 con 0x7f0edc0cdd00 2024-09-10T22:40:06.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.386+0000 7f0ed9600640 1 -- 172.21.15.103:0/3714553967 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4003860 con 0x7f0edc0cdd00 2024-09-10T22:40:06.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.386+0000 7f0ee3c00640 1 -- 172.21.15.103:0/3714553967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0edc15e880 con 0x7f0edc0cdd00 2024-09-10T22:40:06.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.386+0000 7f0ee3c00640 1 -- 172.21.15.103:0/3714553967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0edc1582f0 con 0x7f0edc0cdd00 2024-09-10T22:40:06.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.386+0000 7f0ed9600640 1 -- 172.21.15.103:0/3714553967 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0ec4003a00 con 0x7f0edc0cdd00 2024-09-10T22:40:06.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ed9600640 1 --2- 172.21.15.103:0/3714553967 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0eb80725e0 0x7f0eb8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ed9600640 1 -- 172.21.15.103:0/3714553967 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f0ec4092ad0 con 0x7f0edc0cdd00 2024-09-10T22:40:06.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee7019000 1 Processor -- start 2024-09-10T22:40:06.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee1200640 1 --2- 172.21.15.103:0/3714553967 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0eb80725e0 0x7f0eb8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee7019000 1 -- start start 2024-09-10T22:40:06.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee1200640 1 --2- 172.21.15.103:0/3714553967 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0eb80725e0 0x7f0eb8074aa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0edc15e270 tx=0x7f0ecc0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:06.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee7019000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b65dc0 0x55de68b661a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee7019000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de68b666e0 0x55de68b19ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee7019000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b1a220 0x55de68b1a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee7019000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55de68a363f0 con 0x55de68b1a220 2024-09-10T22:40:06.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee7019000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55de68973b20 con 0x55de68b65dc0 2024-09-10T22:40:06.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee7019000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55de68962f50 con 0x55de68b666e0 2024-09-10T22:40:06.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee1c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b1a220 0x55de68b1a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee1200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b65dc0 0x55de68b661a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee1c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b1a220 0x55de68b1a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43274/0 (socket says 172.21.15.103:43274) 2024-09-10T22:40:06.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee1c00640 1 -- 172.21.15.103:0/2705195903 learned_addr learned my addr 172.21.15.103:0/2705195903 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:06.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ed3e00640 1 --2- 172.21.15.103:0/2705195903 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de68b666e0 0x55de68b19ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee1c00640 1 -- 172.21.15.103:0/2705195903 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de68b666e0 msgr2=0x55de68b19ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee1c00640 1 --2- 172.21.15.103:0/2705195903 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de68b666e0 0x55de68b19ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee1c00640 1 -- 172.21.15.103:0/2705195903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b65dc0 msgr2=0x55de68b661a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee1c00640 1 --2- 172.21.15.103:0/2705195903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b65dc0 0x55de68b661a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee1c00640 1 -- 172.21.15.103:0/2705195903 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de6892a590 con 0x55de68b1a220 2024-09-10T22:40:06.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee1c00640 1 --2- 172.21.15.103:0/2705195903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b1a220 0x55de68b1a600 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40b0040 tx=0x7f0ed4019b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2b16ad0f10bedf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:06.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ed1600640 1 -- 172.21.15.103:0/2705195903 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40b2040 con 0x55de68b1a220 2024-09-10T22:40:06.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ed1600640 1 -- 172.21.15.103:0/2705195903 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ed40bc070 con 0x55de68b1a220 2024-09-10T22:40:06.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ed1600640 1 -- 172.21.15.103:0/2705195903 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40a5d70 con 0x55de68b1a220 2024-09-10T22:40:06.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee7019000 1 -- 172.21.15.103:0/2705195903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b1a220 msgr2=0x55de68b1a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee7019000 1 --2- 172.21.15.103:0/2705195903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b1a220 0x55de68b1a600 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40b0040 tx=0x7f0ed4019b40 comp rx=0 tx=0).stop 2024-09-10T22:40:06.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee7019000 1 -- 172.21.15.103:0/2705195903 shutdown_connections 2024-09-10T22:40:06.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee7019000 1 --2- 172.21.15.103:0/2705195903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b1a220 0x55de68b1a600 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee7019000 1 --2- 172.21.15.103:0/2705195903 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de68b666e0 0x55de68b19ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee7019000 1 --2- 172.21.15.103:0/2705195903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b65dc0 0x55de68b661a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee7019000 1 -- 172.21.15.103:0/2705195903 >> 172.21.15.103:0/2705195903 conn(0x55de689ff130 msgr2=0x55de68b44e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee7019000 1 -- 172.21.15.103:0/2705195903 shutdown_connections 2024-09-10T22:40:06.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.390+0000 7f0ee7019000 1 -- 172.21.15.103:0/2705195903 wait complete. 2024-09-10T22:40:06.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee7019000 1 -- start start 2024-09-10T22:40:06.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee7019000 1 Processor -- start 2024-09-10T22:40:06.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee7019000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de68b1a220 0x55de68b50360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee7019000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b65dc0 0x55de68b508a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee7019000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b666e0 0x55de68b50de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee7019000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55de688fd5d0 con 0x55de68b666e0 2024-09-10T22:40:06.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee7019000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55de68966d60 con 0x55de68b65dc0 2024-09-10T22:40:06.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee7019000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55de68909500 con 0x55de68b1a220 2024-09-10T22:40:06.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee7019000 10 client.0 _ll_register_callbacks cb 0x55de6890d810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:06.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee1c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b666e0 0x55de68b50de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee1c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b666e0 0x55de68b50de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43290/0 (socket says 172.21.15.103:43290) 2024-09-10T22:40:06.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee1c00640 1 -- 172.21.15.103:0/2513968570 learned_addr learned my addr 172.21.15.103:0/2513968570 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:06.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee1200640 1 --2- 172.21.15.103:0/2513968570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de68b1a220 0x55de68b50360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ed3e00640 1 --2- 172.21.15.103:0/2513968570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b65dc0 0x55de68b508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee1c00640 1 -- 172.21.15.103:0/2513968570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de68b1a220 msgr2=0x55de68b50360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee1c00640 1 --2- 172.21.15.103:0/2513968570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de68b1a220 0x55de68b50360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee1c00640 1 -- 172.21.15.103:0/2513968570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b65dc0 msgr2=0x55de68b508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee1c00640 1 --2- 172.21.15.103:0/2513968570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b65dc0 0x55de68b508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee1c00640 1 -- 172.21.15.103:0/2513968570 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de68901170 con 0x55de68b666e0 2024-09-10T22:40:06.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ed3e00640 1 --2- 172.21.15.103:0/2513968570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b65dc0 0x55de68b508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:40:06.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee1c00640 1 --2- 172.21.15.103:0/2513968570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b666e0 0x55de68b50de0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40b9040 tx=0x7f0ed4004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19eeb1c0a3f5810b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:06.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0eca000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:06.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0eca000640 1 -- 172.21.15.103:0/2513968570 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40c5060 con 0x55de68b666e0 2024-09-10T22:40:06.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0eca000640 1 -- 172.21.15.103:0/2513968570 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f0ed4003b80 con 0x55de68b666e0 2024-09-10T22:40:06.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee7019000 1 -- 172.21.15.103:0/2513968570 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55de688fb0f0 con 0x55de68b666e0 2024-09-10T22:40:06.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0eca000640 1 -- 172.21.15.103:0/2513968570 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0ed40cb050 con 0x55de68b666e0 2024-09-10T22:40:06.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee7019000 10 client.5145 fetch_fsmap learned FSMap version 24 2024-09-10T22:40:06.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee7019000 1 -- 172.21.15.103:0/2513968570 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55de689e7ef0 con 0x55de68b666e0 2024-09-10T22:40:06.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0eca000640 1 -- 172.21.15.103:0/2513968570 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55de688fb0f0 con 0x55de68b666e0 2024-09-10T22:40:06.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0eca000640 1 -- 172.21.15.103:0/2513968570 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 24) ==== 3542+0+0 (secure 0 0 0) 0x7f0ed40ce020 con 0x55de68b666e0 2024-09-10T22:40:06.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee7019000 10 client.5145 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:40:06.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee7019000 10 client.5145 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T22:40:06.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee7019000 20 client.5145 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:06.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee7019000 1 --2- 172.21.15.103:0/2513968570 >> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] conn(0x55de68b517f0 0x55de68b77070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee7019000 4 client.5145 mds_command: new command op to 4754 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:40:06.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee7019000 1 -- 172.21.15.103:0/2513968570 --> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de68975a70 con 0x55de68b517f0 2024-09-10T22:40:06.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.394+0000 7f0ee1200640 1 --2- 172.21.15.103:0/2513968570 >> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] conn(0x55de68b517f0 0x55de68b77070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.398+0000 7f0eca000640 10 client.5145 ms_handle_connect on v2:172.21.15.131:6835/1068577002 2024-09-10T22:40:06.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.398+0000 7f0ee1200640 1 --2- 172.21.15.103:0/2513968570 >> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] conn(0x55de68b517f0 0x55de68b77070 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=16fad5de7ff3070a server_cookie=6d6307024b3806ac in_seq=0 out_seq=0 2024-09-10T22:40:06.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.398+0000 7f0eca000640 1 -- 172.21.15.103:0/2513968570 <== mds.2 v2:172.21.15.131:6835/1068577002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55de68975a70 con 0x55de68b517f0 2024-09-10T22:40:06.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.398+0000 7f0eca000640 10 client.5145 handle_command_reply: tid=0 2024-09-10T22:40:06.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.398+0000 7f0ee7019000 1 client.5145 shutdown 2024-09-10T22:40:06.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.398+0000 7f0ee7019000 1 -- 172.21.15.103:0/2513968570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b666e0 msgr2=0x55de68b50de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.398+0000 7f0ee7019000 1 --2- 172.21.15.103:0/2513968570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b666e0 0x55de68b50de0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40b9040 tx=0x7f0ed4004ed0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.398+0000 7f0ee7019000 1 -- 172.21.15.103:0/2513968570 shutdown_connections 2024-09-10T22:40:06.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.398+0000 7f0ee7019000 1 --2- 172.21.15.103:0/2513968570 >> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] conn(0x55de68b517f0 0x55de68b77070 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.398+0000 7f0ee7019000 1 --2- 172.21.15.103:0/2513968570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b666e0 0x55de68b50de0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.398+0000 7f0ee7019000 1 --2- 172.21.15.103:0/2513968570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b65dc0 0x55de68b508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.398+0000 7f0eca000640 0 client.5145 ms_handle_reset on v2:172.21.15.131:6835/1068577002 2024-09-10T22:40:06.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.398+0000 7f0ee7019000 1 --2- 172.21.15.103:0/2513968570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de68b1a220 0x55de68b50360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.398+0000 7f0ee7019000 1 -- 172.21.15.103:0/2513968570 >> 172.21.15.103:0/2513968570 conn(0x55de689ff130 msgr2=0x55de68b148c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.398+0000 7f0ee7019000 1 -- 172.21.15.103:0/2513968570 shutdown_connections 2024-09-10T22:40:06.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.398+0000 7f0ee7019000 1 -- 172.21.15.103:0/2513968570 wait complete. 2024-09-10T22:40:06.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.398+0000 7f0ee7019000 20 client.5145 trim_cache size 0 max 16384 2024-09-10T22:40:06.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 Processor -- start 2024-09-10T22:40:06.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 -- start start 2024-09-10T22:40:06.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b1a220 0x55de68b41f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b65dc0 0x55de68b424b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de68b666e0 0x55de68b77070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55de6896b390 con 0x55de68b1a220 2024-09-10T22:40:06.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55de688fd5d0 con 0x55de68b65dc0 2024-09-10T22:40:06.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55de689e7a60 con 0x55de68b666e0 2024-09-10T22:40:06.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee1200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b1a220 0x55de68b41f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee1200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b1a220 0x55de68b41f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43294/0 (socket says 172.21.15.103:43294) 2024-09-10T22:40:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee1200640 1 -- 172.21.15.103:0/2171918584 learned_addr learned my addr 172.21.15.103:0/2171918584 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee1200640 1 -- 172.21.15.103:0/2171918584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de68b666e0 msgr2=0x55de68b77070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee1200640 1 --2- 172.21.15.103:0/2171918584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de68b666e0 0x55de68b77070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee1200640 1 -- 172.21.15.103:0/2171918584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b65dc0 msgr2=0x55de68b424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee1200640 1 --2- 172.21.15.103:0/2171918584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b65dc0 0x55de68b424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee1200640 1 -- 172.21.15.103:0/2171918584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de689bed90 con 0x55de68b1a220 2024-09-10T22:40:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee1200640 1 --2- 172.21.15.103:0/2171918584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b1a220 0x55de68b41f70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009fd0 tx=0x7f0ecc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa59160274077727 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ed0c00640 1 -- 172.21.15.103:0/2171918584 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc034070 con 0x55de68b1a220 2024-09-10T22:40:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ed0c00640 1 -- 172.21.15.103:0/2171918584 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ecc003800 con 0x55de68b1a220 2024-09-10T22:40:06.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ed0c00640 1 -- 172.21.15.103:0/2171918584 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc003c30 con 0x55de68b1a220 2024-09-10T22:40:06.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 -- 172.21.15.103:0/2171918584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b1a220 msgr2=0x55de68b41f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 --2- 172.21.15.103:0/2171918584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b1a220 0x55de68b41f70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009fd0 tx=0x7f0ecc014000 comp rx=0 tx=0).stop 2024-09-10T22:40:06.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 -- 172.21.15.103:0/2171918584 shutdown_connections 2024-09-10T22:40:06.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 --2- 172.21.15.103:0/2171918584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de68b666e0 0x55de68b77070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 --2- 172.21.15.103:0/2171918584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b65dc0 0x55de68b424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 --2- 172.21.15.103:0/2171918584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b1a220 0x55de68b41f70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 -- 172.21.15.103:0/2171918584 >> 172.21.15.103:0/2171918584 conn(0x55de689ff130 msgr2=0x55de68b23280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 -- 172.21.15.103:0/2171918584 shutdown_connections 2024-09-10T22:40:06.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 -- 172.21.15.103:0/2171918584 wait complete. 2024-09-10T22:40:06.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 -- start start 2024-09-10T22:40:06.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.418+0000 7f0ee7019000 1 Processor -- start 2024-09-10T22:40:06.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de68b1a220 0x55de68bdc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b65dc0 0x55de68bdc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b666e0 0x55de68bdce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55de68a22730 con 0x55de68b65dc0 2024-09-10T22:40:06.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55de68966070 con 0x55de68b666e0 2024-09-10T22:40:06.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55de6892eec0 con 0x55de68b1a220 2024-09-10T22:40:06.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 10 client.0 _ll_register_callbacks cb 0x7f0ecc009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:06.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ed3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b65dc0 0x55de68bdc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ed3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b65dc0 0x55de68bdc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43310/0 (socket says 172.21.15.103:43310) 2024-09-10T22:40:06.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ed3e00640 1 -- 172.21.15.103:0/285705087 learned_addr learned my addr 172.21.15.103:0/285705087 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:06.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ed3e00640 1 -- 172.21.15.103:0/285705087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de68b1a220 msgr2=0x55de68bdc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ed3e00640 1 --2- 172.21.15.103:0/285705087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de68b1a220 0x55de68bdc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ed3e00640 1 -- 172.21.15.103:0/285705087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b666e0 msgr2=0x55de68bdce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ed3e00640 1 --2- 172.21.15.103:0/285705087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b666e0 0x55de68bdce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ed3e00640 1 -- 172.21.15.103:0/285705087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de68929a90 con 0x55de68b65dc0 2024-09-10T22:40:06.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ed3e00640 1 --2- 172.21.15.103:0/285705087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b65dc0 0x55de68bdc950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0ec405d630 tx=0x7f0ec405d1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59303c93f6f2a0dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:06.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0eca000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:06.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0eca000640 1 -- 172.21.15.103:0/285705087 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4062360 con 0x55de68b65dc0 2024-09-10T22:40:06.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0eca000640 1 -- 172.21.15.103:0/285705087 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f0ec4076cb0 con 0x55de68b65dc0 2024-09-10T22:40:06.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 -- 172.21.15.103:0/285705087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ecc003800 con 0x55de68b65dc0 2024-09-10T22:40:06.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0eca000640 1 -- 172.21.15.103:0/285705087 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0ec408e050 con 0x55de68b65dc0 2024-09-10T22:40:06.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 10 client.5151 fetch_fsmap learned FSMap version 24 2024-09-10T22:40:06.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 -- 172.21.15.103:0/285705087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55de68908050 con 0x55de68b65dc0 2024-09-10T22:40:06.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0eca000640 1 -- 172.21.15.103:0/285705087 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ecc003800 con 0x55de68b65dc0 2024-09-10T22:40:06.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0eca000640 1 -- 172.21.15.103:0/285705087 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 24) ==== 3542+0+0 (secure 0 0 0) 0x7f0ec405cb90 con 0x55de68b65dc0 2024-09-10T22:40:06.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 10 client.5151 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:40:06.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 10 client.5151 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T22:40:06.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 20 client.5151 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:06.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 --2- 172.21.15.103:0/285705087 >> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] conn(0x55de68be3660 0x55de68b7abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 4 client.5151 mds_command: new command op to 4754 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:40:06.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 -- 172.21.15.103:0/285705087 --> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] -- command(tid 0: {"prefix": "status"}) -- 0x55de68971520 con 0x55de68be3660 2024-09-10T22:40:06.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee1200640 1 --2- 172.21.15.103:0/285705087 >> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] conn(0x55de68be3660 0x55de68b7abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee1200640 1 --2- 172.21.15.103:0/285705087 >> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] conn(0x55de68be3660 0x55de68b7abc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cd331ab677747f3a server_cookie=b8e28bc65f05c5b7 in_seq=0 out_seq=0 2024-09-10T22:40:06.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0eca000640 10 client.5151 ms_handle_connect on v2:172.21.15.131:6835/1068577002 2024-09-10T22:40:06.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0eca000640 1 -- 172.21.15.103:0/285705087 <== mds.2 v2:172.21.15.131:6835/1068577002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x55de68971520 con 0x55de68be3660 2024-09-10T22:40:06.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0eca000640 10 client.5151 handle_command_reply: tid=0 2024-09-10T22:40:06.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 client.5151 shutdown 2024-09-10T22:40:06.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 -- 172.21.15.103:0/285705087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b65dc0 msgr2=0x55de68bdc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 --2- 172.21.15.103:0/285705087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b65dc0 0x55de68bdc950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0ec405d630 tx=0x7f0ec405d1b0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 -- 172.21.15.103:0/285705087 shutdown_connections 2024-09-10T22:40:06.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 --2- 172.21.15.103:0/285705087 >> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] conn(0x55de68be3660 0x55de68b7abc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 --2- 172.21.15.103:0/285705087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de68b666e0 0x55de68bdce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 --2- 172.21.15.103:0/285705087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de68b65dc0 0x55de68bdc950 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0eca000640 0 client.5151 ms_handle_reset on v2:172.21.15.131:6835/1068577002 2024-09-10T22:40:06.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 --2- 172.21.15.103:0/285705087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de68b1a220 0x55de68bdc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.422+0000 7f0ee7019000 1 -- 172.21.15.103:0/285705087 >> 172.21.15.103:0/285705087 conn(0x55de689ff130 msgr2=0x55de68b40f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.426+0000 7f0ee7019000 1 -- 172.21.15.103:0/285705087 shutdown_connections 2024-09-10T22:40:06.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.426+0000 7f0ee7019000 1 -- 172.21.15.103:0/285705087 wait complete. 2024-09-10T22:40:06.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.426+0000 7f0ee7019000 20 client.5151 trim_cache size 0 max 16384 2024-09-10T22:40:06.438 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:40:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:40:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 2, 2024-09-10T22:40:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4754, 2024-09-10T22:40:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:40:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:40:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:40:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 1.77336702, 2024-09-10T22:40:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 24, 2024-09-10T22:40:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 41, 2024-09-10T22:40:06.439 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 41, 2024-09-10T22:40:06.439 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 17.989761401999999 2024-09-10T22:40:06.439 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:40:06.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.426+0000 7f0ee3c00640 1 -- 172.21.15.103:0/3714553967 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0eb80725e0 msgr2=0x7f0eb8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.426+0000 7f0ee3c00640 1 --2- 172.21.15.103:0/3714553967 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0eb80725e0 0x7f0eb8074aa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0edc15e270 tx=0x7f0ecc0091e0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.426+0000 7f0ee3c00640 1 -- 172.21.15.103:0/3714553967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0edc0cdd00 msgr2=0x7f0edc158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.426+0000 7f0ee3c00640 1 --2- 172.21.15.103:0/3714553967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0edc0cdd00 0x7f0edc158af0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400c400 tx=0x7f0ec400c8c0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.426+0000 7f0ee3c00640 1 -- 172.21.15.103:0/3714553967 shutdown_connections 2024-09-10T22:40:06.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.426+0000 7f0ee3c00640 1 --2- 172.21.15.103:0/3714553967 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0eb80725e0 0x7f0eb8074aa0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.426+0000 7f0ee3c00640 1 --2- 172.21.15.103:0/3714553967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0edc15f1a0 0x7f0edc0b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.426+0000 7f0ee3c00640 1 --2- 172.21.15.103:0/3714553967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0edc0cdd00 0x7f0edc158af0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.426+0000 7f0ee3c00640 1 --2- 172.21.15.103:0/3714553967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0edc0cd500 0x7f0edc1f9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.426+0000 7f0ee3c00640 1 -- 172.21.15.103:0/3714553967 >> 172.21.15.103:0/3714553967 conn(0x7f0edc0d1a20 msgr2=0x7f0edc070990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.426+0000 7f0ee3c00640 1 -- 172.21.15.103:0/3714553967 shutdown_connections 2024-09-10T22:40:06.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.426+0000 7f0ee3c00640 1 -- 172.21.15.103:0/3714553967 wait complete. 2024-09-10T22:40:06.448 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T22:40:06.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.586+0000 7f5b5c800640 1 -- 172.21.15.103:0/1046881214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b5415be30 msgr2=0x7f5b540ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.586+0000 7f5b5c800640 1 --2- 172.21.15.103:0/1046881214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b5415be30 0x7f5b540ce0c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5b540cbf40 tx=0x7f5b4801c830 comp rx=0 tx=0).stop 2024-09-10T22:40:06.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.586+0000 7f5b5c800640 1 -- 172.21.15.103:0/1046881214 shutdown_connections 2024-09-10T22:40:06.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.586+0000 7f5b5c800640 1 --2- 172.21.15.103:0/1046881214 >> v2:172.21.15.131:3300/0 conn(0x7f5b540b09c0 0x7f5b540ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.586+0000 7f5b5c800640 1 --2- 172.21.15.103:0/1046881214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b5415be30 0x7f5b540ce0c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.586+0000 7f5b5c800640 1 -- 172.21.15.103:0/1046881214 >> 172.21.15.103:0/1046881214 conn(0x7f5b540d1ac0 msgr2=0x7f5b540d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.586+0000 7f5b5c800640 1 -- 172.21.15.103:0/1046881214 shutdown_connections 2024-09-10T22:40:06.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.586+0000 7f5b5c800640 1 -- 172.21.15.103:0/1046881214 wait complete. 2024-09-10T22:40:06.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.586+0000 7f5b5c800640 1 Processor -- start 2024-09-10T22:40:06.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.586+0000 7f5b5c800640 1 -- start start 2024-09-10T22:40:06.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.586+0000 7f5b5c800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b540b09c0 0x7f5b540b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.586+0000 7f5b5c800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b540ceb40 0x7f5b54157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b5c800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b5415be30 0x7f5b541f7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b5c800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5b54169010 con 0x7f5b540b09c0 2024-09-10T22:40:06.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b5c800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5b54168e90 con 0x7f5b5415be30 2024-09-10T22:40:06.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b5c800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5b54169190 con 0x7f5b540ceb40 2024-09-10T22:40:06.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b59e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b540b09c0 0x7f5b540b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b59e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b540b09c0 0x7f5b540b7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43332/0 (socket says 172.21.15.103:43332) 2024-09-10T22:40:06.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b59e00640 1 -- 172.21.15.103:0/962812071 learned_addr learned my addr 172.21.15.103:0/962812071 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:06.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b59400640 1 --2- 172.21.15.103:0/962812071 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b540ceb40 0x7f5b54157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b59e00640 1 -- 172.21.15.103:0/962812071 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b540ceb40 msgr2=0x7f5b54157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b5a800640 1 --2- 172.21.15.103:0/962812071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b5415be30 0x7f5b541f7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b59e00640 1 --2- 172.21.15.103:0/962812071 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b540ceb40 0x7f5b54157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b59e00640 1 -- 172.21.15.103:0/962812071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b5415be30 msgr2=0x7f5b541f7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b59e00640 1 --2- 172.21.15.103:0/962812071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b5415be30 0x7f5b541f7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b59e00640 1 -- 172.21.15.103:0/962812071 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b540b7590 con 0x7f5b540b09c0 2024-09-10T22:40:06.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b59400640 1 --2- 172.21.15.103:0/962812071 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b540ceb40 0x7f5b54157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:40:06.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b5a800640 1 --2- 172.21.15.103:0/962812071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b5415be30 0x7f5b541f7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:40:06.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b59e00640 1 --2- 172.21.15.103:0/962812071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b540b09c0 0x7f5b540b7050 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5b480b0040 tx=0x7f5b48004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:06.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b4e000640 1 -- 172.21.15.103:0/962812071 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b48004230 con 0x7f5b540b09c0 2024-09-10T22:40:06.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b4e000640 1 -- 172.21.15.103:0/962812071 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b480044e0 con 0x7f5b540b09c0 2024-09-10T22:40:06.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b4e000640 1 -- 172.21.15.103:0/962812071 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b48003860 con 0x7f5b540b09c0 2024-09-10T22:40:06.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b5c800640 1 -- 172.21.15.103:0/962812071 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b540b6590 con 0x7f5b540b09c0 2024-09-10T22:40:06.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b5c800640 1 -- 172.21.15.103:0/962812071 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b541f8d90 con 0x7f5b540b09c0 2024-09-10T22:40:06.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.590+0000 7f5b4e000640 1 -- 172.21.15.103:0/962812071 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5b48003a00 con 0x7f5b540b09c0 2024-09-10T22:40:06.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b4e000640 1 --2- 172.21.15.103:0/962812071 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5b380725e0 0x7f5b38074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b4e000640 1 -- 172.21.15.103:0/962812071 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f5b4812dc50 con 0x7f5b540b09c0 2024-09-10T22:40:06.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b5fd00000 1 Processor -- start 2024-09-10T22:40:06.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b59400640 1 --2- 172.21.15.103:0/962812071 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5b380725e0 0x7f5b38074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b5fd00000 1 -- start start 2024-09-10T22:40:06.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b59400640 1 --2- 172.21.15.103:0/962812071 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5b380725e0 0x7f5b38074aa0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5b44005fd0 tx=0x7f5b44005da0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:06.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b5fd00000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1222ae9d0 0x55e1222aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b5fd00000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e1222af2f0 0x55e1222628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b5fd00000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e122262e10 0x55e1222631f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b5fd00000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e1221833f0 con 0x55e122262e10 2024-09-10T22:40:06.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b5fd00000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e1220c0b20 con 0x55e1222af2f0 2024-09-10T22:40:06.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b5fd00000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55e1220aff50 con 0x55e1222ae9d0 2024-09-10T22:40:06.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b5a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e122262e10 0x55e1222631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b59e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1222ae9d0 0x55e1222aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b59400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e1222af2f0 0x55e1222628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b5a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e122262e10 0x55e1222631f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43342/0 (socket says 172.21.15.103:43342) 2024-09-10T22:40:06.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b5a800640 1 -- 172.21.15.103:0/1127633886 learned_addr learned my addr 172.21.15.103:0/1127633886 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b5a800640 1 -- 172.21.15.103:0/1127633886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1222ae9d0 msgr2=0x55e1222aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b5a800640 1 --2- 172.21.15.103:0/1127633886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1222ae9d0 0x55e1222aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b5a800640 1 -- 172.21.15.103:0/1127633886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e1222af2f0 msgr2=0x55e1222628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b5a800640 1 --2- 172.21.15.103:0/1127633886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e1222af2f0 0x55e1222628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b5a800640 1 -- 172.21.15.103:0/1127633886 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e122077590 con 0x55e122262e10 2024-09-10T22:40:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b5a800640 1 --2- 172.21.15.103:0/1127633886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e122262e10 0x55e1222631f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5b500045a0 tx=0x7f5b5000d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4038d79ba85db7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b42a00640 1 -- 172.21.15.103:0/1127633886 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50006d60 con 0x55e122262e10 2024-09-10T22:40:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b42a00640 1 -- 172.21.15.103:0/1127633886 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b5000de40 con 0x55e122262e10 2024-09-10T22:40:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.594+0000 7f5b42a00640 1 -- 172.21.15.103:0/1127633886 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b500049f0 con 0x55e122262e10 2024-09-10T22:40:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 -- 172.21.15.103:0/1127633886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e122262e10 msgr2=0x55e1222631f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/1127633886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e122262e10 0x55e1222631f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5b500045a0 tx=0x7f5b5000d520 comp rx=0 tx=0).stop 2024-09-10T22:40:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 -- 172.21.15.103:0/1127633886 shutdown_connections 2024-09-10T22:40:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/1127633886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e122262e10 0x55e1222631f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/1127633886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e1222af2f0 0x55e1222628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/1127633886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1222ae9d0 0x55e1222aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 -- 172.21.15.103:0/1127633886 >> 172.21.15.103:0/1127633886 conn(0x55e12214c130 msgr2=0x55e122291e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 -- 172.21.15.103:0/1127633886 shutdown_connections 2024-09-10T22:40:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 -- 172.21.15.103:0/1127633886 wait complete. 2024-09-10T22:40:06.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 -- start start 2024-09-10T22:40:06.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 Processor -- start 2024-09-10T22:40:06.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e122262e10 0x55e12228f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e1222ae9d0 0x55e12228fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1222af2f0 0x55e1222903b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e12204a5d0 con 0x55e1222af2f0 2024-09-10T22:40:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e1220b3d60 con 0x55e1222ae9d0 2024-09-10T22:40:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55e122056500 con 0x55e122262e10 2024-09-10T22:40:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 10 client.0 _ll_register_callbacks cb 0x55e12205a810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1222af2f0 0x55e1222903b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1222af2f0 0x55e1222903b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43348/0 (socket says 172.21.15.103:43348) 2024-09-10T22:40:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5a800640 1 -- 172.21.15.103:0/414494732 learned_addr learned my addr 172.21.15.103:0/414494732 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b59e00640 1 --2- 172.21.15.103:0/414494732 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e122262e10 0x55e12228f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b59400640 1 --2- 172.21.15.103:0/414494732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e1222ae9d0 0x55e12228fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5a800640 1 -- 172.21.15.103:0/414494732 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e122262e10 msgr2=0x55e12228f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5a800640 1 --2- 172.21.15.103:0/414494732 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e122262e10 0x55e12228f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5a800640 1 -- 172.21.15.103:0/414494732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e1222ae9d0 msgr2=0x55e12228fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5a800640 1 --2- 172.21.15.103:0/414494732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e1222ae9d0 0x55e12228fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5a800640 1 -- 172.21.15.103:0/414494732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e12204e170 con 0x55e1222af2f0 2024-09-10T22:40:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5a800640 1 --2- 172.21.15.103:0/414494732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1222af2f0 0x55e1222903b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55e122061130 tx=0x7f5b50004a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f4fbd961b4e5bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b37400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b37400640 1 -- 172.21.15.103:0/414494732 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50020070 con 0x55e1222af2f0 2024-09-10T22:40:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 -- 172.21.15.103:0/414494732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e1220480f0 con 0x55e1222af2f0 2024-09-10T22:40:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b37400640 1 -- 172.21.15.103:0/414494732 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f5b50005240 con 0x55e1222af2f0 2024-09-10T22:40:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b37400640 1 -- 172.21.15.103:0/414494732 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5b5002d050 con 0x55e1222af2f0 2024-09-10T22:40:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 10 client.5163 fetch_fsmap learned FSMap version 24 2024-09-10T22:40:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b5fd00000 1 -- 172.21.15.103:0/414494732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55e122134ef0 con 0x55e1222af2f0 2024-09-10T22:40:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.598+0000 7f5b37400640 1 -- 172.21.15.103:0/414494732 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55e1220480f0 con 0x55e1222af2f0 2024-09-10T22:40:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b37400640 1 -- 172.21.15.103:0/414494732 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 24) ==== 3542+0+0 (secure 0 0 0) 0x7f5b50030020 con 0x55e1222af2f0 2024-09-10T22:40:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b5fd00000 10 client.5163 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:40:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b5fd00000 10 client.5163 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T22:40:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b5fd00000 20 client.5163 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/414494732 >> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] conn(0x55e1222910f0 0x55e1222c0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b5fd00000 4 client.5163 mds_command: new command op to 4920 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:40:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b5fd00000 1 -- 172.21.15.103:0/414494732 --> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1220c2a70 con 0x55e1222910f0 2024-09-10T22:40:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b59e00640 1 --2- 172.21.15.103:0/414494732 >> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] conn(0x55e1222910f0 0x55e1222c0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b59e00640 1 --2- 172.21.15.103:0/414494732 >> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] conn(0x55e1222910f0 0x55e1222c0c90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5cd0ed1d3dbc08d5 server_cookie=67a43595fce4f1ea in_seq=0 out_seq=0 2024-09-10T22:40:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b37400640 10 client.5163 ms_handle_connect on v2:172.21.15.103:6832/4043692269 2024-09-10T22:40:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b37400640 1 -- 172.21.15.103:0/414494732 <== mds.1 v2:172.21.15.103:6832/4043692269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e1220c2a70 con 0x55e1222910f0 2024-09-10T22:40:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b37400640 10 client.5163 handle_command_reply: tid=0 2024-09-10T22:40:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b5fd00000 1 client.5163 shutdown 2024-09-10T22:40:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b5fd00000 1 -- 172.21.15.103:0/414494732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1222af2f0 msgr2=0x55e1222903b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/414494732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1222af2f0 0x55e1222903b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55e122061130 tx=0x7f5b50004a60 comp rx=0 tx=0).stop 2024-09-10T22:40:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b5fd00000 1 -- 172.21.15.103:0/414494732 shutdown_connections 2024-09-10T22:40:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/414494732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1222af2f0 0x55e1222903b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/414494732 >> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] conn(0x55e1222910f0 0x55e1222c0c90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/414494732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e1222ae9d0 0x55e12228fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/414494732 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e122262e10 0x55e12228f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b37400640 0 client.5163 ms_handle_reset on v2:172.21.15.103:6832/4043692269 2024-09-10T22:40:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b5fd00000 1 -- 172.21.15.103:0/414494732 >> 172.21.15.103:0/414494732 conn(0x55e12214c130 msgr2=0x55e122261fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b5fd00000 1 -- 172.21.15.103:0/414494732 shutdown_connections 2024-09-10T22:40:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b5fd00000 1 -- 172.21.15.103:0/414494732 wait complete. 2024-09-10T22:40:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.602+0000 7f5b5fd00000 20 client.5163 trim_cache size 0 max 16384 2024-09-10T22:40:06.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b5fd00000 1 Processor -- start 2024-09-10T22:40:06.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b5fd00000 1 -- start start 2024-09-10T22:40:06.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b5fd00000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e122262e10 0x55e122320dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b5fd00000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e1222ae9d0 0x55e122321310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b5fd00000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1222af2f0 0x55e122321850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b5fd00000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5b54204950 con 0x55e122262e10 2024-09-10T22:40:06.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b5fd00000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5b54203bb0 con 0x55e1222ae9d0 2024-09-10T22:40:06.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b5fd00000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5b54204280 con 0x55e1222af2f0 2024-09-10T22:40:06.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b59e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e122262e10 0x55e122320dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b59e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e122262e10 0x55e122320dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43362/0 (socket says 172.21.15.103:43362) 2024-09-10T22:40:06.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b59e00640 1 -- 172.21.15.103:0/2072215914 learned_addr learned my addr 172.21.15.103:0/2072215914 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:06.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b59e00640 1 -- 172.21.15.103:0/2072215914 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1222af2f0 msgr2=0x55e122321850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b59e00640 1 --2- 172.21.15.103:0/2072215914 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1222af2f0 0x55e122321850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b59e00640 1 -- 172.21.15.103:0/2072215914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e1222ae9d0 msgr2=0x55e122321310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b59e00640 1 --2- 172.21.15.103:0/2072215914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e1222ae9d0 0x55e122321310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b59e00640 1 -- 172.21.15.103:0/2072215914 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e12210bd90 con 0x55e122262e10 2024-09-10T22:40:06.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b59e00640 1 --2- 172.21.15.103:0/2072215914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e122262e10 0x55e122320dd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5b4801aee0 tx=0x7f5b480fb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c235bfe4a4bebd40 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:06.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b42000640 1 -- 172.21.15.103:0/2072215914 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b48101f00 con 0x55e122262e10 2024-09-10T22:40:06.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b42000640 1 -- 172.21.15.103:0/2072215914 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b48003d20 con 0x55e122262e10 2024-09-10T22:40:06.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b42000640 1 -- 172.21.15.103:0/2072215914 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b480fd130 con 0x55e122262e10 2024-09-10T22:40:06.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b5fd00000 1 -- 172.21.15.103:0/2072215914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e122262e10 msgr2=0x55e122320dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/2072215914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e122262e10 0x55e122320dd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5b4801aee0 tx=0x7f5b480fb040 comp rx=0 tx=0).stop 2024-09-10T22:40:06.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b5fd00000 1 -- 172.21.15.103:0/2072215914 shutdown_connections 2024-09-10T22:40:06.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/2072215914 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1222af2f0 0x55e122321850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/2072215914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e1222ae9d0 0x55e122321310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/2072215914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e122262e10 0x55e122320dd0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b5fd00000 1 -- 172.21.15.103:0/2072215914 >> 172.21.15.103:0/2072215914 conn(0x55e12214c130 msgr2=0x55e12226aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b5fd00000 1 -- 172.21.15.103:0/2072215914 shutdown_connections 2024-09-10T22:40:06.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b5fd00000 1 -- 172.21.15.103:0/2072215914 wait complete. 2024-09-10T22:40:06.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.622+0000 7f5b5fd00000 1 -- start start 2024-09-10T22:40:06.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 1 Processor -- start 2024-09-10T22:40:06.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e122262e10 0x55e122325020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1222ae9d0 0x55e122325560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1222af2f0 0x55e122325aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e1222c5ce0 con 0x55e1222ae9d0 2024-09-10T22:40:06.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e1220b3070 con 0x55e122262e10 2024-09-10T22:40:06.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55e122134a60 con 0x55e1222af2f0 2024-09-10T22:40:06.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 10 client.0 _ll_register_callbacks cb 0x7f5b44013050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:06.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b59400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1222ae9d0 0x55e122325560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b59400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1222ae9d0 0x55e122325560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43376/0 (socket says 172.21.15.103:43376) 2024-09-10T22:40:06.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b59400640 1 -- 172.21.15.103:0/2290093768 learned_addr learned my addr 172.21.15.103:0/2290093768 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:06.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b59e00640 1 --2- 172.21.15.103:0/2290093768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e122262e10 0x55e122325020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5a800640 1 --2- 172.21.15.103:0/2290093768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1222af2f0 0x55e122325aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b59400640 1 -- 172.21.15.103:0/2290093768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1222af2f0 msgr2=0x55e122325aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b59400640 1 --2- 172.21.15.103:0/2290093768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1222af2f0 0x55e122325aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b59400640 1 -- 172.21.15.103:0/2290093768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e122262e10 msgr2=0x55e122325020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b59400640 1 --2- 172.21.15.103:0/2290093768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e122262e10 0x55e122325020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b59400640 1 -- 172.21.15.103:0/2290093768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e122076a90 con 0x55e1222ae9d0 2024-09-10T22:40:06.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b59400640 1 --2- 172.21.15.103:0/2290093768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1222ae9d0 0x55e122325560 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5b4401cb20 tx=0x7f5b4401cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e4c00aa46589a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:06.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b37400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:06.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b37400640 1 -- 172.21.15.103:0/2290093768 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4402a060 con 0x55e1222ae9d0 2024-09-10T22:40:06.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b37400640 1 -- 172.21.15.103:0/2290093768 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f5b4400fc30 con 0x55e1222ae9d0 2024-09-10T22:40:06.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 1 -- 172.21.15.103:0/2290093768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b48003d20 con 0x55e1222ae9d0 2024-09-10T22:40:06.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b37400640 1 -- 172.21.15.103:0/2290093768 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5b44030050 con 0x55e1222ae9d0 2024-09-10T22:40:06.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 10 client.5169 fetch_fsmap learned FSMap version 24 2024-09-10T22:40:06.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 1 -- 172.21.15.103:0/2290093768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55e122055050 con 0x55e1222ae9d0 2024-09-10T22:40:06.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b37400640 1 -- 172.21.15.103:0/2290093768 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b48003d20 con 0x55e1222ae9d0 2024-09-10T22:40:06.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b37400640 1 -- 172.21.15.103:0/2290093768 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 24) ==== 3542+0+0 (secure 0 0 0) 0x7f5b44033020 con 0x55e1222ae9d0 2024-09-10T22:40:06.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 10 client.5169 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:40:06.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 10 client.5169 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T22:40:06.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 20 client.5169 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:06.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/2290093768 >> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] conn(0x55e1222c3c70 0x55e1222c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 4 client.5169 mds_command: new command op to 4920 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:40:06.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 1 -- 172.21.15.103:0/2290093768 --> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] -- command(tid 0: {"prefix": "status"}) -- 0x55e1220be520 con 0x55e1222c3c70 2024-09-10T22:40:06.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b59e00640 1 --2- 172.21.15.103:0/2290093768 >> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] conn(0x55e1222c3c70 0x55e1222c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b59e00640 1 --2- 172.21.15.103:0/2290093768 >> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] conn(0x55e1222c3c70 0x55e1222c2d30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f5cabf69cc9260e6 server_cookie=fc874528b781ce05 in_seq=0 out_seq=0 2024-09-10T22:40:06.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b37400640 10 client.5169 ms_handle_connect on v2:172.21.15.103:6832/4043692269 2024-09-10T22:40:06.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b37400640 1 -- 172.21.15.103:0/2290093768 <== mds.1 v2:172.21.15.103:6832/4043692269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55e1220be520 con 0x55e1222c3c70 2024-09-10T22:40:06.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b37400640 10 client.5169 handle_command_reply: tid=0 2024-09-10T22:40:06.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 1 client.5169 shutdown 2024-09-10T22:40:06.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 1 -- 172.21.15.103:0/2290093768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1222ae9d0 msgr2=0x55e122325560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.626+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/2290093768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1222ae9d0 0x55e122325560 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5b4401cb20 tx=0x7f5b4401cf20 comp rx=0 tx=0).stop 2024-09-10T22:40:06.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5fd00000 1 -- 172.21.15.103:0/2290093768 shutdown_connections 2024-09-10T22:40:06.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/2290093768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e1222af2f0 0x55e122325aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/2290093768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1222ae9d0 0x55e122325560 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/2290093768 >> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] conn(0x55e1222c3c70 0x55e1222c2d30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5fd00000 1 --2- 172.21.15.103:0/2290093768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e122262e10 0x55e122325020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5fd00000 1 -- 172.21.15.103:0/2290093768 >> 172.21.15.103:0/2290093768 conn(0x55e12214c130 msgr2=0x55e12226aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b37400640 0 client.5169 ms_handle_reset on v2:172.21.15.103:6832/4043692269 2024-09-10T22:40:06.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5fd00000 1 -- 172.21.15.103:0/2290093768 shutdown_connections 2024-09-10T22:40:06.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5fd00000 1 -- 172.21.15.103:0/2290093768 wait complete. 2024-09-10T22:40:06.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5fd00000 20 client.5169 trim_cache size 0 max 16384 2024-09-10T22:40:06.638 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:40:06.639 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:40:06.639 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 1, 2024-09-10T22:40:06.639 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4920, 2024-09-10T22:40:06.639 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:40:06.639 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:40:06.639 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:40:06.639 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 2.9875681059999999, 2024-09-10T22:40:06.639 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 24, 2024-09-10T22:40:06.639 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 41, 2024-09-10T22:40:06.639 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 41, 2024-09-10T22:40:06.639 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 24.163013696 2024-09-10T22:40:06.639 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:40:06.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5c800640 1 -- 172.21.15.103:0/962812071 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5b380725e0 msgr2=0x7f5b38074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5c800640 1 --2- 172.21.15.103:0/962812071 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5b380725e0 0x7f5b38074aa0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5b44005fd0 tx=0x7f5b44005da0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5c800640 1 -- 172.21.15.103:0/962812071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b540b09c0 msgr2=0x7f5b540b7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5c800640 1 --2- 172.21.15.103:0/962812071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b540b09c0 0x7f5b540b7050 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5b480b0040 tx=0x7f5b48004040 comp rx=0 tx=0).stop 2024-09-10T22:40:06.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5c800640 1 -- 172.21.15.103:0/962812071 shutdown_connections 2024-09-10T22:40:06.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5c800640 1 --2- 172.21.15.103:0/962812071 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5b380725e0 0x7f5b38074aa0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5c800640 1 --2- 172.21.15.103:0/962812071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b5415be30 0x7f5b541f7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5c800640 1 --2- 172.21.15.103:0/962812071 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b540ceb40 0x7f5b54157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5c800640 1 --2- 172.21.15.103:0/962812071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b540b09c0 0x7f5b540b7050 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5c800640 1 -- 172.21.15.103:0/962812071 >> 172.21.15.103:0/962812071 conn(0x7f5b540d1ac0 msgr2=0x7f5b540d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5c800640 1 -- 172.21.15.103:0/962812071 shutdown_connections 2024-09-10T22:40:06.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.630+0000 7f5b5c800640 1 -- 172.21.15.103:0/962812071 wait complete. 2024-09-10T22:40:06.652 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T22:40:06.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.790+0000 7f16e7200640 1 -- 172.21.15.103:0/4070580436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16e00ae7f0 msgr2=0x7f16e0166bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.790+0000 7f16e7200640 1 --2- 172.21.15.103:0/4070580436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16e00ae7f0 0x7f16e0166bc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009900 tx=0x7f16d801c8e0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.790+0000 7f16e7200640 1 -- 172.21.15.103:0/4070580436 shutdown_connections 2024-09-10T22:40:06.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.790+0000 7f16e7200640 1 --2- 172.21.15.103:0/4070580436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16e00ae7f0 0x7f16e0166bc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.790+0000 7f16e7200640 1 -- 172.21.15.103:0/4070580436 >> 172.21.15.103:0/4070580436 conn(0x7f16e00d1a20 msgr2=0x7f16e00d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.790+0000 7f16e7200640 1 -- 172.21.15.103:0/4070580436 shutdown_connections 2024-09-10T22:40:06.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.790+0000 7f16e7200640 1 -- 172.21.15.103:0/4070580436 wait complete. 2024-09-10T22:40:06.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e7200640 1 Processor -- start 2024-09-10T22:40:06.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e7200640 1 -- start start 2024-09-10T22:40:06.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e7200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16e00ae7f0 0x7f16e00b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e7200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16e00cdd00 0x7f16e00ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e7200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16e015f1a0 0x7f16e0150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e7200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f16e0169dc0 con 0x7f16e015f1a0 2024-09-10T22:40:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e7200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f16e0169c40 con 0x7f16e00ae7f0 2024-09-10T22:40:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e7200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f16e0169f40 con 0x7f16e00cdd00 2024-09-10T22:40:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e5200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16e015f1a0 0x7f16e0150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e5200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16e015f1a0 0x7f16e0150e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56046/0 (socket says 172.21.15.103:56046) 2024-09-10T22:40:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e5200640 1 -- 172.21.15.103:0/3956003201 learned_addr learned my addr 172.21.15.103:0/3956003201 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e5200640 1 -- 172.21.15.103:0/3956003201 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16e00cdd00 msgr2=0x7f16e00ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16d7400640 1 --2- 172.21.15.103:0/3956003201 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16e00cdd00 0x7f16e00ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16dfe00640 1 --2- 172.21.15.103:0/3956003201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16e00ae7f0 0x7f16e00b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e5200640 1 --2- 172.21.15.103:0/3956003201 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16e00cdd00 0x7f16e00ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e5200640 1 -- 172.21.15.103:0/3956003201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16e00ae7f0 msgr2=0x7f16e00b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e5200640 1 --2- 172.21.15.103:0/3956003201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16e00ae7f0 0x7f16e00b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e5200640 1 -- 172.21.15.103:0/3956003201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e00ca860 con 0x7f16e015f1a0 2024-09-10T22:40:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16dfe00640 1 --2- 172.21.15.103:0/3956003201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16e00ae7f0 0x7f16e00b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:40:06.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16d7400640 1 --2- 172.21.15.103:0/3956003201 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16e00cdd00 0x7f16e00ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:40:06.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e5200640 1 --2- 172.21.15.103:0/3956003201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16e015f1a0 0x7f16e0150e30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f16d80b0040 tx=0x7f16d80a5700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:06.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16dcc00640 1 -- 172.21.15.103:0/3956003201 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d80bb070 con 0x7f16e015f1a0 2024-09-10T22:40:06.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16dcc00640 1 -- 172.21.15.103:0/3956003201 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16d80044b0 con 0x7f16e015f1a0 2024-09-10T22:40:06.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16dcc00640 1 -- 172.21.15.103:0/3956003201 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d80b2040 con 0x7f16e015f1a0 2024-09-10T22:40:06.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e7200640 1 -- 172.21.15.103:0/3956003201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e00cab40 con 0x7f16e015f1a0 2024-09-10T22:40:06.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.794+0000 7f16e7200640 1 -- 172.21.15.103:0/3956003201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e00cb100 con 0x7f16e015f1a0 2024-09-10T22:40:06.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16dcc00640 1 -- 172.21.15.103:0/3956003201 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f16d80052d0 con 0x7f16e015f1a0 2024-09-10T22:40:06.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16dcc00640 1 --2- 172.21.15.103:0/3956003201 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16bc0725e0 0x7f16bc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16dcc00640 1 -- 172.21.15.103:0/3956003201 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f16d812ce20 con 0x7f16e015f1a0 2024-09-10T22:40:06.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16ea6c8000 1 Processor -- start 2024-09-10T22:40:06.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16ea6c8000 1 -- start start 2024-09-10T22:40:06.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16dfe00640 1 --2- 172.21.15.103:0/3956003201 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16bc0725e0 0x7f16bc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16ea6c8000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da8049d0 0x55e8da804db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16ea6c8000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8052f0 0x55e8da7b88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16ea6c8000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da7b8e10 0x55e8da7b91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16ea6c8000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e8da6d93f0 con 0x55e8da7b8e10 2024-09-10T22:40:06.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16ea6c8000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e8da616b20 con 0x55e8da8052f0 2024-09-10T22:40:06.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16ea6c8000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55e8da605f50 con 0x55e8da8049d0 2024-09-10T22:40:06.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16e5200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da7b8e10 0x55e8da7b91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16dfe00640 1 --2- 172.21.15.103:0/3956003201 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16bc0725e0 0x7f16bc074aa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f16d0007e90 tx=0x7f16d00073a0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:06.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16e5200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da7b8e10 0x55e8da7b91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56054/0 (socket says 172.21.15.103:56054) 2024-09-10T22:40:06.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16e5200640 1 -- 172.21.15.103:0/665983406 learned_addr learned my addr 172.21.15.103:0/665983406 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:06.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16d7400640 1 --2- 172.21.15.103:0/665983406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8052f0 0x55e8da7b88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16dfe00640 1 --2- 172.21.15.103:0/665983406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da8049d0 0x55e8da804db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16e5200640 1 -- 172.21.15.103:0/665983406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da8049d0 msgr2=0x55e8da804db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16e5200640 1 --2- 172.21.15.103:0/665983406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da8049d0 0x55e8da804db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16e5200640 1 -- 172.21.15.103:0/665983406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8052f0 msgr2=0x55e8da7b88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16e5200640 1 --2- 172.21.15.103:0/665983406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8052f0 0x55e8da7b88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16e5200640 1 -- 172.21.15.103:0/665983406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8da5cd590 con 0x55e8da7b8e10 2024-09-10T22:40:06.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16e5200640 1 --2- 172.21.15.103:0/665983406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da7b8e10 0x55e8da7b91f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f16d80f78d0 tx=0x7f16d80f4350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d075aa927865785 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:06.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16d4c00640 1 -- 172.21.15.103:0/665983406 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d80f76e0 con 0x55e8da7b8e10 2024-09-10T22:40:06.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16d4c00640 1 -- 172.21.15.103:0/665983406 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16d80f7bd0 con 0x55e8da7b8e10 2024-09-10T22:40:06.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.798+0000 7f16d4c00640 1 -- 172.21.15.103:0/665983406 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d80fc6b0 con 0x55e8da7b8e10 2024-09-10T22:40:06.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 -- 172.21.15.103:0/665983406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da7b8e10 msgr2=0x55e8da7b91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/665983406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da7b8e10 0x55e8da7b91f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f16d80f78d0 tx=0x7f16d80f4350 comp rx=0 tx=0).stop 2024-09-10T22:40:06.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 -- 172.21.15.103:0/665983406 shutdown_connections 2024-09-10T22:40:06.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/665983406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da7b8e10 0x55e8da7b91f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/665983406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8052f0 0x55e8da7b88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/665983406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da8049d0 0x55e8da804db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 -- 172.21.15.103:0/665983406 >> 172.21.15.103:0/665983406 conn(0x55e8da6a2130 msgr2=0x55e8da7e7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 -- 172.21.15.103:0/665983406 shutdown_connections 2024-09-10T22:40:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 -- 172.21.15.103:0/665983406 wait complete. 2024-09-10T22:40:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 -- start start 2024-09-10T22:40:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 Processor -- start 2024-09-10T22:40:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da7b8e10 0x55e8da7e56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8049d0 0x55e8da7e5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da8052f0 0x55e8da7e63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e8da5a05d0 con 0x55e8da7b8e10 2024-09-10T22:40:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e8da609d60 con 0x55e8da8049d0 2024-09-10T22:40:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55e8da5ac500 con 0x55e8da8052f0 2024-09-10T22:40:06.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 10 client.0 _ll_register_callbacks cb 0x55e8da5b0810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:06.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16dfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da7b8e10 0x55e8da7e56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16dfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da7b8e10 0x55e8da7e56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56068/0 (socket says 172.21.15.103:56068) 2024-09-10T22:40:06.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16dfe00640 1 -- 172.21.15.103:0/1049477666 learned_addr learned my addr 172.21.15.103:0/1049477666 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:06.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16d7400640 1 --2- 172.21.15.103:0/1049477666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8049d0 0x55e8da7e5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16e5200640 1 --2- 172.21.15.103:0/1049477666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da8052f0 0x55e8da7e63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16dfe00640 1 -- 172.21.15.103:0/1049477666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da8052f0 msgr2=0x55e8da7e63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16dfe00640 1 --2- 172.21.15.103:0/1049477666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da8052f0 0x55e8da7e63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16dfe00640 1 -- 172.21.15.103:0/1049477666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8049d0 msgr2=0x55e8da7e5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16dfe00640 1 --2- 172.21.15.103:0/1049477666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8049d0 0x55e8da7e5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16dfe00640 1 -- 172.21.15.103:0/1049477666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8da5a4170 con 0x55e8da7b8e10 2024-09-10T22:40:06.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16e5200640 1 --2- 172.21.15.103:0/1049477666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da8052f0 0x55e8da7e63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:40:06.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16dfe00640 1 --2- 172.21.15.103:0/1049477666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da7b8e10 0x55e8da7e56a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f16d000fe40 tx=0x7f16d0004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93766dc83a6dc58 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16cd600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16cd600640 1 -- 172.21.15.103:0/1049477666 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d0025400 con 0x55e8da7b8e10 2024-09-10T22:40:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16cd600640 1 -- 172.21.15.103:0/1049477666 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f16d0026de0 con 0x55e8da7b8e10 2024-09-10T22:40:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 -- 172.21.15.103:0/1049477666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e8da59e0f0 con 0x55e8da7b8e10 2024-09-10T22:40:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16cd600640 1 -- 172.21.15.103:0/1049477666 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f16d00255a0 con 0x55e8da7b8e10 2024-09-10T22:40:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 10 client.5184 fetch_fsmap learned FSMap version 24 2024-09-10T22:40:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.802+0000 7f16ea6c8000 1 -- 172.21.15.103:0/1049477666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55e8da68aef0 con 0x55e8da7b8e10 2024-09-10T22:40:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16cd600640 1 -- 172.21.15.103:0/1049477666 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55e8da59e0f0 con 0x55e8da7b8e10 2024-09-10T22:40:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16cd600640 1 -- 172.21.15.103:0/1049477666 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 24) ==== 3542+0+0 (secure 0 0 0) 0x7f16d0025830 con 0x55e8da7b8e10 2024-09-10T22:40:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16ea6c8000 10 client.5184 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:40:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16ea6c8000 10 client.5184 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:40:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16ea6c8000 20 client.5184 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:06.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/1049477666 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x55e8da7e70f0 0x55e8da816c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16ea6c8000 4 client.5184 mds_command: new command op to 4941 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:40:06.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16ea6c8000 1 -- 172.21.15.103:0/1049477666 --> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8da618a70 con 0x55e8da7e70f0 2024-09-10T22:40:06.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16d7400640 1 --2- 172.21.15.103:0/1049477666 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x55e8da7e70f0 0x55e8da816c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16d7400640 1 --2- 172.21.15.103:0/1049477666 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x55e8da7e70f0 0x55e8da816c90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97628bccb008b716 server_cookie=452adcc16d5c21fb in_seq=0 out_seq=0 2024-09-10T22:40:06.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16cd600640 10 client.5184 ms_handle_connect on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:06.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16cd600640 1 -- 172.21.15.103:0/1049477666 <== mds.0 v2:172.21.15.103:6834/1194009116 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e8da618a70 con 0x55e8da7e70f0 2024-09-10T22:40:06.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16cd600640 10 client.5184 handle_command_reply: tid=0 2024-09-10T22:40:06.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16ea6c8000 1 client.5184 shutdown 2024-09-10T22:40:06.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16ea6c8000 1 -- 172.21.15.103:0/1049477666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da7b8e10 msgr2=0x55e8da7e56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/1049477666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da7b8e10 0x55e8da7e56a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f16d000fe40 tx=0x7f16d0004a80 comp rx=0 tx=0).stop 2024-09-10T22:40:06.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16ea6c8000 1 -- 172.21.15.103:0/1049477666 shutdown_connections 2024-09-10T22:40:06.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/1049477666 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x55e8da7e70f0 0x55e8da816c90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/1049477666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da8052f0 0x55e8da7e63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/1049477666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8049d0 0x55e8da7e5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16cd600640 0 client.5184 ms_handle_reset on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:06.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/1049477666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da7b8e10 0x55e8da7e56a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16ea6c8000 1 -- 172.21.15.103:0/1049477666 >> 172.21.15.103:0/1049477666 conn(0x55e8da6a2130 msgr2=0x55e8da7b7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16ea6c8000 1 -- 172.21.15.103:0/1049477666 shutdown_connections 2024-09-10T22:40:06.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16ea6c8000 1 -- 172.21.15.103:0/1049477666 wait complete. 2024-09-10T22:40:06.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.806+0000 7f16ea6c8000 20 client.5184 trim_cache size 0 max 16384 2024-09-10T22:40:06.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16ea6c8000 1 Processor -- start 2024-09-10T22:40:06.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16ea6c8000 1 -- start start 2024-09-10T22:40:06.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16ea6c8000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da7b8e10 0x55e8da87f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16ea6c8000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8049d0 0x55e8da87f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16ea6c8000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da8052f0 0x55e8da87fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16ea6c8000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f16e0201f90 con 0x55e8da8052f0 2024-09-10T22:40:06.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16ea6c8000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f16e02011f0 con 0x55e8da8049d0 2024-09-10T22:40:06.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16ea6c8000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f16e02018c0 con 0x55e8da7b8e10 2024-09-10T22:40:06.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16e5200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da8052f0 0x55e8da87fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16e5200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da8052f0 0x55e8da87fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56082/0 (socket says 172.21.15.103:56082) 2024-09-10T22:40:06.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16e5200640 1 -- 172.21.15.103:0/3479657179 learned_addr learned my addr 172.21.15.103:0/3479657179 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:06.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16d7400640 1 --2- 172.21.15.103:0/3479657179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8049d0 0x55e8da87f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16dfe00640 1 --2- 172.21.15.103:0/3479657179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da7b8e10 0x55e8da87f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16e5200640 1 -- 172.21.15.103:0/3479657179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da7b8e10 msgr2=0x55e8da87f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16e5200640 1 --2- 172.21.15.103:0/3479657179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da7b8e10 0x55e8da87f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16e5200640 1 -- 172.21.15.103:0/3479657179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8049d0 msgr2=0x55e8da87f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16e5200640 1 --2- 172.21.15.103:0/3479657179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8049d0 0x55e8da87f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16e5200640 1 -- 172.21.15.103:0/3479657179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8da661d90 con 0x55e8da8052f0 2024-09-10T22:40:06.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16e5200640 1 --2- 172.21.15.103:0/3479657179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da8052f0 0x55e8da87fe50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f16d801cdc0 tx=0x7f16d812aff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7587826a5112779 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:06.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16cfe00640 1 -- 172.21.15.103:0/3479657179 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d80f76e0 con 0x55e8da8052f0 2024-09-10T22:40:06.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16cfe00640 1 -- 172.21.15.103:0/3479657179 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16d80f82d0 con 0x55e8da8052f0 2024-09-10T22:40:06.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16cfe00640 1 -- 172.21.15.103:0/3479657179 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d81010d0 con 0x55e8da8052f0 2024-09-10T22:40:06.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16ea6c8000 1 -- 172.21.15.103:0/3479657179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da8052f0 msgr2=0x55e8da87fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/3479657179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da8052f0 0x55e8da87fe50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f16d801cdc0 tx=0x7f16d812aff0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16ea6c8000 1 -- 172.21.15.103:0/3479657179 shutdown_connections 2024-09-10T22:40:06.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/3479657179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da8052f0 0x55e8da87fe50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/3479657179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8049d0 0x55e8da87f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/3479657179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da7b8e10 0x55e8da87f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16ea6c8000 1 -- 172.21.15.103:0/3479657179 >> 172.21.15.103:0/3479657179 conn(0x55e8da6a2130 msgr2=0x55e8da7c0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16ea6c8000 1 -- 172.21.15.103:0/3479657179 shutdown_connections 2024-09-10T22:40:06.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.826+0000 7f16ea6c8000 1 -- 172.21.15.103:0/3479657179 wait complete. 2024-09-10T22:40:06.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16ea6c8000 1 -- start start 2024-09-10T22:40:06.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16ea6c8000 1 Processor -- start 2024-09-10T22:40:06.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16ea6c8000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da7b8e10 0x55e8da883200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16ea6c8000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da8049d0 0x55e8da883740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16ea6c8000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8052f0 0x55e8da883c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16ea6c8000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e8da7b2d80 con 0x55e8da8049d0 2024-09-10T22:40:06.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16ea6c8000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e8da68aa60 con 0x55e8da8052f0 2024-09-10T22:40:06.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16ea6c8000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55e8da609070 con 0x55e8da7b8e10 2024-09-10T22:40:06.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16ea6c8000 10 client.0 _ll_register_callbacks cb 0x7f16d000ce90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:06.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16d7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da8049d0 0x55e8da883740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16d7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da8049d0 0x55e8da883740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56086/0 (socket says 172.21.15.103:56086) 2024-09-10T22:40:06.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16d7400640 1 -- 172.21.15.103:0/1143482589 learned_addr learned my addr 172.21.15.103:0/1143482589 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:06.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16dfe00640 1 --2- 172.21.15.103:0/1143482589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da7b8e10 0x55e8da883200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16e5200640 1 --2- 172.21.15.103:0/1143482589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8052f0 0x55e8da883c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16d7400640 1 -- 172.21.15.103:0/1143482589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da7b8e10 msgr2=0x55e8da883200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16d7400640 1 --2- 172.21.15.103:0/1143482589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da7b8e10 0x55e8da883200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16d7400640 1 -- 172.21.15.103:0/1143482589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8052f0 msgr2=0x55e8da883c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:06.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16d7400640 1 --2- 172.21.15.103:0/1143482589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8052f0 0x55e8da883c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16d7400640 1 -- 172.21.15.103:0/1143482589 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8da5cca90 con 0x55e8da8049d0 2024-09-10T22:40:06.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16d7400640 1 --2- 172.21.15.103:0/1143482589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da8049d0 0x55e8da883740 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f16e00c8940 tx=0x7f16c8001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3531f63df50a33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:06.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16cd600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:06.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16cd600640 1 -- 172.21.15.103:0/1143482589 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c80158c0 con 0x55e8da8049d0 2024-09-10T22:40:06.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16cd600640 1 -- 172.21.15.103:0/1143482589 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f16c8023b00 con 0x55e8da8049d0 2024-09-10T22:40:06.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16ea6c8000 1 -- 172.21.15.103:0/1143482589 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16d80f82d0 con 0x55e8da8049d0 2024-09-10T22:40:06.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16cd600640 1 -- 172.21.15.103:0/1143482589 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f16c802c070 con 0x55e8da8049d0 2024-09-10T22:40:06.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16ea6c8000 10 client.5190 fetch_fsmap learned FSMap version 24 2024-09-10T22:40:06.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16ea6c8000 1 -- 172.21.15.103:0/1143482589 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55e8da5ab050 con 0x55e8da8049d0 2024-09-10T22:40:06.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16cd600640 1 -- 172.21.15.103:0/1143482589 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16d80f82d0 con 0x55e8da8049d0 2024-09-10T22:40:06.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16cd600640 1 -- 172.21.15.103:0/1143482589 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 24) ==== 3542+0+0 (secure 0 0 0) 0x7f16c8015a60 con 0x55e8da8049d0 2024-09-10T22:40:06.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16ea6c8000 10 client.5190 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:40:06.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16ea6c8000 10 client.5190 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:40:06.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16ea6c8000 20 client.5190 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:06.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/1143482589 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x55e8da81a400 0x55e8da819540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:06.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16ea6c8000 4 client.5190 mds_command: new command op to 4941 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:40:06.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16ea6c8000 1 -- 172.21.15.103:0/1143482589 --> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] -- command(tid 0: {"prefix": "status"}) -- 0x55e8da614520 con 0x55e8da81a400 2024-09-10T22:40:06.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16dfe00640 1 --2- 172.21.15.103:0/1143482589 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x55e8da81a400 0x55e8da819540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:06.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16dfe00640 1 --2- 172.21.15.103:0/1143482589 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x55e8da81a400 0x55e8da819540 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8132b7a84ce1182 server_cookie=81ac61f4b1f6bebb in_seq=0 out_seq=0 2024-09-10T22:40:06.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.830+0000 7f16cd600640 10 client.5190 ms_handle_connect on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:06.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16cd600640 1 -- 172.21.15.103:0/1143482589 <== mds.0 v2:172.21.15.103:6834/1194009116 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55e8da614520 con 0x55e8da81a400 2024-09-10T22:40:06.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16cd600640 10 client.5190 handle_command_reply: tid=0 2024-09-10T22:40:06.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16ea6c8000 1 client.5190 shutdown 2024-09-10T22:40:06.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16ea6c8000 1 -- 172.21.15.103:0/1143482589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da8049d0 msgr2=0x55e8da883740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/1143482589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da8049d0 0x55e8da883740 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f16e00c8940 tx=0x7f16c8001090 comp rx=0 tx=0).stop 2024-09-10T22:40:06.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16ea6c8000 1 -- 172.21.15.103:0/1143482589 shutdown_connections 2024-09-10T22:40:06.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/1143482589 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x55e8da81a400 0x55e8da819540 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/1143482589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8da8052f0 0x55e8da883c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/1143482589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8da8049d0 0x55e8da883740 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16ea6c8000 1 --2- 172.21.15.103:0/1143482589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8da7b8e10 0x55e8da883200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16cd600640 0 client.5190 ms_handle_reset on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:06.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16ea6c8000 1 -- 172.21.15.103:0/1143482589 >> 172.21.15.103:0/1143482589 conn(0x55e8da6a2130 msgr2=0x55e8da8035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16ea6c8000 1 -- 172.21.15.103:0/1143482589 shutdown_connections 2024-09-10T22:40:06.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16ea6c8000 1 -- 172.21.15.103:0/1143482589 wait complete. 2024-09-10T22:40:06.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16ea6c8000 20 client.5190 trim_cache size 0 max 16384 2024-09-10T22:40:06.844 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:40:06.844 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:40:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-10T22:40:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4941, 2024-09-10T22:40:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:40:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:40:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:40:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 11.260877658, 2024-09-10T22:40:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 24, 2024-09-10T22:40:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 41, 2024-09-10T22:40:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 41, 2024-09-10T22:40:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 18.399075681999999 2024-09-10T22:40:06.846 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:40:06.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16e7200640 1 -- 172.21.15.103:0/3956003201 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16bc0725e0 msgr2=0x7f16bc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16e7200640 1 --2- 172.21.15.103:0/3956003201 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16bc0725e0 0x7f16bc074aa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f16d0007e90 tx=0x7f16d00073a0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16e7200640 1 -- 172.21.15.103:0/3956003201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16e015f1a0 msgr2=0x7f16e0150e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16e7200640 1 --2- 172.21.15.103:0/3956003201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16e015f1a0 0x7f16e0150e30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f16d80b0040 tx=0x7f16d80a5700 comp rx=0 tx=0).stop 2024-09-10T22:40:06.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16e7200640 1 -- 172.21.15.103:0/3956003201 shutdown_connections 2024-09-10T22:40:06.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16e7200640 1 --2- 172.21.15.103:0/3956003201 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16bc0725e0 0x7f16bc074aa0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16e7200640 1 --2- 172.21.15.103:0/3956003201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16e015f1a0 0x7f16e0150e30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16e7200640 1 --2- 172.21.15.103:0/3956003201 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16e00cdd00 0x7f16e00ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16e7200640 1 --2- 172.21.15.103:0/3956003201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16e00ae7f0 0x7f16e00b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16e7200640 1 -- 172.21.15.103:0/3956003201 >> 172.21.15.103:0/3956003201 conn(0x7f16e00d1a20 msgr2=0x7f16e0071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16e7200640 1 -- 172.21.15.103:0/3956003201 shutdown_connections 2024-09-10T22:40:06.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.834+0000 7f16e7200640 1 -- 172.21.15.103:0/3956003201 wait complete. 2024-09-10T22:40:06.856 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:40:06.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.990+0000 7fec0ae00640 1 -- 172.21.15.103:0/3411303901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec0406f0c0 msgr2=0x7fec04073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:06.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.990+0000 7fec0ae00640 1 --2- 172.21.15.103:0/3411303901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec0406f0c0 0x7fec04073610 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fec040cc6e0 tx=0x7febf001c8c0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec0ae00640 1 -- 172.21.15.103:0/3411303901 shutdown_connections 2024-09-10T22:40:06.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec0ae00640 1 --2- 172.21.15.103:0/3411303901 >> v2:172.21.15.131:3300/0 conn(0x7fec040cfdd0 0x7fec04073b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec0ae00640 1 --2- 172.21.15.103:0/3411303901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec0406f0c0 0x7fec04073610 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec0ae00640 1 --2- 172.21.15.103:0/3411303901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec040cf9f0 0x7fec0406eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:06.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec0ae00640 1 -- 172.21.15.103:0/3411303901 >> 172.21.15.103:0/3411303901 conn(0x7fec0406cc00 msgr2=0x7fec0406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:06.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec0ae00640 1 -- 172.21.15.103:0/3411303901 shutdown_connections 2024-09-10T22:40:06.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec0ae00640 1 -- 172.21.15.103:0/3411303901 wait complete. 2024-09-10T22:40:06.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec0ae00640 1 Processor -- start 2024-09-10T22:40:06.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec0ae00640 1 -- start start 2024-09-10T22:40:07.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec0ae00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec0406f0c0 0x7fec04144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:07.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec0ae00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec040cf9f0 0x7fec040b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:07.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec0ae00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec040cfdd0 0x7fec04156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:07.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec0ae00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fec040ccab0 con 0x7fec040cf9f0 2024-09-10T22:40:07.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec0ae00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fec040cc930 con 0x7fec040cfdd0 2024-09-10T22:40:07.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec0ae00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fec040ccc30 con 0x7fec0406f0c0 2024-09-10T22:40:07.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec03400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec040cf9f0 0x7fec040b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:07.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec03400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec040cf9f0 0x7fec040b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56106/0 (socket says 172.21.15.103:56106) 2024-09-10T22:40:07.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec03400640 1 -- 172.21.15.103:0/3622046431 learned_addr learned my addr 172.21.15.103:0/3622046431 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:07.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec03e00640 1 --2- 172.21.15.103:0/3622046431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec0406f0c0 0x7fec04144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:07.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec08e00640 1 --2- 172.21.15.103:0/3622046431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec040cfdd0 0x7fec04156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:07.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec03400640 1 -- 172.21.15.103:0/3622046431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec0406f0c0 msgr2=0x7fec04144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:07.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec03400640 1 --2- 172.21.15.103:0/3622046431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec0406f0c0 0x7fec04144360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:07.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec03400640 1 -- 172.21.15.103:0/3622046431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec040cfdd0 msgr2=0x7fec04156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:07.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec03400640 1 --2- 172.21.15.103:0/3622046431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec040cfdd0 0x7fec04156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:07.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec03400640 1 -- 172.21.15.103:0/3622046431 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0414bb00 con 0x7fec040cf9f0 2024-09-10T22:40:07.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.994+0000 7fec03400640 1 --2- 172.21.15.103:0/3622046431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec040cf9f0 0x7fec040b1040 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7febf001af70 tx=0x7febf0005e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.998+0000 7febfbe00640 1 -- 172.21.15.103:0/3622046431 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf00b2040 con 0x7fec040cf9f0 2024-09-10T22:40:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.998+0000 7febfbe00640 1 -- 172.21.15.103:0/3622046431 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febf0004400 con 0x7fec040cf9f0 2024-09-10T22:40:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.998+0000 7febfbe00640 1 -- 172.21.15.103:0/3622046431 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf00052d0 con 0x7fec040cf9f0 2024-09-10T22:40:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.998+0000 7fec0ae00640 1 -- 172.21.15.103:0/3622046431 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0414bde0 con 0x7fec040cf9f0 2024-09-10T22:40:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.998+0000 7fec0ae00640 1 -- 172.21.15.103:0/3622046431 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec0414c3a0 con 0x7fec040cf9f0 2024-09-10T22:40:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.998+0000 7fec0ae00640 1 -- 172.21.15.103:0/3622046431 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec0406eb80 con 0x7fec040cf9f0 2024-09-10T22:40:07.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.998+0000 7febfbe00640 1 -- 172.21.15.103:0/3622046431 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7febf0005470 con 0x7fec040cf9f0 2024-09-10T22:40:07.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.998+0000 7febfbe00640 1 --2- 172.21.15.103:0/3622046431 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7febe40725e0 0x7febe4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:07.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.998+0000 7febfbe00640 1 -- 172.21.15.103:0/3622046431 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7febf012c810 con 0x7fec040cf9f0 2024-09-10T22:40:07.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:06.998+0000 7fec03e00640 1 --2- 172.21.15.103:0/3622046431 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7febe40725e0 0x7febe4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:07.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:07.002+0000 7fec03e00640 1 --2- 172.21.15.103:0/3622046431 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7febe40725e0 0x7febe4074aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7febf400bc00 tx=0x7febf400b390 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:07.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:07.002+0000 7febfbe00640 1 -- 172.21.15.103:0/3622046431 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7febf00164b0 con 0x7fec040cf9f0 2024-09-10T22:40:07.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:07.202+0000 7fec0ae00640 1 -- 172.21.15.103:0/3622046431 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec04158010 con 0x7fec040cf9f0 2024-09-10T22:40:07.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:07.202+0000 7febfbe00640 1 -- 172.21.15.103:0/3622046431 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5273 (secure 0 0 0) 0x7febf00f7710 con 0x7fec040cf9f0 2024-09-10T22:40:07.206 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:40:07.206 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"btime":"2024-09-10T22:40:05:653070+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/3313045987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3313045987},{"type":"v1","addr":"172.21.15.131:6836","nonce":3313045987}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:39:54.979240+0000","modified":"2024-09-10T22:40:05.653066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4941,"mds_1":4920,"mds_2":4754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4754":{"gid":4754,"name":"d","rank":2,"incarnation":23,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6837/1068577002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1068577002},{"type":"v1","addr":"172.21.15.131:6837","nonce":1068577002}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4920":{"gid":4920,"name":"a","rank":1,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.103:6833/4043692269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4043692269},{"type":"v1","addr":"172.21.15.103:6833","nonce":4043692269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4941":{"gid":4941,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/1194009116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1194009116},{"type":"v1","addr":"172.21.15.103:6835","nonce":1194009116}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4941,"qdb_cluster":[4754,4920,4941]},"id":2}]} 2024-09-10T22:40:07.207 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 24 2024-09-10T22:40:07.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:07.202+0000 7fec0ae00640 1 -- 172.21.15.103:0/3622046431 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7febe40725e0 msgr2=0x7febe4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:07.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:07.202+0000 7fec0ae00640 1 --2- 172.21.15.103:0/3622046431 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7febe40725e0 0x7febe4074aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7febf400bc00 tx=0x7febf400b390 comp rx=0 tx=0).stop 2024-09-10T22:40:07.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:07.202+0000 7fec0ae00640 1 -- 172.21.15.103:0/3622046431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec040cf9f0 msgr2=0x7fec040b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:07.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:07.202+0000 7fec0ae00640 1 --2- 172.21.15.103:0/3622046431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec040cf9f0 0x7fec040b1040 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7febf001af70 tx=0x7febf0005e90 comp rx=0 tx=0).stop 2024-09-10T22:40:07.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:07.202+0000 7fec0ae00640 1 -- 172.21.15.103:0/3622046431 shutdown_connections 2024-09-10T22:40:07.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:07.202+0000 7fec0ae00640 1 --2- 172.21.15.103:0/3622046431 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7febe40725e0 0x7febe4074aa0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:07.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:07.202+0000 7fec0ae00640 1 --2- 172.21.15.103:0/3622046431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec040cfdd0 0x7fec04156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:07.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:07.202+0000 7fec0ae00640 1 --2- 172.21.15.103:0/3622046431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec040cf9f0 0x7fec040b1040 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:07.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:07.202+0000 7fec0ae00640 1 --2- 172.21.15.103:0/3622046431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec0406f0c0 0x7fec04144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:07.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:07.202+0000 7fec0ae00640 1 -- 172.21.15.103:0/3622046431 >> 172.21.15.103:0/3622046431 conn(0x7fec0406cc00 msgr2=0x7fec040b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:07.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:07.202+0000 7fec0ae00640 1 -- 172.21.15.103:0/3622046431 shutdown_connections 2024-09-10T22:40:07.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:07.202+0000 7fec0ae00640 1 -- 172.21.15.103:0/3622046431 wait complete. 2024-09-10T22:40:07.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:07.228 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-10T22:40:07.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:07.258 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-10T22:40:07.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:07.323 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2024-09-10T22:40:07.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:07.374 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2024-09-10T22:40:07.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:07.426 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2024-09-10T22:40:07.483 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:40:07.682 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:40:07.683 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:40:07.683 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:40:09.683 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:40:09.849 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:40:09.850 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:40:09.850 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:40:11.851 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:40:12.017 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:40:12.018 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:40:12.018 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:40:14.019 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:40:14.186 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2024-09-10T22:40:14.187 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-10T22:40:14.187 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:40:14.187 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:40:14.342 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-10T22:40:14.342 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:40:14.343 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:40:16.343 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:40:16.499 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:40:16.503 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:40:16.511 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-10T22:40:16.512 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:40:16.512 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:40:18.513 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:40:18.685 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2024-09-10T22:40:18.685 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-10T22:40:18.685 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:40:18.686 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-10T22:40:18.855 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:40:18.856 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:40:18.856 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:40:18.857 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 flush journal 2024-09-10T22:40:19.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:18.997+0000 7fe6dda00640 1 -- 172.21.15.103:0/3936348500 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6d8072a40 msgr2=0x7fe6d8157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:18.997+0000 7fe6dda00640 1 --2- 172.21.15.103:0/3936348500 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6d8072a40 0x7fe6d8157090 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0009c80 tx=0x7fe6d001cda0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:18.997+0000 7fe6dda00640 1 -- 172.21.15.103:0/3936348500 shutdown_connections 2024-09-10T22:40:19.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:18.997+0000 7fe6dda00640 1 --2- 172.21.15.103:0/3936348500 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6d8072a40 0x7fe6d8157090 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:18.997+0000 7fe6dda00640 1 --2- 172.21.15.103:0/3936348500 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6d80b3320 0x7fe6d8072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:18.997+0000 7fe6dda00640 1 -- 172.21.15.103:0/3936348500 >> 172.21.15.103:0/3936348500 conn(0x7fe6d806cc00 msgr2=0x7fe6d806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:19.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:18.997+0000 7fe6dda00640 1 -- 172.21.15.103:0/3936348500 shutdown_connections 2024-09-10T22:40:19.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:18.997+0000 7fe6dda00640 1 -- 172.21.15.103:0/3936348500 wait complete. 2024-09-10T22:40:19.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6dda00640 1 Processor -- start 2024-09-10T22:40:19.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6dda00640 1 -- start start 2024-09-10T22:40:19.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6dda00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6d8072a40 0x7fe6d81560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6dda00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6d80b3320 0x7fe6d80b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6dda00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6d80cf260 0x7fe6d80b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6dda00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d806e960 con 0x7fe6d80cf260 2024-09-10T22:40:19.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6dda00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d806e7e0 con 0x7fe6d80b3320 2024-09-10T22:40:19.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6dda00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d806eae0 con 0x7fe6d8072a40 2024-09-10T22:40:19.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6d7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6d80cf260 0x7fe6d80b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6cfe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6d80b3320 0x7fe6d80b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6d6a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6d8072a40 0x7fe6d81560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6cfe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6d80b3320 0x7fe6d80b15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:45158/0 (socket says 172.21.15.103:45158) 2024-09-10T22:40:19.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6d7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6d80cf260 0x7fe6d80b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55056/0 (socket says 172.21.15.103:55056) 2024-09-10T22:40:19.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6cfe00640 1 -- 172.21.15.103:0/2845842106 learned_addr learned my addr 172.21.15.103:0/2845842106 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:19.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6cfe00640 1 -- 172.21.15.103:0/2845842106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6d8072a40 msgr2=0x7fe6d81560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6cfe00640 1 --2- 172.21.15.103:0/2845842106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6d8072a40 0x7fe6d81560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6cfe00640 1 -- 172.21.15.103:0/2845842106 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6d80cf260 msgr2=0x7fe6d80b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6cfe00640 1 --2- 172.21.15.103:0/2845842106 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6d80cf260 0x7fe6d80b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6cfe00640 1 -- 172.21.15.103:0/2845842106 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d80af1b0 con 0x7fe6d80b3320 2024-09-10T22:40:19.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6d7400640 1 --2- 172.21.15.103:0/2845842106 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6d80cf260 0x7fe6d80b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:40:19.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6cfe00640 1 --2- 172.21.15.103:0/2845842106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6d80b3320 0x7fe6d80b15b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe6c000ea90 tx=0x7fe6c000ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:19.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6cea00640 1 -- 172.21.15.103:0/2845842106 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c001b070 con 0x7fe6d80b3320 2024-09-10T22:40:19.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6cea00640 1 -- 172.21.15.103:0/2845842106 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6c000cdd0 con 0x7fe6d80b3320 2024-09-10T22:40:19.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6cea00640 1 -- 172.21.15.103:0/2845842106 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0016670 con 0x7fe6d80b3320 2024-09-10T22:40:19.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6dda00640 1 -- 172.21.15.103:0/2845842106 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d81f6040 con 0x7fe6d80b3320 2024-09-10T22:40:19.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.001+0000 7fe6dda00640 1 -- 172.21.15.103:0/2845842106 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d81f5430 con 0x7fe6d80b3320 2024-09-10T22:40:19.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6cea00640 1 -- 172.21.15.103:0/2845842106 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe6c000b040 con 0x7fe6d80b3320 2024-09-10T22:40:19.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6cea00640 1 --2- 172.21.15.103:0/2845842106 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe6b40725e0 0x7fe6b4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6e0d87000 1 Processor -- start 2024-09-10T22:40:19.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6cea00640 1 -- 172.21.15.103:0/2845842106 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fe6c00936f0 con 0x7fe6d80b3320 2024-09-10T22:40:19.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6e0d87000 1 -- start start 2024-09-10T22:40:19.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6d6a00640 1 --2- 172.21.15.103:0/2845842106 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe6b40725e0 0x7fe6b4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6d6a00640 1 --2- 172.21.15.103:0/2845842106 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe6b40725e0 0x7fe6b4074aa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe6c80055f0 tx=0x7fe6c8007e40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:19.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6e0d87000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 0x5580c7a8f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6e0d87000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8fac0 0x5580c7a45680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6e0d87000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7a45fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6e0d87000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5580c792dcb0 con 0x5580c7a8f1a0 2024-09-10T22:40:19.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6e0d87000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5580c7843310 con 0x5580c7a45bc0 2024-09-10T22:40:19.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6e0d87000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5580c78a0b90 con 0x5580c7a8fac0 2024-09-10T22:40:19.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6d6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 0x5580c7a8f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6d6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 0x5580c7a8f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55062/0 (socket says 172.21.15.103:55062) 2024-09-10T22:40:19.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6d6a00640 1 -- 172.21.15.103:0/213990281 learned_addr learned my addr 172.21.15.103:0/213990281 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:19.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6cfe00640 1 --2- 172.21.15.103:0/213990281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8fac0 0x5580c7a45680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6d7400640 1 --2- 172.21.15.103:0/213990281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7a45fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6d6a00640 1 -- 172.21.15.103:0/213990281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8fac0 msgr2=0x5580c7a45680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6d6a00640 1 --2- 172.21.15.103:0/213990281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8fac0 0x5580c7a45680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6d6a00640 1 -- 172.21.15.103:0/213990281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 msgr2=0x5580c7a45fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6d6a00640 1 --2- 172.21.15.103:0/213990281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7a45fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6d6a00640 1 -- 172.21.15.103:0/213990281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c7844c60 con 0x5580c7a8f1a0 2024-09-10T22:40:19.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.005+0000 7fe6d7400640 1 --2- 172.21.15.103:0/213990281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7a45fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:40:19.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6d6a00640 1 --2- 172.21.15.103:0/213990281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 0x5580c7a8f580 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800eaa0 tx=0x7fe6c8010070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbefafb3fa35ba97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:19.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6c7400640 1 -- 172.21.15.103:0/213990281 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c802a070 con 0x5580c7a8f1a0 2024-09-10T22:40:19.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6c7400640 1 -- 172.21.15.103:0/213990281 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6c8025400 con 0x5580c7a8f1a0 2024-09-10T22:40:19.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6c7400640 1 -- 172.21.15.103:0/213990281 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c80257f0 con 0x5580c7a8f1a0 2024-09-10T22:40:19.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6e0d87000 1 -- 172.21.15.103:0/213990281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 msgr2=0x5580c7a8f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/213990281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 0x5580c7a8f580 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800eaa0 tx=0x7fe6c8010070 comp rx=0 tx=0).stop 2024-09-10T22:40:19.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6e0d87000 1 -- 172.21.15.103:0/213990281 shutdown_connections 2024-09-10T22:40:19.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/213990281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7a45fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/213990281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8fac0 0x5580c7a45680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/213990281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 0x5580c7a8f580 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6e0d87000 1 -- 172.21.15.103:0/213990281 >> 172.21.15.103:0/213990281 conn(0x5580c7a4bd20 msgr2=0x5580c7a43f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:19.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6e0d87000 1 -- 172.21.15.103:0/213990281 shutdown_connections 2024-09-10T22:40:19.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6e0d87000 1 -- 172.21.15.103:0/213990281 wait complete. 2024-09-10T22:40:19.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6e0d87000 1 -- start start 2024-09-10T22:40:19.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6e0d87000 1 Processor -- start 2024-09-10T22:40:19.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6e0d87000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7a96530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6e0d87000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8f1a0 0x5580c7a96a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6e0d87000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8fac0 0x5580c7a96fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6e0d87000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5580c7893dd0 con 0x5580c7a8fac0 2024-09-10T22:40:19.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6e0d87000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5580c788ffc0 con 0x5580c7a45bc0 2024-09-10T22:40:19.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6e0d87000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5580c78354b0 con 0x5580c7a8f1a0 2024-09-10T22:40:19.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6e0d87000 10 client.0 _ll_register_callbacks cb 0x5580c78137d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:19.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6d7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8fac0 0x5580c7a96fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6d7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8fac0 0x5580c7a96fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55072/0 (socket says 172.21.15.103:55072) 2024-09-10T22:40:19.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6d7400640 1 -- 172.21.15.103:0/3148222584 learned_addr learned my addr 172.21.15.103:0/3148222584 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:19.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6d6a00640 1 --2- 172.21.15.103:0/3148222584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7a96530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6cfe00640 1 --2- 172.21.15.103:0/3148222584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8f1a0 0x5580c7a96a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6d6a00640 1 -- 172.21.15.103:0/3148222584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8f1a0 msgr2=0x5580c7a96a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6d6a00640 1 --2- 172.21.15.103:0/3148222584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8f1a0 0x5580c7a96a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6d6a00640 1 -- 172.21.15.103:0/3148222584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8fac0 msgr2=0x5580c7a96fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6d6a00640 1 --2- 172.21.15.103:0/3148222584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8fac0 0x5580c7a96fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6d6a00640 1 -- 172.21.15.103:0/3148222584 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580c782e1f0 con 0x5580c7a45bc0 2024-09-10T22:40:19.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6d7400640 1 --2- 172.21.15.103:0/3148222584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8fac0 0x5580c7a96fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:40:19.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6d6a00640 1 --2- 172.21.15.103:0/3148222584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7a96530 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8005420 tx=0x7fe6c8025ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51f53817ac9797f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:19.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.009+0000 7fe6bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-10T22:40:19.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6bbe00640 1 -- 172.21.15.103:0/3148222584 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c802a030 con 0x5580c7a45bc0 2024-09-10T22:40:19.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 1 -- 172.21.15.103:0/3148222584 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5580c7828330 con 0x5580c7a45bc0 2024-09-10T22:40:19.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6bbe00640 1 -- 172.21.15.103:0/3148222584 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fe6c802fc50 con 0x5580c7a45bc0 2024-09-10T22:40:19.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6bbe00640 1 -- 172.21.15.103:0/3148222584 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe6c802fe50 con 0x5580c7a45bc0 2024-09-10T22:40:19.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 10 client.5167 fetch_fsmap learned FSMap version 26 2024-09-10T22:40:19.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 1 -- 172.21.15.103:0/3148222584 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5580c7814fa0 con 0x5580c7a45bc0 2024-09-10T22:40:19.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6bbe00640 1 -- 172.21.15.103:0/3148222584 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5580c7828330 con 0x5580c7a45bc0 2024-09-10T22:40:19.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6bbe00640 1 -- 172.21.15.103:0/3148222584 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 26) ==== 3554+0+0 (secure 0 0 0) 0x7fe6c80245b0 con 0x5580c7a45bc0 2024-09-10T22:40:19.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 10 client.5167 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:40:19.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 10 client.5167 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-10T22:40:19.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 20 client.5167 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:19.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/3148222584 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5580c7a9e900 0x5580c7aa0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 4 client.5167 mds_command: new command op to 4941 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:40:19.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 1 -- 172.21.15.103:0/3148222584 --> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580c78a2ae0 con 0x5580c7a9e900 2024-09-10T22:40:19.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6cfe00640 1 --2- 172.21.15.103:0/3148222584 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5580c7a9e900 0x5580c7aa0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6cfe00640 1 --2- 172.21.15.103:0/3148222584 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5580c7a9e900 0x5580c7aa0cf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bdc15544c88d691 server_cookie=6735083ef88e5152 in_seq=0 out_seq=0 2024-09-10T22:40:19.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6bbe00640 10 client.5167 ms_handle_connect on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:19.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6bbe00640 1 -- 172.21.15.103:0/3148222584 <== mds.0 v2:172.21.15.103:6834/1194009116 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5580c78a2ae0 con 0x5580c7a9e900 2024-09-10T22:40:19.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6bbe00640 10 client.5167 handle_command_reply: tid=0 2024-09-10T22:40:19.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 1 client.5167 shutdown 2024-09-10T22:40:19.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 1 -- 172.21.15.103:0/3148222584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 msgr2=0x5580c7a96530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/3148222584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7a96530 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8005420 tx=0x7fe6c8025ab0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 1 -- 172.21.15.103:0/3148222584 shutdown_connections 2024-09-10T22:40:19.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/3148222584 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5580c7a9e900 0x5580c7aa0cf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/3148222584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8fac0 0x5580c7a96fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/3148222584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8f1a0 0x5580c7a96a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/3148222584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7a96530 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6bbe00640 0 client.5167 ms_handle_reset on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:19.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 1 -- 172.21.15.103:0/3148222584 >> 172.21.15.103:0/3148222584 conn(0x5580c7a4bd20 msgr2=0x5580c7a43f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:19.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 1 -- 172.21.15.103:0/3148222584 shutdown_connections 2024-09-10T22:40:19.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 1 -- 172.21.15.103:0/3148222584 wait complete. 2024-09-10T22:40:19.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.013+0000 7fe6e0d87000 20 client.5167 trim_cache size 0 max 16384 2024-09-10T22:40:19.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6e0d87000 1 Processor -- start 2024-09-10T22:40:19.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6e0d87000 1 -- start start 2024-09-10T22:40:19.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6e0d87000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7b00a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6e0d87000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 0x5580c7b00f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6e0d87000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8fac0 0x5580c7b014a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6e0d87000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d81fff60 con 0x5580c7a8f1a0 2024-09-10T22:40:19.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6e0d87000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d80b0eb0 con 0x5580c7a45bc0 2024-09-10T22:40:19.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6e0d87000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d81ff850 con 0x5580c7a8fac0 2024-09-10T22:40:19.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6cfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 0x5580c7b00f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6cfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 0x5580c7b00f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55084/0 (socket says 172.21.15.103:55084) 2024-09-10T22:40:19.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6cfe00640 1 -- 172.21.15.103:0/1814134704 learned_addr learned my addr 172.21.15.103:0/1814134704 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:19.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6cfe00640 1 -- 172.21.15.103:0/1814134704 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8fac0 msgr2=0x5580c7b014a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6d7400640 1 --2- 172.21.15.103:0/1814134704 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8fac0 0x5580c7b014a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6d6a00640 1 --2- 172.21.15.103:0/1814134704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7b00a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6cfe00640 1 --2- 172.21.15.103:0/1814134704 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8fac0 0x5580c7b014a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6cfe00640 1 -- 172.21.15.103:0/1814134704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 msgr2=0x5580c7b00a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6cfe00640 1 --2- 172.21.15.103:0/1814134704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7b00a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6cfe00640 1 -- 172.21.15.103:0/1814134704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c78ed660 con 0x5580c7a8f1a0 2024-09-10T22:40:19.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6d6a00640 1 --2- 172.21.15.103:0/1814134704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7b00a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:40:19.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6d7400640 1 --2- 172.21.15.103:0/1814134704 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8fac0 0x5580c7b014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:40:19.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6cfe00640 1 --2- 172.21.15.103:0/1814134704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 0x5580c7b00f60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe6c005e4e0 tx=0x7fe6c005aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b38a5671b29324 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:19.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6c6a00640 1 -- 172.21.15.103:0/1814134704 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0078070 con 0x5580c7a8f1a0 2024-09-10T22:40:19.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.029+0000 7fe6c6a00640 1 -- 172.21.15.103:0/1814134704 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6c005a7c0 con 0x5580c7a8f1a0 2024-09-10T22:40:19.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6c6a00640 1 -- 172.21.15.103:0/1814134704 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c005d9b0 con 0x5580c7a8f1a0 2024-09-10T22:40:19.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 -- 172.21.15.103:0/1814134704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 msgr2=0x5580c7b00f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/1814134704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 0x5580c7b00f60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe6c005e4e0 tx=0x7fe6c005aca0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 -- 172.21.15.103:0/1814134704 shutdown_connections 2024-09-10T22:40:19.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/1814134704 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8fac0 0x5580c7b014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/1814134704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 0x5580c7b00f60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/1814134704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7b00a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 -- 172.21.15.103:0/1814134704 >> 172.21.15.103:0/1814134704 conn(0x5580c7a4bd20 msgr2=0x5580c7a46e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:19.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 -- 172.21.15.103:0/1814134704 shutdown_connections 2024-09-10T22:40:19.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 -- 172.21.15.103:0/1814134704 wait complete. 2024-09-10T22:40:19.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 -- start start 2024-09-10T22:40:19.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 Processor -- start 2024-09-10T22:40:19.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7b046b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 0x5580c7b04bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8fac0 0x5580c7b05130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5580c788ffc0 con 0x5580c7a8f1a0 2024-09-10T22:40:19.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5580c7a4ed40 con 0x5580c7a45bc0 2024-09-10T22:40:19.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5580c7a4c100 con 0x5580c7a8fac0 2024-09-10T22:40:19.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 10 client.0 _ll_register_callbacks cb 0x7fe6c8028070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:19.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6cfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 0x5580c7b04bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6cfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 0x5580c7b04bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55096/0 (socket says 172.21.15.103:55096) 2024-09-10T22:40:19.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6cfe00640 1 -- 172.21.15.103:0/4171780599 learned_addr learned my addr 172.21.15.103:0/4171780599 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:19.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6d7400640 1 --2- 172.21.15.103:0/4171780599 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8fac0 0x5580c7b05130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6d6a00640 1 --2- 172.21.15.103:0/4171780599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7b046b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6cfe00640 1 -- 172.21.15.103:0/4171780599 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8fac0 msgr2=0x5580c7b05130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6cfe00640 1 --2- 172.21.15.103:0/4171780599 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8fac0 0x5580c7b05130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6cfe00640 1 -- 172.21.15.103:0/4171780599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 msgr2=0x5580c7b046b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6cfe00640 1 --2- 172.21.15.103:0/4171780599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7b046b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6cfe00640 1 -- 172.21.15.103:0/4171780599 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580c785a090 con 0x5580c7a8f1a0 2024-09-10T22:40:19.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6cfe00640 1 --2- 172.21.15.103:0/4171780599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 0x5580c7b04bf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0000c10 tx=0x7fe6c00781e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb070e142c415c76 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:19.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:19.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6bbe00640 1 -- 172.21.15.103:0/4171780599 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0078040 con 0x5580c7a8f1a0 2024-09-10T22:40:19.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6bbe00640 1 -- 172.21.15.103:0/4171780599 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fe6c008ab90 con 0x5580c7a8f1a0 2024-09-10T22:40:19.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 -- 172.21.15.103:0/4171780599 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6c005a7c0 con 0x5580c7a8f1a0 2024-09-10T22:40:19.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6bbe00640 1 -- 172.21.15.103:0/4171780599 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe6c00679a0 con 0x5580c7a8f1a0 2024-09-10T22:40:19.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 10 client.5214 fetch_fsmap learned FSMap version 26 2024-09-10T22:40:19.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.033+0000 7fe6e0d87000 1 -- 172.21.15.103:0/4171780599 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5580c78265f0 con 0x5580c7a8f1a0 2024-09-10T22:40:19.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.037+0000 7fe6bbe00640 1 -- 172.21.15.103:0/4171780599 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6c005a7c0 con 0x5580c7a8f1a0 2024-09-10T22:40:19.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.037+0000 7fe6bbe00640 1 -- 172.21.15.103:0/4171780599 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 3554+0+0 (secure 0 0 0) 0x7fe6c0065180 con 0x5580c7a8f1a0 2024-09-10T22:40:19.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.037+0000 7fe6e0d87000 10 client.5214 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:40:19.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.037+0000 7fe6e0d87000 10 client.5214 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-10T22:40:19.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.037+0000 7fe6e0d87000 20 client.5214 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:19.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.037+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/4171780599 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5580c7aa5980 0x5580c7aa5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.037+0000 7fe6e0d87000 4 client.5214 mds_command: new command op to 4941 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:40:19.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.037+0000 7fe6e0d87000 1 -- 172.21.15.103:0/4171780599 --> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5580c789e590 con 0x5580c7aa5980 2024-09-10T22:40:19.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.037+0000 7fe6d6a00640 1 --2- 172.21.15.103:0/4171780599 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5580c7aa5980 0x5580c7aa5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.037+0000 7fe6d6a00640 1 --2- 172.21.15.103:0/4171780599 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5580c7aa5980 0x5580c7aa5d90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7b9779563d0caf3 server_cookie=35ac669ebc59c16 in_seq=0 out_seq=0 2024-09-10T22:40:19.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.037+0000 7fe6bbe00640 10 client.5214 ms_handle_connect on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:19.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6bbe00640 1 -- 172.21.15.103:0/4171780599 <== mds.0 v2:172.21.15.103:6834/1194009116 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5580c789e590 con 0x5580c7aa5980 2024-09-10T22:40:19.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6bbe00640 10 client.5214 handle_command_reply: tid=0 2024-09-10T22:40:19.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6e0d87000 1 client.5214 shutdown 2024-09-10T22:40:19.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6e0d87000 1 -- 172.21.15.103:0/4171780599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 msgr2=0x5580c7b04bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/4171780599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 0x5580c7b04bf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0000c10 tx=0x7fe6c00781e0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6e0d87000 1 -- 172.21.15.103:0/4171780599 shutdown_connections 2024-09-10T22:40:19.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/4171780599 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5580c7aa5980 0x5580c7aa5d90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/4171780599 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580c7a8fac0 0x5580c7b05130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/4171780599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c7a8f1a0 0x5580c7b04bf0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6e0d87000 1 --2- 172.21.15.103:0/4171780599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580c7a45bc0 0x5580c7b046b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6bbe00640 0 client.5214 ms_handle_reset on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:19.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6e0d87000 1 -- 172.21.15.103:0/4171780599 >> 172.21.15.103:0/4171780599 conn(0x5580c7a4bd20 msgr2=0x5580c7a47540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:19.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6e0d87000 1 -- 172.21.15.103:0/4171780599 shutdown_connections 2024-09-10T22:40:19.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6e0d87000 1 -- 172.21.15.103:0/4171780599 wait complete. 2024-09-10T22:40:19.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6e0d87000 20 client.5214 trim_cache size 0 max 16384 2024-09-10T22:40:19.061 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:40:19.061 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:40:19.061 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:40:19.061 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:40:19.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6dda00640 1 -- 172.21.15.103:0/2845842106 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe6b40725e0 msgr2=0x7fe6b4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6dda00640 1 --2- 172.21.15.103:0/2845842106 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe6b40725e0 0x7fe6b4074aa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe6c80055f0 tx=0x7fe6c8007e40 comp rx=0 tx=0).stop 2024-09-10T22:40:19.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6dda00640 1 -- 172.21.15.103:0/2845842106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6d80b3320 msgr2=0x7fe6d80b15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.053+0000 7fe6dda00640 1 --2- 172.21.15.103:0/2845842106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6d80b3320 0x7fe6d80b15b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe6c000ea90 tx=0x7fe6c000ee90 comp rx=0 tx=0).stop 2024-09-10T22:40:19.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.057+0000 7fe6dda00640 1 -- 172.21.15.103:0/2845842106 shutdown_connections 2024-09-10T22:40:19.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.057+0000 7fe6dda00640 1 --2- 172.21.15.103:0/2845842106 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe6b40725e0 0x7fe6b4074aa0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.057+0000 7fe6dda00640 1 --2- 172.21.15.103:0/2845842106 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6d80cf260 0x7fe6d80b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.057+0000 7fe6dda00640 1 --2- 172.21.15.103:0/2845842106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6d80b3320 0x7fe6d80b15b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.057+0000 7fe6dda00640 1 --2- 172.21.15.103:0/2845842106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6d8072a40 0x7fe6d81560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.057+0000 7fe6dda00640 1 -- 172.21.15.103:0/2845842106 >> 172.21.15.103:0/2845842106 conn(0x7fe6d806cc00 msgr2=0x7fe6d8159650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:19.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.057+0000 7fe6dda00640 1 -- 172.21.15.103:0/2845842106 shutdown_connections 2024-09-10T22:40:19.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.057+0000 7fe6dda00640 1 -- 172.21.15.103:0/2845842106 wait complete. 2024-09-10T22:40:19.080 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:1 flush journal 2024-09-10T22:40:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.217+0000 7f236f200640 1 -- 172.21.15.103:0/2353353442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f236815be30 msgr2=0x7f23680ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.217+0000 7f236f200640 1 --2- 172.21.15.103:0/2353353442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f236815be30 0x7f23680ce0c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f23680d1590 tx=0x7f235801c830 comp rx=0 tx=0).stop 2024-09-10T22:40:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.217+0000 7f236f200640 1 -- 172.21.15.103:0/2353353442 shutdown_connections 2024-09-10T22:40:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.217+0000 7f236f200640 1 --2- 172.21.15.103:0/2353353442 >> v2:172.21.15.131:3300/0 conn(0x7f23680ae9c0 0x7f23680aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.217+0000 7f236f200640 1 --2- 172.21.15.103:0/2353353442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f236815be30 0x7f23680ce0c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.217+0000 7f236f200640 1 -- 172.21.15.103:0/2353353442 >> 172.21.15.103:0/2353353442 conn(0x7f23680d1ac0 msgr2=0x7f23680d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.217+0000 7f236f200640 1 -- 172.21.15.103:0/2353353442 shutdown_connections 2024-09-10T22:40:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.217+0000 7f236f200640 1 -- 172.21.15.103:0/2353353442 wait complete. 2024-09-10T22:40:19.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f236f200640 1 Processor -- start 2024-09-10T22:40:19.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f236f200640 1 -- start start 2024-09-10T22:40:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f236f200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23680ae9c0 0x7f23680b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f236f200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23680b09c0 0x7f2368166130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f236f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f236815be30 0x7f2368157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f236f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2368168df0 con 0x7f236815be30 2024-09-10T22:40:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f236f200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2368168c70 con 0x7f23680b09c0 2024-09-10T22:40:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f236f200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2368168f70 con 0x7f23680ae9c0 2024-09-10T22:40:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f236d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f236815be30 0x7f2368157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f2367e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23680ae9c0 0x7f23680b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f2367e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23680ae9c0 0x7f23680b6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:38932/0 (socket says 172.21.15.103:38932) 2024-09-10T22:40:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f2367e00640 1 -- 172.21.15.103:0/531649334 learned_addr learned my addr 172.21.15.103:0/531649334 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f235fe00640 1 --2- 172.21.15.103:0/531649334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23680b09c0 0x7f2368166130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f2367e00640 1 -- 172.21.15.103:0/531649334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23680b09c0 msgr2=0x7f2368166130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f2367e00640 1 --2- 172.21.15.103:0/531649334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23680b09c0 0x7f2368166130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f2367e00640 1 -- 172.21.15.103:0/531649334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f236815be30 msgr2=0x7f2368157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f2367e00640 1 --2- 172.21.15.103:0/531649334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f236815be30 0x7f2368157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f2367e00640 1 -- 172.21.15.103:0/531649334 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23680b7930 con 0x7f23680ae9c0 2024-09-10T22:40:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f2367e00640 1 --2- 172.21.15.103:0/531649334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23680ae9c0 0x7f23680b6a90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f23580b0040 tx=0x7f23580040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f2364c00640 1 -- 172.21.15.103:0/531649334 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23580044b0 con 0x7f23680ae9c0 2024-09-10T22:40:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f236f200640 1 -- 172.21.15.103:0/531649334 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23680b7090 con 0x7f23680ae9c0 2024-09-10T22:40:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f2364c00640 1 -- 172.21.15.103:0/531649334 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23580bd070 con 0x7f23680ae9c0 2024-09-10T22:40:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f2364c00640 1 -- 172.21.15.103:0/531649334 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23580053a0 con 0x7f23680ae9c0 2024-09-10T22:40:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.221+0000 7f236f200640 1 -- 172.21.15.103:0/531649334 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f23680b7650 con 0x7f23680ae9c0 2024-09-10T22:40:19.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.225+0000 7f2364c00640 1 -- 172.21.15.103:0/531649334 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2358005540 con 0x7f23680ae9c0 2024-09-10T22:40:19.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.225+0000 7f2364c00640 1 --2- 172.21.15.103:0/531649334 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f23440725e0 0x7f2344074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.225+0000 7f237255d000 1 Processor -- start 2024-09-10T22:40:19.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.225+0000 7f2364c00640 1 -- 172.21.15.103:0/531649334 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f235812dd90 con 0x7f23680ae9c0 2024-09-10T22:40:19.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.225+0000 7f237255d000 1 -- start start 2024-09-10T22:40:19.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.225+0000 7f235fe00640 1 --2- 172.21.15.103:0/531649334 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f23440725e0 0x7f2344074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.225+0000 7f235fe00640 1 --2- 172.21.15.103:0/531649334 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f23440725e0 0x7f2344074aa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f23680b1a10 tx=0x7f2350009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.225+0000 7f237255d000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d939580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.225+0000 7f237255d000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d939ac0 0x55ee2d8ef680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.225+0000 7f237255d000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d8efbc0 0x55ee2d8effa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.225+0000 7f237255d000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ee2d7d7cb0 con 0x55ee2d9391a0 2024-09-10T22:40:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.225+0000 7f237255d000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ee2d6ed310 con 0x55ee2d8efbc0 2024-09-10T22:40:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.225+0000 7f237255d000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ee2d74ab90 con 0x55ee2d939ac0 2024-09-10T22:40:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.225+0000 7f2367e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d939580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f235fe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d939ac0 0x55ee2d8ef680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f2367e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d939580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55118/0 (socket says 172.21.15.103:55118) 2024-09-10T22:40:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f2367e00640 1 -- 172.21.15.103:0/1915435086 learned_addr learned my addr 172.21.15.103:0/1915435086 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f236d200640 1 --2- 172.21.15.103:0/1915435086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d8efbc0 0x55ee2d8effa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f2367e00640 1 -- 172.21.15.103:0/1915435086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d939ac0 msgr2=0x55ee2d8ef680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f2367e00640 1 --2- 172.21.15.103:0/1915435086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d939ac0 0x55ee2d8ef680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f2367e00640 1 -- 172.21.15.103:0/1915435086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d8efbc0 msgr2=0x55ee2d8effa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f2367e00640 1 --2- 172.21.15.103:0/1915435086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d8efbc0 0x55ee2d8effa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f2367e00640 1 -- 172.21.15.103:0/1915435086 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee2d6eec60 con 0x55ee2d9391a0 2024-09-10T22:40:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f2367e00640 1 --2- 172.21.15.103:0/1915435086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d939580 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f23580f8c10 tx=0x7f23580f8700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724f6e19304e5bb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f235cc00640 1 -- 172.21.15.103:0/1915435086 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23580fd6b0 con 0x55ee2d9391a0 2024-09-10T22:40:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f235cc00640 1 -- 172.21.15.103:0/1915435086 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f235811d070 con 0x55ee2d9391a0 2024-09-10T22:40:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f235cc00640 1 -- 172.21.15.103:0/1915435086 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23580f8100 con 0x55ee2d9391a0 2024-09-10T22:40:19.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f237255d000 1 -- 172.21.15.103:0/1915435086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 msgr2=0x55ee2d939580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f237255d000 1 --2- 172.21.15.103:0/1915435086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d939580 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f23580f8c10 tx=0x7f23580f8700 comp rx=0 tx=0).stop 2024-09-10T22:40:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f237255d000 1 -- 172.21.15.103:0/1915435086 shutdown_connections 2024-09-10T22:40:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f237255d000 1 --2- 172.21.15.103:0/1915435086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d8efbc0 0x55ee2d8effa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f237255d000 1 --2- 172.21.15.103:0/1915435086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d939ac0 0x55ee2d8ef680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f237255d000 1 --2- 172.21.15.103:0/1915435086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d939580 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f237255d000 1 -- 172.21.15.103:0/1915435086 >> 172.21.15.103:0/1915435086 conn(0x55ee2d8f5d20 msgr2=0x55ee2d8edf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f237255d000 1 -- 172.21.15.103:0/1915435086 shutdown_connections 2024-09-10T22:40:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f237255d000 1 -- 172.21.15.103:0/1915435086 wait complete. 2024-09-10T22:40:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f237255d000 1 -- start start 2024-09-10T22:40:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f237255d000 1 Processor -- start 2024-09-10T22:40:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f237255d000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d8efbc0 0x55ee2d940530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f237255d000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d940a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f237255d000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d939ac0 0x55ee2d940fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f237255d000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ee2d73ddd0 con 0x55ee2d9391a0 2024-09-10T22:40:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f237255d000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ee2d739fc0 con 0x55ee2d939ac0 2024-09-10T22:40:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f237255d000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ee2d6df4b0 con 0x55ee2d8efbc0 2024-09-10T22:40:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f237255d000 10 client.0 _ll_register_callbacks cb 0x55ee2d6bd7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f235fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d940a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f235fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d940a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55130/0 (socket says 172.21.15.103:55130) 2024-09-10T22:40:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f235fe00640 1 -- 172.21.15.103:0/1695418020 learned_addr learned my addr 172.21.15.103:0/1695418020 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f236d200640 1 --2- 172.21.15.103:0/1695418020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d939ac0 0x55ee2d940fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.229+0000 7f2367e00640 1 --2- 172.21.15.103:0/1695418020 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d8efbc0 0x55ee2d940530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f235fe00640 1 -- 172.21.15.103:0/1695418020 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d8efbc0 msgr2=0x55ee2d940530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f235fe00640 1 --2- 172.21.15.103:0/1695418020 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d8efbc0 0x55ee2d940530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f235fe00640 1 -- 172.21.15.103:0/1695418020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d939ac0 msgr2=0x55ee2d940fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f235fe00640 1 --2- 172.21.15.103:0/1695418020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d939ac0 0x55ee2d940fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f235fe00640 1 -- 172.21.15.103:0/1695418020 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee2d6d81f0 con 0x55ee2d9391a0 2024-09-10T22:40:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f236d200640 1 --2- 172.21.15.103:0/1695418020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d939ac0 0x55ee2d940fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:40:19.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f235fe00640 1 --2- 172.21.15.103:0/1695418020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d940a70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f23680b2570 tx=0x7f2350001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f793879f0f0f610c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:19.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f2355600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f2355600640 1 -- 172.21.15.103:0/1695418020 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350025020 con 0x55ee2d9391a0 2024-09-10T22:40:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 1 -- 172.21.15.103:0/1695418020 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ee2d6d2330 con 0x55ee2d9391a0 2024-09-10T22:40:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f2355600640 1 -- 172.21.15.103:0/1695418020 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f2350013680 con 0x55ee2d9391a0 2024-09-10T22:40:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f2355600640 1 -- 172.21.15.103:0/1695418020 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f235002f050 con 0x55ee2d9391a0 2024-09-10T22:40:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 10 client.5229 fetch_fsmap learned FSMap version 26 2024-09-10T22:40:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 1 -- 172.21.15.103:0/1695418020 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55ee2d6befa0 con 0x55ee2d9391a0 2024-09-10T22:40:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f2355600640 1 -- 172.21.15.103:0/1695418020 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ee2d6d2330 con 0x55ee2d9391a0 2024-09-10T22:40:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f2355600640 1 -- 172.21.15.103:0/1695418020 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 3554+0+0 (secure 0 0 0) 0x7f2350032020 con 0x55ee2d9391a0 2024-09-10T22:40:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 10 client.5229 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:40:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 10 client.5229 resolve_mds: resolved 2:1 to role '2:1' aka daemon mds.a 2024-09-10T22:40:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 20 client.5229 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 1 --2- 172.21.15.103:0/1695418020 >> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] conn(0x55ee2d948900 0x55ee2d94acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 4 client.5229 mds_command: new command op to 4920 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:40:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 1 -- 172.21.15.103:0/1695418020 --> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee2d74cae0 con 0x55ee2d948900 2024-09-10T22:40:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f2367e00640 1 --2- 172.21.15.103:0/1695418020 >> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] conn(0x55ee2d948900 0x55ee2d94acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f2367e00640 1 --2- 172.21.15.103:0/1695418020 >> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] conn(0x55ee2d948900 0x55ee2d94acf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e17defa6200cf16b server_cookie=7cac86d452df7f0e in_seq=0 out_seq=0 2024-09-10T22:40:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f2355600640 10 client.5229 ms_handle_connect on v2:172.21.15.103:6832/4043692269 2024-09-10T22:40:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f2355600640 1 -- 172.21.15.103:0/1695418020 <== mds.1 v2:172.21.15.103:6832/4043692269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee2d74cae0 con 0x55ee2d948900 2024-09-10T22:40:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f2355600640 10 client.5229 handle_command_reply: tid=0 2024-09-10T22:40:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 1 client.5229 shutdown 2024-09-10T22:40:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 1 -- 172.21.15.103:0/1695418020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 msgr2=0x55ee2d940a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 1 --2- 172.21.15.103:0/1695418020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d940a70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f23680b2570 tx=0x7f2350001130 comp rx=0 tx=0).stop 2024-09-10T22:40:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 1 -- 172.21.15.103:0/1695418020 shutdown_connections 2024-09-10T22:40:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 1 --2- 172.21.15.103:0/1695418020 >> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] conn(0x55ee2d948900 0x55ee2d94acf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 1 --2- 172.21.15.103:0/1695418020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d939ac0 0x55ee2d940fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 1 --2- 172.21.15.103:0/1695418020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d940a70 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f2355600640 0 client.5229 ms_handle_reset on v2:172.21.15.103:6832/4043692269 2024-09-10T22:40:19.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 1 --2- 172.21.15.103:0/1695418020 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d8efbc0 0x55ee2d940530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 1 -- 172.21.15.103:0/1695418020 >> 172.21.15.103:0/1695418020 conn(0x55ee2d8f5d20 msgr2=0x55ee2d8edf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:19.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 1 -- 172.21.15.103:0/1695418020 shutdown_connections 2024-09-10T22:40:19.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 1 -- 172.21.15.103:0/1695418020 wait complete. 2024-09-10T22:40:19.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.233+0000 7f237255d000 20 client.5229 trim_cache size 0 max 16384 2024-09-10T22:40:19.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f237255d000 1 Processor -- start 2024-09-10T22:40:19.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f237255d000 1 -- start start 2024-09-10T22:40:19.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f237255d000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d8efbc0 0x55ee2d9b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f237255d000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d9b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f237255d000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d939ac0 0x55ee2d9b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f237255d000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2368204770 con 0x55ee2d9391a0 2024-09-10T22:40:19.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f237255d000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2368203940 con 0x55ee2d8efbc0 2024-09-10T22:40:19.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f237255d000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2368204040 con 0x55ee2d939ac0 2024-09-10T22:40:19.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f235fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d9b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f235fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d9b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55144/0 (socket says 172.21.15.103:55144) 2024-09-10T22:40:19.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f235fe00640 1 -- 172.21.15.103:0/2103040902 learned_addr learned my addr 172.21.15.103:0/2103040902 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:19.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f2367e00640 1 --2- 172.21.15.103:0/2103040902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d8efbc0 0x55ee2d9b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f236d200640 1 --2- 172.21.15.103:0/2103040902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d939ac0 0x55ee2d9b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f235fe00640 1 -- 172.21.15.103:0/2103040902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d939ac0 msgr2=0x55ee2d9b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f235fe00640 1 --2- 172.21.15.103:0/2103040902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d939ac0 0x55ee2d9b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f235fe00640 1 -- 172.21.15.103:0/2103040902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d8efbc0 msgr2=0x55ee2d9b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f235fe00640 1 --2- 172.21.15.103:0/2103040902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d8efbc0 0x55ee2d9b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f235fe00640 1 -- 172.21.15.103:0/2103040902 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee2d797660 con 0x55ee2d9391a0 2024-09-10T22:40:19.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.249+0000 7f2367e00640 1 --2- 172.21.15.103:0/2103040902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d8efbc0 0x55ee2d9b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:40:19.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f235fe00640 1 --2- 172.21.15.103:0/2103040902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d9b3a30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f235000f710 tx=0x7f2350013e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed4953f51d56361 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:19.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f2357e00640 1 -- 172.21.15.103:0/2103040902 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350037030 con 0x55ee2d9391a0 2024-09-10T22:40:19.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f2357e00640 1 -- 172.21.15.103:0/2103040902 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f235001b070 con 0x55ee2d9391a0 2024-09-10T22:40:19.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f2357e00640 1 -- 172.21.15.103:0/2103040902 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350025070 con 0x55ee2d9391a0 2024-09-10T22:40:19.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f237255d000 1 -- 172.21.15.103:0/2103040902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 msgr2=0x55ee2d9b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f237255d000 1 --2- 172.21.15.103:0/2103040902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d9b3a30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f235000f710 tx=0x7f2350013e40 comp rx=0 tx=0).stop 2024-09-10T22:40:19.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f237255d000 1 -- 172.21.15.103:0/2103040902 shutdown_connections 2024-09-10T22:40:19.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f237255d000 1 --2- 172.21.15.103:0/2103040902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d939ac0 0x55ee2d9b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f237255d000 1 --2- 172.21.15.103:0/2103040902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d9b3a30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f237255d000 1 --2- 172.21.15.103:0/2103040902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d8efbc0 0x55ee2d9b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f237255d000 1 -- 172.21.15.103:0/2103040902 >> 172.21.15.103:0/2103040902 conn(0x55ee2d8f5d20 msgr2=0x55ee2d8f1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:19.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f237255d000 1 -- 172.21.15.103:0/2103040902 shutdown_connections 2024-09-10T22:40:19.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f237255d000 1 -- 172.21.15.103:0/2103040902 wait complete. 2024-09-10T22:40:19.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f237255d000 1 -- start start 2024-09-10T22:40:19.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f237255d000 1 Processor -- start 2024-09-10T22:40:19.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f237255d000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d8efbc0 0x55ee2d94f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f237255d000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d94fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f237255d000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d939ac0 0x55ee2d973a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f237255d000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ee2d73ddd0 con 0x55ee2d9391a0 2024-09-10T22:40:19.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f237255d000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ee2d8f8d40 con 0x55ee2d8efbc0 2024-09-10T22:40:19.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f237255d000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ee2d8f6100 con 0x55ee2d939ac0 2024-09-10T22:40:19.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f237255d000 10 client.0 _ll_register_callbacks cb 0x7f235000fe50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:19.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f235fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d94fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f2367e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d8efbc0 0x55ee2d94f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f235fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d94fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55156/0 (socket says 172.21.15.103:55156) 2024-09-10T22:40:19.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f235fe00640 1 -- 172.21.15.103:0/23543876 learned_addr learned my addr 172.21.15.103:0/23543876 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:19.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f236d200640 1 --2- 172.21.15.103:0/23543876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d939ac0 0x55ee2d973a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f235fe00640 1 -- 172.21.15.103:0/23543876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d939ac0 msgr2=0x55ee2d973a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f235fe00640 1 --2- 172.21.15.103:0/23543876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d939ac0 0x55ee2d973a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f235fe00640 1 -- 172.21.15.103:0/23543876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d8efbc0 msgr2=0x55ee2d94f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f235fe00640 1 --2- 172.21.15.103:0/23543876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d8efbc0 0x55ee2d94f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f235fe00640 1 -- 172.21.15.103:0/23543876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee2d704090 con 0x55ee2d9391a0 2024-09-10T22:40:19.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f2367e00640 1 --2- 172.21.15.103:0/23543876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d8efbc0 0x55ee2d94f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:40:19.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f235fe00640 1 --2- 172.21.15.103:0/23543876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d94fba0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2350007a00 tx=0x7f23500067e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50cf52857350c0d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:19.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.253+0000 7f2355600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:19.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.257+0000 7f2355600640 1 -- 172.21.15.103:0/23543876 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350025070 con 0x55ee2d9391a0 2024-09-10T22:40:19.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.257+0000 7f237255d000 1 -- 172.21.15.103:0/23543876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f235001b070 con 0x55ee2d9391a0 2024-09-10T22:40:19.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.257+0000 7f2355600640 1 -- 172.21.15.103:0/23543876 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f235002a8c0 con 0x55ee2d9391a0 2024-09-10T22:40:19.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.257+0000 7f2355600640 1 -- 172.21.15.103:0/23543876 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2350043050 con 0x55ee2d9391a0 2024-09-10T22:40:19.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.257+0000 7f237255d000 10 client.5235 fetch_fsmap learned FSMap version 26 2024-09-10T22:40:19.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.257+0000 7f237255d000 1 -- 172.21.15.103:0/23543876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55ee2d6d05f0 con 0x55ee2d9391a0 2024-09-10T22:40:19.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.257+0000 7f2355600640 1 -- 172.21.15.103:0/23543876 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f235001b070 con 0x55ee2d9391a0 2024-09-10T22:40:19.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.257+0000 7f2355600640 1 -- 172.21.15.103:0/23543876 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 3554+0+0 (secure 0 0 0) 0x7f2350046020 con 0x55ee2d9391a0 2024-09-10T22:40:19.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.257+0000 7f237255d000 10 client.5235 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:40:19.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.257+0000 7f237255d000 10 client.5235 resolve_mds: resolved 2:1 to role '2:1' aka daemon mds.a 2024-09-10T22:40:19.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.257+0000 7f237255d000 20 client.5235 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:19.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.257+0000 7f237255d000 1 --2- 172.21.15.103:0/23543876 >> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] conn(0x55ee2d9743e0 0x55ee2d9b7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.257+0000 7f237255d000 4 client.5235 mds_command: new command op to 4920 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:40:19.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.257+0000 7f237255d000 1 -- 172.21.15.103:0/23543876 --> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ee2d748590 con 0x55ee2d9743e0 2024-09-10T22:40:19.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.257+0000 7f2367e00640 1 --2- 172.21.15.103:0/23543876 >> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] conn(0x55ee2d9743e0 0x55ee2d9b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.257+0000 7f2367e00640 1 --2- 172.21.15.103:0/23543876 >> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] conn(0x55ee2d9743e0 0x55ee2d9b7480 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=82de6d962661c124 server_cookie=fabc0c5d34b33edb in_seq=0 out_seq=0 2024-09-10T22:40:19.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.257+0000 7f2355600640 10 client.5235 ms_handle_connect on v2:172.21.15.103:6832/4043692269 2024-09-10T22:40:19.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.265+0000 7f2355600640 1 -- 172.21.15.103:0/23543876 <== mds.1 v2:172.21.15.103:6832/4043692269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ee2d748590 con 0x55ee2d9743e0 2024-09-10T22:40:19.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.265+0000 7f2355600640 10 client.5235 handle_command_reply: tid=0 2024-09-10T22:40:19.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.265+0000 7f237255d000 1 client.5235 shutdown 2024-09-10T22:40:19.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.265+0000 7f237255d000 1 -- 172.21.15.103:0/23543876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 msgr2=0x55ee2d94fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.265+0000 7f237255d000 1 --2- 172.21.15.103:0/23543876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d94fba0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2350007a00 tx=0x7f23500067e0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.265+0000 7f237255d000 1 -- 172.21.15.103:0/23543876 shutdown_connections 2024-09-10T22:40:19.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.265+0000 7f237255d000 1 --2- 172.21.15.103:0/23543876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ee2d939ac0 0x55ee2d973a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.265+0000 7f237255d000 1 --2- 172.21.15.103:0/23543876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ee2d9391a0 0x55ee2d94fba0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.265+0000 7f237255d000 1 --2- 172.21.15.103:0/23543876 >> [v2:172.21.15.103:6832/4043692269,v1:172.21.15.103:6833/4043692269] conn(0x55ee2d9743e0 0x55ee2d9b7480 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.265+0000 7f237255d000 1 --2- 172.21.15.103:0/23543876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee2d8efbc0 0x55ee2d94f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.265+0000 7f2355600640 0 client.5235 ms_handle_reset on v2:172.21.15.103:6832/4043692269 2024-09-10T22:40:19.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.265+0000 7f237255d000 1 -- 172.21.15.103:0/23543876 >> 172.21.15.103:0/23543876 conn(0x55ee2d8f5d20 msgr2=0x55ee2d94acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:19.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.265+0000 7f237255d000 1 -- 172.21.15.103:0/23543876 shutdown_connections 2024-09-10T22:40:19.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.265+0000 7f237255d000 1 -- 172.21.15.103:0/23543876 wait complete. 2024-09-10T22:40:19.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.265+0000 7f237255d000 20 client.5235 trim_cache size 0 max 16384 2024-09-10T22:40:19.273 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:40:19.274 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:40:19.274 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:40:19.274 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:40:19.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.269+0000 7f236f200640 1 -- 172.21.15.103:0/531649334 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f23440725e0 msgr2=0x7f2344074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.269+0000 7f236f200640 1 --2- 172.21.15.103:0/531649334 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f23440725e0 0x7f2344074aa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f23680b1a10 tx=0x7f2350009040 comp rx=0 tx=0).stop 2024-09-10T22:40:19.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.269+0000 7f236f200640 1 -- 172.21.15.103:0/531649334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23680ae9c0 msgr2=0x7f23680b6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.269+0000 7f236f200640 1 --2- 172.21.15.103:0/531649334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23680ae9c0 0x7f23680b6a90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f23580b0040 tx=0x7f23580040c0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.269+0000 7f236f200640 1 -- 172.21.15.103:0/531649334 shutdown_connections 2024-09-10T22:40:19.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.269+0000 7f236f200640 1 --2- 172.21.15.103:0/531649334 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f23440725e0 0x7f2344074aa0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.269+0000 7f236f200640 1 --2- 172.21.15.103:0/531649334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f236815be30 0x7f2368157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.269+0000 7f236f200640 1 --2- 172.21.15.103:0/531649334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23680b09c0 0x7f2368166130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.269+0000 7f236f200640 1 --2- 172.21.15.103:0/531649334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23680ae9c0 0x7f23680b6a90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.269+0000 7f236f200640 1 -- 172.21.15.103:0/531649334 >> 172.21.15.103:0/531649334 conn(0x7f23680d1ac0 msgr2=0x7f2368070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:19.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.269+0000 7f236f200640 1 -- 172.21.15.103:0/531649334 shutdown_connections 2024-09-10T22:40:19.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.269+0000 7f236f200640 1 -- 172.21.15.103:0/531649334 wait complete. 2024-09-10T22:40:19.292 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:2 flush journal 2024-09-10T22:40:19.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.429+0000 7f1660e00640 1 -- 172.21.15.103:0/216272146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f165c072500 msgr2=0x7f165c0729b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.429+0000 7f1660e00640 1 --2- 172.21.15.103:0/216272146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f165c072500 0x7f165c0729b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1654009900 tx=0x7f165401c8e0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.429+0000 7f1660e00640 1 -- 172.21.15.103:0/216272146 shutdown_connections 2024-09-10T22:40:19.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.429+0000 7f1660e00640 1 --2- 172.21.15.103:0/216272146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f165c072500 0x7f165c0729b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.429+0000 7f1660e00640 1 --2- 172.21.15.103:0/216272146 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f165c0b2c10 0x7f165c0b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.429+0000 7f1660e00640 1 -- 172.21.15.103:0/216272146 >> 172.21.15.103:0/216272146 conn(0x7f165c06cc00 msgr2=0x7f165c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:19.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.429+0000 7f1660e00640 1 -- 172.21.15.103:0/216272146 shutdown_connections 2024-09-10T22:40:19.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.429+0000 7f1660e00640 1 -- 172.21.15.103:0/216272146 wait complete. 2024-09-10T22:40:19.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f1660e00640 1 Processor -- start 2024-09-10T22:40:19.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f1660e00640 1 -- start start 2024-09-10T22:40:19.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f1660e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f165c072500 0x7f165c1f7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f1660e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f165c0b2c10 0x7f165c0b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f1660e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f165c0cf260 0x7f165c0adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f1660e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f165c157c30 con 0x7f165c072500 2024-09-10T22:40:19.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f1660e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f165c157ab0 con 0x7f165c0cf260 2024-09-10T22:40:19.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f1660e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f165c157db0 con 0x7f165c0b2c10 2024-09-10T22:40:19.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f1659e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f165c072500 0x7f165c1f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f1651400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f165c0b2c10 0x7f165c0b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f165a800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f165c0cf260 0x7f165c0adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f1659e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f165c072500 0x7f165c1f7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55184/0 (socket says 172.21.15.103:55184) 2024-09-10T22:40:19.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f1659e00640 1 -- 172.21.15.103:0/3827062082 learned_addr learned my addr 172.21.15.103:0/3827062082 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:19.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f165a800640 1 -- 172.21.15.103:0/3827062082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f165c0b2c10 msgr2=0x7f165c0b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f165a800640 1 --2- 172.21.15.103:0/3827062082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f165c0b2c10 0x7f165c0b1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f165a800640 1 -- 172.21.15.103:0/3827062082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f165c072500 msgr2=0x7f165c1f7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f165a800640 1 --2- 172.21.15.103:0/3827062082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f165c072500 0x7f165c1f7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f165a800640 1 -- 172.21.15.103:0/3827062082 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165c1f78f0 con 0x7f165c0cf260 2024-09-10T22:40:19.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f1659e00640 1 --2- 172.21.15.103:0/3827062082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f165c072500 0x7f165c1f7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:40:19.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f165a800640 1 --2- 172.21.15.103:0/3827062082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f165c0cf260 0x7f165c0adac0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f16540ac000 tx=0x7f16540a5720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:19.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f1652a00640 1 -- 172.21.15.103:0/3827062082 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540ba020 con 0x7f165c0cf260 2024-09-10T22:40:19.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f1652a00640 1 -- 172.21.15.103:0/3827062082 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16540043d0 con 0x7f165c0cf260 2024-09-10T22:40:19.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f1660e00640 1 -- 172.21.15.103:0/3827062082 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f165c1f7bd0 con 0x7f165c0cf260 2024-09-10T22:40:19.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f1652a00640 1 -- 172.21.15.103:0/3827062082 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540b2040 con 0x7f165c0cf260 2024-09-10T22:40:19.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.433+0000 7f1660e00640 1 -- 172.21.15.103:0/3827062082 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f165c1fa910 con 0x7f165c0cf260 2024-09-10T22:40:19.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.437+0000 7f1652a00640 1 -- 172.21.15.103:0/3827062082 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1654005290 con 0x7f165c0cf260 2024-09-10T22:40:19.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.437+0000 7f1652a00640 1 --2- 172.21.15.103:0/3827062082 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16380725e0 0x7f1638074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.437+0000 7f1652a00640 1 -- 172.21.15.103:0/3827062082 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f165412d140 con 0x7f165c0cf260 2024-09-10T22:40:19.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.437+0000 7f1664204000 1 Processor -- start 2024-09-10T22:40:19.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.437+0000 7f1659e00640 1 --2- 172.21.15.103:0/3827062082 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16380725e0 0x7f1638074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.437+0000 7f1664204000 1 -- start start 2024-09-10T22:40:19.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.437+0000 7f1659e00640 1 --2- 172.21.15.103:0/3827062082 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16380725e0 0x7f1638074aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f164c00f290 tx=0x7f164c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:19.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.437+0000 7f1664204000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc9b01a0 0x55e4bc9b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.437+0000 7f1664204000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc9b0ac0 0x55e4bc966680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.437+0000 7f1664204000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc966bc0 0x55e4bc966fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.437+0000 7f1664204000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e4bc84ecb0 con 0x55e4bc966bc0 2024-09-10T22:40:19.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.437+0000 7f1664204000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e4bc764310 con 0x55e4bc9b01a0 2024-09-10T22:40:19.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.437+0000 7f1664204000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55e4bc7c1b90 con 0x55e4bc9b0ac0 2024-09-10T22:40:19.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f165a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc966bc0 0x55e4bc966fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1659e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc9b01a0 0x55e4bc9b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1651400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc9b0ac0 0x55e4bc966680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f165a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc966bc0 0x55e4bc966fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55196/0 (socket says 172.21.15.103:55196) 2024-09-10T22:40:19.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f165a800640 1 -- 172.21.15.103:0/3232307380 learned_addr learned my addr 172.21.15.103:0/3232307380 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:19.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f165a800640 1 -- 172.21.15.103:0/3232307380 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc9b0ac0 msgr2=0x55e4bc966680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f165a800640 1 --2- 172.21.15.103:0/3232307380 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc9b0ac0 0x55e4bc966680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f165a800640 1 -- 172.21.15.103:0/3232307380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc9b01a0 msgr2=0x55e4bc9b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f165a800640 1 --2- 172.21.15.103:0/3232307380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc9b01a0 0x55e4bc9b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f165a800640 1 -- 172.21.15.103:0/3232307380 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4bc765c60 con 0x55e4bc966bc0 2024-09-10T22:40:19.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1659e00640 1 --2- 172.21.15.103:0/3232307380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc9b01a0 0x55e4bc9b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:40:19.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1651400640 1 --2- 172.21.15.103:0/3232307380 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc9b0ac0 0x55e4bc966680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:40:19.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f165a800640 1 --2- 172.21.15.103:0/3232307380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc966bc0 0x55e4bc966fa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f16540f5220 tx=0x7f16540f3f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7efc0f33b0cd8b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:19.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f164aa00640 1 -- 172.21.15.103:0/3232307380 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540f7ac0 con 0x55e4bc966bc0 2024-09-10T22:40:19.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f164aa00640 1 -- 172.21.15.103:0/3232307380 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16540f7fb0 con 0x55e4bc966bc0 2024-09-10T22:40:19.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f164aa00640 1 -- 172.21.15.103:0/3232307380 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540fc9e0 con 0x55e4bc966bc0 2024-09-10T22:40:19.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1664204000 1 -- 172.21.15.103:0/3232307380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc966bc0 msgr2=0x55e4bc966fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1664204000 1 --2- 172.21.15.103:0/3232307380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc966bc0 0x55e4bc966fa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f16540f5220 tx=0x7f16540f3f80 comp rx=0 tx=0).stop 2024-09-10T22:40:19.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1664204000 1 -- 172.21.15.103:0/3232307380 shutdown_connections 2024-09-10T22:40:19.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1664204000 1 --2- 172.21.15.103:0/3232307380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc966bc0 0x55e4bc966fa0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1664204000 1 --2- 172.21.15.103:0/3232307380 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc9b0ac0 0x55e4bc966680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1664204000 1 --2- 172.21.15.103:0/3232307380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc9b01a0 0x55e4bc9b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1664204000 1 -- 172.21.15.103:0/3232307380 >> 172.21.15.103:0/3232307380 conn(0x55e4bc96cd20 msgr2=0x55e4bc964f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:19.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1664204000 1 -- 172.21.15.103:0/3232307380 shutdown_connections 2024-09-10T22:40:19.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1664204000 1 -- 172.21.15.103:0/3232307380 wait complete. 2024-09-10T22:40:19.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1664204000 1 -- start start 2024-09-10T22:40:19.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1664204000 1 Processor -- start 2024-09-10T22:40:19.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1664204000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc966bc0 0x55e4bc9b7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1664204000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc9b01a0 0x55e4bc9b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1664204000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc9b0ac0 0x55e4bc9b7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1664204000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e4bc7b4dd0 con 0x55e4bc966bc0 2024-09-10T22:40:19.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1664204000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e4bc7b0fc0 con 0x55e4bc9b01a0 2024-09-10T22:40:19.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1664204000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55e4bc7564b0 con 0x55e4bc9b0ac0 2024-09-10T22:40:19.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.441+0000 7f1664204000 10 client.0 _ll_register_callbacks cb 0x55e4bc7347d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:19.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1659e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc966bc0 0x55e4bc9b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1659e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc966bc0 0x55e4bc9b7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55204/0 (socket says 172.21.15.103:55204) 2024-09-10T22:40:19.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1659e00640 1 -- 172.21.15.103:0/544260670 learned_addr learned my addr 172.21.15.103:0/544260670 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:19.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1659e00640 1 -- 172.21.15.103:0/544260670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc9b0ac0 msgr2=0x55e4bc9b7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1659e00640 1 --2- 172.21.15.103:0/544260670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc9b0ac0 0x55e4bc9b7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1651400640 1 --2- 172.21.15.103:0/544260670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc9b01a0 0x55e4bc9b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1659e00640 1 -- 172.21.15.103:0/544260670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc9b01a0 msgr2=0x55e4bc9b7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1659e00640 1 --2- 172.21.15.103:0/544260670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc9b01a0 0x55e4bc9b7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1659e00640 1 -- 172.21.15.103:0/544260670 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4bc74f1f0 con 0x55e4bc966bc0 2024-09-10T22:40:19.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1651400640 1 --2- 172.21.15.103:0/544260670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc9b01a0 0x55e4bc9b7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:40:19.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1659e00640 1 --2- 172.21.15.103:0/544260670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc966bc0 0x55e4bc9b7530 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f164c001e40 tx=0x7f164c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931daa7eb4d4a829 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:19.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f163f400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:19.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f163f400640 1 -- 172.21.15.103:0/544260670 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c025020 con 0x55e4bc966bc0 2024-09-10T22:40:19.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 1 -- 172.21.15.103:0/544260670 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e4bc749330 con 0x55e4bc966bc0 2024-09-10T22:40:19.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f163f400640 1 -- 172.21.15.103:0/544260670 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f164c021400 con 0x55e4bc966bc0 2024-09-10T22:40:19.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f163f400640 1 -- 172.21.15.103:0/544260670 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f164c02f050 con 0x55e4bc966bc0 2024-09-10T22:40:19.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 10 client.5247 fetch_fsmap learned FSMap version 26 2024-09-10T22:40:19.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 1 -- 172.21.15.103:0/544260670 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55e4bc735fa0 con 0x55e4bc966bc0 2024-09-10T22:40:19.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f163f400640 1 -- 172.21.15.103:0/544260670 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55e4bc749330 con 0x55e4bc966bc0 2024-09-10T22:40:19.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f163f400640 1 -- 172.21.15.103:0/544260670 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 3554+0+0 (secure 0 0 0) 0x7f164c032020 con 0x55e4bc966bc0 2024-09-10T22:40:19.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 10 client.5247 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:40:19.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 10 client.5247 resolve_mds: resolved 2:2 to role '2:2' aka daemon mds.d 2024-09-10T22:40:19.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 20 client.5247 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:19.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 1 --2- 172.21.15.103:0/544260670 >> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] conn(0x55e4bc9bf900 0x55e4bc9c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 4 client.5247 mds_command: new command op to 4754 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:40:19.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 1 -- 172.21.15.103:0/544260670 --> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4bc7c3ae0 con 0x55e4bc9bf900 2024-09-10T22:40:19.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1651400640 1 --2- 172.21.15.103:0/544260670 >> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] conn(0x55e4bc9bf900 0x55e4bc9c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1651400640 1 --2- 172.21.15.103:0/544260670 >> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] conn(0x55e4bc9bf900 0x55e4bc9c1cf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cb3209acd76db3ed server_cookie=c25cbc53233040d9 in_seq=0 out_seq=0 2024-09-10T22:40:19.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f163f400640 10 client.5247 ms_handle_connect on v2:172.21.15.131:6835/1068577002 2024-09-10T22:40:19.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f163f400640 1 -- 172.21.15.103:0/544260670 <== mds.2 v2:172.21.15.131:6835/1068577002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e4bc7c3ae0 con 0x55e4bc9bf900 2024-09-10T22:40:19.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f163f400640 10 client.5247 handle_command_reply: tid=0 2024-09-10T22:40:19.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 1 client.5247 shutdown 2024-09-10T22:40:19.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 1 -- 172.21.15.103:0/544260670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc966bc0 msgr2=0x55e4bc9b7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 1 --2- 172.21.15.103:0/544260670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc966bc0 0x55e4bc9b7530 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f164c001e40 tx=0x7f164c001260 comp rx=0 tx=0).stop 2024-09-10T22:40:19.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 1 -- 172.21.15.103:0/544260670 shutdown_connections 2024-09-10T22:40:19.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 1 --2- 172.21.15.103:0/544260670 >> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] conn(0x55e4bc9bf900 0x55e4bc9c1cf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 1 --2- 172.21.15.103:0/544260670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc9b0ac0 0x55e4bc9b7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 1 --2- 172.21.15.103:0/544260670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc9b01a0 0x55e4bc9b7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 1 --2- 172.21.15.103:0/544260670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc966bc0 0x55e4bc9b7530 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f163f400640 0 client.5247 ms_handle_reset on v2:172.21.15.131:6835/1068577002 2024-09-10T22:40:19.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 1 -- 172.21.15.103:0/544260670 >> 172.21.15.103:0/544260670 conn(0x55e4bc96cd20 msgr2=0x55e4bc964f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:19.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 1 -- 172.21.15.103:0/544260670 shutdown_connections 2024-09-10T22:40:19.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 1 -- 172.21.15.103:0/544260670 wait complete. 2024-09-10T22:40:19.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.445+0000 7f1664204000 20 client.5247 trim_cache size 0 max 16384 2024-09-10T22:40:19.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.461+0000 7f1664204000 1 Processor -- start 2024-09-10T22:40:19.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.461+0000 7f1664204000 1 -- start start 2024-09-10T22:40:19.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.461+0000 7f1664204000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc966bc0 0x55e4bc966070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.461+0000 7f1664204000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc9b01a0 0x55e4bc9665b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.461+0000 7f1664204000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc9b0ac0 0x55e4bc9ba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.461+0000 7f1664204000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f165c204390 con 0x55e4bc9b0ac0 2024-09-10T22:40:19.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.461+0000 7f1664204000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f165c203560 con 0x55e4bc966bc0 2024-09-10T22:40:19.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.461+0000 7f1664204000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f165c203c60 con 0x55e4bc9b01a0 2024-09-10T22:40:19.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f165a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc9b0ac0 0x55e4bc9ba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f165a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc9b0ac0 0x55e4bc9ba310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55208/0 (socket says 172.21.15.103:55208) 2024-09-10T22:40:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f165a800640 1 -- 172.21.15.103:0/2438270214 learned_addr learned my addr 172.21.15.103:0/2438270214 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1651400640 1 --2- 172.21.15.103:0/2438270214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc9b01a0 0x55e4bc9665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1659e00640 1 --2- 172.21.15.103:0/2438270214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc966bc0 0x55e4bc966070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f165a800640 1 -- 172.21.15.103:0/2438270214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc9b01a0 msgr2=0x55e4bc9665b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f165a800640 1 --2- 172.21.15.103:0/2438270214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc9b01a0 0x55e4bc9665b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f165a800640 1 -- 172.21.15.103:0/2438270214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc966bc0 msgr2=0x55e4bc966070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f165a800640 1 --2- 172.21.15.103:0/2438270214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc966bc0 0x55e4bc966070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f165a800640 1 -- 172.21.15.103:0/2438270214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4bc80e660 con 0x55e4bc9b0ac0 2024-09-10T22:40:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f165a800640 1 --2- 172.21.15.103:0/2438270214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc9b0ac0 0x55e4bc9ba310 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f16540f7cb0 tx=0x7f165412d050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e54fc8321c95dd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f164a000640 1 -- 172.21.15.103:0/2438270214 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540f7ac0 con 0x55e4bc9b0ac0 2024-09-10T22:40:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f164a000640 1 -- 172.21.15.103:0/2438270214 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1654101400 con 0x55e4bc9b0ac0 2024-09-10T22:40:19.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f164a000640 1 -- 172.21.15.103:0/2438270214 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540f7fb0 con 0x55e4bc9b0ac0 2024-09-10T22:40:19.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1664204000 1 -- 172.21.15.103:0/2438270214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc9b0ac0 msgr2=0x55e4bc9ba310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1664204000 1 --2- 172.21.15.103:0/2438270214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc9b0ac0 0x55e4bc9ba310 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f16540f7cb0 tx=0x7f165412d050 comp rx=0 tx=0).stop 2024-09-10T22:40:19.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1664204000 1 -- 172.21.15.103:0/2438270214 shutdown_connections 2024-09-10T22:40:19.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1664204000 1 --2- 172.21.15.103:0/2438270214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc9b0ac0 0x55e4bc9ba310 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1664204000 1 --2- 172.21.15.103:0/2438270214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc9b01a0 0x55e4bc9665b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1664204000 1 --2- 172.21.15.103:0/2438270214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc966bc0 0x55e4bc966070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1664204000 1 -- 172.21.15.103:0/2438270214 >> 172.21.15.103:0/2438270214 conn(0x55e4bc96cd20 msgr2=0x55e4bc965960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:19.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1664204000 1 -- 172.21.15.103:0/2438270214 shutdown_connections 2024-09-10T22:40:19.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1664204000 1 -- 172.21.15.103:0/2438270214 wait complete. 2024-09-10T22:40:19.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1664204000 1 -- start start 2024-09-10T22:40:19.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1664204000 1 Processor -- start 2024-09-10T22:40:19.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1664204000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc966bc0 0x55e4bc9bd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1664204000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc9b01a0 0x55e4bc9bdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1664204000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc9b0ac0 0x55e4bc9e2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1664204000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e4bc7b4dd0 con 0x55e4bc9b01a0 2024-09-10T22:40:19.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1664204000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e4bc96fd40 con 0x55e4bc9b0ac0 2024-09-10T22:40:19.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1664204000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55e4bc96d100 con 0x55e4bc966bc0 2024-09-10T22:40:19.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1664204000 10 client.0 _ll_register_callbacks cb 0x7f164c007da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:19.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1651400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc9b01a0 0x55e4bc9bdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1651400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc9b01a0 0x55e4bc9bdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55212/0 (socket says 172.21.15.103:55212) 2024-09-10T22:40:19.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1651400640 1 -- 172.21.15.103:0/770485697 learned_addr learned my addr 172.21.15.103:0/770485697 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:19.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1659e00640 1 --2- 172.21.15.103:0/770485697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc966bc0 0x55e4bc9bd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f165a800640 1 --2- 172.21.15.103:0/770485697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc9b0ac0 0x55e4bc9e2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1651400640 1 -- 172.21.15.103:0/770485697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc966bc0 msgr2=0x55e4bc9bd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1651400640 1 --2- 172.21.15.103:0/770485697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc966bc0 0x55e4bc9bd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1651400640 1 -- 172.21.15.103:0/770485697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc9b0ac0 msgr2=0x55e4bc9e2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:19.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1651400640 1 --2- 172.21.15.103:0/770485697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc9b0ac0 0x55e4bc9e2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.465+0000 7f1651400640 1 -- 172.21.15.103:0/770485697 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4bc77b090 con 0x55e4bc9b01a0 2024-09-10T22:40:19.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f1651400640 1 --2- 172.21.15.103:0/770485697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc9b01a0 0x55e4bc9bdaa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f16440042d0 tx=0x7f16440039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a5f556c6862cf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:19.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f163f400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:19.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f163f400640 1 -- 172.21.15.103:0/770485697 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644028060 con 0x55e4bc9b01a0 2024-09-10T22:40:19.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f163f400640 1 -- 172.21.15.103:0/770485697 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f164401f830 con 0x55e4bc9b01a0 2024-09-10T22:40:19.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f1664204000 1 -- 172.21.15.103:0/770485697 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1654101400 con 0x55e4bc9b01a0 2024-09-10T22:40:19.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f163f400640 1 -- 172.21.15.103:0/770485697 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f164402e050 con 0x55e4bc9b01a0 2024-09-10T22:40:19.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f1664204000 10 client.5253 fetch_fsmap learned FSMap version 26 2024-09-10T22:40:19.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f1664204000 1 -- 172.21.15.103:0/770485697 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55e4bc7475f0 con 0x55e4bc9b01a0 2024-09-10T22:40:19.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f163f400640 1 -- 172.21.15.103:0/770485697 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1654101400 con 0x55e4bc9b01a0 2024-09-10T22:40:19.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f163f400640 1 -- 172.21.15.103:0/770485697 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 3554+0+0 (secure 0 0 0) 0x7f1644031020 con 0x55e4bc9b01a0 2024-09-10T22:40:19.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f1664204000 10 client.5253 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:40:19.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f1664204000 10 client.5253 resolve_mds: resolved 2:2 to role '2:2' aka daemon mds.d 2024-09-10T22:40:19.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f1664204000 20 client.5253 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:19.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f1664204000 1 --2- 172.21.15.103:0/770485697 >> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] conn(0x55e4bca25c70 0x55e4bca26080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:19.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f1664204000 4 client.5253 mds_command: new command op to 4754 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:40:19.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f1664204000 1 -- 172.21.15.103:0/770485697 --> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e4bc7bf590 con 0x55e4bca25c70 2024-09-10T22:40:19.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f1659e00640 1 --2- 172.21.15.103:0/770485697 >> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] conn(0x55e4bca25c70 0x55e4bca26080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:19.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f1659e00640 1 --2- 172.21.15.103:0/770485697 >> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] conn(0x55e4bca25c70 0x55e4bca26080 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4097119ff9b454f server_cookie=4eb3ae64b22ff2e in_seq=0 out_seq=0 2024-09-10T22:40:19.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.469+0000 7f163f400640 10 client.5253 ms_handle_connect on v2:172.21.15.131:6835/1068577002 2024-09-10T22:40:19.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f163f400640 1 -- 172.21.15.103:0/770485697 <== mds.2 v2:172.21.15.131:6835/1068577002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e4bc7bf590 con 0x55e4bca25c70 2024-09-10T22:40:19.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f163f400640 10 client.5253 handle_command_reply: tid=0 2024-09-10T22:40:19.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1664204000 1 client.5253 shutdown 2024-09-10T22:40:19.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1664204000 1 -- 172.21.15.103:0/770485697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc9b01a0 msgr2=0x55e4bc9bdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1664204000 1 --2- 172.21.15.103:0/770485697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc9b01a0 0x55e4bc9bdaa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f16440042d0 tx=0x7f16440039d0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1664204000 1 -- 172.21.15.103:0/770485697 shutdown_connections 2024-09-10T22:40:19.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1664204000 1 --2- 172.21.15.103:0/770485697 >> [v2:172.21.15.131:6835/1068577002,v1:172.21.15.131:6837/1068577002] conn(0x55e4bca25c70 0x55e4bca26080 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1664204000 1 --2- 172.21.15.103:0/770485697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4bc9b0ac0 0x55e4bc9e2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1664204000 1 --2- 172.21.15.103:0/770485697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e4bc9b01a0 0x55e4bc9bdaa0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1664204000 1 --2- 172.21.15.103:0/770485697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e4bc966bc0 0x55e4bc9bd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f163f400640 0 client.5253 ms_handle_reset on v2:172.21.15.131:6835/1068577002 2024-09-10T22:40:19.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1664204000 1 -- 172.21.15.103:0/770485697 >> 172.21.15.103:0/770485697 conn(0x55e4bc96cd20 msgr2=0x55e4bc966180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:19.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1664204000 1 -- 172.21.15.103:0/770485697 shutdown_connections 2024-09-10T22:40:19.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1664204000 1 -- 172.21.15.103:0/770485697 wait complete. 2024-09-10T22:40:19.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1664204000 20 client.5253 trim_cache size 0 max 16384 2024-09-10T22:40:19.494 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:40:19.494 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:40:19.494 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:40:19.494 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:40:19.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1660e00640 1 -- 172.21.15.103:0/3827062082 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16380725e0 msgr2=0x7f1638074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1660e00640 1 --2- 172.21.15.103:0/3827062082 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16380725e0 0x7f1638074aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f164c00f290 tx=0x7f164c009040 comp rx=0 tx=0).stop 2024-09-10T22:40:19.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1660e00640 1 -- 172.21.15.103:0/3827062082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f165c0cf260 msgr2=0x7f165c0adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:19.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1660e00640 1 --2- 172.21.15.103:0/3827062082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f165c0cf260 0x7f165c0adac0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f16540ac000 tx=0x7f16540a5720 comp rx=0 tx=0).stop 2024-09-10T22:40:19.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1660e00640 1 -- 172.21.15.103:0/3827062082 shutdown_connections 2024-09-10T22:40:19.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1660e00640 1 --2- 172.21.15.103:0/3827062082 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16380725e0 0x7f1638074aa0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1660e00640 1 --2- 172.21.15.103:0/3827062082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f165c0cf260 0x7f165c0adac0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1660e00640 1 --2- 172.21.15.103:0/3827062082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f165c0b2c10 0x7f165c0b1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1660e00640 1 --2- 172.21.15.103:0/3827062082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f165c072500 0x7f165c1f7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:19.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1660e00640 1 -- 172.21.15.103:0/3827062082 >> 172.21.15.103:0/3827062082 conn(0x7f165c06cc00 msgr2=0x7f165c1651f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:19.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1660e00640 1 -- 172.21.15.103:0/3827062082 shutdown_connections 2024-09-10T22:40:19.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19.489+0000 7f1660e00640 1 -- 172.21.15.103:0/3827062082 wait complete. 2024-09-10T22:40:19.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:19.512 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2024-09-10T22:40:19.548 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/ 2024-09-10T22:40:19.548 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4 2024-09-10T22:40:19.548 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5 2024-09-10T22:40:19.548 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5/d6 2024-09-10T22:40:19.548 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5/d6/d7 2024-09-10T22:40:19.548 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2024-09-10T22:40:19.549 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:40:19.549 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:40:19.550 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:40:19.550 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:40:19.550 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2024-09-10T22:40:19.550 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:40:19.664 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627778 2024-09-10T22:40:19.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:40:19.673 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:40:19.673 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:40:19.674 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:40:19.674 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:40:19.674 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2024-09-10T22:40:19.674 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:40:19.780 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627779 2024-09-10T22:40:19.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:40:19.789 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:40:19.789 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:40:19.789 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:40:19.789 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:40:19.789 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2024-09-10T22:40:19.789 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:40:19.899 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627780 2024-09-10T22:40:19.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:40:19.908 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:40:19.908 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:40:19.908 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:40:19.908 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:40:19.909 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2024-09-10T22:40:19.909 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:40:20.016 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627781 2024-09-10T22:40:20.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:40:20.026 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:40:20.026 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:40:20.026 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:40:20.026 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:40:20.026 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2024-09-10T22:40:20.026 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:40:20.132 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627782 2024-09-10T22:40:20.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:40:20.141 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:40:20.141 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:40:20.141 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:40:20.141 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:40:20.141 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2024-09-10T22:40:20.141 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:40:20.249 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627783 2024-09-10T22:40:20.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:40:20.257 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 tag path /d1/d2/d3 tag123 2024-09-10T22:40:20.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb79c00640 1 -- 172.21.15.103:0/2137399626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb740cf9f0 msgr2=0x7fdb7406eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:20.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb79c00640 1 --2- 172.21.15.103:0/2137399626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb740cf9f0 0x7fdb7406eb80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdb740d08e0 tx=0x7fdb6401c8c0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb79c00640 1 -- 172.21.15.103:0/2137399626 shutdown_connections 2024-09-10T22:40:20.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb79c00640 1 --2- 172.21.15.103:0/2137399626 >> v2:172.21.15.131:3300/0 conn(0x7fdb740cfdd0 0x7fdb74073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb79c00640 1 --2- 172.21.15.103:0/2137399626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb740cf9f0 0x7fdb7406eb80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb79c00640 1 -- 172.21.15.103:0/2137399626 >> 172.21.15.103:0/2137399626 conn(0x7fdb7406cc00 msgr2=0x7fdb7406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:20.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb79c00640 1 -- 172.21.15.103:0/2137399626 shutdown_connections 2024-09-10T22:40:20.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb79c00640 1 -- 172.21.15.103:0/2137399626 wait complete. 2024-09-10T22:40:20.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb79c00640 1 Processor -- start 2024-09-10T22:40:20.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb79c00640 1 -- start start 2024-09-10T22:40:20.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb79c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb7406f0c0 0x7fdb741f7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb79c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb740cf9f0 0x7fdb7414a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb79c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb740cfdd0 0x7fdb74146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb79c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdb740cd660 con 0x7fdb740cfdd0 2024-09-10T22:40:20.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb79c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdb740cd4e0 con 0x7fdb7406f0c0 2024-09-10T22:40:20.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb79c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdb740cd7e0 con 0x7fdb740cf9f0 2024-09-10T22:40:20.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb73400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb740cfdd0 0x7fdb74146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb73400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb740cfdd0 0x7fdb74146c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55238/0 (socket says 172.21.15.103:55238) 2024-09-10T22:40:20.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.441+0000 7fdb73400640 1 -- 172.21.15.103:0/1710379575 learned_addr learned my addr 172.21.15.103:0/1710379575 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:20.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.445+0000 7fdb72a00640 1 --2- 172.21.15.103:0/1710379575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb7406f0c0 0x7fdb741f7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.445+0000 7fdb6a000640 1 --2- 172.21.15.103:0/1710379575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb740cf9f0 0x7fdb7414a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.445+0000 7fdb73400640 1 -- 172.21.15.103:0/1710379575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb740cf9f0 msgr2=0x7fdb7414a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:20.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.445+0000 7fdb73400640 1 --2- 172.21.15.103:0/1710379575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb740cf9f0 0x7fdb7414a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.445+0000 7fdb73400640 1 -- 172.21.15.103:0/1710379575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb7406f0c0 msgr2=0x7fdb741f7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:20.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.445+0000 7fdb73400640 1 --2- 172.21.15.103:0/1710379575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb7406f0c0 0x7fdb741f7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.445+0000 7fdb73400640 1 -- 172.21.15.103:0/1710379575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7414af10 con 0x7fdb740cfdd0 2024-09-10T22:40:20.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.445+0000 7fdb72a00640 1 --2- 172.21.15.103:0/1710379575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb7406f0c0 0x7fdb741f7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:40:20.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.445+0000 7fdb73400640 1 --2- 172.21.15.103:0/1710379575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb740cfdd0 0x7fdb74146c10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00e970 tx=0x7fdb6c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:20.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.445+0000 7fdb6b400640 1 -- 172.21.15.103:0/1710379575 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c004d30 con 0x7fdb740cfdd0 2024-09-10T22:40:20.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.445+0000 7fdb6b400640 1 -- 172.21.15.103:0/1710379575 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb6c00cb20 con 0x7fdb740cfdd0 2024-09-10T22:40:20.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.445+0000 7fdb79c00640 1 -- 172.21.15.103:0/1710379575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb741f7d60 con 0x7fdb740cfdd0 2024-09-10T22:40:20.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.445+0000 7fdb6b400640 1 -- 172.21.15.103:0/1710379575 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c005020 con 0x7fdb740cfdd0 2024-09-10T22:40:20.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.445+0000 7fdb79c00640 1 -- 172.21.15.103:0/1710379575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb741f8600 con 0x7fdb740cfdd0 2024-09-10T22:40:20.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.445+0000 7fdb6b400640 1 -- 172.21.15.103:0/1710379575 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdb6c00f040 con 0x7fdb740cfdd0 2024-09-10T22:40:20.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb6b400640 1 --2- 172.21.15.103:0/1710379575 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdb500725e0 0x7fdb50074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb7cf49000 1 Processor -- start 2024-09-10T22:40:20.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb6b400640 1 -- 172.21.15.103:0/1710379575 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fdb6c093ad0 con 0x7fdb740cfdd0 2024-09-10T22:40:20.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb7cf49000 1 -- start start 2024-09-10T22:40:20.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb72a00640 1 --2- 172.21.15.103:0/1710379575 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdb500725e0 0x7fdb50074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb72a00640 1 --2- 172.21.15.103:0/1710379575 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdb500725e0 0x7fdb50074aa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdb640af000 tx=0x7fdb6401b100 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:20.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb7cf49000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed0c30 0x5572d4ed1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb7cf49000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4ed1550 0x5572d4e87340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb7cf49000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 0x5572d4e87c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb7cf49000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5572d4ce2a40 con 0x5572d4e87880 2024-09-10T22:40:20.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb7cf49000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5572d4cd1e70 con 0x5572d4ed1550 2024-09-10T22:40:20.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb7cf49000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5572d4cd5c80 con 0x5572d4ed0c30 2024-09-10T22:40:20.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb73400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 0x5572d4e87c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb73400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 0x5572d4e87c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55240/0 (socket says 172.21.15.103:55240) 2024-09-10T22:40:20.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb73400640 1 -- 172.21.15.103:0/2974914627 learned_addr learned my addr 172.21.15.103:0/2974914627 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:20.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb72a00640 1 --2- 172.21.15.103:0/2974914627 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed0c30 0x5572d4ed1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb6a000640 1 --2- 172.21.15.103:0/2974914627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4ed1550 0x5572d4e87340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb73400640 1 -- 172.21.15.103:0/2974914627 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed0c30 msgr2=0x5572d4ed1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:20.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb73400640 1 --2- 172.21.15.103:0/2974914627 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed0c30 0x5572d4ed1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb73400640 1 -- 172.21.15.103:0/2974914627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4ed1550 msgr2=0x5572d4e87340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:20.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb73400640 1 --2- 172.21.15.103:0/2974914627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4ed1550 0x5572d4e87340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb73400640 1 -- 172.21.15.103:0/2974914627 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572d4d1b040 con 0x5572d4e87880 2024-09-10T22:40:20.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb72a00640 1 --2- 172.21.15.103:0/2974914627 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed0c30 0x5572d4ed1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:40:20.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb73400640 1 --2- 172.21.15.103:0/2974914627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 0x5572d4e87c60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c05e810 tx=0x7fdb6c05b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3f6ac2c816c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:20.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb63400640 1 -- 172.21.15.103:0/2974914627 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c01f070 con 0x5572d4e87880 2024-09-10T22:40:20.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb63400640 1 -- 172.21.15.103:0/2974914627 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb6c063360 con 0x5572d4e87880 2024-09-10T22:40:20.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb63400640 1 -- 172.21.15.103:0/2974914627 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c067d80 con 0x5572d4e87880 2024-09-10T22:40:20.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb7cf49000 1 -- 172.21.15.103:0/2974914627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 msgr2=0x5572d4e87c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:20.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/2974914627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 0x5572d4e87c60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c05e810 tx=0x7fdb6c05b000 comp rx=0 tx=0).stop 2024-09-10T22:40:20.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb7cf49000 1 -- 172.21.15.103:0/2974914627 shutdown_connections 2024-09-10T22:40:20.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/2974914627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 0x5572d4e87c60 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/2974914627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4ed1550 0x5572d4e87340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/2974914627 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed0c30 0x5572d4ed1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb7cf49000 1 -- 172.21.15.103:0/2974914627 >> 172.21.15.103:0/2974914627 conn(0x5572d4e83800 msgr2=0x5572d4e85c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:20.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb7cf49000 1 -- 172.21.15.103:0/2974914627 shutdown_connections 2024-09-10T22:40:20.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.449+0000 7fdb7cf49000 1 -- 172.21.15.103:0/2974914627 wait complete. 2024-09-10T22:40:20.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb7cf49000 1 -- start start 2024-09-10T22:40:20.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb7cf49000 1 Processor -- start 2024-09-10T22:40:20.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb7cf49000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 0x5572d4e91bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb7cf49000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4ed0c30 0x5572d4e92130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb7cf49000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed1550 0x5572d4e92670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb7cf49000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5572d4d15b60 con 0x5572d4e87880 2024-09-10T22:40:20.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb7cf49000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5572d4c7b950 con 0x5572d4ed0c30 2024-09-10T22:40:20.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb7cf49000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5572d4c87bb0 con 0x5572d4ed1550 2024-09-10T22:40:20.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb7cf49000 10 client.0 _ll_register_callbacks cb 0x5572d4c783f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:20.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb72a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 0x5572d4e91bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb72a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 0x5572d4e91bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55248/0 (socket says 172.21.15.103:55248) 2024-09-10T22:40:20.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb72a00640 1 -- 172.21.15.103:0/3773004867 learned_addr learned my addr 172.21.15.103:0/3773004867 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:20.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb6a000640 1 --2- 172.21.15.103:0/3773004867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4ed0c30 0x5572d4e92130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb73400640 1 --2- 172.21.15.103:0/3773004867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed1550 0x5572d4e92670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb72a00640 1 -- 172.21.15.103:0/3773004867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed1550 msgr2=0x5572d4e92670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:20.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb72a00640 1 --2- 172.21.15.103:0/3773004867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed1550 0x5572d4e92670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb72a00640 1 -- 172.21.15.103:0/3773004867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4ed0c30 msgr2=0x5572d4e92130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:20.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb72a00640 1 --2- 172.21.15.103:0/3773004867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4ed0c30 0x5572d4e92130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb72a00640 1 -- 172.21.15.103:0/3773004867 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572d4c7ab30 con 0x5572d4e87880 2024-09-10T22:40:20.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb6a000640 1 --2- 172.21.15.103:0/3773004867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4ed0c30 0x5572d4e92130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:40:20.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb72a00640 1 --2- 172.21.15.103:0/3773004867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 0x5572d4e91bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fdb64000c10 tx=0x7fdb64009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fe443a566a03b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:20.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb57e00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:20.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb57e00640 1 -- 172.21.15.103:0/3773004867 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb640bd050 con 0x5572d4e87880 2024-09-10T22:40:20.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb57e00640 1 -- 172.21.15.103:0/3773004867 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fdb64004990 con 0x5572d4e87880 2024-09-10T22:40:20.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb7cf49000 1 -- 172.21.15.103:0/3773004867 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5572d4c6a1e0 con 0x5572d4e87880 2024-09-10T22:40:20.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb57e00640 1 -- 172.21.15.103:0/3773004867 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdb640cf050 con 0x5572d4e87880 2024-09-10T22:40:20.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb7cf49000 10 client.5268 fetch_fsmap learned FSMap version 26 2024-09-10T22:40:20.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb7cf49000 1 -- 172.21.15.103:0/3773004867 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5572d4c700a0 con 0x5572d4e87880 2024-09-10T22:40:20.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb57e00640 1 -- 172.21.15.103:0/3773004867 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5572d4c6a1e0 con 0x5572d4e87880 2024-09-10T22:40:20.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb57e00640 1 -- 172.21.15.103:0/3773004867 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 3554+0+0 (secure 0 0 0) 0x7fdb640d2020 con 0x5572d4e87880 2024-09-10T22:40:20.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb7cf49000 10 client.5268 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:40:20.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb7cf49000 10 client.5268 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-10T22:40:20.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb7cf49000 20 client.5268 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:20.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/3773004867 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5572d4edfed0 0x5572d4ee22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb7cf49000 4 client.5268 mds_command: new command op to 4941 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:40:20.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb7cf49000 1 -- 172.21.15.103:0/3773004867 --> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572d4ce4990 con 0x5572d4edfed0 2024-09-10T22:40:20.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.453+0000 7fdb6a000640 1 --2- 172.21.15.103:0/3773004867 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5572d4edfed0 0x5572d4ee22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.457+0000 7fdb6a000640 1 --2- 172.21.15.103:0/3773004867 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5572d4edfed0 0x5572d4ee22c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c81359edbc9fe4de server_cookie=bc020ec5e62a6546 in_seq=0 out_seq=0 2024-09-10T22:40:20.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.457+0000 7fdb57e00640 10 client.5268 ms_handle_connect on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:20.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.457+0000 7fdb57e00640 1 -- 172.21.15.103:0/3773004867 <== mds.0 v2:172.21.15.103:6834/1194009116 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5572d4ce4990 con 0x5572d4edfed0 2024-09-10T22:40:20.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.457+0000 7fdb57e00640 10 client.5268 handle_command_reply: tid=0 2024-09-10T22:40:20.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.457+0000 7fdb7cf49000 1 client.5268 shutdown 2024-09-10T22:40:20.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.457+0000 7fdb7cf49000 1 -- 172.21.15.103:0/3773004867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 msgr2=0x5572d4e91bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:20.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.457+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/3773004867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 0x5572d4e91bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fdb64000c10 tx=0x7fdb64009260 comp rx=0 tx=0).stop 2024-09-10T22:40:20.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.457+0000 7fdb7cf49000 1 -- 172.21.15.103:0/3773004867 shutdown_connections 2024-09-10T22:40:20.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.457+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/3773004867 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5572d4edfed0 0x5572d4ee22c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.457+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/3773004867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed1550 0x5572d4e92670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.457+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/3773004867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4ed0c30 0x5572d4e92130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.457+0000 7fdb57e00640 0 client.5268 ms_handle_reset on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:20.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.457+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/3773004867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 0x5572d4e91bf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.457+0000 7fdb7cf49000 1 -- 172.21.15.103:0/3773004867 >> 172.21.15.103:0/3773004867 conn(0x5572d4e83800 msgr2=0x5572d4e86410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:20.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.457+0000 7fdb7cf49000 1 -- 172.21.15.103:0/3773004867 shutdown_connections 2024-09-10T22:40:20.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.457+0000 7fdb7cf49000 1 -- 172.21.15.103:0/3773004867 wait complete. 2024-09-10T22:40:20.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.457+0000 7fdb7cf49000 20 client.5268 trim_cache size 0 max 16384 2024-09-10T22:40:20.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 Processor -- start 2024-09-10T22:40:20.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 -- start start 2024-09-10T22:40:20.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 0x5572d4e8ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4ed0c30 0x5572d4e8cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed1550 0x5572d4ee52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdb742035c0 con 0x5572d4e87880 2024-09-10T22:40:20.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdb74203cc0 con 0x5572d4ed0c30 2024-09-10T22:40:20.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdb741fbac0 con 0x5572d4ed1550 2024-09-10T22:40:20.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb72a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 0x5572d4e8ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb72a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 0x5572d4e8ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55252/0 (socket says 172.21.15.103:55252) 2024-09-10T22:40:20.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb72a00640 1 -- 172.21.15.103:0/178838871 learned_addr learned my addr 172.21.15.103:0/178838871 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:20.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb72a00640 1 -- 172.21.15.103:0/178838871 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed1550 msgr2=0x5572d4ee52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:20.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb72a00640 1 --2- 172.21.15.103:0/178838871 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed1550 0x5572d4ee52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb72a00640 1 -- 172.21.15.103:0/178838871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4ed0c30 msgr2=0x5572d4e8cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:20.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb72a00640 1 --2- 172.21.15.103:0/178838871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4ed0c30 0x5572d4e8cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb72a00640 1 -- 172.21.15.103:0/178838871 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572d4d56dc0 con 0x5572d4e87880 2024-09-10T22:40:20.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb72a00640 1 --2- 172.21.15.103:0/178838871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 0x5572d4e8ca40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009800 tx=0x7fdb64004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686c54381e6ab38b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:20.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb62a00640 1 -- 172.21.15.103:0/178838871 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb640d9070 con 0x5572d4e87880 2024-09-10T22:40:20.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb62a00640 1 -- 172.21.15.103:0/178838871 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb640c7070 con 0x5572d4e87880 2024-09-10T22:40:20.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb62a00640 1 -- 172.21.15.103:0/178838871 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb640bd040 con 0x5572d4e87880 2024-09-10T22:40:20.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 -- 172.21.15.103:0/178838871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 msgr2=0x5572d4e8ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:20.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/178838871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 0x5572d4e8ca40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009800 tx=0x7fdb64004d50 comp rx=0 tx=0).stop 2024-09-10T22:40:20.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 -- 172.21.15.103:0/178838871 shutdown_connections 2024-09-10T22:40:20.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/178838871 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed1550 0x5572d4ee52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/178838871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4ed0c30 0x5572d4e8cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/178838871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4e87880 0x5572d4e8ca40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 -- 172.21.15.103:0/178838871 >> 172.21.15.103:0/178838871 conn(0x5572d4e83800 msgr2=0x5572d4e8c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:20.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 -- 172.21.15.103:0/178838871 shutdown_connections 2024-09-10T22:40:20.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 -- 172.21.15.103:0/178838871 wait complete. 2024-09-10T22:40:20.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 -- start start 2024-09-10T22:40:20.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.477+0000 7fdb7cf49000 1 Processor -- start 2024-09-10T22:40:20.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb7cf49000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4e87880 0x5572d4f46a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb7cf49000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4ed0c30 0x5572d4f46fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb7cf49000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed1550 0x5572d4f474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb7cf49000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5572d4c9df40 con 0x5572d4ed0c30 2024-09-10T22:40:20.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb7cf49000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5572d4c9d760 con 0x5572d4e87880 2024-09-10T22:40:20.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb7cf49000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5572d4cd4f90 con 0x5572d4ed1550 2024-09-10T22:40:20.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb7cf49000 10 client.0 _ll_register_callbacks cb 0x7fdb640ba040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:20.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb6a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4ed0c30 0x5572d4f46fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb6a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4ed0c30 0x5572d4f46fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55254/0 (socket says 172.21.15.103:55254) 2024-09-10T22:40:20.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb6a000640 1 -- 172.21.15.103:0/2548843542 learned_addr learned my addr 172.21.15.103:0/2548843542 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:20.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb72a00640 1 --2- 172.21.15.103:0/2548843542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4e87880 0x5572d4f46a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb73400640 1 --2- 172.21.15.103:0/2548843542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed1550 0x5572d4f474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb6a000640 1 -- 172.21.15.103:0/2548843542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed1550 msgr2=0x5572d4f474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:20.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb6a000640 1 --2- 172.21.15.103:0/2548843542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed1550 0x5572d4f474f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb6a000640 1 -- 172.21.15.103:0/2548843542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4e87880 msgr2=0x5572d4f46a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb6a000640 1 --2- 172.21.15.103:0/2548843542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4e87880 0x5572d4f46a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb6a000640 1 -- 172.21.15.103:0/2548843542 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572d4c68620 con 0x5572d4ed0c30 2024-09-10T22:40:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb6a000640 1 --2- 172.21.15.103:0/2548843542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4ed0c30 0x5572d4f46fb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdb7415ad30 tx=0x7fdb5c004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261c47c6fce83eea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb57e00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb57e00640 1 -- 172.21.15.103:0/2548843542 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c021020 con 0x5572d4ed0c30 2024-09-10T22:40:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb57e00640 1 -- 172.21.15.103:0/2548843542 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fdb5c018b50 con 0x5572d4ed0c30 2024-09-10T22:40:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb7cf49000 1 -- 172.21.15.103:0/2548843542 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb640c7070 con 0x5572d4ed0c30 2024-09-10T22:40:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb57e00640 1 -- 172.21.15.103:0/2548843542 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdb5c02b050 con 0x5572d4ed0c30 2024-09-10T22:40:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb7cf49000 10 client.5274 fetch_fsmap learned FSMap version 26 2024-09-10T22:40:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb7cf49000 1 -- 172.21.15.103:0/2548843542 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5572d4c9aaf0 con 0x5572d4ed0c30 2024-09-10T22:40:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb57e00640 1 -- 172.21.15.103:0/2548843542 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb640c7070 con 0x5572d4ed0c30 2024-09-10T22:40:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb57e00640 1 -- 172.21.15.103:0/2548843542 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 3554+0+0 (secure 0 0 0) 0x7fdb5c02e020 con 0x5572d4ed0c30 2024-09-10T22:40:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb7cf49000 10 client.5274 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:40:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb7cf49000 10 client.5274 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-10T22:40:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb7cf49000 20 client.5274 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/2548843542 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5572d4ee3d80 0x5572d4ee4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb7cf49000 4 client.5274 mds_command: new command op to 4941 tid=0 multi_id=0 [{"prefix": "tag path", "path": "/d1/d2/d3", "tag": "tag123"}] 2024-09-10T22:40:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb7cf49000 1 -- 172.21.15.103:0/2548843542 --> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] -- command(tid 0: {"prefix": "tag path", "path": "/d1/d2/d3", "tag": "tag123"}) -- 0x5572d4ce0440 con 0x5572d4ee3d80 2024-09-10T22:40:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb72a00640 1 --2- 172.21.15.103:0/2548843542 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5572d4ee3d80 0x5572d4ee4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb72a00640 1 --2- 172.21.15.103:0/2548843542 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5572d4ee3d80 0x5572d4ee4190 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b2da110f49d01ea server_cookie=20239523ff9b2cac in_seq=0 out_seq=0 2024-09-10T22:40:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb57e00640 10 client.5274 ms_handle_connect on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:20.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb57e00640 1 -- 172.21.15.103:0/2548843542 <== mds.0 v2:172.21.15.103:6834/1194009116 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x5572d4ce0440 con 0x5572d4ee3d80 2024-09-10T22:40:20.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb57e00640 10 client.5274 handle_command_reply: tid=0 2024-09-10T22:40:20.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.481+0000 7fdb7cf49000 1 client.5274 shutdown 2024-09-10T22:40:20.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb7cf49000 1 -- 172.21.15.103:0/2548843542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4ed0c30 msgr2=0x5572d4f46fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:20.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/2548843542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4ed0c30 0x5572d4f46fb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdb7415ad30 tx=0x7fdb5c004d70 comp rx=0 tx=0).stop 2024-09-10T22:40:20.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb7cf49000 1 -- 172.21.15.103:0/2548843542 shutdown_connections 2024-09-10T22:40:20.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/2548843542 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5572d4ee3d80 0x5572d4ee4190 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/2548843542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572d4ed1550 0x5572d4f474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/2548843542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5572d4ed0c30 0x5572d4f46fb0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb7cf49000 1 --2- 172.21.15.103:0/2548843542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572d4e87880 0x5572d4f46a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb7cf49000 1 -- 172.21.15.103:0/2548843542 >> 172.21.15.103:0/2548843542 conn(0x5572d4e83800 msgr2=0x5572d4e8cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:20.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb57e00640 0 client.5274 ms_handle_reset on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:20.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb7cf49000 1 -- 172.21.15.103:0/2548843542 shutdown_connections 2024-09-10T22:40:20.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb7cf49000 1 -- 172.21.15.103:0/2548843542 wait complete. 2024-09-10T22:40:20.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb7cf49000 20 client.5274 trim_cache size 0 max 16384 2024-09-10T22:40:20.492 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:40:20.492 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0, 2024-09-10T22:40:20.492 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_tag": "tag123", 2024-09-10T22:40:20.493 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": "asynchronous" 2024-09-10T22:40:20.493 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:40:20.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb79c00640 1 -- 172.21.15.103:0/1710379575 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdb500725e0 msgr2=0x7fdb50074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:20.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb79c00640 1 --2- 172.21.15.103:0/1710379575 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdb500725e0 0x7fdb50074aa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdb640af000 tx=0x7fdb6401b100 comp rx=0 tx=0).stop 2024-09-10T22:40:20.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb79c00640 1 -- 172.21.15.103:0/1710379575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb740cfdd0 msgr2=0x7fdb74146c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:20.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb79c00640 1 --2- 172.21.15.103:0/1710379575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb740cfdd0 0x7fdb74146c10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00e970 tx=0x7fdb6c00ee30 comp rx=0 tx=0).stop 2024-09-10T22:40:20.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb79c00640 1 -- 172.21.15.103:0/1710379575 shutdown_connections 2024-09-10T22:40:20.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb79c00640 1 --2- 172.21.15.103:0/1710379575 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdb500725e0 0x7fdb50074aa0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb79c00640 1 --2- 172.21.15.103:0/1710379575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb740cfdd0 0x7fdb74146c10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb79c00640 1 --2- 172.21.15.103:0/1710379575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb740cf9f0 0x7fdb7414a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb79c00640 1 --2- 172.21.15.103:0/1710379575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb7406f0c0 0x7fdb741f7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.485+0000 7fdb79c00640 1 -- 172.21.15.103:0/1710379575 >> 172.21.15.103:0/1710379575 conn(0x7fdb7406cc00 msgr2=0x7fdb740b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:20.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.489+0000 7fdb79c00640 1 -- 172.21.15.103:0/1710379575 shutdown_connections 2024-09-10T22:40:20.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.489+0000 7fdb79c00640 1 -- 172.21.15.103:0/1710379575 wait complete. 2024-09-10T22:40:20.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:20.511 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-10T22:40:20.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.649+0000 7f3914a00640 1 -- 172.21.15.103:0/3975940329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39100aeb40 msgr2=0x7f3910072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:20.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.649+0000 7f3914a00640 1 --2- 172.21.15.103:0/3975940329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39100aeb40 0x7f3910072e30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009840 tx=0x7f38f801c760 comp rx=0 tx=0).stop 2024-09-10T22:40:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.649+0000 7f3914a00640 1 -- 172.21.15.103:0/3975940329 shutdown_connections 2024-09-10T22:40:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.649+0000 7f3914a00640 1 --2- 172.21.15.103:0/3975940329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39100aeb40 0x7f3910072e30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.649+0000 7f3914a00640 1 -- 172.21.15.103:0/3975940329 >> 172.21.15.103:0/3975940329 conn(0x7f391006cc00 msgr2=0x7f391006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.649+0000 7f3914a00640 1 -- 172.21.15.103:0/3975940329 shutdown_connections 2024-09-10T22:40:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.649+0000 7f3914a00640 1 -- 172.21.15.103:0/3975940329 wait complete. 2024-09-10T22:40:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3914a00640 1 Processor -- start 2024-09-10T22:40:20.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3914a00640 1 -- start start 2024-09-10T22:40:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3914a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39100aeb40 0x7f3910155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3914a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39100cc120 0x7f391013f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3914a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39100cf790 0x7f3910154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3914a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f391016a250 con 0x7f39100cc120 2024-09-10T22:40:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3914a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f391016a0d0 con 0x7f39100cf790 2024-09-10T22:40:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3914a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f391016a3d0 con 0x7f39100aeb40 2024-09-10T22:40:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3905400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39100cc120 0x7f391013f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3905400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39100cc120 0x7f391013f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55286/0 (socket says 172.21.15.103:55286) 2024-09-10T22:40:20.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3905400640 1 -- 172.21.15.103:0/4269608905 learned_addr learned my addr 172.21.15.103:0/4269608905 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:20.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3905400640 1 -- 172.21.15.103:0/4269608905 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39100aeb40 msgr2=0x7f3910155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:20.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3905400640 1 --2- 172.21.15.103:0/4269608905 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39100aeb40 0x7f3910155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3905400640 1 -- 172.21.15.103:0/4269608905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39100cf790 msgr2=0x7f3910154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:20.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3905400640 1 --2- 172.21.15.103:0/4269608905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39100cf790 0x7f3910154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3905400640 1 -- 172.21.15.103:0/4269608905 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3910154000 con 0x7f39100cc120 2024-09-10T22:40:20.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3905400640 1 --2- 172.21.15.103:0/4269608905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39100cc120 0x7f391013f010 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009790 tx=0x7f38f80040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:20.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3906a00640 1 -- 172.21.15.103:0/4269608905 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f80bb070 con 0x7f39100cc120 2024-09-10T22:40:20.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3906a00640 1 -- 172.21.15.103:0/4269608905 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38f8005030 con 0x7f39100cc120 2024-09-10T22:40:20.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3914a00640 1 -- 172.21.15.103:0/4269608905 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f391013f550 con 0x7f39100cc120 2024-09-10T22:40:20.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3906a00640 1 -- 172.21.15.103:0/4269608905 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f80b2040 con 0x7f39100cc120 2024-09-10T22:40:20.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.653+0000 7f3914a00640 1 -- 172.21.15.103:0/4269608905 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3910154550 con 0x7f39100cc120 2024-09-10T22:40:20.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.657+0000 7f3906a00640 1 -- 172.21.15.103:0/4269608905 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f38f80b5030 con 0x7f39100cc120 2024-09-10T22:40:20.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.657+0000 7f3906a00640 1 --2- 172.21.15.103:0/4269608905 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f38ec0725e0 0x7f38ec074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.657+0000 7f3917e45000 1 Processor -- start 2024-09-10T22:40:20.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.657+0000 7f3906a00640 1 -- 172.21.15.103:0/4269608905 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f38f812cdb0 con 0x7f39100cc120 2024-09-10T22:40:20.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.657+0000 7f3917e45000 1 -- start start 2024-09-10T22:40:20.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.657+0000 7f390de00640 1 --2- 172.21.15.103:0/4269608905 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f38ec0725e0 0x7f38ec074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.657+0000 7f3917e45000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 0x55d26eaa0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.657+0000 7f3917e45000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26eaa12d0 0x55d26ea4e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.657+0000 7f3917e45000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26ea4ebc0 0x55d26ea4efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.657+0000 7f3917e45000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d26e936cb0 con 0x55d26eaa09b0 2024-09-10T22:40:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.657+0000 7f3917e45000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d26e84c310 con 0x55d26eaa12d0 2024-09-10T22:40:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.657+0000 7f3917e45000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55d26e8a9b90 con 0x55d26ea4ebc0 2024-09-10T22:40:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.657+0000 7f390de00640 1 --2- 172.21.15.103:0/4269608905 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f38ec0725e0 0x7f38ec074aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3900007fd0 tx=0x7f39000078e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.657+0000 7f390de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 0x55d26eaa0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.657+0000 7f390de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 0x55d26eaa0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55288/0 (socket says 172.21.15.103:55288) 2024-09-10T22:40:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f390de00640 1 -- 172.21.15.103:0/1375560096 learned_addr learned my addr 172.21.15.103:0/1375560096 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3905400640 1 --2- 172.21.15.103:0/1375560096 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26eaa12d0 0x55d26ea4e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f390e800640 1 --2- 172.21.15.103:0/1375560096 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26ea4ebc0 0x55d26ea4efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f390de00640 1 -- 172.21.15.103:0/1375560096 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26ea4ebc0 msgr2=0x55d26ea4efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:20.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f390de00640 1 --2- 172.21.15.103:0/1375560096 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26ea4ebc0 0x55d26ea4efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f390de00640 1 -- 172.21.15.103:0/1375560096 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26eaa12d0 msgr2=0x55d26ea4e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:20.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f390de00640 1 --2- 172.21.15.103:0/1375560096 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26eaa12d0 0x55d26ea4e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f390de00640 1 -- 172.21.15.103:0/1375560096 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d26e84dc60 con 0x55d26eaa09b0 2024-09-10T22:40:20.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f390de00640 1 --2- 172.21.15.103:0/1375560096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 0x55d26eaa0d90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3900005560 tx=0x7f390000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89b76574a817449 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:20.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f38fea00640 1 -- 172.21.15.103:0/1375560096 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3900016510 con 0x55d26eaa09b0 2024-09-10T22:40:20.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f38fea00640 1 -- 172.21.15.103:0/1375560096 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39000166b0 con 0x55d26eaa09b0 2024-09-10T22:40:20.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f38fea00640 1 -- 172.21.15.103:0/1375560096 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3900016ac0 con 0x55d26eaa09b0 2024-09-10T22:40:20.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3917e45000 1 -- 172.21.15.103:0/1375560096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 msgr2=0x55d26eaa0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:20.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3917e45000 1 --2- 172.21.15.103:0/1375560096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 0x55d26eaa0d90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3900005560 tx=0x7f390000f000 comp rx=0 tx=0).stop 2024-09-10T22:40:20.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3917e45000 1 -- 172.21.15.103:0/1375560096 shutdown_connections 2024-09-10T22:40:20.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3917e45000 1 --2- 172.21.15.103:0/1375560096 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26ea4ebc0 0x55d26ea4efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3917e45000 1 --2- 172.21.15.103:0/1375560096 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26eaa12d0 0x55d26ea4e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3917e45000 1 --2- 172.21.15.103:0/1375560096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 0x55d26eaa0d90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3917e45000 1 -- 172.21.15.103:0/1375560096 >> 172.21.15.103:0/1375560096 conn(0x55d26ea54d20 msgr2=0x55d26ea4cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:20.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3917e45000 1 -- 172.21.15.103:0/1375560096 shutdown_connections 2024-09-10T22:40:20.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3917e45000 1 -- 172.21.15.103:0/1375560096 wait complete. 2024-09-10T22:40:20.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3917e45000 1 -- start start 2024-09-10T22:40:20.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3917e45000 1 Processor -- start 2024-09-10T22:40:20.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3917e45000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26ea4ebc0 0x55d26eaa7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3917e45000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26eaa09b0 0x55d26eaa8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3917e45000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26eaa12d0 0x55d26eaa87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3917e45000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d26e89cdd0 con 0x55d26ea4ebc0 2024-09-10T22:40:20.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3917e45000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d26e898fc0 con 0x55d26eaa09b0 2024-09-10T22:40:20.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3917e45000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55d26e83e4b0 con 0x55d26eaa12d0 2024-09-10T22:40:20.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f3917e45000 10 client.0 _ll_register_callbacks cb 0x55d26e81c7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:20.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f390de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26ea4ebc0 0x55d26eaa7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f390de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26ea4ebc0 0x55d26eaa7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55294/0 (socket says 172.21.15.103:55294) 2024-09-10T22:40:20.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.661+0000 7f390de00640 1 -- 172.21.15.103:0/4253429854 learned_addr learned my addr 172.21.15.103:0/4253429854 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:20.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3905400640 1 --2- 172.21.15.103:0/4253429854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26eaa09b0 0x55d26eaa8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f390e800640 1 --2- 172.21.15.103:0/4253429854 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26eaa12d0 0x55d26eaa87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f390de00640 1 -- 172.21.15.103:0/4253429854 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26eaa12d0 msgr2=0x55d26eaa87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:20.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f390de00640 1 --2- 172.21.15.103:0/4253429854 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26eaa12d0 0x55d26eaa87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f390de00640 1 -- 172.21.15.103:0/4253429854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26eaa09b0 msgr2=0x55d26eaa8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:20.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f390de00640 1 --2- 172.21.15.103:0/4253429854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26eaa09b0 0x55d26eaa8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f390de00640 1 -- 172.21.15.103:0/4253429854 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d26e8371f0 con 0x55d26ea4ebc0 2024-09-10T22:40:20.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3905400640 1 --2- 172.21.15.103:0/4253429854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26eaa09b0 0x55d26eaa8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:40:20.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f390de00640 1 --2- 172.21.15.103:0/4253429854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26ea4ebc0 0x55d26eaa7d40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3900001ec0 tx=0x7f3900016b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4afe6e83e3eb57 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:20.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f38f3400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:20.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f38f3400640 1 -- 172.21.15.103:0/4253429854 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3900007ad0 con 0x55d26ea4ebc0 2024-09-10T22:40:20.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f38f3400640 1 -- 172.21.15.103:0/4253429854 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f3900001300 con 0x55d26ea4ebc0 2024-09-10T22:40:20.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 1 -- 172.21.15.103:0/4253429854 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d26e831330 con 0x55d26ea4ebc0 2024-09-10T22:40:20.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f38f3400640 1 -- 172.21.15.103:0/4253429854 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f39000067c0 con 0x55d26ea4ebc0 2024-09-10T22:40:20.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 10 client.5289 fetch_fsmap learned FSMap version 26 2024-09-10T22:40:20.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 1 -- 172.21.15.103:0/4253429854 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55d26e81dfa0 con 0x55d26ea4ebc0 2024-09-10T22:40:20.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f38f3400640 1 -- 172.21.15.103:0/4253429854 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3900024020 con 0x55d26ea4ebc0 2024-09-10T22:40:20.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f38f3400640 1 -- 172.21.15.103:0/4253429854 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 3554+0+0 (secure 0 0 0) 0x7f3900006a50 con 0x55d26ea4ebc0 2024-09-10T22:40:20.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 10 client.5289 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:40:20.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 10 client.5289 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-10T22:40:20.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 20 client.5289 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:20.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 1 --2- 172.21.15.103:0/4253429854 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x55d26eab0110 0x55d26eab2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 4 client.5289 mds_command: new command op to 4941 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:40:20.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 1 -- 172.21.15.103:0/4253429854 --> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d26e8abae0 con 0x55d26eab0110 2024-09-10T22:40:20.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3905400640 1 --2- 172.21.15.103:0/4253429854 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x55d26eab0110 0x55d26eab2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3905400640 1 --2- 172.21.15.103:0/4253429854 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x55d26eab0110 0x55d26eab2500 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58e8a896c1876272 server_cookie=7c1a167ab90d3819 in_seq=0 out_seq=0 2024-09-10T22:40:20.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f38f3400640 10 client.5289 ms_handle_connect on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:20.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f38f3400640 1 -- 172.21.15.103:0/4253429854 <== mds.0 v2:172.21.15.103:6834/1194009116 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d26e8abae0 con 0x55d26eab0110 2024-09-10T22:40:20.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f38f3400640 10 client.5289 handle_command_reply: tid=0 2024-09-10T22:40:20.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 1 client.5289 shutdown 2024-09-10T22:40:20.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 1 -- 172.21.15.103:0/4253429854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26ea4ebc0 msgr2=0x55d26eaa7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:20.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 1 --2- 172.21.15.103:0/4253429854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26ea4ebc0 0x55d26eaa7d40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3900001ec0 tx=0x7f3900016b20 comp rx=0 tx=0).stop 2024-09-10T22:40:20.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 1 -- 172.21.15.103:0/4253429854 shutdown_connections 2024-09-10T22:40:20.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 1 --2- 172.21.15.103:0/4253429854 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x55d26eab0110 0x55d26eab2500 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 1 --2- 172.21.15.103:0/4253429854 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26eaa12d0 0x55d26eaa87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 1 --2- 172.21.15.103:0/4253429854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26eaa09b0 0x55d26eaa8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 1 --2- 172.21.15.103:0/4253429854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26ea4ebc0 0x55d26eaa7d40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f38f3400640 0 client.5289 ms_handle_reset on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:20.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 1 -- 172.21.15.103:0/4253429854 >> 172.21.15.103:0/4253429854 conn(0x55d26ea54d20 msgr2=0x55d26ea4cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:20.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 1 -- 172.21.15.103:0/4253429854 shutdown_connections 2024-09-10T22:40:20.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 1 -- 172.21.15.103:0/4253429854 wait complete. 2024-09-10T22:40:20.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.665+0000 7f3917e45000 20 client.5289 trim_cache size 0 max 16384 2024-09-10T22:40:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3917e45000 1 Processor -- start 2024-09-10T22:40:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3917e45000 1 -- start start 2024-09-10T22:40:20.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3917e45000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26ea4ebc0 0x55d26eb12440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3917e45000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 0x55d26eb12980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3917e45000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26eaa12d0 0x55d26eb12ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3917e45000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f39100ad200 con 0x55d26eaa09b0 2024-09-10T22:40:20.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3917e45000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f39100ac3d0 con 0x55d26ea4ebc0 2024-09-10T22:40:20.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3917e45000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f39100acad0 con 0x55d26eaa12d0 2024-09-10T22:40:20.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3905400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 0x55d26eb12980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3905400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 0x55d26eb12980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55302/0 (socket says 172.21.15.103:55302) 2024-09-10T22:40:20.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3905400640 1 -- 172.21.15.103:0/377866898 learned_addr learned my addr 172.21.15.103:0/377866898 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:20.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f390e800640 1 --2- 172.21.15.103:0/377866898 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26eaa12d0 0x55d26eb12ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3905400640 1 -- 172.21.15.103:0/377866898 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26eaa12d0 msgr2=0x55d26eb12ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:20.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f390de00640 1 --2- 172.21.15.103:0/377866898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26ea4ebc0 0x55d26eb12440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3905400640 1 --2- 172.21.15.103:0/377866898 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26eaa12d0 0x55d26eb12ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3905400640 1 -- 172.21.15.103:0/377866898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26ea4ebc0 msgr2=0x55d26eb12440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:20.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3905400640 1 --2- 172.21.15.103:0/377866898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26ea4ebc0 0x55d26eb12440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3905400640 1 -- 172.21.15.103:0/377866898 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d26e8f6660 con 0x55d26eaa09b0 2024-09-10T22:40:20.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f390e800640 1 --2- 172.21.15.103:0/377866898 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26eaa12d0 0x55d26eb12ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:40:20.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f390de00640 1 --2- 172.21.15.103:0/377866898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26ea4ebc0 0x55d26eb12440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:40:20.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3905400640 1 --2- 172.21.15.103:0/377866898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 0x55d26eb12980 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009840 tx=0x7f38f801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4bb53d1da0e1b67 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:20.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f38fe000640 1 -- 172.21.15.103:0/377866898 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f80f7bf0 con 0x55d26eaa09b0 2024-09-10T22:40:20.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f38fe000640 1 -- 172.21.15.103:0/377866898 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38f80fc6d0 con 0x55d26eaa09b0 2024-09-10T22:40:20.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f38fe000640 1 -- 172.21.15.103:0/377866898 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f81010f0 con 0x55d26eaa09b0 2024-09-10T22:40:20.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3917e45000 1 -- 172.21.15.103:0/377866898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 msgr2=0x55d26eb12980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:20.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3917e45000 1 --2- 172.21.15.103:0/377866898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 0x55d26eb12980 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009840 tx=0x7f38f801c760 comp rx=0 tx=0).stop 2024-09-10T22:40:20.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3917e45000 1 -- 172.21.15.103:0/377866898 shutdown_connections 2024-09-10T22:40:20.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3917e45000 1 --2- 172.21.15.103:0/377866898 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26eaa12d0 0x55d26eb12ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3917e45000 1 --2- 172.21.15.103:0/377866898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 0x55d26eb12980 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3917e45000 1 --2- 172.21.15.103:0/377866898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26ea4ebc0 0x55d26eb12440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3917e45000 1 -- 172.21.15.103:0/377866898 >> 172.21.15.103:0/377866898 conn(0x55d26ea54d20 msgr2=0x55d26ea4fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:20.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3917e45000 1 -- 172.21.15.103:0/377866898 shutdown_connections 2024-09-10T22:40:20.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.685+0000 7f3917e45000 1 -- 172.21.15.103:0/377866898 wait complete. 2024-09-10T22:40:20.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3917e45000 1 -- start start 2024-09-10T22:40:20.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3917e45000 1 Processor -- start 2024-09-10T22:40:20.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3917e45000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26ea4ebc0 0x55d26eb12e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3917e45000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 0x55d26eab6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3917e45000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26eaa12d0 0x55d26eab6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3917e45000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d26e89cdd0 con 0x55d26eaa09b0 2024-09-10T22:40:20.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3917e45000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d26ea57d40 con 0x55d26eaa12d0 2024-09-10T22:40:20.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3917e45000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55d26ea55100 con 0x55d26ea4ebc0 2024-09-10T22:40:20.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3917e45000 10 client.0 _ll_register_callbacks cb 0x7f38f8009580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:20.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3905400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 0x55d26eab6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3905400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 0x55d26eab6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55316/0 (socket says 172.21.15.103:55316) 2024-09-10T22:40:20.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3905400640 1 -- 172.21.15.103:0/4211956961 learned_addr learned my addr 172.21.15.103:0/4211956961 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:20.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f390de00640 1 --2- 172.21.15.103:0/4211956961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26ea4ebc0 0x55d26eb12e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f390e800640 1 --2- 172.21.15.103:0/4211956961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26eaa12d0 0x55d26eab6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3905400640 1 -- 172.21.15.103:0/4211956961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26ea4ebc0 msgr2=0x55d26eb12e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:20.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3905400640 1 --2- 172.21.15.103:0/4211956961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26ea4ebc0 0x55d26eb12e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3905400640 1 -- 172.21.15.103:0/4211956961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26eaa12d0 msgr2=0x55d26eab6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:20.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3905400640 1 --2- 172.21.15.103:0/4211956961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26eaa12d0 0x55d26eab6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3905400640 1 -- 172.21.15.103:0/4211956961 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d26e863090 con 0x55d26eaa09b0 2024-09-10T22:40:20.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f390e800640 1 --2- 172.21.15.103:0/4211956961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26eaa12d0 0x55d26eab6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:40:20.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3905400640 1 --2- 172.21.15.103:0/4211956961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 0x55d26eab6760 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f38f801cc40 tx=0x7f38f8101180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215cf4b1b6163554 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:20.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f38f3400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:20.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f38f3400640 1 -- 172.21.15.103:0/4211956961 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f80f3e60 con 0x55d26eaa09b0 2024-09-10T22:40:20.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f38f3400640 1 -- 172.21.15.103:0/4211956961 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f38f8005460 con 0x55d26eaa09b0 2024-09-10T22:40:20.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3917e45000 1 -- 172.21.15.103:0/4211956961 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38f80fc6d0 con 0x55d26eaa09b0 2024-09-10T22:40:20.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f38f3400640 1 -- 172.21.15.103:0/4211956961 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f38f80fc020 con 0x55d26eaa09b0 2024-09-10T22:40:20.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3917e45000 10 client.5295 fetch_fsmap learned FSMap version 26 2024-09-10T22:40:20.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3917e45000 1 -- 172.21.15.103:0/4211956961 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55d26e82f5f0 con 0x55d26eaa09b0 2024-09-10T22:40:20.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f38f3400640 1 -- 172.21.15.103:0/4211956961 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38f80fc6d0 con 0x55d26eaa09b0 2024-09-10T22:40:20.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f38f3400640 1 -- 172.21.15.103:0/4211956961 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 3554+0+0 (secure 0 0 0) 0x7f38f8100c60 con 0x55d26eaa09b0 2024-09-10T22:40:20.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3917e45000 10 client.5295 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:40:20.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3917e45000 10 client.5295 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-10T22:40:20.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3917e45000 20 client.5295 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:20.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3917e45000 1 --2- 172.21.15.103:0/4211956961 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x55d26ead2e40 0x55d26ead3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:20.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3917e45000 4 client.5295 mds_command: new command op to 4941 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:40:20.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f3917e45000 1 -- 172.21.15.103:0/4211956961 --> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d26e8a7590 con 0x55d26ead2e40 2024-09-10T22:40:20.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f390de00640 1 --2- 172.21.15.103:0/4211956961 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x55d26ead2e40 0x55d26ead3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:20.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f390de00640 1 --2- 172.21.15.103:0/4211956961 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x55d26ead2e40 0x55d26ead3250 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d036f5184f5310f server_cookie=fab5881a5d22ba76 in_seq=0 out_seq=0 2024-09-10T22:40:20.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.689+0000 7f38f3400640 10 client.5295 ms_handle_connect on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:20.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f38f3400640 1 -- 172.21.15.103:0/4211956961 <== mds.0 v2:172.21.15.103:6834/1194009116 1 ==== command_reply(tid 0: 0 ) ==== 8+0+496 (crc 0 0 0) 0x55d26e8a7590 con 0x55d26ead2e40 2024-09-10T22:40:20.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f38f3400640 10 client.5295 handle_command_reply: tid=0 2024-09-10T22:40:20.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3917e45000 1 client.5295 shutdown 2024-09-10T22:40:20.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3917e45000 1 -- 172.21.15.103:0/4211956961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 msgr2=0x55d26eab6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:20.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3917e45000 1 --2- 172.21.15.103:0/4211956961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 0x55d26eab6760 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f38f801cc40 tx=0x7f38f8101180 comp rx=0 tx=0).stop 2024-09-10T22:40:20.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3917e45000 1 -- 172.21.15.103:0/4211956961 shutdown_connections 2024-09-10T22:40:20.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3917e45000 1 --2- 172.21.15.103:0/4211956961 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x55d26ead2e40 0x55d26ead3250 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3917e45000 1 --2- 172.21.15.103:0/4211956961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d26eaa12d0 0x55d26eab6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3917e45000 1 --2- 172.21.15.103:0/4211956961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d26eaa09b0 0x55d26eab6760 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f38f3400640 0 client.5295 ms_handle_reset on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:20.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3917e45000 1 --2- 172.21.15.103:0/4211956961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d26ea4ebc0 0x55d26eb12e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3917e45000 1 -- 172.21.15.103:0/4211956961 >> 172.21.15.103:0/4211956961 conn(0x55d26ea54d20 msgr2=0x55d26ea4fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:20.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3917e45000 1 -- 172.21.15.103:0/4211956961 shutdown_connections 2024-09-10T22:40:20.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3917e45000 1 -- 172.21.15.103:0/4211956961 wait complete. 2024-09-10T22:40:20.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3917e45000 20 client.5295 trim_cache size 0 max 16384 2024-09-10T22:40:20.703 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:40:20.703 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:40:20.703 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:40:20.703 INFO:teuthology.orchestra.run.smithi103.stdout: "tag123": { 2024-09-10T22:40:20.704 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:40:20.704 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "tag123", 2024-09-10T22:40:20.704 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:40:20.704 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:40:20.704 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:40:20.704 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_stats": { 2024-09-10T22:40:20.704 INFO:teuthology.orchestra.run.smithi103.stdout: "tag123": { 2024-09-10T22:40:20.704 INFO:teuthology.orchestra.run.smithi103.stdout: "start_time": "2024-09-10T22:40:20.481899+0000", 2024-09-10T22:40:20.704 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:40:20.704 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_started": 0, 2024-09-10T22:40:20.704 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_passed": 0, 2024-09-10T22:40:20.705 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_failed": 0, 2024-09-10T22:40:20.705 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_skipped": 0 2024-09-10T22:40:20.705 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:40:20.705 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:40:20.705 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:40:20.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3914a00640 1 -- 172.21.15.103:0/4269608905 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f38ec0725e0 msgr2=0x7f38ec074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:20.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3914a00640 1 --2- 172.21.15.103:0/4269608905 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f38ec0725e0 0x7f38ec074aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3900007fd0 tx=0x7f39000078e0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3914a00640 1 -- 172.21.15.103:0/4269608905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39100cc120 msgr2=0x7f391013f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:20.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3914a00640 1 --2- 172.21.15.103:0/4269608905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39100cc120 0x7f391013f010 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009790 tx=0x7f38f80040e0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3914a00640 1 -- 172.21.15.103:0/4269608905 shutdown_connections 2024-09-10T22:40:20.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3914a00640 1 --2- 172.21.15.103:0/4269608905 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f38ec0725e0 0x7f38ec074aa0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3914a00640 1 --2- 172.21.15.103:0/4269608905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39100cf790 0x7f3910154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3914a00640 1 --2- 172.21.15.103:0/4269608905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39100cc120 0x7f391013f010 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3914a00640 1 --2- 172.21.15.103:0/4269608905 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39100aeb40 0x7f3910155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:20.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3914a00640 1 -- 172.21.15.103:0/4269608905 >> 172.21.15.103:0/4269608905 conn(0x7f391006cc00 msgr2=0x7f391006ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:20.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3914a00640 1 -- 172.21.15.103:0/4269608905 shutdown_connections 2024-09-10T22:40:20.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:20.693+0000 7f3914a00640 1 -- 172.21.15.103:0/4269608905 wait complete. 2024-09-10T22:40:20.717 INFO:tasks.cephfs.filesystem:scrub status for tag:tag123 - {'path': '/d1/d2/d3', 'tag': 'tag123', 'options': 'recursive,force'} 2024-09-10T22:40:46.565 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:40:46.569 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:40:50.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:50.719 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-10T22:40:50.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7594200640 1 -- 172.21.15.103:0/1929628094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f758c15be30 msgr2=0x7f758c0ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:50.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7594200640 1 --2- 172.21.15.103:0/1929628094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f758c15be30 0x7f758c0ce0c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7580009900 tx=0x7f758001c850 comp rx=0 tx=0).stop 2024-09-10T22:40:50.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7594200640 1 -- 172.21.15.103:0/1929628094 shutdown_connections 2024-09-10T22:40:50.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7594200640 1 --2- 172.21.15.103:0/1929628094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f758c15be30 0x7f758c0ce0c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7594200640 1 -- 172.21.15.103:0/1929628094 >> 172.21.15.103:0/1929628094 conn(0x7f758c0d1ac0 msgr2=0x7f758c0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:50.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7594200640 1 -- 172.21.15.103:0/1929628094 shutdown_connections 2024-09-10T22:40:50.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7594200640 1 -- 172.21.15.103:0/1929628094 wait complete. 2024-09-10T22:40:50.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7594200640 1 Processor -- start 2024-09-10T22:40:50.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7594200640 1 -- start start 2024-09-10T22:40:50.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7594200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f758c0ae9c0 0x7f758c157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7594200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f758c0b09c0 0x7f758c14a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7594200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f758c15be30 0x7f758c14ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7594200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f758c169e00 con 0x7f758c15be30 2024-09-10T22:40:50.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7594200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f758c169c80 con 0x7f758c0ae9c0 2024-09-10T22:40:50.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7594200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f758c169f80 con 0x7f758c0b09c0 2024-09-10T22:40:50.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7592200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f758c15be30 0x7f758c14ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7592200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f758c15be30 0x7f758c14ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44148/0 (socket says 172.21.15.103:44148) 2024-09-10T22:40:50.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7592200640 1 -- 172.21.15.103:0/273599395 learned_addr learned my addr 172.21.15.103:0/273599395 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:50.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7591800640 1 --2- 172.21.15.103:0/273599395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f758c0ae9c0 0x7f758c157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7590e00640 1 --2- 172.21.15.103:0/273599395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f758c0b09c0 0x7f758c14a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7592200640 1 -- 172.21.15.103:0/273599395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f758c0b09c0 msgr2=0x7f758c14a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:50.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7592200640 1 --2- 172.21.15.103:0/273599395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f758c0b09c0 0x7f758c14a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7592200640 1 -- 172.21.15.103:0/273599395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f758c0ae9c0 msgr2=0x7f758c157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:50.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7592200640 1 --2- 172.21.15.103:0/273599395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f758c0ae9c0 0x7f758c157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.861+0000 7f7592200640 1 -- 172.21.15.103:0/273599395 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758c1560a0 con 0x7f758c15be30 2024-09-10T22:40:50.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.865+0000 7f7592200640 1 --2- 172.21.15.103:0/273599395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f758c15be30 0x7f758c14ae70 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f758400c730 tx=0x7f758400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:50.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.865+0000 7f7589600640 1 -- 172.21.15.103:0/273599395 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7584003b80 con 0x7f758c15be30 2024-09-10T22:40:50.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.865+0000 7f7589600640 1 -- 172.21.15.103:0/273599395 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7584003d40 con 0x7f758c15be30 2024-09-10T22:40:50.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.865+0000 7f7594200640 1 -- 172.21.15.103:0/273599395 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f758c156380 con 0x7f758c15be30 2024-09-10T22:40:50.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.865+0000 7f7589600640 1 -- 172.21.15.103:0/273599395 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75840052d0 con 0x7f758c15be30 2024-09-10T22:40:50.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.865+0000 7f7594200640 1 -- 172.21.15.103:0/273599395 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f758c156940 con 0x7f758c15be30 2024-09-10T22:40:50.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.865+0000 7f7589600640 1 -- 172.21.15.103:0/273599395 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7584005680 con 0x7f758c15be30 2024-09-10T22:40:50.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7589600640 1 --2- 172.21.15.103:0/273599395 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f756c0725e0 0x7f756c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7597678000 1 Processor -- start 2024-09-10T22:40:50.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7589600640 1 -- 172.21.15.103:0/273599395 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f75840932d0 con 0x7f758c15be30 2024-09-10T22:40:50.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7597678000 1 -- start start 2024-09-10T22:40:50.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7591800640 1 --2- 172.21.15.103:0/273599395 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f756c0725e0 0x7f756c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7597678000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591720e11a0 0x5591720e1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7597678000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591720e1ac0 0x559172097680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7597678000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559172097bc0 0x559172097fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7597678000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559171f7fcb0 con 0x559172097bc0 2024-09-10T22:40:50.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7597678000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559171e95310 con 0x5591720e1ac0 2024-09-10T22:40:50.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7597678000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x559171ef2b90 con 0x5591720e11a0 2024-09-10T22:40:50.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7591800640 1 --2- 172.21.15.103:0/273599395 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f756c0725e0 0x7f756c074aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f75800af000 tx=0x7f758001b090 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:50.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7592200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559172097bc0 0x559172097fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7592200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559172097bc0 0x559172097fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44158/0 (socket says 172.21.15.103:44158) 2024-09-10T22:40:50.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7592200640 1 -- 172.21.15.103:0/2279622508 learned_addr learned my addr 172.21.15.103:0/2279622508 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:50.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7591800640 1 --2- 172.21.15.103:0/2279622508 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591720e11a0 0x5591720e1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7590e00640 1 --2- 172.21.15.103:0/2279622508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591720e1ac0 0x559172097680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7592200640 1 -- 172.21.15.103:0/2279622508 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591720e11a0 msgr2=0x5591720e1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:50.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7592200640 1 --2- 172.21.15.103:0/2279622508 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591720e11a0 0x5591720e1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7592200640 1 -- 172.21.15.103:0/2279622508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591720e1ac0 msgr2=0x559172097680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:50.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7592200640 1 --2- 172.21.15.103:0/2279622508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591720e1ac0 0x559172097680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7592200640 1 -- 172.21.15.103:0/2279622508 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559171e96c60 con 0x559172097bc0 2024-09-10T22:40:50.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7592200640 1 --2- 172.21.15.103:0/2279622508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559172097bc0 0x559172097fa0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f758405b400 tx=0x7f758405e090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360449d34f054c58 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:50.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f757e000640 1 -- 172.21.15.103:0/2279622508 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7584093110 con 0x559172097bc0 2024-09-10T22:40:50.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f757e000640 1 -- 172.21.15.103:0/2279622508 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f758405e190 con 0x559172097bc0 2024-09-10T22:40:50.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f757e000640 1 -- 172.21.15.103:0/2279622508 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7584062c70 con 0x559172097bc0 2024-09-10T22:40:50.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7597678000 1 -- 172.21.15.103:0/2279622508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559172097bc0 msgr2=0x559172097fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:50.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7597678000 1 --2- 172.21.15.103:0/2279622508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559172097bc0 0x559172097fa0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f758405b400 tx=0x7f758405e090 comp rx=0 tx=0).stop 2024-09-10T22:40:50.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7597678000 1 -- 172.21.15.103:0/2279622508 shutdown_connections 2024-09-10T22:40:50.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7597678000 1 --2- 172.21.15.103:0/2279622508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559172097bc0 0x559172097fa0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7597678000 1 --2- 172.21.15.103:0/2279622508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591720e1ac0 0x559172097680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7597678000 1 --2- 172.21.15.103:0/2279622508 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591720e11a0 0x5591720e1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7597678000 1 -- 172.21.15.103:0/2279622508 >> 172.21.15.103:0/2279622508 conn(0x55917209dd20 msgr2=0x559172095f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:50.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7597678000 1 -- 172.21.15.103:0/2279622508 shutdown_connections 2024-09-10T22:40:50.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.869+0000 7f7597678000 1 -- 172.21.15.103:0/2279622508 wait complete. 2024-09-10T22:40:50.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7597678000 1 -- start start 2024-09-10T22:40:50.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7597678000 1 Processor -- start 2024-09-10T22:40:50.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7597678000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559172097bc0 0x5591720e8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7597678000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e11a0 0x5591720e8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7597678000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591720e1ac0 0x5591720e8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7597678000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559171ee5dd0 con 0x5591720e11a0 2024-09-10T22:40:50.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7597678000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559171ee1fc0 con 0x559172097bc0 2024-09-10T22:40:50.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7597678000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x559171e874b0 con 0x5591720e1ac0 2024-09-10T22:40:50.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7597678000 10 client.0 _ll_register_callbacks cb 0x559171e657d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:50.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7590e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e11a0 0x5591720e8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7590e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e11a0 0x5591720e8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44160/0 (socket says 172.21.15.103:44160) 2024-09-10T22:40:50.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7590e00640 1 -- 172.21.15.103:0/2328594884 learned_addr learned my addr 172.21.15.103:0/2328594884 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:50.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7591800640 1 --2- 172.21.15.103:0/2328594884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559172097bc0 0x5591720e8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7592200640 1 --2- 172.21.15.103:0/2328594884 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591720e1ac0 0x5591720e8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7590e00640 1 -- 172.21.15.103:0/2328594884 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591720e1ac0 msgr2=0x5591720e8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:50.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7590e00640 1 --2- 172.21.15.103:0/2328594884 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591720e1ac0 0x5591720e8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7590e00640 1 -- 172.21.15.103:0/2328594884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559172097bc0 msgr2=0x5591720e8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:50.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7590e00640 1 --2- 172.21.15.103:0/2328594884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559172097bc0 0x5591720e8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7590e00640 1 -- 172.21.15.103:0/2328594884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559171e801f0 con 0x5591720e11a0 2024-09-10T22:40:50.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7590e00640 1 --2- 172.21.15.103:0/2328594884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e11a0 0x5591720e8a70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f75780054d0 tx=0x7f75780105b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48494c8a67a3dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:50.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7572a00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:50.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7572a00640 1 -- 172.21.15.103:0/2328594884 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7578019020 con 0x5591720e11a0 2024-09-10T22:40:50.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7597678000 1 -- 172.21.15.103:0/2328594884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559171e7a330 con 0x5591720e11a0 2024-09-10T22:40:50.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7572a00640 1 -- 172.21.15.103:0/2328594884 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f7578015660 con 0x5591720e11a0 2024-09-10T22:40:50.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7572a00640 1 -- 172.21.15.103:0/2328594884 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7578023050 con 0x5591720e11a0 2024-09-10T22:40:50.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7597678000 10 client.5310 fetch_fsmap learned FSMap version 27 2024-09-10T22:40:50.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7597678000 1 -- 172.21.15.103:0/2328594884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x559171e66fa0 con 0x5591720e11a0 2024-09-10T22:40:50.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7572a00640 1 -- 172.21.15.103:0/2328594884 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x559171e7a330 con 0x5591720e11a0 2024-09-10T22:40:50.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7572a00640 1 -- 172.21.15.103:0/2328594884 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 3558+0+0 (secure 0 0 0) 0x7f7578026020 con 0x5591720e11a0 2024-09-10T22:40:50.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7597678000 10 client.5310 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:40:50.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7597678000 10 client.5310 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-10T22:40:50.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7597678000 20 client.5310 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:50.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7597678000 1 --2- 172.21.15.103:0/2328594884 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5591720f0900 0x5591720f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7597678000 4 client.5310 mds_command: new command op to 4941 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:40:50.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7597678000 1 -- 172.21.15.103:0/2328594884 --> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559171ef4ae0 con 0x5591720f0900 2024-09-10T22:40:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7591800640 1 --2- 172.21.15.103:0/2328594884 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5591720f0900 0x5591720f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7572a00640 10 client.5310 ms_handle_connect on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.873+0000 7f7591800640 1 --2- 172.21.15.103:0/2328594884 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5591720f0900 0x5591720f2cf0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0c8a0dc645269d4 server_cookie=47a5cb4c8cf639b4 in_seq=0 out_seq=0 2024-09-10T22:40:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.877+0000 7f7572a00640 1 -- 172.21.15.103:0/2328594884 <== mds.0 v2:172.21.15.103:6834/1194009116 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559171ef4ae0 con 0x5591720f0900 2024-09-10T22:40:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.877+0000 7f7572a00640 10 client.5310 handle_command_reply: tid=0 2024-09-10T22:40:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.877+0000 7f7597678000 1 client.5310 shutdown 2024-09-10T22:40:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.877+0000 7f7597678000 1 -- 172.21.15.103:0/2328594884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e11a0 msgr2=0x5591720e8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.877+0000 7f7597678000 1 --2- 172.21.15.103:0/2328594884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e11a0 0x5591720e8a70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f75780054d0 tx=0x7f75780105b0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.877+0000 7f7597678000 1 -- 172.21.15.103:0/2328594884 shutdown_connections 2024-09-10T22:40:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.877+0000 7f7597678000 1 --2- 172.21.15.103:0/2328594884 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x5591720f0900 0x5591720f2cf0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.877+0000 7f7597678000 1 --2- 172.21.15.103:0/2328594884 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591720e1ac0 0x5591720e8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.877+0000 7f7597678000 1 --2- 172.21.15.103:0/2328594884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e11a0 0x5591720e8a70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.877+0000 7f7597678000 1 --2- 172.21.15.103:0/2328594884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559172097bc0 0x5591720e8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.877+0000 7f7572a00640 0 client.5310 ms_handle_reset on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:50.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.877+0000 7f7597678000 1 -- 172.21.15.103:0/2328594884 >> 172.21.15.103:0/2328594884 conn(0x55917209dd20 msgr2=0x559172095f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:50.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.877+0000 7f7597678000 1 -- 172.21.15.103:0/2328594884 shutdown_connections 2024-09-10T22:40:50.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.877+0000 7f7597678000 1 -- 172.21.15.103:0/2328594884 wait complete. 2024-09-10T22:40:50.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.877+0000 7f7597678000 20 client.5310 trim_cache size 0 max 16384 2024-09-10T22:40:50.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.893+0000 7f7597678000 1 Processor -- start 2024-09-10T22:40:50.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.893+0000 7f7597678000 1 -- start start 2024-09-10T22:40:50.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.893+0000 7f7597678000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559172097bc0 0x559172152600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.893+0000 7f7597678000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e11a0 0x559172152b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.893+0000 7f7597678000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591720e1ac0 0x559172153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.893+0000 7f7597678000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f758c204580 con 0x5591720e11a0 2024-09-10T22:40:50.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.893+0000 7f7597678000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f758c203720 con 0x5591720e1ac0 2024-09-10T22:40:50.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.893+0000 7f7597678000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f758c203e50 con 0x559172097bc0 2024-09-10T22:40:50.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.893+0000 7f7590e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e11a0 0x559172152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.893+0000 7f7590e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e11a0 0x559172152b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44174/0 (socket says 172.21.15.103:44174) 2024-09-10T22:40:50.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.893+0000 7f7590e00640 1 -- 172.21.15.103:0/2807799497 learned_addr learned my addr 172.21.15.103:0/2807799497 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:50.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7592200640 1 --2- 172.21.15.103:0/2807799497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591720e1ac0 0x559172153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7591800640 1 --2- 172.21.15.103:0/2807799497 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559172097bc0 0x559172152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7590e00640 1 -- 172.21.15.103:0/2807799497 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559172097bc0 msgr2=0x559172152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:50.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7590e00640 1 --2- 172.21.15.103:0/2807799497 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559172097bc0 0x559172152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7590e00640 1 -- 172.21.15.103:0/2807799497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591720e1ac0 msgr2=0x559172153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:50.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7590e00640 1 --2- 172.21.15.103:0/2807799497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591720e1ac0 0x559172153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7590e00640 1 -- 172.21.15.103:0/2807799497 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559171f3f660 con 0x5591720e11a0 2024-09-10T22:40:50.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7592200640 1 --2- 172.21.15.103:0/2807799497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591720e1ac0 0x559172153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:40:50.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7591800640 1 --2- 172.21.15.103:0/2807799497 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559172097bc0 0x559172152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:40:50.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7590e00640 1 --2- 172.21.15.103:0/2807799497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e11a0 0x559172152b40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7578021040 tx=0x7f75780049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd634e8c2fe9bba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:50.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f757d600640 1 -- 172.21.15.103:0/2807799497 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7578019070 con 0x5591720e11a0 2024-09-10T22:40:50.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f757d600640 1 -- 172.21.15.103:0/2807799497 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7578000e50 con 0x5591720e11a0 2024-09-10T22:40:50.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f757d600640 1 -- 172.21.15.103:0/2807799497 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7578015c50 con 0x5591720e11a0 2024-09-10T22:40:50.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7597678000 1 -- 172.21.15.103:0/2807799497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e11a0 msgr2=0x559172152b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:50.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7597678000 1 --2- 172.21.15.103:0/2807799497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e11a0 0x559172152b40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7578021040 tx=0x7f75780049e0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7597678000 1 -- 172.21.15.103:0/2807799497 shutdown_connections 2024-09-10T22:40:50.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7597678000 1 --2- 172.21.15.103:0/2807799497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591720e1ac0 0x559172153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7597678000 1 --2- 172.21.15.103:0/2807799497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e11a0 0x559172152b40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7597678000 1 --2- 172.21.15.103:0/2807799497 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559172097bc0 0x559172152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7597678000 1 -- 172.21.15.103:0/2807799497 >> 172.21.15.103:0/2807799497 conn(0x55917209dd20 msgr2=0x559172099080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:50.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7597678000 1 -- 172.21.15.103:0/2807799497 shutdown_connections 2024-09-10T22:40:50.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7597678000 1 -- 172.21.15.103:0/2807799497 wait complete. 2024-09-10T22:40:50.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7597678000 1 -- start start 2024-09-10T22:40:50.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7597678000 1 Processor -- start 2024-09-10T22:40:50.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7597678000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559172097bc0 0x5591720f7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7597678000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591720e11a0 0x5591720f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7597678000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e1ac0 0x559172113210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7597678000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559171ee5dd0 con 0x5591720e1ac0 2024-09-10T22:40:50.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7597678000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559171edcec0 con 0x5591720e11a0 2024-09-10T22:40:50.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7597678000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5591720a0d40 con 0x559172097bc0 2024-09-10T22:40:50.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7597678000 10 client.0 _ll_register_callbacks cb 0x7f7578005060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:40:50.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7592200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e1ac0 0x559172113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7591800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559172097bc0 0x5591720f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7592200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e1ac0 0x559172113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44180/0 (socket says 172.21.15.103:44180) 2024-09-10T22:40:50.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7591800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559172097bc0 0x5591720f7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:55018/0 (socket says 172.21.15.103:55018) 2024-09-10T22:40:50.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7592200640 1 -- 172.21.15.103:0/2206249322 learned_addr learned my addr 172.21.15.103:0/2206249322 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:50.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7590e00640 1 --2- 172.21.15.103:0/2206249322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591720e11a0 0x5591720f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7592200640 1 -- 172.21.15.103:0/2206249322 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559172097bc0 msgr2=0x5591720f7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:50.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7592200640 1 --2- 172.21.15.103:0/2206249322 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559172097bc0 0x5591720f7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7592200640 1 -- 172.21.15.103:0/2206249322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591720e11a0 msgr2=0x5591720f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:50.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7592200640 1 --2- 172.21.15.103:0/2206249322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591720e11a0 0x5591720f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7592200640 1 -- 172.21.15.103:0/2206249322 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559171eac090 con 0x5591720e1ac0 2024-09-10T22:40:50.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.897+0000 7f7591800640 1 --2- 172.21.15.103:0/2206249322 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559172097bc0 0x5591720f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:40:50.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7592200640 1 --2- 172.21.15.103:0/2206249322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e1ac0 0x559172113210 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f758405b400 tx=0x7f75840833d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491457cc08d01687 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:50.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7572a00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:40:50.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7572a00640 1 -- 172.21.15.103:0/2206249322 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758405e190 con 0x5591720e1ac0 2024-09-10T22:40:50.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7572a00640 1 -- 172.21.15.103:0/2206249322 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f7584093070 con 0x5591720e1ac0 2024-09-10T22:40:50.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 1 -- 172.21.15.103:0/2206249322 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7578000e50 con 0x5591720e1ac0 2024-09-10T22:40:50.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7572a00640 1 -- 172.21.15.103:0/2206249322 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f758408f050 con 0x5591720e1ac0 2024-09-10T22:40:50.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 10 client.5316 fetch_fsmap learned FSMap version 27 2024-09-10T22:40:50.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 1 -- 172.21.15.103:0/2206249322 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x559171e785f0 con 0x5591720e1ac0 2024-09-10T22:40:50.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7572a00640 1 -- 172.21.15.103:0/2206249322 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7578000e50 con 0x5591720e1ac0 2024-09-10T22:40:50.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7572a00640 1 -- 172.21.15.103:0/2206249322 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 3558+0+0 (secure 0 0 0) 0x7f7584067200 con 0x5591720e1ac0 2024-09-10T22:40:50.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 10 client.5316 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:40:50.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 10 client.5316 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-10T22:40:50.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 20 client.5316 populate_metadata read hostname 'smithi103' 2024-09-10T22:40:50.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 1 --2- 172.21.15.103:0/2206249322 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x559172113750 0x559172113b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 4 client.5316 mds_command: new command op to 4941 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:40:50.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 1 -- 172.21.15.103:0/2206249322 --> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559171ef0590 con 0x559172113750 2024-09-10T22:40:50.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7591800640 1 --2- 172.21.15.103:0/2206249322 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x559172113750 0x559172113b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7572a00640 10 client.5316 ms_handle_connect on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:50.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7591800640 1 --2- 172.21.15.103:0/2206249322 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x559172113750 0x559172113b60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1397fe3c710a52b server_cookie=db62bbc7f0a51156 in_seq=0 out_seq=0 2024-09-10T22:40:50.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7572a00640 1 -- 172.21.15.103:0/2206249322 <== mds.0 v2:172.21.15.103:6834/1194009116 1 ==== command_reply(tid 0: 0 ) ==== 8+0+352 (crc 0 0 0) 0x559171ef0590 con 0x559172113750 2024-09-10T22:40:50.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7572a00640 10 client.5316 handle_command_reply: tid=0 2024-09-10T22:40:50.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 1 client.5316 shutdown 2024-09-10T22:40:50.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 1 -- 172.21.15.103:0/2206249322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e1ac0 msgr2=0x559172113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:50.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 1 --2- 172.21.15.103:0/2206249322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e1ac0 0x559172113210 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f758405b400 tx=0x7f75840833d0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 1 -- 172.21.15.103:0/2206249322 shutdown_connections 2024-09-10T22:40:50.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 1 --2- 172.21.15.103:0/2206249322 >> [v2:172.21.15.103:6834/1194009116,v1:172.21.15.103:6835/1194009116] conn(0x559172113750 0x559172113b60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 1 --2- 172.21.15.103:0/2206249322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591720e1ac0 0x559172113210 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 1 --2- 172.21.15.103:0/2206249322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591720e11a0 0x5591720f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 1 --2- 172.21.15.103:0/2206249322 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559172097bc0 0x5591720f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7572a00640 0 client.5316 ms_handle_reset on v2:172.21.15.103:6834/1194009116 2024-09-10T22:40:50.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 1 -- 172.21.15.103:0/2206249322 >> 172.21.15.103:0/2206249322 conn(0x55917209dd20 msgr2=0x5591720f2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:50.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 1 -- 172.21.15.103:0/2206249322 shutdown_connections 2024-09-10T22:40:50.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 1 -- 172.21.15.103:0/2206249322 wait complete. 2024-09-10T22:40:50.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7597678000 20 client.5316 trim_cache size 0 max 16384 2024-09-10T22:40:50.914 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:40:50.914 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "no active scrubs running", 2024-09-10T22:40:50.914 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": {}, 2024-09-10T22:40:50.914 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_stats": { 2024-09-10T22:40:50.915 INFO:teuthology.orchestra.run.smithi103.stdout: "tag123": { 2024-09-10T22:40:50.915 INFO:teuthology.orchestra.run.smithi103.stdout: "start_time": "2024-09-10T22:40:20.481899+0000", 2024-09-10T22:40:50.915 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:40:50.915 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_started": 0, 2024-09-10T22:40:50.915 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_passed": 0, 2024-09-10T22:40:50.915 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_failed": 0, 2024-09-10T22:40:50.915 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_skipped": 0 2024-09-10T22:40:50.915 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:40:50.915 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:40:50.915 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:40:50.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7594200640 1 -- 172.21.15.103:0/273599395 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f756c0725e0 msgr2=0x7f756c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:50.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7594200640 1 --2- 172.21.15.103:0/273599395 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f756c0725e0 0x7f756c074aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f75800af000 tx=0x7f758001b090 comp rx=0 tx=0).stop 2024-09-10T22:40:50.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7594200640 1 -- 172.21.15.103:0/273599395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f758c15be30 msgr2=0x7f758c14ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:50.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7594200640 1 --2- 172.21.15.103:0/273599395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f758c15be30 0x7f758c14ae70 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f758400c730 tx=0x7f758400cbf0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7594200640 1 -- 172.21.15.103:0/273599395 shutdown_connections 2024-09-10T22:40:50.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7594200640 1 --2- 172.21.15.103:0/273599395 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f756c0725e0 0x7f756c074aa0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7594200640 1 --2- 172.21.15.103:0/273599395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f758c15be30 0x7f758c14ae70 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7594200640 1 --2- 172.21.15.103:0/273599395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f758c0b09c0 0x7f758c14a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7594200640 1 --2- 172.21.15.103:0/273599395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f758c0ae9c0 0x7f758c157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7594200640 1 -- 172.21.15.103:0/273599395 >> 172.21.15.103:0/273599395 conn(0x7f758c0d1ac0 msgr2=0x7f758c157d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:50.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7594200640 1 -- 172.21.15.103:0/273599395 shutdown_connections 2024-09-10T22:40:50.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.901+0000 7f7594200640 1 -- 172.21.15.103:0/273599395 wait complete. 2024-09-10T22:40:50.926 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:40:50.927 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000002.00000000 scrub_tag 2024-09-10T22:40:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f2110fc9080 1 Processor -- start 2024-09-10T22:40:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f2110fc9080 1 -- start start 2024-09-10T22:40:50.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f2110fc9080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555ee6220380 0x555ee62945a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f2110fc9080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ee6295e00 0x555ee6294ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f2110fc9080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ee62afa30 0x555ee62b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f2110fc9080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555ee6126a00 con 0x555ee62afa30 2024-09-10T22:40:50.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f2110fc9080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x555ee6184f40 con 0x555ee6295e00 2024-09-10T22:40:50.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f2110fc9080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x555ee6218e90 con 0x555ee6220380 2024-09-10T22:40:50.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f210ec00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ee62afa30 0x555ee62b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f210e200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555ee6220380 0x555ee62945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f2107e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ee6295e00 0x555ee6294ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f210ec00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ee62afa30 0x555ee62b6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44202/0 (socket says 172.21.15.103:44202) 2024-09-10T22:40:50.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f210ec00640 1 -- 172.21.15.103:0/4292643311 learned_addr learned my addr 172.21.15.103:0/4292643311 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:50.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f210ec00640 1 -- 172.21.15.103:0/4292643311 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555ee6220380 msgr2=0x555ee62945a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:50.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f210ec00640 1 --2- 172.21.15.103:0/4292643311 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555ee6220380 0x555ee62945a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f210ec00640 1 -- 172.21.15.103:0/4292643311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ee6295e00 msgr2=0x555ee6294ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:50.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f210ec00640 1 --2- 172.21.15.103:0/4292643311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ee6295e00 0x555ee6294ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f210ec00640 1 -- 172.21.15.103:0/4292643311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ee60ffc10 con 0x555ee62afa30 2024-09-10T22:40:50.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f210ec00640 1 --2- 172.21.15.103:0/4292643311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ee62afa30 0x555ee62b6420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2108001620 tx=0x7f2108001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f2b52014da8419 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:50.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f210ce00640 1 -- 172.21.15.103:0/4292643311 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108017070 con 0x555ee62afa30 2024-09-10T22:40:50.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f210ce00640 1 -- 172.21.15.103:0/4292643311 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f210800f800 con 0x555ee62afa30 2024-09-10T22:40:50.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f210ce00640 1 -- 172.21.15.103:0/4292643311 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210800fc30 con 0x555ee62afa30 2024-09-10T22:40:50.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f2110fc9080 1 -- 172.21.15.103:0/4292643311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ee62afa30 msgr2=0x555ee62b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:50.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f2110fc9080 1 --2- 172.21.15.103:0/4292643311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ee62afa30 0x555ee62b6420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2108001620 tx=0x7f2108001ae0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f2110fc9080 1 -- 172.21.15.103:0/4292643311 shutdown_connections 2024-09-10T22:40:50.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f2110fc9080 1 --2- 172.21.15.103:0/4292643311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ee62afa30 0x555ee62b6420 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f2110fc9080 1 --2- 172.21.15.103:0/4292643311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ee6295e00 0x555ee6294ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f2110fc9080 1 --2- 172.21.15.103:0/4292643311 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555ee6220380 0x555ee62945a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f2110fc9080 1 -- 172.21.15.103:0/4292643311 >> 172.21.15.103:0/4292643311 conn(0x555ee61d9f30 msgr2=0x555ee6221e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:50.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f2110fc9080 1 -- 172.21.15.103:0/4292643311 shutdown_connections 2024-09-10T22:40:50.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.969+0000 7f2110fc9080 1 -- 172.21.15.103:0/4292643311 wait complete. 2024-09-10T22:40:50.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2110fc9080 1 Processor -- start 2024-09-10T22:40:50.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2110fc9080 1 -- start start 2024-09-10T22:40:50.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2110fc9080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ee6220380 0x555ee634b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2110fc9080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ee6295e00 0x555ee634b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2110fc9080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555ee62afa30 0x555ee621a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2110fc9080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555ee621c7f0 con 0x555ee6295e00 2024-09-10T22:40:50.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2110fc9080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x555ee61d7cc0 con 0x555ee6220380 2024-09-10T22:40:50.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2110fc9080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x555ee621c550 con 0x555ee62afa30 2024-09-10T22:40:50.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2107e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ee6295e00 0x555ee634b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2107e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ee6295e00 0x555ee634b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44204/0 (socket says 172.21.15.103:44204) 2024-09-10T22:40:50.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2107e00640 1 -- 172.21.15.103:0/2263636609 learned_addr learned my addr 172.21.15.103:0/2263636609 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:50.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f210e200640 1 --2- 172.21.15.103:0/2263636609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ee6220380 0x555ee634b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f210ec00640 1 --2- 172.21.15.103:0/2263636609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555ee62afa30 0x555ee621a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2107e00640 1 -- 172.21.15.103:0/2263636609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555ee62afa30 msgr2=0x555ee621a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:50.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2107e00640 1 --2- 172.21.15.103:0/2263636609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555ee62afa30 0x555ee621a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2107e00640 1 -- 172.21.15.103:0/2263636609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ee6220380 msgr2=0x555ee634b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:50.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2107e00640 1 --2- 172.21.15.103:0/2263636609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ee6220380 0x555ee634b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2107e00640 1 -- 172.21.15.103:0/2263636609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ee634bf00 con 0x555ee6295e00 2024-09-10T22:40:50.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f210ec00640 1 --2- 172.21.15.103:0/2263636609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555ee62afa30 0x555ee621a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:40:50.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2107e00640 1 --2- 172.21.15.103:0/2263636609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ee6295e00 0x555ee634b7e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f20f801b640 tx=0x7f20f80acaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:50.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2106a00640 1 -- 172.21.15.103:0/2263636609 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f80b8440 con 0x555ee6295e00 2024-09-10T22:40:50.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2106a00640 1 -- 172.21.15.103:0/2263636609 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20f80b86d0 con 0x555ee6295e00 2024-09-10T22:40:50.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2106a00640 1 -- 172.21.15.103:0/2263636609 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f80b8b00 con 0x555ee6295e00 2024-09-10T22:40:50.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2110fc9080 1 -- 172.21.15.103:0/2263636609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555ee62078f0 con 0x555ee6295e00 2024-09-10T22:40:50.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.973+0000 7f2110fc9080 1 -- 172.21.15.103:0/2263636609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ee6207e30 con 0x555ee6295e00 2024-09-10T22:40:50.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f2106a00640 1 -- 172.21.15.103:0/2263636609 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f20f80b8ca0 con 0x555ee6295e00 2024-09-10T22:40:50.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f2106a00640 1 --2- 172.21.15.103:0/2263636609 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20ec070ff0 0x7f20ec0734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f2106a00640 1 -- 172.21.15.103:0/2263636609 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f20f812def0 con 0x555ee6295e00 2024-09-10T22:40:50.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f2110fc9080 1 --2- 172.21.15.103:0/2263636609 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x555ee6293c10 0x555ee6293ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:50.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f2110fc9080 1 -- 172.21.15.103:0/2263636609 --> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] -- osd_op(unknown.0.0:1 5.12 5:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43) -- 0x555ee6294530 con 0x555ee6293c10 2024-09-10T22:40:50.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f210ec00640 1 --2- 172.21.15.103:0/2263636609 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x555ee6293c10 0x555ee6293ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f210e200640 1 --2- 172.21.15.103:0/2263636609 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20ec070ff0 0x7f20ec0734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:50.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f210ec00640 1 --2- 172.21.15.103:0/2263636609 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x555ee6293c10 0x555ee6293ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:50.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f210e200640 1 --2- 172.21.15.103:0/2263636609 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20ec070ff0 0x7f20ec0734b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f210000c8f0 tx=0x7f210000f040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:50.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f210ec00640 1 -- 172.21.15.103:0/2263636609 <== osd.1 v2:172.21.15.103:6800/4140822734 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (10) out=10b] v0'0 uv8 ondisk = 0) ==== 164+0+10 (crc 0 0 0) 0x7f210800f070 con 0x555ee6293c10 2024-09-10T22:40:50.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f2110fc9080 1 -- 172.21.15.103:0/2263636609 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x555ee6293c10 msgr2=0x555ee6293ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f2110fc9080 1 --2- 172.21.15.103:0/2263636609 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x555ee6293c10 0x555ee6293ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f2110fc9080 1 -- 172.21.15.103:0/2263636609 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20ec070ff0 msgr2=0x7f20ec0734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f2110fc9080 1 --2- 172.21.15.103:0/2263636609 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20ec070ff0 0x7f20ec0734b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f210000c8f0 tx=0x7f210000f040 comp rx=0 tx=0).stop 2024-09-10T22:40:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f2110fc9080 1 -- 172.21.15.103:0/2263636609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ee6295e00 msgr2=0x555ee634b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f2110fc9080 1 --2- 172.21.15.103:0/2263636609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ee6295e00 0x555ee634b7e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f20f801b640 tx=0x7f20f80acaa0 comp rx=0 tx=0).stop 2024-09-10T22:40:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f210ec00640 1 -- 172.21.15.103:0/2263636609 reap_dead start 2024-09-10T22:40:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f2110fc9080 1 -- 172.21.15.103:0/2263636609 shutdown_connections 2024-09-10T22:40:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f2110fc9080 1 -- 172.21.15.103:0/2263636609 >> 172.21.15.103:0/2263636609 conn(0x555ee61d9f30 msgr2=0x555ee62b6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f2110fc9080 1 -- 172.21.15.103:0/2263636609 shutdown_connections 2024-09-10T22:40:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:50.977+0000 7f2110fc9080 1 -- 172.21.15.103:0/2263636609 wait complete. 2024-09-10T22:40:50.989 INFO:teuthology.orchestra.run.smithi103.stdout:tag123 2024-09-10T22:40:50.989 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000003.00000000 scrub_tag 2024-09-10T22:40:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a7534a080 1 Processor -- start 2024-09-10T22:40:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a7534a080 1 -- start start 2024-09-10T22:40:51.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a7534a080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea3b7551d0 0x55ea3b7c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a7534a080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ea3b7df570 0x55ea3b707190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a7534a080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ea3b7076d0 0x55ea3b7ba840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a7534a080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ea3b657a00 con 0x55ea3b7076d0 2024-09-10T22:40:51.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a7534a080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ea3b6b5f40 con 0x55ea3b7551d0 2024-09-10T22:40:51.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a7534a080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ea3b7c4bf0 con 0x55ea3b7df570 2024-09-10T22:40:51.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a73000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ea3b7076d0 0x55ea3b7ba840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a73000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ea3b7076d0 0x55ea3b7ba840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44206/0 (socket says 172.21.15.103:44206) 2024-09-10T22:40:51.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a73000640 1 -- 172.21.15.103:0/811778597 learned_addr learned my addr 172.21.15.103:0/811778597 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:51.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a71c00640 1 --2- 172.21.15.103:0/811778597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ea3b7df570 0x55ea3b707190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a72600640 1 --2- 172.21.15.103:0/811778597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea3b7551d0 0x55ea3b7c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a73000640 1 -- 172.21.15.103:0/811778597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ea3b7df570 msgr2=0x55ea3b707190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:51.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a73000640 1 --2- 172.21.15.103:0/811778597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ea3b7df570 0x55ea3b707190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a73000640 1 -- 172.21.15.103:0/811778597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea3b7551d0 msgr2=0x55ea3b7c27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:51.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a73000640 1 --2- 172.21.15.103:0/811778597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea3b7551d0 0x55ea3b7c27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a73000640 1 -- 172.21.15.103:0/811778597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea3b630c10 con 0x55ea3b7076d0 2024-09-10T22:40:51.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a73000640 1 --2- 172.21.15.103:0/811778597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ea3b7076d0 0x55ea3b7ba840 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00b920 tx=0x7f4a6c00bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20f6f809e88649a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.073+0000 7f4a6be00640 1 -- 172.21.15.103:0/811778597 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c00dbf0 con 0x55ea3b7076d0 2024-09-10T22:40:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a6be00640 1 -- 172.21.15.103:0/811778597 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a6c00de80 con 0x55ea3b7076d0 2024-09-10T22:40:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a6be00640 1 -- 172.21.15.103:0/811778597 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c00f690 con 0x55ea3b7076d0 2024-09-10T22:40:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 -- 172.21.15.103:0/811778597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ea3b7076d0 msgr2=0x55ea3b7ba840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 --2- 172.21.15.103:0/811778597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ea3b7076d0 0x55ea3b7ba840 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00b920 tx=0x7f4a6c00bde0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 -- 172.21.15.103:0/811778597 shutdown_connections 2024-09-10T22:40:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 --2- 172.21.15.103:0/811778597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ea3b7076d0 0x55ea3b7ba840 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 --2- 172.21.15.103:0/811778597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ea3b7df570 0x55ea3b707190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 --2- 172.21.15.103:0/811778597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea3b7551d0 0x55ea3b7c27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 -- 172.21.15.103:0/811778597 >> 172.21.15.103:0/811778597 conn(0x55ea3b706db0 msgr2=0x55ea3b7be170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 -- 172.21.15.103:0/811778597 shutdown_connections 2024-09-10T22:40:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 -- 172.21.15.103:0/811778597 wait complete. 2024-09-10T22:40:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 Processor -- start 2024-09-10T22:40:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 -- start start 2024-09-10T22:40:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ea3b7076d0 0x55ea3b7bfb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea3b7551d0 0x55ea3b7db010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ea3b7df570 0x55ea3b7e1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ea3b7bd0d0 con 0x55ea3b7df570 2024-09-10T22:40:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ea3b7bce30 con 0x55ea3b7551d0 2024-09-10T22:40:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ea3b7bd370 con 0x55ea3b7076d0 2024-09-10T22:40:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a73000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ea3b7df570 0x55ea3b7e1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a73000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ea3b7df570 0x55ea3b7e1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44208/0 (socket says 172.21.15.103:44208) 2024-09-10T22:40:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a73000640 1 -- 172.21.15.103:0/3348335946 learned_addr learned my addr 172.21.15.103:0/3348335946 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:51.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a72600640 1 --2- 172.21.15.103:0/3348335946 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ea3b7076d0 0x55ea3b7bfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a73000640 1 -- 172.21.15.103:0/3348335946 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ea3b7076d0 msgr2=0x55ea3b7bfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a73000640 1 --2- 172.21.15.103:0/3348335946 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ea3b7076d0 0x55ea3b7bfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a73000640 1 -- 172.21.15.103:0/3348335946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea3b7551d0 msgr2=0x55ea3b7db010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a73000640 1 --2- 172.21.15.103:0/3348335946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ea3b7551d0 0x55ea3b7db010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a73000640 1 -- 172.21.15.103:0/3348335946 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea3b73b690 con 0x55ea3b7df570 2024-09-10T22:40:51.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a72600640 1 --2- 172.21.15.103:0/3348335946 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ea3b7076d0 0x55ea3b7bfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:40:51.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a73000640 1 --2- 172.21.15.103:0/3348335946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ea3b7df570 0x55ea3b7e1e90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c010670 tx=0x7f4a6c0106a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a6aa00640 1 -- 172.21.15.103:0/3348335946 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c010ad0 con 0x55ea3b7df570 2024-09-10T22:40:51.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a6aa00640 1 -- 172.21.15.103:0/3348335946 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a6c010c90 con 0x55ea3b7df570 2024-09-10T22:40:51.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a6aa00640 1 -- 172.21.15.103:0/3348335946 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c022680 con 0x55ea3b7df570 2024-09-10T22:40:51.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 -- 172.21.15.103:0/3348335946 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea3b7c0230 con 0x55ea3b7df570 2024-09-10T22:40:51.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.077+0000 7f4a7534a080 1 -- 172.21.15.103:0/3348335946 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea3b7c0770 con 0x55ea3b7df570 2024-09-10T22:40:51.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.081+0000 7f4a6aa00640 1 -- 172.21.15.103:0/3348335946 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4a6c022820 con 0x55ea3b7df570 2024-09-10T22:40:51.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.081+0000 7f4a6aa00640 1 --2- 172.21.15.103:0/3348335946 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4a54070fc0 0x7f4a54073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.081+0000 7f4a6aa00640 1 -- 172.21.15.103:0/3348335946 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f4a6c094640 con 0x55ea3b7df570 2024-09-10T22:40:51.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.081+0000 7f4a72600640 1 --2- 172.21.15.103:0/3348335946 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4a54070fc0 0x7f4a54073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.081+0000 7f4a7534a080 1 --2- 172.21.15.103:0/3348335946 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x55ea3b74c4d0 0x55ea3b74c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.081+0000 7f4a7534a080 1 -- 172.21.15.103:0/3348335946 --> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] -- osd_op(unknown.0.0:1 5.12 5:4def72d4:::10000000003.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43) -- 0x55ea3b74cdf0 con 0x55ea3b74c4d0 2024-09-10T22:40:51.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.081+0000 7f4a71c00640 1 --2- 172.21.15.103:0/3348335946 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x55ea3b74c4d0 0x55ea3b74c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.081+0000 7f4a72600640 1 --2- 172.21.15.103:0/3348335946 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4a54070fc0 0x7f4a54073480 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4a64000c10 tx=0x7f4a64002540 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.081+0000 7f4a71c00640 1 --2- 172.21.15.103:0/3348335946 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x55ea3b74c4d0 0x55ea3b74c8b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.085+0000 7f4a71c00640 1 -- 172.21.15.103:0/3348335946 <== osd.1 v2:172.21.15.103:6800/4140822734 1 ==== osd_op_reply(1 10000000003.00000000 [getxattr (10) out=10b] v0'0 uv9 ondisk = 0) ==== 164+0+10 (crc 0 0 0) 0x7f4a600b3040 con 0x55ea3b74c4d0 2024-09-10T22:40:51.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.085+0000 7f4a7534a080 1 -- 172.21.15.103:0/3348335946 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x55ea3b74c4d0 msgr2=0x55ea3b74c8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.085+0000 7f4a7534a080 1 --2- 172.21.15.103:0/3348335946 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x55ea3b74c4d0 0x55ea3b74c8b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.085+0000 7f4a7534a080 1 -- 172.21.15.103:0/3348335946 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4a54070fc0 msgr2=0x7f4a54073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.085+0000 7f4a7534a080 1 --2- 172.21.15.103:0/3348335946 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4a54070fc0 0x7f4a54073480 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4a64000c10 tx=0x7f4a64002540 comp rx=0 tx=0).stop 2024-09-10T22:40:51.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.085+0000 7f4a7534a080 1 -- 172.21.15.103:0/3348335946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ea3b7df570 msgr2=0x55ea3b7e1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.085+0000 7f4a7534a080 1 --2- 172.21.15.103:0/3348335946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ea3b7df570 0x55ea3b7e1e90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c010670 tx=0x7f4a6c0106a0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.085+0000 7f4a73000640 1 -- 172.21.15.103:0/3348335946 reap_dead start 2024-09-10T22:40:51.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.085+0000 7f4a7534a080 1 -- 172.21.15.103:0/3348335946 shutdown_connections 2024-09-10T22:40:51.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.085+0000 7f4a7534a080 1 -- 172.21.15.103:0/3348335946 >> 172.21.15.103:0/3348335946 conn(0x55ea3b706db0 msgr2=0x55ea3b7dba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:51.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.085+0000 7f4a7534a080 1 -- 172.21.15.103:0/3348335946 shutdown_connections 2024-09-10T22:40:51.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.085+0000 7f4a7534a080 1 -- 172.21.15.103:0/3348335946 wait complete. 2024-09-10T22:40:51.094 INFO:teuthology.orchestra.run.smithi103.stdout:tag123 2024-09-10T22:40:51.094 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000004.00000000 scrub_tag 2024-09-10T22:40:51.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38d74c080 1 Processor -- start 2024-09-10T22:40:51.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38d74c080 1 -- start start 2024-09-10T22:40:51.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38d74c080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ca290e380 0x563ca290a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38d74c080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ca2983e00 0x563ca297f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38d74c080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563ca299da30 0x563ca297fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38d74c080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563ca2814a00 con 0x563ca2983e00 2024-09-10T22:40:51.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38d74c080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563ca2872f40 con 0x563ca290e380 2024-09-10T22:40:51.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38d74c080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563ca2906e90 con 0x563ca299da30 2024-09-10T22:40:51.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff383e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ca2983e00 0x563ca297f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff383e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ca2983e00 0x563ca297f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44216/0 (socket says 172.21.15.103:44216) 2024-09-10T22:40:51.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff383e00640 1 -- 172.21.15.103:0/2385173129 learned_addr learned my addr 172.21.15.103:0/2385173129 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:51.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38aa00640 1 --2- 172.21.15.103:0/2385173129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ca290e380 0x563ca290a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38b400640 1 --2- 172.21.15.103:0/2385173129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563ca299da30 0x563ca297fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff383e00640 1 -- 172.21.15.103:0/2385173129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563ca299da30 msgr2=0x563ca297fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:51.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff383e00640 1 --2- 172.21.15.103:0/2385173129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563ca299da30 0x563ca297fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff383e00640 1 -- 172.21.15.103:0/2385173129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ca290e380 msgr2=0x563ca290a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:51.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff383e00640 1 --2- 172.21.15.103:0/2385173129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ca290e380 0x563ca290a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff383e00640 1 -- 172.21.15.103:0/2385173129 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ca27edc10 con 0x563ca2983e00 2024-09-10T22:40:51.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff383e00640 1 --2- 172.21.15.103:0/2385173129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ca2983e00 0x563ca297f600 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff374019790 tx=0x7ff374017e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6519c947eb75751d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff389600640 1 -- 172.21.15.103:0/2385173129 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3740ab5f0 con 0x563ca2983e00 2024-09-10T22:40:51.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff389600640 1 -- 172.21.15.103:0/2385173129 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3740bc070 con 0x563ca2983e00 2024-09-10T22:40:51.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff389600640 1 -- 172.21.15.103:0/2385173129 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3740abcd0 con 0x563ca2983e00 2024-09-10T22:40:51.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38d74c080 1 -- 172.21.15.103:0/2385173129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ca2983e00 msgr2=0x563ca297f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38d74c080 1 --2- 172.21.15.103:0/2385173129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ca2983e00 0x563ca297f600 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff374019790 tx=0x7ff374017e80 comp rx=0 tx=0).stop 2024-09-10T22:40:51.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38d74c080 1 -- 172.21.15.103:0/2385173129 shutdown_connections 2024-09-10T22:40:51.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38d74c080 1 --2- 172.21.15.103:0/2385173129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563ca299da30 0x563ca297fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38d74c080 1 --2- 172.21.15.103:0/2385173129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ca2983e00 0x563ca297f600 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38d74c080 1 --2- 172.21.15.103:0/2385173129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ca290e380 0x563ca290a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38d74c080 1 -- 172.21.15.103:0/2385173129 >> 172.21.15.103:0/2385173129 conn(0x563ca28c7f30 msgr2=0x563ca28f6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:51.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38d74c080 1 -- 172.21.15.103:0/2385173129 shutdown_connections 2024-09-10T22:40:51.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.181+0000 7ff38d74c080 1 -- 172.21.15.103:0/2385173129 wait complete. 2024-09-10T22:40:51.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff38d74c080 1 Processor -- start 2024-09-10T22:40:51.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff38d74c080 1 -- start start 2024-09-10T22:40:51.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff38d74c080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ca290e380 0x563ca29a4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff38d74c080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ca2983e00 0x563ca2999320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff38d74c080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563ca299da30 0x563ca2908ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff38d74c080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563ca29087b0 con 0x563ca2983e00 2024-09-10T22:40:51.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff38d74c080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563ca299a660 con 0x563ca290e380 2024-09-10T22:40:51.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff38d74c080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563ca297ea20 con 0x563ca299da30 2024-09-10T22:40:51.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff383e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ca2983e00 0x563ca2999320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff383e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ca2983e00 0x563ca2999320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44224/0 (socket says 172.21.15.103:44224) 2024-09-10T22:40:51.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff383e00640 1 -- 172.21.15.103:0/108460900 learned_addr learned my addr 172.21.15.103:0/108460900 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:51.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff38aa00640 1 --2- 172.21.15.103:0/108460900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ca290e380 0x563ca29a4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff38b400640 1 --2- 172.21.15.103:0/108460900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563ca299da30 0x563ca2908ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff383e00640 1 -- 172.21.15.103:0/108460900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563ca299da30 msgr2=0x563ca2908ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff383e00640 1 --2- 172.21.15.103:0/108460900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563ca299da30 0x563ca2908ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff383e00640 1 -- 172.21.15.103:0/108460900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ca290e380 msgr2=0x563ca29a4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff383e00640 1 --2- 172.21.15.103:0/108460900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ca290e380 0x563ca29a4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff383e00640 1 -- 172.21.15.103:0/108460900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ca2980050 con 0x563ca2983e00 2024-09-10T22:40:51.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff383e00640 1 --2- 172.21.15.103:0/108460900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ca2983e00 0x563ca2999320 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff3740b9040 tx=0x7ff3740aba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff383400640 1 -- 172.21.15.103:0/108460900 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3740c6030 con 0x563ca2983e00 2024-09-10T22:40:51.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff383400640 1 -- 172.21.15.103:0/108460900 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3740bc070 con 0x563ca2983e00 2024-09-10T22:40:51.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff38d74c080 1 -- 172.21.15.103:0/108460900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ca29802f0 con 0x563ca2983e00 2024-09-10T22:40:51.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff383400640 1 -- 172.21.15.103:0/108460900 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3740c1660 con 0x563ca2983e00 2024-09-10T22:40:51.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.185+0000 7ff38d74c080 1 -- 172.21.15.103:0/108460900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ca2980830 con 0x563ca2983e00 2024-09-10T22:40:51.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff383400640 1 -- 172.21.15.103:0/108460900 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff3740c1800 con 0x563ca2983e00 2024-09-10T22:40:51.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff383400640 1 --2- 172.21.15.103:0/108460900 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff368070fc0 0x7ff368073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff383400640 1 -- 172.21.15.103:0/108460900 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7ff37412e7d0 con 0x563ca2983e00 2024-09-10T22:40:51.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff38aa00640 1 --2- 172.21.15.103:0/108460900 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff368070fc0 0x7ff368073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff38d74c080 1 --2- 172.21.15.103:0/108460900 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x563ca2982860 0x563ca29811e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff38d74c080 1 -- 172.21.15.103:0/108460900 --> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] -- osd_op(unknown.0.0:1 5.5 5:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43) -- 0x563ca2981720 con 0x563ca2982860 2024-09-10T22:40:51.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff38b400640 1 --2- 172.21.15.103:0/108460900 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x563ca2982860 0x563ca29811e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff38aa00640 1 --2- 172.21.15.103:0/108460900 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff368070fc0 0x7ff368073480 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff37c004fd0 tx=0x7ff37c002040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff38b400640 1 --2- 172.21.15.103:0/108460900 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x563ca2982860 0x563ca29811e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff38b400640 1 -- 172.21.15.103:0/108460900 <== osd.0 v2:172.21.15.103:6808/2662233365 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (10) out=10b] v0'0 uv6 ondisk = 0) ==== 164+0+10 (crc 0 0 0) 0x7ff384002020 con 0x563ca2982860 2024-09-10T22:40:51.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff38d74c080 1 -- 172.21.15.103:0/108460900 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x563ca2982860 msgr2=0x563ca29811e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff38d74c080 1 --2- 172.21.15.103:0/108460900 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x563ca2982860 0x563ca29811e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff38d74c080 1 -- 172.21.15.103:0/108460900 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff368070fc0 msgr2=0x7ff368073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff38d74c080 1 --2- 172.21.15.103:0/108460900 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff368070fc0 0x7ff368073480 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff37c004fd0 tx=0x7ff37c002040 comp rx=0 tx=0).stop 2024-09-10T22:40:51.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff38d74c080 1 -- 172.21.15.103:0/108460900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ca2983e00 msgr2=0x563ca2999320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff38d74c080 1 --2- 172.21.15.103:0/108460900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ca2983e00 0x563ca2999320 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff3740b9040 tx=0x7ff3740aba00 comp rx=0 tx=0).stop 2024-09-10T22:40:51.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff38b400640 1 -- 172.21.15.103:0/108460900 reap_dead start 2024-09-10T22:40:51.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff38d74c080 1 -- 172.21.15.103:0/108460900 shutdown_connections 2024-09-10T22:40:51.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff38d74c080 1 -- 172.21.15.103:0/108460900 >> 172.21.15.103:0/108460900 conn(0x563ca28c7f30 msgr2=0x563ca28f6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:51.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff38d74c080 1 -- 172.21.15.103:0/108460900 shutdown_connections 2024-09-10T22:40:51.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.189+0000 7ff38d74c080 1 -- 172.21.15.103:0/108460900 wait complete. 2024-09-10T22:40:51.201 INFO:teuthology.orchestra.run.smithi103.stdout:tag123 2024-09-10T22:40:51.201 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000005.00000000 scrub_tag 2024-09-10T22:40:51.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.241+0000 7f3a6fe38080 1 Processor -- start 2024-09-10T22:40:51.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.241+0000 7f3a6fe38080 1 -- start start 2024-09-10T22:40:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.241+0000 7f3a6fe38080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e97164d2f0 0x55e97171dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.241+0000 7f3a6fe38080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e971725740 0x55e971723d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.241+0000 7f3a6fe38080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e971725b20 0x55e97171fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.241+0000 7f3a6fe38080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e97159da00 con 0x55e97164d2f0 2024-09-10T22:40:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.241+0000 7f3a6fe38080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e9715fbf40 con 0x55e971725b20 2024-09-10T22:40:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.241+0000 7f3a6fe38080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55e971727b70 con 0x55e971725740 2024-09-10T22:40:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.241+0000 7f3a6d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e97164d2f0 0x55e97171dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.241+0000 7f3a6d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e97164d2f0 0x55e97171dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44240/0 (socket says 172.21.15.103:44240) 2024-09-10T22:40:51.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.241+0000 7f3a6d000640 1 -- 172.21.15.103:0/4013094519 learned_addr learned my addr 172.21.15.103:0/4013094519 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:51.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a67e00640 1 --2- 172.21.15.103:0/4013094519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e971725740 0x55e971723d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6da00640 1 --2- 172.21.15.103:0/4013094519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e971725b20 0x55e97171fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6d000640 1 -- 172.21.15.103:0/4013094519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e971725740 msgr2=0x55e971723d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:51.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6d000640 1 --2- 172.21.15.103:0/4013094519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e971725740 0x55e971723d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6d000640 1 -- 172.21.15.103:0/4013094519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e971725b20 msgr2=0x55e97171fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:51.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6d000640 1 --2- 172.21.15.103:0/4013094519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e971725b20 0x55e97171fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6d000640 1 -- 172.21.15.103:0/4013094519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e971576c10 con 0x55e97164d2f0 2024-09-10T22:40:51.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6d000640 1 --2- 172.21.15.103:0/4013094519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e97164d2f0 0x55e97171dd60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000c610 tx=0x7f3a6000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fea162d031b287 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a66a00640 1 -- 172.21.15.103:0/4013094519 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6000aaf0 con 0x55e97164d2f0 2024-09-10T22:40:51.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a66a00640 1 -- 172.21.15.103:0/4013094519 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a6000ac90 con 0x55e97164d2f0 2024-09-10T22:40:51.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a66a00640 1 -- 172.21.15.103:0/4013094519 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6000ae60 con 0x55e97164d2f0 2024-09-10T22:40:51.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6fe38080 1 -- 172.21.15.103:0/4013094519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e97164d2f0 msgr2=0x55e97171dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6fe38080 1 --2- 172.21.15.103:0/4013094519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e97164d2f0 0x55e97171dd60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000c610 tx=0x7f3a6000cad0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6fe38080 1 -- 172.21.15.103:0/4013094519 shutdown_connections 2024-09-10T22:40:51.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6fe38080 1 --2- 172.21.15.103:0/4013094519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e971725b20 0x55e97171fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6fe38080 1 --2- 172.21.15.103:0/4013094519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e971725740 0x55e971723d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6fe38080 1 --2- 172.21.15.103:0/4013094519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e97164d2f0 0x55e97171dd60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6fe38080 1 -- 172.21.15.103:0/4013094519 >> 172.21.15.103:0/4013094519 conn(0x55e97164ec80 msgr2=0x55e971695620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:51.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6fe38080 1 -- 172.21.15.103:0/4013094519 shutdown_connections 2024-09-10T22:40:51.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6fe38080 1 -- 172.21.15.103:0/4013094519 wait complete. 2024-09-10T22:40:51.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6fe38080 1 Processor -- start 2024-09-10T22:40:51.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6fe38080 1 -- start start 2024-09-10T22:40:51.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6fe38080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e97164d2f0 0x55e97172a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6fe38080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e971725740 0x55e971719320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6fe38080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e971725b20 0x55e97171fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6fe38080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e9717212a0 con 0x55e971725b20 2024-09-10T22:40:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6fe38080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e971721000 con 0x55e97164d2f0 2024-09-10T22:40:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6fe38080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55e971721540 con 0x55e971725740 2024-09-10T22:40:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6da00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e971725b20 0x55e97171fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6da00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e971725b20 0x55e97171fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44256/0 (socket says 172.21.15.103:44256) 2024-09-10T22:40:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6da00640 1 -- 172.21.15.103:0/3786542677 learned_addr learned my addr 172.21.15.103:0/3786542677 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6d000640 1 --2- 172.21.15.103:0/3786542677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e97164d2f0 0x55e97172a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a67e00640 1 --2- 172.21.15.103:0/3786542677 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e971725740 0x55e971719320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6da00640 1 -- 172.21.15.103:0/3786542677 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e971725740 msgr2=0x55e971719320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6da00640 1 --2- 172.21.15.103:0/3786542677 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e971725740 0x55e971719320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6da00640 1 -- 172.21.15.103:0/3786542677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e97164d2f0 msgr2=0x55e97172a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6da00640 1 --2- 172.21.15.103:0/3786542677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e97164d2f0 0x55e97172a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.245+0000 7f3a6da00640 1 -- 172.21.15.103:0/3786542677 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9717199c0 con 0x55e971725b20 2024-09-10T22:40:51.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.249+0000 7f3a6da00640 1 --2- 172.21.15.103:0/3786542677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e971725b20 0x55e97171fd30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800d160 tx=0x7f3a6800d620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.249+0000 7f3a65600640 1 -- 172.21.15.103:0/3786542677 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a68018070 con 0x55e971725b20 2024-09-10T22:40:51.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.249+0000 7f3a65600640 1 -- 172.21.15.103:0/3786542677 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a6800de50 con 0x55e971725b20 2024-09-10T22:40:51.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.249+0000 7f3a6fe38080 1 -- 172.21.15.103:0/3786542677 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e971719c60 con 0x55e971725b20 2024-09-10T22:40:51.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.249+0000 7f3a65600640 1 -- 172.21.15.103:0/3786542677 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a680015b0 con 0x55e971725b20 2024-09-10T22:40:51.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.249+0000 7f3a6fe38080 1 -- 172.21.15.103:0/3786542677 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e97167d3e0 con 0x55e971725b20 2024-09-10T22:40:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.249+0000 7f3a65600640 1 -- 172.21.15.103:0/3786542677 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3a68001750 con 0x55e971725b20 2024-09-10T22:40:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.249+0000 7f3a65600640 1 --2- 172.21.15.103:0/3786542677 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3a4c070ff0 0x7f3a4c0734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.249+0000 7f3a65600640 1 -- 172.21.15.103:0/3786542677 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f3a68091aa0 con 0x55e971725b20 2024-09-10T22:40:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.249+0000 7f3a6fe38080 1 --2- 172.21.15.103:0/3786542677 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x55e971720270 0x55e97167e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.249+0000 7f3a6fe38080 1 -- 172.21.15.103:0/3786542677 --> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] -- osd_op(unknown.0.0:1 5.9 5:9258b67d:::10000000005.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43) -- 0x55e97167e570 con 0x55e971720270 2024-09-10T22:40:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.249+0000 7f3a6d000640 1 --2- 172.21.15.103:0/3786542677 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3a4c070ff0 0x7f3a4c0734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.249+0000 7f3a67e00640 1 --2- 172.21.15.103:0/3786542677 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x55e971720270 0x55e97167e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.253+0000 7f3a6d000640 1 --2- 172.21.15.103:0/3786542677 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3a4c070ff0 0x7f3a4c0734b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000c530 tx=0x7f3a60002fc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.253+0000 7f3a67e00640 1 --2- 172.21.15.103:0/3786542677 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x55e971720270 0x55e97167e030 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.253+0000 7f3a67e00640 1 -- 172.21.15.103:0/3786542677 <== osd.7 v2:172.21.15.131:6826/1279722082 1 ==== osd_op_reply(1 10000000005.00000000 [getxattr (10) out=10b] v0'0 uv6 ondisk = 0) ==== 164+0+10 (crc 0 0 0) 0x7f3a580b3040 con 0x55e971720270 2024-09-10T22:40:51.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.253+0000 7f3a6fe38080 1 -- 172.21.15.103:0/3786542677 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x55e971720270 msgr2=0x55e97167e030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.253+0000 7f3a6fe38080 1 --2- 172.21.15.103:0/3786542677 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x55e971720270 0x55e97167e030 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.253+0000 7f3a6fe38080 1 -- 172.21.15.103:0/3786542677 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3a4c070ff0 msgr2=0x7f3a4c0734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.253+0000 7f3a6fe38080 1 --2- 172.21.15.103:0/3786542677 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3a4c070ff0 0x7f3a4c0734b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000c530 tx=0x7f3a60002fc0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.253+0000 7f3a6fe38080 1 -- 172.21.15.103:0/3786542677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e971725b20 msgr2=0x55e97171fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.253+0000 7f3a6fe38080 1 --2- 172.21.15.103:0/3786542677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e971725b20 0x55e97171fd30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800d160 tx=0x7f3a6800d620 comp rx=0 tx=0).stop 2024-09-10T22:40:51.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.253+0000 7f3a6da00640 1 -- 172.21.15.103:0/3786542677 reap_dead start 2024-09-10T22:40:51.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.253+0000 7f3a6fe38080 1 -- 172.21.15.103:0/3786542677 shutdown_connections 2024-09-10T22:40:51.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.253+0000 7f3a6fe38080 1 -- 172.21.15.103:0/3786542677 >> 172.21.15.103:0/3786542677 conn(0x55e97164ec80 msgr2=0x55e971695620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:51.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.253+0000 7f3a6fe38080 1 -- 172.21.15.103:0/3786542677 shutdown_connections 2024-09-10T22:40:51.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.253+0000 7f3a6fe38080 1 -- 172.21.15.103:0/3786542677 wait complete. 2024-09-10T22:40:51.262 INFO:teuthology.orchestra.run.smithi103.stdout:tag123 2024-09-10T22:40:51.262 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000006.00000000 scrub_tag 2024-09-10T22:40:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3ba6d66080 1 Processor -- start 2024-09-10T22:40:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3ba6d66080 1 -- start start 2024-09-10T22:40:51.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3ba6d66080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556546b408b0 0x556546b0d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3ba6d66080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556546b5a1d0 0x556546b0c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3ba6d66080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556546be4570 0x556546be35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3ba6d66080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556546a5ca00 con 0x556546be4570 2024-09-10T22:40:51.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3ba6d66080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x556546abaf40 con 0x556546b408b0 2024-09-10T22:40:51.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3ba6d66080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x556546bc9bf0 con 0x556546b5a1d0 2024-09-10T22:40:51.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3ba4a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556546be4570 0x556546be35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3ba4a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556546be4570 0x556546be35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44270/0 (socket says 172.21.15.103:44270) 2024-09-10T22:40:51.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3ba4a00640 1 -- 172.21.15.103:0/1742360094 learned_addr learned my addr 172.21.15.103:0/1742360094 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:51.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3b9be00640 1 --2- 172.21.15.103:0/1742360094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556546b5a1d0 0x556546b0c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3ba4000640 1 --2- 172.21.15.103:0/1742360094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556546b408b0 0x556546b0d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3ba4a00640 1 -- 172.21.15.103:0/1742360094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556546b5a1d0 msgr2=0x556546b0c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:51.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3ba4a00640 1 --2- 172.21.15.103:0/1742360094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556546b5a1d0 0x556546b0c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3ba4a00640 1 -- 172.21.15.103:0/1742360094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556546b408b0 msgr2=0x556546b0d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:51.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3ba4a00640 1 --2- 172.21.15.103:0/1742360094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556546b408b0 0x556546b0d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3ba4a00640 1 -- 172.21.15.103:0/1742360094 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556546a35c10 con 0x556546be4570 2024-09-10T22:40:51.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.349+0000 7f3ba4000640 1 --2- 172.21.15.103:0/1742360094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556546b408b0 0x556546b0d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:40:51.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba4a00640 1 --2- 172.21.15.103:0/1742360094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556546be4570 0x556546be35b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0016b0 tx=0x7f3b9c001b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e3b82d9b165402 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba2c00640 1 -- 172.21.15.103:0/1742360094 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c017070 con 0x556546be4570 2024-09-10T22:40:51.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba2c00640 1 -- 172.21.15.103:0/1742360094 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b9c0027b0 con 0x556546be4570 2024-09-10T22:40:51.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba2c00640 1 -- 172.21.15.103:0/1742360094 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c002c00 con 0x556546be4570 2024-09-10T22:40:51.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba6d66080 1 -- 172.21.15.103:0/1742360094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556546be4570 msgr2=0x556546be35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba6d66080 1 --2- 172.21.15.103:0/1742360094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556546be4570 0x556546be35b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0016b0 tx=0x7f3b9c001b70 comp rx=0 tx=0).stop 2024-09-10T22:40:51.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba6d66080 1 -- 172.21.15.103:0/1742360094 shutdown_connections 2024-09-10T22:40:51.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba6d66080 1 --2- 172.21.15.103:0/1742360094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556546be4570 0x556546be35b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba6d66080 1 --2- 172.21.15.103:0/1742360094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556546b5a1d0 0x556546b0c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba6d66080 1 --2- 172.21.15.103:0/1742360094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556546b408b0 0x556546b0d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba6d66080 1 -- 172.21.15.103:0/1742360094 >> 172.21.15.103:0/1742360094 conn(0x556546b0bdb0 msgr2=0x556546b0e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:51.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba6d66080 1 -- 172.21.15.103:0/1742360094 shutdown_connections 2024-09-10T22:40:51.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba6d66080 1 -- 172.21.15.103:0/1742360094 wait complete. 2024-09-10T22:40:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba6d66080 1 Processor -- start 2024-09-10T22:40:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba6d66080 1 -- start start 2024-09-10T22:40:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba6d66080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556546b408b0 0x556546b53d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba6d66080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556546b5a1d0 0x556546b590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba6d66080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556546be4570 0x556546b59600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba6d66080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556546be1e60 con 0x556546b408b0 2024-09-10T22:40:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba6d66080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x556546be1bc0 con 0x556546be4570 2024-09-10T22:40:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba6d66080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x556546be2100 con 0x556546b5a1d0 2024-09-10T22:40:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba4000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556546b408b0 0x556546b53d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba4000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556546b408b0 0x556546b53d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44282/0 (socket says 172.21.15.103:44282) 2024-09-10T22:40:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba4000640 1 -- 172.21.15.103:0/4117587563 learned_addr learned my addr 172.21.15.103:0/4117587563 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3b9be00640 1 --2- 172.21.15.103:0/4117587563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556546b5a1d0 0x556546b590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba4a00640 1 --2- 172.21.15.103:0/4117587563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556546be4570 0x556546b59600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba4000640 1 -- 172.21.15.103:0/4117587563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556546b5a1d0 msgr2=0x556546b590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba4000640 1 --2- 172.21.15.103:0/4117587563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556546b5a1d0 0x556546b590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba4000640 1 -- 172.21.15.103:0/4117587563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556546be4570 msgr2=0x556546b59600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba4000640 1 --2- 172.21.15.103:0/4117587563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556546be4570 0x556546b59600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba4000640 1 -- 172.21.15.103:0/4117587563 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556546be12a0 con 0x556546b408b0 2024-09-10T22:40:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.353+0000 7f3ba4000640 1 --2- 172.21.15.103:0/4117587563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556546b408b0 0x556546b53d10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3b94006650 tx=0x7f3b94006740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.357+0000 7f3ba1800640 1 -- 172.21.15.103:0/4117587563 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b94006e50 con 0x556546b408b0 2024-09-10T22:40:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.357+0000 7f3ba1800640 1 -- 172.21.15.103:0/4117587563 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b94014430 con 0x556546b408b0 2024-09-10T22:40:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.357+0000 7f3ba6d66080 1 -- 172.21.15.103:0/4117587563 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556546be1540 con 0x556546b408b0 2024-09-10T22:40:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.357+0000 7f3ba1800640 1 -- 172.21.15.103:0/4117587563 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b94014860 con 0x556546b408b0 2024-09-10T22:40:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.357+0000 7f3ba6d66080 1 -- 172.21.15.103:0/4117587563 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556546b516e0 con 0x556546b408b0 2024-09-10T22:40:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.357+0000 7f3ba1800640 1 -- 172.21.15.103:0/4117587563 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3b9401c030 con 0x556546b408b0 2024-09-10T22:40:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.357+0000 7f3ba1800640 1 --2- 172.21.15.103:0/4117587563 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3b80071190 0x7f3b80073650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.357+0000 7f3ba1800640 1 -- 172.21.15.103:0/4117587563 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f3b94091650 con 0x556546b408b0 2024-09-10T22:40:51.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.357+0000 7f3ba6d66080 1 --2- 172.21.15.103:0/4117587563 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x556546b52330 0x556546bdacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.357+0000 7f3b9be00640 1 --2- 172.21.15.103:0/4117587563 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3b80071190 0x7f3b80073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.357+0000 7f3ba6d66080 1 -- 172.21.15.103:0/4117587563 --> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] -- osd_op(unknown.0.0:1 5.5 5:a5feb6f3:::10000000006.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43) -- 0x556546b52710 con 0x556546b52330 2024-09-10T22:40:51.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.357+0000 7f3ba4a00640 1 --2- 172.21.15.103:0/4117587563 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x556546b52330 0x556546bdacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.361+0000 7f3b9be00640 1 --2- 172.21.15.103:0/4117587563 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3b80071190 0x7f3b80073650 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0ab000 tx=0x7f3b8c019ae0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.361+0000 7f3ba4a00640 1 --2- 172.21.15.103:0/4117587563 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x556546b52330 0x556546bdacc0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.361+0000 7f3ba4a00640 1 -- 172.21.15.103:0/4117587563 <== osd.0 v2:172.21.15.103:6808/2662233365 1 ==== osd_op_reply(1 10000000006.00000000 [getxattr (10) out=10b] v0'0 uv7 ondisk = 0) ==== 164+0+10 (crc 0 0 0) 0x7f3b9c00f070 con 0x556546b52330 2024-09-10T22:40:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.361+0000 7f3ba6d66080 1 -- 172.21.15.103:0/4117587563 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x556546b52330 msgr2=0x556546bdacc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.361+0000 7f3ba6d66080 1 --2- 172.21.15.103:0/4117587563 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x556546b52330 0x556546bdacc0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.361+0000 7f3ba6d66080 1 -- 172.21.15.103:0/4117587563 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3b80071190 msgr2=0x7f3b80073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.361+0000 7f3ba6d66080 1 --2- 172.21.15.103:0/4117587563 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3b80071190 0x7f3b80073650 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0ab000 tx=0x7f3b8c019ae0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.361+0000 7f3ba6d66080 1 -- 172.21.15.103:0/4117587563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556546b408b0 msgr2=0x556546b53d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.361+0000 7f3ba6d66080 1 --2- 172.21.15.103:0/4117587563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556546b408b0 0x556546b53d10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3b94006650 tx=0x7f3b94006740 comp rx=0 tx=0).stop 2024-09-10T22:40:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.361+0000 7f3ba4a00640 1 -- 172.21.15.103:0/4117587563 reap_dead start 2024-09-10T22:40:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.361+0000 7f3ba6d66080 1 -- 172.21.15.103:0/4117587563 shutdown_connections 2024-09-10T22:40:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.361+0000 7f3ba6d66080 1 -- 172.21.15.103:0/4117587563 >> 172.21.15.103:0/4117587563 conn(0x556546b0bdb0 msgr2=0x556546b3f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.361+0000 7f3ba6d66080 1 -- 172.21.15.103:0/4117587563 shutdown_connections 2024-09-10T22:40:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.361+0000 7f3ba6d66080 1 -- 172.21.15.103:0/4117587563 wait complete. 2024-09-10T22:40:51.373 INFO:teuthology.orchestra.run.smithi103.stdout:tag123 2024-09-10T22:40:51.373 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000007.00000000 scrub_tag 2024-09-10T22:40:51.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f01567c4080 1 Processor -- start 2024-09-10T22:40:51.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f01567c4080 1 -- start start 2024-09-10T22:40:51.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f01567c4080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55660ff6e570 0x55660ffe80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f01567c4080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55660ffebe00 0x55660ffe8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f01567c4080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566100054f0 0x55660ffe8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f01567c4080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55660fe7ca00 con 0x5566100054f0 2024-09-10T22:40:51.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f01567c4080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55660fedaf40 con 0x55660ffebe00 2024-09-10T22:40:51.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f01567c4080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5566100042a0 con 0x55660ff6e570 2024-09-10T22:40:51.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f0154400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566100054f0 0x55660ffe8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f0154400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566100054f0 0x55660ffe8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44304/0 (socket says 172.21.15.103:44304) 2024-09-10T22:40:51.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f0154400640 1 -- 172.21.15.103:0/4181114985 learned_addr learned my addr 172.21.15.103:0/4181114985 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:51.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f0153000640 1 --2- 172.21.15.103:0/4181114985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55660ffebe00 0x55660ffe8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f0153a00640 1 --2- 172.21.15.103:0/4181114985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55660ff6e570 0x55660ffe80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f0154400640 1 -- 172.21.15.103:0/4181114985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55660ff6e570 msgr2=0x55660ffe80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:51.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f0154400640 1 --2- 172.21.15.103:0/4181114985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55660ff6e570 0x55660ffe80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f0154400640 1 -- 172.21.15.103:0/4181114985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55660ffebe00 msgr2=0x55660ffe8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:40:51.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f0154400640 1 --2- 172.21.15.103:0/4181114985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55660ffebe00 0x55660ffe8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f0154400640 1 -- 172.21.15.103:0/4181114985 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55660fe55c10 con 0x5566100054f0 2024-09-10T22:40:51.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f0154400640 1 --2- 172.21.15.103:0/4181114985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566100054f0 0x55660ffe8b50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f014c00a600 tx=0x7f014c018120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5661b60d7868e79b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f0151c00640 1 -- 172.21.15.103:0/4181114985 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c0ba020 con 0x5566100054f0 2024-09-10T22:40:51.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f0151c00640 1 -- 172.21.15.103:0/4181114985 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f014c0aaad0 con 0x5566100054f0 2024-09-10T22:40:51.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f0151c00640 1 -- 172.21.15.103:0/4181114985 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c0af070 con 0x5566100054f0 2024-09-10T22:40:51.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f01567c4080 1 -- 172.21.15.103:0/4181114985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566100054f0 msgr2=0x55660ffe8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f01567c4080 1 --2- 172.21.15.103:0/4181114985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566100054f0 0x55660ffe8b50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f014c00a600 tx=0x7f014c018120 comp rx=0 tx=0).stop 2024-09-10T22:40:51.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f01567c4080 1 -- 172.21.15.103:0/4181114985 shutdown_connections 2024-09-10T22:40:51.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f01567c4080 1 --2- 172.21.15.103:0/4181114985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566100054f0 0x55660ffe8b50 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f01567c4080 1 --2- 172.21.15.103:0/4181114985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55660ffebe00 0x55660ffe8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f01567c4080 1 --2- 172.21.15.103:0/4181114985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55660ff6e570 0x55660ffe80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f01567c4080 1 -- 172.21.15.103:0/4181114985 >> 172.21.15.103:0/4181114985 conn(0x55660ff2ff30 msgr2=0x55660ff77e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:51.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f01567c4080 1 -- 172.21.15.103:0/4181114985 shutdown_connections 2024-09-10T22:40:51.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f01567c4080 1 -- 172.21.15.103:0/4181114985 wait complete. 2024-09-10T22:40:51.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.457+0000 7f01567c4080 1 Processor -- start 2024-09-10T22:40:51.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f01567c4080 1 -- start start 2024-09-10T22:40:51.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f01567c4080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55660ff6e570 0x55661000cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f01567c4080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55660ffebe00 0x55660ff5d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f01567c4080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566100054f0 0x55660ff5dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f01567c4080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55660ffe76f0 con 0x5566100054f0 2024-09-10T22:40:51.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f01567c4080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55660ff5e570 con 0x55660ff6e570 2024-09-10T22:40:51.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f01567c4080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55660ffe7990 con 0x55660ffebe00 2024-09-10T22:40:51.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f0154400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566100054f0 0x55660ff5dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f0154400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566100054f0 0x55660ff5dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44308/0 (socket says 172.21.15.103:44308) 2024-09-10T22:40:51.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f0154400640 1 -- 172.21.15.103:0/709880672 learned_addr learned my addr 172.21.15.103:0/709880672 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:51.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f0153a00640 1 --2- 172.21.15.103:0/709880672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55660ff6e570 0x55661000cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f0153000640 1 --2- 172.21.15.103:0/709880672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55660ffebe00 0x55660ff5d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f0154400640 1 -- 172.21.15.103:0/709880672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55660ffebe00 msgr2=0x55660ff5d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f0154400640 1 --2- 172.21.15.103:0/709880672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55660ffebe00 0x55660ff5d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f0154400640 1 -- 172.21.15.103:0/709880672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55660ff6e570 msgr2=0x55661000cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f0154400640 1 --2- 172.21.15.103:0/709880672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55660ff6e570 0x55661000cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f0154400640 1 -- 172.21.15.103:0/709880672 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556610007a20 con 0x5566100054f0 2024-09-10T22:40:51.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f0153000640 1 --2- 172.21.15.103:0/709880672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55660ffebe00 0x55660ff5d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:40:51.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f0154400640 1 --2- 172.21.15.103:0/709880672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566100054f0 0x55660ff5dd80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f014c00a550 tx=0x7f014c0aab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f014be00640 1 -- 172.21.15.103:0/709880672 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c0c3020 con 0x5566100054f0 2024-09-10T22:40:51.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f014be00640 1 -- 172.21.15.103:0/709880672 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f014c004110 con 0x5566100054f0 2024-09-10T22:40:51.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f014be00640 1 -- 172.21.15.103:0/709880672 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c0ba070 con 0x5566100054f0 2024-09-10T22:40:51.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f01567c4080 1 -- 172.21.15.103:0/709880672 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556610007cc0 con 0x5566100054f0 2024-09-10T22:40:51.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.461+0000 7f01567c4080 1 -- 172.21.15.103:0/709880672 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556610007f60 con 0x5566100054f0 2024-09-10T22:40:51.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f014be00640 1 -- 172.21.15.103:0/709880672 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f014c0b5070 con 0x5566100054f0 2024-09-10T22:40:51.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f014be00640 1 --2- 172.21.15.103:0/709880672 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0134070fc0 0x7f0134073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f014be00640 1 -- 172.21.15.103:0/709880672 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f014c12d380 con 0x5566100054f0 2024-09-10T22:40:51.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f01567c4080 1 --2- 172.21.15.103:0/709880672 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x55660ffe9970 0x55660ffe9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f0153a00640 1 --2- 172.21.15.103:0/709880672 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0134070fc0 0x7f0134073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f01567c4080 1 -- 172.21.15.103:0/709880672 --> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] -- osd_op(unknown.0.0:1 5.1d 5:bbf5850a:::10000000007.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43) -- 0x55660ffea2c0 con 0x55660ffe9970 2024-09-10T22:40:51.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f0153000640 1 --2- 172.21.15.103:0/709880672 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x55660ffe9970 0x55660ffe9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f0153a00640 1 --2- 172.21.15.103:0/709880672 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0134070fc0 0x7f0134073480 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0144000c10 tx=0x7f0144001820 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f0153000640 1 --2- 172.21.15.103:0/709880672 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x55660ffe9970 0x55660ffe9d80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f0153000640 1 -- 172.21.15.103:0/709880672 <== osd.1 v2:172.21.15.103:6800/4140822734 1 ==== osd_op_reply(1 10000000007.00000000 [getxattr (10) out=10b] v0'0 uv7 ondisk = 0) ==== 164+0+10 (crc 0 0 0) 0x7f014000b8d0 con 0x55660ffe9970 2024-09-10T22:40:51.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f01567c4080 1 -- 172.21.15.103:0/709880672 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x55660ffe9970 msgr2=0x55660ffe9d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f01567c4080 1 --2- 172.21.15.103:0/709880672 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x55660ffe9970 0x55660ffe9d80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f01567c4080 1 -- 172.21.15.103:0/709880672 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0134070fc0 msgr2=0x7f0134073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f01567c4080 1 --2- 172.21.15.103:0/709880672 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0134070fc0 0x7f0134073480 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0144000c10 tx=0x7f0144001820 comp rx=0 tx=0).stop 2024-09-10T22:40:51.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f01567c4080 1 -- 172.21.15.103:0/709880672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566100054f0 msgr2=0x55660ff5dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f01567c4080 1 --2- 172.21.15.103:0/709880672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5566100054f0 0x55660ff5dd80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f014c00a550 tx=0x7f014c0aab60 comp rx=0 tx=0).stop 2024-09-10T22:40:51.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f0154400640 1 -- 172.21.15.103:0/709880672 reap_dead start 2024-09-10T22:40:51.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f01567c4080 1 -- 172.21.15.103:0/709880672 shutdown_connections 2024-09-10T22:40:51.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f01567c4080 1 -- 172.21.15.103:0/709880672 >> 172.21.15.103:0/709880672 conn(0x55660ff2ff30 msgr2=0x556610001e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:51.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f01567c4080 1 -- 172.21.15.103:0/709880672 shutdown_connections 2024-09-10T22:40:51.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.465+0000 7f01567c4080 1 -- 172.21.15.103:0/709880672 wait complete. 2024-09-10T22:40:51.475 INFO:teuthology.orchestra.run.smithi103.stdout:tag123 2024-09-10T22:40:51.476 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T22:40:51.476 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:40:51.567 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:40:51.646 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T22:40:51.646 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:40:51.646 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:40:51.646 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:40:51.655 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:40:51.655 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:40:51.704 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T22:40:51.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.881+0000 7f9a5f600640 1 -- 172.21.15.103:0/744106710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a40003a10 msgr2=0x7f9a40003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.881+0000 7f9a5f600640 1 --2- 172.21.15.103:0/744106710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a40003a10 0x7f9a40003e30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00abf0 tx=0x7f9a4c01cd90 comp rx=0 tx=0).stop 2024-09-10T22:40:51.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.881+0000 7f9a5d600640 1 -- 172.21.15.103:0/744106710 reap_dead start 2024-09-10T22:40:51.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.881+0000 7f9a5f600640 1 -- 172.21.15.103:0/744106710 shutdown_connections 2024-09-10T22:40:51.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.881+0000 7f9a5f600640 1 -- 172.21.15.103:0/744106710 >> 172.21.15.103:0/744106710 conn(0x7f9a5806cc00 msgr2=0x7f9a5806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:51.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.881+0000 7f9a5f600640 1 -- 172.21.15.103:0/744106710 shutdown_connections 2024-09-10T22:40:51.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.881+0000 7f9a5f600640 1 -- 172.21.15.103:0/744106710 wait complete. 2024-09-10T22:40:51.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5f600640 1 Processor -- start 2024-09-10T22:40:51.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5f600640 1 -- start start 2024-09-10T22:40:51.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5f600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a40003a10 0x7f9a5813d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5f600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a5813fb50 0x7f9a580a9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5f600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a5815b5d0 0x7f9a5815ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5f600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5806e7e0 con 0x7f9a5815b5d0 2024-09-10T22:40:51.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5f600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9a58157d80 con 0x7f9a40003a10 2024-09-10T22:40:51.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5f600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9a5806e960 con 0x7f9a5813fb50 2024-09-10T22:40:51.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5d600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a5815b5d0 0x7f9a5815ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5d600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a5815b5d0 0x7f9a5815ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44324/0 (socket says 172.21.15.103:44324) 2024-09-10T22:40:51.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5d600640 1 -- 172.21.15.103:0/1349170446 learned_addr learned my addr 172.21.15.103:0/1349170446 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:51.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5cc00640 1 --2- 172.21.15.103:0/1349170446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a40003a10 0x7f9a5813d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a57e00640 1 --2- 172.21.15.103:0/1349170446 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a5813fb50 0x7f9a580a9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5d600640 1 -- 172.21.15.103:0/1349170446 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a5813fb50 msgr2=0x7f9a580a9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5d600640 1 --2- 172.21.15.103:0/1349170446 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a5813fb50 0x7f9a580a9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5d600640 1 -- 172.21.15.103:0/1349170446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a40003a10 msgr2=0x7f9a5813d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:51.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5d600640 1 --2- 172.21.15.103:0/1349170446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a40003a10 0x7f9a5813d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:51.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5d600640 1 -- 172.21.15.103:0/1349170446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5813eab0 con 0x7f9a5815b5d0 2024-09-10T22:40:51.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5cc00640 1 --2- 172.21.15.103:0/1349170446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a40003a10 0x7f9a5813d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:40:51.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5d600640 1 --2- 172.21.15.103:0/1349170446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a5815b5d0 0x7f9a5815ba60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9a580d0150 tx=0x7f9a5000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a54c00640 1 -- 172.21.15.103:0/1349170446 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50004b30 con 0x7f9a5815b5d0 2024-09-10T22:40:51.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a54c00640 1 -- 172.21.15.103:0/1349170446 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a50004cd0 con 0x7f9a5815b5d0 2024-09-10T22:40:51.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5f600640 1 -- 172.21.15.103:0/1349170446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a5813ed90 con 0x7f9a5815b5d0 2024-09-10T22:40:51.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a54c00640 1 -- 172.21.15.103:0/1349170446 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50003be0 con 0x7f9a5815b5d0 2024-09-10T22:40:51.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.885+0000 7f9a5f600640 1 -- 172.21.15.103:0/1349170446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a5813f350 con 0x7f9a5815b5d0 2024-09-10T22:40:51.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.889+0000 7f9a5f600640 1 -- 172.21.15.103:0/1349170446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a580b3530 con 0x7f9a5815b5d0 2024-09-10T22:40:51.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.889+0000 7f9a54c00640 1 -- 172.21.15.103:0/1349170446 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9a50018070 con 0x7f9a5815b5d0 2024-09-10T22:40:51.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.889+0000 7f9a54c00640 1 --2- 172.21.15.103:0/1349170446 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9a380725e0 0x7f9a38074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:51.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.889+0000 7f9a54c00640 1 -- 172.21.15.103:0/1349170446 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f9a50093850 con 0x7f9a5815b5d0 2024-09-10T22:40:51.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.889+0000 7f9a5cc00640 1 --2- 172.21.15.103:0/1349170446 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9a380725e0 0x7f9a38074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:51.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.889+0000 7f9a5cc00640 1 --2- 172.21.15.103:0/1349170446 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9a380725e0 0x7f9a38074aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0af000 tx=0x7f9a4c019b30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:51.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:51.893+0000 7f9a54c00640 1 -- 172.21.15.103:0/1349170446 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9a5005e720 con 0x7f9a5815b5d0 2024-09-10T22:40:52.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.069+0000 7f9a5f600640 1 -- 172.21.15.103:0/1349170446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9a5815f3e0 con 0x7f9a5815b5d0 2024-09-10T22:40:52.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.069+0000 7f9a54c00640 1 -- 172.21.15.103:0/1349170446 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) ==== 80+0+0 (secure 0 0 0) 0x7f9a50063150 con 0x7f9a5815b5d0 2024-09-10T22:40:52.075 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T22:40:52.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.073+0000 7f9a5f600640 1 -- 172.21.15.103:0/1349170446 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9a380725e0 msgr2=0x7f9a38074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:52.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.073+0000 7f9a5f600640 1 --2- 172.21.15.103:0/1349170446 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9a380725e0 0x7f9a38074aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0af000 tx=0x7f9a4c019b30 comp rx=0 tx=0).stop 2024-09-10T22:40:52.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.073+0000 7f9a5f600640 1 -- 172.21.15.103:0/1349170446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a5815b5d0 msgr2=0x7f9a5815ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:52.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.073+0000 7f9a5f600640 1 --2- 172.21.15.103:0/1349170446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a5815b5d0 0x7f9a5815ba60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9a580d0150 tx=0x7f9a5000f3c0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.073+0000 7f9a5f600640 1 -- 172.21.15.103:0/1349170446 shutdown_connections 2024-09-10T22:40:52.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.073+0000 7f9a5f600640 1 --2- 172.21.15.103:0/1349170446 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9a380725e0 0x7f9a38074aa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.073+0000 7f9a5f600640 1 --2- 172.21.15.103:0/1349170446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a5815b5d0 0x7f9a5815ba60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.073+0000 7f9a5f600640 1 --2- 172.21.15.103:0/1349170446 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a5813fb50 0x7f9a580a9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.073+0000 7f9a5f600640 1 --2- 172.21.15.103:0/1349170446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a40003a10 0x7f9a5813d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.073+0000 7f9a5f600640 1 -- 172.21.15.103:0/1349170446 >> 172.21.15.103:0/1349170446 conn(0x7f9a5806cc00 msgr2=0x7f9a5815e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:52.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.073+0000 7f9a5f600640 1 -- 172.21.15.103:0/1349170446 shutdown_connections 2024-09-10T22:40:52.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.073+0000 7f9a5f600640 1 -- 172.21.15.103:0/1349170446 wait complete. 2024-09-10T22:40:52.097 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-09-10T22:40:52.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:52.097 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T22:40:52.114 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[37962]: fuse finished with error 0 and tester_r 0 2024-09-10T22:40:52.117 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:40:52.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:40:52.118 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T22:40:52.284 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:40:52.284 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:40:52.285 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:40:52.295 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:40:52.295 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:40:52.295 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:40:52.295 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:40:52.336 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350248k,nr_inodes=4087562,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3542 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T22:40:52.337 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:40:52.337 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:40:52.337 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:40:52.347 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:40:52.347 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:40:52.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.517+0000 7f5425200640 1 -- 172.21.15.103:0/2766322351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54200cc130 msgr2=0x7f54200adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:52.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.517+0000 7f5425200640 1 --2- 172.21.15.103:0/2766322351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54200cc130 0x7f54200adba0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5410009900 tx=0x7f541001c8e0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.517+0000 7f5425200640 1 -- 172.21.15.103:0/2766322351 shutdown_connections 2024-09-10T22:40:52.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.517+0000 7f5425200640 1 --2- 172.21.15.103:0/2766322351 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54200ad5f0 0x7f54200b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.517+0000 7f5425200640 1 --2- 172.21.15.103:0/2766322351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54200cc130 0x7f54200adba0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.517+0000 7f5425200640 1 -- 172.21.15.103:0/2766322351 >> 172.21.15.103:0/2766322351 conn(0x7f54200b1c00 msgr2=0x7f54200b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:52.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.517+0000 7f5425200640 1 -- 172.21.15.103:0/2766322351 shutdown_connections 2024-09-10T22:40:52.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.517+0000 7f5425200640 1 -- 172.21.15.103:0/2766322351 wait complete. 2024-09-10T22:40:52.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f5425200640 1 Processor -- start 2024-09-10T22:40:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f5425200640 1 -- start start 2024-09-10T22:40:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f5425200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f542006de20 0x7f54200cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f5425200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54200ad5f0 0x7f54200c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f5425200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54200cc130 0x7f54200c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f5425200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5420167940 con 0x7f54200cc130 2024-09-10T22:40:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f5425200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f54201677c0 con 0x7f54200ad5f0 2024-09-10T22:40:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f5425200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5420167ac0 con 0x7f542006de20 2024-09-10T22:40:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f541e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54200cc130 0x7f54200c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f541e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54200cc130 0x7f54200c9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44350/0 (socket says 172.21.15.103:44350) 2024-09-10T22:40:52.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f541e800640 1 -- 172.21.15.103:0/2171145172 learned_addr learned my addr 172.21.15.103:0/2171145172 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:52.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f5415400640 1 --2- 172.21.15.103:0/2171145172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54200ad5f0 0x7f54200c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:52.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f541de00640 1 --2- 172.21.15.103:0/2171145172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f542006de20 0x7f54200cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f541e800640 1 -- 172.21.15.103:0/2171145172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f542006de20 msgr2=0x7f54200cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f541e800640 1 --2- 172.21.15.103:0/2171145172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f542006de20 0x7f54200cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f541e800640 1 -- 172.21.15.103:0/2171145172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54200ad5f0 msgr2=0x7f54200c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f541e800640 1 --2- 172.21.15.103:0/2171145172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54200ad5f0 0x7f54200c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f541e800640 1 -- 172.21.15.103:0/2171145172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542009b420 con 0x7f54200cc130 2024-09-10T22:40:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f541de00640 1 --2- 172.21.15.103:0/2171145172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f542006de20 0x7f54200cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:40:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f541e800640 1 --2- 172.21.15.103:0/2171145172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54200cc130 0x7f54200c9b40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f541800ea20 tx=0x7f541800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f5416a00640 1 -- 172.21.15.103:0/2171145172 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541800cde0 con 0x7f54200cc130 2024-09-10T22:40:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f5416a00640 1 -- 172.21.15.103:0/2171145172 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5418004c40 con 0x7f54200cc130 2024-09-10T22:40:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f5416a00640 1 -- 172.21.15.103:0/2171145172 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5418005280 con 0x7f54200cc130 2024-09-10T22:40:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f5425200640 1 -- 172.21.15.103:0/2171145172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f542009b700 con 0x7f54200cc130 2024-09-10T22:40:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.521+0000 7f5425200640 1 -- 172.21.15.103:0/2171145172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f542009bcc0 con 0x7f54200cc130 2024-09-10T22:40:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.525+0000 7f5425200640 1 -- 172.21.15.103:0/2171145172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f542009bec0 con 0x7f54200cc130 2024-09-10T22:40:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.525+0000 7f5416a00640 1 -- 172.21.15.103:0/2171145172 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f541800f040 con 0x7f54200cc130 2024-09-10T22:40:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.525+0000 7f5416a00640 1 --2- 172.21.15.103:0/2171145172 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f53fc0725e0 0x7f53fc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.525+0000 7f5416a00640 1 -- 172.21.15.103:0/2171145172 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f5418093a20 con 0x7f54200cc130 2024-09-10T22:40:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.525+0000 7f541de00640 1 --2- 172.21.15.103:0/2171145172 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f53fc0725e0 0x7f53fc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.525+0000 7f541de00640 1 --2- 172.21.15.103:0/2171145172 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f53fc0725e0 0x7f53fc074aa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f54100af000 tx=0x7f541001b120 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.529+0000 7f5416a00640 1 -- 172.21.15.103:0/2171145172 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5418016030 con 0x7f54200cc130 2024-09-10T22:40:52.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.733+0000 7f5425200640 1 -- 172.21.15.103:0/2171145172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54200b3530 con 0x7f54200cc130 2024-09-10T22:40:52.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.733+0000 7f5416a00640 1 -- 172.21.15.103:0/2171145172 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5279 (secure 0 0 0) 0x7f541805e8f0 con 0x7f54200cc130 2024-09-10T22:40:52.738 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:40:52.738 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":27,"btime":"2024-09-10T22:40:22:706925+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/3313045987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3313045987},{"type":"v1","addr":"172.21.15.131:6836","nonce":3313045987}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:39:54.979240+0000","modified":"2024-09-10T22:40:22.473358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4941,"mds_1":4920,"mds_2":4754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4754":{"gid":4754,"name":"d","rank":2,"incarnation":23,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6837/1068577002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1068577002},{"type":"v1","addr":"172.21.15.131:6837","nonce":1068577002}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4920":{"gid":4920,"name":"a","rank":1,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.103:6833/4043692269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4043692269},{"type":"v1","addr":"172.21.15.103:6833","nonce":4043692269}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4941":{"gid":4941,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/1194009116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1194009116},{"type":"v1","addr":"172.21.15.103:6835","nonce":1194009116}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4941,"qdb_cluster":[4941,4920,4754]},"id":2}]} 2024-09-10T22:40:52.739 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 27 2024-09-10T22:40:52.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.733+0000 7f5425200640 1 -- 172.21.15.103:0/2171145172 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f53fc0725e0 msgr2=0x7f53fc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:52.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.733+0000 7f5425200640 1 --2- 172.21.15.103:0/2171145172 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f53fc0725e0 0x7f53fc074aa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f54100af000 tx=0x7f541001b120 comp rx=0 tx=0).stop 2024-09-10T22:40:52.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.733+0000 7f5425200640 1 -- 172.21.15.103:0/2171145172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54200cc130 msgr2=0x7f54200c9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:52.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.733+0000 7f5425200640 1 --2- 172.21.15.103:0/2171145172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54200cc130 0x7f54200c9b40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f541800ea20 tx=0x7f541800eee0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.733+0000 7f5425200640 1 -- 172.21.15.103:0/2171145172 shutdown_connections 2024-09-10T22:40:52.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.733+0000 7f5425200640 1 --2- 172.21.15.103:0/2171145172 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f53fc0725e0 0x7f53fc074aa0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.733+0000 7f5425200640 1 --2- 172.21.15.103:0/2171145172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54200cc130 0x7f54200c9b40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.733+0000 7f5425200640 1 --2- 172.21.15.103:0/2171145172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54200ad5f0 0x7f54200c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.733+0000 7f5425200640 1 --2- 172.21.15.103:0/2171145172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f542006de20 0x7f54200cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.733+0000 7f5425200640 1 -- 172.21.15.103:0/2171145172 >> 172.21.15.103:0/2171145172 conn(0x7f54200b1c00 msgr2=0x7f54200afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:52.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.733+0000 7f5425200640 1 -- 172.21.15.103:0/2171145172 shutdown_connections 2024-09-10T22:40:52.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.733+0000 7f5425200640 1 -- 172.21.15.103:0/2171145172 wait complete. 2024-09-10T22:40:52.759 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:40:52.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde8b400640 1 -- 172.21.15.103:0/574304160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde840aeb40 msgr2=0x7fde84072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:52.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde8b400640 1 --2- 172.21.15.103:0/574304160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde840aeb40 0x7fde84072e30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fde840d0870 tx=0x7fde7001c830 comp rx=0 tx=0).stop 2024-09-10T22:40:52.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde8b400640 1 -- 172.21.15.103:0/574304160 shutdown_connections 2024-09-10T22:40:52.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde8b400640 1 --2- 172.21.15.103:0/574304160 >> v2:172.21.15.131:3300/0 conn(0x7fde840cf790 0x7fde840cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde8b400640 1 --2- 172.21.15.103:0/574304160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde840aeb40 0x7fde84072e30 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde8b400640 1 -- 172.21.15.103:0/574304160 >> 172.21.15.103:0/574304160 conn(0x7fde8406cc00 msgr2=0x7fde8406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:52.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde8b400640 1 -- 172.21.15.103:0/574304160 shutdown_connections 2024-09-10T22:40:52.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde8b400640 1 -- 172.21.15.103:0/574304160 wait complete. 2024-09-10T22:40:52.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde8b400640 1 Processor -- start 2024-09-10T22:40:52.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde8b400640 1 -- start start 2024-09-10T22:40:52.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde8b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde840aeb40 0x7fde841fab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:52.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde8b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde840cc120 0x7fde84146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:52.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde8b400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde840cf790 0x7fde8415e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:52.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde8b400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fde84168bf0 con 0x7fde840cc120 2024-09-10T22:40:52.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde8b400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fde84168a70 con 0x7fde840aeb40 2024-09-10T22:40:52.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde8b400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fde84168d70 con 0x7fde840cf790 2024-09-10T22:40:52.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde83e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde840cc120 0x7fde84146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:52.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde83e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde840cc120 0x7fde84146380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44374/0 (socket says 172.21.15.103:44374) 2024-09-10T22:40:52.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde83e00640 1 -- 172.21.15.103:0/2312241400 learned_addr learned my addr 172.21.15.103:0/2312241400 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:52.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde88a00640 1 --2- 172.21.15.103:0/2312241400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde840aeb40 0x7fde841fab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:52.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.897+0000 7fde89400640 1 --2- 172.21.15.103:0/2312241400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde840cf790 0x7fde8415e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:52.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.901+0000 7fde88a00640 1 -- 172.21.15.103:0/2312241400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde840cf790 msgr2=0x7fde8415e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:52.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.901+0000 7fde88a00640 1 --2- 172.21.15.103:0/2312241400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde840cf790 0x7fde8415e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.901+0000 7fde88a00640 1 -- 172.21.15.103:0/2312241400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde840cc120 msgr2=0x7fde84146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:52.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.901+0000 7fde88a00640 1 --2- 172.21.15.103:0/2312241400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde840cc120 0x7fde84146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:52.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.901+0000 7fde88a00640 1 -- 172.21.15.103:0/2312241400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8406cfe0 con 0x7fde840aeb40 2024-09-10T22:40:52.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.901+0000 7fde88a00640 1 --2- 172.21.15.103:0/2312241400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde840aeb40 0x7fde841fab80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fde7400c710 tx=0x7fde7400cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:52.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.901+0000 7fde80c00640 1 -- 172.21.15.103:0/2312241400 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde74003b80 con 0x7fde840aeb40 2024-09-10T22:40:52.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.901+0000 7fde80c00640 1 -- 172.21.15.103:0/2312241400 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde74003d20 con 0x7fde840aeb40 2024-09-10T22:40:52.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.901+0000 7fde8b400640 1 -- 172.21.15.103:0/2312241400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde841fbae0 con 0x7fde840aeb40 2024-09-10T22:40:52.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.901+0000 7fde80c00640 1 -- 172.21.15.103:0/2312241400 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7400aab0 con 0x7fde840aeb40 2024-09-10T22:40:52.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.901+0000 7fde8b400640 1 -- 172.21.15.103:0/2312241400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde841fb520 con 0x7fde840aeb40 2024-09-10T22:40:52.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.901+0000 7fde8b400640 1 -- 172.21.15.103:0/2312241400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde84072e30 con 0x7fde840aeb40 2024-09-10T22:40:52.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.901+0000 7fde80c00640 1 -- 172.21.15.103:0/2312241400 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fde7400ac50 con 0x7fde840aeb40 2024-09-10T22:40:52.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.905+0000 7fde80c00640 1 --2- 172.21.15.103:0/2312241400 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fde640725e0 0x7fde64074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:52.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.905+0000 7fde80c00640 1 -- 172.21.15.103:0/2312241400 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fde74093260 con 0x7fde840aeb40 2024-09-10T22:40:52.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.905+0000 7fde83e00640 1 --2- 172.21.15.103:0/2312241400 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fde640725e0 0x7fde64074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:52.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.905+0000 7fde83e00640 1 --2- 172.21.15.103:0/2312241400 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fde640725e0 0x7fde64074aa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fde70009230 tx=0x7fde700a7040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:52.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:52.909+0000 7fde80c00640 1 -- 172.21.15.103:0/2312241400 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fde7400ce20 con 0x7fde840aeb40 2024-09-10T22:40:53.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.105+0000 7fde8b400640 1 -- 172.21.15.103:0/2312241400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde84075df0 con 0x7fde840aeb40 2024-09-10T22:40:53.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.105+0000 7fde80c00640 1 -- 172.21.15.103:0/2312241400 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5279 (secure 0 0 0) 0x7fde7405e1b0 con 0x7fde840aeb40 2024-09-10T22:40:53.111 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:40:53.111 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":27,"btime":"2024-09-10T22:40:22:706925+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/3313045987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3313045987},{"type":"v1","addr":"172.21.15.131:6836","nonce":3313045987}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:39:54.979240+0000","modified":"2024-09-10T22:40:22.473358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4941,"mds_1":4920,"mds_2":4754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4754":{"gid":4754,"name":"d","rank":2,"incarnation":23,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6837/1068577002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1068577002},{"type":"v1","addr":"172.21.15.131:6837","nonce":1068577002}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4920":{"gid":4920,"name":"a","rank":1,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.103:6833/4043692269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4043692269},{"type":"v1","addr":"172.21.15.103:6833","nonce":4043692269}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4941":{"gid":4941,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/1194009116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1194009116},{"type":"v1","addr":"172.21.15.103:6835","nonce":1194009116}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4941,"qdb_cluster":[4941,4920,4754]},"id":2}]} 2024-09-10T22:40:53.111 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 27 2024-09-10T22:40:53.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.109+0000 7fde8b400640 1 -- 172.21.15.103:0/2312241400 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fde640725e0 msgr2=0x7fde64074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:53.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.109+0000 7fde8b400640 1 --2- 172.21.15.103:0/2312241400 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fde640725e0 0x7fde64074aa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fde70009230 tx=0x7fde700a7040 comp rx=0 tx=0).stop 2024-09-10T22:40:53.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.109+0000 7fde8b400640 1 -- 172.21.15.103:0/2312241400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde840aeb40 msgr2=0x7fde841fab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:53.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.109+0000 7fde8b400640 1 --2- 172.21.15.103:0/2312241400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde840aeb40 0x7fde841fab80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fde7400c710 tx=0x7fde7400cbd0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.109+0000 7fde8b400640 1 -- 172.21.15.103:0/2312241400 shutdown_connections 2024-09-10T22:40:53.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.109+0000 7fde8b400640 1 --2- 172.21.15.103:0/2312241400 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fde640725e0 0x7fde64074aa0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.109+0000 7fde8b400640 1 --2- 172.21.15.103:0/2312241400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde840cf790 0x7fde8415e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.109+0000 7fde8b400640 1 --2- 172.21.15.103:0/2312241400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde840cc120 0x7fde84146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.109+0000 7fde8b400640 1 --2- 172.21.15.103:0/2312241400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde840aeb40 0x7fde841fab80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.109+0000 7fde8b400640 1 -- 172.21.15.103:0/2312241400 >> 172.21.15.103:0/2312241400 conn(0x7fde8406cc00 msgr2=0x7fde8415a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:53.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.109+0000 7fde8b400640 1 -- 172.21.15.103:0/2312241400 shutdown_connections 2024-09-10T22:40:53.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.109+0000 7fde8b400640 1 -- 172.21.15.103:0/2312241400 wait complete. 2024-09-10T22:40:53.131 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:40:53.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.265+0000 7f7a7c800640 1 -- 172.21.15.103:0/1135838616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a7415f1a0 msgr2=0x7f7a740ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:53.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.265+0000 7f7a7c800640 1 --2- 172.21.15.103:0/1135838616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a7415f1a0 0x7f7a740ae7f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009900 tx=0x7f7a6801c8e0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7c800640 1 -- 172.21.15.103:0/1135838616 shutdown_connections 2024-09-10T22:40:53.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7c800640 1 --2- 172.21.15.103:0/1135838616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a7415f1a0 0x7f7a740ae7f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7c800640 1 -- 172.21.15.103:0/1135838616 >> 172.21.15.103:0/1135838616 conn(0x7f7a740d1a20 msgr2=0x7f7a740d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:53.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7c800640 1 -- 172.21.15.103:0/1135838616 shutdown_connections 2024-09-10T22:40:53.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7c800640 1 -- 172.21.15.103:0/1135838616 wait complete. 2024-09-10T22:40:53.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7c800640 1 Processor -- start 2024-09-10T22:40:53.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7c800640 1 -- start start 2024-09-10T22:40:53.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7c800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a740cd500 0x7f7a74150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:53.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7c800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a740cdd00 0x7f7a74157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:53.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7c800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a7415f1a0 0x7f7a74157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:53.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7c800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7a74169f70 con 0x7f7a7415f1a0 2024-09-10T22:40:53.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7c800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7a74169df0 con 0x7f7a740cd500 2024-09-10T22:40:53.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7c800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7a7416a0f0 con 0x7f7a740cdd00 2024-09-10T22:40:53.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a7415f1a0 0x7f7a74157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:53.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a7415f1a0 0x7f7a74157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44400/0 (socket says 172.21.15.103:44400) 2024-09-10T22:40:53.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7a800640 1 -- 172.21.15.103:0/1344784360 learned_addr learned my addr 172.21.15.103:0/1344784360 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:53.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a79e00640 1 --2- 172.21.15.103:0/1344784360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a740cd500 0x7f7a74150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:53.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a79400640 1 --2- 172.21.15.103:0/1344784360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a740cdd00 0x7f7a74157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:53.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7a800640 1 -- 172.21.15.103:0/1344784360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a740cdd00 msgr2=0x7f7a74157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:53.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7a800640 1 --2- 172.21.15.103:0/1344784360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a740cdd00 0x7f7a74157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7a800640 1 -- 172.21.15.103:0/1344784360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a740cd500 msgr2=0x7f7a74150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:53.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7a800640 1 --2- 172.21.15.103:0/1344784360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a740cd500 0x7f7a74150ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7a800640 1 -- 172.21.15.103:0/1344784360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a74151430 con 0x7f7a7415f1a0 2024-09-10T22:40:53.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.269+0000 7f7a7a800640 1 --2- 172.21.15.103:0/1344784360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a7415f1a0 0x7f7a74157570 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c7f0 tx=0x7f7a7000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:53.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.273+0000 7f7a6e000640 1 -- 172.21.15.103:0/1344784360 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70003b80 con 0x7f7a7415f1a0 2024-09-10T22:40:53.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.273+0000 7f7a6e000640 1 -- 172.21.15.103:0/1344784360 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a70003d20 con 0x7f7a7415f1a0 2024-09-10T22:40:53.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.273+0000 7f7a6e000640 1 -- 172.21.15.103:0/1344784360 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7000aab0 con 0x7f7a7415f1a0 2024-09-10T22:40:53.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.273+0000 7f7a7c800640 1 -- 172.21.15.103:0/1344784360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a740c7cb0 con 0x7f7a7415f1a0 2024-09-10T22:40:53.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.273+0000 7f7a7c800640 1 -- 172.21.15.103:0/1344784360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a740c8270 con 0x7f7a7415f1a0 2024-09-10T22:40:53.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.273+0000 7f7a7c800640 1 -- 172.21.15.103:0/1344784360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a740ae7f0 con 0x7f7a7415f1a0 2024-09-10T22:40:53.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.273+0000 7f7a6e000640 1 -- 172.21.15.103:0/1344784360 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7a7000ac50 con 0x7f7a7415f1a0 2024-09-10T22:40:53.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.273+0000 7f7a6e000640 1 --2- 172.21.15.103:0/1344784360 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7a580725e0 0x7f7a58074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:53.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.273+0000 7f7a6e000640 1 -- 172.21.15.103:0/1344784360 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f7a70093290 con 0x7f7a7415f1a0 2024-09-10T22:40:53.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.273+0000 7f7a79e00640 1 --2- 172.21.15.103:0/1344784360 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7a580725e0 0x7f7a58074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:53.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.277+0000 7f7a79e00640 1 --2- 172.21.15.103:0/1344784360 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7a580725e0 0x7f7a58074aa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7a680af000 tx=0x7f7a6801b120 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:53.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.277+0000 7f7a6e000640 1 -- 172.21.15.103:0/1344784360 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7a7005e7b0 con 0x7f7a7415f1a0 2024-09-10T22:40:53.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.445+0000 7f7a7c800640 1 -- 172.21.15.103:0/1344784360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a740cfd30 con 0x7f7a7415f1a0 2024-09-10T22:40:53.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.445+0000 7f7a6e000640 1 -- 172.21.15.103:0/1344784360 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+17110 (secure 0 0 0) 0x7f7a7005e0b0 con 0x7f7a7415f1a0 2024-09-10T22:40:53.450 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:40:53.450 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":43,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:40:31.745213+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:39:52.660431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T22:39:53.935665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.4","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:40:53.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.445+0000 7f7a7c800640 1 -- 172.21.15.103:0/1344784360 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7a580725e0 msgr2=0x7f7a58074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:53.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.445+0000 7f7a7c800640 1 --2- 172.21.15.103:0/1344784360 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7a580725e0 0x7f7a58074aa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7a680af000 tx=0x7f7a6801b120 comp rx=0 tx=0).stop 2024-09-10T22:40:53.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.445+0000 7f7a7c800640 1 -- 172.21.15.103:0/1344784360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a7415f1a0 msgr2=0x7f7a74157570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:53.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.445+0000 7f7a7c800640 1 --2- 172.21.15.103:0/1344784360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a7415f1a0 0x7f7a74157570 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c7f0 tx=0x7f7a7000ccb0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.445+0000 7f7a7c800640 1 -- 172.21.15.103:0/1344784360 shutdown_connections 2024-09-10T22:40:53.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.449+0000 7f7a7c800640 1 --2- 172.21.15.103:0/1344784360 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7a580725e0 0x7f7a58074aa0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.449+0000 7f7a7c800640 1 --2- 172.21.15.103:0/1344784360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a7415f1a0 0x7f7a74157570 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.449+0000 7f7a7c800640 1 --2- 172.21.15.103:0/1344784360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a740cdd00 0x7f7a74157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.449+0000 7f7a7c800640 1 --2- 172.21.15.103:0/1344784360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a740cd500 0x7f7a74150ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.449+0000 7f7a7c800640 1 -- 172.21.15.103:0/1344784360 >> 172.21.15.103:0/1344784360 conn(0x7f7a740d1a20 msgr2=0x7f7a740ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:53.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.449+0000 7f7a7c800640 1 -- 172.21.15.103:0/1344784360 shutdown_connections 2024-09-10T22:40:53.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.449+0000 7f7a7c800640 1 -- 172.21.15.103:0/1344784360 wait complete. 2024-09-10T22:40:53.471 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T22:40:53.472 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:40:53.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.605+0000 7f48cc400640 1 -- 172.21.15.103:0/444704930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48c40b09c0 msgr2=0x7f48c40ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:53.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.605+0000 7f48cc400640 1 --2- 172.21.15.103:0/444704930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48c40b09c0 0x7f48c40ce600 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009900 tx=0x7f48b001c850 comp rx=0 tx=0).stop 2024-09-10T22:40:53.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.605+0000 7f48cc400640 1 -- 172.21.15.103:0/444704930 shutdown_connections 2024-09-10T22:40:53.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.605+0000 7f48cc400640 1 --2- 172.21.15.103:0/444704930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48c40b09c0 0x7f48c40ce600 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.605+0000 7f48cc400640 1 --2- 172.21.15.103:0/444704930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48c415be30 0x7f48c40ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.605+0000 7f48cc400640 1 -- 172.21.15.103:0/444704930 >> 172.21.15.103:0/444704930 conn(0x7f48c40d1ac0 msgr2=0x7f48c40d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:53.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.605+0000 7f48cc400640 1 -- 172.21.15.103:0/444704930 shutdown_connections 2024-09-10T22:40:53.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.605+0000 7f48cc400640 1 -- 172.21.15.103:0/444704930 wait complete. 2024-09-10T22:40:53.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48cc400640 1 Processor -- start 2024-09-10T22:40:53.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48cc400640 1 -- start start 2024-09-10T22:40:53.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48cc400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48c40b09c0 0x7f48c414e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:53.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48cc400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48c40ceb40 0x7f48c40c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:53.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48cc400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48c415be30 0x7f48c40b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:53.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48cc400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f48c4169160 con 0x7f48c40ceb40 2024-09-10T22:40:53.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48cc400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f48c4168fe0 con 0x7f48c40b09c0 2024-09-10T22:40:53.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48cc400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f48c41692e0 con 0x7f48c415be30 2024-09-10T22:40:53.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48c9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48c40ceb40 0x7f48c40c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:53.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48c9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48c40ceb40 0x7f48c40c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44412/0 (socket says 172.21.15.103:44412) 2024-09-10T22:40:53.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48c9000640 1 -- 172.21.15.103:0/865777489 learned_addr learned my addr 172.21.15.103:0/865777489 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:53.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48ca400640 1 --2- 172.21.15.103:0/865777489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48c415be30 0x7f48c40b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:53.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48c9a00640 1 --2- 172.21.15.103:0/865777489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48c40b09c0 0x7f48c414e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:53.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48c9000640 1 -- 172.21.15.103:0/865777489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48c415be30 msgr2=0x7f48c40b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:53.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48c9000640 1 --2- 172.21.15.103:0/865777489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48c415be30 0x7f48c40b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48c9000640 1 -- 172.21.15.103:0/865777489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48c40b09c0 msgr2=0x7f48c414e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:53.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48c9000640 1 --2- 172.21.15.103:0/865777489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48c40b09c0 0x7f48c414e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48c9000640 1 -- 172.21.15.103:0/865777489 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c41561e0 con 0x7f48c40ceb40 2024-09-10T22:40:53.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48ca400640 1 --2- 172.21.15.103:0/865777489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48c415be30 0x7f48c40b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:40:53.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48c9a00640 1 --2- 172.21.15.103:0/865777489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48c40b09c0 0x7f48c414e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:40:53.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48c9000640 1 --2- 172.21.15.103:0/865777489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48c40ceb40 0x7f48c40c6cb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009850 tx=0x7f48b00a5590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:53.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48c1600640 1 -- 172.21.15.103:0/865777489 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b00b2040 con 0x7f48c40ceb40 2024-09-10T22:40:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48c1600640 1 -- 172.21.15.103:0/865777489 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48b0004470 con 0x7f48c40ceb40 2024-09-10T22:40:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48cc400640 1 -- 172.21.15.103:0/865777489 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48c40caf10 con 0x7f48c40ceb40 2024-09-10T22:40:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48c1600640 1 -- 172.21.15.103:0/865777489 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b00052d0 con 0x7f48c40ceb40 2024-09-10T22:40:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.609+0000 7f48cc400640 1 -- 172.21.15.103:0/865777489 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48c40cb4d0 con 0x7f48c40ceb40 2024-09-10T22:40:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.613+0000 7f48cc400640 1 -- 172.21.15.103:0/865777489 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48c40c90f0 con 0x7f48c40ceb40 2024-09-10T22:40:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.613+0000 7f48c1600640 1 -- 172.21.15.103:0/865777489 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f48b0005470 con 0x7f48c40ceb40 2024-09-10T22:40:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.613+0000 7f48c1600640 1 --2- 172.21.15.103:0/865777489 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f48a40725e0 0x7f48a4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.613+0000 7f48c1600640 1 -- 172.21.15.103:0/865777489 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f48b012cbf0 con 0x7f48c40ceb40 2024-09-10T22:40:53.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.613+0000 7f48c9a00640 1 --2- 172.21.15.103:0/865777489 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f48a40725e0 0x7f48a4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:53.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.613+0000 7f48c9a00640 1 --2- 172.21.15.103:0/865777489 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f48a40725e0 0x7f48a4074aa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f48b800bbd0 tx=0x7f48b800b5b0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:53.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.617+0000 7f48c1600640 1 -- 172.21.15.103:0/865777489 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f48c40c90f0 con 0x7f48c40ceb40 2024-09-10T22:40:53.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.817+0000 7f48cc400640 1 -- 172.21.15.103:0/865777489 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48c40cf9c0 con 0x7f48c40ceb40 2024-09-10T22:40:53.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.817+0000 7f48c1600640 1 -- 172.21.15.103:0/865777489 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5279 (secure 0 0 0) 0x7f48b00164d0 con 0x7f48c40ceb40 2024-09-10T22:40:53.824 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:40:53.824 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":27,"btime":"2024-09-10T22:40:22:706925+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/3313045987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3313045987},{"type":"v1","addr":"172.21.15.131:6836","nonce":3313045987}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:39:54.979240+0000","modified":"2024-09-10T22:40:22.473358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4941,"mds_1":4920,"mds_2":4754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4754":{"gid":4754,"name":"d","rank":2,"incarnation":23,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6837/1068577002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1068577002},{"type":"v1","addr":"172.21.15.131:6837","nonce":1068577002}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4920":{"gid":4920,"name":"a","rank":1,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.103:6833/4043692269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4043692269},{"type":"v1","addr":"172.21.15.103:6833","nonce":4043692269}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4941":{"gid":4941,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/1194009116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1194009116},{"type":"v1","addr":"172.21.15.103:6835","nonce":1194009116}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4941,"qdb_cluster":[4941,4920,4754]},"id":2}]} 2024-09-10T22:40:53.825 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 27 2024-09-10T22:40:53.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.821+0000 7f48cc400640 1 -- 172.21.15.103:0/865777489 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f48a40725e0 msgr2=0x7f48a4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:53.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.821+0000 7f48cc400640 1 --2- 172.21.15.103:0/865777489 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f48a40725e0 0x7f48a4074aa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f48b800bbd0 tx=0x7f48b800b5b0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.821+0000 7f48cc400640 1 -- 172.21.15.103:0/865777489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48c40ceb40 msgr2=0x7f48c40c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:53.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.821+0000 7f48cc400640 1 --2- 172.21.15.103:0/865777489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48c40ceb40 0x7f48c40c6cb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009850 tx=0x7f48b00a5590 comp rx=0 tx=0).stop 2024-09-10T22:40:53.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.821+0000 7f48cc400640 1 -- 172.21.15.103:0/865777489 shutdown_connections 2024-09-10T22:40:53.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.821+0000 7f48cc400640 1 --2- 172.21.15.103:0/865777489 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f48a40725e0 0x7f48a4074aa0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.821+0000 7f48cc400640 1 --2- 172.21.15.103:0/865777489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48c415be30 0x7f48c40b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.821+0000 7f48cc400640 1 --2- 172.21.15.103:0/865777489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48c40ceb40 0x7f48c40c6cb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.821+0000 7f48cc400640 1 --2- 172.21.15.103:0/865777489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48c40b09c0 0x7f48c414e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.821+0000 7f48cc400640 1 -- 172.21.15.103:0/865777489 >> 172.21.15.103:0/865777489 conn(0x7f48c40d1ac0 msgr2=0x7f48c40d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:53.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.821+0000 7f48cc400640 1 -- 172.21.15.103:0/865777489 shutdown_connections 2024-09-10T22:40:53.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.821+0000 7f48cc400640 1 -- 172.21.15.103:0/865777489 wait complete. 2024-09-10T22:40:53.845 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:40:53.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.981+0000 7fa6e6c00640 1 -- 172.21.15.103:0/4039550745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c4003c40 msgr2=0x7fa6c4004040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:53.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.981+0000 7fa6e6c00640 1 --2- 172.21.15.103:0/4039550745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c4003c40 0x7fa6c4004040 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0006fc0 tx=0x7fa6d001cf20 comp rx=0 tx=0).stop 2024-09-10T22:40:53.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.981+0000 7fa6e6c00640 1 -- 172.21.15.103:0/4039550745 shutdown_connections 2024-09-10T22:40:53.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.981+0000 7fa6e6c00640 1 --2- 172.21.15.103:0/4039550745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c4003c40 0x7fa6c4004040 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.981+0000 7fa6e6c00640 1 -- 172.21.15.103:0/4039550745 >> 172.21.15.103:0/4039550745 conn(0x7fa6e00d1ac0 msgr2=0x7fa6e00d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:53.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.981+0000 7fa6e6c00640 1 -- 172.21.15.103:0/4039550745 shutdown_connections 2024-09-10T22:40:53.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.981+0000 7fa6e6c00640 1 -- 172.21.15.103:0/4039550745 wait complete. 2024-09-10T22:40:53.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6e6c00640 1 Processor -- start 2024-09-10T22:40:53.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6e6c00640 1 -- start start 2024-09-10T22:40:53.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6e6c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c4003c40 0x7fa6e0154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:53.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6e6c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6e015c500 0x7fa6e00afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:53.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6e6c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6e015c980 0x7fa6e00b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:53.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6e6c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e00b2a90 con 0x7fa6c4003c40 2024-09-10T22:40:53.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6e6c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e00b2910 con 0x7fa6e015c500 2024-09-10T22:40:53.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6e6c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa6e00b2c10 con 0x7fa6e015c980 2024-09-10T22:40:53.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6dfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c4003c40 0x7fa6e0154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:53.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6dfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c4003c40 0x7fa6e0154b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44432/0 (socket says 172.21.15.103:44432) 2024-09-10T22:40:53.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6dfe00640 1 -- 172.21.15.103:0/2430194808 learned_addr learned my addr 172.21.15.103:0/2430194808 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:53.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6e4c00640 1 --2- 172.21.15.103:0/2430194808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6e015c980 0x7fa6e00b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:53.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6d7400640 1 --2- 172.21.15.103:0/2430194808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6e015c500 0x7fa6e00afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:53.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6dfe00640 1 -- 172.21.15.103:0/2430194808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6e015c980 msgr2=0x7fa6e00b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:53.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6dfe00640 1 --2- 172.21.15.103:0/2430194808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6e015c980 0x7fa6e00b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6dfe00640 1 -- 172.21.15.103:0/2430194808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6e015c500 msgr2=0x7fa6e00afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:53.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6dfe00640 1 --2- 172.21.15.103:0/2430194808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6e015c500 0x7fa6e00afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:53.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6dfe00640 1 -- 172.21.15.103:0/2430194808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e015d4f0 con 0x7fa6c4003c40 2024-09-10T22:40:53.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6dfe00640 1 --2- 172.21.15.103:0/2430194808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c4003c40 0x7fa6e0154b30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa6d001d400 tx=0x7fa6d0001cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:53.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6dcc00640 1 -- 172.21.15.103:0/2430194808 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0003600 con 0x7fa6c4003c40 2024-09-10T22:40:53.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6dcc00640 1 -- 172.21.15.103:0/2430194808 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6d00037a0 con 0x7fa6c4003c40 2024-09-10T22:40:53.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6dcc00640 1 -- 172.21.15.103:0/2430194808 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0003b50 con 0x7fa6c4003c40 2024-09-10T22:40:53.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6e6c00640 1 -- 172.21.15.103:0/2430194808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e015cf30 con 0x7fa6c4003c40 2024-09-10T22:40:53.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.985+0000 7fa6e6c00640 1 -- 172.21.15.103:0/2430194808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e00b56a0 con 0x7fa6c4003c40 2024-09-10T22:40:53.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.989+0000 7fa6e6c00640 1 -- 172.21.15.103:0/2430194808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e00cfcb0 con 0x7fa6c4003c40 2024-09-10T22:40:53.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.989+0000 7fa6dcc00640 1 -- 172.21.15.103:0/2430194808 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa6d00ad430 con 0x7fa6c4003c40 2024-09-10T22:40:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.989+0000 7fa6dcc00640 1 --2- 172.21.15.103:0/2430194808 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6bc072610 0x7fa6bc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.989+0000 7fa6dcc00640 1 -- 172.21.15.103:0/2430194808 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fa6d012d8c0 con 0x7fa6c4003c40 2024-09-10T22:40:53.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.989+0000 7fa6d7400640 1 --2- 172.21.15.103:0/2430194808 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6bc072610 0x7fa6bc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:53.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.989+0000 7fa6d7400640 1 --2- 172.21.15.103:0/2430194808 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6bc072610 0x7fa6bc074ad0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa6e01fbad0 tx=0x7fa6c80091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:53.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:53.993+0000 7fa6dcc00640 1 -- 172.21.15.103:0/2430194808 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa6d00c0030 con 0x7fa6c4003c40 2024-09-10T22:40:54.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.193+0000 7fa6e6c00640 1 -- 172.21.15.103:0/2430194808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6e01ed4c0 con 0x7fa6c4003c40 2024-09-10T22:40:54.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.193+0000 7fa6dcc00640 1 -- 172.21.15.103:0/2430194808 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5279 (secure 0 0 0) 0x7fa6d0016cd0 con 0x7fa6c4003c40 2024-09-10T22:40:54.198 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:40:54.199 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":27,"btime":"2024-09-10T22:40:22:706925+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/3313045987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3313045987},{"type":"v1","addr":"172.21.15.131:6836","nonce":3313045987}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:39:54.979240+0000","modified":"2024-09-10T22:40:22.473358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4941,"mds_1":4920,"mds_2":4754},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4754":{"gid":4754,"name":"d","rank":2,"incarnation":23,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6837/1068577002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1068577002},{"type":"v1","addr":"172.21.15.131:6837","nonce":1068577002}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4920":{"gid":4920,"name":"a","rank":1,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.103:6833/4043692269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4043692269},{"type":"v1","addr":"172.21.15.103:6833","nonce":4043692269}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4941":{"gid":4941,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/1194009116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1194009116},{"type":"v1","addr":"172.21.15.103:6835","nonce":1194009116}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4941,"qdb_cluster":[4941,4920,4754]},"id":2}]} 2024-09-10T22:40:54.199 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 27 2024-09-10T22:40:54.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.193+0000 7fa6e6c00640 1 -- 172.21.15.103:0/2430194808 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6bc072610 msgr2=0x7fa6bc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:54.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.193+0000 7fa6e6c00640 1 --2- 172.21.15.103:0/2430194808 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6bc072610 0x7fa6bc074ad0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa6e01fbad0 tx=0x7fa6c80091e0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.193+0000 7fa6e6c00640 1 -- 172.21.15.103:0/2430194808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c4003c40 msgr2=0x7fa6e0154b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:54.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.193+0000 7fa6e6c00640 1 --2- 172.21.15.103:0/2430194808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c4003c40 0x7fa6e0154b30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa6d001d400 tx=0x7fa6d0001cf0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.197+0000 7fa6e6c00640 1 -- 172.21.15.103:0/2430194808 shutdown_connections 2024-09-10T22:40:54.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.197+0000 7fa6e6c00640 1 --2- 172.21.15.103:0/2430194808 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6bc072610 0x7fa6bc074ad0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.197+0000 7fa6e6c00640 1 --2- 172.21.15.103:0/2430194808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6e015c980 0x7fa6e00b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.197+0000 7fa6e6c00640 1 --2- 172.21.15.103:0/2430194808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6e015c500 0x7fa6e00afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.197+0000 7fa6e6c00640 1 --2- 172.21.15.103:0/2430194808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c4003c40 0x7fa6e0154b30 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.197+0000 7fa6e6c00640 1 -- 172.21.15.103:0/2430194808 >> 172.21.15.103:0/2430194808 conn(0x7fa6e00d1ac0 msgr2=0x7fa6e00b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:54.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.197+0000 7fa6e6c00640 1 -- 172.21.15.103:0/2430194808 shutdown_connections 2024-09-10T22:40:54.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.197+0000 7fa6e6c00640 1 -- 172.21.15.103:0/2430194808 wait complete. 2024-09-10T22:40:54.219 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:40:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.357+0000 7ffb8da00640 1 -- 172.21.15.103:0/2703725425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb6c0051d0 msgr2=0x7ffb6c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.357+0000 7ffb8da00640 1 --2- 172.21.15.103:0/2703725425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb6c0051d0 0x7ffb6c00b9d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ffb80006fa0 tx=0x7ffb8001f660 comp rx=0 tx=0).stop 2024-09-10T22:40:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.357+0000 7ffb8da00640 1 -- 172.21.15.103:0/2703725425 shutdown_connections 2024-09-10T22:40:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.357+0000 7ffb8da00640 1 --2- 172.21.15.103:0/2703725425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb6c0051d0 0x7ffb6c00b9d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.357+0000 7ffb8da00640 1 -- 172.21.15.103:0/2703725425 >> 172.21.15.103:0/2703725425 conn(0x7ffb880d0940 msgr2=0x7ffb880d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.357+0000 7ffb8da00640 1 -- 172.21.15.103:0/2703725425 shutdown_connections 2024-09-10T22:40:54.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.357+0000 7ffb8da00640 1 -- 172.21.15.103:0/2703725425 wait complete. 2024-09-10T22:40:54.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.357+0000 7ffb8da00640 1 Processor -- start 2024-09-10T22:40:54.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.357+0000 7ffb8da00640 1 -- start start 2024-09-10T22:40:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb8da00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb6c0051d0 0x7ffb88152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb8da00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb88158f60 0x7ffb881f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb8da00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb881e4b20 0x7ffb881e4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb8da00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffb88070ca0 con 0x7ffb881e4b20 2024-09-10T22:40:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb8da00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ffb88070b20 con 0x7ffb88158f60 2024-09-10T22:40:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb8da00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ffb88070e20 con 0x7ffb6c0051d0 2024-09-10T22:40:54.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb87400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb881e4b20 0x7ffb881e4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:54.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb87400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb881e4b20 0x7ffb881e4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44438/0 (socket says 172.21.15.103:44438) 2024-09-10T22:40:54.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb87400640 1 -- 172.21.15.103:0/4165155786 learned_addr learned my addr 172.21.15.103:0/4165155786 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:54.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb7e000640 1 --2- 172.21.15.103:0/4165155786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb88158f60 0x7ffb881f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:54.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb86a00640 1 --2- 172.21.15.103:0/4165155786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb6c0051d0 0x7ffb88152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:54.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb87400640 1 -- 172.21.15.103:0/4165155786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb6c0051d0 msgr2=0x7ffb88152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:54.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb87400640 1 --2- 172.21.15.103:0/4165155786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb6c0051d0 0x7ffb88152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb87400640 1 -- 172.21.15.103:0/4165155786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb88158f60 msgr2=0x7ffb881f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:54.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb87400640 1 --2- 172.21.15.103:0/4165155786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb88158f60 0x7ffb881f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb87400640 1 -- 172.21.15.103:0/4165155786 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb881f2660 con 0x7ffb881e4b20 2024-09-10T22:40:54.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb7e000640 1 --2- 172.21.15.103:0/4165155786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb88158f60 0x7ffb881f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:40:54.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb87400640 1 --2- 172.21.15.103:0/4165155786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb881e4b20 0x7ffb881e4fd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ffb8001ff00 tx=0x7ffb80006bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:54.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb7f400640 1 -- 172.21.15.103:0/4165155786 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb80006460 con 0x7ffb881e4b20 2024-09-10T22:40:54.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb7f400640 1 -- 172.21.15.103:0/4165155786 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb80003600 con 0x7ffb881e4b20 2024-09-10T22:40:54.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb7f400640 1 -- 172.21.15.103:0/4165155786 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb80003a30 con 0x7ffb881e4b20 2024-09-10T22:40:54.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb8da00640 1 -- 172.21.15.103:0/4165155786 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb881e3cd0 con 0x7ffb881e4b20 2024-09-10T22:40:54.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb8da00640 1 -- 172.21.15.103:0/4165155786 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb881f2be0 con 0x7ffb881e4b20 2024-09-10T22:40:54.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb8da00640 1 -- 172.21.15.103:0/4165155786 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb88071310 con 0x7ffb881e4b20 2024-09-10T22:40:54.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.361+0000 7ffb7f400640 1 -- 172.21.15.103:0/4165155786 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ffb80003bd0 con 0x7ffb881e4b20 2024-09-10T22:40:54.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.365+0000 7ffb7f400640 1 --2- 172.21.15.103:0/4165155786 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffb64072610 0x7ffb64074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:54.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.365+0000 7ffb7f400640 1 -- 172.21.15.103:0/4165155786 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7ffb80130a30 con 0x7ffb881e4b20 2024-09-10T22:40:54.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.365+0000 7ffb86a00640 1 --2- 172.21.15.103:0/4165155786 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffb64072610 0x7ffb64074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:54.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.365+0000 7ffb86a00640 1 --2- 172.21.15.103:0/4165155786 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffb64072610 0x7ffb64074ad0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffb881e4350 tx=0x7ffb78009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:54.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.369+0000 7ffb7f400640 1 -- 172.21.15.103:0/4165155786 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ffb80019410 con 0x7ffb881e4b20 2024-09-10T22:40:54.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.533+0000 7ffb8da00640 1 -- 172.21.15.103:0/4165155786 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb88074680 con 0x7ffb881e4b20 2024-09-10T22:40:54.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.537+0000 7ffb7f400640 1 -- 172.21.15.103:0/4165155786 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+17110 (secure 0 0 0) 0x7ffb800fbec0 con 0x7ffb881e4b20 2024-09-10T22:40:54.541 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:40:54.541 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":43,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:40:31.745213+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:39:52.660431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T22:39:53.935665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.4","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:40:54.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.537+0000 7ffb8da00640 1 -- 172.21.15.103:0/4165155786 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffb64072610 msgr2=0x7ffb64074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:54.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.537+0000 7ffb8da00640 1 --2- 172.21.15.103:0/4165155786 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffb64072610 0x7ffb64074ad0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffb881e4350 tx=0x7ffb78009500 comp rx=0 tx=0).stop 2024-09-10T22:40:54.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.537+0000 7ffb8da00640 1 -- 172.21.15.103:0/4165155786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb881e4b20 msgr2=0x7ffb881e4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:54.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.537+0000 7ffb8da00640 1 --2- 172.21.15.103:0/4165155786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb881e4b20 0x7ffb881e4fd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ffb8001ff00 tx=0x7ffb80006bc0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.537+0000 7ffb8da00640 1 -- 172.21.15.103:0/4165155786 shutdown_connections 2024-09-10T22:40:54.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.537+0000 7ffb8da00640 1 --2- 172.21.15.103:0/4165155786 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffb64072610 0x7ffb64074ad0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.537+0000 7ffb8da00640 1 --2- 172.21.15.103:0/4165155786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb881e4b20 0x7ffb881e4fd0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.537+0000 7ffb8da00640 1 --2- 172.21.15.103:0/4165155786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb88158f60 0x7ffb881f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.537+0000 7ffb8da00640 1 --2- 172.21.15.103:0/4165155786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb6c0051d0 0x7ffb88152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.537+0000 7ffb8da00640 1 -- 172.21.15.103:0/4165155786 >> 172.21.15.103:0/4165155786 conn(0x7ffb880d0940 msgr2=0x7ffb880b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:54.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.537+0000 7ffb8da00640 1 -- 172.21.15.103:0/4165155786 shutdown_connections 2024-09-10T22:40:54.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.537+0000 7ffb8da00640 1 -- 172.21.15.103:0/4165155786 wait complete. 2024-09-10T22:40:54.562 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T22:40:54.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb4200640 1 -- 172.21.15.103:0/2163179542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c94003c90 msgr2=0x7f9c94004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:54.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb4200640 1 --2- 172.21.15.103:0/2163179542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c94003c90 0x7f9c94004090 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009d30 tx=0x7f9ca001d410 comp rx=0 tx=0).stop 2024-09-10T22:40:54.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb4200640 1 -- 172.21.15.103:0/2163179542 shutdown_connections 2024-09-10T22:40:54.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb4200640 1 --2- 172.21.15.103:0/2163179542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c94003c90 0x7f9c94004090 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb4200640 1 -- 172.21.15.103:0/2163179542 >> 172.21.15.103:0/2163179542 conn(0x7f9cac0d1a20 msgr2=0x7f9cac0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:54.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb4200640 1 -- 172.21.15.103:0/2163179542 shutdown_connections 2024-09-10T22:40:54.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb4200640 1 -- 172.21.15.103:0/2163179542 wait complete. 2024-09-10T22:40:54.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb4200640 1 Processor -- start 2024-09-10T22:40:54.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb4200640 1 -- start start 2024-09-10T22:40:54.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb4200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c94003c90 0x7f9cac0b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:54.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb4200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cac154210 0x7f9cac14bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:54.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb4200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cac153cc0 0x7f9cac1fb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb4200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9cac06e520 con 0x7f9cac153cc0 2024-09-10T22:40:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb4200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9cac0b1f40 con 0x7f9c94003c90 2024-09-10T22:40:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb4200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9cac06e6a0 con 0x7f9cac154210 2024-09-10T22:40:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb2200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cac153cc0 0x7f9cac1fb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb2200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cac153cc0 0x7f9cac1fb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44462/0 (socket says 172.21.15.103:44462) 2024-09-10T22:40:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb2200640 1 -- 172.21.15.103:0/2620230494 learned_addr learned my addr 172.21.15.103:0/2620230494 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb1800640 1 --2- 172.21.15.103:0/2620230494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c94003c90 0x7f9cac0b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.701+0000 7f9cb0e00640 1 --2- 172.21.15.103:0/2620230494 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cac154210 0x7f9cac14bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.705+0000 7f9cb2200640 1 -- 172.21.15.103:0/2620230494 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cac154210 msgr2=0x7f9cac14bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.705+0000 7f9cb2200640 1 --2- 172.21.15.103:0/2620230494 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cac154210 0x7f9cac14bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.705+0000 7f9cb2200640 1 -- 172.21.15.103:0/2620230494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c94003c90 msgr2=0x7f9cac0b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.705+0000 7f9cb2200640 1 --2- 172.21.15.103:0/2620230494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c94003c90 0x7f9cac0b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.705+0000 7f9cb2200640 1 -- 172.21.15.103:0/2620230494 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cac0b5570 con 0x7f9cac153cc0 2024-09-10T22:40:54.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.705+0000 7f9cb2200640 1 --2- 172.21.15.103:0/2620230494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cac153cc0 0x7f9cac1fb3b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9cac073410 tx=0x7f9ca4001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:54.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.705+0000 7f9ca9600640 1 -- 172.21.15.103:0/2620230494 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4011870 con 0x7f9cac153cc0 2024-09-10T22:40:54.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.705+0000 7f9ca9600640 1 -- 172.21.15.103:0/2620230494 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ca4017070 con 0x7f9cac153cc0 2024-09-10T22:40:54.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.705+0000 7f9ca9600640 1 -- 172.21.15.103:0/2620230494 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4011dc0 con 0x7f9cac153cc0 2024-09-10T22:40:54.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.705+0000 7f9cb4200640 1 -- 172.21.15.103:0/2620230494 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cac1fbf80 con 0x7f9cac153cc0 2024-09-10T22:40:54.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.705+0000 7f9cb4200640 1 -- 172.21.15.103:0/2620230494 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cac1fc260 con 0x7f9cac153cc0 2024-09-10T22:40:54.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.705+0000 7f9cb4200640 1 -- 172.21.15.103:0/2620230494 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cac1619c0 con 0x7f9cac153cc0 2024-09-10T22:40:54.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.705+0000 7f9ca9600640 1 -- 172.21.15.103:0/2620230494 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9ca401c460 con 0x7f9cac153cc0 2024-09-10T22:40:54.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.705+0000 7f9ca9600640 1 --2- 172.21.15.103:0/2620230494 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9c8c072610 0x7f9c8c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:54.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.705+0000 7f9ca9600640 1 -- 172.21.15.103:0/2620230494 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f9ca4093cf0 con 0x7f9cac153cc0 2024-09-10T22:40:54.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.709+0000 7f9cb1800640 1 --2- 172.21.15.103:0/2620230494 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9c8c072610 0x7f9c8c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:54.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.709+0000 7f9cb1800640 1 --2- 172.21.15.103:0/2620230494 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9c8c072610 0x7f9c8c074ad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9ca00ad000 tx=0x7f9ca001a1b0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:54.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.709+0000 7f9ca9600640 1 -- 172.21.15.103:0/2620230494 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9ca405f210 con 0x7f9cac153cc0 2024-09-10T22:40:54.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.909+0000 7f9cb4200640 1 -- 172.21.15.103:0/2620230494 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9cac0af010 con 0x7f9cac153cc0 2024-09-10T22:40:54.915 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-10T22:40:54.909+0000 7fb5aba00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:40:54.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.913+0000 7f9ca9600640 1 -- 172.21.15.103:0/2620230494 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) ==== 161+0+0 (secure 0 0 0) 0x7f9ca405eb10 con 0x7f9cac153cc0 2024-09-10T22:40:54.917 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T22:40:54.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.917+0000 7f9cb4200640 1 -- 172.21.15.103:0/2620230494 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9c8c072610 msgr2=0x7f9c8c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:54.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.917+0000 7f9cb4200640 1 --2- 172.21.15.103:0/2620230494 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9c8c072610 0x7f9c8c074ad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9ca00ad000 tx=0x7f9ca001a1b0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.917+0000 7f9cb4200640 1 -- 172.21.15.103:0/2620230494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cac153cc0 msgr2=0x7f9cac1fb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:54.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.917+0000 7f9cb4200640 1 --2- 172.21.15.103:0/2620230494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cac153cc0 0x7f9cac1fb3b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9cac073410 tx=0x7f9ca4001b90 comp rx=0 tx=0).stop 2024-09-10T22:40:54.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.917+0000 7f9cb4200640 1 -- 172.21.15.103:0/2620230494 shutdown_connections 2024-09-10T22:40:54.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.917+0000 7f9cb4200640 1 --2- 172.21.15.103:0/2620230494 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9c8c072610 0x7f9c8c074ad0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.917+0000 7f9cb4200640 1 --2- 172.21.15.103:0/2620230494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cac153cc0 0x7f9cac1fb3b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.917+0000 7f9cb4200640 1 --2- 172.21.15.103:0/2620230494 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cac154210 0x7f9cac14bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.917+0000 7f9cb4200640 1 --2- 172.21.15.103:0/2620230494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c94003c90 0x7f9cac0b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:54.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.917+0000 7f9cb4200640 1 -- 172.21.15.103:0/2620230494 >> 172.21.15.103:0/2620230494 conn(0x7f9cac0d1a20 msgr2=0x7f9cac0b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:54.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.917+0000 7f9cb4200640 1 -- 172.21.15.103:0/2620230494 shutdown_connections 2024-09-10T22:40:54.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:54.917+0000 7f9cb4200640 1 -- 172.21.15.103:0/2620230494 wait complete. 2024-09-10T22:40:54.944 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T22:40:54.978 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2024-09-10T22:40:54.985 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-09-10T22:40:54.987 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-09-10T22:40:55.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.089+0000 7f1b61800640 1 -- 172.21.15.103:0/3099880441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c15c970 msgr2=0x7f1b5c072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:55.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.089+0000 7f1b61800640 1 --2- 172.21.15.103:0/3099880441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c15c970 0x7f1b5c072e30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c0b4ee0 tx=0x7f1b4801c810 comp rx=0 tx=0).stop 2024-09-10T22:40:55.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.089+0000 7f1b61800640 1 -- 172.21.15.103:0/3099880441 shutdown_connections 2024-09-10T22:40:55.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.089+0000 7f1b61800640 1 --2- 172.21.15.103:0/3099880441 >> v2:172.21.15.131:3300/0 conn(0x7f1b5c0cf790 0x7f1b5c0cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:55.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.089+0000 7f1b61800640 1 --2- 172.21.15.103:0/3099880441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c15c970 0x7f1b5c072e30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:55.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.089+0000 7f1b61800640 1 --2- 172.21.15.103:0/3099880441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b5c0cc120 0x7f1b5c0aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:55.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.089+0000 7f1b61800640 1 -- 172.21.15.103:0/3099880441 >> 172.21.15.103:0/3099880441 conn(0x7f1b5c06cc00 msgr2=0x7f1b5c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:55.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.089+0000 7f1b61800640 1 -- 172.21.15.103:0/3099880441 shutdown_connections 2024-09-10T22:40:55.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.089+0000 7f1b61800640 1 -- 172.21.15.103:0/3099880441 wait complete. 2024-09-10T22:40:55.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.089+0000 7f1b61800640 1 Processor -- start 2024-09-10T22:40:55.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.089+0000 7f1b61800640 1 -- start start 2024-09-10T22:40:55.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b61800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b5c0cc120 0x7f1b5c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:55.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b61800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0cf790 0x7f1b5c1f7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:55.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b61800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b5c15c970 0x7f1b5c1f7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:55.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b61800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5c15f930 con 0x7f1b5c0cf790 2024-09-10T22:40:55.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b61800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5c15f7b0 con 0x7f1b5c0cc120 2024-09-10T22:40:55.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b61800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1b5c15fab0 con 0x7f1b5c15c970 2024-09-10T22:40:55.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b5a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0cf790 0x7f1b5c1f7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:55.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b5a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0cf790 0x7f1b5c1f7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44524/0 (socket says 172.21.15.103:44524) 2024-09-10T22:40:55.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b5a000640 1 -- 172.21.15.103:0/1738199421 learned_addr learned my addr 172.21.15.103:0/1738199421 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:55.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b5aa00640 1 --2- 172.21.15.103:0/1738199421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b5c0cc120 0x7f1b5c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:55.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b5b400640 1 --2- 172.21.15.103:0/1738199421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b5c15c970 0x7f1b5c1f7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:55.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b5a000640 1 -- 172.21.15.103:0/1738199421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b5c15c970 msgr2=0x7f1b5c1f7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:55.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b5a000640 1 --2- 172.21.15.103:0/1738199421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b5c15c970 0x7f1b5c1f7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:55.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b5a000640 1 -- 172.21.15.103:0/1738199421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b5c0cc120 msgr2=0x7f1b5c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:55.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b5a000640 1 --2- 172.21.15.103:0/1738199421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b5c0cc120 0x7f1b5c0afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:55.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b5a000640 1 -- 172.21.15.103:0/1738199421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5c0b04f0 con 0x7f1b5c0cf790 2024-09-10T22:40:55.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b5a000640 1 --2- 172.21.15.103:0/1738199421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0cf790 0x7f1b5c1f7350 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1b480b0040 tx=0x7f1b480a55a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:55.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b52a00640 1 -- 172.21.15.103:0/1738199421 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b480b2040 con 0x7f1b5c0cf790 2024-09-10T22:40:55.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b52a00640 1 -- 172.21.15.103:0/1738199421 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b48004470 con 0x7f1b5c0cf790 2024-09-10T22:40:55.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b61800640 1 -- 172.21.15.103:0/1738199421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b5c0b07d0 con 0x7f1b5c0cf790 2024-09-10T22:40:55.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b52a00640 1 -- 172.21.15.103:0/1738199421 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b480052b0 con 0x7f1b5c0cf790 2024-09-10T22:40:55.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b61800640 1 -- 172.21.15.103:0/1738199421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b5c0b1010 con 0x7f1b5c0cf790 2024-09-10T22:40:55.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.093+0000 7f1b61800640 1 -- 172.21.15.103:0/1738199421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b5c160010 con 0x7f1b5c0cf790 2024-09-10T22:40:55.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.097+0000 7f1b52a00640 1 -- 172.21.15.103:0/1738199421 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1b48005450 con 0x7f1b5c0cf790 2024-09-10T22:40:55.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.097+0000 7f1b52a00640 1 --2- 172.21.15.103:0/1738199421 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1b3c072610 0x7f1b3c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:55.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.097+0000 7f1b52a00640 1 -- 172.21.15.103:0/1738199421 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6388+0+0 (secure 0 0 0) 0x7f1b4812ca40 con 0x7f1b5c0cf790 2024-09-10T22:40:55.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.097+0000 7f1b5aa00640 1 --2- 172.21.15.103:0/1738199421 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1b3c072610 0x7f1b3c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:55.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.097+0000 7f1b5aa00640 1 --2- 172.21.15.103:0/1738199421 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1b3c072610 0x7f1b3c074ad0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c0b0fa0 tx=0x7f1b4c00b2e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:55.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.101+0000 7f1b52a00640 1 -- 172.21.15.103:0/1738199421 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1b48016490 con 0x7f1b5c0cf790 2024-09-10T22:40:55.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.301+0000 7f1b61800640 1 -- 172.21.15.103:0/1738199421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1b5c0aeac0 con 0x7f1b5c0cf790 2024-09-10T22:40:55.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.917+0000 7f1b52a00640 1 -- 172.21.15.103:0/1738199421 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7f1b480f78b0 con 0x7f1b5c0cf790 2024-09-10T22:40:55.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.921+0000 7f1b61800640 1 -- 172.21.15.103:0/1738199421 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1b3c072610 msgr2=0x7f1b3c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:55.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.921+0000 7f1b61800640 1 --2- 172.21.15.103:0/1738199421 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1b3c072610 0x7f1b3c074ad0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c0b0fa0 tx=0x7f1b4c00b2e0 comp rx=0 tx=0).stop 2024-09-10T22:40:55.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.921+0000 7f1b61800640 1 -- 172.21.15.103:0/1738199421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0cf790 msgr2=0x7f1b5c1f7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:55.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.921+0000 7f1b61800640 1 --2- 172.21.15.103:0/1738199421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0cf790 0x7f1b5c1f7350 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1b480b0040 tx=0x7f1b480a55a0 comp rx=0 tx=0).stop 2024-09-10T22:40:55.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.921+0000 7f1b61800640 1 -- 172.21.15.103:0/1738199421 shutdown_connections 2024-09-10T22:40:55.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.921+0000 7f1b61800640 1 --2- 172.21.15.103:0/1738199421 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1b3c072610 0x7f1b3c074ad0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:55.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.921+0000 7f1b61800640 1 --2- 172.21.15.103:0/1738199421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b5c15c970 0x7f1b5c1f7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:55.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.921+0000 7f1b61800640 1 --2- 172.21.15.103:0/1738199421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0cf790 0x7f1b5c1f7350 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:55.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.921+0000 7f1b61800640 1 --2- 172.21.15.103:0/1738199421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b5c0cc120 0x7f1b5c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:55.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.921+0000 7f1b61800640 1 -- 172.21.15.103:0/1738199421 >> 172.21.15.103:0/1738199421 conn(0x7f1b5c06cc00 msgr2=0x7f1b5c15d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:55.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.921+0000 7f1b61800640 1 -- 172.21.15.103:0/1738199421 shutdown_connections 2024-09-10T22:40:55.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:55.921+0000 7f1b61800640 1 -- 172.21.15.103:0/1738199421 wait complete. 2024-09-10T22:40:55.952 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T22:40:56.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d6da00640 1 -- 172.21.15.103:0/1830649542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d680d1460 msgr2=0x7f7d681634e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:56.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d6da00640 1 --2- 172.21.15.103:0/1830649542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d680d1460 0x7f7d681634e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7d50009840 tx=0x7f7d5001c790 comp rx=0 tx=0).stop 2024-09-10T22:40:56.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d6da00640 1 -- 172.21.15.103:0/1830649542 shutdown_connections 2024-09-10T22:40:56.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d6da00640 1 --2- 172.21.15.103:0/1830649542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d680d1460 0x7f7d681634e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:56.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d6da00640 1 -- 172.21.15.103:0/1830649542 >> 172.21.15.103:0/1830649542 conn(0x7f7d680d0940 msgr2=0x7f7d680d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:56.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d6da00640 1 -- 172.21.15.103:0/1830649542 shutdown_connections 2024-09-10T22:40:56.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d6da00640 1 -- 172.21.15.103:0/1830649542 wait complete. 2024-09-10T22:40:56.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d6da00640 1 Processor -- start 2024-09-10T22:40:56.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d6da00640 1 -- start start 2024-09-10T22:40:56.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d6da00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d6806cc00 0x7f7d68145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:56.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d6da00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d680d02c0 0x7f7d68155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:56.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d6da00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d680d1460 0x7f7d681517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:56.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d6da00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7d68169ea0 con 0x7f7d680d1460 2024-09-10T22:40:56.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d6da00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7d68169d20 con 0x7f7d6806cc00 2024-09-10T22:40:56.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d6da00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7d6816a020 con 0x7f7d680d02c0 2024-09-10T22:40:56.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d67400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d680d1460 0x7f7d681517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:56.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d66a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d6806cc00 0x7f7d68145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:56.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d66a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d6806cc00 0x7f7d68145f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:58796/0 (socket says 172.21.15.103:58796) 2024-09-10T22:40:56.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d66a00640 1 -- 172.21.15.103:0/1069209285 learned_addr learned my addr 172.21.15.103:0/1069209285 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:56.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d67400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d680d1460 0x7f7d681517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44530/0 (socket says 172.21.15.103:44530) 2024-09-10T22:40:56.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d5e000640 1 --2- 172.21.15.103:0/1069209285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d680d02c0 0x7f7d68155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:56.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d66a00640 1 -- 172.21.15.103:0/1069209285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d680d02c0 msgr2=0x7f7d68155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:56.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d66a00640 1 --2- 172.21.15.103:0/1069209285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d680d02c0 0x7f7d68155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:56.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d66a00640 1 -- 172.21.15.103:0/1069209285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d680d1460 msgr2=0x7f7d681517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:56.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d66a00640 1 --2- 172.21.15.103:0/1069209285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d680d1460 0x7f7d681517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:56.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d66a00640 1 -- 172.21.15.103:0/1069209285 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d68071910 con 0x7f7d6806cc00 2024-09-10T22:40:56.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d67400640 1 --2- 172.21.15.103:0/1069209285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d680d1460 0x7f7d681517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:40:56.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.145+0000 7f7d66a00640 1 --2- 172.21.15.103:0/1069209285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d6806cc00 0x7f7d68145f60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800c870 tx=0x7f7d5800cd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:56.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.149+0000 7f7d5f400640 1 -- 172.21.15.103:0/1069209285 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d58003b80 con 0x7f7d6806cc00 2024-09-10T22:40:56.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.149+0000 7f7d5f400640 1 -- 172.21.15.103:0/1069209285 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d58003d40 con 0x7f7d6806cc00 2024-09-10T22:40:56.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.149+0000 7f7d6da00640 1 -- 172.21.15.103:0/1069209285 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d68071350 con 0x7f7d6806cc00 2024-09-10T22:40:56.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.149+0000 7f7d5f400640 1 -- 172.21.15.103:0/1069209285 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5800aab0 con 0x7f7d6806cc00 2024-09-10T22:40:56.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.149+0000 7f7d6da00640 1 -- 172.21.15.103:0/1069209285 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d68154e70 con 0x7f7d6806cc00 2024-09-10T22:40:56.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.149+0000 7f7d6da00640 1 -- 172.21.15.103:0/1069209285 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d6806cfe0 con 0x7f7d6806cc00 2024-09-10T22:40:56.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.149+0000 7f7d5f400640 1 -- 172.21.15.103:0/1069209285 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7d5800ac50 con 0x7f7d6806cc00 2024-09-10T22:40:56.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.149+0000 7f7d5f400640 1 --2- 172.21.15.103:0/1069209285 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7d440725e0 0x7f7d44074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:56.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.149+0000 7f7d5f400640 1 -- 172.21.15.103:0/1069209285 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6388+0+0 (secure 0 0 0) 0x7f7d580933b0 con 0x7f7d6806cc00 2024-09-10T22:40:56.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.149+0000 7f7d5e000640 1 --2- 172.21.15.103:0/1069209285 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7d440725e0 0x7f7d44074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:56.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.153+0000 7f7d5e000640 1 --2- 172.21.15.103:0/1069209285 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7d440725e0 0x7f7d44074aa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7d500af000 tx=0x7f7d5001afd0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:56.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.153+0000 7f7d5f400640 1 -- 172.21.15.103:0/1069209285 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7d5805e180 con 0x7f7d6806cc00 2024-09-10T22:40:56.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.321+0000 7f7d6da00640 1 -- 172.21.15.103:0/1069209285 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7d680cd0c0 con 0x7f7d6806cc00 2024-09-10T22:40:56.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.925+0000 7f7d5f400640 1 -- 172.21.15.103:0/1069209285 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) ==== 181+0+0 (secure 0 0 0) 0x7f7d58062bb0 con 0x7f7d6806cc00 2024-09-10T22:40:56.931 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2024-09-10T22:40:56.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.929+0000 7f7d6da00640 1 -- 172.21.15.103:0/1069209285 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7d440725e0 msgr2=0x7f7d44074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:56.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.929+0000 7f7d6da00640 1 --2- 172.21.15.103:0/1069209285 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7d440725e0 0x7f7d44074aa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7d500af000 tx=0x7f7d5001afd0 comp rx=0 tx=0).stop 2024-09-10T22:40:56.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.929+0000 7f7d6da00640 1 -- 172.21.15.103:0/1069209285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d6806cc00 msgr2=0x7f7d68145f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:56.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.929+0000 7f7d6da00640 1 --2- 172.21.15.103:0/1069209285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d6806cc00 0x7f7d68145f60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800c870 tx=0x7f7d5800cd30 comp rx=0 tx=0).stop 2024-09-10T22:40:56.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.929+0000 7f7d6da00640 1 -- 172.21.15.103:0/1069209285 shutdown_connections 2024-09-10T22:40:56.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.929+0000 7f7d6da00640 1 --2- 172.21.15.103:0/1069209285 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7d440725e0 0x7f7d44074aa0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:56.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.929+0000 7f7d6da00640 1 --2- 172.21.15.103:0/1069209285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d680d1460 0x7f7d681517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:56.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.929+0000 7f7d6da00640 1 --2- 172.21.15.103:0/1069209285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d680d02c0 0x7f7d68155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:56.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.929+0000 7f7d6da00640 1 --2- 172.21.15.103:0/1069209285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d6806cc00 0x7f7d68145f60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:56.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.929+0000 7f7d6da00640 1 -- 172.21.15.103:0/1069209285 >> 172.21.15.103:0/1069209285 conn(0x7f7d680d0940 msgr2=0x7f7d6815e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:56.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.929+0000 7f7d6da00640 1 -- 172.21.15.103:0/1069209285 shutdown_connections 2024-09-10T22:40:56.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:56.929+0000 7f7d6da00640 1 -- 172.21.15.103:0/1069209285 wait complete. 2024-09-10T22:40:56.956 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T22:40:57.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.097+0000 7eff12600640 1 -- 172.21.15.103:0/2082850259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff0c06f810 msgr2=0x7eff0c072c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:57.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.097+0000 7eff12600640 1 --2- 172.21.15.103:0/2082850259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff0c06f810 0x7eff0c072c10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7eff0400aa10 tx=0x7eff0401dc30 comp rx=0 tx=0).stop 2024-09-10T22:40:57.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.097+0000 7eff12600640 1 -- 172.21.15.103:0/2082850259 shutdown_connections 2024-09-10T22:40:57.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.097+0000 7eff12600640 1 --2- 172.21.15.103:0/2082850259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff0c06f810 0x7eff0c072c10 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:57.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.097+0000 7eff12600640 1 -- 172.21.15.103:0/2082850259 >> 172.21.15.103:0/2082850259 conn(0x7eff0c06cc00 msgr2=0x7eff0c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:57.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.097+0000 7eff12600640 1 -- 172.21.15.103:0/2082850259 shutdown_connections 2024-09-10T22:40:57.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.097+0000 7eff12600640 1 -- 172.21.15.103:0/2082850259 wait complete. 2024-09-10T22:40:57.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.097+0000 7eff12600640 1 Processor -- start 2024-09-10T22:40:57.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.097+0000 7eff12600640 1 -- start start 2024-09-10T22:40:57.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.097+0000 7eff12600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff0c06f810 0x7eff0c14b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:57.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.097+0000 7eff12600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff0c0b3320 0x7eff0c13c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:57.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff12600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff0c0cf260 0x7eff0c0b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:57.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff12600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c167fc0 con 0x7eff0c0cf260 2024-09-10T22:40:57.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff12600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c167e40 con 0x7eff0c0b3320 2024-09-10T22:40:57.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff12600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7eff0c168140 con 0x7eff0c06f810 2024-09-10T22:40:57.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff0be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff0c0cf260 0x7eff0c0b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:57.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff0be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff0c0cf260 0x7eff0c0b1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46500/0 (socket says 172.21.15.103:46500) 2024-09-10T22:40:57.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff0be00640 1 -- 172.21.15.103:0/981891585 learned_addr learned my addr 172.21.15.103:0/981891585 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:57.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff0be00640 1 -- 172.21.15.103:0/981891585 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff0c06f810 msgr2=0x7eff0c14b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:57.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff0be00640 1 --2- 172.21.15.103:0/981891585 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff0c06f810 0x7eff0c14b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:57.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff0be00640 1 -- 172.21.15.103:0/981891585 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff0c0b3320 msgr2=0x7eff0c13c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:57.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff0be00640 1 --2- 172.21.15.103:0/981891585 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff0c0b3320 0x7eff0c13c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:57.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff0be00640 1 -- 172.21.15.103:0/981891585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff0c151af0 con 0x7eff0c0cf260 2024-09-10T22:40:57.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff0be00640 1 --2- 172.21.15.103:0/981891585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff0c0cf260 0x7eff0c0b1300 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7eff0401c2e0 tx=0x7eff04003830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:57.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff03e00640 1 -- 172.21.15.103:0/981891585 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff040bc070 con 0x7eff0c0cf260 2024-09-10T22:40:57.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff03e00640 1 -- 172.21.15.103:0/981891585 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff04003d20 con 0x7eff0c0cf260 2024-09-10T22:40:57.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff12600640 1 -- 172.21.15.103:0/981891585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff0c1544f0 con 0x7eff0c0cf260 2024-09-10T22:40:57.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff03e00640 1 -- 172.21.15.103:0/981891585 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff040b3070 con 0x7eff0c0cf260 2024-09-10T22:40:57.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff12600640 1 -- 172.21.15.103:0/981891585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff0c13cb10 con 0x7eff0c0cf260 2024-09-10T22:40:57.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff12600640 1 -- 172.21.15.103:0/981891585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff0c1549a0 con 0x7eff0c0cf260 2024-09-10T22:40:57.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.101+0000 7eff03e00640 1 -- 172.21.15.103:0/981891585 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7eff0400b040 con 0x7eff0c0cf260 2024-09-10T22:40:57.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.105+0000 7eff03e00640 1 --2- 172.21.15.103:0/981891585 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efee80725e0 0x7efee8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:57.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.105+0000 7eff03e00640 1 -- 172.21.15.103:0/981891585 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5950+0+0 (secure 0 0 0) 0x7eff0412d7d0 con 0x7eff0c0cf260 2024-09-10T22:40:57.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.105+0000 7eff0b400640 1 --2- 172.21.15.103:0/981891585 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efee80725e0 0x7efee8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:57.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.105+0000 7eff0b400640 1 --2- 172.21.15.103:0/981891585 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efee80725e0 0x7efee8074aa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efefc007fd0 tx=0x7efefc007d40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:57.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.109+0000 7eff03e00640 1 -- 172.21.15.103:0/981891585 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7eff040a6e20 con 0x7eff0c0cf260 2024-09-10T22:40:57.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.277+0000 7eff12600640 1 -- 172.21.15.103:0/981891585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7eff0c15d1f0 con 0x7eff0c0cf260 2024-09-10T22:40:57.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.925+0000 7eff03e00640 1 -- 172.21.15.103:0/981891585 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) ==== 169+0+0 (secure 0 0 0) 0x7eff04017820 con 0x7eff0c0cf260 2024-09-10T22:40:57.932 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2024-09-10T22:40:57.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.933+0000 7eff12600640 1 -- 172.21.15.103:0/981891585 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efee80725e0 msgr2=0x7efee8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:57.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.933+0000 7eff12600640 1 --2- 172.21.15.103:0/981891585 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efee80725e0 0x7efee8074aa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efefc007fd0 tx=0x7efefc007d40 comp rx=0 tx=0).stop 2024-09-10T22:40:57.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.933+0000 7eff12600640 1 -- 172.21.15.103:0/981891585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff0c0cf260 msgr2=0x7eff0c0b1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:57.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.933+0000 7eff12600640 1 --2- 172.21.15.103:0/981891585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff0c0cf260 0x7eff0c0b1300 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7eff0401c2e0 tx=0x7eff04003830 comp rx=0 tx=0).stop 2024-09-10T22:40:57.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.933+0000 7eff12600640 1 -- 172.21.15.103:0/981891585 shutdown_connections 2024-09-10T22:40:57.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.933+0000 7eff12600640 1 --2- 172.21.15.103:0/981891585 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efee80725e0 0x7efee8074aa0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:57.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.933+0000 7eff12600640 1 --2- 172.21.15.103:0/981891585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff0c0cf260 0x7eff0c0b1300 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:57.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.933+0000 7eff12600640 1 --2- 172.21.15.103:0/981891585 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff0c0b3320 0x7eff0c13c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:57.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.933+0000 7eff12600640 1 --2- 172.21.15.103:0/981891585 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff0c06f810 0x7eff0c14b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:57.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.933+0000 7eff12600640 1 -- 172.21.15.103:0/981891585 >> 172.21.15.103:0/981891585 conn(0x7eff0c06cc00 msgr2=0x7eff0c06cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:57.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.933+0000 7eff12600640 1 -- 172.21.15.103:0/981891585 shutdown_connections 2024-09-10T22:40:57.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:57.933+0000 7eff12600640 1 -- 172.21.15.103:0/981891585 wait complete. 2024-09-10T22:40:57.960 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T22:40:58.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cefc00640 1 -- 172.21.15.103:0/1152830790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ccc003c20 msgr2=0x7f2ccc004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:58.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cefc00640 1 --2- 172.21.15.103:0/1152830790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ccc003c20 0x7f2ccc004020 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8006fc0 tx=0x7f2cd801cef0 comp rx=0 tx=0).stop 2024-09-10T22:40:58.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cedc00640 1 -- 172.21.15.103:0/1152830790 reap_dead start 2024-09-10T22:40:58.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cefc00640 1 -- 172.21.15.103:0/1152830790 shutdown_connections 2024-09-10T22:40:58.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cefc00640 1 -- 172.21.15.103:0/1152830790 >> 172.21.15.103:0/1152830790 conn(0x7f2ce806cc00 msgr2=0x7f2ce806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:58.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cefc00640 1 -- 172.21.15.103:0/1152830790 shutdown_connections 2024-09-10T22:40:58.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cefc00640 1 -- 172.21.15.103:0/1152830790 wait complete. 2024-09-10T22:40:58.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cefc00640 1 Processor -- start 2024-09-10T22:40:58.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cefc00640 1 -- start start 2024-09-10T22:40:58.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cefc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ccc003c20 0x7f2ce815e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:58.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cefc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ce80b1af0 0x7f2ce815b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:58.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cefc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ce80b1f50 0x7f2ce815b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:58.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cefc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce8167bc0 con 0x7f2ce80b1f50 2024-09-10T22:40:58.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cefc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce8167a40 con 0x7f2ccc003c20 2024-09-10T22:40:58.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cefc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce8167d40 con 0x7f2ce80b1af0 2024-09-10T22:40:58.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cedc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ce80b1f50 0x7f2ce815b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:58.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cedc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ce80b1f50 0x7f2ce815b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46528/0 (socket says 172.21.15.103:46528) 2024-09-10T22:40:58.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cedc00640 1 -- 172.21.15.103:0/1134198679 learned_addr learned my addr 172.21.15.103:0/1134198679 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:58.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2cdfe00640 1 --2- 172.21.15.103:0/1134198679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ce80b1af0 0x7f2ce815b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:58.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.101+0000 7f2ced200640 1 --2- 172.21.15.103:0/1134198679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ccc003c20 0x7f2ce815e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:58.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.105+0000 7f2cedc00640 1 -- 172.21.15.103:0/1134198679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ce80b1af0 msgr2=0x7f2ce815b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:58.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.105+0000 7f2cedc00640 1 --2- 172.21.15.103:0/1134198679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ce80b1af0 0x7f2ce815b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:58.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.105+0000 7f2cedc00640 1 -- 172.21.15.103:0/1134198679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ccc003c20 msgr2=0x7f2ce815e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:58.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.105+0000 7f2cedc00640 1 --2- 172.21.15.103:0/1134198679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ccc003c20 0x7f2ce815e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:58.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.105+0000 7f2cedc00640 1 -- 172.21.15.103:0/1134198679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce81f8a20 con 0x7f2ce80b1f50 2024-09-10T22:40:58.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.105+0000 7f2cedc00640 1 --2- 172.21.15.103:0/1134198679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ce80b1f50 0x7f2ce815b560 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80cfb70 tx=0x7f2ce0001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:58.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.105+0000 7f2ce5600640 1 -- 172.21.15.103:0/1134198679 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0015020 con 0x7f2ce80b1f50 2024-09-10T22:40:58.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.105+0000 7f2ce5600640 1 -- 172.21.15.103:0/1134198679 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ce0011960 con 0x7f2ce80b1f50 2024-09-10T22:40:58.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.105+0000 7f2ce5600640 1 -- 172.21.15.103:0/1134198679 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0011db0 con 0x7f2ce80b1f50 2024-09-10T22:40:58.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.105+0000 7f2cefc00640 1 -- 172.21.15.103:0/1134198679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce80b1010 con 0x7f2ce80b1f50 2024-09-10T22:40:58.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.105+0000 7f2cefc00640 1 -- 172.21.15.103:0/1134198679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce815ee80 con 0x7f2ce80b1f50 2024-09-10T22:40:58.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.105+0000 7f2cefc00640 1 -- 172.21.15.103:0/1134198679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce80b2870 con 0x7f2ce80b1f50 2024-09-10T22:40:58.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.105+0000 7f2ce5600640 1 -- 172.21.15.103:0/1134198679 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2ce001a400 con 0x7f2ce80b1f50 2024-09-10T22:40:58.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.105+0000 7f2ce5600640 1 --2- 172.21.15.103:0/1134198679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2cc40725e0 0x7f2cc4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:58.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.109+0000 7f2ce5600640 1 -- 172.21.15.103:0/1134198679 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5507+0+0 (secure 0 0 0) 0x7f2ce0093e70 con 0x7f2ce80b1f50 2024-09-10T22:40:58.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.109+0000 7f2ced200640 1 --2- 172.21.15.103:0/1134198679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2cc40725e0 0x7f2cc4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:58.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.109+0000 7f2ced200640 1 --2- 172.21.15.103:0/1134198679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2cc40725e0 0x7f2cc4074aa0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2cd80ac000 tx=0x7f2cd8019d30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:58.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.109+0000 7f2ce5600640 1 -- 172.21.15.103:0/1134198679 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2ce001f020 con 0x7f2ce80b1f50 2024-09-10T22:40:58.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.281+0000 7f2cefc00640 1 -- 172.21.15.103:0/1134198679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f2ce8159fd0 con 0x7f2ce80b1f50 2024-09-10T22:40:58.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.285+0000 7f2ce5600640 1 -- 172.21.15.103:0/1134198679 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v29) ==== 71+0+0 (secure 0 0 0) 0x7f2ce005efb0 con 0x7f2ce80b1f50 2024-09-10T22:40:58.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.285+0000 7f2cefc00640 1 -- 172.21.15.103:0/1134198679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2cc40725e0 msgr2=0x7f2cc4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:58.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.285+0000 7f2cefc00640 1 --2- 172.21.15.103:0/1134198679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2cc40725e0 0x7f2cc4074aa0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2cd80ac000 tx=0x7f2cd8019d30 comp rx=0 tx=0).stop 2024-09-10T22:40:58.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.285+0000 7f2cefc00640 1 -- 172.21.15.103:0/1134198679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ce80b1f50 msgr2=0x7f2ce815b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:58.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.285+0000 7f2cefc00640 1 --2- 172.21.15.103:0/1134198679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ce80b1f50 0x7f2ce815b560 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80cfb70 tx=0x7f2ce0001b90 comp rx=0 tx=0).stop 2024-09-10T22:40:58.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.285+0000 7f2cefc00640 1 -- 172.21.15.103:0/1134198679 shutdown_connections 2024-09-10T22:40:58.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.285+0000 7f2cefc00640 1 --2- 172.21.15.103:0/1134198679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2cc40725e0 0x7f2cc4074aa0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:58.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.285+0000 7f2cefc00640 1 --2- 172.21.15.103:0/1134198679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ce80b1f50 0x7f2ce815b560 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:58.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.285+0000 7f2cefc00640 1 --2- 172.21.15.103:0/1134198679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ce80b1af0 0x7f2ce815b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:58.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.285+0000 7f2cefc00640 1 --2- 172.21.15.103:0/1134198679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ccc003c20 0x7f2ce815e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:58.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.285+0000 7f2cefc00640 1 -- 172.21.15.103:0/1134198679 >> 172.21.15.103:0/1134198679 conn(0x7f2ce806cc00 msgr2=0x7f2ce80ae040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:58.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.285+0000 7f2cefc00640 1 -- 172.21.15.103:0/1134198679 shutdown_connections 2024-09-10T22:40:58.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.285+0000 7f2cefc00640 1 -- 172.21.15.103:0/1134198679 wait complete. 2024-09-10T22:40:58.313 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag' 2024-09-10T22:40:58.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.449+0000 7ffaa3600640 1 -- 172.21.15.103:0/1148388540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa80004810 msgr2=0x7ffa80004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:58.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.449+0000 7ffaa3600640 1 --2- 172.21.15.103:0/1148388540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa80004810 0x7ffa80004c90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ffa88001860 tx=0x7ffa8801f010 comp rx=0 tx=0).stop 2024-09-10T22:40:58.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.449+0000 7ffaa3600640 1 -- 172.21.15.103:0/1148388540 shutdown_connections 2024-09-10T22:40:58.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.449+0000 7ffaa3600640 1 --2- 172.21.15.103:0/1148388540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa80004810 0x7ffa80004c90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:58.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.449+0000 7ffaa3600640 1 -- 172.21.15.103:0/1148388540 >> 172.21.15.103:0/1148388540 conn(0x7ffa9c06cc00 msgr2=0x7ffa9c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:58.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.449+0000 7ffaa3600640 1 -- 172.21.15.103:0/1148388540 shutdown_connections 2024-09-10T22:40:58.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.449+0000 7ffaa3600640 1 -- 172.21.15.103:0/1148388540 wait complete. 2024-09-10T22:40:58.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa3600640 1 Processor -- start 2024-09-10T22:40:58.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa3600640 1 -- start start 2024-09-10T22:40:58.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa3600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa80004810 0x7ffa9c13d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:58.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa3600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa9c13de60 0x7ffa9c158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:58.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa3600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa9c158fb0 0x7ffa9c1f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:58.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa3600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9c06ef10 con 0x7ffa80004810 2024-09-10T22:40:58.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa3600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9c06ed90 con 0x7ffa9c158fb0 2024-09-10T22:40:58.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa3600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ffa9c06f090 con 0x7ffa9c13de60 2024-09-10T22:40:58.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa0c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa80004810 0x7ffa9c13d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:58.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa0c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa80004810 0x7ffa9c13d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46546/0 (socket says 172.21.15.103:46546) 2024-09-10T22:40:58.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa0c00640 1 -- 172.21.15.103:0/2707060259 learned_addr learned my addr 172.21.15.103:0/2707060259 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:58.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffa9be00640 1 --2- 172.21.15.103:0/2707060259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa9c13de60 0x7ffa9c158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:58.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa1600640 1 --2- 172.21.15.103:0/2707060259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa9c158fb0 0x7ffa9c1f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:58.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa0c00640 1 -- 172.21.15.103:0/2707060259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa9c13de60 msgr2=0x7ffa9c158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:58.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa0c00640 1 --2- 172.21.15.103:0/2707060259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa9c13de60 0x7ffa9c158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:58.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa0c00640 1 -- 172.21.15.103:0/2707060259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa9c158fb0 msgr2=0x7ffa9c1f7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:58.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa0c00640 1 --2- 172.21.15.103:0/2707060259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa9c158fb0 0x7ffa9c1f7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:58.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa0c00640 1 -- 172.21.15.103:0/2707060259 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9c1f4890 con 0x7ffa80004810 2024-09-10T22:40:58.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa1600640 1 --2- 172.21.15.103:0/2707060259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa9c158fb0 0x7ffa9c1f7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:40:58.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa0c00640 1 --2- 172.21.15.103:0/2707060259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa80004810 0x7ffa9c13d920 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c0013e0 tx=0x7ffa8c006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:58.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffa98c00640 1 -- 172.21.15.103:0/2707060259 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c015070 con 0x7ffa80004810 2024-09-10T22:40:58.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffa98c00640 1 -- 172.21.15.103:0/2707060259 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa8c00fcb0 con 0x7ffa80004810 2024-09-10T22:40:58.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffa98c00640 1 -- 172.21.15.103:0/2707060259 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c00fea0 con 0x7ffa80004810 2024-09-10T22:40:58.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa3600640 1 -- 172.21.15.103:0/2707060259 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa9c1f4b70 con 0x7ffa80004810 2024-09-10T22:40:58.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.453+0000 7ffaa3600640 1 -- 172.21.15.103:0/2707060259 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa9c1f5130 con 0x7ffa80004810 2024-09-10T22:40:58.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.457+0000 7ffaa3600640 1 -- 172.21.15.103:0/2707060259 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa9c1f5330 con 0x7ffa80004810 2024-09-10T22:40:58.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.457+0000 7ffa98c00640 1 -- 172.21.15.103:0/2707060259 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ffa8c011690 con 0x7ffa80004810 2024-09-10T22:40:58.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.457+0000 7ffa98c00640 1 --2- 172.21.15.103:0/2707060259 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffa7c072610 0x7ffa7c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:58.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.457+0000 7ffa98c00640 1 -- 172.21.15.103:0/2707060259 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5507+0+0 (secure 0 0 0) 0x7ffa8c094150 con 0x7ffa80004810 2024-09-10T22:40:58.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.457+0000 7ffa9be00640 1 --2- 172.21.15.103:0/2707060259 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffa7c072610 0x7ffa7c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:58.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.457+0000 7ffa9be00640 1 --2- 172.21.15.103:0/2707060259 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffa7c072610 0x7ffa7c074ad0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffa88001830 tx=0x7ffa880a8f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:58.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.461+0000 7ffa98c00640 1 -- 172.21.15.103:0/2707060259 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ffa9c1f5330 con 0x7ffa80004810 2024-09-10T22:40:58.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.693+0000 7ffaa3600640 1 -- 172.21.15.103:0/2707060259 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]} v 0) -- 0x7ffa9c073660 con 0x7ffa80004810 2024-09-10T22:40:58.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.929+0000 7ffa98c00640 1 -- 172.21.15.103:0/2707060259 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]}]=0 v126) ==== 136+0+0 (secure 0 0 0) 0x7ffa8c05f850 con 0x7ffa80004810 2024-09-10T22:40:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.933+0000 7ffaa3600640 1 -- 172.21.15.103:0/2707060259 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffa7c072610 msgr2=0x7ffa7c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.933+0000 7ffaa3600640 1 --2- 172.21.15.103:0/2707060259 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffa7c072610 0x7ffa7c074ad0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffa88001830 tx=0x7ffa880a8f90 comp rx=0 tx=0).stop 2024-09-10T22:40:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.933+0000 7ffaa3600640 1 -- 172.21.15.103:0/2707060259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa80004810 msgr2=0x7ffa9c13d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.933+0000 7ffaa3600640 1 --2- 172.21.15.103:0/2707060259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa80004810 0x7ffa9c13d920 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c0013e0 tx=0x7ffa8c006720 comp rx=0 tx=0).stop 2024-09-10T22:40:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.933+0000 7ffaa3600640 1 -- 172.21.15.103:0/2707060259 shutdown_connections 2024-09-10T22:40:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.933+0000 7ffaa3600640 1 --2- 172.21.15.103:0/2707060259 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffa7c072610 0x7ffa7c074ad0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.933+0000 7ffaa3600640 1 --2- 172.21.15.103:0/2707060259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa9c158fb0 0x7ffa9c1f7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.933+0000 7ffaa3600640 1 --2- 172.21.15.103:0/2707060259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa9c13de60 0x7ffa9c158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.933+0000 7ffaa3600640 1 --2- 172.21.15.103:0/2707060259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa80004810 0x7ffa9c13d920 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.933+0000 7ffaa3600640 1 -- 172.21.15.103:0/2707060259 >> 172.21.15.103:0/2707060259 conn(0x7ffa9c06cc00 msgr2=0x7ffa9c0b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.933+0000 7ffaa3600640 1 -- 172.21.15.103:0/2707060259 shutdown_connections 2024-09-10T22:40:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:58.933+0000 7ffaa3600640 1 -- 172.21.15.103:0/2707060259 wait complete. 2024-09-10T22:40:58.957 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2024-09-10T22:40:58.957 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2024-09-10T22:40:58.957 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:40:59.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.093+0000 7f17cc400640 1 -- 172.21.15.103:0/2131797079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17c40ae9c0 msgr2=0x7f17c40aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:59.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.093+0000 7f17cc400640 1 --2- 172.21.15.103:0/2131797079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17c40ae9c0 0x7f17c40aee10 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f17c40cbf40 tx=0x7f17bc01ccf0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.093+0000 7f17cc400640 1 -- 172.21.15.103:0/2131797079 shutdown_connections 2024-09-10T22:40:59.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.093+0000 7f17cc400640 1 --2- 172.21.15.103:0/2131797079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17c40ae9c0 0x7f17c40aee10 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.093+0000 7f17cc400640 1 --2- 172.21.15.103:0/2131797079 >> v2:172.21.15.131:3300/0 conn(0x7f17c40b09c0 0x7f17c40ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.093+0000 7f17cc400640 1 -- 172.21.15.103:0/2131797079 >> 172.21.15.103:0/2131797079 conn(0x7f17c40d1ac0 msgr2=0x7f17c40d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:59.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.093+0000 7f17cc400640 1 -- 172.21.15.103:0/2131797079 shutdown_connections 2024-09-10T22:40:59.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.093+0000 7f17cc400640 1 -- 172.21.15.103:0/2131797079 wait complete. 2024-09-10T22:40:59.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17cc400640 1 Processor -- start 2024-09-10T22:40:59.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17cc400640 1 -- start start 2024-09-10T22:40:59.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17cc400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17c40ae9c0 0x7f17c40ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:59.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17cc400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17c40b09c0 0x7f17c40b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:59.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17cc400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17c415be30 0x7f17c40b7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:59.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17cc400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f17c4168df0 con 0x7f17c415be30 2024-09-10T22:40:59.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17cc400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f17c4168c70 con 0x7f17c40ae9c0 2024-09-10T22:40:59.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17cc400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f17c4168f70 con 0x7f17c40b09c0 2024-09-10T22:40:59.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17ca400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17c415be30 0x7f17c40b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:59.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17ca400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17c415be30 0x7f17c40b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46566/0 (socket says 172.21.15.103:46566) 2024-09-10T22:40:59.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17ca400640 1 -- 172.21.15.103:0/3525571693 learned_addr learned my addr 172.21.15.103:0/3525571693 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:59.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17ca400640 1 -- 172.21.15.103:0/3525571693 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17c40b09c0 msgr2=0x7f17c40b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:59.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17ca400640 1 --2- 172.21.15.103:0/3525571693 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17c40b09c0 0x7f17c40b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17ca400640 1 -- 172.21.15.103:0/3525571693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17c40ae9c0 msgr2=0x7f17c40ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:59.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17ca400640 1 --2- 172.21.15.103:0/3525571693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17c40ae9c0 0x7f17c40ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17ca400640 1 -- 172.21.15.103:0/3525571693 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c40caa10 con 0x7f17c415be30 2024-09-10T22:40:59.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17ca400640 1 --2- 172.21.15.103:0/3525571693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17c415be30 0x7f17c40b7250 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f17bc019900 tx=0x7f17bc003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:59.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17c1600640 1 -- 172.21.15.103:0/3525571693 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0bb070 con 0x7f17c415be30 2024-09-10T22:40:59.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17c1600640 1 -- 172.21.15.103:0/3525571693 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17bc004e00 con 0x7f17c415be30 2024-09-10T22:40:59.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17cc400640 1 -- 172.21.15.103:0/3525571693 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c41fb460 con 0x7f17c415be30 2024-09-10T22:40:59.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17c1600640 1 -- 172.21.15.103:0/3525571693 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0b2040 con 0x7f17c415be30 2024-09-10T22:40:59.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17cc400640 1 -- 172.21.15.103:0/3525571693 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c41fba20 con 0x7f17c415be30 2024-09-10T22:40:59.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.097+0000 7f17cc400640 1 -- 172.21.15.103:0/3525571693 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c40aee10 con 0x7f17c415be30 2024-09-10T22:40:59.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.101+0000 7f17c1600640 1 -- 172.21.15.103:0/3525571693 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f17bc0b5030 con 0x7f17c415be30 2024-09-10T22:40:59.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.101+0000 7f17c1600640 1 --2- 172.21.15.103:0/3525571693 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f17a40725e0 0x7f17a4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:59.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.101+0000 7f17c1600640 1 -- 172.21.15.103:0/3525571693 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5507+0+0 (secure 0 0 0) 0x7f17bc12cdb0 con 0x7f17c415be30 2024-09-10T22:40:59.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.101+0000 7f17c9a00640 1 --2- 172.21.15.103:0/3525571693 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f17a40725e0 0x7f17a4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:59.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.101+0000 7f17c9a00640 1 --2- 172.21.15.103:0/3525571693 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f17a40725e0 0x7f17a4074aa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f17b8000f70 tx=0x7f17b80079c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:59.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.105+0000 7f17c1600640 1 -- 172.21.15.103:0/3525571693 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f17bc131070 con 0x7f17c415be30 2024-09-10T22:40:59.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.277+0000 7f17cc400640 1 -- 172.21.15.103:0/3525571693 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17c40b7860 con 0x7f17c415be30 2024-09-10T22:40:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.277+0000 7f17c1600640 1 -- 172.21.15.103:0/3525571693 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+13631 (secure 0 0 0) 0x7f17bc016970 con 0x7f17c415be30 2024-09-10T22:40:59.281 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:40:59.282 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":46,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:40:57.927089+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6833/4043692269":"2024-09-11T22:40:54.915052+0000","172.21.15.103:6832/4043692269":"2024-09-11T22:40:54.915052+0000","172.21.15.131:6837/1068577002":"2024-09-11T22:40:54.915040+0000","172.21.15.131:6835/1068577002":"2024-09-11T22:40:54.915040+0000","172.21.15.103:6835/1194009116":"2024-09-11T22:40:54.915056+0000","172.21.15.103:6834/1194009116":"2024-09-11T22:40:54.915056+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:40:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.277+0000 7f17cc400640 1 -- 172.21.15.103:0/3525571693 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f17a40725e0 msgr2=0x7f17a4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.277+0000 7f17cc400640 1 --2- 172.21.15.103:0/3525571693 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f17a40725e0 0x7f17a4074aa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f17b8000f70 tx=0x7f17b80079c0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.277+0000 7f17cc400640 1 -- 172.21.15.103:0/3525571693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17c415be30 msgr2=0x7f17c40b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.277+0000 7f17cc400640 1 --2- 172.21.15.103:0/3525571693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17c415be30 0x7f17c40b7250 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f17bc019900 tx=0x7f17bc003f60 comp rx=0 tx=0).stop 2024-09-10T22:40:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.277+0000 7f17cc400640 1 -- 172.21.15.103:0/3525571693 shutdown_connections 2024-09-10T22:40:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.277+0000 7f17cc400640 1 --2- 172.21.15.103:0/3525571693 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f17a40725e0 0x7f17a4074aa0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.277+0000 7f17cc400640 1 --2- 172.21.15.103:0/3525571693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17c415be30 0x7f17c40b7250 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.277+0000 7f17cc400640 1 --2- 172.21.15.103:0/3525571693 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17c40b09c0 0x7f17c40b6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.277+0000 7f17cc400640 1 --2- 172.21.15.103:0/3525571693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17c40ae9c0 0x7f17c40ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.277+0000 7f17cc400640 1 -- 172.21.15.103:0/3525571693 >> 172.21.15.103:0/3525571693 conn(0x7f17c40d1ac0 msgr2=0x7f17c414dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.277+0000 7f17cc400640 1 -- 172.21.15.103:0/3525571693 shutdown_connections 2024-09-10T22:40:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.277+0000 7f17cc400640 1 -- 172.21.15.103:0/3525571693 wait complete. 2024-09-10T22:40:59.303 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T22:38:39.639064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T22:40:59.303 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T22:40:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739f800640 1 -- 172.21.15.103:0/2385479468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f737c003a40 msgr2=0x7f737c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739f800640 1 --2- 172.21.15.103:0/2385479468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f737c003a40 0x7f737c003e60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f738800c2e0 tx=0x7f738801cf00 comp rx=0 tx=0).stop 2024-09-10T22:40:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739d800640 1 -- 172.21.15.103:0/2385479468 reap_dead start 2024-09-10T22:40:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739f800640 1 -- 172.21.15.103:0/2385479468 shutdown_connections 2024-09-10T22:40:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739f800640 1 -- 172.21.15.103:0/2385479468 >> 172.21.15.103:0/2385479468 conn(0x7f739806cc00 msgr2=0x7f739806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739f800640 1 -- 172.21.15.103:0/2385479468 shutdown_connections 2024-09-10T22:40:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739f800640 1 -- 172.21.15.103:0/2385479468 wait complete. 2024-09-10T22:40:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739f800640 1 Processor -- start 2024-09-10T22:40:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739f800640 1 -- start start 2024-09-10T22:40:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739f800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f737c003a40 0x7f73981f8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739f800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73980b1b70 0x7f73981469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739f800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7398146ef0 0x7f73981fb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739f800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f73980cdbe0 con 0x7f737c003a40 2024-09-10T22:40:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739f800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f73980cda60 con 0x7f7398146ef0 2024-09-10T22:40:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739f800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7398072500 con 0x7f73980b1b70 2024-09-10T22:40:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f737c003a40 0x7f73981f8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f737c003a40 0x7f73981f8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46588/0 (socket says 172.21.15.103:46588) 2024-09-10T22:40:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739ce00640 1 -- 172.21.15.103:0/3160042419 learned_addr learned my addr 172.21.15.103:0/3160042419 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f738fe00640 1 --2- 172.21.15.103:0/3160042419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73980b1b70 0x7f73981469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739d800640 1 --2- 172.21.15.103:0/3160042419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7398146ef0 0x7f73981fb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:59.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739ce00640 1 -- 172.21.15.103:0/3160042419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73980b1b70 msgr2=0x7f73981469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:59.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739ce00640 1 --2- 172.21.15.103:0/3160042419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73980b1b70 0x7f73981469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739ce00640 1 -- 172.21.15.103:0/3160042419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7398146ef0 msgr2=0x7f73981fb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:59.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739ce00640 1 --2- 172.21.15.103:0/3160042419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7398146ef0 0x7f73981fb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739ce00640 1 -- 172.21.15.103:0/3160042419 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73981f8c60 con 0x7f737c003a40 2024-09-10T22:40:59.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f738fe00640 1 --2- 172.21.15.103:0/3160042419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73980b1b70 0x7f73981469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:40:59.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739d800640 1 --2- 172.21.15.103:0/3160042419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7398146ef0 0x7f73981fb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:40:59.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.445+0000 7f739ce00640 1 --2- 172.21.15.103:0/3160042419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f737c003a40 0x7f73981f8720 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f738801c9c0 tx=0x7f7388001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:59.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.449+0000 7f7395600640 1 -- 172.21.15.103:0/3160042419 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7388001500 con 0x7f737c003a40 2024-09-10T22:40:59.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.449+0000 7f7395600640 1 -- 172.21.15.103:0/3160042419 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73880016a0 con 0x7f737c003a40 2024-09-10T22:40:59.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.449+0000 7f7395600640 1 -- 172.21.15.103:0/3160042419 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7388006330 con 0x7f737c003a40 2024-09-10T22:40:59.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.449+0000 7f739f800640 1 -- 172.21.15.103:0/3160042419 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73980b0ad0 con 0x7f737c003a40 2024-09-10T22:40:59.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.449+0000 7f739f800640 1 -- 172.21.15.103:0/3160042419 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73980b1090 con 0x7f737c003a40 2024-09-10T22:40:59.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.449+0000 7f739f800640 1 -- 172.21.15.103:0/3160042419 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f739806eb80 con 0x7f737c003a40 2024-09-10T22:40:59.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.449+0000 7f7395600640 1 -- 172.21.15.103:0/3160042419 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f73880a5c10 con 0x7f737c003a40 2024-09-10T22:40:59.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.449+0000 7f7395600640 1 --2- 172.21.15.103:0/3160042419 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7374072610 0x7f7374074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:59.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.449+0000 7f7395600640 1 -- 172.21.15.103:0/3160042419 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5507+0+0 (secure 0 0 0) 0x7f738812c930 con 0x7f737c003a40 2024-09-10T22:40:59.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.453+0000 7f738fe00640 1 --2- 172.21.15.103:0/3160042419 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7374072610 0x7f7374074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:59.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.453+0000 7f738fe00640 1 --2- 172.21.15.103:0/3160042419 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7374072610 0x7f7374074ad0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7398161e70 tx=0x7f738000b260 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:59.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.453+0000 7f7395600640 1 -- 172.21.15.103:0/3160042419 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f73981f8c60 con 0x7f737c003a40 2024-09-10T22:40:59.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.621+0000 7f739f800640 1 -- 172.21.15.103:0/3160042419 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f73980ae010 con 0x7f737c003a40 2024-09-10T22:40:59.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.621+0000 7f7395600640 1 -- 172.21.15.103:0/3160042419 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) ==== 93+0+10 (secure 0 0 0) 0x7f7388016cb0 con 0x7f737c003a40 2024-09-10T22:40:59.626 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-09-10T22:40:59.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.621+0000 7f739f800640 1 -- 172.21.15.103:0/3160042419 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7374072610 msgr2=0x7f7374074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:59.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.621+0000 7f739f800640 1 --2- 172.21.15.103:0/3160042419 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7374072610 0x7f7374074ad0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7398161e70 tx=0x7f738000b260 comp rx=0 tx=0).stop 2024-09-10T22:40:59.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.621+0000 7f739f800640 1 -- 172.21.15.103:0/3160042419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f737c003a40 msgr2=0x7f73981f8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:59.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.621+0000 7f739f800640 1 --2- 172.21.15.103:0/3160042419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f737c003a40 0x7f73981f8720 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f738801c9c0 tx=0x7f7388001d00 comp rx=0 tx=0).stop 2024-09-10T22:40:59.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.621+0000 7f739f800640 1 -- 172.21.15.103:0/3160042419 shutdown_connections 2024-09-10T22:40:59.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.621+0000 7f739f800640 1 --2- 172.21.15.103:0/3160042419 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7374072610 0x7f7374074ad0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.621+0000 7f739f800640 1 --2- 172.21.15.103:0/3160042419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7398146ef0 0x7f73981fb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.621+0000 7f739f800640 1 --2- 172.21.15.103:0/3160042419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73980b1b70 0x7f73981469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.621+0000 7f739f800640 1 --2- 172.21.15.103:0/3160042419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f737c003a40 0x7f73981f8720 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.621+0000 7f739f800640 1 -- 172.21.15.103:0/3160042419 >> 172.21.15.103:0/3160042419 conn(0x7f739806cc00 msgr2=0x7f7398072980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:59.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.621+0000 7f739f800640 1 -- 172.21.15.103:0/3160042419 shutdown_connections 2024-09-10T22:40:59.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.621+0000 7f739f800640 1 -- 172.21.15.103:0/3160042419 wait complete. 2024-09-10T22:40:59.648 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0' 2024-09-10T22:40:59.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.785+0000 7fcf9c600640 1 -- 172.21.15.103:0/2776396305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf9415be30 msgr2=0x7fcf940ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:59.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.785+0000 7fcf9c600640 1 --2- 172.21.15.103:0/2776396305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf9415be30 0x7fcf940ce0c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009840 tx=0x7fcf8801c6b0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.785+0000 7fcf9c600640 1 -- 172.21.15.103:0/2776396305 shutdown_connections 2024-09-10T22:40:59.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.785+0000 7fcf9c600640 1 --2- 172.21.15.103:0/2776396305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf940ae9c0 0x7fcf940aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.785+0000 7fcf9c600640 1 --2- 172.21.15.103:0/2776396305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf9415be30 0x7fcf940ce0c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.785+0000 7fcf9c600640 1 -- 172.21.15.103:0/2776396305 >> 172.21.15.103:0/2776396305 conn(0x7fcf940d1ac0 msgr2=0x7fcf940d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:40:59.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.785+0000 7fcf9c600640 1 -- 172.21.15.103:0/2776396305 shutdown_connections 2024-09-10T22:40:59.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.785+0000 7fcf9c600640 1 -- 172.21.15.103:0/2776396305 wait complete. 2024-09-10T22:40:59.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9c600640 1 Processor -- start 2024-09-10T22:40:59.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9c600640 1 -- start start 2024-09-10T22:40:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9c600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf940ae9c0 0x7fcf940b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9c600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf940b09c0 0x7fcf9414b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9c600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9415be30 0x7fcf941572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9c600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcf94168be0 con 0x7fcf9415be30 2024-09-10T22:40:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9c600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcf94168a60 con 0x7fcf940b09c0 2024-09-10T22:40:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9c600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcf94168d60 con 0x7fcf940ae9c0 2024-09-10T22:40:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9a600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9415be30 0x7fcf941572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9a600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9415be30 0x7fcf941572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46594/0 (socket says 172.21.15.103:46594) 2024-09-10T22:40:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9a600640 1 -- 172.21.15.103:0/2248399941 learned_addr learned my addr 172.21.15.103:0/2248399941 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:40:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf99c00640 1 --2- 172.21.15.103:0/2248399941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf940ae9c0 0x7fcf940b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf99200640 1 --2- 172.21.15.103:0/2248399941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf940b09c0 0x7fcf9414b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9a600640 1 -- 172.21.15.103:0/2248399941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf940ae9c0 msgr2=0x7fcf940b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:59.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9a600640 1 --2- 172.21.15.103:0/2248399941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf940ae9c0 0x7fcf940b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9a600640 1 -- 172.21.15.103:0/2248399941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf940b09c0 msgr2=0x7fcf9414b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:40:59.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9a600640 1 --2- 172.21.15.103:0/2248399941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf940b09c0 0x7fcf9414b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:40:59.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9a600640 1 -- 172.21.15.103:0/2248399941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf940b2e90 con 0x7fcf9415be30 2024-09-10T22:40:59.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9a600640 1 --2- 172.21.15.103:0/2248399941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9415be30 0x7fcf941572c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00efd0 tx=0x7fcf8c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:59.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf91600640 1 -- 172.21.15.103:0/2248399941 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c003b80 con 0x7fcf9415be30 2024-09-10T22:40:59.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf91600640 1 -- 172.21.15.103:0/2248399941 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf8c003d20 con 0x7fcf9415be30 2024-09-10T22:40:59.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9c600640 1 -- 172.21.15.103:0/2248399941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf940b7780 con 0x7fcf9415be30 2024-09-10T22:40:59.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf91600640 1 -- 172.21.15.103:0/2248399941 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c004280 con 0x7fcf9415be30 2024-09-10T22:40:59.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.789+0000 7fcf9c600640 1 -- 172.21.15.103:0/2248399941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf941f8da0 con 0x7fcf9415be30 2024-09-10T22:40:59.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.793+0000 7fcf9c600640 1 -- 172.21.15.103:0/2248399941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf941f88b0 con 0x7fcf9415be30 2024-09-10T22:40:59.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.793+0000 7fcf91600640 1 -- 172.21.15.103:0/2248399941 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcf8c004420 con 0x7fcf9415be30 2024-09-10T22:40:59.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.793+0000 7fcf91600640 1 --2- 172.21.15.103:0/2248399941 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcf74072610 0x7fcf74074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:40:59.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.793+0000 7fcf91600640 1 -- 172.21.15.103:0/2248399941 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5507+0+0 (secure 0 0 0) 0x7fcf8c093cf0 con 0x7fcf9415be30 2024-09-10T22:40:59.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.793+0000 7fcf99c00640 1 --2- 172.21.15.103:0/2248399941 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcf74072610 0x7fcf74074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:40:59.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.793+0000 7fcf99c00640 1 --2- 172.21.15.103:0/2248399941 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcf74072610 0x7fcf74074ad0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcf880af000 tx=0x7fcf880b2040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:40:59.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:40:59.797+0000 7fcf91600640 1 -- 172.21.15.103:0/2248399941 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcf8c098070 con 0x7fcf9415be30 2024-09-10T22:41:00.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:00.033+0000 7fcf9c600640 1 -- 172.21.15.103:0/2248399941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]} v 0) -- 0x7fcf940aee50 con 0x7fcf9415be30 2024-09-10T22:41:00.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:00.937+0000 7fcf91600640 1 -- 172.21.15.103:0/2248399941 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]}]=0 v128) ==== 146+0+0 (secure 0 0 0) 0x7fcf8c05eed0 con 0x7fcf9415be30 2024-09-10T22:41:00.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:00.941+0000 7fcf9c600640 1 -- 172.21.15.103:0/2248399941 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcf74072610 msgr2=0x7fcf74074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:00.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:00.941+0000 7fcf9c600640 1 --2- 172.21.15.103:0/2248399941 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcf74072610 0x7fcf74074ad0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcf880af000 tx=0x7fcf880b2040 comp rx=0 tx=0).stop 2024-09-10T22:41:00.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:00.941+0000 7fcf9c600640 1 -- 172.21.15.103:0/2248399941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9415be30 msgr2=0x7fcf941572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:00.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:00.941+0000 7fcf9c600640 1 --2- 172.21.15.103:0/2248399941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9415be30 0x7fcf941572c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00efd0 tx=0x7fcf8c00c6a0 comp rx=0 tx=0).stop 2024-09-10T22:41:00.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:00.941+0000 7fcf9c600640 1 -- 172.21.15.103:0/2248399941 shutdown_connections 2024-09-10T22:41:00.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:00.941+0000 7fcf9c600640 1 --2- 172.21.15.103:0/2248399941 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcf74072610 0x7fcf74074ad0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:00.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:00.941+0000 7fcf9c600640 1 --2- 172.21.15.103:0/2248399941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9415be30 0x7fcf941572c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:00.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:00.941+0000 7fcf9c600640 1 --2- 172.21.15.103:0/2248399941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf940b09c0 0x7fcf9414b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:00.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:00.941+0000 7fcf9c600640 1 --2- 172.21.15.103:0/2248399941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf940ae9c0 0x7fcf940b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:00.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:00.941+0000 7fcf9c600640 1 -- 172.21.15.103:0/2248399941 >> 172.21.15.103:0/2248399941 conn(0x7fcf940d1ac0 msgr2=0x7fcf940b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:00.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:00.941+0000 7fcf9c600640 1 -- 172.21.15.103:0/2248399941 shutdown_connections 2024-09-10T22:41:00.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:00.941+0000 7fcf9c600640 1 -- 172.21.15.103:0/2248399941 wait complete. 2024-09-10T22:41:00.970 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T22:41:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f176f200640 1 -- 172.21.15.103:0/538288238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f174c003a10 msgr2=0x7f174c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f176f200640 1 --2- 172.21.15.103:0/538288238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f174c003a10 0x7f174c003e30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1758009ee0 tx=0x7f175801d630 comp rx=0 tx=0).stop 2024-09-10T22:41:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f176d200640 1 -- 172.21.15.103:0/538288238 reap_dead start 2024-09-10T22:41:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f176f200640 1 -- 172.21.15.103:0/538288238 shutdown_connections 2024-09-10T22:41:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f176f200640 1 -- 172.21.15.103:0/538288238 >> 172.21.15.103:0/538288238 conn(0x7f17680d1a20 msgr2=0x7f17680d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f176f200640 1 -- 172.21.15.103:0/538288238 shutdown_connections 2024-09-10T22:41:01.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f176f200640 1 -- 172.21.15.103:0/538288238 wait complete. 2024-09-10T22:41:01.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f176f200640 1 Processor -- start 2024-09-10T22:41:01.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f176f200640 1 -- start start 2024-09-10T22:41:01.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f176f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f174c003a10 0x7f17681f8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:01.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f176f200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17681f7150 0x7f17680b6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:01.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f176f200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17680b7520 0x7f17681525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:01.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f176f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1768160430 con 0x7f174c003a10 2024-09-10T22:41:01.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f176f200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f17681602b0 con 0x7f17680b7520 2024-09-10T22:41:01.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f176f200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f17681605b0 con 0x7f17681f7150 2024-09-10T22:41:01.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f1767e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f174c003a10 0x7f17681f8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:01.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f1767e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f174c003a10 0x7f17681f8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46618/0 (socket says 172.21.15.103:46618) 2024-09-10T22:41:01.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f1767e00640 1 -- 172.21.15.103:0/2216166464 learned_addr learned my addr 172.21.15.103:0/2216166464 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:01.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f175f400640 1 --2- 172.21.15.103:0/2216166464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17681f7150 0x7f17680b6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:01.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f176d200640 1 --2- 172.21.15.103:0/2216166464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17680b7520 0x7f17681525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:01.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f1767e00640 1 -- 172.21.15.103:0/2216166464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17681f7150 msgr2=0x7f17680b6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:01.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f1767e00640 1 --2- 172.21.15.103:0/2216166464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17681f7150 0x7f17680b6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:01.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f1767e00640 1 -- 172.21.15.103:0/2216166464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17680b7520 msgr2=0x7f17681525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:01.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f1767e00640 1 --2- 172.21.15.103:0/2216166464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17680b7520 0x7f17681525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:01.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f1767e00640 1 -- 172.21.15.103:0/2216166464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17680b5b50 con 0x7f174c003a10 2024-09-10T22:41:01.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.113+0000 7f175f400640 1 --2- 172.21.15.103:0/2216166464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17681f7150 0x7f17680b6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:01.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.117+0000 7f1767e00640 1 --2- 172.21.15.103:0/2216166464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f174c003a10 0x7f17681f8420 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f17580ae040 tx=0x7f1758009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:01.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.117+0000 7f1764c00640 1 -- 172.21.15.103:0/2216166464 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1758003b80 con 0x7f174c003a10 2024-09-10T22:41:01.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.117+0000 7f1764c00640 1 -- 172.21.15.103:0/2216166464 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1758003e10 con 0x7f174c003a10 2024-09-10T22:41:01.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.117+0000 7f1764c00640 1 -- 172.21.15.103:0/2216166464 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1758004270 con 0x7f174c003a10 2024-09-10T22:41:01.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.117+0000 7f176f200640 1 -- 172.21.15.103:0/2216166464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17680b6540 con 0x7f174c003a10 2024-09-10T22:41:01.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.117+0000 7f176f200640 1 -- 172.21.15.103:0/2216166464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17680b5df0 con 0x7f174c003a10 2024-09-10T22:41:01.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.117+0000 7f176f200640 1 -- 172.21.15.103:0/2216166464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17680ae7f0 con 0x7f174c003a10 2024-09-10T22:41:01.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.117+0000 7f1764c00640 1 -- 172.21.15.103:0/2216166464 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f17580c7030 con 0x7f174c003a10 2024-09-10T22:41:01.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.117+0000 7f1764c00640 1 --2- 172.21.15.103:0/2216166464 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1744072610 0x7f1744074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:01.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.117+0000 7f1764c00640 1 -- 172.21.15.103:0/2216166464 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5507+0+0 (secure 0 0 0) 0x7f175812ea50 con 0x7f174c003a10 2024-09-10T22:41:01.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.117+0000 7f175f400640 1 --2- 172.21.15.103:0/2216166464 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1744072610 0x7f1744074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:01.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.121+0000 7f175f400640 1 --2- 172.21.15.103:0/2216166464 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1744072610 0x7f1744074ad0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1750001230 tx=0x7f1750001120 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:01.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.121+0000 7f1764c00640 1 -- 172.21.15.103:0/2216166464 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1758017340 con 0x7f174c003a10 2024-09-10T22:41:01.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.285+0000 7f176f200640 1 -- 172.21.15.103:0/2216166464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f17680b2140 con 0x7f174c003a10 2024-09-10T22:41:01.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.289+0000 7f1764c00640 1 -- 172.21.15.103:0/2216166464 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v29) ==== 59+0+1998 (secure 0 0 0) 0x7f17580fa0c0 con 0x7f174c003a10 2024-09-10T22:41:01.293 INFO:teuthology.orchestra.run.smithi103.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T22:41:01.293 INFO:teuthology.orchestra.run.smithi103.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T22:41:01.293 INFO:teuthology.orchestra.run.smithi103.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T22:41:01.293 INFO:teuthology.orchestra.run.smithi103.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T22:41:01.293 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4853.781452 2024-09-10T22:41:01.294 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 8222.655229 2024-09-10T22:41:01.294 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4587.934032 2024-09-10T22:41:01.294 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4814.972817 2024-09-10T22:41:01.294 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3485.951614 2024-09-10T22:41:01.294 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3821.456289 2024-09-10T22:41:01.294 INFO:teuthology.orchestra.run.smithi103.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3533.610209 2024-09-10T22:41:01.294 INFO:teuthology.orchestra.run.smithi103.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3752.830807 2024-09-10T22:41:01.294 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced debug_mds 20/20 2024-09-10T22:41:01.294 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T22:41:01.294 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced debug_ms 2/2 2024-09-10T22:41:01.294 INFO:teuthology.orchestra.run.smithi103.stdout:mds dev mds_debug_frag true 2024-09-10T22:41:01.294 INFO:teuthology.orchestra.run.smithi103.stdout:mds dev mds_debug_scatterstat true 2024-09-10T22:41:01.294 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T22:41:01.295 INFO:teuthology.orchestra.run.smithi103.stdout:mds dev mds_verify_scatter true 2024-09-10T22:41:01.295 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T22:41:01.295 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T22:41:01.295 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T22:41:01.295 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced client_mount_timeout 600 2024-09-10T22:41:01.295 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced debug_client 20/20 2024-09-10T22:41:01.295 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced debug_ms 1/1 2024-09-10T22:41:01.295 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T22:41:01.295 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T22:41:01.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.289+0000 7f176f200640 1 -- 172.21.15.103:0/2216166464 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1744072610 msgr2=0x7f1744074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:01.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.289+0000 7f176f200640 1 --2- 172.21.15.103:0/2216166464 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1744072610 0x7f1744074ad0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1750001230 tx=0x7f1750001120 comp rx=0 tx=0).stop 2024-09-10T22:41:01.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.289+0000 7f176f200640 1 -- 172.21.15.103:0/2216166464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f174c003a10 msgr2=0x7f17681f8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:01.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.289+0000 7f176f200640 1 --2- 172.21.15.103:0/2216166464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f174c003a10 0x7f17681f8420 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f17580ae040 tx=0x7f1758009b30 comp rx=0 tx=0).stop 2024-09-10T22:41:01.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.289+0000 7f176f200640 1 -- 172.21.15.103:0/2216166464 shutdown_connections 2024-09-10T22:41:01.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.289+0000 7f176f200640 1 --2- 172.21.15.103:0/2216166464 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1744072610 0x7f1744074ad0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:01.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.289+0000 7f176f200640 1 --2- 172.21.15.103:0/2216166464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17680b7520 0x7f17681525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:01.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.289+0000 7f176f200640 1 --2- 172.21.15.103:0/2216166464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17681f7150 0x7f17680b6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:01.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.289+0000 7f176f200640 1 --2- 172.21.15.103:0/2216166464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f174c003a10 0x7f17681f8420 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:01.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.289+0000 7f176f200640 1 -- 172.21.15.103:0/2216166464 >> 172.21.15.103:0/2216166464 conn(0x7f17680d1a20 msgr2=0x7f17680b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:01.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.289+0000 7f176f200640 1 -- 172.21.15.103:0/2216166464 shutdown_connections 2024-09-10T22:41:01.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.289+0000 7f176f200640 1 -- 172.21.15.103:0/2216166464 wait complete. 2024-09-10T22:41:01.314 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T22:41:01.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.453+0000 7f495c000640 1 -- 172.21.15.103:0/3319442444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49540cc130 msgr2=0x7f49540adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:01.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.453+0000 7f495c000640 1 --2- 172.21.15.103:0/3319442444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49540cc130 0x7f49540adba0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4948009bc0 tx=0x7f494801cba0 comp rx=0 tx=0).stop 2024-09-10T22:41:01.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.453+0000 7f495c000640 1 -- 172.21.15.103:0/3319442444 shutdown_connections 2024-09-10T22:41:01.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.453+0000 7f495c000640 1 --2- 172.21.15.103:0/3319442444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f495406de20 0x7f49540acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:01.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.453+0000 7f495c000640 1 --2- 172.21.15.103:0/3319442444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49540cc130 0x7f49540adba0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:01.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.453+0000 7f495c000640 1 -- 172.21.15.103:0/3319442444 >> 172.21.15.103:0/3319442444 conn(0x7f49540b1c00 msgr2=0x7f49540b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:01.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.453+0000 7f495c000640 1 -- 172.21.15.103:0/3319442444 shutdown_connections 2024-09-10T22:41:01.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.453+0000 7f495c000640 1 -- 172.21.15.103:0/3319442444 wait complete. 2024-09-10T22:41:01.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.453+0000 7f495c000640 1 Processor -- start 2024-09-10T22:41:01.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.453+0000 7f495c000640 1 -- start start 2024-09-10T22:41:01.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f495c000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f495406de20 0x7f4954154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:01.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f495c000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49540ad420 0x7f495415c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:01.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f495c000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49540cc130 0x7f495415c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:01.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f495c000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f49541679c0 con 0x7f49540ad420 2024-09-10T22:41:01.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f495c000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4954167840 con 0x7f495406de20 2024-09-10T22:41:01.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f495c000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4954167b40 con 0x7f49540cc130 2024-09-10T22:41:01.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f4958c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49540ad420 0x7f495415c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:01.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f4958c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49540ad420 0x7f495415c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46620/0 (socket says 172.21.15.103:46620) 2024-09-10T22:41:01.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f4958c00640 1 -- 172.21.15.103:0/1922594656 learned_addr learned my addr 172.21.15.103:0/1922594656 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:01.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f4959600640 1 --2- 172.21.15.103:0/1922594656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f495406de20 0x7f4954154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:01.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f495a000640 1 --2- 172.21.15.103:0/1922594656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49540cc130 0x7f495415c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:01.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f4958c00640 1 -- 172.21.15.103:0/1922594656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49540cc130 msgr2=0x7f495415c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:01.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f4958c00640 1 --2- 172.21.15.103:0/1922594656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49540cc130 0x7f495415c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:01.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f4958c00640 1 -- 172.21.15.103:0/1922594656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f495406de20 msgr2=0x7f4954154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:01.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f4958c00640 1 --2- 172.21.15.103:0/1922594656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f495406de20 0x7f4954154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f4958c00640 1 -- 172.21.15.103:0/1922594656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495415d200 con 0x7f49540ad420 2024-09-10T22:41:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f4958c00640 1 --2- 172.21.15.103:0/1922594656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49540ad420 0x7f495415c020 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f494000e9f0 tx=0x7f494000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f4951600640 1 -- 172.21.15.103:0/1922594656 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494000cd80 con 0x7f49540ad420 2024-09-10T22:41:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f4951600640 1 -- 172.21.15.103:0/1922594656 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4940010430 con 0x7f49540ad420 2024-09-10T22:41:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f4951600640 1 -- 172.21.15.103:0/1922594656 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4940010860 con 0x7f49540ad420 2024-09-10T22:41:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f495c000640 1 -- 172.21.15.103:0/1922594656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495415d4a0 con 0x7f49540ad420 2024-09-10T22:41:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f495c000640 1 -- 172.21.15.103:0/1922594656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f495409acd0 con 0x7f49540ad420 2024-09-10T22:41:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.457+0000 7f495c000640 1 -- 172.21.15.103:0/1922594656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49540acee0 con 0x7f49540ad420 2024-09-10T22:41:01.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.461+0000 7f4951600640 1 -- 172.21.15.103:0/1922594656 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4940010a00 con 0x7f49540ad420 2024-09-10T22:41:01.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.461+0000 7f4951600640 1 --2- 172.21.15.103:0/1922594656 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f49340725e0 0x7f4934074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:01.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.461+0000 7f4951600640 1 -- 172.21.15.103:0/1922594656 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5507+0+0 (secure 0 0 0) 0x7f4940093d50 con 0x7f49540ad420 2024-09-10T22:41:01.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.461+0000 7f4959600640 1 --2- 172.21.15.103:0/1922594656 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f49340725e0 0x7f4934074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:01.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.461+0000 7f4959600640 1 --2- 172.21.15.103:0/1922594656 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f49340725e0 0x7f4934074aa0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f49480af000 tx=0x7f494801b3e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:01.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.465+0000 7f4951600640 1 -- 172.21.15.103:0/1922594656 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f494005eed0 con 0x7f49540ad420 2024-09-10T22:41:01.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.629+0000 7f495c000640 1 -- 172.21.15.103:0/1922594656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f49540ca430 con 0x7f49540ad420 2024-09-10T22:41:01.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.633+0000 7f4951600640 1 -- 172.21.15.103:0/1922594656 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7f4940063900 con 0x7f49540ad420 2024-09-10T22:41:01.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.637+0000 7f495c000640 1 -- 172.21.15.103:0/1922594656 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f49340725e0 msgr2=0x7f4934074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:01.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.637+0000 7f495c000640 1 --2- 172.21.15.103:0/1922594656 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f49340725e0 0x7f4934074aa0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f49480af000 tx=0x7f494801b3e0 comp rx=0 tx=0).stop 2024-09-10T22:41:01.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.637+0000 7f495c000640 1 -- 172.21.15.103:0/1922594656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49540ad420 msgr2=0x7f495415c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:01.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.637+0000 7f495c000640 1 --2- 172.21.15.103:0/1922594656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49540ad420 0x7f495415c020 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f494000e9f0 tx=0x7f494000eeb0 comp rx=0 tx=0).stop 2024-09-10T22:41:01.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.637+0000 7f495c000640 1 -- 172.21.15.103:0/1922594656 shutdown_connections 2024-09-10T22:41:01.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.637+0000 7f495c000640 1 --2- 172.21.15.103:0/1922594656 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f49340725e0 0x7f4934074aa0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:01.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.637+0000 7f495c000640 1 --2- 172.21.15.103:0/1922594656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49540cc130 0x7f495415c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:01.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.637+0000 7f495c000640 1 --2- 172.21.15.103:0/1922594656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49540ad420 0x7f495415c020 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:01.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.637+0000 7f495c000640 1 --2- 172.21.15.103:0/1922594656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f495406de20 0x7f4954154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:01.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.637+0000 7f495c000640 1 -- 172.21.15.103:0/1922594656 >> 172.21.15.103:0/1922594656 conn(0x7f49540b1c00 msgr2=0x7f4954155530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:01.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.637+0000 7f495c000640 1 -- 172.21.15.103:0/1922594656 shutdown_connections 2024-09-10T22:41:01.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:01.637+0000 7f495c000640 1 -- 172.21.15.103:0/1922594656 wait complete. 2024-09-10T22:41:01.663 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T22:41:01.663 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:41:01.755 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:41:01.858 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T22:41:01.858 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:41:01.858 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:41:01.867 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350248k,nr_inodes=4087562,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3542 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T22:41:01.867 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:41:01.867 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:41:01.876 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:41:01.876 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:41:01.876 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:41:01.916 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350248k,nr_inodes=4087562,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3542 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T22:41:01.916 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:41:01.916 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:41:01.926 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:41:01.926 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T22:41:01.926 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:41:02.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.093+0000 7feb32200640 1 -- 172.21.15.103:0/2535088944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb2c0d1460 msgr2=0x7feb2c0cf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:02.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.093+0000 7feb32200640 1 --2- 172.21.15.103:0/2535088944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb2c0d1460 0x7feb2c0cf2b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7feb2c051070 tx=0x7feb1401c830 comp rx=0 tx=0).stop 2024-09-10T22:41:02.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.093+0000 7feb32200640 1 -- 172.21.15.103:0/2535088944 shutdown_connections 2024-09-10T22:41:02.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.093+0000 7feb32200640 1 --2- 172.21.15.103:0/2535088944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb2c0d1460 0x7feb2c0cf2b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:02.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.093+0000 7feb32200640 1 --2- 172.21.15.103:0/2535088944 >> v2:172.21.15.131:3300/0 conn(0x7feb2c06cc00 0x7feb2c06cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:02.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.093+0000 7feb32200640 1 -- 172.21.15.103:0/2535088944 >> 172.21.15.103:0/2535088944 conn(0x7feb2c0d0940 msgr2=0x7feb2c0d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:02.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.093+0000 7feb32200640 1 -- 172.21.15.103:0/2535088944 shutdown_connections 2024-09-10T22:41:02.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.093+0000 7feb32200640 1 -- 172.21.15.103:0/2535088944 wait complete. 2024-09-10T22:41:02.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.093+0000 7feb32200640 1 Processor -- start 2024-09-10T22:41:02.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.093+0000 7feb32200640 1 -- start start 2024-09-10T22:41:02.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.093+0000 7feb32200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb2c06cc00 0x7feb2c158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:02.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.093+0000 7feb32200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb2c071be0 0x7feb2c1f8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:02.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.093+0000 7feb32200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb2c0d1460 0x7feb2c1f9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:02.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.093+0000 7feb32200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c1688a0 con 0x7feb2c0d1460 2024-09-10T22:41:02.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.093+0000 7feb32200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c168720 con 0x7feb2c06cc00 2024-09-10T22:41:02.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.093+0000 7feb32200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7feb2c168a20 con 0x7feb2c071be0 2024-09-10T22:41:02.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb2be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb2c0d1460 0x7feb2c1f9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:02.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb2be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb2c0d1460 0x7feb2c1f9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46646/0 (socket says 172.21.15.103:46646) 2024-09-10T22:41:02.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb22a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb2c071be0 0x7feb2c1f8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:02.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb2be00640 1 -- 172.21.15.103:0/2270686042 learned_addr learned my addr 172.21.15.103:0/2270686042 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:02.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb2b400640 1 --2- 172.21.15.103:0/2270686042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb2c06cc00 0x7feb2c158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:02.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb2be00640 1 -- 172.21.15.103:0/2270686042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb2c071be0 msgr2=0x7feb2c1f8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:02.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb2be00640 1 --2- 172.21.15.103:0/2270686042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb2c071be0 0x7feb2c1f8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:02.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb2be00640 1 -- 172.21.15.103:0/2270686042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb2c06cc00 msgr2=0x7feb2c158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:02.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb2be00640 1 --2- 172.21.15.103:0/2270686042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb2c06cc00 0x7feb2c158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:02.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb2be00640 1 -- 172.21.15.103:0/2270686042 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2c076a60 con 0x7feb2c0d1460 2024-09-10T22:41:02.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb2b400640 1 --2- 172.21.15.103:0/2270686042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb2c06cc00 0x7feb2c158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:41:02.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb2be00640 1 --2- 172.21.15.103:0/2270686042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb2c0d1460 0x7feb2c1f9130 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7feb2400c3a0 tx=0x7feb2400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:02.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb23e00640 1 -- 172.21.15.103:0/2270686042 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb24017070 con 0x7feb2c0d1460 2024-09-10T22:41:02.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb23e00640 1 -- 172.21.15.103:0/2270686042 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb24003600 con 0x7feb2c0d1460 2024-09-10T22:41:02.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb32200640 1 -- 172.21.15.103:0/2270686042 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb2c13f9e0 con 0x7feb2c0d1460 2024-09-10T22:41:02.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb23e00640 1 -- 172.21.15.103:0/2270686042 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb24003a50 con 0x7feb2c0d1460 2024-09-10T22:41:02.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb32200640 1 -- 172.21.15.103:0/2270686042 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb2c13ffa0 con 0x7feb2c0d1460 2024-09-10T22:41:02.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb32200640 1 -- 172.21.15.103:0/2270686042 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb2c06cfe0 con 0x7feb2c0d1460 2024-09-10T22:41:02.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.097+0000 7feb23e00640 1 -- 172.21.15.103:0/2270686042 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7feb24003bf0 con 0x7feb2c0d1460 2024-09-10T22:41:02.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.101+0000 7feb23e00640 1 --2- 172.21.15.103:0/2270686042 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feb080725e0 0x7feb08074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:02.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.101+0000 7feb23e00640 1 -- 172.21.15.103:0/2270686042 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5507+0+0 (secure 0 0 0) 0x7feb240926d0 con 0x7feb2c0d1460 2024-09-10T22:41:02.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.101+0000 7feb2b400640 1 --2- 172.21.15.103:0/2270686042 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feb080725e0 0x7feb08074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:02.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.101+0000 7feb2b400640 1 --2- 172.21.15.103:0/2270686042 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feb080725e0 0x7feb08074aa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7feb1c011790 tx=0x7feb1c009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:02.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.105+0000 7feb23e00640 1 -- 172.21.15.103:0/2270686042 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7feb2405d820 con 0x7feb2c0d1460 2024-09-10T22:41:02.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.301+0000 7feb32200640 1 -- 172.21.15.103:0/2270686042 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb2c0cd0c0 con 0x7feb2c0d1460 2024-09-10T22:41:02.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.301+0000 7feb23e00640 1 -- 172.21.15.103:0/2270686042 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+3917 (secure 0 0 0) 0x7feb24062250 con 0x7feb2c0d1460 2024-09-10T22:41:02.307 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:02.308 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":29,"btime":"2024-09-10T22:40:55:918064+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/3313045987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3313045987},{"type":"v1","addr":"172.21.15.131:6836","nonce":3313045987}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":5344,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/1628637891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1628637891},{"type":"v1","addr":"172.21.15.131:6837","nonce":1628637891}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5448,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/247116450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":247116450},{"type":"v1","addr":"172.21.15.103:6833","nonce":247116450}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/929469101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":929469101},{"type":"v1","addr":"172.21.15.103:6835","nonce":929469101}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[]} 2024-09-10T22:41:02.308 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 29 2024-09-10T22:41:02.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.305+0000 7feb32200640 1 -- 172.21.15.103:0/2270686042 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feb080725e0 msgr2=0x7feb08074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:02.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.305+0000 7feb32200640 1 --2- 172.21.15.103:0/2270686042 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feb080725e0 0x7feb08074aa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7feb1c011790 tx=0x7feb1c009500 comp rx=0 tx=0).stop 2024-09-10T22:41:02.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.305+0000 7feb32200640 1 -- 172.21.15.103:0/2270686042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb2c0d1460 msgr2=0x7feb2c1f9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:02.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.305+0000 7feb32200640 1 --2- 172.21.15.103:0/2270686042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb2c0d1460 0x7feb2c1f9130 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7feb2400c3a0 tx=0x7feb2400c860 comp rx=0 tx=0).stop 2024-09-10T22:41:02.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.305+0000 7feb32200640 1 -- 172.21.15.103:0/2270686042 shutdown_connections 2024-09-10T22:41:02.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.305+0000 7feb32200640 1 --2- 172.21.15.103:0/2270686042 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feb080725e0 0x7feb08074aa0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:02.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.305+0000 7feb32200640 1 --2- 172.21.15.103:0/2270686042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb2c0d1460 0x7feb2c1f9130 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:02.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.305+0000 7feb32200640 1 --2- 172.21.15.103:0/2270686042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb2c071be0 0x7feb2c1f8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:02.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.305+0000 7feb32200640 1 --2- 172.21.15.103:0/2270686042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb2c06cc00 0x7feb2c158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:02.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.305+0000 7feb32200640 1 -- 172.21.15.103:0/2270686042 >> 172.21.15.103:0/2270686042 conn(0x7feb2c0d0940 msgr2=0x7feb2c146a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:02.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.305+0000 7feb32200640 1 -- 172.21.15.103:0/2270686042 shutdown_connections 2024-09-10T22:41:02.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.305+0000 7feb32200640 1 -- 172.21.15.103:0/2270686042 wait complete. 2024-09-10T22:41:02.329 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T22:41:02.329 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T22:41:02.329 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T22:41:02.330 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:41:02.330 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T22:41:02.330 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T22:41:02.330 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T22:41:02.330 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:41:02.330 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T22:41:02.330 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T22:41:02.331 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T22:41:02.331 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:41:02.331 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T22:41:02.331 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T22:41:02.331 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T22:41:02.331 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:41:02.343 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T22:41:02.343 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T22:41:02.344 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T22:41:02.345 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T22:41:02.346 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T22:41:02.346 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T22:41:02.347 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T22:41:02.347 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T22:41:02.394 INFO:tasks.ceph.mds.a:Started 2024-09-10T22:41:02.394 INFO:tasks.ceph.mds.b:Started 2024-09-10T22:41:02.395 DEBUG:teuthology.parallel:result is None 2024-09-10T22:41:02.395 DEBUG:teuthology.parallel:result is None 2024-09-10T22:41:02.395 INFO:tasks.ceph.mds.d:Started 2024-09-10T22:41:02.396 DEBUG:teuthology.parallel:result is None 2024-09-10T22:41:02.396 INFO:tasks.ceph.mds.c:Started 2024-09-10T22:41:02.397 DEBUG:teuthology.parallel:result is None 2024-09-10T22:41:02.397 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T22:41:02.480 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-09-10T22:41:02.481 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-09-10T22:41:02.484 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2024-09-10T22:41:02.485 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2024-09-10T22:41:02.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.541+0000 7f6a11000640 1 -- 172.21.15.103:0/2101786172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c0cf260 msgr2=0x7f6a0c0cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:02.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.541+0000 7f6a11000640 1 --2- 172.21.15.103:0/2101786172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c0cf260 0x7f6a0c0cf800 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c074960 tx=0x7f69fc01c8c0 comp rx=0 tx=0).stop 2024-09-10T22:41:02.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.541+0000 7f6a11000640 1 -- 172.21.15.103:0/2101786172 shutdown_connections 2024-09-10T22:41:02.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.541+0000 7f6a11000640 1 --2- 172.21.15.103:0/2101786172 >> v2:172.21.15.131:3300/0 conn(0x7f6a0c072500 0x7f6a0c072970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:02.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.541+0000 7f6a11000640 1 --2- 172.21.15.103:0/2101786172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c0cf260 0x7f6a0c0cf800 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:02.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.541+0000 7f6a11000640 1 -- 172.21.15.103:0/2101786172 >> 172.21.15.103:0/2101786172 conn(0x7f6a0c06cc00 msgr2=0x7f6a0c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:02.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.541+0000 7f6a11000640 1 -- 172.21.15.103:0/2101786172 shutdown_connections 2024-09-10T22:41:02.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.541+0000 7f6a11000640 1 -- 172.21.15.103:0/2101786172 wait complete. 2024-09-10T22:41:02.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.541+0000 7f6a11000640 1 Processor -- start 2024-09-10T22:41:02.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a11000640 1 -- start start 2024-09-10T22:41:02.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a11000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a0c072500 0x7f6a0c147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:02.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a11000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a0c0b2c10 0x7f6a0c149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:02.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a11000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c0cf260 0x7f6a0c153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:02.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a11000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c157c30 con 0x7f6a0c0cf260 2024-09-10T22:41:02.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a11000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c157ab0 con 0x7f6a0c0b2c10 2024-09-10T22:41:02.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a11000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6a0c157db0 con 0x7f6a0c072500 2024-09-10T22:41:02.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a0a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c0cf260 0x7f6a0c153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:02.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a0a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c0cf260 0x7f6a0c153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46694/0 (socket says 172.21.15.103:46694) 2024-09-10T22:41:02.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a0a800640 1 -- 172.21.15.103:0/789129336 learned_addr learned my addr 172.21.15.103:0/789129336 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:02.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a09e00640 1 --2- 172.21.15.103:0/789129336 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a0c072500 0x7f6a0c147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:02.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a09400640 1 --2- 172.21.15.103:0/789129336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a0c0b2c10 0x7f6a0c149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:02.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a0a800640 1 -- 172.21.15.103:0/789129336 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a0c072500 msgr2=0x7f6a0c147c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:02.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a0a800640 1 --2- 172.21.15.103:0/789129336 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a0c072500 0x7f6a0c147c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:02.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a0a800640 1 -- 172.21.15.103:0/789129336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a0c0b2c10 msgr2=0x7f6a0c149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:02.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a0a800640 1 --2- 172.21.15.103:0/789129336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a0c0b2c10 0x7f6a0c149370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:02.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a0a800640 1 -- 172.21.15.103:0/789129336 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0c14b070 con 0x7f6a0c0cf260 2024-09-10T22:41:02.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a0a800640 1 --2- 172.21.15.103:0/789129336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c0cf260 0x7f6a0c153c60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400eb20 tx=0x7f6a0400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:02.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a02000640 1 -- 172.21.15.103:0/789129336 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04004b30 con 0x7f6a0c0cf260 2024-09-10T22:41:02.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a02000640 1 -- 172.21.15.103:0/789129336 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a04004cf0 con 0x7f6a0c0cf260 2024-09-10T22:41:02.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a02000640 1 -- 172.21.15.103:0/789129336 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04005280 con 0x7f6a0c0cf260 2024-09-10T22:41:02.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a11000640 1 -- 172.21.15.103:0/789129336 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0c14b2e0 con 0x7f6a0c0cf260 2024-09-10T22:41:02.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a11000640 1 -- 172.21.15.103:0/789129336 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a0c14b8a0 con 0x7f6a0c0cf260 2024-09-10T22:41:02.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.545+0000 7f6a11000640 1 -- 172.21.15.103:0/789129336 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a0c072970 con 0x7f6a0c0cf260 2024-09-10T22:41:02.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.549+0000 7f6a02000640 1 -- 172.21.15.103:0/789129336 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6a04005420 con 0x7f6a0c0cf260 2024-09-10T22:41:02.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.549+0000 7f6a02000640 1 --2- 172.21.15.103:0/789129336 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f69ec0725e0 0x7f69ec074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:02.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.549+0000 7f6a02000640 1 -- 172.21.15.103:0/789129336 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5507+0+0 (secure 0 0 0) 0x7f6a04093e10 con 0x7f6a0c0cf260 2024-09-10T22:41:02.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.549+0000 7f6a09e00640 1 --2- 172.21.15.103:0/789129336 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f69ec0725e0 0x7f69ec074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:02.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.549+0000 7f6a09e00640 1 --2- 172.21.15.103:0/789129336 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f69ec0725e0 0x7f69ec074aa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0af000 tx=0x7f69fc0a7040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:02.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.553+0000 7f6a02000640 1 -- 172.21.15.103:0/789129336 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6a04097030 con 0x7f6a0c0cf260 2024-09-10T22:41:02.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:02.733+0000 7f6a11000640 1 -- 172.21.15.103:0/789129336 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f6a0c156990 con 0x7f6a0c0cf260 2024-09-10T22:41:03.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.661+0000 7f6a02000640 1 -- 172.21.15.103:0/789129336 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) ==== 97+0+0 (secure 0 0 0) 0x7f6a0405eec0 con 0x7f6a0c0cf260 2024-09-10T22:41:03.667 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blocklist entries 2024-09-10T22:41:03.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.665+0000 7f6a11000640 1 -- 172.21.15.103:0/789129336 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f69ec0725e0 msgr2=0x7f69ec074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:03.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.665+0000 7f6a11000640 1 --2- 172.21.15.103:0/789129336 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f69ec0725e0 0x7f69ec074aa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0af000 tx=0x7f69fc0a7040 comp rx=0 tx=0).stop 2024-09-10T22:41:03.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.665+0000 7f6a11000640 1 -- 172.21.15.103:0/789129336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c0cf260 msgr2=0x7f6a0c153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:03.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.665+0000 7f6a11000640 1 --2- 172.21.15.103:0/789129336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c0cf260 0x7f6a0c153c60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400eb20 tx=0x7f6a0400c2d0 comp rx=0 tx=0).stop 2024-09-10T22:41:03.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.665+0000 7f6a11000640 1 -- 172.21.15.103:0/789129336 shutdown_connections 2024-09-10T22:41:03.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.665+0000 7f6a11000640 1 --2- 172.21.15.103:0/789129336 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f69ec0725e0 0x7f69ec074aa0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:03.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.665+0000 7f6a11000640 1 --2- 172.21.15.103:0/789129336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c0cf260 0x7f6a0c153c60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:03.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.665+0000 7f6a11000640 1 --2- 172.21.15.103:0/789129336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a0c0b2c10 0x7f6a0c149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:03.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.665+0000 7f6a11000640 1 --2- 172.21.15.103:0/789129336 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a0c072500 0x7f6a0c147c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:03.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.665+0000 7f6a11000640 1 -- 172.21.15.103:0/789129336 >> 172.21.15.103:0/789129336 conn(0x7f6a0c06cc00 msgr2=0x7f6a0c06fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:03.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.665+0000 7f6a11000640 1 -- 172.21.15.103:0/789129336 shutdown_connections 2024-09-10T22:41:03.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.665+0000 7f6a11000640 1 -- 172.21.15.103:0/789129336 wait complete. 2024-09-10T22:41:03.693 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T22:41:03.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.833+0000 7f85c5600640 1 -- 172.21.15.103:0/968140331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c00b09c0 msgr2=0x7f85c00ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:03.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.833+0000 7f85c5600640 1 --2- 172.21.15.103:0/968140331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c00b09c0 0x7f85c00ce7d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f85ac009900 tx=0x7f85ac01c850 comp rx=0 tx=0).stop 2024-09-10T22:41:03.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.833+0000 7f85c5600640 1 -- 172.21.15.103:0/968140331 shutdown_connections 2024-09-10T22:41:03.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.833+0000 7f85c5600640 1 --2- 172.21.15.103:0/968140331 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85c00ae9c0 0x7f85c00aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:03.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.833+0000 7f85c5600640 1 --2- 172.21.15.103:0/968140331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c00b09c0 0x7f85c00ce7d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:03.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.833+0000 7f85c5600640 1 -- 172.21.15.103:0/968140331 >> 172.21.15.103:0/968140331 conn(0x7f85c00d1ac0 msgr2=0x7f85c00d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:03.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.833+0000 7f85c5600640 1 -- 172.21.15.103:0/968140331 shutdown_connections 2024-09-10T22:41:03.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.833+0000 7f85c5600640 1 -- 172.21.15.103:0/968140331 wait complete. 2024-09-10T22:41:03.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85c5600640 1 Processor -- start 2024-09-10T22:41:03.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85c5600640 1 -- start start 2024-09-10T22:41:03.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85c5600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85c00ae9c0 0x7f85c006f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:03.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85c5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c00b09c0 0x7f85c014cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:03.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85c5600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85c015be30 0x7f85c0159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:03.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85c5600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f85c0168c70 con 0x7f85c00b09c0 2024-09-10T22:41:03.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85c5600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f85c00cef50 con 0x7f85c00ae9c0 2024-09-10T22:41:03.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85c5600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f85c0168df0 con 0x7f85c015be30 2024-09-10T22:41:03.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85be000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c00b09c0 0x7f85c014cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:03.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85be000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c00b09c0 0x7f85c014cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46708/0 (socket says 172.21.15.103:46708) 2024-09-10T22:41:03.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85be000640 1 -- 172.21.15.103:0/481144727 learned_addr learned my addr 172.21.15.103:0/481144727 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:03.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85bea00640 1 --2- 172.21.15.103:0/481144727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85c00ae9c0 0x7f85c006f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:03.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85bf400640 1 --2- 172.21.15.103:0/481144727 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85c015be30 0x7f85c0159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:03.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85be000640 1 -- 172.21.15.103:0/481144727 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85c015be30 msgr2=0x7f85c0159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:03.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85be000640 1 --2- 172.21.15.103:0/481144727 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85c015be30 0x7f85c0159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:03.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85be000640 1 -- 172.21.15.103:0/481144727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85c00ae9c0 msgr2=0x7f85c006f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:03.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85be000640 1 --2- 172.21.15.103:0/481144727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85c00ae9c0 0x7f85c006f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:03.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85be000640 1 -- 172.21.15.103:0/481144727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c006dd10 con 0x7f85c00b09c0 2024-09-10T22:41:03.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85be000640 1 --2- 172.21.15.103:0/481144727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c00b09c0 0x7f85c014cf00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0b0040 tx=0x7f85ac0a5680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:03.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85b6a00640 1 -- 172.21.15.103:0/481144727 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac0b2040 con 0x7f85c00b09c0 2024-09-10T22:41:03.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85b6a00640 1 -- 172.21.15.103:0/481144727 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85ac004470 con 0x7f85c00b09c0 2024-09-10T22:41:03.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85c5600640 1 -- 172.21.15.103:0/481144727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85c006dfb0 con 0x7f85c00b09c0 2024-09-10T22:41:03.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85b6a00640 1 -- 172.21.15.103:0/481144727 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac005290 con 0x7f85c00b09c0 2024-09-10T22:41:03.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85c5600640 1 -- 172.21.15.103:0/481144727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85c006e570 con 0x7f85c00b09c0 2024-09-10T22:41:03.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.837+0000 7f85c5600640 1 -- 172.21.15.103:0/481144727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85c00aee50 con 0x7f85c00b09c0 2024-09-10T22:41:03.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.841+0000 7f85b6a00640 1 -- 172.21.15.103:0/481144727 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f85ac005430 con 0x7f85c00b09c0 2024-09-10T22:41:03.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.841+0000 7f85b6a00640 1 --2- 172.21.15.103:0/481144727 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f85a00725e0 0x7f85a0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:03.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.841+0000 7f85b6a00640 1 -- 172.21.15.103:0/481144727 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5249+0+0 (secure 0 0 0) 0x7f85ac12c8d0 con 0x7f85c00b09c0 2024-09-10T22:41:03.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.841+0000 7f85bea00640 1 --2- 172.21.15.103:0/481144727 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f85a00725e0 0x7f85a0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:03.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.841+0000 7f85bea00640 1 --2- 172.21.15.103:0/481144727 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f85a00725e0 0x7f85a0074aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f85b0000f70 tx=0x7f85b0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:03.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:03.845+0000 7f85b6a00640 1 -- 172.21.15.103:0/481144727 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f85ac0164d0 con 0x7f85c00b09c0 2024-09-10T22:41:04.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.077+0000 7f85c5600640 1 -- 172.21.15.103:0/481144727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f85c00d2780 con 0x7f85c00b09c0 2024-09-10T22:41:04.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.077+0000 7f85b6a00640 1 -- 172.21.15.103:0/481144727 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7f85ac0f8050 con 0x7f85c00b09c0 2024-09-10T22:41:04.081 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:04.081 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:41:04.081 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2024-09-10T22:41:04.082 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.082 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2024-09-10T22:41:04.082 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmh8HQHBAAZlp4CnHLegqhgWrgXoyltw==", 2024-09-10T22:41:04.082 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.082 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:41:04.082 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:41:04.082 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:41:04.082 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:41:04.082 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.082 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:04.082 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.082 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2024-09-10T22:41:04.082 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmpYUNKRAAstv0pZDy3081UKcsSWnWIg==", 2024-09-10T22:41:04.082 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.083 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:41:04.083 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:41:04.083 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:41:04.083 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:41:04.083 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.083 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:04.083 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.083 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.c", 2024-09-10T22:41:04.083 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBm8I0TJBAAmW480qKYYrolVm7+SlJ97w==", 2024-09-10T22:41:04.083 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.083 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:41:04.083 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:41:04.083 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:41:04.083 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:41:04.083 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:04.084 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.084 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.d", 2024-09-10T22:41:04.084 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmB55uMBAA1VqVuUEAk1i2LFBoZXiRmA==", 2024-09-10T22:41:04.084 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.084 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:41:04.084 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:41:04.084 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:41:04.084 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:41:04.084 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:04.084 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.085 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2024-09-10T22:41:04.085 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA/yuBm+fNzNRAAwt8IZXd3mcEh5UbXc924UQ==", 2024-09-10T22:41:04.085 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.085 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:41:04.085 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:41:04.085 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:41:04.085 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.085 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:04.085 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.085 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2024-09-10T22:41:04.085 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBDyuBmNBfvDhAAcBNATtrJNZ4RFzYXqWt2pg==", 2024-09-10T22:41:04.085 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.085 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:41:04.085 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:41:04.085 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:41:04.086 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:04.086 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.086 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2024-09-10T22:41:04.086 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBGyuBmJD9HJBAAgq8tqoeDT8WNr7pMxQCCJw==", 2024-09-10T22:41:04.086 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.086 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:41:04.086 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:41:04.086 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:41:04.086 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:04.086 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.086 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2024-09-10T22:41:04.086 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBJyuBmzxWIOhAA4yOLmTZAY0MRLj+w3mhCeQ==", 2024-09-10T22:41:04.086 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.087 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:41:04.087 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:41:04.087 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:41:04.087 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.087 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:04.087 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.087 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2024-09-10T22:41:04.087 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBQyuBm3pi6ABAAnwu13uYkLRJuU5y+DE2Isw==", 2024-09-10T22:41:04.087 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.087 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:41:04.087 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:41:04.087 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:41:04.087 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.087 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:04.087 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.088 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2024-09-10T22:41:04.088 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBTyuBmkaPVFhAALlwgsnQ/dUJVLTK2iAh6Ww==", 2024-09-10T22:41:04.088 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.088 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:41:04.088 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:41:04.088 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:41:04.088 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:04.088 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.088 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2024-09-10T22:41:04.088 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBWyuBmL2kKKxAAbxeyAuzd994tvNfKKs+WIA==", 2024-09-10T22:41:04.088 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.088 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:41:04.089 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:41:04.089 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:41:04.089 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:04.089 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.089 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2024-09-10T22:41:04.089 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBayuBmUmSwBBAAWTFVgtYXlyEI+rJzGIM+Aw==", 2024-09-10T22:41:04.089 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.089 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:41:04.089 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:41:04.089 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:41:04.089 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:04.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.090 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2024-09-10T22:41:04.090 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmtOhZNBAAeszxWpV60NIn/zOInT5Zzw==", 2024-09-10T22:41:04.090 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.090 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:41:04.090 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2024-09-10T22:41:04.090 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T22:41:04.090 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:04.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.090 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2024-09-10T22:41:04.090 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9yuBmu20iAhAASacT/hh3sxW1XU/XD6uDjA==", 2024-09-10T22:41:04.090 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.090 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:41:04.090 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:41:04.091 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:41:04.091 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:41:04.091 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:04.091 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.091 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2024-09-10T22:41:04.091 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmd1E5OhAAfidEn8dwfGna8gwefsYtUg==", 2024-09-10T22:41:04.091 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.091 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:41:04.091 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:41:04.091 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:41:04.091 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:41:04.091 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2024-09-10T22:41:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9yuBmGGhVCBAAAs3y0cfqMN0t0/PTNsVEQw==", 2024-09-10T22:41:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:41:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:41:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:41:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:41:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2024-09-10T22:41:04.093 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmsY75ABAAYeEF+hTiVUtmqzwU0IIpjA==", 2024-09-10T22:41:04.093 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.093 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-09-10T22:41:04.093 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:41:04.093 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:41:04.093 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:41:04.093 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:04.093 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.093 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2024-09-10T22:41:04.093 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmghJQGBAAXvlC58nhT9H/c71/ToGCSw==", 2024-09-10T22:41:04.093 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.093 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-09-10T22:41:04.094 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2024-09-10T22:41:04.094 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:41:04.094 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.094 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:04.094 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.094 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2024-09-10T22:41:04.094 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBma9x+FBAAQrKkw3eGcKnLxSqVz/DHJQ==", 2024-09-10T22:41:04.094 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:41:04.094 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-09-10T22:41:04.094 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2024-09-10T22:41:04.094 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:41:04.094 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.094 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.094 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T22:41:04.095 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:41:04.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.077+0000 7f85c5600640 1 -- 172.21.15.103:0/481144727 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f85a00725e0 msgr2=0x7f85a0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:04.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.077+0000 7f85c5600640 1 --2- 172.21.15.103:0/481144727 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f85a00725e0 0x7f85a0074aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f85b0000f70 tx=0x7f85b0009040 comp rx=0 tx=0).stop 2024-09-10T22:41:04.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.077+0000 7f85c5600640 1 -- 172.21.15.103:0/481144727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c00b09c0 msgr2=0x7f85c014cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:04.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.077+0000 7f85c5600640 1 --2- 172.21.15.103:0/481144727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c00b09c0 0x7f85c014cf00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0b0040 tx=0x7f85ac0a5680 comp rx=0 tx=0).stop 2024-09-10T22:41:04.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.077+0000 7f85c5600640 1 -- 172.21.15.103:0/481144727 shutdown_connections 2024-09-10T22:41:04.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.077+0000 7f85c5600640 1 --2- 172.21.15.103:0/481144727 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f85a00725e0 0x7f85a0074aa0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.077+0000 7f85c5600640 1 --2- 172.21.15.103:0/481144727 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85c015be30 0x7f85c0159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.077+0000 7f85c5600640 1 --2- 172.21.15.103:0/481144727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c00b09c0 0x7f85c014cf00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.077+0000 7f85c5600640 1 --2- 172.21.15.103:0/481144727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85c00ae9c0 0x7f85c006f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.077+0000 7f85c5600640 1 -- 172.21.15.103:0/481144727 >> 172.21.15.103:0/481144727 conn(0x7f85c00d1ac0 msgr2=0x7f85c0158d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:04.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.077+0000 7f85c5600640 1 -- 172.21.15.103:0/481144727 shutdown_connections 2024-09-10T22:41:04.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.077+0000 7f85c5600640 1 -- 172.21.15.103:0/481144727 wait complete. 2024-09-10T22:41:04.103 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T22:41:04.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.237+0000 7f6e35400640 1 -- 172.21.15.103:0/919391235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e300d1460 msgr2=0x7f6e300cf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:04.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.237+0000 7f6e35400640 1 --2- 172.21.15.103:0/919391235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e300d1460 0x7f6e300cf2b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009840 tx=0x7f6e1801c700 comp rx=0 tx=0).stop 2024-09-10T22:41:04.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.237+0000 7f6e35400640 1 -- 172.21.15.103:0/919391235 shutdown_connections 2024-09-10T22:41:04.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.237+0000 7f6e35400640 1 --2- 172.21.15.103:0/919391235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e300d1460 0x7f6e300cf2b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.237+0000 7f6e35400640 1 --2- 172.21.15.103:0/919391235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e3006cc00 0x7f6e3006cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.237+0000 7f6e35400640 1 -- 172.21.15.103:0/919391235 >> 172.21.15.103:0/919391235 conn(0x7f6e300d0940 msgr2=0x7f6e300d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:04.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.237+0000 7f6e35400640 1 -- 172.21.15.103:0/919391235 shutdown_connections 2024-09-10T22:41:04.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.237+0000 7f6e35400640 1 -- 172.21.15.103:0/919391235 wait complete. 2024-09-10T22:41:04.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e35400640 1 Processor -- start 2024-09-10T22:41:04.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e35400640 1 -- start start 2024-09-10T22:41:04.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e35400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e3006cc00 0x7f6e301550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:04.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e35400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e30071be0 0x7f6e3006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:04.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e35400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e300d1460 0x7f6e3015ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:04.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e35400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6e30168900 con 0x7f6e30071be0 2024-09-10T22:41:04.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e35400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6e30168780 con 0x7f6e3006cc00 2024-09-10T22:41:04.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e35400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6e30168a80 con 0x7f6e300d1460 2024-09-10T22:41:04.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e25e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e30071be0 0x7f6e3006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:04.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e25e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e30071be0 0x7f6e3006fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46720/0 (socket says 172.21.15.103:46720) 2024-09-10T22:41:04.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e25e00640 1 -- 172.21.15.103:0/3939030191 learned_addr learned my addr 172.21.15.103:0/3939030191 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:04.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e2e800640 1 --2- 172.21.15.103:0/3939030191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e3006cc00 0x7f6e301550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:04.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e2f200640 1 --2- 172.21.15.103:0/3939030191 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e300d1460 0x7f6e3015ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:04.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e25e00640 1 -- 172.21.15.103:0/3939030191 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e300d1460 msgr2=0x7f6e3015ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:04.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e25e00640 1 --2- 172.21.15.103:0/3939030191 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e300d1460 0x7f6e3015ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e25e00640 1 -- 172.21.15.103:0/3939030191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e3006cc00 msgr2=0x7f6e301550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:04.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e25e00640 1 --2- 172.21.15.103:0/3939030191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e3006cc00 0x7f6e301550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e25e00640 1 -- 172.21.15.103:0/3939030191 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3015c450 con 0x7f6e30071be0 2024-09-10T22:41:04.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e25e00640 1 --2- 172.21.15.103:0/3939030191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e30071be0 0x7f6e3006fee0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009790 tx=0x7f6e180a5660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:04.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e27400640 1 -- 172.21.15.103:0/3939030191 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e180b2040 con 0x7f6e30071be0 2024-09-10T22:41:04.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e27400640 1 -- 172.21.15.103:0/3939030191 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e18004380 con 0x7f6e30071be0 2024-09-10T22:41:04.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e27400640 1 -- 172.21.15.103:0/3939030191 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18005280 con 0x7f6e30071be0 2024-09-10T22:41:04.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e35400640 1 -- 172.21.15.103:0/3939030191 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e30163c00 con 0x7f6e30071be0 2024-09-10T22:41:04.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.241+0000 7f6e35400640 1 -- 172.21.15.103:0/3939030191 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e301fb270 con 0x7f6e30071be0 2024-09-10T22:41:04.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.245+0000 7f6e35400640 1 -- 172.21.15.103:0/3939030191 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e3006cfe0 con 0x7f6e30071be0 2024-09-10T22:41:04.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.245+0000 7f6e27400640 1 -- 172.21.15.103:0/3939030191 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6e180b5070 con 0x7f6e30071be0 2024-09-10T22:41:04.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.245+0000 7f6e27400640 1 --2- 172.21.15.103:0/3939030191 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6e0c0725e0 0x7f6e0c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:04.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.245+0000 7f6e27400640 1 -- 172.21.15.103:0/3939030191 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5249+0+0 (secure 0 0 0) 0x7f6e1812c6d0 con 0x7f6e30071be0 2024-09-10T22:41:04.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.245+0000 7f6e2e800640 1 --2- 172.21.15.103:0/3939030191 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6e0c0725e0 0x7f6e0c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:04.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.245+0000 7f6e2e800640 1 --2- 172.21.15.103:0/3939030191 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6e0c0725e0 0x7f6e0c074aa0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000bc00 tx=0x7f6e2000b390 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:04.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.249+0000 7f6e27400640 1 -- 172.21.15.103:0/3939030191 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6e18016410 con 0x7f6e30071be0 2024-09-10T22:41:04.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.417+0000 7f6e35400640 1 -- 172.21.15.103:0/3939030191 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6e300cd0c0 con 0x7f6e30071be0 2024-09-10T22:41:04.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.417+0000 7f6e27400640 1 -- 172.21.15.103:0/3939030191 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v51) ==== 84+0+65 (secure 0 0 0) 0x7f6e180f7890 con 0x7f6e30071be0 2024-09-10T22:41:04.423 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:04.424 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-09-10T22:41:04.424 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:41:04.424 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2024-09-10T22:41:04.424 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": ".mgr" 2024-09-10T22:41:04.424 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:04.424 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-09-10T22:41:04.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.421+0000 7f6e35400640 1 -- 172.21.15.103:0/3939030191 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6e0c0725e0 msgr2=0x7f6e0c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:04.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.421+0000 7f6e35400640 1 --2- 172.21.15.103:0/3939030191 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6e0c0725e0 0x7f6e0c074aa0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000bc00 tx=0x7f6e2000b390 comp rx=0 tx=0).stop 2024-09-10T22:41:04.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.421+0000 7f6e35400640 1 -- 172.21.15.103:0/3939030191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e30071be0 msgr2=0x7f6e3006fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:04.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.421+0000 7f6e35400640 1 --2- 172.21.15.103:0/3939030191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e30071be0 0x7f6e3006fee0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009790 tx=0x7f6e180a5660 comp rx=0 tx=0).stop 2024-09-10T22:41:04.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.421+0000 7f6e35400640 1 -- 172.21.15.103:0/3939030191 shutdown_connections 2024-09-10T22:41:04.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.421+0000 7f6e35400640 1 --2- 172.21.15.103:0/3939030191 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6e0c0725e0 0x7f6e0c074aa0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.421+0000 7f6e35400640 1 --2- 172.21.15.103:0/3939030191 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e300d1460 0x7f6e3015ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.421+0000 7f6e35400640 1 --2- 172.21.15.103:0/3939030191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e30071be0 0x7f6e3006fee0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.421+0000 7f6e35400640 1 --2- 172.21.15.103:0/3939030191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e3006cc00 0x7f6e301550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.421+0000 7f6e35400640 1 -- 172.21.15.103:0/3939030191 >> 172.21.15.103:0/3939030191 conn(0x7f6e300d0940 msgr2=0x7f6e300d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:04.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.421+0000 7f6e35400640 1 -- 172.21.15.103:0/3939030191 shutdown_connections 2024-09-10T22:41:04.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.421+0000 7f6e35400640 1 -- 172.21.15.103:0/3939030191 wait complete. 2024-09-10T22:41:04.445 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T22:41:04.445 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T22:41:04.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.585+0000 7f3279400640 1 -- 172.21.15.103:0/3047473377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3258004d50 msgr2=0x7f32580051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:04.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.585+0000 7f3279400640 1 --2- 172.21.15.103:0/3047473377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3258004d50 0x7f32580051d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f326c009ee0 tx=0x7f326c01d5c0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.585+0000 7f3273200640 1 -- 172.21.15.103:0/3047473377 reap_dead start 2024-09-10T22:41:04.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.585+0000 7f3279400640 1 -- 172.21.15.103:0/3047473377 shutdown_connections 2024-09-10T22:41:04.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.585+0000 7f3279400640 1 -- 172.21.15.103:0/3047473377 >> 172.21.15.103:0/3047473377 conn(0x7f32740d1ad0 msgr2=0x7f32740d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:04.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.585+0000 7f3279400640 1 -- 172.21.15.103:0/3047473377 shutdown_connections 2024-09-10T22:41:04.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.585+0000 7f3279400640 1 -- 172.21.15.103:0/3047473377 wait complete. 2024-09-10T22:41:04.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3279400640 1 Processor -- start 2024-09-10T22:41:04.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3279400640 1 -- start start 2024-09-10T22:41:04.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3279400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3258004d50 0x7f32741fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:04.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3279400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3274155f30 0x7f32741f7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:04.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3279400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32740c9c60 0x7f32740b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:04.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3279400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3274166b00 con 0x7f3258004d50 2024-09-10T22:41:04.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3279400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3274166980 con 0x7f32740c9c60 2024-09-10T22:41:04.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3279400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3274166c80 con 0x7f3274155f30 2024-09-10T22:41:04.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3272800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3258004d50 0x7f32741fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:04.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3272800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3258004d50 0x7f32741fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46730/0 (socket says 172.21.15.103:46730) 2024-09-10T22:41:04.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3272800640 1 -- 172.21.15.103:0/757670333 learned_addr learned my addr 172.21.15.103:0/757670333 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:04.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3269e00640 1 --2- 172.21.15.103:0/757670333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3274155f30 0x7f32741f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:04.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3273200640 1 --2- 172.21.15.103:0/757670333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32740c9c60 0x7f32740b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:04.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3272800640 1 -- 172.21.15.103:0/757670333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3274155f30 msgr2=0x7f32741f7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:04.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3272800640 1 --2- 172.21.15.103:0/757670333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3274155f30 0x7f32741f7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3272800640 1 -- 172.21.15.103:0/757670333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32740c9c60 msgr2=0x7f32740b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:04.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3272800640 1 --2- 172.21.15.103:0/757670333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32740c9c60 0x7f32740b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3272800640 1 -- 172.21.15.103:0/757670333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32741f80c0 con 0x7f3258004d50 2024-09-10T22:41:04.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3269e00640 1 --2- 172.21.15.103:0/757670333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3274155f30 0x7f32741f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:04.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3273200640 1 --2- 172.21.15.103:0/757670333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32740c9c60 0x7f32740b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:04.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3272800640 1 --2- 172.21.15.103:0/757670333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3258004d50 0x7f32741fbbf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f326400e640 tx=0x7f326400eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:04.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f326b400640 1 -- 172.21.15.103:0/757670333 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3264015070 con 0x7f3258004d50 2024-09-10T22:41:04.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f326b400640 1 -- 172.21.15.103:0/757670333 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f326400ca30 con 0x7f3258004d50 2024-09-10T22:41:04.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f326b400640 1 -- 172.21.15.103:0/757670333 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326400ce80 con 0x7f3258004d50 2024-09-10T22:41:04.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3279400640 1 -- 172.21.15.103:0/757670333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32741563b0 con 0x7f3258004d50 2024-09-10T22:41:04.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.589+0000 7f3279400640 1 -- 172.21.15.103:0/757670333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32741f8640 con 0x7f3258004d50 2024-09-10T22:41:04.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.593+0000 7f3279400640 1 -- 172.21.15.103:0/757670333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32740af720 con 0x7f3258004d50 2024-09-10T22:41:04.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.593+0000 7f326b400640 1 -- 172.21.15.103:0/757670333 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3264011460 con 0x7f3258004d50 2024-09-10T22:41:04.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.593+0000 7f326b400640 1 --2- 172.21.15.103:0/757670333 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3250072610 0x7f3250074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:04.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.593+0000 7f326b400640 1 -- 172.21.15.103:0/757670333 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5249+0+0 (secure 0 0 0) 0x7f3264093790 con 0x7f3258004d50 2024-09-10T22:41:04.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.593+0000 7f3269e00640 1 --2- 172.21.15.103:0/757670333 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3250072610 0x7f3250074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:04.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.593+0000 7f3269e00640 1 --2- 172.21.15.103:0/757670333 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3250072610 0x7f3250074ad0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f32740b45c0 tx=0x7f325c0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:04.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.597+0000 7f326b400640 1 -- 172.21.15.103:0/757670333 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f326405f040 con 0x7f3258004d50 2024-09-10T22:41:04.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.761+0000 7f3279400640 1 -- 172.21.15.103:0/757670333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f327406fa10 con 0x7f3258004d50 2024-09-10T22:41:04.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.965+0000 7f326b400640 1 -- 172.21.15.103:0/757670333 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v52) ==== 138+0+0 (secure 0 0 0) 0x7f326405e940 con 0x7f3258004d50 2024-09-10T22:41:04.972 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2024-09-10T22:41:04.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.969+0000 7f3279400640 1 -- 172.21.15.103:0/757670333 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3250072610 msgr2=0x7f3250074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:04.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.969+0000 7f3279400640 1 --2- 172.21.15.103:0/757670333 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3250072610 0x7f3250074ad0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f32740b45c0 tx=0x7f325c0091e0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.969+0000 7f3279400640 1 -- 172.21.15.103:0/757670333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3258004d50 msgr2=0x7f32741fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:04.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.969+0000 7f3279400640 1 --2- 172.21.15.103:0/757670333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3258004d50 0x7f32741fbbf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f326400e640 tx=0x7f326400eb00 comp rx=0 tx=0).stop 2024-09-10T22:41:04.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.969+0000 7f3279400640 1 -- 172.21.15.103:0/757670333 shutdown_connections 2024-09-10T22:41:04.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.969+0000 7f3279400640 1 --2- 172.21.15.103:0/757670333 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3250072610 0x7f3250074ad0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.969+0000 7f3279400640 1 --2- 172.21.15.103:0/757670333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32740c9c60 0x7f32740b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.969+0000 7f3279400640 1 --2- 172.21.15.103:0/757670333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3274155f30 0x7f32741f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.969+0000 7f3279400640 1 --2- 172.21.15.103:0/757670333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3258004d50 0x7f32741fbbf0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:04.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.969+0000 7f3279400640 1 -- 172.21.15.103:0/757670333 >> 172.21.15.103:0/757670333 conn(0x7f32740d1ad0 msgr2=0x7f32740cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:04.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.969+0000 7f3279400640 1 -- 172.21.15.103:0/757670333 shutdown_connections 2024-09-10T22:41:04.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:04.969+0000 7f3279400640 1 -- 172.21.15.103:0/757670333 wait complete. 2024-09-10T22:41:04.999 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T22:41:05.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.141+0000 7f7be2a00640 1 -- 172.21.15.103:0/2156081453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bdc0cffb0 msgr2=0x7f7bdc143a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:05.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.141+0000 7f7be2a00640 1 --2- 172.21.15.103:0/2156081453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bdc0cffb0 0x7f7bdc143a80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009c80 tx=0x7f7bd001cda0 comp rx=0 tx=0).stop 2024-09-10T22:41:05.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.141+0000 7f7be2a00640 1 -- 172.21.15.103:0/2156081453 shutdown_connections 2024-09-10T22:41:05.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.141+0000 7f7be2a00640 1 --2- 172.21.15.103:0/2156081453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bdc0cffb0 0x7f7bdc143a80 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:05.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.141+0000 7f7be2a00640 1 -- 172.21.15.103:0/2156081453 >> 172.21.15.103:0/2156081453 conn(0x7f7bdc0d0860 msgr2=0x7f7bdc0d0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:05.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.141+0000 7f7be2a00640 1 -- 172.21.15.103:0/2156081453 shutdown_connections 2024-09-10T22:41:05.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.141+0000 7f7be2a00640 1 -- 172.21.15.103:0/2156081453 wait complete. 2024-09-10T22:41:05.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2a00640 1 Processor -- start 2024-09-10T22:41:05.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2a00640 1 -- start start 2024-09-10T22:41:05.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bdc06f500 0x7f7bdc155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:05.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7bdc0cffb0 0x7f7bdc13cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:05.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bdc0d0390 0x7f7bdc13fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:05.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc06d7a0 con 0x7f7bdc0d0390 2024-09-10T22:41:05.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc06d620 con 0x7f7bdc06f500 2024-09-10T22:41:05.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7bdc06d920 con 0x7f7bdc0cffb0 2024-09-10T22:41:05.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bdc0d0390 0x7f7bdc13fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:05.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bdc0d0390 0x7f7bdc13fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46760/0 (socket says 172.21.15.103:46760) 2024-09-10T22:41:05.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2000640 1 -- 172.21.15.103:0/943107085 learned_addr learned my addr 172.21.15.103:0/943107085 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:05.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be0c00640 1 --2- 172.21.15.103:0/943107085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7bdc0cffb0 0x7f7bdc13cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:05.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be1600640 1 --2- 172.21.15.103:0/943107085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bdc06f500 0x7f7bdc155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:05.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2000640 1 -- 172.21.15.103:0/943107085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7bdc0cffb0 msgr2=0x7f7bdc13cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:05.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2000640 1 --2- 172.21.15.103:0/943107085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7bdc0cffb0 0x7f7bdc13cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:05.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2000640 1 -- 172.21.15.103:0/943107085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bdc06f500 msgr2=0x7f7bdc155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:05.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2000640 1 --2- 172.21.15.103:0/943107085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bdc06f500 0x7f7bdc155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:05.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2000640 1 -- 172.21.15.103:0/943107085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc155f80 con 0x7f7bdc0d0390 2024-09-10T22:41:05.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be0c00640 1 --2- 172.21.15.103:0/943107085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7bdc0cffb0 0x7f7bdc13cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:05.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2000640 1 --2- 172.21.15.103:0/943107085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bdc0d0390 0x7f7bdc13fb60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400c4d0 tx=0x7f7bd400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:05.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7bd9600640 1 -- 172.21.15.103:0/943107085 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4017070 con 0x7f7bdc0d0390 2024-09-10T22:41:05.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7bd9600640 1 -- 172.21.15.103:0/943107085 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bd40053c0 con 0x7f7bdc0d0390 2024-09-10T22:41:05.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2a00640 1 -- 172.21.15.103:0/943107085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bdc156230 con 0x7f7bdc0d0390 2024-09-10T22:41:05.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7bd9600640 1 -- 172.21.15.103:0/943107085 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4003860 con 0x7f7bdc0d0390 2024-09-10T22:41:05.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.145+0000 7f7be2a00640 1 -- 172.21.15.103:0/943107085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bdc1567d0 con 0x7f7bdc0d0390 2024-09-10T22:41:05.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.149+0000 7f7be2a00640 1 -- 172.21.15.103:0/943107085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bdc074690 con 0x7f7bdc0d0390 2024-09-10T22:41:05.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.149+0000 7f7bd9600640 1 -- 172.21.15.103:0/943107085 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7bd4003a00 con 0x7f7bdc0d0390 2024-09-10T22:41:05.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.149+0000 7f7bd9600640 1 --2- 172.21.15.103:0/943107085 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7bbc0725e0 0x7f7bbc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:05.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.149+0000 7f7bd9600640 1 -- 172.21.15.103:0/943107085 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5619+0+0 (secure 0 0 0) 0x7f7bd4092c40 con 0x7f7bdc0d0390 2024-09-10T22:41:05.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.149+0000 7f7be1600640 1 --2- 172.21.15.103:0/943107085 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7bbc0725e0 0x7f7bbc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:05.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.153+0000 7f7be1600640 1 --2- 172.21.15.103:0/943107085 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7bbc0725e0 0x7f7bbc074aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00af000 tx=0x7f7bd001b5e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:05.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.153+0000 7f7bd9600640 1 -- 172.21.15.103:0/943107085 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7bd4021020 con 0x7f7bdc0d0390 2024-09-10T22:41:05.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.317+0000 7f7be2a00640 1 -- 172.21.15.103:0/943107085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7bdc0d1690 con 0x7f7bdc0d0390 2024-09-10T22:41:05.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.976+0000 7f7bd9600640 1 -- 172.21.15.103:0/943107085 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v53) ==== 170+0+0 (secure 0 0 0) 0x7f7bd405dd90 con 0x7f7bdc0d0390 2024-09-10T22:41:05.982 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2024-09-10T22:41:05.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.980+0000 7f7be2a00640 1 -- 172.21.15.103:0/943107085 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7bbc0725e0 msgr2=0x7f7bbc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:05.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.980+0000 7f7be2a00640 1 --2- 172.21.15.103:0/943107085 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7bbc0725e0 0x7f7bbc074aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00af000 tx=0x7f7bd001b5e0 comp rx=0 tx=0).stop 2024-09-10T22:41:05.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.980+0000 7f7be2a00640 1 -- 172.21.15.103:0/943107085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bdc0d0390 msgr2=0x7f7bdc13fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:05.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.980+0000 7f7be2a00640 1 --2- 172.21.15.103:0/943107085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bdc0d0390 0x7f7bdc13fb60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400c4d0 tx=0x7f7bd400c990 comp rx=0 tx=0).stop 2024-09-10T22:41:05.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.980+0000 7f7be2a00640 1 -- 172.21.15.103:0/943107085 shutdown_connections 2024-09-10T22:41:05.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.980+0000 7f7be2a00640 1 --2- 172.21.15.103:0/943107085 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7bbc0725e0 0x7f7bbc074aa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:05.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.980+0000 7f7be2a00640 1 --2- 172.21.15.103:0/943107085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bdc0d0390 0x7f7bdc13fb60 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:05.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.980+0000 7f7be2a00640 1 --2- 172.21.15.103:0/943107085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7bdc0cffb0 0x7f7bdc13cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:05.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.980+0000 7f7be2a00640 1 --2- 172.21.15.103:0/943107085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bdc06f500 0x7f7bdc155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:05.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.980+0000 7f7be2a00640 1 -- 172.21.15.103:0/943107085 >> 172.21.15.103:0/943107085 conn(0x7f7bdc0d0860 msgr2=0x7f7bdc06db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:05.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.980+0000 7f7be2a00640 1 -- 172.21.15.103:0/943107085 shutdown_connections 2024-09-10T22:41:05.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:05.980+0000 7f7be2a00640 1 -- 172.21.15.103:0/943107085 wait complete. 2024-09-10T22:41:06.026 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T22:41:06.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.164+0000 7fe98ac00640 1 -- 172.21.15.103:0/2078597015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe98415be30 msgr2=0x7fe9840ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:06.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.164+0000 7fe98ac00640 1 --2- 172.21.15.103:0/2078597015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe98415be30 0x7fe9840ce0c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe974009900 tx=0x7fe97401c850 comp rx=0 tx=0).stop 2024-09-10T22:41:06.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.164+0000 7fe98ac00640 1 -- 172.21.15.103:0/2078597015 shutdown_connections 2024-09-10T22:41:06.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.164+0000 7fe98ac00640 1 --2- 172.21.15.103:0/2078597015 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9840ae9c0 0x7fe9840aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:06.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.164+0000 7fe98ac00640 1 --2- 172.21.15.103:0/2078597015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe98415be30 0x7fe9840ce0c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:06.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.164+0000 7fe98ac00640 1 -- 172.21.15.103:0/2078597015 >> 172.21.15.103:0/2078597015 conn(0x7fe9840d1ac0 msgr2=0x7fe9840d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:06.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.164+0000 7fe98ac00640 1 -- 172.21.15.103:0/2078597015 shutdown_connections 2024-09-10T22:41:06.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.164+0000 7fe98ac00640 1 -- 172.21.15.103:0/2078597015 wait complete. 2024-09-10T22:41:06.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe98ac00640 1 Processor -- start 2024-09-10T22:41:06.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe98ac00640 1 -- start start 2024-09-10T22:41:06.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe98ac00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9840ae9c0 0x7fe98414d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:06.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe98ac00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9840b09c0 0x7fe984156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:06.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe98ac00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe98415be30 0x7fe9841f8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:06.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe98ac00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe984168df0 con 0x7fe9840ae9c0 2024-09-10T22:41:06.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe98ac00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe984168c70 con 0x7fe98415be30 2024-09-10T22:41:06.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe98ac00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe984168f70 con 0x7fe9840b09c0 2024-09-10T22:41:06.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe983e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9840ae9c0 0x7fe98414d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:06.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe983e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9840ae9c0 0x7fe98414d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46766/0 (socket says 172.21.15.103:46766) 2024-09-10T22:41:06.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe983e00640 1 -- 172.21.15.103:0/1501257245 learned_addr learned my addr 172.21.15.103:0/1501257245 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:06.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe97b400640 1 --2- 172.21.15.103:0/1501257245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9840b09c0 0x7fe984156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:06.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe988c00640 1 --2- 172.21.15.103:0/1501257245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe98415be30 0x7fe9841f8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:06.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe983e00640 1 -- 172.21.15.103:0/1501257245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9840b09c0 msgr2=0x7fe984156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:06.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe983e00640 1 --2- 172.21.15.103:0/1501257245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9840b09c0 0x7fe984156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:06.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe983e00640 1 -- 172.21.15.103:0/1501257245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe98415be30 msgr2=0x7fe9841f8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:06.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe983e00640 1 --2- 172.21.15.103:0/1501257245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe98415be30 0x7fe9841f8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:06.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe983e00640 1 -- 172.21.15.103:0/1501257245 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9841550c0 con 0x7fe9840ae9c0 2024-09-10T22:41:06.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe983e00640 1 --2- 172.21.15.103:0/1501257245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9840ae9c0 0x7fe98414d890 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe974009850 tx=0x7fe974005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:06.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe980c00640 1 -- 172.21.15.103:0/1501257245 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9740b2040 con 0x7fe9840ae9c0 2024-09-10T22:41:06.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe980c00640 1 -- 172.21.15.103:0/1501257245 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe974004240 con 0x7fe9840ae9c0 2024-09-10T22:41:06.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe980c00640 1 -- 172.21.15.103:0/1501257245 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974005030 con 0x7fe9840ae9c0 2024-09-10T22:41:06.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe98ac00640 1 -- 172.21.15.103:0/1501257245 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe984155380 con 0x7fe9840ae9c0 2024-09-10T22:41:06.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.168+0000 7fe98ac00640 1 -- 172.21.15.103:0/1501257245 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe984155940 con 0x7fe9840ae9c0 2024-09-10T22:41:06.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.172+0000 7fe98ac00640 1 -- 172.21.15.103:0/1501257245 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9840aee50 con 0x7fe9840ae9c0 2024-09-10T22:41:06.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.172+0000 7fe980c00640 1 -- 172.21.15.103:0/1501257245 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe9740051d0 con 0x7fe9840ae9c0 2024-09-10T22:41:06.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.172+0000 7fe980c00640 1 --2- 172.21.15.103:0/1501257245 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe960072610 0x7fe960074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:06.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.172+0000 7fe980c00640 1 -- 172.21.15.103:0/1501257245 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6001+0+0 (secure 0 0 0) 0x7fe97412cd70 con 0x7fe9840ae9c0 2024-09-10T22:41:06.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.172+0000 7fe97b400640 1 --2- 172.21.15.103:0/1501257245 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe960072610 0x7fe960074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:06.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.172+0000 7fe97b400640 1 --2- 172.21.15.103:0/1501257245 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe960072610 0x7fe960074ad0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe9840ceae0 tx=0x7fe96c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:06.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.176+0000 7fe980c00640 1 -- 172.21.15.103:0/1501257245 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe9740164d0 con 0x7fe9840ae9c0 2024-09-10T22:41:06.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.376+0000 7fe98ac00640 1 -- 172.21.15.103:0/1501257245 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe98406fb80 con 0x7fe9840ae9c0 2024-09-10T22:41:06.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.976+0000 7fe980c00640 1 -- 172.21.15.103:0/1501257245 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v31) ==== 172+0+0 (secure 0 0 0) 0x7fe9740f8280 con 0x7fe9840ae9c0 2024-09-10T22:41:06.985 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 7 and data pool 8 2024-09-10T22:41:06.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.984+0000 7fe98ac00640 1 -- 172.21.15.103:0/1501257245 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe960072610 msgr2=0x7fe960074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:06.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.984+0000 7fe98ac00640 1 --2- 172.21.15.103:0/1501257245 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe960072610 0x7fe960074ad0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe9840ceae0 tx=0x7fe96c009040 comp rx=0 tx=0).stop 2024-09-10T22:41:06.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.984+0000 7fe98ac00640 1 -- 172.21.15.103:0/1501257245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9840ae9c0 msgr2=0x7fe98414d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:06.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.984+0000 7fe98ac00640 1 --2- 172.21.15.103:0/1501257245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9840ae9c0 0x7fe98414d890 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe974009850 tx=0x7fe974005de0 comp rx=0 tx=0).stop 2024-09-10T22:41:06.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.988+0000 7fe98ac00640 1 -- 172.21.15.103:0/1501257245 shutdown_connections 2024-09-10T22:41:06.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.988+0000 7fe98ac00640 1 --2- 172.21.15.103:0/1501257245 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe960072610 0x7fe960074ad0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:06.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.988+0000 7fe98ac00640 1 --2- 172.21.15.103:0/1501257245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe98415be30 0x7fe9841f8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:06.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.988+0000 7fe98ac00640 1 --2- 172.21.15.103:0/1501257245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9840b09c0 0x7fe984156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:06.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.988+0000 7fe98ac00640 1 --2- 172.21.15.103:0/1501257245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9840ae9c0 0x7fe98414d890 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:06.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.988+0000 7fe98ac00640 1 -- 172.21.15.103:0/1501257245 >> 172.21.15.103:0/1501257245 conn(0x7fe9840d1ac0 msgr2=0x7fe98406e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:06.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.988+0000 7fe98ac00640 1 -- 172.21.15.103:0/1501257245 shutdown_connections 2024-09-10T22:41:06.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:06.988+0000 7fe98ac00640 1 -- 172.21.15.103:0/1501257245 wait complete. 2024-09-10T22:41:07.039 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:41:07.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.176+0000 7f650e000640 1 -- 172.21.15.103:0/3591569734 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65080cd500 msgr2=0x7f650815f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:07.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.176+0000 7f650e000640 1 --2- 172.21.15.103:0/3591569734 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65080cd500 0x7f650815f890 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6500009c80 tx=0x7f650001cda0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.176+0000 7f650e000640 1 -- 172.21.15.103:0/3591569734 shutdown_connections 2024-09-10T22:41:07.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.176+0000 7f650e000640 1 --2- 172.21.15.103:0/3591569734 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65080cd500 0x7f650815f890 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.176+0000 7f650e000640 1 --2- 172.21.15.103:0/3591569734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f650815f1a0 0x7f65080ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.176+0000 7f650e000640 1 -- 172.21.15.103:0/3591569734 >> 172.21.15.103:0/3591569734 conn(0x7f65080d1a20 msgr2=0x7f65080d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:07.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.176+0000 7f650e000640 1 -- 172.21.15.103:0/3591569734 shutdown_connections 2024-09-10T22:41:07.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.176+0000 7f650e000640 1 -- 172.21.15.103:0/3591569734 wait complete. 2024-09-10T22:41:07.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f650e000640 1 Processor -- start 2024-09-10T22:41:07.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f650e000640 1 -- start start 2024-09-10T22:41:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f650e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65080cd500 0x7f65081f9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f650e000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65080cdd00 0x7f6508158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f650e000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f650815f1a0 0x7f65080b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f650e000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6508168f60 con 0x7f65080cd500 2024-09-10T22:41:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f650e000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6508168de0 con 0x7f65080cdd00 2024-09-10T22:41:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f650e000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f65081690e0 con 0x7f650815f1a0 2024-09-10T22:41:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f6507400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65080cd500 0x7f65081f9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f6507400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65080cd500 0x7f65081f9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56484/0 (socket says 172.21.15.103:56484) 2024-09-10T22:41:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f6507400640 1 -- 172.21.15.103:0/3674172628 learned_addr learned my addr 172.21.15.103:0/3674172628 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f6507e00640 1 --2- 172.21.15.103:0/3674172628 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f650815f1a0 0x7f65080b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f64fea00640 1 --2- 172.21.15.103:0/3674172628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65080cdd00 0x7f6508158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:07.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f6507400640 1 -- 172.21.15.103:0/3674172628 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f650815f1a0 msgr2=0x7f65080b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:07.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f6507400640 1 --2- 172.21.15.103:0/3674172628 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f650815f1a0 0x7f65080b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f6507400640 1 -- 172.21.15.103:0/3674172628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65080cdd00 msgr2=0x7f6508158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:07.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f6507400640 1 --2- 172.21.15.103:0/3674172628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65080cdd00 0x7f6508158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f6507400640 1 -- 172.21.15.103:0/3674172628 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65081f9b80 con 0x7f65080cd500 2024-09-10T22:41:07.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f64fea00640 1 --2- 172.21.15.103:0/3674172628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65080cdd00 0x7f6508158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:07.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f6507400640 1 --2- 172.21.15.103:0/3674172628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65080cd500 0x7f65081f9640 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f64f80058d0 tx=0x7f64f800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:07.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f64ffe00640 1 -- 172.21.15.103:0/3674172628 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f8017070 con 0x7f65080cd500 2024-09-10T22:41:07.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f64ffe00640 1 -- 172.21.15.103:0/3674172628 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64f8009d20 con 0x7f65080cd500 2024-09-10T22:41:07.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f650e000640 1 -- 172.21.15.103:0/3674172628 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f650815e880 con 0x7f65080cd500 2024-09-10T22:41:07.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f64ffe00640 1 -- 172.21.15.103:0/3674172628 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f80106c0 con 0x7f65080cd500 2024-09-10T22:41:07.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f650e000640 1 -- 172.21.15.103:0/3674172628 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65081582f0 con 0x7f65080cd500 2024-09-10T22:41:07.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.180+0000 7f650e000640 1 -- 172.21.15.103:0/3674172628 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f650815f890 con 0x7f65080cd500 2024-09-10T22:41:07.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.184+0000 7f64ffe00640 1 -- 172.21.15.103:0/3674172628 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f64f8010860 con 0x7f65080cd500 2024-09-10T22:41:07.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.184+0000 7f64ffe00640 1 --2- 172.21.15.103:0/3674172628 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f64e40725e0 0x7f64e4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:07.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.184+0000 7f64ffe00640 1 -- 172.21.15.103:0/3674172628 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f64f8093890 con 0x7f65080cd500 2024-09-10T22:41:07.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.184+0000 7f64fea00640 1 --2- 172.21.15.103:0/3674172628 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f64e40725e0 0x7f64e4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:07.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.184+0000 7f64fea00640 1 --2- 172.21.15.103:0/3674172628 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f64e40725e0 0x7f64e4074aa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f65080ce200 tx=0x7f64f0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:07.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.188+0000 7f64ffe00640 1 -- 172.21.15.103:0/3674172628 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f65081f9b80 con 0x7f65080cd500 2024-09-10T22:41:07.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.356+0000 7f650e000640 1 -- 172.21.15.103:0/3674172628 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65080af1f0 con 0x7f65080cd500 2024-09-10T22:41:07.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.356+0000 7f64ffe00640 1 -- 172.21.15.103:0/3674172628 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+17075 (secure 0 0 0) 0x7f64f805e6f0 con 0x7f65080cd500 2024-09-10T22:41:07.364 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:07.364 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:41:06.381740+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:41:04.777605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-10T22:41:05.333657+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:41:07.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.360+0000 7f650e000640 1 -- 172.21.15.103:0/3674172628 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f64e40725e0 msgr2=0x7f64e4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:07.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.360+0000 7f650e000640 1 --2- 172.21.15.103:0/3674172628 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f64e40725e0 0x7f64e4074aa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f65080ce200 tx=0x7f64f0009040 comp rx=0 tx=0).stop 2024-09-10T22:41:07.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.360+0000 7f650e000640 1 -- 172.21.15.103:0/3674172628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65080cd500 msgr2=0x7f65081f9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:07.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.360+0000 7f650e000640 1 --2- 172.21.15.103:0/3674172628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65080cd500 0x7f65081f9640 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f64f80058d0 tx=0x7f64f800dde0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.360+0000 7f650e000640 1 -- 172.21.15.103:0/3674172628 shutdown_connections 2024-09-10T22:41:07.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.360+0000 7f650e000640 1 --2- 172.21.15.103:0/3674172628 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f64e40725e0 0x7f64e4074aa0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.360+0000 7f650e000640 1 --2- 172.21.15.103:0/3674172628 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f650815f1a0 0x7f65080b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.360+0000 7f650e000640 1 --2- 172.21.15.103:0/3674172628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65080cdd00 0x7f6508158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.360+0000 7f650e000640 1 --2- 172.21.15.103:0/3674172628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65080cd500 0x7f65081f9640 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.360+0000 7f650e000640 1 -- 172.21.15.103:0/3674172628 >> 172.21.15.103:0/3674172628 conn(0x7f65080d1a20 msgr2=0x7f6508070990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:07.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.360+0000 7f650e000640 1 -- 172.21.15.103:0/3674172628 shutdown_connections 2024-09-10T22:41:07.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.360+0000 7f650e000640 1 -- 172.21.15.103:0/3674172628 wait complete. 2024-09-10T22:41:07.386 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:41:07.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.524+0000 7fded1400640 1 -- 172.21.15.103:0/1065596975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeb0004810 msgr2=0x7fdeb0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:07.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.524+0000 7fded1400640 1 --2- 172.21.15.103:0/1065596975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeb0004810 0x7fdeb0004c90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4006f90 tx=0x7fdeb401cc40 comp rx=0 tx=0).stop 2024-09-10T22:41:07.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.524+0000 7fdecb200640 1 -- 172.21.15.103:0/1065596975 reap_dead start 2024-09-10T22:41:07.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.524+0000 7fded1400640 1 -- 172.21.15.103:0/1065596975 shutdown_connections 2024-09-10T22:41:07.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.524+0000 7fded1400640 1 -- 172.21.15.103:0/1065596975 >> 172.21.15.103:0/1065596975 conn(0x7fdecc0b1c00 msgr2=0x7fdecc0b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:07.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.524+0000 7fded1400640 1 -- 172.21.15.103:0/1065596975 shutdown_connections 2024-09-10T22:41:07.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.524+0000 7fded1400640 1 -- 172.21.15.103:0/1065596975 wait complete. 2024-09-10T22:41:07.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.524+0000 7fded1400640 1 Processor -- start 2024-09-10T22:41:07.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.524+0000 7fded1400640 1 -- start start 2024-09-10T22:41:07.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.524+0000 7fded1400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdeb0004810 0x7fdecc155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:07.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.524+0000 7fded1400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdecc074280 0x7fdecc074700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:07.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.524+0000 7fded1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdecc072c10 0x7fdecc073070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:07.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.524+0000 7fded1400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc163890 con 0x7fdecc072c10 2024-09-10T22:41:07.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.524+0000 7fded1400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc163710 con 0x7fdecc074280 2024-09-10T22:41:07.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.524+0000 7fded1400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdecc163a10 con 0x7fdeb0004810 2024-09-10T22:41:07.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.528+0000 7fdecb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdecc072c10 0x7fdecc073070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:07.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.528+0000 7fdecb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdecc072c10 0x7fdecc073070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56488/0 (socket says 172.21.15.103:56488) 2024-09-10T22:41:07.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.528+0000 7fdecb200640 1 -- 172.21.15.103:0/1232668053 learned_addr learned my addr 172.21.15.103:0/1232668053 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:07.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.528+0000 7fdeca800640 1 --2- 172.21.15.103:0/1232668053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdeb0004810 0x7fdecc155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:07.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.528+0000 7fdec1e00640 1 --2- 172.21.15.103:0/1232668053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdecc074280 0x7fdecc074700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:07.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.528+0000 7fdecb200640 1 -- 172.21.15.103:0/1232668053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdeb0004810 msgr2=0x7fdecc155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:07.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.528+0000 7fdecb200640 1 --2- 172.21.15.103:0/1232668053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdeb0004810 0x7fdecc155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.528+0000 7fdecb200640 1 -- 172.21.15.103:0/1232668053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdecc074280 msgr2=0x7fdecc074700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:07.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.528+0000 7fdecb200640 1 --2- 172.21.15.103:0/1232668053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdecc074280 0x7fdecc074700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.528+0000 7fdecb200640 1 -- 172.21.15.103:0/1232668053 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdecc073890 con 0x7fdecc072c10 2024-09-10T22:41:07.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.528+0000 7fdecb200640 1 --2- 172.21.15.103:0/1232668053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdecc072c10 0x7fdecc073070 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdecc15e430 tx=0x7fdec4011b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:07.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.528+0000 7fdec3400640 1 -- 172.21.15.103:0/1232668053 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec400f8c0 con 0x7fdecc072c10 2024-09-10T22:41:07.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.528+0000 7fdec3400640 1 -- 172.21.15.103:0/1232668053 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdec400fa80 con 0x7fdecc072c10 2024-09-10T22:41:07.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.528+0000 7fdec3400640 1 -- 172.21.15.103:0/1232668053 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec4005020 con 0x7fdecc072c10 2024-09-10T22:41:07.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.528+0000 7fded1400640 1 -- 172.21.15.103:0/1232668053 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdecc1f7ea0 con 0x7fdecc072c10 2024-09-10T22:41:07.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.528+0000 7fded1400640 1 -- 172.21.15.103:0/1232668053 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdecc155b80 con 0x7fdecc072c10 2024-09-10T22:41:07.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.528+0000 7fded1400640 1 -- 172.21.15.103:0/1232668053 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdecc1f7c90 con 0x7fdecc072c10 2024-09-10T22:41:07.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.528+0000 7fdec3400640 1 -- 172.21.15.103:0/1232668053 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdec4018030 con 0x7fdecc072c10 2024-09-10T22:41:07.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.532+0000 7fdec3400640 1 --2- 172.21.15.103:0/1232668053 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdea80725e0 0x7fdea8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:07.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.532+0000 7fdec3400640 1 -- 172.21.15.103:0/1232668053 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fdec4093b50 con 0x7fdecc072c10 2024-09-10T22:41:07.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.532+0000 7fdeca800640 1 --2- 172.21.15.103:0/1232668053 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdea80725e0 0x7fdea8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:07.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.532+0000 7fdeca800640 1 --2- 172.21.15.103:0/1232668053 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdea80725e0 0x7fdea8074aa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdebc006fd0 tx=0x7fdebc006ea0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.532+0000 7fdec3400640 1 -- 172.21.15.103:0/1232668053 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdec405f130 con 0x7fdecc072c10 2024-09-10T22:41:07.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.700+0000 7fded1400640 1 -- 172.21.15.103:0/1232668053 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdecc0acee0 con 0x7fdecc072c10 2024-09-10T22:41:07.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.700+0000 7fdec3400640 1 -- 172.21.15.103:0/1232668053 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+17075 (secure 0 0 0) 0x7fdec405ea30 con 0x7fdecc072c10 2024-09-10T22:41:07.706 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:07.707 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:41:06.381740+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:41:04.777605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-10T22:41:05.333657+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:41:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.704+0000 7fded1400640 1 -- 172.21.15.103:0/1232668053 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdea80725e0 msgr2=0x7fdea8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.704+0000 7fded1400640 1 --2- 172.21.15.103:0/1232668053 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdea80725e0 0x7fdea8074aa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdebc006fd0 tx=0x7fdebc006ea0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.704+0000 7fded1400640 1 -- 172.21.15.103:0/1232668053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdecc072c10 msgr2=0x7fdecc073070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.704+0000 7fded1400640 1 --2- 172.21.15.103:0/1232668053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdecc072c10 0x7fdecc073070 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdecc15e430 tx=0x7fdec4011b80 comp rx=0 tx=0).stop 2024-09-10T22:41:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.704+0000 7fded1400640 1 -- 172.21.15.103:0/1232668053 shutdown_connections 2024-09-10T22:41:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.704+0000 7fded1400640 1 --2- 172.21.15.103:0/1232668053 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdea80725e0 0x7fdea8074aa0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.704+0000 7fded1400640 1 --2- 172.21.15.103:0/1232668053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdecc072c10 0x7fdecc073070 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.704+0000 7fded1400640 1 --2- 172.21.15.103:0/1232668053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdecc074280 0x7fdecc074700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.704+0000 7fded1400640 1 --2- 172.21.15.103:0/1232668053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdeb0004810 0x7fdecc155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.704+0000 7fded1400640 1 -- 172.21.15.103:0/1232668053 >> 172.21.15.103:0/1232668053 conn(0x7fdecc0b1c00 msgr2=0x7fdecc156250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:07.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.704+0000 7fded1400640 1 -- 172.21.15.103:0/1232668053 shutdown_connections 2024-09-10T22:41:07.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.704+0000 7fded1400640 1 -- 172.21.15.103:0/1232668053 wait complete. 2024-09-10T22:41:07.728 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T22:41:07.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.864+0000 7f413b200640 1 -- 172.21.15.103:0/2459666985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f413c15b7d0 msgr2=0x7f413c0d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:07.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.864+0000 7f413b200640 1 --2- 172.21.15.103:0/2459666985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f413c15b7d0 0x7f413c0d00b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f412c009c80 tx=0x7f412c01cda0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.864+0000 7f413b200640 1 -- 172.21.15.103:0/2459666985 shutdown_connections 2024-09-10T22:41:07.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.864+0000 7f413b200640 1 --2- 172.21.15.103:0/2459666985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f413c0ce790 0x7f413c071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.864+0000 7f413b200640 1 --2- 172.21.15.103:0/2459666985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f413c15b7d0 0x7f413c0d00b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.864+0000 7f413b200640 1 -- 172.21.15.103:0/2459666985 >> 172.21.15.103:0/2459666985 conn(0x7f413c0b2300 msgr2=0x7f413c0b2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:07.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.864+0000 7f413b200640 1 -- 172.21.15.103:0/2459666985 shutdown_connections 2024-09-10T22:41:07.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.864+0000 7f413b200640 1 -- 172.21.15.103:0/2459666985 wait complete. 2024-09-10T22:41:07.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f413b200640 1 Processor -- start 2024-09-10T22:41:07.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f413b200640 1 -- start start 2024-09-10T22:41:07.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f413b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f413c071840 0x7f413c165510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:07.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f413b200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f413c0ce790 0x7f413c0ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:07.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f413b200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f413c15b7d0 0x7f413c1fb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:07.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f413b200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f413c168b70 con 0x7f413c071840 2024-09-10T22:41:07.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f413b200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f413c1689f0 con 0x7f413c15b7d0 2024-09-10T22:41:07.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f413b200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f413c168cf0 con 0x7f413c0ce790 2024-09-10T22:41:07.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f4139e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f413c071840 0x7f413c165510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:07.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f4139e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f413c071840 0x7f413c165510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56518/0 (socket says 172.21.15.103:56518) 2024-09-10T22:41:07.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f4139e00640 1 -- 172.21.15.103:0/2442457158 learned_addr learned my addr 172.21.15.103:0/2442457158 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:07.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f4131400640 1 --2- 172.21.15.103:0/2442457158 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f413c0ce790 0x7f413c0ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:07.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f413a800640 1 --2- 172.21.15.103:0/2442457158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f413c15b7d0 0x7f413c1fb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:07.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f4139e00640 1 -- 172.21.15.103:0/2442457158 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f413c0ce790 msgr2=0x7f413c0ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:07.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f4139e00640 1 --2- 172.21.15.103:0/2442457158 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f413c0ce790 0x7f413c0ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f4139e00640 1 -- 172.21.15.103:0/2442457158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f413c15b7d0 msgr2=0x7f413c1fb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:07.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f4139e00640 1 --2- 172.21.15.103:0/2442457158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f413c15b7d0 0x7f413c1fb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:07.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f4139e00640 1 -- 172.21.15.103:0/2442457158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413c165af0 con 0x7f413c071840 2024-09-10T22:41:07.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f4131400640 1 --2- 172.21.15.103:0/2442457158 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f413c0ce790 0x7f413c0ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:07.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f413a800640 1 --2- 172.21.15.103:0/2442457158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f413c15b7d0 0x7f413c1fb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:07.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f4139e00640 1 --2- 172.21.15.103:0/2442457158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f413c071840 0x7f413c165510 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f412c009bd0 tx=0x7f412c009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:07.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f4132a00640 1 -- 172.21.15.103:0/2442457158 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c0bb070 con 0x7f413c071840 2024-09-10T22:41:07.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f4132a00640 1 -- 172.21.15.103:0/2442457158 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f412c004c50 con 0x7f413c071840 2024-09-10T22:41:07.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f4132a00640 1 -- 172.21.15.103:0/2442457158 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c0b2040 con 0x7f413c071840 2024-09-10T22:41:07.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f413b200640 1 -- 172.21.15.103:0/2442457158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413c165dd0 con 0x7f413c071840 2024-09-10T22:41:07.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.868+0000 7f413b200640 1 -- 172.21.15.103:0/2442457158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f413c1fafc0 con 0x7f413c071840 2024-09-10T22:41:07.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.872+0000 7f413b200640 1 -- 172.21.15.103:0/2442457158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f413c071300 con 0x7f413c071840 2024-09-10T22:41:07.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.872+0000 7f4132a00640 1 -- 172.21.15.103:0/2442457158 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f412c0b5070 con 0x7f413c071840 2024-09-10T22:41:07.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.872+0000 7f4132a00640 1 --2- 172.21.15.103:0/2442457158 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f41180725e0 0x7f4118074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:07.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.872+0000 7f4132a00640 1 -- 172.21.15.103:0/2442457158 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f412c12cee0 con 0x7f413c071840 2024-09-10T22:41:07.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.872+0000 7f4131400640 1 --2- 172.21.15.103:0/2442457158 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f41180725e0 0x7f4118074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:07.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.872+0000 7f4131400640 1 --2- 172.21.15.103:0/2442457158 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f41180725e0 0x7f4118074aa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f41240058d0 tx=0x7f4124005860 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:07.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:07.876+0000 7f4132a00640 1 -- 172.21.15.103:0/2442457158 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f412c016990 con 0x7f413c071840 2024-09-10T22:41:08.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:08.080+0000 7f413b200640 1 -- 172.21.15.103:0/2442457158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f413c158010 con 0x7f413c071840 2024-09-10T22:41:09.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.016+0000 7f4132a00640 1 -- 172.21.15.103:0/2442457158 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) ==== 118+0+0 (secure 0 0 0) 0x7f412c0f8440 con 0x7f413c071840 2024-09-10T22:41:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.016+0000 7f413b200640 1 -- 172.21.15.103:0/2442457158 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f41180725e0 msgr2=0x7f4118074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.016+0000 7f413b200640 1 --2- 172.21.15.103:0/2442457158 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f41180725e0 0x7f4118074aa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f41240058d0 tx=0x7f4124005860 comp rx=0 tx=0).stop 2024-09-10T22:41:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.016+0000 7f413b200640 1 -- 172.21.15.103:0/2442457158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f413c071840 msgr2=0x7f413c165510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.016+0000 7f413b200640 1 --2- 172.21.15.103:0/2442457158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f413c071840 0x7f413c165510 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f412c009bd0 tx=0x7f412c009360 comp rx=0 tx=0).stop 2024-09-10T22:41:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.016+0000 7f413b200640 1 -- 172.21.15.103:0/2442457158 shutdown_connections 2024-09-10T22:41:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.016+0000 7f413b200640 1 --2- 172.21.15.103:0/2442457158 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f41180725e0 0x7f4118074aa0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.016+0000 7f413b200640 1 --2- 172.21.15.103:0/2442457158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f413c15b7d0 0x7f413c1fb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.016+0000 7f413b200640 1 --2- 172.21.15.103:0/2442457158 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f413c0ce790 0x7f413c0ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:09.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.016+0000 7f413b200640 1 --2- 172.21.15.103:0/2442457158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f413c071840 0x7f413c165510 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:09.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.016+0000 7f413b200640 1 -- 172.21.15.103:0/2442457158 >> 172.21.15.103:0/2442457158 conn(0x7f413c0b2300 msgr2=0x7f413c158530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:09.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.016+0000 7f413b200640 1 -- 172.21.15.103:0/2442457158 shutdown_connections 2024-09-10T22:41:09.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.016+0000 7f413b200640 1 -- 172.21.15.103:0/2442457158 wait complete. 2024-09-10T22:41:09.047 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T22:41:09.047 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T22:41:09.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.188+0000 7fbbebc00640 1 -- 172.21.15.103:0/51162866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc8003fe0 msgr2=0x7fbbc8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:09.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.188+0000 7fbbebc00640 1 --2- 172.21.15.103:0/51162866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc8003fe0 0x7fbbc8004810 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009b90 tx=0x7fbbd001d2b0 comp rx=0 tx=0).stop 2024-09-10T22:41:09.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.188+0000 7fbbe9c00640 1 -- 172.21.15.103:0/51162866 reap_dead start 2024-09-10T22:41:09.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.188+0000 7fbbebc00640 1 -- 172.21.15.103:0/51162866 shutdown_connections 2024-09-10T22:41:09.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.188+0000 7fbbebc00640 1 -- 172.21.15.103:0/51162866 >> 172.21.15.103:0/51162866 conn(0x7fbbe40d1a20 msgr2=0x7fbbe40d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:09.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.188+0000 7fbbebc00640 1 -- 172.21.15.103:0/51162866 shutdown_connections 2024-09-10T22:41:09.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.188+0000 7fbbebc00640 1 -- 172.21.15.103:0/51162866 wait complete. 2024-09-10T22:41:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbebc00640 1 Processor -- start 2024-09-10T22:41:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbebc00640 1 -- start start 2024-09-10T22:41:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbebc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc8003fe0 0x7fbbe40b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbebc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbe40b4a60 0x7fbbe4158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbebc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbbe415aa70 0x7fbbe40cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbebc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe40cd990 con 0x7fbbc8003fe0 2024-09-10T22:41:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbebc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe40cdb10 con 0x7fbbe40b4a60 2024-09-10T22:41:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbebc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe415f890 con 0x7fbbe415aa70 2024-09-10T22:41:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbe9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc8003fe0 0x7fbbe40b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbe9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc8003fe0 0x7fbbe40b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56534/0 (socket says 172.21.15.103:56534) 2024-09-10T22:41:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbe9200640 1 -- 172.21.15.103:0/2390305679 learned_addr learned my addr 172.21.15.103:0/2390305679 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbe3e00640 1 --2- 172.21.15.103:0/2390305679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbe40b4a60 0x7fbbe4158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbe9c00640 1 --2- 172.21.15.103:0/2390305679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbbe415aa70 0x7fbbe40cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbe9200640 1 -- 172.21.15.103:0/2390305679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbbe415aa70 msgr2=0x7fbbe40cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbe9200640 1 --2- 172.21.15.103:0/2390305679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbbe415aa70 0x7fbbe40cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbe9200640 1 -- 172.21.15.103:0/2390305679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbe40b4a60 msgr2=0x7fbbe4158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbe9200640 1 --2- 172.21.15.103:0/2390305679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbe40b4a60 0x7fbbe4158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbe9200640 1 -- 172.21.15.103:0/2390305679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe41e5d90 con 0x7fbbc8003fe0 2024-09-10T22:41:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbe9200640 1 --2- 172.21.15.103:0/2390305679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc8003fe0 0x7fbbe40b5950 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4011940 tx=0x7fbbd4011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbe0c00640 1 -- 172.21.15.103:0/2390305679 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4017070 con 0x7fbbc8003fe0 2024-09-10T22:41:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbe0c00640 1 -- 172.21.15.103:0/2390305679 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbd400fdf0 con 0x7fbbc8003fe0 2024-09-10T22:41:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbe0c00640 1 -- 172.21.15.103:0/2390305679 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4013690 con 0x7fbbc8003fe0 2024-09-10T22:41:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbebc00640 1 -- 172.21.15.103:0/2390305679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe41e6070 con 0x7fbbc8003fe0 2024-09-10T22:41:09.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.192+0000 7fbbebc00640 1 -- 172.21.15.103:0/2390305679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe41e6630 con 0x7fbbc8003fe0 2024-09-10T22:41:09.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.196+0000 7fbbebc00640 1 -- 172.21.15.103:0/2390305679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe40ae7f0 con 0x7fbbc8003fe0 2024-09-10T22:41:09.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.196+0000 7fbbe0c00640 1 -- 172.21.15.103:0/2390305679 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbbd4010040 con 0x7fbbc8003fe0 2024-09-10T22:41:09.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.196+0000 7fbbe0c00640 1 --2- 172.21.15.103:0/2390305679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbbc4072610 0x7fbbc4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:09.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.196+0000 7fbbe0c00640 1 -- 172.21.15.103:0/2390305679 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fbbd4097270 con 0x7fbbc8003fe0 2024-09-10T22:41:09.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.196+0000 7fbbe3e00640 1 --2- 172.21.15.103:0/2390305679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbbc4072610 0x7fbbc4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:09.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.200+0000 7fbbe3e00640 1 --2- 172.21.15.103:0/2390305679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbbc4072610 0x7fbbc4074ad0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00af000 tx=0x7fbbd001a050 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.200+0000 7fbbe0c00640 1 -- 172.21.15.103:0/2390305679 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbbd40620d0 con 0x7fbbc8003fe0 2024-09-10T22:41:09.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:09.404+0000 7fbbebc00640 1 -- 172.21.15.103:0/2390305679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fbbe40aff50 con 0x7fbbc8003fe0 2024-09-10T22:41:10.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.020+0000 7fbbe0c00640 1 -- 172.21.15.103:0/2390305679 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) ==== 122+0+0 (secure 0 0 0) 0x7fbbd4066b00 con 0x7fbbc8003fe0 2024-09-10T22:41:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.024+0000 7fbbebc00640 1 -- 172.21.15.103:0/2390305679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbbc4072610 msgr2=0x7fbbc4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.024+0000 7fbbebc00640 1 --2- 172.21.15.103:0/2390305679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbbc4072610 0x7fbbc4074ad0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00af000 tx=0x7fbbd001a050 comp rx=0 tx=0).stop 2024-09-10T22:41:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.024+0000 7fbbebc00640 1 -- 172.21.15.103:0/2390305679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc8003fe0 msgr2=0x7fbbe40b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.024+0000 7fbbebc00640 1 --2- 172.21.15.103:0/2390305679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc8003fe0 0x7fbbe40b5950 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4011940 tx=0x7fbbd4011e00 comp rx=0 tx=0).stop 2024-09-10T22:41:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.024+0000 7fbbebc00640 1 -- 172.21.15.103:0/2390305679 shutdown_connections 2024-09-10T22:41:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.024+0000 7fbbebc00640 1 --2- 172.21.15.103:0/2390305679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbbc4072610 0x7fbbc4074ad0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.024+0000 7fbbebc00640 1 --2- 172.21.15.103:0/2390305679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbbe415aa70 0x7fbbe40cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.024+0000 7fbbebc00640 1 --2- 172.21.15.103:0/2390305679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbe40b4a60 0x7fbbe4158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.024+0000 7fbbebc00640 1 --2- 172.21.15.103:0/2390305679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbc8003fe0 0x7fbbe40b5950 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.024+0000 7fbbebc00640 1 -- 172.21.15.103:0/2390305679 >> 172.21.15.103:0/2390305679 conn(0x7fbbe40d1a20 msgr2=0x7fbbe40b02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.024+0000 7fbbebc00640 1 -- 172.21.15.103:0/2390305679 shutdown_connections 2024-09-10T22:41:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.024+0000 7fbbebc00640 1 -- 172.21.15.103:0/2390305679 wait complete. 2024-09-10T22:41:10.051 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T22:41:10.052 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:41:10.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.188+0000 7fa843200640 1 -- 172.21.15.103:0/1244238188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa83c15ece0 msgr2=0x7fa83c06f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:10.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.188+0000 7fa843200640 1 --2- 172.21.15.103:0/1244238188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa83c15ece0 0x7fa83c06f450 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa830009840 tx=0x7fa83001c820 comp rx=0 tx=0).stop 2024-09-10T22:41:10.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.188+0000 7fa843200640 1 -- 172.21.15.103:0/1244238188 shutdown_connections 2024-09-10T22:41:10.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.188+0000 7fa843200640 1 --2- 172.21.15.103:0/1244238188 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa83c0afcb0 0x7fa83c0cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.188+0000 7fa843200640 1 --2- 172.21.15.103:0/1244238188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa83c15ece0 0x7fa83c06f450 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.188+0000 7fa843200640 1 -- 172.21.15.103:0/1244238188 >> 172.21.15.103:0/1244238188 conn(0x7fa83c0d0780 msgr2=0x7fa83c0d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:10.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.188+0000 7fa843200640 1 -- 172.21.15.103:0/1244238188 shutdown_connections 2024-09-10T22:41:10.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.188+0000 7fa843200640 1 -- 172.21.15.103:0/1244238188 wait complete. 2024-09-10T22:41:10.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa843200640 1 Processor -- start 2024-09-10T22:41:10.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa843200640 1 -- start start 2024-09-10T22:41:10.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa843200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa83c0afcb0 0x7fa83c1f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:10.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa843200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa83c0ccc10 0x7fa83c13eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:10.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa843200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c15ece0 0x7fa83c1fb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:10.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa843200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c168840 con 0x7fa83c15ece0 2024-09-10T22:41:10.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa843200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1686c0 con 0x7fa83c0afcb0 2024-09-10T22:41:10.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa843200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa83c1689c0 con 0x7fa83c0ccc10 2024-09-10T22:41:10.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa842800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c15ece0 0x7fa83c1fb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:10.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa841400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa83c0ccc10 0x7fa83c13eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:10.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa841e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa83c0afcb0 0x7fa83c1f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:10.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa841e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa83c0afcb0 0x7fa83c1f7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:45530/0 (socket says 172.21.15.103:45530) 2024-09-10T22:41:10.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa841e00640 1 -- 172.21.15.103:0/2308909447 learned_addr learned my addr 172.21.15.103:0/2308909447 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:10.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa841e00640 1 -- 172.21.15.103:0/2308909447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa83c0ccc10 msgr2=0x7fa83c13eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:10.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa841e00640 1 --2- 172.21.15.103:0/2308909447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa83c0ccc10 0x7fa83c13eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa841e00640 1 -- 172.21.15.103:0/2308909447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c15ece0 msgr2=0x7fa83c1fb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:10.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa841e00640 1 --2- 172.21.15.103:0/2308909447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c15ece0 0x7fa83c1fb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa841e00640 1 -- 172.21.15.103:0/2308909447 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83c152600 con 0x7fa83c0afcb0 2024-09-10T22:41:10.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa842800640 1 --2- 172.21.15.103:0/2308909447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c15ece0 0x7fa83c1fb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:41:10.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa841e00640 1 --2- 172.21.15.103:0/2308909447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa83c0afcb0 0x7fa83c1f7e60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa830009790 tx=0x7fa8300a5670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:10.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa836000640 1 -- 172.21.15.103:0/2308909447 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8300bb070 con 0x7fa83c0afcb0 2024-09-10T22:41:10.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa836000640 1 -- 172.21.15.103:0/2308909447 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa830004470 con 0x7fa83c0afcb0 2024-09-10T22:41:10.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa836000640 1 -- 172.21.15.103:0/2308909447 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8300b2040 con 0x7fa83c0afcb0 2024-09-10T22:41:10.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa843200640 1 -- 172.21.15.103:0/2308909447 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83c0b3e70 con 0x7fa83c0afcb0 2024-09-10T22:41:10.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.192+0000 7fa843200640 1 -- 172.21.15.103:0/2308909447 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa83c1f7380 con 0x7fa83c0afcb0 2024-09-10T22:41:10.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.196+0000 7fa843200640 1 -- 172.21.15.103:0/2308909447 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa83c0b0600 con 0x7fa83c0afcb0 2024-09-10T22:41:10.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.196+0000 7fa836000640 1 -- 172.21.15.103:0/2308909447 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa8300b5030 con 0x7fa83c0afcb0 2024-09-10T22:41:10.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.196+0000 7fa836000640 1 --2- 172.21.15.103:0/2308909447 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa820072610 0x7fa820074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:10.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.196+0000 7fa836000640 1 -- 172.21.15.103:0/2308909447 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fa83012c7e0 con 0x7fa83c0afcb0 2024-09-10T22:41:10.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.196+0000 7fa841400640 1 --2- 172.21.15.103:0/2308909447 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa820072610 0x7fa820074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:10.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.196+0000 7fa841400640 1 --2- 172.21.15.103:0/2308909447 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa820072610 0x7fa820074ad0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0af6c0 tx=0x7fa82c0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:10.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.200+0000 7fa836000640 1 -- 172.21.15.103:0/2308909447 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa830016410 con 0x7fa83c0afcb0 2024-09-10T22:41:10.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.396+0000 7fa843200640 1 -- 172.21.15.103:0/2308909447 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa83c0b0320 con 0x7fa83c0afcb0 2024-09-10T22:41:10.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.400+0000 7fa836000640 1 -- 172.21.15.103:0/2308909447 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5232 (secure 0 0 0) 0x7fa8300f76d0 con 0x7fa83c0afcb0 2024-09-10T22:41:10.405 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:10.405 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":35,"btime":"2024-09-10T22:41:10:021317+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/1187797704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1187797704},{"type":"v1","addr":"172.21.15.131:6836","nonce":1187797704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5153,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3348473142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3348473142},{"type":"v1","addr":"172.21.15.131:6837","nonce":3348473142}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/3910783847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":3910783847},{"type":"v1","addr":"172.21.15.103:6834","nonce":3910783847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:41:06.381695+0000","modified":"2024-09-10T22:41:09.411810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5547":{"gid":5547,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/343761048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":343761048},{"type":"v1","addr":"172.21.15.103:6835","nonce":343761048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5547,"qdb_cluster":[5547]},"id":3}]} 2024-09-10T22:41:10.405 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 35 2024-09-10T22:41:10.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.400+0000 7fa843200640 1 -- 172.21.15.103:0/2308909447 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa820072610 msgr2=0x7fa820074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:10.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.400+0000 7fa843200640 1 --2- 172.21.15.103:0/2308909447 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa820072610 0x7fa820074ad0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0af6c0 tx=0x7fa82c0091e0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.400+0000 7fa843200640 1 -- 172.21.15.103:0/2308909447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa83c0afcb0 msgr2=0x7fa83c1f7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:10.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.400+0000 7fa843200640 1 --2- 172.21.15.103:0/2308909447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa83c0afcb0 0x7fa83c1f7e60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa830009790 tx=0x7fa8300a5670 comp rx=0 tx=0).stop 2024-09-10T22:41:10.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.400+0000 7fa843200640 1 -- 172.21.15.103:0/2308909447 shutdown_connections 2024-09-10T22:41:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.400+0000 7fa843200640 1 --2- 172.21.15.103:0/2308909447 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa820072610 0x7fa820074ad0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.400+0000 7fa843200640 1 --2- 172.21.15.103:0/2308909447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c15ece0 0x7fa83c1fb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.400+0000 7fa843200640 1 --2- 172.21.15.103:0/2308909447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa83c0ccc10 0x7fa83c13eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.400+0000 7fa843200640 1 --2- 172.21.15.103:0/2308909447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa83c0afcb0 0x7fa83c1f7e60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.400+0000 7fa843200640 1 -- 172.21.15.103:0/2308909447 >> 172.21.15.103:0/2308909447 conn(0x7fa83c0d0780 msgr2=0x7fa83c157cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.400+0000 7fa843200640 1 -- 172.21.15.103:0/2308909447 shutdown_connections 2024-09-10T22:41:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.400+0000 7fa843200640 1 -- 172.21.15.103:0/2308909447 wait complete. 2024-09-10T22:41:10.426 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:41:10.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfce600640 1 -- 172.21.15.103:0/1433374796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbfc815be30 msgr2=0x7fbfc80ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:10.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfce600640 1 --2- 172.21.15.103:0/1433374796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbfc815be30 0x7fbfc80ce0c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009bf0 tx=0x7fbfb801cb50 comp rx=0 tx=0).stop 2024-09-10T22:41:10.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfce600640 1 -- 172.21.15.103:0/1433374796 shutdown_connections 2024-09-10T22:41:10.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfce600640 1 --2- 172.21.15.103:0/1433374796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbfc815be30 0x7fbfc80ce0c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfce600640 1 -- 172.21.15.103:0/1433374796 >> 172.21.15.103:0/1433374796 conn(0x7fbfc80d1ac0 msgr2=0x7fbfc80d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:10.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfce600640 1 -- 172.21.15.103:0/1433374796 shutdown_connections 2024-09-10T22:41:10.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfce600640 1 -- 172.21.15.103:0/1433374796 wait complete. 2024-09-10T22:41:10.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfce600640 1 Processor -- start 2024-09-10T22:41:10.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfce600640 1 -- start start 2024-09-10T22:41:10.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfce600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80ae9c0 0x7fbfc80b7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:10.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfce600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfc80b09c0 0x7fbfc80ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:10.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfce600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbfc815be30 0x7fbfc8150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:10.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfce600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc8169e00 con 0x7fbfc80ae9c0 2024-09-10T22:41:10.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfce600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc8169c80 con 0x7fbfc80b09c0 2024-09-10T22:41:10.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfce600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc8169f80 con 0x7fbfc815be30 2024-09-10T22:41:10.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfc7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80ae9c0 0x7fbfc80b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:10.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfc7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80ae9c0 0x7fbfc80b7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56554/0 (socket says 172.21.15.103:56554) 2024-09-10T22:41:10.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfc7400640 1 -- 172.21.15.103:0/624926456 learned_addr learned my addr 172.21.15.103:0/624926456 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:10.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfbea00640 1 --2- 172.21.15.103:0/624926456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfc80b09c0 0x7fbfc80ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:10.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfc7400640 1 -- 172.21.15.103:0/624926456 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbfc815be30 msgr2=0x7fbfc8150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:10.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfc7e00640 1 --2- 172.21.15.103:0/624926456 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbfc815be30 0x7fbfc8150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:10.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfc7400640 1 --2- 172.21.15.103:0/624926456 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbfc815be30 0x7fbfc8150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfc7400640 1 -- 172.21.15.103:0/624926456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfc80b09c0 msgr2=0x7fbfc80ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:10.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfc7400640 1 --2- 172.21.15.103:0/624926456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfc80b09c0 0x7fbfc80ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfc7400640 1 -- 172.21.15.103:0/624926456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc80b4a40 con 0x7fbfc80ae9c0 2024-09-10T22:41:10.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfbea00640 1 --2- 172.21.15.103:0/624926456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfc80b09c0 0x7fbfc80ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:10.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfc7e00640 1 --2- 172.21.15.103:0/624926456 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbfc815be30 0x7fbfc8150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:10.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.564+0000 7fbfc7400640 1 --2- 172.21.15.103:0/624926456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80ae9c0 0x7fbfc80b7520 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbfb801c5c0 tx=0x7fbfb8009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:10.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.568+0000 7fbfbfe00640 1 -- 172.21.15.103:0/624926456 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb80b2040 con 0x7fbfc80ae9c0 2024-09-10T22:41:10.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.568+0000 7fbfbfe00640 1 -- 172.21.15.103:0/624926456 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfb80bb070 con 0x7fbfc80ae9c0 2024-09-10T22:41:10.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.568+0000 7fbfbfe00640 1 -- 172.21.15.103:0/624926456 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8004040 con 0x7fbfc80ae9c0 2024-09-10T22:41:10.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.568+0000 7fbfce600640 1 -- 172.21.15.103:0/624926456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc80b4d20 con 0x7fbfc80ae9c0 2024-09-10T22:41:10.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.568+0000 7fbfce600640 1 -- 172.21.15.103:0/624926456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc80b52e0 con 0x7fbfc80ae9c0 2024-09-10T22:41:10.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.568+0000 7fbfce600640 1 -- 172.21.15.103:0/624926456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfc80aee70 con 0x7fbfc80ae9c0 2024-09-10T22:41:10.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.568+0000 7fbfbfe00640 1 -- 172.21.15.103:0/624926456 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbfb80b5070 con 0x7fbfc80ae9c0 2024-09-10T22:41:10.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.568+0000 7fbfbfe00640 1 --2- 172.21.15.103:0/624926456 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbfa40725e0 0x7fbfa4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:10.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.568+0000 7fbfbfe00640 1 -- 172.21.15.103:0/624926456 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fbfb812d470 con 0x7fbfc80ae9c0 2024-09-10T22:41:10.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.568+0000 7fbfbea00640 1 --2- 172.21.15.103:0/624926456 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbfa40725e0 0x7fbfa4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:10.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.572+0000 7fbfbea00640 1 --2- 172.21.15.103:0/624926456 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbfa40725e0 0x7fbfa4074aa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0001230 tx=0x7fbfb0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:10.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.572+0000 7fbfbfe00640 1 -- 172.21.15.103:0/624926456 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbfb80167d0 con 0x7fbfc80ae9c0 2024-09-10T22:41:10.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.740+0000 7fbfce600640 1 -- 172.21.15.103:0/624926456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbfc8070c60 con 0x7fbfc80ae9c0 2024-09-10T22:41:10.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.740+0000 7fbfbfe00640 1 -- 172.21.15.103:0/624926456 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+17062 (secure 0 0 0) 0x7fbfb80f89b0 con 0x7fbfc80ae9c0 2024-09-10T22:41:10.746 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:10.746 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":55,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:41:07.984504+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:41:04.777605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-10T22:41:05.333657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:41:10.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.740+0000 7fbfce600640 1 -- 172.21.15.103:0/624926456 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbfa40725e0 msgr2=0x7fbfa4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:10.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.740+0000 7fbfce600640 1 --2- 172.21.15.103:0/624926456 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbfa40725e0 0x7fbfa4074aa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0001230 tx=0x7fbfb0009040 comp rx=0 tx=0).stop 2024-09-10T22:41:10.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.740+0000 7fbfce600640 1 -- 172.21.15.103:0/624926456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80ae9c0 msgr2=0x7fbfc80b7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:10.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.740+0000 7fbfce600640 1 --2- 172.21.15.103:0/624926456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80ae9c0 0x7fbfc80b7520 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbfb801c5c0 tx=0x7fbfb8009280 comp rx=0 tx=0).stop 2024-09-10T22:41:10.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.740+0000 7fbfce600640 1 -- 172.21.15.103:0/624926456 shutdown_connections 2024-09-10T22:41:10.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.740+0000 7fbfce600640 1 --2- 172.21.15.103:0/624926456 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbfa40725e0 0x7fbfa4074aa0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.740+0000 7fbfce600640 1 --2- 172.21.15.103:0/624926456 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbfc815be30 0x7fbfc8150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.740+0000 7fbfce600640 1 --2- 172.21.15.103:0/624926456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfc80b09c0 0x7fbfc80ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.740+0000 7fbfce600640 1 --2- 172.21.15.103:0/624926456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80ae9c0 0x7fbfc80b7520 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.740+0000 7fbfce600640 1 -- 172.21.15.103:0/624926456 >> 172.21.15.103:0/624926456 conn(0x7fbfc80d1ac0 msgr2=0x7fbfc806dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:10.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.740+0000 7fbfce600640 1 -- 172.21.15.103:0/624926456 shutdown_connections 2024-09-10T22:41:10.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.740+0000 7fbfce600640 1 -- 172.21.15.103:0/624926456 wait complete. 2024-09-10T22:41:10.768 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T22:41:10.768 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:41:10.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960fe00640 1 -- 172.21.15.103:0/3480134603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9608072a40 msgr2=0x7f9608157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:10.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960fe00640 1 --2- 172.21.15.103:0/3480134603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9608072a40 0x7f9608157090 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f960000acd0 tx=0x7f960001def0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960fe00640 1 -- 172.21.15.103:0/3480134603 shutdown_connections 2024-09-10T22:41:10.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960fe00640 1 --2- 172.21.15.103:0/3480134603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9608072a40 0x7f9608157090 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960fe00640 1 --2- 172.21.15.103:0/3480134603 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96080b3320 0x7f9608072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960fe00640 1 -- 172.21.15.103:0/3480134603 >> 172.21.15.103:0/3480134603 conn(0x7f960806cc00 msgr2=0x7f960806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:10.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960fe00640 1 -- 172.21.15.103:0/3480134603 shutdown_connections 2024-09-10T22:41:10.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960fe00640 1 -- 172.21.15.103:0/3480134603 wait complete. 2024-09-10T22:41:10.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960fe00640 1 Processor -- start 2024-09-10T22:41:10.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960fe00640 1 -- start start 2024-09-10T22:41:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9608072a40 0x7f9608136a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96080b3320 0x7f96081379e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960fe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96080cf260 0x7f96081643e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960fe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f960806e980 con 0x7f9608072a40 2024-09-10T22:41:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960fe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f960806e800 con 0x7f96080b3320 2024-09-10T22:41:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960fe00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f960806eb00 con 0x7f96080cf260 2024-09-10T22:41:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9608072a40 0x7f9608136a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9608072a40 0x7f9608136a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56578/0 (socket says 172.21.15.103:56578) 2024-09-10T22:41:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960d400640 1 -- 172.21.15.103:0/1487479884 learned_addr learned my addr 172.21.15.103:0/1487479884 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960ca00640 1 --2- 172.21.15.103:0/1487479884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96080b3320 0x7f96081379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960de00640 1 --2- 172.21.15.103:0/1487479884 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96080cf260 0x7f96081643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960d400640 1 -- 172.21.15.103:0/1487479884 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96080cf260 msgr2=0x7f96081643e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960d400640 1 --2- 172.21.15.103:0/1487479884 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96080cf260 0x7f96081643e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960d400640 1 -- 172.21.15.103:0/1487479884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96080b3320 msgr2=0x7f96081379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960d400640 1 --2- 172.21.15.103:0/1487479884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96080b3320 0x7f96081379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:10.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960d400640 1 -- 172.21.15.103:0/1487479884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960813db50 con 0x7f9608072a40 2024-09-10T22:41:10.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960de00640 1 --2- 172.21.15.103:0/1487479884 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96080cf260 0x7f96081643e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:10.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.904+0000 7f960d400640 1 --2- 172.21.15.103:0/1487479884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9608072a40 0x7f9608136a60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f95fc001ec0 tx=0x7f95fc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:10.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.908+0000 7f9605600640 1 -- 172.21.15.103:0/1487479884 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc017070 con 0x7f9608072a40 2024-09-10T22:41:10.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.908+0000 7f9605600640 1 -- 172.21.15.103:0/1487479884 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95fc003600 con 0x7f9608072a40 2024-09-10T22:41:10.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.908+0000 7f9605600640 1 -- 172.21.15.103:0/1487479884 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc003a50 con 0x7f9608072a40 2024-09-10T22:41:10.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.908+0000 7f960fe00640 1 -- 172.21.15.103:0/1487479884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f960813e0a0 con 0x7f9608072a40 2024-09-10T22:41:10.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.908+0000 7f960fe00640 1 -- 172.21.15.103:0/1487479884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f960813ddc0 con 0x7f9608072a40 2024-09-10T22:41:10.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.908+0000 7f960fe00640 1 -- 172.21.15.103:0/1487479884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9608157090 con 0x7f9608072a40 2024-09-10T22:41:10.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.908+0000 7f9605600640 1 -- 172.21.15.103:0/1487479884 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f95fc003bf0 con 0x7f9608072a40 2024-09-10T22:41:10.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.908+0000 7f9605600640 1 --2- 172.21.15.103:0/1487479884 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f95e80725e0 0x7f95e8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:10.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.908+0000 7f9605600640 1 -- 172.21.15.103:0/1487479884 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f95fc092990 con 0x7f9608072a40 2024-09-10T22:41:10.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.908+0000 7f960ca00640 1 --2- 172.21.15.103:0/1487479884 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f95e80725e0 0x7f95e8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:10.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.912+0000 7f960ca00640 1 --2- 172.21.15.103:0/1487479884 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f95e80725e0 0x7f95e8074aa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f960815a6c0 tx=0x7f95f400a2d0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:10.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:10.912+0000 7f9605600640 1 -- 172.21.15.103:0/1487479884 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f95fc05d880 con 0x7f9608072a40 2024-09-10T22:41:11.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.076+0000 7f960fe00640 1 -- 172.21.15.103:0/1487479884 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f960815f8a0 con 0x7f95e80725e0 2024-09-10T22:41:11.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.080+0000 7f9605600640 1 -- 172.21.15.103:0/1487479884 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250312 (secure 0 0 0) 0x7f960815f8a0 con 0x7f95e80725e0 2024-09-10T22:41:11.090 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:11.092 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:41:11.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.084+0000 7f960fe00640 1 -- 172.21.15.103:0/1487479884 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f95e80725e0 msgr2=0x7f95e8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:11.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.084+0000 7f960fe00640 1 --2- 172.21.15.103:0/1487479884 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f95e80725e0 0x7f95e8074aa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f960815a6c0 tx=0x7f95f400a2d0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.084+0000 7f960fe00640 1 -- 172.21.15.103:0/1487479884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9608072a40 msgr2=0x7f9608136a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:11.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.084+0000 7f960fe00640 1 --2- 172.21.15.103:0/1487479884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9608072a40 0x7f9608136a60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f95fc001ec0 tx=0x7f95fc00c890 comp rx=0 tx=0).stop 2024-09-10T22:41:11.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.084+0000 7f960fe00640 1 -- 172.21.15.103:0/1487479884 shutdown_connections 2024-09-10T22:41:11.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.084+0000 7f960fe00640 1 --2- 172.21.15.103:0/1487479884 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f95e80725e0 0x7f95e8074aa0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.084+0000 7f960fe00640 1 --2- 172.21.15.103:0/1487479884 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96080cf260 0x7f96081643e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.084+0000 7f960fe00640 1 --2- 172.21.15.103:0/1487479884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96080b3320 0x7f96081379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.084+0000 7f960fe00640 1 --2- 172.21.15.103:0/1487479884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9608072a40 0x7f9608136a60 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.084+0000 7f960fe00640 1 -- 172.21.15.103:0/1487479884 >> 172.21.15.103:0/1487479884 conn(0x7f960806cc00 msgr2=0x7f960815c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:11.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.084+0000 7f960fe00640 1 -- 172.21.15.103:0/1487479884 shutdown_connections 2024-09-10T22:41:11.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.084+0000 7f960fe00640 1 -- 172.21.15.103:0/1487479884 wait complete. 2024-09-10T22:41:11.110 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2024-09-10T22:41:09.651778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":141,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226600,"kb_used_data":6176,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748120,"statfs":{"total":773094113280,"available":772862074880,"internally_reserved":0,"allocated":6324224,"data_stored":3434786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.677408"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991867+0000","last_change":"2024-09-10T22:41:07.018450+0000","last_active":"2024-09-10T22:41:07.991867+0000","last_peered":"2024-09-10T22:41:07.991867+0000","last_clean":"2024-09-10T22:41:07.991867+0000","last_became_active":"2024-09-10T22:41:07.018138+0000","last_became_peered":"2024-09-10T22:41:07.018138+0000","last_unstale":"2024-09-10T22:41:07.991867+0000","last_undegraded":"2024-09-10T22:41:07.991867+0000","last_fullsized":"2024-09-10T22:41:07.991867+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:18.409465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.031628+0000","last_change":"2024-09-10T22:41:07.011508+0000","last_active":"2024-09-10T22:41:07.031628+0000","last_peered":"2024-09-10T22:41:07.031628+0000","last_clean":"2024-09-10T22:41:07.031628+0000","last_became_active":"2024-09-10T22:41:07.011224+0000","last_became_peered":"2024-09-10T22:41:07.011224+0000","last_unstale":"2024-09-10T22:41:07.031628+0000","last_undegraded":"2024-09-10T22:41:07.031628+0000","last_fullsized":"2024-09-10T22:41:07.031628+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:43.688712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990876+0000","last_change":"2024-09-10T22:41:07.016143+0000","last_active":"2024-09-10T22:41:07.990876+0000","last_peered":"2024-09-10T22:41:07.990876+0000","last_clean":"2024-09-10T22:41:07.990876+0000","last_became_active":"2024-09-10T22:41:07.015887+0000","last_became_peered":"2024-09-10T22:41:07.015887+0000","last_unstale":"2024-09-10T22:41:07.990876+0000","last_undegraded":"2024-09-10T22:41:07.990876+0000","last_fullsized":"2024-09-10T22:41:07.990876+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:15.842949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.011219+0000","last_change":"2024-09-10T22:41:07.006851+0000","last_active":"2024-09-10T22:41:07.011219+0000","last_peered":"2024-09-10T22:41:07.011219+0000","last_clean":"2024-09-10T22:41:07.011219+0000","last_became_active":"2024-09-10T22:41:07.006583+0000","last_became_peered":"2024-09-10T22:41:07.006583+0000","last_unstale":"2024-09-10T22:41:07.011219+0000","last_undegraded":"2024-09-10T22:41:07.011219+0000","last_fullsized":"2024-09-10T22:41:07.011219+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:30.833275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.030232+0000","last_change":"2024-09-10T22:41:07.010472+0000","last_active":"2024-09-10T22:41:07.030232+0000","last_peered":"2024-09-10T22:41:07.030232+0000","last_clean":"2024-09-10T22:41:07.030232+0000","last_became_active":"2024-09-10T22:41:07.010173+0000","last_became_peered":"2024-09-10T22:41:07.010173+0000","last_unstale":"2024-09-10T22:41:07.030232+0000","last_undegraded":"2024-09-10T22:41:07.030232+0000","last_fullsized":"2024-09-10T22:41:07.030232+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:43.970261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.005681+0000","last_change":"2024-09-10T22:41:07.000969+0000","last_active":"2024-09-10T22:41:07.005681+0000","last_peered":"2024-09-10T22:41:07.005681+0000","last_clean":"2024-09-10T22:41:07.005681+0000","last_became_active":"2024-09-10T22:41:07.000706+0000","last_became_peered":"2024-09-10T22:41:07.000706+0000","last_unstale":"2024-09-10T22:41:07.005681+0000","last_undegraded":"2024-09-10T22:41:07.005681+0000","last_fullsized":"2024-09-10T22:41:07.005681+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:41:27.226599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.004522+0000","last_change":"2024-09-10T22:41:06.998131+0000","last_active":"2024-09-10T22:41:07.004522+0000","last_peered":"2024-09-10T22:41:07.004522+0000","last_clean":"2024-09-10T22:41:07.004522+0000","last_became_active":"2024-09-10T22:41:06.997825+0000","last_became_peered":"2024-09-10T22:41:06.997825+0000","last_unstale":"2024-09-10T22:41:07.004522+0000","last_undegraded":"2024-09-10T22:41:07.004522+0000","last_fullsized":"2024-09-10T22:41:07.004522+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:19.478124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988797+0000","last_change":"2024-09-10T22:41:07.014300+0000","last_active":"2024-09-10T22:41:07.988797+0000","last_peered":"2024-09-10T22:41:07.988797+0000","last_clean":"2024-09-10T22:41:07.988797+0000","last_became_active":"2024-09-10T22:41:07.013875+0000","last_became_peered":"2024-09-10T22:41:07.013875+0000","last_unstale":"2024-09-10T22:41:07.988797+0000","last_undegraded":"2024-09-10T22:41:07.988797+0000","last_fullsized":"2024-09-10T22:41:07.988797+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:23.123417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.004478+0000","last_change":"2024-09-10T22:41:06.994043+0000","last_active":"2024-09-10T22:41:07.004478+0000","last_peered":"2024-09-10T22:41:07.004478+0000","last_clean":"2024-09-10T22:41:07.004478+0000","last_became_active":"2024-09-10T22:41:06.993754+0000","last_became_peered":"2024-09-10T22:41:06.993754+0000","last_unstale":"2024-09-10T22:41:07.004478+0000","last_undegraded":"2024-09-10T22:41:07.004478+0000","last_fullsized":"2024-09-10T22:41:07.004478+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:59.336126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.032966+0000","last_change":"2024-09-10T22:41:07.021525+0000","last_active":"2024-09-10T22:41:07.032966+0000","last_peered":"2024-09-10T22:41:07.032966+0000","last_clean":"2024-09-10T22:41:07.032966+0000","last_became_active":"2024-09-10T22:41:07.021240+0000","last_became_peered":"2024-09-10T22:41:07.021240+0000","last_unstale":"2024-09-10T22:41:07.032966+0000","last_undegraded":"2024-09-10T22:41:07.032966+0000","last_fullsized":"2024-09-10T22:41:07.032966+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:47.347113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991192+0000","last_change":"2024-09-10T22:41:07.011414+0000","last_active":"2024-09-10T22:41:07.991192+0000","last_peered":"2024-09-10T22:41:07.991192+0000","last_clean":"2024-09-10T22:41:07.991192+0000","last_became_active":"2024-09-10T22:41:07.011123+0000","last_became_peered":"2024-09-10T22:41:07.011123+0000","last_unstale":"2024-09-10T22:41:07.991192+0000","last_undegraded":"2024-09-10T22:41:07.991192+0000","last_fullsized":"2024-09-10T22:41:07.991192+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:42.747411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.007790+0000","last_change":"2024-09-10T22:41:07.001750+0000","last_active":"2024-09-10T22:41:07.007790+0000","last_peered":"2024-09-10T22:41:07.007790+0000","last_clean":"2024-09-10T22:41:07.007790+0000","last_became_active":"2024-09-10T22:41:07.001438+0000","last_became_peered":"2024-09-10T22:41:07.001438+0000","last_unstale":"2024-09-10T22:41:07.007790+0000","last_undegraded":"2024-09-10T22:41:07.007790+0000","last_fullsized":"2024-09-10T22:41:07.007790+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:52.884128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991902+0000","last_change":"2024-09-10T22:41:07.019159+0000","last_active":"2024-09-10T22:41:07.991902+0000","last_peered":"2024-09-10T22:41:07.991902+0000","last_clean":"2024-09-10T22:41:07.991902+0000","last_became_active":"2024-09-10T22:41:07.018849+0000","last_became_peered":"2024-09-10T22:41:07.018849+0000","last_unstale":"2024-09-10T22:41:07.991902+0000","last_undegraded":"2024-09-10T22:41:07.991902+0000","last_fullsized":"2024-09-10T22:41:07.991902+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:01.412535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.016214+0000","last_change":"2024-09-10T22:41:07.003836+0000","last_active":"2024-09-10T22:41:07.016214+0000","last_peered":"2024-09-10T22:41:07.016214+0000","last_clean":"2024-09-10T22:41:07.016214+0000","last_became_active":"2024-09-10T22:41:07.002677+0000","last_became_peered":"2024-09-10T22:41:07.002677+0000","last_unstale":"2024-09-10T22:41:07.016214+0000","last_undegraded":"2024-09-10T22:41:07.016214+0000","last_fullsized":"2024-09-10T22:41:07.016214+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:33.311396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442700+0000","last_change":"2024-09-10T22:41:07.004930+0000","last_active":"2024-09-10T22:41:08.442700+0000","last_peered":"2024-09-10T22:41:08.442700+0000","last_clean":"2024-09-10T22:41:08.442700+0000","last_became_active":"2024-09-10T22:41:07.004625+0000","last_became_peered":"2024-09-10T22:41:07.004625+0000","last_unstale":"2024-09-10T22:41:08.442700+0000","last_undegraded":"2024-09-10T22:41:08.442700+0000","last_fullsized":"2024-09-10T22:41:08.442700+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:57.405156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442644+0000","last_change":"2024-09-10T22:41:07.006673+0000","last_active":"2024-09-10T22:41:08.442644+0000","last_peered":"2024-09-10T22:41:08.442644+0000","last_clean":"2024-09-10T22:41:08.442644+0000","last_became_active":"2024-09-10T22:41:07.006370+0000","last_became_peered":"2024-09-10T22:41:07.006370+0000","last_unstale":"2024-09-10T22:41:08.442644+0000","last_undegraded":"2024-09-10T22:41:08.442644+0000","last_fullsized":"2024-09-10T22:41:08.442644+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:23.696110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.006456+0000","last_change":"2024-09-10T22:41:07.003450+0000","last_active":"2024-09-10T22:41:07.006456+0000","last_peered":"2024-09-10T22:41:07.006456+0000","last_clean":"2024-09-10T22:41:07.006456+0000","last_became_active":"2024-09-10T22:41:07.003154+0000","last_became_peered":"2024-09-10T22:41:07.003154+0000","last_unstale":"2024-09-10T22:41:07.006456+0000","last_undegraded":"2024-09-10T22:41:07.006456+0000","last_fullsized":"2024-09-10T22:41:07.006456+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:47.347113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988596+0000","last_change":"2024-09-10T22:41:07.033768+0000","last_active":"2024-09-10T22:41:07.988596+0000","last_peered":"2024-09-10T22:41:07.988596+0000","last_clean":"2024-09-10T22:41:07.988596+0000","last_became_active":"2024-09-10T22:41:07.033472+0000","last_became_peered":"2024-09-10T22:41:07.033472+0000","last_unstale":"2024-09-10T22:41:07.988596+0000","last_undegraded":"2024-09-10T22:41:07.988596+0000","last_fullsized":"2024-09-10T22:41:07.988596+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:43:44.233205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.032902+0000","last_change":"2024-09-10T22:41:07.021556+0000","last_active":"2024-09-10T22:41:07.032902+0000","last_peered":"2024-09-10T22:41:07.032902+0000","last_clean":"2024-09-10T22:41:07.032902+0000","last_became_active":"2024-09-10T22:41:07.021228+0000","last_became_peered":"2024-09-10T22:41:07.021228+0000","last_unstale":"2024-09-10T22:41:07.032902+0000","last_undegraded":"2024-09-10T22:41:07.032902+0000","last_fullsized":"2024-09-10T22:41:07.032902+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:25.632741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.031256+0000","last_change":"2024-09-10T22:41:07.012645+0000","last_active":"2024-09-10T22:41:07.031256+0000","last_peered":"2024-09-10T22:41:07.031256+0000","last_clean":"2024-09-10T22:41:07.031256+0000","last_became_active":"2024-09-10T22:41:07.011780+0000","last_became_peered":"2024-09-10T22:41:07.011780+0000","last_unstale":"2024-09-10T22:41:07.031256+0000","last_undegraded":"2024-09-10T22:41:07.031256+0000","last_fullsized":"2024-09-10T22:41:07.031256+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:59.336126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.029894+0000","last_change":"2024-09-10T22:41:07.021657+0000","last_active":"2024-09-10T22:41:07.029894+0000","last_peered":"2024-09-10T22:41:07.029894+0000","last_clean":"2024-09-10T22:41:07.029894+0000","last_became_active":"2024-09-10T22:41:07.021005+0000","last_became_peered":"2024-09-10T22:41:07.021005+0000","last_unstale":"2024-09-10T22:41:07.029894+0000","last_undegraded":"2024-09-10T22:41:07.029894+0000","last_fullsized":"2024-09-10T22:41:07.029894+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:37.329229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442852+0000","last_change":"2024-09-10T22:41:07.021311+0000","last_active":"2024-09-10T22:41:08.442852+0000","last_peered":"2024-09-10T22:41:08.442852+0000","last_clean":"2024-09-10T22:41:08.442852+0000","last_became_active":"2024-09-10T22:41:07.017967+0000","last_became_peered":"2024-09-10T22:41:07.017967+0000","last_unstale":"2024-09-10T22:41:08.442852+0000","last_undegraded":"2024-09-10T22:41:08.442852+0000","last_fullsized":"2024-09-10T22:41:08.442852+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:36.893264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.005035+0000","last_change":"2024-09-10T22:41:06.999101+0000","last_active":"2024-09-10T22:41:07.005035+0000","last_peered":"2024-09-10T22:41:07.005035+0000","last_clean":"2024-09-10T22:41:07.005035+0000","last_became_active":"2024-09-10T22:41:06.998842+0000","last_became_peered":"2024-09-10T22:41:06.998842+0000","last_unstale":"2024-09-10T22:41:07.005035+0000","last_undegraded":"2024-09-10T22:41:07.005035+0000","last_fullsized":"2024-09-10T22:41:07.005035+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:36.893264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990989+0000","last_change":"2024-09-10T22:41:07.017658+0000","last_active":"2024-09-10T22:41:07.990989+0000","last_peered":"2024-09-10T22:41:07.990989+0000","last_clean":"2024-09-10T22:41:07.990989+0000","last_became_active":"2024-09-10T22:41:07.017345+0000","last_became_peered":"2024-09-10T22:41:07.017345+0000","last_unstale":"2024-09-10T22:41:07.990989+0000","last_undegraded":"2024-09-10T22:41:07.990989+0000","last_fullsized":"2024-09-10T22:41:07.990989+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:51.381851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.030208+0000","last_change":"2024-09-10T22:41:07.010437+0000","last_active":"2024-09-10T22:41:07.030208+0000","last_peered":"2024-09-10T22:41:07.030208+0000","last_clean":"2024-09-10T22:41:07.030208+0000","last_became_active":"2024-09-10T22:41:07.009860+0000","last_became_peered":"2024-09-10T22:41:07.009860+0000","last_unstale":"2024-09-10T22:41:07.030208+0000","last_undegraded":"2024-09-10T22:41:07.030208+0000","last_fullsized":"2024-09-10T22:41:07.030208+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:48.714132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990379+0000","last_change":"2024-09-10T22:41:07.006639+0000","last_active":"2024-09-10T22:41:07.990379+0000","last_peered":"2024-09-10T22:41:07.990379+0000","last_clean":"2024-09-10T22:41:07.990379+0000","last_became_active":"2024-09-10T22:41:07.006355+0000","last_became_peered":"2024-09-10T22:41:07.006355+0000","last_unstale":"2024-09-10T22:41:07.990379+0000","last_undegraded":"2024-09-10T22:41:07.990379+0000","last_fullsized":"2024-09-10T22:41:07.990379+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:19.478124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990346+0000","last_change":"2024-09-10T22:41:07.001696+0000","last_active":"2024-09-10T22:41:07.990346+0000","last_peered":"2024-09-10T22:41:07.990346+0000","last_clean":"2024-09-10T22:41:07.990346+0000","last_became_active":"2024-09-10T22:41:07.001303+0000","last_became_peered":"2024-09-10T22:41:07.001303+0000","last_unstale":"2024-09-10T22:41:07.990346+0000","last_undegraded":"2024-09-10T22:41:07.990346+0000","last_fullsized":"2024-09-10T22:41:07.990346+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:41.157921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"54'4","reported_seq":19,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442528+0000","last_change":"2024-09-10T22:41:06.002183+0000","last_active":"2024-09-10T22:41:08.442528+0000","last_peered":"2024-09-10T22:41:08.442528+0000","last_clean":"2024-09-10T22:41:08.442528+0000","last_became_active":"2024-09-10T22:41:06.001895+0000","last_became_peered":"2024-09-10T22:41:06.001895+0000","last_unstale":"2024-09-10T22:41:08.442528+0000","last_undegraded":"2024-09-10T22:41:08.442528+0000","last_fullsized":"2024-09-10T22:41:08.442528+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:27.972852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991108+0000","last_change":"2024-09-10T22:41:07.003184+0000","last_active":"2024-09-10T22:41:07.991108+0000","last_peered":"2024-09-10T22:41:07.991108+0000","last_clean":"2024-09-10T22:41:07.991108+0000","last_became_active":"2024-09-10T22:41:07.002900+0000","last_became_peered":"2024-09-10T22:41:07.002900+0000","last_unstale":"2024-09-10T22:41:07.991108+0000","last_undegraded":"2024-09-10T22:41:07.991108+0000","last_fullsized":"2024-09-10T22:41:07.991108+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.301734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-10T22:41:04.981178+0000","last_change":"2024-09-10T22:41:04.981178+0000","last_active":"2024-09-10T22:41:04.962109+0000","last_peered":"2024-09-10T22:41:04.962109+0000","last_clean":"2024-09-10T22:41:04.962109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:04.981178+0000","last_undegraded":"2024-09-10T22:41:04.981178+0000","last_fullsized":"2024-09-10T22:41:04.981178+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442743+0000","last_change":"2024-09-10T22:41:07.006193+0000","last_active":"2024-09-10T22:41:08.442743+0000","last_peered":"2024-09-10T22:41:08.442743+0000","last_clean":"2024-09-10T22:41:08.442743+0000","last_became_active":"2024-09-10T22:41:07.005918+0000","last_became_peered":"2024-09-10T22:41:07.005918+0000","last_unstale":"2024-09-10T22:41:08.442743+0000","last_undegraded":"2024-09-10T22:41:08.442743+0000","last_fullsized":"2024-09-10T22:41:08.442743+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:57.920678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-10T22:41:04.981072+0000","last_change":"2024-09-10T22:41:04.981072+0000","last_active":"2024-09-10T22:41:04.962109+0000","last_peered":"2024-09-10T22:41:04.962109+0000","last_clean":"2024-09-10T22:41:04.962109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:04.981072+0000","last_undegraded":"2024-09-10T22:41:04.981072+0000","last_fullsized":"2024-09-10T22:41:04.981072+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.028346+0000","last_change":"2024-09-10T22:41:07.019698+0000","last_active":"2024-09-10T22:41:07.028346+0000","last_peered":"2024-09-10T22:41:07.028346+0000","last_clean":"2024-09-10T22:41:07.028346+0000","last_became_active":"2024-09-10T22:41:07.019353+0000","last_became_peered":"2024-09-10T22:41:07.019353+0000","last_unstale":"2024-09-10T22:41:07.028346+0000","last_undegraded":"2024-09-10T22:41:07.028346+0000","last_fullsized":"2024-09-10T22:41:07.028346+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:08.459818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991030+0000","last_change":"2024-09-10T22:41:05.997081+0000","last_active":"2024-09-10T22:41:07.991030+0000","last_peered":"2024-09-10T22:41:07.991030+0000","last_clean":"2024-09-10T22:41:07.991030+0000","last_became_active":"2024-09-10T22:41:05.996813+0000","last_became_peered":"2024-09-10T22:41:05.996813+0000","last_unstale":"2024-09-10T22:41:07.991030+0000","last_undegraded":"2024-09-10T22:41:07.991030+0000","last_fullsized":"2024-09-10T22:41:07.991030+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:35.883087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.015463+0000","last_change":"2024-09-10T22:41:07.012392+0000","last_active":"2024-09-10T22:41:07.015463+0000","last_peered":"2024-09-10T22:41:07.015463+0000","last_clean":"2024-09-10T22:41:07.015463+0000","last_became_active":"2024-09-10T22:41:07.012159+0000","last_became_peered":"2024-09-10T22:41:07.012159+0000","last_unstale":"2024-09-10T22:41:07.015463+0000","last_undegraded":"2024-09-10T22:41:07.015463+0000","last_fullsized":"2024-09-10T22:41:07.015463+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:40.550666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"54'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.036336+0000","last_change":"2024-09-10T22:41:06.013192+0000","last_active":"2024-09-10T22:41:07.036336+0000","last_peered":"2024-09-10T22:41:07.036336+0000","last_clean":"2024-09-10T22:41:07.036336+0000","last_became_active":"2024-09-10T22:41:06.012907+0000","last_became_peered":"2024-09-10T22:41:06.012907+0000","last_unstale":"2024-09-10T22:41:07.036336+0000","last_undegraded":"2024-09-10T22:41:07.036336+0000","last_fullsized":"2024-09-10T22:41:07.036336+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:22.685932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991457+0000","last_change":"2024-09-10T22:41:07.017658+0000","last_active":"2024-09-10T22:41:07.991457+0000","last_peered":"2024-09-10T22:41:07.991457+0000","last_clean":"2024-09-10T22:41:07.991457+0000","last_became_active":"2024-09-10T22:41:07.017429+0000","last_became_peered":"2024-09-10T22:41:07.017429+0000","last_unstale":"2024-09-10T22:41:07.991457+0000","last_undegraded":"2024-09-10T22:41:07.991457+0000","last_fullsized":"2024-09-10T22:41:07.991457+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:48.871383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"54'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.024168+0000","last_change":"2024-09-10T22:41:06.005980+0000","last_active":"2024-09-10T22:41:07.024168+0000","last_peered":"2024-09-10T22:41:07.024168+0000","last_clean":"2024-09-10T22:41:07.024168+0000","last_became_active":"2024-09-10T22:41:06.005716+0000","last_became_peered":"2024-09-10T22:41:06.005716+0000","last_unstale":"2024-09-10T22:41:07.024168+0000","last_undegraded":"2024-09-10T22:41:07.024168+0000","last_fullsized":"2024-09-10T22:41:07.024168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:46.600179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.029862+0000","last_change":"2024-09-10T22:41:07.021354+0000","last_active":"2024-09-10T22:41:07.029862+0000","last_peered":"2024-09-10T22:41:07.029862+0000","last_clean":"2024-09-10T22:41:07.029862+0000","last_became_active":"2024-09-10T22:41:07.020585+0000","last_became_peered":"2024-09-10T22:41:07.020585+0000","last_unstale":"2024-09-10T22:41:07.029862+0000","last_undegraded":"2024-09-10T22:41:07.029862+0000","last_fullsized":"2024-09-10T22:41:07.029862+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:37:14.763484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442343+0000","last_change":"2024-09-10T22:41:05.995026+0000","last_active":"2024-09-10T22:41:08.442343+0000","last_peered":"2024-09-10T22:41:08.442343+0000","last_clean":"2024-09-10T22:41:08.442343+0000","last_became_active":"2024-09-10T22:41:05.994459+0000","last_became_peered":"2024-09-10T22:41:05.994459+0000","last_unstale":"2024-09-10T22:41:08.442343+0000","last_undegraded":"2024-09-10T22:41:08.442343+0000","last_fullsized":"2024-09-10T22:41:08.442343+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:24.208151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991919+0000","last_change":"2024-09-10T22:41:07.031675+0000","last_active":"2024-09-10T22:41:07.991919+0000","last_peered":"2024-09-10T22:41:07.991919+0000","last_clean":"2024-09-10T22:41:07.991919+0000","last_became_active":"2024-09-10T22:41:07.031451+0000","last_became_peered":"2024-09-10T22:41:07.031451+0000","last_unstale":"2024-09-10T22:41:07.991919+0000","last_undegraded":"2024-09-10T22:41:07.991919+0000","last_fullsized":"2024-09-10T22:41:07.991919+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:31:18.659448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.988819+0000","last_change":"2024-09-10T22:41:06.000385+0000","last_active":"2024-09-10T22:41:06.988819+0000","last_peered":"2024-09-10T22:41:06.988819+0000","last_clean":"2024-09-10T22:41:06.988819+0000","last_became_active":"2024-09-10T22:41:06.000130+0000","last_became_peered":"2024-09-10T22:41:06.000130+0000","last_unstale":"2024-09-10T22:41:06.988819+0000","last_undegraded":"2024-09-10T22:41:06.988819+0000","last_fullsized":"2024-09-10T22:41:06.988819+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:12.373720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.015502+0000","last_change":"2024-09-10T22:41:07.012034+0000","last_active":"2024-09-10T22:41:07.015502+0000","last_peered":"2024-09-10T22:41:07.015502+0000","last_clean":"2024-09-10T22:41:07.015502+0000","last_became_active":"2024-09-10T22:41:07.008587+0000","last_became_peered":"2024-09-10T22:41:07.008587+0000","last_unstale":"2024-09-10T22:41:07.015502+0000","last_undegraded":"2024-09-10T22:41:07.015502+0000","last_fullsized":"2024-09-10T22:41:07.015502+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:56.351069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.992010+0000","last_change":"2024-09-10T22:41:06.008557+0000","last_active":"2024-09-10T22:41:07.992010+0000","last_peered":"2024-09-10T22:41:07.992010+0000","last_clean":"2024-09-10T22:41:07.992010+0000","last_became_active":"2024-09-10T22:41:06.008253+0000","last_became_peered":"2024-09-10T22:41:06.008253+0000","last_unstale":"2024-09-10T22:41:07.992010+0000","last_undegraded":"2024-09-10T22:41:07.992010+0000","last_fullsized":"2024-09-10T22:41:07.992010+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:56.394978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990584+0000","last_change":"2024-09-10T22:41:06.999332+0000","last_active":"2024-09-10T22:41:07.990584+0000","last_peered":"2024-09-10T22:41:07.990584+0000","last_clean":"2024-09-10T22:41:07.990584+0000","last_became_active":"2024-09-10T22:41:06.998916+0000","last_became_peered":"2024-09-10T22:41:06.998916+0000","last_unstale":"2024-09-10T22:41:07.990584+0000","last_undegraded":"2024-09-10T22:41:07.990584+0000","last_fullsized":"2024-09-10T22:41:07.990584+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:43.688712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.995400+0000","last_change":"2024-09-10T22:41:06.006905+0000","last_active":"2024-09-10T22:41:06.995400+0000","last_peered":"2024-09-10T22:41:06.995400+0000","last_clean":"2024-09-10T22:41:06.995400+0000","last_became_active":"2024-09-10T22:41:06.006582+0000","last_became_peered":"2024-09-10T22:41:06.006582+0000","last_unstale":"2024-09-10T22:41:06.995400+0000","last_undegraded":"2024-09-10T22:41:06.995400+0000","last_fullsized":"2024-09-10T22:41:06.995400+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:45.947252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.011380+0000","last_change":"2024-09-10T22:41:07.002342+0000","last_active":"2024-09-10T22:41:07.011380+0000","last_peered":"2024-09-10T22:41:07.011380+0000","last_clean":"2024-09-10T22:41:07.011380+0000","last_became_active":"2024-09-10T22:41:07.002066+0000","last_became_peered":"2024-09-10T22:41:07.002066+0000","last_unstale":"2024-09-10T22:41:07.011380+0000","last_undegraded":"2024-09-10T22:41:07.011380+0000","last_fullsized":"2024-09-10T22:41:07.011380+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:37.124449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"54'3","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991349+0000","last_change":"2024-09-10T22:41:06.008984+0000","last_active":"2024-09-10T22:41:07.991349+0000","last_peered":"2024-09-10T22:41:07.991349+0000","last_clean":"2024-09-10T22:41:07.991349+0000","last_became_active":"2024-09-10T22:41:06.008191+0000","last_became_peered":"2024-09-10T22:41:06.008191+0000","last_unstale":"2024-09-10T22:41:07.991349+0000","last_undegraded":"2024-09-10T22:41:07.991349+0000","last_fullsized":"2024-09-10T22:41:07.991349+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:03.893470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.017655+0000","last_change":"2024-09-10T22:41:07.015038+0000","last_active":"2024-09-10T22:41:07.017655+0000","last_peered":"2024-09-10T22:41:07.017655+0000","last_clean":"2024-09-10T22:41:07.017655+0000","last_became_active":"2024-09-10T22:41:07.014790+0000","last_became_peered":"2024-09-10T22:41:07.014790+0000","last_unstale":"2024-09-10T22:41:07.017655+0000","last_undegraded":"2024-09-10T22:41:07.017655+0000","last_fullsized":"2024-09-10T22:41:07.017655+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:33.101104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"54'6","reported_seq":19,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.038208+0000","last_change":"2024-09-10T22:41:05.997554+0000","last_active":"2024-09-10T22:41:07.038208+0000","last_peered":"2024-09-10T22:41:07.038208+0000","last_clean":"2024-09-10T22:41:07.038208+0000","last_became_active":"2024-09-10T22:41:05.997207+0000","last_became_peered":"2024-09-10T22:41:05.997207+0000","last_unstale":"2024-09-10T22:41:07.038208+0000","last_undegraded":"2024-09-10T22:41:07.038208+0000","last_fullsized":"2024-09-10T22:41:07.038208+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:53.069745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990781+0000","last_change":"2024-09-10T22:41:07.009874+0000","last_active":"2024-09-10T22:41:07.990781+0000","last_peered":"2024-09-10T22:41:07.990781+0000","last_clean":"2024-09-10T22:41:07.990781+0000","last_became_active":"2024-09-10T22:41:07.009570+0000","last_became_peered":"2024-09-10T22:41:07.009570+0000","last_unstale":"2024-09-10T22:41:07.990781+0000","last_undegraded":"2024-09-10T22:41:07.990781+0000","last_fullsized":"2024-09-10T22:41:07.990781+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:41:27.226599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"54'2","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.033033+0000","last_change":"2024-09-10T22:41:06.006329+0000","last_active":"2024-09-10T22:41:07.033033+0000","last_peered":"2024-09-10T22:41:07.033033+0000","last_clean":"2024-09-10T22:41:07.033033+0000","last_became_active":"2024-09-10T22:41:06.006076+0000","last_became_peered":"2024-09-10T22:41:06.006076+0000","last_unstale":"2024-09-10T22:41:07.033033+0000","last_undegraded":"2024-09-10T22:41:07.033033+0000","last_fullsized":"2024-09-10T22:41:07.033033+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:03.893470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.031658+0000","last_change":"2024-09-10T22:41:07.015684+0000","last_active":"2024-09-10T22:41:07.031658+0000","last_peered":"2024-09-10T22:41:07.031658+0000","last_clean":"2024-09-10T22:41:07.031658+0000","last_became_active":"2024-09-10T22:41:07.015425+0000","last_became_peered":"2024-09-10T22:41:07.015425+0000","last_unstale":"2024-09-10T22:41:07.031658+0000","last_undegraded":"2024-09-10T22:41:07.031658+0000","last_fullsized":"2024-09-10T22:41:07.031658+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:41:27.226599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442629+0000","last_change":"2024-09-10T22:41:05.996246+0000","last_active":"2024-09-10T22:41:08.442629+0000","last_peered":"2024-09-10T22:41:08.442629+0000","last_clean":"2024-09-10T22:41:08.442629+0000","last_became_active":"2024-09-10T22:41:05.995968+0000","last_became_peered":"2024-09-10T22:41:05.995968+0000","last_unstale":"2024-09-10T22:41:08.442629+0000","last_undegraded":"2024-09-10T22:41:08.442629+0000","last_fullsized":"2024-09-10T22:41:08.442629+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:11.662901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.020799+0000","last_change":"2024-09-10T22:41:07.012291+0000","last_active":"2024-09-10T22:41:07.020799+0000","last_peered":"2024-09-10T22:41:07.020799+0000","last_clean":"2024-09-10T22:41:07.020799+0000","last_became_active":"2024-09-10T22:41:07.012006+0000","last_became_peered":"2024-09-10T22:41:07.012006+0000","last_unstale":"2024-09-10T22:41:07.020799+0000","last_undegraded":"2024-09-10T22:41:07.020799+0000","last_fullsized":"2024-09-10T22:41:07.020799+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.301734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991300+0000","last_change":"2024-09-10T22:41:06.009142+0000","last_active":"2024-09-10T22:41:07.991300+0000","last_peered":"2024-09-10T22:41:07.991300+0000","last_clean":"2024-09-10T22:41:07.991300+0000","last_became_active":"2024-09-10T22:41:06.008215+0000","last_became_peered":"2024-09-10T22:41:06.008215+0000","last_unstale":"2024-09-10T22:41:07.991300+0000","last_undegraded":"2024-09-10T22:41:07.991300+0000","last_fullsized":"2024-09-10T22:41:07.991300+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:25.802794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.007816+0000","last_change":"2024-09-10T22:41:07.001776+0000","last_active":"2024-09-10T22:41:07.007816+0000","last_peered":"2024-09-10T22:41:07.007816+0000","last_clean":"2024-09-10T22:41:07.007816+0000","last_became_active":"2024-09-10T22:41:07.001504+0000","last_became_peered":"2024-09-10T22:41:07.001504+0000","last_unstale":"2024-09-10T22:41:07.007816+0000","last_undegraded":"2024-09-10T22:41:07.007816+0000","last_fullsized":"2024-09-10T22:41:07.007816+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:34.312993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"54'8","reported_seq":21,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.036815+0000","last_change":"2024-09-10T22:41:05.998248+0000","last_active":"2024-09-10T22:41:07.036815+0000","last_peered":"2024-09-10T22:41:07.036815+0000","last_clean":"2024-09-10T22:41:07.036815+0000","last_became_active":"2024-09-10T22:41:05.997978+0000","last_became_peered":"2024-09-10T22:41:05.997978+0000","last_unstale":"2024-09-10T22:41:07.036815+0000","last_undegraded":"2024-09-10T22:41:07.036815+0000","last_fullsized":"2024-09-10T22:41:07.036815+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:42.960083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.006427+0000","last_change":"2024-09-10T22:41:07.005382+0000","last_active":"2024-09-10T22:41:07.006427+0000","last_peered":"2024-09-10T22:41:07.006427+0000","last_clean":"2024-09-10T22:41:07.006427+0000","last_became_active":"2024-09-10T22:41:07.004169+0000","last_became_peered":"2024-09-10T22:41:07.004169+0000","last_unstale":"2024-09-10T22:41:07.006427+0000","last_undegraded":"2024-09-10T22:41:07.006427+0000","last_fullsized":"2024-09-10T22:41:07.006427+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:25.632741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"54'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.033085+0000","last_change":"2024-09-10T22:41:05.997356+0000","last_active":"2024-09-10T22:41:07.033085+0000","last_peered":"2024-09-10T22:41:07.033085+0000","last_clean":"2024-09-10T22:41:07.033085+0000","last_became_active":"2024-09-10T22:41:05.997087+0000","last_became_peered":"2024-09-10T22:41:05.997087+0000","last_unstale":"2024-09-10T22:41:07.033085+0000","last_undegraded":"2024-09-10T22:41:07.033085+0000","last_fullsized":"2024-09-10T22:41:07.033085+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:56.394978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988949+0000","last_change":"2024-09-10T22:41:06.005480+0000","last_active":"2024-09-10T22:41:07.988949+0000","last_peered":"2024-09-10T22:41:07.988949+0000","last_clean":"2024-09-10T22:41:07.988949+0000","last_became_active":"2024-09-10T22:41:06.005212+0000","last_became_peered":"2024-09-10T22:41:06.005212+0000","last_unstale":"2024-09-10T22:41:07.988949+0000","last_undegraded":"2024-09-10T22:41:07.988949+0000","last_fullsized":"2024-09-10T22:41:07.988949+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:05.166519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.016705+0000","last_change":"2024-09-10T22:41:07.013980+0000","last_active":"2024-09-10T22:41:07.016705+0000","last_peered":"2024-09-10T22:41:07.016705+0000","last_clean":"2024-09-10T22:41:07.016705+0000","last_became_active":"2024-09-10T22:41:07.013700+0000","last_became_peered":"2024-09-10T22:41:07.013700+0000","last_unstale":"2024-09-10T22:41:07.016705+0000","last_undegraded":"2024-09-10T22:41:07.016705+0000","last_fullsized":"2024-09-10T22:41:07.016705+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:53.050265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"54'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442896+0000","last_change":"2024-09-10T22:41:06.005503+0000","last_active":"2024-09-10T22:41:08.442896+0000","last_peered":"2024-09-10T22:41:08.442896+0000","last_clean":"2024-09-10T22:41:08.442896+0000","last_became_active":"2024-09-10T22:41:06.005205+0000","last_became_peered":"2024-09-10T22:41:06.005205+0000","last_unstale":"2024-09-10T22:41:08.442896+0000","last_undegraded":"2024-09-10T22:41:08.442896+0000","last_fullsized":"2024-09-10T22:41:08.442896+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:03.751309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442830+0000","last_change":"2024-09-10T22:41:05.990766+0000","last_active":"2024-09-10T22:41:08.442830+0000","last_peered":"2024-09-10T22:41:08.442830+0000","last_clean":"2024-09-10T22:41:08.442830+0000","last_became_active":"2024-09-10T22:41:05.990495+0000","last_became_peered":"2024-09-10T22:41:05.990495+0000","last_unstale":"2024-09-10T22:41:08.442830+0000","last_undegraded":"2024-09-10T22:41:08.442830+0000","last_fullsized":"2024-09-10T22:41:08.442830+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:56.811450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991002+0000","last_change":"2024-09-10T22:41:07.004711+0000","last_active":"2024-09-10T22:41:07.991002+0000","last_peered":"2024-09-10T22:41:07.991002+0000","last_clean":"2024-09-10T22:41:07.991002+0000","last_became_active":"2024-09-10T22:41:07.004451+0000","last_became_peered":"2024-09-10T22:41:07.004451+0000","last_unstale":"2024-09-10T22:41:07.991002+0000","last_undegraded":"2024-09-10T22:41:07.991002+0000","last_fullsized":"2024-09-10T22:41:07.991002+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:25.632741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-10T22:41:04.981101+0000","last_change":"2024-09-10T22:41:04.981101+0000","last_active":"2024-09-10T22:41:04.962109+0000","last_peered":"2024-09-10T22:41:04.962109+0000","last_clean":"2024-09-10T22:41:04.962109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:04.981101+0000","last_undegraded":"2024-09-10T22:41:04.981101+0000","last_fullsized":"2024-09-10T22:41:04.981101+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442845+0000","last_change":"2024-09-10T22:41:07.005871+0000","last_active":"2024-09-10T22:41:08.442845+0000","last_peered":"2024-09-10T22:41:08.442845+0000","last_clean":"2024-09-10T22:41:08.442845+0000","last_became_active":"2024-09-10T22:41:07.005588+0000","last_became_peered":"2024-09-10T22:41:07.005588+0000","last_unstale":"2024-09-10T22:41:08.442845+0000","last_undegraded":"2024-09-10T22:41:08.442845+0000","last_fullsized":"2024-09-10T22:41:08.442845+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:42.463673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.990690+0000","last_change":"2024-09-10T22:41:06.000828+0000","last_active":"2024-09-10T22:41:06.990690+0000","last_peered":"2024-09-10T22:41:06.990690+0000","last_clean":"2024-09-10T22:41:06.990690+0000","last_became_active":"2024-09-10T22:41:05.998637+0000","last_became_peered":"2024-09-10T22:41:05.998637+0000","last_unstale":"2024-09-10T22:41:06.990690+0000","last_undegraded":"2024-09-10T22:41:06.990690+0000","last_fullsized":"2024-09-10T22:41:06.990690+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:32.301219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.020821+0000","last_change":"2024-09-10T22:41:07.008864+0000","last_active":"2024-09-10T22:41:07.020821+0000","last_peered":"2024-09-10T22:41:07.020821+0000","last_clean":"2024-09-10T22:41:07.020821+0000","last_became_active":"2024-09-10T22:41:07.002835+0000","last_became_peered":"2024-09-10T22:41:07.002835+0000","last_unstale":"2024-09-10T22:41:07.020821+0000","last_undegraded":"2024-09-10T22:41:07.020821+0000","last_fullsized":"2024-09-10T22:41:07.020821+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:54.079923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.989540+0000","last_change":"2024-09-10T22:41:06.005138+0000","last_active":"2024-09-10T22:41:06.989540+0000","last_peered":"2024-09-10T22:41:06.989540+0000","last_clean":"2024-09-10T22:41:06.989540+0000","last_became_active":"2024-09-10T22:41:06.004886+0000","last_became_peered":"2024-09-10T22:41:06.004886+0000","last_unstale":"2024-09-10T22:41:06.989540+0000","last_undegraded":"2024-09-10T22:41:06.989540+0000","last_fullsized":"2024-09-10T22:41:06.989540+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:25.802794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988463+0000","last_change":"2024-09-10T22:41:06.008205+0000","last_active":"2024-09-10T22:41:07.988463+0000","last_peered":"2024-09-10T22:41:07.988463+0000","last_clean":"2024-09-10T22:41:07.988463+0000","last_became_active":"2024-09-10T22:41:06.006600+0000","last_became_peered":"2024-09-10T22:41:06.006600+0000","last_unstale":"2024-09-10T22:41:07.988463+0000","last_undegraded":"2024-09-10T22:41:07.988463+0000","last_fullsized":"2024-09-10T22:41:07.988463+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:57.966564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990322+0000","last_change":"2024-09-10T22:41:07.007272+0000","last_active":"2024-09-10T22:41:07.990322+0000","last_peered":"2024-09-10T22:41:07.990322+0000","last_clean":"2024-09-10T22:41:07.990322+0000","last_became_active":"2024-09-10T22:41:07.006909+0000","last_became_peered":"2024-09-10T22:41:07.006909+0000","last_unstale":"2024-09-10T22:41:07.990322+0000","last_undegraded":"2024-09-10T22:41:07.990322+0000","last_fullsized":"2024-09-10T22:41:07.990322+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:59.336126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442684+0000","last_change":"2024-09-10T22:41:05.999502+0000","last_active":"2024-09-10T22:41:08.442684+0000","last_peered":"2024-09-10T22:41:08.442684+0000","last_clean":"2024-09-10T22:41:08.442684+0000","last_became_active":"2024-09-10T22:41:05.999171+0000","last_became_peered":"2024-09-10T22:41:05.999171+0000","last_unstale":"2024-09-10T22:41:08.442684+0000","last_undegraded":"2024-09-10T22:41:08.442684+0000","last_fullsized":"2024-09-10T22:41:08.442684+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:11.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991455+0000","last_change":"2024-09-10T22:41:06.010369+0000","last_active":"2024-09-10T22:41:07.991455+0000","last_peered":"2024-09-10T22:41:07.991455+0000","last_clean":"2024-09-10T22:41:07.991455+0000","last_became_active":"2024-09-10T22:41:06.010182+0000","last_became_peered":"2024-09-10T22:41:06.010182+0000","last_unstale":"2024-09-10T22:41:07.991455+0000","last_undegraded":"2024-09-10T22:41:07.991455+0000","last_fullsized":"2024-09-10T22:41:07.991455+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:22.685932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.005193+0000","last_change":"2024-09-10T22:41:07.000440+0000","last_active":"2024-09-10T22:41:07.005193+0000","last_peered":"2024-09-10T22:41:07.005193+0000","last_clean":"2024-09-10T22:41:07.005193+0000","last_became_active":"2024-09-10T22:41:06.999910+0000","last_became_peered":"2024-09-10T22:41:06.999910+0000","last_unstale":"2024-09-10T22:41:07.005193+0000","last_undegraded":"2024-09-10T22:41:07.005193+0000","last_fullsized":"2024-09-10T22:41:07.005193+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:43.688712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.992451+0000","last_change":"2024-09-10T22:41:06.009093+0000","last_active":"2024-09-10T22:41:06.992451+0000","last_peered":"2024-09-10T22:41:06.992451+0000","last_clean":"2024-09-10T22:41:06.992451+0000","last_became_active":"2024-09-10T22:41:06.008811+0000","last_became_peered":"2024-09-10T22:41:06.008811+0000","last_unstale":"2024-09-10T22:41:06.992451+0000","last_undegraded":"2024-09-10T22:41:06.992451+0000","last_fullsized":"2024-09-10T22:41:06.992451+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:54.497387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.030485+0000","last_change":"2024-09-10T22:41:07.011776+0000","last_active":"2024-09-10T22:41:07.030485+0000","last_peered":"2024-09-10T22:41:07.030485+0000","last_clean":"2024-09-10T22:41:07.030485+0000","last_became_active":"2024-09-10T22:41:07.011500+0000","last_became_peered":"2024-09-10T22:41:07.011500+0000","last_unstale":"2024-09-10T22:41:07.030485+0000","last_undegraded":"2024-09-10T22:41:07.030485+0000","last_fullsized":"2024-09-10T22:41:07.030485+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:21.906726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.991701+0000","last_change":"2024-09-10T22:41:05.998931+0000","last_active":"2024-09-10T22:41:06.991701+0000","last_peered":"2024-09-10T22:41:06.991701+0000","last_clean":"2024-09-10T22:41:06.991701+0000","last_became_active":"2024-09-10T22:41:05.997587+0000","last_became_peered":"2024-09-10T22:41:05.997587+0000","last_unstale":"2024-09-10T22:41:06.991701+0000","last_undegraded":"2024-09-10T22:41:06.991701+0000","last_fullsized":"2024-09-10T22:41:06.991701+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:20.896548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990817+0000","last_change":"2024-09-10T22:41:07.009487+0000","last_active":"2024-09-10T22:41:07.990817+0000","last_peered":"2024-09-10T22:41:07.990817+0000","last_clean":"2024-09-10T22:41:07.990817+0000","last_became_active":"2024-09-10T22:41:07.009104+0000","last_became_peered":"2024-09-10T22:41:07.009104+0000","last_unstale":"2024-09-10T22:41:07.990817+0000","last_undegraded":"2024-09-10T22:41:07.990817+0000","last_fullsized":"2024-09-10T22:41:07.990817+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:47.347113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.990894+0000","last_change":"2024-09-10T22:41:06.006577+0000","last_active":"2024-09-10T22:41:06.990894+0000","last_peered":"2024-09-10T22:41:06.990894+0000","last_clean":"2024-09-10T22:41:06.990894+0000","last_became_active":"2024-09-10T22:41:06.006219+0000","last_became_peered":"2024-09-10T22:41:06.006219+0000","last_unstale":"2024-09-10T22:41:06.990894+0000","last_undegraded":"2024-09-10T22:41:06.990894+0000","last_fullsized":"2024-09-10T22:41:06.990894+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:47.703955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.030507+0000","last_change":"2024-09-10T22:41:07.013569+0000","last_active":"2024-09-10T22:41:07.030507+0000","last_peered":"2024-09-10T22:41:07.030507+0000","last_clean":"2024-09-10T22:41:07.030507+0000","last_became_active":"2024-09-10T22:41:07.013309+0000","last_became_peered":"2024-09-10T22:41:07.013309+0000","last_unstale":"2024-09-10T22:41:07.030507+0000","last_undegraded":"2024-09-10T22:41:07.030507+0000","last_fullsized":"2024-09-10T22:41:07.030507+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:19.478124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.994609+0000","last_change":"2024-09-10T22:41:06.007609+0000","last_active":"2024-09-10T22:41:06.994609+0000","last_peered":"2024-09-10T22:41:06.994609+0000","last_clean":"2024-09-10T22:41:06.994609+0000","last_became_active":"2024-09-10T22:41:06.007320+0000","last_became_peered":"2024-09-10T22:41:06.007320+0000","last_unstale":"2024-09-10T22:41:06.994609+0000","last_undegraded":"2024-09-10T22:41:06.994609+0000","last_fullsized":"2024-09-10T22:41:06.994609+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:02:49.505104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.023434+0000","last_change":"2024-09-10T22:41:07.019550+0000","last_active":"2024-09-10T22:41:07.023434+0000","last_peered":"2024-09-10T22:41:07.023434+0000","last_clean":"2024-09-10T22:41:07.023434+0000","last_became_active":"2024-09-10T22:41:07.019073+0000","last_became_peered":"2024-09-10T22:41:07.019073+0000","last_unstale":"2024-09-10T22:41:07.023434+0000","last_undegraded":"2024-09-10T22:41:07.023434+0000","last_fullsized":"2024-09-10T22:41:07.023434+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:15.786849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990444+0000","last_change":"2024-09-10T22:41:06.011292+0000","last_active":"2024-09-10T22:41:07.990444+0000","last_peered":"2024-09-10T22:41:07.990444+0000","last_clean":"2024-09-10T22:41:07.990444+0000","last_became_active":"2024-09-10T22:41:06.010970+0000","last_became_peered":"2024-09-10T22:41:06.010970+0000","last_unstale":"2024-09-10T22:41:07.990444+0000","last_undegraded":"2024-09-10T22:41:07.990444+0000","last_fullsized":"2024-09-10T22:41:07.990444+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:51.873950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442589+0000","last_change":"2024-09-10T22:41:06.999739+0000","last_active":"2024-09-10T22:41:08.442589+0000","last_peered":"2024-09-10T22:41:08.442589+0000","last_clean":"2024-09-10T22:41:08.442589+0000","last_became_active":"2024-09-10T22:41:06.999350+0000","last_became_peered":"2024-09-10T22:41:06.999350+0000","last_unstale":"2024-09-10T22:41:08.442589+0000","last_undegraded":"2024-09-10T22:41:08.442589+0000","last_fullsized":"2024-09-10T22:41:08.442589+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:04.903647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.994361+0000","last_change":"2024-09-10T22:41:06.013365+0000","last_active":"2024-09-10T22:41:06.994361+0000","last_peered":"2024-09-10T22:41:06.994361+0000","last_clean":"2024-09-10T22:41:06.994361+0000","last_became_active":"2024-09-10T22:41:06.012873+0000","last_became_peered":"2024-09-10T22:41:06.012873+0000","last_unstale":"2024-09-10T22:41:06.994361+0000","last_undegraded":"2024-09-10T22:41:06.994361+0000","last_fullsized":"2024-09-10T22:41:06.994361+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:56.910500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":173,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991085+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:41:07.991085+0000","last_peered":"2024-09-10T22:41:07.991085+0000","last_clean":"2024-09-10T22:41:07.991085+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:41:07.991085+0000","last_undegraded":"2024-09-10T22:41:07.991085+0000","last_fullsized":"2024-09-10T22:41:07.991085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1236992,"data_stored":871722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509473,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":288574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":634880,"data_stored":281230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509473,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":638976,"data_stored":281812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":651264,"data_stored":282864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":659456,"data_stored":289534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509473,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1236992,"data_stored":871654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":610304,"data_stored":267396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:41:11.115 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:41:11.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f333aa00640 1 -- 172.21.15.103:0/2460844455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3318004d50 msgr2=0x7f33180051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:11.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f333aa00640 1 --2- 172.21.15.103:0/2460844455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3318004d50 0x7f33180051d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f332c009ee0 tx=0x7f332c01d630 comp rx=0 tx=0).stop 2024-09-10T22:41:11.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f3338a00640 1 -- 172.21.15.103:0/2460844455 reap_dead start 2024-09-10T22:41:11.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f333aa00640 1 -- 172.21.15.103:0/2460844455 shutdown_connections 2024-09-10T22:41:11.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f333aa00640 1 -- 172.21.15.103:0/2460844455 >> 172.21.15.103:0/2460844455 conn(0x7f333406cc00 msgr2=0x7f333406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:11.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f333aa00640 1 -- 172.21.15.103:0/2460844455 shutdown_connections 2024-09-10T22:41:11.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f333aa00640 1 -- 172.21.15.103:0/2460844455 wait complete. 2024-09-10T22:41:11.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f333aa00640 1 Processor -- start 2024-09-10T22:41:11.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f333aa00640 1 -- start start 2024-09-10T22:41:11.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f333aa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3318004d50 0x7f33340cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:11.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f333aa00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33341f12c0 0x7f3334150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:11.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f333aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33341f0590 0x7f33341f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:11.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f333aa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f333406eb80 con 0x7f33341f0590 2024-09-10T22:41:11.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f333aa00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3334074470 con 0x7f3318004d50 2024-09-10T22:41:11.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f333aa00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f333406ed00 con 0x7f33341f12c0 2024-09-10T22:41:11.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f3338a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33341f0590 0x7f33341f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:11.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f3338a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33341f0590 0x7f33341f0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56596/0 (socket says 172.21.15.103:56596) 2024-09-10T22:41:11.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f3338a00640 1 -- 172.21.15.103:0/1580725614 learned_addr learned my addr 172.21.15.103:0/1580725614 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:11.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f332b400640 1 --2- 172.21.15.103:0/1580725614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33341f12c0 0x7f3334150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:11.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.292+0000 7f3333e00640 1 --2- 172.21.15.103:0/1580725614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3318004d50 0x7f33340cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:11.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.296+0000 7f3338a00640 1 -- 172.21.15.103:0/1580725614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33341f12c0 msgr2=0x7f3334150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:11.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.296+0000 7f3338a00640 1 --2- 172.21.15.103:0/1580725614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33341f12c0 0x7f3334150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.296+0000 7f3338a00640 1 -- 172.21.15.103:0/1580725614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3318004d50 msgr2=0x7f33340cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:11.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.296+0000 7f3338a00640 1 --2- 172.21.15.103:0/1580725614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3318004d50 0x7f33340cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.296+0000 7f3338a00640 1 -- 172.21.15.103:0/1580725614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33341f0f50 con 0x7f33341f0590 2024-09-10T22:41:11.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.296+0000 7f3338a00640 1 --2- 172.21.15.103:0/1580725614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33341f0590 0x7f33341f0a10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f332c099160 tx=0x7f332c004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:11.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.296+0000 7f3330c00640 1 -- 172.21.15.103:0/1580725614 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c0ad050 con 0x7f33341f0590 2024-09-10T22:41:11.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.296+0000 7f3330c00640 1 -- 172.21.15.103:0/1580725614 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f332c0a7ad0 con 0x7f33341f0590 2024-09-10T22:41:11.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.296+0000 7f3330c00640 1 -- 172.21.15.103:0/1580725614 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c009200 con 0x7f33341f0590 2024-09-10T22:41:11.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.296+0000 7f333aa00640 1 -- 172.21.15.103:0/1580725614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333415e5b0 con 0x7f33341f0590 2024-09-10T22:41:11.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.296+0000 7f333aa00640 1 -- 172.21.15.103:0/1580725614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3334151490 con 0x7f33341f0590 2024-09-10T22:41:11.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.296+0000 7f333aa00640 1 -- 172.21.15.103:0/1580725614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f333415eda0 con 0x7f33341f0590 2024-09-10T22:41:11.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.296+0000 7f3330c00640 1 -- 172.21.15.103:0/1580725614 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f332c003980 con 0x7f33341f0590 2024-09-10T22:41:11.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.296+0000 7f3330c00640 1 --2- 172.21.15.103:0/1580725614 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33100725e0 0x7f3310074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:11.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.296+0000 7f3330c00640 1 -- 172.21.15.103:0/1580725614 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f332c12e2a0 con 0x7f33341f0590 2024-09-10T22:41:11.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.300+0000 7f3333e00640 1 --2- 172.21.15.103:0/1580725614 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33100725e0 0x7f3310074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:11.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.300+0000 7f3333e00640 1 --2- 172.21.15.103:0/1580725614 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33100725e0 0x7f3310074aa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3324009c60 tx=0x7f33240091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:11.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.300+0000 7f3330c00640 1 -- 172.21.15.103:0/1580725614 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f332c017340 con 0x7f33341f0590 2024-09-10T22:41:11.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.464+0000 7f333aa00640 1 -- 172.21.15.103:0/1580725614 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3334155b10 con 0x7f33100725e0 2024-09-10T22:41:11.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.468+0000 7f3330c00640 1 -- 172.21.15.103:0/1580725614 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250312 (secure 0 0 0) 0x7f332405e1e0 con 0x7f33100725e0 2024-09-10T22:41:11.478 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:11.479 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:41:11.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.472+0000 7f333aa00640 1 -- 172.21.15.103:0/1580725614 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33100725e0 msgr2=0x7f3310074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:11.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.472+0000 7f333aa00640 1 --2- 172.21.15.103:0/1580725614 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33100725e0 0x7f3310074aa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3324009c60 tx=0x7f33240091e0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.472+0000 7f333aa00640 1 -- 172.21.15.103:0/1580725614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33341f0590 msgr2=0x7f33341f0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:11.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.472+0000 7f333aa00640 1 --2- 172.21.15.103:0/1580725614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33341f0590 0x7f33341f0a10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f332c099160 tx=0x7f332c004f10 comp rx=0 tx=0).stop 2024-09-10T22:41:11.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.472+0000 7f333aa00640 1 -- 172.21.15.103:0/1580725614 shutdown_connections 2024-09-10T22:41:11.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.472+0000 7f333aa00640 1 --2- 172.21.15.103:0/1580725614 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33100725e0 0x7f3310074aa0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.472+0000 7f333aa00640 1 --2- 172.21.15.103:0/1580725614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33341f0590 0x7f33341f0a10 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.472+0000 7f333aa00640 1 --2- 172.21.15.103:0/1580725614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33341f12c0 0x7f3334150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.472+0000 7f333aa00640 1 --2- 172.21.15.103:0/1580725614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3318004d50 0x7f33340cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.472+0000 7f333aa00640 1 -- 172.21.15.103:0/1580725614 >> 172.21.15.103:0/1580725614 conn(0x7f333406cc00 msgr2=0x7f33340b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:11.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.472+0000 7f333aa00640 1 -- 172.21.15.103:0/1580725614 shutdown_connections 2024-09-10T22:41:11.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.472+0000 7f333aa00640 1 -- 172.21.15.103:0/1580725614 wait complete. 2024-09-10T22:41:11.498 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2024-09-10T22:41:09.651778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":141,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226600,"kb_used_data":6176,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748120,"statfs":{"total":773094113280,"available":772862074880,"internally_reserved":0,"allocated":6324224,"data_stored":3434786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.677408"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991867+0000","last_change":"2024-09-10T22:41:07.018450+0000","last_active":"2024-09-10T22:41:07.991867+0000","last_peered":"2024-09-10T22:41:07.991867+0000","last_clean":"2024-09-10T22:41:07.991867+0000","last_became_active":"2024-09-10T22:41:07.018138+0000","last_became_peered":"2024-09-10T22:41:07.018138+0000","last_unstale":"2024-09-10T22:41:07.991867+0000","last_undegraded":"2024-09-10T22:41:07.991867+0000","last_fullsized":"2024-09-10T22:41:07.991867+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:18.409465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.031628+0000","last_change":"2024-09-10T22:41:07.011508+0000","last_active":"2024-09-10T22:41:07.031628+0000","last_peered":"2024-09-10T22:41:07.031628+0000","last_clean":"2024-09-10T22:41:07.031628+0000","last_became_active":"2024-09-10T22:41:07.011224+0000","last_became_peered":"2024-09-10T22:41:07.011224+0000","last_unstale":"2024-09-10T22:41:07.031628+0000","last_undegraded":"2024-09-10T22:41:07.031628+0000","last_fullsized":"2024-09-10T22:41:07.031628+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:43.688712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990876+0000","last_change":"2024-09-10T22:41:07.016143+0000","last_active":"2024-09-10T22:41:07.990876+0000","last_peered":"2024-09-10T22:41:07.990876+0000","last_clean":"2024-09-10T22:41:07.990876+0000","last_became_active":"2024-09-10T22:41:07.015887+0000","last_became_peered":"2024-09-10T22:41:07.015887+0000","last_unstale":"2024-09-10T22:41:07.990876+0000","last_undegraded":"2024-09-10T22:41:07.990876+0000","last_fullsized":"2024-09-10T22:41:07.990876+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:15.842949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.011219+0000","last_change":"2024-09-10T22:41:07.006851+0000","last_active":"2024-09-10T22:41:07.011219+0000","last_peered":"2024-09-10T22:41:07.011219+0000","last_clean":"2024-09-10T22:41:07.011219+0000","last_became_active":"2024-09-10T22:41:07.006583+0000","last_became_peered":"2024-09-10T22:41:07.006583+0000","last_unstale":"2024-09-10T22:41:07.011219+0000","last_undegraded":"2024-09-10T22:41:07.011219+0000","last_fullsized":"2024-09-10T22:41:07.011219+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:30.833275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.030232+0000","last_change":"2024-09-10T22:41:07.010472+0000","last_active":"2024-09-10T22:41:07.030232+0000","last_peered":"2024-09-10T22:41:07.030232+0000","last_clean":"2024-09-10T22:41:07.030232+0000","last_became_active":"2024-09-10T22:41:07.010173+0000","last_became_peered":"2024-09-10T22:41:07.010173+0000","last_unstale":"2024-09-10T22:41:07.030232+0000","last_undegraded":"2024-09-10T22:41:07.030232+0000","last_fullsized":"2024-09-10T22:41:07.030232+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:43.970261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.005681+0000","last_change":"2024-09-10T22:41:07.000969+0000","last_active":"2024-09-10T22:41:07.005681+0000","last_peered":"2024-09-10T22:41:07.005681+0000","last_clean":"2024-09-10T22:41:07.005681+0000","last_became_active":"2024-09-10T22:41:07.000706+0000","last_became_peered":"2024-09-10T22:41:07.000706+0000","last_unstale":"2024-09-10T22:41:07.005681+0000","last_undegraded":"2024-09-10T22:41:07.005681+0000","last_fullsized":"2024-09-10T22:41:07.005681+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:41:27.226599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.004522+0000","last_change":"2024-09-10T22:41:06.998131+0000","last_active":"2024-09-10T22:41:07.004522+0000","last_peered":"2024-09-10T22:41:07.004522+0000","last_clean":"2024-09-10T22:41:07.004522+0000","last_became_active":"2024-09-10T22:41:06.997825+0000","last_became_peered":"2024-09-10T22:41:06.997825+0000","last_unstale":"2024-09-10T22:41:07.004522+0000","last_undegraded":"2024-09-10T22:41:07.004522+0000","last_fullsized":"2024-09-10T22:41:07.004522+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:19.478124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988797+0000","last_change":"2024-09-10T22:41:07.014300+0000","last_active":"2024-09-10T22:41:07.988797+0000","last_peered":"2024-09-10T22:41:07.988797+0000","last_clean":"2024-09-10T22:41:07.988797+0000","last_became_active":"2024-09-10T22:41:07.013875+0000","last_became_peered":"2024-09-10T22:41:07.013875+0000","last_unstale":"2024-09-10T22:41:07.988797+0000","last_undegraded":"2024-09-10T22:41:07.988797+0000","last_fullsized":"2024-09-10T22:41:07.988797+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:23.123417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.004478+0000","last_change":"2024-09-10T22:41:06.994043+0000","last_active":"2024-09-10T22:41:07.004478+0000","last_peered":"2024-09-10T22:41:07.004478+0000","last_clean":"2024-09-10T22:41:07.004478+0000","last_became_active":"2024-09-10T22:41:06.993754+0000","last_became_peered":"2024-09-10T22:41:06.993754+0000","last_unstale":"2024-09-10T22:41:07.004478+0000","last_undegraded":"2024-09-10T22:41:07.004478+0000","last_fullsized":"2024-09-10T22:41:07.004478+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:59.336126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.032966+0000","last_change":"2024-09-10T22:41:07.021525+0000","last_active":"2024-09-10T22:41:07.032966+0000","last_peered":"2024-09-10T22:41:07.032966+0000","last_clean":"2024-09-10T22:41:07.032966+0000","last_became_active":"2024-09-10T22:41:07.021240+0000","last_became_peered":"2024-09-10T22:41:07.021240+0000","last_unstale":"2024-09-10T22:41:07.032966+0000","last_undegraded":"2024-09-10T22:41:07.032966+0000","last_fullsized":"2024-09-10T22:41:07.032966+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:47.347113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991192+0000","last_change":"2024-09-10T22:41:07.011414+0000","last_active":"2024-09-10T22:41:07.991192+0000","last_peered":"2024-09-10T22:41:07.991192+0000","last_clean":"2024-09-10T22:41:07.991192+0000","last_became_active":"2024-09-10T22:41:07.011123+0000","last_became_peered":"2024-09-10T22:41:07.011123+0000","last_unstale":"2024-09-10T22:41:07.991192+0000","last_undegraded":"2024-09-10T22:41:07.991192+0000","last_fullsized":"2024-09-10T22:41:07.991192+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:42.747411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.007790+0000","last_change":"2024-09-10T22:41:07.001750+0000","last_active":"2024-09-10T22:41:07.007790+0000","last_peered":"2024-09-10T22:41:07.007790+0000","last_clean":"2024-09-10T22:41:07.007790+0000","last_became_active":"2024-09-10T22:41:07.001438+0000","last_became_peered":"2024-09-10T22:41:07.001438+0000","last_unstale":"2024-09-10T22:41:07.007790+0000","last_undegraded":"2024-09-10T22:41:07.007790+0000","last_fullsized":"2024-09-10T22:41:07.007790+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:52.884128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991902+0000","last_change":"2024-09-10T22:41:07.019159+0000","last_active":"2024-09-10T22:41:07.991902+0000","last_peered":"2024-09-10T22:41:07.991902+0000","last_clean":"2024-09-10T22:41:07.991902+0000","last_became_active":"2024-09-10T22:41:07.018849+0000","last_became_peered":"2024-09-10T22:41:07.018849+0000","last_unstale":"2024-09-10T22:41:07.991902+0000","last_undegraded":"2024-09-10T22:41:07.991902+0000","last_fullsized":"2024-09-10T22:41:07.991902+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:01.412535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.016214+0000","last_change":"2024-09-10T22:41:07.003836+0000","last_active":"2024-09-10T22:41:07.016214+0000","last_peered":"2024-09-10T22:41:07.016214+0000","last_clean":"2024-09-10T22:41:07.016214+0000","last_became_active":"2024-09-10T22:41:07.002677+0000","last_became_peered":"2024-09-10T22:41:07.002677+0000","last_unstale":"2024-09-10T22:41:07.016214+0000","last_undegraded":"2024-09-10T22:41:07.016214+0000","last_fullsized":"2024-09-10T22:41:07.016214+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:33.311396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442700+0000","last_change":"2024-09-10T22:41:07.004930+0000","last_active":"2024-09-10T22:41:08.442700+0000","last_peered":"2024-09-10T22:41:08.442700+0000","last_clean":"2024-09-10T22:41:08.442700+0000","last_became_active":"2024-09-10T22:41:07.004625+0000","last_became_peered":"2024-09-10T22:41:07.004625+0000","last_unstale":"2024-09-10T22:41:08.442700+0000","last_undegraded":"2024-09-10T22:41:08.442700+0000","last_fullsized":"2024-09-10T22:41:08.442700+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:57.405156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442644+0000","last_change":"2024-09-10T22:41:07.006673+0000","last_active":"2024-09-10T22:41:08.442644+0000","last_peered":"2024-09-10T22:41:08.442644+0000","last_clean":"2024-09-10T22:41:08.442644+0000","last_became_active":"2024-09-10T22:41:07.006370+0000","last_became_peered":"2024-09-10T22:41:07.006370+0000","last_unstale":"2024-09-10T22:41:08.442644+0000","last_undegraded":"2024-09-10T22:41:08.442644+0000","last_fullsized":"2024-09-10T22:41:08.442644+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:23.696110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.006456+0000","last_change":"2024-09-10T22:41:07.003450+0000","last_active":"2024-09-10T22:41:07.006456+0000","last_peered":"2024-09-10T22:41:07.006456+0000","last_clean":"2024-09-10T22:41:07.006456+0000","last_became_active":"2024-09-10T22:41:07.003154+0000","last_became_peered":"2024-09-10T22:41:07.003154+0000","last_unstale":"2024-09-10T22:41:07.006456+0000","last_undegraded":"2024-09-10T22:41:07.006456+0000","last_fullsized":"2024-09-10T22:41:07.006456+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:47.347113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988596+0000","last_change":"2024-09-10T22:41:07.033768+0000","last_active":"2024-09-10T22:41:07.988596+0000","last_peered":"2024-09-10T22:41:07.988596+0000","last_clean":"2024-09-10T22:41:07.988596+0000","last_became_active":"2024-09-10T22:41:07.033472+0000","last_became_peered":"2024-09-10T22:41:07.033472+0000","last_unstale":"2024-09-10T22:41:07.988596+0000","last_undegraded":"2024-09-10T22:41:07.988596+0000","last_fullsized":"2024-09-10T22:41:07.988596+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:43:44.233205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.032902+0000","last_change":"2024-09-10T22:41:07.021556+0000","last_active":"2024-09-10T22:41:07.032902+0000","last_peered":"2024-09-10T22:41:07.032902+0000","last_clean":"2024-09-10T22:41:07.032902+0000","last_became_active":"2024-09-10T22:41:07.021228+0000","last_became_peered":"2024-09-10T22:41:07.021228+0000","last_unstale":"2024-09-10T22:41:07.032902+0000","last_undegraded":"2024-09-10T22:41:07.032902+0000","last_fullsized":"2024-09-10T22:41:07.032902+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:25.632741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.031256+0000","last_change":"2024-09-10T22:41:07.012645+0000","last_active":"2024-09-10T22:41:07.031256+0000","last_peered":"2024-09-10T22:41:07.031256+0000","last_clean":"2024-09-10T22:41:07.031256+0000","last_became_active":"2024-09-10T22:41:07.011780+0000","last_became_peered":"2024-09-10T22:41:07.011780+0000","last_unstale":"2024-09-10T22:41:07.031256+0000","last_undegraded":"2024-09-10T22:41:07.031256+0000","last_fullsized":"2024-09-10T22:41:07.031256+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:59.336126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.029894+0000","last_change":"2024-09-10T22:41:07.021657+0000","last_active":"2024-09-10T22:41:07.029894+0000","last_peered":"2024-09-10T22:41:07.029894+0000","last_clean":"2024-09-10T22:41:07.029894+0000","last_became_active":"2024-09-10T22:41:07.021005+0000","last_became_peered":"2024-09-10T22:41:07.021005+0000","last_unstale":"2024-09-10T22:41:07.029894+0000","last_undegraded":"2024-09-10T22:41:07.029894+0000","last_fullsized":"2024-09-10T22:41:07.029894+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:37.329229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442852+0000","last_change":"2024-09-10T22:41:07.021311+0000","last_active":"2024-09-10T22:41:08.442852+0000","last_peered":"2024-09-10T22:41:08.442852+0000","last_clean":"2024-09-10T22:41:08.442852+0000","last_became_active":"2024-09-10T22:41:07.017967+0000","last_became_peered":"2024-09-10T22:41:07.017967+0000","last_unstale":"2024-09-10T22:41:08.442852+0000","last_undegraded":"2024-09-10T22:41:08.442852+0000","last_fullsized":"2024-09-10T22:41:08.442852+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:36.893264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.005035+0000","last_change":"2024-09-10T22:41:06.999101+0000","last_active":"2024-09-10T22:41:07.005035+0000","last_peered":"2024-09-10T22:41:07.005035+0000","last_clean":"2024-09-10T22:41:07.005035+0000","last_became_active":"2024-09-10T22:41:06.998842+0000","last_became_peered":"2024-09-10T22:41:06.998842+0000","last_unstale":"2024-09-10T22:41:07.005035+0000","last_undegraded":"2024-09-10T22:41:07.005035+0000","last_fullsized":"2024-09-10T22:41:07.005035+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:36.893264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990989+0000","last_change":"2024-09-10T22:41:07.017658+0000","last_active":"2024-09-10T22:41:07.990989+0000","last_peered":"2024-09-10T22:41:07.990989+0000","last_clean":"2024-09-10T22:41:07.990989+0000","last_became_active":"2024-09-10T22:41:07.017345+0000","last_became_peered":"2024-09-10T22:41:07.017345+0000","last_unstale":"2024-09-10T22:41:07.990989+0000","last_undegraded":"2024-09-10T22:41:07.990989+0000","last_fullsized":"2024-09-10T22:41:07.990989+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:51.381851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.030208+0000","last_change":"2024-09-10T22:41:07.010437+0000","last_active":"2024-09-10T22:41:07.030208+0000","last_peered":"2024-09-10T22:41:07.030208+0000","last_clean":"2024-09-10T22:41:07.030208+0000","last_became_active":"2024-09-10T22:41:07.009860+0000","last_became_peered":"2024-09-10T22:41:07.009860+0000","last_unstale":"2024-09-10T22:41:07.030208+0000","last_undegraded":"2024-09-10T22:41:07.030208+0000","last_fullsized":"2024-09-10T22:41:07.030208+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:48.714132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990379+0000","last_change":"2024-09-10T22:41:07.006639+0000","last_active":"2024-09-10T22:41:07.990379+0000","last_peered":"2024-09-10T22:41:07.990379+0000","last_clean":"2024-09-10T22:41:07.990379+0000","last_became_active":"2024-09-10T22:41:07.006355+0000","last_became_peered":"2024-09-10T22:41:07.006355+0000","last_unstale":"2024-09-10T22:41:07.990379+0000","last_undegraded":"2024-09-10T22:41:07.990379+0000","last_fullsized":"2024-09-10T22:41:07.990379+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:19.478124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990346+0000","last_change":"2024-09-10T22:41:07.001696+0000","last_active":"2024-09-10T22:41:07.990346+0000","last_peered":"2024-09-10T22:41:07.990346+0000","last_clean":"2024-09-10T22:41:07.990346+0000","last_became_active":"2024-09-10T22:41:07.001303+0000","last_became_peered":"2024-09-10T22:41:07.001303+0000","last_unstale":"2024-09-10T22:41:07.990346+0000","last_undegraded":"2024-09-10T22:41:07.990346+0000","last_fullsized":"2024-09-10T22:41:07.990346+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:41.157921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"54'4","reported_seq":19,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442528+0000","last_change":"2024-09-10T22:41:06.002183+0000","last_active":"2024-09-10T22:41:08.442528+0000","last_peered":"2024-09-10T22:41:08.442528+0000","last_clean":"2024-09-10T22:41:08.442528+0000","last_became_active":"2024-09-10T22:41:06.001895+0000","last_became_peered":"2024-09-10T22:41:06.001895+0000","last_unstale":"2024-09-10T22:41:08.442528+0000","last_undegraded":"2024-09-10T22:41:08.442528+0000","last_fullsized":"2024-09-10T22:41:08.442528+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:27.972852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991108+0000","last_change":"2024-09-10T22:41:07.003184+0000","last_active":"2024-09-10T22:41:07.991108+0000","last_peered":"2024-09-10T22:41:07.991108+0000","last_clean":"2024-09-10T22:41:07.991108+0000","last_became_active":"2024-09-10T22:41:07.002900+0000","last_became_peered":"2024-09-10T22:41:07.002900+0000","last_unstale":"2024-09-10T22:41:07.991108+0000","last_undegraded":"2024-09-10T22:41:07.991108+0000","last_fullsized":"2024-09-10T22:41:07.991108+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.301734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-10T22:41:04.981178+0000","last_change":"2024-09-10T22:41:04.981178+0000","last_active":"2024-09-10T22:41:04.962109+0000","last_peered":"2024-09-10T22:41:04.962109+0000","last_clean":"2024-09-10T22:41:04.962109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:04.981178+0000","last_undegraded":"2024-09-10T22:41:04.981178+0000","last_fullsized":"2024-09-10T22:41:04.981178+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442743+0000","last_change":"2024-09-10T22:41:07.006193+0000","last_active":"2024-09-10T22:41:08.442743+0000","last_peered":"2024-09-10T22:41:08.442743+0000","last_clean":"2024-09-10T22:41:08.442743+0000","last_became_active":"2024-09-10T22:41:07.005918+0000","last_became_peered":"2024-09-10T22:41:07.005918+0000","last_unstale":"2024-09-10T22:41:08.442743+0000","last_undegraded":"2024-09-10T22:41:08.442743+0000","last_fullsized":"2024-09-10T22:41:08.442743+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:57.920678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-10T22:41:04.981072+0000","last_change":"2024-09-10T22:41:04.981072+0000","last_active":"2024-09-10T22:41:04.962109+0000","last_peered":"2024-09-10T22:41:04.962109+0000","last_clean":"2024-09-10T22:41:04.962109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:04.981072+0000","last_undegraded":"2024-09-10T22:41:04.981072+0000","last_fullsized":"2024-09-10T22:41:04.981072+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.028346+0000","last_change":"2024-09-10T22:41:07.019698+0000","last_active":"2024-09-10T22:41:07.028346+0000","last_peered":"2024-09-10T22:41:07.028346+0000","last_clean":"2024-09-10T22:41:07.028346+0000","last_became_active":"2024-09-10T22:41:07.019353+0000","last_became_peered":"2024-09-10T22:41:07.019353+0000","last_unstale":"2024-09-10T22:41:07.028346+0000","last_undegraded":"2024-09-10T22:41:07.028346+0000","last_fullsized":"2024-09-10T22:41:07.028346+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:08.459818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991030+0000","last_change":"2024-09-10T22:41:05.997081+0000","last_active":"2024-09-10T22:41:07.991030+0000","last_peered":"2024-09-10T22:41:07.991030+0000","last_clean":"2024-09-10T22:41:07.991030+0000","last_became_active":"2024-09-10T22:41:05.996813+0000","last_became_peered":"2024-09-10T22:41:05.996813+0000","last_unstale":"2024-09-10T22:41:07.991030+0000","last_undegraded":"2024-09-10T22:41:07.991030+0000","last_fullsized":"2024-09-10T22:41:07.991030+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:35.883087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.015463+0000","last_change":"2024-09-10T22:41:07.012392+0000","last_active":"2024-09-10T22:41:07.015463+0000","last_peered":"2024-09-10T22:41:07.015463+0000","last_clean":"2024-09-10T22:41:07.015463+0000","last_became_active":"2024-09-10T22:41:07.012159+0000","last_became_peered":"2024-09-10T22:41:07.012159+0000","last_unstale":"2024-09-10T22:41:07.015463+0000","last_undegraded":"2024-09-10T22:41:07.015463+0000","last_fullsized":"2024-09-10T22:41:07.015463+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:40.550666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"54'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.036336+0000","last_change":"2024-09-10T22:41:06.013192+0000","last_active":"2024-09-10T22:41:07.036336+0000","last_peered":"2024-09-10T22:41:07.036336+0000","last_clean":"2024-09-10T22:41:07.036336+0000","last_became_active":"2024-09-10T22:41:06.012907+0000","last_became_peered":"2024-09-10T22:41:06.012907+0000","last_unstale":"2024-09-10T22:41:07.036336+0000","last_undegraded":"2024-09-10T22:41:07.036336+0000","last_fullsized":"2024-09-10T22:41:07.036336+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:22.685932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991457+0000","last_change":"2024-09-10T22:41:07.017658+0000","last_active":"2024-09-10T22:41:07.991457+0000","last_peered":"2024-09-10T22:41:07.991457+0000","last_clean":"2024-09-10T22:41:07.991457+0000","last_became_active":"2024-09-10T22:41:07.017429+0000","last_became_peered":"2024-09-10T22:41:07.017429+0000","last_unstale":"2024-09-10T22:41:07.991457+0000","last_undegraded":"2024-09-10T22:41:07.991457+0000","last_fullsized":"2024-09-10T22:41:07.991457+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:48.871383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"54'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.024168+0000","last_change":"2024-09-10T22:41:06.005980+0000","last_active":"2024-09-10T22:41:07.024168+0000","last_peered":"2024-09-10T22:41:07.024168+0000","last_clean":"2024-09-10T22:41:07.024168+0000","last_became_active":"2024-09-10T22:41:06.005716+0000","last_became_peered":"2024-09-10T22:41:06.005716+0000","last_unstale":"2024-09-10T22:41:07.024168+0000","last_undegraded":"2024-09-10T22:41:07.024168+0000","last_fullsized":"2024-09-10T22:41:07.024168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:46.600179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.029862+0000","last_change":"2024-09-10T22:41:07.021354+0000","last_active":"2024-09-10T22:41:07.029862+0000","last_peered":"2024-09-10T22:41:07.029862+0000","last_clean":"2024-09-10T22:41:07.029862+0000","last_became_active":"2024-09-10T22:41:07.020585+0000","last_became_peered":"2024-09-10T22:41:07.020585+0000","last_unstale":"2024-09-10T22:41:07.029862+0000","last_undegraded":"2024-09-10T22:41:07.029862+0000","last_fullsized":"2024-09-10T22:41:07.029862+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:37:14.763484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442343+0000","last_change":"2024-09-10T22:41:05.995026+0000","last_active":"2024-09-10T22:41:08.442343+0000","last_peered":"2024-09-10T22:41:08.442343+0000","last_clean":"2024-09-10T22:41:08.442343+0000","last_became_active":"2024-09-10T22:41:05.994459+0000","last_became_peered":"2024-09-10T22:41:05.994459+0000","last_unstale":"2024-09-10T22:41:08.442343+0000","last_undegraded":"2024-09-10T22:41:08.442343+0000","last_fullsized":"2024-09-10T22:41:08.442343+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:24.208151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991919+0000","last_change":"2024-09-10T22:41:07.031675+0000","last_active":"2024-09-10T22:41:07.991919+0000","last_peered":"2024-09-10T22:41:07.991919+0000","last_clean":"2024-09-10T22:41:07.991919+0000","last_became_active":"2024-09-10T22:41:07.031451+0000","last_became_peered":"2024-09-10T22:41:07.031451+0000","last_unstale":"2024-09-10T22:41:07.991919+0000","last_undegraded":"2024-09-10T22:41:07.991919+0000","last_fullsized":"2024-09-10T22:41:07.991919+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:31:18.659448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.988819+0000","last_change":"2024-09-10T22:41:06.000385+0000","last_active":"2024-09-10T22:41:06.988819+0000","last_peered":"2024-09-10T22:41:06.988819+0000","last_clean":"2024-09-10T22:41:06.988819+0000","last_became_active":"2024-09-10T22:41:06.000130+0000","last_became_peered":"2024-09-10T22:41:06.000130+0000","last_unstale":"2024-09-10T22:41:06.988819+0000","last_undegraded":"2024-09-10T22:41:06.988819+0000","last_fullsized":"2024-09-10T22:41:06.988819+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:12.373720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.015502+0000","last_change":"2024-09-10T22:41:07.012034+0000","last_active":"2024-09-10T22:41:07.015502+0000","last_peered":"2024-09-10T22:41:07.015502+0000","last_clean":"2024-09-10T22:41:07.015502+0000","last_became_active":"2024-09-10T22:41:07.008587+0000","last_became_peered":"2024-09-10T22:41:07.008587+0000","last_unstale":"2024-09-10T22:41:07.015502+0000","last_undegraded":"2024-09-10T22:41:07.015502+0000","last_fullsized":"2024-09-10T22:41:07.015502+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:56.351069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.992010+0000","last_change":"2024-09-10T22:41:06.008557+0000","last_active":"2024-09-10T22:41:07.992010+0000","last_peered":"2024-09-10T22:41:07.992010+0000","last_clean":"2024-09-10T22:41:07.992010+0000","last_became_active":"2024-09-10T22:41:06.008253+0000","last_became_peered":"2024-09-10T22:41:06.008253+0000","last_unstale":"2024-09-10T22:41:07.992010+0000","last_undegraded":"2024-09-10T22:41:07.992010+0000","last_fullsized":"2024-09-10T22:41:07.992010+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:56.394978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990584+0000","last_change":"2024-09-10T22:41:06.999332+0000","last_active":"2024-09-10T22:41:07.990584+0000","last_peered":"2024-09-10T22:41:07.990584+0000","last_clean":"2024-09-10T22:41:07.990584+0000","last_became_active":"2024-09-10T22:41:06.998916+0000","last_became_peered":"2024-09-10T22:41:06.998916+0000","last_unstale":"2024-09-10T22:41:07.990584+0000","last_undegraded":"2024-09-10T22:41:07.990584+0000","last_fullsized":"2024-09-10T22:41:07.990584+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:43.688712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.995400+0000","last_change":"2024-09-10T22:41:06.006905+0000","last_active":"2024-09-10T22:41:06.995400+0000","last_peered":"2024-09-10T22:41:06.995400+0000","last_clean":"2024-09-10T22:41:06.995400+0000","last_became_active":"2024-09-10T22:41:06.006582+0000","last_became_peered":"2024-09-10T22:41:06.006582+0000","last_unstale":"2024-09-10T22:41:06.995400+0000","last_undegraded":"2024-09-10T22:41:06.995400+0000","last_fullsized":"2024-09-10T22:41:06.995400+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:45.947252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.011380+0000","last_change":"2024-09-10T22:41:07.002342+0000","last_active":"2024-09-10T22:41:07.011380+0000","last_peered":"2024-09-10T22:41:07.011380+0000","last_clean":"2024-09-10T22:41:07.011380+0000","last_became_active":"2024-09-10T22:41:07.002066+0000","last_became_peered":"2024-09-10T22:41:07.002066+0000","last_unstale":"2024-09-10T22:41:07.011380+0000","last_undegraded":"2024-09-10T22:41:07.011380+0000","last_fullsized":"2024-09-10T22:41:07.011380+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:37.124449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"54'3","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991349+0000","last_change":"2024-09-10T22:41:06.008984+0000","last_active":"2024-09-10T22:41:07.991349+0000","last_peered":"2024-09-10T22:41:07.991349+0000","last_clean":"2024-09-10T22:41:07.991349+0000","last_became_active":"2024-09-10T22:41:06.008191+0000","last_became_peered":"2024-09-10T22:41:06.008191+0000","last_unstale":"2024-09-10T22:41:07.991349+0000","last_undegraded":"2024-09-10T22:41:07.991349+0000","last_fullsized":"2024-09-10T22:41:07.991349+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:03.893470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.017655+0000","last_change":"2024-09-10T22:41:07.015038+0000","last_active":"2024-09-10T22:41:07.017655+0000","last_peered":"2024-09-10T22:41:07.017655+0000","last_clean":"2024-09-10T22:41:07.017655+0000","last_became_active":"2024-09-10T22:41:07.014790+0000","last_became_peered":"2024-09-10T22:41:07.014790+0000","last_unstale":"2024-09-10T22:41:07.017655+0000","last_undegraded":"2024-09-10T22:41:07.017655+0000","last_fullsized":"2024-09-10T22:41:07.017655+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:33.101104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"54'6","reported_seq":19,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.038208+0000","last_change":"2024-09-10T22:41:05.997554+0000","last_active":"2024-09-10T22:41:07.038208+0000","last_peered":"2024-09-10T22:41:07.038208+0000","last_clean":"2024-09-10T22:41:07.038208+0000","last_became_active":"2024-09-10T22:41:05.997207+0000","last_became_peered":"2024-09-10T22:41:05.997207+0000","last_unstale":"2024-09-10T22:41:07.038208+0000","last_undegraded":"2024-09-10T22:41:07.038208+0000","last_fullsized":"2024-09-10T22:41:07.038208+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:53.069745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990781+0000","last_change":"2024-09-10T22:41:07.009874+0000","last_active":"2024-09-10T22:41:07.990781+0000","last_peered":"2024-09-10T22:41:07.990781+0000","last_clean":"2024-09-10T22:41:07.990781+0000","last_became_active":"2024-09-10T22:41:07.009570+0000","last_became_peered":"2024-09-10T22:41:07.009570+0000","last_unstale":"2024-09-10T22:41:07.990781+0000","last_undegraded":"2024-09-10T22:41:07.990781+0000","last_fullsized":"2024-09-10T22:41:07.990781+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:41:27.226599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"54'2","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.033033+0000","last_change":"2024-09-10T22:41:06.006329+0000","last_active":"2024-09-10T22:41:07.033033+0000","last_peered":"2024-09-10T22:41:07.033033+0000","last_clean":"2024-09-10T22:41:07.033033+0000","last_became_active":"2024-09-10T22:41:06.006076+0000","last_became_peered":"2024-09-10T22:41:06.006076+0000","last_unstale":"2024-09-10T22:41:07.033033+0000","last_undegraded":"2024-09-10T22:41:07.033033+0000","last_fullsized":"2024-09-10T22:41:07.033033+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:03.893470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.031658+0000","last_change":"2024-09-10T22:41:07.015684+0000","last_active":"2024-09-10T22:41:07.031658+0000","last_peered":"2024-09-10T22:41:07.031658+0000","last_clean":"2024-09-10T22:41:07.031658+0000","last_became_active":"2024-09-10T22:41:07.015425+0000","last_became_peered":"2024-09-10T22:41:07.015425+0000","last_unstale":"2024-09-10T22:41:07.031658+0000","last_undegraded":"2024-09-10T22:41:07.031658+0000","last_fullsized":"2024-09-10T22:41:07.031658+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:41:27.226599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442629+0000","last_change":"2024-09-10T22:41:05.996246+0000","last_active":"2024-09-10T22:41:08.442629+0000","last_peered":"2024-09-10T22:41:08.442629+0000","last_clean":"2024-09-10T22:41:08.442629+0000","last_became_active":"2024-09-10T22:41:05.995968+0000","last_became_peered":"2024-09-10T22:41:05.995968+0000","last_unstale":"2024-09-10T22:41:08.442629+0000","last_undegraded":"2024-09-10T22:41:08.442629+0000","last_fullsized":"2024-09-10T22:41:08.442629+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:11.662901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.020799+0000","last_change":"2024-09-10T22:41:07.012291+0000","last_active":"2024-09-10T22:41:07.020799+0000","last_peered":"2024-09-10T22:41:07.020799+0000","last_clean":"2024-09-10T22:41:07.020799+0000","last_became_active":"2024-09-10T22:41:07.012006+0000","last_became_peered":"2024-09-10T22:41:07.012006+0000","last_unstale":"2024-09-10T22:41:07.020799+0000","last_undegraded":"2024-09-10T22:41:07.020799+0000","last_fullsized":"2024-09-10T22:41:07.020799+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.301734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991300+0000","last_change":"2024-09-10T22:41:06.009142+0000","last_active":"2024-09-10T22:41:07.991300+0000","last_peered":"2024-09-10T22:41:07.991300+0000","last_clean":"2024-09-10T22:41:07.991300+0000","last_became_active":"2024-09-10T22:41:06.008215+0000","last_became_peered":"2024-09-10T22:41:06.008215+0000","last_unstale":"2024-09-10T22:41:07.991300+0000","last_undegraded":"2024-09-10T22:41:07.991300+0000","last_fullsized":"2024-09-10T22:41:07.991300+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:25.802794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.007816+0000","last_change":"2024-09-10T22:41:07.001776+0000","last_active":"2024-09-10T22:41:07.007816+0000","last_peered":"2024-09-10T22:41:07.007816+0000","last_clean":"2024-09-10T22:41:07.007816+0000","last_became_active":"2024-09-10T22:41:07.001504+0000","last_became_peered":"2024-09-10T22:41:07.001504+0000","last_unstale":"2024-09-10T22:41:07.007816+0000","last_undegraded":"2024-09-10T22:41:07.007816+0000","last_fullsized":"2024-09-10T22:41:07.007816+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:34.312993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"54'8","reported_seq":21,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.036815+0000","last_change":"2024-09-10T22:41:05.998248+0000","last_active":"2024-09-10T22:41:07.036815+0000","last_peered":"2024-09-10T22:41:07.036815+0000","last_clean":"2024-09-10T22:41:07.036815+0000","last_became_active":"2024-09-10T22:41:05.997978+0000","last_became_peered":"2024-09-10T22:41:05.997978+0000","last_unstale":"2024-09-10T22:41:07.036815+0000","last_undegraded":"2024-09-10T22:41:07.036815+0000","last_fullsized":"2024-09-10T22:41:07.036815+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:42.960083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.006427+0000","last_change":"2024-09-10T22:41:07.005382+0000","last_active":"2024-09-10T22:41:07.006427+0000","last_peered":"2024-09-10T22:41:07.006427+0000","last_clean":"2024-09-10T22:41:07.006427+0000","last_became_active":"2024-09-10T22:41:07.004169+0000","last_became_peered":"2024-09-10T22:41:07.004169+0000","last_unstale":"2024-09-10T22:41:07.006427+0000","last_undegraded":"2024-09-10T22:41:07.006427+0000","last_fullsized":"2024-09-10T22:41:07.006427+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:25.632741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"54'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.033085+0000","last_change":"2024-09-10T22:41:05.997356+0000","last_active":"2024-09-10T22:41:07.033085+0000","last_peered":"2024-09-10T22:41:07.033085+0000","last_clean":"2024-09-10T22:41:07.033085+0000","last_became_active":"2024-09-10T22:41:05.997087+0000","last_became_peered":"2024-09-10T22:41:05.997087+0000","last_unstale":"2024-09-10T22:41:07.033085+0000","last_undegraded":"2024-09-10T22:41:07.033085+0000","last_fullsized":"2024-09-10T22:41:07.033085+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:56.394978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988949+0000","last_change":"2024-09-10T22:41:06.005480+0000","last_active":"2024-09-10T22:41:07.988949+0000","last_peered":"2024-09-10T22:41:07.988949+0000","last_clean":"2024-09-10T22:41:07.988949+0000","last_became_active":"2024-09-10T22:41:06.005212+0000","last_became_peered":"2024-09-10T22:41:06.005212+0000","last_unstale":"2024-09-10T22:41:07.988949+0000","last_undegraded":"2024-09-10T22:41:07.988949+0000","last_fullsized":"2024-09-10T22:41:07.988949+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:05.166519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.016705+0000","last_change":"2024-09-10T22:41:07.013980+0000","last_active":"2024-09-10T22:41:07.016705+0000","last_peered":"2024-09-10T22:41:07.016705+0000","last_clean":"2024-09-10T22:41:07.016705+0000","last_became_active":"2024-09-10T22:41:07.013700+0000","last_became_peered":"2024-09-10T22:41:07.013700+0000","last_unstale":"2024-09-10T22:41:07.016705+0000","last_undegraded":"2024-09-10T22:41:07.016705+0000","last_fullsized":"2024-09-10T22:41:07.016705+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:53.050265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"54'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442896+0000","last_change":"2024-09-10T22:41:06.005503+0000","last_active":"2024-09-10T22:41:08.442896+0000","last_peered":"2024-09-10T22:41:08.442896+0000","last_clean":"2024-09-10T22:41:08.442896+0000","last_became_active":"2024-09-10T22:41:06.005205+0000","last_became_peered":"2024-09-10T22:41:06.005205+0000","last_unstale":"2024-09-10T22:41:08.442896+0000","last_undegraded":"2024-09-10T22:41:08.442896+0000","last_fullsized":"2024-09-10T22:41:08.442896+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:03.751309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442830+0000","last_change":"2024-09-10T22:41:05.990766+0000","last_active":"2024-09-10T22:41:08.442830+0000","last_peered":"2024-09-10T22:41:08.442830+0000","last_clean":"2024-09-10T22:41:08.442830+0000","last_became_active":"2024-09-10T22:41:05.990495+0000","last_became_peered":"2024-09-10T22:41:05.990495+0000","last_unstale":"2024-09-10T22:41:08.442830+0000","last_undegraded":"2024-09-10T22:41:08.442830+0000","last_fullsized":"2024-09-10T22:41:08.442830+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:56.811450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991002+0000","last_change":"2024-09-10T22:41:07.004711+0000","last_active":"2024-09-10T22:41:07.991002+0000","last_peered":"2024-09-10T22:41:07.991002+0000","last_clean":"2024-09-10T22:41:07.991002+0000","last_became_active":"2024-09-10T22:41:07.004451+0000","last_became_peered":"2024-09-10T22:41:07.004451+0000","last_unstale":"2024-09-10T22:41:07.991002+0000","last_undegraded":"2024-09-10T22:41:07.991002+0000","last_fullsized":"2024-09-10T22:41:07.991002+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:25.632741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-10T22:41:04.981101+0000","last_change":"2024-09-10T22:41:04.981101+0000","last_active":"2024-09-10T22:41:04.962109+0000","last_peered":"2024-09-10T22:41:04.962109+0000","last_clean":"2024-09-10T22:41:04.962109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:04.981101+0000","last_undegraded":"2024-09-10T22:41:04.981101+0000","last_fullsized":"2024-09-10T22:41:04.981101+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442845+0000","last_change":"2024-09-10T22:41:07.005871+0000","last_active":"2024-09-10T22:41:08.442845+0000","last_peered":"2024-09-10T22:41:08.442845+0000","last_clean":"2024-09-10T22:41:08.442845+0000","last_became_active":"2024-09-10T22:41:07.005588+0000","last_became_peered":"2024-09-10T22:41:07.005588+0000","last_unstale":"2024-09-10T22:41:08.442845+0000","last_undegraded":"2024-09-10T22:41:08.442845+0000","last_fullsized":"2024-09-10T22:41:08.442845+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:42.463673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.990690+0000","last_change":"2024-09-10T22:41:06.000828+0000","last_active":"2024-09-10T22:41:06.990690+0000","last_peered":"2024-09-10T22:41:06.990690+0000","last_clean":"2024-09-10T22:41:06.990690+0000","last_became_active":"2024-09-10T22:41:05.998637+0000","last_became_peered":"2024-09-10T22:41:05.998637+0000","last_unstale":"2024-09-10T22:41:06.990690+0000","last_undegraded":"2024-09-10T22:41:06.990690+0000","last_fullsized":"2024-09-10T22:41:06.990690+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:32.301219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.020821+0000","last_change":"2024-09-10T22:41:07.008864+0000","last_active":"2024-09-10T22:41:07.020821+0000","last_peered":"2024-09-10T22:41:07.020821+0000","last_clean":"2024-09-10T22:41:07.020821+0000","last_became_active":"2024-09-10T22:41:07.002835+0000","last_became_peered":"2024-09-10T22:41:07.002835+0000","last_unstale":"2024-09-10T22:41:07.020821+0000","last_undegraded":"2024-09-10T22:41:07.020821+0000","last_fullsized":"2024-09-10T22:41:07.020821+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:54.079923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.989540+0000","last_change":"2024-09-10T22:41:06.005138+0000","last_active":"2024-09-10T22:41:06.989540+0000","last_peered":"2024-09-10T22:41:06.989540+0000","last_clean":"2024-09-10T22:41:06.989540+0000","last_became_active":"2024-09-10T22:41:06.004886+0000","last_became_peered":"2024-09-10T22:41:06.004886+0000","last_unstale":"2024-09-10T22:41:06.989540+0000","last_undegraded":"2024-09-10T22:41:06.989540+0000","last_fullsized":"2024-09-10T22:41:06.989540+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:25.802794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988463+0000","last_change":"2024-09-10T22:41:06.008205+0000","last_active":"2024-09-10T22:41:07.988463+0000","last_peered":"2024-09-10T22:41:07.988463+0000","last_clean":"2024-09-10T22:41:07.988463+0000","last_became_active":"2024-09-10T22:41:06.006600+0000","last_became_peered":"2024-09-10T22:41:06.006600+0000","last_unstale":"2024-09-10T22:41:07.988463+0000","last_undegraded":"2024-09-10T22:41:07.988463+0000","last_fullsized":"2024-09-10T22:41:07.988463+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:57.966564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990322+0000","last_change":"2024-09-10T22:41:07.007272+0000","last_active":"2024-09-10T22:41:07.990322+0000","last_peered":"2024-09-10T22:41:07.990322+0000","last_clean":"2024-09-10T22:41:07.990322+0000","last_became_active":"2024-09-10T22:41:07.006909+0000","last_became_peered":"2024-09-10T22:41:07.006909+0000","last_unstale":"2024-09-10T22:41:07.990322+0000","last_undegraded":"2024-09-10T22:41:07.990322+0000","last_fullsized":"2024-09-10T22:41:07.990322+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:59.336126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442684+0000","last_change":"2024-09-10T22:41:05.999502+0000","last_active":"2024-09-10T22:41:08.442684+0000","last_peered":"2024-09-10T22:41:08.442684+0000","last_clean":"2024-09-10T22:41:08.442684+0000","last_became_active":"2024-09-10T22:41:05.999171+0000","last_became_peered":"2024-09-10T22:41:05.999171+0000","last_unstale":"2024-09-10T22:41:08.442684+0000","last_undegraded":"2024-09-10T22:41:08.442684+0000","last_fullsized":"2024-09-10T22:41:08.442684+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:11.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:41:05.972287+0000","last_change":"2024-09-10T22:41:05.972287+0000","last_active":"2024-09-10T22:41:05.972287+0000","last_peered":"2024-09-10T22:41:05.972287+0000","last_clean":"2024-09-10T22:41:05.972287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:41:05.972287+0000","last_undegraded":"2024-09-10T22:41:05.972287+0000","last_fullsized":"2024-09-10T22:41:05.972287+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991455+0000","last_change":"2024-09-10T22:41:06.010369+0000","last_active":"2024-09-10T22:41:07.991455+0000","last_peered":"2024-09-10T22:41:07.991455+0000","last_clean":"2024-09-10T22:41:07.991455+0000","last_became_active":"2024-09-10T22:41:06.010182+0000","last_became_peered":"2024-09-10T22:41:06.010182+0000","last_unstale":"2024-09-10T22:41:07.991455+0000","last_undegraded":"2024-09-10T22:41:07.991455+0000","last_fullsized":"2024-09-10T22:41:07.991455+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:22.685932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.005193+0000","last_change":"2024-09-10T22:41:07.000440+0000","last_active":"2024-09-10T22:41:07.005193+0000","last_peered":"2024-09-10T22:41:07.005193+0000","last_clean":"2024-09-10T22:41:07.005193+0000","last_became_active":"2024-09-10T22:41:06.999910+0000","last_became_peered":"2024-09-10T22:41:06.999910+0000","last_unstale":"2024-09-10T22:41:07.005193+0000","last_undegraded":"2024-09-10T22:41:07.005193+0000","last_fullsized":"2024-09-10T22:41:07.005193+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:43.688712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.992451+0000","last_change":"2024-09-10T22:41:06.009093+0000","last_active":"2024-09-10T22:41:06.992451+0000","last_peered":"2024-09-10T22:41:06.992451+0000","last_clean":"2024-09-10T22:41:06.992451+0000","last_became_active":"2024-09-10T22:41:06.008811+0000","last_became_peered":"2024-09-10T22:41:06.008811+0000","last_unstale":"2024-09-10T22:41:06.992451+0000","last_undegraded":"2024-09-10T22:41:06.992451+0000","last_fullsized":"2024-09-10T22:41:06.992451+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:54.497387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.030485+0000","last_change":"2024-09-10T22:41:07.011776+0000","last_active":"2024-09-10T22:41:07.030485+0000","last_peered":"2024-09-10T22:41:07.030485+0000","last_clean":"2024-09-10T22:41:07.030485+0000","last_became_active":"2024-09-10T22:41:07.011500+0000","last_became_peered":"2024-09-10T22:41:07.011500+0000","last_unstale":"2024-09-10T22:41:07.030485+0000","last_undegraded":"2024-09-10T22:41:07.030485+0000","last_fullsized":"2024-09-10T22:41:07.030485+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:21.906726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.991701+0000","last_change":"2024-09-10T22:41:05.998931+0000","last_active":"2024-09-10T22:41:06.991701+0000","last_peered":"2024-09-10T22:41:06.991701+0000","last_clean":"2024-09-10T22:41:06.991701+0000","last_became_active":"2024-09-10T22:41:05.997587+0000","last_became_peered":"2024-09-10T22:41:05.997587+0000","last_unstale":"2024-09-10T22:41:06.991701+0000","last_undegraded":"2024-09-10T22:41:06.991701+0000","last_fullsized":"2024-09-10T22:41:06.991701+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:20.896548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990817+0000","last_change":"2024-09-10T22:41:07.009487+0000","last_active":"2024-09-10T22:41:07.990817+0000","last_peered":"2024-09-10T22:41:07.990817+0000","last_clean":"2024-09-10T22:41:07.990817+0000","last_became_active":"2024-09-10T22:41:07.009104+0000","last_became_peered":"2024-09-10T22:41:07.009104+0000","last_unstale":"2024-09-10T22:41:07.990817+0000","last_undegraded":"2024-09-10T22:41:07.990817+0000","last_fullsized":"2024-09-10T22:41:07.990817+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:47.347113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.990894+0000","last_change":"2024-09-10T22:41:06.006577+0000","last_active":"2024-09-10T22:41:06.990894+0000","last_peered":"2024-09-10T22:41:06.990894+0000","last_clean":"2024-09-10T22:41:06.990894+0000","last_became_active":"2024-09-10T22:41:06.006219+0000","last_became_peered":"2024-09-10T22:41:06.006219+0000","last_unstale":"2024-09-10T22:41:06.990894+0000","last_undegraded":"2024-09-10T22:41:06.990894+0000","last_fullsized":"2024-09-10T22:41:06.990894+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:47.703955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.030507+0000","last_change":"2024-09-10T22:41:07.013569+0000","last_active":"2024-09-10T22:41:07.030507+0000","last_peered":"2024-09-10T22:41:07.030507+0000","last_clean":"2024-09-10T22:41:07.030507+0000","last_became_active":"2024-09-10T22:41:07.013309+0000","last_became_peered":"2024-09-10T22:41:07.013309+0000","last_unstale":"2024-09-10T22:41:07.030507+0000","last_undegraded":"2024-09-10T22:41:07.030507+0000","last_fullsized":"2024-09-10T22:41:07.030507+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:19.478124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.994609+0000","last_change":"2024-09-10T22:41:06.007609+0000","last_active":"2024-09-10T22:41:06.994609+0000","last_peered":"2024-09-10T22:41:06.994609+0000","last_clean":"2024-09-10T22:41:06.994609+0000","last_became_active":"2024-09-10T22:41:06.007320+0000","last_became_peered":"2024-09-10T22:41:06.007320+0000","last_unstale":"2024-09-10T22:41:06.994609+0000","last_undegraded":"2024-09-10T22:41:06.994609+0000","last_fullsized":"2024-09-10T22:41:06.994609+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:02:49.505104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.023434+0000","last_change":"2024-09-10T22:41:07.019550+0000","last_active":"2024-09-10T22:41:07.023434+0000","last_peered":"2024-09-10T22:41:07.023434+0000","last_clean":"2024-09-10T22:41:07.023434+0000","last_became_active":"2024-09-10T22:41:07.019073+0000","last_became_peered":"2024-09-10T22:41:07.019073+0000","last_unstale":"2024-09-10T22:41:07.023434+0000","last_undegraded":"2024-09-10T22:41:07.023434+0000","last_fullsized":"2024-09-10T22:41:07.023434+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:15.786849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990444+0000","last_change":"2024-09-10T22:41:06.011292+0000","last_active":"2024-09-10T22:41:07.990444+0000","last_peered":"2024-09-10T22:41:07.990444+0000","last_clean":"2024-09-10T22:41:07.990444+0000","last_became_active":"2024-09-10T22:41:06.010970+0000","last_became_peered":"2024-09-10T22:41:06.010970+0000","last_unstale":"2024-09-10T22:41:07.990444+0000","last_undegraded":"2024-09-10T22:41:07.990444+0000","last_fullsized":"2024-09-10T22:41:07.990444+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:51.873950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442589+0000","last_change":"2024-09-10T22:41:06.999739+0000","last_active":"2024-09-10T22:41:08.442589+0000","last_peered":"2024-09-10T22:41:08.442589+0000","last_clean":"2024-09-10T22:41:08.442589+0000","last_became_active":"2024-09-10T22:41:06.999350+0000","last_became_peered":"2024-09-10T22:41:06.999350+0000","last_unstale":"2024-09-10T22:41:08.442589+0000","last_undegraded":"2024-09-10T22:41:08.442589+0000","last_fullsized":"2024-09-10T22:41:08.442589+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:04.903647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.994361+0000","last_change":"2024-09-10T22:41:06.013365+0000","last_active":"2024-09-10T22:41:06.994361+0000","last_peered":"2024-09-10T22:41:06.994361+0000","last_clean":"2024-09-10T22:41:06.994361+0000","last_became_active":"2024-09-10T22:41:06.012873+0000","last_became_peered":"2024-09-10T22:41:06.012873+0000","last_unstale":"2024-09-10T22:41:06.994361+0000","last_undegraded":"2024-09-10T22:41:06.994361+0000","last_fullsized":"2024-09-10T22:41:06.994361+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:56.910500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":173,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991085+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:41:07.991085+0000","last_peered":"2024-09-10T22:41:07.991085+0000","last_clean":"2024-09-10T22:41:07.991085+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:41:07.991085+0000","last_undegraded":"2024-09-10T22:41:07.991085+0000","last_fullsized":"2024-09-10T22:41:07.991085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1236992,"data_stored":871722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509473,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":288574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":634880,"data_stored":281230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509473,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":638976,"data_stored":281812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":651264,"data_stored":282864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":659456,"data_stored":289534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509473,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1236992,"data_stored":871654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":610304,"data_stored":267396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:41:11.502 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:41:11.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.672+0000 7f69f5a00640 1 -- 172.21.15.103:0/3060176851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f00cf9f0 msgr2=0x7f69f006eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:11.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.672+0000 7f69f5a00640 1 --2- 172.21.15.103:0/3060176851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f00cf9f0 0x7f69f006eb80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f69f00cc6e0 tx=0x7f69e001c8c0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.672+0000 7f69f5a00640 1 -- 172.21.15.103:0/3060176851 shutdown_connections 2024-09-10T22:41:11.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.672+0000 7f69f5a00640 1 --2- 172.21.15.103:0/3060176851 >> v2:172.21.15.131:3300/0 conn(0x7f69f00cfdd0 0x7f69f0073b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.672+0000 7f69f5a00640 1 --2- 172.21.15.103:0/3060176851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69f006f0c0 0x7f69f0073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.672+0000 7f69f5a00640 1 --2- 172.21.15.103:0/3060176851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f00cf9f0 0x7f69f006eb80 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.672+0000 7f69f5a00640 1 -- 172.21.15.103:0/3060176851 >> 172.21.15.103:0/3060176851 conn(0x7f69f006cc00 msgr2=0x7f69f006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:11.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.672+0000 7f69f5a00640 1 -- 172.21.15.103:0/3060176851 shutdown_connections 2024-09-10T22:41:11.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.672+0000 7f69f5a00640 1 -- 172.21.15.103:0/3060176851 wait complete. 2024-09-10T22:41:11.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69f5a00640 1 Processor -- start 2024-09-10T22:41:11.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69f5a00640 1 -- start start 2024-09-10T22:41:11.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69f5a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69f006f0c0 0x7f69f015e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:11.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69f5a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69f00cf9f0 0x7f69f014fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:11.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69f5a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f00cfdd0 0x7f69f014ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:11.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69f5a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f69f00ccab0 con 0x7f69f00cfdd0 2024-09-10T22:41:11.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69f5a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f69f00cc930 con 0x7f69f00cf9f0 2024-09-10T22:41:11.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69f5a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f69f00ccc30 con 0x7f69f006f0c0 2024-09-10T22:41:11.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69ef400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f00cfdd0 0x7f69f014ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:11.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69ef400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f00cfdd0 0x7f69f014ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56614/0 (socket says 172.21.15.103:56614) 2024-09-10T22:41:11.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69ef400640 1 -- 172.21.15.103:0/3068313074 learned_addr learned my addr 172.21.15.103:0/3068313074 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:11.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69eea00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69f006f0c0 0x7f69f015e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:11.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69ee000640 1 --2- 172.21.15.103:0/3068313074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69f00cf9f0 0x7f69f014fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:11.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69ef400640 1 -- 172.21.15.103:0/3068313074 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69f006f0c0 msgr2=0x7f69f015e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:11.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69ef400640 1 --2- 172.21.15.103:0/3068313074 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69f006f0c0 0x7f69f015e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69ef400640 1 -- 172.21.15.103:0/3068313074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69f00cf9f0 msgr2=0x7f69f014fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:11.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69ef400640 1 --2- 172.21.15.103:0/3068313074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69f00cf9f0 0x7f69f014fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69ef400640 1 -- 172.21.15.103:0/3068313074 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f01fb290 con 0x7f69f00cfdd0 2024-09-10T22:41:11.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69ef400640 1 --2- 172.21.15.103:0/3068313074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f00cfdd0 0x7f69f014ff80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f69e800daf0 tx=0x7f69e800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:11.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69e6a00640 1 -- 172.21.15.103:0/3068313074 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8017070 con 0x7f69f00cfdd0 2024-09-10T22:41:11.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69e6a00640 1 -- 172.21.15.103:0/3068313074 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69e8004b30 con 0x7f69f00cfdd0 2024-09-10T22:41:11.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69e6a00640 1 -- 172.21.15.103:0/3068313074 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8005020 con 0x7f69f00cfdd0 2024-09-10T22:41:11.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69f5a00640 1 -- 172.21.15.103:0/3068313074 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f01fb570 con 0x7f69f00cfdd0 2024-09-10T22:41:11.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.676+0000 7f69f5a00640 1 -- 172.21.15.103:0/3068313074 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f01fbb30 con 0x7f69f00cfdd0 2024-09-10T22:41:11.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.680+0000 7f69f5a00640 1 -- 172.21.15.103:0/3068313074 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f006eb80 con 0x7f69f00cfdd0 2024-09-10T22:41:11.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.680+0000 7f69e6a00640 1 -- 172.21.15.103:0/3068313074 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f69e80051c0 con 0x7f69f00cfdd0 2024-09-10T22:41:11.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.680+0000 7f69e6a00640 1 --2- 172.21.15.103:0/3068313074 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f69d00725e0 0x7f69d0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:11.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.680+0000 7f69e6a00640 1 -- 172.21.15.103:0/3068313074 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f69e8093640 con 0x7f69f00cfdd0 2024-09-10T22:41:11.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.680+0000 7f69eea00640 1 --2- 172.21.15.103:0/3068313074 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f69d00725e0 0x7f69d0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:11.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.684+0000 7f69eea00640 1 --2- 172.21.15.103:0/3068313074 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f69d00725e0 0x7f69d0074aa0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f69e00af000 tx=0x7f69e001b100 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:11.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.684+0000 7f69e6a00640 1 -- 172.21.15.103:0/3068313074 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f69e8020070 con 0x7f69f00cfdd0 2024-09-10T22:41:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.848+0000 7f69f5a00640 1 -- 172.21.15.103:0/3068313074 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f69f00afa80 con 0x7f69d00725e0 2024-09-10T22:41:11.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.852+0000 7f69e6a00640 1 -- 172.21.15.103:0/3068313074 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251943 (secure 0 0 0) 0x7f69f00afa80 con 0x7f69d00725e0 2024-09-10T22:41:11.861 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:11.862 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:41:11.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.856+0000 7f69f5a00640 1 -- 172.21.15.103:0/3068313074 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f69d00725e0 msgr2=0x7f69d0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:11.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.856+0000 7f69f5a00640 1 --2- 172.21.15.103:0/3068313074 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f69d00725e0 0x7f69d0074aa0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f69e00af000 tx=0x7f69e001b100 comp rx=0 tx=0).stop 2024-09-10T22:41:11.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.856+0000 7f69f5a00640 1 -- 172.21.15.103:0/3068313074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f00cfdd0 msgr2=0x7f69f014ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:11.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.856+0000 7f69f5a00640 1 --2- 172.21.15.103:0/3068313074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f00cfdd0 0x7f69f014ff80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f69e800daf0 tx=0x7f69e800b260 comp rx=0 tx=0).stop 2024-09-10T22:41:11.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.856+0000 7f69f5a00640 1 -- 172.21.15.103:0/3068313074 shutdown_connections 2024-09-10T22:41:11.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.856+0000 7f69f5a00640 1 --2- 172.21.15.103:0/3068313074 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f69d00725e0 0x7f69d0074aa0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.856+0000 7f69f5a00640 1 --2- 172.21.15.103:0/3068313074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f00cfdd0 0x7f69f014ff80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.856+0000 7f69f5a00640 1 --2- 172.21.15.103:0/3068313074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69f00cf9f0 0x7f69f014fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.856+0000 7f69f5a00640 1 --2- 172.21.15.103:0/3068313074 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69f006f0c0 0x7f69f015e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:11.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.856+0000 7f69f5a00640 1 -- 172.21.15.103:0/3068313074 >> 172.21.15.103:0/3068313074 conn(0x7f69f006cc00 msgr2=0x7f69f00b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:11.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.856+0000 7f69f5a00640 1 -- 172.21.15.103:0/3068313074 shutdown_connections 2024-09-10T22:41:11.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:11.856+0000 7f69f5a00640 1 -- 172.21.15.103:0/3068313074 wait complete. 2024-09-10T22:41:11.882 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2024-09-10T22:41:11.652367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226640,"kb_used_data":6220,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748080,"statfs":{"total":773094113280,"available":772862033920,"internally_reserved":0,"allocated":6369280,"data_stored":3455472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001462"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234823+0000","last_change":"2024-09-10T22:41:07.009600+0000","last_active":"2024-09-10T22:41:09.234823+0000","last_peered":"2024-09-10T22:41:09.234823+0000","last_clean":"2024-09-10T22:41:09.234823+0000","last_became_active":"2024-09-10T22:41:07.009300+0000","last_became_peered":"2024-09-10T22:41:07.009300+0000","last_unstale":"2024-09-10T22:41:09.234823+0000","last_undegraded":"2024-09-10T22:41:09.234823+0000","last_fullsized":"2024-09-10T22:41:09.234823+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:43.814129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991867+0000","last_change":"2024-09-10T22:41:07.018450+0000","last_active":"2024-09-10T22:41:07.991867+0000","last_peered":"2024-09-10T22:41:07.991867+0000","last_clean":"2024-09-10T22:41:07.991867+0000","last_became_active":"2024-09-10T22:41:07.018138+0000","last_became_peered":"2024-09-10T22:41:07.018138+0000","last_unstale":"2024-09-10T22:41:07.991867+0000","last_undegraded":"2024-09-10T22:41:07.991867+0000","last_fullsized":"2024-09-10T22:41:07.991867+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:18.409465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.031628+0000","last_change":"2024-09-10T22:41:07.011508+0000","last_active":"2024-09-10T22:41:07.031628+0000","last_peered":"2024-09-10T22:41:07.031628+0000","last_clean":"2024-09-10T22:41:07.031628+0000","last_became_active":"2024-09-10T22:41:07.011224+0000","last_became_peered":"2024-09-10T22:41:07.011224+0000","last_unstale":"2024-09-10T22:41:07.031628+0000","last_undegraded":"2024-09-10T22:41:07.031628+0000","last_fullsized":"2024-09-10T22:41:07.031628+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:43.688712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990876+0000","last_change":"2024-09-10T22:41:07.016143+0000","last_active":"2024-09-10T22:41:07.990876+0000","last_peered":"2024-09-10T22:41:07.990876+0000","last_clean":"2024-09-10T22:41:07.990876+0000","last_became_active":"2024-09-10T22:41:07.015887+0000","last_became_peered":"2024-09-10T22:41:07.015887+0000","last_unstale":"2024-09-10T22:41:07.990876+0000","last_undegraded":"2024-09-10T22:41:07.990876+0000","last_fullsized":"2024-09-10T22:41:07.990876+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:15.842949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.011219+0000","last_change":"2024-09-10T22:41:07.006851+0000","last_active":"2024-09-10T22:41:07.011219+0000","last_peered":"2024-09-10T22:41:07.011219+0000","last_clean":"2024-09-10T22:41:07.011219+0000","last_became_active":"2024-09-10T22:41:07.006583+0000","last_became_peered":"2024-09-10T22:41:07.006583+0000","last_unstale":"2024-09-10T22:41:07.011219+0000","last_undegraded":"2024-09-10T22:41:07.011219+0000","last_fullsized":"2024-09-10T22:41:07.011219+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:30.833275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235120+0000","last_change":"2024-09-10T22:41:07.018190+0000","last_active":"2024-09-10T22:41:09.235120+0000","last_peered":"2024-09-10T22:41:09.235120+0000","last_clean":"2024-09-10T22:41:09.235120+0000","last_became_active":"2024-09-10T22:41:07.017937+0000","last_became_peered":"2024-09-10T22:41:07.017937+0000","last_unstale":"2024-09-10T22:41:09.235120+0000","last_undegraded":"2024-09-10T22:41:09.235120+0000","last_fullsized":"2024-09-10T22:41:09.235120+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:58.501910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.030232+0000","last_change":"2024-09-10T22:41:07.010472+0000","last_active":"2024-09-10T22:41:07.030232+0000","last_peered":"2024-09-10T22:41:07.030232+0000","last_clean":"2024-09-10T22:41:07.030232+0000","last_became_active":"2024-09-10T22:41:07.010173+0000","last_became_peered":"2024-09-10T22:41:07.010173+0000","last_unstale":"2024-09-10T22:41:07.030232+0000","last_undegraded":"2024-09-10T22:41:07.030232+0000","last_fullsized":"2024-09-10T22:41:07.030232+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:43.970261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.005681+0000","last_change":"2024-09-10T22:41:07.000969+0000","last_active":"2024-09-10T22:41:07.005681+0000","last_peered":"2024-09-10T22:41:07.005681+0000","last_clean":"2024-09-10T22:41:07.005681+0000","last_became_active":"2024-09-10T22:41:07.000706+0000","last_became_peered":"2024-09-10T22:41:07.000706+0000","last_unstale":"2024-09-10T22:41:07.005681+0000","last_undegraded":"2024-09-10T22:41:07.005681+0000","last_fullsized":"2024-09-10T22:41:07.005681+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:41:27.226599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.004522+0000","last_change":"2024-09-10T22:41:06.998131+0000","last_active":"2024-09-10T22:41:07.004522+0000","last_peered":"2024-09-10T22:41:07.004522+0000","last_clean":"2024-09-10T22:41:07.004522+0000","last_became_active":"2024-09-10T22:41:06.997825+0000","last_became_peered":"2024-09-10T22:41:06.997825+0000","last_unstale":"2024-09-10T22:41:07.004522+0000","last_undegraded":"2024-09-10T22:41:07.004522+0000","last_fullsized":"2024-09-10T22:41:07.004522+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:19.478124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234515+0000","last_change":"2024-09-10T22:41:07.015006+0000","last_active":"2024-09-10T22:41:09.234515+0000","last_peered":"2024-09-10T22:41:09.234515+0000","last_clean":"2024-09-10T22:41:09.234515+0000","last_became_active":"2024-09-10T22:41:07.014712+0000","last_became_peered":"2024-09-10T22:41:07.014712+0000","last_unstale":"2024-09-10T22:41:09.234515+0000","last_undegraded":"2024-09-10T22:41:09.234515+0000","last_fullsized":"2024-09-10T22:41:09.234515+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:37.809927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988797+0000","last_change":"2024-09-10T22:41:07.014300+0000","last_active":"2024-09-10T22:41:07.988797+0000","last_peered":"2024-09-10T22:41:07.988797+0000","last_clean":"2024-09-10T22:41:07.988797+0000","last_became_active":"2024-09-10T22:41:07.013875+0000","last_became_peered":"2024-09-10T22:41:07.013875+0000","last_unstale":"2024-09-10T22:41:07.988797+0000","last_undegraded":"2024-09-10T22:41:07.988797+0000","last_fullsized":"2024-09-10T22:41:07.988797+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:23.123417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.004478+0000","last_change":"2024-09-10T22:41:06.994043+0000","last_active":"2024-09-10T22:41:07.004478+0000","last_peered":"2024-09-10T22:41:07.004478+0000","last_clean":"2024-09-10T22:41:07.004478+0000","last_became_active":"2024-09-10T22:41:06.993754+0000","last_became_peered":"2024-09-10T22:41:06.993754+0000","last_unstale":"2024-09-10T22:41:07.004478+0000","last_undegraded":"2024-09-10T22:41:07.004478+0000","last_fullsized":"2024-09-10T22:41:07.004478+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:59.336126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234455+0000","last_change":"2024-09-10T22:41:07.015850+0000","last_active":"2024-09-10T22:41:09.234455+0000","last_peered":"2024-09-10T22:41:09.234455+0000","last_clean":"2024-09-10T22:41:09.234455+0000","last_became_active":"2024-09-10T22:41:07.015582+0000","last_became_peered":"2024-09-10T22:41:07.015582+0000","last_unstale":"2024-09-10T22:41:09.234455+0000","last_undegraded":"2024-09-10T22:41:09.234455+0000","last_fullsized":"2024-09-10T22:41:09.234455+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:08.678783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.032966+0000","last_change":"2024-09-10T22:41:07.021525+0000","last_active":"2024-09-10T22:41:07.032966+0000","last_peered":"2024-09-10T22:41:07.032966+0000","last_clean":"2024-09-10T22:41:07.032966+0000","last_became_active":"2024-09-10T22:41:07.021240+0000","last_became_peered":"2024-09-10T22:41:07.021240+0000","last_unstale":"2024-09-10T22:41:07.032966+0000","last_undegraded":"2024-09-10T22:41:07.032966+0000","last_fullsized":"2024-09-10T22:41:07.032966+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:47.347113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991192+0000","last_change":"2024-09-10T22:41:07.011414+0000","last_active":"2024-09-10T22:41:07.991192+0000","last_peered":"2024-09-10T22:41:07.991192+0000","last_clean":"2024-09-10T22:41:07.991192+0000","last_became_active":"2024-09-10T22:41:07.011123+0000","last_became_peered":"2024-09-10T22:41:07.011123+0000","last_unstale":"2024-09-10T22:41:07.991192+0000","last_undegraded":"2024-09-10T22:41:07.991192+0000","last_fullsized":"2024-09-10T22:41:07.991192+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:42.747411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234294+0000","last_change":"2024-09-10T22:41:07.015097+0000","last_active":"2024-09-10T22:41:09.234294+0000","last_peered":"2024-09-10T22:41:09.234294+0000","last_clean":"2024-09-10T22:41:09.234294+0000","last_became_active":"2024-09-10T22:41:07.014724+0000","last_became_peered":"2024-09-10T22:41:07.014724+0000","last_unstale":"2024-09-10T22:41:09.234294+0000","last_undegraded":"2024-09-10T22:41:09.234294+0000","last_fullsized":"2024-09-10T22:41:09.234294+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:35.995356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.007790+0000","last_change":"2024-09-10T22:41:07.001750+0000","last_active":"2024-09-10T22:41:07.007790+0000","last_peered":"2024-09-10T22:41:07.007790+0000","last_clean":"2024-09-10T22:41:07.007790+0000","last_became_active":"2024-09-10T22:41:07.001438+0000","last_became_peered":"2024-09-10T22:41:07.001438+0000","last_unstale":"2024-09-10T22:41:07.007790+0000","last_undegraded":"2024-09-10T22:41:07.007790+0000","last_fullsized":"2024-09-10T22:41:07.007790+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:52.884128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991902+0000","last_change":"2024-09-10T22:41:07.019159+0000","last_active":"2024-09-10T22:41:07.991902+0000","last_peered":"2024-09-10T22:41:07.991902+0000","last_clean":"2024-09-10T22:41:07.991902+0000","last_became_active":"2024-09-10T22:41:07.018849+0000","last_became_peered":"2024-09-10T22:41:07.018849+0000","last_unstale":"2024-09-10T22:41:07.991902+0000","last_undegraded":"2024-09-10T22:41:07.991902+0000","last_fullsized":"2024-09-10T22:41:07.991902+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:01.412535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.016214+0000","last_change":"2024-09-10T22:41:07.003836+0000","last_active":"2024-09-10T22:41:07.016214+0000","last_peered":"2024-09-10T22:41:07.016214+0000","last_clean":"2024-09-10T22:41:07.016214+0000","last_became_active":"2024-09-10T22:41:07.002677+0000","last_became_peered":"2024-09-10T22:41:07.002677+0000","last_unstale":"2024-09-10T22:41:07.016214+0000","last_undegraded":"2024-09-10T22:41:07.016214+0000","last_fullsized":"2024-09-10T22:41:07.016214+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:33.311396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442700+0000","last_change":"2024-09-10T22:41:07.004930+0000","last_active":"2024-09-10T22:41:08.442700+0000","last_peered":"2024-09-10T22:41:08.442700+0000","last_clean":"2024-09-10T22:41:08.442700+0000","last_became_active":"2024-09-10T22:41:07.004625+0000","last_became_peered":"2024-09-10T22:41:07.004625+0000","last_unstale":"2024-09-10T22:41:08.442700+0000","last_undegraded":"2024-09-10T22:41:08.442700+0000","last_fullsized":"2024-09-10T22:41:08.442700+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:57.405156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442644+0000","last_change":"2024-09-10T22:41:07.006673+0000","last_active":"2024-09-10T22:41:08.442644+0000","last_peered":"2024-09-10T22:41:08.442644+0000","last_clean":"2024-09-10T22:41:08.442644+0000","last_became_active":"2024-09-10T22:41:07.006370+0000","last_became_peered":"2024-09-10T22:41:07.006370+0000","last_unstale":"2024-09-10T22:41:08.442644+0000","last_undegraded":"2024-09-10T22:41:08.442644+0000","last_fullsized":"2024-09-10T22:41:08.442644+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:23.696110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.006456+0000","last_change":"2024-09-10T22:41:07.003450+0000","last_active":"2024-09-10T22:41:07.006456+0000","last_peered":"2024-09-10T22:41:07.006456+0000","last_clean":"2024-09-10T22:41:07.006456+0000","last_became_active":"2024-09-10T22:41:07.003154+0000","last_became_peered":"2024-09-10T22:41:07.003154+0000","last_unstale":"2024-09-10T22:41:07.006456+0000","last_undegraded":"2024-09-10T22:41:07.006456+0000","last_fullsized":"2024-09-10T22:41:07.006456+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:47.347113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988596+0000","last_change":"2024-09-10T22:41:07.033768+0000","last_active":"2024-09-10T22:41:07.988596+0000","last_peered":"2024-09-10T22:41:07.988596+0000","last_clean":"2024-09-10T22:41:07.988596+0000","last_became_active":"2024-09-10T22:41:07.033472+0000","last_became_peered":"2024-09-10T22:41:07.033472+0000","last_unstale":"2024-09-10T22:41:07.988596+0000","last_undegraded":"2024-09-10T22:41:07.988596+0000","last_fullsized":"2024-09-10T22:41:07.988596+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:43:44.233205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.032902+0000","last_change":"2024-09-10T22:41:07.021556+0000","last_active":"2024-09-10T22:41:07.032902+0000","last_peered":"2024-09-10T22:41:07.032902+0000","last_clean":"2024-09-10T22:41:07.032902+0000","last_became_active":"2024-09-10T22:41:07.021228+0000","last_became_peered":"2024-09-10T22:41:07.021228+0000","last_unstale":"2024-09-10T22:41:07.032902+0000","last_undegraded":"2024-09-10T22:41:07.032902+0000","last_fullsized":"2024-09-10T22:41:07.032902+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:25.632741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.031256+0000","last_change":"2024-09-10T22:41:07.012645+0000","last_active":"2024-09-10T22:41:07.031256+0000","last_peered":"2024-09-10T22:41:07.031256+0000","last_clean":"2024-09-10T22:41:07.031256+0000","last_became_active":"2024-09-10T22:41:07.011780+0000","last_became_peered":"2024-09-10T22:41:07.011780+0000","last_unstale":"2024-09-10T22:41:07.031256+0000","last_undegraded":"2024-09-10T22:41:07.031256+0000","last_fullsized":"2024-09-10T22:41:07.031256+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:59.336126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.029894+0000","last_change":"2024-09-10T22:41:07.021657+0000","last_active":"2024-09-10T22:41:07.029894+0000","last_peered":"2024-09-10T22:41:07.029894+0000","last_clean":"2024-09-10T22:41:07.029894+0000","last_became_active":"2024-09-10T22:41:07.021005+0000","last_became_peered":"2024-09-10T22:41:07.021005+0000","last_unstale":"2024-09-10T22:41:07.029894+0000","last_undegraded":"2024-09-10T22:41:07.029894+0000","last_fullsized":"2024-09-10T22:41:07.029894+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:37.329229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234562+0000","last_change":"2024-09-10T22:41:07.018391+0000","last_active":"2024-09-10T22:41:09.234562+0000","last_peered":"2024-09-10T22:41:09.234562+0000","last_clean":"2024-09-10T22:41:09.234562+0000","last_became_active":"2024-09-10T22:41:07.017756+0000","last_became_peered":"2024-09-10T22:41:07.017756+0000","last_unstale":"2024-09-10T22:41:09.234562+0000","last_undegraded":"2024-09-10T22:41:09.234562+0000","last_fullsized":"2024-09-10T22:41:09.234562+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:39.637740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442852+0000","last_change":"2024-09-10T22:41:07.021311+0000","last_active":"2024-09-10T22:41:08.442852+0000","last_peered":"2024-09-10T22:41:08.442852+0000","last_clean":"2024-09-10T22:41:08.442852+0000","last_became_active":"2024-09-10T22:41:07.017967+0000","last_became_peered":"2024-09-10T22:41:07.017967+0000","last_unstale":"2024-09-10T22:41:08.442852+0000","last_undegraded":"2024-09-10T22:41:08.442852+0000","last_fullsized":"2024-09-10T22:41:08.442852+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:36.893264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.005035+0000","last_change":"2024-09-10T22:41:06.999101+0000","last_active":"2024-09-10T22:41:07.005035+0000","last_peered":"2024-09-10T22:41:07.005035+0000","last_clean":"2024-09-10T22:41:07.005035+0000","last_became_active":"2024-09-10T22:41:06.998842+0000","last_became_peered":"2024-09-10T22:41:06.998842+0000","last_unstale":"2024-09-10T22:41:07.005035+0000","last_undegraded":"2024-09-10T22:41:07.005035+0000","last_fullsized":"2024-09-10T22:41:07.005035+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:36.893264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990989+0000","last_change":"2024-09-10T22:41:07.017658+0000","last_active":"2024-09-10T22:41:07.990989+0000","last_peered":"2024-09-10T22:41:07.990989+0000","last_clean":"2024-09-10T22:41:07.990989+0000","last_became_active":"2024-09-10T22:41:07.017345+0000","last_became_peered":"2024-09-10T22:41:07.017345+0000","last_unstale":"2024-09-10T22:41:07.990989+0000","last_undegraded":"2024-09-10T22:41:07.990989+0000","last_fullsized":"2024-09-10T22:41:07.990989+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:51.381851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.030208+0000","last_change":"2024-09-10T22:41:07.010437+0000","last_active":"2024-09-10T22:41:07.030208+0000","last_peered":"2024-09-10T22:41:07.030208+0000","last_clean":"2024-09-10T22:41:07.030208+0000","last_became_active":"2024-09-10T22:41:07.009860+0000","last_became_peered":"2024-09-10T22:41:07.009860+0000","last_unstale":"2024-09-10T22:41:07.030208+0000","last_undegraded":"2024-09-10T22:41:07.030208+0000","last_fullsized":"2024-09-10T22:41:07.030208+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:48.714132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990379+0000","last_change":"2024-09-10T22:41:07.006639+0000","last_active":"2024-09-10T22:41:07.990379+0000","last_peered":"2024-09-10T22:41:07.990379+0000","last_clean":"2024-09-10T22:41:07.990379+0000","last_became_active":"2024-09-10T22:41:07.006355+0000","last_became_peered":"2024-09-10T22:41:07.006355+0000","last_unstale":"2024-09-10T22:41:07.990379+0000","last_undegraded":"2024-09-10T22:41:07.990379+0000","last_fullsized":"2024-09-10T22:41:07.990379+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:19.478124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990346+0000","last_change":"2024-09-10T22:41:07.001696+0000","last_active":"2024-09-10T22:41:07.990346+0000","last_peered":"2024-09-10T22:41:07.990346+0000","last_clean":"2024-09-10T22:41:07.990346+0000","last_became_active":"2024-09-10T22:41:07.001303+0000","last_became_peered":"2024-09-10T22:41:07.001303+0000","last_unstale":"2024-09-10T22:41:07.990346+0000","last_undegraded":"2024-09-10T22:41:07.990346+0000","last_fullsized":"2024-09-10T22:41:07.990346+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:41.157921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"54'4","reported_seq":19,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442528+0000","last_change":"2024-09-10T22:41:06.002183+0000","last_active":"2024-09-10T22:41:08.442528+0000","last_peered":"2024-09-10T22:41:08.442528+0000","last_clean":"2024-09-10T22:41:08.442528+0000","last_became_active":"2024-09-10T22:41:06.001895+0000","last_became_peered":"2024-09-10T22:41:06.001895+0000","last_unstale":"2024-09-10T22:41:08.442528+0000","last_undegraded":"2024-09-10T22:41:08.442528+0000","last_fullsized":"2024-09-10T22:41:08.442528+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:27.972852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991108+0000","last_change":"2024-09-10T22:41:07.003184+0000","last_active":"2024-09-10T22:41:07.991108+0000","last_peered":"2024-09-10T22:41:07.991108+0000","last_clean":"2024-09-10T22:41:07.991108+0000","last_became_active":"2024-09-10T22:41:07.002900+0000","last_became_peered":"2024-09-10T22:41:07.002900+0000","last_unstale":"2024-09-10T22:41:07.991108+0000","last_undegraded":"2024-09-10T22:41:07.991108+0000","last_fullsized":"2024-09-10T22:41:07.991108+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.301734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"54'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234583+0000","last_change":"2024-09-10T22:41:06.010884+0000","last_active":"2024-09-10T22:41:09.234583+0000","last_peered":"2024-09-10T22:41:09.234583+0000","last_clean":"2024-09-10T22:41:09.234583+0000","last_became_active":"2024-09-10T22:41:06.010619+0000","last_became_peered":"2024-09-10T22:41:06.010619+0000","last_unstale":"2024-09-10T22:41:09.234583+0000","last_undegraded":"2024-09-10T22:41:09.234583+0000","last_fullsized":"2024-09-10T22:41:09.234583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:37.296445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442743+0000","last_change":"2024-09-10T22:41:07.006193+0000","last_active":"2024-09-10T22:41:08.442743+0000","last_peered":"2024-09-10T22:41:08.442743+0000","last_clean":"2024-09-10T22:41:08.442743+0000","last_became_active":"2024-09-10T22:41:07.005918+0000","last_became_peered":"2024-09-10T22:41:07.005918+0000","last_unstale":"2024-09-10T22:41:08.442743+0000","last_undegraded":"2024-09-10T22:41:08.442743+0000","last_fullsized":"2024-09-10T22:41:08.442743+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:57.920678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234620+0000","last_change":"2024-09-10T22:41:06.011552+0000","last_active":"2024-09-10T22:41:09.234620+0000","last_peered":"2024-09-10T22:41:09.234620+0000","last_clean":"2024-09-10T22:41:09.234620+0000","last_became_active":"2024-09-10T22:41:06.011220+0000","last_became_peered":"2024-09-10T22:41:06.011220+0000","last_unstale":"2024-09-10T22:41:09.234620+0000","last_undegraded":"2024-09-10T22:41:09.234620+0000","last_fullsized":"2024-09-10T22:41:09.234620+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:32.955172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.028346+0000","last_change":"2024-09-10T22:41:07.019698+0000","last_active":"2024-09-10T22:41:07.028346+0000","last_peered":"2024-09-10T22:41:07.028346+0000","last_clean":"2024-09-10T22:41:07.028346+0000","last_became_active":"2024-09-10T22:41:07.019353+0000","last_became_peered":"2024-09-10T22:41:07.019353+0000","last_unstale":"2024-09-10T22:41:07.028346+0000","last_undegraded":"2024-09-10T22:41:07.028346+0000","last_fullsized":"2024-09-10T22:41:07.028346+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:08.459818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991030+0000","last_change":"2024-09-10T22:41:05.997081+0000","last_active":"2024-09-10T22:41:07.991030+0000","last_peered":"2024-09-10T22:41:07.991030+0000","last_clean":"2024-09-10T22:41:07.991030+0000","last_became_active":"2024-09-10T22:41:05.996813+0000","last_became_peered":"2024-09-10T22:41:05.996813+0000","last_unstale":"2024-09-10T22:41:07.991030+0000","last_undegraded":"2024-09-10T22:41:07.991030+0000","last_fullsized":"2024-09-10T22:41:07.991030+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:35.883087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.015463+0000","last_change":"2024-09-10T22:41:07.012392+0000","last_active":"2024-09-10T22:41:07.015463+0000","last_peered":"2024-09-10T22:41:07.015463+0000","last_clean":"2024-09-10T22:41:07.015463+0000","last_became_active":"2024-09-10T22:41:07.012159+0000","last_became_peered":"2024-09-10T22:41:07.012159+0000","last_unstale":"2024-09-10T22:41:07.015463+0000","last_undegraded":"2024-09-10T22:41:07.015463+0000","last_fullsized":"2024-09-10T22:41:07.015463+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:40.550666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"54'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.036336+0000","last_change":"2024-09-10T22:41:06.013192+0000","last_active":"2024-09-10T22:41:07.036336+0000","last_peered":"2024-09-10T22:41:07.036336+0000","last_clean":"2024-09-10T22:41:07.036336+0000","last_became_active":"2024-09-10T22:41:06.012907+0000","last_became_peered":"2024-09-10T22:41:06.012907+0000","last_unstale":"2024-09-10T22:41:07.036336+0000","last_undegraded":"2024-09-10T22:41:07.036336+0000","last_fullsized":"2024-09-10T22:41:07.036336+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:22.685932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991457+0000","last_change":"2024-09-10T22:41:07.017658+0000","last_active":"2024-09-10T22:41:07.991457+0000","last_peered":"2024-09-10T22:41:07.991457+0000","last_clean":"2024-09-10T22:41:07.991457+0000","last_became_active":"2024-09-10T22:41:07.017429+0000","last_became_peered":"2024-09-10T22:41:07.017429+0000","last_unstale":"2024-09-10T22:41:07.991457+0000","last_undegraded":"2024-09-10T22:41:07.991457+0000","last_fullsized":"2024-09-10T22:41:07.991457+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:48.871383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"54'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.024168+0000","last_change":"2024-09-10T22:41:06.005980+0000","last_active":"2024-09-10T22:41:07.024168+0000","last_peered":"2024-09-10T22:41:07.024168+0000","last_clean":"2024-09-10T22:41:07.024168+0000","last_became_active":"2024-09-10T22:41:06.005716+0000","last_became_peered":"2024-09-10T22:41:06.005716+0000","last_unstale":"2024-09-10T22:41:07.024168+0000","last_undegraded":"2024-09-10T22:41:07.024168+0000","last_fullsized":"2024-09-10T22:41:07.024168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:46.600179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.029862+0000","last_change":"2024-09-10T22:41:07.021354+0000","last_active":"2024-09-10T22:41:07.029862+0000","last_peered":"2024-09-10T22:41:07.029862+0000","last_clean":"2024-09-10T22:41:07.029862+0000","last_became_active":"2024-09-10T22:41:07.020585+0000","last_became_peered":"2024-09-10T22:41:07.020585+0000","last_unstale":"2024-09-10T22:41:07.029862+0000","last_undegraded":"2024-09-10T22:41:07.029862+0000","last_fullsized":"2024-09-10T22:41:07.029862+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:37:14.763484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442343+0000","last_change":"2024-09-10T22:41:05.995026+0000","last_active":"2024-09-10T22:41:08.442343+0000","last_peered":"2024-09-10T22:41:08.442343+0000","last_clean":"2024-09-10T22:41:08.442343+0000","last_became_active":"2024-09-10T22:41:05.994459+0000","last_became_peered":"2024-09-10T22:41:05.994459+0000","last_unstale":"2024-09-10T22:41:08.442343+0000","last_undegraded":"2024-09-10T22:41:08.442343+0000","last_fullsized":"2024-09-10T22:41:08.442343+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:24.208151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991919+0000","last_change":"2024-09-10T22:41:07.031675+0000","last_active":"2024-09-10T22:41:07.991919+0000","last_peered":"2024-09-10T22:41:07.991919+0000","last_clean":"2024-09-10T22:41:07.991919+0000","last_became_active":"2024-09-10T22:41:07.031451+0000","last_became_peered":"2024-09-10T22:41:07.031451+0000","last_unstale":"2024-09-10T22:41:07.991919+0000","last_undegraded":"2024-09-10T22:41:07.991919+0000","last_fullsized":"2024-09-10T22:41:07.991919+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:31:18.659448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.988819+0000","last_change":"2024-09-10T22:41:06.000385+0000","last_active":"2024-09-10T22:41:06.988819+0000","last_peered":"2024-09-10T22:41:06.988819+0000","last_clean":"2024-09-10T22:41:06.988819+0000","last_became_active":"2024-09-10T22:41:06.000130+0000","last_became_peered":"2024-09-10T22:41:06.000130+0000","last_unstale":"2024-09-10T22:41:06.988819+0000","last_undegraded":"2024-09-10T22:41:06.988819+0000","last_fullsized":"2024-09-10T22:41:06.988819+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:12.373720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.015502+0000","last_change":"2024-09-10T22:41:07.012034+0000","last_active":"2024-09-10T22:41:07.015502+0000","last_peered":"2024-09-10T22:41:07.015502+0000","last_clean":"2024-09-10T22:41:07.015502+0000","last_became_active":"2024-09-10T22:41:07.008587+0000","last_became_peered":"2024-09-10T22:41:07.008587+0000","last_unstale":"2024-09-10T22:41:07.015502+0000","last_undegraded":"2024-09-10T22:41:07.015502+0000","last_fullsized":"2024-09-10T22:41:07.015502+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:56.351069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.992010+0000","last_change":"2024-09-10T22:41:06.008557+0000","last_active":"2024-09-10T22:41:07.992010+0000","last_peered":"2024-09-10T22:41:07.992010+0000","last_clean":"2024-09-10T22:41:07.992010+0000","last_became_active":"2024-09-10T22:41:06.008253+0000","last_became_peered":"2024-09-10T22:41:06.008253+0000","last_unstale":"2024-09-10T22:41:07.992010+0000","last_undegraded":"2024-09-10T22:41:07.992010+0000","last_fullsized":"2024-09-10T22:41:07.992010+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:56.394978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990584+0000","last_change":"2024-09-10T22:41:06.999332+0000","last_active":"2024-09-10T22:41:07.990584+0000","last_peered":"2024-09-10T22:41:07.990584+0000","last_clean":"2024-09-10T22:41:07.990584+0000","last_became_active":"2024-09-10T22:41:06.998916+0000","last_became_peered":"2024-09-10T22:41:06.998916+0000","last_unstale":"2024-09-10T22:41:07.990584+0000","last_undegraded":"2024-09-10T22:41:07.990584+0000","last_fullsized":"2024-09-10T22:41:07.990584+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:43.688712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.995400+0000","last_change":"2024-09-10T22:41:06.006905+0000","last_active":"2024-09-10T22:41:06.995400+0000","last_peered":"2024-09-10T22:41:06.995400+0000","last_clean":"2024-09-10T22:41:06.995400+0000","last_became_active":"2024-09-10T22:41:06.006582+0000","last_became_peered":"2024-09-10T22:41:06.006582+0000","last_unstale":"2024-09-10T22:41:06.995400+0000","last_undegraded":"2024-09-10T22:41:06.995400+0000","last_fullsized":"2024-09-10T22:41:06.995400+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:45.947252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.011380+0000","last_change":"2024-09-10T22:41:07.002342+0000","last_active":"2024-09-10T22:41:07.011380+0000","last_peered":"2024-09-10T22:41:07.011380+0000","last_clean":"2024-09-10T22:41:07.011380+0000","last_became_active":"2024-09-10T22:41:07.002066+0000","last_became_peered":"2024-09-10T22:41:07.002066+0000","last_unstale":"2024-09-10T22:41:07.011380+0000","last_undegraded":"2024-09-10T22:41:07.011380+0000","last_fullsized":"2024-09-10T22:41:07.011380+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:37.124449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"54'3","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991349+0000","last_change":"2024-09-10T22:41:06.008984+0000","last_active":"2024-09-10T22:41:07.991349+0000","last_peered":"2024-09-10T22:41:07.991349+0000","last_clean":"2024-09-10T22:41:07.991349+0000","last_became_active":"2024-09-10T22:41:06.008191+0000","last_became_peered":"2024-09-10T22:41:06.008191+0000","last_unstale":"2024-09-10T22:41:07.991349+0000","last_undegraded":"2024-09-10T22:41:07.991349+0000","last_fullsized":"2024-09-10T22:41:07.991349+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:03.893470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.017655+0000","last_change":"2024-09-10T22:41:07.015038+0000","last_active":"2024-09-10T22:41:07.017655+0000","last_peered":"2024-09-10T22:41:07.017655+0000","last_clean":"2024-09-10T22:41:07.017655+0000","last_became_active":"2024-09-10T22:41:07.014790+0000","last_became_peered":"2024-09-10T22:41:07.014790+0000","last_unstale":"2024-09-10T22:41:07.017655+0000","last_undegraded":"2024-09-10T22:41:07.017655+0000","last_fullsized":"2024-09-10T22:41:07.017655+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:33.101104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"54'6","reported_seq":19,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.038208+0000","last_change":"2024-09-10T22:41:05.997554+0000","last_active":"2024-09-10T22:41:07.038208+0000","last_peered":"2024-09-10T22:41:07.038208+0000","last_clean":"2024-09-10T22:41:07.038208+0000","last_became_active":"2024-09-10T22:41:05.997207+0000","last_became_peered":"2024-09-10T22:41:05.997207+0000","last_unstale":"2024-09-10T22:41:07.038208+0000","last_undegraded":"2024-09-10T22:41:07.038208+0000","last_fullsized":"2024-09-10T22:41:07.038208+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:53.069745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990781+0000","last_change":"2024-09-10T22:41:07.009874+0000","last_active":"2024-09-10T22:41:07.990781+0000","last_peered":"2024-09-10T22:41:07.990781+0000","last_clean":"2024-09-10T22:41:07.990781+0000","last_became_active":"2024-09-10T22:41:07.009570+0000","last_became_peered":"2024-09-10T22:41:07.009570+0000","last_unstale":"2024-09-10T22:41:07.990781+0000","last_undegraded":"2024-09-10T22:41:07.990781+0000","last_fullsized":"2024-09-10T22:41:07.990781+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:41:27.226599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"54'2","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.033033+0000","last_change":"2024-09-10T22:41:06.006329+0000","last_active":"2024-09-10T22:41:07.033033+0000","last_peered":"2024-09-10T22:41:07.033033+0000","last_clean":"2024-09-10T22:41:07.033033+0000","last_became_active":"2024-09-10T22:41:06.006076+0000","last_became_peered":"2024-09-10T22:41:06.006076+0000","last_unstale":"2024-09-10T22:41:07.033033+0000","last_undegraded":"2024-09-10T22:41:07.033033+0000","last_fullsized":"2024-09-10T22:41:07.033033+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:03.893470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.031658+0000","last_change":"2024-09-10T22:41:07.015684+0000","last_active":"2024-09-10T22:41:07.031658+0000","last_peered":"2024-09-10T22:41:07.031658+0000","last_clean":"2024-09-10T22:41:07.031658+0000","last_became_active":"2024-09-10T22:41:07.015425+0000","last_became_peered":"2024-09-10T22:41:07.015425+0000","last_unstale":"2024-09-10T22:41:07.031658+0000","last_undegraded":"2024-09-10T22:41:07.031658+0000","last_fullsized":"2024-09-10T22:41:07.031658+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:41:27.226599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442629+0000","last_change":"2024-09-10T22:41:05.996246+0000","last_active":"2024-09-10T22:41:08.442629+0000","last_peered":"2024-09-10T22:41:08.442629+0000","last_clean":"2024-09-10T22:41:08.442629+0000","last_became_active":"2024-09-10T22:41:05.995968+0000","last_became_peered":"2024-09-10T22:41:05.995968+0000","last_unstale":"2024-09-10T22:41:08.442629+0000","last_undegraded":"2024-09-10T22:41:08.442629+0000","last_fullsized":"2024-09-10T22:41:08.442629+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:11.662901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.020799+0000","last_change":"2024-09-10T22:41:07.012291+0000","last_active":"2024-09-10T22:41:07.020799+0000","last_peered":"2024-09-10T22:41:07.020799+0000","last_clean":"2024-09-10T22:41:07.020799+0000","last_became_active":"2024-09-10T22:41:07.012006+0000","last_became_peered":"2024-09-10T22:41:07.012006+0000","last_unstale":"2024-09-10T22:41:07.020799+0000","last_undegraded":"2024-09-10T22:41:07.020799+0000","last_fullsized":"2024-09-10T22:41:07.020799+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.301734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991300+0000","last_change":"2024-09-10T22:41:06.009142+0000","last_active":"2024-09-10T22:41:07.991300+0000","last_peered":"2024-09-10T22:41:07.991300+0000","last_clean":"2024-09-10T22:41:07.991300+0000","last_became_active":"2024-09-10T22:41:06.008215+0000","last_became_peered":"2024-09-10T22:41:06.008215+0000","last_unstale":"2024-09-10T22:41:07.991300+0000","last_undegraded":"2024-09-10T22:41:07.991300+0000","last_fullsized":"2024-09-10T22:41:07.991300+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:25.802794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.007816+0000","last_change":"2024-09-10T22:41:07.001776+0000","last_active":"2024-09-10T22:41:07.007816+0000","last_peered":"2024-09-10T22:41:07.007816+0000","last_clean":"2024-09-10T22:41:07.007816+0000","last_became_active":"2024-09-10T22:41:07.001504+0000","last_became_peered":"2024-09-10T22:41:07.001504+0000","last_unstale":"2024-09-10T22:41:07.007816+0000","last_undegraded":"2024-09-10T22:41:07.007816+0000","last_fullsized":"2024-09-10T22:41:07.007816+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:34.312993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"54'8","reported_seq":21,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.036815+0000","last_change":"2024-09-10T22:41:05.998248+0000","last_active":"2024-09-10T22:41:07.036815+0000","last_peered":"2024-09-10T22:41:07.036815+0000","last_clean":"2024-09-10T22:41:07.036815+0000","last_became_active":"2024-09-10T22:41:05.997978+0000","last_became_peered":"2024-09-10T22:41:05.997978+0000","last_unstale":"2024-09-10T22:41:07.036815+0000","last_undegraded":"2024-09-10T22:41:07.036815+0000","last_fullsized":"2024-09-10T22:41:07.036815+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:42.960083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.006427+0000","last_change":"2024-09-10T22:41:07.005382+0000","last_active":"2024-09-10T22:41:07.006427+0000","last_peered":"2024-09-10T22:41:07.006427+0000","last_clean":"2024-09-10T22:41:07.006427+0000","last_became_active":"2024-09-10T22:41:07.004169+0000","last_became_peered":"2024-09-10T22:41:07.004169+0000","last_unstale":"2024-09-10T22:41:07.006427+0000","last_undegraded":"2024-09-10T22:41:07.006427+0000","last_fullsized":"2024-09-10T22:41:07.006427+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:25.632741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"54'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.033085+0000","last_change":"2024-09-10T22:41:05.997356+0000","last_active":"2024-09-10T22:41:07.033085+0000","last_peered":"2024-09-10T22:41:07.033085+0000","last_clean":"2024-09-10T22:41:07.033085+0000","last_became_active":"2024-09-10T22:41:05.997087+0000","last_became_peered":"2024-09-10T22:41:05.997087+0000","last_unstale":"2024-09-10T22:41:07.033085+0000","last_undegraded":"2024-09-10T22:41:07.033085+0000","last_fullsized":"2024-09-10T22:41:07.033085+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:56.394978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234317+0000","last_change":"2024-09-10T22:41:07.030952+0000","last_active":"2024-09-10T22:41:09.234317+0000","last_peered":"2024-09-10T22:41:09.234317+0000","last_clean":"2024-09-10T22:41:09.234317+0000","last_became_active":"2024-09-10T22:41:07.030660+0000","last_became_peered":"2024-09-10T22:41:07.030660+0000","last_unstale":"2024-09-10T22:41:09.234317+0000","last_undegraded":"2024-09-10T22:41:09.234317+0000","last_fullsized":"2024-09-10T22:41:09.234317+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:46:17.184864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988949+0000","last_change":"2024-09-10T22:41:06.005480+0000","last_active":"2024-09-10T22:41:07.988949+0000","last_peered":"2024-09-10T22:41:07.988949+0000","last_clean":"2024-09-10T22:41:07.988949+0000","last_became_active":"2024-09-10T22:41:06.005212+0000","last_became_peered":"2024-09-10T22:41:06.005212+0000","last_unstale":"2024-09-10T22:41:07.988949+0000","last_undegraded":"2024-09-10T22:41:07.988949+0000","last_fullsized":"2024-09-10T22:41:07.988949+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:05.166519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.016705+0000","last_change":"2024-09-10T22:41:07.013980+0000","last_active":"2024-09-10T22:41:07.016705+0000","last_peered":"2024-09-10T22:41:07.016705+0000","last_clean":"2024-09-10T22:41:07.016705+0000","last_became_active":"2024-09-10T22:41:07.013700+0000","last_became_peered":"2024-09-10T22:41:07.013700+0000","last_unstale":"2024-09-10T22:41:07.016705+0000","last_undegraded":"2024-09-10T22:41:07.016705+0000","last_fullsized":"2024-09-10T22:41:07.016705+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:53.050265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"54'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442896+0000","last_change":"2024-09-10T22:41:06.005503+0000","last_active":"2024-09-10T22:41:08.442896+0000","last_peered":"2024-09-10T22:41:08.442896+0000","last_clean":"2024-09-10T22:41:08.442896+0000","last_became_active":"2024-09-10T22:41:06.005205+0000","last_became_peered":"2024-09-10T22:41:06.005205+0000","last_unstale":"2024-09-10T22:41:08.442896+0000","last_undegraded":"2024-09-10T22:41:08.442896+0000","last_fullsized":"2024-09-10T22:41:08.442896+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:03.751309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235132+0000","last_change":"2024-09-10T22:41:07.009702+0000","last_active":"2024-09-10T22:41:09.235132+0000","last_peered":"2024-09-10T22:41:09.235132+0000","last_clean":"2024-09-10T22:41:09.235132+0000","last_became_active":"2024-09-10T22:41:07.009422+0000","last_became_peered":"2024-09-10T22:41:07.009422+0000","last_unstale":"2024-09-10T22:41:09.235132+0000","last_undegraded":"2024-09-10T22:41:09.235132+0000","last_fullsized":"2024-09-10T22:41:09.235132+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:48.766775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442830+0000","last_change":"2024-09-10T22:41:05.990766+0000","last_active":"2024-09-10T22:41:08.442830+0000","last_peered":"2024-09-10T22:41:08.442830+0000","last_clean":"2024-09-10T22:41:08.442830+0000","last_became_active":"2024-09-10T22:41:05.990495+0000","last_became_peered":"2024-09-10T22:41:05.990495+0000","last_unstale":"2024-09-10T22:41:08.442830+0000","last_undegraded":"2024-09-10T22:41:08.442830+0000","last_fullsized":"2024-09-10T22:41:08.442830+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:56.811450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991002+0000","last_change":"2024-09-10T22:41:07.004711+0000","last_active":"2024-09-10T22:41:07.991002+0000","last_peered":"2024-09-10T22:41:07.991002+0000","last_clean":"2024-09-10T22:41:07.991002+0000","last_became_active":"2024-09-10T22:41:07.004451+0000","last_became_peered":"2024-09-10T22:41:07.004451+0000","last_unstale":"2024-09-10T22:41:07.991002+0000","last_undegraded":"2024-09-10T22:41:07.991002+0000","last_fullsized":"2024-09-10T22:41:07.991002+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:25.632741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234629+0000","last_change":"2024-09-10T22:41:06.011467+0000","last_active":"2024-09-10T22:41:09.234629+0000","last_peered":"2024-09-10T22:41:09.234629+0000","last_clean":"2024-09-10T22:41:09.234629+0000","last_became_active":"2024-09-10T22:41:06.011088+0000","last_became_peered":"2024-09-10T22:41:06.011088+0000","last_unstale":"2024-09-10T22:41:09.234629+0000","last_undegraded":"2024-09-10T22:41:09.234629+0000","last_fullsized":"2024-09-10T22:41:09.234629+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:56.185721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442845+0000","last_change":"2024-09-10T22:41:07.005871+0000","last_active":"2024-09-10T22:41:08.442845+0000","last_peered":"2024-09-10T22:41:08.442845+0000","last_clean":"2024-09-10T22:41:08.442845+0000","last_became_active":"2024-09-10T22:41:07.005588+0000","last_became_peered":"2024-09-10T22:41:07.005588+0000","last_unstale":"2024-09-10T22:41:08.442845+0000","last_undegraded":"2024-09-10T22:41:08.442845+0000","last_fullsized":"2024-09-10T22:41:08.442845+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:42.463673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.990690+0000","last_change":"2024-09-10T22:41:06.000828+0000","last_active":"2024-09-10T22:41:06.990690+0000","last_peered":"2024-09-10T22:41:06.990690+0000","last_clean":"2024-09-10T22:41:06.990690+0000","last_became_active":"2024-09-10T22:41:05.998637+0000","last_became_peered":"2024-09-10T22:41:05.998637+0000","last_unstale":"2024-09-10T22:41:06.990690+0000","last_undegraded":"2024-09-10T22:41:06.990690+0000","last_fullsized":"2024-09-10T22:41:06.990690+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:32.301219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.020821+0000","last_change":"2024-09-10T22:41:07.008864+0000","last_active":"2024-09-10T22:41:07.020821+0000","last_peered":"2024-09-10T22:41:07.020821+0000","last_clean":"2024-09-10T22:41:07.020821+0000","last_became_active":"2024-09-10T22:41:07.002835+0000","last_became_peered":"2024-09-10T22:41:07.002835+0000","last_unstale":"2024-09-10T22:41:07.020821+0000","last_undegraded":"2024-09-10T22:41:07.020821+0000","last_fullsized":"2024-09-10T22:41:07.020821+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:54.079923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.989540+0000","last_change":"2024-09-10T22:41:06.005138+0000","last_active":"2024-09-10T22:41:06.989540+0000","last_peered":"2024-09-10T22:41:06.989540+0000","last_clean":"2024-09-10T22:41:06.989540+0000","last_became_active":"2024-09-10T22:41:06.004886+0000","last_became_peered":"2024-09-10T22:41:06.004886+0000","last_unstale":"2024-09-10T22:41:06.989540+0000","last_undegraded":"2024-09-10T22:41:06.989540+0000","last_fullsized":"2024-09-10T22:41:06.989540+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:25.802794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235059+0000","last_change":"2024-09-10T22:41:07.016437+0000","last_active":"2024-09-10T22:41:09.235059+0000","last_peered":"2024-09-10T22:41:09.235059+0000","last_clean":"2024-09-10T22:41:09.235059+0000","last_became_active":"2024-09-10T22:41:07.016216+0000","last_became_peered":"2024-09-10T22:41:07.016216+0000","last_unstale":"2024-09-10T22:41:09.235059+0000","last_undegraded":"2024-09-10T22:41:09.235059+0000","last_fullsized":"2024-09-10T22:41:09.235059+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:43.759788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988463+0000","last_change":"2024-09-10T22:41:06.008205+0000","last_active":"2024-09-10T22:41:07.988463+0000","last_peered":"2024-09-10T22:41:07.988463+0000","last_clean":"2024-09-10T22:41:07.988463+0000","last_became_active":"2024-09-10T22:41:06.006600+0000","last_became_peered":"2024-09-10T22:41:06.006600+0000","last_unstale":"2024-09-10T22:41:07.988463+0000","last_undegraded":"2024-09-10T22:41:07.988463+0000","last_fullsized":"2024-09-10T22:41:07.988463+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:57.966564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990322+0000","last_change":"2024-09-10T22:41:07.007272+0000","last_active":"2024-09-10T22:41:07.990322+0000","last_peered":"2024-09-10T22:41:07.990322+0000","last_clean":"2024-09-10T22:41:07.990322+0000","last_became_active":"2024-09-10T22:41:07.006909+0000","last_became_peered":"2024-09-10T22:41:07.006909+0000","last_unstale":"2024-09-10T22:41:07.990322+0000","last_undegraded":"2024-09-10T22:41:07.990322+0000","last_fullsized":"2024-09-10T22:41:07.990322+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:59.336126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442684+0000","last_change":"2024-09-10T22:41:05.999502+0000","last_active":"2024-09-10T22:41:08.442684+0000","last_peered":"2024-09-10T22:41:08.442684+0000","last_clean":"2024-09-10T22:41:08.442684+0000","last_became_active":"2024-09-10T22:41:05.999171+0000","last_became_peered":"2024-09-10T22:41:05.999171+0000","last_unstale":"2024-09-10T22:41:08.442684+0000","last_undegraded":"2024-09-10T22:41:08.442684+0000","last_fullsized":"2024-09-10T22:41:08.442684+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:11.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235231+0000","last_change":"2024-09-10T22:41:07.028930+0000","last_active":"2024-09-10T22:41:09.235231+0000","last_peered":"2024-09-10T22:41:09.235231+0000","last_clean":"2024-09-10T22:41:09.235231+0000","last_became_active":"2024-09-10T22:41:07.028710+0000","last_became_peered":"2024-09-10T22:41:07.028710+0000","last_unstale":"2024-09-10T22:41:09.235231+0000","last_undegraded":"2024-09-10T22:41:09.235231+0000","last_fullsized":"2024-09-10T22:41:09.235231+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:29.579930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991455+0000","last_change":"2024-09-10T22:41:06.010369+0000","last_active":"2024-09-10T22:41:07.991455+0000","last_peered":"2024-09-10T22:41:07.991455+0000","last_clean":"2024-09-10T22:41:07.991455+0000","last_became_active":"2024-09-10T22:41:06.010182+0000","last_became_peered":"2024-09-10T22:41:06.010182+0000","last_unstale":"2024-09-10T22:41:07.991455+0000","last_undegraded":"2024-09-10T22:41:07.991455+0000","last_fullsized":"2024-09-10T22:41:07.991455+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:22.685932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.005193+0000","last_change":"2024-09-10T22:41:07.000440+0000","last_active":"2024-09-10T22:41:07.005193+0000","last_peered":"2024-09-10T22:41:07.005193+0000","last_clean":"2024-09-10T22:41:07.005193+0000","last_became_active":"2024-09-10T22:41:06.999910+0000","last_became_peered":"2024-09-10T22:41:06.999910+0000","last_unstale":"2024-09-10T22:41:07.005193+0000","last_undegraded":"2024-09-10T22:41:07.005193+0000","last_fullsized":"2024-09-10T22:41:07.005193+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:43.688712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.992451+0000","last_change":"2024-09-10T22:41:06.009093+0000","last_active":"2024-09-10T22:41:06.992451+0000","last_peered":"2024-09-10T22:41:06.992451+0000","last_clean":"2024-09-10T22:41:06.992451+0000","last_became_active":"2024-09-10T22:41:06.008811+0000","last_became_peered":"2024-09-10T22:41:06.008811+0000","last_unstale":"2024-09-10T22:41:06.992451+0000","last_undegraded":"2024-09-10T22:41:06.992451+0000","last_fullsized":"2024-09-10T22:41:06.992451+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:54.497387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.030485+0000","last_change":"2024-09-10T22:41:07.011776+0000","last_active":"2024-09-10T22:41:07.030485+0000","last_peered":"2024-09-10T22:41:07.030485+0000","last_clean":"2024-09-10T22:41:07.030485+0000","last_became_active":"2024-09-10T22:41:07.011500+0000","last_became_peered":"2024-09-10T22:41:07.011500+0000","last_unstale":"2024-09-10T22:41:07.030485+0000","last_undegraded":"2024-09-10T22:41:07.030485+0000","last_fullsized":"2024-09-10T22:41:07.030485+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:21.906726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.991701+0000","last_change":"2024-09-10T22:41:05.998931+0000","last_active":"2024-09-10T22:41:06.991701+0000","last_peered":"2024-09-10T22:41:06.991701+0000","last_clean":"2024-09-10T22:41:06.991701+0000","last_became_active":"2024-09-10T22:41:05.997587+0000","last_became_peered":"2024-09-10T22:41:05.997587+0000","last_unstale":"2024-09-10T22:41:06.991701+0000","last_undegraded":"2024-09-10T22:41:06.991701+0000","last_fullsized":"2024-09-10T22:41:06.991701+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:20.896548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990817+0000","last_change":"2024-09-10T22:41:07.009487+0000","last_active":"2024-09-10T22:41:07.990817+0000","last_peered":"2024-09-10T22:41:07.990817+0000","last_clean":"2024-09-10T22:41:07.990817+0000","last_became_active":"2024-09-10T22:41:07.009104+0000","last_became_peered":"2024-09-10T22:41:07.009104+0000","last_unstale":"2024-09-10T22:41:07.990817+0000","last_undegraded":"2024-09-10T22:41:07.990817+0000","last_fullsized":"2024-09-10T22:41:07.990817+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:47.347113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.990894+0000","last_change":"2024-09-10T22:41:06.006577+0000","last_active":"2024-09-10T22:41:06.990894+0000","last_peered":"2024-09-10T22:41:06.990894+0000","last_clean":"2024-09-10T22:41:06.990894+0000","last_became_active":"2024-09-10T22:41:06.006219+0000","last_became_peered":"2024-09-10T22:41:06.006219+0000","last_unstale":"2024-09-10T22:41:06.990894+0000","last_undegraded":"2024-09-10T22:41:06.990894+0000","last_fullsized":"2024-09-10T22:41:06.990894+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:47.703955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.030507+0000","last_change":"2024-09-10T22:41:07.013569+0000","last_active":"2024-09-10T22:41:07.030507+0000","last_peered":"2024-09-10T22:41:07.030507+0000","last_clean":"2024-09-10T22:41:07.030507+0000","last_became_active":"2024-09-10T22:41:07.013309+0000","last_became_peered":"2024-09-10T22:41:07.013309+0000","last_unstale":"2024-09-10T22:41:07.030507+0000","last_undegraded":"2024-09-10T22:41:07.030507+0000","last_fullsized":"2024-09-10T22:41:07.030507+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:19.478124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.994609+0000","last_change":"2024-09-10T22:41:06.007609+0000","last_active":"2024-09-10T22:41:06.994609+0000","last_peered":"2024-09-10T22:41:06.994609+0000","last_clean":"2024-09-10T22:41:06.994609+0000","last_became_active":"2024-09-10T22:41:06.007320+0000","last_became_peered":"2024-09-10T22:41:06.007320+0000","last_unstale":"2024-09-10T22:41:06.994609+0000","last_undegraded":"2024-09-10T22:41:06.994609+0000","last_fullsized":"2024-09-10T22:41:06.994609+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:02:49.505104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.023434+0000","last_change":"2024-09-10T22:41:07.019550+0000","last_active":"2024-09-10T22:41:07.023434+0000","last_peered":"2024-09-10T22:41:07.023434+0000","last_clean":"2024-09-10T22:41:07.023434+0000","last_became_active":"2024-09-10T22:41:07.019073+0000","last_became_peered":"2024-09-10T22:41:07.019073+0000","last_unstale":"2024-09-10T22:41:07.023434+0000","last_undegraded":"2024-09-10T22:41:07.023434+0000","last_fullsized":"2024-09-10T22:41:07.023434+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:15.786849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990444+0000","last_change":"2024-09-10T22:41:06.011292+0000","last_active":"2024-09-10T22:41:07.990444+0000","last_peered":"2024-09-10T22:41:07.990444+0000","last_clean":"2024-09-10T22:41:07.990444+0000","last_became_active":"2024-09-10T22:41:06.010970+0000","last_became_peered":"2024-09-10T22:41:06.010970+0000","last_unstale":"2024-09-10T22:41:07.990444+0000","last_undegraded":"2024-09-10T22:41:07.990444+0000","last_fullsized":"2024-09-10T22:41:07.990444+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:51.873950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442589+0000","last_change":"2024-09-10T22:41:06.999739+0000","last_active":"2024-09-10T22:41:08.442589+0000","last_peered":"2024-09-10T22:41:08.442589+0000","last_clean":"2024-09-10T22:41:08.442589+0000","last_became_active":"2024-09-10T22:41:06.999350+0000","last_became_peered":"2024-09-10T22:41:06.999350+0000","last_unstale":"2024-09-10T22:41:08.442589+0000","last_undegraded":"2024-09-10T22:41:08.442589+0000","last_fullsized":"2024-09-10T22:41:08.442589+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:04.903647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.994361+0000","last_change":"2024-09-10T22:41:06.013365+0000","last_active":"2024-09-10T22:41:06.994361+0000","last_peered":"2024-09-10T22:41:06.994361+0000","last_clean":"2024-09-10T22:41:06.994361+0000","last_became_active":"2024-09-10T22:41:06.012873+0000","last_became_peered":"2024-09-10T22:41:06.012873+0000","last_unstale":"2024-09-10T22:41:06.994361+0000","last_undegraded":"2024-09-10T22:41:06.994361+0000","last_fullsized":"2024-09-10T22:41:06.994361+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:56.910500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":173,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991085+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:41:07.991085+0000","last_peered":"2024-09-10T22:41:07.991085+0000","last_clean":"2024-09-10T22:41:07.991085+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:41:07.991085+0000","last_undegraded":"2024-09-10T22:41:07.991085+0000","last_fullsized":"2024-09-10T22:41:07.991085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1236992,"data_stored":871722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509473,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":288574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":634880,"data_stored":281230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509473,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":638976,"data_stored":281812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":651264,"data_stored":282864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":659456,"data_stored":289534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509473,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1236992,"data_stored":871654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":288082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:41:11.889 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:41:12.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f8b400640 1 -- 172.21.15.103:0/3770433143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f840cc120 msgr2=0x7f0f840aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:12.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f8b400640 1 --2- 172.21.15.103:0/3770433143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f840cc120 0x7f0f840aeb40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009840 tx=0x7f0f7401c760 comp rx=0 tx=0).stop 2024-09-10T22:41:12.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f8b400640 1 -- 172.21.15.103:0/3770433143 shutdown_connections 2024-09-10T22:41:12.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f8b400640 1 --2- 172.21.15.103:0/3770433143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f840cc120 0x7f0f840aeb40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f8b400640 1 -- 172.21.15.103:0/3770433143 >> 172.21.15.103:0/3770433143 conn(0x7f0f8406cc00 msgr2=0x7f0f8406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:12.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f8b400640 1 -- 172.21.15.103:0/3770433143 shutdown_connections 2024-09-10T22:41:12.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f8b400640 1 -- 172.21.15.103:0/3770433143 wait complete. 2024-09-10T22:41:12.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f8b400640 1 Processor -- start 2024-09-10T22:41:12.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f8b400640 1 -- start start 2024-09-10T22:41:12.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f8b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f840cc120 0x7f0f840af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:12.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f8b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f840cf790 0x7f0f841518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f8b400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f8415c970 0x7f0f84143070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f8b400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8416a250 con 0x7f0f840cf790 2024-09-10T22:41:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f8b400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8416a0d0 con 0x7f0f840cc120 2024-09-10T22:41:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f8b400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0f8416a3d0 con 0x7f0f8415c970 2024-09-10T22:41:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f83e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f840cf790 0x7f0f841518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f83e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f840cf790 0x7f0f841518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56624/0 (socket says 172.21.15.103:56624) 2024-09-10T22:41:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f83e00640 1 -- 172.21.15.103:0/2536724689 learned_addr learned my addr 172.21.15.103:0/2536724689 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f89400640 1 --2- 172.21.15.103:0/2536724689 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f8415c970 0x7f0f84143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f88a00640 1 --2- 172.21.15.103:0/2536724689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f840cc120 0x7f0f840af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f83e00640 1 -- 172.21.15.103:0/2536724689 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f8415c970 msgr2=0x7f0f84143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f83e00640 1 --2- 172.21.15.103:0/2536724689 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f8415c970 0x7f0f84143070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f83e00640 1 -- 172.21.15.103:0/2536724689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f840cc120 msgr2=0x7f0f840af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f83e00640 1 --2- 172.21.15.103:0/2536724689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f840cc120 0x7f0f840af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f83e00640 1 -- 172.21.15.103:0/2536724689 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8415d6f0 con 0x7f0f840cf790 2024-09-10T22:41:12.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.060+0000 7f0f83e00640 1 --2- 172.21.15.103:0/2536724689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f840cf790 0x7f0f841518d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000b410 tx=0x7f0f7000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:12.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.064+0000 7f0f80c00640 1 -- 172.21.15.103:0/2536724689 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f70015030 con 0x7f0f840cf790 2024-09-10T22:41:12.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.064+0000 7f0f80c00640 1 -- 172.21.15.103:0/2536724689 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f70004020 con 0x7f0f840cf790 2024-09-10T22:41:12.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.064+0000 7f0f80c00640 1 -- 172.21.15.103:0/2536724689 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f70004470 con 0x7f0f840cf790 2024-09-10T22:41:12.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.064+0000 7f0f8b400640 1 -- 172.21.15.103:0/2536724689 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f8415d9d0 con 0x7f0f840cf790 2024-09-10T22:41:12.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.064+0000 7f0f8b400640 1 -- 172.21.15.103:0/2536724689 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f8415df90 con 0x7f0f840cf790 2024-09-10T22:41:12.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.064+0000 7f0f8b400640 1 -- 172.21.15.103:0/2536724689 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f840aeb40 con 0x7f0f840cf790 2024-09-10T22:41:12.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.064+0000 7f0f80c00640 1 -- 172.21.15.103:0/2536724689 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0f70022060 con 0x7f0f840cf790 2024-09-10T22:41:12.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.064+0000 7f0f80c00640 1 --2- 172.21.15.103:0/2536724689 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f640725e0 0x7f0f64074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:12.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.064+0000 7f0f80c00640 1 -- 172.21.15.103:0/2536724689 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f0f70092e40 con 0x7f0f840cf790 2024-09-10T22:41:12.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.064+0000 7f0f88a00640 1 --2- 172.21.15.103:0/2536724689 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f640725e0 0x7f0f64074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:12.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.068+0000 7f0f88a00640 1 --2- 172.21.15.103:0/2536724689 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f640725e0 0x7f0f64074aa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0f740af000 tx=0x7f0f7401afa0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:12.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.068+0000 7f0f80c00640 1 -- 172.21.15.103:0/2536724689 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0f7005dd30 con 0x7f0f840cf790 2024-09-10T22:41:12.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.292+0000 7f0f8b400640 1 -- 172.21.15.103:0/2536724689 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0f8406fc50 con 0x7f0f840cf790 2024-09-10T22:41:12.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.292+0000 7f0f80c00640 1 -- 172.21.15.103:0/2536724689 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1056 (secure 0 0 0) 0x7f0f70062760 con 0x7f0f840cf790 2024-09-10T22:41:12.298 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:12.298 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":168,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":55,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":232079360,"bytes_avail":772862033920,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":35,"btime":"2024-09-10T22:41:10:021317+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5547}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-09-10T22:40:55.649061+0000","services":{}},"progress_events":{}} 2024-09-10T22:41:12.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.292+0000 7f0f8b400640 1 -- 172.21.15.103:0/2536724689 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f640725e0 msgr2=0x7f0f64074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:12.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.292+0000 7f0f8b400640 1 --2- 172.21.15.103:0/2536724689 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f640725e0 0x7f0f64074aa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0f740af000 tx=0x7f0f7401afa0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.292+0000 7f0f8b400640 1 -- 172.21.15.103:0/2536724689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f840cf790 msgr2=0x7f0f841518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:12.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.292+0000 7f0f8b400640 1 --2- 172.21.15.103:0/2536724689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f840cf790 0x7f0f841518d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000b410 tx=0x7f0f7000b8d0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.292+0000 7f0f8b400640 1 -- 172.21.15.103:0/2536724689 shutdown_connections 2024-09-10T22:41:12.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.292+0000 7f0f8b400640 1 --2- 172.21.15.103:0/2536724689 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f640725e0 0x7f0f64074aa0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.292+0000 7f0f8b400640 1 --2- 172.21.15.103:0/2536724689 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f8415c970 0x7f0f84143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.292+0000 7f0f8b400640 1 --2- 172.21.15.103:0/2536724689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f840cf790 0x7f0f841518d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.292+0000 7f0f8b400640 1 --2- 172.21.15.103:0/2536724689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f840cc120 0x7f0f840af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.292+0000 7f0f8b400640 1 -- 172.21.15.103:0/2536724689 >> 172.21.15.103:0/2536724689 conn(0x7f0f8406cc00 msgr2=0x7f0f8406feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:12.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.292+0000 7f0f8b400640 1 -- 172.21.15.103:0/2536724689 shutdown_connections 2024-09-10T22:41:12.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.292+0000 7f0f8b400640 1 -- 172.21.15.103:0/2536724689 wait complete. 2024-09-10T22:41:12.319 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T22:41:12.319 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:41:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.456+0000 7f8eb2a00640 1 -- 172.21.15.103:0/43599180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8eac0cd330 msgr2=0x7f8eac0cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.456+0000 7f8eb2a00640 1 --2- 172.21.15.103:0/43599180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8eac0cd330 0x7f8eac0cf800 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8eac0d2b20 tx=0x7f8ea401c8c0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.456+0000 7f8eb2a00640 1 -- 172.21.15.103:0/43599180 shutdown_connections 2024-09-10T22:41:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.456+0000 7f8eb2a00640 1 --2- 172.21.15.103:0/43599180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8eac0cd330 0x7f8eac0cf800 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.456+0000 7f8eb2a00640 1 --2- 172.21.15.103:0/43599180 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8eac0cdd00 0x7f8eac0ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.456+0000 7f8eb2a00640 1 --2- 172.21.15.103:0/43599180 >> v2:172.21.15.131:3300/0 conn(0x7f8eac15f1a0 0x7f8eac0ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.456+0000 7f8eb2a00640 1 -- 172.21.15.103:0/43599180 >> 172.21.15.103:0/43599180 conn(0x7f8eac0d1a20 msgr2=0x7f8eac0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.456+0000 7f8eb2a00640 1 -- 172.21.15.103:0/43599180 shutdown_connections 2024-09-10T22:41:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.456+0000 7f8eb2a00640 1 -- 172.21.15.103:0/43599180 wait complete. 2024-09-10T22:41:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.456+0000 7f8eb2a00640 1 Processor -- start 2024-09-10T22:41:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.456+0000 7f8eb2a00640 1 -- start start 2024-09-10T22:41:12.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.456+0000 7f8eb2a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8eac0cd330 0x7f8eac0b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:12.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.456+0000 7f8eb2a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8eac0cdd00 0x7f8eac15c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:12.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.456+0000 7f8eb2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8eac15f1a0 0x7f8eac0b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:12.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.456+0000 7f8eb2a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac15fde0 con 0x7f8eac15f1a0 2024-09-10T22:41:12.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.456+0000 7f8eb2a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac15fc60 con 0x7f8eac0cdd00 2024-09-10T22:41:12.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.456+0000 7f8eb2a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8eac15ff60 con 0x7f8eac0cd330 2024-09-10T22:41:12.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8eb0a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8eac15f1a0 0x7f8eac0b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:12.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8eb0a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8eac15f1a0 0x7f8eac0b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56642/0 (socket says 172.21.15.103:56642) 2024-09-10T22:41:12.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8eb0a00640 1 -- 172.21.15.103:0/1874462757 learned_addr learned my addr 172.21.15.103:0/1874462757 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:12.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8eabe00640 1 --2- 172.21.15.103:0/1874462757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8eac0cd330 0x7f8eac0b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:12.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8ea3400640 1 --2- 172.21.15.103:0/1874462757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8eac0cdd00 0x7f8eac15c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:12.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8eb0a00640 1 -- 172.21.15.103:0/1874462757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8eac0cd330 msgr2=0x7f8eac0b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:12.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8eb0a00640 1 --2- 172.21.15.103:0/1874462757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8eac0cd330 0x7f8eac0b73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8eb0a00640 1 -- 172.21.15.103:0/1874462757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8eac0cdd00 msgr2=0x7f8eac15c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:12.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8eb0a00640 1 --2- 172.21.15.103:0/1874462757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8eac0cdd00 0x7f8eac15c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8eb0a00640 1 -- 172.21.15.103:0/1874462757 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eac15ac40 con 0x7f8eac15f1a0 2024-09-10T22:41:12.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8ea3400640 1 --2- 172.21.15.103:0/1874462757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8eac0cdd00 0x7f8eac15c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:12.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8eabe00640 1 --2- 172.21.15.103:0/1874462757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8eac0cd330 0x7f8eac0b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:12.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8eb0a00640 1 --2- 172.21.15.103:0/1874462757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8eac15f1a0 0x7f8eac0b5280 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40b0040 tx=0x7f8ea40a56a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:12.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8ea8c00640 1 -- 172.21.15.103:0/1874462757 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40b2040 con 0x7f8eac15f1a0 2024-09-10T22:41:12.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8ea8c00640 1 -- 172.21.15.103:0/1874462757 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ea4005070 con 0x7f8eac15f1a0 2024-09-10T22:41:12.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8ea8c00640 1 -- 172.21.15.103:0/1874462757 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40054c0 con 0x7f8eac15f1a0 2024-09-10T22:41:12.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8eb2a00640 1 -- 172.21.15.103:0/1874462757 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eac1599d0 con 0x7f8eac15f1a0 2024-09-10T22:41:12.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8eb2a00640 1 -- 172.21.15.103:0/1874462757 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eac155070 con 0x7f8eac15f1a0 2024-09-10T22:41:12.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8eb2a00640 1 -- 172.21.15.103:0/1874462757 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eac1604f0 con 0x7f8eac15f1a0 2024-09-10T22:41:12.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.460+0000 7f8ea8c00640 1 -- 172.21.15.103:0/1874462757 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8ea40046d0 con 0x7f8eac15f1a0 2024-09-10T22:41:12.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.464+0000 7f8ea8c00640 1 --2- 172.21.15.103:0/1874462757 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8e880725e0 0x7f8e88074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:12.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.464+0000 7f8ea8c00640 1 -- 172.21.15.103:0/1874462757 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f8ea412d0f0 con 0x7f8eac15f1a0 2024-09-10T22:41:12.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.464+0000 7f8eabe00640 1 --2- 172.21.15.103:0/1874462757 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8e880725e0 0x7f8e88074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:12.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.464+0000 7f8eabe00640 1 --2- 172.21.15.103:0/1874462757 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8e880725e0 0x7f8e88074aa0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c005fd0 tx=0x7f8e9c00a430 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:12.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.468+0000 7f8ea8c00640 1 -- 172.21.15.103:0/1874462757 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8ea40164b0 con 0x7f8eac15f1a0 2024-09-10T22:41:12.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.636+0000 7f8eb2a00640 1 -- 172.21.15.103:0/1874462757 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8eac15a9f0 con 0x7f8e880725e0 2024-09-10T22:41:12.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.640+0000 7f8ea8c00640 1 -- 172.21.15.103:0/1874462757 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251943 (secure 0 0 0) 0x7f8eac15a9f0 con 0x7f8e880725e0 2024-09-10T22:41:12.648 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:12.649 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:41:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.644+0000 7f8eb2a00640 1 -- 172.21.15.103:0/1874462757 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8e880725e0 msgr2=0x7f8e88074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.644+0000 7f8eb2a00640 1 --2- 172.21.15.103:0/1874462757 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8e880725e0 0x7f8e88074aa0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c005fd0 tx=0x7f8e9c00a430 comp rx=0 tx=0).stop 2024-09-10T22:41:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.644+0000 7f8eb2a00640 1 -- 172.21.15.103:0/1874462757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8eac15f1a0 msgr2=0x7f8eac0b5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.644+0000 7f8eb2a00640 1 --2- 172.21.15.103:0/1874462757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8eac15f1a0 0x7f8eac0b5280 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40b0040 tx=0x7f8ea40a56a0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.644+0000 7f8eb2a00640 1 -- 172.21.15.103:0/1874462757 shutdown_connections 2024-09-10T22:41:12.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.644+0000 7f8eb2a00640 1 --2- 172.21.15.103:0/1874462757 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8e880725e0 0x7f8e88074aa0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.644+0000 7f8eb2a00640 1 --2- 172.21.15.103:0/1874462757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8eac15f1a0 0x7f8eac0b5280 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.644+0000 7f8eb2a00640 1 --2- 172.21.15.103:0/1874462757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8eac0cdd00 0x7f8eac15c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.644+0000 7f8eb2a00640 1 --2- 172.21.15.103:0/1874462757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8eac0cd330 0x7f8eac0b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:12.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.644+0000 7f8eb2a00640 1 -- 172.21.15.103:0/1874462757 >> 172.21.15.103:0/1874462757 conn(0x7f8eac0d1a20 msgr2=0x7f8eac071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:12.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.644+0000 7f8eb2a00640 1 -- 172.21.15.103:0/1874462757 shutdown_connections 2024-09-10T22:41:12.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:12.644+0000 7f8eb2a00640 1 -- 172.21.15.103:0/1874462757 wait complete. 2024-09-10T22:41:12.674 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2024-09-10T22:41:11.652367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226640,"kb_used_data":6220,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748080,"statfs":{"total":773094113280,"available":772862033920,"internally_reserved":0,"allocated":6369280,"data_stored":3455472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001462"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234823+0000","last_change":"2024-09-10T22:41:07.009600+0000","last_active":"2024-09-10T22:41:09.234823+0000","last_peered":"2024-09-10T22:41:09.234823+0000","last_clean":"2024-09-10T22:41:09.234823+0000","last_became_active":"2024-09-10T22:41:07.009300+0000","last_became_peered":"2024-09-10T22:41:07.009300+0000","last_unstale":"2024-09-10T22:41:09.234823+0000","last_undegraded":"2024-09-10T22:41:09.234823+0000","last_fullsized":"2024-09-10T22:41:09.234823+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:43.814129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991867+0000","last_change":"2024-09-10T22:41:07.018450+0000","last_active":"2024-09-10T22:41:07.991867+0000","last_peered":"2024-09-10T22:41:07.991867+0000","last_clean":"2024-09-10T22:41:07.991867+0000","last_became_active":"2024-09-10T22:41:07.018138+0000","last_became_peered":"2024-09-10T22:41:07.018138+0000","last_unstale":"2024-09-10T22:41:07.991867+0000","last_undegraded":"2024-09-10T22:41:07.991867+0000","last_fullsized":"2024-09-10T22:41:07.991867+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:18.409465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.031628+0000","last_change":"2024-09-10T22:41:07.011508+0000","last_active":"2024-09-10T22:41:07.031628+0000","last_peered":"2024-09-10T22:41:07.031628+0000","last_clean":"2024-09-10T22:41:07.031628+0000","last_became_active":"2024-09-10T22:41:07.011224+0000","last_became_peered":"2024-09-10T22:41:07.011224+0000","last_unstale":"2024-09-10T22:41:07.031628+0000","last_undegraded":"2024-09-10T22:41:07.031628+0000","last_fullsized":"2024-09-10T22:41:07.031628+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:43.688712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990876+0000","last_change":"2024-09-10T22:41:07.016143+0000","last_active":"2024-09-10T22:41:07.990876+0000","last_peered":"2024-09-10T22:41:07.990876+0000","last_clean":"2024-09-10T22:41:07.990876+0000","last_became_active":"2024-09-10T22:41:07.015887+0000","last_became_peered":"2024-09-10T22:41:07.015887+0000","last_unstale":"2024-09-10T22:41:07.990876+0000","last_undegraded":"2024-09-10T22:41:07.990876+0000","last_fullsized":"2024-09-10T22:41:07.990876+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:15.842949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.011219+0000","last_change":"2024-09-10T22:41:07.006851+0000","last_active":"2024-09-10T22:41:07.011219+0000","last_peered":"2024-09-10T22:41:07.011219+0000","last_clean":"2024-09-10T22:41:07.011219+0000","last_became_active":"2024-09-10T22:41:07.006583+0000","last_became_peered":"2024-09-10T22:41:07.006583+0000","last_unstale":"2024-09-10T22:41:07.011219+0000","last_undegraded":"2024-09-10T22:41:07.011219+0000","last_fullsized":"2024-09-10T22:41:07.011219+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:30.833275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235120+0000","last_change":"2024-09-10T22:41:07.018190+0000","last_active":"2024-09-10T22:41:09.235120+0000","last_peered":"2024-09-10T22:41:09.235120+0000","last_clean":"2024-09-10T22:41:09.235120+0000","last_became_active":"2024-09-10T22:41:07.017937+0000","last_became_peered":"2024-09-10T22:41:07.017937+0000","last_unstale":"2024-09-10T22:41:09.235120+0000","last_undegraded":"2024-09-10T22:41:09.235120+0000","last_fullsized":"2024-09-10T22:41:09.235120+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:58.501910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.030232+0000","last_change":"2024-09-10T22:41:07.010472+0000","last_active":"2024-09-10T22:41:07.030232+0000","last_peered":"2024-09-10T22:41:07.030232+0000","last_clean":"2024-09-10T22:41:07.030232+0000","last_became_active":"2024-09-10T22:41:07.010173+0000","last_became_peered":"2024-09-10T22:41:07.010173+0000","last_unstale":"2024-09-10T22:41:07.030232+0000","last_undegraded":"2024-09-10T22:41:07.030232+0000","last_fullsized":"2024-09-10T22:41:07.030232+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:43.970261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.005681+0000","last_change":"2024-09-10T22:41:07.000969+0000","last_active":"2024-09-10T22:41:07.005681+0000","last_peered":"2024-09-10T22:41:07.005681+0000","last_clean":"2024-09-10T22:41:07.005681+0000","last_became_active":"2024-09-10T22:41:07.000706+0000","last_became_peered":"2024-09-10T22:41:07.000706+0000","last_unstale":"2024-09-10T22:41:07.005681+0000","last_undegraded":"2024-09-10T22:41:07.005681+0000","last_fullsized":"2024-09-10T22:41:07.005681+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:41:27.226599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.004522+0000","last_change":"2024-09-10T22:41:06.998131+0000","last_active":"2024-09-10T22:41:07.004522+0000","last_peered":"2024-09-10T22:41:07.004522+0000","last_clean":"2024-09-10T22:41:07.004522+0000","last_became_active":"2024-09-10T22:41:06.997825+0000","last_became_peered":"2024-09-10T22:41:06.997825+0000","last_unstale":"2024-09-10T22:41:07.004522+0000","last_undegraded":"2024-09-10T22:41:07.004522+0000","last_fullsized":"2024-09-10T22:41:07.004522+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:19.478124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234515+0000","last_change":"2024-09-10T22:41:07.015006+0000","last_active":"2024-09-10T22:41:09.234515+0000","last_peered":"2024-09-10T22:41:09.234515+0000","last_clean":"2024-09-10T22:41:09.234515+0000","last_became_active":"2024-09-10T22:41:07.014712+0000","last_became_peered":"2024-09-10T22:41:07.014712+0000","last_unstale":"2024-09-10T22:41:09.234515+0000","last_undegraded":"2024-09-10T22:41:09.234515+0000","last_fullsized":"2024-09-10T22:41:09.234515+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:37.809927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988797+0000","last_change":"2024-09-10T22:41:07.014300+0000","last_active":"2024-09-10T22:41:07.988797+0000","last_peered":"2024-09-10T22:41:07.988797+0000","last_clean":"2024-09-10T22:41:07.988797+0000","last_became_active":"2024-09-10T22:41:07.013875+0000","last_became_peered":"2024-09-10T22:41:07.013875+0000","last_unstale":"2024-09-10T22:41:07.988797+0000","last_undegraded":"2024-09-10T22:41:07.988797+0000","last_fullsized":"2024-09-10T22:41:07.988797+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:23.123417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.004478+0000","last_change":"2024-09-10T22:41:06.994043+0000","last_active":"2024-09-10T22:41:07.004478+0000","last_peered":"2024-09-10T22:41:07.004478+0000","last_clean":"2024-09-10T22:41:07.004478+0000","last_became_active":"2024-09-10T22:41:06.993754+0000","last_became_peered":"2024-09-10T22:41:06.993754+0000","last_unstale":"2024-09-10T22:41:07.004478+0000","last_undegraded":"2024-09-10T22:41:07.004478+0000","last_fullsized":"2024-09-10T22:41:07.004478+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:59.336126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234455+0000","last_change":"2024-09-10T22:41:07.015850+0000","last_active":"2024-09-10T22:41:09.234455+0000","last_peered":"2024-09-10T22:41:09.234455+0000","last_clean":"2024-09-10T22:41:09.234455+0000","last_became_active":"2024-09-10T22:41:07.015582+0000","last_became_peered":"2024-09-10T22:41:07.015582+0000","last_unstale":"2024-09-10T22:41:09.234455+0000","last_undegraded":"2024-09-10T22:41:09.234455+0000","last_fullsized":"2024-09-10T22:41:09.234455+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:08.678783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.032966+0000","last_change":"2024-09-10T22:41:07.021525+0000","last_active":"2024-09-10T22:41:07.032966+0000","last_peered":"2024-09-10T22:41:07.032966+0000","last_clean":"2024-09-10T22:41:07.032966+0000","last_became_active":"2024-09-10T22:41:07.021240+0000","last_became_peered":"2024-09-10T22:41:07.021240+0000","last_unstale":"2024-09-10T22:41:07.032966+0000","last_undegraded":"2024-09-10T22:41:07.032966+0000","last_fullsized":"2024-09-10T22:41:07.032966+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:47.347113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991192+0000","last_change":"2024-09-10T22:41:07.011414+0000","last_active":"2024-09-10T22:41:07.991192+0000","last_peered":"2024-09-10T22:41:07.991192+0000","last_clean":"2024-09-10T22:41:07.991192+0000","last_became_active":"2024-09-10T22:41:07.011123+0000","last_became_peered":"2024-09-10T22:41:07.011123+0000","last_unstale":"2024-09-10T22:41:07.991192+0000","last_undegraded":"2024-09-10T22:41:07.991192+0000","last_fullsized":"2024-09-10T22:41:07.991192+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:42.747411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234294+0000","last_change":"2024-09-10T22:41:07.015097+0000","last_active":"2024-09-10T22:41:09.234294+0000","last_peered":"2024-09-10T22:41:09.234294+0000","last_clean":"2024-09-10T22:41:09.234294+0000","last_became_active":"2024-09-10T22:41:07.014724+0000","last_became_peered":"2024-09-10T22:41:07.014724+0000","last_unstale":"2024-09-10T22:41:09.234294+0000","last_undegraded":"2024-09-10T22:41:09.234294+0000","last_fullsized":"2024-09-10T22:41:09.234294+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:35.995356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.007790+0000","last_change":"2024-09-10T22:41:07.001750+0000","last_active":"2024-09-10T22:41:07.007790+0000","last_peered":"2024-09-10T22:41:07.007790+0000","last_clean":"2024-09-10T22:41:07.007790+0000","last_became_active":"2024-09-10T22:41:07.001438+0000","last_became_peered":"2024-09-10T22:41:07.001438+0000","last_unstale":"2024-09-10T22:41:07.007790+0000","last_undegraded":"2024-09-10T22:41:07.007790+0000","last_fullsized":"2024-09-10T22:41:07.007790+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:52.884128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991902+0000","last_change":"2024-09-10T22:41:07.019159+0000","last_active":"2024-09-10T22:41:07.991902+0000","last_peered":"2024-09-10T22:41:07.991902+0000","last_clean":"2024-09-10T22:41:07.991902+0000","last_became_active":"2024-09-10T22:41:07.018849+0000","last_became_peered":"2024-09-10T22:41:07.018849+0000","last_unstale":"2024-09-10T22:41:07.991902+0000","last_undegraded":"2024-09-10T22:41:07.991902+0000","last_fullsized":"2024-09-10T22:41:07.991902+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:01.412535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.016214+0000","last_change":"2024-09-10T22:41:07.003836+0000","last_active":"2024-09-10T22:41:07.016214+0000","last_peered":"2024-09-10T22:41:07.016214+0000","last_clean":"2024-09-10T22:41:07.016214+0000","last_became_active":"2024-09-10T22:41:07.002677+0000","last_became_peered":"2024-09-10T22:41:07.002677+0000","last_unstale":"2024-09-10T22:41:07.016214+0000","last_undegraded":"2024-09-10T22:41:07.016214+0000","last_fullsized":"2024-09-10T22:41:07.016214+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:33.311396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442700+0000","last_change":"2024-09-10T22:41:07.004930+0000","last_active":"2024-09-10T22:41:08.442700+0000","last_peered":"2024-09-10T22:41:08.442700+0000","last_clean":"2024-09-10T22:41:08.442700+0000","last_became_active":"2024-09-10T22:41:07.004625+0000","last_became_peered":"2024-09-10T22:41:07.004625+0000","last_unstale":"2024-09-10T22:41:08.442700+0000","last_undegraded":"2024-09-10T22:41:08.442700+0000","last_fullsized":"2024-09-10T22:41:08.442700+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:57.405156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442644+0000","last_change":"2024-09-10T22:41:07.006673+0000","last_active":"2024-09-10T22:41:08.442644+0000","last_peered":"2024-09-10T22:41:08.442644+0000","last_clean":"2024-09-10T22:41:08.442644+0000","last_became_active":"2024-09-10T22:41:07.006370+0000","last_became_peered":"2024-09-10T22:41:07.006370+0000","last_unstale":"2024-09-10T22:41:08.442644+0000","last_undegraded":"2024-09-10T22:41:08.442644+0000","last_fullsized":"2024-09-10T22:41:08.442644+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:23.696110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.006456+0000","last_change":"2024-09-10T22:41:07.003450+0000","last_active":"2024-09-10T22:41:07.006456+0000","last_peered":"2024-09-10T22:41:07.006456+0000","last_clean":"2024-09-10T22:41:07.006456+0000","last_became_active":"2024-09-10T22:41:07.003154+0000","last_became_peered":"2024-09-10T22:41:07.003154+0000","last_unstale":"2024-09-10T22:41:07.006456+0000","last_undegraded":"2024-09-10T22:41:07.006456+0000","last_fullsized":"2024-09-10T22:41:07.006456+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:47.347113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988596+0000","last_change":"2024-09-10T22:41:07.033768+0000","last_active":"2024-09-10T22:41:07.988596+0000","last_peered":"2024-09-10T22:41:07.988596+0000","last_clean":"2024-09-10T22:41:07.988596+0000","last_became_active":"2024-09-10T22:41:07.033472+0000","last_became_peered":"2024-09-10T22:41:07.033472+0000","last_unstale":"2024-09-10T22:41:07.988596+0000","last_undegraded":"2024-09-10T22:41:07.988596+0000","last_fullsized":"2024-09-10T22:41:07.988596+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:43:44.233205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.032902+0000","last_change":"2024-09-10T22:41:07.021556+0000","last_active":"2024-09-10T22:41:07.032902+0000","last_peered":"2024-09-10T22:41:07.032902+0000","last_clean":"2024-09-10T22:41:07.032902+0000","last_became_active":"2024-09-10T22:41:07.021228+0000","last_became_peered":"2024-09-10T22:41:07.021228+0000","last_unstale":"2024-09-10T22:41:07.032902+0000","last_undegraded":"2024-09-10T22:41:07.032902+0000","last_fullsized":"2024-09-10T22:41:07.032902+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:25.632741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.031256+0000","last_change":"2024-09-10T22:41:07.012645+0000","last_active":"2024-09-10T22:41:07.031256+0000","last_peered":"2024-09-10T22:41:07.031256+0000","last_clean":"2024-09-10T22:41:07.031256+0000","last_became_active":"2024-09-10T22:41:07.011780+0000","last_became_peered":"2024-09-10T22:41:07.011780+0000","last_unstale":"2024-09-10T22:41:07.031256+0000","last_undegraded":"2024-09-10T22:41:07.031256+0000","last_fullsized":"2024-09-10T22:41:07.031256+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:59.336126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.029894+0000","last_change":"2024-09-10T22:41:07.021657+0000","last_active":"2024-09-10T22:41:07.029894+0000","last_peered":"2024-09-10T22:41:07.029894+0000","last_clean":"2024-09-10T22:41:07.029894+0000","last_became_active":"2024-09-10T22:41:07.021005+0000","last_became_peered":"2024-09-10T22:41:07.021005+0000","last_unstale":"2024-09-10T22:41:07.029894+0000","last_undegraded":"2024-09-10T22:41:07.029894+0000","last_fullsized":"2024-09-10T22:41:07.029894+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:37.329229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234562+0000","last_change":"2024-09-10T22:41:07.018391+0000","last_active":"2024-09-10T22:41:09.234562+0000","last_peered":"2024-09-10T22:41:09.234562+0000","last_clean":"2024-09-10T22:41:09.234562+0000","last_became_active":"2024-09-10T22:41:07.017756+0000","last_became_peered":"2024-09-10T22:41:07.017756+0000","last_unstale":"2024-09-10T22:41:09.234562+0000","last_undegraded":"2024-09-10T22:41:09.234562+0000","last_fullsized":"2024-09-10T22:41:09.234562+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:39.637740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442852+0000","last_change":"2024-09-10T22:41:07.021311+0000","last_active":"2024-09-10T22:41:08.442852+0000","last_peered":"2024-09-10T22:41:08.442852+0000","last_clean":"2024-09-10T22:41:08.442852+0000","last_became_active":"2024-09-10T22:41:07.017967+0000","last_became_peered":"2024-09-10T22:41:07.017967+0000","last_unstale":"2024-09-10T22:41:08.442852+0000","last_undegraded":"2024-09-10T22:41:08.442852+0000","last_fullsized":"2024-09-10T22:41:08.442852+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:36.893264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.005035+0000","last_change":"2024-09-10T22:41:06.999101+0000","last_active":"2024-09-10T22:41:07.005035+0000","last_peered":"2024-09-10T22:41:07.005035+0000","last_clean":"2024-09-10T22:41:07.005035+0000","last_became_active":"2024-09-10T22:41:06.998842+0000","last_became_peered":"2024-09-10T22:41:06.998842+0000","last_unstale":"2024-09-10T22:41:07.005035+0000","last_undegraded":"2024-09-10T22:41:07.005035+0000","last_fullsized":"2024-09-10T22:41:07.005035+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:36.893264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990989+0000","last_change":"2024-09-10T22:41:07.017658+0000","last_active":"2024-09-10T22:41:07.990989+0000","last_peered":"2024-09-10T22:41:07.990989+0000","last_clean":"2024-09-10T22:41:07.990989+0000","last_became_active":"2024-09-10T22:41:07.017345+0000","last_became_peered":"2024-09-10T22:41:07.017345+0000","last_unstale":"2024-09-10T22:41:07.990989+0000","last_undegraded":"2024-09-10T22:41:07.990989+0000","last_fullsized":"2024-09-10T22:41:07.990989+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:51.381851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.030208+0000","last_change":"2024-09-10T22:41:07.010437+0000","last_active":"2024-09-10T22:41:07.030208+0000","last_peered":"2024-09-10T22:41:07.030208+0000","last_clean":"2024-09-10T22:41:07.030208+0000","last_became_active":"2024-09-10T22:41:07.009860+0000","last_became_peered":"2024-09-10T22:41:07.009860+0000","last_unstale":"2024-09-10T22:41:07.030208+0000","last_undegraded":"2024-09-10T22:41:07.030208+0000","last_fullsized":"2024-09-10T22:41:07.030208+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:48.714132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990379+0000","last_change":"2024-09-10T22:41:07.006639+0000","last_active":"2024-09-10T22:41:07.990379+0000","last_peered":"2024-09-10T22:41:07.990379+0000","last_clean":"2024-09-10T22:41:07.990379+0000","last_became_active":"2024-09-10T22:41:07.006355+0000","last_became_peered":"2024-09-10T22:41:07.006355+0000","last_unstale":"2024-09-10T22:41:07.990379+0000","last_undegraded":"2024-09-10T22:41:07.990379+0000","last_fullsized":"2024-09-10T22:41:07.990379+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:19.478124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990346+0000","last_change":"2024-09-10T22:41:07.001696+0000","last_active":"2024-09-10T22:41:07.990346+0000","last_peered":"2024-09-10T22:41:07.990346+0000","last_clean":"2024-09-10T22:41:07.990346+0000","last_became_active":"2024-09-10T22:41:07.001303+0000","last_became_peered":"2024-09-10T22:41:07.001303+0000","last_unstale":"2024-09-10T22:41:07.990346+0000","last_undegraded":"2024-09-10T22:41:07.990346+0000","last_fullsized":"2024-09-10T22:41:07.990346+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:41.157921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"54'4","reported_seq":19,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442528+0000","last_change":"2024-09-10T22:41:06.002183+0000","last_active":"2024-09-10T22:41:08.442528+0000","last_peered":"2024-09-10T22:41:08.442528+0000","last_clean":"2024-09-10T22:41:08.442528+0000","last_became_active":"2024-09-10T22:41:06.001895+0000","last_became_peered":"2024-09-10T22:41:06.001895+0000","last_unstale":"2024-09-10T22:41:08.442528+0000","last_undegraded":"2024-09-10T22:41:08.442528+0000","last_fullsized":"2024-09-10T22:41:08.442528+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:27.972852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991108+0000","last_change":"2024-09-10T22:41:07.003184+0000","last_active":"2024-09-10T22:41:07.991108+0000","last_peered":"2024-09-10T22:41:07.991108+0000","last_clean":"2024-09-10T22:41:07.991108+0000","last_became_active":"2024-09-10T22:41:07.002900+0000","last_became_peered":"2024-09-10T22:41:07.002900+0000","last_unstale":"2024-09-10T22:41:07.991108+0000","last_undegraded":"2024-09-10T22:41:07.991108+0000","last_fullsized":"2024-09-10T22:41:07.991108+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.301734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"54'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234583+0000","last_change":"2024-09-10T22:41:06.010884+0000","last_active":"2024-09-10T22:41:09.234583+0000","last_peered":"2024-09-10T22:41:09.234583+0000","last_clean":"2024-09-10T22:41:09.234583+0000","last_became_active":"2024-09-10T22:41:06.010619+0000","last_became_peered":"2024-09-10T22:41:06.010619+0000","last_unstale":"2024-09-10T22:41:09.234583+0000","last_undegraded":"2024-09-10T22:41:09.234583+0000","last_fullsized":"2024-09-10T22:41:09.234583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:37.296445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442743+0000","last_change":"2024-09-10T22:41:07.006193+0000","last_active":"2024-09-10T22:41:08.442743+0000","last_peered":"2024-09-10T22:41:08.442743+0000","last_clean":"2024-09-10T22:41:08.442743+0000","last_became_active":"2024-09-10T22:41:07.005918+0000","last_became_peered":"2024-09-10T22:41:07.005918+0000","last_unstale":"2024-09-10T22:41:08.442743+0000","last_undegraded":"2024-09-10T22:41:08.442743+0000","last_fullsized":"2024-09-10T22:41:08.442743+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:57.920678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234620+0000","last_change":"2024-09-10T22:41:06.011552+0000","last_active":"2024-09-10T22:41:09.234620+0000","last_peered":"2024-09-10T22:41:09.234620+0000","last_clean":"2024-09-10T22:41:09.234620+0000","last_became_active":"2024-09-10T22:41:06.011220+0000","last_became_peered":"2024-09-10T22:41:06.011220+0000","last_unstale":"2024-09-10T22:41:09.234620+0000","last_undegraded":"2024-09-10T22:41:09.234620+0000","last_fullsized":"2024-09-10T22:41:09.234620+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:32.955172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.028346+0000","last_change":"2024-09-10T22:41:07.019698+0000","last_active":"2024-09-10T22:41:07.028346+0000","last_peered":"2024-09-10T22:41:07.028346+0000","last_clean":"2024-09-10T22:41:07.028346+0000","last_became_active":"2024-09-10T22:41:07.019353+0000","last_became_peered":"2024-09-10T22:41:07.019353+0000","last_unstale":"2024-09-10T22:41:07.028346+0000","last_undegraded":"2024-09-10T22:41:07.028346+0000","last_fullsized":"2024-09-10T22:41:07.028346+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:08.459818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991030+0000","last_change":"2024-09-10T22:41:05.997081+0000","last_active":"2024-09-10T22:41:07.991030+0000","last_peered":"2024-09-10T22:41:07.991030+0000","last_clean":"2024-09-10T22:41:07.991030+0000","last_became_active":"2024-09-10T22:41:05.996813+0000","last_became_peered":"2024-09-10T22:41:05.996813+0000","last_unstale":"2024-09-10T22:41:07.991030+0000","last_undegraded":"2024-09-10T22:41:07.991030+0000","last_fullsized":"2024-09-10T22:41:07.991030+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:35.883087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.015463+0000","last_change":"2024-09-10T22:41:07.012392+0000","last_active":"2024-09-10T22:41:07.015463+0000","last_peered":"2024-09-10T22:41:07.015463+0000","last_clean":"2024-09-10T22:41:07.015463+0000","last_became_active":"2024-09-10T22:41:07.012159+0000","last_became_peered":"2024-09-10T22:41:07.012159+0000","last_unstale":"2024-09-10T22:41:07.015463+0000","last_undegraded":"2024-09-10T22:41:07.015463+0000","last_fullsized":"2024-09-10T22:41:07.015463+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:40.550666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"54'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.036336+0000","last_change":"2024-09-10T22:41:06.013192+0000","last_active":"2024-09-10T22:41:07.036336+0000","last_peered":"2024-09-10T22:41:07.036336+0000","last_clean":"2024-09-10T22:41:07.036336+0000","last_became_active":"2024-09-10T22:41:06.012907+0000","last_became_peered":"2024-09-10T22:41:06.012907+0000","last_unstale":"2024-09-10T22:41:07.036336+0000","last_undegraded":"2024-09-10T22:41:07.036336+0000","last_fullsized":"2024-09-10T22:41:07.036336+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:22.685932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991457+0000","last_change":"2024-09-10T22:41:07.017658+0000","last_active":"2024-09-10T22:41:07.991457+0000","last_peered":"2024-09-10T22:41:07.991457+0000","last_clean":"2024-09-10T22:41:07.991457+0000","last_became_active":"2024-09-10T22:41:07.017429+0000","last_became_peered":"2024-09-10T22:41:07.017429+0000","last_unstale":"2024-09-10T22:41:07.991457+0000","last_undegraded":"2024-09-10T22:41:07.991457+0000","last_fullsized":"2024-09-10T22:41:07.991457+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:48.871383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"54'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.024168+0000","last_change":"2024-09-10T22:41:06.005980+0000","last_active":"2024-09-10T22:41:07.024168+0000","last_peered":"2024-09-10T22:41:07.024168+0000","last_clean":"2024-09-10T22:41:07.024168+0000","last_became_active":"2024-09-10T22:41:06.005716+0000","last_became_peered":"2024-09-10T22:41:06.005716+0000","last_unstale":"2024-09-10T22:41:07.024168+0000","last_undegraded":"2024-09-10T22:41:07.024168+0000","last_fullsized":"2024-09-10T22:41:07.024168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:46.600179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.029862+0000","last_change":"2024-09-10T22:41:07.021354+0000","last_active":"2024-09-10T22:41:07.029862+0000","last_peered":"2024-09-10T22:41:07.029862+0000","last_clean":"2024-09-10T22:41:07.029862+0000","last_became_active":"2024-09-10T22:41:07.020585+0000","last_became_peered":"2024-09-10T22:41:07.020585+0000","last_unstale":"2024-09-10T22:41:07.029862+0000","last_undegraded":"2024-09-10T22:41:07.029862+0000","last_fullsized":"2024-09-10T22:41:07.029862+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:37:14.763484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442343+0000","last_change":"2024-09-10T22:41:05.995026+0000","last_active":"2024-09-10T22:41:08.442343+0000","last_peered":"2024-09-10T22:41:08.442343+0000","last_clean":"2024-09-10T22:41:08.442343+0000","last_became_active":"2024-09-10T22:41:05.994459+0000","last_became_peered":"2024-09-10T22:41:05.994459+0000","last_unstale":"2024-09-10T22:41:08.442343+0000","last_undegraded":"2024-09-10T22:41:08.442343+0000","last_fullsized":"2024-09-10T22:41:08.442343+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:24.208151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991919+0000","last_change":"2024-09-10T22:41:07.031675+0000","last_active":"2024-09-10T22:41:07.991919+0000","last_peered":"2024-09-10T22:41:07.991919+0000","last_clean":"2024-09-10T22:41:07.991919+0000","last_became_active":"2024-09-10T22:41:07.031451+0000","last_became_peered":"2024-09-10T22:41:07.031451+0000","last_unstale":"2024-09-10T22:41:07.991919+0000","last_undegraded":"2024-09-10T22:41:07.991919+0000","last_fullsized":"2024-09-10T22:41:07.991919+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:31:18.659448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.988819+0000","last_change":"2024-09-10T22:41:06.000385+0000","last_active":"2024-09-10T22:41:06.988819+0000","last_peered":"2024-09-10T22:41:06.988819+0000","last_clean":"2024-09-10T22:41:06.988819+0000","last_became_active":"2024-09-10T22:41:06.000130+0000","last_became_peered":"2024-09-10T22:41:06.000130+0000","last_unstale":"2024-09-10T22:41:06.988819+0000","last_undegraded":"2024-09-10T22:41:06.988819+0000","last_fullsized":"2024-09-10T22:41:06.988819+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:12.373720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.015502+0000","last_change":"2024-09-10T22:41:07.012034+0000","last_active":"2024-09-10T22:41:07.015502+0000","last_peered":"2024-09-10T22:41:07.015502+0000","last_clean":"2024-09-10T22:41:07.015502+0000","last_became_active":"2024-09-10T22:41:07.008587+0000","last_became_peered":"2024-09-10T22:41:07.008587+0000","last_unstale":"2024-09-10T22:41:07.015502+0000","last_undegraded":"2024-09-10T22:41:07.015502+0000","last_fullsized":"2024-09-10T22:41:07.015502+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:56.351069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.992010+0000","last_change":"2024-09-10T22:41:06.008557+0000","last_active":"2024-09-10T22:41:07.992010+0000","last_peered":"2024-09-10T22:41:07.992010+0000","last_clean":"2024-09-10T22:41:07.992010+0000","last_became_active":"2024-09-10T22:41:06.008253+0000","last_became_peered":"2024-09-10T22:41:06.008253+0000","last_unstale":"2024-09-10T22:41:07.992010+0000","last_undegraded":"2024-09-10T22:41:07.992010+0000","last_fullsized":"2024-09-10T22:41:07.992010+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:56.394978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990584+0000","last_change":"2024-09-10T22:41:06.999332+0000","last_active":"2024-09-10T22:41:07.990584+0000","last_peered":"2024-09-10T22:41:07.990584+0000","last_clean":"2024-09-10T22:41:07.990584+0000","last_became_active":"2024-09-10T22:41:06.998916+0000","last_became_peered":"2024-09-10T22:41:06.998916+0000","last_unstale":"2024-09-10T22:41:07.990584+0000","last_undegraded":"2024-09-10T22:41:07.990584+0000","last_fullsized":"2024-09-10T22:41:07.990584+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:43.688712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.995400+0000","last_change":"2024-09-10T22:41:06.006905+0000","last_active":"2024-09-10T22:41:06.995400+0000","last_peered":"2024-09-10T22:41:06.995400+0000","last_clean":"2024-09-10T22:41:06.995400+0000","last_became_active":"2024-09-10T22:41:06.006582+0000","last_became_peered":"2024-09-10T22:41:06.006582+0000","last_unstale":"2024-09-10T22:41:06.995400+0000","last_undegraded":"2024-09-10T22:41:06.995400+0000","last_fullsized":"2024-09-10T22:41:06.995400+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:45.947252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.011380+0000","last_change":"2024-09-10T22:41:07.002342+0000","last_active":"2024-09-10T22:41:07.011380+0000","last_peered":"2024-09-10T22:41:07.011380+0000","last_clean":"2024-09-10T22:41:07.011380+0000","last_became_active":"2024-09-10T22:41:07.002066+0000","last_became_peered":"2024-09-10T22:41:07.002066+0000","last_unstale":"2024-09-10T22:41:07.011380+0000","last_undegraded":"2024-09-10T22:41:07.011380+0000","last_fullsized":"2024-09-10T22:41:07.011380+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:37.124449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"54'3","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991349+0000","last_change":"2024-09-10T22:41:06.008984+0000","last_active":"2024-09-10T22:41:07.991349+0000","last_peered":"2024-09-10T22:41:07.991349+0000","last_clean":"2024-09-10T22:41:07.991349+0000","last_became_active":"2024-09-10T22:41:06.008191+0000","last_became_peered":"2024-09-10T22:41:06.008191+0000","last_unstale":"2024-09-10T22:41:07.991349+0000","last_undegraded":"2024-09-10T22:41:07.991349+0000","last_fullsized":"2024-09-10T22:41:07.991349+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:03.893470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.017655+0000","last_change":"2024-09-10T22:41:07.015038+0000","last_active":"2024-09-10T22:41:07.017655+0000","last_peered":"2024-09-10T22:41:07.017655+0000","last_clean":"2024-09-10T22:41:07.017655+0000","last_became_active":"2024-09-10T22:41:07.014790+0000","last_became_peered":"2024-09-10T22:41:07.014790+0000","last_unstale":"2024-09-10T22:41:07.017655+0000","last_undegraded":"2024-09-10T22:41:07.017655+0000","last_fullsized":"2024-09-10T22:41:07.017655+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:33.101104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"54'6","reported_seq":19,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.038208+0000","last_change":"2024-09-10T22:41:05.997554+0000","last_active":"2024-09-10T22:41:07.038208+0000","last_peered":"2024-09-10T22:41:07.038208+0000","last_clean":"2024-09-10T22:41:07.038208+0000","last_became_active":"2024-09-10T22:41:05.997207+0000","last_became_peered":"2024-09-10T22:41:05.997207+0000","last_unstale":"2024-09-10T22:41:07.038208+0000","last_undegraded":"2024-09-10T22:41:07.038208+0000","last_fullsized":"2024-09-10T22:41:07.038208+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:53.069745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990781+0000","last_change":"2024-09-10T22:41:07.009874+0000","last_active":"2024-09-10T22:41:07.990781+0000","last_peered":"2024-09-10T22:41:07.990781+0000","last_clean":"2024-09-10T22:41:07.990781+0000","last_became_active":"2024-09-10T22:41:07.009570+0000","last_became_peered":"2024-09-10T22:41:07.009570+0000","last_unstale":"2024-09-10T22:41:07.990781+0000","last_undegraded":"2024-09-10T22:41:07.990781+0000","last_fullsized":"2024-09-10T22:41:07.990781+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:41:27.226599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"54'2","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.033033+0000","last_change":"2024-09-10T22:41:06.006329+0000","last_active":"2024-09-10T22:41:07.033033+0000","last_peered":"2024-09-10T22:41:07.033033+0000","last_clean":"2024-09-10T22:41:07.033033+0000","last_became_active":"2024-09-10T22:41:06.006076+0000","last_became_peered":"2024-09-10T22:41:06.006076+0000","last_unstale":"2024-09-10T22:41:07.033033+0000","last_undegraded":"2024-09-10T22:41:07.033033+0000","last_fullsized":"2024-09-10T22:41:07.033033+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:03.893470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.031658+0000","last_change":"2024-09-10T22:41:07.015684+0000","last_active":"2024-09-10T22:41:07.031658+0000","last_peered":"2024-09-10T22:41:07.031658+0000","last_clean":"2024-09-10T22:41:07.031658+0000","last_became_active":"2024-09-10T22:41:07.015425+0000","last_became_peered":"2024-09-10T22:41:07.015425+0000","last_unstale":"2024-09-10T22:41:07.031658+0000","last_undegraded":"2024-09-10T22:41:07.031658+0000","last_fullsized":"2024-09-10T22:41:07.031658+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:41:27.226599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442629+0000","last_change":"2024-09-10T22:41:05.996246+0000","last_active":"2024-09-10T22:41:08.442629+0000","last_peered":"2024-09-10T22:41:08.442629+0000","last_clean":"2024-09-10T22:41:08.442629+0000","last_became_active":"2024-09-10T22:41:05.995968+0000","last_became_peered":"2024-09-10T22:41:05.995968+0000","last_unstale":"2024-09-10T22:41:08.442629+0000","last_undegraded":"2024-09-10T22:41:08.442629+0000","last_fullsized":"2024-09-10T22:41:08.442629+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:11.662901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.020799+0000","last_change":"2024-09-10T22:41:07.012291+0000","last_active":"2024-09-10T22:41:07.020799+0000","last_peered":"2024-09-10T22:41:07.020799+0000","last_clean":"2024-09-10T22:41:07.020799+0000","last_became_active":"2024-09-10T22:41:07.012006+0000","last_became_peered":"2024-09-10T22:41:07.012006+0000","last_unstale":"2024-09-10T22:41:07.020799+0000","last_undegraded":"2024-09-10T22:41:07.020799+0000","last_fullsized":"2024-09-10T22:41:07.020799+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.301734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991300+0000","last_change":"2024-09-10T22:41:06.009142+0000","last_active":"2024-09-10T22:41:07.991300+0000","last_peered":"2024-09-10T22:41:07.991300+0000","last_clean":"2024-09-10T22:41:07.991300+0000","last_became_active":"2024-09-10T22:41:06.008215+0000","last_became_peered":"2024-09-10T22:41:06.008215+0000","last_unstale":"2024-09-10T22:41:07.991300+0000","last_undegraded":"2024-09-10T22:41:07.991300+0000","last_fullsized":"2024-09-10T22:41:07.991300+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:25.802794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.007816+0000","last_change":"2024-09-10T22:41:07.001776+0000","last_active":"2024-09-10T22:41:07.007816+0000","last_peered":"2024-09-10T22:41:07.007816+0000","last_clean":"2024-09-10T22:41:07.007816+0000","last_became_active":"2024-09-10T22:41:07.001504+0000","last_became_peered":"2024-09-10T22:41:07.001504+0000","last_unstale":"2024-09-10T22:41:07.007816+0000","last_undegraded":"2024-09-10T22:41:07.007816+0000","last_fullsized":"2024-09-10T22:41:07.007816+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:34.312993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"54'8","reported_seq":21,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.036815+0000","last_change":"2024-09-10T22:41:05.998248+0000","last_active":"2024-09-10T22:41:07.036815+0000","last_peered":"2024-09-10T22:41:07.036815+0000","last_clean":"2024-09-10T22:41:07.036815+0000","last_became_active":"2024-09-10T22:41:05.997978+0000","last_became_peered":"2024-09-10T22:41:05.997978+0000","last_unstale":"2024-09-10T22:41:07.036815+0000","last_undegraded":"2024-09-10T22:41:07.036815+0000","last_fullsized":"2024-09-10T22:41:07.036815+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:42.960083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.006427+0000","last_change":"2024-09-10T22:41:07.005382+0000","last_active":"2024-09-10T22:41:07.006427+0000","last_peered":"2024-09-10T22:41:07.006427+0000","last_clean":"2024-09-10T22:41:07.006427+0000","last_became_active":"2024-09-10T22:41:07.004169+0000","last_became_peered":"2024-09-10T22:41:07.004169+0000","last_unstale":"2024-09-10T22:41:07.006427+0000","last_undegraded":"2024-09-10T22:41:07.006427+0000","last_fullsized":"2024-09-10T22:41:07.006427+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:25.632741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"54'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.033085+0000","last_change":"2024-09-10T22:41:05.997356+0000","last_active":"2024-09-10T22:41:07.033085+0000","last_peered":"2024-09-10T22:41:07.033085+0000","last_clean":"2024-09-10T22:41:07.033085+0000","last_became_active":"2024-09-10T22:41:05.997087+0000","last_became_peered":"2024-09-10T22:41:05.997087+0000","last_unstale":"2024-09-10T22:41:07.033085+0000","last_undegraded":"2024-09-10T22:41:07.033085+0000","last_fullsized":"2024-09-10T22:41:07.033085+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:56.394978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234317+0000","last_change":"2024-09-10T22:41:07.030952+0000","last_active":"2024-09-10T22:41:09.234317+0000","last_peered":"2024-09-10T22:41:09.234317+0000","last_clean":"2024-09-10T22:41:09.234317+0000","last_became_active":"2024-09-10T22:41:07.030660+0000","last_became_peered":"2024-09-10T22:41:07.030660+0000","last_unstale":"2024-09-10T22:41:09.234317+0000","last_undegraded":"2024-09-10T22:41:09.234317+0000","last_fullsized":"2024-09-10T22:41:09.234317+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:46:17.184864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988949+0000","last_change":"2024-09-10T22:41:06.005480+0000","last_active":"2024-09-10T22:41:07.988949+0000","last_peered":"2024-09-10T22:41:07.988949+0000","last_clean":"2024-09-10T22:41:07.988949+0000","last_became_active":"2024-09-10T22:41:06.005212+0000","last_became_peered":"2024-09-10T22:41:06.005212+0000","last_unstale":"2024-09-10T22:41:07.988949+0000","last_undegraded":"2024-09-10T22:41:07.988949+0000","last_fullsized":"2024-09-10T22:41:07.988949+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:05.166519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.016705+0000","last_change":"2024-09-10T22:41:07.013980+0000","last_active":"2024-09-10T22:41:07.016705+0000","last_peered":"2024-09-10T22:41:07.016705+0000","last_clean":"2024-09-10T22:41:07.016705+0000","last_became_active":"2024-09-10T22:41:07.013700+0000","last_became_peered":"2024-09-10T22:41:07.013700+0000","last_unstale":"2024-09-10T22:41:07.016705+0000","last_undegraded":"2024-09-10T22:41:07.016705+0000","last_fullsized":"2024-09-10T22:41:07.016705+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:53.050265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"54'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442896+0000","last_change":"2024-09-10T22:41:06.005503+0000","last_active":"2024-09-10T22:41:08.442896+0000","last_peered":"2024-09-10T22:41:08.442896+0000","last_clean":"2024-09-10T22:41:08.442896+0000","last_became_active":"2024-09-10T22:41:06.005205+0000","last_became_peered":"2024-09-10T22:41:06.005205+0000","last_unstale":"2024-09-10T22:41:08.442896+0000","last_undegraded":"2024-09-10T22:41:08.442896+0000","last_fullsized":"2024-09-10T22:41:08.442896+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:03.751309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235132+0000","last_change":"2024-09-10T22:41:07.009702+0000","last_active":"2024-09-10T22:41:09.235132+0000","last_peered":"2024-09-10T22:41:09.235132+0000","last_clean":"2024-09-10T22:41:09.235132+0000","last_became_active":"2024-09-10T22:41:07.009422+0000","last_became_peered":"2024-09-10T22:41:07.009422+0000","last_unstale":"2024-09-10T22:41:09.235132+0000","last_undegraded":"2024-09-10T22:41:09.235132+0000","last_fullsized":"2024-09-10T22:41:09.235132+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:48.766775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442830+0000","last_change":"2024-09-10T22:41:05.990766+0000","last_active":"2024-09-10T22:41:08.442830+0000","last_peered":"2024-09-10T22:41:08.442830+0000","last_clean":"2024-09-10T22:41:08.442830+0000","last_became_active":"2024-09-10T22:41:05.990495+0000","last_became_peered":"2024-09-10T22:41:05.990495+0000","last_unstale":"2024-09-10T22:41:08.442830+0000","last_undegraded":"2024-09-10T22:41:08.442830+0000","last_fullsized":"2024-09-10T22:41:08.442830+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:56.811450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991002+0000","last_change":"2024-09-10T22:41:07.004711+0000","last_active":"2024-09-10T22:41:07.991002+0000","last_peered":"2024-09-10T22:41:07.991002+0000","last_clean":"2024-09-10T22:41:07.991002+0000","last_became_active":"2024-09-10T22:41:07.004451+0000","last_became_peered":"2024-09-10T22:41:07.004451+0000","last_unstale":"2024-09-10T22:41:07.991002+0000","last_undegraded":"2024-09-10T22:41:07.991002+0000","last_fullsized":"2024-09-10T22:41:07.991002+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:25.632741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234629+0000","last_change":"2024-09-10T22:41:06.011467+0000","last_active":"2024-09-10T22:41:09.234629+0000","last_peered":"2024-09-10T22:41:09.234629+0000","last_clean":"2024-09-10T22:41:09.234629+0000","last_became_active":"2024-09-10T22:41:06.011088+0000","last_became_peered":"2024-09-10T22:41:06.011088+0000","last_unstale":"2024-09-10T22:41:09.234629+0000","last_undegraded":"2024-09-10T22:41:09.234629+0000","last_fullsized":"2024-09-10T22:41:09.234629+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:56.185721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442845+0000","last_change":"2024-09-10T22:41:07.005871+0000","last_active":"2024-09-10T22:41:08.442845+0000","last_peered":"2024-09-10T22:41:08.442845+0000","last_clean":"2024-09-10T22:41:08.442845+0000","last_became_active":"2024-09-10T22:41:07.005588+0000","last_became_peered":"2024-09-10T22:41:07.005588+0000","last_unstale":"2024-09-10T22:41:08.442845+0000","last_undegraded":"2024-09-10T22:41:08.442845+0000","last_fullsized":"2024-09-10T22:41:08.442845+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:42.463673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.990690+0000","last_change":"2024-09-10T22:41:06.000828+0000","last_active":"2024-09-10T22:41:06.990690+0000","last_peered":"2024-09-10T22:41:06.990690+0000","last_clean":"2024-09-10T22:41:06.990690+0000","last_became_active":"2024-09-10T22:41:05.998637+0000","last_became_peered":"2024-09-10T22:41:05.998637+0000","last_unstale":"2024-09-10T22:41:06.990690+0000","last_undegraded":"2024-09-10T22:41:06.990690+0000","last_fullsized":"2024-09-10T22:41:06.990690+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:32.301219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.020821+0000","last_change":"2024-09-10T22:41:07.008864+0000","last_active":"2024-09-10T22:41:07.020821+0000","last_peered":"2024-09-10T22:41:07.020821+0000","last_clean":"2024-09-10T22:41:07.020821+0000","last_became_active":"2024-09-10T22:41:07.002835+0000","last_became_peered":"2024-09-10T22:41:07.002835+0000","last_unstale":"2024-09-10T22:41:07.020821+0000","last_undegraded":"2024-09-10T22:41:07.020821+0000","last_fullsized":"2024-09-10T22:41:07.020821+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:54.079923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.989540+0000","last_change":"2024-09-10T22:41:06.005138+0000","last_active":"2024-09-10T22:41:06.989540+0000","last_peered":"2024-09-10T22:41:06.989540+0000","last_clean":"2024-09-10T22:41:06.989540+0000","last_became_active":"2024-09-10T22:41:06.004886+0000","last_became_peered":"2024-09-10T22:41:06.004886+0000","last_unstale":"2024-09-10T22:41:06.989540+0000","last_undegraded":"2024-09-10T22:41:06.989540+0000","last_fullsized":"2024-09-10T22:41:06.989540+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:25.802794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235059+0000","last_change":"2024-09-10T22:41:07.016437+0000","last_active":"2024-09-10T22:41:09.235059+0000","last_peered":"2024-09-10T22:41:09.235059+0000","last_clean":"2024-09-10T22:41:09.235059+0000","last_became_active":"2024-09-10T22:41:07.016216+0000","last_became_peered":"2024-09-10T22:41:07.016216+0000","last_unstale":"2024-09-10T22:41:09.235059+0000","last_undegraded":"2024-09-10T22:41:09.235059+0000","last_fullsized":"2024-09-10T22:41:09.235059+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:43.759788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988463+0000","last_change":"2024-09-10T22:41:06.008205+0000","last_active":"2024-09-10T22:41:07.988463+0000","last_peered":"2024-09-10T22:41:07.988463+0000","last_clean":"2024-09-10T22:41:07.988463+0000","last_became_active":"2024-09-10T22:41:06.006600+0000","last_became_peered":"2024-09-10T22:41:06.006600+0000","last_unstale":"2024-09-10T22:41:07.988463+0000","last_undegraded":"2024-09-10T22:41:07.988463+0000","last_fullsized":"2024-09-10T22:41:07.988463+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:57.966564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990322+0000","last_change":"2024-09-10T22:41:07.007272+0000","last_active":"2024-09-10T22:41:07.990322+0000","last_peered":"2024-09-10T22:41:07.990322+0000","last_clean":"2024-09-10T22:41:07.990322+0000","last_became_active":"2024-09-10T22:41:07.006909+0000","last_became_peered":"2024-09-10T22:41:07.006909+0000","last_unstale":"2024-09-10T22:41:07.990322+0000","last_undegraded":"2024-09-10T22:41:07.990322+0000","last_fullsized":"2024-09-10T22:41:07.990322+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:59.336126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442684+0000","last_change":"2024-09-10T22:41:05.999502+0000","last_active":"2024-09-10T22:41:08.442684+0000","last_peered":"2024-09-10T22:41:08.442684+0000","last_clean":"2024-09-10T22:41:08.442684+0000","last_became_active":"2024-09-10T22:41:05.999171+0000","last_became_peered":"2024-09-10T22:41:05.999171+0000","last_unstale":"2024-09-10T22:41:08.442684+0000","last_undegraded":"2024-09-10T22:41:08.442684+0000","last_fullsized":"2024-09-10T22:41:08.442684+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:11.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235231+0000","last_change":"2024-09-10T22:41:07.028930+0000","last_active":"2024-09-10T22:41:09.235231+0000","last_peered":"2024-09-10T22:41:09.235231+0000","last_clean":"2024-09-10T22:41:09.235231+0000","last_became_active":"2024-09-10T22:41:07.028710+0000","last_became_peered":"2024-09-10T22:41:07.028710+0000","last_unstale":"2024-09-10T22:41:09.235231+0000","last_undegraded":"2024-09-10T22:41:09.235231+0000","last_fullsized":"2024-09-10T22:41:09.235231+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:29.579930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991455+0000","last_change":"2024-09-10T22:41:06.010369+0000","last_active":"2024-09-10T22:41:07.991455+0000","last_peered":"2024-09-10T22:41:07.991455+0000","last_clean":"2024-09-10T22:41:07.991455+0000","last_became_active":"2024-09-10T22:41:06.010182+0000","last_became_peered":"2024-09-10T22:41:06.010182+0000","last_unstale":"2024-09-10T22:41:07.991455+0000","last_undegraded":"2024-09-10T22:41:07.991455+0000","last_fullsized":"2024-09-10T22:41:07.991455+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:22.685932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.005193+0000","last_change":"2024-09-10T22:41:07.000440+0000","last_active":"2024-09-10T22:41:07.005193+0000","last_peered":"2024-09-10T22:41:07.005193+0000","last_clean":"2024-09-10T22:41:07.005193+0000","last_became_active":"2024-09-10T22:41:06.999910+0000","last_became_peered":"2024-09-10T22:41:06.999910+0000","last_unstale":"2024-09-10T22:41:07.005193+0000","last_undegraded":"2024-09-10T22:41:07.005193+0000","last_fullsized":"2024-09-10T22:41:07.005193+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:43.688712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.992451+0000","last_change":"2024-09-10T22:41:06.009093+0000","last_active":"2024-09-10T22:41:06.992451+0000","last_peered":"2024-09-10T22:41:06.992451+0000","last_clean":"2024-09-10T22:41:06.992451+0000","last_became_active":"2024-09-10T22:41:06.008811+0000","last_became_peered":"2024-09-10T22:41:06.008811+0000","last_unstale":"2024-09-10T22:41:06.992451+0000","last_undegraded":"2024-09-10T22:41:06.992451+0000","last_fullsized":"2024-09-10T22:41:06.992451+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:54.497387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.030485+0000","last_change":"2024-09-10T22:41:07.011776+0000","last_active":"2024-09-10T22:41:07.030485+0000","last_peered":"2024-09-10T22:41:07.030485+0000","last_clean":"2024-09-10T22:41:07.030485+0000","last_became_active":"2024-09-10T22:41:07.011500+0000","last_became_peered":"2024-09-10T22:41:07.011500+0000","last_unstale":"2024-09-10T22:41:07.030485+0000","last_undegraded":"2024-09-10T22:41:07.030485+0000","last_fullsized":"2024-09-10T22:41:07.030485+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:21.906726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.991701+0000","last_change":"2024-09-10T22:41:05.998931+0000","last_active":"2024-09-10T22:41:06.991701+0000","last_peered":"2024-09-10T22:41:06.991701+0000","last_clean":"2024-09-10T22:41:06.991701+0000","last_became_active":"2024-09-10T22:41:05.997587+0000","last_became_peered":"2024-09-10T22:41:05.997587+0000","last_unstale":"2024-09-10T22:41:06.991701+0000","last_undegraded":"2024-09-10T22:41:06.991701+0000","last_fullsized":"2024-09-10T22:41:06.991701+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:20.896548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990817+0000","last_change":"2024-09-10T22:41:07.009487+0000","last_active":"2024-09-10T22:41:07.990817+0000","last_peered":"2024-09-10T22:41:07.990817+0000","last_clean":"2024-09-10T22:41:07.990817+0000","last_became_active":"2024-09-10T22:41:07.009104+0000","last_became_peered":"2024-09-10T22:41:07.009104+0000","last_unstale":"2024-09-10T22:41:07.990817+0000","last_undegraded":"2024-09-10T22:41:07.990817+0000","last_fullsized":"2024-09-10T22:41:07.990817+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:47.347113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.990894+0000","last_change":"2024-09-10T22:41:06.006577+0000","last_active":"2024-09-10T22:41:06.990894+0000","last_peered":"2024-09-10T22:41:06.990894+0000","last_clean":"2024-09-10T22:41:06.990894+0000","last_became_active":"2024-09-10T22:41:06.006219+0000","last_became_peered":"2024-09-10T22:41:06.006219+0000","last_unstale":"2024-09-10T22:41:06.990894+0000","last_undegraded":"2024-09-10T22:41:06.990894+0000","last_fullsized":"2024-09-10T22:41:06.990894+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:47.703955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.030507+0000","last_change":"2024-09-10T22:41:07.013569+0000","last_active":"2024-09-10T22:41:07.030507+0000","last_peered":"2024-09-10T22:41:07.030507+0000","last_clean":"2024-09-10T22:41:07.030507+0000","last_became_active":"2024-09-10T22:41:07.013309+0000","last_became_peered":"2024-09-10T22:41:07.013309+0000","last_unstale":"2024-09-10T22:41:07.030507+0000","last_undegraded":"2024-09-10T22:41:07.030507+0000","last_fullsized":"2024-09-10T22:41:07.030507+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:19.478124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.994609+0000","last_change":"2024-09-10T22:41:06.007609+0000","last_active":"2024-09-10T22:41:06.994609+0000","last_peered":"2024-09-10T22:41:06.994609+0000","last_clean":"2024-09-10T22:41:06.994609+0000","last_became_active":"2024-09-10T22:41:06.007320+0000","last_became_peered":"2024-09-10T22:41:06.007320+0000","last_unstale":"2024-09-10T22:41:06.994609+0000","last_undegraded":"2024-09-10T22:41:06.994609+0000","last_fullsized":"2024-09-10T22:41:06.994609+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:02:49.505104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.023434+0000","last_change":"2024-09-10T22:41:07.019550+0000","last_active":"2024-09-10T22:41:07.023434+0000","last_peered":"2024-09-10T22:41:07.023434+0000","last_clean":"2024-09-10T22:41:07.023434+0000","last_became_active":"2024-09-10T22:41:07.019073+0000","last_became_peered":"2024-09-10T22:41:07.019073+0000","last_unstale":"2024-09-10T22:41:07.023434+0000","last_undegraded":"2024-09-10T22:41:07.023434+0000","last_fullsized":"2024-09-10T22:41:07.023434+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:15.786849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990444+0000","last_change":"2024-09-10T22:41:06.011292+0000","last_active":"2024-09-10T22:41:07.990444+0000","last_peered":"2024-09-10T22:41:07.990444+0000","last_clean":"2024-09-10T22:41:07.990444+0000","last_became_active":"2024-09-10T22:41:06.010970+0000","last_became_peered":"2024-09-10T22:41:06.010970+0000","last_unstale":"2024-09-10T22:41:07.990444+0000","last_undegraded":"2024-09-10T22:41:07.990444+0000","last_fullsized":"2024-09-10T22:41:07.990444+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:51.873950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442589+0000","last_change":"2024-09-10T22:41:06.999739+0000","last_active":"2024-09-10T22:41:08.442589+0000","last_peered":"2024-09-10T22:41:08.442589+0000","last_clean":"2024-09-10T22:41:08.442589+0000","last_became_active":"2024-09-10T22:41:06.999350+0000","last_became_peered":"2024-09-10T22:41:06.999350+0000","last_unstale":"2024-09-10T22:41:08.442589+0000","last_undegraded":"2024-09-10T22:41:08.442589+0000","last_fullsized":"2024-09-10T22:41:08.442589+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:04.903647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T22:41:06.994361+0000","last_change":"2024-09-10T22:41:06.013365+0000","last_active":"2024-09-10T22:41:06.994361+0000","last_peered":"2024-09-10T22:41:06.994361+0000","last_clean":"2024-09-10T22:41:06.994361+0000","last_became_active":"2024-09-10T22:41:06.012873+0000","last_became_peered":"2024-09-10T22:41:06.012873+0000","last_unstale":"2024-09-10T22:41:06.994361+0000","last_undegraded":"2024-09-10T22:41:06.994361+0000","last_fullsized":"2024-09-10T22:41:06.994361+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:56.910500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":173,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991085+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:41:07.991085+0000","last_peered":"2024-09-10T22:41:07.991085+0000","last_clean":"2024-09-10T22:41:07.991085+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:41:07.991085+0000","last_undegraded":"2024-09-10T22:41:07.991085+0000","last_fullsized":"2024-09-10T22:41:07.991085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1236992,"data_stored":871722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509473,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":288574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":634880,"data_stored":281230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509473,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":638976,"data_stored":281812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":651264,"data_stored":282864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":659456,"data_stored":289534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509473,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1236992,"data_stored":871654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":288082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:41:12.957 INFO:tasks.ceph.mds.a.smithi103.stderr:2024-09-10T22:41:12.952+0000 7faa08e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T22:41:15.679 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:41:15.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.824+0000 7f5d0d200640 1 -- 172.21.15.103:0/2323384736 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d080b09c0 msgr2=0x7f5d080ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:15.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.824+0000 7f5d0d200640 1 --2- 172.21.15.103:0/2323384736 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d080b09c0 0x7f5d080ce600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009900 tx=0x7f5cf001c850 comp rx=0 tx=0).stop 2024-09-10T22:41:15.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.824+0000 7f5d0d200640 1 -- 172.21.15.103:0/2323384736 shutdown_connections 2024-09-10T22:41:15.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.824+0000 7f5d0d200640 1 --2- 172.21.15.103:0/2323384736 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d080b09c0 0x7f5d080ce600 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:15.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.824+0000 7f5d0d200640 1 --2- 172.21.15.103:0/2323384736 >> v2:172.21.15.131:3300/0 conn(0x7f5d0815be30 0x7f5d080ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:15.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.824+0000 7f5d0d200640 1 -- 172.21.15.103:0/2323384736 >> 172.21.15.103:0/2323384736 conn(0x7f5d080d1ac0 msgr2=0x7f5d080d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:15.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.824+0000 7f5d0d200640 1 -- 172.21.15.103:0/2323384736 shutdown_connections 2024-09-10T22:41:15.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.824+0000 7f5d0d200640 1 -- 172.21.15.103:0/2323384736 wait complete. 2024-09-10T22:41:15.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5d0d200640 1 Processor -- start 2024-09-10T22:41:15.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5d0d200640 1 -- start start 2024-09-10T22:41:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5d0d200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d080b09c0 0x7f5d08153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5d0d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d080ceb40 0x7f5d080c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5d0d200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d0815be30 0x7f5d080c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5d0d200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5d08169110 con 0x7f5d080ceb40 2024-09-10T22:41:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5d0d200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5d08168f90 con 0x7f5d0815be30 2024-09-10T22:41:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5d0d200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5d08169290 con 0x7f5d080b09c0 2024-09-10T22:41:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5cfd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d080ceb40 0x7f5d080c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5cfd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d080ceb40 0x7f5d080c4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56650/0 (socket says 172.21.15.103:56650) 2024-09-10T22:41:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5cfd400640 1 -- 172.21.15.103:0/965997649 learned_addr learned my addr 172.21.15.103:0/965997649 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5d05e00640 1 --2- 172.21.15.103:0/965997649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d080b09c0 0x7f5d08153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5d06800640 1 --2- 172.21.15.103:0/965997649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d0815be30 0x7f5d080c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5cfd400640 1 -- 172.21.15.103:0/965997649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d080b09c0 msgr2=0x7f5d08153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:15.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5cfd400640 1 --2- 172.21.15.103:0/965997649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d080b09c0 0x7f5d08153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:15.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5cfd400640 1 -- 172.21.15.103:0/965997649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d0815be30 msgr2=0x7f5d080c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:15.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5cfd400640 1 --2- 172.21.15.103:0/965997649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d0815be30 0x7f5d080c4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:15.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5cfd400640 1 -- 172.21.15.103:0/965997649 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d08153750 con 0x7f5d080ceb40 2024-09-10T22:41:15.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5cfd400640 1 --2- 172.21.15.103:0/965997649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d080ceb40 0x7f5d080c4620 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0019460 tx=0x7f5cf0005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:15.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5cfea00640 1 -- 172.21.15.103:0/965997649 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00b2040 con 0x7f5d080ceb40 2024-09-10T22:41:15.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5d0d200640 1 -- 172.21.15.103:0/965997649 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d080b4da0 con 0x7f5d080ceb40 2024-09-10T22:41:15.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5cfea00640 1 -- 172.21.15.103:0/965997649 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cf0004330 con 0x7f5d080ceb40 2024-09-10T22:41:15.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.828+0000 7f5cfea00640 1 -- 172.21.15.103:0/965997649 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0003860 con 0x7f5d080ceb40 2024-09-10T22:41:15.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.832+0000 7f5d0d200640 1 -- 172.21.15.103:0/965997649 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d080b7470 con 0x7f5d080ceb40 2024-09-10T22:41:15.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.832+0000 7f5d0d200640 1 -- 172.21.15.103:0/965997649 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d080b6f80 con 0x7f5d080ceb40 2024-09-10T22:41:15.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.832+0000 7f5cfea00640 1 -- 172.21.15.103:0/965997649 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5cf00b5070 con 0x7f5d080ceb40 2024-09-10T22:41:15.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.832+0000 7f5cfea00640 1 --2- 172.21.15.103:0/965997649 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5ce40725e0 0x7f5ce4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:15.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.832+0000 7f5cfea00640 1 -- 172.21.15.103:0/965997649 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f5cf012ccd0 con 0x7f5d080ceb40 2024-09-10T22:41:15.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.832+0000 7f5d05e00640 1 --2- 172.21.15.103:0/965997649 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5ce40725e0 0x7f5ce4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:15.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.836+0000 7f5d05e00640 1 --2- 172.21.15.103:0/965997649 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5ce40725e0 0x7f5ce4074aa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009980 tx=0x7f5cf8009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:15.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:15.836+0000 7f5cfea00640 1 -- 172.21.15.103:0/965997649 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5cf00164d0 con 0x7f5d080ceb40 2024-09-10T22:41:16.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.000+0000 7f5d0d200640 1 -- 172.21.15.103:0/965997649 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5d080cf9c0 con 0x7f5ce40725e0 2024-09-10T22:41:16.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.004+0000 7f5cfea00640 1 -- 172.21.15.103:0/965997649 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251870 (secure 0 0 0) 0x7f5d080cf9c0 con 0x7f5ce40725e0 2024-09-10T22:41:16.014 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:16.015 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:41:16.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.008+0000 7f5d0d200640 1 -- 172.21.15.103:0/965997649 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5ce40725e0 msgr2=0x7f5ce4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:16.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.008+0000 7f5d0d200640 1 --2- 172.21.15.103:0/965997649 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5ce40725e0 0x7f5ce4074aa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009980 tx=0x7f5cf8009500 comp rx=0 tx=0).stop 2024-09-10T22:41:16.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.008+0000 7f5d0d200640 1 -- 172.21.15.103:0/965997649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d080ceb40 msgr2=0x7f5d080c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:16.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.008+0000 7f5d0d200640 1 --2- 172.21.15.103:0/965997649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d080ceb40 0x7f5d080c4620 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0019460 tx=0x7f5cf0005700 comp rx=0 tx=0).stop 2024-09-10T22:41:16.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.008+0000 7f5d0d200640 1 -- 172.21.15.103:0/965997649 shutdown_connections 2024-09-10T22:41:16.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.008+0000 7f5d0d200640 1 --2- 172.21.15.103:0/965997649 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5ce40725e0 0x7f5ce4074aa0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.008+0000 7f5d0d200640 1 --2- 172.21.15.103:0/965997649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d0815be30 0x7f5d080c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.008+0000 7f5d0d200640 1 --2- 172.21.15.103:0/965997649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d080ceb40 0x7f5d080c4620 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.008+0000 7f5d0d200640 1 --2- 172.21.15.103:0/965997649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d080b09c0 0x7f5d08153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.008+0000 7f5d0d200640 1 -- 172.21.15.103:0/965997649 >> 172.21.15.103:0/965997649 conn(0x7f5d080d1ac0 msgr2=0x7f5d0814ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:16.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.008+0000 7f5d0d200640 1 -- 172.21.15.103:0/965997649 shutdown_connections 2024-09-10T22:41:16.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.008+0000 7f5d0d200640 1 -- 172.21.15.103:0/965997649 wait complete. 2024-09-10T22:41:16.034 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2024-09-10T22:41:15.653400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":191,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226672,"kb_used_data":6280,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748048,"statfs":{"total":773094113280,"available":772862001152,"internally_reserved":0,"allocated":6430720,"data_stored":3488932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.667895"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234823+0000","last_change":"2024-09-10T22:41:07.009600+0000","last_active":"2024-09-10T22:41:09.234823+0000","last_peered":"2024-09-10T22:41:09.234823+0000","last_clean":"2024-09-10T22:41:09.234823+0000","last_became_active":"2024-09-10T22:41:07.009300+0000","last_became_peered":"2024-09-10T22:41:07.009300+0000","last_unstale":"2024-09-10T22:41:09.234823+0000","last_undegraded":"2024-09-10T22:41:09.234823+0000","last_fullsized":"2024-09-10T22:41:09.234823+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:43.814129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991867+0000","last_change":"2024-09-10T22:41:07.018450+0000","last_active":"2024-09-10T22:41:07.991867+0000","last_peered":"2024-09-10T22:41:07.991867+0000","last_clean":"2024-09-10T22:41:07.991867+0000","last_became_active":"2024-09-10T22:41:07.018138+0000","last_became_peered":"2024-09-10T22:41:07.018138+0000","last_unstale":"2024-09-10T22:41:07.991867+0000","last_undegraded":"2024-09-10T22:41:07.991867+0000","last_fullsized":"2024-09-10T22:41:07.991867+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:18.409465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.998013+0000","last_change":"2024-09-10T22:41:07.011508+0000","last_active":"2024-09-10T22:41:08.998013+0000","last_peered":"2024-09-10T22:41:08.998013+0000","last_clean":"2024-09-10T22:41:08.998013+0000","last_became_active":"2024-09-10T22:41:07.011224+0000","last_became_peered":"2024-09-10T22:41:07.011224+0000","last_unstale":"2024-09-10T22:41:08.998013+0000","last_undegraded":"2024-09-10T22:41:08.998013+0000","last_fullsized":"2024-09-10T22:41:08.998013+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:22.018035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990876+0000","last_change":"2024-09-10T22:41:07.016143+0000","last_active":"2024-09-10T22:41:07.990876+0000","last_peered":"2024-09-10T22:41:07.990876+0000","last_clean":"2024-09-10T22:41:07.990876+0000","last_became_active":"2024-09-10T22:41:07.015887+0000","last_became_peered":"2024-09-10T22:41:07.015887+0000","last_unstale":"2024-09-10T22:41:07.990876+0000","last_undegraded":"2024-09-10T22:41:07.990876+0000","last_fullsized":"2024-09-10T22:41:07.990876+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:15.842949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234852+0000","last_change":"2024-09-10T22:41:07.006851+0000","last_active":"2024-09-10T22:41:09.234852+0000","last_peered":"2024-09-10T22:41:09.234852+0000","last_clean":"2024-09-10T22:41:09.234852+0000","last_became_active":"2024-09-10T22:41:07.006583+0000","last_became_peered":"2024-09-10T22:41:07.006583+0000","last_unstale":"2024-09-10T22:41:09.234852+0000","last_undegraded":"2024-09-10T22:41:09.234852+0000","last_fullsized":"2024-09-10T22:41:09.234852+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:06.913569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235120+0000","last_change":"2024-09-10T22:41:07.018190+0000","last_active":"2024-09-10T22:41:09.235120+0000","last_peered":"2024-09-10T22:41:09.235120+0000","last_clean":"2024-09-10T22:41:09.235120+0000","last_became_active":"2024-09-10T22:41:07.017937+0000","last_became_peered":"2024-09-10T22:41:07.017937+0000","last_unstale":"2024-09-10T22:41:09.235120+0000","last_undegraded":"2024-09-10T22:41:09.235120+0000","last_fullsized":"2024-09-10T22:41:09.235120+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:58.501910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.997514+0000","last_change":"2024-09-10T22:41:07.010472+0000","last_active":"2024-09-10T22:41:08.997514+0000","last_peered":"2024-09-10T22:41:08.997514+0000","last_clean":"2024-09-10T22:41:08.997514+0000","last_became_active":"2024-09-10T22:41:07.010173+0000","last_became_peered":"2024-09-10T22:41:07.010173+0000","last_unstale":"2024-09-10T22:41:08.997514+0000","last_undegraded":"2024-09-10T22:41:08.997514+0000","last_fullsized":"2024-09-10T22:41:08.997514+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:46.213554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234351+0000","last_change":"2024-09-10T22:41:07.000969+0000","last_active":"2024-09-10T22:41:09.234351+0000","last_peered":"2024-09-10T22:41:09.234351+0000","last_clean":"2024-09-10T22:41:09.234351+0000","last_became_active":"2024-09-10T22:41:07.000706+0000","last_became_peered":"2024-09-10T22:41:07.000706+0000","last_unstale":"2024-09-10T22:41:09.234351+0000","last_undegraded":"2024-09-10T22:41:09.234351+0000","last_fullsized":"2024-09-10T22:41:09.234351+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:25.436865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235600+0000","last_change":"2024-09-10T22:41:06.998131+0000","last_active":"2024-09-10T22:41:09.235600+0000","last_peered":"2024-09-10T22:41:09.235600+0000","last_clean":"2024-09-10T22:41:09.235600+0000","last_became_active":"2024-09-10T22:41:06.997825+0000","last_became_peered":"2024-09-10T22:41:06.997825+0000","last_unstale":"2024-09-10T22:41:09.235600+0000","last_undegraded":"2024-09-10T22:41:09.235600+0000","last_fullsized":"2024-09-10T22:41:09.235600+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:48.068597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234515+0000","last_change":"2024-09-10T22:41:07.015006+0000","last_active":"2024-09-10T22:41:09.234515+0000","last_peered":"2024-09-10T22:41:09.234515+0000","last_clean":"2024-09-10T22:41:09.234515+0000","last_became_active":"2024-09-10T22:41:07.014712+0000","last_became_peered":"2024-09-10T22:41:07.014712+0000","last_unstale":"2024-09-10T22:41:09.234515+0000","last_undegraded":"2024-09-10T22:41:09.234515+0000","last_fullsized":"2024-09-10T22:41:09.234515+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:37.809927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988797+0000","last_change":"2024-09-10T22:41:07.014300+0000","last_active":"2024-09-10T22:41:07.988797+0000","last_peered":"2024-09-10T22:41:07.988797+0000","last_clean":"2024-09-10T22:41:07.988797+0000","last_became_active":"2024-09-10T22:41:07.013875+0000","last_became_peered":"2024-09-10T22:41:07.013875+0000","last_unstale":"2024-09-10T22:41:07.988797+0000","last_undegraded":"2024-09-10T22:41:07.988797+0000","last_fullsized":"2024-09-10T22:41:07.988797+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:23.123417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235355+0000","last_change":"2024-09-10T22:41:06.994043+0000","last_active":"2024-09-10T22:41:09.235355+0000","last_peered":"2024-09-10T22:41:09.235355+0000","last_clean":"2024-09-10T22:41:09.235355+0000","last_became_active":"2024-09-10T22:41:06.993754+0000","last_became_peered":"2024-09-10T22:41:06.993754+0000","last_unstale":"2024-09-10T22:41:09.235355+0000","last_undegraded":"2024-09-10T22:41:09.235355+0000","last_fullsized":"2024-09-10T22:41:09.235355+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:20.933417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234455+0000","last_change":"2024-09-10T22:41:07.015850+0000","last_active":"2024-09-10T22:41:09.234455+0000","last_peered":"2024-09-10T22:41:09.234455+0000","last_clean":"2024-09-10T22:41:09.234455+0000","last_became_active":"2024-09-10T22:41:07.015582+0000","last_became_peered":"2024-09-10T22:41:07.015582+0000","last_unstale":"2024-09-10T22:41:09.234455+0000","last_undegraded":"2024-09-10T22:41:09.234455+0000","last_fullsized":"2024-09-10T22:41:09.234455+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:08.678783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.997633+0000","last_change":"2024-09-10T22:41:07.021525+0000","last_active":"2024-09-10T22:41:08.997633+0000","last_peered":"2024-09-10T22:41:08.997633+0000","last_clean":"2024-09-10T22:41:08.997633+0000","last_became_active":"2024-09-10T22:41:07.021240+0000","last_became_peered":"2024-09-10T22:41:07.021240+0000","last_unstale":"2024-09-10T22:41:08.997633+0000","last_undegraded":"2024-09-10T22:41:08.997633+0000","last_fullsized":"2024-09-10T22:41:08.997633+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:46:39.611980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991192+0000","last_change":"2024-09-10T22:41:07.011414+0000","last_active":"2024-09-10T22:41:07.991192+0000","last_peered":"2024-09-10T22:41:07.991192+0000","last_clean":"2024-09-10T22:41:07.991192+0000","last_became_active":"2024-09-10T22:41:07.011123+0000","last_became_peered":"2024-09-10T22:41:07.011123+0000","last_unstale":"2024-09-10T22:41:07.991192+0000","last_undegraded":"2024-09-10T22:41:07.991192+0000","last_fullsized":"2024-09-10T22:41:07.991192+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:42.747411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234294+0000","last_change":"2024-09-10T22:41:07.015097+0000","last_active":"2024-09-10T22:41:09.234294+0000","last_peered":"2024-09-10T22:41:09.234294+0000","last_clean":"2024-09-10T22:41:09.234294+0000","last_became_active":"2024-09-10T22:41:07.014724+0000","last_became_peered":"2024-09-10T22:41:07.014724+0000","last_unstale":"2024-09-10T22:41:09.234294+0000","last_undegraded":"2024-09-10T22:41:09.234294+0000","last_fullsized":"2024-09-10T22:41:09.234294+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:35.995356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.998352+0000","last_change":"2024-09-10T22:41:07.001750+0000","last_active":"2024-09-10T22:41:08.998352+0000","last_peered":"2024-09-10T22:41:08.998352+0000","last_clean":"2024-09-10T22:41:08.998352+0000","last_became_active":"2024-09-10T22:41:07.001438+0000","last_became_peered":"2024-09-10T22:41:07.001438+0000","last_unstale":"2024-09-10T22:41:08.998352+0000","last_undegraded":"2024-09-10T22:41:08.998352+0000","last_fullsized":"2024-09-10T22:41:08.998352+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:20.933417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991902+0000","last_change":"2024-09-10T22:41:07.019159+0000","last_active":"2024-09-10T22:41:07.991902+0000","last_peered":"2024-09-10T22:41:07.991902+0000","last_clean":"2024-09-10T22:41:07.991902+0000","last_became_active":"2024-09-10T22:41:07.018849+0000","last_became_peered":"2024-09-10T22:41:07.018849+0000","last_unstale":"2024-09-10T22:41:07.991902+0000","last_undegraded":"2024-09-10T22:41:07.991902+0000","last_fullsized":"2024-09-10T22:41:07.991902+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:01.412535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.998116+0000","last_change":"2024-09-10T22:41:07.003836+0000","last_active":"2024-09-10T22:41:08.998116+0000","last_peered":"2024-09-10T22:41:08.998116+0000","last_clean":"2024-09-10T22:41:08.998116+0000","last_became_active":"2024-09-10T22:41:07.002677+0000","last_became_peered":"2024-09-10T22:41:07.002677+0000","last_unstale":"2024-09-10T22:41:08.998116+0000","last_undegraded":"2024-09-10T22:41:08.998116+0000","last_fullsized":"2024-09-10T22:41:08.998116+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:16.556957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442700+0000","last_change":"2024-09-10T22:41:07.004930+0000","last_active":"2024-09-10T22:41:08.442700+0000","last_peered":"2024-09-10T22:41:08.442700+0000","last_clean":"2024-09-10T22:41:08.442700+0000","last_became_active":"2024-09-10T22:41:07.004625+0000","last_became_peered":"2024-09-10T22:41:07.004625+0000","last_unstale":"2024-09-10T22:41:08.442700+0000","last_undegraded":"2024-09-10T22:41:08.442700+0000","last_fullsized":"2024-09-10T22:41:08.442700+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:57.405156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442644+0000","last_change":"2024-09-10T22:41:07.006673+0000","last_active":"2024-09-10T22:41:08.442644+0000","last_peered":"2024-09-10T22:41:08.442644+0000","last_clean":"2024-09-10T22:41:08.442644+0000","last_became_active":"2024-09-10T22:41:07.006370+0000","last_became_peered":"2024-09-10T22:41:07.006370+0000","last_unstale":"2024-09-10T22:41:08.442644+0000","last_undegraded":"2024-09-10T22:41:08.442644+0000","last_fullsized":"2024-09-10T22:41:08.442644+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:23.696110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234700+0000","last_change":"2024-09-10T22:41:07.003450+0000","last_active":"2024-09-10T22:41:09.234700+0000","last_peered":"2024-09-10T22:41:09.234700+0000","last_clean":"2024-09-10T22:41:09.234700+0000","last_became_active":"2024-09-10T22:41:07.003154+0000","last_became_peered":"2024-09-10T22:41:07.003154+0000","last_unstale":"2024-09-10T22:41:09.234700+0000","last_undegraded":"2024-09-10T22:41:09.234700+0000","last_fullsized":"2024-09-10T22:41:09.234700+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:22.018035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988596+0000","last_change":"2024-09-10T22:41:07.033768+0000","last_active":"2024-09-10T22:41:07.988596+0000","last_peered":"2024-09-10T22:41:07.988596+0000","last_clean":"2024-09-10T22:41:07.988596+0000","last_became_active":"2024-09-10T22:41:07.033472+0000","last_became_peered":"2024-09-10T22:41:07.033472+0000","last_unstale":"2024-09-10T22:41:07.988596+0000","last_undegraded":"2024-09-10T22:41:07.988596+0000","last_fullsized":"2024-09-10T22:41:07.988596+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:43:44.233205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.997396+0000","last_change":"2024-09-10T22:41:07.021556+0000","last_active":"2024-09-10T22:41:08.997396+0000","last_peered":"2024-09-10T22:41:08.997396+0000","last_clean":"2024-09-10T22:41:08.997396+0000","last_became_active":"2024-09-10T22:41:07.021228+0000","last_became_peered":"2024-09-10T22:41:07.021228+0000","last_unstale":"2024-09-10T22:41:08.997396+0000","last_undegraded":"2024-09-10T22:41:08.997396+0000","last_fullsized":"2024-09-10T22:41:08.997396+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:56.553718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.998588+0000","last_change":"2024-09-10T22:41:07.012645+0000","last_active":"2024-09-10T22:41:08.998588+0000","last_peered":"2024-09-10T22:41:08.998588+0000","last_clean":"2024-09-10T22:41:08.998588+0000","last_became_active":"2024-09-10T22:41:07.011780+0000","last_became_peered":"2024-09-10T22:41:07.011780+0000","last_unstale":"2024-09-10T22:41:08.998588+0000","last_undegraded":"2024-09-10T22:41:08.998588+0000","last_fullsized":"2024-09-10T22:41:08.998588+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:46.149167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235406+0000","last_change":"2024-09-10T22:41:07.021657+0000","last_active":"2024-09-10T22:41:09.235406+0000","last_peered":"2024-09-10T22:41:09.235406+0000","last_clean":"2024-09-10T22:41:09.235406+0000","last_became_active":"2024-09-10T22:41:07.021005+0000","last_became_peered":"2024-09-10T22:41:07.021005+0000","last_unstale":"2024-09-10T22:41:09.235406+0000","last_undegraded":"2024-09-10T22:41:09.235406+0000","last_fullsized":"2024-09-10T22:41:09.235406+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:31.048486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234562+0000","last_change":"2024-09-10T22:41:07.018391+0000","last_active":"2024-09-10T22:41:09.234562+0000","last_peered":"2024-09-10T22:41:09.234562+0000","last_clean":"2024-09-10T22:41:09.234562+0000","last_became_active":"2024-09-10T22:41:07.017756+0000","last_became_peered":"2024-09-10T22:41:07.017756+0000","last_unstale":"2024-09-10T22:41:09.234562+0000","last_undegraded":"2024-09-10T22:41:09.234562+0000","last_fullsized":"2024-09-10T22:41:09.234562+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:39.637740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442852+0000","last_change":"2024-09-10T22:41:07.021311+0000","last_active":"2024-09-10T22:41:08.442852+0000","last_peered":"2024-09-10T22:41:08.442852+0000","last_clean":"2024-09-10T22:41:08.442852+0000","last_became_active":"2024-09-10T22:41:07.017967+0000","last_became_peered":"2024-09-10T22:41:07.017967+0000","last_unstale":"2024-09-10T22:41:08.442852+0000","last_undegraded":"2024-09-10T22:41:08.442852+0000","last_fullsized":"2024-09-10T22:41:08.442852+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:36.893264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.997680+0000","last_change":"2024-09-10T22:41:06.999101+0000","last_active":"2024-09-10T22:41:08.997680+0000","last_peered":"2024-09-10T22:41:08.997680+0000","last_clean":"2024-09-10T22:41:08.997680+0000","last_became_active":"2024-09-10T22:41:06.998842+0000","last_became_peered":"2024-09-10T22:41:06.998842+0000","last_unstale":"2024-09-10T22:41:08.997680+0000","last_undegraded":"2024-09-10T22:41:08.997680+0000","last_fullsized":"2024-09-10T22:41:08.997680+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:44.127556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990989+0000","last_change":"2024-09-10T22:41:07.017658+0000","last_active":"2024-09-10T22:41:07.990989+0000","last_peered":"2024-09-10T22:41:07.990989+0000","last_clean":"2024-09-10T22:41:07.990989+0000","last_became_active":"2024-09-10T22:41:07.017345+0000","last_became_peered":"2024-09-10T22:41:07.017345+0000","last_unstale":"2024-09-10T22:41:07.990989+0000","last_undegraded":"2024-09-10T22:41:07.990989+0000","last_fullsized":"2024-09-10T22:41:07.990989+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:51.381851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.997598+0000","last_change":"2024-09-10T22:41:07.010437+0000","last_active":"2024-09-10T22:41:08.997598+0000","last_peered":"2024-09-10T22:41:08.997598+0000","last_clean":"2024-09-10T22:41:08.997598+0000","last_became_active":"2024-09-10T22:41:07.009860+0000","last_became_peered":"2024-09-10T22:41:07.009860+0000","last_unstale":"2024-09-10T22:41:08.997598+0000","last_undegraded":"2024-09-10T22:41:08.997598+0000","last_fullsized":"2024-09-10T22:41:08.997598+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:25.436865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990379+0000","last_change":"2024-09-10T22:41:07.006639+0000","last_active":"2024-09-10T22:41:07.990379+0000","last_peered":"2024-09-10T22:41:07.990379+0000","last_clean":"2024-09-10T22:41:07.990379+0000","last_became_active":"2024-09-10T22:41:07.006355+0000","last_became_peered":"2024-09-10T22:41:07.006355+0000","last_unstale":"2024-09-10T22:41:07.990379+0000","last_undegraded":"2024-09-10T22:41:07.990379+0000","last_fullsized":"2024-09-10T22:41:07.990379+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:19.478124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990346+0000","last_change":"2024-09-10T22:41:07.001696+0000","last_active":"2024-09-10T22:41:07.990346+0000","last_peered":"2024-09-10T22:41:07.990346+0000","last_clean":"2024-09-10T22:41:07.990346+0000","last_became_active":"2024-09-10T22:41:07.001303+0000","last_became_peered":"2024-09-10T22:41:07.001303+0000","last_unstale":"2024-09-10T22:41:07.990346+0000","last_undegraded":"2024-09-10T22:41:07.990346+0000","last_fullsized":"2024-09-10T22:41:07.990346+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:41.157921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"54'4","reported_seq":19,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442528+0000","last_change":"2024-09-10T22:41:06.002183+0000","last_active":"2024-09-10T22:41:08.442528+0000","last_peered":"2024-09-10T22:41:08.442528+0000","last_clean":"2024-09-10T22:41:08.442528+0000","last_became_active":"2024-09-10T22:41:06.001895+0000","last_became_peered":"2024-09-10T22:41:06.001895+0000","last_unstale":"2024-09-10T22:41:08.442528+0000","last_undegraded":"2024-09-10T22:41:08.442528+0000","last_fullsized":"2024-09-10T22:41:08.442528+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:27.972852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991108+0000","last_change":"2024-09-10T22:41:07.003184+0000","last_active":"2024-09-10T22:41:07.991108+0000","last_peered":"2024-09-10T22:41:07.991108+0000","last_clean":"2024-09-10T22:41:07.991108+0000","last_became_active":"2024-09-10T22:41:07.002900+0000","last_became_peered":"2024-09-10T22:41:07.002900+0000","last_unstale":"2024-09-10T22:41:07.991108+0000","last_undegraded":"2024-09-10T22:41:07.991108+0000","last_fullsized":"2024-09-10T22:41:07.991108+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.301734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"54'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234583+0000","last_change":"2024-09-10T22:41:06.010884+0000","last_active":"2024-09-10T22:41:09.234583+0000","last_peered":"2024-09-10T22:41:09.234583+0000","last_clean":"2024-09-10T22:41:09.234583+0000","last_became_active":"2024-09-10T22:41:06.010619+0000","last_became_peered":"2024-09-10T22:41:06.010619+0000","last_unstale":"2024-09-10T22:41:09.234583+0000","last_undegraded":"2024-09-10T22:41:09.234583+0000","last_fullsized":"2024-09-10T22:41:09.234583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:37.296445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442743+0000","last_change":"2024-09-10T22:41:07.006193+0000","last_active":"2024-09-10T22:41:08.442743+0000","last_peered":"2024-09-10T22:41:08.442743+0000","last_clean":"2024-09-10T22:41:08.442743+0000","last_became_active":"2024-09-10T22:41:07.005918+0000","last_became_peered":"2024-09-10T22:41:07.005918+0000","last_unstale":"2024-09-10T22:41:08.442743+0000","last_undegraded":"2024-09-10T22:41:08.442743+0000","last_fullsized":"2024-09-10T22:41:08.442743+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:57.920678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234620+0000","last_change":"2024-09-10T22:41:06.011552+0000","last_active":"2024-09-10T22:41:09.234620+0000","last_peered":"2024-09-10T22:41:09.234620+0000","last_clean":"2024-09-10T22:41:09.234620+0000","last_became_active":"2024-09-10T22:41:06.011220+0000","last_became_peered":"2024-09-10T22:41:06.011220+0000","last_unstale":"2024-09-10T22:41:09.234620+0000","last_undegraded":"2024-09-10T22:41:09.234620+0000","last_fullsized":"2024-09-10T22:41:09.234620+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:32.955172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234706+0000","last_change":"2024-09-10T22:41:07.019698+0000","last_active":"2024-09-10T22:41:09.234706+0000","last_peered":"2024-09-10T22:41:09.234706+0000","last_clean":"2024-09-10T22:41:09.234706+0000","last_became_active":"2024-09-10T22:41:07.019353+0000","last_became_peered":"2024-09-10T22:41:07.019353+0000","last_unstale":"2024-09-10T22:41:09.234706+0000","last_undegraded":"2024-09-10T22:41:09.234706+0000","last_fullsized":"2024-09-10T22:41:09.234706+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:53.755432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991030+0000","last_change":"2024-09-10T22:41:05.997081+0000","last_active":"2024-09-10T22:41:07.991030+0000","last_peered":"2024-09-10T22:41:07.991030+0000","last_clean":"2024-09-10T22:41:07.991030+0000","last_became_active":"2024-09-10T22:41:05.996813+0000","last_became_peered":"2024-09-10T22:41:05.996813+0000","last_unstale":"2024-09-10T22:41:07.991030+0000","last_undegraded":"2024-09-10T22:41:07.991030+0000","last_fullsized":"2024-09-10T22:41:07.991030+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:35.883087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234996+0000","last_change":"2024-09-10T22:41:07.012392+0000","last_active":"2024-09-10T22:41:09.234996+0000","last_peered":"2024-09-10T22:41:09.234996+0000","last_clean":"2024-09-10T22:41:09.234996+0000","last_became_active":"2024-09-10T22:41:07.012159+0000","last_became_peered":"2024-09-10T22:41:07.012159+0000","last_unstale":"2024-09-10T22:41:09.234996+0000","last_undegraded":"2024-09-10T22:41:09.234996+0000","last_fullsized":"2024-09-10T22:41:09.234996+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:34.909935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"54'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.997674+0000","last_change":"2024-09-10T22:41:06.013192+0000","last_active":"2024-09-10T22:41:08.997674+0000","last_peered":"2024-09-10T22:41:08.997674+0000","last_clean":"2024-09-10T22:41:08.997674+0000","last_became_active":"2024-09-10T22:41:06.012907+0000","last_became_peered":"2024-09-10T22:41:06.012907+0000","last_unstale":"2024-09-10T22:41:08.997674+0000","last_undegraded":"2024-09-10T22:41:08.997674+0000","last_fullsized":"2024-09-10T22:41:08.997674+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:22.685932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991457+0000","last_change":"2024-09-10T22:41:07.017658+0000","last_active":"2024-09-10T22:41:07.991457+0000","last_peered":"2024-09-10T22:41:07.991457+0000","last_clean":"2024-09-10T22:41:07.991457+0000","last_became_active":"2024-09-10T22:41:07.017429+0000","last_became_peered":"2024-09-10T22:41:07.017429+0000","last_unstale":"2024-09-10T22:41:07.991457+0000","last_undegraded":"2024-09-10T22:41:07.991457+0000","last_fullsized":"2024-09-10T22:41:07.991457+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:48.871383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"54'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234553+0000","last_change":"2024-09-10T22:41:06.005980+0000","last_active":"2024-09-10T22:41:09.234553+0000","last_peered":"2024-09-10T22:41:09.234553+0000","last_clean":"2024-09-10T22:41:09.234553+0000","last_became_active":"2024-09-10T22:41:06.005716+0000","last_became_peered":"2024-09-10T22:41:06.005716+0000","last_unstale":"2024-09-10T22:41:09.234553+0000","last_undegraded":"2024-09-10T22:41:09.234553+0000","last_fullsized":"2024-09-10T22:41:09.234553+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:46.600179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235601+0000","last_change":"2024-09-10T22:41:07.021354+0000","last_active":"2024-09-10T22:41:09.235601+0000","last_peered":"2024-09-10T22:41:09.235601+0000","last_clean":"2024-09-10T22:41:09.235601+0000","last_became_active":"2024-09-10T22:41:07.020585+0000","last_became_peered":"2024-09-10T22:41:07.020585+0000","last_unstale":"2024-09-10T22:41:09.235601+0000","last_undegraded":"2024-09-10T22:41:09.235601+0000","last_fullsized":"2024-09-10T22:41:09.235601+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:46.149167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442343+0000","last_change":"2024-09-10T22:41:05.995026+0000","last_active":"2024-09-10T22:41:08.442343+0000","last_peered":"2024-09-10T22:41:08.442343+0000","last_clean":"2024-09-10T22:41:08.442343+0000","last_became_active":"2024-09-10T22:41:05.994459+0000","last_became_peered":"2024-09-10T22:41:05.994459+0000","last_unstale":"2024-09-10T22:41:08.442343+0000","last_undegraded":"2024-09-10T22:41:08.442343+0000","last_fullsized":"2024-09-10T22:41:08.442343+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:24.208151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991919+0000","last_change":"2024-09-10T22:41:07.031675+0000","last_active":"2024-09-10T22:41:07.991919+0000","last_peered":"2024-09-10T22:41:07.991919+0000","last_clean":"2024-09-10T22:41:07.991919+0000","last_became_active":"2024-09-10T22:41:07.031451+0000","last_became_peered":"2024-09-10T22:41:07.031451+0000","last_unstale":"2024-09-10T22:41:07.991919+0000","last_undegraded":"2024-09-10T22:41:07.991919+0000","last_fullsized":"2024-09-10T22:41:07.991919+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:31:18.659448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.997404+0000","last_change":"2024-09-10T22:41:06.000385+0000","last_active":"2024-09-10T22:41:08.997404+0000","last_peered":"2024-09-10T22:41:08.997404+0000","last_clean":"2024-09-10T22:41:08.997404+0000","last_became_active":"2024-09-10T22:41:06.000130+0000","last_became_peered":"2024-09-10T22:41:06.000130+0000","last_unstale":"2024-09-10T22:41:08.997404+0000","last_undegraded":"2024-09-10T22:41:08.997404+0000","last_fullsized":"2024-09-10T22:41:08.997404+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:12.373720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234588+0000","last_change":"2024-09-10T22:41:07.012034+0000","last_active":"2024-09-10T22:41:09.234588+0000","last_peered":"2024-09-10T22:41:09.234588+0000","last_clean":"2024-09-10T22:41:09.234588+0000","last_became_active":"2024-09-10T22:41:07.008587+0000","last_became_peered":"2024-09-10T22:41:07.008587+0000","last_unstale":"2024-09-10T22:41:09.234588+0000","last_undegraded":"2024-09-10T22:41:09.234588+0000","last_fullsized":"2024-09-10T22:41:09.234588+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:27:34.068540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.992010+0000","last_change":"2024-09-10T22:41:06.008557+0000","last_active":"2024-09-10T22:41:07.992010+0000","last_peered":"2024-09-10T22:41:07.992010+0000","last_clean":"2024-09-10T22:41:07.992010+0000","last_became_active":"2024-09-10T22:41:06.008253+0000","last_became_peered":"2024-09-10T22:41:06.008253+0000","last_unstale":"2024-09-10T22:41:07.992010+0000","last_undegraded":"2024-09-10T22:41:07.992010+0000","last_fullsized":"2024-09-10T22:41:07.992010+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:56.394978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990584+0000","last_change":"2024-09-10T22:41:06.999332+0000","last_active":"2024-09-10T22:41:07.990584+0000","last_peered":"2024-09-10T22:41:07.990584+0000","last_clean":"2024-09-10T22:41:07.990584+0000","last_became_active":"2024-09-10T22:41:06.998916+0000","last_became_peered":"2024-09-10T22:41:06.998916+0000","last_unstale":"2024-09-10T22:41:07.990584+0000","last_undegraded":"2024-09-10T22:41:07.990584+0000","last_fullsized":"2024-09-10T22:41:07.990584+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:43.688712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234991+0000","last_change":"2024-09-10T22:41:06.006905+0000","last_active":"2024-09-10T22:41:09.234991+0000","last_peered":"2024-09-10T22:41:09.234991+0000","last_clean":"2024-09-10T22:41:09.234991+0000","last_became_active":"2024-09-10T22:41:06.006582+0000","last_became_peered":"2024-09-10T22:41:06.006582+0000","last_unstale":"2024-09-10T22:41:09.234991+0000","last_undegraded":"2024-09-10T22:41:09.234991+0000","last_fullsized":"2024-09-10T22:41:09.234991+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:45.947252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.997754+0000","last_change":"2024-09-10T22:41:07.002342+0000","last_active":"2024-09-10T22:41:08.997754+0000","last_peered":"2024-09-10T22:41:08.997754+0000","last_clean":"2024-09-10T22:41:08.997754+0000","last_became_active":"2024-09-10T22:41:07.002066+0000","last_became_peered":"2024-09-10T22:41:07.002066+0000","last_unstale":"2024-09-10T22:41:08.997754+0000","last_undegraded":"2024-09-10T22:41:08.997754+0000","last_fullsized":"2024-09-10T22:41:08.997754+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:42.102594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"54'3","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991349+0000","last_change":"2024-09-10T22:41:06.008984+0000","last_active":"2024-09-10T22:41:07.991349+0000","last_peered":"2024-09-10T22:41:07.991349+0000","last_clean":"2024-09-10T22:41:07.991349+0000","last_became_active":"2024-09-10T22:41:06.008191+0000","last_became_peered":"2024-09-10T22:41:06.008191+0000","last_unstale":"2024-09-10T22:41:07.991349+0000","last_undegraded":"2024-09-10T22:41:07.991349+0000","last_fullsized":"2024-09-10T22:41:07.991349+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:03.893470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234936+0000","last_change":"2024-09-10T22:41:07.015038+0000","last_active":"2024-09-10T22:41:09.234936+0000","last_peered":"2024-09-10T22:41:09.234936+0000","last_clean":"2024-09-10T22:41:09.234936+0000","last_became_active":"2024-09-10T22:41:07.014790+0000","last_became_peered":"2024-09-10T22:41:07.014790+0000","last_unstale":"2024-09-10T22:41:09.234936+0000","last_undegraded":"2024-09-10T22:41:09.234936+0000","last_fullsized":"2024-09-10T22:41:09.234936+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:44.327503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"54'6","reported_seq":21,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235351+0000","last_change":"2024-09-10T22:41:05.997554+0000","last_active":"2024-09-10T22:41:09.235351+0000","last_peered":"2024-09-10T22:41:09.235351+0000","last_clean":"2024-09-10T22:41:09.235351+0000","last_became_active":"2024-09-10T22:41:05.997207+0000","last_became_peered":"2024-09-10T22:41:05.997207+0000","last_unstale":"2024-09-10T22:41:09.235351+0000","last_undegraded":"2024-09-10T22:41:09.235351+0000","last_fullsized":"2024-09-10T22:41:09.235351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:53.069745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990781+0000","last_change":"2024-09-10T22:41:07.009874+0000","last_active":"2024-09-10T22:41:07.990781+0000","last_peered":"2024-09-10T22:41:07.990781+0000","last_clean":"2024-09-10T22:41:07.990781+0000","last_became_active":"2024-09-10T22:41:07.009570+0000","last_became_peered":"2024-09-10T22:41:07.009570+0000","last_unstale":"2024-09-10T22:41:07.990781+0000","last_undegraded":"2024-09-10T22:41:07.990781+0000","last_fullsized":"2024-09-10T22:41:07.990781+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:41:27.226599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.997916+0000","last_change":"2024-09-10T22:41:06.006329+0000","last_active":"2024-09-10T22:41:08.997916+0000","last_peered":"2024-09-10T22:41:08.997916+0000","last_clean":"2024-09-10T22:41:08.997916+0000","last_became_active":"2024-09-10T22:41:06.006076+0000","last_became_peered":"2024-09-10T22:41:06.006076+0000","last_unstale":"2024-09-10T22:41:08.997916+0000","last_undegraded":"2024-09-10T22:41:08.997916+0000","last_fullsized":"2024-09-10T22:41:08.997916+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:03.893470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.998340+0000","last_change":"2024-09-10T22:41:07.015684+0000","last_active":"2024-09-10T22:41:08.998340+0000","last_peered":"2024-09-10T22:41:08.998340+0000","last_clean":"2024-09-10T22:41:08.998340+0000","last_became_active":"2024-09-10T22:41:07.015425+0000","last_became_peered":"2024-09-10T22:41:07.015425+0000","last_unstale":"2024-09-10T22:41:08.998340+0000","last_undegraded":"2024-09-10T22:41:08.998340+0000","last_fullsized":"2024-09-10T22:41:08.998340+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:26.488734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442629+0000","last_change":"2024-09-10T22:41:05.996246+0000","last_active":"2024-09-10T22:41:08.442629+0000","last_peered":"2024-09-10T22:41:08.442629+0000","last_clean":"2024-09-10T22:41:08.442629+0000","last_became_active":"2024-09-10T22:41:05.995968+0000","last_became_peered":"2024-09-10T22:41:05.995968+0000","last_unstale":"2024-09-10T22:41:08.442629+0000","last_undegraded":"2024-09-10T22:41:08.442629+0000","last_fullsized":"2024-09-10T22:41:08.442629+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:11.662901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235446+0000","last_change":"2024-09-10T22:41:07.012291+0000","last_active":"2024-09-10T22:41:09.235446+0000","last_peered":"2024-09-10T22:41:09.235446+0000","last_clean":"2024-09-10T22:41:09.235446+0000","last_became_active":"2024-09-10T22:41:07.012006+0000","last_became_peered":"2024-09-10T22:41:07.012006+0000","last_unstale":"2024-09-10T22:41:09.235446+0000","last_undegraded":"2024-09-10T22:41:09.235446+0000","last_fullsized":"2024-09-10T22:41:09.235446+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:51.272658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991300+0000","last_change":"2024-09-10T22:41:06.009142+0000","last_active":"2024-09-10T22:41:07.991300+0000","last_peered":"2024-09-10T22:41:07.991300+0000","last_clean":"2024-09-10T22:41:07.991300+0000","last_became_active":"2024-09-10T22:41:06.008215+0000","last_became_peered":"2024-09-10T22:41:06.008215+0000","last_unstale":"2024-09-10T22:41:07.991300+0000","last_undegraded":"2024-09-10T22:41:07.991300+0000","last_fullsized":"2024-09-10T22:41:07.991300+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:25.802794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.998294+0000","last_change":"2024-09-10T22:41:07.001776+0000","last_active":"2024-09-10T22:41:08.998294+0000","last_peered":"2024-09-10T22:41:08.998294+0000","last_clean":"2024-09-10T22:41:08.998294+0000","last_became_active":"2024-09-10T22:41:07.001504+0000","last_became_peered":"2024-09-10T22:41:07.001504+0000","last_unstale":"2024-09-10T22:41:08.998294+0000","last_undegraded":"2024-09-10T22:41:08.998294+0000","last_fullsized":"2024-09-10T22:41:08.998294+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:30.018346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"54'8","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234694+0000","last_change":"2024-09-10T22:41:05.998248+0000","last_active":"2024-09-10T22:41:09.234694+0000","last_peered":"2024-09-10T22:41:09.234694+0000","last_clean":"2024-09-10T22:41:09.234694+0000","last_became_active":"2024-09-10T22:41:05.997978+0000","last_became_peered":"2024-09-10T22:41:05.997978+0000","last_unstale":"2024-09-10T22:41:09.234694+0000","last_undegraded":"2024-09-10T22:41:09.234694+0000","last_fullsized":"2024-09-10T22:41:09.234694+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:42.960083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234551+0000","last_change":"2024-09-10T22:41:07.005382+0000","last_active":"2024-09-10T22:41:09.234551+0000","last_peered":"2024-09-10T22:41:09.234551+0000","last_clean":"2024-09-10T22:41:09.234551+0000","last_became_active":"2024-09-10T22:41:07.004169+0000","last_became_peered":"2024-09-10T22:41:07.004169+0000","last_unstale":"2024-09-10T22:41:09.234551+0000","last_undegraded":"2024-09-10T22:41:09.234551+0000","last_fullsized":"2024-09-10T22:41:09.234551+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:43.884770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"54'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.998553+0000","last_change":"2024-09-10T22:41:05.997356+0000","last_active":"2024-09-10T22:41:08.998553+0000","last_peered":"2024-09-10T22:41:08.998553+0000","last_clean":"2024-09-10T22:41:08.998553+0000","last_became_active":"2024-09-10T22:41:05.997087+0000","last_became_peered":"2024-09-10T22:41:05.997087+0000","last_unstale":"2024-09-10T22:41:08.998553+0000","last_undegraded":"2024-09-10T22:41:08.998553+0000","last_fullsized":"2024-09-10T22:41:08.998553+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:56.394978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234317+0000","last_change":"2024-09-10T22:41:07.030952+0000","last_active":"2024-09-10T22:41:09.234317+0000","last_peered":"2024-09-10T22:41:09.234317+0000","last_clean":"2024-09-10T22:41:09.234317+0000","last_became_active":"2024-09-10T22:41:07.030660+0000","last_became_peered":"2024-09-10T22:41:07.030660+0000","last_unstale":"2024-09-10T22:41:09.234317+0000","last_undegraded":"2024-09-10T22:41:09.234317+0000","last_fullsized":"2024-09-10T22:41:09.234317+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:46:17.184864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988949+0000","last_change":"2024-09-10T22:41:06.005480+0000","last_active":"2024-09-10T22:41:07.988949+0000","last_peered":"2024-09-10T22:41:07.988949+0000","last_clean":"2024-09-10T22:41:07.988949+0000","last_became_active":"2024-09-10T22:41:06.005212+0000","last_became_peered":"2024-09-10T22:41:06.005212+0000","last_unstale":"2024-09-10T22:41:07.988949+0000","last_undegraded":"2024-09-10T22:41:07.988949+0000","last_fullsized":"2024-09-10T22:41:07.988949+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:05.166519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234569+0000","last_change":"2024-09-10T22:41:07.013980+0000","last_active":"2024-09-10T22:41:09.234569+0000","last_peered":"2024-09-10T22:41:09.234569+0000","last_clean":"2024-09-10T22:41:09.234569+0000","last_became_active":"2024-09-10T22:41:07.013700+0000","last_became_peered":"2024-09-10T22:41:07.013700+0000","last_unstale":"2024-09-10T22:41:09.234569+0000","last_undegraded":"2024-09-10T22:41:09.234569+0000","last_fullsized":"2024-09-10T22:41:09.234569+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:49.465463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"54'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442896+0000","last_change":"2024-09-10T22:41:06.005503+0000","last_active":"2024-09-10T22:41:08.442896+0000","last_peered":"2024-09-10T22:41:08.442896+0000","last_clean":"2024-09-10T22:41:08.442896+0000","last_became_active":"2024-09-10T22:41:06.005205+0000","last_became_peered":"2024-09-10T22:41:06.005205+0000","last_unstale":"2024-09-10T22:41:08.442896+0000","last_undegraded":"2024-09-10T22:41:08.442896+0000","last_fullsized":"2024-09-10T22:41:08.442896+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:03.751309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235132+0000","last_change":"2024-09-10T22:41:07.009702+0000","last_active":"2024-09-10T22:41:09.235132+0000","last_peered":"2024-09-10T22:41:09.235132+0000","last_clean":"2024-09-10T22:41:09.235132+0000","last_became_active":"2024-09-10T22:41:07.009422+0000","last_became_peered":"2024-09-10T22:41:07.009422+0000","last_unstale":"2024-09-10T22:41:09.235132+0000","last_undegraded":"2024-09-10T22:41:09.235132+0000","last_fullsized":"2024-09-10T22:41:09.235132+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:48.766775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442830+0000","last_change":"2024-09-10T22:41:05.990766+0000","last_active":"2024-09-10T22:41:08.442830+0000","last_peered":"2024-09-10T22:41:08.442830+0000","last_clean":"2024-09-10T22:41:08.442830+0000","last_became_active":"2024-09-10T22:41:05.990495+0000","last_became_peered":"2024-09-10T22:41:05.990495+0000","last_unstale":"2024-09-10T22:41:08.442830+0000","last_undegraded":"2024-09-10T22:41:08.442830+0000","last_fullsized":"2024-09-10T22:41:08.442830+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:56.811450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991002+0000","last_change":"2024-09-10T22:41:07.004711+0000","last_active":"2024-09-10T22:41:07.991002+0000","last_peered":"2024-09-10T22:41:07.991002+0000","last_clean":"2024-09-10T22:41:07.991002+0000","last_became_active":"2024-09-10T22:41:07.004451+0000","last_became_peered":"2024-09-10T22:41:07.004451+0000","last_unstale":"2024-09-10T22:41:07.991002+0000","last_undegraded":"2024-09-10T22:41:07.991002+0000","last_fullsized":"2024-09-10T22:41:07.991002+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:25.632741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234629+0000","last_change":"2024-09-10T22:41:06.011467+0000","last_active":"2024-09-10T22:41:09.234629+0000","last_peered":"2024-09-10T22:41:09.234629+0000","last_clean":"2024-09-10T22:41:09.234629+0000","last_became_active":"2024-09-10T22:41:06.011088+0000","last_became_peered":"2024-09-10T22:41:06.011088+0000","last_unstale":"2024-09-10T22:41:09.234629+0000","last_undegraded":"2024-09-10T22:41:09.234629+0000","last_fullsized":"2024-09-10T22:41:09.234629+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:56.185721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442845+0000","last_change":"2024-09-10T22:41:07.005871+0000","last_active":"2024-09-10T22:41:08.442845+0000","last_peered":"2024-09-10T22:41:08.442845+0000","last_clean":"2024-09-10T22:41:08.442845+0000","last_became_active":"2024-09-10T22:41:07.005588+0000","last_became_peered":"2024-09-10T22:41:07.005588+0000","last_unstale":"2024-09-10T22:41:08.442845+0000","last_undegraded":"2024-09-10T22:41:08.442845+0000","last_fullsized":"2024-09-10T22:41:08.442845+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:42.463673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234848+0000","last_change":"2024-09-10T22:41:06.000828+0000","last_active":"2024-09-10T22:41:09.234848+0000","last_peered":"2024-09-10T22:41:09.234848+0000","last_clean":"2024-09-10T22:41:09.234848+0000","last_became_active":"2024-09-10T22:41:05.998637+0000","last_became_peered":"2024-09-10T22:41:05.998637+0000","last_unstale":"2024-09-10T22:41:09.234848+0000","last_undegraded":"2024-09-10T22:41:09.234848+0000","last_fullsized":"2024-09-10T22:41:09.234848+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:32.301219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.998320+0000","last_change":"2024-09-10T22:41:07.008864+0000","last_active":"2024-09-10T22:41:08.998320+0000","last_peered":"2024-09-10T22:41:08.998320+0000","last_clean":"2024-09-10T22:41:08.998320+0000","last_became_active":"2024-09-10T22:41:07.002835+0000","last_became_peered":"2024-09-10T22:41:07.002835+0000","last_unstale":"2024-09-10T22:41:08.998320+0000","last_undegraded":"2024-09-10T22:41:08.998320+0000","last_fullsized":"2024-09-10T22:41:08.998320+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:33.370595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.997708+0000","last_change":"2024-09-10T22:41:06.005138+0000","last_active":"2024-09-10T22:41:08.997708+0000","last_peered":"2024-09-10T22:41:08.997708+0000","last_clean":"2024-09-10T22:41:08.997708+0000","last_became_active":"2024-09-10T22:41:06.004886+0000","last_became_peered":"2024-09-10T22:41:06.004886+0000","last_unstale":"2024-09-10T22:41:08.997708+0000","last_undegraded":"2024-09-10T22:41:08.997708+0000","last_fullsized":"2024-09-10T22:41:08.997708+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:25.802794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235059+0000","last_change":"2024-09-10T22:41:07.016437+0000","last_active":"2024-09-10T22:41:09.235059+0000","last_peered":"2024-09-10T22:41:09.235059+0000","last_clean":"2024-09-10T22:41:09.235059+0000","last_became_active":"2024-09-10T22:41:07.016216+0000","last_became_peered":"2024-09-10T22:41:07.016216+0000","last_unstale":"2024-09-10T22:41:09.235059+0000","last_undegraded":"2024-09-10T22:41:09.235059+0000","last_fullsized":"2024-09-10T22:41:09.235059+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:43.759788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.988463+0000","last_change":"2024-09-10T22:41:06.008205+0000","last_active":"2024-09-10T22:41:07.988463+0000","last_peered":"2024-09-10T22:41:07.988463+0000","last_clean":"2024-09-10T22:41:07.988463+0000","last_became_active":"2024-09-10T22:41:06.006600+0000","last_became_peered":"2024-09-10T22:41:06.006600+0000","last_unstale":"2024-09-10T22:41:07.988463+0000","last_undegraded":"2024-09-10T22:41:07.988463+0000","last_fullsized":"2024-09-10T22:41:07.988463+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:57.966564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990322+0000","last_change":"2024-09-10T22:41:07.007272+0000","last_active":"2024-09-10T22:41:07.990322+0000","last_peered":"2024-09-10T22:41:07.990322+0000","last_clean":"2024-09-10T22:41:07.990322+0000","last_became_active":"2024-09-10T22:41:07.006909+0000","last_became_peered":"2024-09-10T22:41:07.006909+0000","last_unstale":"2024-09-10T22:41:07.990322+0000","last_undegraded":"2024-09-10T22:41:07.990322+0000","last_fullsized":"2024-09-10T22:41:07.990322+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:59.336126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"54'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442684+0000","last_change":"2024-09-10T22:41:05.999502+0000","last_active":"2024-09-10T22:41:08.442684+0000","last_peered":"2024-09-10T22:41:08.442684+0000","last_clean":"2024-09-10T22:41:08.442684+0000","last_became_active":"2024-09-10T22:41:05.999171+0000","last_became_peered":"2024-09-10T22:41:05.999171+0000","last_unstale":"2024-09-10T22:41:08.442684+0000","last_undegraded":"2024-09-10T22:41:08.442684+0000","last_fullsized":"2024-09-10T22:41:08.442684+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:11.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235231+0000","last_change":"2024-09-10T22:41:07.028930+0000","last_active":"2024-09-10T22:41:09.235231+0000","last_peered":"2024-09-10T22:41:09.235231+0000","last_clean":"2024-09-10T22:41:09.235231+0000","last_became_active":"2024-09-10T22:41:07.028710+0000","last_became_peered":"2024-09-10T22:41:07.028710+0000","last_unstale":"2024-09-10T22:41:09.235231+0000","last_undegraded":"2024-09-10T22:41:09.235231+0000","last_fullsized":"2024-09-10T22:41:09.235231+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:29.579930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991455+0000","last_change":"2024-09-10T22:41:06.010369+0000","last_active":"2024-09-10T22:41:07.991455+0000","last_peered":"2024-09-10T22:41:07.991455+0000","last_clean":"2024-09-10T22:41:07.991455+0000","last_became_active":"2024-09-10T22:41:06.010182+0000","last_became_peered":"2024-09-10T22:41:06.010182+0000","last_unstale":"2024-09-10T22:41:07.991455+0000","last_undegraded":"2024-09-10T22:41:07.991455+0000","last_fullsized":"2024-09-10T22:41:07.991455+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:22.685932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234819+0000","last_change":"2024-09-10T22:41:07.000440+0000","last_active":"2024-09-10T22:41:09.234819+0000","last_peered":"2024-09-10T22:41:09.234819+0000","last_clean":"2024-09-10T22:41:09.234819+0000","last_became_active":"2024-09-10T22:41:06.999910+0000","last_became_peered":"2024-09-10T22:41:06.999910+0000","last_unstale":"2024-09-10T22:41:09.234819+0000","last_undegraded":"2024-09-10T22:41:09.234819+0000","last_fullsized":"2024-09-10T22:41:09.234819+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:47.119250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.997813+0000","last_change":"2024-09-10T22:41:06.009093+0000","last_active":"2024-09-10T22:41:08.997813+0000","last_peered":"2024-09-10T22:41:08.997813+0000","last_clean":"2024-09-10T22:41:08.997813+0000","last_became_active":"2024-09-10T22:41:06.008811+0000","last_became_peered":"2024-09-10T22:41:06.008811+0000","last_unstale":"2024-09-10T22:41:08.997813+0000","last_undegraded":"2024-09-10T22:41:08.997813+0000","last_fullsized":"2024-09-10T22:41:08.997813+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:54.497387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.997902+0000","last_change":"2024-09-10T22:41:07.011776+0000","last_active":"2024-09-10T22:41:08.997902+0000","last_peered":"2024-09-10T22:41:08.997902+0000","last_clean":"2024-09-10T22:41:08.997902+0000","last_became_active":"2024-09-10T22:41:07.011500+0000","last_became_peered":"2024-09-10T22:41:07.011500+0000","last_unstale":"2024-09-10T22:41:08.997902+0000","last_undegraded":"2024-09-10T22:41:08.997902+0000","last_fullsized":"2024-09-10T22:41:08.997902+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:35:43.884770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235062+0000","last_change":"2024-09-10T22:41:05.998931+0000","last_active":"2024-09-10T22:41:09.235062+0000","last_peered":"2024-09-10T22:41:09.235062+0000","last_clean":"2024-09-10T22:41:09.235062+0000","last_became_active":"2024-09-10T22:41:05.997587+0000","last_became_peered":"2024-09-10T22:41:05.997587+0000","last_unstale":"2024-09-10T22:41:09.235062+0000","last_undegraded":"2024-09-10T22:41:09.235062+0000","last_fullsized":"2024-09-10T22:41:09.235062+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:20.896548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990817+0000","last_change":"2024-09-10T22:41:07.009487+0000","last_active":"2024-09-10T22:41:07.990817+0000","last_peered":"2024-09-10T22:41:07.990817+0000","last_clean":"2024-09-10T22:41:07.990817+0000","last_became_active":"2024-09-10T22:41:07.009104+0000","last_became_peered":"2024-09-10T22:41:07.009104+0000","last_unstale":"2024-09-10T22:41:07.990817+0000","last_undegraded":"2024-09-10T22:41:07.990817+0000","last_fullsized":"2024-09-10T22:41:07.990817+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:47.347113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234937+0000","last_change":"2024-09-10T22:41:06.006577+0000","last_active":"2024-09-10T22:41:09.234937+0000","last_peered":"2024-09-10T22:41:09.234937+0000","last_clean":"2024-09-10T22:41:09.234937+0000","last_became_active":"2024-09-10T22:41:06.006219+0000","last_became_peered":"2024-09-10T22:41:06.006219+0000","last_unstale":"2024-09-10T22:41:09.234937+0000","last_undegraded":"2024-09-10T22:41:09.234937+0000","last_fullsized":"2024-09-10T22:41:09.234937+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:47.703955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.998183+0000","last_change":"2024-09-10T22:41:07.013569+0000","last_active":"2024-09-10T22:41:08.998183+0000","last_peered":"2024-09-10T22:41:08.998183+0000","last_clean":"2024-09-10T22:41:08.998183+0000","last_became_active":"2024-09-10T22:41:07.013309+0000","last_became_peered":"2024-09-10T22:41:07.013309+0000","last_unstale":"2024-09-10T22:41:08.998183+0000","last_undegraded":"2024-09-10T22:41:08.998183+0000","last_fullsized":"2024-09-10T22:41:08.998183+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:47.119250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.234507+0000","last_change":"2024-09-10T22:41:06.007609+0000","last_active":"2024-09-10T22:41:09.234507+0000","last_peered":"2024-09-10T22:41:09.234507+0000","last_clean":"2024-09-10T22:41:09.234507+0000","last_became_active":"2024-09-10T22:41:06.007320+0000","last_became_peered":"2024-09-10T22:41:06.007320+0000","last_unstale":"2024-09-10T22:41:09.234507+0000","last_undegraded":"2024-09-10T22:41:09.234507+0000","last_fullsized":"2024-09-10T22:41:09.234507+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:02:49.505104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:09.235615+0000","last_change":"2024-09-10T22:41:07.019550+0000","last_active":"2024-09-10T22:41:09.235615+0000","last_peered":"2024-09-10T22:41:09.235615+0000","last_clean":"2024-09-10T22:41:09.235615+0000","last_became_active":"2024-09-10T22:41:07.019073+0000","last_became_peered":"2024-09-10T22:41:07.019073+0000","last_unstale":"2024-09-10T22:41:09.235615+0000","last_undegraded":"2024-09-10T22:41:09.235615+0000","last_fullsized":"2024-09-10T22:41:09.235615+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:14.745401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.990444+0000","last_change":"2024-09-10T22:41:06.011292+0000","last_active":"2024-09-10T22:41:07.990444+0000","last_peered":"2024-09-10T22:41:07.990444+0000","last_clean":"2024-09-10T22:41:07.990444+0000","last_became_active":"2024-09-10T22:41:06.010970+0000","last_became_peered":"2024-09-10T22:41:06.010970+0000","last_unstale":"2024-09-10T22:41:07.990444+0000","last_undegraded":"2024-09-10T22:41:07.990444+0000","last_fullsized":"2024-09-10T22:41:07.990444+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:51.873950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.442589+0000","last_change":"2024-09-10T22:41:06.999739+0000","last_active":"2024-09-10T22:41:08.442589+0000","last_peered":"2024-09-10T22:41:08.442589+0000","last_clean":"2024-09-10T22:41:08.442589+0000","last_became_active":"2024-09-10T22:41:06.999350+0000","last_became_peered":"2024-09-10T22:41:06.999350+0000","last_unstale":"2024-09-10T22:41:08.442589+0000","last_undegraded":"2024-09-10T22:41:08.442589+0000","last_fullsized":"2024-09-10T22:41:08.442589+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:05.972287+0000","last_clean_scrub_stamp":"2024-09-10T22:41:05.972287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:04.903647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"55'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:08.998386+0000","last_change":"2024-09-10T22:41:06.013365+0000","last_active":"2024-09-10T22:41:08.998386+0000","last_peered":"2024-09-10T22:41:08.998386+0000","last_clean":"2024-09-10T22:41:08.998386+0000","last_became_active":"2024-09-10T22:41:06.012873+0000","last_became_peered":"2024-09-10T22:41:06.012873+0000","last_unstale":"2024-09-10T22:41:08.998386+0000","last_undegraded":"2024-09-10T22:41:08.998386+0000","last_fullsized":"2024-09-10T22:41:08.998386+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:41:04.962109+0000","last_clean_scrub_stamp":"2024-09-10T22:41:04.962109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:56.910500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":173,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T22:41:07.991085+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:41:07.991085+0000","last_peered":"2024-09-10T22:41:07.991085+0000","last_clean":"2024-09-10T22:41:07.991085+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:41:07.991085+0000","last_undegraded":"2024-09-10T22:41:07.991085+0000","last_fullsized":"2024-09-10T22:41:07.991085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509474,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1249280,"data_stored":878414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509474,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":288574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509475,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":287922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509474,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":288504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509474,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":289556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509474,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":659456,"data_stored":289534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509474,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1249280,"data_stored":878346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":288082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:41:16.039 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T22:41:16.039 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T22:41:16.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d34e00640 1 -- 172.21.15.103:0/2443466987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d300aee80 msgr2=0x7f9d3015bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:16.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d34e00640 1 --2- 172.21.15.103:0/2443466987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d300aee80 0x7f9d3015bea0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009840 tx=0x7f9d2001c7f0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d34e00640 1 -- 172.21.15.103:0/2443466987 shutdown_connections 2024-09-10T22:41:16.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d34e00640 1 --2- 172.21.15.103:0/2443466987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d300cc1a0 0x7f9d30072470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d34e00640 1 --2- 172.21.15.103:0/2443466987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d300aee80 0x7f9d3015bea0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d34e00640 1 -- 172.21.15.103:0/2443466987 >> 172.21.15.103:0/2443466987 conn(0x7f9d300cf7f0 msgr2=0x7f9d300cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:16.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d34e00640 1 -- 172.21.15.103:0/2443466987 shutdown_connections 2024-09-10T22:41:16.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d34e00640 1 -- 172.21.15.103:0/2443466987 wait complete. 2024-09-10T22:41:16.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d34e00640 1 Processor -- start 2024-09-10T22:41:16.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d34e00640 1 -- start start 2024-09-10T22:41:16.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d34e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d300729b0 0x7f9d30157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:16.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d34e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d300aee80 0x7f9d300adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:16.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d34e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d300cc1a0 0x7f9d30140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:16.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d34e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9d300ce7c0 con 0x7f9d300729b0 2024-09-10T22:41:16.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d34e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9d300ce640 con 0x7f9d300cc1a0 2024-09-10T22:41:16.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d34e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9d300ce940 con 0x7f9d300aee80 2024-09-10T22:41:16.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d2de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d300729b0 0x7f9d30157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:16.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d2de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d300729b0 0x7f9d30157920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56652/0 (socket says 172.21.15.103:56652) 2024-09-10T22:41:16.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d2de00640 1 -- 172.21.15.103:0/3545457351 learned_addr learned my addr 172.21.15.103:0/3545457351 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:16.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d2de00640 1 -- 172.21.15.103:0/3545457351 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d300aee80 msgr2=0x7f9d300adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:16.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d2de00640 1 --2- 172.21.15.103:0/3545457351 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d300aee80 0x7f9d300adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d2de00640 1 -- 172.21.15.103:0/3545457351 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d300cc1a0 msgr2=0x7f9d30140c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:16.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d2de00640 1 --2- 172.21.15.103:0/3545457351 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d300cc1a0 0x7f9d30140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.236+0000 7f9d2de00640 1 -- 172.21.15.103:0/3545457351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d30157e60 con 0x7f9d300729b0 2024-09-10T22:41:16.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.240+0000 7f9d2de00640 1 --2- 172.21.15.103:0/3545457351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d300729b0 0x7f9d30157920 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009790 tx=0x7f9d200a5800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:16.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.240+0000 7f9d26000640 1 -- 172.21.15.103:0/3545457351 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d200b2040 con 0x7f9d300729b0 2024-09-10T22:41:16.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.240+0000 7f9d26000640 1 -- 172.21.15.103:0/3545457351 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d200044b0 con 0x7f9d300729b0 2024-09-10T22:41:16.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.240+0000 7f9d34e00640 1 -- 172.21.15.103:0/3545457351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d30158120 con 0x7f9d300729b0 2024-09-10T22:41:16.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.240+0000 7f9d26000640 1 -- 172.21.15.103:0/3545457351 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d20005280 con 0x7f9d300729b0 2024-09-10T22:41:16.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.240+0000 7f9d34e00640 1 -- 172.21.15.103:0/3545457351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d301586e0 con 0x7f9d300729b0 2024-09-10T22:41:16.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.240+0000 7f9d34e00640 1 -- 172.21.15.103:0/3545457351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d3015bea0 con 0x7f9d300729b0 2024-09-10T22:41:16.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.240+0000 7f9d26000640 1 -- 172.21.15.103:0/3545457351 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9d200bf060 con 0x7f9d300729b0 2024-09-10T22:41:16.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.240+0000 7f9d26000640 1 --2- 172.21.15.103:0/3545457351 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9d0c0725e0 0x7f9d0c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:16.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.240+0000 7f9d26000640 1 -- 172.21.15.103:0/3545457351 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f9d2012c590 con 0x7f9d300729b0 2024-09-10T22:41:16.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.244+0000 7f9d27e00640 1 --2- 172.21.15.103:0/3545457351 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9d0c0725e0 0x7f9d0c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:16.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.244+0000 7f9d27e00640 1 --2- 172.21.15.103:0/3545457351 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9d0c0725e0 0x7f9d0c074aa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9d180058d0 tx=0x7f9d18005860 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:16.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.244+0000 7f9d26000640 1 -- 172.21.15.103:0/3545457351 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9d20016410 con 0x7f9d300729b0 2024-09-10T22:41:16.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.472+0000 7f9d34e00640 1 -- 172.21.15.103:0/3545457351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f9d3015a730 con 0x7f9d300729b0 2024-09-10T22:41:16.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.472+0000 7f9d26000640 1 -- 172.21.15.103:0/3545457351 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f9d20100020 con 0x7f9d300729b0 2024-09-10T22:41:16.479 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-09-10T22:41:16.479 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA8yuBmtOhZNBAAeszxWpV60NIn/zOInT5Zzw== 2024-09-10T22:41:16.479 INFO:teuthology.orchestra.run.smithi103.stdout: caps mds = "allow" 2024-09-10T22:41:16.479 INFO:teuthology.orchestra.run.smithi103.stdout: caps mon = "allow r" 2024-09-10T22:41:16.479 INFO:teuthology.orchestra.run.smithi103.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T22:41:16.480 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2024-09-10T22:41:16.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.476+0000 7f9d34e00640 1 -- 172.21.15.103:0/3545457351 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9d0c0725e0 msgr2=0x7f9d0c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:16.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.476+0000 7f9d34e00640 1 --2- 172.21.15.103:0/3545457351 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9d0c0725e0 0x7f9d0c074aa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9d180058d0 tx=0x7f9d18005860 comp rx=0 tx=0).stop 2024-09-10T22:41:16.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.476+0000 7f9d34e00640 1 -- 172.21.15.103:0/3545457351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d300729b0 msgr2=0x7f9d30157920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:16.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.476+0000 7f9d34e00640 1 --2- 172.21.15.103:0/3545457351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d300729b0 0x7f9d30157920 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009790 tx=0x7f9d200a5800 comp rx=0 tx=0).stop 2024-09-10T22:41:16.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.476+0000 7f9d34e00640 1 -- 172.21.15.103:0/3545457351 shutdown_connections 2024-09-10T22:41:16.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.476+0000 7f9d34e00640 1 --2- 172.21.15.103:0/3545457351 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9d0c0725e0 0x7f9d0c074aa0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.476+0000 7f9d34e00640 1 --2- 172.21.15.103:0/3545457351 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d300cc1a0 0x7f9d30140c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.476+0000 7f9d34e00640 1 --2- 172.21.15.103:0/3545457351 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d300aee80 0x7f9d300adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.476+0000 7f9d34e00640 1 --2- 172.21.15.103:0/3545457351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d300729b0 0x7f9d30157920 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.476+0000 7f9d34e00640 1 -- 172.21.15.103:0/3545457351 >> 172.21.15.103:0/3545457351 conn(0x7f9d300cf7f0 msgr2=0x7f9d3006f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:16.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.476+0000 7f9d34e00640 1 -- 172.21.15.103:0/3545457351 shutdown_connections 2024-09-10T22:41:16.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.476+0000 7f9d34e00640 1 -- 172.21.15.103:0/3545457351 wait complete. 2024-09-10T22:41:16.504 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:41:16.631 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:41:16.635 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:41:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a84c00640 1 -- 172.21.15.103:0/3627963034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a8015be30 msgr2=0x7f2a800ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a84c00640 1 --2- 172.21.15.103:0/3627963034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a8015be30 0x7f2a800ce0c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009840 tx=0x7f2a7001c790 comp rx=0 tx=0).stop 2024-09-10T22:41:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a84c00640 1 -- 172.21.15.103:0/3627963034 shutdown_connections 2024-09-10T22:41:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a84c00640 1 --2- 172.21.15.103:0/3627963034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a8015be30 0x7f2a800ce0c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a84c00640 1 -- 172.21.15.103:0/3627963034 >> 172.21.15.103:0/3627963034 conn(0x7f2a800d1ac0 msgr2=0x7f2a800d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a84c00640 1 -- 172.21.15.103:0/3627963034 shutdown_connections 2024-09-10T22:41:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a84c00640 1 -- 172.21.15.103:0/3627963034 wait complete. 2024-09-10T22:41:16.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a84c00640 1 Processor -- start 2024-09-10T22:41:16.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a84c00640 1 -- start start 2024-09-10T22:41:16.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a84c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a800ae9c0 0x7f2a800c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:16.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a84c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a800b09c0 0x7f2a800b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:16.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a84c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a8015be30 0x7f2a800cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:16.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a84c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2a80169e00 con 0x7f2a800b09c0 2024-09-10T22:41:16.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a84c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2a80169c80 con 0x7f2a8015be30 2024-09-10T22:41:16.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a84c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2a80169f80 con 0x7f2a800ae9c0 2024-09-10T22:41:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a77e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a800b09c0 0x7f2a800b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a77e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a800b09c0 0x7f2a800b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55666/0 (socket says 172.21.15.103:55666) 2024-09-10T22:41:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a77e00640 1 -- 172.21.15.103:0/4188504347 learned_addr learned my addr 172.21.15.103:0/4188504347 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a7de00640 1 --2- 172.21.15.103:0/4188504347 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a800ae9c0 0x7f2a800c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.644+0000 7f2a7e800640 1 --2- 172.21.15.103:0/4188504347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a8015be30 0x7f2a800cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.648+0000 7f2a77e00640 1 -- 172.21.15.103:0/4188504347 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a800ae9c0 msgr2=0x7f2a800c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.648+0000 7f2a77e00640 1 --2- 172.21.15.103:0/4188504347 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a800ae9c0 0x7f2a800c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.648+0000 7f2a77e00640 1 -- 172.21.15.103:0/4188504347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a8015be30 msgr2=0x7f2a800cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.648+0000 7f2a77e00640 1 --2- 172.21.15.103:0/4188504347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a8015be30 0x7f2a800cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.648+0000 7f2a77e00640 1 -- 172.21.15.103:0/4188504347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a800c9270 con 0x7f2a800b09c0 2024-09-10T22:41:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.648+0000 7f2a77e00640 1 --2- 172.21.15.103:0/4188504347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a800b09c0 0x7f2a800b2eb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800c4b0 tx=0x7f2a6800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.648+0000 7f2a76000640 1 -- 172.21.15.103:0/4188504347 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a68017070 con 0x7f2a800b09c0 2024-09-10T22:41:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.648+0000 7f2a76000640 1 -- 172.21.15.103:0/4188504347 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a680053c0 con 0x7f2a800b09c0 2024-09-10T22:41:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.648+0000 7f2a76000640 1 -- 172.21.15.103:0/4188504347 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a68003860 con 0x7f2a800b09c0 2024-09-10T22:41:16.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.648+0000 7f2a84c00640 1 -- 172.21.15.103:0/4188504347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a800c9550 con 0x7f2a800b09c0 2024-09-10T22:41:16.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.648+0000 7f2a84c00640 1 -- 172.21.15.103:0/4188504347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a800c9b10 con 0x7f2a800b09c0 2024-09-10T22:41:16.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.648+0000 7f2a84c00640 1 -- 172.21.15.103:0/4188504347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a800aee10 con 0x7f2a800b09c0 2024-09-10T22:41:16.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.648+0000 7f2a76000640 1 -- 172.21.15.103:0/4188504347 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2a68003a00 con 0x7f2a800b09c0 2024-09-10T22:41:16.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.648+0000 7f2a76000640 1 --2- 172.21.15.103:0/4188504347 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2a5c0725e0 0x7f2a5c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:16.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.648+0000 7f2a76000640 1 -- 172.21.15.103:0/4188504347 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f2a68092a20 con 0x7f2a800b09c0 2024-09-10T22:41:16.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.652+0000 7f2a7de00640 1 --2- 172.21.15.103:0/4188504347 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2a5c0725e0 0x7f2a5c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:16.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.652+0000 7f2a7de00640 1 --2- 172.21.15.103:0/4188504347 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2a5c0725e0 0x7f2a5c074aa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2a700af000 tx=0x7f2a700b2040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:16.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.656+0000 7f2a76000640 1 -- 172.21.15.103:0/4188504347 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2a6805d910 con 0x7f2a800b09c0 2024-09-10T22:41:16.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.856+0000 7f2a84c00640 1 -- 172.21.15.103:0/4188504347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a800b2a50 con 0x7f2a800b09c0 2024-09-10T22:41:16.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.856+0000 7f2a76000640 1 -- 172.21.15.103:0/4188504347 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5232 (secure 0 0 0) 0x7f2a68062340 con 0x7f2a800b09c0 2024-09-10T22:41:16.863 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:16.863 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":35,"btime":"2024-09-10T22:41:10:021317+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/1187797704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1187797704},{"type":"v1","addr":"172.21.15.131:6836","nonce":1187797704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5153,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3348473142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3348473142},{"type":"v1","addr":"172.21.15.131:6837","nonce":3348473142}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/3910783847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":3910783847},{"type":"v1","addr":"172.21.15.103:6834","nonce":3910783847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:41:06.381695+0000","modified":"2024-09-10T22:41:09.411810+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5547":{"gid":5547,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/343761048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":343761048},{"type":"v1","addr":"172.21.15.103:6835","nonce":343761048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5547,"qdb_cluster":[5547]},"id":3}]} 2024-09-10T22:41:16.863 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 35 2024-09-10T22:41:16.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.860+0000 7f2a84c00640 1 -- 172.21.15.103:0/4188504347 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2a5c0725e0 msgr2=0x7f2a5c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:16.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.860+0000 7f2a84c00640 1 --2- 172.21.15.103:0/4188504347 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2a5c0725e0 0x7f2a5c074aa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2a700af000 tx=0x7f2a700b2040 comp rx=0 tx=0).stop 2024-09-10T22:41:16.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.860+0000 7f2a84c00640 1 -- 172.21.15.103:0/4188504347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a800b09c0 msgr2=0x7f2a800b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:16.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.860+0000 7f2a84c00640 1 --2- 172.21.15.103:0/4188504347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a800b09c0 0x7f2a800b2eb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800c4b0 tx=0x7f2a6800c970 comp rx=0 tx=0).stop 2024-09-10T22:41:16.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.860+0000 7f2a84c00640 1 -- 172.21.15.103:0/4188504347 shutdown_connections 2024-09-10T22:41:16.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.860+0000 7f2a84c00640 1 --2- 172.21.15.103:0/4188504347 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2a5c0725e0 0x7f2a5c074aa0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.860+0000 7f2a84c00640 1 --2- 172.21.15.103:0/4188504347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a8015be30 0x7f2a800cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.860+0000 7f2a84c00640 1 --2- 172.21.15.103:0/4188504347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a800b09c0 0x7f2a800b2eb0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.860+0000 7f2a84c00640 1 --2- 172.21.15.103:0/4188504347 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a800ae9c0 0x7f2a800c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:16.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.860+0000 7f2a84c00640 1 -- 172.21.15.103:0/4188504347 >> 172.21.15.103:0/4188504347 conn(0x7f2a800d1ac0 msgr2=0x7f2a800ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:16.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.860+0000 7f2a84c00640 1 -- 172.21.15.103:0/4188504347 shutdown_connections 2024-09-10T22:41:16.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:16.860+0000 7f2a84c00640 1 -- 172.21.15.103:0/4188504347 wait complete. 2024-09-10T22:41:17.286 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:41:06.381695+0000', 'modified': '2024-09-10T22:41:09.411810+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5547}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5547': {'gid': 5547, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/343761048', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6832', 'nonce': 343761048}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 343761048}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5547, 'qdb_cluster': [5547]} 2024-09-10T22:41:17.286 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T22:41:17.287 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T22:41:17.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.424+0000 7f0535400640 1 -- 172.21.15.103:0/1091982900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05300ae7f0 msgr2=0x7f0530166bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:17.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.424+0000 7f0535400640 1 --2- 172.21.15.103:0/1091982900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05300ae7f0 0x7f0530166bc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0528009bf0 tx=0x7f052801cbe0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.424+0000 7f0535400640 1 -- 172.21.15.103:0/1091982900 shutdown_connections 2024-09-10T22:41:17.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.424+0000 7f0535400640 1 --2- 172.21.15.103:0/1091982900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05300ae7f0 0x7f0530166bc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.424+0000 7f0535400640 1 -- 172.21.15.103:0/1091982900 >> 172.21.15.103:0/1091982900 conn(0x7f05300d1a20 msgr2=0x7f05300d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:17.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f0535400640 1 -- 172.21.15.103:0/1091982900 shutdown_connections 2024-09-10T22:41:17.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f0535400640 1 -- 172.21.15.103:0/1091982900 wait complete. 2024-09-10T22:41:17.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f0535400640 1 Processor -- start 2024-09-10T22:41:17.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f0535400640 1 -- start start 2024-09-10T22:41:17.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f0535400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05300ae7f0 0x7f05301526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f0535400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05300cdd00 0x7f0530152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f0535400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f053015f1a0 0x7f05301592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f0535400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0530169d40 con 0x7f053015f1a0 2024-09-10T22:41:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f0535400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0530169bc0 con 0x7f05300ae7f0 2024-09-10T22:41:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f0535400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0530169ec0 con 0x7f05300cdd00 2024-09-10T22:41:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f052f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f053015f1a0 0x7f05301592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f052f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f053015f1a0 0x7f05301592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55682/0 (socket says 172.21.15.103:55682) 2024-09-10T22:41:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f052f200640 1 -- 172.21.15.103:0/2446894208 learned_addr learned my addr 172.21.15.103:0/2446894208 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f052e800640 1 --2- 172.21.15.103:0/2446894208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05300ae7f0 0x7f05301526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f052de00640 1 --2- 172.21.15.103:0/2446894208 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05300cdd00 0x7f0530152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f052f200640 1 -- 172.21.15.103:0/2446894208 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05300cdd00 msgr2=0x7f0530152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f052f200640 1 --2- 172.21.15.103:0/2446894208 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05300cdd00 0x7f0530152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f052f200640 1 -- 172.21.15.103:0/2446894208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05300ae7f0 msgr2=0x7f05301526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f052f200640 1 --2- 172.21.15.103:0/2446894208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05300ae7f0 0x7f05301526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f052f200640 1 -- 172.21.15.103:0/2446894208 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05300b4330 con 0x7f053015f1a0 2024-09-10T22:41:17.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f052f200640 1 --2- 172.21.15.103:0/2446894208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f053015f1a0 0x7f05301592e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f05280197f0 tx=0x7f0528009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:17.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f0526a00640 1 -- 172.21.15.103:0/2446894208 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05280bb070 con 0x7f053015f1a0 2024-09-10T22:41:17.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f0526a00640 1 -- 172.21.15.103:0/2446894208 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0528004d40 con 0x7f053015f1a0 2024-09-10T22:41:17.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f0526a00640 1 -- 172.21.15.103:0/2446894208 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05280b2040 con 0x7f053015f1a0 2024-09-10T22:41:17.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.428+0000 7f0535400640 1 -- 172.21.15.103:0/2446894208 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f053015a4f0 con 0x7f053015f1a0 2024-09-10T22:41:17.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.432+0000 7f0535400640 1 -- 172.21.15.103:0/2446894208 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f053015aab0 con 0x7f053015f1a0 2024-09-10T22:41:17.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.432+0000 7f0526a00640 1 -- 172.21.15.103:0/2446894208 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f05280b5030 con 0x7f053015f1a0 2024-09-10T22:41:17.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.432+0000 7f05388e7000 1 Processor -- start 2024-09-10T22:41:17.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.432+0000 7f0526a00640 1 --2- 172.21.15.103:0/2446894208 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05100725e0 0x7f0510074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.432+0000 7f0526a00640 1 -- 172.21.15.103:0/2446894208 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f052812cec0 con 0x7f053015f1a0 2024-09-10T22:41:17.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.432+0000 7f05388e7000 1 -- start start 2024-09-10T22:41:17.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.432+0000 7f052e800640 1 --2- 172.21.15.103:0/2446894208 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05100725e0 0x7f0510074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f05388e7000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b953389d0 0x560b95338db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f05388e7000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b953392f0 0x560b952ec8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f05388e7000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b952ece10 0x560b952ed1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f05388e7000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560b9520d3f0 con 0x560b952ece10 2024-09-10T22:41:17.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f05388e7000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560b9514ab20 con 0x560b953389d0 2024-09-10T22:41:17.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f05388e7000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560b95139f50 con 0x560b953392f0 2024-09-10T22:41:17.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f052f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b952ece10 0x560b952ed1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f052e800640 1 --2- 172.21.15.103:0/2446894208 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05100725e0 0x7f0510074aa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0520001720 tx=0x7f0520007c90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:17.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f052f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b952ece10 0x560b952ed1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55694/0 (socket says 172.21.15.103:55694) 2024-09-10T22:41:17.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f052f200640 1 -- 172.21.15.103:0/2028121898 learned_addr learned my addr 172.21.15.103:0/2028121898 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:17.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f052de00640 1 --2- 172.21.15.103:0/2028121898 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b953392f0 0x560b952ec8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f052e800640 1 --2- 172.21.15.103:0/2028121898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b953389d0 0x560b95338db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f052f200640 1 -- 172.21.15.103:0/2028121898 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b953392f0 msgr2=0x560b952ec8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:17.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f052f200640 1 --2- 172.21.15.103:0/2028121898 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b953392f0 0x560b952ec8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f052f200640 1 -- 172.21.15.103:0/2028121898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b953389d0 msgr2=0x560b95338db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:17.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f052f200640 1 --2- 172.21.15.103:0/2028121898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b953389d0 0x560b95338db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f052f200640 1 -- 172.21.15.103:0/2028121898 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b95101590 con 0x560b952ece10 2024-09-10T22:41:17.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f052f200640 1 --2- 172.21.15.103:0/2028121898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b952ece10 0x560b952ed1f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f05280f7de0 tx=0x7f05280f7c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4b23629ed662f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:17.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f051b400640 1 -- 172.21.15.103:0/2028121898 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05280f7960 con 0x560b952ece10 2024-09-10T22:41:17.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f051b400640 1 -- 172.21.15.103:0/2028121898 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05280fc880 con 0x560b952ece10 2024-09-10T22:41:17.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f051b400640 1 -- 172.21.15.103:0/2028121898 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05281012a0 con 0x560b952ece10 2024-09-10T22:41:17.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f05388e7000 1 -- 172.21.15.103:0/2028121898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b952ece10 msgr2=0x560b952ed1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:17.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f05388e7000 1 --2- 172.21.15.103:0/2028121898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b952ece10 0x560b952ed1f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f05280f7de0 tx=0x7f05280f7c20 comp rx=0 tx=0).stop 2024-09-10T22:41:17.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f05388e7000 1 -- 172.21.15.103:0/2028121898 shutdown_connections 2024-09-10T22:41:17.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f05388e7000 1 --2- 172.21.15.103:0/2028121898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b952ece10 0x560b952ed1f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f05388e7000 1 --2- 172.21.15.103:0/2028121898 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b953392f0 0x560b952ec8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f05388e7000 1 --2- 172.21.15.103:0/2028121898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b953389d0 0x560b95338db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f05388e7000 1 -- 172.21.15.103:0/2028121898 >> 172.21.15.103:0/2028121898 conn(0x560b951d6130 msgr2=0x560b9531be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:17.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f05388e7000 1 -- 172.21.15.103:0/2028121898 shutdown_connections 2024-09-10T22:41:17.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f05388e7000 1 -- 172.21.15.103:0/2028121898 wait complete. 2024-09-10T22:41:17.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f05388e7000 1 -- start start 2024-09-10T22:41:17.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.436+0000 7f05388e7000 1 Processor -- start 2024-09-10T22:41:17.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b952ece10 0x560b953196a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b953389d0 0x560b95319e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953392f0 0x560b9531a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560b950d45d0 con 0x560b953392f0 2024-09-10T22:41:17.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560b9513dd60 con 0x560b953389d0 2024-09-10T22:41:17.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560b950e0500 con 0x560b952ece10 2024-09-10T22:41:17.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 10 client.0 _ll_register_callbacks cb 0x560b950e4810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:17.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f052f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953392f0 0x560b9531a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f052f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953392f0 0x560b9531a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55706/0 (socket says 172.21.15.103:55706) 2024-09-10T22:41:17.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f052f200640 1 -- 172.21.15.103:0/3506924750 learned_addr learned my addr 172.21.15.103:0/3506924750 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:17.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f052de00640 1 --2- 172.21.15.103:0/3506924750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b953389d0 0x560b95319e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f052e800640 1 --2- 172.21.15.103:0/3506924750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b952ece10 0x560b953196a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f052f200640 1 -- 172.21.15.103:0/3506924750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b952ece10 msgr2=0x560b953196a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:17.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f052f200640 1 --2- 172.21.15.103:0/3506924750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b952ece10 0x560b953196a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f052f200640 1 -- 172.21.15.103:0/3506924750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b953389d0 msgr2=0x560b95319e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:17.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f052f200640 1 --2- 172.21.15.103:0/3506924750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b953389d0 0x560b95319e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f052f200640 1 -- 172.21.15.103:0/3506924750 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b950d8170 con 0x560b953392f0 2024-09-10T22:41:17.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f052de00640 1 --2- 172.21.15.103:0/3506924750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b953389d0 0x560b95319e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:17.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f052e800640 1 --2- 172.21.15.103:0/3506924750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b952ece10 0x560b953196a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:17.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f052f200640 1 --2- 172.21.15.103:0/3506924750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953392f0 0x560b9531a3b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f05280985d0 tx=0x7f05280f7960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa1c3f36c09a794 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:17.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f050fe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:17.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f050fe00640 1 -- 172.21.15.103:0/3506924750 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0528101010 con 0x560b953392f0 2024-09-10T22:41:17.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 -- 172.21.15.103:0/3506924750 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560b950d20f0 con 0x560b953392f0 2024-09-10T22:41:17.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f050fe00640 1 -- 172.21.15.103:0/3506924750 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f05280ffb70 con 0x560b953392f0 2024-09-10T22:41:17.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f050fe00640 1 -- 172.21.15.103:0/3506924750 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f05281012a0 con 0x560b953392f0 2024-09-10T22:41:17.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 10 client.5697 fetch_fsmap learned FSMap version 35 2024-09-10T22:41:17.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 -- 172.21.15.103:0/3506924750 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x560b951beef0 con 0x560b953392f0 2024-09-10T22:41:17.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f050fe00640 1 -- 172.21.15.103:0/3506924750 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560b950d20f0 con 0x560b953392f0 2024-09-10T22:41:17.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f050fe00640 1 -- 172.21.15.103:0/3506924750 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 35) ==== 3502+0+0 (secure 0 0 0) 0x7f05280f70b0 con 0x560b953392f0 2024-09-10T22:41:17.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 10 client.5697 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T22:41:17.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 10 client.5697 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T22:41:17.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 20 client.5697 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:17.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 --2- 172.21.15.103:0/3506924750 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x560b9531b0f0 0x560b9534ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 4 client.5697 mds_command: new command op to 5547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:41:17.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 -- 172.21.15.103:0/3506924750 --> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b9514ca70 con 0x560b9531b0f0 2024-09-10T22:41:17.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f052e800640 1 --2- 172.21.15.103:0/3506924750 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x560b9531b0f0 0x560b9534ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f052e800640 1 --2- 172.21.15.103:0/3506924750 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x560b9531b0f0 0x560b9534ac90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=810634d078d40403 server_cookie=7204d48cee2b54f5 in_seq=0 out_seq=0 2024-09-10T22:41:17.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f050fe00640 10 client.5697 ms_handle_connect on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:17.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f050fe00640 1 -- 172.21.15.103:0/3506924750 <== mds.0 v2:172.21.15.103:6832/343761048 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b9514ca70 con 0x560b9531b0f0 2024-09-10T22:41:17.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f050fe00640 10 client.5697 handle_command_reply: tid=0 2024-09-10T22:41:17.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 client.5697 shutdown 2024-09-10T22:41:17.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 -- 172.21.15.103:0/3506924750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953392f0 msgr2=0x560b9531a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:17.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 --2- 172.21.15.103:0/3506924750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953392f0 0x560b9531a3b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f05280985d0 tx=0x7f05280f7960 comp rx=0 tx=0).stop 2024-09-10T22:41:17.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 -- 172.21.15.103:0/3506924750 shutdown_connections 2024-09-10T22:41:17.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 --2- 172.21.15.103:0/3506924750 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x560b9531b0f0 0x560b9534ac90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 --2- 172.21.15.103:0/3506924750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953392f0 0x560b9531a3b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f050fe00640 0 client.5697 ms_handle_reset on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:17.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 --2- 172.21.15.103:0/3506924750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b953389d0 0x560b95319e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 --2- 172.21.15.103:0/3506924750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b952ece10 0x560b953196a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.440+0000 7f05388e7000 1 -- 172.21.15.103:0/3506924750 >> 172.21.15.103:0/3506924750 conn(0x560b951d6130 msgr2=0x560b952ebfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:17.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.444+0000 7f05388e7000 1 -- 172.21.15.103:0/3506924750 shutdown_connections 2024-09-10T22:41:17.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.444+0000 7f05388e7000 1 -- 172.21.15.103:0/3506924750 wait complete. 2024-09-10T22:41:17.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.444+0000 7f05388e7000 20 client.5697 trim_cache size 0 max 16384 2024-09-10T22:41:17.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.460+0000 7f05388e7000 1 Processor -- start 2024-09-10T22:41:17.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.460+0000 7f05388e7000 1 -- start start 2024-09-10T22:41:17.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.460+0000 7f05388e7000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b952ece10 0x560b953b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.460+0000 7f05388e7000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953389d0 0x560b953b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.460+0000 7f05388e7000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b953392f0 0x560b953b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.460+0000 7f05388e7000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f05302031d0 con 0x560b953389d0 2024-09-10T22:41:17.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.460+0000 7f05388e7000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f05300b14e0 con 0x560b952ece10 2024-09-10T22:41:17.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.460+0000 7f05388e7000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0530202d80 con 0x560b953392f0 2024-09-10T22:41:17.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.460+0000 7f052de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953389d0 0x560b953b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.460+0000 7f052de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953389d0 0x560b953b3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55712/0 (socket says 172.21.15.103:55712) 2024-09-10T22:41:17.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.460+0000 7f052de00640 1 -- 172.21.15.103:0/2943492240 learned_addr learned my addr 172.21.15.103:0/2943492240 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:17.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.460+0000 7f052de00640 1 -- 172.21.15.103:0/2943492240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b953392f0 msgr2=0x560b953b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:17.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.460+0000 7f052de00640 1 --2- 172.21.15.103:0/2943492240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b953392f0 0x560b953b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.460+0000 7f052de00640 1 -- 172.21.15.103:0/2943492240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b952ece10 msgr2=0x560b953b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:17.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.460+0000 7f052de00640 1 --2- 172.21.15.103:0/2943492240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b952ece10 0x560b953b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.460+0000 7f052de00640 1 -- 172.21.15.103:0/2943492240 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b95195d90 con 0x560b953389d0 2024-09-10T22:41:17.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f052de00640 1 --2- 172.21.15.103:0/2943492240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953389d0 0x560b953b3d30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f051c005510 tx=0x7f051c0039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4e7e7c656af42f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:17.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f051aa00640 1 -- 172.21.15.103:0/2943492240 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051c0015c0 con 0x560b953389d0 2024-09-10T22:41:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f051aa00640 1 -- 172.21.15.103:0/2943492240 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f051c001760 con 0x560b953389d0 2024-09-10T22:41:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f051aa00640 1 -- 172.21.15.103:0/2943492240 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051c001b50 con 0x560b953389d0 2024-09-10T22:41:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 1 -- 172.21.15.103:0/2943492240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953389d0 msgr2=0x560b953b3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 1 --2- 172.21.15.103:0/2943492240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953389d0 0x560b953b3d30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f051c005510 tx=0x7f051c0039d0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 1 -- 172.21.15.103:0/2943492240 shutdown_connections 2024-09-10T22:41:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 1 --2- 172.21.15.103:0/2943492240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b953392f0 0x560b953b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 1 --2- 172.21.15.103:0/2943492240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953389d0 0x560b953b3d30 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 1 --2- 172.21.15.103:0/2943492240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b952ece10 0x560b953b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 1 -- 172.21.15.103:0/2943492240 >> 172.21.15.103:0/2943492240 conn(0x560b951d6130 msgr2=0x560b952f4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 1 -- 172.21.15.103:0/2943492240 shutdown_connections 2024-09-10T22:41:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 1 -- 172.21.15.103:0/2943492240 wait complete. 2024-09-10T22:41:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 1 -- start start 2024-09-10T22:41:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 1 Processor -- start 2024-09-10T22:41:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b952ece10 0x560b953b7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953389d0 0x560b953b7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b953392f0 0x560b953b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560b950d45d0 con 0x560b953389d0 2024-09-10T22:41:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560b95105ec0 con 0x560b953392f0 2024-09-10T22:41:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560b9513dd60 con 0x560b952ece10 2024-09-10T22:41:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 10 client.0 _ll_register_callbacks cb 0x7f0528110070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f052de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953389d0 0x560b953b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f052de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953389d0 0x560b953b7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55720/0 (socket says 172.21.15.103:55720) 2024-09-10T22:41:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f052de00640 1 -- 172.21.15.103:0/2398662158 learned_addr learned my addr 172.21.15.103:0/2398662158 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f052f200640 1 --2- 172.21.15.103:0/2398662158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b953392f0 0x560b953b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f052e800640 1 --2- 172.21.15.103:0/2398662158 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b952ece10 0x560b953b7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f052de00640 1 -- 172.21.15.103:0/2398662158 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b952ece10 msgr2=0x560b953b7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f052de00640 1 --2- 172.21.15.103:0/2398662158 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b952ece10 0x560b953b7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f052de00640 1 -- 172.21.15.103:0/2398662158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b953392f0 msgr2=0x560b953b7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f052de00640 1 --2- 172.21.15.103:0/2398662158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b953392f0 0x560b953b7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f052de00640 1 -- 172.21.15.103:0/2398662158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b95100a90 con 0x560b953389d0 2024-09-10T22:41:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f052f200640 1 --2- 172.21.15.103:0/2398662158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b953392f0 0x560b953b7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f052de00640 1 --2- 172.21.15.103:0/2398662158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953389d0 0x560b953b7950 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f051c000fc0 tx=0x7f051c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84fdab604041b0a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f050fe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f050fe00640 1 -- 172.21.15.103:0/2398662158 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051c024070 con 0x560b953389d0 2024-09-10T22:41:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f050fe00640 1 -- 172.21.15.103:0/2398662158 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f051c017ae0 con 0x560b953389d0 2024-09-10T22:41:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.464+0000 7f05388e7000 1 -- 172.21.15.103:0/2398662158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f051c001760 con 0x560b953389d0 2024-09-10T22:41:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f050fe00640 1 -- 172.21.15.103:0/2398662158 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f051c030050 con 0x560b953389d0 2024-09-10T22:41:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 10 client.5703 fetch_fsmap learned FSMap version 35 2024-09-10T22:41:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 1 -- 172.21.15.103:0/2398662158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x560b950df050 con 0x560b953389d0 2024-09-10T22:41:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f050fe00640 1 -- 172.21.15.103:0/2398662158 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f051c001760 con 0x560b953389d0 2024-09-10T22:41:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f050fe00640 1 -- 172.21.15.103:0/2398662158 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 35) ==== 3502+0+0 (secure 0 0 0) 0x7f051c033020 con 0x560b953389d0 2024-09-10T22:41:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 10 client.5703 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T22:41:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 10 client.5703 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T22:41:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 20 client.5703 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 1 --2- 172.21.15.103:0/2398662158 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x560b9534e200 0x560b953c0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 4 client.5703 mds_command: new command op to 5547 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:41:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 1 -- 172.21.15.103:0/2398662158 --> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] -- command(tid 0: {"prefix": "status"}) -- 0x560b95148520 con 0x560b9534e200 2024-09-10T22:41:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f052e800640 1 --2- 172.21.15.103:0/2398662158 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x560b9534e200 0x560b953c0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f052e800640 1 --2- 172.21.15.103:0/2398662158 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x560b9534e200 0x560b953c0670 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e6f2dfdf0ae0f5b server_cookie=bda453e9e873cf5b in_seq=0 out_seq=0 2024-09-10T22:41:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f050fe00640 10 client.5703 ms_handle_connect on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f050fe00640 1 -- 172.21.15.103:0/2398662158 <== mds.0 v2:172.21.15.103:6832/343761048 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x560b95148520 con 0x560b9534e200 2024-09-10T22:41:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f050fe00640 10 client.5703 handle_command_reply: tid=0 2024-09-10T22:41:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 1 client.5703 shutdown 2024-09-10T22:41:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 1 -- 172.21.15.103:0/2398662158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953389d0 msgr2=0x560b953b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 1 --2- 172.21.15.103:0/2398662158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953389d0 0x560b953b7950 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f051c000fc0 tx=0x7f051c001e50 comp rx=0 tx=0).stop 2024-09-10T22:41:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 1 -- 172.21.15.103:0/2398662158 shutdown_connections 2024-09-10T22:41:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 1 --2- 172.21.15.103:0/2398662158 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x560b9534e200 0x560b953c0670 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 1 --2- 172.21.15.103:0/2398662158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560b953392f0 0x560b953b7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 1 --2- 172.21.15.103:0/2398662158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b953389d0 0x560b953b7950 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 1 --2- 172.21.15.103:0/2398662158 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560b952ece10 0x560b953b7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f050fe00640 0 client.5703 ms_handle_reset on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 1 -- 172.21.15.103:0/2398662158 >> 172.21.15.103:0/2398662158 conn(0x560b951d6130 msgr2=0x560b953375b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 1 -- 172.21.15.103:0/2398662158 shutdown_connections 2024-09-10T22:41:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 1 -- 172.21.15.103:0/2398662158 wait complete. 2024-09-10T22:41:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f05388e7000 20 client.5703 trim_cache size 0 max 16384 2024-09-10T22:41:17.481 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:41:17.481 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:41:17.481 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-10T22:41:17.481 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5547, 2024-09-10T22:41:17.481 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:41:17.481 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:41:17.481 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:41:17.482 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 10.488522766999999, 2024-09-10T22:41:17.482 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 35, 2024-09-10T22:41:17.482 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 55, 2024-09-10T22:41:17.482 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 55, 2024-09-10T22:41:17.482 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 14.98898982 2024-09-10T22:41:17.482 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:41:17.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f0535400640 1 -- 172.21.15.103:0/2446894208 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05100725e0 msgr2=0x7f0510074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:17.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f0535400640 1 --2- 172.21.15.103:0/2446894208 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05100725e0 0x7f0510074aa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0520001720 tx=0x7f0520007c90 comp rx=0 tx=0).stop 2024-09-10T22:41:17.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f0535400640 1 -- 172.21.15.103:0/2446894208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f053015f1a0 msgr2=0x7f05301592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:17.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f0535400640 1 --2- 172.21.15.103:0/2446894208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f053015f1a0 0x7f05301592e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f05280197f0 tx=0x7f0528009200 comp rx=0 tx=0).stop 2024-09-10T22:41:17.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f0535400640 1 -- 172.21.15.103:0/2446894208 shutdown_connections 2024-09-10T22:41:17.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f0535400640 1 --2- 172.21.15.103:0/2446894208 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05100725e0 0x7f0510074aa0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f0535400640 1 --2- 172.21.15.103:0/2446894208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f053015f1a0 0x7f05301592e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f0535400640 1 --2- 172.21.15.103:0/2446894208 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05300cdd00 0x7f0530152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f0535400640 1 --2- 172.21.15.103:0/2446894208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05300ae7f0 0x7f05301526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f0535400640 1 -- 172.21.15.103:0/2446894208 >> 172.21.15.103:0/2446894208 conn(0x7f05300d1a20 msgr2=0x7f0530071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:17.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f0535400640 1 -- 172.21.15.103:0/2446894208 shutdown_connections 2024-09-10T22:41:17.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.468+0000 7f0535400640 1 -- 172.21.15.103:0/2446894208 wait complete. 2024-09-10T22:41:17.494 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T22:41:17.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe300600640 1 -- 172.21.15.103:0/1724460565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2f8072500 msgr2=0x7fe2f8072990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:17.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe300600640 1 --2- 172.21.15.103:0/1724460565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2f8072500 0x7fe2f8072990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009bf0 tx=0x7fe2f001cb00 comp rx=0 tx=0).stop 2024-09-10T22:41:17.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe300600640 1 -- 172.21.15.103:0/1724460565 shutdown_connections 2024-09-10T22:41:17.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe300600640 1 --2- 172.21.15.103:0/1724460565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2f8072500 0x7fe2f8072990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe300600640 1 -- 172.21.15.103:0/1724460565 >> 172.21.15.103:0/1724460565 conn(0x7fe2f806cc00 msgr2=0x7fe2f806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:17.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe300600640 1 -- 172.21.15.103:0/1724460565 shutdown_connections 2024-09-10T22:41:17.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe300600640 1 -- 172.21.15.103:0/1724460565 wait complete. 2024-09-10T22:41:17.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe300600640 1 Processor -- start 2024-09-10T22:41:17.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe300600640 1 -- start start 2024-09-10T22:41:17.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe300600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2f8072500 0x7fe2f8155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe300600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2f80b2c10 0x7fe2f8154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe300600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2f80cf260 0x7fe2f815c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe300600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f8168c40 con 0x7fe2f80cf260 2024-09-10T22:41:17.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe300600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f8157d80 con 0x7fe2f8072500 2024-09-10T22:41:17.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe300600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f8168dc0 con 0x7fe2f80b2c10 2024-09-10T22:41:17.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe2fe600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2f80cf260 0x7fe2f815c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe2fe600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2f80cf260 0x7fe2f815c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55730/0 (socket says 172.21.15.103:55730) 2024-09-10T22:41:17.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe2fe600640 1 -- 172.21.15.103:0/3211291665 learned_addr learned my addr 172.21.15.103:0/3211291665 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:17.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe2fdc00640 1 --2- 172.21.15.103:0/3211291665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2f8072500 0x7fe2f8155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe2fd200640 1 --2- 172.21.15.103:0/3211291665 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2f80b2c10 0x7fe2f8154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe2fe600640 1 -- 172.21.15.103:0/3211291665 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2f80b2c10 msgr2=0x7fe2f8154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:17.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe2fe600640 1 --2- 172.21.15.103:0/3211291665 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2f80b2c10 0x7fe2f8154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe2fe600640 1 -- 172.21.15.103:0/3211291665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2f8072500 msgr2=0x7fe2f8155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:17.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe2fe600640 1 --2- 172.21.15.103:0/3211291665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2f8072500 0x7fe2f8155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.632+0000 7fe2fe600640 1 -- 172.21.15.103:0/3211291665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f815ccc0 con 0x7fe2f80cf260 2024-09-10T22:41:17.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.636+0000 7fe2fe600640 1 --2- 172.21.15.103:0/3211291665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2f80cf260 0x7fe2f815c520 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00b0040 tx=0x7fe2f0005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:17.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.636+0000 7fe2f5600640 1 -- 172.21.15.103:0/3211291665 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00bb070 con 0x7fe2f80cf260 2024-09-10T22:41:17.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.636+0000 7fe2f5600640 1 -- 172.21.15.103:0/3211291665 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2f0004e00 con 0x7fe2f80cf260 2024-09-10T22:41:17.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.636+0000 7fe2f5600640 1 -- 172.21.15.103:0/3211291665 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00b2040 con 0x7fe2f80cf260 2024-09-10T22:41:17.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.636+0000 7fe300600640 1 -- 172.21.15.103:0/3211291665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f8153990 con 0x7fe2f80cf260 2024-09-10T22:41:17.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.636+0000 7fe300600640 1 -- 172.21.15.103:0/3211291665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f8153f50 con 0x7fe2f80cf260 2024-09-10T22:41:17.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.636+0000 7fe300600640 1 -- 172.21.15.103:0/3211291665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f8072990 con 0x7fe2f80cf260 2024-09-10T22:41:17.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.636+0000 7fe2f5600640 1 -- 172.21.15.103:0/3211291665 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe2f00b5070 con 0x7fe2f80cf260 2024-09-10T22:41:17.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.636+0000 7fe2f5600640 1 --2- 172.21.15.103:0/3211291665 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe2d80725e0 0x7fe2d8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:17.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.636+0000 7fe2f5600640 1 -- 172.21.15.103:0/3211291665 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fe2f012ccb0 con 0x7fe2f80cf260 2024-09-10T22:41:17.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.636+0000 7fe2fdc00640 1 --2- 172.21.15.103:0/3211291665 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe2d80725e0 0x7fe2d8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:17.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.640+0000 7fe2fdc00640 1 --2- 172.21.15.103:0/3211291665 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe2d80725e0 0x7fe2d8074aa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec001130 tx=0x7fe2ec009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:17.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.640+0000 7fe2f5600640 1 -- 172.21.15.103:0/3211291665 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe2f00166f0 con 0x7fe2f80cf260 2024-09-10T22:41:17.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.840+0000 7fe300600640 1 -- 172.21.15.103:0/3211291665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe2f8156480 con 0x7fe2f80cf260 2024-09-10T22:41:17.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.840+0000 7fe2f5600640 1 -- 172.21.15.103:0/3211291665 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) ==== 53+0+73 (secure 0 0 0) 0x7fe2f00f81f0 con 0x7fe2f80cf260 2024-09-10T22:41:17.847 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T22:41:17.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.844+0000 7fe300600640 1 -- 172.21.15.103:0/3211291665 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe2d80725e0 msgr2=0x7fe2d8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:17.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.844+0000 7fe300600640 1 --2- 172.21.15.103:0/3211291665 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe2d80725e0 0x7fe2d8074aa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec001130 tx=0x7fe2ec009040 comp rx=0 tx=0).stop 2024-09-10T22:41:17.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.844+0000 7fe300600640 1 -- 172.21.15.103:0/3211291665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2f80cf260 msgr2=0x7fe2f815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:17.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.844+0000 7fe300600640 1 --2- 172.21.15.103:0/3211291665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2f80cf260 0x7fe2f815c520 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00b0040 tx=0x7fe2f0005ac0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.844+0000 7fe300600640 1 -- 172.21.15.103:0/3211291665 shutdown_connections 2024-09-10T22:41:17.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.844+0000 7fe300600640 1 --2- 172.21.15.103:0/3211291665 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe2d80725e0 0x7fe2d8074aa0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.844+0000 7fe300600640 1 --2- 172.21.15.103:0/3211291665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2f80cf260 0x7fe2f815c520 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.844+0000 7fe300600640 1 --2- 172.21.15.103:0/3211291665 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2f80b2c10 0x7fe2f8154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.844+0000 7fe300600640 1 --2- 172.21.15.103:0/3211291665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2f8072500 0x7fe2f8155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:17.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.844+0000 7fe300600640 1 -- 172.21.15.103:0/3211291665 >> 172.21.15.103:0/3211291665 conn(0x7fe2f806cc00 msgr2=0x7fe2f806cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:17.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.844+0000 7fe300600640 1 -- 172.21.15.103:0/3211291665 shutdown_connections 2024-09-10T22:41:17.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:17.844+0000 7fe300600640 1 -- 172.21.15.103:0/3211291665 wait complete. 2024-09-10T22:41:17.869 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T22:41:17.869 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T22:41:17.869 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-10T22:41:17.869 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T22:41:17.869 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T22:41:17.869 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T22:41:17.869 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T22:41:17.869 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T22:41:17.870 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:41:17.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:41:17.870 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-10T22:41:17.879 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T22:41:17.879 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T22:41:17.879 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T22:41:17.879 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:41:17.880 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-10T22:41:17.880 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:41:17.880 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:41:17.880 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:41:17.880 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-10T22:41:17.880 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:41:17.880 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:41:17.880 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-10T22:41:17.880 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:41:17.880 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-10T22:41:17.880 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T22:41:17.880 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-10T22:41:17.880 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-10T22:41:17.881 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42304sec preferred_lft 42304sec 2024-09-10T22:41:17.881 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2024-09-10T22:41:17.881 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:41:17.881 INFO:teuthology.orchestra.run.smithi103.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T22:41:17.881 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 02:42:c3:dd:ba:ba brd ff:ff:ff:ff:ff:ff 2024-09-10T22:41:17.881 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T22:41:17.881 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:41:17.881 INFO:teuthology.orchestra.run.smithi103.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T22:41:17.881 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T22:41:17.881 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T22:41:17.881 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:41:17.881 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T22:41:17.882 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:41:17.882 INFO:teuthology.orchestra.run.smithi103.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T22:41:17.882 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:41:17.882 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T22:41:17.882 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:41:17.882 INFO:teuthology.orchestra.run.smithi103.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T22:41:17.882 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:41:17.882 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T22:41:17.882 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:41:17.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:41:17.883 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T22:41:17.937 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-10T22:41:17.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:41:17.939 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-10T22:41:17.992 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-10T22:41:17.993 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T22:41:17.993 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-10T22:41:17.993 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T22:41:17.993 INFO:teuthology.orchestra.run.smithi103.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-10T22:41:17.993 INFO:teuthology.orchestra.run.smithi103.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T22:41:17.993 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T22:41:17.993 INFO:teuthology.orchestra.run.smithi103.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:41:17.993 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:41:17.993 INFO:teuthology.orchestra.run.smithi103.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:41:17.993 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T22:41:17.994 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:41:17.994 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:41:17.994 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T22:41:17.994 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T22:41:17.994 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T22:41:17.994 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:41:18.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:41:18.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:41:18.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:41:18.135 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-10T22:41:18.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T22:41:18.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T22:41:18.145 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:41:18.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:41:18.146 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-10T22:41:18.211 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T22:41:18.212 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:41:18.212 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T22:41:18.260 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:41:18.260 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:41:18.260 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T22:41:18.312 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:41:18.380 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:41:18.437 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:41:18.437 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:41:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:41:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:41:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:41:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:41:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:41:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:41:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:41:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:41:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:41:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:41:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:41:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:41:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:41:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:41:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:41:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:41:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:41:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:41:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:41:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:41:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:41:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:41:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:41:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:41:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:41:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:41:18.440 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:41:18.440 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:41:18.440 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:41:18.440 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:41:18.440 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:41:18.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:41:18.441 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:41:18.492 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T22:41:18.492 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T22:41:18.539 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:41:18.560 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:41:18.609 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:41:18.609 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:41:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:41:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:41:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:41:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:41:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:41:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:41:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:41:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:41:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:41:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:41:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:41:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:41:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:41:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:41:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:41:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:41:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:41:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:41:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:41:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:41:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:41:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:41:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:41:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:41:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:41:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:41:18.612 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:41:18.612 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:41:18.612 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:41:18.612 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:41:18.612 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:41:18.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:41:18.613 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:41:18.633 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2024-09-10T22:41:18.628+0000 7f283c04b580 -1 init, newargv = 0x56438a652900 newargc=15 2024-09-10T22:41:18.633 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[40011]: starting ceph client 2024-09-10T22:41:18.639 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[40011]: starting fuse 2024-09-10T22:41:18.643 INFO:teuthology.orchestra.run.smithi103.stdout:44 2024-09-10T22:41:18.643 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T22:41:18.644 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-09-10T22:41:18.644 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-09-10T22:41:18.644 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-09-10T22:41:18.644 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:41:18.644 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-09-10T22:41:18.644 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:41:18.644 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-09-10T22:41:18.644 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T22:41:18.644 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-09-10T22:41:18.644 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T22:41:18.644 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:41:18.644 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-09-10T22:41:18.644 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-09-10T22:41:18.645 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-09-10T22:41:18.645 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-09-10T22:41:18.645 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:41:18.645 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-09-10T22:41:18.645 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T22:41:18.645 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T22:41:18.645 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T22:41:18.645 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-09-10T22:41:18.645 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-09-10T22:41:18.645 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-09-10T22:41:18.645 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T22:41:18.645 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:41:18.645 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.0")) 2024-09-10T22:41:18.646 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:41:18.763 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.40011.asok 2024-09-10T22:41:18.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:41:18.775 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40011.asok 2024-09-10T22:41:18.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:41:18.775 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.40011.asok status 2024-09-10T22:41:18.947 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:41:18.948 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-09-10T22:41:18.948 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T22:41:18.948 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:41:18.948 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2024-09-10T22:41:18.948 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-09-10T22:41:18.948 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T22:41:18.948 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "40011", 2024-09-10T22:41:18.948 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-09-10T22:41:18.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:18.949 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-09-10T22:41:18.949 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-09-10T22:41:18.949 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5718, 2024-09-10T22:41:18.949 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-09-10T22:41:18.949 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-09-10T22:41:18.949 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-09-10T22:41:18.949 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5718 2024-09-10T22:41:18.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:18.949 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T22:41:18.949 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T22:41:18.949 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-10T22:41:18.950 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1970203261 2024-09-10T22:41:18.950 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:18.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:18.950 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T22:41:18.950 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T22:41:18.950 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-10T22:41:18.950 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1970203261 2024-09-10T22:41:18.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:41:18.950 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.5718 192.168.0.1:0/1970203261", 2024-09-10T22:41:18.950 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/1970203261", 2024-09-10T22:41:18.950 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-09-10T22:41:18.950 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 35, 2024-09-10T22:41:18.951 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 55, 2024-09-10T22:41:18.951 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-09-10T22:41:18.951 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-09-10T22:41:18.951 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-09-10T22:41:18.951 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:41:18.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:41:18.963 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-09-10T22:41:18.963 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T22:41:18.972 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-09-10T22:41:18.972 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T22:41:18.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:41:18.972 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T22:41:19.035 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-10T22:41:19.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.216+0000 7fa1ea200640 1 -- 172.21.15.103:0/128827575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1c8003c90 msgr2=0x7fa1c8004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:19.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.216+0000 7fa1ea200640 1 --2- 172.21.15.103:0/128827575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1c8003c90 0x7fa1c8004090 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009b60 tx=0x7fa1d401d270 comp rx=0 tx=0).stop 2024-09-10T22:41:19.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.216+0000 7fa1e9800640 1 -- 172.21.15.103:0/128827575 reap_dead start 2024-09-10T22:41:19.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.216+0000 7fa1ea200640 1 -- 172.21.15.103:0/128827575 shutdown_connections 2024-09-10T22:41:19.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.216+0000 7fa1ea200640 1 -- 172.21.15.103:0/128827575 >> 172.21.15.103:0/128827575 conn(0x7fa1e40d18f0 msgr2=0x7fa1e40d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:19.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.216+0000 7fa1ea200640 1 -- 172.21.15.103:0/128827575 shutdown_connections 2024-09-10T22:41:19.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.216+0000 7fa1ea200640 1 -- 172.21.15.103:0/128827575 wait complete. 2024-09-10T22:41:19.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.216+0000 7fa1ea200640 1 Processor -- start 2024-09-10T22:41:19.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.216+0000 7fa1ea200640 1 -- start start 2024-09-10T22:41:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.216+0000 7fa1ea200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1c8003c90 0x7fa1e40c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.216+0000 7fa1ea200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1e415b860 0x7fa1e415b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1ea200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40c7920 0x7fa1e40c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1ea200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e4167e00 con 0x7fa1e40c7920 2024-09-10T22:41:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1ea200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e4167c80 con 0x7fa1c8003c90 2024-09-10T22:41:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1ea200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e4167f80 con 0x7fa1e415b860 2024-09-10T22:41:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1e9800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40c7920 0x7fa1e40c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1e9800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40c7920 0x7fa1e40c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55752/0 (socket says 172.21.15.103:55752) 2024-09-10T22:41:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1e9800640 1 -- 172.21.15.103:0/1727154887 learned_addr learned my addr 172.21.15.103:0/1727154887 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1dbe00640 1 --2- 172.21.15.103:0/1727154887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1e415b860 0x7fa1e415b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1e8e00640 1 --2- 172.21.15.103:0/1727154887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1c8003c90 0x7fa1e40c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1e9800640 1 -- 172.21.15.103:0/1727154887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1e415b860 msgr2=0x7fa1e415b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1e9800640 1 --2- 172.21.15.103:0/1727154887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1e415b860 0x7fa1e415b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1e9800640 1 -- 172.21.15.103:0/1727154887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1c8003c90 msgr2=0x7fa1e40c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1e9800640 1 --2- 172.21.15.103:0/1727154887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1c8003c90 0x7fa1e40c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1e9800640 1 -- 172.21.15.103:0/1727154887 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e40c5420 con 0x7fa1e40c7920 2024-09-10T22:41:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1e9800640 1 --2- 172.21.15.103:0/1727154887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40c7920 0x7fa1e40c7da0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4073820 tx=0x7fa1dc001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1e1600640 1 -- 172.21.15.103:0/1727154887 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc011870 con 0x7fa1e40c7920 2024-09-10T22:41:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1e1600640 1 -- 172.21.15.103:0/1727154887 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1dc017070 con 0x7fa1e40c7920 2024-09-10T22:41:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1ea200640 1 -- 172.21.15.103:0/1727154887 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e406fbe0 con 0x7fa1e40c7920 2024-09-10T22:41:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1e1600640 1 -- 172.21.15.103:0/1727154887 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc011dc0 con 0x7fa1e40c7920 2024-09-10T22:41:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1ea200640 1 -- 172.21.15.103:0/1727154887 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e40c59a0 con 0x7fa1e40c7920 2024-09-10T22:41:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1ea200640 1 -- 172.21.15.103:0/1727154887 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e4070430 con 0x7fa1e40c7920 2024-09-10T22:41:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.220+0000 7fa1e1600640 1 -- 172.21.15.103:0/1727154887 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa1dc01c460 con 0x7fa1e40c7920 2024-09-10T22:41:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.224+0000 7fa1e1600640 1 --2- 172.21.15.103:0/1727154887 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa1c00725e0 0x7fa1c0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.224+0000 7fa1e1600640 1 -- 172.21.15.103:0/1727154887 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fa1dc093bb0 con 0x7fa1e40c7920 2024-09-10T22:41:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.224+0000 7fa1e8e00640 1 --2- 172.21.15.103:0/1727154887 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa1c00725e0 0x7fa1c0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:19.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.224+0000 7fa1e8e00640 1 --2- 172.21.15.103:0/1727154887 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa1c00725e0 0x7fa1c0074aa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40ae000 tx=0x7fa1d401a010 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.228+0000 7fa1e1600640 1 -- 172.21.15.103:0/1727154887 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa1dc05ea10 con 0x7fa1e40c7920 2024-09-10T22:41:19.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:19.428+0000 7fa1ea200640 1 -- 172.21.15.103:0/1727154887 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fa1e40b01b0 con 0x7fa1e40c7920 2024-09-10T22:41:20.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.060+0000 7fa1e1600640 1 -- 172.21.15.103:0/1727154887 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v36) ==== 105+0+0 (secure 0 0 0) 0x7fa1dc063440 con 0x7fa1e40c7920 2024-09-10T22:41:20.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.064+0000 7fa1ea200640 1 -- 172.21.15.103:0/1727154887 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa1c00725e0 msgr2=0x7fa1c0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:20.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.064+0000 7fa1ea200640 1 --2- 172.21.15.103:0/1727154887 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa1c00725e0 0x7fa1c0074aa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40ae000 tx=0x7fa1d401a010 comp rx=0 tx=0).stop 2024-09-10T22:41:20.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.064+0000 7fa1ea200640 1 -- 172.21.15.103:0/1727154887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40c7920 msgr2=0x7fa1e40c7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:20.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.064+0000 7fa1ea200640 1 --2- 172.21.15.103:0/1727154887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40c7920 0x7fa1e40c7da0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4073820 tx=0x7fa1dc001b90 comp rx=0 tx=0).stop 2024-09-10T22:41:20.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.064+0000 7fa1ea200640 1 -- 172.21.15.103:0/1727154887 shutdown_connections 2024-09-10T22:41:20.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.064+0000 7fa1ea200640 1 --2- 172.21.15.103:0/1727154887 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa1c00725e0 0x7fa1c0074aa0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:20.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.064+0000 7fa1ea200640 1 --2- 172.21.15.103:0/1727154887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40c7920 0x7fa1e40c7da0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:20.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.064+0000 7fa1ea200640 1 --2- 172.21.15.103:0/1727154887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1e415b860 0x7fa1e415b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:20.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.064+0000 7fa1ea200640 1 --2- 172.21.15.103:0/1727154887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1c8003c90 0x7fa1e40c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:20.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.064+0000 7fa1ea200640 1 -- 172.21.15.103:0/1727154887 >> 172.21.15.103:0/1727154887 conn(0x7fa1e40d18f0 msgr2=0x7fa1e40cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:20.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.064+0000 7fa1ea200640 1 -- 172.21.15.103:0/1727154887 shutdown_connections 2024-09-10T22:41:20.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.064+0000 7fa1ea200640 1 -- 172.21.15.103:0/1727154887 wait complete. 2024-09-10T22:41:20.099 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:41:20.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.232+0000 7f3749a00640 1 -- 172.21.15.103:0/3122938347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37440717a0 msgr2=0x7f37440afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:21.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.232+0000 7f3749a00640 1 --2- 172.21.15.103:0/3122938347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37440717a0 0x7f37440afe30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f37440b14a0 tx=0x7f373c01ca50 comp rx=0 tx=0).stop 2024-09-10T22:41:21.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.232+0000 7f3749a00640 1 -- 172.21.15.103:0/3122938347 shutdown_connections 2024-09-10T22:41:21.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.232+0000 7f3749a00640 1 --2- 172.21.15.103:0/3122938347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37440717a0 0x7f37440afe30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:21.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.232+0000 7f3749a00640 1 -- 172.21.15.103:0/3122938347 >> 172.21.15.103:0/3122938347 conn(0x7f37440d1ad0 msgr2=0x7f37440d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:21.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.232+0000 7f3749a00640 1 -- 172.21.15.103:0/3122938347 shutdown_connections 2024-09-10T22:41:21.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.232+0000 7f3749a00640 1 -- 172.21.15.103:0/3122938347 wait complete. 2024-09-10T22:41:21.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3749a00640 1 Processor -- start 2024-09-10T22:41:21.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3749a00640 1 -- start start 2024-09-10T22:41:21.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3749a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37440717a0 0x7f3744154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:21.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3749a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37440cfda0 0x7f374415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:21.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3749a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37440d25f0 0x7f3744158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:21.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3749a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f374416a340 con 0x7f37440717a0 2024-09-10T22:41:21.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3749a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f374416a1c0 con 0x7f37440cfda0 2024-09-10T22:41:21.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3749a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f374416a4c0 con 0x7f37440d25f0 2024-09-10T22:41:21.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3742a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37440717a0 0x7f3744154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:21.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3742a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37440717a0 0x7f3744154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55776/0 (socket says 172.21.15.103:55776) 2024-09-10T22:41:21.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3742a00640 1 -- 172.21.15.103:0/1317145163 learned_addr learned my addr 172.21.15.103:0/1317145163 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:21.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3743400640 1 --2- 172.21.15.103:0/1317145163 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37440d25f0 0x7f3744158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:21.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3742000640 1 --2- 172.21.15.103:0/1317145163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37440cfda0 0x7f374415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:21.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3742a00640 1 -- 172.21.15.103:0/1317145163 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37440d25f0 msgr2=0x7f3744158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:21.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3742a00640 1 --2- 172.21.15.103:0/1317145163 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37440d25f0 0x7f3744158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:21.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3742a00640 1 -- 172.21.15.103:0/1317145163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37440cfda0 msgr2=0x7f374415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:21.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3742a00640 1 --2- 172.21.15.103:0/1317145163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37440cfda0 0x7f374415a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:21.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3742a00640 1 -- 172.21.15.103:0/1317145163 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374415ace0 con 0x7f37440717a0 2024-09-10T22:41:21.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3743400640 1 --2- 172.21.15.103:0/1317145163 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37440d25f0 0x7f3744158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:21.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3742000640 1 --2- 172.21.15.103:0/1317145163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37440cfda0 0x7f374415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:21.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3742a00640 1 --2- 172.21.15.103:0/1317145163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37440717a0 0x7f3744154410 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f373400c4e0 tx=0x7f373400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:21.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f373aa00640 1 -- 172.21.15.103:0/1317145163 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37340052d0 con 0x7f37440717a0 2024-09-10T22:41:21.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f373aa00640 1 -- 172.21.15.103:0/1317145163 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3734005470 con 0x7f37440717a0 2024-09-10T22:41:21.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f373aa00640 1 -- 172.21.15.103:0/1317145163 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3734012890 con 0x7f37440717a0 2024-09-10T22:41:21.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3749a00640 1 -- 172.21.15.103:0/1317145163 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f374415afc0 con 0x7f37440717a0 2024-09-10T22:41:21.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.236+0000 7f3749a00640 1 -- 172.21.15.103:0/1317145163 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f374414bf20 con 0x7f37440717a0 2024-09-10T22:41:21.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.240+0000 7f3749a00640 1 -- 172.21.15.103:0/1317145163 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f374415eca0 con 0x7f37440717a0 2024-09-10T22:41:21.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.240+0000 7f373aa00640 1 -- 172.21.15.103:0/1317145163 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3734003600 con 0x7f37440717a0 2024-09-10T22:41:21.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.240+0000 7f373aa00640 1 --2- 172.21.15.103:0/1317145163 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f37240725e0 0x7f3724074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:21.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.240+0000 7f373aa00640 1 -- 172.21.15.103:0/1317145163 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f3734092fa0 con 0x7f37440717a0 2024-09-10T22:41:21.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.240+0000 7f3742000640 1 --2- 172.21.15.103:0/1317145163 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f37240725e0 0x7f3724074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:21.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.240+0000 7f3742000640 1 --2- 172.21.15.103:0/1317145163 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f37240725e0 0x7f3724074aa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f37440cbc10 tx=0x7f3730009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:21.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.244+0000 7f373aa00640 1 -- 172.21.15.103:0/1317145163 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f373405e4e0 con 0x7f37440717a0 2024-09-10T22:41:21.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.444+0000 7f3749a00640 1 -- 172.21.15.103:0/1317145163 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f374415b280 con 0x7f37440717a0 2024-09-10T22:41:21.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.444+0000 7f373aa00640 1 -- 172.21.15.103:0/1317145163 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5248 (secure 0 0 0) 0x7f373405dde0 con 0x7f37440717a0 2024-09-10T22:41:21.067 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:21.067 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":37,"btime":"2024-09-10T22:41:20:069875+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/1187797704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1187797704},{"type":"v1","addr":"172.21.15.131:6836","nonce":1187797704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5153,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3348473142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3348473142},{"type":"v1","addr":"172.21.15.131:6837","nonce":3348473142}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:41:06.381695+0000","modified":"2024-09-10T22:41:20.069856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":5547,"mds_1":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"c","rank":1,"incarnation":37,"state":"up:creating","state_seq":1,"addr":"172.21.15.103:6834/3910783847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":3910783847},{"type":"v1","addr":"172.21.15.103:6834","nonce":3910783847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5547":{"gid":5547,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/343761048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":343761048},{"type":"v1","addr":"172.21.15.103:6835","nonce":343761048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5547,"qdb_cluster":[5547]},"id":3}]} 2024-09-10T22:41:21.068 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 37 2024-09-10T22:41:21.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.444+0000 7f3749a00640 1 -- 172.21.15.103:0/1317145163 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f37240725e0 msgr2=0x7f3724074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:21.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.444+0000 7f3749a00640 1 --2- 172.21.15.103:0/1317145163 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f37240725e0 0x7f3724074aa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f37440cbc10 tx=0x7f3730009040 comp rx=0 tx=0).stop 2024-09-10T22:41:21.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.444+0000 7f3749a00640 1 -- 172.21.15.103:0/1317145163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37440717a0 msgr2=0x7f3744154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:21.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.444+0000 7f3749a00640 1 --2- 172.21.15.103:0/1317145163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37440717a0 0x7f3744154410 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f373400c4e0 tx=0x7f373400c9a0 comp rx=0 tx=0).stop 2024-09-10T22:41:21.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.444+0000 7f3749a00640 1 -- 172.21.15.103:0/1317145163 shutdown_connections 2024-09-10T22:41:21.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.444+0000 7f3749a00640 1 --2- 172.21.15.103:0/1317145163 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f37240725e0 0x7f3724074aa0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:21.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.444+0000 7f3749a00640 1 --2- 172.21.15.103:0/1317145163 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37440d25f0 0x7f3744158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:21.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.444+0000 7f3749a00640 1 --2- 172.21.15.103:0/1317145163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37440cfda0 0x7f374415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:21.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.444+0000 7f3749a00640 1 --2- 172.21.15.103:0/1317145163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37440717a0 0x7f3744154410 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:21.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.444+0000 7f3749a00640 1 -- 172.21.15.103:0/1317145163 >> 172.21.15.103:0/1317145163 conn(0x7f37440d1ad0 msgr2=0x7f37440cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:21.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.444+0000 7f3749a00640 1 -- 172.21.15.103:0/1317145163 shutdown_connections 2024-09-10T22:41:21.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:20.444+0000 7f3749a00640 1 -- 172.21.15.103:0/1317145163 wait complete. 2024-09-10T22:41:21.473 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:41:06.381695+0000', 'modified': '2024-09-10T22:41:20.069856+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 5547, 'mds_1': 5544}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5544': {'gid': 5544, 'name': 'c', 'rank': 1, 'incarnation': 37, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.103:6834/3910783847', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6833', 'nonce': 3910783847}, {'type': 'v1', 'addr': '172.21.15.103:6834', 'nonce': 3910783847}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5547': {'gid': 5547, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/343761048', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6832', 'nonce': 343761048}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 343761048}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5547, 'qdb_cluster': [5547]} 2024-09-10T22:41:21.473 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5544:up:creating 2024-09-10T22:41:22.474 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:41:22.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f1615800640 1 -- 172.21.15.103:0/1348561750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16100cd500 msgr2=0x7f161015f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:22.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f1615800640 1 --2- 172.21.15.103:0/1348561750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16100cd500 0x7f161015f890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1608009840 tx=0x7f160801c820 comp rx=0 tx=0).stop 2024-09-10T22:41:22.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f1615800640 1 -- 172.21.15.103:0/1348561750 shutdown_connections 2024-09-10T22:41:22.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f1615800640 1 --2- 172.21.15.103:0/1348561750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16100cd500 0x7f161015f890 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:22.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f1615800640 1 --2- 172.21.15.103:0/1348561750 >> v2:172.21.15.131:3300/0 conn(0x7f16100cdd00 0x7f16100ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:22.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f1615800640 1 -- 172.21.15.103:0/1348561750 >> 172.21.15.103:0/1348561750 conn(0x7f16100d1a20 msgr2=0x7f16100d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:22.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f1615800640 1 -- 172.21.15.103:0/1348561750 shutdown_connections 2024-09-10T22:41:22.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f1615800640 1 -- 172.21.15.103:0/1348561750 wait complete. 2024-09-10T22:41:22.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f1615800640 1 Processor -- start 2024-09-10T22:41:22.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f1615800640 1 -- start start 2024-09-10T22:41:22.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f1615800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16100cd500 0x7f1610153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:22.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f1615800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16100cdd00 0x7f16100b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:22.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f1615800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f161015f1a0 0x7f1610158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f1615800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1610168f60 con 0x7f161015f1a0 2024-09-10T22:41:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f1615800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1610168de0 con 0x7f16100cd500 2024-09-10T22:41:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f1615800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f16101690e0 con 0x7f16100cdd00 2024-09-10T22:41:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f160f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f161015f1a0 0x7f1610158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f160f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f161015f1a0 0x7f1610158b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55778/0 (socket says 172.21.15.103:55778) 2024-09-10T22:41:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f160f400640 1 -- 172.21.15.103:0/1783745530 learned_addr learned my addr 172.21.15.103:0/1783745530 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f160ea00640 1 --2- 172.21.15.103:0/1783745530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16100cd500 0x7f1610153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.624+0000 7f1606000640 1 --2- 172.21.15.103:0/1783745530 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16100cdd00 0x7f16100b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.628+0000 7f160f400640 1 -- 172.21.15.103:0/1783745530 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16100cdd00 msgr2=0x7f16100b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.628+0000 7f160f400640 1 --2- 172.21.15.103:0/1783745530 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16100cdd00 0x7f16100b1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.628+0000 7f160f400640 1 -- 172.21.15.103:0/1783745530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16100cd500 msgr2=0x7f1610153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:22.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.628+0000 7f160f400640 1 --2- 172.21.15.103:0/1783745530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16100cd500 0x7f1610153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:22.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.628+0000 7f160f400640 1 -- 172.21.15.103:0/1783745530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16100b2510 con 0x7f161015f1a0 2024-09-10T22:41:22.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.628+0000 7f160f400640 1 --2- 172.21.15.103:0/1783745530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f161015f1a0 0x7f1610158b80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1608009790 tx=0x7f1608005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:22.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.628+0000 7f1607400640 1 -- 172.21.15.103:0/1783745530 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16080a6670 con 0x7f161015f1a0 2024-09-10T22:41:22.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.628+0000 7f1607400640 1 -- 172.21.15.103:0/1783745530 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1608004130 con 0x7f161015f1a0 2024-09-10T22:41:22.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.628+0000 7f1615800640 1 -- 172.21.15.103:0/1783745530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16100b4910 con 0x7f161015f1a0 2024-09-10T22:41:22.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.628+0000 7f1607400640 1 -- 172.21.15.103:0/1783745530 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1608003600 con 0x7f161015f1a0 2024-09-10T22:41:22.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.628+0000 7f1615800640 1 -- 172.21.15.103:0/1783745530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16100b4ed0 con 0x7f161015f1a0 2024-09-10T22:41:22.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.628+0000 7f1615800640 1 -- 172.21.15.103:0/1783745530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f161015f890 con 0x7f161015f1a0 2024-09-10T22:41:22.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.628+0000 7f1607400640 1 -- 172.21.15.103:0/1783745530 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f16080037a0 con 0x7f161015f1a0 2024-09-10T22:41:22.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.628+0000 7f1607400640 1 --2- 172.21.15.103:0/1783745530 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f15ec0725e0 0x7f15ec074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:22.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.632+0000 7f1607400640 1 -- 172.21.15.103:0/1783745530 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f160812df40 con 0x7f161015f1a0 2024-09-10T22:41:22.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.632+0000 7f160ea00640 1 --2- 172.21.15.103:0/1783745530 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f15ec0725e0 0x7f15ec074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:22.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.632+0000 7f160ea00640 1 --2- 172.21.15.103:0/1783745530 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f15ec0725e0 0x7f15ec074aa0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1600001870 tx=0x7f1600001380 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:22.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.632+0000 7f1607400640 1 -- 172.21.15.103:0/1783745530 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f16080c9020 con 0x7f161015f1a0 2024-09-10T22:41:22.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.832+0000 7f1615800640 1 -- 172.21.15.103:0/1783745530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16100b2740 con 0x7f161015f1a0 2024-09-10T22:41:22.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.832+0000 7f1607400640 1 -- 172.21.15.103:0/1783745530 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5270 (secure 0 0 0) 0x7f1608016410 con 0x7f161015f1a0 2024-09-10T22:41:22.839 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:22.839 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":40,"btime":"2024-09-10T22:41:22:083564+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/1187797704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1187797704},{"type":"v1","addr":"172.21.15.131:6836","nonce":1187797704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:41:06.381695+0000","modified":"2024-09-10T22:41:22.083552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5547,"mds_1":5544,"mds_2":5153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5153":{"gid":5153,"name":"d","rank":2,"incarnation":39,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6837/3348473142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3348473142},{"type":"v1","addr":"172.21.15.131:6837","nonce":3348473142}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5544":{"gid":5544,"name":"c","rank":1,"incarnation":37,"state":"up:active","state_seq":6,"addr":"172.21.15.103:6834/3910783847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":3910783847},{"type":"v1","addr":"172.21.15.103:6834","nonce":3910783847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5547":{"gid":5547,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/343761048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":343761048},{"type":"v1","addr":"172.21.15.103:6835","nonce":343761048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5547,"qdb_cluster":[5153,5544,5547]},"id":3}]} 2024-09-10T22:41:22.840 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 40 2024-09-10T22:41:22.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.836+0000 7f1615800640 1 -- 172.21.15.103:0/1783745530 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f15ec0725e0 msgr2=0x7f15ec074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:22.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.836+0000 7f1615800640 1 --2- 172.21.15.103:0/1783745530 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f15ec0725e0 0x7f15ec074aa0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1600001870 tx=0x7f1600001380 comp rx=0 tx=0).stop 2024-09-10T22:41:22.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.836+0000 7f1615800640 1 -- 172.21.15.103:0/1783745530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f161015f1a0 msgr2=0x7f1610158b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:22.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.836+0000 7f1615800640 1 --2- 172.21.15.103:0/1783745530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f161015f1a0 0x7f1610158b80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1608009790 tx=0x7f1608005db0 comp rx=0 tx=0).stop 2024-09-10T22:41:22.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.836+0000 7f1615800640 1 -- 172.21.15.103:0/1783745530 shutdown_connections 2024-09-10T22:41:22.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.836+0000 7f1615800640 1 --2- 172.21.15.103:0/1783745530 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f15ec0725e0 0x7f15ec074aa0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:22.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.836+0000 7f1615800640 1 --2- 172.21.15.103:0/1783745530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f161015f1a0 0x7f1610158b80 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:22.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.836+0000 7f1615800640 1 --2- 172.21.15.103:0/1783745530 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16100cdd00 0x7f16100b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:22.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.836+0000 7f1615800640 1 --2- 172.21.15.103:0/1783745530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16100cd500 0x7f1610153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:22.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.836+0000 7f1615800640 1 -- 172.21.15.103:0/1783745530 >> 172.21.15.103:0/1783745530 conn(0x7f16100d1a20 msgr2=0x7f161015a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:22.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.836+0000 7f1615800640 1 -- 172.21.15.103:0/1783745530 shutdown_connections 2024-09-10T22:41:22.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:22.836+0000 7f1615800640 1 -- 172.21.15.103:0/1783745530 wait complete. 2024-09-10T22:41:22.958 INFO:tasks.ceph.mds.a.smithi103.stderr:2024-09-10T22:41:22.956+0000 7faa08e00640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-10T22:41:22.958 INFO:tasks.ceph.mds.a.smithi103.stderr:2024-09-10T22:41:22.956+0000 7faa08e00640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-10T22:41:23.264 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:41:06.381695+0000', 'modified': '2024-09-10T22:41:22.083552+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 5547, 'mds_1': 5544, 'mds_2': 5153}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5153': {'gid': 5153, 'name': 'd', 'rank': 2, 'incarnation': 39, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.131:6837/3348473142', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6835', 'nonce': 3348473142}, {'type': 'v1', 'addr': '172.21.15.131:6837', 'nonce': 3348473142}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5544': {'gid': 5544, 'name': 'c', 'rank': 1, 'incarnation': 37, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.103:6834/3910783847', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6833', 'nonce': 3910783847}, {'type': 'v1', 'addr': '172.21.15.103:6834', 'nonce': 3910783847}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5547': {'gid': 5547, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/343761048', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6832', 'nonce': 343761048}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 343761048}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5547, 'qdb_cluster': [5153, 5544, 5547]} 2024-09-10T22:41:23.264 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T22:41:23.264 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T22:41:23.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f6905a00640 1 -- 172.21.15.103:0/4238647658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69000d4750 msgr2=0x7f69000d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f6905a00640 1 --2- 172.21.15.103:0/4238647658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69000d4750 0x7f69000d1830 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009c80 tx=0x7f68f801f5a0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f6905a00640 1 -- 172.21.15.103:0/4238647658 shutdown_connections 2024-09-10T22:41:23.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f6905a00640 1 --2- 172.21.15.103:0/4238647658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69000d4750 0x7f69000d1830 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f6905a00640 1 -- 172.21.15.103:0/4238647658 >> 172.21.15.103:0/4238647658 conn(0x7f69000d3c60 msgr2=0x7f69000d4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:23.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f6905a00640 1 -- 172.21.15.103:0/4238647658 shutdown_connections 2024-09-10T22:41:23.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f6905a00640 1 -- 172.21.15.103:0/4238647658 wait complete. 2024-09-10T22:41:23.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f6905a00640 1 Processor -- start 2024-09-10T22:41:23.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f6905a00640 1 -- start start 2024-09-10T22:41:23.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f6905a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69000d21a0 0x7f69001f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f6905a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69000d4750 0x7f69000cff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f6905a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69000b9090 0x7f69000b94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f6905a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f69000b40e0 con 0x7f69000d4750 2024-09-10T22:41:23.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f6905a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f69000b3f60 con 0x7f69000d21a0 2024-09-10T22:41:23.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f6905a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f69000b4260 con 0x7f69000b9090 2024-09-10T22:41:23.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f68f6000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69000d4750 0x7f69000cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f68f6000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69000d4750 0x7f69000cff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55798/0 (socket says 172.21.15.103:55798) 2024-09-10T22:41:23.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f68f6000640 1 -- 172.21.15.103:0/2586918620 learned_addr learned my addr 172.21.15.103:0/2586918620 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:23.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f68f6000640 1 -- 172.21.15.103:0/2586918620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69000b9090 msgr2=0x7f69000b94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f68f6000640 1 --2- 172.21.15.103:0/2586918620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69000b9090 0x7f69000b94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f68f6000640 1 -- 172.21.15.103:0/2586918620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69000d21a0 msgr2=0x7f69001f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f68f6000640 1 --2- 172.21.15.103:0/2586918620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69000d21a0 0x7f69001f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.404+0000 7f68f6000640 1 -- 172.21.15.103:0/2586918620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69000b7d90 con 0x7f69000d4750 2024-09-10T22:41:23.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.408+0000 7f68f6000640 1 --2- 172.21.15.103:0/2586918620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69000d4750 0x7f69000cff60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f68e800c3c0 tx=0x7f68e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:23.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.408+0000 7f68f7400640 1 -- 172.21.15.103:0/2586918620 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8017070 con 0x7f69000d4750 2024-09-10T22:41:23.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.408+0000 7f68f7400640 1 -- 172.21.15.103:0/2586918620 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68e8003600 con 0x7f69000d4750 2024-09-10T22:41:23.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.408+0000 7f68f7400640 1 -- 172.21.15.103:0/2586918620 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8003a50 con 0x7f69000d4750 2024-09-10T22:41:23.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.408+0000 7f6905a00640 1 -- 172.21.15.103:0/2586918620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69000b8070 con 0x7f69000d4750 2024-09-10T22:41:23.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.408+0000 7f6905a00640 1 -- 172.21.15.103:0/2586918620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69000b8630 con 0x7f69000d4750 2024-09-10T22:41:23.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.408+0000 7f68f7400640 1 -- 172.21.15.103:0/2586918620 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f68e8003bf0 con 0x7f69000d4750 2024-09-10T22:41:23.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.408+0000 7f68f7400640 1 --2- 172.21.15.103:0/2586918620 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f68dc0725e0 0x7f68dc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.408+0000 7f68f7400640 1 -- 172.21.15.103:0/2586918620 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f68e8092910 con 0x7f69000d4750 2024-09-10T22:41:23.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f6908d46000 1 Processor -- start 2024-09-10T22:41:23.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f6908d46000 1 -- start start 2024-09-10T22:41:23.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f68fea00640 1 --2- 172.21.15.103:0/2586918620 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f68dc0725e0 0x7f68dc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f6908d46000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f689d0 0x563341f68db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f6908d46000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f692f0 0x563341f1c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f6908d46000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f1ce10 0x563341f1d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f6908d46000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563341e3d3f0 con 0x563341f1ce10 2024-09-10T22:41:23.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f6908d46000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563341d7ab20 con 0x563341f689d0 2024-09-10T22:41:23.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f6908d46000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563341d69f50 con 0x563341f692f0 2024-09-10T22:41:23.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f68fea00640 1 --2- 172.21.15.103:0/2586918620 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f68dc0725e0 0x7f68dc074aa0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f68f0007fd0 tx=0x7f68f0007980 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:23.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f68ff400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f1ce10 0x563341f1d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f68fea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f689d0 0x563341f68db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f68f6000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f692f0 0x563341f1c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f68ff400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f1ce10 0x563341f1d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55808/0 (socket says 172.21.15.103:55808) 2024-09-10T22:41:23.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f68ff400640 1 -- 172.21.15.103:0/3746816173 learned_addr learned my addr 172.21.15.103:0/3746816173 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:23.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f68fea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f689d0 0x563341f68db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:37010/0 (socket says 172.21.15.103:37010) 2024-09-10T22:41:23.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f68f6000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f692f0 0x563341f1c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:41794/0 (socket says 172.21.15.103:41794) 2024-09-10T22:41:23.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f68ff400640 1 -- 172.21.15.103:0/3746816173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f692f0 msgr2=0x563341f1c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f68ff400640 1 --2- 172.21.15.103:0/3746816173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f692f0 0x563341f1c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f68ff400640 1 -- 172.21.15.103:0/3746816173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f689d0 msgr2=0x563341f68db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f68ff400640 1 --2- 172.21.15.103:0/3746816173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f689d0 0x563341f68db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f68ff400640 1 -- 172.21.15.103:0/3746816173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563341d31590 con 0x563341f1ce10 2024-09-10T22:41:23.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f68ff400640 1 --2- 172.21.15.103:0/3746816173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f1ce10 0x563341f1d1f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f68f801c1b0 tx=0x7f68f8009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b0f83ff43339a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:23.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f68ef400640 1 -- 172.21.15.103:0/3746816173 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f8004c50 con 0x563341f1ce10 2024-09-10T22:41:23.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f68ef400640 1 -- 172.21.15.103:0/3746816173 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68f80bd030 con 0x563341f1ce10 2024-09-10T22:41:23.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f68ef400640 1 -- 172.21.15.103:0/3746816173 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f8003c60 con 0x563341f1ce10 2024-09-10T22:41:23.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f6908d46000 1 -- 172.21.15.103:0/3746816173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f1ce10 msgr2=0x563341f1d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f6908d46000 1 --2- 172.21.15.103:0/3746816173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f1ce10 0x563341f1d1f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f68f801c1b0 tx=0x7f68f8009370 comp rx=0 tx=0).stop 2024-09-10T22:41:23.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f6908d46000 1 -- 172.21.15.103:0/3746816173 shutdown_connections 2024-09-10T22:41:23.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f6908d46000 1 --2- 172.21.15.103:0/3746816173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f1ce10 0x563341f1d1f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f6908d46000 1 --2- 172.21.15.103:0/3746816173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f692f0 0x563341f1c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f6908d46000 1 --2- 172.21.15.103:0/3746816173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f689d0 0x563341f68db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f6908d46000 1 -- 172.21.15.103:0/3746816173 >> 172.21.15.103:0/3746816173 conn(0x563341e06130 msgr2=0x563341f4be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:23.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f6908d46000 1 -- 172.21.15.103:0/3746816173 shutdown_connections 2024-09-10T22:41:23.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f6908d46000 1 -- 172.21.15.103:0/3746816173 wait complete. 2024-09-10T22:41:23.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.412+0000 7f6908d46000 1 -- start start 2024-09-10T22:41:23.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f6908d46000 1 Processor -- start 2024-09-10T22:41:23.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f6908d46000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f1ce10 0x563341f496a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f6908d46000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f689d0 0x563341f49e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f6908d46000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f692f0 0x563341f4a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f6908d46000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563341d045d0 con 0x563341f692f0 2024-09-10T22:41:23.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f6908d46000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563341d6dd60 con 0x563341f1ce10 2024-09-10T22:41:23.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f6908d46000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563341d10500 con 0x563341f689d0 2024-09-10T22:41:23.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f6908d46000 10 client.0 _ll_register_callbacks cb 0x563341d14810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:23.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68ff400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f692f0 0x563341f4a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68ff400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f692f0 0x563341f4a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55810/0 (socket says 172.21.15.103:55810) 2024-09-10T22:41:23.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68ff400640 1 -- 172.21.15.103:0/1105764744 learned_addr learned my addr 172.21.15.103:0/1105764744 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:23.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68f6000640 1 --2- 172.21.15.103:0/1105764744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f689d0 0x563341f49e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68fea00640 1 --2- 172.21.15.103:0/1105764744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f1ce10 0x563341f496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68ff400640 1 -- 172.21.15.103:0/1105764744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f689d0 msgr2=0x563341f49e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68ff400640 1 --2- 172.21.15.103:0/1105764744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f689d0 0x563341f49e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68ff400640 1 -- 172.21.15.103:0/1105764744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f1ce10 msgr2=0x563341f496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68ff400640 1 --2- 172.21.15.103:0/1105764744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f1ce10 0x563341f496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68ff400640 1 -- 172.21.15.103:0/1105764744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563341d08170 con 0x563341f692f0 2024-09-10T22:41:23.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68fea00640 1 --2- 172.21.15.103:0/1105764744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f1ce10 0x563341f496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:23.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68ff400640 1 --2- 172.21.15.103:0/1105764744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f692f0 0x563341f4a3b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f68f801dc50 tx=0x7f68f80c2420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8b72ecb21f91f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:23.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68e3e00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:23.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68e3e00640 1 -- 172.21.15.103:0/1105764744 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f80cf060 con 0x563341f692f0 2024-09-10T22:41:23.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f6908d46000 1 -- 172.21.15.103:0/1105764744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563341d020f0 con 0x563341f692f0 2024-09-10T22:41:23.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68e3e00640 1 -- 172.21.15.103:0/1105764744 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f68f80c2810 con 0x563341f692f0 2024-09-10T22:41:23.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68e3e00640 1 -- 172.21.15.103:0/1105764744 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f68f80d5050 con 0x563341f692f0 2024-09-10T22:41:23.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f6908d46000 10 client.5751 fetch_fsmap learned FSMap version 40 2024-09-10T22:41:23.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f6908d46000 1 -- 172.21.15.103:0/1105764744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x563341deeef0 con 0x563341f692f0 2024-09-10T22:41:23.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68e3e00640 1 -- 172.21.15.103:0/1105764744 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563341d020f0 con 0x563341f692f0 2024-09-10T22:41:23.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68e3e00640 1 -- 172.21.15.103:0/1105764744 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 40) ==== 3542+0+0 (secure 0 0 0) 0x7f68f80d8020 con 0x563341f692f0 2024-09-10T22:41:23.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f6908d46000 10 client.5751 fetch_fsmap finished waiting for FSMap version 40 2024-09-10T22:41:23.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f6908d46000 10 client.5751 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T22:41:23.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f6908d46000 20 client.5751 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:23.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f6908d46000 1 --2- 172.21.15.103:0/1105764744 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x563341f4b0f0 0x563341f7ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f6908d46000 4 client.5751 mds_command: new command op to 5153 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:41:23.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f6908d46000 1 -- 172.21.15.103:0/1105764744 --> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563341d7ca70 con 0x563341f4b0f0 2024-09-10T22:41:23.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.416+0000 7f68fea00640 1 --2- 172.21.15.103:0/1105764744 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x563341f4b0f0 0x563341f7ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.424+0000 7f68fea00640 1 --2- 172.21.15.103:0/1105764744 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x563341f4b0f0 0x563341f7ac90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=85fb4886d0c21f5a server_cookie=a82d8067e5df0fc3 in_seq=0 out_seq=0 2024-09-10T22:41:23.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.424+0000 7f68e3e00640 10 client.5751 ms_handle_connect on v2:172.21.15.131:6835/3348473142 2024-09-10T22:41:23.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.424+0000 7f68e3e00640 1 -- 172.21.15.103:0/1105764744 <== mds.2 v2:172.21.15.131:6835/3348473142 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563341d7ca70 con 0x563341f4b0f0 2024-09-10T22:41:23.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.424+0000 7f68e3e00640 10 client.5751 handle_command_reply: tid=0 2024-09-10T22:41:23.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.424+0000 7f6908d46000 1 client.5751 shutdown 2024-09-10T22:41:23.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.424+0000 7f6908d46000 1 -- 172.21.15.103:0/1105764744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f692f0 msgr2=0x563341f4a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.424+0000 7f6908d46000 1 --2- 172.21.15.103:0/1105764744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f692f0 0x563341f4a3b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f68f801dc50 tx=0x7f68f80c2420 comp rx=0 tx=0).stop 2024-09-10T22:41:23.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.424+0000 7f6908d46000 1 -- 172.21.15.103:0/1105764744 shutdown_connections 2024-09-10T22:41:23.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.424+0000 7f6908d46000 1 --2- 172.21.15.103:0/1105764744 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x563341f4b0f0 0x563341f7ac90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.424+0000 7f6908d46000 1 --2- 172.21.15.103:0/1105764744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f692f0 0x563341f4a3b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.424+0000 7f6908d46000 1 --2- 172.21.15.103:0/1105764744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f689d0 0x563341f49e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.424+0000 7f68e3e00640 0 client.5751 ms_handle_reset on v2:172.21.15.131:6835/3348473142 2024-09-10T22:41:23.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.424+0000 7f6908d46000 1 --2- 172.21.15.103:0/1105764744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f1ce10 0x563341f496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.424+0000 7f6908d46000 1 -- 172.21.15.103:0/1105764744 >> 172.21.15.103:0/1105764744 conn(0x563341e06130 msgr2=0x563341f1bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:23.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.424+0000 7f6908d46000 1 -- 172.21.15.103:0/1105764744 shutdown_connections 2024-09-10T22:41:23.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.424+0000 7f6908d46000 1 -- 172.21.15.103:0/1105764744 wait complete. 2024-09-10T22:41:23.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.424+0000 7f6908d46000 20 client.5751 trim_cache size 0 max 16384 2024-09-10T22:41:23.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 Processor -- start 2024-09-10T22:41:23.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- start start 2024-09-10T22:41:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f1ce10 0x563341fdabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f689d0 0x563341fdb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f692f0 0x563341fdb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f69002014b0 con 0x563341f1ce10 2024-09-10T22:41:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6900200710 con 0x563341f689d0 2024-09-10T22:41:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6900200de0 con 0x563341f692f0 2024-09-10T22:41:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68fea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f1ce10 0x563341fdabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68fea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f1ce10 0x563341fdabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55824/0 (socket says 172.21.15.103:55824) 2024-09-10T22:41:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68fea00640 1 -- 172.21.15.103:0/3070715214 learned_addr learned my addr 172.21.15.103:0/3070715214 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68f6000640 1 --2- 172.21.15.103:0/3070715214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f689d0 0x563341fdb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68ff400640 1 --2- 172.21.15.103:0/3070715214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f692f0 0x563341fdb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68fea00640 1 -- 172.21.15.103:0/3070715214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f692f0 msgr2=0x563341fdb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68fea00640 1 --2- 172.21.15.103:0/3070715214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f692f0 0x563341fdb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68fea00640 1 -- 172.21.15.103:0/3070715214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f689d0 msgr2=0x563341fdb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68fea00640 1 --2- 172.21.15.103:0/3070715214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f689d0 0x563341fdb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68fea00640 1 -- 172.21.15.103:0/3070715214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563341dc5d90 con 0x563341f1ce10 2024-09-10T22:41:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68fea00640 1 --2- 172.21.15.103:0/3070715214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f1ce10 0x563341fdabc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f68f0000f70 tx=0x7f68f0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4565a98d17d00f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68eea00640 1 -- 172.21.15.103:0/3070715214 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f0003680 con 0x563341f1ce10 2024-09-10T22:41:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68eea00640 1 -- 172.21.15.103:0/3070715214 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68f0003820 con 0x563341f1ce10 2024-09-10T22:41:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68eea00640 1 -- 172.21.15.103:0/3070715214 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f0003bf0 con 0x563341f1ce10 2024-09-10T22:41:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- 172.21.15.103:0/3070715214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f1ce10 msgr2=0x563341fdabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 --2- 172.21.15.103:0/3070715214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f1ce10 0x563341fdabc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f68f0000f70 tx=0x7f68f0012000 comp rx=0 tx=0).stop 2024-09-10T22:41:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- 172.21.15.103:0/3070715214 shutdown_connections 2024-09-10T22:41:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 --2- 172.21.15.103:0/3070715214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f692f0 0x563341fdb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 --2- 172.21.15.103:0/3070715214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f689d0 0x563341fdb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 --2- 172.21.15.103:0/3070715214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f1ce10 0x563341fdabc0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- 172.21.15.103:0/3070715214 >> 172.21.15.103:0/3070715214 conn(0x563341e06130 msgr2=0x563341f75fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:23.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- 172.21.15.103:0/3070715214 shutdown_connections 2024-09-10T22:41:23.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- 172.21.15.103:0/3070715214 wait complete. 2024-09-10T22:41:23.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- start start 2024-09-10T22:41:23.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 Processor -- start 2024-09-10T22:41:23.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f1ce10 0x563341f7c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f689d0 0x563341f7ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f692f0 0x563341f7d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563341d72390 con 0x563341f689d0 2024-09-10T22:41:23.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563341d798f0 con 0x563341f692f0 2024-09-10T22:41:23.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563341deea60 con 0x563341f1ce10 2024-09-10T22:41:23.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 10 client.0 _ll_register_callbacks cb 0x7f68f0001300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:23.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68f6000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f689d0 0x563341f7ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68f6000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f689d0 0x563341f7ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55832/0 (socket says 172.21.15.103:55832) 2024-09-10T22:41:23.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68f6000640 1 -- 172.21.15.103:0/761117927 learned_addr learned my addr 172.21.15.103:0/761117927 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:23.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68fea00640 1 --2- 172.21.15.103:0/761117927 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f1ce10 0x563341f7c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68ff400640 1 --2- 172.21.15.103:0/761117927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f692f0 0x563341f7d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68f6000640 1 -- 172.21.15.103:0/761117927 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f1ce10 msgr2=0x563341f7c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68f6000640 1 --2- 172.21.15.103:0/761117927 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f1ce10 0x563341f7c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68f6000640 1 -- 172.21.15.103:0/761117927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f692f0 msgr2=0x563341f7d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68f6000640 1 --2- 172.21.15.103:0/761117927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f692f0 0x563341f7d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68f6000640 1 -- 172.21.15.103:0/761117927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563341d30a90 con 0x563341f689d0 2024-09-10T22:41:23.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68f6000640 1 --2- 172.21.15.103:0/761117927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f689d0 0x563341f7ccd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f68e8000fc0 tx=0x7f68e805cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d662eeac9c5606 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:23.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68e3e00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:23.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68e3e00640 1 -- 172.21.15.103:0/761117927 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e805de60 con 0x563341f689d0 2024-09-10T22:41:23.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68e3e00640 1 -- 172.21.15.103:0/761117927 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f68e8064650 con 0x563341f689d0 2024-09-10T22:41:23.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- 172.21.15.103:0/761117927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68f0003820 con 0x563341f689d0 2024-09-10T22:41:23.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68e3e00640 1 -- 172.21.15.103:0/761117927 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f68e805d760 con 0x563341f689d0 2024-09-10T22:41:23.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 10 client.5757 fetch_fsmap learned FSMap version 40 2024-09-10T22:41:23.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- 172.21.15.103:0/761117927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x563341d0f050 con 0x563341f689d0 2024-09-10T22:41:23.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68e3e00640 1 -- 172.21.15.103:0/761117927 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68f0003820 con 0x563341f689d0 2024-09-10T22:41:23.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68e3e00640 1 -- 172.21.15.103:0/761117927 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 40) ==== 3542+0+0 (secure 0 0 0) 0x7f68e8075020 con 0x563341f689d0 2024-09-10T22:41:23.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 10 client.5757 fetch_fsmap finished waiting for FSMap version 40 2024-09-10T22:41:23.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 10 client.5757 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T22:41:23.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 20 client.5757 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:23.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 --2- 172.21.15.103:0/761117927 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x563341f7db40 0x563341fe6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 4 client.5757 mds_command: new command op to 5153 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:41:23.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- 172.21.15.103:0/761117927 --> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] -- command(tid 0: {"prefix": "status"}) -- 0x563341d78520 con 0x563341f7db40 2024-09-10T22:41:23.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68fea00640 1 --2- 172.21.15.103:0/761117927 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x563341f7db40 0x563341fe6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68fea00640 1 --2- 172.21.15.103:0/761117927 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x563341f7db40 0x563341fe6c40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=85bde441d4b3d429 server_cookie=6d21e002616dc069 in_seq=0 out_seq=0 2024-09-10T22:41:23.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68e3e00640 10 client.5757 ms_handle_connect on v2:172.21.15.131:6835/3348473142 2024-09-10T22:41:23.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68e3e00640 1 -- 172.21.15.103:0/761117927 <== mds.2 v2:172.21.15.131:6835/3348473142 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x563341d78520 con 0x563341f7db40 2024-09-10T22:41:23.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68e3e00640 10 client.5757 handle_command_reply: tid=0 2024-09-10T22:41:23.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 client.5757 shutdown 2024-09-10T22:41:23.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- 172.21.15.103:0/761117927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f689d0 msgr2=0x563341f7ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 --2- 172.21.15.103:0/761117927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f689d0 0x563341f7ccd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f68e8000fc0 tx=0x7f68e805cf40 comp rx=0 tx=0).stop 2024-09-10T22:41:23.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- 172.21.15.103:0/761117927 shutdown_connections 2024-09-10T22:41:23.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 --2- 172.21.15.103:0/761117927 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x563341f7db40 0x563341fe6c40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 --2- 172.21.15.103:0/761117927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563341f692f0 0x563341f7d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 --2- 172.21.15.103:0/761117927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563341f689d0 0x563341f7ccd0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f68e3e00640 0 client.5757 ms_handle_reset on v2:172.21.15.131:6835/3348473142 2024-09-10T22:41:23.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 --2- 172.21.15.103:0/761117927 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563341f1ce10 0x563341f7c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.444+0000 7f6908d46000 1 -- 172.21.15.103:0/761117927 >> 172.21.15.103:0/761117927 conn(0x563341e06130 msgr2=0x563341f24b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:23.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.448+0000 7f6908d46000 1 -- 172.21.15.103:0/761117927 shutdown_connections 2024-09-10T22:41:23.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.448+0000 7f6908d46000 1 -- 172.21.15.103:0/761117927 wait complete. 2024-09-10T22:41:23.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.448+0000 7f6908d46000 20 client.5757 trim_cache size 0 max 16384 2024-09-10T22:41:23.459 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:41:23.459 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:41:23.459 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 2, 2024-09-10T22:41:23.459 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5153, 2024-09-10T22:41:23.460 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:41:23.460 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:41:23.460 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:41:23.460 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 2.3671650190000002, 2024-09-10T22:41:23.460 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 40, 2024-09-10T22:41:23.460 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 55, 2024-09-10T22:41:23.460 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 55, 2024-09-10T22:41:23.460 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 20.962252040999999 2024-09-10T22:41:23.460 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:41:23.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.448+0000 7f6905a00640 1 -- 172.21.15.103:0/2586918620 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f68dc0725e0 msgr2=0x7f68dc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.448+0000 7f6905a00640 1 --2- 172.21.15.103:0/2586918620 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f68dc0725e0 0x7f68dc074aa0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f68f0007fd0 tx=0x7f68f0007980 comp rx=0 tx=0).stop 2024-09-10T22:41:23.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.448+0000 7f6905a00640 1 -- 172.21.15.103:0/2586918620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69000d4750 msgr2=0x7f69000cff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.448+0000 7f6905a00640 1 --2- 172.21.15.103:0/2586918620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69000d4750 0x7f69000cff60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f68e800c3c0 tx=0x7f68e800c880 comp rx=0 tx=0).stop 2024-09-10T22:41:23.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.448+0000 7f6905a00640 1 -- 172.21.15.103:0/2586918620 shutdown_connections 2024-09-10T22:41:23.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.448+0000 7f6905a00640 1 --2- 172.21.15.103:0/2586918620 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f68dc0725e0 0x7f68dc074aa0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.448+0000 7f6905a00640 1 --2- 172.21.15.103:0/2586918620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69000b9090 0x7f69000b94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.448+0000 7f6905a00640 1 --2- 172.21.15.103:0/2586918620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69000d4750 0x7f69000cff60 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.448+0000 7f6905a00640 1 --2- 172.21.15.103:0/2586918620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69000d21a0 0x7f69001f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.448+0000 7f6905a00640 1 -- 172.21.15.103:0/2586918620 >> 172.21.15.103:0/2586918620 conn(0x7f69000d3c60 msgr2=0x7f69000d4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:23.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.448+0000 7f6905a00640 1 -- 172.21.15.103:0/2586918620 shutdown_connections 2024-09-10T22:41:23.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.448+0000 7f6905a00640 1 -- 172.21.15.103:0/2586918620 wait complete. 2024-09-10T22:41:23.472 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T22:41:23.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 -- 172.21.15.103:0/1628803987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4cc15be30 msgr2=0x7fe4cc0ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 --2- 172.21.15.103:0/1628803987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4cc15be30 0x7fe4cc0ce0c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc15f970 tx=0x7fe4bc01c830 comp rx=0 tx=0).stop 2024-09-10T22:41:23.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 -- 172.21.15.103:0/1628803987 shutdown_connections 2024-09-10T22:41:23.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 --2- 172.21.15.103:0/1628803987 >> v2:172.21.15.131:3300/0 conn(0x7fe4cc0ceb40 0x7fe4cc0cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 --2- 172.21.15.103:0/1628803987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4cc0b09c0 0x7fe4cc0ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 --2- 172.21.15.103:0/1628803987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4cc15be30 0x7fe4cc0ce0c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 -- 172.21.15.103:0/1628803987 >> 172.21.15.103:0/1628803987 conn(0x7fe4cc0d1ac0 msgr2=0x7fe4cc0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:23.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 -- 172.21.15.103:0/1628803987 shutdown_connections 2024-09-10T22:41:23.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 -- 172.21.15.103:0/1628803987 wait complete. 2024-09-10T22:41:23.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 Processor -- start 2024-09-10T22:41:23.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 -- start start 2024-09-10T22:41:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4cc0b09c0 0x7fe4cc1fb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4cc0ceb40 0x7fe4cc14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4cc15be30 0x7fe4cc06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc0aed50 con 0x7fe4cc0ceb40 2024-09-10T22:41:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc0aebd0 con 0x7fe4cc15be30 2024-09-10T22:41:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe4cc0aeed0 con 0x7fe4cc0b09c0 2024-09-10T22:41:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4c3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4cc0ceb40 0x7fe4cc14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4c3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4cc0ceb40 0x7fe4cc14dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55844/0 (socket says 172.21.15.103:55844) 2024-09-10T22:41:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4c3e00640 1 -- 172.21.15.103:0/2388526706 learned_addr learned my addr 172.21.15.103:0/2388526706 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4caa00640 1 --2- 172.21.15.103:0/2388526706 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4cc0b09c0 0x7fe4cc1fb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4cb400640 1 --2- 172.21.15.103:0/2388526706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4cc15be30 0x7fe4cc06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4c3e00640 1 -- 172.21.15.103:0/2388526706 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4cc0b09c0 msgr2=0x7fe4cc1fb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4c3e00640 1 --2- 172.21.15.103:0/2388526706 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4cc0b09c0 0x7fe4cc1fb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4c3e00640 1 -- 172.21.15.103:0/2388526706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4cc15be30 msgr2=0x7fe4cc06ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4c3e00640 1 --2- 172.21.15.103:0/2388526706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4cc15be30 0x7fe4cc06ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4c3e00640 1 -- 172.21.15.103:0/2388526706 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4cc06ded0 con 0x7fe4cc0ceb40 2024-09-10T22:41:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4cb400640 1 --2- 172.21.15.103:0/2388526706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4cc15be30 0x7fe4cc06ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4c3e00640 1 --2- 172.21.15.103:0/2388526706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4cc0ceb40 0x7fe4cc14dce0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400c940 tx=0x7fe4b400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4c2a00640 1 -- 172.21.15.103:0/2388526706 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4007bb0 con 0x7fe4cc0ceb40 2024-09-10T22:41:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4c2a00640 1 -- 172.21.15.103:0/2388526706 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4b400f450 con 0x7fe4cc0ceb40 2024-09-10T22:41:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4c2a00640 1 -- 172.21.15.103:0/2388526706 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4007e60 con 0x7fe4cc0ceb40 2024-09-10T22:41:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 -- 172.21.15.103:0/2388526706 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4cc06e1b0 con 0x7fe4cc0ceb40 2024-09-10T22:41:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.612+0000 7fe4d1a00640 1 -- 172.21.15.103:0/2388526706 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4cc06e770 con 0x7fe4cc0ceb40 2024-09-10T22:41:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.620+0000 7fe4c2a00640 1 -- 172.21.15.103:0/2388526706 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe4b400f8a0 con 0x7fe4cc0ceb40 2024-09-10T22:41:23.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.620+0000 7fe4c2a00640 1 --2- 172.21.15.103:0/2388526706 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4a80725e0 0x7fe4a8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.620+0000 7fe4c2a00640 1 -- 172.21.15.103:0/2388526706 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fe4b4093cb0 con 0x7fe4cc0ceb40 2024-09-10T22:41:23.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.620+0000 7fe4d4e6e000 1 Processor -- start 2024-09-10T22:41:23.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.620+0000 7fe4caa00640 1 --2- 172.21.15.103:0/2388526706 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4a80725e0 0x7fe4a8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.620+0000 7fe4d4e6e000 1 -- start start 2024-09-10T22:41:23.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.620+0000 7fe4caa00640 1 --2- 172.21.15.103:0/2388526706 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4a80725e0 0x7fe4a8074aa0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0af000 tx=0x7fe4bc01b070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.620+0000 7fe4d4e6e000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fc9d0 0x55603d7fcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.620+0000 7fe4d4e6e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7fd2f0 0x55603d7b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.620+0000 7fe4d4e6e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7b0e10 0x55603d7b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.620+0000 7fe4d4e6e000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55603d6d13f0 con 0x55603d7fc9d0 2024-09-10T22:41:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.620+0000 7fe4d4e6e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55603d60eb20 con 0x55603d7b0e10 2024-09-10T22:41:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.620+0000 7fe4d4e6e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55603d5fdf50 con 0x55603d7fd2f0 2024-09-10T22:41:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.620+0000 7fe4caa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fc9d0 0x55603d7fcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.620+0000 7fe4caa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fc9d0 0x55603d7fcdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55858/0 (socket says 172.21.15.103:55858) 2024-09-10T22:41:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.620+0000 7fe4caa00640 1 -- 172.21.15.103:0/2329475030 learned_addr learned my addr 172.21.15.103:0/2329475030 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:23.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4c3e00640 1 --2- 172.21.15.103:0/2329475030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7fd2f0 0x55603d7b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4cb400640 1 --2- 172.21.15.103:0/2329475030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7b0e10 0x55603d7b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4caa00640 1 -- 172.21.15.103:0/2329475030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7fd2f0 msgr2=0x55603d7b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4caa00640 1 --2- 172.21.15.103:0/2329475030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7fd2f0 0x55603d7b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4caa00640 1 -- 172.21.15.103:0/2329475030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7b0e10 msgr2=0x55603d7b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4caa00640 1 --2- 172.21.15.103:0/2329475030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7b0e10 0x55603d7b11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4caa00640 1 -- 172.21.15.103:0/2329475030 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55603d5c5590 con 0x55603d7fc9d0 2024-09-10T22:41:23.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4c3e00640 1 --2- 172.21.15.103:0/2329475030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7fd2f0 0x55603d7b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:23.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4cb400640 1 --2- 172.21.15.103:0/2329475030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7b0e10 0x55603d7b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:23.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4caa00640 1 --2- 172.21.15.103:0/2329475030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fc9d0 0x55603d7fcdb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0981d0 tx=0x7fe4bc0b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad8d2e7969ac0ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:23.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4bb400640 1 -- 172.21.15.103:0/2329475030 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc004c20 con 0x55603d7fc9d0 2024-09-10T22:41:23.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4bb400640 1 -- 172.21.15.103:0/2329475030 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4bc0c8070 con 0x55603d7fc9d0 2024-09-10T22:41:23.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4bb400640 1 -- 172.21.15.103:0/2329475030 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc003860 con 0x55603d7fc9d0 2024-09-10T22:41:23.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/2329475030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fc9d0 msgr2=0x55603d7fcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/2329475030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fc9d0 0x55603d7fcdb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0981d0 tx=0x7fe4bc0b7000 comp rx=0 tx=0).stop 2024-09-10T22:41:23.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/2329475030 shutdown_connections 2024-09-10T22:41:23.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/2329475030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7b0e10 0x55603d7b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/2329475030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7fd2f0 0x55603d7b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/2329475030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fc9d0 0x55603d7fcdb0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/2329475030 >> 172.21.15.103:0/2329475030 conn(0x55603d69a130 msgr2=0x55603d7dfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:23.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/2329475030 shutdown_connections 2024-09-10T22:41:23.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/2329475030 wait complete. 2024-09-10T22:41:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 -- start start 2024-09-10T22:41:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 Processor -- start 2024-09-10T22:41:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7b0e10 0x55603d7b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7fc9d0 0x55603d7b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fd2f0 0x55603d7b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55603d5985d0 con 0x55603d7fd2f0 2024-09-10T22:41:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55603d601d60 con 0x55603d7b0e10 2024-09-10T22:41:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55603d5a4500 con 0x55603d7fc9d0 2024-09-10T22:41:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 10 client.0 _ll_register_callbacks cb 0x55603d5a8810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4cb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fd2f0 0x55603d7b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4cb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fd2f0 0x55603d7b2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55866/0 (socket says 172.21.15.103:55866) 2024-09-10T22:41:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4cb400640 1 -- 172.21.15.103:0/3218540134 learned_addr learned my addr 172.21.15.103:0/3218540134 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4c3e00640 1 --2- 172.21.15.103:0/3218540134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7fc9d0 0x55603d7b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4caa00640 1 --2- 172.21.15.103:0/3218540134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7b0e10 0x55603d7b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4cb400640 1 -- 172.21.15.103:0/3218540134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7fc9d0 msgr2=0x55603d7b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4cb400640 1 --2- 172.21.15.103:0/3218540134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7fc9d0 0x55603d7b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4cb400640 1 -- 172.21.15.103:0/3218540134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7b0e10 msgr2=0x55603d7b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4cb400640 1 --2- 172.21.15.103:0/3218540134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7b0e10 0x55603d7b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4cb400640 1 -- 172.21.15.103:0/3218540134 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55603d59c170 con 0x55603d7fd2f0 2024-09-10T22:41:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4cb400640 1 --2- 172.21.15.103:0/3218540134 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fd2f0 0x55603d7b2cc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400f6f0 tx=0x7fe4c400faf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cc2bbcff68ac51 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4afe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4afe00640 1 -- 172.21.15.103:0/3218540134 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4004d30 con 0x55603d7fd2f0 2024-09-10T22:41:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4afe00640 1 -- 172.21.15.103:0/3218540134 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fe4c400a850 con 0x55603d7fd2f0 2024-09-10T22:41:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/3218540134 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55603d5960f0 con 0x55603d7fd2f0 2024-09-10T22:41:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4afe00640 1 -- 172.21.15.103:0/3218540134 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fe4c4021050 con 0x55603d7fd2f0 2024-09-10T22:41:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 10 client.5769 fetch_fsmap learned FSMap version 40 2024-09-10T22:41:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/3218540134 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x55603d682ef0 con 0x55603d7fd2f0 2024-09-10T22:41:23.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4afe00640 1 -- 172.21.15.103:0/3218540134 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55603d5960f0 con 0x55603d7fd2f0 2024-09-10T22:41:23.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4afe00640 1 -- 172.21.15.103:0/3218540134 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 40) ==== 3542+0+0 (secure 0 0 0) 0x7fe4c4024020 con 0x55603d7fd2f0 2024-09-10T22:41:23.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 10 client.5769 fetch_fsmap finished waiting for FSMap version 40 2024-09-10T22:41:23.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 10 client.5769 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:41:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 20 client.5769 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/3218540134 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x55603d80bc70 0x55603d80e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 4 client.5769 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:41:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/3218540134 --> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55603d610a70 con 0x55603d80bc70 2024-09-10T22:41:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4caa00640 1 --2- 172.21.15.103:0/3218540134 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x55603d80bc70 0x55603d80e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4caa00640 1 --2- 172.21.15.103:0/3218540134 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x55603d80bc70 0x55603d80e060 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=68dc0da3ea989136 server_cookie=9bf4ab7148770ed3 in_seq=0 out_seq=0 2024-09-10T22:41:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4afe00640 10 client.5769 ms_handle_connect on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4afe00640 1 -- 172.21.15.103:0/3218540134 <== mds.1 v2:172.21.15.103:6833/3910783847 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55603d610a70 con 0x55603d80bc70 2024-09-10T22:41:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4afe00640 10 client.5769 handle_command_reply: tid=0 2024-09-10T22:41:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 client.5769 shutdown 2024-09-10T22:41:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/3218540134 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fd2f0 msgr2=0x55603d7b2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/3218540134 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fd2f0 0x55603d7b2cc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400f6f0 tx=0x7fe4c400faf0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/3218540134 shutdown_connections 2024-09-10T22:41:23.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/3218540134 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x55603d80bc70 0x55603d80e060 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/3218540134 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fd2f0 0x55603d7b2cc0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/3218540134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7fc9d0 0x55603d7b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4afe00640 0 client.5769 ms_handle_reset on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:23.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/3218540134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7b0e10 0x55603d7b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/3218540134 >> 172.21.15.103:0/3218540134 conn(0x55603d69a130 msgr2=0x55603d7affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:23.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/3218540134 shutdown_connections 2024-09-10T22:41:23.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/3218540134 wait complete. 2024-09-10T22:41:23.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.624+0000 7fe4d4e6e000 20 client.5769 trim_cache size 0 max 16384 2024-09-10T22:41:23.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 Processor -- start 2024-09-10T22:41:23.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 -- start start 2024-09-10T22:41:23.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7b0e10 0x55603d86e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fc9d0 0x55603d86e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7fd2f0 0x55603d86ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc2034b0 con 0x55603d7fc9d0 2024-09-10T22:41:23.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc203b80 con 0x55603d7fd2f0 2024-09-10T22:41:23.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe4cc1f7cc0 con 0x55603d7b0e10 2024-09-10T22:41:23.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4c3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fc9d0 0x55603d86e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4c3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fc9d0 0x55603d86e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55878/0 (socket says 172.21.15.103:55878) 2024-09-10T22:41:23.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4c3e00640 1 -- 172.21.15.103:0/1368069223 learned_addr learned my addr 172.21.15.103:0/1368069223 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:23.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4caa00640 1 --2- 172.21.15.103:0/1368069223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7b0e10 0x55603d86e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4cb400640 1 --2- 172.21.15.103:0/1368069223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7fd2f0 0x55603d86ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4c3e00640 1 -- 172.21.15.103:0/1368069223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7b0e10 msgr2=0x55603d86e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4c3e00640 1 --2- 172.21.15.103:0/1368069223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7b0e10 0x55603d86e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4c3e00640 1 -- 172.21.15.103:0/1368069223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7fd2f0 msgr2=0x55603d86ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4c3e00640 1 --2- 172.21.15.103:0/1368069223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7fd2f0 0x55603d86ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4c3e00640 1 -- 172.21.15.103:0/1368069223 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55603d659d90 con 0x55603d7fc9d0 2024-09-10T22:41:23.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4c3e00640 1 --2- 172.21.15.103:0/1368069223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fc9d0 0x55603d86e900 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe4b405e9f0 tx=0x7fe4b405a980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668ac0bda4be60b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:23.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4baa00640 1 -- 172.21.15.103:0/1368069223 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b401d070 con 0x55603d7fc9d0 2024-09-10T22:41:23.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4baa00640 1 -- 172.21.15.103:0/1368069223 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4b4067f60 con 0x55603d7fc9d0 2024-09-10T22:41:23.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4baa00640 1 -- 172.21.15.103:0/1368069223 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b405ef00 con 0x55603d7fc9d0 2024-09-10T22:41:23.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/1368069223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fc9d0 msgr2=0x55603d86e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/1368069223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fc9d0 0x55603d86e900 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe4b405e9f0 tx=0x7fe4b405a980 comp rx=0 tx=0).stop 2024-09-10T22:41:23.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/1368069223 shutdown_connections 2024-09-10T22:41:23.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/1368069223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7fd2f0 0x55603d86ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/1368069223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7fc9d0 0x55603d86e900 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/1368069223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7b0e10 0x55603d86e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/1368069223 >> 172.21.15.103:0/1368069223 conn(0x55603d69a130 msgr2=0x55603d813e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:23.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/1368069223 shutdown_connections 2024-09-10T22:41:23.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/1368069223 wait complete. 2024-09-10T22:41:23.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 -- start start 2024-09-10T22:41:23.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 Processor -- start 2024-09-10T22:41:23.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7b0e10 0x55603d812a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7fc9d0 0x55603d82e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7fd2f0 0x55603d82eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55603d601070 con 0x55603d7b0e10 2024-09-10T22:41:23.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55603d606390 con 0x55603d7fd2f0 2024-09-10T22:41:23.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55603d60d8f0 con 0x55603d7fc9d0 2024-09-10T22:41:23.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4d4e6e000 10 client.0 _ll_register_callbacks cb 0x7fe4c40076a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:23.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4caa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7b0e10 0x55603d812a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4caa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7b0e10 0x55603d812a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55890/0 (socket says 172.21.15.103:55890) 2024-09-10T22:41:23.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4caa00640 1 -- 172.21.15.103:0/3213476996 learned_addr learned my addr 172.21.15.103:0/3213476996 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:23.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4c3e00640 1 --2- 172.21.15.103:0/3213476996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7fc9d0 0x55603d82e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4cb400640 1 --2- 172.21.15.103:0/3213476996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7fd2f0 0x55603d82eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4caa00640 1 -- 172.21.15.103:0/3213476996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7fc9d0 msgr2=0x55603d82e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4caa00640 1 --2- 172.21.15.103:0/3213476996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7fc9d0 0x55603d82e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4caa00640 1 -- 172.21.15.103:0/3213476996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7fd2f0 msgr2=0x55603d82eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4caa00640 1 --2- 172.21.15.103:0/3213476996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7fd2f0 0x55603d82eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4caa00640 1 -- 172.21.15.103:0/3213476996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55603d5c4a90 con 0x55603d7b0e10 2024-09-10T22:41:23.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4c3e00640 1 --2- 172.21.15.103:0/3213476996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7fc9d0 0x55603d82e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:23.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4caa00640 1 --2- 172.21.15.103:0/3213476996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7b0e10 0x55603d812a50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0b0040 tx=0x7fe4bc0195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae673396b93dad16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:23.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.648+0000 7fe4afe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:23.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4afe00640 1 -- 172.21.15.103:0/3213476996 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0054d0 con 0x55603d7b0e10 2024-09-10T22:41:23.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/3213476996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4b4067f60 con 0x55603d7b0e10 2024-09-10T22:41:23.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4afe00640 1 -- 172.21.15.103:0/3213476996 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fe4bc003600 con 0x55603d7b0e10 2024-09-10T22:41:23.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4afe00640 1 -- 172.21.15.103:0/3213476996 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fe4bc0e5050 con 0x55603d7b0e10 2024-09-10T22:41:23.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 10 client.5775 fetch_fsmap learned FSMap version 40 2024-09-10T22:41:23.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/3213476996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x55603d5a3050 con 0x55603d7b0e10 2024-09-10T22:41:23.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4afe00640 1 -- 172.21.15.103:0/3213476996 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4b4067f60 con 0x55603d7b0e10 2024-09-10T22:41:23.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4afe00640 1 -- 172.21.15.103:0/3213476996 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 40) ==== 3542+0+0 (secure 0 0 0) 0x7fe4bc0e8020 con 0x55603d7b0e10 2024-09-10T22:41:23.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 10 client.5775 fetch_fsmap finished waiting for FSMap version 40 2024-09-10T22:41:23.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 10 client.5775 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:41:23.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 20 client.5775 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:23.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/3213476996 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x55603d82f000 0x55603d872400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 4 client.5775 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:41:23.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/3213476996 --> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] -- command(tid 0: {"prefix": "status"}) -- 0x55603d60c520 con 0x55603d82f000 2024-09-10T22:41:23.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4c3e00640 1 --2- 172.21.15.103:0/3213476996 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x55603d82f000 0x55603d872400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4c3e00640 1 --2- 172.21.15.103:0/3213476996 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x55603d82f000 0x55603d872400 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bbd99822a5c2b0ff server_cookie=514b42be02e9dee8 in_seq=0 out_seq=0 2024-09-10T22:41:23.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4afe00640 10 client.5775 ms_handle_connect on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:23.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4afe00640 1 -- 172.21.15.103:0/3213476996 <== mds.1 v2:172.21.15.103:6833/3910783847 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55603d60c520 con 0x55603d82f000 2024-09-10T22:41:23.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4afe00640 10 client.5775 handle_command_reply: tid=0 2024-09-10T22:41:23.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 1 client.5775 shutdown 2024-09-10T22:41:23.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/3213476996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7b0e10 msgr2=0x55603d812a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/3213476996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7b0e10 0x55603d812a50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0b0040 tx=0x7fe4bc0195d0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/3213476996 shutdown_connections 2024-09-10T22:41:23.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/3213476996 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x55603d82f000 0x55603d872400 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/3213476996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55603d7fd2f0 0x55603d82eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/3213476996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55603d7fc9d0 0x55603d82e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 1 --2- 172.21.15.103:0/3213476996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55603d7b0e10 0x55603d812a50 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4afe00640 0 client.5775 ms_handle_reset on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:23.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/3213476996 >> 172.21.15.103:0/3213476996 conn(0x55603d69a130 msgr2=0x55603d7b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:23.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/3213476996 shutdown_connections 2024-09-10T22:41:23.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 1 -- 172.21.15.103:0/3213476996 wait complete. 2024-09-10T22:41:23.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d4e6e000 20 client.5775 trim_cache size 0 max 16384 2024-09-10T22:41:23.666 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:41:23.666 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:41:23.666 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 1, 2024-09-10T22:41:23.667 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5544, 2024-09-10T22:41:23.667 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:41:23.667 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:41:23.667 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:41:23.667 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 3.5863205090000001, 2024-09-10T22:41:23.667 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 40, 2024-09-10T22:41:23.667 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 55, 2024-09-10T22:41:23.667 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 55, 2024-09-10T22:41:23.667 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 21.173598618 2024-09-10T22:41:23.667 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:41:23.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d1a00640 1 -- 172.21.15.103:0/2388526706 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4a80725e0 msgr2=0x7fe4a8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d1a00640 1 --2- 172.21.15.103:0/2388526706 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4a80725e0 0x7fe4a8074aa0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0af000 tx=0x7fe4bc01b070 comp rx=0 tx=0).stop 2024-09-10T22:41:23.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d1a00640 1 -- 172.21.15.103:0/2388526706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4cc0ceb40 msgr2=0x7fe4cc14dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d1a00640 1 --2- 172.21.15.103:0/2388526706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4cc0ceb40 0x7fe4cc14dce0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400c940 tx=0x7fe4b400ce00 comp rx=0 tx=0).stop 2024-09-10T22:41:23.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d1a00640 1 -- 172.21.15.103:0/2388526706 shutdown_connections 2024-09-10T22:41:23.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d1a00640 1 --2- 172.21.15.103:0/2388526706 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4a80725e0 0x7fe4a8074aa0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d1a00640 1 --2- 172.21.15.103:0/2388526706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4cc15be30 0x7fe4cc06ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d1a00640 1 --2- 172.21.15.103:0/2388526706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4cc0ceb40 0x7fe4cc14dce0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d1a00640 1 --2- 172.21.15.103:0/2388526706 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4cc0b09c0 0x7fe4cc1fb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d1a00640 1 -- 172.21.15.103:0/2388526706 >> 172.21.15.103:0/2388526706 conn(0x7fe4cc0d1ac0 msgr2=0x7fe4cc0b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:23.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d1a00640 1 -- 172.21.15.103:0/2388526706 shutdown_connections 2024-09-10T22:41:23.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.656+0000 7fe4d1a00640 1 -- 172.21.15.103:0/2388526706 wait complete. 2024-09-10T22:41:23.679 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T22:41:23.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff59b600640 1 -- 172.21.15.103:0/3578648697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5940b3150 msgr2=0x7ff594072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff59b600640 1 --2- 172.21.15.103:0/3578648697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5940b3150 0x7ff594072500 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff594070730 tx=0x7ff57c01c8c0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff59b600640 1 -- 172.21.15.103:0/3578648697 shutdown_connections 2024-09-10T22:41:23.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff59b600640 1 --2- 172.21.15.103:0/3578648697 >> v2:172.21.15.131:3300/0 conn(0x7ff594072a40 0x7ff594157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff59b600640 1 --2- 172.21.15.103:0/3578648697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5940b3150 0x7ff594072500 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff59b600640 1 --2- 172.21.15.103:0/3578648697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5940cf260 0x7ff5940b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff59b600640 1 -- 172.21.15.103:0/3578648697 >> 172.21.15.103:0/3578648697 conn(0x7ff59406cc00 msgr2=0x7ff59406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:23.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff59b600640 1 -- 172.21.15.103:0/3578648697 shutdown_connections 2024-09-10T22:41:23.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff59b600640 1 -- 172.21.15.103:0/3578648697 wait complete. 2024-09-10T22:41:23.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff59b600640 1 Processor -- start 2024-09-10T22:41:23.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff59b600640 1 -- start start 2024-09-10T22:41:23.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff59b600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff594072a40 0x7ff59406ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff59b600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5940b3150 0x7ff594144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff59b600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5940cf260 0x7ff594145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff59b600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff594157a10 con 0x7ff594072a40 2024-09-10T22:41:23.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff59b600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff594157890 con 0x7ff5940b3150 2024-09-10T22:41:23.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff59b600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff594157b90 con 0x7ff5940cf260 2024-09-10T22:41:23.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff598c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff594072a40 0x7ff59406ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff598c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff594072a40 0x7ff59406ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55904/0 (socket says 172.21.15.103:55904) 2024-09-10T22:41:23.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff598c00640 1 -- 172.21.15.103:0/2546677039 learned_addr learned my addr 172.21.15.103:0/2546677039 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:23.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff58be00640 1 --2- 172.21.15.103:0/2546677039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5940b3150 0x7ff594144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff599600640 1 --2- 172.21.15.103:0/2546677039 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5940cf260 0x7ff594145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff598c00640 1 -- 172.21.15.103:0/2546677039 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5940cf260 msgr2=0x7ff594145420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff598c00640 1 --2- 172.21.15.103:0/2546677039 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5940cf260 0x7ff594145420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff598c00640 1 -- 172.21.15.103:0/2546677039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5940b3150 msgr2=0x7ff594144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff598c00640 1 --2- 172.21.15.103:0/2546677039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5940b3150 0x7ff594144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.820+0000 7ff598c00640 1 -- 172.21.15.103:0/2546677039 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff594153340 con 0x7ff594072a40 2024-09-10T22:41:23.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.824+0000 7ff598c00640 1 --2- 172.21.15.103:0/2546677039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff594072a40 0x7ff59406ea60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff58400c940 tx=0x7ff58400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:23.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.824+0000 7ff591600640 1 -- 172.21.15.103:0/2546677039 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff584004220 con 0x7ff594072a40 2024-09-10T22:41:23.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.824+0000 7ff591600640 1 -- 172.21.15.103:0/2546677039 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5840079b0 con 0x7ff594072a40 2024-09-10T22:41:23.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.824+0000 7ff59b600640 1 -- 172.21.15.103:0/2546677039 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff594153620 con 0x7ff594072a40 2024-09-10T22:41:23.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.824+0000 7ff591600640 1 -- 172.21.15.103:0/2546677039 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5840044b0 con 0x7ff594072a40 2024-09-10T22:41:23.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.824+0000 7ff59b600640 1 -- 172.21.15.103:0/2546677039 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff59415d6a0 con 0x7ff594072a40 2024-09-10T22:41:23.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.824+0000 7ff591600640 1 -- 172.21.15.103:0/2546677039 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff584020060 con 0x7ff594072a40 2024-09-10T22:41:23.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.824+0000 7ff591600640 1 --2- 172.21.15.103:0/2546677039 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff5700725e0 0x7ff570074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.824+0000 7ff59e997000 1 Processor -- start 2024-09-10T22:41:23.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.824+0000 7ff591600640 1 -- 172.21.15.103:0/2546677039 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7ff5840931c0 con 0x7ff594072a40 2024-09-10T22:41:23.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.824+0000 7ff59e997000 1 -- start start 2024-09-10T22:41:23.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff58be00640 1 --2- 172.21.15.103:0/2546677039 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff5700725e0 0x7ff570074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff58be00640 1 --2- 172.21.15.103:0/2546677039 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff5700725e0 0x7ff570074aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0af000 tx=0x7ff57c01b100 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:23.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff59e997000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a5639d0 0x56384a563db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff59e997000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5642f0 0x56384a5178d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff59e997000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a517e10 0x56384a5181f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff59e997000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56384a4383f0 con 0x56384a5642f0 2024-09-10T22:41:23.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff59e997000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56384a375b20 con 0x56384a5639d0 2024-09-10T22:41:23.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff59e997000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56384a364f50 con 0x56384a517e10 2024-09-10T22:41:23.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff58be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5642f0 0x56384a5178d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff58be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5642f0 0x56384a5178d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55916/0 (socket says 172.21.15.103:55916) 2024-09-10T22:41:23.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff58be00640 1 -- 172.21.15.103:0/1766315934 learned_addr learned my addr 172.21.15.103:0/1766315934 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:23.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff598c00640 1 --2- 172.21.15.103:0/1766315934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a5639d0 0x56384a563db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff599600640 1 --2- 172.21.15.103:0/1766315934 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a517e10 0x56384a5181f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff58be00640 1 -- 172.21.15.103:0/1766315934 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a517e10 msgr2=0x56384a5181f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff58be00640 1 --2- 172.21.15.103:0/1766315934 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a517e10 0x56384a5181f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff58be00640 1 -- 172.21.15.103:0/1766315934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a5639d0 msgr2=0x56384a563db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff58be00640 1 --2- 172.21.15.103:0/1766315934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a5639d0 0x56384a563db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff58be00640 1 -- 172.21.15.103:0/1766315934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56384a32c590 con 0x56384a5642f0 2024-09-10T22:41:23.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff598c00640 1 --2- 172.21.15.103:0/1766315934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a5639d0 0x56384a563db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:23.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff58be00640 1 --2- 172.21.15.103:0/1766315934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5642f0 0x56384a5178d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009850 tx=0x7ff57c0b4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb315f490026fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:23.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff589600640 1 -- 172.21.15.103:0/1766315934 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0c8070 con 0x56384a5642f0 2024-09-10T22:41:23.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff589600640 1 -- 172.21.15.103:0/1766315934 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff57c005040 con 0x56384a5642f0 2024-09-10T22:41:23.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff589600640 1 -- 172.21.15.103:0/1766315934 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0b2040 con 0x56384a5642f0 2024-09-10T22:41:23.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff59e997000 1 -- 172.21.15.103:0/1766315934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5642f0 msgr2=0x56384a5178d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff59e997000 1 --2- 172.21.15.103:0/1766315934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5642f0 0x56384a5178d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009850 tx=0x7ff57c0b4000 comp rx=0 tx=0).stop 2024-09-10T22:41:23.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff59e997000 1 -- 172.21.15.103:0/1766315934 shutdown_connections 2024-09-10T22:41:23.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff59e997000 1 --2- 172.21.15.103:0/1766315934 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a517e10 0x56384a5181f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff59e997000 1 --2- 172.21.15.103:0/1766315934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5642f0 0x56384a5178d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff59e997000 1 --2- 172.21.15.103:0/1766315934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a5639d0 0x56384a563db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff59e997000 1 -- 172.21.15.103:0/1766315934 >> 172.21.15.103:0/1766315934 conn(0x56384a401130 msgr2=0x56384a546e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:23.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff59e997000 1 -- 172.21.15.103:0/1766315934 shutdown_connections 2024-09-10T22:41:23.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff59e997000 1 -- 172.21.15.103:0/1766315934 wait complete. 2024-09-10T22:41:23.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff59e997000 1 -- start start 2024-09-10T22:41:23.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.828+0000 7ff59e997000 1 Processor -- start 2024-09-10T22:41:23.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff59e997000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a517e10 0x56384a519240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff59e997000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5639d0 0x56384a519780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff59e997000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a5642f0 0x56384a519cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff59e997000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56384a2ff5d0 con 0x56384a5639d0 2024-09-10T22:41:23.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff59e997000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56384a368d60 con 0x56384a517e10 2024-09-10T22:41:23.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff59e997000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56384a30b500 con 0x56384a5642f0 2024-09-10T22:41:23.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff59e997000 10 client.0 _ll_register_callbacks cb 0x56384a30f810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:23.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff58be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5639d0 0x56384a519780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff598c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a517e10 0x56384a519240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff599600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a5642f0 0x56384a519cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff58be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5639d0 0x56384a519780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55924/0 (socket says 172.21.15.103:55924) 2024-09-10T22:41:23.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff58be00640 1 -- 172.21.15.103:0/1049563197 learned_addr learned my addr 172.21.15.103:0/1049563197 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:23.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff58be00640 1 -- 172.21.15.103:0/1049563197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a5642f0 msgr2=0x56384a519cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff58be00640 1 --2- 172.21.15.103:0/1049563197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a5642f0 0x56384a519cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff58be00640 1 -- 172.21.15.103:0/1049563197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a517e10 msgr2=0x56384a519240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff58be00640 1 --2- 172.21.15.103:0/1049563197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a517e10 0x56384a519240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff58be00640 1 -- 172.21.15.103:0/1049563197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56384a303170 con 0x56384a5639d0 2024-09-10T22:41:23.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff58be00640 1 --2- 172.21.15.103:0/1049563197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5639d0 0x56384a519780 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff57c01af70 tx=0x7ff57c005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2baa5d2a4cec1c3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:23.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff582000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:23.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff582000640 1 -- 172.21.15.103:0/1049563197 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0c8070 con 0x56384a5639d0 2024-09-10T22:41:23.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff582000640 1 -- 172.21.15.103:0/1049563197 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7ff57c0cdc40 con 0x56384a5639d0 2024-09-10T22:41:23.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff59e997000 1 -- 172.21.15.103:0/1049563197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56384a2fd0f0 con 0x56384a5639d0 2024-09-10T22:41:23.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff582000640 1 -- 172.21.15.103:0/1049563197 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7ff57c0b2050 con 0x56384a5639d0 2024-09-10T22:41:23.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff59e997000 10 client.5787 fetch_fsmap learned FSMap version 40 2024-09-10T22:41:23.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff59e997000 1 -- 172.21.15.103:0/1049563197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x56384a3e9ef0 con 0x56384a5639d0 2024-09-10T22:41:23.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff582000640 1 -- 172.21.15.103:0/1049563197 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56384a2fd0f0 con 0x56384a5639d0 2024-09-10T22:41:23.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff582000640 1 -- 172.21.15.103:0/1049563197 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 40) ==== 3542+0+0 (secure 0 0 0) 0x7ff57c0b5030 con 0x56384a5639d0 2024-09-10T22:41:23.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff59e997000 10 client.5787 fetch_fsmap finished waiting for FSMap version 40 2024-09-10T22:41:23.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff59e997000 10 client.5787 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T22:41:23.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff59e997000 20 client.5787 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:23.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff59e997000 1 --2- 172.21.15.103:0/1049563197 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x56384a572c70 0x56384a575060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff59e997000 4 client.5787 mds_command: new command op to 5547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:41:23.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff59e997000 1 -- 172.21.15.103:0/1049563197 --> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56384a377a70 con 0x56384a572c70 2024-09-10T22:41:23.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff598c00640 1 --2- 172.21.15.103:0/1049563197 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x56384a572c70 0x56384a575060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff598c00640 1 --2- 172.21.15.103:0/1049563197 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x56384a572c70 0x56384a575060 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c22310000f57819 server_cookie=a0bc5b61d93800bf in_seq=0 out_seq=0 2024-09-10T22:41:23.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff582000640 10 client.5787 ms_handle_connect on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:23.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff582000640 1 -- 172.21.15.103:0/1049563197 <== mds.0 v2:172.21.15.103:6832/343761048 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56384a377a70 con 0x56384a572c70 2024-09-10T22:41:23.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff582000640 10 client.5787 handle_command_reply: tid=0 2024-09-10T22:41:23.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.832+0000 7ff59e997000 1 client.5787 shutdown 2024-09-10T22:41:23.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.836+0000 7ff59e997000 1 -- 172.21.15.103:0/1049563197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5639d0 msgr2=0x56384a519780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.836+0000 7ff59e997000 1 --2- 172.21.15.103:0/1049563197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5639d0 0x56384a519780 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff57c01af70 tx=0x7ff57c005760 comp rx=0 tx=0).stop 2024-09-10T22:41:23.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.836+0000 7ff59e997000 1 -- 172.21.15.103:0/1049563197 shutdown_connections 2024-09-10T22:41:23.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.836+0000 7ff59e997000 1 --2- 172.21.15.103:0/1049563197 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x56384a572c70 0x56384a575060 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.836+0000 7ff59e997000 1 --2- 172.21.15.103:0/1049563197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a5642f0 0x56384a519cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.836+0000 7ff59e997000 1 --2- 172.21.15.103:0/1049563197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5639d0 0x56384a519780 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.836+0000 7ff59e997000 1 --2- 172.21.15.103:0/1049563197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a517e10 0x56384a519240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.836+0000 7ff582000640 0 client.5787 ms_handle_reset on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:23.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.836+0000 7ff59e997000 1 -- 172.21.15.103:0/1049563197 >> 172.21.15.103:0/1049563197 conn(0x56384a401130 msgr2=0x56384a516fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:23.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.836+0000 7ff59e997000 1 -- 172.21.15.103:0/1049563197 shutdown_connections 2024-09-10T22:41:23.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.836+0000 7ff59e997000 1 -- 172.21.15.103:0/1049563197 wait complete. 2024-09-10T22:41:23.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.836+0000 7ff59e997000 20 client.5787 trim_cache size 0 max 16384 2024-09-10T22:41:23.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.852+0000 7ff59e997000 1 Processor -- start 2024-09-10T22:41:23.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.852+0000 7ff59e997000 1 -- start start 2024-09-10T22:41:23.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.852+0000 7ff59e997000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a517e10 0x56384a5d5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.852+0000 7ff59e997000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5639d0 0x56384a5d6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.852+0000 7ff59e997000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a5642f0 0x56384a5d6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.852+0000 7ff59e997000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56384a36d390 con 0x56384a5639d0 2024-09-10T22:41:23.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.852+0000 7ff59e997000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56384a2ff5d0 con 0x56384a5642f0 2024-09-10T22:41:23.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.852+0000 7ff59e997000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56384a368d60 con 0x56384a517e10 2024-09-10T22:41:23.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff58be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5639d0 0x56384a5d6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff58be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5639d0 0x56384a5d6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55934/0 (socket says 172.21.15.103:55934) 2024-09-10T22:41:23.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff58be00640 1 -- 172.21.15.103:0/165744755 learned_addr learned my addr 172.21.15.103:0/165744755 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:23.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff599600640 1 --2- 172.21.15.103:0/165744755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a5642f0 0x56384a5d6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff598c00640 1 --2- 172.21.15.103:0/165744755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a517e10 0x56384a5d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff58be00640 1 -- 172.21.15.103:0/165744755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a517e10 msgr2=0x56384a5d5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff58be00640 1 --2- 172.21.15.103:0/165744755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a517e10 0x56384a5d5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff58be00640 1 -- 172.21.15.103:0/165744755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a5642f0 msgr2=0x56384a5d6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff58be00640 1 --2- 172.21.15.103:0/165744755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a5642f0 0x56384a5d6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff58be00640 1 -- 172.21.15.103:0/165744755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56384a3c0d90 con 0x56384a5639d0 2024-09-10T22:41:23.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff599600640 1 --2- 172.21.15.103:0/165744755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a5642f0 0x56384a5d6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:23.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff598c00640 1 --2- 172.21.15.103:0/165744755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a517e10 0x56384a5d5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:23.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff58be00640 1 --2- 172.21.15.103:0/165744755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5639d0 0x56384a5d6140 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff57c01c900 tx=0x7ff57c0056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d010295669ea5b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:23.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff588c00640 1 -- 172.21.15.103:0/165744755 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0c8040 con 0x56384a5639d0 2024-09-10T22:41:23.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff588c00640 1 -- 172.21.15.103:0/165744755 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff57c003800 con 0x56384a5639d0 2024-09-10T22:41:23.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff588c00640 1 -- 172.21.15.103:0/165744755 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c003c30 con 0x56384a5639d0 2024-09-10T22:41:23.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff59e997000 1 -- 172.21.15.103:0/165744755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5639d0 msgr2=0x56384a5d6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff59e997000 1 --2- 172.21.15.103:0/165744755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5639d0 0x56384a5d6140 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff57c01c900 tx=0x7ff57c0056f0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff59e997000 1 -- 172.21.15.103:0/165744755 shutdown_connections 2024-09-10T22:41:23.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff59e997000 1 --2- 172.21.15.103:0/165744755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a5642f0 0x56384a5d6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff59e997000 1 --2- 172.21.15.103:0/165744755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5639d0 0x56384a5d6140 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff59e997000 1 --2- 172.21.15.103:0/165744755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a517e10 0x56384a5d5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff59e997000 1 -- 172.21.15.103:0/165744755 >> 172.21.15.103:0/165744755 conn(0x56384a401130 msgr2=0x56384a57ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:23.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff59e997000 1 -- 172.21.15.103:0/165744755 shutdown_connections 2024-09-10T22:41:23.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff59e997000 1 -- 172.21.15.103:0/165744755 wait complete. 2024-09-10T22:41:23.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff59e997000 1 -- start start 2024-09-10T22:41:23.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff59e997000 1 Processor -- start 2024-09-10T22:41:23.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff59e997000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a517e10 0x56384a57a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff59e997000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a5639d0 0x56384a5bea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff59e997000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5642f0 0x56384a5bef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff59e997000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56384a368070 con 0x56384a5642f0 2024-09-10T22:41:23.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff59e997000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56384a3e9a60 con 0x56384a5639d0 2024-09-10T22:41:23.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff59e997000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56384a3748f0 con 0x56384a517e10 2024-09-10T22:41:23.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff59e997000 10 client.0 _ll_register_callbacks cb 0x7ff57c0c6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:23.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff599600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5642f0 0x56384a5bef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff599600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5642f0 0x56384a5bef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55938/0 (socket says 172.21.15.103:55938) 2024-09-10T22:41:23.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff599600640 1 -- 172.21.15.103:0/913619720 learned_addr learned my addr 172.21.15.103:0/913619720 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:23.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff58be00640 1 --2- 172.21.15.103:0/913619720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a5639d0 0x56384a5bea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.856+0000 7ff598c00640 1 --2- 172.21.15.103:0/913619720 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a517e10 0x56384a57a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff599600640 1 -- 172.21.15.103:0/913619720 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a517e10 msgr2=0x56384a57a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff599600640 1 --2- 172.21.15.103:0/913619720 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a517e10 0x56384a57a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff599600640 1 -- 172.21.15.103:0/913619720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a5639d0 msgr2=0x56384a5bea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:23.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff599600640 1 --2- 172.21.15.103:0/913619720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a5639d0 0x56384a5bea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff599600640 1 -- 172.21.15.103:0/913619720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56384a32ba90 con 0x56384a5642f0 2024-09-10T22:41:23.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff599600640 1 --2- 172.21.15.103:0/913619720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5642f0 0x56384a5bef60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0126a0 tx=0x7ff58c012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981fae35af506532 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:23.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff582000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:23.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff582000640 1 -- 172.21.15.103:0/913619720 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c020060 con 0x56384a5642f0 2024-09-10T22:41:23.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff582000640 1 -- 172.21.15.103:0/913619720 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7ff58c010ac0 con 0x56384a5642f0 2024-09-10T22:41:23.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 1 -- 172.21.15.103:0/913619720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff57c003800 con 0x56384a5642f0 2024-09-10T22:41:23.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff582000640 1 -- 172.21.15.103:0/913619720 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7ff58c010cc0 con 0x56384a5642f0 2024-09-10T22:41:23.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 10 client.5793 fetch_fsmap learned FSMap version 40 2024-09-10T22:41:23.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 1 -- 172.21.15.103:0/913619720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x56384a30a050 con 0x56384a5642f0 2024-09-10T22:41:23.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff582000640 1 -- 172.21.15.103:0/913619720 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff57c003800 con 0x56384a5642f0 2024-09-10T22:41:23.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff582000640 1 -- 172.21.15.103:0/913619720 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 40) ==== 3542+0+0 (secure 0 0 0) 0x7ff58c00f040 con 0x56384a5642f0 2024-09-10T22:41:23.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 10 client.5793 fetch_fsmap finished waiting for FSMap version 40 2024-09-10T22:41:23.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 10 client.5793 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T22:41:23.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 20 client.5793 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:23.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 1 --2- 172.21.15.103:0/913619720 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x56384a5bf4a0 0x56384a5d9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:23.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 4 client.5793 mds_command: new command op to 5547 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:41:23.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 1 -- 172.21.15.103:0/913619720 --> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] -- command(tid 0: {"prefix": "status"}) -- 0x56384a373520 con 0x56384a5bf4a0 2024-09-10T22:41:23.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff598c00640 1 --2- 172.21.15.103:0/913619720 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x56384a5bf4a0 0x56384a5d9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:23.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff582000640 10 client.5793 ms_handle_connect on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:23.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff598c00640 1 --2- 172.21.15.103:0/913619720 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x56384a5bf4a0 0x56384a5d9e50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c26e6d6b35ecb9db server_cookie=6c1415eb85078fae in_seq=0 out_seq=0 2024-09-10T22:41:23.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff582000640 1 -- 172.21.15.103:0/913619720 <== mds.0 v2:172.21.15.103:6832/343761048 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x56384a373520 con 0x56384a5bf4a0 2024-09-10T22:41:23.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff582000640 10 client.5793 handle_command_reply: tid=0 2024-09-10T22:41:23.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 1 client.5793 shutdown 2024-09-10T22:41:23.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 1 -- 172.21.15.103:0/913619720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5642f0 msgr2=0x56384a5bef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 1 --2- 172.21.15.103:0/913619720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5642f0 0x56384a5bef60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0126a0 tx=0x7ff58c012b60 comp rx=0 tx=0).stop 2024-09-10T22:41:23.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 1 -- 172.21.15.103:0/913619720 shutdown_connections 2024-09-10T22:41:23.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 1 --2- 172.21.15.103:0/913619720 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x56384a5bf4a0 0x56384a5d9e50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 1 --2- 172.21.15.103:0/913619720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56384a5642f0 0x56384a5bef60 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 1 --2- 172.21.15.103:0/913619720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56384a5639d0 0x56384a5bea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 1 --2- 172.21.15.103:0/913619720 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56384a517e10 0x56384a57a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff582000640 0 client.5793 ms_handle_reset on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:23.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 1 -- 172.21.15.103:0/913619720 >> 172.21.15.103:0/913619720 conn(0x56384a401130 msgr2=0x56384a575060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:23.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 1 -- 172.21.15.103:0/913619720 shutdown_connections 2024-09-10T22:41:23.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 1 -- 172.21.15.103:0/913619720 wait complete. 2024-09-10T22:41:23.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59e997000 20 client.5793 trim_cache size 0 max 16384 2024-09-10T22:41:23.870 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:41:23.870 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:41:23.870 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-10T22:41:23.870 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5547, 2024-09-10T22:41:23.870 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:41:23.870 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:41:23.870 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:41:23.870 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 16.877216029, 2024-09-10T22:41:23.870 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 40, 2024-09-10T22:41:23.871 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 55, 2024-09-10T22:41:23.871 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 55, 2024-09-10T22:41:23.871 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 21.377683216000001 2024-09-10T22:41:23.871 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:41:23.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59b600640 1 -- 172.21.15.103:0/2546677039 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff5700725e0 msgr2=0x7ff570074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59b600640 1 --2- 172.21.15.103:0/2546677039 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff5700725e0 0x7ff570074aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0af000 tx=0x7ff57c01b100 comp rx=0 tx=0).stop 2024-09-10T22:41:23.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59b600640 1 -- 172.21.15.103:0/2546677039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff594072a40 msgr2=0x7ff59406ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:23.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59b600640 1 --2- 172.21.15.103:0/2546677039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff594072a40 0x7ff59406ea60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff58400c940 tx=0x7ff58400ce00 comp rx=0 tx=0).stop 2024-09-10T22:41:23.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59b600640 1 -- 172.21.15.103:0/2546677039 shutdown_connections 2024-09-10T22:41:23.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59b600640 1 --2- 172.21.15.103:0/2546677039 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff5700725e0 0x7ff570074aa0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59b600640 1 --2- 172.21.15.103:0/2546677039 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5940cf260 0x7ff594145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59b600640 1 --2- 172.21.15.103:0/2546677039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5940b3150 0x7ff594144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59b600640 1 --2- 172.21.15.103:0/2546677039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff594072a40 0x7ff59406ea60 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:23.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59b600640 1 -- 172.21.15.103:0/2546677039 >> 172.21.15.103:0/2546677039 conn(0x7ff59406cc00 msgr2=0x7ff59415aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:23.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59b600640 1 -- 172.21.15.103:0/2546677039 shutdown_connections 2024-09-10T22:41:23.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:23.860+0000 7ff59b600640 1 -- 172.21.15.103:0/2546677039 wait complete. 2024-09-10T22:41:23.882 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:41:24.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.020+0000 7fec90800640 1 -- 172.21.15.103:0/1898803488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec700077e0 msgr2=0x7fec70009c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:24.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.020+0000 7fec90800640 1 --2- 172.21.15.103:0/1898803488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec700077e0 0x7fec70009c70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fec7800c4a0 tx=0x7fec7801f6c0 comp rx=0 tx=0).stop 2024-09-10T22:41:24.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.020+0000 7fec90800640 1 -- 172.21.15.103:0/1898803488 shutdown_connections 2024-09-10T22:41:24.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.020+0000 7fec90800640 1 --2- 172.21.15.103:0/1898803488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec700077e0 0x7fec70009c70 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:24.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.020+0000 7fec90800640 1 -- 172.21.15.103:0/1898803488 >> 172.21.15.103:0/1898803488 conn(0x7fec880cfc40 msgr2=0x7fec880d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:24.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.020+0000 7fec90800640 1 -- 172.21.15.103:0/1898803488 shutdown_connections 2024-09-10T22:41:24.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.020+0000 7fec90800640 1 -- 172.21.15.103:0/1898803488 wait complete. 2024-09-10T22:41:24.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec90800640 1 Processor -- start 2024-09-10T22:41:24.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec90800640 1 -- start start 2024-09-10T22:41:24.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec90800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec700077e0 0x7fec8814ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:24.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec90800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec880c8db0 0x7fec880b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:24.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec90800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec880c9cb0 0x7fec880b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:24.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec90800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fec8806ecc0 con 0x7fec880c8db0 2024-09-10T22:41:24.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec90800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fec8806a200 con 0x7fec880c9cb0 2024-09-10T22:41:24.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec90800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fec8806ee40 con 0x7fec700077e0 2024-09-10T22:41:24.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec8d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec880c8db0 0x7fec880b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:24.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec8d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec880c8db0 0x7fec880b33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55956/0 (socket says 172.21.15.103:55956) 2024-09-10T22:41:24.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec8d400640 1 -- 172.21.15.103:0/3917186839 learned_addr learned my addr 172.21.15.103:0/3917186839 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:24.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec8de00640 1 --2- 172.21.15.103:0/3917186839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec700077e0 0x7fec8814ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:24.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec8e800640 1 --2- 172.21.15.103:0/3917186839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec880c9cb0 0x7fec880b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:24.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec8d400640 1 -- 172.21.15.103:0/3917186839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec700077e0 msgr2=0x7fec8814ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:24.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec8d400640 1 --2- 172.21.15.103:0/3917186839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec700077e0 0x7fec8814ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:24.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec8d400640 1 -- 172.21.15.103:0/3917186839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec880c9cb0 msgr2=0x7fec880b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:24.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec8d400640 1 --2- 172.21.15.103:0/3917186839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec880c9cb0 0x7fec880b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:24.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec8d400640 1 -- 172.21.15.103:0/3917186839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec881f62e0 con 0x7fec880c8db0 2024-09-10T22:41:24.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec8d400640 1 --2- 172.21.15.103:0/3917186839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec880c8db0 0x7fec880b33f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fec780b1040 tx=0x7fec78006050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:24.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec82000640 1 -- 172.21.15.103:0/3917186839 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec780b3070 con 0x7fec880c8db0 2024-09-10T22:41:24.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec82000640 1 -- 172.21.15.103:0/3917186839 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec780be070 con 0x7fec880c8db0 2024-09-10T22:41:24.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec90800640 1 -- 172.21.15.103:0/3917186839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec881f6560 con 0x7fec880c8db0 2024-09-10T22:41:24.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec82000640 1 -- 172.21.15.103:0/3917186839 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec78003600 con 0x7fec880c8db0 2024-09-10T22:41:24.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.024+0000 7fec90800640 1 -- 172.21.15.103:0/3917186839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec881f27b0 con 0x7fec880c8db0 2024-09-10T22:41:24.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.028+0000 7fec90800640 1 -- 172.21.15.103:0/3917186839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec88070660 con 0x7fec880c8db0 2024-09-10T22:41:24.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.028+0000 7fec82000640 1 -- 172.21.15.103:0/3917186839 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fec780037c0 con 0x7fec880c8db0 2024-09-10T22:41:24.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.028+0000 7fec82000640 1 --2- 172.21.15.103:0/3917186839 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fec6c072610 0x7fec6c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:24.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.028+0000 7fec82000640 1 -- 172.21.15.103:0/3917186839 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fec78130e10 con 0x7fec880c8db0 2024-09-10T22:41:24.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.028+0000 7fec8de00640 1 --2- 172.21.15.103:0/3917186839 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fec6c072610 0x7fec6c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:24.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.028+0000 7fec8de00640 1 --2- 172.21.15.103:0/3917186839 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fec6c072610 0x7fec6c074ad0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009c60 tx=0x7fec7c0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:24.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.032+0000 7fec82000640 1 -- 172.21.15.103:0/3917186839 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fec881f62e0 con 0x7fec880c8db0 2024-09-10T22:41:24.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.232+0000 7fec90800640 1 -- 172.21.15.103:0/3917186839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec880cbe90 con 0x7fec880c8db0 2024-09-10T22:41:24.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.232+0000 7fec82000640 1 -- 172.21.15.103:0/3917186839 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5270 (secure 0 0 0) 0x7fec880caa30 con 0x7fec880c8db0 2024-09-10T22:41:24.235 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:24.235 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":40,"btime":"2024-09-10T22:41:22:083564+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/1187797704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1187797704},{"type":"v1","addr":"172.21.15.131:6836","nonce":1187797704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:41:06.381695+0000","modified":"2024-09-10T22:41:22.083552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5547,"mds_1":5544,"mds_2":5153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5153":{"gid":5153,"name":"d","rank":2,"incarnation":39,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6837/3348473142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3348473142},{"type":"v1","addr":"172.21.15.131:6837","nonce":3348473142}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5544":{"gid":5544,"name":"c","rank":1,"incarnation":37,"state":"up:active","state_seq":6,"addr":"172.21.15.103:6834/3910783847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":3910783847},{"type":"v1","addr":"172.21.15.103:6834","nonce":3910783847}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5547":{"gid":5547,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/343761048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":343761048},{"type":"v1","addr":"172.21.15.103:6835","nonce":343761048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5547,"qdb_cluster":[5153,5544,5547]},"id":3}]} 2024-09-10T22:41:24.235 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 40 2024-09-10T22:41:24.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.236+0000 7fec90800640 1 -- 172.21.15.103:0/3917186839 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fec6c072610 msgr2=0x7fec6c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:24.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.236+0000 7fec90800640 1 --2- 172.21.15.103:0/3917186839 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fec6c072610 0x7fec6c074ad0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009c60 tx=0x7fec7c0091e0 comp rx=0 tx=0).stop 2024-09-10T22:41:24.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.236+0000 7fec90800640 1 -- 172.21.15.103:0/3917186839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec880c8db0 msgr2=0x7fec880b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:24.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.236+0000 7fec90800640 1 --2- 172.21.15.103:0/3917186839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec880c8db0 0x7fec880b33f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fec780b1040 tx=0x7fec78006050 comp rx=0 tx=0).stop 2024-09-10T22:41:24.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.236+0000 7fec90800640 1 -- 172.21.15.103:0/3917186839 shutdown_connections 2024-09-10T22:41:24.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.236+0000 7fec90800640 1 --2- 172.21.15.103:0/3917186839 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fec6c072610 0x7fec6c074ad0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:24.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.236+0000 7fec90800640 1 --2- 172.21.15.103:0/3917186839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec880c9cb0 0x7fec880b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:24.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.236+0000 7fec90800640 1 --2- 172.21.15.103:0/3917186839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec880c8db0 0x7fec880b33f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:24.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.236+0000 7fec90800640 1 --2- 172.21.15.103:0/3917186839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec700077e0 0x7fec8814ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:24.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.236+0000 7fec90800640 1 -- 172.21.15.103:0/3917186839 >> 172.21.15.103:0/3917186839 conn(0x7fec880cfc40 msgr2=0x7fec880b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:24.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.236+0000 7fec90800640 1 -- 172.21.15.103:0/3917186839 shutdown_connections 2024-09-10T22:41:24.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:24.236+0000 7fec90800640 1 -- 172.21.15.103:0/3917186839 wait complete. 2024-09-10T22:41:24.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:41:24.257 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-10T22:41:24.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:41:24.285 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-10T22:41:24.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:41:24.344 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2024-09-10T22:41:24.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:41:24.398 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2024-09-10T22:41:24.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:41:24.451 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2024-09-10T22:41:24.503 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:41:24.699 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:41:24.699 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:41:24.700 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:41:26.701 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:41:26.868 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:41:26.869 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:41:26.869 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:41:28.870 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:41:29.037 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:41:29.038 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:41:29.038 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:41:31.039 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:41:31.208 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:41:31.209 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:41:31.209 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:41:33.210 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:41:33.378 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2024-09-10T22:41:33.379 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-10T22:41:33.379 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:41:33.379 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:41:33.536 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:41:33.537 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:41:33.537 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:41:35.538 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:41:35.706 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:41:35.706 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:41:35.706 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:41:37.707 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:41:37.873 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:41:37.874 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:41:37.874 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:41:39.875 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:41:40.038 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:41:40.038 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:41:40.039 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:41:40.039 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-10T22:41:40.207 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:41:40.208 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:41:40.208 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:41:40.208 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush journal 2024-09-10T22:41:40.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.352+0000 7fbf96a00640 1 -- 172.21.15.103:0/2948766173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf900aeb40 msgr2=0x7fbf90072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.352+0000 7fbf96a00640 1 --2- 172.21.15.103:0/2948766173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf900aeb40 0x7fbf90072e30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c009900 tx=0x7fbf7c01c850 comp rx=0 tx=0).stop 2024-09-10T22:41:40.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.352+0000 7fbf96a00640 1 -- 172.21.15.103:0/2948766173 shutdown_connections 2024-09-10T22:41:40.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.352+0000 7fbf96a00640 1 --2- 172.21.15.103:0/2948766173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf900cf790 0x7fbf900cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.352+0000 7fbf96a00640 1 --2- 172.21.15.103:0/2948766173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf900aeb40 0x7fbf90072e30 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.352+0000 7fbf96a00640 1 -- 172.21.15.103:0/2948766173 >> 172.21.15.103:0/2948766173 conn(0x7fbf9006cc00 msgr2=0x7fbf9006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:40.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.352+0000 7fbf96a00640 1 -- 172.21.15.103:0/2948766173 shutdown_connections 2024-09-10T22:41:40.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.352+0000 7fbf96a00640 1 -- 172.21.15.103:0/2948766173 wait complete. 2024-09-10T22:41:40.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.352+0000 7fbf96a00640 1 Processor -- start 2024-09-10T22:41:40.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.352+0000 7fbf96a00640 1 -- start start 2024-09-10T22:41:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.352+0000 7fbf96a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf900aeb40 0x7fbf900b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.352+0000 7fbf96a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf900cc120 0x7fbf90147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.352+0000 7fbf96a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf900cf790 0x7fbf90164a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.352+0000 7fbf96a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbf90168c40 con 0x7fbf900aeb40 2024-09-10T22:41:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.352+0000 7fbf96a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbf90168ac0 con 0x7fbf900cc120 2024-09-10T22:41:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.352+0000 7fbf96a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fbf90168dc0 con 0x7fbf900cf790 2024-09-10T22:41:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf8fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf900aeb40 0x7fbf900b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf8fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf900aeb40 0x7fbf900b0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35968/0 (socket says 172.21.15.103:35968) 2024-09-10T22:41:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf8fe00640 1 -- 172.21.15.103:0/514083668 learned_addr learned my addr 172.21.15.103:0/514083668 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf94a00640 1 --2- 172.21.15.103:0/514083668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf900cf790 0x7fbf90164a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf8f400640 1 --2- 172.21.15.103:0/514083668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf900cc120 0x7fbf90147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf8fe00640 1 -- 172.21.15.103:0/514083668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf900cf790 msgr2=0x7fbf90164a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf8fe00640 1 --2- 172.21.15.103:0/514083668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf900cf790 0x7fbf90164a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf8fe00640 1 -- 172.21.15.103:0/514083668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf900cc120 msgr2=0x7fbf90147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf8fe00640 1 --2- 172.21.15.103:0/514083668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf900cc120 0x7fbf90147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf8fe00640 1 -- 172.21.15.103:0/514083668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf900b22a0 con 0x7fbf900aeb40 2024-09-10T22:41:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf8f400640 1 --2- 172.21.15.103:0/514083668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf900cc120 0x7fbf90147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf94a00640 1 --2- 172.21.15.103:0/514083668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf900cf790 0x7fbf90164a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf8fe00640 1 --2- 172.21.15.103:0/514083668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf900aeb40 0x7fbf900b0740 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbf8000c400 tx=0x7fbf8000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf87e00640 1 -- 172.21.15.103:0/514083668 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80017070 con 0x7fbf900aeb40 2024-09-10T22:41:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf87e00640 1 -- 172.21.15.103:0/514083668 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf800053c0 con 0x7fbf900aeb40 2024-09-10T22:41:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf87e00640 1 -- 172.21.15.103:0/514083668 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80003880 con 0x7fbf900aeb40 2024-09-10T22:41:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf96a00640 1 -- 172.21.15.103:0/514083668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf901fab30 con 0x7fbf900aeb40 2024-09-10T22:41:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf96a00640 1 -- 172.21.15.103:0/514083668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf901fb0f0 con 0x7fbf900aeb40 2024-09-10T22:41:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.356+0000 7fbf87e00640 1 -- 172.21.15.103:0/514083668 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbf80003a20 con 0x7fbf900aeb40 2024-09-10T22:41:40.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf87e00640 1 --2- 172.21.15.103:0/514083668 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbf700725e0 0x7fbf70074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf87e00640 1 -- 172.21.15.103:0/514083668 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fbf80092bc0 con 0x7fbf900aeb40 2024-09-10T22:41:40.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf99d73000 1 Processor -- start 2024-09-10T22:41:40.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf8f400640 1 --2- 172.21.15.103:0/514083668 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbf700725e0 0x7fbf70074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf99d73000 1 -- start start 2024-09-10T22:41:40.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf8f400640 1 --2- 172.21.15.103:0/514083668 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbf700725e0 0x7fbf70074aa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0af000 tx=0x7fbf7c01b090 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:40.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf99d73000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 0x5595bfd36580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf99d73000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfd36ac0 0x5595bfcec680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf99d73000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcecbc0 0x5595bfcecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf99d73000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5595bfbd4cb0 con 0x5595bfcecbc0 2024-09-10T22:41:40.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf99d73000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5595bfaea310 con 0x5595bfd361a0 2024-09-10T22:41:40.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf99d73000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5595bfb47b90 con 0x5595bfd36ac0 2024-09-10T22:41:40.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf94a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcecbc0 0x5595bfcecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf94a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcecbc0 0x5595bfcecfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35974/0 (socket says 172.21.15.103:35974) 2024-09-10T22:41:40.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf94a00640 1 -- 172.21.15.103:0/2769787164 learned_addr learned my addr 172.21.15.103:0/2769787164 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:40.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf8f400640 1 --2- 172.21.15.103:0/2769787164 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfd36ac0 0x5595bfcec680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf8fe00640 1 --2- 172.21.15.103:0/2769787164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 0x5595bfd36580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf94a00640 1 -- 172.21.15.103:0/2769787164 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfd36ac0 msgr2=0x5595bfcec680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf94a00640 1 --2- 172.21.15.103:0/2769787164 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfd36ac0 0x5595bfcec680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf94a00640 1 -- 172.21.15.103:0/2769787164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 msgr2=0x5595bfd36580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf94a00640 1 --2- 172.21.15.103:0/2769787164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 0x5595bfd36580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf94a00640 1 -- 172.21.15.103:0/2769787164 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595bfaebc60 con 0x5595bfcecbc0 2024-09-10T22:41:40.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf94a00640 1 --2- 172.21.15.103:0/2769787164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcecbc0 0x5595bfcecfa0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbf8800f390 tx=0x7fbf8800f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ed5b482255f7c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:40.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf84c00640 1 -- 172.21.15.103:0/2769787164 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf88015070 con 0x5595bfcecbc0 2024-09-10T22:41:40.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf84c00640 1 -- 172.21.15.103:0/2769787164 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf880117f0 con 0x5595bfcecbc0 2024-09-10T22:41:40.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf84c00640 1 -- 172.21.15.103:0/2769787164 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf88011be0 con 0x5595bfcecbc0 2024-09-10T22:41:40.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf99d73000 1 -- 172.21.15.103:0/2769787164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcecbc0 msgr2=0x5595bfcecfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf99d73000 1 --2- 172.21.15.103:0/2769787164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcecbc0 0x5595bfcecfa0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbf8800f390 tx=0x7fbf8800f850 comp rx=0 tx=0).stop 2024-09-10T22:41:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf99d73000 1 -- 172.21.15.103:0/2769787164 shutdown_connections 2024-09-10T22:41:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf99d73000 1 --2- 172.21.15.103:0/2769787164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcecbc0 0x5595bfcecfa0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf99d73000 1 --2- 172.21.15.103:0/2769787164 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfd36ac0 0x5595bfcec680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf99d73000 1 --2- 172.21.15.103:0/2769787164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 0x5595bfd36580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf99d73000 1 -- 172.21.15.103:0/2769787164 >> 172.21.15.103:0/2769787164 conn(0x5595bfcf2d20 msgr2=0x5595bfceaf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf99d73000 1 -- 172.21.15.103:0/2769787164 shutdown_connections 2024-09-10T22:41:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.360+0000 7fbf99d73000 1 -- 172.21.15.103:0/2769787164 wait complete. 2024-09-10T22:41:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf99d73000 1 -- start start 2024-09-10T22:41:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf99d73000 1 Processor -- start 2024-09-10T22:41:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf99d73000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfcecbc0 0x5595bfd3d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf99d73000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 0x5595bfd3da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf99d73000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfd36ac0 0x5595bfd3dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf99d73000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5595bfb3add0 con 0x5595bfd36ac0 2024-09-10T22:41:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf99d73000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5595bfb36fc0 con 0x5595bfd361a0 2024-09-10T22:41:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf99d73000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5595bfadc4b0 con 0x5595bfcecbc0 2024-09-10T22:41:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf99d73000 10 client.0 _ll_register_callbacks cb 0x5595bfaba7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf94a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfd36ac0 0x5595bfd3dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf8fe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfcecbc0 0x5595bfd3d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf94a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfd36ac0 0x5595bfd3dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35984/0 (socket says 172.21.15.103:35984) 2024-09-10T22:41:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf94a00640 1 -- 172.21.15.103:0/1113325132 learned_addr learned my addr 172.21.15.103:0/1113325132 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf8f400640 1 --2- 172.21.15.103:0/1113325132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 0x5595bfd3da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf94a00640 1 -- 172.21.15.103:0/1113325132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfcecbc0 msgr2=0x5595bfd3d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf94a00640 1 --2- 172.21.15.103:0/1113325132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfcecbc0 0x5595bfd3d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf94a00640 1 -- 172.21.15.103:0/1113325132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 msgr2=0x5595bfd3da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf94a00640 1 --2- 172.21.15.103:0/1113325132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 0x5595bfd3da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf94a00640 1 -- 172.21.15.103:0/1113325132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595bfad51f0 con 0x5595bfd36ac0 2024-09-10T22:41:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf94a00640 1 --2- 172.21.15.103:0/1113325132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfd36ac0 0x5595bfd3dfb0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x5595bfb425e0 tx=0x7fbf88003bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af1aefe166a455d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf79600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf79600640 1 -- 172.21.15.103:0/1113325132 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf88015070 con 0x5595bfd36ac0 2024-09-10T22:41:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf79600640 1 -- 172.21.15.103:0/1113325132 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fbf88004240 con 0x5595bfd36ac0 2024-09-10T22:41:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf99d73000 1 -- 172.21.15.103:0/1113325132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5595bfacf330 con 0x5595bfd36ac0 2024-09-10T22:41:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf79600640 1 -- 172.21.15.103:0/1113325132 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fbf8802b050 con 0x5595bfd36ac0 2024-09-10T22:41:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf99d73000 10 client.5814 fetch_fsmap learned FSMap version 42 2024-09-10T22:41:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf99d73000 1 -- 172.21.15.103:0/1113325132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x5595bfabbfa0 con 0x5595bfd36ac0 2024-09-10T22:41:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf79600640 1 -- 172.21.15.103:0/1113325132 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5595bfacf330 con 0x5595bfd36ac0 2024-09-10T22:41:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf79600640 1 -- 172.21.15.103:0/1113325132 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 42) ==== 3554+0+0 (secure 0 0 0) 0x7fbf8802e020 con 0x5595bfd36ac0 2024-09-10T22:41:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf99d73000 10 client.5814 fetch_fsmap finished waiting for FSMap version 42 2024-09-10T22:41:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf99d73000 10 client.5814 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T22:41:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf99d73000 20 client.5814 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf99d73000 1 --2- 172.21.15.103:0/1113325132 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5595bfd45900 0x5595bfd47cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf99d73000 4 client.5814 mds_command: new command op to 5547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:41:40.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf99d73000 1 -- 172.21.15.103:0/1113325132 --> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595bfb49ae0 con 0x5595bfd45900 2024-09-10T22:41:40.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.364+0000 7fbf8fe00640 1 --2- 172.21.15.103:0/1113325132 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5595bfd45900 0x5595bfd47cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.368+0000 7fbf8fe00640 1 --2- 172.21.15.103:0/1113325132 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5595bfd45900 0x5595bfd47cf0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ade92bfd96ec2f5b server_cookie=5a8ea5d7ac1adbed in_seq=0 out_seq=0 2024-09-10T22:41:40.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.368+0000 7fbf79600640 10 client.5814 ms_handle_connect on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:40.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.368+0000 7fbf79600640 1 -- 172.21.15.103:0/1113325132 <== mds.0 v2:172.21.15.103:6832/343761048 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595bfb49ae0 con 0x5595bfd45900 2024-09-10T22:41:40.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.368+0000 7fbf79600640 10 client.5814 handle_command_reply: tid=0 2024-09-10T22:41:40.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.368+0000 7fbf99d73000 1 client.5814 shutdown 2024-09-10T22:41:40.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.368+0000 7fbf99d73000 1 -- 172.21.15.103:0/1113325132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfd36ac0 msgr2=0x5595bfd3dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.368+0000 7fbf99d73000 1 --2- 172.21.15.103:0/1113325132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfd36ac0 0x5595bfd3dfb0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x5595bfb425e0 tx=0x7fbf88003bb0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.368+0000 7fbf99d73000 1 -- 172.21.15.103:0/1113325132 shutdown_connections 2024-09-10T22:41:40.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.368+0000 7fbf99d73000 1 --2- 172.21.15.103:0/1113325132 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5595bfd45900 0x5595bfd47cf0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.368+0000 7fbf99d73000 1 --2- 172.21.15.103:0/1113325132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfd36ac0 0x5595bfd3dfb0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.368+0000 7fbf99d73000 1 --2- 172.21.15.103:0/1113325132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 0x5595bfd3da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.368+0000 7fbf99d73000 1 --2- 172.21.15.103:0/1113325132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfcecbc0 0x5595bfd3d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.368+0000 7fbf99d73000 1 -- 172.21.15.103:0/1113325132 >> 172.21.15.103:0/1113325132 conn(0x5595bfcf2d20 msgr2=0x5595bfceaf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:40.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.368+0000 7fbf79600640 0 client.5814 ms_handle_reset on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:40.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.368+0000 7fbf99d73000 1 -- 172.21.15.103:0/1113325132 shutdown_connections 2024-09-10T22:41:40.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.368+0000 7fbf99d73000 1 -- 172.21.15.103:0/1113325132 wait complete. 2024-09-10T22:41:40.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.368+0000 7fbf99d73000 20 client.5814 trim_cache size 0 max 16384 2024-09-10T22:41:40.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf99d73000 1 Processor -- start 2024-09-10T22:41:40.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf99d73000 1 -- start start 2024-09-10T22:41:40.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf99d73000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfcf2d20 0x5595bfda8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf99d73000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcecbc0 0x5595bfda9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf99d73000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 0x5595bfda98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf99d73000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbf902048a0 con 0x5595bfcecbc0 2024-09-10T22:41:40.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf99d73000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbf90203a70 con 0x5595bfd361a0 2024-09-10T22:41:40.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf99d73000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fbf90204170 con 0x5595bfcf2d20 2024-09-10T22:41:40.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf8f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcecbc0 0x5595bfda9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf8f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcecbc0 0x5595bfda9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35990/0 (socket says 172.21.15.103:35990) 2024-09-10T22:41:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf8f400640 1 -- 172.21.15.103:0/1265955066 learned_addr learned my addr 172.21.15.103:0/1265955066 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf8fe00640 1 --2- 172.21.15.103:0/1265955066 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfcf2d20 0x5595bfda8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf94a00640 1 --2- 172.21.15.103:0/1265955066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 0x5595bfda98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf8f400640 1 -- 172.21.15.103:0/1265955066 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfcf2d20 msgr2=0x5595bfda8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf8f400640 1 --2- 172.21.15.103:0/1265955066 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfcf2d20 0x5595bfda8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf8f400640 1 -- 172.21.15.103:0/1265955066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 msgr2=0x5595bfda98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf8f400640 1 --2- 172.21.15.103:0/1265955066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 0x5595bfda98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf8f400640 1 -- 172.21.15.103:0/1265955066 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595bfb94660 con 0x5595bfcecbc0 2024-09-10T22:41:40.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf8f400640 1 --2- 172.21.15.103:0/1265955066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcecbc0 0x5595bfda9390 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c01a480 tx=0x7fbf7c0b4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcb79fe483eeda4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:40.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf7be00640 1 -- 172.21.15.103:0/1265955066 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c0b2040 con 0x5595bfcecbc0 2024-09-10T22:41:40.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf7be00640 1 -- 172.21.15.103:0/1265955066 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf7c005580 con 0x5595bfcecbc0 2024-09-10T22:41:40.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf7be00640 1 -- 172.21.15.103:0/1265955066 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c004910 con 0x5595bfcecbc0 2024-09-10T22:41:40.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf99d73000 1 -- 172.21.15.103:0/1265955066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcecbc0 msgr2=0x5595bfda9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf99d73000 1 --2- 172.21.15.103:0/1265955066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcecbc0 0x5595bfda9390 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c01a480 tx=0x7fbf7c0b4000 comp rx=0 tx=0).stop 2024-09-10T22:41:40.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf99d73000 1 -- 172.21.15.103:0/1265955066 shutdown_connections 2024-09-10T22:41:40.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf99d73000 1 --2- 172.21.15.103:0/1265955066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 0x5595bfda98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf99d73000 1 --2- 172.21.15.103:0/1265955066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcecbc0 0x5595bfda9390 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf99d73000 1 --2- 172.21.15.103:0/1265955066 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfcf2d20 0x5595bfda8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf99d73000 1 -- 172.21.15.103:0/1265955066 >> 172.21.15.103:0/1265955066 conn(0x5595bfce9270 msgr2=0x5595bfcecfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:40.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf99d73000 1 -- 172.21.15.103:0/1265955066 shutdown_connections 2024-09-10T22:41:40.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.384+0000 7fbf99d73000 1 -- 172.21.15.103:0/1265955066 wait complete. 2024-09-10T22:41:40.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf99d73000 1 -- start start 2024-09-10T22:41:40.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf99d73000 1 Processor -- start 2024-09-10T22:41:40.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf99d73000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfcecbc0 0x5595bfd68210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf99d73000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcf2d20 0x5595bfd68750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf99d73000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 0x5595bfd68c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf99d73000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5595bfb3add0 con 0x5595bfcf2d20 2024-09-10T22:41:40.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf99d73000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5595bfb31ec0 con 0x5595bfd361a0 2024-09-10T22:41:40.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf99d73000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5595bfcf5d40 con 0x5595bfcecbc0 2024-09-10T22:41:40.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf99d73000 10 client.0 _ll_register_callbacks cb 0x7fbf800597e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:40.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf8f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcf2d20 0x5595bfd68750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf8f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcf2d20 0x5595bfd68750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35992/0 (socket says 172.21.15.103:35992) 2024-09-10T22:41:40.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf8f400640 1 -- 172.21.15.103:0/1565336602 learned_addr learned my addr 172.21.15.103:0/1565336602 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:40.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf8fe00640 1 --2- 172.21.15.103:0/1565336602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfcecbc0 0x5595bfd68210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf94a00640 1 --2- 172.21.15.103:0/1565336602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 0x5595bfd68c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf8f400640 1 -- 172.21.15.103:0/1565336602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfcecbc0 msgr2=0x5595bfd68210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf8f400640 1 --2- 172.21.15.103:0/1565336602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfcecbc0 0x5595bfd68210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf8f400640 1 -- 172.21.15.103:0/1565336602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 msgr2=0x5595bfd68c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf8f400640 1 --2- 172.21.15.103:0/1565336602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 0x5595bfd68c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf8f400640 1 -- 172.21.15.103:0/1565336602 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595bfb01090 con 0x5595bfcf2d20 2024-09-10T22:41:40.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf8fe00640 1 --2- 172.21.15.103:0/1565336602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfcecbc0 0x5595bfd68210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:41:40.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf8f400640 1 --2- 172.21.15.103:0/1565336602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcf2d20 0x5595bfd68750 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0096c0 tx=0x7fbf7c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866b5048451c623c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:40.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf79600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:40.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf79600640 1 -- 172.21.15.103:0/1565336602 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c0b2070 con 0x5595bfcf2d20 2024-09-10T22:41:40.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf79600640 1 -- 172.21.15.103:0/1565336602 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fbf7c004cb0 con 0x5595bfcf2d20 2024-09-10T22:41:40.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf99d73000 1 -- 172.21.15.103:0/1565336602 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf7c005580 con 0x5595bfcf2d20 2024-09-10T22:41:40.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf79600640 1 -- 172.21.15.103:0/1565336602 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fbf7c0d6050 con 0x5595bfcf2d20 2024-09-10T22:41:40.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf99d73000 10 client.5820 fetch_fsmap learned FSMap version 42 2024-09-10T22:41:40.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf99d73000 1 -- 172.21.15.103:0/1565336602 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x5595bfacd5f0 con 0x5595bfcf2d20 2024-09-10T22:41:40.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf79600640 1 -- 172.21.15.103:0/1565336602 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf7c005580 con 0x5595bfcf2d20 2024-09-10T22:41:40.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf79600640 1 -- 172.21.15.103:0/1565336602 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 42) ==== 3554+0+0 (secure 0 0 0) 0x7fbf7c0d9020 con 0x5595bfcf2d20 2024-09-10T22:41:40.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf99d73000 10 client.5820 fetch_fsmap finished waiting for FSMap version 42 2024-09-10T22:41:40.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf99d73000 10 client.5820 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T22:41:40.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf99d73000 20 client.5820 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:40.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf99d73000 1 --2- 172.21.15.103:0/1565336602 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5595bfd36ac0 0x5595bfd691d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf99d73000 4 client.5820 mds_command: new command op to 5547 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:41:40.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf99d73000 1 -- 172.21.15.103:0/1565336602 --> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5595bfd4e010 con 0x5595bfd36ac0 2024-09-10T22:41:40.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf8fe00640 1 --2- 172.21.15.103:0/1565336602 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5595bfd36ac0 0x5595bfd691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf8fe00640 1 --2- 172.21.15.103:0/1565336602 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5595bfd36ac0 0x5595bfd691d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4faa5d5435024e98 server_cookie=ad9bfc6301405ce3 in_seq=0 out_seq=0 2024-09-10T22:41:40.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.388+0000 7fbf79600640 10 client.5820 ms_handle_connect on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:40.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf79600640 1 -- 172.21.15.103:0/1565336602 <== mds.0 v2:172.21.15.103:6832/343761048 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5595bfd4e010 con 0x5595bfd36ac0 2024-09-10T22:41:40.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf79600640 10 client.5820 handle_command_reply: tid=0 2024-09-10T22:41:40.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf99d73000 1 client.5820 shutdown 2024-09-10T22:41:40.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf99d73000 1 -- 172.21.15.103:0/1565336602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcf2d20 msgr2=0x5595bfd68750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf99d73000 1 --2- 172.21.15.103:0/1565336602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcf2d20 0x5595bfd68750 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0096c0 tx=0x7fbf7c004ac0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf99d73000 1 -- 172.21.15.103:0/1565336602 shutdown_connections 2024-09-10T22:41:40.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf99d73000 1 --2- 172.21.15.103:0/1565336602 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5595bfd36ac0 0x5595bfd691d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf99d73000 1 --2- 172.21.15.103:0/1565336602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595bfd361a0 0x5595bfd68c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf99d73000 1 --2- 172.21.15.103:0/1565336602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595bfcf2d20 0x5595bfd68750 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf99d73000 1 --2- 172.21.15.103:0/1565336602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5595bfcecbc0 0x5595bfd68210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf79600640 0 client.5820 ms_handle_reset on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:40.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf99d73000 1 -- 172.21.15.103:0/1565336602 >> 172.21.15.103:0/1565336602 conn(0x5595bfce9270 msgr2=0x5595bfced7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:40.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf99d73000 1 -- 172.21.15.103:0/1565336602 shutdown_connections 2024-09-10T22:41:40.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf99d73000 1 -- 172.21.15.103:0/1565336602 wait complete. 2024-09-10T22:41:40.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf99d73000 20 client.5820 trim_cache size 0 max 16384 2024-09-10T22:41:40.415 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:41:40.415 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:41:40.415 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:41:40.415 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:41:40.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf96a00640 1 -- 172.21.15.103:0/514083668 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbf700725e0 msgr2=0x7fbf70074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf96a00640 1 --2- 172.21.15.103:0/514083668 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbf700725e0 0x7fbf70074aa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0af000 tx=0x7fbf7c01b090 comp rx=0 tx=0).stop 2024-09-10T22:41:40.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf96a00640 1 -- 172.21.15.103:0/514083668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf900aeb40 msgr2=0x7fbf900b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf96a00640 1 --2- 172.21.15.103:0/514083668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf900aeb40 0x7fbf900b0740 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbf8000c400 tx=0x7fbf8000c8c0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf96a00640 1 -- 172.21.15.103:0/514083668 shutdown_connections 2024-09-10T22:41:40.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf96a00640 1 --2- 172.21.15.103:0/514083668 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbf700725e0 0x7fbf70074aa0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf96a00640 1 --2- 172.21.15.103:0/514083668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf900cf790 0x7fbf90164a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf96a00640 1 --2- 172.21.15.103:0/514083668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf900cc120 0x7fbf90147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf96a00640 1 --2- 172.21.15.103:0/514083668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf900aeb40 0x7fbf900b0740 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf96a00640 1 -- 172.21.15.103:0/514083668 >> 172.21.15.103:0/514083668 conn(0x7fbf9006cc00 msgr2=0x7fbf900b3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:40.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf96a00640 1 -- 172.21.15.103:0/514083668 shutdown_connections 2024-09-10T22:41:40.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.412+0000 7fbf96a00640 1 -- 172.21.15.103:0/514083668 wait complete. 2024-09-10T22:41:40.433 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:1 flush journal 2024-09-10T22:41:40.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.576+0000 7fb72c800640 1 -- 172.21.15.103:0/3597332363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb70c004d50 msgr2=0x7fb70c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.576+0000 7fb72c800640 1 --2- 172.21.15.103:0/3597332363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb70c004d50 0x7fb70c0051d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb720009eb0 tx=0x7fb72001d5f0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.576+0000 7fb72a800640 1 -- 172.21.15.103:0/3597332363 reap_dead start 2024-09-10T22:41:40.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.576+0000 7fb72c800640 1 -- 172.21.15.103:0/3597332363 shutdown_connections 2024-09-10T22:41:40.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.576+0000 7fb72c800640 1 -- 172.21.15.103:0/3597332363 >> 172.21.15.103:0/3597332363 conn(0x7fb7240d0940 msgr2=0x7fb7240d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:40.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.576+0000 7fb72c800640 1 -- 172.21.15.103:0/3597332363 shutdown_connections 2024-09-10T22:41:40.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.576+0000 7fb72c800640 1 -- 172.21.15.103:0/3597332363 wait complete. 2024-09-10T22:41:40.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb72c800640 1 Processor -- start 2024-09-10T22:41:40.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb72c800640 1 -- start start 2024-09-10T22:41:40.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb72c800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb724160d20 0x7fb7241f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb72c800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7240b5480 0x7fb724156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb72c800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb72415ab40 0x7fb72415aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb72c800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb724071d60 con 0x7fb7240b5480 2024-09-10T22:41:40.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb72c800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb724071be0 con 0x7fb724160d20 2024-09-10T22:41:40.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb72c800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb724071ee0 con 0x7fb72415ab40 2024-09-10T22:41:40.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb729400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7240b5480 0x7fb724156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb729400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7240b5480 0x7fb724156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36014/0 (socket says 172.21.15.103:36014) 2024-09-10T22:41:40.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb729e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb724160d20 0x7fb7241f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb729400640 1 -- 172.21.15.103:0/2405120183 learned_addr learned my addr 172.21.15.103:0/2405120183 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:40.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb72a800640 1 --2- 172.21.15.103:0/2405120183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb72415ab40 0x7fb72415aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb729400640 1 -- 172.21.15.103:0/2405120183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb72415ab40 msgr2=0x7fb72415aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb729400640 1 --2- 172.21.15.103:0/2405120183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb72415ab40 0x7fb72415aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb729400640 1 -- 172.21.15.103:0/2405120183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb724160d20 msgr2=0x7fb7241f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb729400640 1 --2- 172.21.15.103:0/2405120183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb724160d20 0x7fb7241f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb729400640 1 -- 172.21.15.103:0/2405120183 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72415f250 con 0x7fb7240b5480 2024-09-10T22:41:40.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb729400640 1 --2- 172.21.15.103:0/2405120183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7240b5480 0x7fb724156590 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb714011ae0 tx=0x7fb714009e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:40.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb71e000640 1 -- 172.21.15.103:0/2405120183 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71401e070 con 0x7fb7240b5480 2024-09-10T22:41:40.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb71e000640 1 -- 172.21.15.103:0/2405120183 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb714004460 con 0x7fb7240b5480 2024-09-10T22:41:40.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb72c800640 1 -- 172.21.15.103:0/2405120183 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72415f530 con 0x7fb7240b5480 2024-09-10T22:41:40.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb71e000640 1 -- 172.21.15.103:0/2405120183 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71400fc60 con 0x7fb7240b5480 2024-09-10T22:41:40.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.580+0000 7fb72c800640 1 -- 172.21.15.103:0/2405120183 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72415faf0 con 0x7fb7240b5480 2024-09-10T22:41:40.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.584+0000 7fb71e000640 1 -- 172.21.15.103:0/2405120183 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb714003600 con 0x7fb7240b5480 2024-09-10T22:41:40.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.584+0000 7fb71e000640 1 --2- 172.21.15.103:0/2405120183 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb7080725e0 0x7fb708074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.584+0000 7fb71e000640 1 -- 172.21.15.103:0/2405120183 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fb714094170 con 0x7fb7240b5480 2024-09-10T22:41:40.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.584+0000 7fb72fcd5000 1 Processor -- start 2024-09-10T22:41:40.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.584+0000 7fb729e00640 1 --2- 172.21.15.103:0/2405120183 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb7080725e0 0x7fb708074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.584+0000 7fb72fcd5000 1 -- start start 2024-09-10T22:41:40.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.584+0000 7fb729e00640 1 --2- 172.21.15.103:0/2405120183 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb7080725e0 0x7fb708074aa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb718001d60 tx=0x7fb718006bf0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:40.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.584+0000 7fb72fcd5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9dcb1a0 0x55f1f9dcb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.584+0000 7fb72fcd5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 0x55f1f9d81680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.584+0000 7fb72fcd5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9d81bc0 0x55f1f9d81fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.584+0000 7fb72fcd5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f1f9c69cb0 con 0x55f1f9dcbac0 2024-09-10T22:41:40.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.584+0000 7fb72fcd5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f1f9b7f310 con 0x55f1f9dcb1a0 2024-09-10T22:41:40.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.584+0000 7fb72fcd5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55f1f9bdcb90 con 0x55f1f9d81bc0 2024-09-10T22:41:40.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.584+0000 7fb729400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 0x55f1f9d81680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.584+0000 7fb729400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 0x55f1f9d81680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36028/0 (socket says 172.21.15.103:36028) 2024-09-10T22:41:40.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.584+0000 7fb729400640 1 -- 172.21.15.103:0/275827038 learned_addr learned my addr 172.21.15.103:0/275827038 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:40.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.584+0000 7fb729e00640 1 --2- 172.21.15.103:0/275827038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9dcb1a0 0x55f1f9dcb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.584+0000 7fb72a800640 1 --2- 172.21.15.103:0/275827038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9d81bc0 0x55f1f9d81fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb729400640 1 -- 172.21.15.103:0/275827038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9d81bc0 msgr2=0x55f1f9d81fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb729400640 1 --2- 172.21.15.103:0/275827038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9d81bc0 0x55f1f9d81fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb729400640 1 -- 172.21.15.103:0/275827038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9dcb1a0 msgr2=0x55f1f9dcb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb729400640 1 --2- 172.21.15.103:0/275827038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9dcb1a0 0x55f1f9dcb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb729400640 1 -- 172.21.15.103:0/275827038 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1f9b80c60 con 0x55f1f9dcbac0 2024-09-10T22:41:40.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb729400640 1 --2- 172.21.15.103:0/275827038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 0x55f1f9d81680 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb714092440 tx=0x7fb71405ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5645a67d9455b7de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:40.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb712a00640 1 -- 172.21.15.103:0/275827038 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb714063a60 con 0x55f1f9dcbac0 2024-09-10T22:41:40.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb712a00640 1 -- 172.21.15.103:0/275827038 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb714068480 con 0x55f1f9dcbac0 2024-09-10T22:41:40.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb712a00640 1 -- 172.21.15.103:0/275827038 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71405e290 con 0x55f1f9dcbac0 2024-09-10T22:41:40.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72fcd5000 1 -- 172.21.15.103:0/275827038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 msgr2=0x55f1f9d81680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/275827038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 0x55f1f9d81680 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb714092440 tx=0x7fb71405ea80 comp rx=0 tx=0).stop 2024-09-10T22:41:40.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72fcd5000 1 -- 172.21.15.103:0/275827038 shutdown_connections 2024-09-10T22:41:40.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/275827038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9d81bc0 0x55f1f9d81fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/275827038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 0x55f1f9d81680 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/275827038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9dcb1a0 0x55f1f9dcb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72fcd5000 1 -- 172.21.15.103:0/275827038 >> 172.21.15.103:0/275827038 conn(0x55f1f9d87d20 msgr2=0x55f1f9d7ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:40.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72fcd5000 1 -- 172.21.15.103:0/275827038 shutdown_connections 2024-09-10T22:41:40.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72fcd5000 1 -- 172.21.15.103:0/275827038 wait complete. 2024-09-10T22:41:40.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72fcd5000 1 -- start start 2024-09-10T22:41:40.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72fcd5000 1 Processor -- start 2024-09-10T22:41:40.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72fcd5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9d81bc0 0x55f1f9dd2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72fcd5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9dcb1a0 0x55f1f9dd2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72fcd5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 0x55f1f9dd2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72fcd5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f1f9bcfdd0 con 0x55f1f9dcbac0 2024-09-10T22:41:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72fcd5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f1f9bcbfc0 con 0x55f1f9dcb1a0 2024-09-10T22:41:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72fcd5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55f1f9b714b0 con 0x55f1f9d81bc0 2024-09-10T22:41:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72fcd5000 10 client.0 _ll_register_callbacks cb 0x55f1f9b4f7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 0x55f1f9dd2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 0x55f1f9dd2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36044/0 (socket says 172.21.15.103:36044) 2024-09-10T22:41:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72a800640 1 -- 172.21.15.103:0/825621011 learned_addr learned my addr 172.21.15.103:0/825621011 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb729400640 1 --2- 172.21.15.103:0/825621011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9dcb1a0 0x55f1f9dd2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb729e00640 1 --2- 172.21.15.103:0/825621011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9d81bc0 0x55f1f9dd2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72a800640 1 -- 172.21.15.103:0/825621011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9d81bc0 msgr2=0x55f1f9dd2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72a800640 1 --2- 172.21.15.103:0/825621011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9d81bc0 0x55f1f9dd2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72a800640 1 -- 172.21.15.103:0/825621011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9dcb1a0 msgr2=0x55f1f9dd2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72a800640 1 --2- 172.21.15.103:0/825621011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9dcb1a0 0x55f1f9dd2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.588+0000 7fb72a800640 1 -- 172.21.15.103:0/825621011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1f9b6a1f0 con 0x55f1f9dcbac0 2024-09-10T22:41:40.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72a800640 1 --2- 172.21.15.103:0/825621011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 0x55f1f9dd2fb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb72001d420 tx=0x7fb720009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f89f8f558484b87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:40.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb707400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:40.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb707400640 1 -- 172.21.15.103:0/825621011 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7200c1020 con 0x55f1f9dcbac0 2024-09-10T22:41:40.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb707400640 1 -- 172.21.15.103:0/825621011 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fb720009ab0 con 0x55f1f9dcbac0 2024-09-10T22:41:40.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 1 -- 172.21.15.103:0/825621011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f1f9b64330 con 0x55f1f9dcbac0 2024-09-10T22:41:40.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb707400640 1 -- 172.21.15.103:0/825621011 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fb720004a50 con 0x55f1f9dcbac0 2024-09-10T22:41:40.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 10 client.5832 fetch_fsmap learned FSMap version 42 2024-09-10T22:41:40.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 1 -- 172.21.15.103:0/825621011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x55f1f9b50fa0 con 0x55f1f9dcbac0 2024-09-10T22:41:40.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb707400640 1 -- 172.21.15.103:0/825621011 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f1f9b64330 con 0x55f1f9dcbac0 2024-09-10T22:41:40.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb707400640 1 -- 172.21.15.103:0/825621011 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 42) ==== 3554+0+0 (secure 0 0 0) 0x7fb720004bf0 con 0x55f1f9dcbac0 2024-09-10T22:41:40.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 10 client.5832 fetch_fsmap finished waiting for FSMap version 42 2024-09-10T22:41:40.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 10 client.5832 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2024-09-10T22:41:40.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 20 client.5832 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:40.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/825621011 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x55f1f9dda900 0x55f1f9ddccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 4 client.5832 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:41:40.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 1 -- 172.21.15.103:0/825621011 --> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1f9bdeae0 con 0x55f1f9dda900 2024-09-10T22:41:40.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb729e00640 1 --2- 172.21.15.103:0/825621011 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x55f1f9dda900 0x55f1f9ddccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb729e00640 1 --2- 172.21.15.103:0/825621011 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x55f1f9dda900 0x55f1f9ddccf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=851b87e610824e90 server_cookie=21049b2266b7e2fe in_seq=0 out_seq=0 2024-09-10T22:41:40.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb707400640 10 client.5832 ms_handle_connect on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:40.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb707400640 1 -- 172.21.15.103:0/825621011 <== mds.1 v2:172.21.15.103:6833/3910783847 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f1f9bdeae0 con 0x55f1f9dda900 2024-09-10T22:41:40.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb707400640 10 client.5832 handle_command_reply: tid=0 2024-09-10T22:41:40.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 1 client.5832 shutdown 2024-09-10T22:41:40.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 1 -- 172.21.15.103:0/825621011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 msgr2=0x55f1f9dd2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/825621011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 0x55f1f9dd2fb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb72001d420 tx=0x7fb720009970 comp rx=0 tx=0).stop 2024-09-10T22:41:40.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 1 -- 172.21.15.103:0/825621011 shutdown_connections 2024-09-10T22:41:40.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/825621011 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x55f1f9dda900 0x55f1f9ddccf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/825621011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 0x55f1f9dd2fb0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/825621011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9dcb1a0 0x55f1f9dd2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/825621011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9d81bc0 0x55f1f9dd2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb707400640 0 client.5832 ms_handle_reset on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:40.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 1 -- 172.21.15.103:0/825621011 >> 172.21.15.103:0/825621011 conn(0x55f1f9d87d20 msgr2=0x55f1f9d7ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:40.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 1 -- 172.21.15.103:0/825621011 shutdown_connections 2024-09-10T22:41:40.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 1 -- 172.21.15.103:0/825621011 wait complete. 2024-09-10T22:41:40.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.592+0000 7fb72fcd5000 20 client.5832 trim_cache size 0 max 16384 2024-09-10T22:41:40.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.608+0000 7fb72fcd5000 1 Processor -- start 2024-09-10T22:41:40.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.608+0000 7fb72fcd5000 1 -- start start 2024-09-10T22:41:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.608+0000 7fb72fcd5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9d81bc0 0x55f1f9d81070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.608+0000 7fb72fcd5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9dcb1a0 0x55f1f9d815b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.608+0000 7fb72fcd5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 0x55f1f9dd5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.608+0000 7fb72fcd5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb724202270 con 0x55f1f9dcbac0 2024-09-10T22:41:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.608+0000 7fb72fcd5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb724201440 con 0x55f1f9d81bc0 2024-09-10T22:41:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.608+0000 7fb72fcd5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb724201b40 con 0x55f1f9dcb1a0 2024-09-10T22:41:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.608+0000 7fb72a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 0x55f1f9dd5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.608+0000 7fb72a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 0x55f1f9dd5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36060/0 (socket says 172.21.15.103:36060) 2024-09-10T22:41:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.608+0000 7fb72a800640 1 -- 172.21.15.103:0/1060882996 learned_addr learned my addr 172.21.15.103:0/1060882996 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.608+0000 7fb729400640 1 --2- 172.21.15.103:0/1060882996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9dcb1a0 0x55f1f9d815b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.608+0000 7fb729e00640 1 --2- 172.21.15.103:0/1060882996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9d81bc0 0x55f1f9d81070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.608+0000 7fb72a800640 1 -- 172.21.15.103:0/1060882996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9dcb1a0 msgr2=0x55f1f9d815b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.608+0000 7fb72a800640 1 --2- 172.21.15.103:0/1060882996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9dcb1a0 0x55f1f9d815b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.608+0000 7fb72a800640 1 -- 172.21.15.103:0/1060882996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9d81bc0 msgr2=0x55f1f9d81070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.608+0000 7fb72a800640 1 --2- 172.21.15.103:0/1060882996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9d81bc0 0x55f1f9d81070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.608+0000 7fb72a800640 1 -- 172.21.15.103:0/1060882996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1f9c29660 con 0x55f1f9dcbac0 2024-09-10T22:41:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72a800640 1 --2- 172.21.15.103:0/1060882996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 0x55f1f9dd5310 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb72001de90 tx=0x7fb720009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286bf2e4ec8011f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb712000640 1 -- 172.21.15.103:0/1060882996 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7200c1040 con 0x55f1f9dcbac0 2024-09-10T22:41:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb712000640 1 -- 172.21.15.103:0/1060882996 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb720004bf0 con 0x55f1f9dcbac0 2024-09-10T22:41:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb712000640 1 -- 172.21.15.103:0/1060882996 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7200051d0 con 0x55f1f9dcbac0 2024-09-10T22:41:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72fcd5000 1 -- 172.21.15.103:0/1060882996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 msgr2=0x55f1f9dd5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/1060882996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 0x55f1f9dd5310 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb72001de90 tx=0x7fb720009c40 comp rx=0 tx=0).stop 2024-09-10T22:41:40.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72fcd5000 1 -- 172.21.15.103:0/1060882996 shutdown_connections 2024-09-10T22:41:40.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/1060882996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9dcbac0 0x55f1f9dd5310 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/1060882996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9dcb1a0 0x55f1f9d815b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/1060882996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9d81bc0 0x55f1f9d81070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72fcd5000 1 -- 172.21.15.103:0/1060882996 >> 172.21.15.103:0/1060882996 conn(0x55f1f9d87d20 msgr2=0x55f1f9d80960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:40.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72fcd5000 1 -- 172.21.15.103:0/1060882996 shutdown_connections 2024-09-10T22:41:40.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72fcd5000 1 -- 172.21.15.103:0/1060882996 wait complete. 2024-09-10T22:41:40.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72fcd5000 1 -- start start 2024-09-10T22:41:40.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72fcd5000 1 Processor -- start 2024-09-10T22:41:40.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72fcd5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9d81bc0 0x55f1f9dd7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72fcd5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9dcb1a0 0x55f1f9dd8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72fcd5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9dcbac0 0x55f1f9dfd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72fcd5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f1f9d8ad40 con 0x55f1f9d81bc0 2024-09-10T22:41:40.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72fcd5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f1f9d88100 con 0x55f1f9dcbac0 2024-09-10T22:41:40.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72fcd5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55f1f9bc6ec0 con 0x55f1f9dcb1a0 2024-09-10T22:41:40.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72fcd5000 10 client.0 _ll_register_callbacks cb 0x7fb7200093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:40.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb729e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9d81bc0 0x55f1f9dd7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb729e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9d81bc0 0x55f1f9dd7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36062/0 (socket says 172.21.15.103:36062) 2024-09-10T22:41:40.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb729e00640 1 -- 172.21.15.103:0/1009704325 learned_addr learned my addr 172.21.15.103:0/1009704325 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:40.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb729400640 1 --2- 172.21.15.103:0/1009704325 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9dcb1a0 0x55f1f9dd8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb72a800640 1 --2- 172.21.15.103:0/1009704325 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9dcbac0 0x55f1f9dfd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb729e00640 1 -- 172.21.15.103:0/1009704325 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9dcb1a0 msgr2=0x55f1f9dd8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb729e00640 1 --2- 172.21.15.103:0/1009704325 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9dcb1a0 0x55f1f9dd8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb729e00640 1 -- 172.21.15.103:0/1009704325 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9dcbac0 msgr2=0x55f1f9dfd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb729e00640 1 --2- 172.21.15.103:0/1009704325 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9dcbac0 0x55f1f9dfd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb729e00640 1 -- 172.21.15.103:0/1009704325 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1f9b96090 con 0x55f1f9d81bc0 2024-09-10T22:41:40.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb729e00640 1 --2- 172.21.15.103:0/1009704325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9d81bc0 0x55f1f9dd7fc0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb718013e80 tx=0x7fb718001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f238535056ee115d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:40.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb707400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:40.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.612+0000 7fb707400640 1 -- 172.21.15.103:0/1009704325 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71803a060 con 0x55f1f9d81bc0 2024-09-10T22:41:40.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.616+0000 7fb707400640 1 -- 172.21.15.103:0/1009704325 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fb718019070 con 0x55f1f9d81bc0 2024-09-10T22:41:40.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.616+0000 7fb72fcd5000 1 -- 172.21.15.103:0/1009704325 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb720004bf0 con 0x55f1f9d81bc0 2024-09-10T22:41:40.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.616+0000 7fb707400640 1 -- 172.21.15.103:0/1009704325 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fb718012da0 con 0x55f1f9d81bc0 2024-09-10T22:41:40.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.616+0000 7fb72fcd5000 10 client.5838 fetch_fsmap learned FSMap version 42 2024-09-10T22:41:40.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.616+0000 7fb72fcd5000 1 -- 172.21.15.103:0/1009704325 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x55f1f9b625f0 con 0x55f1f9d81bc0 2024-09-10T22:41:40.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.616+0000 7fb707400640 1 -- 172.21.15.103:0/1009704325 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb720004bf0 con 0x55f1f9d81bc0 2024-09-10T22:41:40.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.616+0000 7fb707400640 1 -- 172.21.15.103:0/1009704325 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 42) ==== 3554+0+0 (secure 0 0 0) 0x7fb718020430 con 0x55f1f9d81bc0 2024-09-10T22:41:40.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.616+0000 7fb72fcd5000 10 client.5838 fetch_fsmap finished waiting for FSMap version 42 2024-09-10T22:41:40.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.616+0000 7fb72fcd5000 10 client.5838 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2024-09-10T22:41:40.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.616+0000 7fb72fcd5000 20 client.5838 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:40.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.616+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/1009704325 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x55f1f9e40850 0x55f1f9e40c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.616+0000 7fb72fcd5000 4 client.5838 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:41:40.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.616+0000 7fb72fcd5000 1 -- 172.21.15.103:0/1009704325 --> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f1f9bda590 con 0x55f1f9e40850 2024-09-10T22:41:40.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.616+0000 7fb729400640 1 --2- 172.21.15.103:0/1009704325 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x55f1f9e40850 0x55f1f9e40c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.616+0000 7fb729400640 1 --2- 172.21.15.103:0/1009704325 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x55f1f9e40850 0x55f1f9e40c60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e9b7d04b9ebc9a32 server_cookie=341ada2fcd6a5a9f in_seq=0 out_seq=0 2024-09-10T22:41:40.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.616+0000 7fb707400640 10 client.5838 ms_handle_connect on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:40.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb707400640 1 -- 172.21.15.103:0/1009704325 <== mds.1 v2:172.21.15.103:6833/3910783847 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f1f9bda590 con 0x55f1f9e40850 2024-09-10T22:41:40.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb707400640 10 client.5838 handle_command_reply: tid=0 2024-09-10T22:41:40.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72fcd5000 1 client.5838 shutdown 2024-09-10T22:41:40.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72fcd5000 1 -- 172.21.15.103:0/1009704325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9d81bc0 msgr2=0x55f1f9dd7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/1009704325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9d81bc0 0x55f1f9dd7fc0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb718013e80 tx=0x7fb718001a40 comp rx=0 tx=0).stop 2024-09-10T22:41:40.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72fcd5000 1 -- 172.21.15.103:0/1009704325 shutdown_connections 2024-09-10T22:41:40.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/1009704325 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x55f1f9e40850 0x55f1f9e40c60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/1009704325 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f1f9dcbac0 0x55f1f9dfd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/1009704325 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f1f9dcb1a0 0x55f1f9dd8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb707400640 0 client.5838 ms_handle_reset on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:40.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72fcd5000 1 --2- 172.21.15.103:0/1009704325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1f9d81bc0 0x55f1f9dd7fc0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72fcd5000 1 -- 172.21.15.103:0/1009704325 >> 172.21.15.103:0/1009704325 conn(0x55f1f9d87d20 msgr2=0x55f1f9d81180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:40.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72fcd5000 1 -- 172.21.15.103:0/1009704325 shutdown_connections 2024-09-10T22:41:40.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72fcd5000 1 -- 172.21.15.103:0/1009704325 wait complete. 2024-09-10T22:41:40.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72fcd5000 20 client.5838 trim_cache size 0 max 16384 2024-09-10T22:41:40.633 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:41:40.633 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:41:40.633 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:41:40.633 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:41:40.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72c800640 1 -- 172.21.15.103:0/2405120183 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb7080725e0 msgr2=0x7fb708074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72c800640 1 --2- 172.21.15.103:0/2405120183 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb7080725e0 0x7fb708074aa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb718001d60 tx=0x7fb718006bf0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72c800640 1 -- 172.21.15.103:0/2405120183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7240b5480 msgr2=0x7fb724156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72c800640 1 --2- 172.21.15.103:0/2405120183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7240b5480 0x7fb724156590 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb714011ae0 tx=0x7fb714009e10 comp rx=0 tx=0).stop 2024-09-10T22:41:40.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72c800640 1 -- 172.21.15.103:0/2405120183 shutdown_connections 2024-09-10T22:41:40.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72c800640 1 --2- 172.21.15.103:0/2405120183 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb7080725e0 0x7fb708074aa0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72c800640 1 --2- 172.21.15.103:0/2405120183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb72415ab40 0x7fb72415aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72c800640 1 --2- 172.21.15.103:0/2405120183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7240b5480 0x7fb724156590 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72c800640 1 --2- 172.21.15.103:0/2405120183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb724160d20 0x7fb7241f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72c800640 1 -- 172.21.15.103:0/2405120183 >> 172.21.15.103:0/2405120183 conn(0x7fb7240d0940 msgr2=0x7fb72414bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:40.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72c800640 1 -- 172.21.15.103:0/2405120183 shutdown_connections 2024-09-10T22:41:40.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.628+0000 7fb72c800640 1 -- 172.21.15.103:0/2405120183 wait complete. 2024-09-10T22:41:40.650 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:2 flush journal 2024-09-10T22:41:40.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.792+0000 7f4ce1000640 1 -- 172.21.15.103:0/72084270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cdc0cd500 msgr2=0x7f4cdc15f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.792+0000 7f4ce1000640 1 --2- 172.21.15.103:0/72084270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cdc0cd500 0x7f4cdc15f890 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc0ce200 tx=0x7f4cd401c8c0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.792+0000 7f4ce1000640 1 -- 172.21.15.103:0/72084270 shutdown_connections 2024-09-10T22:41:40.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.792+0000 7f4ce1000640 1 --2- 172.21.15.103:0/72084270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cdc0cd500 0x7f4cdc15f890 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.792+0000 7f4ce1000640 1 --2- 172.21.15.103:0/72084270 >> v2:172.21.15.131:3300/0 conn(0x7f4cdc0cdd00 0x7f4cdc0ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.792+0000 7f4ce1000640 1 -- 172.21.15.103:0/72084270 >> 172.21.15.103:0/72084270 conn(0x7f4cdc0d1a20 msgr2=0x7f4cdc0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:40.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.792+0000 7f4ce1000640 1 -- 172.21.15.103:0/72084270 shutdown_connections 2024-09-10T22:41:40.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.792+0000 7f4ce1000640 1 -- 172.21.15.103:0/72084270 wait complete. 2024-09-10T22:41:40.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4ce1000640 1 Processor -- start 2024-09-10T22:41:40.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4ce1000640 1 -- start start 2024-09-10T22:41:40.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4ce1000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4cdc0cd500 0x7f4cdc14d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4ce1000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cdc0cdd00 0x7f4cdc0afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4ce1000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4cdc15f1a0 0x7f4cdc154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4ce1000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc168f60 con 0x7f4cdc0cdd00 2024-09-10T22:41:40.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4ce1000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc168de0 con 0x7f4cdc15f1a0 2024-09-10T22:41:40.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4ce1000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4cdc1690e0 con 0x7f4cdc0cd500 2024-09-10T22:41:40.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4cd1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cdc0cdd00 0x7f4cdc0afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4cd1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cdc0cdd00 0x7f4cdc0afeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36086/0 (socket says 172.21.15.103:36086) 2024-09-10T22:41:40.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4cd1400640 1 -- 172.21.15.103:0/3178424532 learned_addr learned my addr 172.21.15.103:0/3178424532 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:40.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4cd9e00640 1 --2- 172.21.15.103:0/3178424532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4cdc0cd500 0x7f4cdc14d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4cda800640 1 --2- 172.21.15.103:0/3178424532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4cdc15f1a0 0x7f4cdc154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4cd1400640 1 -- 172.21.15.103:0/3178424532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4cdc0cd500 msgr2=0x7f4cdc14d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4cd1400640 1 --2- 172.21.15.103:0/3178424532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4cdc0cd500 0x7f4cdc14d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4cd1400640 1 -- 172.21.15.103:0/3178424532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4cdc15f1a0 msgr2=0x7f4cdc154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4cd1400640 1 --2- 172.21.15.103:0/3178424532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4cdc15f1a0 0x7f4cdc154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4cd1400640 1 -- 172.21.15.103:0/3178424532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cdc0aee80 con 0x7f4cdc0cdd00 2024-09-10T22:41:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4cd1400640 1 --2- 172.21.15.103:0/3178424532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cdc0cdd00 0x7f4cdc0afeb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400d980 tx=0x7f4cc400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4cd2a00640 1 -- 172.21.15.103:0/3178424532 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4017070 con 0x7f4cdc0cdd00 2024-09-10T22:41:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4cd2a00640 1 -- 172.21.15.103:0/3178424532 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cc4009d20 con 0x7f4cdc0cdd00 2024-09-10T22:41:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4cd2a00640 1 -- 172.21.15.103:0/3178424532 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc40106c0 con 0x7f4cdc0cdd00 2024-09-10T22:41:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4ce1000640 1 -- 172.21.15.103:0/3178424532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cdc0af0f0 con 0x7f4cdc0cdd00 2024-09-10T22:41:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.796+0000 7f4ce1000640 1 -- 172.21.15.103:0/3178424532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cdc0af6b0 con 0x7f4cdc0cdd00 2024-09-10T22:41:40.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4cd2a00640 1 -- 172.21.15.103:0/3178424532 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4cc4010860 con 0x7f4cdc0cdd00 2024-09-10T22:41:40.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4cd2a00640 1 --2- 172.21.15.103:0/3178424532 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4cb8072610 0x7f4cb8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4cd2a00640 1 -- 172.21.15.103:0/3178424532 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f4cc4093780 con 0x7f4cdc0cdd00 2024-09-10T22:41:40.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4ce445c000 1 Processor -- start 2024-09-10T22:41:40.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4cd9e00640 1 --2- 172.21.15.103:0/3178424532 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4cb8072610 0x7f4cb8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4ce445c000 1 -- start start 2024-09-10T22:41:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4cd9e00640 1 --2- 172.21.15.103:0/3178424532 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4cb8072610 0x7f4cb8074ad0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc0cebc0 tx=0x7f4ccc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4ce445c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602055711a0 0x560205571580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4ce445c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560205571ac0 0x560205527680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4ce445c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560205527bc0 0x560205527fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4ce445c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56020540fcb0 con 0x5602055711a0 2024-09-10T22:41:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4ce445c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560205325310 con 0x560205527bc0 2024-09-10T22:41:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4ce445c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560205382b90 con 0x560205571ac0 2024-09-10T22:41:40.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4cd9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602055711a0 0x560205571580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4cd9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602055711a0 0x560205571580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36102/0 (socket says 172.21.15.103:36102) 2024-09-10T22:41:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4cd9e00640 1 -- 172.21.15.103:0/1194180093 learned_addr learned my addr 172.21.15.103:0/1194180093 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4cda800640 1 --2- 172.21.15.103:0/1194180093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560205527bc0 0x560205527fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4cd1400640 1 --2- 172.21.15.103:0/1194180093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560205571ac0 0x560205527680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4cd9e00640 1 -- 172.21.15.103:0/1194180093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560205571ac0 msgr2=0x560205527680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4cd9e00640 1 --2- 172.21.15.103:0/1194180093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560205571ac0 0x560205527680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4cd9e00640 1 -- 172.21.15.103:0/1194180093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560205527bc0 msgr2=0x560205527fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4cd9e00640 1 --2- 172.21.15.103:0/1194180093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560205527bc0 0x560205527fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.800+0000 7f4cd9e00640 1 -- 172.21.15.103:0/1194180093 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560205326c60 con 0x5602055711a0 2024-09-10T22:41:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4cd9e00640 1 --2- 172.21.15.103:0/1194180093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602055711a0 0x560205571580 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00fcd0 tx=0x7f4ccc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58251f06799cac64 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ccaa00640 1 -- 172.21.15.103:0/1194180093 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc025070 con 0x5602055711a0 2024-09-10T22:41:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ccaa00640 1 -- 172.21.15.103:0/1194180093 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ccc01b050 con 0x5602055711a0 2024-09-10T22:41:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ccaa00640 1 -- 172.21.15.103:0/1194180093 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc001b00 con 0x5602055711a0 2024-09-10T22:41:40.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ce445c000 1 -- 172.21.15.103:0/1194180093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602055711a0 msgr2=0x560205571580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ce445c000 1 --2- 172.21.15.103:0/1194180093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602055711a0 0x560205571580 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00fcd0 tx=0x7f4ccc012000 comp rx=0 tx=0).stop 2024-09-10T22:41:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ce445c000 1 -- 172.21.15.103:0/1194180093 shutdown_connections 2024-09-10T22:41:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ce445c000 1 --2- 172.21.15.103:0/1194180093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560205527bc0 0x560205527fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ce445c000 1 --2- 172.21.15.103:0/1194180093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560205571ac0 0x560205527680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ce445c000 1 --2- 172.21.15.103:0/1194180093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602055711a0 0x560205571580 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ce445c000 1 -- 172.21.15.103:0/1194180093 >> 172.21.15.103:0/1194180093 conn(0x56020552dd20 msgr2=0x560205525f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ce445c000 1 -- 172.21.15.103:0/1194180093 shutdown_connections 2024-09-10T22:41:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ce445c000 1 -- 172.21.15.103:0/1194180093 wait complete. 2024-09-10T22:41:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ce445c000 1 -- start start 2024-09-10T22:41:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ce445c000 1 Processor -- start 2024-09-10T22:41:40.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ce445c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560205527bc0 0x560205578530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ce445c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602055711a0 0x560205578a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ce445c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560205571ac0 0x560205578fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ce445c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560205375dd0 con 0x560205527bc0 2024-09-10T22:41:40.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ce445c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560205371fc0 con 0x5602055711a0 2024-09-10T22:41:40.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ce445c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5602053174b0 con 0x560205571ac0 2024-09-10T22:41:40.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4ce445c000 10 client.0 _ll_register_callbacks cb 0x5602052f57d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:40.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4cd9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560205527bc0 0x560205578530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4cd9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560205527bc0 0x560205578530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36110/0 (socket says 172.21.15.103:36110) 2024-09-10T22:41:40.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4cd9e00640 1 -- 172.21.15.103:0/3567992537 learned_addr learned my addr 172.21.15.103:0/3567992537 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:40.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4cda800640 1 --2- 172.21.15.103:0/3567992537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560205571ac0 0x560205578fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4cd1400640 1 --2- 172.21.15.103:0/3567992537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602055711a0 0x560205578a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4cd9e00640 1 -- 172.21.15.103:0/3567992537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560205571ac0 msgr2=0x560205578fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4cd9e00640 1 --2- 172.21.15.103:0/3567992537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560205571ac0 0x560205578fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4cd9e00640 1 -- 172.21.15.103:0/3567992537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602055711a0 msgr2=0x560205578a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4cd9e00640 1 --2- 172.21.15.103:0/3567992537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602055711a0 0x560205578a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4cd9e00640 1 -- 172.21.15.103:0/3567992537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602053101f0 con 0x560205527bc0 2024-09-10T22:41:40.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4cda800640 1 --2- 172.21.15.103:0/3567992537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560205571ac0 0x560205578fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:40.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4cd1400640 1 --2- 172.21.15.103:0/3567992537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602055711a0 0x560205578a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:40.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4cd9e00640 1 --2- 172.21.15.103:0/3567992537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560205527bc0 0x560205578530 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc000f90 tx=0x7f4ccc021a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ed52ccbdfca3a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:40.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4cbf400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:40.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.804+0000 7f4cbf400640 1 -- 172.21.15.103:0/3567992537 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc025040 con 0x560205527bc0 2024-09-10T22:41:40.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 1 -- 172.21.15.103:0/3567992537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56020530a330 con 0x560205527bc0 2024-09-10T22:41:40.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4cbf400640 1 -- 172.21.15.103:0/3567992537 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f4ccc029440 con 0x560205527bc0 2024-09-10T22:41:40.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4cbf400640 1 -- 172.21.15.103:0/3567992537 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4ccc021e20 con 0x560205527bc0 2024-09-10T22:41:40.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 10 client.5853 fetch_fsmap learned FSMap version 42 2024-09-10T22:41:40.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 1 -- 172.21.15.103:0/3567992537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x5602052f6fa0 con 0x560205527bc0 2024-09-10T22:41:40.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4cbf400640 1 -- 172.21.15.103:0/3567992537 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56020530a330 con 0x560205527bc0 2024-09-10T22:41:40.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4cbf400640 1 -- 172.21.15.103:0/3567992537 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 42) ==== 3554+0+0 (secure 0 0 0) 0x7f4ccc029640 con 0x560205527bc0 2024-09-10T22:41:40.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 10 client.5853 fetch_fsmap finished waiting for FSMap version 42 2024-09-10T22:41:40.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 10 client.5853 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.d 2024-09-10T22:41:40.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 20 client.5853 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:40.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 1 --2- 172.21.15.103:0/3567992537 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x560205580900 0x560205582cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 4 client.5853 mds_command: new command op to 5153 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:41:40.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 1 -- 172.21.15.103:0/3567992537 --> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560205384ae0 con 0x560205580900 2024-09-10T22:41:40.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4cd1400640 1 --2- 172.21.15.103:0/3567992537 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x560205580900 0x560205582cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4cd1400640 1 --2- 172.21.15.103:0/3567992537 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x560205580900 0x560205582cf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eecc9606b7ec7876 server_cookie=7f3e8704472c1f91 in_seq=0 out_seq=0 2024-09-10T22:41:40.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4cbf400640 10 client.5853 ms_handle_connect on v2:172.21.15.131:6835/3348473142 2024-09-10T22:41:40.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4cbf400640 1 -- 172.21.15.103:0/3567992537 <== mds.2 v2:172.21.15.131:6835/3348473142 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560205384ae0 con 0x560205580900 2024-09-10T22:41:40.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4cbf400640 10 client.5853 handle_command_reply: tid=0 2024-09-10T22:41:40.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 1 client.5853 shutdown 2024-09-10T22:41:40.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 1 -- 172.21.15.103:0/3567992537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560205527bc0 msgr2=0x560205578530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 1 --2- 172.21.15.103:0/3567992537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560205527bc0 0x560205578530 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc000f90 tx=0x7f4ccc021a30 comp rx=0 tx=0).stop 2024-09-10T22:41:40.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 1 -- 172.21.15.103:0/3567992537 shutdown_connections 2024-09-10T22:41:40.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 1 --2- 172.21.15.103:0/3567992537 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x560205580900 0x560205582cf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 1 --2- 172.21.15.103:0/3567992537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560205571ac0 0x560205578fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 1 --2- 172.21.15.103:0/3567992537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602055711a0 0x560205578a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 1 --2- 172.21.15.103:0/3567992537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560205527bc0 0x560205578530 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 1 -- 172.21.15.103:0/3567992537 >> 172.21.15.103:0/3567992537 conn(0x56020552dd20 msgr2=0x560205525f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:40.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4cbf400640 0 client.5853 ms_handle_reset on v2:172.21.15.131:6835/3348473142 2024-09-10T22:41:40.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 1 -- 172.21.15.103:0/3567992537 shutdown_connections 2024-09-10T22:41:40.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 1 -- 172.21.15.103:0/3567992537 wait complete. 2024-09-10T22:41:40.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.808+0000 7f4ce445c000 20 client.5853 trim_cache size 0 max 16384 2024-09-10T22:41:40.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4ce445c000 1 Processor -- start 2024-09-10T22:41:40.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4ce445c000 1 -- start start 2024-09-10T22:41:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4ce445c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560205527bc0 0x5602055e2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4ce445c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602055711a0 0x5602055e2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4ce445c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560205571ac0 0x5602055e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4ce445c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc204a10 con 0x5602055711a0 2024-09-10T22:41:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4ce445c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc203be0 con 0x560205571ac0 2024-09-10T22:41:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4ce445c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4cdc2042e0 con 0x560205527bc0 2024-09-10T22:41:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4cd1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602055711a0 0x5602055e2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4cd1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602055711a0 0x5602055e2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36112/0 (socket says 172.21.15.103:36112) 2024-09-10T22:41:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4cd1400640 1 -- 172.21.15.103:0/2620191525 learned_addr learned my addr 172.21.15.103:0/2620191525 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4cd9e00640 1 --2- 172.21.15.103:0/2620191525 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560205527bc0 0x5602055e2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4cda800640 1 --2- 172.21.15.103:0/2620191525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560205571ac0 0x5602055e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4cd1400640 1 -- 172.21.15.103:0/2620191525 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560205527bc0 msgr2=0x5602055e2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4cd1400640 1 --2- 172.21.15.103:0/2620191525 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560205527bc0 0x5602055e2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4cd1400640 1 -- 172.21.15.103:0/2620191525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560205571ac0 msgr2=0x5602055e34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4cd1400640 1 --2- 172.21.15.103:0/2620191525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560205571ac0 0x5602055e34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4cd1400640 1 -- 172.21.15.103:0/2620191525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602053cf660 con 0x5602055711a0 2024-09-10T22:41:40.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4cd1400640 1 --2- 172.21.15.103:0/2620191525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602055711a0 0x5602055e2f60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009610 tx=0x7f4cc4091920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c5833c3b4353d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:40.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4cca000640 1 -- 172.21.15.103:0/2620191525 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4020040 con 0x5602055711a0 2024-09-10T22:41:40.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4cca000640 1 -- 172.21.15.103:0/2620191525 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cc4062fe0 con 0x5602055711a0 2024-09-10T22:41:40.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.824+0000 7f4cca000640 1 -- 172.21.15.103:0/2620191525 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4065040 con 0x5602055711a0 2024-09-10T22:41:40.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 -- 172.21.15.103:0/2620191525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602055711a0 msgr2=0x5602055e2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 --2- 172.21.15.103:0/2620191525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602055711a0 0x5602055e2f60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009610 tx=0x7f4cc4091920 comp rx=0 tx=0).stop 2024-09-10T22:41:40.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 -- 172.21.15.103:0/2620191525 shutdown_connections 2024-09-10T22:41:40.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 --2- 172.21.15.103:0/2620191525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560205571ac0 0x5602055e34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 --2- 172.21.15.103:0/2620191525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602055711a0 0x5602055e2f60 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 --2- 172.21.15.103:0/2620191525 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560205527bc0 0x5602055e2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 -- 172.21.15.103:0/2620191525 >> 172.21.15.103:0/2620191525 conn(0x56020552dd20 msgr2=0x560205528e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:40.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 -- 172.21.15.103:0/2620191525 shutdown_connections 2024-09-10T22:41:40.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 -- 172.21.15.103:0/2620191525 wait complete. 2024-09-10T22:41:40.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 -- start start 2024-09-10T22:41:40.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 Processor -- start 2024-09-10T22:41:40.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560205527bc0 0x560205587500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5602055711a0 0x560205587a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560205571ac0 0x560205587f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560205375dd0 con 0x560205571ac0 2024-09-10T22:41:40.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560205530d40 con 0x560205527bc0 2024-09-10T22:41:40.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56020552e100 con 0x5602055711a0 2024-09-10T22:41:40.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 10 client.0 _ll_register_callbacks cb 0x7f4ccc023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:40.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4cda800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560205571ac0 0x560205587f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4cda800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560205571ac0 0x560205587f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36116/0 (socket says 172.21.15.103:36116) 2024-09-10T22:41:40.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4cda800640 1 -- 172.21.15.103:0/2563031386 learned_addr learned my addr 172.21.15.103:0/2563031386 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:40.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4cd1400640 1 --2- 172.21.15.103:0/2563031386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5602055711a0 0x560205587a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4cd9e00640 1 --2- 172.21.15.103:0/2563031386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560205527bc0 0x560205587500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4cda800640 1 -- 172.21.15.103:0/2563031386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5602055711a0 msgr2=0x560205587a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4cda800640 1 --2- 172.21.15.103:0/2563031386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5602055711a0 0x560205587a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4cda800640 1 -- 172.21.15.103:0/2563031386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560205527bc0 msgr2=0x560205587500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:40.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4cda800640 1 --2- 172.21.15.103:0/2563031386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560205527bc0 0x560205587500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4cda800640 1 -- 172.21.15.103:0/2563031386 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56020533c090 con 0x560205571ac0 2024-09-10T22:41:40.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4cd9e00640 1 --2- 172.21.15.103:0/2563031386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560205527bc0 0x560205587500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:40.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4cda800640 1 --2- 172.21.15.103:0/2563031386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560205571ac0 0x560205587f80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40b0040 tx=0x7f4cd40055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e5d571e8ac8128 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:40.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4cbf400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:40.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4cbf400640 1 -- 172.21.15.103:0/2563031386 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd40b2040 con 0x560205571ac0 2024-09-10T22:41:40.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4cbf400640 1 -- 172.21.15.103:0/2563031386 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f4cd40042f0 con 0x560205571ac0 2024-09-10T22:41:40.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 -- 172.21.15.103:0/2563031386 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cc4062fe0 con 0x560205571ac0 2024-09-10T22:41:40.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4cbf400640 1 -- 172.21.15.103:0/2563031386 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4cd40c5050 con 0x560205571ac0 2024-09-10T22:41:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 10 client.5859 fetch_fsmap learned FSMap version 42 2024-09-10T22:41:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 -- 172.21.15.103:0/2563031386 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x5602053085f0 con 0x560205571ac0 2024-09-10T22:41:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4cbf400640 1 -- 172.21.15.103:0/2563031386 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cc4062fe0 con 0x560205571ac0 2024-09-10T22:41:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4cbf400640 1 -- 172.21.15.103:0/2563031386 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 42) ==== 3554+0+0 (secure 0 0 0) 0x7f4cd40c8020 con 0x560205571ac0 2024-09-10T22:41:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 10 client.5859 fetch_fsmap finished waiting for FSMap version 42 2024-09-10T22:41:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 10 client.5859 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.d 2024-09-10T22:41:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 20 client.5859 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 1 --2- 172.21.15.103:0/2563031386 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x5602055884c0 0x5602055888d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.828+0000 7f4ce445c000 4 client.5859 mds_command: new command op to 5153 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:41:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.832+0000 7f4ce445c000 1 -- 172.21.15.103:0/2563031386 --> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560205380590 con 0x5602055884c0 2024-09-10T22:41:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.832+0000 7f4cd9e00640 1 --2- 172.21.15.103:0/2563031386 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x5602055884c0 0x5602055888d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.832+0000 7f4cd9e00640 1 --2- 172.21.15.103:0/2563031386 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x5602055884c0 0x5602055888d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5e7ffd524fa1d8e1 server_cookie=64dfa56a9a4d0000 in_seq=0 out_seq=0 2024-09-10T22:41:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.832+0000 7f4cbf400640 10 client.5859 ms_handle_connect on v2:172.21.15.131:6835/3348473142 2024-09-10T22:41:40.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4cbf400640 1 -- 172.21.15.103:0/2563031386 <== mds.2 v2:172.21.15.131:6835/3348473142 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560205380590 con 0x5602055884c0 2024-09-10T22:41:40.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4cbf400640 10 client.5859 handle_command_reply: tid=0 2024-09-10T22:41:40.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce445c000 1 client.5859 shutdown 2024-09-10T22:41:40.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce445c000 1 -- 172.21.15.103:0/2563031386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560205571ac0 msgr2=0x560205587f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce445c000 1 --2- 172.21.15.103:0/2563031386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560205571ac0 0x560205587f80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40b0040 tx=0x7f4cd40055e0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce445c000 1 -- 172.21.15.103:0/2563031386 shutdown_connections 2024-09-10T22:41:40.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce445c000 1 --2- 172.21.15.103:0/2563031386 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x5602055884c0 0x5602055888d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce445c000 1 --2- 172.21.15.103:0/2563031386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560205571ac0 0x560205587f80 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce445c000 1 --2- 172.21.15.103:0/2563031386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5602055711a0 0x560205587a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce445c000 1 --2- 172.21.15.103:0/2563031386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560205527bc0 0x560205587500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4cbf400640 0 client.5859 ms_handle_reset on v2:172.21.15.131:6835/3348473142 2024-09-10T22:41:40.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce445c000 1 -- 172.21.15.103:0/2563031386 >> 172.21.15.103:0/2563031386 conn(0x56020552dd20 msgr2=0x560205529540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:40.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce445c000 1 -- 172.21.15.103:0/2563031386 shutdown_connections 2024-09-10T22:41:40.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce445c000 1 -- 172.21.15.103:0/2563031386 wait complete. 2024-09-10T22:41:40.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce445c000 20 client.5859 trim_cache size 0 max 16384 2024-09-10T22:41:40.848 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:41:40.848 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:41:40.848 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:41:40.848 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:41:40.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce1000640 1 -- 172.21.15.103:0/3178424532 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4cb8072610 msgr2=0x7f4cb8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce1000640 1 --2- 172.21.15.103:0/3178424532 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4cb8072610 0x7f4cb8074ad0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc0cebc0 tx=0x7f4ccc009040 comp rx=0 tx=0).stop 2024-09-10T22:41:40.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce1000640 1 -- 172.21.15.103:0/3178424532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cdc0cdd00 msgr2=0x7f4cdc0afeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:40.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce1000640 1 --2- 172.21.15.103:0/3178424532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cdc0cdd00 0x7f4cdc0afeb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400d980 tx=0x7f4cc400de40 comp rx=0 tx=0).stop 2024-09-10T22:41:40.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce1000640 1 -- 172.21.15.103:0/3178424532 shutdown_connections 2024-09-10T22:41:40.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce1000640 1 --2- 172.21.15.103:0/3178424532 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4cb8072610 0x7f4cb8074ad0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce1000640 1 --2- 172.21.15.103:0/3178424532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4cdc15f1a0 0x7f4cdc154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce1000640 1 --2- 172.21.15.103:0/3178424532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cdc0cdd00 0x7f4cdc0afeb0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce1000640 1 --2- 172.21.15.103:0/3178424532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4cdc0cd500 0x7f4cdc14d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:40.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce1000640 1 -- 172.21.15.103:0/3178424532 >> 172.21.15.103:0/3178424532 conn(0x7f4cdc0d1a20 msgr2=0x7f4cdc0719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:40.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce1000640 1 -- 172.21.15.103:0/3178424532 shutdown_connections 2024-09-10T22:41:40.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:40.844+0000 7f4ce1000640 1 -- 172.21.15.103:0/3178424532 wait complete. 2024-09-10T22:41:40.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:41:40.866 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2024-09-10T22:41:40.901 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/ 2024-09-10T22:41:40.901 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4 2024-09-10T22:41:40.901 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5 2024-09-10T22:41:40.901 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5/d6 2024-09-10T22:41:40.901 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5/d6/d7 2024-09-10T22:41:40.901 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2024-09-10T22:41:40.902 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:41:40.903 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:41:40.903 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:41:40.903 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:41:40.903 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2024-09-10T22:41:40.903 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:41:41.008 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627778 2024-09-10T22:41:41.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:41:41.017 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:41:41.017 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:41:41.018 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:41:41.018 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:41:41.018 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2024-09-10T22:41:41.018 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:41:41.125 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627779 2024-09-10T22:41:41.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:41:41.135 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:41:41.135 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:41:41.135 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:41:41.136 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:41:41.136 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2024-09-10T22:41:41.136 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:41:41.240 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627780 2024-09-10T22:41:41.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:41:41.249 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:41:41.249 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:41:41.249 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:41:41.249 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:41:41.249 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2024-09-10T22:41:41.249 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:41:41.360 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627781 2024-09-10T22:41:41.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:41:41.370 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:41:41.370 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:41:41.370 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:41:41.370 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:41:41.370 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2024-09-10T22:41:41.370 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:41:41.480 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627782 2024-09-10T22:41:41.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:41:41.489 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:41:41.489 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:41:41.489 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:41:41.489 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:41:41.490 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2024-09-10T22:41:41.490 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:41:41.596 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627783 2024-09-10T22:41:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:41:41.605 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2024-09-10T22:41:41.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7038e47080 1 Processor -- start 2024-09-10T22:41:41.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7038e47080 1 -- start start 2024-09-10T22:41:41.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7038e47080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559a07625570 0x559a0769f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7038e47080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a076a2e00 0x559a0769f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7038e47080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a076bc4f0 0x559a0769fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7038e47080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559a07533a00 con 0x559a07625570 2024-09-10T22:41:41.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7038e47080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559a07591f40 con 0x559a076a2e00 2024-09-10T22:41:41.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7038e47080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x559a076bb2a0 con 0x559a076bc4f0 2024-09-10T22:41:41.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7035400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559a07625570 0x559a0769f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7035400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559a07625570 0x559a0769f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36144/0 (socket says 172.21.15.103:36144) 2024-09-10T22:41:41.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7035400640 1 -- 172.21.15.103:0/1234534166 learned_addr learned my addr 172.21.15.103:0/1234534166 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:41.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7035e00640 1 --2- 172.21.15.103:0/1234534166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a076bc4f0 0x559a0769fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f702fe00640 1 --2- 172.21.15.103:0/1234534166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a076a2e00 0x559a0769f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7035400640 1 -- 172.21.15.103:0/1234534166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a076bc4f0 msgr2=0x559a0769fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:41.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7035400640 1 --2- 172.21.15.103:0/1234534166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a076bc4f0 0x559a0769fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7035400640 1 -- 172.21.15.103:0/1234534166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a076a2e00 msgr2=0x559a0769f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:41.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7035400640 1 --2- 172.21.15.103:0/1234534166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a076a2e00 0x559a0769f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7035400640 1 -- 172.21.15.103:0/1234534166 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a0750cc10 con 0x559a07625570 2024-09-10T22:41:41.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f702fe00640 1 --2- 172.21.15.103:0/1234534166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a076a2e00 0x559a0769f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:41.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7035400640 1 --2- 172.21.15.103:0/1234534166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559a07625570 0x559a0769f0d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f702800b2e0 tx=0x7f702800b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347b8c7fe49cd622 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:41.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f702f400640 1 -- 172.21.15.103:0/1234534166 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028016070 con 0x559a07625570 2024-09-10T22:41:41.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f702f400640 1 -- 172.21.15.103:0/1234534166 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f702800d4c0 con 0x559a07625570 2024-09-10T22:41:41.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f702f400640 1 -- 172.21.15.103:0/1234534166 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702800d730 con 0x559a07625570 2024-09-10T22:41:41.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7038e47080 1 -- 172.21.15.103:0/1234534166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559a07625570 msgr2=0x559a0769f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7038e47080 1 --2- 172.21.15.103:0/1234534166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559a07625570 0x559a0769f0d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f702800b2e0 tx=0x7f702800b7a0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7038e47080 1 -- 172.21.15.103:0/1234534166 shutdown_connections 2024-09-10T22:41:41.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7038e47080 1 --2- 172.21.15.103:0/1234534166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a076bc4f0 0x559a0769fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7038e47080 1 --2- 172.21.15.103:0/1234534166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a076a2e00 0x559a0769f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7038e47080 1 --2- 172.21.15.103:0/1234534166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559a07625570 0x559a0769f0d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7038e47080 1 -- 172.21.15.103:0/1234534166 >> 172.21.15.103:0/1234534166 conn(0x559a075e6f30 msgr2=0x559a0762ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:41.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7038e47080 1 -- 172.21.15.103:0/1234534166 shutdown_connections 2024-09-10T22:41:41.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.692+0000 7f7038e47080 1 -- 172.21.15.103:0/1234534166 wait complete. 2024-09-10T22:41:41.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7038e47080 1 Processor -- start 2024-09-10T22:41:41.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7038e47080 1 -- start start 2024-09-10T22:41:41.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7038e47080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559a07625570 0x559a0762af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7038e47080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a076a2e00 0x559a0762b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7038e47080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a076bc4f0 0x559a07754590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7038e47080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559a0769e6f0 con 0x559a07625570 2024-09-10T22:41:41.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7038e47080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559a07615570 con 0x559a076a2e00 2024-09-10T22:41:41.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7038e47080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x559a0769e990 con 0x559a076bc4f0 2024-09-10T22:41:41.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7035400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559a07625570 0x559a0762af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7035400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559a07625570 0x559a0762af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36158/0 (socket says 172.21.15.103:36158) 2024-09-10T22:41:41.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7035400640 1 -- 172.21.15.103:0/1466156077 learned_addr learned my addr 172.21.15.103:0/1466156077 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:41.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7035e00640 1 --2- 172.21.15.103:0/1466156077 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a076bc4f0 0x559a07754590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f702fe00640 1 --2- 172.21.15.103:0/1466156077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a076a2e00 0x559a0762b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7035400640 1 -- 172.21.15.103:0/1466156077 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a076bc4f0 msgr2=0x559a07754590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7035400640 1 --2- 172.21.15.103:0/1466156077 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a076bc4f0 0x559a07754590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7035400640 1 -- 172.21.15.103:0/1466156077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a076a2e00 msgr2=0x559a0762b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7035400640 1 --2- 172.21.15.103:0/1466156077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a076a2e00 0x559a0762b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7035400640 1 -- 172.21.15.103:0/1466156077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a076b9330 con 0x559a07625570 2024-09-10T22:41:41.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7035400640 1 --2- 172.21.15.103:0/1466156077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559a07625570 0x559a0762af70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7028000f70 tx=0x7f702800dff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:41.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f702e000640 1 -- 172.21.15.103:0/1466156077 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702801e020 con 0x559a07625570 2024-09-10T22:41:41.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f702e000640 1 -- 172.21.15.103:0/1466156077 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f702800d4c0 con 0x559a07625570 2024-09-10T22:41:41.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7038e47080 1 -- 172.21.15.103:0/1466156077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a0769f3d0 con 0x559a07625570 2024-09-10T22:41:41.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f702e000640 1 -- 172.21.15.103:0/1466156077 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028016040 con 0x559a07625570 2024-09-10T22:41:41.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.696+0000 7f7038e47080 1 -- 172.21.15.103:0/1466156077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a07615910 con 0x559a07625570 2024-09-10T22:41:41.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.700+0000 7f702e000640 1 -- 172.21.15.103:0/1466156077 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f70280108c0 con 0x559a07625570 2024-09-10T22:41:41.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.700+0000 7f702e000640 1 --2- 172.21.15.103:0/1466156077 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7014070fc0 0x7f7014073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.700+0000 7f702e000640 1 -- 172.21.15.103:0/1466156077 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f7028092de0 con 0x559a07625570 2024-09-10T22:41:41.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.700+0000 7f7038e47080 1 --2- 172.21.15.103:0/1466156077 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x559a076b8e20 0x559a0769fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.700+0000 7f7038e47080 1 -- 172.21.15.103:0/1466156077 --> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] -- osd_op(unknown.0.0:1 7.12 7:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x559a076a02f0 con 0x559a076b8e20 2024-09-10T22:41:41.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.700+0000 7f702fe00640 1 --2- 172.21.15.103:0/1466156077 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7014070fc0 0x7f7014073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.700+0000 7f7035e00640 1 --2- 172.21.15.103:0/1466156077 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x559a076b8e20 0x559a0769fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.700+0000 7f702fe00640 1 --2- 172.21.15.103:0/1466156077 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7014070fc0 0x7f7014073480 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f702000c650 tx=0x7f7020004890 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:41.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.700+0000 7f7035e00640 1 --2- 172.21.15.103:0/1466156077 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x559a076b8e20 0x559a0769fdb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.704+0000 7f7035e00640 1 -- 172.21.15.103:0/1466156077 <== osd.6 v2:172.21.15.131:6818/3165743337 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v57'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7030002050 con 0x559a076b8e20 2024-09-10T22:41:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.704+0000 7f7038e47080 1 -- 172.21.15.103:0/1466156077 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x559a076b8e20 msgr2=0x559a0769fdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.704+0000 7f7038e47080 1 --2- 172.21.15.103:0/1466156077 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x559a076b8e20 0x559a0769fdb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.704+0000 7f7038e47080 1 -- 172.21.15.103:0/1466156077 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7014070fc0 msgr2=0x7f7014073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.704+0000 7f7038e47080 1 --2- 172.21.15.103:0/1466156077 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7014070fc0 0x7f7014073480 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f702000c650 tx=0x7f7020004890 comp rx=0 tx=0).stop 2024-09-10T22:41:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.704+0000 7f7038e47080 1 -- 172.21.15.103:0/1466156077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559a07625570 msgr2=0x559a0762af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.704+0000 7f7038e47080 1 --2- 172.21.15.103:0/1466156077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559a07625570 0x559a0762af70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7028000f70 tx=0x7f702800dff0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.704+0000 7f7035e00640 1 -- 172.21.15.103:0/1466156077 reap_dead start 2024-09-10T22:41:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.704+0000 7f7038e47080 1 -- 172.21.15.103:0/1466156077 shutdown_connections 2024-09-10T22:41:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.704+0000 7f7038e47080 1 -- 172.21.15.103:0/1466156077 >> 172.21.15.103:0/1466156077 conn(0x559a075e6f30 msgr2=0x559a07627710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.704+0000 7f7038e47080 1 -- 172.21.15.103:0/1466156077 shutdown_connections 2024-09-10T22:41:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.704+0000 7f7038e47080 1 -- 172.21.15.103:0/1466156077 wait complete. 2024-09-10T22:41:41.710 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2024-09-10T22:41:41.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.752+0000 7f82af02b080 1 Processor -- start 2024-09-10T22:41:41.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.752+0000 7f82af02b080 1 -- start start 2024-09-10T22:41:41.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82af02b080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5638375b7570 0x5638375ba030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82af02b080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563837634e00 0x5638375c1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82af02b080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56383764e4f0 0x5638375c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82af02b080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563837523f40 con 0x563837634e00 2024-09-10T22:41:41.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82af02b080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563837530d00 con 0x56383764e4f0 2024-09-10T22:41:41.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82af02b080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5638374c5a00 con 0x5638375b7570 2024-09-10T22:41:41.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82a2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563837634e00 0x5638375c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82a2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563837634e00 0x5638375c1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36176/0 (socket says 172.21.15.103:36176) 2024-09-10T22:41:41.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82a2800640 1 -- 172.21.15.103:0/1411564446 learned_addr learned my addr 172.21.15.103:0/1411564446 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:41.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82abc00640 1 --2- 172.21.15.103:0/1411564446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56383764e4f0 0x5638375c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82ab200640 1 --2- 172.21.15.103:0/1411564446 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5638375b7570 0x5638375ba030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82a2800640 1 -- 172.21.15.103:0/1411564446 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5638375b7570 msgr2=0x5638375ba030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:41.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82a2800640 1 --2- 172.21.15.103:0/1411564446 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5638375b7570 0x5638375ba030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82a2800640 1 -- 172.21.15.103:0/1411564446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56383764e4f0 msgr2=0x5638375c1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:41.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82a2800640 1 --2- 172.21.15.103:0/1411564446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56383764e4f0 0x5638375c1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82a2800640 1 -- 172.21.15.103:0/1411564446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638375bc850 con 0x563837634e00 2024-09-10T22:41:41.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82a2800640 1 --2- 172.21.15.103:0/1411564446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563837634e00 0x5638375c1760 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f829401b5c0 tx=0x7f8294017e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b41066fc7179a65 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:41.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82a9e00640 1 -- 172.21.15.103:0/1411564446 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82940b0040 con 0x563837634e00 2024-09-10T22:41:41.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82a9e00640 1 -- 172.21.15.103:0/1411564446 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82940ba070 con 0x563837634e00 2024-09-10T22:41:41.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82a9e00640 1 -- 172.21.15.103:0/1411564446 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82940b5410 con 0x563837634e00 2024-09-10T22:41:41.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82af02b080 1 -- 172.21.15.103:0/1411564446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563837634e00 msgr2=0x5638375c1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82af02b080 1 --2- 172.21.15.103:0/1411564446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563837634e00 0x5638375c1760 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f829401b5c0 tx=0x7f8294017e80 comp rx=0 tx=0).stop 2024-09-10T22:41:41.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82af02b080 1 -- 172.21.15.103:0/1411564446 shutdown_connections 2024-09-10T22:41:41.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82af02b080 1 --2- 172.21.15.103:0/1411564446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56383764e4f0 0x5638375c1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82af02b080 1 --2- 172.21.15.103:0/1411564446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563837634e00 0x5638375c1760 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82af02b080 1 --2- 172.21.15.103:0/1411564446 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5638375b7570 0x5638375ba030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82af02b080 1 -- 172.21.15.103:0/1411564446 >> 172.21.15.103:0/1411564446 conn(0x563837578f30 msgr2=0x5638375b9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:41.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82af02b080 1 -- 172.21.15.103:0/1411564446 shutdown_connections 2024-09-10T22:41:41.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82af02b080 1 -- 172.21.15.103:0/1411564446 wait complete. 2024-09-10T22:41:41.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82af02b080 1 Processor -- start 2024-09-10T22:41:41.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.756+0000 7f82af02b080 1 -- start start 2024-09-10T22:41:41.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82af02b080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5638375b7570 0x563837653400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82af02b080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563837634e00 0x5638375c1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82af02b080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56383764e4f0 0x563837654e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82af02b080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5638375775e0 con 0x5638375b7570 2024-09-10T22:41:41.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82af02b080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563837577880 con 0x563837634e00 2024-09-10T22:41:41.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82af02b080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563837577b20 con 0x56383764e4f0 2024-09-10T22:41:41.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82ab200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5638375b7570 0x563837653400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82ab200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5638375b7570 0x563837653400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36186/0 (socket says 172.21.15.103:36186) 2024-09-10T22:41:41.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82ab200640 1 -- 172.21.15.103:0/3093254927 learned_addr learned my addr 172.21.15.103:0/3093254927 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:41.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82a2800640 1 --2- 172.21.15.103:0/3093254927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563837634e00 0x5638375c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82abc00640 1 --2- 172.21.15.103:0/3093254927 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56383764e4f0 0x563837654e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82ab200640 1 -- 172.21.15.103:0/3093254927 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56383764e4f0 msgr2=0x563837654e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82ab200640 1 --2- 172.21.15.103:0/3093254927 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56383764e4f0 0x563837654e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82ab200640 1 -- 172.21.15.103:0/3093254927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563837634e00 msgr2=0x5638375c1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82ab200640 1 --2- 172.21.15.103:0/3093254927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563837634e00 0x5638375c1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82ab200640 1 -- 172.21.15.103:0/3093254927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638376e6e60 con 0x5638375b7570 2024-09-10T22:41:41.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82abc00640 1 --2- 172.21.15.103:0/3093254927 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56383764e4f0 0x563837654e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:41.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82ab200640 1 --2- 172.21.15.103:0/3093254927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5638375b7570 0x563837653400 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f829c00c560 tx=0x7f829c00c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:41.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82a8a00640 1 -- 172.21.15.103:0/3093254927 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c017620 con 0x5638375b7570 2024-09-10T22:41:41.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82a8a00640 1 -- 172.21.15.103:0/3093254927 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f829c013070 con 0x5638375b7570 2024-09-10T22:41:41.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82a8a00640 1 -- 172.21.15.103:0/3093254927 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c017a80 con 0x5638375b7570 2024-09-10T22:41:41.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82af02b080 1 -- 172.21.15.103:0/3093254927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638376e7100 con 0x5638375b7570 2024-09-10T22:41:41.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82af02b080 1 -- 172.21.15.103:0/3093254927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638376e7640 con 0x5638375b7570 2024-09-10T22:41:41.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.760+0000 7f82a8a00640 1 -- 172.21.15.103:0/3093254927 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f829c00f410 con 0x5638375b7570 2024-09-10T22:41:41.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.764+0000 7f82a8a00640 1 --2- 172.21.15.103:0/3093254927 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8288070ff0 0x7f82880734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.764+0000 7f82a8a00640 1 -- 172.21.15.103:0/3093254927 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f829c0927b0 con 0x5638375b7570 2024-09-10T22:41:41.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.764+0000 7f82af02b080 1 --2- 172.21.15.103:0/3093254927 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x5638376ea2e0 0x5638376ea6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.764+0000 7f82af02b080 1 -- 172.21.15.103:0/3093254927 --> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] -- osd_op(unknown.0.0:1 7.12 7:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x563837655380 con 0x5638376ea2e0 2024-09-10T22:41:41.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.764+0000 7f82a2800640 1 --2- 172.21.15.103:0/3093254927 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8288070ff0 0x7f82880734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.764+0000 7f82abc00640 1 --2- 172.21.15.103:0/3093254927 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x5638376ea2e0 0x5638376ea6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.764+0000 7f82a2800640 1 --2- 172.21.15.103:0/3093254927 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8288070ff0 0x7f82880734b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f829401b5c0 tx=0x7f8294004890 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:41.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.764+0000 7f82abc00640 1 --2- 172.21.15.103:0/3093254927 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x5638376ea2e0 0x5638376ea6c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:41.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.764+0000 7f82abc00640 1 -- 172.21.15.103:0/3093254927 <== osd.6 v2:172.21.15.131:6818/3165743337 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v57'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f82a4003a40 con 0x5638376ea2e0 2024-09-10T22:41:41.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.764+0000 7f82af02b080 1 -- 172.21.15.103:0/3093254927 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x5638376ea2e0 msgr2=0x5638376ea6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.764+0000 7f82af02b080 1 --2- 172.21.15.103:0/3093254927 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x5638376ea2e0 0x5638376ea6c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.764+0000 7f82af02b080 1 -- 172.21.15.103:0/3093254927 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8288070ff0 msgr2=0x7f82880734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.764+0000 7f82af02b080 1 --2- 172.21.15.103:0/3093254927 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8288070ff0 0x7f82880734b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f829401b5c0 tx=0x7f8294004890 comp rx=0 tx=0).stop 2024-09-10T22:41:41.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.764+0000 7f82af02b080 1 -- 172.21.15.103:0/3093254927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5638375b7570 msgr2=0x563837653400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.764+0000 7f82af02b080 1 --2- 172.21.15.103:0/3093254927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5638375b7570 0x563837653400 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f829c00c560 tx=0x7f829c00c650 comp rx=0 tx=0).stop 2024-09-10T22:41:41.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.764+0000 7f82abc00640 1 -- 172.21.15.103:0/3093254927 reap_dead start 2024-09-10T22:41:41.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.764+0000 7f82af02b080 1 -- 172.21.15.103:0/3093254927 shutdown_connections 2024-09-10T22:41:41.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.764+0000 7f82af02b080 1 -- 172.21.15.103:0/3093254927 >> 172.21.15.103:0/3093254927 conn(0x563837578f30 msgr2=0x5638375b9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:41.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.768+0000 7f82af02b080 1 -- 172.21.15.103:0/3093254927 shutdown_connections 2024-09-10T22:41:41.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.768+0000 7f82af02b080 1 -- 172.21.15.103:0/3093254927 wait complete. 2024-09-10T22:41:41.773 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2024-09-10T22:41:41.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e92e0080 1 Processor -- start 2024-09-10T22:41:41.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e92e0080 1 -- start start 2024-09-10T22:41:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e92e0080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309efa0570 0x56309ef609c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e92e0080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309f01de00 0x56309efaa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e92e0080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309f0374f0 0x56309efaaca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e92e0080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56309ef0cf40 con 0x56309f0374f0 2024-09-10T22:41:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e92e0080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56309ef19d00 con 0x56309efa0570 2024-09-10T22:41:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e92e0080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56309eeaea00 con 0x56309f01de00 2024-09-10T22:41:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e6e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309f0374f0 0x56309efaaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e6e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309f0374f0 0x56309efaaca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36196/0 (socket says 172.21.15.103:36196) 2024-09-10T22:41:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e6e00640 1 -- 172.21.15.103:0/3716425307 learned_addr learned my addr 172.21.15.103:0/3716425307 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e6e00640 1 -- 172.21.15.103:0/3716425307 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309f01de00 msgr2=0x56309efaa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e5a00640 1 --2- 172.21.15.103:0/3716425307 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309f01de00 0x56309efaa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e6400640 1 --2- 172.21.15.103:0/3716425307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309efa0570 0x56309ef609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e6e00640 1 --2- 172.21.15.103:0/3716425307 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309f01de00 0x56309efaa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e6e00640 1 -- 172.21.15.103:0/3716425307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309efa0570 msgr2=0x56309ef609c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e6e00640 1 --2- 172.21.15.103:0/3716425307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309efa0570 0x56309ef609c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e6e00640 1 -- 172.21.15.103:0/3716425307 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56309ef60f00 con 0x56309f0374f0 2024-09-10T22:41:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e6400640 1 --2- 172.21.15.103:0/3716425307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309efa0570 0x56309ef609c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e5a00640 1 --2- 172.21.15.103:0/3716425307 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309f01de00 0x56309efaa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46e6e00640 1 --2- 172.21.15.103:0/3716425307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309f0374f0 0x56309efaaca0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f46e00016d0 tx=0x7f46e0001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc1b56719d37b21 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46dfe00640 1 -- 172.21.15.103:0/3716425307 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0010790 con 0x56309f0374f0 2024-09-10T22:41:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46dfe00640 1 -- 172.21.15.103:0/3716425307 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46e0010950 con 0x56309f0374f0 2024-09-10T22:41:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.864+0000 7f46dfe00640 1 -- 172.21.15.103:0/3716425307 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0010da0 con 0x56309f0374f0 2024-09-10T22:41:41.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 -- 172.21.15.103:0/3716425307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309f0374f0 msgr2=0x56309efaaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 --2- 172.21.15.103:0/3716425307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309f0374f0 0x56309efaaca0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f46e00016d0 tx=0x7f46e0001b90 comp rx=0 tx=0).stop 2024-09-10T22:41:41.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 -- 172.21.15.103:0/3716425307 shutdown_connections 2024-09-10T22:41:41.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 --2- 172.21.15.103:0/3716425307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309f0374f0 0x56309efaaca0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 --2- 172.21.15.103:0/3716425307 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309f01de00 0x56309efaa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 --2- 172.21.15.103:0/3716425307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309efa0570 0x56309ef609c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 -- 172.21.15.103:0/3716425307 >> 172.21.15.103:0/3716425307 conn(0x56309ef61f30 msgr2=0x56309efa2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:41.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 -- 172.21.15.103:0/3716425307 shutdown_connections 2024-09-10T22:41:41.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 -- 172.21.15.103:0/3716425307 wait complete. 2024-09-10T22:41:41.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 Processor -- start 2024-09-10T22:41:41.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 -- start start 2024-09-10T22:41:41.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309efa0570 0x56309f0d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309f01de00 0x56309efa4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309f0374f0 0x56309f034170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56309efa3260 con 0x56309f01de00 2024-09-10T22:41:41.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56309ef5ffe0 con 0x56309f0374f0 2024-09-10T22:41:41.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56309ef91830 con 0x56309efa0570 2024-09-10T22:41:41.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e5a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309f01de00 0x56309efa4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e5a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309f01de00 0x56309efa4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36200/0 (socket says 172.21.15.103:36200) 2024-09-10T22:41:41.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e5a00640 1 -- 172.21.15.103:0/2425995569 learned_addr learned my addr 172.21.15.103:0/2425995569 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:41.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e6e00640 1 --2- 172.21.15.103:0/2425995569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309f0374f0 0x56309f034170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e6400640 1 --2- 172.21.15.103:0/2425995569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309efa0570 0x56309f0d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e5a00640 1 -- 172.21.15.103:0/2425995569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309efa0570 msgr2=0x56309f0d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e5a00640 1 --2- 172.21.15.103:0/2425995569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309efa0570 0x56309f0d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e5a00640 1 -- 172.21.15.103:0/2425995569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309f0374f0 msgr2=0x56309f034170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e5a00640 1 --2- 172.21.15.103:0/2425995569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309f0374f0 0x56309f034170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e5a00640 1 -- 172.21.15.103:0/2425995569 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56309efa4310 con 0x56309f01de00 2024-09-10T22:41:41.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e6400640 1 --2- 172.21.15.103:0/2425995569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309efa0570 0x56309f0d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:41.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e5a00640 1 --2- 172.21.15.103:0/2425995569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309f01de00 0x56309efa4cf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f46d4096ac0 tx=0x7f46d40ab590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:41.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46dea00640 1 -- 172.21.15.103:0/2425995569 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d40ba030 con 0x56309f01de00 2024-09-10T22:41:41.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46dea00640 1 -- 172.21.15.103:0/2425995569 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46d40b1040 con 0x56309f01de00 2024-09-10T22:41:41.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 -- 172.21.15.103:0/2425995569 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56309efa45b0 con 0x56309f01de00 2024-09-10T22:41:41.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46dea00640 1 -- 172.21.15.103:0/2425995569 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d40abd30 con 0x56309f01de00 2024-09-10T22:41:41.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.868+0000 7f46e92e0080 1 -- 172.21.15.103:0/2425995569 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56309ef91280 con 0x56309f01de00 2024-09-10T22:41:41.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.872+0000 7f46dea00640 1 -- 172.21.15.103:0/2425995569 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f46d40c7060 con 0x56309f01de00 2024-09-10T22:41:41.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.872+0000 7f46dea00640 1 --2- 172.21.15.103:0/2425995569 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f46c8070ff0 0x7f46c80734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.872+0000 7f46dea00640 1 -- 172.21.15.103:0/2425995569 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f46d412ce60 con 0x56309f01de00 2024-09-10T22:41:41.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.872+0000 7f46e92e0080 1 --2- 172.21.15.103:0/2425995569 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x56309f03d450 0x56309f03d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.872+0000 7f46e92e0080 1 -- 172.21.15.103:0/2425995569 --> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] -- osd_op(unknown.0.0:1 7.5 7:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x56309f0346b0 con 0x56309f03d450 2024-09-10T22:41:41.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.872+0000 7f46e6400640 1 --2- 172.21.15.103:0/2425995569 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f46c8070ff0 0x7f46c80734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.872+0000 7f46e6e00640 1 --2- 172.21.15.103:0/2425995569 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x56309f03d450 0x56309f03d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.872+0000 7f46e6400640 1 --2- 172.21.15.103:0/2425995569 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f46c8070ff0 0x7f46c80734b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f46d800e520 tx=0x7f46d8003780 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:41.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.872+0000 7f46e6e00640 1 --2- 172.21.15.103:0/2425995569 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x56309f03d450 0x56309f03d860 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:41.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.876+0000 7f46e6e00640 1 -- 172.21.15.103:0/2425995569 <== osd.7 v2:172.21.15.131:6826/1279722082 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v57'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f46e000f050 con 0x56309f03d450 2024-09-10T22:41:41.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.876+0000 7f46e92e0080 1 -- 172.21.15.103:0/2425995569 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x56309f03d450 msgr2=0x56309f03d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.876+0000 7f46e92e0080 1 --2- 172.21.15.103:0/2425995569 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x56309f03d450 0x56309f03d860 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.876+0000 7f46e92e0080 1 -- 172.21.15.103:0/2425995569 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f46c8070ff0 msgr2=0x7f46c80734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.876+0000 7f46e92e0080 1 --2- 172.21.15.103:0/2425995569 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f46c8070ff0 0x7f46c80734b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f46d800e520 tx=0x7f46d8003780 comp rx=0 tx=0).stop 2024-09-10T22:41:41.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.876+0000 7f46e92e0080 1 -- 172.21.15.103:0/2425995569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309f01de00 msgr2=0x56309efa4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.876+0000 7f46e92e0080 1 --2- 172.21.15.103:0/2425995569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309f01de00 0x56309efa4cf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f46d4096ac0 tx=0x7f46d40ab590 comp rx=0 tx=0).stop 2024-09-10T22:41:41.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.876+0000 7f46e6e00640 1 -- 172.21.15.103:0/2425995569 reap_dead start 2024-09-10T22:41:41.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.876+0000 7f46e92e0080 1 -- 172.21.15.103:0/2425995569 shutdown_connections 2024-09-10T22:41:41.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.876+0000 7f46e92e0080 1 -- 172.21.15.103:0/2425995569 >> 172.21.15.103:0/2425995569 conn(0x56309ef61f30 msgr2=0x56309f034b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:41.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.876+0000 7f46e92e0080 1 -- 172.21.15.103:0/2425995569 shutdown_connections 2024-09-10T22:41:41.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.876+0000 7f46e92e0080 1 -- 172.21.15.103:0/2425995569 wait complete. 2024-09-10T22:41:41.883 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2024-09-10T22:41:41.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f867ab23080 1 Processor -- start 2024-09-10T22:41:41.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f867ab23080 1 -- start start 2024-09-10T22:41:41.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f867ab23080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8731878b0 0x55e87320e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f867ab23080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8731a11d0 0x55e873228eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f867ab23080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e87322b570 0x55e8731856f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f867ab23080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e8730a3a00 con 0x55e87322b570 2024-09-10T22:41:41.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f867ab23080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e873101f40 con 0x55e8731a11d0 2024-09-10T22:41:41.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f867ab23080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55e873210bf0 con 0x55e8731878b0 2024-09-10T22:41:41.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f8678800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e87322b570 0x55e8731856f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f8678800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e87322b570 0x55e8731856f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36210/0 (socket says 172.21.15.103:36210) 2024-09-10T22:41:41.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f8678800640 1 -- 172.21.15.103:0/554578423 learned_addr learned my addr 172.21.15.103:0/554578423 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:41.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f8677e00640 1 --2- 172.21.15.103:0/554578423 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8731878b0 0x55e87320e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f8677400640 1 --2- 172.21.15.103:0/554578423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8731a11d0 0x55e873228eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f8678800640 1 -- 172.21.15.103:0/554578423 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8731878b0 msgr2=0x55e87320e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:41.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f8678800640 1 --2- 172.21.15.103:0/554578423 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8731878b0 0x55e87320e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f8678800640 1 -- 172.21.15.103:0/554578423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8731a11d0 msgr2=0x55e873228eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:41.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f8678800640 1 --2- 172.21.15.103:0/554578423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8731a11d0 0x55e873228eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f8678800640 1 -- 172.21.15.103:0/554578423 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e87307cc10 con 0x55e87322b570 2024-09-10T22:41:41.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f8677400640 1 --2- 172.21.15.103:0/554578423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8731a11d0 0x55e873228eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:41.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f8678800640 1 --2- 172.21.15.103:0/554578423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e87322b570 0x55e8731856f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f86700016a0 tx=0x7f8670001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b576b90e35211ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:41.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f8676000640 1 -- 172.21.15.103:0/554578423 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8670017070 con 0x55e87322b570 2024-09-10T22:41:41.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f8676000640 1 -- 172.21.15.103:0/554578423 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f867000f800 con 0x55e87322b570 2024-09-10T22:41:41.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.968+0000 7f8676000640 1 -- 172.21.15.103:0/554578423 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867000fc30 con 0x55e87322b570 2024-09-10T22:41:41.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 -- 172.21.15.103:0/554578423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e87322b570 msgr2=0x55e8731856f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 --2- 172.21.15.103:0/554578423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e87322b570 0x55e8731856f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f86700016a0 tx=0x7f8670001b60 comp rx=0 tx=0).stop 2024-09-10T22:41:41.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 -- 172.21.15.103:0/554578423 shutdown_connections 2024-09-10T22:41:41.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 --2- 172.21.15.103:0/554578423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e87322b570 0x55e8731856f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 --2- 172.21.15.103:0/554578423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8731a11d0 0x55e873228eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 --2- 172.21.15.103:0/554578423 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e8731878b0 0x55e87320e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 -- 172.21.15.103:0/554578423 >> 172.21.15.103:0/554578423 conn(0x55e873152db0 msgr2=0x55e873227f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:41.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 -- 172.21.15.103:0/554578423 shutdown_connections 2024-09-10T22:41:41.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 -- 172.21.15.103:0/554578423 wait complete. 2024-09-10T22:41:41.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 Processor -- start 2024-09-10T22:41:41.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 -- start start 2024-09-10T22:41:41.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8731878b0 0x55e873199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8731a11d0 0x55e87320d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e87322b570 0x55e87319bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e873229880 con 0x55e8731a11d0 2024-09-10T22:41:41.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e873153fd0 con 0x55e8731878b0 2024-09-10T22:41:41.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55e873229b20 con 0x55e87322b570 2024-09-10T22:41:41.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f8677400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8731a11d0 0x55e87320d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f8677400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8731a11d0 0x55e87320d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36214/0 (socket says 172.21.15.103:36214) 2024-09-10T22:41:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f8677400640 1 -- 172.21.15.103:0/1512024283 learned_addr learned my addr 172.21.15.103:0/1512024283 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f8677e00640 1 --2- 172.21.15.103:0/1512024283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8731878b0 0x55e873199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f8678800640 1 --2- 172.21.15.103:0/1512024283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e87322b570 0x55e87319bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f8677e00640 1 -- 172.21.15.103:0/1512024283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e87322b570 msgr2=0x55e87319bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f8677e00640 1 --2- 172.21.15.103:0/1512024283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e87322b570 0x55e87319bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f8677e00640 1 -- 172.21.15.103:0/1512024283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8731a11d0 msgr2=0x55e87320d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f8677e00640 1 --2- 172.21.15.103:0/1512024283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8731a11d0 0x55e87320d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f8677e00640 1 -- 172.21.15.103:0/1512024283 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8731a05d0 con 0x55e8731878b0 2024-09-10T22:41:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f8677400640 1 --2- 172.21.15.103:0/1512024283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e8731a11d0 0x55e87320d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:41:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f8677e00640 1 --2- 172.21.15.103:0/1512024283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8731878b0 0x55e873199940 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8668008780 tx=0x7f8668008c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:41.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f8674c00640 1 -- 172.21.15.103:0/1512024283 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866800add0 con 0x55e8731878b0 2024-09-10T22:41:41.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 -- 172.21.15.103:0/1512024283 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8731a0870 con 0x55e8731878b0 2024-09-10T22:41:41.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f8674c00640 1 -- 172.21.15.103:0/1512024283 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8668008e30 con 0x55e8731878b0 2024-09-10T22:41:41.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f8674c00640 1 -- 172.21.15.103:0/1512024283 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8668015680 con 0x55e8731878b0 2024-09-10T22:41:41.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.972+0000 7f867ab23080 1 -- 172.21.15.103:0/1512024283 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e87320da40 con 0x55e8731878b0 2024-09-10T22:41:41.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.976+0000 7f8674c00640 1 -- 172.21.15.103:0/1512024283 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8668015820 con 0x55e8731878b0 2024-09-10T22:41:41.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.976+0000 7f8674c00640 1 --2- 172.21.15.103:0/1512024283 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8658070fc0 0x7f8658073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.976+0000 7f8674c00640 1 -- 172.21.15.103:0/1512024283 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f8668092600 con 0x55e8731878b0 2024-09-10T22:41:41.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.976+0000 7f867ab23080 1 --2- 172.21.15.103:0/1512024283 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55e87319c4d0 0x55e87322dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:41.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.976+0000 7f8677400640 1 --2- 172.21.15.103:0/1512024283 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8658070fc0 0x7f8658073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.976+0000 7f867ab23080 1 -- 172.21.15.103:0/1512024283 --> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] -- osd_op(unknown.0.0:1 7.9 7:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x55e87320d5e0 con 0x55e87319c4d0 2024-09-10T22:41:41.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.976+0000 7f8678800640 1 --2- 172.21.15.103:0/1512024283 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55e87319c4d0 0x55e87322dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:41.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.976+0000 7f8677400640 1 --2- 172.21.15.103:0/1512024283 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8658070fc0 0x7f8658073480 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8664003000 tx=0x7f8664019ae0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:41.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.976+0000 7f8678800640 1 --2- 172.21.15.103:0/1512024283 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55e87319c4d0 0x55e87322dea0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:41.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.980+0000 7f8678800640 1 -- 172.21.15.103:0/1512024283 <== osd.0 v2:172.21.15.103:6808/2662233365 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v57'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f867000f070 con 0x55e87319c4d0 2024-09-10T22:41:41.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.980+0000 7f867ab23080 1 -- 172.21.15.103:0/1512024283 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55e87319c4d0 msgr2=0x55e87322dea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.980+0000 7f867ab23080 1 --2- 172.21.15.103:0/1512024283 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55e87319c4d0 0x55e87322dea0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.980+0000 7f867ab23080 1 -- 172.21.15.103:0/1512024283 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8658070fc0 msgr2=0x7f8658073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.980+0000 7f867ab23080 1 --2- 172.21.15.103:0/1512024283 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8658070fc0 0x7f8658073480 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8664003000 tx=0x7f8664019ae0 comp rx=0 tx=0).stop 2024-09-10T22:41:41.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.980+0000 7f867ab23080 1 -- 172.21.15.103:0/1512024283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8731878b0 msgr2=0x55e873199940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:41.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.980+0000 7f867ab23080 1 --2- 172.21.15.103:0/1512024283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8731878b0 0x55e873199940 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8668008780 tx=0x7f8668008c40 comp rx=0 tx=0).stop 2024-09-10T22:41:41.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.980+0000 7f8678800640 1 -- 172.21.15.103:0/1512024283 reap_dead start 2024-09-10T22:41:41.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.980+0000 7f867ab23080 1 -- 172.21.15.103:0/1512024283 shutdown_connections 2024-09-10T22:41:41.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.980+0000 7f867ab23080 1 -- 172.21.15.103:0/1512024283 >> 172.21.15.103:0/1512024283 conn(0x55e873152db0 msgr2=0x55e873227f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:41.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.980+0000 7f867ab23080 1 -- 172.21.15.103:0/1512024283 shutdown_connections 2024-09-10T22:41:41.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:41.980+0000 7f867ab23080 1 -- 172.21.15.103:0/1512024283 wait complete. 2024-09-10T22:41:41.987 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2024-09-10T22:41:42.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc940d85080 1 Processor -- start 2024-09-10T22:41:42.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc940d85080 1 -- start start 2024-09-10T22:41:42.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc940d85080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559361a7e380 0x559361a7a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc940d85080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559361af3e00 0x559361a800b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc940d85080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559361b0da30 0x559361a66210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc940d85080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559361b0ce30 con 0x559361af3e00 2024-09-10T22:41:42.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc940d85080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559361984a00 con 0x559361a7e380 2024-09-10T22:41:42.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc940d85080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x559361b0c2a0 con 0x559361b0da30 2024-09-10T22:41:42.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc937e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559361af3e00 0x559361a800b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc937e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559361af3e00 0x559361a800b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36232/0 (socket says 172.21.15.103:36232) 2024-09-10T22:41:42.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc937e00640 1 -- 172.21.15.103:0/4189307824 learned_addr learned my addr 172.21.15.103:0/4189307824 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc93e000640 1 --2- 172.21.15.103:0/4189307824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559361a7e380 0x559361a7a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc93ea00640 1 --2- 172.21.15.103:0/4189307824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559361b0da30 0x559361a66210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc937e00640 1 -- 172.21.15.103:0/4189307824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559361b0da30 msgr2=0x559361a66210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc937e00640 1 --2- 172.21.15.103:0/4189307824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559361b0da30 0x559361a66210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc937e00640 1 -- 172.21.15.103:0/4189307824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559361a7e380 msgr2=0x559361a7a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc937e00640 1 --2- 172.21.15.103:0/4189307824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559361a7e380 0x559361a7a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc937e00640 1 -- 172.21.15.103:0/4189307824 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559361983a20 con 0x559361af3e00 2024-09-10T22:41:42.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc93e000640 1 --2- 172.21.15.103:0/4189307824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559361a7e380 0x559361a7a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:42.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc93ea00640 1 --2- 172.21.15.103:0/4189307824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559361b0da30 0x559361a66210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:42.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc937e00640 1 --2- 172.21.15.103:0/4189307824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559361af3e00 0x559361a800b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc92801b5e0 tx=0x7fc928017f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41adcf456d4f82e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc93cc00640 1 -- 172.21.15.103:0/4189307824 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9280ab980 con 0x559361af3e00 2024-09-10T22:41:42.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc93cc00640 1 -- 172.21.15.103:0/4189307824 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9280bb070 con 0x559361af3e00 2024-09-10T22:41:42.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc93cc00640 1 -- 172.21.15.103:0/4189307824 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9280b63f0 con 0x559361af3e00 2024-09-10T22:41:42.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc940d85080 1 -- 172.21.15.103:0/4189307824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559361af3e00 msgr2=0x559361a800b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc940d85080 1 --2- 172.21.15.103:0/4189307824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559361af3e00 0x559361a800b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc92801b5e0 tx=0x7fc928017f00 comp rx=0 tx=0).stop 2024-09-10T22:41:42.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc940d85080 1 -- 172.21.15.103:0/4189307824 shutdown_connections 2024-09-10T22:41:42.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc940d85080 1 --2- 172.21.15.103:0/4189307824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559361b0da30 0x559361a66210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc940d85080 1 --2- 172.21.15.103:0/4189307824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559361af3e00 0x559361a800b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc940d85080 1 --2- 172.21.15.103:0/4189307824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559361a7e380 0x559361a7a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc940d85080 1 -- 172.21.15.103:0/4189307824 >> 172.21.15.103:0/4189307824 conn(0x559361a37f30 msgr2=0x559361a65a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc940d85080 1 -- 172.21.15.103:0/4189307824 shutdown_connections 2024-09-10T22:41:42.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.072+0000 7fc940d85080 1 -- 172.21.15.103:0/4189307824 wait complete. 2024-09-10T22:41:42.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc940d85080 1 Processor -- start 2024-09-10T22:41:42.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc940d85080 1 -- start start 2024-09-10T22:41:42.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc940d85080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559361a7e380 0x559361ba69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc940d85080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559361af3e00 0x559361b0a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc940d85080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559361b0da30 0x559361a35f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc940d85080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559361a7d270 con 0x559361af3e00 2024-09-10T22:41:42.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc940d85080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559361a36890 con 0x559361b0da30 2024-09-10T22:41:42.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc940d85080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x559361ba5dd0 con 0x559361a7e380 2024-09-10T22:41:42.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc937e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559361af3e00 0x559361b0a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc937e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559361af3e00 0x559361b0a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36248/0 (socket says 172.21.15.103:36248) 2024-09-10T22:41:42.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc937e00640 1 -- 172.21.15.103:0/3948054837 learned_addr learned my addr 172.21.15.103:0/3948054837 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc93e000640 1 --2- 172.21.15.103:0/3948054837 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559361a7e380 0x559361ba69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc93ea00640 1 --2- 172.21.15.103:0/3948054837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559361b0da30 0x559361a35f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc937e00640 1 -- 172.21.15.103:0/3948054837 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559361a7e380 msgr2=0x559361ba69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc937e00640 1 --2- 172.21.15.103:0/3948054837 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559361a7e380 0x559361ba69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc937e00640 1 -- 172.21.15.103:0/3948054837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559361b0da30 msgr2=0x559361a35f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc937e00640 1 --2- 172.21.15.103:0/3948054837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559361b0da30 0x559361a35f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc937e00640 1 -- 172.21.15.103:0/3948054837 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55936195dc10 con 0x559361af3e00 2024-09-10T22:41:42.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc937e00640 1 --2- 172.21.15.103:0/3948054837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559361af3e00 0x559361b0a0e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc9280b8040 tx=0x7fc9280abb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc936a00640 1 -- 172.21.15.103:0/3948054837 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9280b0040 con 0x559361af3e00 2024-09-10T22:41:42.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc936a00640 1 -- 172.21.15.103:0/3948054837 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9280bb070 con 0x559361af3e00 2024-09-10T22:41:42.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc940d85080 1 -- 172.21.15.103:0/3948054837 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559361b0a620 con 0x559361af3e00 2024-09-10T22:41:42.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc936a00640 1 -- 172.21.15.103:0/3948054837 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9280b6b10 con 0x559361af3e00 2024-09-10T22:41:42.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.076+0000 7fc940d85080 1 -- 172.21.15.103:0/3948054837 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559361ba6010 con 0x559361af3e00 2024-09-10T22:41:42.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.080+0000 7fc936a00640 1 -- 172.21.15.103:0/3948054837 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc9280b6cb0 con 0x559361af3e00 2024-09-10T22:41:42.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.080+0000 7fc936a00640 1 --2- 172.21.15.103:0/3948054837 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc91c070ff0 0x7fc91c0734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.080+0000 7fc936a00640 1 -- 172.21.15.103:0/3948054837 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fc92812e9b0 con 0x559361af3e00 2024-09-10T22:41:42.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.080+0000 7fc93e000640 1 --2- 172.21.15.103:0/3948054837 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc91c070ff0 0x7fc91c0734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.080+0000 7fc940d85080 1 --2- 172.21.15.103:0/3948054837 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x559361af2500 0x559361aef570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.080+0000 7fc940d85080 1 -- 172.21.15.103:0/3948054837 --> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] -- osd_op(unknown.0.0:1 7.5 7:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x559361aefab0 con 0x559361af2500 2024-09-10T22:41:42.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.080+0000 7fc93ea00640 1 --2- 172.21.15.103:0/3948054837 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x559361af2500 0x559361aef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.080+0000 7fc93e000640 1 --2- 172.21.15.103:0/3948054837 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc91c070ff0 0x7fc91c0734b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc93000a790 tx=0x7fc9300049e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.080+0000 7fc93ea00640 1 --2- 172.21.15.103:0/3948054837 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x559361af2500 0x559361aef570 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.084+0000 7fc93ea00640 1 -- 172.21.15.103:0/3948054837 <== osd.7 v2:172.21.15.131:6826/1279722082 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v57'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc93800c7f0 con 0x559361af2500 2024-09-10T22:41:42.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.084+0000 7fc940d85080 1 -- 172.21.15.103:0/3948054837 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x559361af2500 msgr2=0x559361aef570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.084+0000 7fc940d85080 1 --2- 172.21.15.103:0/3948054837 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x559361af2500 0x559361aef570 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.084+0000 7fc940d85080 1 -- 172.21.15.103:0/3948054837 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc91c070ff0 msgr2=0x7fc91c0734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.084+0000 7fc940d85080 1 --2- 172.21.15.103:0/3948054837 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc91c070ff0 0x7fc91c0734b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc93000a790 tx=0x7fc9300049e0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.084+0000 7fc940d85080 1 -- 172.21.15.103:0/3948054837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559361af3e00 msgr2=0x559361b0a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.084+0000 7fc940d85080 1 --2- 172.21.15.103:0/3948054837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559361af3e00 0x559361b0a0e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc9280b8040 tx=0x7fc9280abb60 comp rx=0 tx=0).stop 2024-09-10T22:41:42.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.084+0000 7fc93ea00640 1 -- 172.21.15.103:0/3948054837 reap_dead start 2024-09-10T22:41:42.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.084+0000 7fc940d85080 1 -- 172.21.15.103:0/3948054837 shutdown_connections 2024-09-10T22:41:42.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.084+0000 7fc940d85080 1 -- 172.21.15.103:0/3948054837 >> 172.21.15.103:0/3948054837 conn(0x559361a37f30 msgr2=0x559361a800b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.084+0000 7fc940d85080 1 -- 172.21.15.103:0/3948054837 shutdown_connections 2024-09-10T22:41:42.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.084+0000 7fc940d85080 1 -- 172.21.15.103:0/3948054837 wait complete. 2024-09-10T22:41:42.090 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2024-09-10T22:41:42.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bfbdad080 1 Processor -- start 2024-09-10T22:41:42.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bfbdad080 1 -- start start 2024-09-10T22:41:42.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bfbdad080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556d06f48b0 0x5556d06c1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bfbdad080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556d070e8e0 0x5556d06c2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bfbdad080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5556d0798570 0x5556d0796d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bfbdad080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5556d0610a00 con 0x5556d06f48b0 2024-09-10T22:41:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bfbdad080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5556d066ef40 con 0x5556d070e8e0 2024-09-10T22:41:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bfbdad080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5556d077dbf0 con 0x5556d0798570 2024-09-10T22:41:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bf9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556d06f48b0 0x5556d06c1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bf9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556d06f48b0 0x5556d06c1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36266/0 (socket says 172.21.15.103:36266) 2024-09-10T22:41:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bf9000640 1 -- 172.21.15.103:0/2810809886 learned_addr learned my addr 172.21.15.103:0/2810809886 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bf9000640 1 -- 172.21.15.103:0/2810809886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5556d0798570 msgr2=0x5556d0796d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bf9000640 1 --2- 172.21.15.103:0/2810809886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5556d0798570 0x5556d0796d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bf9000640 1 -- 172.21.15.103:0/2810809886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556d070e8e0 msgr2=0x5556d06c2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bf9000640 1 --2- 172.21.15.103:0/2810809886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556d070e8e0 0x5556d06c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bf9000640 1 -- 172.21.15.103:0/2810809886 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556d05e9c10 con 0x5556d06f48b0 2024-09-10T22:41:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bf9000640 1 --2- 172.21.15.103:0/2810809886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556d06f48b0 0x5556d06c1b00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0bec004f60 tx=0x7f0bec018060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3fe13daeba9913 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bf2a00640 1 -- 172.21.15.103:0/2810809886 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec0a3e00 con 0x5556d06f48b0 2024-09-10T22:41:42.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bf2a00640 1 -- 172.21.15.103:0/2810809886 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bec0bb070 con 0x5556d06f48b0 2024-09-10T22:41:42.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bf2a00640 1 -- 172.21.15.103:0/2810809886 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec0abb30 con 0x5556d06f48b0 2024-09-10T22:41:42.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bfbdad080 1 -- 172.21.15.103:0/2810809886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556d06f48b0 msgr2=0x5556d06c1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bfbdad080 1 --2- 172.21.15.103:0/2810809886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556d06f48b0 0x5556d06c1b00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0bec004f60 tx=0x7f0bec018060 comp rx=0 tx=0).stop 2024-09-10T22:41:42.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bfbdad080 1 -- 172.21.15.103:0/2810809886 shutdown_connections 2024-09-10T22:41:42.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bfbdad080 1 --2- 172.21.15.103:0/2810809886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5556d0798570 0x5556d0796d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bfbdad080 1 --2- 172.21.15.103:0/2810809886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556d070e8e0 0x5556d06c2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bfbdad080 1 --2- 172.21.15.103:0/2810809886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556d06f48b0 0x5556d06c1b00 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bfbdad080 1 -- 172.21.15.103:0/2810809886 >> 172.21.15.103:0/2810809886 conn(0x5556d06bfdb0 msgr2=0x5556d06c0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.180+0000 7f0bfbdad080 1 -- 172.21.15.103:0/2810809886 shutdown_connections 2024-09-10T22:41:42.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bfbdad080 1 -- 172.21.15.103:0/2810809886 wait complete. 2024-09-10T22:41:42.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bfbdad080 1 Processor -- start 2024-09-10T22:41:42.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bfbdad080 1 -- start start 2024-09-10T22:41:42.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bfbdad080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556d06f48b0 0x5556d0706490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bfbdad080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556d070e8e0 0x5556d077a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bfbdad080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5556d0798570 0x5556d08318f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bfbdad080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5556d06c0c60 con 0x5556d06f48b0 2024-09-10T22:41:42.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bfbdad080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5556d06c0f00 con 0x5556d070e8e0 2024-09-10T22:41:42.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bfbdad080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5556d077afe0 con 0x5556d0798570 2024-09-10T22:41:42.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bf9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556d06f48b0 0x5556d0706490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bf9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556d06f48b0 0x5556d0706490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36268/0 (socket says 172.21.15.103:36268) 2024-09-10T22:41:42.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bf9000640 1 -- 172.21.15.103:0/2161190366 learned_addr learned my addr 172.21.15.103:0/2161190366 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bf3e00640 1 --2- 172.21.15.103:0/2161190366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556d070e8e0 0x5556d077a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bf9a00640 1 --2- 172.21.15.103:0/2161190366 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5556d0798570 0x5556d08318f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bf9000640 1 -- 172.21.15.103:0/2161190366 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5556d0798570 msgr2=0x5556d08318f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bf9000640 1 --2- 172.21.15.103:0/2161190366 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5556d0798570 0x5556d08318f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bf9000640 1 -- 172.21.15.103:0/2161190366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556d070e8e0 msgr2=0x5556d077a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bf9000640 1 --2- 172.21.15.103:0/2161190366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556d070e8e0 0x5556d077a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bf9000640 1 -- 172.21.15.103:0/2161190366 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556d0780540 con 0x5556d06f48b0 2024-09-10T22:41:42.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bf3e00640 1 --2- 172.21.15.103:0/2161190366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556d070e8e0 0x5556d077a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:42.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bf9a00640 1 --2- 172.21.15.103:0/2161190366 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5556d0798570 0x5556d08318f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:42.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bf9000640 1 --2- 172.21.15.103:0/2161190366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556d06f48b0 0x5556d0706490 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0bec01b740 tx=0x7f0bec0ab9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bf1600640 1 -- 172.21.15.103:0/2161190366 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec0abde0 con 0x5556d06f48b0 2024-09-10T22:41:42.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bf1600640 1 -- 172.21.15.103:0/2161190366 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bec0c4020 con 0x5556d06f48b0 2024-09-10T22:41:42.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bf1600640 1 -- 172.21.15.103:0/2161190366 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec0c0570 con 0x5556d06f48b0 2024-09-10T22:41:42.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bfbdad080 1 -- 172.21.15.103:0/2161190366 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5556d07807e0 con 0x5556d06f48b0 2024-09-10T22:41:42.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.184+0000 7f0bfbdad080 1 -- 172.21.15.103:0/2161190366 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556d0780d20 con 0x5556d06f48b0 2024-09-10T22:41:42.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.188+0000 7f0bf1600640 1 -- 172.21.15.103:0/2161190366 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0bec0c0710 con 0x5556d06f48b0 2024-09-10T22:41:42.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.188+0000 7f0bf1600640 1 --2- 172.21.15.103:0/2161190366 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0bd8070fc0 0x7f0bd8073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.188+0000 7f0bf1600640 1 -- 172.21.15.103:0/2161190366 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f0bec12e7c0 con 0x5556d06f48b0 2024-09-10T22:41:42.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.188+0000 7f0bfbdad080 1 --2- 172.21.15.103:0/2161190366 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x5556d070d5d0 0x5556d0781460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.188+0000 7f0bf3e00640 1 --2- 172.21.15.103:0/2161190366 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0bd8070fc0 0x7f0bd8073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.188+0000 7f0bfbdad080 1 -- 172.21.15.103:0/2161190366 --> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] -- osd_op(unknown.0.0:1 7.1d 7:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x5556d07819a0 con 0x5556d070d5d0 2024-09-10T22:41:42.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.188+0000 7f0bf9a00640 1 --2- 172.21.15.103:0/2161190366 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x5556d070d5d0 0x5556d0781460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.188+0000 7f0bf9a00640 1 --2- 172.21.15.103:0/2161190366 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x5556d070d5d0 0x5556d0781460 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.188+0000 7f0bf3e00640 1 --2- 172.21.15.103:0/2161190366 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0bd8070fc0 0x7f0bd8073480 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0be4000f70 tx=0x7f0be40015a0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.192+0000 7f0bf9a00640 1 -- 172.21.15.103:0/2161190366 <== osd.1 v2:172.21.15.103:6800/4140822734 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v57'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0bf4002040 con 0x5556d070d5d0 2024-09-10T22:41:42.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.192+0000 7f0bfbdad080 1 -- 172.21.15.103:0/2161190366 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x5556d070d5d0 msgr2=0x5556d0781460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.192+0000 7f0bfbdad080 1 --2- 172.21.15.103:0/2161190366 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x5556d070d5d0 0x5556d0781460 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.192+0000 7f0bfbdad080 1 -- 172.21.15.103:0/2161190366 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0bd8070fc0 msgr2=0x7f0bd8073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.192+0000 7f0bfbdad080 1 --2- 172.21.15.103:0/2161190366 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0bd8070fc0 0x7f0bd8073480 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0be4000f70 tx=0x7f0be40015a0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.192+0000 7f0bfbdad080 1 -- 172.21.15.103:0/2161190366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556d06f48b0 msgr2=0x5556d0706490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.192+0000 7f0bfbdad080 1 --2- 172.21.15.103:0/2161190366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556d06f48b0 0x5556d0706490 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0bec01b740 tx=0x7f0bec0ab9e0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.192+0000 7f0bf9a00640 1 -- 172.21.15.103:0/2161190366 reap_dead start 2024-09-10T22:41:42.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.192+0000 7f0bfbdad080 1 -- 172.21.15.103:0/2161190366 shutdown_connections 2024-09-10T22:41:42.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.192+0000 7f0bfbdad080 1 -- 172.21.15.103:0/2161190366 >> 172.21.15.103:0/2161190366 conn(0x5556d06bfdb0 msgr2=0x5556d0795030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.192+0000 7f0bfbdad080 1 -- 172.21.15.103:0/2161190366 shutdown_connections 2024-09-10T22:41:42.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.192+0000 7f0bfbdad080 1 -- 172.21.15.103:0/2161190366 wait complete. 2024-09-10T22:41:42.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:41:42.198 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub start /d1/d2/d3 recursive,force 2024-09-10T22:41:42.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.344+0000 7f468f800640 1 -- 172.21.15.103:0/28703839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f466c004d50 msgr2=0x7f466c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.344+0000 7f468f800640 1 --2- 172.21.15.103:0/28703839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f466c004d50 0x7f466c0051d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4680009b60 tx=0x7f468001d2b0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.344+0000 7f468d800640 1 -- 172.21.15.103:0/28703839 reap_dead start 2024-09-10T22:41:42.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.344+0000 7f468f800640 1 -- 172.21.15.103:0/28703839 shutdown_connections 2024-09-10T22:41:42.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.344+0000 7f468f800640 1 -- 172.21.15.103:0/28703839 >> 172.21.15.103:0/28703839 conn(0x7f46880d1a20 msgr2=0x7f46880d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.344+0000 7f468f800640 1 -- 172.21.15.103:0/28703839 shutdown_connections 2024-09-10T22:41:42.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.344+0000 7f468f800640 1 -- 172.21.15.103:0/28703839 wait complete. 2024-09-10T22:41:42.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.344+0000 7f468f800640 1 Processor -- start 2024-09-10T22:41:42.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.344+0000 7f468f800640 1 -- start start 2024-09-10T22:41:42.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.344+0000 7f468f800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f466c004d50 0x7f46880c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f468f800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46881f87c0 0x7f46880c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f468f800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46880b50f0 0x7f46880b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f468f800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f46880cdb30 con 0x7f466c004d50 2024-09-10T22:41:42.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f468f800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f46880cd9b0 con 0x7f46881f87c0 2024-09-10T22:41:42.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f468f800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f46880ae7f0 con 0x7f46880b50f0 2024-09-10T22:41:42.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f468ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f466c004d50 0x7f46880c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f468ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f466c004d50 0x7f46880c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36276/0 (socket says 172.21.15.103:36276) 2024-09-10T22:41:42.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f468ce00640 1 -- 172.21.15.103:0/4256736572 learned_addr learned my addr 172.21.15.103:0/4256736572 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f468d800640 1 --2- 172.21.15.103:0/4256736572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46880b50f0 0x7f46880b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f4687e00640 1 --2- 172.21.15.103:0/4256736572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46881f87c0 0x7f46880c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f468ce00640 1 -- 172.21.15.103:0/4256736572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46880b50f0 msgr2=0x7f46880b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f468ce00640 1 --2- 172.21.15.103:0/4256736572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46880b50f0 0x7f46880b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f468ce00640 1 -- 172.21.15.103:0/4256736572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46881f87c0 msgr2=0x7f46880c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f468ce00640 1 --2- 172.21.15.103:0/4256736572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46881f87c0 0x7f46880c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f468ce00640 1 -- 172.21.15.103:0/4256736572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46880c7d50 con 0x7f466c004d50 2024-09-10T22:41:42.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f468ce00640 1 --2- 172.21.15.103:0/4256736572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f466c004d50 0x7f46880c49f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4678006270 tx=0x7f4678006730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f4684c00640 1 -- 172.21.15.103:0/4256736572 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678015070 con 0x7f466c004d50 2024-09-10T22:41:42.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f4684c00640 1 -- 172.21.15.103:0/4256736572 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f467800fd60 con 0x7f466c004d50 2024-09-10T22:41:42.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f468f800640 1 -- 172.21.15.103:0/4256736572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46880c8030 con 0x7f466c004d50 2024-09-10T22:41:42.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f4684c00640 1 -- 172.21.15.103:0/4256736572 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678011690 con 0x7f466c004d50 2024-09-10T22:41:42.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f468f800640 1 -- 172.21.15.103:0/4256736572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46880b4bd0 con 0x7f466c004d50 2024-09-10T22:41:42.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.348+0000 7f4684c00640 1 -- 172.21.15.103:0/4256736572 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4678011830 con 0x7f466c004d50 2024-09-10T22:41:42.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4684c00640 1 --2- 172.21.15.103:0/4256736572 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4668072610 0x7f4668074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4684c00640 1 -- 172.21.15.103:0/4256736572 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f4678094480 con 0x7f466c004d50 2024-09-10T22:41:42.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4692b7c000 1 Processor -- start 2024-09-10T22:41:42.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4687e00640 1 --2- 172.21.15.103:0/4256736572 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4668072610 0x7f4668074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4692b7c000 1 -- start start 2024-09-10T22:41:42.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4687e00640 1 --2- 172.21.15.103:0/4256736572 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4668072610 0x7f4668074ad0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f46880ce200 tx=0x7f46740091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4692b7c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325e10470 0x559325e10850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4692b7c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10d90 0x559325dc6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4692b7c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325dc70b0 0x559325dc7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4692b7c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559325c22bb0 con 0x559325e10d90 2024-09-10T22:41:42.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4692b7c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559325c11fe0 con 0x559325e10470 2024-09-10T22:41:42.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4692b7c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x559325c15df0 con 0x559325dc70b0 2024-09-10T22:41:42.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4687e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10d90 0x559325dc6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4687e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10d90 0x559325dc6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36280/0 (socket says 172.21.15.103:36280) 2024-09-10T22:41:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4687e00640 1 -- 172.21.15.103:0/3951286702 learned_addr learned my addr 172.21.15.103:0/3951286702 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f468ce00640 1 --2- 172.21.15.103:0/3951286702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325e10470 0x559325e10850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f468d800640 1 --2- 172.21.15.103:0/3951286702 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325dc70b0 0x559325dc7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4687e00640 1 -- 172.21.15.103:0/3951286702 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325dc70b0 msgr2=0x559325dc7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4687e00640 1 --2- 172.21.15.103:0/3951286702 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325dc70b0 0x559325dc7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4687e00640 1 -- 172.21.15.103:0/3951286702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325e10470 msgr2=0x559325e10850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4687e00640 1 --2- 172.21.15.103:0/3951286702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325e10470 0x559325e10850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4687e00640 1 -- 172.21.15.103:0/3951286702 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559325bed4a0 con 0x559325e10d90 2024-09-10T22:41:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4687e00640 1 --2- 172.21.15.103:0/3951286702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10d90 0x559325dc6b70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4674004060 tx=0x7f4674017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fddb5e7ea2d11df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f467d600640 1 -- 172.21.15.103:0/3951286702 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674003b80 con 0x559325e10d90 2024-09-10T22:41:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f467d600640 1 -- 172.21.15.103:0/3951286702 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4674003d20 con 0x559325e10d90 2024-09-10T22:41:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f467d600640 1 -- 172.21.15.103:0/3951286702 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46740296a0 con 0x559325e10d90 2024-09-10T22:41:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4692b7c000 1 -- 172.21.15.103:0/3951286702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10d90 msgr2=0x559325dc6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4692b7c000 1 --2- 172.21.15.103:0/3951286702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10d90 0x559325dc6b70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4674004060 tx=0x7f4674017000 comp rx=0 tx=0).stop 2024-09-10T22:41:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4692b7c000 1 -- 172.21.15.103:0/3951286702 shutdown_connections 2024-09-10T22:41:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4692b7c000 1 --2- 172.21.15.103:0/3951286702 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325dc70b0 0x559325dc7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4692b7c000 1 --2- 172.21.15.103:0/3951286702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10d90 0x559325dc6b70 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4692b7c000 1 --2- 172.21.15.103:0/3951286702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325e10470 0x559325e10850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4692b7c000 1 -- 172.21.15.103:0/3951286702 >> 172.21.15.103:0/3951286702 conn(0x559325dc3060 msgr2=0x559325dc5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4692b7c000 1 -- 172.21.15.103:0/3951286702 shutdown_connections 2024-09-10T22:41:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.352+0000 7f4692b7c000 1 -- 172.21.15.103:0/3951286702 wait complete. 2024-09-10T22:41:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4692b7c000 1 -- start start 2024-09-10T22:41:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4692b7c000 1 Processor -- start 2024-09-10T22:41:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4692b7c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325dc70b0 0x559325dcbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4692b7c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325e10470 0x559325dcc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4692b7c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10d90 0x559325dd1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4692b7c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559325ccda10 con 0x559325e10d90 2024-09-10T22:41:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4692b7c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559325bbbb30 con 0x559325dc70b0 2024-09-10T22:41:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4692b7c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x559325bb8990 con 0x559325e10470 2024-09-10T22:41:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4692b7c000 10 client.0 _ll_register_callbacks cb 0x559325cc8c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f468d800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10d90 0x559325dd1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f468d800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10d90 0x559325dd1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36282/0 (socket says 172.21.15.103:36282) 2024-09-10T22:41:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f468d800640 1 -- 172.21.15.103:0/607403460 learned_addr learned my addr 172.21.15.103:0/607403460 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4687e00640 1 --2- 172.21.15.103:0/607403460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325e10470 0x559325dcc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f468ce00640 1 --2- 172.21.15.103:0/607403460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325dc70b0 0x559325dcbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f468d800640 1 -- 172.21.15.103:0/607403460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325e10470 msgr2=0x559325dcc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f468d800640 1 --2- 172.21.15.103:0/607403460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325e10470 0x559325dcc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f468d800640 1 -- 172.21.15.103:0/607403460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325dc70b0 msgr2=0x559325dcbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f468d800640 1 --2- 172.21.15.103:0/607403460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325dc70b0 0x559325dcbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f468d800640 1 -- 172.21.15.103:0/607403460 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559325c5b600 con 0x559325e10d90 2024-09-10T22:41:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f468d800640 1 --2- 172.21.15.103:0/607403460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10d90 0x559325dd1430 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f46800b0040 tx=0x7f46800054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ec4208a4198419 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4672000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4672000640 1 -- 172.21.15.103:0/607403460 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46800b2070 con 0x559325e10d90 2024-09-10T22:41:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4692b7c000 1 -- 172.21.15.103:0/607403460 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559325baa240 con 0x559325e10d90 2024-09-10T22:41:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4672000640 1 -- 172.21.15.103:0/607403460 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f46800055a0 con 0x559325e10d90 2024-09-10T22:41:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4672000640 1 -- 172.21.15.103:0/607403460 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f46800c5050 con 0x559325e10d90 2024-09-10T22:41:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4692b7c000 10 client.5937 fetch_fsmap learned FSMap version 42 2024-09-10T22:41:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4692b7c000 1 -- 172.21.15.103:0/607403460 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x559325bc5350 con 0x559325e10d90 2024-09-10T22:41:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4672000640 1 -- 172.21.15.103:0/607403460 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x559325baa240 con 0x559325e10d90 2024-09-10T22:41:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4672000640 1 -- 172.21.15.103:0/607403460 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 42) ==== 3554+0+0 (secure 0 0 0) 0x7f46800c8020 con 0x559325e10d90 2024-09-10T22:41:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4692b7c000 10 client.5937 fetch_fsmap finished waiting for FSMap version 42 2024-09-10T22:41:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4692b7c000 10 client.5937 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T22:41:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4692b7c000 20 client.5937 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4692b7c000 1 --2- 172.21.15.103:0/607403460 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x559325e167f0 0x559325e16c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4692b7c000 4 client.5937 mds_command: new command op to 5547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:41:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f4692b7c000 1 -- 172.21.15.103:0/607403460 --> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559325c24b00 con 0x559325e167f0 2024-09-10T22:41:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.356+0000 7f468ce00640 1 --2- 172.21.15.103:0/607403460 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x559325e167f0 0x559325e16c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.360+0000 7f468ce00640 1 --2- 172.21.15.103:0/607403460 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x559325e167f0 0x559325e16c00 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfc8bd5bc8f03638 server_cookie=79d440fad49e471 in_seq=0 out_seq=0 2024-09-10T22:41:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.360+0000 7f4672000640 10 client.5937 ms_handle_connect on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.360+0000 7f4672000640 1 -- 172.21.15.103:0/607403460 <== mds.0 v2:172.21.15.103:6832/343761048 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559325c24b00 con 0x559325e167f0 2024-09-10T22:41:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.360+0000 7f4672000640 10 client.5937 handle_command_reply: tid=0 2024-09-10T22:41:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.360+0000 7f4692b7c000 1 client.5937 shutdown 2024-09-10T22:41:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.360+0000 7f4692b7c000 1 -- 172.21.15.103:0/607403460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10d90 msgr2=0x559325dd1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.360+0000 7f4692b7c000 1 --2- 172.21.15.103:0/607403460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10d90 0x559325dd1430 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f46800b0040 tx=0x7f46800054b0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.360+0000 7f4692b7c000 1 -- 172.21.15.103:0/607403460 shutdown_connections 2024-09-10T22:41:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.360+0000 7f4692b7c000 1 --2- 172.21.15.103:0/607403460 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x559325e167f0 0x559325e16c00 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.360+0000 7f4692b7c000 1 --2- 172.21.15.103:0/607403460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10d90 0x559325dd1430 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.360+0000 7f4692b7c000 1 --2- 172.21.15.103:0/607403460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325e10470 0x559325dcc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.360+0000 7f4692b7c000 1 --2- 172.21.15.103:0/607403460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325dc70b0 0x559325dcbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.360+0000 7f4672000640 0 client.5937 ms_handle_reset on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.360+0000 7f4692b7c000 1 -- 172.21.15.103:0/607403460 >> 172.21.15.103:0/607403460 conn(0x559325dc3060 msgr2=0x559325dc5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.360+0000 7f4692b7c000 1 -- 172.21.15.103:0/607403460 shutdown_connections 2024-09-10T22:41:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.360+0000 7f4692b7c000 1 -- 172.21.15.103:0/607403460 wait complete. 2024-09-10T22:41:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.360+0000 7f4692b7c000 20 client.5937 trim_cache size 0 max 16384 2024-09-10T22:41:42.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.376+0000 7f4692b7c000 1 Processor -- start 2024-09-10T22:41:42.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.376+0000 7f4692b7c000 1 -- start start 2024-09-10T22:41:42.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.376+0000 7f4692b7c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325dc70b0 0x559325dca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.376+0000 7f4692b7c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10470 0x559325dcadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325e10d90 0x559325dcb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4688200cd0 con 0x559325e10470 2024-09-10T22:41:42.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f46882013d0 con 0x559325e10d90 2024-09-10T22:41:42.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f46881f4f90 con 0x559325dc70b0 2024-09-10T22:41:42.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4687e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10470 0x559325dcadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4687e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10470 0x559325dcadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36286/0 (socket says 172.21.15.103:36286) 2024-09-10T22:41:42.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4687e00640 1 -- 172.21.15.103:0/1206984689 learned_addr learned my addr 172.21.15.103:0/1206984689 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f468ce00640 1 --2- 172.21.15.103:0/1206984689 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325dc70b0 0x559325dca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f468d800640 1 --2- 172.21.15.103:0/1206984689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325e10d90 0x559325dcb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4687e00640 1 -- 172.21.15.103:0/1206984689 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325dc70b0 msgr2=0x559325dca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4687e00640 1 --2- 172.21.15.103:0/1206984689 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325dc70b0 0x559325dca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4687e00640 1 -- 172.21.15.103:0/1206984689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325e10d90 msgr2=0x559325dcb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4687e00640 1 --2- 172.21.15.103:0/1206984689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325e10d90 0x559325dcb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4687e00640 1 -- 172.21.15.103:0/1206984689 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559325bb0100 con 0x559325e10470 2024-09-10T22:41:42.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4687e00640 1 --2- 172.21.15.103:0/1206984689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10470 0x559325dcadc0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f46740128e0 tx=0x7f4674004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f9afad5d13e21b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f467cc00640 1 -- 172.21.15.103:0/1206984689 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46740047b0 con 0x559325e10470 2024-09-10T22:41:42.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f467cc00640 1 -- 172.21.15.103:0/1206984689 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4674004970 con 0x559325e10470 2024-09-10T22:41:42.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f467cc00640 1 -- 172.21.15.103:0/1206984689 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674004bc0 con 0x559325e10470 2024-09-10T22:41:42.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 -- 172.21.15.103:0/1206984689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10470 msgr2=0x559325dcadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 --2- 172.21.15.103:0/1206984689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10470 0x559325dcadc0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f46740128e0 tx=0x7f4674004740 comp rx=0 tx=0).stop 2024-09-10T22:41:42.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 -- 172.21.15.103:0/1206984689 shutdown_connections 2024-09-10T22:41:42.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 --2- 172.21.15.103:0/1206984689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325e10d90 0x559325dcb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 --2- 172.21.15.103:0/1206984689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325e10470 0x559325dcadc0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 --2- 172.21.15.103:0/1206984689 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325dc70b0 0x559325dca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 -- 172.21.15.103:0/1206984689 >> 172.21.15.103:0/1206984689 conn(0x559325dc3060 msgr2=0x559325e25d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 -- 172.21.15.103:0/1206984689 shutdown_connections 2024-09-10T22:41:42.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 -- 172.21.15.103:0/1206984689 wait complete. 2024-09-10T22:41:42.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 -- start start 2024-09-10T22:41:42.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 Processor -- start 2024-09-10T22:41:42.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325dc70b0 0x559325e1d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325e10470 0x559325e18f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325e10d90 0x559325e19450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559325c15100 con 0x559325dc70b0 2024-09-10T22:41:42.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559325bdfa90 con 0x559325e10470 2024-09-10T22:41:42.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x559325c1a420 con 0x559325e10d90 2024-09-10T22:41:42.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f4692b7c000 10 client.0 _ll_register_callbacks cb 0x7f46800b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:42.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f468ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325dc70b0 0x559325e1d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f468ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325dc70b0 0x559325e1d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36302/0 (socket says 172.21.15.103:36302) 2024-09-10T22:41:42.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.380+0000 7f468ce00640 1 -- 172.21.15.103:0/2277860948 learned_addr learned my addr 172.21.15.103:0/2277860948 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f468d800640 1 --2- 172.21.15.103:0/2277860948 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325e10d90 0x559325e19450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4687e00640 1 --2- 172.21.15.103:0/2277860948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325e10470 0x559325e18f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f468ce00640 1 -- 172.21.15.103:0/2277860948 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325e10d90 msgr2=0x559325e19450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f468ce00640 1 --2- 172.21.15.103:0/2277860948 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325e10d90 0x559325e19450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f468ce00640 1 -- 172.21.15.103:0/2277860948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325e10470 msgr2=0x559325e18f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f468ce00640 1 --2- 172.21.15.103:0/2277860948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325e10470 0x559325e18f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f468ce00640 1 -- 172.21.15.103:0/2277860948 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559325c97290 con 0x559325dc70b0 2024-09-10T22:41:42.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f468ce00640 1 --2- 172.21.15.103:0/2277860948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325dc70b0 0x559325e1d4c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f467805f240 tx=0x7f4678006a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a7fbd13a6e1592 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4672000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:42.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4672000640 1 -- 172.21.15.103:0/2277860948 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678020040 con 0x559325dc70b0 2024-09-10T22:41:42.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4672000640 1 -- 172.21.15.103:0/2277860948 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f467805f710 con 0x559325dc70b0 2024-09-10T22:41:42.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 1 -- 172.21.15.103:0/2277860948 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4674004970 con 0x559325dc70b0 2024-09-10T22:41:42.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4672000640 1 -- 172.21.15.103:0/2277860948 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f467805f2b0 con 0x559325dc70b0 2024-09-10T22:41:42.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 10 client.5943 fetch_fsmap learned FSMap version 42 2024-09-10T22:41:42.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 1 -- 172.21.15.103:0/2277860948 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x559325ba8600 con 0x559325dc70b0 2024-09-10T22:41:42.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4672000640 1 -- 172.21.15.103:0/2277860948 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4674004970 con 0x559325dc70b0 2024-09-10T22:41:42.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4672000640 1 -- 172.21.15.103:0/2277860948 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 42) ==== 3554+0+0 (secure 0 0 0) 0x7f4678068320 con 0x559325dc70b0 2024-09-10T22:41:42.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 10 client.5943 fetch_fsmap finished waiting for FSMap version 42 2024-09-10T22:41:42.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 10 client.5943 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T22:41:42.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 20 client.5943 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:42.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 1 --2- 172.21.15.103:0/2277860948 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x559325e1a1a0 0x559325e8e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 4 client.5943 mds_command: new command op to 5547 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2024-09-10T22:41:42.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 1 -- 172.21.15.103:0/2277860948 --> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) -- 0x559325c205b0 con 0x559325e1a1a0 2024-09-10T22:41:42.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4687e00640 1 --2- 172.21.15.103:0/2277860948 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x559325e1a1a0 0x559325e8e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4672000640 10 client.5943 ms_handle_connect on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:42.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4687e00640 1 --2- 172.21.15.103:0/2277860948 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x559325e1a1a0 0x559325e8e190 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2c43af3b6e6fd28 server_cookie=cb3a51b516ae9e45 in_seq=0 out_seq=0 2024-09-10T22:41:42.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4672000640 1 -- 172.21.15.103:0/2277860948 <== mds.0 v2:172.21.15.103:6832/343761048 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559325c205b0 con 0x559325e1a1a0 2024-09-10T22:41:42.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4672000640 10 client.5943 handle_command_reply: tid=0 2024-09-10T22:41:42.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 1 client.5943 shutdown 2024-09-10T22:41:42.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 1 -- 172.21.15.103:0/2277860948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325dc70b0 msgr2=0x559325e1d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 1 --2- 172.21.15.103:0/2277860948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325dc70b0 0x559325e1d4c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f467805f240 tx=0x7f4678006a40 comp rx=0 tx=0).stop 2024-09-10T22:41:42.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 1 -- 172.21.15.103:0/2277860948 shutdown_connections 2024-09-10T22:41:42.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 1 --2- 172.21.15.103:0/2277860948 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x559325e1a1a0 0x559325e8e190 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 1 --2- 172.21.15.103:0/2277860948 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559325e10d90 0x559325e19450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 1 --2- 172.21.15.103:0/2277860948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559325e10470 0x559325e18f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 1 --2- 172.21.15.103:0/2277860948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559325dc70b0 0x559325e1d4c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 1 -- 172.21.15.103:0/2277860948 >> 172.21.15.103:0/2277860948 conn(0x559325dc3060 msgr2=0x559325dcb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4672000640 0 client.5943 ms_handle_reset on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:42.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 1 -- 172.21.15.103:0/2277860948 shutdown_connections 2024-09-10T22:41:42.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 1 -- 172.21.15.103:0/2277860948 wait complete. 2024-09-10T22:41:42.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.384+0000 7f4692b7c000 20 client.5943 trim_cache size 0 max 16384 2024-09-10T22:41:42.394 INFO:tasks.ceph.mds.a.smithi103.stderr:2024-09-10T22:41:42.384+0000 7faa03e00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-10T22:41:24.276414+0000 1=0+1) n(v3 rc2024-09-10T22:41:24.501380+0000 6=0+6) (inest mix dirty) (ifile excl) caps={5718=pAsLsXsFsx/AsLsXsFsx@9},l=5718 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x5637621a7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:41:24.276414+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:41:24.501380+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-10T22:41:24.276414+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-10T22:41:24.501380+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-10T22:41:42.394 INFO:tasks.ceph.mds.c.smithi103.stderr:2024-09-10T22:41:42.384+0000 7fad57e00640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-10T22:41:24.279863+0000 1=0+1) n(v2 rc2024-09-10T22:41:24.501380+0000 4=0+4) (inest lock) caps={5718=pAsLsXsFs/-@7},l=5718 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x559f49588580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:41:24.279863+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:41:24.501380+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-10T22:41:24.279863+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-10T22:41:24.501380+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-10T22:41:42.395 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:41:42.395 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0, 2024-09-10T22:41:42.395 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_tag": "42b5cfe9-6527-4d7a-bba4-3f2b1b35b58a", 2024-09-10T22:41:42.395 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": "asynchronous" 2024-09-10T22:41:42.395 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:41:42.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.388+0000 7f468f800640 1 -- 172.21.15.103:0/4256736572 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4668072610 msgr2=0x7f4668074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.388+0000 7f468f800640 1 --2- 172.21.15.103:0/4256736572 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4668072610 0x7f4668074ad0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f46880ce200 tx=0x7f46740091e0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.388+0000 7f468f800640 1 -- 172.21.15.103:0/4256736572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f466c004d50 msgr2=0x7f46880c49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.388+0000 7f468f800640 1 --2- 172.21.15.103:0/4256736572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f466c004d50 0x7f46880c49f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4678006270 tx=0x7f4678006730 comp rx=0 tx=0).stop 2024-09-10T22:41:42.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.388+0000 7f468f800640 1 -- 172.21.15.103:0/4256736572 shutdown_connections 2024-09-10T22:41:42.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.388+0000 7f468f800640 1 --2- 172.21.15.103:0/4256736572 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4668072610 0x7f4668074ad0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.388+0000 7f468f800640 1 --2- 172.21.15.103:0/4256736572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46880b50f0 0x7f46880b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.388+0000 7f468f800640 1 --2- 172.21.15.103:0/4256736572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46881f87c0 0x7f46880c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.388+0000 7f468f800640 1 --2- 172.21.15.103:0/4256736572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f466c004d50 0x7f46880c49f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.388+0000 7f468f800640 1 -- 172.21.15.103:0/4256736572 >> 172.21.15.103:0/4256736572 conn(0x7f46880d1a20 msgr2=0x7f468815c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.388+0000 7f468f800640 1 -- 172.21.15.103:0/4256736572 shutdown_connections 2024-09-10T22:41:42.397 INFO:tasks.ceph.mds.a.smithi103.stderr:2024-09-10T22:41:42.388+0000 7faa0c000640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-10T22:41:24.278188+0000 1=0+1) n(v4 rc2024-09-10T22:41:24.501380+0000 5=0+5) (inest sync->mix g=1,2) caps={5718=pAsLsXsFs/-@11} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x5637621a7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:41:24.278188+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:41:24.501380+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-10T22:41:24.278188+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-10T22:41:24.501380+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-10T22:41:42.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.388+0000 7f468f800640 1 -- 172.21.15.103:0/4256736572 wait complete. 2024-09-10T22:41:42.397 INFO:tasks.ceph.mds.c.smithi103.stderr:2024-09-10T22:41:42.388+0000 7fad60000640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-10T22:41:24.281657+0000 1=0+1) n(v1 rc2024-09-10T22:41:24.501380+0000 3=0+3) (inest sync->mix g=0,2 scatter_wanted) caps={5718=pAsLsXsFs/-@7} | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x559f49588b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:41:24.281657+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:41:24.283348+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-10T22:41:24.281657+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-10T22:41:24.501380+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-10T22:41:42.398 INFO:tasks.ceph.mds.d.smithi131.stderr:2024-09-10T22:41:42.384+0000 7fba35200640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-10T22:41:24.283348+0000 1=0+1) n(v0 rc2024-09-10T22:41:24.283348+0000 2=0+2) (inest lock) (ifile excl) caps={5718=pAsLsXsFsx/-@6},l=5718 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x564666b3a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:41:24.283348+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:41:24.283348+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-10T22:41:24.283348+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-10T22:41:24.283348+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-10T22:41:42.398 INFO:tasks.ceph.mds.d.smithi131.stderr:2024-09-10T22:41:42.384+0000 7fba35200640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) caps={5718=pAsLsXsFs/-@3},l=5718 | request=0 lock=0 importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x564666b3ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-10T22:41:42.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:41:42.409 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub abort 2024-09-10T22:41:42.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99f400640 1 -- 172.21.15.103:0/771774532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa99815c970 msgr2=0x7fa998072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99f400640 1 --2- 172.21.15.103:0/771774532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa99815c970 0x7fa998072e30 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa99806dbc0 tx=0x7fa98001c740 comp rx=0 tx=0).stop 2024-09-10T22:41:42.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99f400640 1 -- 172.21.15.103:0/771774532 shutdown_connections 2024-09-10T22:41:42.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99f400640 1 --2- 172.21.15.103:0/771774532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa99815c970 0x7fa998072e30 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99f400640 1 --2- 172.21.15.103:0/771774532 >> v2:172.21.15.131:3300/0 conn(0x7fa9980cc120 0x7fa9980aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99f400640 1 -- 172.21.15.103:0/771774532 >> 172.21.15.103:0/771774532 conn(0x7fa99806cc00 msgr2=0x7fa99806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99f400640 1 -- 172.21.15.103:0/771774532 shutdown_connections 2024-09-10T22:41:42.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99f400640 1 -- 172.21.15.103:0/771774532 wait complete. 2024-09-10T22:41:42.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99f400640 1 Processor -- start 2024-09-10T22:41:42.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99f400640 1 -- start start 2024-09-10T22:41:42.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9980cc120 0x7fa99815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99f400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9980cf790 0x7fa9981fb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa99815c970 0x7fa9981585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99f400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa998169030 con 0x7fa9980cc120 2024-09-10T22:41:42.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99f400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa998168eb0 con 0x7fa99815c970 2024-09-10T22:41:42.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99f400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa9981691b0 con 0x7fa9980cf790 2024-09-10T22:41:42.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9980cc120 0x7fa99815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9980cc120 0x7fa99815b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36316/0 (socket says 172.21.15.103:36316) 2024-09-10T22:41:42.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.552+0000 7fa99ca00640 1 -- 172.21.15.103:0/864513218 learned_addr learned my addr 172.21.15.103:0/864513218 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.556+0000 7fa98fe00640 1 --2- 172.21.15.103:0/864513218 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9980cf790 0x7fa9981fb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.556+0000 7fa99d400640 1 --2- 172.21.15.103:0/864513218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa99815c970 0x7fa9981585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.556+0000 7fa99ca00640 1 -- 172.21.15.103:0/864513218 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9980cf790 msgr2=0x7fa9981fb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.556+0000 7fa99ca00640 1 --2- 172.21.15.103:0/864513218 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9980cf790 0x7fa9981fb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.556+0000 7fa99ca00640 1 -- 172.21.15.103:0/864513218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa99815c970 msgr2=0x7fa9981585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.556+0000 7fa99ca00640 1 --2- 172.21.15.103:0/864513218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa99815c970 0x7fa9981585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.556+0000 7fa99ca00640 1 -- 172.21.15.103:0/864513218 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9981fbbb0 con 0x7fa9980cc120 2024-09-10T22:41:42.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.556+0000 7fa99ca00640 1 --2- 172.21.15.103:0/864513218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9980cc120 0x7fa99815b3c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa98800c970 tx=0x7fa98800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.556+0000 7fa995600640 1 -- 172.21.15.103:0/864513218 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa988007c70 con 0x7fa9980cc120 2024-09-10T22:41:42.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.556+0000 7fa995600640 1 -- 172.21.15.103:0/864513218 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa98800f450 con 0x7fa9980cc120 2024-09-10T22:41:42.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.556+0000 7fa995600640 1 -- 172.21.15.103:0/864513218 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98800f8a0 con 0x7fa9980cc120 2024-09-10T22:41:42.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.556+0000 7fa99f400640 1 -- 172.21.15.103:0/864513218 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9980afcf0 con 0x7fa9980cc120 2024-09-10T22:41:42.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.556+0000 7fa99f400640 1 -- 172.21.15.103:0/864513218 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa99815abc0 con 0x7fa9980cc120 2024-09-10T22:41:42.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.556+0000 7fa995600640 1 -- 172.21.15.103:0/864513218 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa98800fa40 con 0x7fa9980cc120 2024-09-10T22:41:42.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa995600640 1 --2- 172.21.15.103:0/864513218 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa9740725e0 0x7fa974074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa995600640 1 -- 172.21.15.103:0/864513218 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fa988093b60 con 0x7fa9980cc120 2024-09-10T22:41:42.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa9a2786000 1 Processor -- start 2024-09-10T22:41:42.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa9a2786000 1 -- start start 2024-09-10T22:41:42.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa98fe00640 1 --2- 172.21.15.103:0/864513218 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa9740725e0 0x7fa974074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa98fe00640 1 --2- 172.21.15.103:0/864513218 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa9740725e0 0x7fa974074aa0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa9800af000 tx=0x7fa98001af80 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa9a2786000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 0x5555f7ad2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa9a2786000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7ad33d0 0x5555f7ad37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa9a2786000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f7a895a0 0x5555f7a89980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa9a2786000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5555f78872c0 con 0x5555f79711d0 2024-09-10T22:41:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa9a2786000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5555f78e4b90 con 0x5555f7ad33d0 2024-09-10T22:41:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa9a2786000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5555f78d3fc0 con 0x5555f7a895a0 2024-09-10T22:41:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa99ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 0x5555f7ad2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa99ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 0x5555f7ad2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36330/0 (socket says 172.21.15.103:36330) 2024-09-10T22:41:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa99ca00640 1 -- 172.21.15.103:0/3657466440 learned_addr learned my addr 172.21.15.103:0/3657466440 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa98fe00640 1 --2- 172.21.15.103:0/3657466440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7ad33d0 0x5555f7ad37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa99d400640 1 --2- 172.21.15.103:0/3657466440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f7a895a0 0x5555f7a89980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa99ca00640 1 -- 172.21.15.103:0/3657466440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f7a895a0 msgr2=0x5555f7a89980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa99ca00640 1 --2- 172.21.15.103:0/3657466440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f7a895a0 0x5555f7a89980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa99ca00640 1 -- 172.21.15.103:0/3657466440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7ad33d0 msgr2=0x5555f7ad37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa99ca00640 1 --2- 172.21.15.103:0/3657466440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7ad33d0 0x5555f7ad37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa99ca00640 1 -- 172.21.15.103:0/3657466440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555f78721a0 con 0x5555f79711d0 2024-09-10T22:41:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa99ca00640 1 --2- 172.21.15.103:0/3657466440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 0x5555f7ad2e90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa98801e030 tx=0x7fa98805e4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7908e0040734918d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa98d600640 1 -- 172.21.15.103:0/3657466440 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98801d030 con 0x5555f79711d0 2024-09-10T22:41:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa98d600640 1 -- 172.21.15.103:0/3657466440 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9880633c0 con 0x5555f79711d0 2024-09-10T22:41:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa98d600640 1 -- 172.21.15.103:0/3657466440 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa988067de0 con 0x5555f79711d0 2024-09-10T22:41:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa9a2786000 1 -- 172.21.15.103:0/3657466440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 msgr2=0x5555f7ad2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa9a2786000 1 --2- 172.21.15.103:0/3657466440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 0x5555f7ad2e90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa98801e030 tx=0x7fa98805e4a0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa9a2786000 1 -- 172.21.15.103:0/3657466440 shutdown_connections 2024-09-10T22:41:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa9a2786000 1 --2- 172.21.15.103:0/3657466440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f7a895a0 0x5555f7a89980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa9a2786000 1 --2- 172.21.15.103:0/3657466440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7ad33d0 0x5555f7ad37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa9a2786000 1 --2- 172.21.15.103:0/3657466440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 0x5555f7ad2e90 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa9a2786000 1 -- 172.21.15.103:0/3657466440 >> 172.21.15.103:0/3657466440 conn(0x5555f7592880 msgr2=0x5555f7a87e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa9a2786000 1 -- 172.21.15.103:0/3657466440 shutdown_connections 2024-09-10T22:41:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.560+0000 7fa9a2786000 1 -- 172.21.15.103:0/3657466440 wait complete. 2024-09-10T22:41:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa9a2786000 1 -- start start 2024-09-10T22:41:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa9a2786000 1 Processor -- start 2024-09-10T22:41:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa9a2786000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f79711d0 0x5555f7ad9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa9a2786000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7a895a0 0x5555f7ad9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa9a2786000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f7ad33d0 0x5555f7ada4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa9a2786000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5555f78794d0 con 0x5555f7ad33d0 2024-09-10T22:41:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa9a2786000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5555f78d7dd0 con 0x5555f7a895a0 2024-09-10T22:41:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa9a2786000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5555f7599620 con 0x5555f79711d0 2024-09-10T22:41:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa9a2786000 10 client.0 _ll_register_callbacks cb 0x5555f78aacd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa99d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f7ad33d0 0x5555f7ada4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa99d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f7ad33d0 0x5555f7ada4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36334/0 (socket says 172.21.15.103:36334) 2024-09-10T22:41:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa99d400640 1 -- 172.21.15.103:0/2650959030 learned_addr learned my addr 172.21.15.103:0/2650959030 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa99ca00640 1 --2- 172.21.15.103:0/2650959030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f79711d0 0x5555f7ad9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa98fe00640 1 --2- 172.21.15.103:0/2650959030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7a895a0 0x5555f7ad9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa99d400640 1 -- 172.21.15.103:0/2650959030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f79711d0 msgr2=0x5555f7ad9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa99d400640 1 --2- 172.21.15.103:0/2650959030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f79711d0 0x5555f7ad9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa99d400640 1 -- 172.21.15.103:0/2650959030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7a895a0 msgr2=0x5555f7ad9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa99d400640 1 --2- 172.21.15.103:0/2650959030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7a895a0 0x5555f7ad9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa99d400640 1 -- 172.21.15.103:0/2650959030 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555f79a3720 con 0x5555f7ad33d0 2024-09-10T22:41:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa99d400640 1 --2- 172.21.15.103:0/2650959030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f7ad33d0 0x5555f7ada4a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa9900057a0 tx=0x7fa990001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3edd4834e7eac21a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa986000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa986000640 1 -- 172.21.15.103:0/2650959030 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990013600 con 0x5555f7ad33d0 2024-09-10T22:41:42.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa9a2786000 1 -- 172.21.15.103:0/2650959030 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5555f786c2e0 con 0x5555f7ad33d0 2024-09-10T22:41:42.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa986000640 1 -- 172.21.15.103:0/2650959030 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fa9900137a0 con 0x5555f7ad33d0 2024-09-10T22:41:42.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa986000640 1 -- 172.21.15.103:0/2650959030 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa990022050 con 0x5555f7ad33d0 2024-09-10T22:41:42.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa9a2786000 10 client.5958 fetch_fsmap learned FSMap version 42 2024-09-10T22:41:42.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa9a2786000 1 -- 172.21.15.103:0/2650959030 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x5555f7959420 con 0x5555f7ad33d0 2024-09-10T22:41:42.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa986000640 1 -- 172.21.15.103:0/2650959030 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5555f786c2e0 con 0x5555f7ad33d0 2024-09-10T22:41:42.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa986000640 1 -- 172.21.15.103:0/2650959030 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 42) ==== 3554+0+0 (secure 0 0 0) 0x7fa990025020 con 0x5555f7ad33d0 2024-09-10T22:41:42.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa9a2786000 10 client.5958 fetch_fsmap finished waiting for FSMap version 42 2024-09-10T22:41:42.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa9a2786000 10 client.5958 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T22:41:42.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa9a2786000 20 client.5958 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:42.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa9a2786000 1 --2- 172.21.15.103:0/2650959030 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5555f7ae1df0 0x5555f7ae41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa9a2786000 4 client.5958 mds_command: new command op to 5547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:41:42.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa9a2786000 1 -- 172.21.15.103:0/2650959030 --> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555f78e6ae0 con 0x5555f7ae1df0 2024-09-10T22:41:42.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa99ca00640 1 --2- 172.21.15.103:0/2650959030 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5555f7ae1df0 0x5555f7ae41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa986000640 10 client.5958 ms_handle_connect on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.564+0000 7fa99ca00640 1 --2- 172.21.15.103:0/2650959030 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5555f7ae1df0 0x5555f7ae41e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee5bfa58f7b5af5c server_cookie=78dd9bc2d6c59397 in_seq=0 out_seq=0 2024-09-10T22:41:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.568+0000 7fa986000640 1 -- 172.21.15.103:0/2650959030 <== mds.0 v2:172.21.15.103:6832/343761048 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5555f78e6ae0 con 0x5555f7ae1df0 2024-09-10T22:41:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.568+0000 7fa986000640 10 client.5958 handle_command_reply: tid=0 2024-09-10T22:41:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.568+0000 7fa9a2786000 1 client.5958 shutdown 2024-09-10T22:41:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.568+0000 7fa9a2786000 1 -- 172.21.15.103:0/2650959030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f7ad33d0 msgr2=0x5555f7ada4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.568+0000 7fa9a2786000 1 --2- 172.21.15.103:0/2650959030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f7ad33d0 0x5555f7ada4a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa9900057a0 tx=0x7fa990001cc0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.568+0000 7fa9a2786000 1 -- 172.21.15.103:0/2650959030 shutdown_connections 2024-09-10T22:41:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.568+0000 7fa9a2786000 1 --2- 172.21.15.103:0/2650959030 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5555f7ae1df0 0x5555f7ae41e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.568+0000 7fa9a2786000 1 --2- 172.21.15.103:0/2650959030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f7ad33d0 0x5555f7ada4a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.568+0000 7fa9a2786000 1 --2- 172.21.15.103:0/2650959030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7a895a0 0x5555f7ad9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.568+0000 7fa986000640 0 client.5958 ms_handle_reset on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.568+0000 7fa9a2786000 1 --2- 172.21.15.103:0/2650959030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f79711d0 0x5555f7ad9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.568+0000 7fa9a2786000 1 -- 172.21.15.103:0/2650959030 >> 172.21.15.103:0/2650959030 conn(0x5555f7592880 msgr2=0x5555f7a88590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.568+0000 7fa9a2786000 1 -- 172.21.15.103:0/2650959030 shutdown_connections 2024-09-10T22:41:42.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.568+0000 7fa9a2786000 1 -- 172.21.15.103:0/2650959030 wait complete. 2024-09-10T22:41:42.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.568+0000 7fa9a2786000 20 client.5958 trim_cache size 0 max 16384 2024-09-10T22:41:42.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.584+0000 7fa9a2786000 1 Processor -- start 2024-09-10T22:41:42.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.584+0000 7fa9a2786000 1 -- start start 2024-09-10T22:41:42.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.584+0000 7fa9a2786000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 0x5555f7a87660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.584+0000 7fa9a2786000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7a895a0 0x5555f7a87ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.584+0000 7fa9a2786000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f7ad33d0 0x5555f7a880e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.584+0000 7fa9a2786000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa9982049d0 con 0x5555f79711d0 2024-09-10T22:41:42.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.584+0000 7fa9a2786000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa998203ba0 con 0x5555f7a895a0 2024-09-10T22:41:42.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.584+0000 7fa9a2786000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa9982042a0 con 0x5555f7ad33d0 2024-09-10T22:41:42.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.584+0000 7fa99ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 0x5555f7a87660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.584+0000 7fa99ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 0x5555f7a87660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36350/0 (socket says 172.21.15.103:36350) 2024-09-10T22:41:42.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.584+0000 7fa99ca00640 1 -- 172.21.15.103:0/1406393330 learned_addr learned my addr 172.21.15.103:0/1406393330 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.584+0000 7fa99d400640 1 --2- 172.21.15.103:0/1406393330 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f7ad33d0 0x5555f7a880e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.584+0000 7fa98fe00640 1 --2- 172.21.15.103:0/1406393330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7a895a0 0x5555f7a87ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa99ca00640 1 -- 172.21.15.103:0/1406393330 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f7ad33d0 msgr2=0x5555f7a880e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa99ca00640 1 --2- 172.21.15.103:0/1406393330 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f7ad33d0 0x5555f7a880e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa99ca00640 1 -- 172.21.15.103:0/1406393330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7a895a0 msgr2=0x5555f7a87ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa99ca00640 1 --2- 172.21.15.103:0/1406393330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7a895a0 0x5555f7a87ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa99ca00640 1 -- 172.21.15.103:0/1406393330 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555f7930ae0 con 0x5555f79711d0 2024-09-10T22:41:42.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa99d400640 1 --2- 172.21.15.103:0/1406393330 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f7ad33d0 0x5555f7a880e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:42.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa98fe00640 1 --2- 172.21.15.103:0/1406393330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7a895a0 0x5555f7a87ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:42.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa99ca00640 1 --2- 172.21.15.103:0/1406393330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 0x5555f7a87660 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa98805eb50 tx=0x7fa988000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7377f54e4335d2e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa98cc00640 1 -- 172.21.15.103:0/1406393330 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98801d040 con 0x5555f79711d0 2024-09-10T22:41:42.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa98cc00640 1 -- 172.21.15.103:0/1406393330 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa988067de0 con 0x5555f79711d0 2024-09-10T22:41:42.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa98cc00640 1 -- 172.21.15.103:0/1406393330 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa988067bb0 con 0x5555f79711d0 2024-09-10T22:41:42.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 1 -- 172.21.15.103:0/1406393330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 msgr2=0x5555f7a87660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 1 --2- 172.21.15.103:0/1406393330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 0x5555f7a87660 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa98805eb50 tx=0x7fa988000bd0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 1 -- 172.21.15.103:0/1406393330 shutdown_connections 2024-09-10T22:41:42.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 1 --2- 172.21.15.103:0/1406393330 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f7ad33d0 0x5555f7a880e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 1 --2- 172.21.15.103:0/1406393330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7a895a0 0x5555f7a87ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 1 --2- 172.21.15.103:0/1406393330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 0x5555f7a87660 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 1 -- 172.21.15.103:0/1406393330 >> 172.21.15.103:0/1406393330 conn(0x5555f7592880 msgr2=0x5555f7a8e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 1 -- 172.21.15.103:0/1406393330 shutdown_connections 2024-09-10T22:41:42.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 1 -- 172.21.15.103:0/1406393330 wait complete. 2024-09-10T22:41:42.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 1 -- start start 2024-09-10T22:41:42.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 1 Processor -- start 2024-09-10T22:41:42.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 0x5555f7b49160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f7a895a0 0x5555f7b496a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7ad33d0 0x5555f7b49be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5555f7a8bc40 con 0x5555f79711d0 2024-09-10T22:41:42.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5555f789a2c0 con 0x5555f7ad33d0 2024-09-10T22:41:42.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5555f789fc50 con 0x5555f7a895a0 2024-09-10T22:41:42.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 10 client.0 _ll_register_callbacks cb 0x7fa990003a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:42.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa99ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 0x5555f7b49160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa99ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 0x5555f7b49160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36366/0 (socket says 172.21.15.103:36366) 2024-09-10T22:41:42.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa99ca00640 1 -- 172.21.15.103:0/1961760378 learned_addr learned my addr 172.21.15.103:0/1961760378 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa98fe00640 1 --2- 172.21.15.103:0/1961760378 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f7a895a0 0x5555f7b496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa99d400640 1 --2- 172.21.15.103:0/1961760378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7ad33d0 0x5555f7b49be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa99ca00640 1 -- 172.21.15.103:0/1961760378 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f7a895a0 msgr2=0x5555f7b496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa99ca00640 1 --2- 172.21.15.103:0/1961760378 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f7a895a0 0x5555f7b496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa99ca00640 1 -- 172.21.15.103:0/1961760378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7ad33d0 msgr2=0x5555f7b49be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa99ca00640 1 --2- 172.21.15.103:0/1961760378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7ad33d0 0x5555f7b49be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa99ca00640 1 -- 172.21.15.103:0/1961760378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555f789e040 con 0x5555f79711d0 2024-09-10T22:41:42.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa99ca00640 1 --2- 172.21.15.103:0/1961760378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 0x5555f7b49160 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa98800a6c0 tx=0x7fa988091eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51cd0deb9366e314 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa986000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:42.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa986000640 1 -- 172.21.15.103:0/1961760378 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98801d040 con 0x5555f79711d0 2024-09-10T22:41:42.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa986000640 1 -- 172.21.15.103:0/1961760378 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fa988067950 con 0x5555f79711d0 2024-09-10T22:41:42.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.588+0000 7fa9a2786000 1 -- 172.21.15.103:0/1961760378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa988067de0 con 0x5555f79711d0 2024-09-10T22:41:42.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa986000640 1 -- 172.21.15.103:0/1961760378 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa98808a050 con 0x5555f79711d0 2024-09-10T22:41:42.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 10 client.5964 fetch_fsmap learned FSMap version 42 2024-09-10T22:41:42.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 1 -- 172.21.15.103:0/1961760378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x5555f786a620 con 0x5555f79711d0 2024-09-10T22:41:42.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa986000640 1 -- 172.21.15.103:0/1961760378 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa988067de0 con 0x5555f79711d0 2024-09-10T22:41:42.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa986000640 1 -- 172.21.15.103:0/1961760378 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 42) ==== 3554+0+0 (secure 0 0 0) 0x7fa98805dbf0 con 0x5555f79711d0 2024-09-10T22:41:42.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 10 client.5964 fetch_fsmap finished waiting for FSMap version 42 2024-09-10T22:41:42.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 10 client.5964 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T22:41:42.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 20 client.5964 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:42.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 1 --2- 172.21.15.103:0/1961760378 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5555f7adf230 0x5555f7adf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 4 client.5964 mds_command: new command op to 5547 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-10T22:41:42.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 1 -- 172.21.15.103:0/1961760378 --> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x5555f7aea500 con 0x5555f7adf230 2024-09-10T22:41:42.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa98fe00640 1 --2- 172.21.15.103:0/1961760378 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5555f7adf230 0x5555f7adf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa98fe00640 1 --2- 172.21.15.103:0/1961760378 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5555f7adf230 0x5555f7adf640 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd63dce218e9348e server_cookie=9e03e144a967da93 in_seq=0 out_seq=0 2024-09-10T22:41:42.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa986000640 10 client.5964 ms_handle_connect on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:42.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa986000640 1 -- 172.21.15.103:0/1961760378 <== mds.0 v2:172.21.15.103:6832/343761048 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5555f7aea500 con 0x5555f7adf230 2024-09-10T22:41:42.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa986000640 10 client.5964 handle_command_reply: tid=0 2024-09-10T22:41:42.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 1 client.5964 shutdown 2024-09-10T22:41:42.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 1 -- 172.21.15.103:0/1961760378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 msgr2=0x5555f7b49160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 1 --2- 172.21.15.103:0/1961760378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 0x5555f7b49160 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa98800a6c0 tx=0x7fa988091eb0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 1 -- 172.21.15.103:0/1961760378 shutdown_connections 2024-09-10T22:41:42.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 1 --2- 172.21.15.103:0/1961760378 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5555f7adf230 0x5555f7adf640 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 1 --2- 172.21.15.103:0/1961760378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555f7ad33d0 0x5555f7b49be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa986000640 0 client.5964 ms_handle_reset on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:42.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 1 --2- 172.21.15.103:0/1961760378 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555f7a895a0 0x5555f7b496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 1 --2- 172.21.15.103:0/1961760378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555f79711d0 0x5555f7b49160 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 1 -- 172.21.15.103:0/1961760378 >> 172.21.15.103:0/1961760378 conn(0x5555f7592880 msgr2=0x5555f7a8e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 1 -- 172.21.15.103:0/1961760378 shutdown_connections 2024-09-10T22:41:42.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 1 -- 172.21.15.103:0/1961760378 wait complete. 2024-09-10T22:41:42.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa9a2786000 20 client.5964 trim_cache size 0 max 16384 2024-09-10T22:41:42.599 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:41:42.600 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:41:42.600 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:41:42.600 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:41:42.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa99f400640 1 -- 172.21.15.103:0/864513218 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa9740725e0 msgr2=0x7fa974074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa99f400640 1 --2- 172.21.15.103:0/864513218 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa9740725e0 0x7fa974074aa0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa9800af000 tx=0x7fa98001af80 comp rx=0 tx=0).stop 2024-09-10T22:41:42.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa99f400640 1 -- 172.21.15.103:0/864513218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9980cc120 msgr2=0x7fa99815b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa99f400640 1 --2- 172.21.15.103:0/864513218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9980cc120 0x7fa99815b3c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa98800c970 tx=0x7fa98800ce30 comp rx=0 tx=0).stop 2024-09-10T22:41:42.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa99f400640 1 -- 172.21.15.103:0/864513218 shutdown_connections 2024-09-10T22:41:42.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa99f400640 1 --2- 172.21.15.103:0/864513218 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa9740725e0 0x7fa974074aa0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa99f400640 1 --2- 172.21.15.103:0/864513218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa99815c970 0x7fa9981585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa99f400640 1 --2- 172.21.15.103:0/864513218 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9980cf790 0x7fa9981fb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa99f400640 1 --2- 172.21.15.103:0/864513218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9980cc120 0x7fa99815b3c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa99f400640 1 -- 172.21.15.103:0/864513218 >> 172.21.15.103:0/864513218 conn(0x7fa99806cc00 msgr2=0x7fa9980b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa99f400640 1 -- 172.21.15.103:0/864513218 shutdown_connections 2024-09-10T22:41:42.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.592+0000 7fa99f400640 1 -- 172.21.15.103:0/864513218 wait complete. 2024-09-10T22:41:42.614 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:41:42.614 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:1 scrub status 2024-09-10T22:41:42.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.756+0000 7fa9c4000640 1 -- 172.21.15.103:0/1740185127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc0cf9f0 msgr2=0x7fa9bc06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.756+0000 7fa9c4000640 1 --2- 172.21.15.103:0/1740185127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc0cf9f0 0x7fa9bc06eb80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc0d08e0 tx=0x7fa9b001c8c0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.756+0000 7fa9c4000640 1 -- 172.21.15.103:0/1740185127 shutdown_connections 2024-09-10T22:41:42.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.756+0000 7fa9c4000640 1 --2- 172.21.15.103:0/1740185127 >> v2:172.21.15.131:3300/0 conn(0x7fa9bc0cfdd0 0x7fa9bc073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.756+0000 7fa9c4000640 1 --2- 172.21.15.103:0/1740185127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc0cf9f0 0x7fa9bc06eb80 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.756+0000 7fa9c4000640 1 -- 172.21.15.103:0/1740185127 >> 172.21.15.103:0/1740185127 conn(0x7fa9bc06cc00 msgr2=0x7fa9bc06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.756+0000 7fa9c4000640 1 -- 172.21.15.103:0/1740185127 shutdown_connections 2024-09-10T22:41:42.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.756+0000 7fa9c4000640 1 -- 172.21.15.103:0/1740185127 wait complete. 2024-09-10T22:41:42.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.756+0000 7fa9c4000640 1 Processor -- start 2024-09-10T22:41:42.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.756+0000 7fa9c4000640 1 -- start start 2024-09-10T22:41:42.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c4000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9bc06f0c0 0x7fa9bc14c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c4000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9bc0cf9f0 0x7fa9bc150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c4000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc0cfdd0 0x7fa9bc155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c4000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc0cd660 con 0x7fa9bc0cfdd0 2024-09-10T22:41:42.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c4000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc0cd4e0 con 0x7fa9bc06f0c0 2024-09-10T22:41:42.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c4000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa9bc0cd7e0 con 0x7fa9bc0cf9f0 2024-09-10T22:41:42.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc0cfdd0 0x7fa9bc155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc0cfdd0 0x7fa9bc155f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36376/0 (socket says 172.21.15.103:36376) 2024-09-10T22:41:42.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c2000640 1 -- 172.21.15.103:0/2264798908 learned_addr learned my addr 172.21.15.103:0/2264798908 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c1600640 1 --2- 172.21.15.103:0/2264798908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9bc06f0c0 0x7fa9bc14c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c0c00640 1 --2- 172.21.15.103:0/2264798908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9bc0cf9f0 0x7fa9bc150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c2000640 1 -- 172.21.15.103:0/2264798908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9bc0cf9f0 msgr2=0x7fa9bc150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c2000640 1 --2- 172.21.15.103:0/2264798908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9bc0cf9f0 0x7fa9bc150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c2000640 1 -- 172.21.15.103:0/2264798908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9bc06f0c0 msgr2=0x7fa9bc14c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c2000640 1 --2- 172.21.15.103:0/2264798908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9bc06f0c0 0x7fa9bc14c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c2000640 1 -- 172.21.15.103:0/2264798908 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9bc151b30 con 0x7fa9bc0cfdd0 2024-09-10T22:41:42.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c2000640 1 --2- 172.21.15.103:0/2264798908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc0cfdd0 0x7fa9bc155f20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400e970 tx=0x7fa9b400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9b9600640 1 -- 172.21.15.103:0/2264798908 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4004d30 con 0x7fa9bc0cfdd0 2024-09-10T22:41:42.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9b9600640 1 -- 172.21.15.103:0/2264798908 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9b400cb20 con 0x7fa9bc0cfdd0 2024-09-10T22:41:42.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c4000640 1 -- 172.21.15.103:0/2264798908 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9bc151570 con 0x7fa9bc0cfdd0 2024-09-10T22:41:42.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9b9600640 1 -- 172.21.15.103:0/2264798908 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4005020 con 0x7fa9bc0cfdd0 2024-09-10T22:41:42.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.760+0000 7fa9c4000640 1 -- 172.21.15.103:0/2264798908 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9bc156bf0 con 0x7fa9bc0cfdd0 2024-09-10T22:41:42.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9b9600640 1 -- 172.21.15.103:0/2264798908 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa9b400f040 con 0x7fa9bc0cfdd0 2024-09-10T22:41:42.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c73c2000 1 Processor -- start 2024-09-10T22:41:42.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9b9600640 1 --2- 172.21.15.103:0/2264798908 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa99c072610 0x7fa99c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c73c2000 1 -- start start 2024-09-10T22:41:42.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9b9600640 1 -- 172.21.15.103:0/2264798908 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fa9b4093980 con 0x7fa9bc0cfdd0 2024-09-10T22:41:42.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c0c00640 1 --2- 172.21.15.103:0/2264798908 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa99c072610 0x7fa99c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c73c2000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 0x5560ab26a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c73c2000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab26aac0 0x5560ab220680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c73c2000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab220bc0 0x5560ab220fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c73c2000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5560ab108cb0 con 0x5560ab26a1a0 2024-09-10T22:41:42.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c73c2000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5560ab01e310 con 0x5560ab26aac0 2024-09-10T22:41:42.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c73c2000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5560ab07bb90 con 0x5560ab220bc0 2024-09-10T22:41:42.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c0c00640 1 --2- 172.21.15.103:0/2264798908 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa99c072610 0x7fa99c074ad0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc1fa740 tx=0x7fa9a8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c1600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 0x5560ab26a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c1600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 0x5560ab26a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36384/0 (socket says 172.21.15.103:36384) 2024-09-10T22:41:42.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c1600640 1 -- 172.21.15.103:0/4065329437 learned_addr learned my addr 172.21.15.103:0/4065329437 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c0c00640 1 --2- 172.21.15.103:0/4065329437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab26aac0 0x5560ab220680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c2000640 1 --2- 172.21.15.103:0/4065329437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab220bc0 0x5560ab220fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c1600640 1 -- 172.21.15.103:0/4065329437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab220bc0 msgr2=0x5560ab220fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c1600640 1 --2- 172.21.15.103:0/4065329437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab220bc0 0x5560ab220fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c1600640 1 -- 172.21.15.103:0/4065329437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab26aac0 msgr2=0x5560ab220680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c1600640 1 --2- 172.21.15.103:0/4065329437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab26aac0 0x5560ab220680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c1600640 1 -- 172.21.15.103:0/4065329437 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ab01fc60 con 0x5560ab26a1a0 2024-09-10T22:41:42.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9c1600640 1 --2- 172.21.15.103:0/4065329437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 0x5560ab26a580 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa9b001a4f0 tx=0x7fa9b0019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd60976f2bbce9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9ae000640 1 -- 172.21.15.103:0/4065329437 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00bb020 con 0x5560ab26a1a0 2024-09-10T22:41:42.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9ae000640 1 -- 172.21.15.103:0/4065329437 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9b00b3040 con 0x5560ab26a1a0 2024-09-10T22:41:42.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.764+0000 7fa9ae000640 1 -- 172.21.15.103:0/4065329437 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00b2050 con 0x5560ab26a1a0 2024-09-10T22:41:42.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 1 -- 172.21.15.103:0/4065329437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 msgr2=0x5560ab26a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/4065329437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 0x5560ab26a580 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa9b001a4f0 tx=0x7fa9b0019660 comp rx=0 tx=0).stop 2024-09-10T22:41:42.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 1 -- 172.21.15.103:0/4065329437 shutdown_connections 2024-09-10T22:41:42.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/4065329437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab220bc0 0x5560ab220fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/4065329437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab26aac0 0x5560ab220680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/4065329437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 0x5560ab26a580 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 1 -- 172.21.15.103:0/4065329437 >> 172.21.15.103:0/4065329437 conn(0x5560ab226d20 msgr2=0x5560ab21ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 1 -- 172.21.15.103:0/4065329437 shutdown_connections 2024-09-10T22:41:42.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 1 -- 172.21.15.103:0/4065329437 wait complete. 2024-09-10T22:41:42.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 1 -- start start 2024-09-10T22:41:42.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 1 Processor -- start 2024-09-10T22:41:42.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab220bc0 0x5560ab271530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 0x5560ab271a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab26aac0 0x5560ab271fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5560ab06edd0 con 0x5560ab26a1a0 2024-09-10T22:41:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5560ab06afc0 con 0x5560ab220bc0 2024-09-10T22:41:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5560ab0104b0 con 0x5560ab26aac0 2024-09-10T22:41:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 10 client.0 _ll_register_callbacks cb 0x5560aafee7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c0c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 0x5560ab271a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c0c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 0x5560ab271a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36398/0 (socket says 172.21.15.103:36398) 2024-09-10T22:41:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c0c00640 1 -- 172.21.15.103:0/1635694262 learned_addr learned my addr 172.21.15.103:0/1635694262 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c1600640 1 --2- 172.21.15.103:0/1635694262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab220bc0 0x5560ab271530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c2000640 1 --2- 172.21.15.103:0/1635694262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab26aac0 0x5560ab271fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c0c00640 1 -- 172.21.15.103:0/1635694262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab26aac0 msgr2=0x5560ab271fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c0c00640 1 --2- 172.21.15.103:0/1635694262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab26aac0 0x5560ab271fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c0c00640 1 -- 172.21.15.103:0/1635694262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab220bc0 msgr2=0x5560ab271530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c0c00640 1 --2- 172.21.15.103:0/1635694262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab220bc0 0x5560ab271530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c0c00640 1 -- 172.21.15.103:0/1635694262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560ab0091f0 con 0x5560ab26a1a0 2024-09-10T22:41:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c2000640 1 --2- 172.21.15.103:0/1635694262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab26aac0 0x5560ab271fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c0c00640 1 --2- 172.21.15.103:0/1635694262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 0x5560ab271a70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800e760 tx=0x7fa9a8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdade0d2ce51c5bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9a2a00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9a2a00640 1 -- 172.21.15.103:0/1635694262 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8027060 con 0x5560ab26a1a0 2024-09-10T22:41:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9a2a00640 1 -- 172.21.15.103:0/1635694262 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fa9a8010040 con 0x5560ab26a1a0 2024-09-10T22:41:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.768+0000 7fa9c73c2000 1 -- 172.21.15.103:0/1635694262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5560ab003330 con 0x5560ab26a1a0 2024-09-10T22:41:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9a2a00640 1 -- 172.21.15.103:0/1635694262 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa9a8003a80 con 0x5560ab26a1a0 2024-09-10T22:41:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 10 client.5976 fetch_fsmap learned FSMap version 42 2024-09-10T22:41:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 1 -- 172.21.15.103:0/1635694262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x5560aafeffa0 con 0x5560ab26a1a0 2024-09-10T22:41:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9a2a00640 1 -- 172.21.15.103:0/1635694262 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5560ab003330 con 0x5560ab26a1a0 2024-09-10T22:41:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9a2a00640 1 -- 172.21.15.103:0/1635694262 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 42) ==== 3554+0+0 (secure 0 0 0) 0x7fa9a8013420 con 0x5560ab26a1a0 2024-09-10T22:41:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 10 client.5976 fetch_fsmap finished waiting for FSMap version 42 2024-09-10T22:41:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 10 client.5976 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2024-09-10T22:41:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 20 client.5976 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/1635694262 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x5560ab279900 0x5560ab27bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 4 client.5976 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:41:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 1 -- 172.21.15.103:0/1635694262 --> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560ab07dae0 con 0x5560ab279900 2024-09-10T22:41:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c1600640 1 --2- 172.21.15.103:0/1635694262 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x5560ab279900 0x5560ab27bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c1600640 1 --2- 172.21.15.103:0/1635694262 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x5560ab279900 0x5560ab27bcf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fdaecbaa46c2f523 server_cookie=b5c1c7e8b352cbfb in_seq=0 out_seq=0 2024-09-10T22:41:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9a2a00640 10 client.5976 ms_handle_connect on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9a2a00640 1 -- 172.21.15.103:0/1635694262 <== mds.1 v2:172.21.15.103:6833/3910783847 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5560ab07dae0 con 0x5560ab279900 2024-09-10T22:41:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9a2a00640 10 client.5976 handle_command_reply: tid=0 2024-09-10T22:41:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 1 client.5976 shutdown 2024-09-10T22:41:42.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 1 -- 172.21.15.103:0/1635694262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 msgr2=0x5560ab271a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/1635694262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 0x5560ab271a70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800e760 tx=0x7fa9a8000ee0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 1 -- 172.21.15.103:0/1635694262 shutdown_connections 2024-09-10T22:41:42.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/1635694262 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x5560ab279900 0x5560ab27bcf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/1635694262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab26aac0 0x5560ab271fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9a2a00640 0 client.5976 ms_handle_reset on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:42.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/1635694262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 0x5560ab271a70 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/1635694262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab220bc0 0x5560ab271530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 1 -- 172.21.15.103:0/1635694262 >> 172.21.15.103:0/1635694262 conn(0x5560ab226d20 msgr2=0x5560ab21ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 1 -- 172.21.15.103:0/1635694262 shutdown_connections 2024-09-10T22:41:42.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 1 -- 172.21.15.103:0/1635694262 wait complete. 2024-09-10T22:41:42.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.772+0000 7fa9c73c2000 20 client.5976 trim_cache size 0 max 16384 2024-09-10T22:41:42.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 Processor -- start 2024-09-10T22:41:42.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 -- start start 2024-09-10T22:41:42.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab220bc0 0x5560ab221fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab26a1a0 0x5560ab2224f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab26aac0 0x5560ab274550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc204550 con 0x5560ab220bc0 2024-09-10T22:41:42.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc203720 con 0x5560ab26a1a0 2024-09-10T22:41:42.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa9bc203e20 con 0x5560ab26aac0 2024-09-10T22:41:42.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c1600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab220bc0 0x5560ab221fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c1600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab220bc0 0x5560ab221fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36404/0 (socket says 172.21.15.103:36404) 2024-09-10T22:41:42.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c1600640 1 -- 172.21.15.103:0/3775137963 learned_addr learned my addr 172.21.15.103:0/3775137963 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c0c00640 1 --2- 172.21.15.103:0/3775137963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab26a1a0 0x5560ab2224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c2000640 1 --2- 172.21.15.103:0/3775137963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab26aac0 0x5560ab274550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c1600640 1 -- 172.21.15.103:0/3775137963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab26aac0 msgr2=0x5560ab274550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c1600640 1 --2- 172.21.15.103:0/3775137963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab26aac0 0x5560ab274550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c1600640 1 -- 172.21.15.103:0/3775137963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab26a1a0 msgr2=0x5560ab2224f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c1600640 1 --2- 172.21.15.103:0/3775137963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab26a1a0 0x5560ab2224f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c1600640 1 -- 172.21.15.103:0/3775137963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ab0c8660 con 0x5560ab220bc0 2024-09-10T22:41:42.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c2000640 1 --2- 172.21.15.103:0/3775137963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab26aac0 0x5560ab274550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:42.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c1600640 1 --2- 172.21.15.103:0/3775137963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab220bc0 0x5560ab221fb0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa9b001af70 tx=0x7fa9b001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aed3da2ef2148c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9ad600640 1 -- 172.21.15.103:0/3775137963 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00b2040 con 0x5560ab220bc0 2024-09-10T22:41:42.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9ad600640 1 -- 172.21.15.103:0/3775137963 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9b0005310 con 0x5560ab220bc0 2024-09-10T22:41:42.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9ad600640 1 -- 172.21.15.103:0/3775137963 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00bb040 con 0x5560ab220bc0 2024-09-10T22:41:42.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 -- 172.21.15.103:0/3775137963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab220bc0 msgr2=0x5560ab221fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/3775137963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab220bc0 0x5560ab221fb0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa9b001af70 tx=0x7fa9b001c8c0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 -- 172.21.15.103:0/3775137963 shutdown_connections 2024-09-10T22:41:42.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/3775137963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab26aac0 0x5560ab274550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/3775137963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab26a1a0 0x5560ab2224f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/3775137963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab220bc0 0x5560ab221fb0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 -- 172.21.15.103:0/3775137963 >> 172.21.15.103:0/3775137963 conn(0x5560ab226d20 msgr2=0x5560ab220180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 -- 172.21.15.103:0/3775137963 shutdown_connections 2024-09-10T22:41:42.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 -- 172.21.15.103:0/3775137963 wait complete. 2024-09-10T22:41:42.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 -- start start 2024-09-10T22:41:42.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.792+0000 7fa9c73c2000 1 Processor -- start 2024-09-10T22:41:42.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab220bc0 0x5560ab277560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 0x5560ab277aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab26aac0 0x5560ab29c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5560ab229d40 con 0x5560ab26a1a0 2024-09-10T22:41:42.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5560ab227100 con 0x5560ab26aac0 2024-09-10T22:41:42.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5560ab065ec0 con 0x5560ab220bc0 2024-09-10T22:41:42.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 10 client.0 _ll_register_callbacks cb 0x7fa9a8001450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:42.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c0c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 0x5560ab277aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c0c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 0x5560ab277aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36408/0 (socket says 172.21.15.103:36408) 2024-09-10T22:41:42.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c0c00640 1 -- 172.21.15.103:0/3332159938 learned_addr learned my addr 172.21.15.103:0/3332159938 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:42.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c1600640 1 --2- 172.21.15.103:0/3332159938 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab220bc0 0x5560ab277560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c2000640 1 --2- 172.21.15.103:0/3332159938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab26aac0 0x5560ab29c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c0c00640 1 -- 172.21.15.103:0/3332159938 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab220bc0 msgr2=0x5560ab277560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c0c00640 1 --2- 172.21.15.103:0/3332159938 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab220bc0 0x5560ab277560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c0c00640 1 -- 172.21.15.103:0/3332159938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab26aac0 msgr2=0x5560ab29c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:42.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c0c00640 1 --2- 172.21.15.103:0/3332159938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab26aac0 0x5560ab29c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c0c00640 1 -- 172.21.15.103:0/3332159938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560ab035090 con 0x5560ab26a1a0 2024-09-10T22:41:42.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c2000640 1 --2- 172.21.15.103:0/3332159938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab26aac0 0x5560ab29c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:42.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c0c00640 1 --2- 172.21.15.103:0/3332159938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 0x5560ab277aa0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8013680 tx=0x7fa9a80136b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e0ef7b1994f6d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:42.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9a2a00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:42.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9a2a00640 1 -- 172.21.15.103:0/3332159938 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8013b80 con 0x5560ab26a1a0 2024-09-10T22:41:42.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9a2a00640 1 -- 172.21.15.103:0/3332159938 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fa9a801e030 con 0x5560ab26a1a0 2024-09-10T22:41:42.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 -- 172.21.15.103:0/3332159938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9b0005310 con 0x5560ab26a1a0 2024-09-10T22:41:42.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9a2a00640 1 -- 172.21.15.103:0/3332159938 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa9a8036400 con 0x5560ab26a1a0 2024-09-10T22:41:42.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 10 client.5982 fetch_fsmap learned FSMap version 42 2024-09-10T22:41:42.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 -- 172.21.15.103:0/3332159938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x5560ab0015f0 con 0x5560ab26a1a0 2024-09-10T22:41:42.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9a2a00640 1 -- 172.21.15.103:0/3332159938 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9b0005310 con 0x5560ab26a1a0 2024-09-10T22:41:42.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9a2a00640 1 -- 172.21.15.103:0/3332159938 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 42) ==== 3554+0+0 (secure 0 0 0) 0x7fa9a803e020 con 0x5560ab26a1a0 2024-09-10T22:41:42.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 10 client.5982 fetch_fsmap finished waiting for FSMap version 42 2024-09-10T22:41:42.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 10 client.5982 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2024-09-10T22:41:42.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 20 client.5982 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/3332159938 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x5560ab2e0090 0x5560ab2e04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 4 client.5982 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:41:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 -- 172.21.15.103:0/3332159938 --> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5560ab079590 con 0x5560ab2e0090 2024-09-10T22:41:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c1600640 1 --2- 172.21.15.103:0/3332159938 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x5560ab2e0090 0x5560ab2e04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c1600640 1 --2- 172.21.15.103:0/3332159938 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x5560ab2e0090 0x5560ab2e04a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9b8d83ea616b8c63 server_cookie=1756da5330d4303b in_seq=0 out_seq=0 2024-09-10T22:41:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9a2a00640 10 client.5982 ms_handle_connect on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9a2a00640 1 -- 172.21.15.103:0/3332159938 <== mds.1 v2:172.21.15.103:6833/3910783847 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x5560ab079590 con 0x5560ab2e0090 2024-09-10T22:41:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9a2a00640 10 client.5982 handle_command_reply: tid=0 2024-09-10T22:41:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 client.5982 shutdown 2024-09-10T22:41:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 -- 172.21.15.103:0/3332159938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 msgr2=0x5560ab277aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/3332159938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 0x5560ab277aa0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8013680 tx=0x7fa9a80136b0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 -- 172.21.15.103:0/3332159938 shutdown_connections 2024-09-10T22:41:42.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/3332159938 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x5560ab2e0090 0x5560ab2e04a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/3332159938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5560ab26aac0 0x5560ab29c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/3332159938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560ab26a1a0 0x5560ab277aa0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9a2a00640 0 client.5982 ms_handle_reset on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:42.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 --2- 172.21.15.103:0/3332159938 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5560ab220bc0 0x5560ab277560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 -- 172.21.15.103:0/3332159938 >> 172.21.15.103:0/3332159938 conn(0x5560ab226d20 msgr2=0x5560ab220fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 -- 172.21.15.103:0/3332159938 shutdown_connections 2024-09-10T22:41:42.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.796+0000 7fa9c73c2000 1 -- 172.21.15.103:0/3332159938 wait complete. 2024-09-10T22:41:42.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.800+0000 7fa9c73c2000 20 client.5982 trim_cache size 0 max 16384 2024-09-10T22:41:42.805 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:41:42.806 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:41:42.806 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:41:42.806 INFO:teuthology.orchestra.run.smithi103.stdout: "42b5cfe9-6527-4d7a-bba4-3f2b1b35b58a": { 2024-09-10T22:41:42.806 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:41:42.806 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "42b5cfe9-6527-4d7a-bba4-3f2b1b35b58a", 2024-09-10T22:41:42.806 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:41:42.806 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:42.806 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:42.807 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:41:42.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.800+0000 7fa9c4000640 1 -- 172.21.15.103:0/2264798908 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa99c072610 msgr2=0x7fa99c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.800+0000 7fa9c4000640 1 --2- 172.21.15.103:0/2264798908 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa99c072610 0x7fa99c074ad0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc1fa740 tx=0x7fa9a8009040 comp rx=0 tx=0).stop 2024-09-10T22:41:42.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.800+0000 7fa9c4000640 1 -- 172.21.15.103:0/2264798908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc0cfdd0 msgr2=0x7fa9bc155f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:42.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.800+0000 7fa9c4000640 1 --2- 172.21.15.103:0/2264798908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc0cfdd0 0x7fa9bc155f20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400e970 tx=0x7fa9b400ee30 comp rx=0 tx=0).stop 2024-09-10T22:41:42.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.800+0000 7fa9c4000640 1 -- 172.21.15.103:0/2264798908 shutdown_connections 2024-09-10T22:41:42.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.800+0000 7fa9c4000640 1 --2- 172.21.15.103:0/2264798908 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa99c072610 0x7fa99c074ad0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.800+0000 7fa9c4000640 1 --2- 172.21.15.103:0/2264798908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc0cfdd0 0x7fa9bc155f20 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.800+0000 7fa9c4000640 1 --2- 172.21.15.103:0/2264798908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9bc0cf9f0 0x7fa9bc150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.800+0000 7fa9c4000640 1 --2- 172.21.15.103:0/2264798908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9bc06f0c0 0x7fa9bc14c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:42.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.800+0000 7fa9c4000640 1 -- 172.21.15.103:0/2264798908 >> 172.21.15.103:0/2264798908 conn(0x7fa9bc06cc00 msgr2=0x7fa9bc0b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:42.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.800+0000 7fa9c4000640 1 -- 172.21.15.103:0/2264798908 shutdown_connections 2024-09-10T22:41:42.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:42.800+0000 7fa9c4000640 1 -- 172.21.15.103:0/2264798908 wait complete. 2024-09-10T22:41:43.152 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-10T22:41:43.148+0000 7fb5aec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-10T22:41:46.709 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:41:46.713 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:41:47.821 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:41:47.821 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:1 scrub status 2024-09-10T22:41:47.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.972+0000 7f6f8b800640 1 -- 172.21.15.103:0/3577828720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f840d1830 msgr2=0x7f6f840b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:47.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.972+0000 7f6f8b800640 1 --2- 172.21.15.103:0/3577828720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f840d1830 0x7f6f840b3640 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6f8408c3a0 tx=0x7f6f7c01f580 comp rx=0 tx=0).stop 2024-09-10T22:41:47.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.972+0000 7f6f8b800640 1 -- 172.21.15.103:0/3577828720 shutdown_connections 2024-09-10T22:41:47.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.972+0000 7f6f8b800640 1 --2- 172.21.15.103:0/3577828720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f840d1830 0x7f6f840b3640 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:47.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.972+0000 7f6f8b800640 1 --2- 172.21.15.103:0/3577828720 >> v2:172.21.15.131:3300/0 conn(0x7f6f840d21a0 0x7f6f840d4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:47.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.972+0000 7f6f8b800640 1 -- 172.21.15.103:0/3577828720 >> 172.21.15.103:0/3577828720 conn(0x7f6f840d3c60 msgr2=0x7f6f840d4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:47.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.972+0000 7f6f8b800640 1 -- 172.21.15.103:0/3577828720 shutdown_connections 2024-09-10T22:41:47.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.972+0000 7f6f8b800640 1 -- 172.21.15.103:0/3577828720 wait complete. 2024-09-10T22:41:47.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f8b800640 1 Processor -- start 2024-09-10T22:41:47.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f8b800640 1 -- start start 2024-09-10T22:41:47.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f8b800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f840d1830 0x7f6f840cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:47.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f8b800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f840d21a0 0x7f6f841583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:47.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f8b800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f840b1f90 0x7f6f840b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:47.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f8b800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6f840b3f10 con 0x7f6f840d21a0 2024-09-10T22:41:47.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f8b800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6f840b3d90 con 0x7f6f840b1f90 2024-09-10T22:41:47.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f8b800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6f840b4090 con 0x7f6f840d1830 2024-09-10T22:41:47.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f83e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f840d21a0 0x7f6f841583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:47.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f83e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f840d21a0 0x7f6f841583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58776/0 (socket says 172.21.15.103:58776) 2024-09-10T22:41:47.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f83e00640 1 -- 172.21.15.103:0/1384178124 learned_addr learned my addr 172.21.15.103:0/1384178124 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:47.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f88e00640 1 --2- 172.21.15.103:0/1384178124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f840d1830 0x7f6f840cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:47.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f89800640 1 --2- 172.21.15.103:0/1384178124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f840b1f90 0x7f6f840b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:47.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f83e00640 1 -- 172.21.15.103:0/1384178124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f840d1830 msgr2=0x7f6f840cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:47.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f83e00640 1 --2- 172.21.15.103:0/1384178124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f840d1830 0x7f6f840cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:47.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f83e00640 1 -- 172.21.15.103:0/1384178124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f840b1f90 msgr2=0x7f6f840b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:47.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f83e00640 1 --2- 172.21.15.103:0/1384178124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f840b1f90 0x7f6f840b2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:47.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f83e00640 1 -- 172.21.15.103:0/1384178124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f84161490 con 0x7f6f840d21a0 2024-09-10T22:41:47.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f83e00640 1 --2- 172.21.15.103:0/1384178124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f840d21a0 0x7f6f841583c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000b410 tx=0x7f6f7000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:47.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f80c00640 1 -- 172.21.15.103:0/1384178124 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f70015030 con 0x7f6f840d21a0 2024-09-10T22:41:47.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f80c00640 1 -- 172.21.15.103:0/1384178124 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f70004020 con 0x7f6f840d21a0 2024-09-10T22:41:47.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f80c00640 1 -- 172.21.15.103:0/1384178124 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f700044b0 con 0x7f6f840d21a0 2024-09-10T22:41:47.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f8b800640 1 -- 172.21.15.103:0/1384178124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f841f87a0 con 0x7f6f840d21a0 2024-09-10T22:41:47.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.976+0000 7f6f8b800640 1 -- 172.21.15.103:0/1384178124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f84158ce0 con 0x7f6f840d21a0 2024-09-10T22:41:47.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.980+0000 7f6f80c00640 1 -- 172.21.15.103:0/1384178124 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6f70022060 con 0x7f6f840d21a0 2024-09-10T22:41:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.980+0000 7f6f80c00640 1 --2- 172.21.15.103:0/1384178124 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6f640725e0 0x7f6f64074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.980+0000 7f6f80c00640 1 -- 172.21.15.103:0/1384178124 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f6f70092f30 con 0x7f6f840d21a0 2024-09-10T22:41:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.980+0000 7f6f8ebb5000 1 Processor -- start 2024-09-10T22:41:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.980+0000 7f6f88e00640 1 --2- 172.21.15.103:0/1384178124 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6f640725e0 0x7f6f64074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.980+0000 7f6f8ebb5000 1 -- start start 2024-09-10T22:41:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.980+0000 7f6f88e00640 1 --2- 172.21.15.103:0/1384178124 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6f640725e0 0x7f6f64074aa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400abe0 tx=0x7f6f7400a2d0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.980+0000 7f6f8ebb5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f310bc1a0 0x562f310bc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.980+0000 7f6f8ebb5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 0x562f31072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.980+0000 7f6f8ebb5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f31072bc0 0x562f31072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.980+0000 7f6f8ebb5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562f30f5acb0 con 0x562f310bc1a0 2024-09-10T22:41:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.980+0000 7f6f8ebb5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562f30e70310 con 0x562f310bcac0 2024-09-10T22:41:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.980+0000 7f6f8ebb5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x562f30ecdb90 con 0x562f31072bc0 2024-09-10T22:41:47.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.980+0000 7f6f88e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f310bc1a0 0x562f310bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:47.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.980+0000 7f6f88e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f310bc1a0 0x562f310bc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58786/0 (socket says 172.21.15.103:58786) 2024-09-10T22:41:47.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.980+0000 7f6f88e00640 1 -- 172.21.15.103:0/3842305581 learned_addr learned my addr 172.21.15.103:0/3842305581 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:47.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.980+0000 7f6f83e00640 1 --2- 172.21.15.103:0/3842305581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 0x562f31072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:47.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.980+0000 7f6f89800640 1 --2- 172.21.15.103:0/3842305581 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f31072bc0 0x562f31072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:47.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f83e00640 1 -- 172.21.15.103:0/3842305581 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f31072bc0 msgr2=0x562f31072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:47.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f83e00640 1 --2- 172.21.15.103:0/3842305581 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f31072bc0 0x562f31072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:47.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f83e00640 1 -- 172.21.15.103:0/3842305581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f310bc1a0 msgr2=0x562f310bc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:47.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f83e00640 1 --2- 172.21.15.103:0/3842305581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f310bc1a0 0x562f310bc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f83e00640 1 -- 172.21.15.103:0/3842305581 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f30e71c60 con 0x562f310bcac0 2024-09-10T22:41:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f88e00640 1 --2- 172.21.15.103:0/3842305581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f310bc1a0 0x562f310bc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:41:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f83e00640 1 --2- 172.21.15.103:0/3842305581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 0x562f31072680 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6f70009390 tx=0x7f6f7005dd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b69ab703f47e6db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f79600640 1 -- 172.21.15.103:0/3842305581 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f70080030 con 0x562f310bcac0 2024-09-10T22:41:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f79600640 1 -- 172.21.15.103:0/3842305581 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f70059f40 con 0x562f310bcac0 2024-09-10T22:41:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f79600640 1 -- 172.21.15.103:0/3842305581 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7005d190 con 0x562f310bcac0 2024-09-10T22:41:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3842305581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 msgr2=0x562f31072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/3842305581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 0x562f31072680 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6f70009390 tx=0x7f6f7005dd90 comp rx=0 tx=0).stop 2024-09-10T22:41:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3842305581 shutdown_connections 2024-09-10T22:41:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/3842305581 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f31072bc0 0x562f31072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/3842305581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 0x562f31072680 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/3842305581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f310bc1a0 0x562f310bc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3842305581 >> 172.21.15.103:0/3842305581 conn(0x562f31078d20 msgr2=0x562f31070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:47.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3842305581 shutdown_connections 2024-09-10T22:41:47.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3842305581 wait complete. 2024-09-10T22:41:47.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f8ebb5000 1 -- start start 2024-09-10T22:41:47.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f8ebb5000 1 Processor -- start 2024-09-10T22:41:47.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f8ebb5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 0x562f310c3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f8ebb5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f310bc1a0 0x562f310c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f8ebb5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 0x562f310c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f8ebb5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562f30ec0dd0 con 0x562f31072bc0 2024-09-10T22:41:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f8ebb5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562f30ebcfc0 con 0x562f310bcac0 2024-09-10T22:41:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f8ebb5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x562f30e624b0 con 0x562f310bc1a0 2024-09-10T22:41:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f8ebb5000 10 client.0 _ll_register_callbacks cb 0x562f30e407d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f88e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 0x562f310c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f88e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 0x562f310c3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58802/0 (socket says 172.21.15.103:58802) 2024-09-10T22:41:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f88e00640 1 -- 172.21.15.103:0/3131969102 learned_addr learned my addr 172.21.15.103:0/3131969102 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f89800640 1 --2- 172.21.15.103:0/3131969102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 0x562f310c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f83e00640 1 --2- 172.21.15.103:0/3131969102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f310bc1a0 0x562f310c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f88e00640 1 -- 172.21.15.103:0/3131969102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f310bc1a0 msgr2=0x562f310c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f88e00640 1 --2- 172.21.15.103:0/3131969102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f310bc1a0 0x562f310c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f88e00640 1 -- 172.21.15.103:0/3131969102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 msgr2=0x562f310c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f88e00640 1 --2- 172.21.15.103:0/3131969102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 0x562f310c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f88e00640 1 -- 172.21.15.103:0/3131969102 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f30e5b1f0 con 0x562f31072bc0 2024-09-10T22:41:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.984+0000 7f6f83e00640 1 --2- 172.21.15.103:0/3131969102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f310bc1a0 0x562f310c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f88e00640 1 --2- 172.21.15.103:0/3131969102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 0x562f310c3530 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6f74010e30 tx=0x7f6f74004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79efb206e79026f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f6e000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f6e000640 1 -- 172.21.15.103:0/3131969102 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7402a060 con 0x562f31072bc0 2024-09-10T22:41:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f6e000640 1 -- 172.21.15.103:0/3131969102 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f6f7401cb30 con 0x562f31072bc0 2024-09-10T22:41:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3131969102 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562f30e55330 con 0x562f31072bc0 2024-09-10T22:41:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f6e000640 1 -- 172.21.15.103:0/3131969102 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f6f74030050 con 0x562f31072bc0 2024-09-10T22:41:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 10 client.5994 fetch_fsmap learned FSMap version 45 2024-09-10T22:41:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3131969102 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) -- 0x562f30e41fa0 con 0x562f31072bc0 2024-09-10T22:41:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f6e000640 1 -- 172.21.15.103:0/3131969102 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x562f30e55330 con 0x562f31072bc0 2024-09-10T22:41:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f6e000640 1 -- 172.21.15.103:0/3131969102 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 45) ==== 3558+0+0 (secure 0 0 0) 0x7f6f74033020 con 0x562f31072bc0 2024-09-10T22:41:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 10 client.5994 fetch_fsmap finished waiting for FSMap version 45 2024-09-10T22:41:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 10 client.5994 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2024-09-10T22:41:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 20 client.5994 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/3131969102 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x562f310cb900 0x562f310cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 4 client.5994 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:41:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3131969102 --> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f30ecfae0 con 0x562f310cb900 2024-09-10T22:41:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f83e00640 1 --2- 172.21.15.103:0/3131969102 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x562f310cb900 0x562f310cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f6e000640 10 client.5994 ms_handle_connect on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f83e00640 1 --2- 172.21.15.103:0/3131969102 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x562f310cb900 0x562f310cdcf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e838f0c543ae2848 server_cookie=c6fe229d112fb4fd in_seq=0 out_seq=0 2024-09-10T22:41:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f6e000640 1 -- 172.21.15.103:0/3131969102 <== mds.1 v2:172.21.15.103:6833/3910783847 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562f30ecfae0 con 0x562f310cb900 2024-09-10T22:41:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f6e000640 10 client.5994 handle_command_reply: tid=0 2024-09-10T22:41:47.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 1 client.5994 shutdown 2024-09-10T22:41:47.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3131969102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 msgr2=0x562f310c3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:47.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/3131969102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 0x562f310c3530 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6f74010e30 tx=0x7f6f74004740 comp rx=0 tx=0).stop 2024-09-10T22:41:47.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3131969102 shutdown_connections 2024-09-10T22:41:47.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/3131969102 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x562f310cb900 0x562f310cdcf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:47.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/3131969102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 0x562f310c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:47.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f6e000640 0 client.5994 ms_handle_reset on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:47.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/3131969102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f310bc1a0 0x562f310c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:47.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/3131969102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 0x562f310c3530 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:47.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3131969102 >> 172.21.15.103:0/3131969102 conn(0x562f31078d20 msgr2=0x562f31070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:47.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3131969102 shutdown_connections 2024-09-10T22:41:47.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3131969102 wait complete. 2024-09-10T22:41:47.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:47.988+0000 7f6f8ebb5000 20 client.5994 trim_cache size 0 max 16384 2024-09-10T22:41:48.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f8ebb5000 1 Processor -- start 2024-09-10T22:41:48.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f8ebb5000 1 -- start start 2024-09-10T22:41:48.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f8ebb5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 0x562f310c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:48.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f8ebb5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f310bc1a0 0x562f31072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:48.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f8ebb5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 0x562f310725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:48.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f8ebb5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6f84201760 con 0x562f31072bc0 2024-09-10T22:41:48.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f8ebb5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6f84200900 con 0x562f310bcac0 2024-09-10T22:41:48.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f8ebb5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6f84201030 con 0x562f310bc1a0 2024-09-10T22:41:48.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f88e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 0x562f310c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:48.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f88e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 0x562f310c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58810/0 (socket says 172.21.15.103:58810) 2024-09-10T22:41:48.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f88e00640 1 -- 172.21.15.103:0/4157977196 learned_addr learned my addr 172.21.15.103:0/4157977196 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:48.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f89800640 1 --2- 172.21.15.103:0/4157977196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 0x562f310725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:48.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f83e00640 1 --2- 172.21.15.103:0/4157977196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f310bc1a0 0x562f31072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:48.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f88e00640 1 -- 172.21.15.103:0/4157977196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f310bc1a0 msgr2=0x562f31072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:48.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f88e00640 1 --2- 172.21.15.103:0/4157977196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f310bc1a0 0x562f31072070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:48.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f88e00640 1 -- 172.21.15.103:0/4157977196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 msgr2=0x562f310725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:48.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f88e00640 1 --2- 172.21.15.103:0/4157977196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 0x562f310725b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:48.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f88e00640 1 -- 172.21.15.103:0/4157977196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f30f1a660 con 0x562f31072bc0 2024-09-10T22:41:48.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f89800640 1 --2- 172.21.15.103:0/4157977196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 0x562f310725b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:48.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f83e00640 1 --2- 172.21.15.103:0/4157977196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f310bc1a0 0x562f31072070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:48.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f88e00640 1 --2- 172.21.15.103:0/4157977196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 0x562f310c9dc0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400a9c0 tx=0x7f6f7400f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f20e5c0d5148e5f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:48.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f78c00640 1 -- 172.21.15.103:0/4157977196 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74016070 con 0x562f31072bc0 2024-09-10T22:41:48.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f78c00640 1 -- 172.21.15.103:0/4157977196 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f74025490 con 0x562f31072bc0 2024-09-10T22:41:48.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f78c00640 1 -- 172.21.15.103:0/4157977196 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74025840 con 0x562f31072bc0 2024-09-10T22:41:48.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/4157977196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 msgr2=0x562f310c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:48.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/4157977196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 0x562f310c9dc0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400a9c0 tx=0x7f6f7400f930 comp rx=0 tx=0).stop 2024-09-10T22:41:48.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/4157977196 shutdown_connections 2024-09-10T22:41:48.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/4157977196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 0x562f310725b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:48.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/4157977196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f310bc1a0 0x562f31072070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:48.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/4157977196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 0x562f310c9dc0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:48.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/4157977196 >> 172.21.15.103:0/4157977196 conn(0x562f31078d20 msgr2=0x562f31071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:48.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/4157977196 shutdown_connections 2024-09-10T22:41:48.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.008+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/4157977196 wait complete. 2024-09-10T22:41:48.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f8ebb5000 1 -- start start 2024-09-10T22:41:48.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f8ebb5000 1 Processor -- start 2024-09-10T22:41:48.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f8ebb5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 0x562f310c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:48.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f8ebb5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f310bc1a0 0x562f310c9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:48.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f8ebb5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 0x562f310ee210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:48.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f8ebb5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562f3107bd40 con 0x562f31072bc0 2024-09-10T22:41:48.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f8ebb5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562f30e70310 con 0x562f310bcac0 2024-09-10T22:41:48.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f8ebb5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x562f31079100 con 0x562f310bc1a0 2024-09-10T22:41:48.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f8ebb5000 10 client.0 _ll_register_callbacks cb 0x7f6f7400fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:48.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f88e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 0x562f310c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:48.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f88e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 0x562f310c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58816/0 (socket says 172.21.15.103:58816) 2024-09-10T22:41:48.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f88e00640 1 -- 172.21.15.103:0/3428167432 learned_addr learned my addr 172.21.15.103:0/3428167432 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:48.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f83e00640 1 --2- 172.21.15.103:0/3428167432 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f310bc1a0 0x562f310c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:48.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f89800640 1 --2- 172.21.15.103:0/3428167432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 0x562f310ee210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:48.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f88e00640 1 -- 172.21.15.103:0/3428167432 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f310bc1a0 msgr2=0x562f310c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:48.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f88e00640 1 --2- 172.21.15.103:0/3428167432 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f310bc1a0 0x562f310c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:48.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f88e00640 1 -- 172.21.15.103:0/3428167432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 msgr2=0x562f310ee210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:48.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f88e00640 1 --2- 172.21.15.103:0/3428167432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 0x562f310ee210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:48.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f88e00640 1 -- 172.21.15.103:0/3428167432 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f30e87090 con 0x562f31072bc0 2024-09-10T22:41:48.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f88e00640 1 --2- 172.21.15.103:0/3428167432 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 0x562f310c8fc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x562f30ec85e0 tx=0x7f6f74025a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b4232c72129d6a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:48.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f6e000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:48.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f6e000640 1 -- 172.21.15.103:0/3428167432 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74041060 con 0x562f31072bc0 2024-09-10T22:41:48.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3428167432 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f74025490 con 0x562f31072bc0 2024-09-10T22:41:48.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f6e000640 1 -- 172.21.15.103:0/3428167432 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f6f74034600 con 0x562f31072bc0 2024-09-10T22:41:48.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f6e000640 1 -- 172.21.15.103:0/3428167432 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f6f74047050 con 0x562f31072bc0 2024-09-10T22:41:48.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f8ebb5000 10 client.6000 fetch_fsmap learned FSMap version 45 2024-09-10T22:41:48.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3428167432 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) -- 0x562f30e535f0 con 0x562f31072bc0 2024-09-10T22:41:48.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f6e000640 1 -- 172.21.15.103:0/3428167432 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f74025490 con 0x562f31072bc0 2024-09-10T22:41:48.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f6e000640 1 -- 172.21.15.103:0/3428167432 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 45) ==== 3558+0+0 (secure 0 0 0) 0x7f6f7404a020 con 0x562f31072bc0 2024-09-10T22:41:48.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f8ebb5000 10 client.6000 fetch_fsmap finished waiting for FSMap version 45 2024-09-10T22:41:48.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f8ebb5000 10 client.6000 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2024-09-10T22:41:48.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f8ebb5000 20 client.6000 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:48.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/3428167432 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x562f310eec00 0x562f31131850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:48.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f8ebb5000 4 client.6000 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:41:48.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3428167432 --> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562f30ecb590 con 0x562f310eec00 2024-09-10T22:41:48.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f83e00640 1 --2- 172.21.15.103:0/3428167432 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x562f310eec00 0x562f31131850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:48.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f6e000640 10 client.6000 ms_handle_connect on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:48.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.012+0000 7f6f83e00640 1 --2- 172.21.15.103:0/3428167432 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x562f310eec00 0x562f31131850 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32c0513295250774 server_cookie=44da5956a2d663ba in_seq=0 out_seq=0 2024-09-10T22:41:48.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f6e000640 1 -- 172.21.15.103:0/3428167432 <== mds.1 v2:172.21.15.103:6833/3910783847 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x562f30ecb590 con 0x562f310eec00 2024-09-10T22:41:48.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f6e000640 10 client.6000 handle_command_reply: tid=0 2024-09-10T22:41:48.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8ebb5000 1 client.6000 shutdown 2024-09-10T22:41:48.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3428167432 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 msgr2=0x562f310c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:48.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/3428167432 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 0x562f310c8fc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x562f30ec85e0 tx=0x7f6f74025a40 comp rx=0 tx=0).stop 2024-09-10T22:41:48.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3428167432 shutdown_connections 2024-09-10T22:41:48.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/3428167432 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x562f310eec00 0x562f31131850 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:48.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/3428167432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f310bcac0 0x562f310ee210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:48.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/3428167432 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f310bc1a0 0x562f310c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:48.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8ebb5000 1 --2- 172.21.15.103:0/3428167432 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f31072bc0 0x562f310c8fc0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:48.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3428167432 >> 172.21.15.103:0/3428167432 conn(0x562f31078d20 msgr2=0x562f31072180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:48.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f6e000640 0 client.6000 ms_handle_reset on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:48.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3428167432 shutdown_connections 2024-09-10T22:41:48.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8ebb5000 1 -- 172.21.15.103:0/3428167432 wait complete. 2024-09-10T22:41:48.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8ebb5000 20 client.6000 trim_cache size 0 max 16384 2024-09-10T22:41:48.024 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:41:48.024 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:41:48.024 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:41:48.024 INFO:teuthology.orchestra.run.smithi103.stdout: "42b5cfe9-6527-4d7a-bba4-3f2b1b35b58a": { 2024-09-10T22:41:48.024 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:41:48.025 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "42b5cfe9-6527-4d7a-bba4-3f2b1b35b58a", 2024-09-10T22:41:48.025 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:41:48.025 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:48.025 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:48.025 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:41:48.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8b800640 1 -- 172.21.15.103:0/1384178124 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6f640725e0 msgr2=0x7f6f64074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:48.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8b800640 1 --2- 172.21.15.103:0/1384178124 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6f640725e0 0x7f6f64074aa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400abe0 tx=0x7f6f7400a2d0 comp rx=0 tx=0).stop 2024-09-10T22:41:48.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8b800640 1 -- 172.21.15.103:0/1384178124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f840d21a0 msgr2=0x7f6f841583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:48.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8b800640 1 --2- 172.21.15.103:0/1384178124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f840d21a0 0x7f6f841583c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000b410 tx=0x7f6f7000b8d0 comp rx=0 tx=0).stop 2024-09-10T22:41:48.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8b800640 1 -- 172.21.15.103:0/1384178124 shutdown_connections 2024-09-10T22:41:48.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8b800640 1 --2- 172.21.15.103:0/1384178124 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6f640725e0 0x7f6f64074aa0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:48.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8b800640 1 --2- 172.21.15.103:0/1384178124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f840b1f90 0x7f6f840b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:48.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8b800640 1 --2- 172.21.15.103:0/1384178124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f840d21a0 0x7f6f841583c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:48.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8b800640 1 --2- 172.21.15.103:0/1384178124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f840d1830 0x7f6f840cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:48.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8b800640 1 -- 172.21.15.103:0/1384178124 >> 172.21.15.103:0/1384178124 conn(0x7f6f840d3c60 msgr2=0x7f6f8406ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:48.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8b800640 1 -- 172.21.15.103:0/1384178124 shutdown_connections 2024-09-10T22:41:48.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:48.016+0000 7f6f8b800640 1 -- 172.21.15.103:0/1384178124 wait complete. 2024-09-10T22:41:49.086 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-10T22:41:49.084+0000 7fb5aec00640 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-10T22:41:53.037 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:41:53.037 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:1 scrub status 2024-09-10T22:41:53.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.188+0000 7f357ac00640 1 -- 172.21.15.103:0/3261570834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3558004810 msgr2=0x7f3558004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.188+0000 7f357ac00640 1 --2- 172.21.15.103:0/3261570834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3558004810 0x7f3558004c90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3560009d00 tx=0x7f356001d420 comp rx=0 tx=0).stop 2024-09-10T22:41:53.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.188+0000 7f3578c00640 1 -- 172.21.15.103:0/3261570834 reap_dead start 2024-09-10T22:41:53.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.188+0000 7f357ac00640 1 -- 172.21.15.103:0/3261570834 shutdown_connections 2024-09-10T22:41:53.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.188+0000 7f357ac00640 1 -- 172.21.15.103:0/3261570834 >> 172.21.15.103:0/3261570834 conn(0x7f357406cc00 msgr2=0x7f357406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.188+0000 7f357ac00640 1 -- 172.21.15.103:0/3261570834 shutdown_connections 2024-09-10T22:41:53.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.188+0000 7f357ac00640 1 -- 172.21.15.103:0/3261570834 wait complete. 2024-09-10T22:41:53.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.188+0000 7f357ac00640 1 Processor -- start 2024-09-10T22:41:53.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.188+0000 7f357ac00640 1 -- start start 2024-09-10T22:41:53.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.188+0000 7f357ac00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3558004810 0x7f357414da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.188+0000 7f357ac00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3574163080 0x7f3574163d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.188+0000 7f357ac00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f357414df60 0x7f35741642a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.188+0000 7f357ac00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f35740cff50 con 0x7f3558004810 2024-09-10T22:41:53.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.188+0000 7f357ac00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f35740cfdd0 con 0x7f3574163080 2024-09-10T22:41:53.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.188+0000 7f357ac00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f35740d00d0 con 0x7f357414df60 2024-09-10T22:41:53.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.192+0000 7f3573e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3558004810 0x7f357414da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.192+0000 7f3573e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3558004810 0x7f357414da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58826/0 (socket says 172.21.15.103:58826) 2024-09-10T22:41:53.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.192+0000 7f3573e00640 1 -- 172.21.15.103:0/3430081099 learned_addr learned my addr 172.21.15.103:0/3430081099 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:53.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.192+0000 7f3573400640 1 --2- 172.21.15.103:0/3430081099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3574163080 0x7f3574163d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.192+0000 7f3578c00640 1 --2- 172.21.15.103:0/3430081099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f357414df60 0x7f35741642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.192+0000 7f3573e00640 1 -- 172.21.15.103:0/3430081099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f357414df60 msgr2=0x7f35741642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.192+0000 7f3573e00640 1 --2- 172.21.15.103:0/3430081099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f357414df60 0x7f35741642a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.192+0000 7f3573e00640 1 -- 172.21.15.103:0/3430081099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3574163080 msgr2=0x7f3574163d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.192+0000 7f3573e00640 1 --2- 172.21.15.103:0/3430081099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3574163080 0x7f3574163d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.192+0000 7f3573e00640 1 -- 172.21.15.103:0/3430081099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3574163560 con 0x7f3558004810 2024-09-10T22:41:53.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.192+0000 7f3573400640 1 --2- 172.21.15.103:0/3430081099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3574163080 0x7f3574163d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:53.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.192+0000 7f3573e00640 1 --2- 172.21.15.103:0/3430081099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3558004810 0x7f357414da20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3564009f90 tx=0x7f356400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.192+0000 7f356be00640 1 -- 172.21.15.103:0/3430081099 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564003980 con 0x7f3558004810 2024-09-10T22:41:53.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.192+0000 7f356be00640 1 -- 172.21.15.103:0/3430081099 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3564003b20 con 0x7f3558004810 2024-09-10T22:41:53.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.192+0000 7f357ac00640 1 -- 172.21.15.103:0/3430081099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35740afa30 con 0x7f3558004810 2024-09-10T22:41:53.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.192+0000 7f356be00640 1 -- 172.21.15.103:0/3430081099 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564004020 con 0x7f3558004810 2024-09-10T22:41:53.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.192+0000 7f357ac00640 1 -- 172.21.15.103:0/3430081099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f357414e960 con 0x7f3558004810 2024-09-10T22:41:53.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.192+0000 7f356be00640 1 -- 172.21.15.103:0/3430081099 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f35640041c0 con 0x7f3558004810 2024-09-10T22:41:53.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f356be00640 1 --2- 172.21.15.103:0/3430081099 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3554072610 0x7f3554074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f356be00640 1 -- 172.21.15.103:0/3430081099 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f3564094270 con 0x7f3558004810 2024-09-10T22:41:53.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f357e054000 1 Processor -- start 2024-09-10T22:41:53.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f3573400640 1 --2- 172.21.15.103:0/3430081099 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3554072610 0x7f3554074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f357e054000 1 -- start start 2024-09-10T22:41:53.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f357e054000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b879741a0 0x562b87974580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f3573400640 1 --2- 172.21.15.103:0/3430081099 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3554072610 0x7f3554074ad0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f35600af000 tx=0x7f356001a1c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f357e054000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b87974ac0 0x562b8792a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f357e054000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b8792abc0 0x562b8792afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f357e054000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562b87812cb0 con 0x562b879741a0 2024-09-10T22:41:53.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f357e054000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562b87728310 con 0x562b87974ac0 2024-09-10T22:41:53.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f357e054000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x562b87785b90 con 0x562b8792abc0 2024-09-10T22:41:53.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f3573e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b879741a0 0x562b87974580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f3573e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b879741a0 0x562b87974580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58842/0 (socket says 172.21.15.103:58842) 2024-09-10T22:41:53.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f3573e00640 1 -- 172.21.15.103:0/1226940944 learned_addr learned my addr 172.21.15.103:0/1226940944 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:53.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f3573400640 1 --2- 172.21.15.103:0/1226940944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b87974ac0 0x562b8792a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f3578c00640 1 --2- 172.21.15.103:0/1226940944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b8792abc0 0x562b8792afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f3573e00640 1 -- 172.21.15.103:0/1226940944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b8792abc0 msgr2=0x562b8792afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f3573e00640 1 --2- 172.21.15.103:0/1226940944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b8792abc0 0x562b8792afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f3573e00640 1 -- 172.21.15.103:0/1226940944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b87974ac0 msgr2=0x562b8792a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f3573e00640 1 --2- 172.21.15.103:0/1226940944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b87974ac0 0x562b8792a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f3573e00640 1 -- 172.21.15.103:0/1226940944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b87729c60 con 0x562b879741a0 2024-09-10T22:41:53.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f3573e00640 1 --2- 172.21.15.103:0/1226940944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b879741a0 0x562b87974580 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f356405f010 tx=0x7f356405e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c0d1e68d296a3e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f3568c00640 1 -- 172.21.15.103:0/1226940944 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356405f780 con 0x562b879741a0 2024-09-10T22:41:53.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f3568c00640 1 -- 172.21.15.103:0/1226940944 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3564066e50 con 0x562b879741a0 2024-09-10T22:41:53.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.196+0000 7f3568c00640 1 -- 172.21.15.103:0/1226940944 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356405e540 con 0x562b879741a0 2024-09-10T22:41:53.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 1 -- 172.21.15.103:0/1226940944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b879741a0 msgr2=0x562b87974580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 1 --2- 172.21.15.103:0/1226940944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b879741a0 0x562b87974580 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f356405f010 tx=0x7f356405e8b0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 1 -- 172.21.15.103:0/1226940944 shutdown_connections 2024-09-10T22:41:53.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 1 --2- 172.21.15.103:0/1226940944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b8792abc0 0x562b8792afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 1 --2- 172.21.15.103:0/1226940944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b87974ac0 0x562b8792a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 1 --2- 172.21.15.103:0/1226940944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b879741a0 0x562b87974580 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 1 -- 172.21.15.103:0/1226940944 >> 172.21.15.103:0/1226940944 conn(0x562b87930d20 msgr2=0x562b87928f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 1 -- 172.21.15.103:0/1226940944 shutdown_connections 2024-09-10T22:41:53.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 1 -- 172.21.15.103:0/1226940944 wait complete. 2024-09-10T22:41:53.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 1 -- start start 2024-09-10T22:41:53.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 1 Processor -- start 2024-09-10T22:41:53.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b8792abc0 0x562b879735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b879741a0 0x562b87973af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b87974ac0 0x562b879750b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562b87778dd0 con 0x562b879741a0 2024-09-10T22:41:53.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562b87774fc0 con 0x562b87974ac0 2024-09-10T22:41:53.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x562b8771a4b0 con 0x562b8792abc0 2024-09-10T22:41:53.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 10 client.0 _ll_register_callbacks cb 0x562b876f87d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:53.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f3573400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b879741a0 0x562b87973af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f3573400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b879741a0 0x562b87973af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58856/0 (socket says 172.21.15.103:58856) 2024-09-10T22:41:53.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f3573400640 1 -- 172.21.15.103:0/1609206130 learned_addr learned my addr 172.21.15.103:0/1609206130 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:53.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f3578c00640 1 --2- 172.21.15.103:0/1609206130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b87974ac0 0x562b879750b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f3573e00640 1 --2- 172.21.15.103:0/1609206130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b8792abc0 0x562b879735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f3573400640 1 -- 172.21.15.103:0/1609206130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b8792abc0 msgr2=0x562b879735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f3573400640 1 --2- 172.21.15.103:0/1609206130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b8792abc0 0x562b879735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f3573400640 1 -- 172.21.15.103:0/1609206130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b87974ac0 msgr2=0x562b879750b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f3573400640 1 --2- 172.21.15.103:0/1609206130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b87974ac0 0x562b879750b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f3573400640 1 -- 172.21.15.103:0/1609206130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b877131f0 con 0x562b879741a0 2024-09-10T22:41:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f3573e00640 1 --2- 172.21.15.103:0/1609206130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b8792abc0 0x562b879735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f3573400640 1 --2- 172.21.15.103:0/1609206130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b879741a0 0x562b87973af0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f356001bca0 tx=0x7f35600091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c3d700e3a5748 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f355d600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f355d600640 1 -- 172.21.15.103:0/1609206130 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560004da0 con 0x562b879741a0 2024-09-10T22:41:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f355d600640 1 -- 172.21.15.103:0/1609206130 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f35600ac480 con 0x562b879741a0 2024-09-10T22:41:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.200+0000 7f357e054000 1 -- 172.21.15.103:0/1609206130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562b8770d330 con 0x562b879741a0 2024-09-10T22:41:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f355d600640 1 -- 172.21.15.103:0/1609206130 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f35600d5050 con 0x562b879741a0 2024-09-10T22:41:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 10 client.6012 fetch_fsmap learned FSMap version 45 2024-09-10T22:41:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 1 -- 172.21.15.103:0/1609206130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) -- 0x562b876f9fa0 con 0x562b879741a0 2024-09-10T22:41:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f355d600640 1 -- 172.21.15.103:0/1609206130 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x562b8770d330 con 0x562b879741a0 2024-09-10T22:41:53.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f355d600640 1 -- 172.21.15.103:0/1609206130 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 45) ==== 3558+0+0 (secure 0 0 0) 0x7f35600cb020 con 0x562b879741a0 2024-09-10T22:41:53.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 10 client.6012 fetch_fsmap finished waiting for FSMap version 45 2024-09-10T22:41:53.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 10 client.6012 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2024-09-10T22:41:53.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 20 client.6012 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:53.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 1 --2- 172.21.15.103:0/1609206130 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x562b87975e20 0x562b87976230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 4 client.6012 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:41:53.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 1 -- 172.21.15.103:0/1609206130 --> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b87787ae0 con 0x562b87975e20 2024-09-10T22:41:53.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f3573e00640 1 --2- 172.21.15.103:0/1609206130 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x562b87975e20 0x562b87976230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f3573e00640 1 --2- 172.21.15.103:0/1609206130 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x562b87975e20 0x562b87976230 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bfdc06998cfd8882 server_cookie=1367422c72b63beb in_seq=0 out_seq=0 2024-09-10T22:41:53.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f355d600640 10 client.6012 ms_handle_connect on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:53.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f355d600640 1 -- 172.21.15.103:0/1609206130 <== mds.1 v2:172.21.15.103:6833/3910783847 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562b87787ae0 con 0x562b87975e20 2024-09-10T22:41:53.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f355d600640 10 client.6012 handle_command_reply: tid=0 2024-09-10T22:41:53.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 1 client.6012 shutdown 2024-09-10T22:41:53.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 1 -- 172.21.15.103:0/1609206130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b879741a0 msgr2=0x562b87973af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 1 --2- 172.21.15.103:0/1609206130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b879741a0 0x562b87973af0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f356001bca0 tx=0x7f35600091e0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 1 -- 172.21.15.103:0/1609206130 shutdown_connections 2024-09-10T22:41:53.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 1 --2- 172.21.15.103:0/1609206130 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x562b87975e20 0x562b87976230 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 1 --2- 172.21.15.103:0/1609206130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b87974ac0 0x562b879750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 1 --2- 172.21.15.103:0/1609206130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b879741a0 0x562b87973af0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f355d600640 0 client.6012 ms_handle_reset on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:53.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 1 --2- 172.21.15.103:0/1609206130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b8792abc0 0x562b879735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 1 -- 172.21.15.103:0/1609206130 >> 172.21.15.103:0/1609206130 conn(0x562b87930d20 msgr2=0x562b87928f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 1 -- 172.21.15.103:0/1609206130 shutdown_connections 2024-09-10T22:41:53.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 1 -- 172.21.15.103:0/1609206130 wait complete. 2024-09-10T22:41:53.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.204+0000 7f357e054000 20 client.6012 trim_cache size 0 max 16384 2024-09-10T22:41:53.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.220+0000 7f357e054000 1 Processor -- start 2024-09-10T22:41:53.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.220+0000 7f357e054000 1 -- start start 2024-09-10T22:41:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f357e054000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b8792abc0 0x562b879ea960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f357e054000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b879741a0 0x562b879eaea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f357e054000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b87974ac0 0x562b879eb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f357e054000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3574200e40 con 0x562b8792abc0 2024-09-10T22:41:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f357e054000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f35741fffe0 con 0x562b879741a0 2024-09-10T22:41:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f357e054000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3574200710 con 0x562b87974ac0 2024-09-10T22:41:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f3573e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b8792abc0 0x562b879ea960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f3573e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b8792abc0 0x562b879ea960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58864/0 (socket says 172.21.15.103:58864) 2024-09-10T22:41:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f3573e00640 1 -- 172.21.15.103:0/1608044042 learned_addr learned my addr 172.21.15.103:0/1608044042 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f3573400640 1 --2- 172.21.15.103:0/1608044042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b879741a0 0x562b879eaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f3578c00640 1 --2- 172.21.15.103:0/1608044042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b87974ac0 0x562b879eb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f3573e00640 1 -- 172.21.15.103:0/1608044042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b87974ac0 msgr2=0x562b879eb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f3573e00640 1 --2- 172.21.15.103:0/1608044042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b87974ac0 0x562b879eb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f3573e00640 1 -- 172.21.15.103:0/1608044042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b879741a0 msgr2=0x562b879eaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f3573e00640 1 --2- 172.21.15.103:0/1608044042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b879741a0 0x562b879eaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f3573e00640 1 -- 172.21.15.103:0/1608044042 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b877d2660 con 0x562b8792abc0 2024-09-10T22:41:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f3573e00640 1 --2- 172.21.15.103:0/1608044042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b8792abc0 0x562b879ea960 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f356405ed80 tx=0x7f3564000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1f41d48bb9215f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f355fe00640 1 -- 172.21.15.103:0/1608044042 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356404c030 con 0x562b8792abc0 2024-09-10T22:41:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f355fe00640 1 -- 172.21.15.103:0/1608044042 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f356405f080 con 0x562b8792abc0 2024-09-10T22:41:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f355fe00640 1 -- 172.21.15.103:0/1608044042 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564084040 con 0x562b8792abc0 2024-09-10T22:41:53.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f357e054000 1 -- 172.21.15.103:0/1608044042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b8792abc0 msgr2=0x562b879ea960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f357e054000 1 --2- 172.21.15.103:0/1608044042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b8792abc0 0x562b879ea960 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f356405ed80 tx=0x7f3564000f50 comp rx=0 tx=0).stop 2024-09-10T22:41:53.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f357e054000 1 -- 172.21.15.103:0/1608044042 shutdown_connections 2024-09-10T22:41:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f357e054000 1 --2- 172.21.15.103:0/1608044042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b87974ac0 0x562b879eb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f357e054000 1 --2- 172.21.15.103:0/1608044042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b879741a0 0x562b879eaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f357e054000 1 --2- 172.21.15.103:0/1608044042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b8792abc0 0x562b879ea960 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f357e054000 1 -- 172.21.15.103:0/1608044042 >> 172.21.15.103:0/1608044042 conn(0x562b87930d20 msgr2=0x562b8798f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f357e054000 1 -- 172.21.15.103:0/1608044042 shutdown_connections 2024-09-10T22:41:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f357e054000 1 -- 172.21.15.103:0/1608044042 wait complete. 2024-09-10T22:41:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f357e054000 1 -- start start 2024-09-10T22:41:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.224+0000 7f357e054000 1 Processor -- start 2024-09-10T22:41:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b8792abc0 0x562b87983600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b879741a0 0x562b87983b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b87974ac0 0x562b87984080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562b87933d40 con 0x562b8792abc0 2024-09-10T22:41:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562b87931100 con 0x562b87974ac0 2024-09-10T22:41:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x562b8776fec0 con 0x562b879741a0 2024-09-10T22:41:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 10 client.0 _ll_register_callbacks cb 0x7f3560005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f3573e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b8792abc0 0x562b87983600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f3573e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b8792abc0 0x562b87983600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58866/0 (socket says 172.21.15.103:58866) 2024-09-10T22:41:53.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f3573e00640 1 -- 172.21.15.103:0/1891372680 learned_addr learned my addr 172.21.15.103:0/1891372680 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:53.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f3573400640 1 --2- 172.21.15.103:0/1891372680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b879741a0 0x562b87983b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f3578c00640 1 --2- 172.21.15.103:0/1891372680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b87974ac0 0x562b87984080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f3573e00640 1 -- 172.21.15.103:0/1891372680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b879741a0 msgr2=0x562b87983b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f3573e00640 1 --2- 172.21.15.103:0/1891372680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b879741a0 0x562b87983b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f3573e00640 1 -- 172.21.15.103:0/1891372680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b87974ac0 msgr2=0x562b87984080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f3573e00640 1 --2- 172.21.15.103:0/1891372680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b87974ac0 0x562b87984080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f3573e00640 1 -- 172.21.15.103:0/1891372680 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b8773f090 con 0x562b8792abc0 2024-09-10T22:41:53.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f3578c00640 1 --2- 172.21.15.103:0/1891372680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b87974ac0 0x562b87984080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:53.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f3573e00640 1 --2- 172.21.15.103:0/1891372680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b8792abc0 0x562b87983600 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f356400fc90 tx=0x7f35640096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63310ce8c5ca62b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f355d600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:53.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f355d600640 1 -- 172.21.15.103:0/1891372680 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356404c040 con 0x562b8792abc0 2024-09-10T22:41:53.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f355d600640 1 -- 172.21.15.103:0/1891372680 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f356405e2e0 con 0x562b8792abc0 2024-09-10T22:41:53.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 -- 172.21.15.103:0/1891372680 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f356405f080 con 0x562b8792abc0 2024-09-10T22:41:53.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f355d600640 1 -- 172.21.15.103:0/1891372680 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f3564084040 con 0x562b8792abc0 2024-09-10T22:41:53.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 10 client.6018 fetch_fsmap learned FSMap version 45 2024-09-10T22:41:53.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 -- 172.21.15.103:0/1891372680 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) -- 0x562b8770b5f0 con 0x562b8792abc0 2024-09-10T22:41:53.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f355d600640 1 -- 172.21.15.103:0/1891372680 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f356405f080 con 0x562b8792abc0 2024-09-10T22:41:53.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f355d600640 1 -- 172.21.15.103:0/1891372680 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 45) ==== 3558+0+0 (secure 0 0 0) 0x7f35640044e0 con 0x562b8792abc0 2024-09-10T22:41:53.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 10 client.6018 fetch_fsmap finished waiting for FSMap version 45 2024-09-10T22:41:53.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 10 client.6018 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2024-09-10T22:41:53.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 20 client.6018 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:53.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 --2- 172.21.15.103:0/1891372680 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x562b87984a10 0x562b879f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 4 client.6018 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:41:53.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 -- 172.21.15.103:0/1891372680 --> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562b87783590 con 0x562b87984a10 2024-09-10T22:41:53.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f3573400640 1 --2- 172.21.15.103:0/1891372680 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x562b87984a10 0x562b879f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f355d600640 10 client.6018 ms_handle_connect on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f3573400640 1 --2- 172.21.15.103:0/1891372680 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x562b87984a10 0x562b879f69e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7821c5b081ee39fd server_cookie=4fd19d98563df00e in_seq=0 out_seq=0 2024-09-10T22:41:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f355d600640 1 -- 172.21.15.103:0/1891372680 <== mds.1 v2:172.21.15.103:6833/3910783847 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562b87783590 con 0x562b87984a10 2024-09-10T22:41:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f355d600640 10 client.6018 handle_command_reply: tid=0 2024-09-10T22:41:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 client.6018 shutdown 2024-09-10T22:41:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 -- 172.21.15.103:0/1891372680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b8792abc0 msgr2=0x562b87983600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 --2- 172.21.15.103:0/1891372680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b8792abc0 0x562b87983600 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f356400fc90 tx=0x7f35640096a0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 -- 172.21.15.103:0/1891372680 shutdown_connections 2024-09-10T22:41:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 --2- 172.21.15.103:0/1891372680 >> [v2:172.21.15.103:6833/3910783847,v1:172.21.15.103:6834/3910783847] conn(0x562b87984a10 0x562b879f69e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 --2- 172.21.15.103:0/1891372680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b87974ac0 0x562b87984080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 --2- 172.21.15.103:0/1891372680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562b879741a0 0x562b87983b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f355d600640 0 client.6018 ms_handle_reset on v2:172.21.15.103:6833/3910783847 2024-09-10T22:41:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 --2- 172.21.15.103:0/1891372680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b8792abc0 0x562b87983600 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 -- 172.21.15.103:0/1891372680 >> 172.21.15.103:0/1891372680 conn(0x562b87930d20 msgr2=0x562b8798faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 -- 172.21.15.103:0/1891372680 shutdown_connections 2024-09-10T22:41:53.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 1 -- 172.21.15.103:0/1891372680 wait complete. 2024-09-10T22:41:53.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.228+0000 7f357e054000 20 client.6018 trim_cache size 0 max 16384 2024-09-10T22:41:53.237 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:41:53.237 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "no active scrubs running", 2024-09-10T22:41:53.237 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": {} 2024-09-10T22:41:53.237 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:41:53.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.232+0000 7f357ac00640 1 -- 172.21.15.103:0/3430081099 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3554072610 msgr2=0x7f3554074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.232+0000 7f357ac00640 1 --2- 172.21.15.103:0/3430081099 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3554072610 0x7f3554074ad0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f35600af000 tx=0x7f356001a1c0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.232+0000 7f357ac00640 1 -- 172.21.15.103:0/3430081099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3558004810 msgr2=0x7f357414da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.232+0000 7f357ac00640 1 --2- 172.21.15.103:0/3430081099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3558004810 0x7f357414da20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3564009f90 tx=0x7f356400f790 comp rx=0 tx=0).stop 2024-09-10T22:41:53.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.232+0000 7f357ac00640 1 -- 172.21.15.103:0/3430081099 shutdown_connections 2024-09-10T22:41:53.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.232+0000 7f357ac00640 1 --2- 172.21.15.103:0/3430081099 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3554072610 0x7f3554074ad0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.232+0000 7f357ac00640 1 --2- 172.21.15.103:0/3430081099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f357414df60 0x7f35741642a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.232+0000 7f357ac00640 1 --2- 172.21.15.103:0/3430081099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3574163080 0x7f3574163d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.232+0000 7f357ac00640 1 --2- 172.21.15.103:0/3430081099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3558004810 0x7f357414da20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.232+0000 7f357ac00640 1 -- 172.21.15.103:0/3430081099 >> 172.21.15.103:0/3430081099 conn(0x7f357406cc00 msgr2=0x7f35740b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.232+0000 7f357ac00640 1 -- 172.21.15.103:0/3430081099 shutdown_connections 2024-09-10T22:41:53.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.232+0000 7f357ac00640 1 -- 172.21.15.103:0/3430081099 wait complete. 2024-09-10T22:41:53.252 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:41:53.252 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:41:53.252 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:2 scrub status 2024-09-10T22:41:53.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.396+0000 7fda78e00640 1 -- 172.21.15.103:0/2677983989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda58003c70 msgr2=0x7fda58004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.396+0000 7fda78e00640 1 --2- 172.21.15.103:0/2677983989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda58003c70 0x7fda58004070 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fda64001860 tx=0x7fda6401c8e0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.396+0000 7fda72800640 1 -- 172.21.15.103:0/2677983989 reap_dead start 2024-09-10T22:41:53.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.396+0000 7fda78e00640 1 -- 172.21.15.103:0/2677983989 shutdown_connections 2024-09-10T22:41:53.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.396+0000 7fda78e00640 1 -- 172.21.15.103:0/2677983989 >> 172.21.15.103:0/2677983989 conn(0x7fda7406cc00 msgr2=0x7fda7406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.396+0000 7fda78e00640 1 -- 172.21.15.103:0/2677983989 shutdown_connections 2024-09-10T22:41:53.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.396+0000 7fda78e00640 1 -- 172.21.15.103:0/2677983989 wait complete. 2024-09-10T22:41:53.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.396+0000 7fda78e00640 1 Processor -- start 2024-09-10T22:41:53.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.396+0000 7fda78e00640 1 -- start start 2024-09-10T22:41:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.396+0000 7fda78e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda58003c70 0x7fda7414dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.396+0000 7fda78e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda741517e0 0x7fda740b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.396+0000 7fda78e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda74151c60 0x7fda740b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.396+0000 7fda78e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fda740cdbe0 con 0x7fda58003c70 2024-09-10T22:41:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.396+0000 7fda78e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fda740cda60 con 0x7fda741517e0 2024-09-10T22:41:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.396+0000 7fda78e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fda74167000 con 0x7fda74151c60 2024-09-10T22:41:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.400+0000 7fda71e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda58003c70 0x7fda7414dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.400+0000 7fda71e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda58003c70 0x7fda7414dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58886/0 (socket says 172.21.15.103:58886) 2024-09-10T22:41:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.400+0000 7fda71e00640 1 -- 172.21.15.103:0/3381576692 learned_addr learned my addr 172.21.15.103:0/3381576692 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.400+0000 7fda72800640 1 --2- 172.21.15.103:0/3381576692 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda74151c60 0x7fda740b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.400+0000 7fda71400640 1 --2- 172.21.15.103:0/3381576692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda741517e0 0x7fda740b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.400+0000 7fda71e00640 1 -- 172.21.15.103:0/3381576692 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda74151c60 msgr2=0x7fda740b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.400+0000 7fda71e00640 1 --2- 172.21.15.103:0/3381576692 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda74151c60 0x7fda740b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.400+0000 7fda71e00640 1 -- 172.21.15.103:0/3381576692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda741517e0 msgr2=0x7fda740b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.400+0000 7fda71e00640 1 --2- 172.21.15.103:0/3381576692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda741517e0 0x7fda740b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.400+0000 7fda71e00640 1 -- 172.21.15.103:0/3381576692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7414e010 con 0x7fda58003c70 2024-09-10T22:41:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.400+0000 7fda71400640 1 --2- 172.21.15.103:0/3381576692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda741517e0 0x7fda740b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:53.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.400+0000 7fda71e00640 1 --2- 172.21.15.103:0/3381576692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda58003c70 0x7fda7414dad0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fda6401afe0 tx=0x7fda64003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.400+0000 7fda6a000640 1 -- 172.21.15.103:0/3381576692 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64001480 con 0x7fda58003c70 2024-09-10T22:41:53.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.400+0000 7fda6a000640 1 -- 172.21.15.103:0/3381576692 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda640b4030 con 0x7fda58003c70 2024-09-10T22:41:53.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.400+0000 7fda6a000640 1 -- 172.21.15.103:0/3381576692 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda640a5ab0 con 0x7fda58003c70 2024-09-10T22:41:53.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.400+0000 7fda78e00640 1 -- 172.21.15.103:0/3381576692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda74150a20 con 0x7fda58003c70 2024-09-10T22:41:53.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.400+0000 7fda78e00640 1 -- 172.21.15.103:0/3381576692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda74150fe0 con 0x7fda58003c70 2024-09-10T22:41:53.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.400+0000 7fda6a000640 1 -- 172.21.15.103:0/3381576692 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fda640a5c50 con 0x7fda58003c70 2024-09-10T22:41:53.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda6a000640 1 --2- 172.21.15.103:0/3381576692 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda540725e0 0x7fda54074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda6a000640 1 -- 172.21.15.103:0/3381576692 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fda6412d4b0 con 0x7fda58003c70 2024-09-10T22:41:53.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda71400640 1 --2- 172.21.15.103:0/3381576692 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda540725e0 0x7fda54074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda7c2ab000 1 Processor -- start 2024-09-10T22:41:53.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda7c2ab000 1 -- start start 2024-09-10T22:41:53.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda71400640 1 --2- 172.21.15.103:0/3381576692 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda540725e0 0x7fda54074aa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fda7414fe20 tx=0x7fda600091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda7c2ab000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5ad61a0 0x55a3a5ad6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda7c2ab000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5ad6ac0 0x55a3a5a8c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda7c2ab000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5a8cbc0 0x55a3a5a8cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda7c2ab000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a3a5974cb0 con 0x55a3a5ad6ac0 2024-09-10T22:41:53.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda7c2ab000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a3a588a310 con 0x55a3a5a8cbc0 2024-09-10T22:41:53.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda7c2ab000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a3a58e7b90 con 0x55a3a5ad61a0 2024-09-10T22:41:53.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda71400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5ad6ac0 0x55a3a5a8c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda71400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5ad6ac0 0x55a3a5a8c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58902/0 (socket says 172.21.15.103:58902) 2024-09-10T22:41:53.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda71400640 1 -- 172.21.15.103:0/1008735262 learned_addr learned my addr 172.21.15.103:0/1008735262 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:53.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda71e00640 1 --2- 172.21.15.103:0/1008735262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5ad61a0 0x55a3a5ad6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda72800640 1 --2- 172.21.15.103:0/1008735262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5a8cbc0 0x55a3a5a8cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda71400640 1 -- 172.21.15.103:0/1008735262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5ad61a0 msgr2=0x55a3a5ad6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda71400640 1 --2- 172.21.15.103:0/1008735262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5ad61a0 0x55a3a5ad6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda71400640 1 -- 172.21.15.103:0/1008735262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5a8cbc0 msgr2=0x55a3a5a8cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda71400640 1 --2- 172.21.15.103:0/1008735262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5a8cbc0 0x55a3a5a8cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda71400640 1 -- 172.21.15.103:0/1008735262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3a588bc60 con 0x55a3a5ad6ac0 2024-09-10T22:41:53.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda71400640 1 --2- 172.21.15.103:0/1008735262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5ad6ac0 0x55a3a5a8c680 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fda60004140 tx=0x7fda60017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6534cc7345e3a24c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda5ea00640 1 -- 172.21.15.103:0/1008735262 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda60003b00 con 0x55a3a5ad6ac0 2024-09-10T22:41:53.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda5ea00640 1 -- 172.21.15.103:0/1008735262 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda60003ca0 con 0x55a3a5ad6ac0 2024-09-10T22:41:53.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.404+0000 7fda5ea00640 1 -- 172.21.15.103:0/1008735262 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda600296c0 con 0x55a3a5ad6ac0 2024-09-10T22:41:53.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 -- 172.21.15.103:0/1008735262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5ad6ac0 msgr2=0x55a3a5a8c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/1008735262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5ad6ac0 0x55a3a5a8c680 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fda60004140 tx=0x7fda60017000 comp rx=0 tx=0).stop 2024-09-10T22:41:53.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 -- 172.21.15.103:0/1008735262 shutdown_connections 2024-09-10T22:41:53.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/1008735262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5a8cbc0 0x55a3a5a8cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/1008735262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5ad6ac0 0x55a3a5a8c680 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/1008735262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5ad61a0 0x55a3a5ad6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 -- 172.21.15.103:0/1008735262 >> 172.21.15.103:0/1008735262 conn(0x55a3a5a92d20 msgr2=0x55a3a5a8af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 -- 172.21.15.103:0/1008735262 shutdown_connections 2024-09-10T22:41:53.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 -- 172.21.15.103:0/1008735262 wait complete. 2024-09-10T22:41:53.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 -- start start 2024-09-10T22:41:53.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 Processor -- start 2024-09-10T22:41:53.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5a8cbc0 0x55a3a5add530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5ad61a0 0x55a3a5adda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5ad6ac0 0x55a3a5addfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a3a58dadd0 con 0x55a3a5ad61a0 2024-09-10T22:41:53.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a3a58d6fc0 con 0x55a3a5a8cbc0 2024-09-10T22:41:53.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a3a587c4b0 con 0x55a3a5ad6ac0 2024-09-10T22:41:53.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 10 client.0 _ll_register_callbacks cb 0x55a3a585a7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:53.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda71400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5ad61a0 0x55a3a5adda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda71400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5ad61a0 0x55a3a5adda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58904/0 (socket says 172.21.15.103:58904) 2024-09-10T22:41:53.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda71400640 1 -- 172.21.15.103:0/208194331 learned_addr learned my addr 172.21.15.103:0/208194331 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:53.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda71e00640 1 --2- 172.21.15.103:0/208194331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5a8cbc0 0x55a3a5add530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda72800640 1 --2- 172.21.15.103:0/208194331 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5ad6ac0 0x55a3a5addfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda71400640 1 -- 172.21.15.103:0/208194331 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5ad6ac0 msgr2=0x55a3a5addfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda71400640 1 --2- 172.21.15.103:0/208194331 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5ad6ac0 0x55a3a5addfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda71400640 1 -- 172.21.15.103:0/208194331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5a8cbc0 msgr2=0x55a3a5add530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda71400640 1 --2- 172.21.15.103:0/208194331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5a8cbc0 0x55a3a5add530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda71400640 1 -- 172.21.15.103:0/208194331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3a58751f0 con 0x55a3a5ad61a0 2024-09-10T22:41:53.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda71400640 1 --2- 172.21.15.103:0/208194331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5ad61a0 0x55a3a5adda70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fda60019040 tx=0x7fda60003fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c245c2f55af11195 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda53400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:53.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda53400640 1 -- 172.21.15.103:0/208194331 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6002a920 con 0x55a3a5ad61a0 2024-09-10T22:41:53.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 -- 172.21.15.103:0/208194331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a3a586f330 con 0x55a3a5ad61a0 2024-09-10T22:41:53.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda53400640 1 -- 172.21.15.103:0/208194331 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fda60034cb0 con 0x55a3a5ad61a0 2024-09-10T22:41:53.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda53400640 1 -- 172.21.15.103:0/208194331 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fda6002aac0 con 0x55a3a5ad61a0 2024-09-10T22:41:53.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 10 client.6030 fetch_fsmap learned FSMap version 45 2024-09-10T22:41:53.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.408+0000 7fda7c2ab000 1 -- 172.21.15.103:0/208194331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) -- 0x55a3a585bfa0 con 0x55a3a5ad61a0 2024-09-10T22:41:53.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda53400640 1 -- 172.21.15.103:0/208194331 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a3a586f330 con 0x55a3a5ad61a0 2024-09-10T22:41:53.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda53400640 1 -- 172.21.15.103:0/208194331 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 45) ==== 3558+0+0 (secure 0 0 0) 0x7fda60031020 con 0x55a3a5ad61a0 2024-09-10T22:41:53.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda7c2ab000 10 client.6030 fetch_fsmap finished waiting for FSMap version 45 2024-09-10T22:41:53.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda7c2ab000 10 client.6030 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.d 2024-09-10T22:41:53.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda7c2ab000 20 client.6030 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:53.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/208194331 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x55a3a5ae5900 0x55a3a5ae7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda7c2ab000 4 client.6030 mds_command: new command op to 5153 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:41:53.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda7c2ab000 1 -- 172.21.15.103:0/208194331 --> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3a58e9ae0 con 0x55a3a5ae5900 2024-09-10T22:41:53.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda71e00640 1 --2- 172.21.15.103:0/208194331 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x55a3a5ae5900 0x55a3a5ae7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda71e00640 1 --2- 172.21.15.103:0/208194331 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x55a3a5ae5900 0x55a3a5ae7cf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c8a882d2bbaae6a9 server_cookie=31dbf16bf61ec3a9 in_seq=0 out_seq=0 2024-09-10T22:41:53.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda53400640 10 client.6030 ms_handle_connect on v2:172.21.15.131:6835/3348473142 2024-09-10T22:41:53.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda53400640 1 -- 172.21.15.103:0/208194331 <== mds.2 v2:172.21.15.131:6835/3348473142 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a3a58e9ae0 con 0x55a3a5ae5900 2024-09-10T22:41:53.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda53400640 10 client.6030 handle_command_reply: tid=0 2024-09-10T22:41:53.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda7c2ab000 1 client.6030 shutdown 2024-09-10T22:41:53.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda7c2ab000 1 -- 172.21.15.103:0/208194331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5ad61a0 msgr2=0x55a3a5adda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/208194331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5ad61a0 0x55a3a5adda70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fda60019040 tx=0x7fda60003fb0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda7c2ab000 1 -- 172.21.15.103:0/208194331 shutdown_connections 2024-09-10T22:41:53.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/208194331 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x55a3a5ae5900 0x55a3a5ae7cf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/208194331 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5ad6ac0 0x55a3a5addfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/208194331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5ad61a0 0x55a3a5adda70 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda53400640 0 client.6030 ms_handle_reset on v2:172.21.15.131:6835/3348473142 2024-09-10T22:41:53.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/208194331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5a8cbc0 0x55a3a5add530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda7c2ab000 1 -- 172.21.15.103:0/208194331 >> 172.21.15.103:0/208194331 conn(0x55a3a5a92d20 msgr2=0x55a3a5a8af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda7c2ab000 1 -- 172.21.15.103:0/208194331 shutdown_connections 2024-09-10T22:41:53.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda7c2ab000 1 -- 172.21.15.103:0/208194331 wait complete. 2024-09-10T22:41:53.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.412+0000 7fda7c2ab000 20 client.6030 trim_cache size 0 max 16384 2024-09-10T22:41:53.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda7c2ab000 1 Processor -- start 2024-09-10T22:41:53.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda7c2ab000 1 -- start start 2024-09-10T22:41:53.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda7c2ab000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5a92d20 0x55a3a5b48a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda7c2ab000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5a8cbc0 0x55a3a5b48f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda7c2ab000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5ad61a0 0x55a3a5b494b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda7c2ab000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fda742033e0 con 0x55a3a5a92d20 2024-09-10T22:41:53.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda7c2ab000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fda74202580 con 0x55a3a5a8cbc0 2024-09-10T22:41:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda7c2ab000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fda74202cb0 con 0x55a3a5ad61a0 2024-09-10T22:41:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda71e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5a92d20 0x55a3a5b48a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda71e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5a92d20 0x55a3a5b48a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58918/0 (socket says 172.21.15.103:58918) 2024-09-10T22:41:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda71e00640 1 -- 172.21.15.103:0/2671625080 learned_addr learned my addr 172.21.15.103:0/2671625080 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda71e00640 1 -- 172.21.15.103:0/2671625080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5ad61a0 msgr2=0x55a3a5b494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda71e00640 1 --2- 172.21.15.103:0/2671625080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5ad61a0 0x55a3a5b494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda71e00640 1 -- 172.21.15.103:0/2671625080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5a8cbc0 msgr2=0x55a3a5b48f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda71e00640 1 --2- 172.21.15.103:0/2671625080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5a8cbc0 0x55a3a5b48f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda71e00640 1 -- 172.21.15.103:0/2671625080 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3a5934660 con 0x55a3a5a92d20 2024-09-10T22:41:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda71e00640 1 --2- 172.21.15.103:0/2671625080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5a92d20 0x55a3a5b48a30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fda640f82d0 tx=0x7fda640fb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520e56d78e96bb8f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda5e000640 1 -- 172.21.15.103:0/2671625080 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda640be040 con 0x55a3a5a92d20 2024-09-10T22:41:53.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda5e000640 1 -- 172.21.15.103:0/2671625080 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda640f7e50 con 0x55a3a5a92d20 2024-09-10T22:41:53.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda5e000640 1 -- 172.21.15.103:0/2671625080 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda640f8a40 con 0x55a3a5a92d20 2024-09-10T22:41:53.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda7c2ab000 1 -- 172.21.15.103:0/2671625080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5a92d20 msgr2=0x55a3a5b48a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/2671625080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5a92d20 0x55a3a5b48a30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fda640f82d0 tx=0x7fda640fb040 comp rx=0 tx=0).stop 2024-09-10T22:41:53.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda7c2ab000 1 -- 172.21.15.103:0/2671625080 shutdown_connections 2024-09-10T22:41:53.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/2671625080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5ad61a0 0x55a3a5b494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/2671625080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5a8cbc0 0x55a3a5b48f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/2671625080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5a92d20 0x55a3a5b48a30 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda7c2ab000 1 -- 172.21.15.103:0/2671625080 >> 172.21.15.103:0/2671625080 conn(0x55a3a5a89270 msgr2=0x55a3a5a8cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda7c2ab000 1 -- 172.21.15.103:0/2671625080 shutdown_connections 2024-09-10T22:41:53.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda7c2ab000 1 -- 172.21.15.103:0/2671625080 wait complete. 2024-09-10T22:41:53.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.432+0000 7fda7c2ab000 1 -- start start 2024-09-10T22:41:53.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 1 Processor -- start 2024-09-10T22:41:53.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5a8cbc0 0x55a3a5b4c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5a92d20 0x55a3a5b4c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5ad61a0 0x55a3a5b4cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a3a58d6fc0 con 0x55a3a5a8cbc0 2024-09-10T22:41:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a3a58dadd0 con 0x55a3a5ad61a0 2024-09-10T22:41:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a3a5a95d40 con 0x55a3a5a92d20 2024-09-10T22:41:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 10 client.0 _ll_register_callbacks cb 0x7fda6c006e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda71e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5a8cbc0 0x55a3a5b4c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda71e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5a8cbc0 0x55a3a5b4c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58926/0 (socket says 172.21.15.103:58926) 2024-09-10T22:41:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda71e00640 1 -- 172.21.15.103:0/1747889055 learned_addr learned my addr 172.21.15.103:0/1747889055 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda72800640 1 --2- 172.21.15.103:0/1747889055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5ad61a0 0x55a3a5b4cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda71400640 1 --2- 172.21.15.103:0/1747889055 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5a92d20 0x55a3a5b4c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda71e00640 1 -- 172.21.15.103:0/1747889055 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5a92d20 msgr2=0x55a3a5b4c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda71e00640 1 --2- 172.21.15.103:0/1747889055 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5a92d20 0x55a3a5b4c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda71e00640 1 -- 172.21.15.103:0/1747889055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5ad61a0 msgr2=0x55a3a5b4cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda71e00640 1 --2- 172.21.15.103:0/1747889055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5ad61a0 0x55a3a5b4cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda71e00640 1 -- 172.21.15.103:0/1747889055 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3a58a1090 con 0x55a3a5a8cbc0 2024-09-10T22:41:53.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda71400640 1 --2- 172.21.15.103:0/1747889055 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5a92d20 0x55a3a5b4c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:53.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda71e00640 1 --2- 172.21.15.103:0/1747889055 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5a8cbc0 0x55a3a5b4c170 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fda6401cdc0 tx=0x7fda640f8ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18cf84815cce00e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda53400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:53.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda53400640 1 -- 172.21.15.103:0/1747889055 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda640be070 con 0x55a3a5a8cbc0 2024-09-10T22:41:53.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda53400640 1 -- 172.21.15.103:0/1747889055 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fda6412a040 con 0x55a3a5a8cbc0 2024-09-10T22:41:53.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 1 -- 172.21.15.103:0/1747889055 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda640f7e50 con 0x55a3a5a8cbc0 2024-09-10T22:41:53.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda53400640 1 -- 172.21.15.103:0/1747889055 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fda64101840 con 0x55a3a5a8cbc0 2024-09-10T22:41:53.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 10 client.6036 fetch_fsmap learned FSMap version 45 2024-09-10T22:41:53.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 1 -- 172.21.15.103:0/1747889055 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) -- 0x55a3a586d5f0 con 0x55a3a5a8cbc0 2024-09-10T22:41:53.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda53400640 1 -- 172.21.15.103:0/1747889055 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda640f7e50 con 0x55a3a5a8cbc0 2024-09-10T22:41:53.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda53400640 1 -- 172.21.15.103:0/1747889055 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 45) ==== 3558+0+0 (secure 0 0 0) 0x7fda640f45b0 con 0x55a3a5a8cbc0 2024-09-10T22:41:53.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 10 client.6036 fetch_fsmap finished waiting for FSMap version 45 2024-09-10T22:41:53.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 10 client.6036 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.d 2024-09-10T22:41:53.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 20 client.6036 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:53.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/1747889055 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x55a3a5ad6ac0 0x55a3a5b086c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 4 client.6036 mds_command: new command op to 5153 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:41:53.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 1 -- 172.21.15.103:0/1747889055 --> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a3a5aee010 con 0x55a3a5ad6ac0 2024-09-10T22:41:53.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda71400640 1 --2- 172.21.15.103:0/1747889055 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x55a3a5ad6ac0 0x55a3a5b086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda71400640 1 --2- 172.21.15.103:0/1747889055 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x55a3a5ad6ac0 0x55a3a5b086c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ffa35632fa56dc19 server_cookie=e43c62375fba4525 in_seq=0 out_seq=0 2024-09-10T22:41:53.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda53400640 10 client.6036 ms_handle_connect on v2:172.21.15.131:6835/3348473142 2024-09-10T22:41:53.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda53400640 1 -- 172.21.15.103:0/1747889055 <== mds.2 v2:172.21.15.131:6835/3348473142 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a3a5aee010 con 0x55a3a5ad6ac0 2024-09-10T22:41:53.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda53400640 10 client.6036 handle_command_reply: tid=0 2024-09-10T22:41:53.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 1 client.6036 shutdown 2024-09-10T22:41:53.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 1 -- 172.21.15.103:0/1747889055 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5a8cbc0 msgr2=0x55a3a5b4c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.436+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/1747889055 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5a8cbc0 0x55a3a5b4c170 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fda6401cdc0 tx=0x7fda640f8ba0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda7c2ab000 1 -- 172.21.15.103:0/1747889055 shutdown_connections 2024-09-10T22:41:53.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/1747889055 >> [v2:172.21.15.131:6835/3348473142,v1:172.21.15.131:6837/3348473142] conn(0x55a3a5ad6ac0 0x55a3a5b086c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/1747889055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3a5ad61a0 0x55a3a5b4cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/1747889055 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3a5a92d20 0x55a3a5b4c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda53400640 0 client.6036 ms_handle_reset on v2:172.21.15.131:6835/3348473142 2024-09-10T22:41:53.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda7c2ab000 1 --2- 172.21.15.103:0/1747889055 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a3a5a8cbc0 0x55a3a5b4c170 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda7c2ab000 1 -- 172.21.15.103:0/1747889055 >> 172.21.15.103:0/1747889055 conn(0x55a3a5a89270 msgr2=0x55a3a5a8d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda7c2ab000 1 -- 172.21.15.103:0/1747889055 shutdown_connections 2024-09-10T22:41:53.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda7c2ab000 1 -- 172.21.15.103:0/1747889055 wait complete. 2024-09-10T22:41:53.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda7c2ab000 20 client.6036 trim_cache size 0 max 16384 2024-09-10T22:41:53.445 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:41:53.445 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "no active scrubs running", 2024-09-10T22:41:53.445 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": {} 2024-09-10T22:41:53.445 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:41:53.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda78e00640 1 -- 172.21.15.103:0/3381576692 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda540725e0 msgr2=0x7fda54074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda78e00640 1 --2- 172.21.15.103:0/3381576692 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda540725e0 0x7fda54074aa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fda7414fe20 tx=0x7fda600091e0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda78e00640 1 -- 172.21.15.103:0/3381576692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda58003c70 msgr2=0x7fda7414dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda78e00640 1 --2- 172.21.15.103:0/3381576692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda58003c70 0x7fda7414dad0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fda6401afe0 tx=0x7fda64003c60 comp rx=0 tx=0).stop 2024-09-10T22:41:53.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda78e00640 1 -- 172.21.15.103:0/3381576692 shutdown_connections 2024-09-10T22:41:53.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda78e00640 1 --2- 172.21.15.103:0/3381576692 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda540725e0 0x7fda54074aa0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda78e00640 1 --2- 172.21.15.103:0/3381576692 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda74151c60 0x7fda740b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda78e00640 1 --2- 172.21.15.103:0/3381576692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda741517e0 0x7fda740b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda78e00640 1 --2- 172.21.15.103:0/3381576692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda58003c70 0x7fda7414dad0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda78e00640 1 -- 172.21.15.103:0/3381576692 >> 172.21.15.103:0/3381576692 conn(0x7fda7406cc00 msgr2=0x7fda740b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda78e00640 1 -- 172.21.15.103:0/3381576692 shutdown_connections 2024-09-10T22:41:53.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.440+0000 7fda78e00640 1 -- 172.21.15.103:0/3381576692 wait complete. 2024-09-10T22:41:53.460 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:41:53.460 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:41:53.461 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-10T22:41:53.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b47200640 1 -- 172.21.15.103:0/912333147 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b480b0510 msgr2=0x7f5b48070430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b47200640 1 --2- 172.21.15.103:0/912333147 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b480b0510 0x7f5b48070430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009c80 tx=0x7f5b4001cd10 comp rx=0 tx=0).stop 2024-09-10T22:41:53.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b47200640 1 -- 172.21.15.103:0/912333147 shutdown_connections 2024-09-10T22:41:53.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b47200640 1 --2- 172.21.15.103:0/912333147 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b480b0510 0x7f5b48070430 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b47200640 1 --2- 172.21.15.103:0/912333147 >> v2:172.21.15.131:3300/0 conn(0x7f5b480714d0 0x7f5b480affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b47200640 1 -- 172.21.15.103:0/912333147 >> 172.21.15.103:0/912333147 conn(0x7f5b480d18f0 msgr2=0x7f5b480d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b47200640 1 -- 172.21.15.103:0/912333147 shutdown_connections 2024-09-10T22:41:53.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b47200640 1 -- 172.21.15.103:0/912333147 wait complete. 2024-09-10T22:41:53.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b47200640 1 Processor -- start 2024-09-10T22:41:53.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b47200640 1 -- start start 2024-09-10T22:41:53.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b47200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b480714d0 0x7f5b480c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b47200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b480b0510 0x7f5b480c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b47200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b4815f0e0 0x7f5b4814d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b47200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5b48168c30 con 0x7f5b480b0510 2024-09-10T22:41:53.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b47200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5b48168ab0 con 0x7f5b480714d0 2024-09-10T22:41:53.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b47200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5b48168db0 con 0x7f5b4815f0e0 2024-09-10T22:41:53.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b45400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b480b0510 0x7f5b480c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b45400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b480b0510 0x7f5b480c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58930/0 (socket says 172.21.15.103:58930) 2024-09-10T22:41:53.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b45400640 1 -- 172.21.15.103:0/1953499526 learned_addr learned my addr 172.21.15.103:0/1953499526 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:53.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b45e00640 1 --2- 172.21.15.103:0/1953499526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b480714d0 0x7f5b480c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b46800640 1 --2- 172.21.15.103:0/1953499526 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b4815f0e0 0x7f5b4814d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b45400640 1 -- 172.21.15.103:0/1953499526 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b4815f0e0 msgr2=0x7f5b4814d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b45400640 1 --2- 172.21.15.103:0/1953499526 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b4815f0e0 0x7f5b4814d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b45400640 1 -- 172.21.15.103:0/1953499526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b480714d0 msgr2=0x7f5b480c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b45400640 1 --2- 172.21.15.103:0/1953499526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b480714d0 0x7f5b480c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.604+0000 7f5b45400640 1 -- 172.21.15.103:0/1953499526 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b480c6a40 con 0x7f5b480b0510 2024-09-10T22:41:53.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.608+0000 7f5b45400640 1 --2- 172.21.15.103:0/1953499526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b480b0510 0x7f5b480c7fb0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f5b3400e9f0 tx=0x7f5b3400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.608+0000 7f5b3e000640 1 -- 172.21.15.103:0/1953499526 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3400cd80 con 0x7f5b480b0510 2024-09-10T22:41:53.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.608+0000 7f5b3e000640 1 -- 172.21.15.103:0/1953499526 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b34010430 con 0x7f5b480b0510 2024-09-10T22:41:53.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.608+0000 7f5b47200640 1 -- 172.21.15.103:0/1953499526 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b4814c6a0 con 0x7f5b480b0510 2024-09-10T22:41:53.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.608+0000 7f5b3e000640 1 -- 172.21.15.103:0/1953499526 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b34010860 con 0x7f5b480b0510 2024-09-10T22:41:53.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.608+0000 7f5b47200640 1 -- 172.21.15.103:0/1953499526 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b4814cc60 con 0x7f5b480b0510 2024-09-10T22:41:53.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.608+0000 7f5b3e000640 1 -- 172.21.15.103:0/1953499526 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5b34010a00 con 0x7f5b480b0510 2024-09-10T22:41:53.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b3e000640 1 --2- 172.21.15.103:0/1953499526 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5b280725e0 0x7f5b28074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b4fe26000 1 Processor -- start 2024-09-10T22:41:53.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b3e000640 1 -- 172.21.15.103:0/1953499526 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f5b34093fd0 con 0x7f5b480b0510 2024-09-10T22:41:53.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b4fe26000 1 -- start start 2024-09-10T22:41:53.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b45e00640 1 --2- 172.21.15.103:0/1953499526 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5b280725e0 0x7f5b28074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b45e00640 1 --2- 172.21.15.103:0/1953499526 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5b280725e0 0x7f5b28074aa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5b480b7740 tx=0x7f5b38009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b4fe26000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f00701a0 0x5654f0070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b4fe26000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f0070ac0 0x5654f0026680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b4fe26000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0026bc0 0x5654f0026fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b4fe26000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5654eff0ecb0 con 0x5654f0026bc0 2024-09-10T22:41:53.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b4fe26000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5654efe24310 con 0x5654f0070ac0 2024-09-10T22:41:53.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b4fe26000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5654efe81b90 con 0x5654f00701a0 2024-09-10T22:41:53.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b46800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0026bc0 0x5654f0026fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b45400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f0070ac0 0x5654f0026680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b45e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f00701a0 0x5654f0070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b45400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f0070ac0 0x5654f0026680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:54942/0 (socket says 172.21.15.103:54942) 2024-09-10T22:41:53.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b45400640 1 -- 172.21.15.103:0/224979857 learned_addr learned my addr 172.21.15.103:0/224979857 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b45400640 1 -- 172.21.15.103:0/224979857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f00701a0 msgr2=0x5654f0070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b45400640 1 --2- 172.21.15.103:0/224979857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f00701a0 0x5654f0070580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b45400640 1 -- 172.21.15.103:0/224979857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0026bc0 msgr2=0x5654f0026fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b45400640 1 --2- 172.21.15.103:0/224979857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0026bc0 0x5654f0026fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b45400640 1 -- 172.21.15.103:0/224979857 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654efe25c60 con 0x5654f0070ac0 2024-09-10T22:41:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b45400640 1 --2- 172.21.15.103:0/224979857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f0070ac0 0x5654f0026680 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5b3405ee50 tx=0x7f5b3405ea90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9d4284087f01412 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b32a00640 1 -- 172.21.15.103:0/224979857 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b34068310 con 0x5654f0070ac0 2024-09-10T22:41:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b32a00640 1 -- 172.21.15.103:0/224979857 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b34010d20 con 0x5654f0070ac0 2024-09-10T22:41:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b32a00640 1 -- 172.21.15.103:0/224979857 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b34066be0 con 0x5654f0070ac0 2024-09-10T22:41:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b4fe26000 1 -- 172.21.15.103:0/224979857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f0070ac0 msgr2=0x5654f0026680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/224979857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f0070ac0 0x5654f0026680 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5b3405ee50 tx=0x7f5b3405ea90 comp rx=0 tx=0).stop 2024-09-10T22:41:53.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b4fe26000 1 -- 172.21.15.103:0/224979857 shutdown_connections 2024-09-10T22:41:53.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/224979857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0026bc0 0x5654f0026fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/224979857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f0070ac0 0x5654f0026680 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/224979857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f00701a0 0x5654f0070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b4fe26000 1 -- 172.21.15.103:0/224979857 >> 172.21.15.103:0/224979857 conn(0x5654f002cd20 msgr2=0x5654f0024f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b4fe26000 1 -- 172.21.15.103:0/224979857 shutdown_connections 2024-09-10T22:41:53.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.612+0000 7f5b4fe26000 1 -- 172.21.15.103:0/224979857 wait complete. 2024-09-10T22:41:53.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b4fe26000 1 -- start start 2024-09-10T22:41:53.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b4fe26000 1 Processor -- start 2024-09-10T22:41:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b4fe26000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f0026bc0 0x5654f0077530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b4fe26000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f00701a0 0x5654f0077a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b4fe26000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 0x5654f0077fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b4fe26000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5654efe74dd0 con 0x5654f0070ac0 2024-09-10T22:41:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b4fe26000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5654efe70fc0 con 0x5654f00701a0 2024-09-10T22:41:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b4fe26000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5654efe164b0 con 0x5654f0026bc0 2024-09-10T22:41:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b4fe26000 10 client.0 _ll_register_callbacks cb 0x5654efdf47d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b46800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 0x5654f0077fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b46800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 0x5654f0077fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58936/0 (socket says 172.21.15.103:58936) 2024-09-10T22:41:53.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b46800640 1 -- 172.21.15.103:0/1722809250 learned_addr learned my addr 172.21.15.103:0/1722809250 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:53.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b45400640 1 --2- 172.21.15.103:0/1722809250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f00701a0 0x5654f0077a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b45e00640 1 --2- 172.21.15.103:0/1722809250 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f0026bc0 0x5654f0077530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b46800640 1 -- 172.21.15.103:0/1722809250 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f0026bc0 msgr2=0x5654f0077530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b46800640 1 --2- 172.21.15.103:0/1722809250 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f0026bc0 0x5654f0077530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b46800640 1 -- 172.21.15.103:0/1722809250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f00701a0 msgr2=0x5654f0077a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b46800640 1 --2- 172.21.15.103:0/1722809250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f00701a0 0x5654f0077a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b46800640 1 -- 172.21.15.103:0/1722809250 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654efe0f1f0 con 0x5654f0070ac0 2024-09-10T22:41:53.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b46800640 1 --2- 172.21.15.103:0/1722809250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 0x5654f0077fb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009bd0 tx=0x7f5b400092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b612ddfd490fabbb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b27400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:53.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b27400640 1 -- 172.21.15.103:0/1722809250 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b400b2040 con 0x5654f0070ac0 2024-09-10T22:41:53.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b4fe26000 1 -- 172.21.15.103:0/1722809250 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5654efe09330 con 0x5654f0070ac0 2024-09-10T22:41:53.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b27400640 1 -- 172.21.15.103:0/1722809250 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f5b40004cd0 con 0x5654f0070ac0 2024-09-10T22:41:53.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b27400640 1 -- 172.21.15.103:0/1722809250 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f5b400c4050 con 0x5654f0070ac0 2024-09-10T22:41:53.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b4fe26000 10 client.6045 fetch_fsmap learned FSMap version 45 2024-09-10T22:41:53.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b4fe26000 1 -- 172.21.15.103:0/1722809250 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) -- 0x5654efdf5fa0 con 0x5654f0070ac0 2024-09-10T22:41:53.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b27400640 1 -- 172.21.15.103:0/1722809250 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5654efe09330 con 0x5654f0070ac0 2024-09-10T22:41:53.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b27400640 1 -- 172.21.15.103:0/1722809250 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 45) ==== 3558+0+0 (secure 0 0 0) 0x7f5b400c7020 con 0x5654f0070ac0 2024-09-10T22:41:53.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b4fe26000 10 client.6045 fetch_fsmap finished waiting for FSMap version 45 2024-09-10T22:41:53.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b4fe26000 10 client.6045 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T22:41:53.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b4fe26000 20 client.6045 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:53.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/1722809250 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5654f007f900 0x5654f0081cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b4fe26000 4 client.6045 mds_command: new command op to 5547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:41:53.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b4fe26000 1 -- 172.21.15.103:0/1722809250 --> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654efe83ae0 con 0x5654f007f900 2024-09-10T22:41:53.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.616+0000 7f5b45e00640 1 --2- 172.21.15.103:0/1722809250 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5654f007f900 0x5654f0081cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.620+0000 7f5b45e00640 1 --2- 172.21.15.103:0/1722809250 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5654f007f900 0x5654f0081cf0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c5e01f94e33348 server_cookie=7edfd455365ceb9a in_seq=0 out_seq=0 2024-09-10T22:41:53.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.620+0000 7f5b27400640 10 client.6045 ms_handle_connect on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:53.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.620+0000 7f5b27400640 1 -- 172.21.15.103:0/1722809250 <== mds.0 v2:172.21.15.103:6832/343761048 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5654efe83ae0 con 0x5654f007f900 2024-09-10T22:41:53.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.620+0000 7f5b27400640 10 client.6045 handle_command_reply: tid=0 2024-09-10T22:41:53.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.620+0000 7f5b4fe26000 1 client.6045 shutdown 2024-09-10T22:41:53.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.620+0000 7f5b4fe26000 1 -- 172.21.15.103:0/1722809250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 msgr2=0x5654f0077fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.620+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/1722809250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 0x5654f0077fb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009bd0 tx=0x7f5b400092e0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.620+0000 7f5b4fe26000 1 -- 172.21.15.103:0/1722809250 shutdown_connections 2024-09-10T22:41:53.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.620+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/1722809250 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5654f007f900 0x5654f0081cf0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.620+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/1722809250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 0x5654f0077fb0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.620+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/1722809250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f00701a0 0x5654f0077a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.620+0000 7f5b27400640 0 client.6045 ms_handle_reset on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:53.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.620+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/1722809250 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f0026bc0 0x5654f0077530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.620+0000 7f5b4fe26000 1 -- 172.21.15.103:0/1722809250 >> 172.21.15.103:0/1722809250 conn(0x5654f002cd20 msgr2=0x5654f0024f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.620+0000 7f5b4fe26000 1 -- 172.21.15.103:0/1722809250 shutdown_connections 2024-09-10T22:41:53.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.620+0000 7f5b4fe26000 1 -- 172.21.15.103:0/1722809250 wait complete. 2024-09-10T22:41:53.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.620+0000 7f5b4fe26000 20 client.6045 trim_cache size 0 max 16384 2024-09-10T22:41:53.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.636+0000 7f5b4fe26000 1 Processor -- start 2024-09-10T22:41:53.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.636+0000 7f5b4fe26000 1 -- start start 2024-09-10T22:41:53.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f0026bc0 0x5654f0026070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f00701a0 0x5654f00265b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 0x5654f007a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5b482024d0 con 0x5654f0070ac0 2024-09-10T22:41:53.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5b48201670 con 0x5654f0026bc0 2024-09-10T22:41:53.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5b48201da0 con 0x5654f00701a0 2024-09-10T22:41:53.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b46800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 0x5654f007a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b46800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 0x5654f007a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58952/0 (socket says 172.21.15.103:58952) 2024-09-10T22:41:53.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b46800640 1 -- 172.21.15.103:0/247336447 learned_addr learned my addr 172.21.15.103:0/247336447 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:53.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b45400640 1 --2- 172.21.15.103:0/247336447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f00701a0 0x5654f00265b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b45e00640 1 --2- 172.21.15.103:0/247336447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f0026bc0 0x5654f0026070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b46800640 1 -- 172.21.15.103:0/247336447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f00701a0 msgr2=0x5654f00265b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b46800640 1 --2- 172.21.15.103:0/247336447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f00701a0 0x5654f00265b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b46800640 1 -- 172.21.15.103:0/247336447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f0026bc0 msgr2=0x5654f0026070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b46800640 1 --2- 172.21.15.103:0/247336447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f0026bc0 0x5654f0026070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b46800640 1 -- 172.21.15.103:0/247336447 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654efece660 con 0x5654f0070ac0 2024-09-10T22:41:53.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b46800640 1 --2- 172.21.15.103:0/247336447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 0x5654f007a310 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5b400a8020 tx=0x7f5b400099a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c9a521d1cb8fcf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b32000640 1 -- 172.21.15.103:0/247336447 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b400b2040 con 0x5654f0070ac0 2024-09-10T22:41:53.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b32000640 1 -- 172.21.15.103:0/247336447 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b40004a50 con 0x5654f0070ac0 2024-09-10T22:41:53.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b32000640 1 -- 172.21.15.103:0/247336447 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b40005020 con 0x5654f0070ac0 2024-09-10T22:41:53.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 -- 172.21.15.103:0/247336447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 msgr2=0x5654f007a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/247336447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 0x5654f007a310 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5b400a8020 tx=0x7f5b400099a0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 -- 172.21.15.103:0/247336447 shutdown_connections 2024-09-10T22:41:53.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/247336447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 0x5654f007a310 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/247336447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f00701a0 0x5654f00265b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/247336447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f0026bc0 0x5654f0026070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 -- 172.21.15.103:0/247336447 >> 172.21.15.103:0/247336447 conn(0x5654f002cd20 msgr2=0x5654f0025960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 -- 172.21.15.103:0/247336447 shutdown_connections 2024-09-10T22:41:53.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 -- 172.21.15.103:0/247336447 wait complete. 2024-09-10T22:41:53.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 -- start start 2024-09-10T22:41:53.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 Processor -- start 2024-09-10T22:41:53.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f0026bc0 0x5654f007cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f00701a0 0x5654f007d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 0x5654f00a2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5654f002fd40 con 0x5654f0070ac0 2024-09-10T22:41:53.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5654f002d100 con 0x5654f00701a0 2024-09-10T22:41:53.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5654efe6bec0 con 0x5654f0026bc0 2024-09-10T22:41:53.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.640+0000 7f5b4fe26000 10 client.0 _ll_register_callbacks cb 0x7f5b40009b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:41:53.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b46800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 0x5654f00a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b45e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f0026bc0 0x5654f007cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b46800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 0x5654f00a2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58956/0 (socket says 172.21.15.103:58956) 2024-09-10T22:41:53.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b46800640 1 -- 172.21.15.103:0/540863173 learned_addr learned my addr 172.21.15.103:0/540863173 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:53.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b45400640 1 --2- 172.21.15.103:0/540863173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f00701a0 0x5654f007d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b46800640 1 -- 172.21.15.103:0/540863173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f0026bc0 msgr2=0x5654f007cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b46800640 1 --2- 172.21.15.103:0/540863173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f0026bc0 0x5654f007cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b46800640 1 -- 172.21.15.103:0/540863173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f00701a0 msgr2=0x5654f007d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:41:53.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b46800640 1 --2- 172.21.15.103:0/540863173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f00701a0 0x5654f007d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b46800640 1 -- 172.21.15.103:0/540863173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654efe3b090 con 0x5654f0070ac0 2024-09-10T22:41:53.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b46800640 1 --2- 172.21.15.103:0/540863173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 0x5654f00a2210 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5b40098810 tx=0x7f5b400bf520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7fd919a90d6e67 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b27400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:41:53.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b27400640 1 -- 172.21.15.103:0/540863173 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b400b2070 con 0x5654f0070ac0 2024-09-10T22:41:53.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b27400640 1 -- 172.21.15.103:0/540863173 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f5b400b0920 con 0x5654f0070ac0 2024-09-10T22:41:53.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 1 -- 172.21.15.103:0/540863173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b40004a50 con 0x5654f0070ac0 2024-09-10T22:41:53.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b27400640 1 -- 172.21.15.103:0/540863173 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f5b400b0b20 con 0x5654f0070ac0 2024-09-10T22:41:53.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 10 client.6051 fetch_fsmap learned FSMap version 45 2024-09-10T22:41:53.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 1 -- 172.21.15.103:0/540863173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) -- 0x5654efe075f0 con 0x5654f0070ac0 2024-09-10T22:41:53.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b27400640 1 -- 172.21.15.103:0/540863173 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b40004a50 con 0x5654f0070ac0 2024-09-10T22:41:53.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b27400640 1 -- 172.21.15.103:0/540863173 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 45) ==== 3558+0+0 (secure 0 0 0) 0x7f5b400c7070 con 0x5654f0070ac0 2024-09-10T22:41:53.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 10 client.6051 fetch_fsmap finished waiting for FSMap version 45 2024-09-10T22:41:53.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 10 client.6051 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T22:41:53.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 20 client.6051 populate_metadata read hostname 'smithi103' 2024-09-10T22:41:53.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/540863173 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5654f00a2b40 0x5654f00e5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 4 client.6051 mds_command: new command op to 5547 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:41:53.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 1 -- 172.21.15.103:0/540863173 --> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5654efe7f590 con 0x5654f00a2b40 2024-09-10T22:41:53.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b45e00640 1 --2- 172.21.15.103:0/540863173 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5654f00a2b40 0x5654f00e5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b45e00640 1 --2- 172.21.15.103:0/540863173 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5654f00a2b40 0x5654f00e5640 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7f30c316b829ade server_cookie=b6e4ed0e037d78d7 in_seq=0 out_seq=0 2024-09-10T22:41:53.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b27400640 10 client.6051 ms_handle_connect on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:53.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b27400640 1 -- 172.21.15.103:0/540863173 <== mds.0 v2:172.21.15.103:6832/343761048 1 ==== command_reply(tid 0: 0 ) ==== 8+0+382 (crc 0 0 0) 0x5654efe7f590 con 0x5654f00a2b40 2024-09-10T22:41:53.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b27400640 10 client.6051 handle_command_reply: tid=0 2024-09-10T22:41:53.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 1 client.6051 shutdown 2024-09-10T22:41:53.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 1 -- 172.21.15.103:0/540863173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 msgr2=0x5654f00a2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/540863173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 0x5654f00a2210 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5b40098810 tx=0x7f5b400bf520 comp rx=0 tx=0).stop 2024-09-10T22:41:53.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 1 -- 172.21.15.103:0/540863173 shutdown_connections 2024-09-10T22:41:53.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/540863173 >> [v2:172.21.15.103:6832/343761048,v1:172.21.15.103:6835/343761048] conn(0x5654f00a2b40 0x5654f00e5640 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/540863173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654f0070ac0 0x5654f00a2210 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/540863173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654f00701a0 0x5654f007d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b27400640 0 client.6051 ms_handle_reset on v2:172.21.15.103:6832/343761048 2024-09-10T22:41:53.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 1 --2- 172.21.15.103:0/540863173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5654f0026bc0 0x5654f007cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 1 -- 172.21.15.103:0/540863173 >> 172.21.15.103:0/540863173 conn(0x5654f002cd20 msgr2=0x5654f0026180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 1 -- 172.21.15.103:0/540863173 shutdown_connections 2024-09-10T22:41:53.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 1 -- 172.21.15.103:0/540863173 wait complete. 2024-09-10T22:41:53.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b4fe26000 20 client.6051 trim_cache size 0 max 16384 2024-09-10T22:41:53.653 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:41:53.653 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "no active scrubs running", 2024-09-10T22:41:53.653 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": {}, 2024-09-10T22:41:53.653 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_stats": { 2024-09-10T22:41:53.653 INFO:teuthology.orchestra.run.smithi103.stdout: "42b5cfe9-6527-4d7a-bba4-3f2b1b35b58a": { 2024-09-10T22:41:53.654 INFO:teuthology.orchestra.run.smithi103.stdout: "start_time": "2024-09-10T22:41:42.384489+0000", 2024-09-10T22:41:53.654 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:41:53.654 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_started": 0, 2024-09-10T22:41:53.654 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_passed": 0, 2024-09-10T22:41:53.654 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_failed": 0, 2024-09-10T22:41:53.654 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_skipped": 0 2024-09-10T22:41:53.654 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:53.654 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:41:53.654 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:41:53.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b47200640 1 -- 172.21.15.103:0/1953499526 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5b280725e0 msgr2=0x7f5b28074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b47200640 1 --2- 172.21.15.103:0/1953499526 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5b280725e0 0x7f5b28074aa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5b480b7740 tx=0x7f5b38009040 comp rx=0 tx=0).stop 2024-09-10T22:41:53.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b47200640 1 -- 172.21.15.103:0/1953499526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b480b0510 msgr2=0x7f5b480c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b47200640 1 --2- 172.21.15.103:0/1953499526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b480b0510 0x7f5b480c7fb0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f5b3400e9f0 tx=0x7f5b3400eeb0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b47200640 1 -- 172.21.15.103:0/1953499526 shutdown_connections 2024-09-10T22:41:53.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b47200640 1 --2- 172.21.15.103:0/1953499526 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5b280725e0 0x7f5b28074aa0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b47200640 1 --2- 172.21.15.103:0/1953499526 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b4815f0e0 0x7f5b4814d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b47200640 1 --2- 172.21.15.103:0/1953499526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b480b0510 0x7f5b480c7fb0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b47200640 1 --2- 172.21.15.103:0/1953499526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b480714d0 0x7f5b480c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.644+0000 7f5b47200640 1 -- 172.21.15.103:0/1953499526 >> 172.21.15.103:0/1953499526 conn(0x7f5b480d18f0 msgr2=0x7f5b480cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.648+0000 7f5b47200640 1 -- 172.21.15.103:0/1953499526 shutdown_connections 2024-09-10T22:41:53.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.648+0000 7f5b47200640 1 -- 172.21.15.103:0/1953499526 wait complete. 2024-09-10T22:41:53.666 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:41:53.666 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:41:53.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.804+0000 7f022c600640 1 -- 172.21.15.103:0/1872850729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02240cc120 msgr2=0x7f02240aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.804+0000 7f022c600640 1 --2- 172.21.15.103:0/1872850729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02240cc120 0x7f02240aeb40 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f0218009900 tx=0x7f021801c850 comp rx=0 tx=0).stop 2024-09-10T22:41:53.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.804+0000 7f022c600640 1 -- 172.21.15.103:0/1872850729 shutdown_connections 2024-09-10T22:41:53.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.804+0000 7f022c600640 1 --2- 172.21.15.103:0/1872850729 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02240cf790 0x7f02240cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.804+0000 7f022c600640 1 --2- 172.21.15.103:0/1872850729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02240cc120 0x7f02240aeb40 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.804+0000 7f022c600640 1 -- 172.21.15.103:0/1872850729 >> 172.21.15.103:0/1872850729 conn(0x7f022406cc00 msgr2=0x7f022406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:53.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.804+0000 7f022c600640 1 -- 172.21.15.103:0/1872850729 shutdown_connections 2024-09-10T22:41:53.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.804+0000 7f022c600640 1 -- 172.21.15.103:0/1872850729 wait complete. 2024-09-10T22:41:53.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f022c600640 1 Processor -- start 2024-09-10T22:41:53.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f022c600640 1 -- start start 2024-09-10T22:41:53.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f022c600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02240cc120 0x7f0224140de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f022c600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02240cf790 0x7f0224159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f022c600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f022415c970 0x7f02241563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f022c600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0224168b90 con 0x7f022415c970 2024-09-10T22:41:53.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f022c600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0224168a10 con 0x7f02240cf790 2024-09-10T22:41:53.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f022c600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0224168d10 con 0x7f02240cc120 2024-09-10T22:41:53.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f022a600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f022415c970 0x7f02241563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f0229c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02240cc120 0x7f0224140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f022a600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f022415c970 0x7f02241563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58976/0 (socket says 172.21.15.103:58976) 2024-09-10T22:41:53.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f022a600640 1 -- 172.21.15.103:0/424319825 learned_addr learned my addr 172.21.15.103:0/424319825 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:53.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f0229200640 1 --2- 172.21.15.103:0/424319825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02240cf790 0x7f0224159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f0229c00640 1 -- 172.21.15.103:0/424319825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02240cf790 msgr2=0x7f0224159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f0229c00640 1 --2- 172.21.15.103:0/424319825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02240cf790 0x7f0224159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f0229c00640 1 -- 172.21.15.103:0/424319825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f022415c970 msgr2=0x7f02241563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:53.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f0229c00640 1 --2- 172.21.15.103:0/424319825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f022415c970 0x7f02241563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:53.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f0229c00640 1 -- 172.21.15.103:0/424319825 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02241568e0 con 0x7f02240cc120 2024-09-10T22:41:53.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f0229c00640 1 --2- 172.21.15.103:0/424319825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02240cc120 0x7f0224140de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f02240707f0 tx=0x7f02180a5710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f0221600640 1 -- 172.21.15.103:0/424319825 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02180ba020 con 0x7f02240cc120 2024-09-10T22:41:53.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f0221600640 1 -- 172.21.15.103:0/424319825 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0218004450 con 0x7f02240cc120 2024-09-10T22:41:53.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f0221600640 1 -- 172.21.15.103:0/424319825 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02180b2040 con 0x7f02240cc120 2024-09-10T22:41:53.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f022c600640 1 -- 172.21.15.103:0/424319825 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f022415a470 con 0x7f02240cc120 2024-09-10T22:41:53.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.808+0000 7f022c600640 1 -- 172.21.15.103:0/424319825 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f022415aa30 con 0x7f02240cc120 2024-09-10T22:41:53.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.812+0000 7f022c600640 1 -- 172.21.15.103:0/424319825 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02240cfc20 con 0x7f02240cc120 2024-09-10T22:41:53.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.812+0000 7f0221600640 1 -- 172.21.15.103:0/424319825 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0218005290 con 0x7f02240cc120 2024-09-10T22:41:53.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.812+0000 7f0221600640 1 --2- 172.21.15.103:0/424319825 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f02040725e0 0x7f0204074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:53.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.812+0000 7f0221600640 1 -- 172.21.15.103:0/424319825 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f021812d3a0 con 0x7f02240cc120 2024-09-10T22:41:53.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.812+0000 7f0229200640 1 --2- 172.21.15.103:0/424319825 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f02040725e0 0x7f0204074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:53.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.816+0000 7f0229200640 1 --2- 172.21.15.103:0/424319825 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f02040725e0 0x7f0204074aa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0210007fd0 tx=0x7f0210009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:53.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:53.816+0000 7f0221600640 1 -- 172.21.15.103:0/424319825 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f02180c4060 con 0x7f02240cc120 2024-09-10T22:41:54.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.016+0000 7f022c600640 1 -- 172.21.15.103:0/424319825 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f022406cfe0 con 0x7f02240cc120 2024-09-10T22:41:54.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.016+0000 7f0221600640 1 -- 172.21.15.103:0/424319825 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5279 (secure 0 0 0) 0x7f02180164d0 con 0x7f02240cc120 2024-09-10T22:41:54.019 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:54.019 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":45,"btime":"2024-09-10T22:41:45:168066+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/1187797704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1187797704},{"type":"v1","addr":"172.21.15.131:6836","nonce":1187797704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:41:06.381695+0000","modified":"2024-09-10T22:41:45.105121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5547,"mds_1":5544,"mds_2":5153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5153":{"gid":5153,"name":"d","rank":2,"incarnation":39,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6837/3348473142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3348473142},{"type":"v1","addr":"172.21.15.131:6837","nonce":3348473142}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5544":{"gid":5544,"name":"c","rank":1,"incarnation":37,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3910783847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":3910783847},{"type":"v1","addr":"172.21.15.103:6834","nonce":3910783847}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5547":{"gid":5547,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/343761048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":343761048},{"type":"v1","addr":"172.21.15.103:6835","nonce":343761048}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5547,"qdb_cluster":[5547,5544,5153]},"id":3}]} 2024-09-10T22:41:54.020 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 45 2024-09-10T22:41:54.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.020+0000 7f022c600640 1 -- 172.21.15.103:0/424319825 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f02040725e0 msgr2=0x7f0204074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:54.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.020+0000 7f022c600640 1 --2- 172.21.15.103:0/424319825 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f02040725e0 0x7f0204074aa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0210007fd0 tx=0x7f0210009040 comp rx=0 tx=0).stop 2024-09-10T22:41:54.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.020+0000 7f022c600640 1 -- 172.21.15.103:0/424319825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02240cc120 msgr2=0x7f0224140de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:54.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.020+0000 7f022c600640 1 --2- 172.21.15.103:0/424319825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02240cc120 0x7f0224140de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f02240707f0 tx=0x7f02180a5710 comp rx=0 tx=0).stop 2024-09-10T22:41:54.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.020+0000 7f022c600640 1 -- 172.21.15.103:0/424319825 shutdown_connections 2024-09-10T22:41:54.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.020+0000 7f022c600640 1 --2- 172.21.15.103:0/424319825 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f02040725e0 0x7f0204074aa0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:54.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.020+0000 7f022c600640 1 --2- 172.21.15.103:0/424319825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f022415c970 0x7f02241563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:54.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.020+0000 7f022c600640 1 --2- 172.21.15.103:0/424319825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02240cf790 0x7f0224159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:54.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.020+0000 7f022c600640 1 --2- 172.21.15.103:0/424319825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02240cc120 0x7f0224140de0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:54.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.020+0000 7f022c600640 1 -- 172.21.15.103:0/424319825 >> 172.21.15.103:0/424319825 conn(0x7f022406cc00 msgr2=0x7f022415c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:54.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.020+0000 7f022c600640 1 -- 172.21.15.103:0/424319825 shutdown_connections 2024-09-10T22:41:54.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.020+0000 7f022c600640 1 -- 172.21.15.103:0/424319825 wait complete. 2024-09-10T22:41:54.041 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-10T22:41:54.041 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:41:54.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.180+0000 7fe453e00640 1 -- 172.21.15.103:0/2726149334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4540cc850 msgr2=0x7fe45406fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:54.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.180+0000 7fe453e00640 1 --2- 172.21.15.103:0/2726149334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4540cc850 0x7fe45406fb30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009840 tx=0x7fe43c01c710 comp rx=0 tx=0).stop 2024-09-10T22:41:54.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.180+0000 7fe453e00640 1 -- 172.21.15.103:0/2726149334 shutdown_connections 2024-09-10T22:41:54.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.180+0000 7fe453e00640 1 --2- 172.21.15.103:0/2726149334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe454070070 0x7fe4540ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:54.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.180+0000 7fe453e00640 1 --2- 172.21.15.103:0/2726149334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4540cc850 0x7fe45406fb30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:54.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.180+0000 7fe453e00640 1 -- 172.21.15.103:0/2726149334 >> 172.21.15.103:0/2726149334 conn(0x7fe45406d580 msgr2=0x7fe4540b1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:54.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.180+0000 7fe453e00640 1 -- 172.21.15.103:0/2726149334 shutdown_connections 2024-09-10T22:41:54.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.180+0000 7fe453e00640 1 -- 172.21.15.103:0/2726149334 wait complete. 2024-09-10T22:41:54.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.180+0000 7fe453e00640 1 Processor -- start 2024-09-10T22:41:54.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.180+0000 7fe453e00640 1 -- start start 2024-09-10T22:41:54.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe453e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe454070070 0x7fe4541506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:54.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe453e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4540cc850 0x7fe45414bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:54.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe453e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4541529e0 0x7fe45414ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:54.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe453e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe4541686b0 con 0x7fe4540cc850 2024-09-10T22:41:54.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe453e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe454168530 con 0x7fe454070070 2024-09-10T22:41:54.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe453e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe454168830 con 0x7fe4541529e0 2024-09-10T22:41:54.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe44a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4540cc850 0x7fe45414bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:54.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe44a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4540cc850 0x7fe45414bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58988/0 (socket says 172.21.15.103:58988) 2024-09-10T22:41:54.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe44a000640 1 -- 172.21.15.103:0/1196549354 learned_addr learned my addr 172.21.15.103:0/1196549354 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:54.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe452a00640 1 --2- 172.21.15.103:0/1196549354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe454070070 0x7fe4541506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:54.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe453400640 1 --2- 172.21.15.103:0/1196549354 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4541529e0 0x7fe45414ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe44a000640 1 -- 172.21.15.103:0/1196549354 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4541529e0 msgr2=0x7fe45414ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe44a000640 1 --2- 172.21.15.103:0/1196549354 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4541529e0 0x7fe45414ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe44a000640 1 -- 172.21.15.103:0/1196549354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe454070070 msgr2=0x7fe4541506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe44a000640 1 --2- 172.21.15.103:0/1196549354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe454070070 0x7fe4541506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe44a000640 1 -- 172.21.15.103:0/1196549354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4541f6fd0 con 0x7fe4540cc850 2024-09-10T22:41:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe452a00640 1 --2- 172.21.15.103:0/1196549354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe454070070 0x7fe4541506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:41:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe44a000640 1 --2- 172.21.15.103:0/1196549354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4540cc850 0x7fe45414bb90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe43c01cbf0 tx=0x7fe43c004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe44b400640 1 -- 172.21.15.103:0/1196549354 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c0ba020 con 0x7fe4540cc850 2024-09-10T22:41:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe44b400640 1 -- 172.21.15.103:0/1196549354 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe43c005310 con 0x7fe4540cc850 2024-09-10T22:41:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe453e00640 1 -- 172.21.15.103:0/1196549354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe45414c0d0 con 0x7fe4540cc850 2024-09-10T22:41:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe44b400640 1 -- 172.21.15.103:0/1196549354 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c0b2040 con 0x7fe4540cc850 2024-09-10T22:41:54.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe453e00640 1 -- 172.21.15.103:0/1196549354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4541f7580 con 0x7fe4540cc850 2024-09-10T22:41:54.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe453e00640 1 -- 172.21.15.103:0/1196549354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe454151fb0 con 0x7fe4540cc850 2024-09-10T22:41:54.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.184+0000 7fe44b400640 1 -- 172.21.15.103:0/1196549354 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe43c0b5070 con 0x7fe4540cc850 2024-09-10T22:41:54.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.188+0000 7fe44b400640 1 --2- 172.21.15.103:0/1196549354 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4300725e0 0x7fe430074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:54.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.188+0000 7fe44b400640 1 -- 172.21.15.103:0/1196549354 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fe43c12c830 con 0x7fe4540cc850 2024-09-10T22:41:54.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.188+0000 7fe452a00640 1 --2- 172.21.15.103:0/1196549354 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4300725e0 0x7fe430074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:54.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.188+0000 7fe452a00640 1 --2- 172.21.15.103:0/1196549354 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4300725e0 0x7fe430074aa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe444001790 tx=0x7fe444009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:54.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.192+0000 7fe44b400640 1 -- 172.21.15.103:0/1196549354 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe43c016330 con 0x7fe4540cc850 2024-09-10T22:41:54.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.416+0000 7fe453e00640 1 -- 172.21.15.103:0/1196549354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe454151cd0 con 0x7fe4540cc850 2024-09-10T22:41:54.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.416+0000 7fe44b400640 1 -- 172.21.15.103:0/1196549354 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2026 (secure 0 0 0) 0x7fe43c0f7d40 con 0x7fe4540cc850 2024-09-10T22:41:54.419 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:54.419 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":210,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":57,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700795,"bytes_used":232570880,"bytes_avail":772861542400,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":5715,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":45,"btime":"2024-09-10T22:41:45:168066+0000","id":3,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":3,"rank":2,"name":"d","status":"up:active","gid":5153},{"filesystem_id":3,"rank":1,"name":"c","status":"up:active","gid":5544},{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5547}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-09-10T22:41:49.663381+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-10T22:41:54.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.420+0000 7fe453e00640 1 -- 172.21.15.103:0/1196549354 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4300725e0 msgr2=0x7fe430074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:54.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.420+0000 7fe453e00640 1 --2- 172.21.15.103:0/1196549354 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4300725e0 0x7fe430074aa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe444001790 tx=0x7fe444009040 comp rx=0 tx=0).stop 2024-09-10T22:41:54.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.420+0000 7fe453e00640 1 -- 172.21.15.103:0/1196549354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4540cc850 msgr2=0x7fe45414bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:54.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.420+0000 7fe453e00640 1 --2- 172.21.15.103:0/1196549354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4540cc850 0x7fe45414bb90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe43c01cbf0 tx=0x7fe43c004620 comp rx=0 tx=0).stop 2024-09-10T22:41:54.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.420+0000 7fe453e00640 1 -- 172.21.15.103:0/1196549354 shutdown_connections 2024-09-10T22:41:54.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.420+0000 7fe453e00640 1 --2- 172.21.15.103:0/1196549354 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4300725e0 0x7fe430074aa0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:54.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.420+0000 7fe453e00640 1 --2- 172.21.15.103:0/1196549354 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4541529e0 0x7fe45414ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:54.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.420+0000 7fe453e00640 1 --2- 172.21.15.103:0/1196549354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4540cc850 0x7fe45414bb90 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:54.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.420+0000 7fe453e00640 1 --2- 172.21.15.103:0/1196549354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe454070070 0x7fe4541506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:54.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.420+0000 7fe453e00640 1 -- 172.21.15.103:0/1196549354 >> 172.21.15.103:0/1196549354 conn(0x7fe45406d580 msgr2=0x7fe45415e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:54.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.420+0000 7fe453e00640 1 -- 172.21.15.103:0/1196549354 shutdown_connections 2024-09-10T22:41:54.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:54.420+0000 7fe453e00640 1 -- 172.21.15.103:0/1196549354 wait complete. 2024-09-10T22:41:54.440 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]', 'd': 'idle+waiting paths [/d1/d2/d3]'} 2024-09-10T22:41:55.442 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:41:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.592+0000 7f2053e00640 1 -- 172.21.15.103:0/2925713193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2038004810 msgr2=0x7f2038004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.592+0000 7f2053e00640 1 --2- 172.21.15.103:0/2925713193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2038004810 0x7f2038004c90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f203c009b30 tx=0x7f203c01d250 comp rx=0 tx=0).stop 2024-09-10T22:41:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.592+0000 7f2053400640 1 -- 172.21.15.103:0/2925713193 reap_dead start 2024-09-10T22:41:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.592+0000 7f2053e00640 1 -- 172.21.15.103:0/2925713193 shutdown_connections 2024-09-10T22:41:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.592+0000 7f2053e00640 1 -- 172.21.15.103:0/2925713193 >> 172.21.15.103:0/2925713193 conn(0x7f20540d0780 msgr2=0x7f20540d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.592+0000 7f2053e00640 1 -- 172.21.15.103:0/2925713193 shutdown_connections 2024-09-10T22:41:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.592+0000 7f2053e00640 1 -- 172.21.15.103:0/2925713193 wait complete. 2024-09-10T22:41:55.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f2053e00640 1 Processor -- start 2024-09-10T22:41:55.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f2053e00640 1 -- start start 2024-09-10T22:41:55.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f2053e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2038004810 0x7f205414e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:55.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f2053e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2054167790 0x7f2054150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:55.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f2053e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20540b1500 0x7f20540b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f2053e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f205415b570 con 0x7f2054167790 2024-09-10T22:41:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f2053e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f205415b3f0 con 0x7f20540b1500 2024-09-10T22:41:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f2053e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f205415b6f0 con 0x7f2038004810 2024-09-10T22:41:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f204be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2054167790 0x7f2054150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f204be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2054167790 0x7f2054150d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59012/0 (socket says 172.21.15.103:59012) 2024-09-10T22:41:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f204be00640 1 -- 172.21.15.103:0/2724190221 learned_addr learned my addr 172.21.15.103:0/2724190221 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f2053400640 1 --2- 172.21.15.103:0/2724190221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20540b1500 0x7f20540b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f2052a00640 1 --2- 172.21.15.103:0/2724190221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2038004810 0x7f205414e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f204be00640 1 -- 172.21.15.103:0/2724190221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2038004810 msgr2=0x7f205414e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f204be00640 1 --2- 172.21.15.103:0/2724190221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2038004810 0x7f205414e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f204be00640 1 -- 172.21.15.103:0/2724190221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20540b1500 msgr2=0x7f20540b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f204be00640 1 --2- 172.21.15.103:0/2724190221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20540b1500 0x7f20540b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:55.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f204be00640 1 -- 172.21.15.103:0/2724190221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2054152760 con 0x7f2054167790 2024-09-10T22:41:55.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f204be00640 1 --2- 172.21.15.103:0/2724190221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2054167790 0x7f2054150d70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f203c01d080 tx=0x7f203c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:55.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f204b400640 1 -- 172.21.15.103:0/2724190221 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c0ba020 con 0x7f2054167790 2024-09-10T22:41:55.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f204b400640 1 -- 172.21.15.103:0/2724190221 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f203c0ac8a0 con 0x7f2054167790 2024-09-10T22:41:55.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f2053e00640 1 -- 172.21.15.103:0/2724190221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20541516c0 con 0x7f2054167790 2024-09-10T22:41:55.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f204b400640 1 -- 172.21.15.103:0/2724190221 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c0b1040 con 0x7f2054167790 2024-09-10T22:41:55.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.596+0000 7f2053e00640 1 -- 172.21.15.103:0/2724190221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2054151c80 con 0x7f2054167790 2024-09-10T22:41:55.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.600+0000 7f2053e00640 1 -- 172.21.15.103:0/2724190221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2054073b60 con 0x7f2054167790 2024-09-10T22:41:55.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.600+0000 7f204b400640 1 -- 172.21.15.103:0/2724190221 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f203c0accd0 con 0x7f2054167790 2024-09-10T22:41:55.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.600+0000 7f204b400640 1 --2- 172.21.15.103:0/2724190221 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20300725e0 0x7f2030074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:55.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.600+0000 7f204b400640 1 -- 172.21.15.103:0/2724190221 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f203c12e550 con 0x7f2054167790 2024-09-10T22:41:55.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.600+0000 7f2052a00640 1 --2- 172.21.15.103:0/2724190221 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20300725e0 0x7f2030074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:55.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.600+0000 7f2052a00640 1 --2- 172.21.15.103:0/2724190221 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20300725e0 0x7f2030074aa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2054152b90 tx=0x7f20440091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:55.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.604+0000 7f204b400640 1 -- 172.21.15.103:0/2724190221 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f203c0c4030 con 0x7f2054167790 2024-09-10T22:41:55.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.804+0000 7f2053e00640 1 -- 172.21.15.103:0/2724190221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20540cf8b0 con 0x7f2054167790 2024-09-10T22:41:55.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.804+0000 7f204b400640 1 -- 172.21.15.103:0/2724190221 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5279 (secure 0 0 0) 0x7f203c016f60 con 0x7f2054167790 2024-09-10T22:41:55.807 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:55.807 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":45,"btime":"2024-09-10T22:41:45:168066+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/1187797704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1187797704},{"type":"v1","addr":"172.21.15.131:6836","nonce":1187797704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:41:06.381695+0000","modified":"2024-09-10T22:41:45.105121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5547,"mds_1":5544,"mds_2":5153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5153":{"gid":5153,"name":"d","rank":2,"incarnation":39,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6837/3348473142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3348473142},{"type":"v1","addr":"172.21.15.131:6837","nonce":3348473142}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5544":{"gid":5544,"name":"c","rank":1,"incarnation":37,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3910783847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":3910783847},{"type":"v1","addr":"172.21.15.103:6834","nonce":3910783847}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5547":{"gid":5547,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/343761048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":343761048},{"type":"v1","addr":"172.21.15.103:6835","nonce":343761048}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5547,"qdb_cluster":[5547,5544,5153]},"id":3}]} 2024-09-10T22:41:55.807 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 45 2024-09-10T22:41:55.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.808+0000 7f2053e00640 1 -- 172.21.15.103:0/2724190221 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20300725e0 msgr2=0x7f2030074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:55.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.808+0000 7f2053e00640 1 --2- 172.21.15.103:0/2724190221 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20300725e0 0x7f2030074aa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2054152b90 tx=0x7f20440091e0 comp rx=0 tx=0).stop 2024-09-10T22:41:55.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.808+0000 7f2053e00640 1 -- 172.21.15.103:0/2724190221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2054167790 msgr2=0x7f2054150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:55.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.808+0000 7f2053e00640 1 --2- 172.21.15.103:0/2724190221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2054167790 0x7f2054150d70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f203c01d080 tx=0x7f203c005640 comp rx=0 tx=0).stop 2024-09-10T22:41:55.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.808+0000 7f2053e00640 1 -- 172.21.15.103:0/2724190221 shutdown_connections 2024-09-10T22:41:55.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.808+0000 7f2053e00640 1 --2- 172.21.15.103:0/2724190221 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20300725e0 0x7f2030074aa0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:55.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.808+0000 7f2053e00640 1 --2- 172.21.15.103:0/2724190221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20540b1500 0x7f20540b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:55.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.808+0000 7f2053e00640 1 --2- 172.21.15.103:0/2724190221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2054167790 0x7f2054150d70 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:55.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.808+0000 7f2053e00640 1 --2- 172.21.15.103:0/2724190221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2038004810 0x7f205414e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:55.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.808+0000 7f2053e00640 1 -- 172.21.15.103:0/2724190221 >> 172.21.15.103:0/2724190221 conn(0x7f20540d0780 msgr2=0x7f2054153bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:55.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.808+0000 7f2053e00640 1 -- 172.21.15.103:0/2724190221 shutdown_connections 2024-09-10T22:41:55.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.808+0000 7f2053e00640 1 -- 172.21.15.103:0/2724190221 wait complete. 2024-09-10T22:41:55.828 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-10T22:41:55.828 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:41:55.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.964+0000 7f989b200640 1 -- 172.21.15.103:0/1749841038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98940717a0 msgr2=0x7f9894070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:55.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.964+0000 7f989b200640 1 --2- 172.21.15.103:0/1749841038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98940717a0 0x7f9894070700 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9894073690 tx=0x7f988c01cc30 comp rx=0 tx=0).stop 2024-09-10T22:41:55.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.964+0000 7f989b200640 1 -- 172.21.15.103:0/1749841038 shutdown_connections 2024-09-10T22:41:55.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.964+0000 7f989b200640 1 --2- 172.21.15.103:0/1749841038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98940717a0 0x7f9894070700 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:55.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.964+0000 7f989b200640 1 --2- 172.21.15.103:0/1749841038 >> v2:172.21.15.131:3300/0 conn(0x7f98940d25f0 0x7f989415f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:55.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.964+0000 7f989b200640 1 --2- 172.21.15.103:0/1749841038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98940cfda0 0x7f989415eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:55.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.964+0000 7f989b200640 1 -- 172.21.15.103:0/1749841038 >> 172.21.15.103:0/1749841038 conn(0x7f98940d1ad0 msgr2=0x7f98940d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:55.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.964+0000 7f989b200640 1 -- 172.21.15.103:0/1749841038 shutdown_connections 2024-09-10T22:41:55.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.964+0000 7f989b200640 1 -- 172.21.15.103:0/1749841038 wait complete. 2024-09-10T22:41:55.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f989b200640 1 Processor -- start 2024-09-10T22:41:55.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f989b200640 1 -- start start 2024-09-10T22:41:55.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f989b200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98940717a0 0x7f9894151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:55.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f989b200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98940cfda0 0x7f9894151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:55.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f989b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98940d25f0 0x7f98940c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:55.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f989b200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f98940aff40 con 0x7f98940d25f0 2024-09-10T22:41:55.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f989b200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f98940afdc0 con 0x7f98940717a0 2024-09-10T22:41:55.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f989b200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f98940b00c0 con 0x7f98940cfda0 2024-09-10T22:41:55.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f9899200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98940d25f0 0x7f98940c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f9893e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98940717a0 0x7f9894151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f9899200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98940d25f0 0x7f98940c78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59022/0 (socket says 172.21.15.103:59022) 2024-09-10T22:41:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f9899200640 1 -- 172.21.15.103:0/573295029 learned_addr learned my addr 172.21.15.103:0/573295029 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f988b400640 1 --2- 172.21.15.103:0/573295029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98940cfda0 0x7f9894151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f9899200640 1 -- 172.21.15.103:0/573295029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98940cfda0 msgr2=0x7f9894151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f9899200640 1 --2- 172.21.15.103:0/573295029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98940cfda0 0x7f9894151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f9899200640 1 -- 172.21.15.103:0/573295029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98940717a0 msgr2=0x7f9894151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f9899200640 1 --2- 172.21.15.103:0/573295029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98940717a0 0x7f9894151530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f9899200640 1 -- 172.21.15.103:0/573295029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9894151a70 con 0x7f98940d25f0 2024-09-10T22:41:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f988b400640 1 --2- 172.21.15.103:0/573295029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98940cfda0 0x7f9894151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f9899200640 1 --2- 172.21.15.103:0/573295029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98940d25f0 0x7f98940c78c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f988c01b2e0 tx=0x7f988c0a5c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f9890c00640 1 -- 172.21.15.103:0/573295029 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c0bb070 con 0x7f98940d25f0 2024-09-10T22:41:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f9890c00640 1 -- 172.21.15.103:0/573295029 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f988c004d40 con 0x7f98940d25f0 2024-09-10T22:41:55.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f989b200640 1 -- 172.21.15.103:0/573295029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9894151c60 con 0x7f98940d25f0 2024-09-10T22:41:55.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f9890c00640 1 -- 172.21.15.103:0/573295029 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c0b2040 con 0x7f98940d25f0 2024-09-10T22:41:55.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.968+0000 7f989b200640 1 -- 172.21.15.103:0/573295029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98940cab50 con 0x7f98940d25f0 2024-09-10T22:41:55.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.972+0000 7f989b200640 1 -- 172.21.15.103:0/573295029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9894070700 con 0x7f98940d25f0 2024-09-10T22:41:55.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.972+0000 7f9890c00640 1 -- 172.21.15.103:0/573295029 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f988c0b5030 con 0x7f98940d25f0 2024-09-10T22:41:55.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.972+0000 7f9890c00640 1 --2- 172.21.15.103:0/573295029 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f98700725e0 0x7f9870074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:55.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.972+0000 7f9890c00640 1 -- 172.21.15.103:0/573295029 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f988c12d170 con 0x7f98940d25f0 2024-09-10T22:41:55.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.972+0000 7f9893e00640 1 --2- 172.21.15.103:0/573295029 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f98700725e0 0x7f9870074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:55.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.972+0000 7f9893e00640 1 --2- 172.21.15.103:0/573295029 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f98700725e0 0x7f9870074aa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f98940cf440 tx=0x7f9884009110 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:55.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:55.976+0000 7f9890c00640 1 -- 172.21.15.103:0/573295029 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f988c016970 con 0x7f98940d25f0 2024-09-10T22:41:56.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:56.200+0000 7f989b200640 1 -- 172.21.15.103:0/573295029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f9894152480 con 0x7f98940d25f0 2024-09-10T22:41:56.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:56.200+0000 7f9890c00640 1 -- 172.21.15.103:0/573295029 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2026 (secure 0 0 0) 0x7f988c0f7fa0 con 0x7f98940d25f0 2024-09-10T22:41:56.204 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:56.204 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":211,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":57,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700795,"bytes_used":232570880,"bytes_avail":772861542400,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":5715,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":45,"btime":"2024-09-10T22:41:45:168066+0000","id":3,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":3,"rank":2,"name":"d","status":"up:active","gid":5153},{"filesystem_id":3,"rank":1,"name":"c","status":"up:active","gid":5544},{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5547}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-09-10T22:41:49.663381+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-10T22:41:56.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:56.204+0000 7f989b200640 1 -- 172.21.15.103:0/573295029 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f98700725e0 msgr2=0x7f9870074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:56.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:56.204+0000 7f989b200640 1 --2- 172.21.15.103:0/573295029 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f98700725e0 0x7f9870074aa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f98940cf440 tx=0x7f9884009110 comp rx=0 tx=0).stop 2024-09-10T22:41:56.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:56.204+0000 7f989b200640 1 -- 172.21.15.103:0/573295029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98940d25f0 msgr2=0x7f98940c78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:56.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:56.204+0000 7f989b200640 1 --2- 172.21.15.103:0/573295029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98940d25f0 0x7f98940c78c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f988c01b2e0 tx=0x7f988c0a5c20 comp rx=0 tx=0).stop 2024-09-10T22:41:56.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:56.204+0000 7f989b200640 1 -- 172.21.15.103:0/573295029 shutdown_connections 2024-09-10T22:41:56.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:56.204+0000 7f989b200640 1 --2- 172.21.15.103:0/573295029 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f98700725e0 0x7f9870074aa0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:56.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:56.204+0000 7f989b200640 1 --2- 172.21.15.103:0/573295029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98940d25f0 0x7f98940c78c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:56.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:56.204+0000 7f989b200640 1 --2- 172.21.15.103:0/573295029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98940cfda0 0x7f9894151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:56.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:56.204+0000 7f989b200640 1 --2- 172.21.15.103:0/573295029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98940717a0 0x7f9894151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:56.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:56.204+0000 7f989b200640 1 -- 172.21.15.103:0/573295029 >> 172.21.15.103:0/573295029 conn(0x7f98940d1ad0 msgr2=0x7f989415ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:56.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:56.204+0000 7f989b200640 1 -- 172.21.15.103:0/573295029 shutdown_connections 2024-09-10T22:41:56.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:56.204+0000 7f989b200640 1 -- 172.21.15.103:0/573295029 wait complete. 2024-09-10T22:41:56.226 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]', 'd': 'idle+waiting paths [/d1/d2/d3]'} 2024-09-10T22:41:57.228 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:41:57.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.376+0000 7fd96fa00640 1 -- 172.21.15.103:0/3634560748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9680cc120 msgr2=0x7fd9680aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:57.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.376+0000 7fd96fa00640 1 --2- 172.21.15.103:0/3634560748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9680cc120 0x7fd9680aeb40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd9680b4ee0 tx=0x7fd95801c810 comp rx=0 tx=0).stop 2024-09-10T22:41:57.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.376+0000 7fd96fa00640 1 -- 172.21.15.103:0/3634560748 shutdown_connections 2024-09-10T22:41:57.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.376+0000 7fd96fa00640 1 --2- 172.21.15.103:0/3634560748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9680cf790 0x7fd9680cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.376+0000 7fd96fa00640 1 --2- 172.21.15.103:0/3634560748 >> v2:172.21.15.131:3300/0 conn(0x7fd96815c970 0x7fd968072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.376+0000 7fd96fa00640 1 --2- 172.21.15.103:0/3634560748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9680cc120 0x7fd9680aeb40 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.376+0000 7fd96fa00640 1 -- 172.21.15.103:0/3634560748 >> 172.21.15.103:0/3634560748 conn(0x7fd96806cc00 msgr2=0x7fd96806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:57.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.376+0000 7fd96fa00640 1 -- 172.21.15.103:0/3634560748 shutdown_connections 2024-09-10T22:41:57.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.376+0000 7fd96fa00640 1 -- 172.21.15.103:0/3634560748 wait complete. 2024-09-10T22:41:57.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96fa00640 1 Processor -- start 2024-09-10T22:41:57.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96fa00640 1 -- start start 2024-09-10T22:41:57.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96fa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9680cc120 0x7fd9680b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:57.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96fa00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9680cf790 0x7fd968148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:57.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96fa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd96815c970 0x7fd96806f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:57.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96fa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd96815f8a0 con 0x7fd9680cc120 2024-09-10T22:41:57.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96fa00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd96815f720 con 0x7fd96815c970 2024-09-10T22:41:57.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96fa00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd96815fa20 con 0x7fd9680cf790 2024-09-10T22:41:57.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9680cc120 0x7fd9680b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:57.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9680cc120 0x7fd9680b01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35410/0 (socket says 172.21.15.103:35410) 2024-09-10T22:41:57.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96d000640 1 -- 172.21.15.103:0/2163674992 learned_addr learned my addr 172.21.15.103:0/2163674992 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:57.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96d000640 1 -- 172.21.15.103:0/2163674992 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9680cf790 msgr2=0x7fd968148310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:57.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96d000640 1 --2- 172.21.15.103:0/2163674992 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9680cf790 0x7fd968148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96d000640 1 -- 172.21.15.103:0/2163674992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd96815c970 msgr2=0x7fd96806f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:57.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96d000640 1 --2- 172.21.15.103:0/2163674992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd96815c970 0x7fd96806f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96d000640 1 -- 172.21.15.103:0/2163674992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd96806fd70 con 0x7fd9680cc120 2024-09-10T22:41:57.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96d000640 1 --2- 172.21.15.103:0/2163674992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9680cc120 0x7fd9680b01d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd9580b0040 tx=0x7fd9580a5620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:57.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd965600640 1 -- 172.21.15.103:0/2163674992 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9580b2040 con 0x7fd9680cc120 2024-09-10T22:41:57.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd965600640 1 -- 172.21.15.103:0/2163674992 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9580043b0 con 0x7fd9680cc120 2024-09-10T22:41:57.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd965600640 1 -- 172.21.15.103:0/2163674992 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958003860 con 0x7fd9680cc120 2024-09-10T22:41:57.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96fa00640 1 -- 172.21.15.103:0/2163674992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9680af410 con 0x7fd9680cc120 2024-09-10T22:41:57.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.380+0000 7fd96fa00640 1 -- 172.21.15.103:0/2163674992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9680af9d0 con 0x7fd9680cc120 2024-09-10T22:41:57.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.384+0000 7fd96fa00640 1 -- 172.21.15.103:0/2163674992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9680cfc20 con 0x7fd9680cc120 2024-09-10T22:41:57.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.384+0000 7fd965600640 1 -- 172.21.15.103:0/2163674992 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd9580c0060 con 0x7fd9680cc120 2024-09-10T22:41:57.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.384+0000 7fd965600640 1 --2- 172.21.15.103:0/2163674992 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd9440725e0 0x7fd944074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:57.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.384+0000 7fd965600640 1 -- 172.21.15.103:0/2163674992 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fd95812cb90 con 0x7fd9680cc120 2024-09-10T22:41:57.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.384+0000 7fd95fe00640 1 --2- 172.21.15.103:0/2163674992 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd9440725e0 0x7fd944074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:57.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.388+0000 7fd95fe00640 1 --2- 172.21.15.103:0/2163674992 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd9440725e0 0x7fd944074aa0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd96815b6b0 tx=0x7fd950005be0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:57.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.388+0000 7fd965600640 1 -- 172.21.15.103:0/2163674992 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd958016490 con 0x7fd9680cc120 2024-09-10T22:41:57.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.592+0000 7fd96fa00640 1 -- 172.21.15.103:0/2163674992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9680ce870 con 0x7fd9680cc120 2024-09-10T22:41:57.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.592+0000 7fd965600640 1 -- 172.21.15.103:0/2163674992 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5279 (secure 0 0 0) 0x7fd9580f8020 con 0x7fd9680cc120 2024-09-10T22:41:57.594 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:57.594 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":45,"btime":"2024-09-10T22:41:45:168066+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/1187797704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1187797704},{"type":"v1","addr":"172.21.15.131:6836","nonce":1187797704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:41:06.381695+0000","modified":"2024-09-10T22:41:45.105121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5547,"mds_1":5544,"mds_2":5153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5153":{"gid":5153,"name":"d","rank":2,"incarnation":39,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6837/3348473142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3348473142},{"type":"v1","addr":"172.21.15.131:6837","nonce":3348473142}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5544":{"gid":5544,"name":"c","rank":1,"incarnation":37,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3910783847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":3910783847},{"type":"v1","addr":"172.21.15.103:6834","nonce":3910783847}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5547":{"gid":5547,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/343761048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":343761048},{"type":"v1","addr":"172.21.15.103:6835","nonce":343761048}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5547,"qdb_cluster":[5547,5544,5153]},"id":3}]} 2024-09-10T22:41:57.594 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 45 2024-09-10T22:41:57.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.592+0000 7fd96fa00640 1 -- 172.21.15.103:0/2163674992 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd9440725e0 msgr2=0x7fd944074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:57.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.592+0000 7fd96fa00640 1 --2- 172.21.15.103:0/2163674992 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd9440725e0 0x7fd944074aa0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd96815b6b0 tx=0x7fd950005be0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.592+0000 7fd96fa00640 1 -- 172.21.15.103:0/2163674992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9680cc120 msgr2=0x7fd9680b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:57.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.592+0000 7fd96fa00640 1 --2- 172.21.15.103:0/2163674992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9680cc120 0x7fd9680b01d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd9580b0040 tx=0x7fd9580a5620 comp rx=0 tx=0).stop 2024-09-10T22:41:57.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.592+0000 7fd96fa00640 1 -- 172.21.15.103:0/2163674992 shutdown_connections 2024-09-10T22:41:57.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.592+0000 7fd96fa00640 1 --2- 172.21.15.103:0/2163674992 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd9440725e0 0x7fd944074aa0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.592+0000 7fd96fa00640 1 --2- 172.21.15.103:0/2163674992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd96815c970 0x7fd96806f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.592+0000 7fd96fa00640 1 --2- 172.21.15.103:0/2163674992 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9680cf790 0x7fd968148310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.592+0000 7fd96fa00640 1 --2- 172.21.15.103:0/2163674992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9680cc120 0x7fd9680b01d0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.592+0000 7fd96fa00640 1 -- 172.21.15.103:0/2163674992 >> 172.21.15.103:0/2163674992 conn(0x7fd96806cc00 msgr2=0x7fd968158920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:57.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.592+0000 7fd96fa00640 1 -- 172.21.15.103:0/2163674992 shutdown_connections 2024-09-10T22:41:57.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.592+0000 7fd96fa00640 1 -- 172.21.15.103:0/2163674992 wait complete. 2024-09-10T22:41:57.615 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-10T22:41:57.615 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:41:57.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40cc800640 1 -- 172.21.15.103:0/2149067855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40c40cfda0 msgr2=0x7f40c415eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:57.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40cc800640 1 --2- 172.21.15.103:0/2149067855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40c40cfda0 0x7f40c415eca0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009840 tx=0x7f40b801c5f0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40cc800640 1 -- 172.21.15.103:0/2149067855 shutdown_connections 2024-09-10T22:41:57.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40cc800640 1 --2- 172.21.15.103:0/2149067855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40c40cfda0 0x7f40c415eca0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40cc800640 1 -- 172.21.15.103:0/2149067855 >> 172.21.15.103:0/2149067855 conn(0x7f40c40d1ad0 msgr2=0x7f40c40d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:57.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40cc800640 1 -- 172.21.15.103:0/2149067855 shutdown_connections 2024-09-10T22:41:57.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40cc800640 1 -- 172.21.15.103:0/2149067855 wait complete. 2024-09-10T22:41:57.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40cc800640 1 Processor -- start 2024-09-10T22:41:57.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40cc800640 1 -- start start 2024-09-10T22:41:57.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40cc800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40c40717a0 0x7f40c415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:57.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40cc800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f40c40cfda0 0x7f40c415e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:57.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40cc800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40c40d25f0 0x7f40c413f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:57.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40cc800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f40c416a330 con 0x7f40c40d25f0 2024-09-10T22:41:57.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40cc800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f40c416a1b0 con 0x7f40c40717a0 2024-09-10T22:41:57.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40cc800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f40c416a4b0 con 0x7f40c40cfda0 2024-09-10T22:41:57.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40ca800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40c40d25f0 0x7f40c413f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:57.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40ca800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40c40d25f0 0x7f40c413f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35422/0 (socket says 172.21.15.103:35422) 2024-09-10T22:41:57.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40ca800640 1 -- 172.21.15.103:0/945345347 learned_addr learned my addr 172.21.15.103:0/945345347 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:57.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40c9e00640 1 --2- 172.21.15.103:0/945345347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40c40717a0 0x7f40c415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:57.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40c9400640 1 --2- 172.21.15.103:0/945345347 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f40c40cfda0 0x7f40c415e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:57.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40ca800640 1 -- 172.21.15.103:0/945345347 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f40c40cfda0 msgr2=0x7f40c415e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:57.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40ca800640 1 --2- 172.21.15.103:0/945345347 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f40c40cfda0 0x7f40c415e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40ca800640 1 -- 172.21.15.103:0/945345347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40c40717a0 msgr2=0x7f40c415dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:57.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40ca800640 1 --2- 172.21.15.103:0/945345347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40c40717a0 0x7f40c415dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40ca800640 1 -- 172.21.15.103:0/945345347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c41595a0 con 0x7f40c40d25f0 2024-09-10T22:41:57.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.756+0000 7f40c9e00640 1 --2- 172.21.15.103:0/945345347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40c40717a0 0x7f40c415dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:57.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.760+0000 7f40ca800640 1 --2- 172.21.15.103:0/945345347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40c40d25f0 0x7f40c413f560 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f40c000cfc0 tx=0x7f40c0001fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:57.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.760+0000 7f40be000640 1 -- 172.21.15.103:0/945345347 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c0016020 con 0x7f40c40d25f0 2024-09-10T22:41:57.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.760+0000 7f40be000640 1 -- 172.21.15.103:0/945345347 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40c000ab40 con 0x7f40c40d25f0 2024-09-10T22:41:57.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.760+0000 7f40be000640 1 -- 172.21.15.103:0/945345347 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c0012420 con 0x7f40c40d25f0 2024-09-10T22:41:57.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.760+0000 7f40cc800640 1 -- 172.21.15.103:0/945345347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c4159880 con 0x7f40c40d25f0 2024-09-10T22:41:57.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.760+0000 7f40cc800640 1 -- 172.21.15.103:0/945345347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c413faa0 con 0x7f40c40d25f0 2024-09-10T22:41:57.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.760+0000 7f40cc800640 1 -- 172.21.15.103:0/945345347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40c415eca0 con 0x7f40c40d25f0 2024-09-10T22:41:57.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.760+0000 7f40be000640 1 -- 172.21.15.103:0/945345347 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f40c001b400 con 0x7f40c40d25f0 2024-09-10T22:41:57.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.760+0000 7f40be000640 1 --2- 172.21.15.103:0/945345347 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f40a80725e0 0x7f40a8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:57.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.760+0000 7f40be000640 1 -- 172.21.15.103:0/945345347 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f40c0093c10 con 0x7f40c40d25f0 2024-09-10T22:41:57.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.764+0000 7f40c9e00640 1 --2- 172.21.15.103:0/945345347 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f40a80725e0 0x7f40a8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:57.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.764+0000 7f40c9e00640 1 --2- 172.21.15.103:0/945345347 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f40a80725e0 0x7f40a8074aa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f40b80af000 tx=0x7f40b801ae30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:57.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.764+0000 7f40be000640 1 -- 172.21.15.103:0/945345347 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f40c0020020 con 0x7f40c40d25f0 2024-09-10T22:41:57.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.992+0000 7f40cc800640 1 -- 172.21.15.103:0/945345347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f40c40d2150 con 0x7f40c40d25f0 2024-09-10T22:41:57.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.992+0000 7f40be000640 1 -- 172.21.15.103:0/945345347 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2026 (secure 0 0 0) 0x7f40c005f0a0 con 0x7f40c40d25f0 2024-09-10T22:41:57.995 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:57.995 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":213,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":57,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700795,"bytes_used":232570880,"bytes_avail":772861542400,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":5715,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":45,"btime":"2024-09-10T22:41:45:168066+0000","id":3,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":3,"rank":2,"name":"d","status":"up:active","gid":5153},{"filesystem_id":3,"rank":1,"name":"c","status":"up:active","gid":5544},{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5547}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-09-10T22:41:49.663381+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-10T22:41:57.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.996+0000 7f40cc800640 1 -- 172.21.15.103:0/945345347 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f40a80725e0 msgr2=0x7f40a8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:57.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.996+0000 7f40cc800640 1 --2- 172.21.15.103:0/945345347 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f40a80725e0 0x7f40a8074aa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f40b80af000 tx=0x7f40b801ae30 comp rx=0 tx=0).stop 2024-09-10T22:41:57.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.996+0000 7f40cc800640 1 -- 172.21.15.103:0/945345347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40c40d25f0 msgr2=0x7f40c413f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:57.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.996+0000 7f40cc800640 1 --2- 172.21.15.103:0/945345347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40c40d25f0 0x7f40c413f560 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f40c000cfc0 tx=0x7f40c0001fa0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.996+0000 7f40cc800640 1 -- 172.21.15.103:0/945345347 shutdown_connections 2024-09-10T22:41:57.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.996+0000 7f40cc800640 1 --2- 172.21.15.103:0/945345347 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f40a80725e0 0x7f40a8074aa0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.996+0000 7f40cc800640 1 --2- 172.21.15.103:0/945345347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40c40d25f0 0x7f40c413f560 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.996+0000 7f40cc800640 1 --2- 172.21.15.103:0/945345347 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f40c40cfda0 0x7f40c415e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.996+0000 7f40cc800640 1 --2- 172.21.15.103:0/945345347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40c40717a0 0x7f40c415dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:57.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.996+0000 7f40cc800640 1 -- 172.21.15.103:0/945345347 >> 172.21.15.103:0/945345347 conn(0x7f40c40d1ad0 msgr2=0x7f40c40b5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:57.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.996+0000 7f40cc800640 1 -- 172.21.15.103:0/945345347 shutdown_connections 2024-09-10T22:41:57.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:57.996+0000 7f40cc800640 1 -- 172.21.15.103:0/945345347 wait complete. 2024-09-10T22:41:58.017 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]', 'd': 'idle+waiting paths [/d1/d2/d3]'} 2024-09-10T22:41:59.018 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:41:59.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.168+0000 7fb32e600640 1 -- 172.21.15.103:0/3943948581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3280cc120 msgr2=0x7fb3280aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:59.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.168+0000 7fb32e600640 1 --2- 172.21.15.103:0/3943948581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3280cc120 0x7fb3280aeb40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb318009900 tx=0x7fb31801c850 comp rx=0 tx=0).stop 2024-09-10T22:41:59.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.168+0000 7fb32e600640 1 -- 172.21.15.103:0/3943948581 shutdown_connections 2024-09-10T22:41:59.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.168+0000 7fb32e600640 1 --2- 172.21.15.103:0/3943948581 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3280cf790 0x7fb3280cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.168+0000 7fb32e600640 1 --2- 172.21.15.103:0/3943948581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3280cc120 0x7fb3280aeb40 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.168+0000 7fb32e600640 1 -- 172.21.15.103:0/3943948581 >> 172.21.15.103:0/3943948581 conn(0x7fb32806cc00 msgr2=0x7fb32806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:59.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.168+0000 7fb32e600640 1 -- 172.21.15.103:0/3943948581 shutdown_connections 2024-09-10T22:41:59.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.168+0000 7fb32e600640 1 -- 172.21.15.103:0/3943948581 wait complete. 2024-09-10T22:41:59.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.168+0000 7fb32e600640 1 Processor -- start 2024-09-10T22:41:59.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.168+0000 7fb32e600640 1 -- start start 2024-09-10T22:41:59.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.168+0000 7fb32e600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3280cc120 0x7fb32814e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:59.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.168+0000 7fb32e600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3280cf790 0x7fb3280b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:59.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.168+0000 7fb32e600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb32815c970 0x7fb328155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:59.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.168+0000 7fb32e600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb328168b90 con 0x7fb32815c970 2024-09-10T22:41:59.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.168+0000 7fb32e600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb328168a10 con 0x7fb3280cf790 2024-09-10T22:41:59.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.168+0000 7fb32e600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb328168d10 con 0x7fb3280cc120 2024-09-10T22:41:59.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb327e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb32815c970 0x7fb328155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:59.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb327e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb32815c970 0x7fb328155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35442/0 (socket says 172.21.15.103:35442) 2024-09-10T22:41:59.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb327e00640 1 -- 172.21.15.103:0/1855309831 learned_addr learned my addr 172.21.15.103:0/1855309831 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:59.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb327400640 1 --2- 172.21.15.103:0/1855309831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3280cc120 0x7fb32814e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:59.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb326a00640 1 --2- 172.21.15.103:0/1855309831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3280cf790 0x7fb3280b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:59.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb327e00640 1 -- 172.21.15.103:0/1855309831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3280cc120 msgr2=0x7fb32814e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:59.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb327e00640 1 --2- 172.21.15.103:0/1855309831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3280cc120 0x7fb32814e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb327e00640 1 -- 172.21.15.103:0/1855309831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3280cf790 msgr2=0x7fb3280b1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:59.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb327e00640 1 --2- 172.21.15.103:0/1855309831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3280cf790 0x7fb3280b1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb327e00640 1 -- 172.21.15.103:0/1855309831 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3281562d0 con 0x7fb32815c970 2024-09-10T22:41:59.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb326a00640 1 --2- 172.21.15.103:0/1855309831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3280cf790 0x7fb3280b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:59.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb327e00640 1 --2- 172.21.15.103:0/1855309831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb32815c970 0x7fb328155910 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb32000ea20 tx=0x7fb32000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:59.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb31f400640 1 -- 172.21.15.103:0/1855309831 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32000cde0 con 0x7fb32815c970 2024-09-10T22:41:59.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb31f400640 1 -- 172.21.15.103:0/1855309831 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb320004c40 con 0x7fb32815c970 2024-09-10T22:41:59.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb31f400640 1 -- 172.21.15.103:0/1855309831 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb320005280 con 0x7fb32815c970 2024-09-10T22:41:59.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb32e600640 1 -- 172.21.15.103:0/1855309831 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3281565b0 con 0x7fb32815c970 2024-09-10T22:41:59.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb32e600640 1 -- 172.21.15.103:0/1855309831 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3280b0d50 con 0x7fb32815c970 2024-09-10T22:41:59.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb32e600640 1 -- 172.21.15.103:0/1855309831 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3281567f0 con 0x7fb32815c970 2024-09-10T22:41:59.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.172+0000 7fb31f400640 1 -- 172.21.15.103:0/1855309831 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb32000f040 con 0x7fb32815c970 2024-09-10T22:41:59.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.176+0000 7fb31f400640 1 --2- 172.21.15.103:0/1855309831 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb3080725e0 0x7fb308074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:59.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.176+0000 7fb31f400640 1 -- 172.21.15.103:0/1855309831 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fb320093b00 con 0x7fb32815c970 2024-09-10T22:41:59.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.176+0000 7fb327400640 1 --2- 172.21.15.103:0/1855309831 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb3080725e0 0x7fb308074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:59.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.176+0000 7fb327400640 1 --2- 172.21.15.103:0/1855309831 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb3080725e0 0x7fb308074aa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb3180af000 tx=0x7fb31801b090 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:59.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.180+0000 7fb31f400640 1 -- 172.21.15.103:0/1855309831 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb3281567f0 con 0x7fb32815c970 2024-09-10T22:41:59.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.376+0000 7fb32e600640 1 -- 172.21.15.103:0/1855309831 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3280b0f50 con 0x7fb32815c970 2024-09-10T22:41:59.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.380+0000 7fb31f400640 1 -- 172.21.15.103:0/1855309831 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5279 (secure 0 0 0) 0x7fb3280b0f50 con 0x7fb32815c970 2024-09-10T22:41:59.381 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:59.381 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":45,"btime":"2024-09-10T22:41:45:168066+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/1187797704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1187797704},{"type":"v1","addr":"172.21.15.131:6836","nonce":1187797704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:41:06.381695+0000","modified":"2024-09-10T22:41:45.105121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5547,"mds_1":5544,"mds_2":5153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5153":{"gid":5153,"name":"d","rank":2,"incarnation":39,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6837/3348473142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3348473142},{"type":"v1","addr":"172.21.15.131:6837","nonce":3348473142}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5544":{"gid":5544,"name":"c","rank":1,"incarnation":37,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3910783847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":3910783847},{"type":"v1","addr":"172.21.15.103:6834","nonce":3910783847}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5547":{"gid":5547,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/343761048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":343761048},{"type":"v1","addr":"172.21.15.103:6835","nonce":343761048}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5547,"qdb_cluster":[5547,5544,5153]},"id":3}]} 2024-09-10T22:41:59.381 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 45 2024-09-10T22:41:59.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.380+0000 7fb32e600640 1 -- 172.21.15.103:0/1855309831 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb3080725e0 msgr2=0x7fb308074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:59.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.380+0000 7fb32e600640 1 --2- 172.21.15.103:0/1855309831 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb3080725e0 0x7fb308074aa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb3180af000 tx=0x7fb31801b090 comp rx=0 tx=0).stop 2024-09-10T22:41:59.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.380+0000 7fb32e600640 1 -- 172.21.15.103:0/1855309831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb32815c970 msgr2=0x7fb328155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:59.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.380+0000 7fb32e600640 1 --2- 172.21.15.103:0/1855309831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb32815c970 0x7fb328155910 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb32000ea20 tx=0x7fb32000eee0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.380+0000 7fb32e600640 1 -- 172.21.15.103:0/1855309831 shutdown_connections 2024-09-10T22:41:59.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.380+0000 7fb32e600640 1 --2- 172.21.15.103:0/1855309831 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb3080725e0 0x7fb308074aa0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.380+0000 7fb32e600640 1 --2- 172.21.15.103:0/1855309831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb32815c970 0x7fb328155910 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.380+0000 7fb32e600640 1 --2- 172.21.15.103:0/1855309831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3280cf790 0x7fb3280b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.380+0000 7fb32e600640 1 --2- 172.21.15.103:0/1855309831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3280cc120 0x7fb32814e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.380+0000 7fb32e600640 1 -- 172.21.15.103:0/1855309831 >> 172.21.15.103:0/1855309831 conn(0x7fb32806cc00 msgr2=0x7fb32815a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:59.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.380+0000 7fb32e600640 1 -- 172.21.15.103:0/1855309831 shutdown_connections 2024-09-10T22:41:59.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.380+0000 7fb32e600640 1 -- 172.21.15.103:0/1855309831 wait complete. 2024-09-10T22:41:59.402 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-10T22:41:59.402 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:41:59.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.540+0000 7fba73400640 1 -- 172.21.15.103:0/2798462891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba6c15ab10 msgr2=0x7fba6c06ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:59.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.540+0000 7fba73400640 1 --2- 172.21.15.103:0/2798462891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba6c15ab10 0x7fba6c06ff40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fba6c06c420 tx=0x7fba5401c5d0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.540+0000 7fba73400640 1 -- 172.21.15.103:0/2798462891 shutdown_connections 2024-09-10T22:41:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.540+0000 7fba73400640 1 --2- 172.21.15.103:0/2798462891 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba6c0cebe0 0x7fba6c15e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.540+0000 7fba73400640 1 --2- 172.21.15.103:0/2798462891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba6c15ab10 0x7fba6c06ff40 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.540+0000 7fba73400640 1 --2- 172.21.15.103:0/2798462891 >> v2:172.21.15.131:3300/0 conn(0x7fba6c06fb60 0x7fba6c073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.540+0000 7fba73400640 1 -- 172.21.15.103:0/2798462891 >> 172.21.15.103:0/2798462891 conn(0x7fba6c0cd420 msgr2=0x7fba6c0cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.540+0000 7fba73400640 1 -- 172.21.15.103:0/2798462891 shutdown_connections 2024-09-10T22:41:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.540+0000 7fba73400640 1 -- 172.21.15.103:0/2798462891 wait complete. 2024-09-10T22:41:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.540+0000 7fba73400640 1 Processor -- start 2024-09-10T22:41:59.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.540+0000 7fba73400640 1 -- start start 2024-09-10T22:41:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba73400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba6c06fb60 0x7fba6c159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba73400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba6c0cebe0 0x7fba6c0cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba73400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba6c15ab10 0x7fba6c149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba73400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c0cb380 con 0x7fba6c15ab10 2024-09-10T22:41:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba73400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c0cb200 con 0x7fba6c0cebe0 2024-09-10T22:41:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba73400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fba6c0cb500 con 0x7fba6c06fb60 2024-09-10T22:41:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba71400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba6c15ab10 0x7fba6c149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba71400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba6c15ab10 0x7fba6c149170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35456/0 (socket says 172.21.15.103:35456) 2024-09-10T22:41:59.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba71400640 1 -- 172.21.15.103:0/3922217059 learned_addr learned my addr 172.21.15.103:0/3922217059 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:41:59.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba70a00640 1 --2- 172.21.15.103:0/3922217059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba6c06fb60 0x7fba6c159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:59.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba63e00640 1 --2- 172.21.15.103:0/3922217059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba6c0cebe0 0x7fba6c0cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba71400640 1 -- 172.21.15.103:0/3922217059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba6c06fb60 msgr2=0x7fba6c159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba71400640 1 --2- 172.21.15.103:0/3922217059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba6c06fb60 0x7fba6c159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba71400640 1 -- 172.21.15.103:0/3922217059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba6c0cebe0 msgr2=0x7fba6c0cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba71400640 1 --2- 172.21.15.103:0/3922217059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba6c0cebe0 0x7fba6c0cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba71400640 1 -- 172.21.15.103:0/3922217059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6c1fb0b0 con 0x7fba6c15ab10 2024-09-10T22:41:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba70a00640 1 --2- 172.21.15.103:0/3922217059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba6c06fb60 0x7fba6c159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:41:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba71400640 1 --2- 172.21.15.103:0/3922217059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba6c15ab10 0x7fba6c149170 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fba6400ea20 tx=0x7fba6400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba69600640 1 -- 172.21.15.103:0/3922217059 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6400cde0 con 0x7fba6c15ab10 2024-09-10T22:41:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba69600640 1 -- 172.21.15.103:0/3922217059 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba64004c40 con 0x7fba6c15ab10 2024-09-10T22:41:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba69600640 1 -- 172.21.15.103:0/3922217059 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64005280 con 0x7fba6c15ab10 2024-09-10T22:41:59.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba73400640 1 -- 172.21.15.103:0/3922217059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba6c1fb350 con 0x7fba6c15ab10 2024-09-10T22:41:59.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba73400640 1 -- 172.21.15.103:0/3922217059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba6c1fb910 con 0x7fba6c15ab10 2024-09-10T22:41:59.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba73400640 1 -- 172.21.15.103:0/3922217059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba6c15e440 con 0x7fba6c15ab10 2024-09-10T22:41:59.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.544+0000 7fba69600640 1 -- 172.21.15.103:0/3922217059 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fba6400f040 con 0x7fba6c15ab10 2024-09-10T22:41:59.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.548+0000 7fba69600640 1 --2- 172.21.15.103:0/3922217059 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fba480725e0 0x7fba48074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:41:59.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.548+0000 7fba69600640 1 -- 172.21.15.103:0/3922217059 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fba64093a30 con 0x7fba6c15ab10 2024-09-10T22:41:59.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.548+0000 7fba70a00640 1 --2- 172.21.15.103:0/3922217059 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fba480725e0 0x7fba48074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:41:59.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.548+0000 7fba70a00640 1 --2- 172.21.15.103:0/3922217059 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fba480725e0 0x7fba48074aa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fba5c005fd0 tx=0x7fba5c005f20 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:41:59.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.552+0000 7fba69600640 1 -- 172.21.15.103:0/3922217059 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fba64016030 con 0x7fba6c15ab10 2024-09-10T22:41:59.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.772+0000 7fba73400640 1 -- 172.21.15.103:0/3922217059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fba6c0c5860 con 0x7fba6c15ab10 2024-09-10T22:41:59.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.776+0000 7fba69600640 1 -- 172.21.15.103:0/3922217059 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2006 (secure 0 0 0) 0x7fba6405e8f0 con 0x7fba6c15ab10 2024-09-10T22:41:59.777 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:41:59.777 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":215,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":57,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700795,"bytes_used":232570880,"bytes_avail":772861542400,"bytes_total":773094113280,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":45,"btime":"2024-09-10T22:41:45:168066+0000","id":3,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":3,"rank":2,"name":"d","status":"up:active","gid":5153},{"filesystem_id":3,"rank":1,"name":"c","status":"up:active","gid":5544},{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5547}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-09-10T22:41:49.663381+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-10T22:41:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.776+0000 7fba73400640 1 -- 172.21.15.103:0/3922217059 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fba480725e0 msgr2=0x7fba48074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.776+0000 7fba73400640 1 --2- 172.21.15.103:0/3922217059 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fba480725e0 0x7fba48074aa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fba5c005fd0 tx=0x7fba5c005f20 comp rx=0 tx=0).stop 2024-09-10T22:41:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.776+0000 7fba73400640 1 -- 172.21.15.103:0/3922217059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba6c15ab10 msgr2=0x7fba6c149170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:41:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.776+0000 7fba73400640 1 --2- 172.21.15.103:0/3922217059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba6c15ab10 0x7fba6c149170 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fba6400ea20 tx=0x7fba6400eee0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.776+0000 7fba73400640 1 -- 172.21.15.103:0/3922217059 shutdown_connections 2024-09-10T22:41:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.776+0000 7fba73400640 1 --2- 172.21.15.103:0/3922217059 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fba480725e0 0x7fba48074aa0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.776+0000 7fba73400640 1 --2- 172.21.15.103:0/3922217059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba6c15ab10 0x7fba6c149170 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.776+0000 7fba73400640 1 --2- 172.21.15.103:0/3922217059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba6c0cebe0 0x7fba6c0cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.776+0000 7fba73400640 1 --2- 172.21.15.103:0/3922217059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba6c06fb60 0x7fba6c159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:41:59.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.776+0000 7fba73400640 1 -- 172.21.15.103:0/3922217059 >> 172.21.15.103:0/3922217059 conn(0x7fba6c0cd420 msgr2=0x7fba6c06cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:41:59.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.776+0000 7fba73400640 1 -- 172.21.15.103:0/3922217059 shutdown_connections 2024-09-10T22:41:59.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:41:59.776+0000 7fba73400640 1 -- 172.21.15.103:0/3922217059 wait complete. 2024-09-10T22:41:59.799 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]', 'd': 'idle+waiting paths [/d1/d2/d3]'} 2024-09-10T22:42:00.800 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:42:00.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.948+0000 7fe15b600640 1 -- 172.21.15.103:0/3156368649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1540b09c0 msgr2=0x7fe1540ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:00.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.948+0000 7fe15b600640 1 --2- 172.21.15.103:0/3156368649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1540b09c0 0x7fe1540ce600 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe154073910 tx=0x7fe14001c770 comp rx=0 tx=0).stop 2024-09-10T22:42:00.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.948+0000 7fe15b600640 1 -- 172.21.15.103:0/3156368649 shutdown_connections 2024-09-10T22:42:00.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.948+0000 7fe15b600640 1 --2- 172.21.15.103:0/3156368649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1540b09c0 0x7fe1540ce600 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:00.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.948+0000 7fe15b600640 1 --2- 172.21.15.103:0/3156368649 >> v2:172.21.15.131:3300/0 conn(0x7fe15415be30 0x7fe1540ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:00.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.948+0000 7fe15b600640 1 -- 172.21.15.103:0/3156368649 >> 172.21.15.103:0/3156368649 conn(0x7fe1540d1ac0 msgr2=0x7fe1540d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:00.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.948+0000 7fe15b600640 1 -- 172.21.15.103:0/3156368649 shutdown_connections 2024-09-10T22:42:00.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.948+0000 7fe15b600640 1 -- 172.21.15.103:0/3156368649 wait complete. 2024-09-10T22:42:00.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe15b600640 1 Processor -- start 2024-09-10T22:42:00.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe15b600640 1 -- start start 2024-09-10T22:42:00.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe15b600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1540b09c0 0x7fe1541fbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:00.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe15b600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1540ceb40 0x7fe154152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:00.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe15b600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe15415be30 0x7fe15406ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:00.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe15b600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe154169070 con 0x7fe1540ceb40 2024-09-10T22:42:00.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe15b600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe154168ef0 con 0x7fe1540b09c0 2024-09-10T22:42:00.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe15b600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe1541691f0 con 0x7fe15415be30 2024-09-10T22:42:00.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe153e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1540ceb40 0x7fe154152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:00.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe153e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1540ceb40 0x7fe154152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35474/0 (socket says 172.21.15.103:35474) 2024-09-10T22:42:00.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe153e00640 1 -- 172.21.15.103:0/3708985104 learned_addr learned my addr 172.21.15.103:0/3708985104 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:00.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe158c00640 1 --2- 172.21.15.103:0/3708985104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1540b09c0 0x7fe1541fbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:00.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe159600640 1 --2- 172.21.15.103:0/3708985104 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe15415be30 0x7fe15406ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:00.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe153e00640 1 -- 172.21.15.103:0/3708985104 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe15415be30 msgr2=0x7fe15406ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:00.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe153e00640 1 --2- 172.21.15.103:0/3708985104 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe15415be30 0x7fe15406ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:00.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe153e00640 1 -- 172.21.15.103:0/3708985104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1540b09c0 msgr2=0x7fe1541fbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:00.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe153e00640 1 --2- 172.21.15.103:0/3708985104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1540b09c0 0x7fe1541fbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:00.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe153e00640 1 -- 172.21.15.103:0/3708985104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe154152770 con 0x7fe1540ceb40 2024-09-10T22:42:00.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe159600640 1 --2- 172.21.15.103:0/3708985104 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe15415be30 0x7fe15406ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:00.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe153e00640 1 --2- 172.21.15.103:0/3708985104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1540ceb40 0x7fe154152070 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe140019380 tx=0x7fe1400a6a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:00.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe150c00640 1 -- 172.21.15.103:0/3708985104 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1400a6c70 con 0x7fe1540ceb40 2024-09-10T22:42:00.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe150c00640 1 -- 172.21.15.103:0/3708985104 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1400a6e10 con 0x7fe1540ceb40 2024-09-10T22:42:00.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe150c00640 1 -- 172.21.15.103:0/3708985104 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe140004290 con 0x7fe1540ceb40 2024-09-10T22:42:00.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe15b600640 1 -- 172.21.15.103:0/3708985104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe154152a50 con 0x7fe1540ceb40 2024-09-10T22:42:00.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.952+0000 7fe15b600640 1 -- 172.21.15.103:0/3708985104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1541fb430 con 0x7fe1540ceb40 2024-09-10T22:42:00.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.956+0000 7fe15b600640 1 -- 172.21.15.103:0/3708985104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1540cf9c0 con 0x7fe1540ceb40 2024-09-10T22:42:00.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.956+0000 7fe150c00640 1 -- 172.21.15.103:0/3708985104 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe140005070 con 0x7fe1540ceb40 2024-09-10T22:42:00.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.956+0000 7fe150c00640 1 --2- 172.21.15.103:0/3708985104 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe1340725e0 0x7fe134074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:00.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.956+0000 7fe150c00640 1 -- 172.21.15.103:0/3708985104 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fe14012cc50 con 0x7fe1540ceb40 2024-09-10T22:42:00.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.956+0000 7fe158c00640 1 --2- 172.21.15.103:0/3708985104 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe1340725e0 0x7fe134074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:00.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.960+0000 7fe158c00640 1 --2- 172.21.15.103:0/3708985104 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe1340725e0 0x7fe134074aa0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe148009b40 tx=0x7fe1480091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:00.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:00.960+0000 7fe150c00640 1 -- 172.21.15.103:0/3708985104 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe1400bf070 con 0x7fe1540ceb40 2024-09-10T22:42:01.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.160+0000 7fe15b600640 1 -- 172.21.15.103:0/3708985104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe154158ae0 con 0x7fe1540ceb40 2024-09-10T22:42:01.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.160+0000 7fe150c00640 1 -- 172.21.15.103:0/3708985104 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5279 (secure 0 0 0) 0x7fe1400ac030 con 0x7fe1540ceb40 2024-09-10T22:42:01.162 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:01.162 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":45,"btime":"2024-09-10T22:41:45:168066+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/1187797704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1187797704},{"type":"v1","addr":"172.21.15.131:6836","nonce":1187797704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:41:06.381695+0000","modified":"2024-09-10T22:41:45.105121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5547,"mds_1":5544,"mds_2":5153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5153":{"gid":5153,"name":"d","rank":2,"incarnation":39,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6837/3348473142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3348473142},{"type":"v1","addr":"172.21.15.131:6837","nonce":3348473142}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5544":{"gid":5544,"name":"c","rank":1,"incarnation":37,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3910783847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":3910783847},{"type":"v1","addr":"172.21.15.103:6834","nonce":3910783847}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5547":{"gid":5547,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/343761048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":343761048},{"type":"v1","addr":"172.21.15.103:6835","nonce":343761048}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5547,"qdb_cluster":[5547,5544,5153]},"id":3}]} 2024-09-10T22:42:01.162 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 45 2024-09-10T22:42:01.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.160+0000 7fe15b600640 1 -- 172.21.15.103:0/3708985104 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe1340725e0 msgr2=0x7fe134074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:01.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.160+0000 7fe15b600640 1 --2- 172.21.15.103:0/3708985104 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe1340725e0 0x7fe134074aa0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe148009b40 tx=0x7fe1480091e0 comp rx=0 tx=0).stop 2024-09-10T22:42:01.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.160+0000 7fe15b600640 1 -- 172.21.15.103:0/3708985104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1540ceb40 msgr2=0x7fe154152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:01.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.160+0000 7fe15b600640 1 --2- 172.21.15.103:0/3708985104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1540ceb40 0x7fe154152070 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe140019380 tx=0x7fe1400a6a80 comp rx=0 tx=0).stop 2024-09-10T22:42:01.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.160+0000 7fe15b600640 1 -- 172.21.15.103:0/3708985104 shutdown_connections 2024-09-10T22:42:01.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.160+0000 7fe15b600640 1 --2- 172.21.15.103:0/3708985104 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe1340725e0 0x7fe134074aa0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:01.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.160+0000 7fe15b600640 1 --2- 172.21.15.103:0/3708985104 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe15415be30 0x7fe15406ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:01.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.160+0000 7fe15b600640 1 --2- 172.21.15.103:0/3708985104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1540ceb40 0x7fe154152070 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:01.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.160+0000 7fe15b600640 1 --2- 172.21.15.103:0/3708985104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1540b09c0 0x7fe1541fbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:01.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.160+0000 7fe15b600640 1 -- 172.21.15.103:0/3708985104 >> 172.21.15.103:0/3708985104 conn(0x7fe1540d1ac0 msgr2=0x7fe1540d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:01.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.160+0000 7fe15b600640 1 -- 172.21.15.103:0/3708985104 shutdown_connections 2024-09-10T22:42:01.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.160+0000 7fe15b600640 1 -- 172.21.15.103:0/3708985104 wait complete. 2024-09-10T22:42:01.184 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-10T22:42:01.184 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:42:01.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f0780600640 1 -- 172.21.15.103:0/1033274134 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0778072a40 msgr2=0x7f0778157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:01.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f0780600640 1 --2- 172.21.15.103:0/1033274134 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0778072a40 0x7f0778157090 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f07780d0150 tx=0x7f077001cd80 comp rx=0 tx=0).stop 2024-09-10T22:42:01.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f0780600640 1 -- 172.21.15.103:0/1033274134 shutdown_connections 2024-09-10T22:42:01.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f0780600640 1 --2- 172.21.15.103:0/1033274134 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0778072a40 0x7f0778157090 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:01.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f0780600640 1 --2- 172.21.15.103:0/1033274134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07780b3150 0x7f0778072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:01.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f0780600640 1 --2- 172.21.15.103:0/1033274134 >> v2:172.21.15.131:3300/0 conn(0x7f07780cf260 0x7f07780b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:01.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f0780600640 1 -- 172.21.15.103:0/1033274134 >> 172.21.15.103:0/1033274134 conn(0x7f077806cc00 msgr2=0x7f077806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:01.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f0780600640 1 -- 172.21.15.103:0/1033274134 shutdown_connections 2024-09-10T22:42:01.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f0780600640 1 -- 172.21.15.103:0/1033274134 wait complete. 2024-09-10T22:42:01.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f0780600640 1 Processor -- start 2024-09-10T22:42:01.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f0780600640 1 -- start start 2024-09-10T22:42:01.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f0780600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0778072a40 0x7f07781fb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:01.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f0780600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07780b3150 0x7f077814ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:01.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f0780600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07780cf260 0x7f077814d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:01.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f0780600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0778157ab0 con 0x7f07780b3150 2024-09-10T22:42:01.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f0780600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0778157930 con 0x7f0778072a40 2024-09-10T22:42:01.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f0780600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0778157c30 con 0x7f07780cf260 2024-09-10T22:42:01.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f077d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07780b3150 0x7f077814ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:01.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f077d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07780b3150 0x7f077814ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35506/0 (socket says 172.21.15.103:35506) 2024-09-10T22:42:01.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.324+0000 7f077d200640 1 -- 172.21.15.103:0/141146413 learned_addr learned my addr 172.21.15.103:0/141146413 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:01.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.328+0000 7f077d200640 1 -- 172.21.15.103:0/141146413 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07780cf260 msgr2=0x7f077814d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:01.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.328+0000 7f077d200640 1 --2- 172.21.15.103:0/141146413 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07780cf260 0x7f077814d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:01.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.328+0000 7f077dc00640 1 --2- 172.21.15.103:0/141146413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0778072a40 0x7f07781fb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:01.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.328+0000 7f077d200640 1 -- 172.21.15.103:0/141146413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0778072a40 msgr2=0x7f07781fb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:01.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.328+0000 7f077d200640 1 --2- 172.21.15.103:0/141146413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0778072a40 0x7f07781fb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:01.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.328+0000 7f077d200640 1 -- 172.21.15.103:0/141146413 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07781f8330 con 0x7f07780b3150 2024-09-10T22:42:01.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.328+0000 7f077dc00640 1 --2- 172.21.15.103:0/141146413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0778072a40 0x7f07781fb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:01.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.328+0000 7f077d200640 1 --2- 172.21.15.103:0/141146413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07780b3150 0x7f077814ce30 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f076400d700 tx=0x7f076400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:01.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.328+0000 7f0775600640 1 -- 172.21.15.103:0/141146413 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0764017070 con 0x7f07780b3150 2024-09-10T22:42:01.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.328+0000 7f0775600640 1 -- 172.21.15.103:0/141146413 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0764009d20 con 0x7f07780b3150 2024-09-10T22:42:01.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.328+0000 7f0780600640 1 -- 172.21.15.103:0/141146413 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07780b2350 con 0x7f07780b3150 2024-09-10T22:42:01.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.328+0000 7f0775600640 1 -- 172.21.15.103:0/141146413 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07640106c0 con 0x7f07780b3150 2024-09-10T22:42:01.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.328+0000 7f0780600640 1 -- 172.21.15.103:0/141146413 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07781f7b30 con 0x7f07780b3150 2024-09-10T22:42:01.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.328+0000 7f0780600640 1 -- 172.21.15.103:0/141146413 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0778072500 con 0x7f07780b3150 2024-09-10T22:42:01.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.328+0000 7f0775600640 1 -- 172.21.15.103:0/141146413 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0764010860 con 0x7f07780b3150 2024-09-10T22:42:01.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.332+0000 7f0775600640 1 --2- 172.21.15.103:0/141146413 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07580725e0 0x7f0758074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:01.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.332+0000 7f0775600640 1 -- 172.21.15.103:0/141146413 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f0764093950 con 0x7f07780b3150 2024-09-10T22:42:01.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.332+0000 7f077dc00640 1 --2- 172.21.15.103:0/141146413 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07580725e0 0x7f0758074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:01.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.332+0000 7f077dc00640 1 --2- 172.21.15.103:0/141146413 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07580725e0 0x7f0758074aa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f076c009ac0 tx=0x7f076c0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:01.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.336+0000 7f0775600640 1 -- 172.21.15.103:0/141146413 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f076405edd0 con 0x7f07780b3150 2024-09-10T22:42:01.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.560+0000 7f0780600640 1 -- 172.21.15.103:0/141146413 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f07781556b0 con 0x7f07780b3150 2024-09-10T22:42:01.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.560+0000 7f0775600640 1 -- 172.21.15.103:0/141146413 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1866 (secure 0 0 0) 0x7f076405e6d0 con 0x7f07780b3150 2024-09-10T22:42:01.563 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:01.563 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":217,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":57,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":706256,"bytes_used":232579072,"bytes_avail":772861534208,"bytes_total":773094113280,"write_bytes_sec":1279,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":45,"btime":"2024-09-10T22:41:45:168066+0000","id":3,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":3,"rank":2,"name":"d","status":"up:active","gid":5153},{"filesystem_id":3,"rank":1,"name":"c","status":"up:active","gid":5544},{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5547}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2024-09-10T22:41:59.666248+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T22:42:01.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.564+0000 7f0780600640 1 -- 172.21.15.103:0/141146413 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07580725e0 msgr2=0x7f0758074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:01.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.564+0000 7f0780600640 1 --2- 172.21.15.103:0/141146413 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07580725e0 0x7f0758074aa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f076c009ac0 tx=0x7f076c0091e0 comp rx=0 tx=0).stop 2024-09-10T22:42:01.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.564+0000 7f0780600640 1 -- 172.21.15.103:0/141146413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07780b3150 msgr2=0x7f077814ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:01.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.564+0000 7f0780600640 1 --2- 172.21.15.103:0/141146413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07780b3150 0x7f077814ce30 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f076400d700 tx=0x7f076400dbc0 comp rx=0 tx=0).stop 2024-09-10T22:42:01.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.564+0000 7f0780600640 1 -- 172.21.15.103:0/141146413 shutdown_connections 2024-09-10T22:42:01.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.564+0000 7f0780600640 1 --2- 172.21.15.103:0/141146413 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07580725e0 0x7f0758074aa0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:01.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.564+0000 7f0780600640 1 --2- 172.21.15.103:0/141146413 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07780cf260 0x7f077814d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:01.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.564+0000 7f0780600640 1 --2- 172.21.15.103:0/141146413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07780b3150 0x7f077814ce30 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:01.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.564+0000 7f0780600640 1 --2- 172.21.15.103:0/141146413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0778072a40 0x7f07781fb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:01.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.564+0000 7f0780600640 1 -- 172.21.15.103:0/141146413 >> 172.21.15.103:0/141146413 conn(0x7f077806cc00 msgr2=0x7f077806e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:01.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.564+0000 7f0780600640 1 -- 172.21.15.103:0/141146413 shutdown_connections 2024-09-10T22:42:01.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:01.564+0000 7f0780600640 1 -- 172.21.15.103:0/141146413 wait complete. 2024-09-10T22:42:01.585 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T22:42:01.585 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T22:42:01.585 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:42:01.699 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:42:01.797 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T22:42:01.797 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:42:01.797 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:42:01.797 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:42:01.806 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:42:01.806 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:42:01.856 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T22:42:02.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.040+0000 7f35d7c00640 1 -- 172.21.15.103:0/2548572491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35b4004060 msgr2=0x7f35b4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.040+0000 7f35d7c00640 1 --2- 172.21.15.103:0/2548572491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35b4004060 0x7f35b4004810 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009b60 tx=0x7f35b801d270 comp rx=0 tx=0).stop 2024-09-10T22:42:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.040+0000 7f35d5c00640 1 -- 172.21.15.103:0/2548572491 reap_dead start 2024-09-10T22:42:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.040+0000 7f35d7c00640 1 -- 172.21.15.103:0/2548572491 shutdown_connections 2024-09-10T22:42:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.040+0000 7f35d7c00640 1 -- 172.21.15.103:0/2548572491 >> 172.21.15.103:0/2548572491 conn(0x7f35d00cc7e0 msgr2=0x7f35d00ccbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.040+0000 7f35d7c00640 1 -- 172.21.15.103:0/2548572491 shutdown_connections 2024-09-10T22:42:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.040+0000 7f35d7c00640 1 -- 172.21.15.103:0/2548572491 wait complete. 2024-09-10T22:42:02.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.040+0000 7f35d7c00640 1 Processor -- start 2024-09-10T22:42:02.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.040+0000 7f35d7c00640 1 -- start start 2024-09-10T22:42:02.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d7c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35b4004060 0x7f35d00b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:02.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d7c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35d01f58c0 0x7f35d01f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:02.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d7c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35d0157270 0x7f35d01576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:02.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d7c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f35d015ad10 con 0x7f35d0157270 2024-09-10T22:42:02.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d7c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f35d015ab90 con 0x7f35d01f58c0 2024-09-10T22:42:02.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d7c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f35d00b44e0 con 0x7f35b4004060 2024-09-10T22:42:02.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d5c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35d0157270 0x7f35d01576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:02.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d5c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35d0157270 0x7f35d01576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35528/0 (socket says 172.21.15.103:35528) 2024-09-10T22:42:02.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d5c00640 1 -- 172.21.15.103:0/3251893469 learned_addr learned my addr 172.21.15.103:0/3251893469 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:02.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35c7e00640 1 --2- 172.21.15.103:0/3251893469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35d01f58c0 0x7f35d01f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:02.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d5200640 1 --2- 172.21.15.103:0/3251893469 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35b4004060 0x7f35d00b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:02.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d5c00640 1 -- 172.21.15.103:0/3251893469 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35b4004060 msgr2=0x7f35d00b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:02.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d5c00640 1 --2- 172.21.15.103:0/3251893469 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35b4004060 0x7f35d00b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:02.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d5c00640 1 -- 172.21.15.103:0/3251893469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35d01f58c0 msgr2=0x7f35d01f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:02.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d5c00640 1 --2- 172.21.15.103:0/3251893469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35d01f58c0 0x7f35d01f5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:02.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d5c00640 1 -- 172.21.15.103:0/3251893469 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d00b0650 con 0x7f35d0157270 2024-09-10T22:42:02.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35c7e00640 1 --2- 172.21.15.103:0/3251893469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35d01f58c0 0x7f35d01f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:02.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d5c00640 1 --2- 172.21.15.103:0/3251893469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35d0157270 0x7f35d01576f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f35c80115a0 tx=0x7f35c8011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:02.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35cd600640 1 -- 172.21.15.103:0/3251893469 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c8013920 con 0x7f35d0157270 2024-09-10T22:42:02.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35cd600640 1 -- 172.21.15.103:0/3251893469 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35c8013bb0 con 0x7f35d0157270 2024-09-10T22:42:02.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35cd600640 1 -- 172.21.15.103:0/3251893469 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c800f3f0 con 0x7f35d0157270 2024-09-10T22:42:02.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d7c00640 1 -- 172.21.15.103:0/3251893469 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35d01561d0 con 0x7f35d0157270 2024-09-10T22:42:02.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d7c00640 1 -- 172.21.15.103:0/3251893469 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35d0156790 con 0x7f35d0157270 2024-09-10T22:42:02.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.044+0000 7f35d7c00640 1 -- 172.21.15.103:0/3251893469 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35d00cebf0 con 0x7f35d0157270 2024-09-10T22:42:02.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.048+0000 7f35cd600640 1 -- 172.21.15.103:0/3251893469 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f35c8010040 con 0x7f35d0157270 2024-09-10T22:42:02.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.048+0000 7f35cd600640 1 --2- 172.21.15.103:0/3251893469 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35ac072610 0x7f35ac074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:02.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.048+0000 7f35cd600640 1 -- 172.21.15.103:0/3251893469 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f35c80969e0 con 0x7f35d0157270 2024-09-10T22:42:02.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.048+0000 7f35d5200640 1 --2- 172.21.15.103:0/3251893469 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35ac072610 0x7f35ac074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:02.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.048+0000 7f35d5200640 1 --2- 172.21.15.103:0/3251893469 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35ac072610 0x7f35ac074ad0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f35c0000f70 tx=0x7f35c0000f00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:02.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.052+0000 7f35cd600640 1 -- 172.21.15.103:0/3251893469 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f35c8061e60 con 0x7f35d0157270 2024-09-10T22:42:02.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.228+0000 7f35d7c00640 1 -- 172.21.15.103:0/3251893469 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f35d0072fc0 con 0x7f35d0157270 2024-09-10T22:42:02.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.228+0000 7f35cd600640 1 -- 172.21.15.103:0/3251893469 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) ==== 80+0+0 (secure 0 0 0) 0x7f35c8061760 con 0x7f35d0157270 2024-09-10T22:42:02.231 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T22:42:02.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.232+0000 7f35d7c00640 1 -- 172.21.15.103:0/3251893469 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35ac072610 msgr2=0x7f35ac074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:02.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.232+0000 7f35d7c00640 1 --2- 172.21.15.103:0/3251893469 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35ac072610 0x7f35ac074ad0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f35c0000f70 tx=0x7f35c0000f00 comp rx=0 tx=0).stop 2024-09-10T22:42:02.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.232+0000 7f35d7c00640 1 -- 172.21.15.103:0/3251893469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35d0157270 msgr2=0x7f35d01576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:02.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.232+0000 7f35d7c00640 1 --2- 172.21.15.103:0/3251893469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35d0157270 0x7f35d01576f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f35c80115a0 tx=0x7f35c8011a60 comp rx=0 tx=0).stop 2024-09-10T22:42:02.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.232+0000 7f35d7c00640 1 -- 172.21.15.103:0/3251893469 shutdown_connections 2024-09-10T22:42:02.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.232+0000 7f35d7c00640 1 --2- 172.21.15.103:0/3251893469 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35ac072610 0x7f35ac074ad0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:02.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.232+0000 7f35d7c00640 1 --2- 172.21.15.103:0/3251893469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35d0157270 0x7f35d01576f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:02.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.232+0000 7f35d7c00640 1 --2- 172.21.15.103:0/3251893469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35d01f58c0 0x7f35d01f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:02.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.232+0000 7f35d7c00640 1 --2- 172.21.15.103:0/3251893469 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35b4004060 0x7f35d00b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:02.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.232+0000 7f35d7c00640 1 -- 172.21.15.103:0/3251893469 >> 172.21.15.103:0/3251893469 conn(0x7f35d00cc7e0 msgr2=0x7f35d00b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:02.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.232+0000 7f35d7c00640 1 -- 172.21.15.103:0/3251893469 shutdown_connections 2024-09-10T22:42:02.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.232+0000 7f35d7c00640 1 -- 172.21.15.103:0/3251893469 wait complete. 2024-09-10T22:42:02.254 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-09-10T22:42:02.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:02.254 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T22:42:02.271 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[40011]: fuse finished with error 0 and tester_r 0 2024-09-10T22:42:02.277 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:42:02.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:02.278 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T22:42:02.444 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:42:02.444 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:42:02.444 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:42:02.453 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:42:02.454 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:42:02.454 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:42:02.454 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:42:02.497 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350248k,nr_inodes=4087562,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3542 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T22:42:02.497 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:42:02.497 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:42:02.497 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:42:02.506 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:42:02.506 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:42:02.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.680+0000 7fb023a00640 1 -- 172.21.15.103:0/420754035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb01c0cf790 msgr2=0x7fb01c0cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:02.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.680+0000 7fb023a00640 1 --2- 172.21.15.103:0/420754035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb01c0cf790 0x7fb01c0cfc20 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb01c06dbc0 tx=0x7fb01401caf0 comp rx=0 tx=0).stop 2024-09-10T22:42:02.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.680+0000 7fb023a00640 1 -- 172.21.15.103:0/420754035 shutdown_connections 2024-09-10T22:42:02.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.680+0000 7fb023a00640 1 --2- 172.21.15.103:0/420754035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb01c0cf790 0x7fb01c0cfc20 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:02.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.680+0000 7fb023a00640 1 --2- 172.21.15.103:0/420754035 >> v2:172.21.15.131:3300/0 conn(0x7fb01c0cc120 0x7fb01c0aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:02.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.680+0000 7fb023a00640 1 -- 172.21.15.103:0/420754035 >> 172.21.15.103:0/420754035 conn(0x7fb01c06cc00 msgr2=0x7fb01c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:02.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.680+0000 7fb023a00640 1 -- 172.21.15.103:0/420754035 shutdown_connections 2024-09-10T22:42:02.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.680+0000 7fb023a00640 1 -- 172.21.15.103:0/420754035 wait complete. 2024-09-10T22:42:02.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.680+0000 7fb023a00640 1 Processor -- start 2024-09-10T22:42:02.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.680+0000 7fb023a00640 1 -- start start 2024-09-10T22:42:02.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb023a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb01c0cc120 0x7fb01c144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:02.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb023a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01c0cf790 0x7fb01c0a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:02.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb023a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb01c15c970 0x7fb01c156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:02.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb023a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c168b90 con 0x7fb01c15c970 2024-09-10T22:42:02.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb023a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c168a10 con 0x7fb01c0cf790 2024-09-10T22:42:02.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb023a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb01c168d10 con 0x7fb01c0cc120 2024-09-10T22:42:02.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb021a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb01c15c970 0x7fb01c156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:02.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb021a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb01c15c970 0x7fb01c156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35554/0 (socket says 172.21.15.103:35554) 2024-09-10T22:42:02.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb021a00640 1 -- 172.21.15.103:0/1418133217 learned_addr learned my addr 172.21.15.103:0/1418133217 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:02.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb013e00640 1 --2- 172.21.15.103:0/1418133217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01c0cf790 0x7fb01c0a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:02.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb021a00640 1 -- 172.21.15.103:0/1418133217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb01c0cc120 msgr2=0x7fb01c144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:02.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb021a00640 1 --2- 172.21.15.103:0/1418133217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb01c0cc120 0x7fb01c144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:02.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb021a00640 1 -- 172.21.15.103:0/1418133217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01c0cf790 msgr2=0x7fb01c0a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:02.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb021a00640 1 --2- 172.21.15.103:0/1418133217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01c0cf790 0x7fb01c0a9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:02.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb021a00640 1 -- 172.21.15.103:0/1418133217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01c152ea0 con 0x7fb01c15c970 2024-09-10T22:42:02.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb013e00640 1 --2- 172.21.15.103:0/1418133217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01c0cf790 0x7fb01c0a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb021a00640 1 --2- 172.21.15.103:0/1418133217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb01c15c970 0x7fb01c156390 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fb014009b10 tx=0x7fb0140a58d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb019600640 1 -- 172.21.15.103:0/1418133217 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0140bb070 con 0x7fb01c15c970 2024-09-10T22:42:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb019600640 1 -- 172.21.15.103:0/1418133217 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb014004d40 con 0x7fb01c15c970 2024-09-10T22:42:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb019600640 1 -- 172.21.15.103:0/1418133217 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0140b2040 con 0x7fb01c15c970 2024-09-10T22:42:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb023a00640 1 -- 172.21.15.103:0/1418133217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb01c153140 con 0x7fb01c15c970 2024-09-10T22:42:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb023a00640 1 -- 172.21.15.103:0/1418133217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb01c153700 con 0x7fb01c15c970 2024-09-10T22:42:02.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb023a00640 1 -- 172.21.15.103:0/1418133217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb01c0cfc20 con 0x7fb01c15c970 2024-09-10T22:42:02.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.684+0000 7fb019600640 1 -- 172.21.15.103:0/1418133217 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb0140b5030 con 0x7fb01c15c970 2024-09-10T22:42:02.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.688+0000 7fb019600640 1 --2- 172.21.15.103:0/1418133217 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faff80725e0 0x7faff8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:02.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.688+0000 7fb019600640 1 -- 172.21.15.103:0/1418133217 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fb01412d2f0 con 0x7fb01c15c970 2024-09-10T22:42:02.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.688+0000 7fb021000640 1 --2- 172.21.15.103:0/1418133217 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faff80725e0 0x7faff8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:02.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.688+0000 7fb021000640 1 --2- 172.21.15.103:0/1418133217 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faff80725e0 0x7faff8074aa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb01c15da50 tx=0x7fb00c005f50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:02.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.692+0000 7fb019600640 1 -- 172.21.15.103:0/1418133217 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb014016770 con 0x7fb01c15c970 2024-09-10T22:42:02.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.888+0000 7fb023a00640 1 -- 172.21.15.103:0/1418133217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb01c15df20 con 0x7fb01c15c970 2024-09-10T22:42:02.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.888+0000 7fb019600640 1 -- 172.21.15.103:0/1418133217 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5279 (secure 0 0 0) 0x7fb0140f8800 con 0x7fb01c15c970 2024-09-10T22:42:02.893 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:02.893 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":45,"btime":"2024-09-10T22:41:45:168066+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/1187797704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1187797704},{"type":"v1","addr":"172.21.15.131:6836","nonce":1187797704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:41:06.381695+0000","modified":"2024-09-10T22:41:45.105121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5547,"mds_1":5544,"mds_2":5153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5153":{"gid":5153,"name":"d","rank":2,"incarnation":39,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6837/3348473142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3348473142},{"type":"v1","addr":"172.21.15.131:6837","nonce":3348473142}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5544":{"gid":5544,"name":"c","rank":1,"incarnation":37,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3910783847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":3910783847},{"type":"v1","addr":"172.21.15.103:6834","nonce":3910783847}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5547":{"gid":5547,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/343761048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":343761048},{"type":"v1","addr":"172.21.15.103:6835","nonce":343761048}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5547,"qdb_cluster":[5547,5544,5153]},"id":3}]} 2024-09-10T22:42:02.893 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 45 2024-09-10T22:42:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.892+0000 7fb023a00640 1 -- 172.21.15.103:0/1418133217 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faff80725e0 msgr2=0x7faff8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.892+0000 7fb023a00640 1 --2- 172.21.15.103:0/1418133217 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faff80725e0 0x7faff8074aa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb01c15da50 tx=0x7fb00c005f50 comp rx=0 tx=0).stop 2024-09-10T22:42:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.892+0000 7fb023a00640 1 -- 172.21.15.103:0/1418133217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb01c15c970 msgr2=0x7fb01c156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.892+0000 7fb023a00640 1 --2- 172.21.15.103:0/1418133217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb01c15c970 0x7fb01c156390 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fb014009b10 tx=0x7fb0140a58d0 comp rx=0 tx=0).stop 2024-09-10T22:42:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.892+0000 7fb023a00640 1 -- 172.21.15.103:0/1418133217 shutdown_connections 2024-09-10T22:42:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.892+0000 7fb023a00640 1 --2- 172.21.15.103:0/1418133217 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faff80725e0 0x7faff8074aa0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.892+0000 7fb023a00640 1 --2- 172.21.15.103:0/1418133217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb01c15c970 0x7fb01c156390 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.892+0000 7fb023a00640 1 --2- 172.21.15.103:0/1418133217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01c0cf790 0x7fb01c0a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.892+0000 7fb023a00640 1 --2- 172.21.15.103:0/1418133217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb01c0cc120 0x7fb01c144480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.892+0000 7fb023a00640 1 -- 172.21.15.103:0/1418133217 >> 172.21.15.103:0/1418133217 conn(0x7fb01c06cc00 msgr2=0x7fb01c15f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.892+0000 7fb023a00640 1 -- 172.21.15.103:0/1418133217 shutdown_connections 2024-09-10T22:42:02.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:02.892+0000 7fb023a00640 1 -- 172.21.15.103:0/1418133217 wait complete. 2024-09-10T22:42:02.913 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:42:03.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.056+0000 7fa802200640 1 -- 172.21.15.103:0/1358000014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7fc073510 msgr2=0x7fa7fc073970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:03.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.056+0000 7fa802200640 1 --2- 172.21.15.103:0/1358000014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7fc073510 0x7fa7fc073970 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8009900 tx=0x7fa7e801c8e0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.056+0000 7fa802200640 1 -- 172.21.15.103:0/1358000014 shutdown_connections 2024-09-10T22:42:03.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.056+0000 7fa802200640 1 --2- 172.21.15.103:0/1358000014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7fc073510 0x7fa7fc073970 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.056+0000 7fa802200640 1 --2- 172.21.15.103:0/1358000014 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7fc06fc60 0x7fa7fc070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.056+0000 7fa802200640 1 -- 172.21.15.103:0/1358000014 >> 172.21.15.103:0/1358000014 conn(0x7fa7fc0cd3d0 msgr2=0x7fa7fc0cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:03.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.056+0000 7fa802200640 1 -- 172.21.15.103:0/1358000014 shutdown_connections 2024-09-10T22:42:03.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.056+0000 7fa802200640 1 -- 172.21.15.103:0/1358000014 wait complete. 2024-09-10T22:42:03.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa802200640 1 Processor -- start 2024-09-10T22:42:03.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa802200640 1 -- start start 2024-09-10T22:42:03.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa802200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7fc06fc60 0x7fa7fc1f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:03.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa802200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7fc073510 0x7fa7fc14b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:03.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa802200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7fc15e390 0x7fa7fc163b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:03.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa802200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc1680c0 con 0x7fa7fc15e390 2024-09-10T22:42:03.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa802200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc167f40 con 0x7fa7fc073510 2024-09-10T22:42:03.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa802200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa7fc168240 con 0x7fa7fc06fc60 2024-09-10T22:42:03.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa7fbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7fc15e390 0x7fa7fc163b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:03.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa7fbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7fc15e390 0x7fa7fc163b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35572/0 (socket says 172.21.15.103:35572) 2024-09-10T22:42:03.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa7fbe00640 1 -- 172.21.15.103:0/3833794768 learned_addr learned my addr 172.21.15.103:0/3833794768 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:03.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa7fb400640 1 --2- 172.21.15.103:0/3833794768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7fc06fc60 0x7fa7fc1f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:03.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa7faa00640 1 --2- 172.21.15.103:0/3833794768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7fc073510 0x7fa7fc14b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:03.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa7fbe00640 1 -- 172.21.15.103:0/3833794768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7fc06fc60 msgr2=0x7fa7fc1f86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:03.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa7fbe00640 1 --2- 172.21.15.103:0/3833794768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7fc06fc60 0x7fa7fc1f86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa7fbe00640 1 -- 172.21.15.103:0/3833794768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7fc073510 msgr2=0x7fa7fc14b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:03.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa7fbe00640 1 --2- 172.21.15.103:0/3833794768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7fc073510 0x7fa7fc14b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa7fbe00640 1 -- 172.21.15.103:0/3833794768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7fc1f8c00 con 0x7fa7fc15e390 2024-09-10T22:42:03.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa7fbe00640 1 --2- 172.21.15.103:0/3833794768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7fc15e390 0x7fa7fc163b30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400c740 tx=0x7fa7f400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:03.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa7f3400640 1 -- 172.21.15.103:0/3833794768 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4003b80 con 0x7fa7fc15e390 2024-09-10T22:42:03.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa7f3400640 1 -- 172.21.15.103:0/3833794768 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7f400ce50 con 0x7fa7fc15e390 2024-09-10T22:42:03.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa802200640 1 -- 172.21.15.103:0/3833794768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7fc14b8c0 con 0x7fa7fc15e390 2024-09-10T22:42:03.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa7f3400640 1 -- 172.21.15.103:0/3833794768 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400a850 con 0x7fa7fc15e390 2024-09-10T22:42:03.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa802200640 1 -- 172.21.15.103:0/3833794768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7fc158ca0 con 0x7fa7fc15e390 2024-09-10T22:42:03.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.060+0000 7fa802200640 1 -- 172.21.15.103:0/3833794768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7fc070040 con 0x7fa7fc15e390 2024-09-10T22:42:03.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.064+0000 7fa7f3400640 1 -- 172.21.15.103:0/3833794768 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa7f400a9f0 con 0x7fa7fc15e390 2024-09-10T22:42:03.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.064+0000 7fa7f3400640 1 --2- 172.21.15.103:0/3833794768 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa7dc072610 0x7fa7dc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:03.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.064+0000 7fa7f3400640 1 -- 172.21.15.103:0/3833794768 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fa7f40930f0 con 0x7fa7fc15e390 2024-09-10T22:42:03.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.064+0000 7fa7fb400640 1 --2- 172.21.15.103:0/3833794768 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa7dc072610 0x7fa7dc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:03.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.064+0000 7fa7fb400640 1 --2- 172.21.15.103:0/3833794768 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa7dc072610 0x7fa7dc074ad0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc1597e0 tx=0x7fa7ec0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.068+0000 7fa7f3400640 1 -- 172.21.15.103:0/3833794768 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa7fc1f8c00 con 0x7fa7fc15e390 2024-09-10T22:42:03.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.268+0000 7fa802200640 1 -- 172.21.15.103:0/3833794768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7fc0c7130 con 0x7fa7fc15e390 2024-09-10T22:42:03.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.268+0000 7fa7f3400640 1 -- 172.21.15.103:0/3833794768 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5279 (secure 0 0 0) 0x7fa7f405dfb0 con 0x7fa7fc15e390 2024-09-10T22:42:03.271 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:03.271 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":45,"btime":"2024-09-10T22:41:45:168066+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/1187797704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1187797704},{"type":"v1","addr":"172.21.15.131:6836","nonce":1187797704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:41:06.381695+0000","modified":"2024-09-10T22:41:45.105121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5547,"mds_1":5544,"mds_2":5153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5153":{"gid":5153,"name":"d","rank":2,"incarnation":39,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6837/3348473142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3348473142},{"type":"v1","addr":"172.21.15.131:6837","nonce":3348473142}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5544":{"gid":5544,"name":"c","rank":1,"incarnation":37,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3910783847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":3910783847},{"type":"v1","addr":"172.21.15.103:6834","nonce":3910783847}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5547":{"gid":5547,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/343761048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":343761048},{"type":"v1","addr":"172.21.15.103:6835","nonce":343761048}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5547,"qdb_cluster":[5547,5544,5153]},"id":3}]} 2024-09-10T22:42:03.272 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 45 2024-09-10T22:42:03.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.272+0000 7fa802200640 1 -- 172.21.15.103:0/3833794768 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa7dc072610 msgr2=0x7fa7dc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:03.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.272+0000 7fa802200640 1 --2- 172.21.15.103:0/3833794768 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa7dc072610 0x7fa7dc074ad0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc1597e0 tx=0x7fa7ec0091e0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.272+0000 7fa802200640 1 -- 172.21.15.103:0/3833794768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7fc15e390 msgr2=0x7fa7fc163b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:03.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.272+0000 7fa802200640 1 --2- 172.21.15.103:0/3833794768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7fc15e390 0x7fa7fc163b30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400c740 tx=0x7fa7f400cc00 comp rx=0 tx=0).stop 2024-09-10T22:42:03.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.272+0000 7fa802200640 1 -- 172.21.15.103:0/3833794768 shutdown_connections 2024-09-10T22:42:03.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.272+0000 7fa802200640 1 --2- 172.21.15.103:0/3833794768 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa7dc072610 0x7fa7dc074ad0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.272+0000 7fa802200640 1 --2- 172.21.15.103:0/3833794768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7fc15e390 0x7fa7fc163b30 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.272+0000 7fa802200640 1 --2- 172.21.15.103:0/3833794768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7fc073510 0x7fa7fc14b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.272+0000 7fa802200640 1 --2- 172.21.15.103:0/3833794768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7fc06fc60 0x7fa7fc1f86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.272+0000 7fa802200640 1 -- 172.21.15.103:0/3833794768 >> 172.21.15.103:0/3833794768 conn(0x7fa7fc0cd3d0 msgr2=0x7fa7fc0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:03.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.272+0000 7fa802200640 1 -- 172.21.15.103:0/3833794768 shutdown_connections 2024-09-10T22:42:03.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.272+0000 7fa802200640 1 -- 172.21.15.103:0/3833794768 wait complete. 2024-09-10T22:42:03.297 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:42:03.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.436+0000 7fefdea00640 1 -- 172.21.15.103:0/2015866213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd815be30 msgr2=0x7fefd80ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:03.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.436+0000 7fefdea00640 1 --2- 172.21.15.103:0/2015866213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd815be30 0x7fefd80ce0c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fefc8009840 tx=0x7fefc801c790 comp rx=0 tx=0).stop 2024-09-10T22:42:03.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.436+0000 7fefdea00640 1 -- 172.21.15.103:0/2015866213 shutdown_connections 2024-09-10T22:42:03.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.436+0000 7fefdea00640 1 --2- 172.21.15.103:0/2015866213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd815be30 0x7fefd80ce0c0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.436+0000 7fefdea00640 1 -- 172.21.15.103:0/2015866213 >> 172.21.15.103:0/2015866213 conn(0x7fefd80d1ac0 msgr2=0x7fefd80d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:03.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.436+0000 7fefdea00640 1 -- 172.21.15.103:0/2015866213 shutdown_connections 2024-09-10T22:42:03.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.436+0000 7fefdea00640 1 -- 172.21.15.103:0/2015866213 wait complete. 2024-09-10T22:42:03.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.436+0000 7fefdea00640 1 Processor -- start 2024-09-10T22:42:03.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.436+0000 7fefdea00640 1 -- start start 2024-09-10T22:42:03.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefdea00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fefd80ae9c0 0x7fefd81536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:03.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefdea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd80b09c0 0x7fefd806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:03.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefdea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefd815be30 0x7fefd814ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:03.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefdea00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fefd8169e00 con 0x7fefd80b09c0 2024-09-10T22:42:03.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefdea00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fefd8169c80 con 0x7fefd815be30 2024-09-10T22:42:03.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefdea00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fefd8169f80 con 0x7fefd80ae9c0 2024-09-10T22:42:03.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefcf400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd80b09c0 0x7fefd806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:03.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefcf400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd80b09c0 0x7fefd806dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35598/0 (socket says 172.21.15.103:35598) 2024-09-10T22:42:03.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefcf400640 1 -- 172.21.15.103:0/138057303 learned_addr learned my addr 172.21.15.103:0/138057303 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:03.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefcf400640 1 -- 172.21.15.103:0/138057303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fefd80ae9c0 msgr2=0x7fefd81536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:03.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefcf400640 1 --2- 172.21.15.103:0/138057303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fefd80ae9c0 0x7fefd81536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefcf400640 1 -- 172.21.15.103:0/138057303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefd815be30 msgr2=0x7fefd814ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:03.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefdca00640 1 --2- 172.21.15.103:0/138057303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefd815be30 0x7fefd814ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:03.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefcf400640 1 --2- 172.21.15.103:0/138057303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefd815be30 0x7fefd814ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefcf400640 1 -- 172.21.15.103:0/138057303 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd806e410 con 0x7fefd80b09c0 2024-09-10T22:42:03.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefdca00640 1 --2- 172.21.15.103:0/138057303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefd815be30 0x7fefd814ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:03.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefcf400640 1 --2- 172.21.15.103:0/138057303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd80b09c0 0x7fefd806dd10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fefc000c490 tx=0x7fefc0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:03.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefd4c00640 1 -- 172.21.15.103:0/138057303 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0017070 con 0x7fefd80b09c0 2024-09-10T22:42:03.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefd4c00640 1 -- 172.21.15.103:0/138057303 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefc0003600 con 0x7fefd80b09c0 2024-09-10T22:42:03.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefd4c00640 1 -- 172.21.15.103:0/138057303 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0003a90 con 0x7fefd80b09c0 2024-09-10T22:42:03.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefdea00640 1 -- 172.21.15.103:0/138057303 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd806e6f0 con 0x7fefd80b09c0 2024-09-10T22:42:03.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefdea00640 1 -- 172.21.15.103:0/138057303 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd806ecb0 con 0x7fefd80b09c0 2024-09-10T22:42:03.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.440+0000 7fefdea00640 1 -- 172.21.15.103:0/138057303 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd80aee10 con 0x7fefd80b09c0 2024-09-10T22:42:03.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.444+0000 7fefd4c00640 1 -- 172.21.15.103:0/138057303 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fefc0003c30 con 0x7fefd80b09c0 2024-09-10T22:42:03.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.444+0000 7fefd4c00640 1 --2- 172.21.15.103:0/138057303 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fefb40725e0 0x7fefb4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:03.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.444+0000 7fefd4c00640 1 -- 172.21.15.103:0/138057303 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7fefc0092640 con 0x7fefd80b09c0 2024-09-10T22:42:03.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.444+0000 7fefd7e00640 1 --2- 172.21.15.103:0/138057303 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fefb40725e0 0x7fefb4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:03.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.444+0000 7fefd7e00640 1 --2- 172.21.15.103:0/138057303 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fefb40725e0 0x7fefb4074aa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fefc80af000 tx=0x7fefc8019530 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:03.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.448+0000 7fefd4c00640 1 -- 172.21.15.103:0/138057303 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fefc005db50 con 0x7fefd80b09c0 2024-09-10T22:42:03.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.612+0000 7fefdea00640 1 -- 172.21.15.103:0/138057303 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fefd80b0700 con 0x7fefd80b09c0 2024-09-10T22:42:03.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.616+0000 7fefd4c00640 1 -- 172.21.15.103:0/138057303 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+17102 (secure 0 0 0) 0x7fefc005d450 con 0x7fefd80b09c0 2024-09-10T22:42:03.617 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:03.618 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":57,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:41:32.113651+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:41:04.777605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-10T22:41:05.333657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.21","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:42:03.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.616+0000 7fefdea00640 1 -- 172.21.15.103:0/138057303 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fefb40725e0 msgr2=0x7fefb4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:03.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.616+0000 7fefdea00640 1 --2- 172.21.15.103:0/138057303 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fefb40725e0 0x7fefb4074aa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fefc80af000 tx=0x7fefc8019530 comp rx=0 tx=0).stop 2024-09-10T22:42:03.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.616+0000 7fefdea00640 1 -- 172.21.15.103:0/138057303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd80b09c0 msgr2=0x7fefd806dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:03.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.616+0000 7fefdea00640 1 --2- 172.21.15.103:0/138057303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd80b09c0 0x7fefd806dd10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fefc000c490 tx=0x7fefc0001e80 comp rx=0 tx=0).stop 2024-09-10T22:42:03.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.616+0000 7fefdea00640 1 -- 172.21.15.103:0/138057303 shutdown_connections 2024-09-10T22:42:03.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.616+0000 7fefdea00640 1 --2- 172.21.15.103:0/138057303 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fefb40725e0 0x7fefb4074aa0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.616+0000 7fefdea00640 1 --2- 172.21.15.103:0/138057303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefd815be30 0x7fefd814ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.616+0000 7fefdea00640 1 --2- 172.21.15.103:0/138057303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd80b09c0 0x7fefd806dd10 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.616+0000 7fefdea00640 1 --2- 172.21.15.103:0/138057303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fefd80ae9c0 0x7fefd81536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.616+0000 7fefdea00640 1 -- 172.21.15.103:0/138057303 >> 172.21.15.103:0/138057303 conn(0x7fefd80d1ac0 msgr2=0x7fefd8157b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:03.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.616+0000 7fefdea00640 1 -- 172.21.15.103:0/138057303 shutdown_connections 2024-09-10T22:42:03.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.616+0000 7fefdea00640 1 -- 172.21.15.103:0/138057303 wait complete. 2024-09-10T22:42:03.639 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T22:42:03.640 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:42:03.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.780+0000 7f00ca800640 1 -- 172.21.15.103:0/41906821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00c40cf260 msgr2=0x7f00c40b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:03.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.780+0000 7f00ca800640 1 --2- 172.21.15.103:0/41906821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00c40cf260 0x7f00c40b2c10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f00b4009840 tx=0x7f00b401c820 comp rx=0 tx=0).stop 2024-09-10T22:42:03.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.780+0000 7f00ca800640 1 -- 172.21.15.103:0/41906821 shutdown_connections 2024-09-10T22:42:03.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.780+0000 7f00ca800640 1 --2- 172.21.15.103:0/41906821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00c40cf260 0x7f00c40b2c10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.780+0000 7f00ca800640 1 -- 172.21.15.103:0/41906821 >> 172.21.15.103:0/41906821 conn(0x7f00c406cc00 msgr2=0x7f00c406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:03.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.780+0000 7f00ca800640 1 -- 172.21.15.103:0/41906821 shutdown_connections 2024-09-10T22:42:03.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.780+0000 7f00ca800640 1 -- 172.21.15.103:0/41906821 wait complete. 2024-09-10T22:42:03.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.780+0000 7f00ca800640 1 Processor -- start 2024-09-10T22:42:03.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.780+0000 7f00ca800640 1 -- start start 2024-09-10T22:42:03.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.780+0000 7f00ca800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c4072c10 0x7f00c4149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:03.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.780+0000 7f00ca800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00c40b3150 0x7f00c414a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:03.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.780+0000 7f00ca800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00c40cf260 0x7f00c4148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:03.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.780+0000 7f00ca800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f00c4167e40 con 0x7f00c4072c10 2024-09-10T22:42:03.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.780+0000 7f00ca800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f00c4157eb0 con 0x7f00c40b3150 2024-09-10T22:42:03.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.780+0000 7f00ca800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f00c4167fc0 con 0x7f00c40cf260 2024-09-10T22:42:03.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00c3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c4072c10 0x7f00c4149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:03.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00c3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c4072c10 0x7f00c4149bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35604/0 (socket says 172.21.15.103:35604) 2024-09-10T22:42:03.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00c3400640 1 -- 172.21.15.103:0/490204513 learned_addr learned my addr 172.21.15.103:0/490204513 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:03.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00bbe00640 1 --2- 172.21.15.103:0/490204513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00c40b3150 0x7f00c414a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:03.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00c3e00640 1 --2- 172.21.15.103:0/490204513 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00c40cf260 0x7f00c4148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:03.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00c3400640 1 -- 172.21.15.103:0/490204513 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00c40cf260 msgr2=0x7f00c4148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:03.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00c3400640 1 --2- 172.21.15.103:0/490204513 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00c40cf260 0x7f00c4148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00c3400640 1 -- 172.21.15.103:0/490204513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00c40b3150 msgr2=0x7f00c414a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:03.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00c3400640 1 --2- 172.21.15.103:0/490204513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00c40b3150 0x7f00c414a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00c3400640 1 -- 172.21.15.103:0/490204513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c40af170 con 0x7f00c4072c10 2024-09-10T22:42:03.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00c3e00640 1 --2- 172.21.15.103:0/490204513 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00c40cf260 0x7f00c4148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:03.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00c3400640 1 --2- 172.21.15.103:0/490204513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c4072c10 0x7f00c4149bf0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f00b4000c10 tx=0x7f00b40a65b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:03.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00bb400640 1 -- 172.21.15.103:0/490204513 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b4005030 con 0x7f00c4072c10 2024-09-10T22:42:03.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00bb400640 1 -- 172.21.15.103:0/490204513 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00b40051d0 con 0x7f00c4072c10 2024-09-10T22:42:03.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00bb400640 1 -- 172.21.15.103:0/490204513 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b40055c0 con 0x7f00c4072c10 2024-09-10T22:42:03.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00ca800640 1 -- 172.21.15.103:0/490204513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c414cb60 con 0x7f00c4072c10 2024-09-10T22:42:03.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00ca800640 1 -- 172.21.15.103:0/490204513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c414d120 con 0x7f00c4072c10 2024-09-10T22:42:03.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00ca800640 1 -- 172.21.15.103:0/490204513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00c4152d20 con 0x7f00c4072c10 2024-09-10T22:42:03.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.784+0000 7f00bb400640 1 -- 172.21.15.103:0/490204513 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f00b40046d0 con 0x7f00c4072c10 2024-09-10T22:42:03.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.788+0000 7f00bb400640 1 --2- 172.21.15.103:0/490204513 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f00a00725e0 0x7f00a0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:03.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.788+0000 7f00bb400640 1 -- 172.21.15.103:0/490204513 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f00b412cf00 con 0x7f00c4072c10 2024-09-10T22:42:03.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.788+0000 7f00bbe00640 1 --2- 172.21.15.103:0/490204513 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f00a00725e0 0x7f00a0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:03.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.788+0000 7f00bbe00640 1 --2- 172.21.15.103:0/490204513 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f00a00725e0 0x7f00a0074aa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f00c41f9a00 tx=0x7f00ac009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:03.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.792+0000 7f00bb400640 1 -- 172.21.15.103:0/490204513 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f00b40bf070 con 0x7f00c4072c10 2024-09-10T22:42:03.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.988+0000 7f00ca800640 1 -- 172.21.15.103:0/490204513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00c414a130 con 0x7f00c4072c10 2024-09-10T22:42:03.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.988+0000 7f00bb400640 1 -- 172.21.15.103:0/490204513 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5279 (secure 0 0 0) 0x7f00b40ac030 con 0x7f00c4072c10 2024-09-10T22:42:03.990 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:03.990 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":45,"btime":"2024-09-10T22:41:45:168066+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/1187797704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1187797704},{"type":"v1","addr":"172.21.15.131:6836","nonce":1187797704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:41:06.381695+0000","modified":"2024-09-10T22:41:45.105121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5547,"mds_1":5544,"mds_2":5153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5153":{"gid":5153,"name":"d","rank":2,"incarnation":39,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6837/3348473142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3348473142},{"type":"v1","addr":"172.21.15.131:6837","nonce":3348473142}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5544":{"gid":5544,"name":"c","rank":1,"incarnation":37,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3910783847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":3910783847},{"type":"v1","addr":"172.21.15.103:6834","nonce":3910783847}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5547":{"gid":5547,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/343761048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":343761048},{"type":"v1","addr":"172.21.15.103:6835","nonce":343761048}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5547,"qdb_cluster":[5547,5544,5153]},"id":3}]} 2024-09-10T22:42:03.990 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 45 2024-09-10T22:42:03.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.988+0000 7f00ca800640 1 -- 172.21.15.103:0/490204513 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f00a00725e0 msgr2=0x7f00a0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:03.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.988+0000 7f00ca800640 1 --2- 172.21.15.103:0/490204513 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f00a00725e0 0x7f00a0074aa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f00c41f9a00 tx=0x7f00ac009040 comp rx=0 tx=0).stop 2024-09-10T22:42:03.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.988+0000 7f00ca800640 1 -- 172.21.15.103:0/490204513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c4072c10 msgr2=0x7f00c4149bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:03.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.988+0000 7f00ca800640 1 --2- 172.21.15.103:0/490204513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c4072c10 0x7f00c4149bf0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f00b4000c10 tx=0x7f00b40a65b0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.988+0000 7f00ca800640 1 -- 172.21.15.103:0/490204513 shutdown_connections 2024-09-10T22:42:03.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.988+0000 7f00ca800640 1 --2- 172.21.15.103:0/490204513 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f00a00725e0 0x7f00a0074aa0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.988+0000 7f00ca800640 1 --2- 172.21.15.103:0/490204513 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00c40cf260 0x7f00c4148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.988+0000 7f00ca800640 1 --2- 172.21.15.103:0/490204513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00c40b3150 0x7f00c414a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.988+0000 7f00ca800640 1 --2- 172.21.15.103:0/490204513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c4072c10 0x7f00c4149bf0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:03.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.988+0000 7f00ca800640 1 -- 172.21.15.103:0/490204513 >> 172.21.15.103:0/490204513 conn(0x7f00c406cc00 msgr2=0x7f00c4156820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:03.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.988+0000 7f00ca800640 1 -- 172.21.15.103:0/490204513 shutdown_connections 2024-09-10T22:42:03.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:03.988+0000 7f00ca800640 1 -- 172.21.15.103:0/490204513 wait complete. 2024-09-10T22:42:04.010 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:42:04.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.148+0000 7f92f3400640 1 -- 172.21.15.103:0/454302538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92ec0aeb40 msgr2=0x7f92ec072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:04.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.148+0000 7f92f3400640 1 --2- 172.21.15.103:0/454302538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92ec0aeb40 0x7f92ec072e30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f92d8009840 tx=0x7f92d801c790 comp rx=0 tx=0).stop 2024-09-10T22:42:04.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.148+0000 7f92f3400640 1 -- 172.21.15.103:0/454302538 shutdown_connections 2024-09-10T22:42:04.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.148+0000 7f92f3400640 1 --2- 172.21.15.103:0/454302538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92ec0cf790 0x7f92ec0cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.148+0000 7f92f3400640 1 --2- 172.21.15.103:0/454302538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92ec0aeb40 0x7f92ec072e30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.148+0000 7f92f3400640 1 -- 172.21.15.103:0/454302538 >> 172.21.15.103:0/454302538 conn(0x7f92ec06cc00 msgr2=0x7f92ec06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:04.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.148+0000 7f92f3400640 1 -- 172.21.15.103:0/454302538 shutdown_connections 2024-09-10T22:42:04.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.148+0000 7f92f3400640 1 -- 172.21.15.103:0/454302538 wait complete. 2024-09-10T22:42:04.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92f3400640 1 Processor -- start 2024-09-10T22:42:04.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92f3400640 1 -- start start 2024-09-10T22:42:04.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92f3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92ec0aeb40 0x7f92ec1fb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:04.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92f3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92ec0cc120 0x7f92ec1f7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:04.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92f3400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92ec0cf790 0x7f92ec159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:04.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92f3400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec168c40 con 0x7f92ec0cc120 2024-09-10T22:42:04.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92f3400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec168ac0 con 0x7f92ec0aeb40 2024-09-10T22:42:04.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92f3400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f92ec168dc0 con 0x7f92ec0cf790 2024-09-10T22:42:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92ebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92ec0cc120 0x7f92ec1f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92ebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92ec0cc120 0x7f92ec1f7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35614/0 (socket says 172.21.15.103:35614) 2024-09-10T22:42:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92ebe00640 1 -- 172.21.15.103:0/2422551552 learned_addr learned my addr 172.21.15.103:0/2422551552 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92f0a00640 1 --2- 172.21.15.103:0/2422551552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92ec0aeb40 0x7f92ec1fb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92f1400640 1 --2- 172.21.15.103:0/2422551552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92ec0cf790 0x7f92ec159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92ebe00640 1 -- 172.21.15.103:0/2422551552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92ec0cf790 msgr2=0x7f92ec159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92ebe00640 1 --2- 172.21.15.103:0/2422551552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92ec0cf790 0x7f92ec159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92ebe00640 1 -- 172.21.15.103:0/2422551552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92ec0aeb40 msgr2=0x7f92ec1fb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92ebe00640 1 --2- 172.21.15.103:0/2422551552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92ec0aeb40 0x7f92ec1fb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92ebe00640 1 -- 172.21.15.103:0/2422551552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92ec1f7b60 con 0x7f92ec0cc120 2024-09-10T22:42:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92f1400640 1 --2- 172.21.15.103:0/2422551552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92ec0cf790 0x7f92ec159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92ebe00640 1 --2- 172.21.15.103:0/2422551552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92ec0cc120 0x7f92ec1f7130 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f92d8009790 tx=0x7f92d8005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92e8c00640 1 -- 172.21.15.103:0/2422551552 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d80b2040 con 0x7f92ec0cc120 2024-09-10T22:42:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92e8c00640 1 -- 172.21.15.103:0/2422551552 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92d8004320 con 0x7f92ec0cc120 2024-09-10T22:42:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92e8c00640 1 -- 172.21.15.103:0/2422551552 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d8005280 con 0x7f92ec0cc120 2024-09-10T22:42:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92f3400640 1 -- 172.21.15.103:0/2422551552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92ec1f7e40 con 0x7f92ec0cc120 2024-09-10T22:42:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92f3400640 1 -- 172.21.15.103:0/2422551552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92ec1fab60 con 0x7f92ec0cc120 2024-09-10T22:42:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.152+0000 7f92f3400640 1 -- 172.21.15.103:0/2422551552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92ec1f8080 con 0x7f92ec0cc120 2024-09-10T22:42:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.156+0000 7f92e8c00640 1 -- 172.21.15.103:0/2422551552 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f92d80b5030 con 0x7f92ec0cc120 2024-09-10T22:42:04.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.156+0000 7f92e8c00640 1 --2- 172.21.15.103:0/2422551552 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f92cc0725e0 0x7f92cc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:04.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.156+0000 7f92e8c00640 1 -- 172.21.15.103:0/2422551552 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f92d812ca10 con 0x7f92ec0cc120 2024-09-10T22:42:04.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.156+0000 7f92f0a00640 1 --2- 172.21.15.103:0/2422551552 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f92cc0725e0 0x7f92cc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:04.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.156+0000 7f92f0a00640 1 --2- 172.21.15.103:0/2422551552 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f92cc0725e0 0x7f92cc074aa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f92dc001870 tx=0x7f92dc001800 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:04.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.160+0000 7f92e8c00640 1 -- 172.21.15.103:0/2422551552 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f92ec1f8080 con 0x7f92ec0cc120 2024-09-10T22:42:04.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.360+0000 7f92f3400640 1 -- 172.21.15.103:0/2422551552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92ec072e30 con 0x7f92ec0cc120 2024-09-10T22:42:04.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.360+0000 7f92e8c00640 1 -- 172.21.15.103:0/2422551552 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5279 (secure 0 0 0) 0x7f92d8016410 con 0x7f92ec0cc120 2024-09-10T22:42:04.364 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:04.365 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":45,"btime":"2024-09-10T22:41:45:168066+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/1187797704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1187797704},{"type":"v1","addr":"172.21.15.131:6836","nonce":1187797704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:41:06.381695+0000","modified":"2024-09-10T22:41:45.105121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5547,"mds_1":5544,"mds_2":5153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5153":{"gid":5153,"name":"d","rank":2,"incarnation":39,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6837/3348473142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3348473142},{"type":"v1","addr":"172.21.15.131:6837","nonce":3348473142}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5544":{"gid":5544,"name":"c","rank":1,"incarnation":37,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3910783847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":3910783847},{"type":"v1","addr":"172.21.15.103:6834","nonce":3910783847}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5547":{"gid":5547,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/343761048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":343761048},{"type":"v1","addr":"172.21.15.103:6835","nonce":343761048}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5547,"qdb_cluster":[5547,5544,5153]},"id":3}]} 2024-09-10T22:42:04.365 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 45 2024-09-10T22:42:04.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.364+0000 7f92f3400640 1 -- 172.21.15.103:0/2422551552 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f92cc0725e0 msgr2=0x7f92cc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:04.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.364+0000 7f92f3400640 1 --2- 172.21.15.103:0/2422551552 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f92cc0725e0 0x7f92cc074aa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f92dc001870 tx=0x7f92dc001800 comp rx=0 tx=0).stop 2024-09-10T22:42:04.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.364+0000 7f92f3400640 1 -- 172.21.15.103:0/2422551552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92ec0cc120 msgr2=0x7f92ec1f7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:04.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.364+0000 7f92f3400640 1 --2- 172.21.15.103:0/2422551552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92ec0cc120 0x7f92ec1f7130 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f92d8009790 tx=0x7f92d8005dc0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.364+0000 7f92f3400640 1 -- 172.21.15.103:0/2422551552 shutdown_connections 2024-09-10T22:42:04.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.364+0000 7f92f3400640 1 --2- 172.21.15.103:0/2422551552 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f92cc0725e0 0x7f92cc074aa0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.364+0000 7f92f3400640 1 --2- 172.21.15.103:0/2422551552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92ec0cf790 0x7f92ec159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.364+0000 7f92f3400640 1 --2- 172.21.15.103:0/2422551552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92ec0cc120 0x7f92ec1f7130 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.364+0000 7f92f3400640 1 --2- 172.21.15.103:0/2422551552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92ec0aeb40 0x7f92ec1fb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.364+0000 7f92f3400640 1 -- 172.21.15.103:0/2422551552 >> 172.21.15.103:0/2422551552 conn(0x7f92ec06cc00 msgr2=0x7f92ec0b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:04.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.364+0000 7f92f3400640 1 -- 172.21.15.103:0/2422551552 shutdown_connections 2024-09-10T22:42:04.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.364+0000 7f92f3400640 1 -- 172.21.15.103:0/2422551552 wait complete. 2024-09-10T22:42:04.386 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:42:04.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.524+0000 7ff8c4200640 1 -- 172.21.15.103:0/668420068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8a4003a10 msgr2=0x7ff8a4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:04.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.524+0000 7ff8c4200640 1 --2- 172.21.15.103:0/668420068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8a4003a10 0x7ff8a4003e30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000c2e0 tx=0x7ff8b001cfc0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.524+0000 7ff8c2200640 1 -- 172.21.15.103:0/668420068 reap_dead start 2024-09-10T22:42:04.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.524+0000 7ff8c4200640 1 -- 172.21.15.103:0/668420068 shutdown_connections 2024-09-10T22:42:04.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.524+0000 7ff8c4200640 1 -- 172.21.15.103:0/668420068 >> 172.21.15.103:0/668420068 conn(0x7ff8bc0d1ac0 msgr2=0x7ff8bc0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:04.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.524+0000 7ff8c4200640 1 -- 172.21.15.103:0/668420068 shutdown_connections 2024-09-10T22:42:04.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.524+0000 7ff8c4200640 1 -- 172.21.15.103:0/668420068 wait complete. 2024-09-10T22:42:04.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c4200640 1 Processor -- start 2024-09-10T22:42:04.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c4200640 1 -- start start 2024-09-10T22:42:04.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c4200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8a4003a10 0x7ff8bc164010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c4200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8bc06fa30 0x7ff8bc0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c4200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8bc0b4c90 0x7ff8bc0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c4200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc0af970 con 0x7ff8bc0b4c90 2024-09-10T22:42:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c4200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc0af7f0 con 0x7ff8a4003a10 2024-09-10T22:42:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c4200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff8bc0afaf0 con 0x7ff8bc06fa30 2024-09-10T22:42:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c2200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8bc0b4c90 0x7ff8bc0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c2200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8bc0b4c90 0x7ff8bc0cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35630/0 (socket says 172.21.15.103:35630) 2024-09-10T22:42:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c2200640 1 -- 172.21.15.103:0/2238361130 learned_addr learned my addr 172.21.15.103:0/2238361130 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c0e00640 1 --2- 172.21.15.103:0/2238361130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8bc06fa30 0x7ff8bc0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c1800640 1 --2- 172.21.15.103:0/2238361130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8a4003a10 0x7ff8bc164010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c2200640 1 -- 172.21.15.103:0/2238361130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8bc06fa30 msgr2=0x7ff8bc0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:04.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c2200640 1 --2- 172.21.15.103:0/2238361130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8bc06fa30 0x7ff8bc0cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c2200640 1 -- 172.21.15.103:0/2238361130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8a4003a10 msgr2=0x7ff8bc164010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:04.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c2200640 1 --2- 172.21.15.103:0/2238361130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8a4003a10 0x7ff8bc164010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c2200640 1 -- 172.21.15.103:0/2238361130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8bc0b5380 con 0x7ff8bc0b4c90 2024-09-10T22:42:04.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c2200640 1 --2- 172.21.15.103:0/2238361130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8bc0b4c90 0x7ff8bc0cb390 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc073840 tx=0x7ff8b400fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:04.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8b9600640 1 -- 172.21.15.103:0/2238361130 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4004d30 con 0x7ff8bc0b4c90 2024-09-10T22:42:04.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8b9600640 1 -- 172.21.15.103:0/2238361130 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8b400eab0 con 0x7ff8bc0b4c90 2024-09-10T22:42:04.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8b9600640 1 -- 172.21.15.103:0/2238361130 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4005020 con 0x7ff8bc0b4c90 2024-09-10T22:42:04.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c4200640 1 -- 172.21.15.103:0/2238361130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8bc0b55f0 con 0x7ff8bc0b4c90 2024-09-10T22:42:04.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.528+0000 7ff8c4200640 1 -- 172.21.15.103:0/2238361130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8bc0b6fe0 con 0x7ff8bc0b4c90 2024-09-10T22:42:04.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.532+0000 7ff8c4200640 1 -- 172.21.15.103:0/2238361130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8bc0ce0c0 con 0x7ff8bc0b4c90 2024-09-10T22:42:04.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.532+0000 7ff8b9600640 1 -- 172.21.15.103:0/2238361130 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff8b400f040 con 0x7ff8bc0b4c90 2024-09-10T22:42:04.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.532+0000 7ff8b9600640 1 --2- 172.21.15.103:0/2238361130 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff89c072610 0x7ff89c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:04.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.532+0000 7ff8b9600640 1 -- 172.21.15.103:0/2238361130 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7ff8b4093ce0 con 0x7ff8bc0b4c90 2024-09-10T22:42:04.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.532+0000 7ff8c1800640 1 --2- 172.21.15.103:0/2238361130 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff89c072610 0x7ff89c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:04.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.532+0000 7ff8c1800640 1 --2- 172.21.15.103:0/2238361130 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff89c072610 0x7ff89c074ad0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff8b00ac000 tx=0x7ff8b0019e00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:04.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.536+0000 7ff8b9600640 1 -- 172.21.15.103:0/2238361130 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff8b405eb10 con 0x7ff8bc0b4c90 2024-09-10T22:42:04.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.704+0000 7ff8c4200640 1 -- 172.21.15.103:0/2238361130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8bc0d28a0 con 0x7ff8bc0b4c90 2024-09-10T22:42:04.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.704+0000 7ff8b9600640 1 -- 172.21.15.103:0/2238361130 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+17102 (secure 0 0 0) 0x7ff8b4063540 con 0x7ff8bc0b4c90 2024-09-10T22:42:04.708 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:04.708 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":57,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:41:32.113651+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:41:04.777605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-10T22:41:05.333657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.21","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:42:04.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.708+0000 7ff8c4200640 1 -- 172.21.15.103:0/2238361130 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff89c072610 msgr2=0x7ff89c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:04.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.708+0000 7ff8c4200640 1 --2- 172.21.15.103:0/2238361130 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff89c072610 0x7ff89c074ad0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff8b00ac000 tx=0x7ff8b0019e00 comp rx=0 tx=0).stop 2024-09-10T22:42:04.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.708+0000 7ff8c4200640 1 -- 172.21.15.103:0/2238361130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8bc0b4c90 msgr2=0x7ff8bc0cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:04.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.708+0000 7ff8c4200640 1 --2- 172.21.15.103:0/2238361130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8bc0b4c90 0x7ff8bc0cb390 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc073840 tx=0x7ff8b400fd90 comp rx=0 tx=0).stop 2024-09-10T22:42:04.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.708+0000 7ff8c4200640 1 -- 172.21.15.103:0/2238361130 shutdown_connections 2024-09-10T22:42:04.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.708+0000 7ff8c4200640 1 --2- 172.21.15.103:0/2238361130 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff89c072610 0x7ff89c074ad0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.708+0000 7ff8c4200640 1 --2- 172.21.15.103:0/2238361130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8bc0b4c90 0x7ff8bc0cb390 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.708+0000 7ff8c4200640 1 --2- 172.21.15.103:0/2238361130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8bc06fa30 0x7ff8bc0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.708+0000 7ff8c4200640 1 --2- 172.21.15.103:0/2238361130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8a4003a10 0x7ff8bc164010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.708+0000 7ff8c4200640 1 -- 172.21.15.103:0/2238361130 >> 172.21.15.103:0/2238361130 conn(0x7ff8bc0d1ac0 msgr2=0x7ff8bc15a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:04.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.708+0000 7ff8c4200640 1 -- 172.21.15.103:0/2238361130 shutdown_connections 2024-09-10T22:42:04.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.708+0000 7ff8c4200640 1 -- 172.21.15.103:0/2238361130 wait complete. 2024-09-10T22:42:04.730 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T22:42:04.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.868+0000 7f6b66600640 1 -- 172.21.15.103:0/3599669444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b48004be0 msgr2=0x7f6b48005020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:04.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.868+0000 7f6b66600640 1 --2- 172.21.15.103:0/3599669444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b48004be0 0x7f6b48005020 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009b30 tx=0x7f6b5401d230 comp rx=0 tx=0).stop 2024-09-10T22:42:04.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.868+0000 7f6b66600640 1 -- 172.21.15.103:0/3599669444 shutdown_connections 2024-09-10T22:42:04.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.868+0000 7f6b66600640 1 --2- 172.21.15.103:0/3599669444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b48004be0 0x7f6b48005020 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.868+0000 7f6b66600640 1 -- 172.21.15.103:0/3599669444 >> 172.21.15.103:0/3599669444 conn(0x7f6b600cc950 msgr2=0x7f6b600ccd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:04.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.868+0000 7f6b66600640 1 -- 172.21.15.103:0/3599669444 shutdown_connections 2024-09-10T22:42:04.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.868+0000 7f6b66600640 1 -- 172.21.15.103:0/3599669444 wait complete. 2024-09-10T22:42:04.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b66600640 1 Processor -- start 2024-09-10T22:42:04.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b66600640 1 -- start start 2024-09-10T22:42:04.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b66600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48004be0 0x7f6b60156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:04.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b66600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b600ae750 0x7f6b600aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:04.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b66600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b60153e40 0x7f6b600cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:04.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b66600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6006ec10 con 0x7f6b600ae750 2024-09-10T22:42:04.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b66600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6b600ce250 con 0x7f6b48004be0 2024-09-10T22:42:04.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b66600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6b6006ed90 con 0x7f6b60153e40 2024-09-10T22:42:04.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b5fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b600ae750 0x7f6b600aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:04.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b5fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b600ae750 0x7f6b600aec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35658/0 (socket says 172.21.15.103:35658) 2024-09-10T22:42:04.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b5fe00640 1 -- 172.21.15.103:0/3041780815 learned_addr learned my addr 172.21.15.103:0/3041780815 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b65200640 1 --2- 172.21.15.103:0/3041780815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48004be0 0x7f6b60156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b5fe00640 1 -- 172.21.15.103:0/3041780815 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b60153e40 msgr2=0x7f6b600cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b65c00640 1 --2- 172.21.15.103:0/3041780815 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b60153e40 0x7f6b600cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b5fe00640 1 --2- 172.21.15.103:0/3041780815 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b60153e40 0x7f6b600cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b5fe00640 1 -- 172.21.15.103:0/3041780815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48004be0 msgr2=0x7f6b60156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b5fe00640 1 --2- 172.21.15.103:0/3041780815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48004be0 0x7f6b60156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b5fe00640 1 -- 172.21.15.103:0/3041780815 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b600ad990 con 0x7f6b600ae750 2024-09-10T22:42:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b65200640 1 --2- 172.21.15.103:0/3041780815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48004be0 0x7f6b60156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b65c00640 1 --2- 172.21.15.103:0/3041780815 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b60153e40 0x7f6b600cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b5fe00640 1 --2- 172.21.15.103:0/3041780815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b600ae750 0x7f6b600aec20 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c004da0 tx=0x7f6b4c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b5cc00640 1 -- 172.21.15.103:0/3041780815 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c001d50 con 0x7f6b600ae750 2024-09-10T22:42:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b5cc00640 1 -- 172.21.15.103:0/3041780815 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b4c016070 con 0x7f6b600ae750 2024-09-10T22:42:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b66600640 1 -- 172.21.15.103:0/3041780815 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b600adc70 con 0x7f6b600ae750 2024-09-10T22:42:04.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b5cc00640 1 -- 172.21.15.103:0/3041780815 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c010b00 con 0x7f6b600ae750 2024-09-10T22:42:04.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.872+0000 7f6b66600640 1 -- 172.21.15.103:0/3041780815 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b600ae230 con 0x7f6b600ae750 2024-09-10T22:42:04.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.876+0000 7f6b66600640 1 -- 172.21.15.103:0/3041780815 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b6006f2f0 con 0x7f6b600ae750 2024-09-10T22:42:04.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.876+0000 7f6b5cc00640 1 -- 172.21.15.103:0/3041780815 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6b4c010ca0 con 0x7f6b600ae750 2024-09-10T22:42:04.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.876+0000 7f6b5cc00640 1 --2- 172.21.15.103:0/3041780815 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6b400725e0 0x7f6b40074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:04.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.876+0000 7f6b5cc00640 1 -- 172.21.15.103:0/3041780815 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6159+0+0 (secure 0 0 0) 0x7f6b4c093bd0 con 0x7f6b600ae750 2024-09-10T22:42:04.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.876+0000 7f6b65200640 1 --2- 172.21.15.103:0/3041780815 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6b400725e0 0x7f6b40074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:04.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.880+0000 7f6b65200640 1 --2- 172.21.15.103:0/3041780815 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6b400725e0 0x7f6b40074aa0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6b540ae000 tx=0x7f6b54019fd0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:04.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:04.880+0000 7f6b5cc00640 1 -- 172.21.15.103:0/3041780815 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6b4c05f0e0 con 0x7f6b600ae750 2024-09-10T22:42:05.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.080+0000 7f6b66600640 1 -- 172.21.15.103:0/3041780815 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6b600af750 con 0x7f6b600ae750 2024-09-10T22:42:05.082 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-10T22:42:05.080+0000 7fb5aba00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:42:05.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.084+0000 7f6b5cc00640 1 -- 172.21.15.103:0/3041780815 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v46) ==== 161+0+0 (secure 0 0 0) 0x7f6b4c05e9e0 con 0x7f6b600ae750 2024-09-10T22:42:05.084 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T22:42:05.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.084+0000 7f6b66600640 1 -- 172.21.15.103:0/3041780815 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6b400725e0 msgr2=0x7f6b40074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:05.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.084+0000 7f6b66600640 1 --2- 172.21.15.103:0/3041780815 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6b400725e0 0x7f6b40074aa0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6b540ae000 tx=0x7f6b54019fd0 comp rx=0 tx=0).stop 2024-09-10T22:42:05.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.084+0000 7f6b66600640 1 -- 172.21.15.103:0/3041780815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b600ae750 msgr2=0x7f6b600aec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:05.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.084+0000 7f6b66600640 1 --2- 172.21.15.103:0/3041780815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b600ae750 0x7f6b600aec20 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c004da0 tx=0x7f6b4c001640 comp rx=0 tx=0).stop 2024-09-10T22:42:05.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.084+0000 7f6b66600640 1 -- 172.21.15.103:0/3041780815 shutdown_connections 2024-09-10T22:42:05.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.084+0000 7f6b66600640 1 --2- 172.21.15.103:0/3041780815 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6b400725e0 0x7f6b40074aa0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:05.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.084+0000 7f6b66600640 1 --2- 172.21.15.103:0/3041780815 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b60153e40 0x7f6b600cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:05.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.084+0000 7f6b66600640 1 --2- 172.21.15.103:0/3041780815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b600ae750 0x7f6b600aec20 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:05.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.084+0000 7f6b66600640 1 --2- 172.21.15.103:0/3041780815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48004be0 0x7f6b60156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:05.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.084+0000 7f6b66600640 1 -- 172.21.15.103:0/3041780815 >> 172.21.15.103:0/3041780815 conn(0x7f6b600cc950 msgr2=0x7f6b60156da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:05.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.088+0000 7f6b66600640 1 -- 172.21.15.103:0/3041780815 shutdown_connections 2024-09-10T22:42:05.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.088+0000 7f6b66600640 1 -- 172.21.15.103:0/3041780815 wait complete. 2024-09-10T22:42:05.103 INFO:tasks.ceph.mds.d.smithi131.stderr: -1096> 2024-09-10T22:41:42.384+0000 7fba35200640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-10T22:41:24.283348+0000 1=0+1) n(v0 rc2024-09-10T22:41:24.283348+0000 2=0+2) (inest lock) (ifile excl) caps={5718=pAsLsXsFsx/-@6},l=5718 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x564666b3a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:41:24.283348+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:41:24.283348+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-10T22:41:24.283348+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-10T22:41:24.283348+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-10T22:42:05.103 INFO:tasks.ceph.mds.d.smithi131.stderr: -1074> 2024-09-10T22:41:42.384+0000 7fba35200640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) caps={5718=pAsLsXsFs/-@3},l=5718 | request=0 lock=0 importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x564666b3ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-10T22:42:05.107 INFO:tasks.ceph.mds.a.smithi103.stderr: -2625> 2024-09-10T22:41:42.384+0000 7faa03e00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-10T22:41:24.276414+0000 1=0+1) n(v3 rc2024-09-10T22:41:24.501380+0000 6=0+6) (inest mix dirty) (ifile excl) caps={5718=pAsLsXsFsx/AsLsXsFsx@9},l=5718 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x5637621a7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:41:24.276414+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:41:24.501380+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-10T22:41:24.276414+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-10T22:41:24.501380+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-10T22:42:05.107 INFO:tasks.ceph.mds.a.smithi103.stderr: -2521> 2024-09-10T22:41:42.388+0000 7faa0c000640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-10T22:41:24.278188+0000 1=0+1) n(v4 rc2024-09-10T22:41:24.501380+0000 5=0+5) (inest sync->mix g=1,2) caps={5718=pAsLsXsFs/-@11} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x5637621a7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:41:24.278188+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:41:24.501380+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-10T22:41:24.278188+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-10T22:41:24.501380+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-10T22:42:05.113 INFO:tasks.ceph.mds.c.smithi103.stderr: -1324> 2024-09-10T22:41:42.384+0000 7fad57e00640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-10T22:41:24.279863+0000 1=0+1) n(v2 rc2024-09-10T22:41:24.501380+0000 4=0+4) (inest lock) caps={5718=pAsLsXsFs/-@7},l=5718 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x559f49588580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:41:24.279863+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:41:24.501380+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-10T22:41:24.279863+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-10T22:41:24.501380+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-10T22:42:05.114 INFO:tasks.ceph.mds.c.smithi103.stderr: -1174> 2024-09-10T22:41:42.388+0000 7fad60000640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-10T22:41:24.281657+0000 1=0+1) n(v1 rc2024-09-10T22:41:24.501380+0000 3=0+3) (inest sync->mix g=0,2 scatter_wanted) caps={5718=pAsLsXsFs/-@7} | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x559f49588b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:41:24.281657+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:41:24.283348+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-10T22:41:24.281657+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-10T22:41:24.501380+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-10T22:42:05.120 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T22:42:05.147 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2024-09-10T22:42:05.153 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-09-10T22:42:05.159 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-09-10T22:42:05.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.268+0000 7f3403000640 1 -- 172.21.15.103:0/1835222179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33fc072500 msgr2=0x7f33fc072970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:05.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.268+0000 7f3403000640 1 --2- 172.21.15.103:0/1835222179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33fc072500 0x7f33fc072970 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009bc0 tx=0x7f33f401cac0 comp rx=0 tx=0).stop 2024-09-10T22:42:05.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.268+0000 7f3403000640 1 -- 172.21.15.103:0/1835222179 shutdown_connections 2024-09-10T22:42:05.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.268+0000 7f3403000640 1 --2- 172.21.15.103:0/1835222179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33fc072500 0x7f33fc072970 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:05.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.268+0000 7f3403000640 1 -- 172.21.15.103:0/1835222179 >> 172.21.15.103:0/1835222179 conn(0x7f33fc06cc00 msgr2=0x7f33fc06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:05.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.268+0000 7f3403000640 1 -- 172.21.15.103:0/1835222179 shutdown_connections 2024-09-10T22:42:05.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.268+0000 7f3403000640 1 -- 172.21.15.103:0/1835222179 wait complete. 2024-09-10T22:42:05.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.268+0000 7f3403000640 1 Processor -- start 2024-09-10T22:42:05.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.268+0000 7f3403000640 1 -- start start 2024-09-10T22:42:05.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f3403000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33fc072500 0x7f33fc146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:05.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f3403000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33fc0b2c10 0x7f33fc14ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:05.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f3403000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33fc0cf260 0x7f33fc149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:05.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f3403000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc157ea0 con 0x7f33fc0cf260 2024-09-10T22:42:05.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f3403000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc157d20 con 0x7f33fc0b2c10 2024-09-10T22:42:05.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f3403000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f33fc168c40 con 0x7f33fc072500 2024-09-10T22:42:05.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f3401000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33fc0cf260 0x7f33fc149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:05.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f3401000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33fc0cf260 0x7f33fc149d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35696/0 (socket says 172.21.15.103:35696) 2024-09-10T22:42:05.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f3401000640 1 -- 172.21.15.103:0/2757994853 learned_addr learned my addr 172.21.15.103:0/2757994853 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:05.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f33f3400640 1 --2- 172.21.15.103:0/2757994853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33fc0b2c10 0x7f33fc14ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:05.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f33fbe00640 1 --2- 172.21.15.103:0/2757994853 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33fc072500 0x7f33fc146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:05.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f3401000640 1 -- 172.21.15.103:0/2757994853 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33fc072500 msgr2=0x7f33fc146eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:05.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f3401000640 1 --2- 172.21.15.103:0/2757994853 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33fc072500 0x7f33fc146eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:05.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f3401000640 1 -- 172.21.15.103:0/2757994853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33fc0b2c10 msgr2=0x7f33fc14ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:05.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f3401000640 1 --2- 172.21.15.103:0/2757994853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33fc0b2c10 0x7f33fc14ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:05.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f3401000640 1 -- 172.21.15.103:0/2757994853 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33fc1f8b00 con 0x7f33fc0cf260 2024-09-10T22:42:05.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f3401000640 1 --2- 172.21.15.103:0/2757994853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33fc0cf260 0x7f33fc149d00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f33f40b0040 tx=0x7f33f40a5f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:05.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f33f8c00640 1 -- 172.21.15.103:0/2757994853 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f40bb070 con 0x7f33fc0cf260 2024-09-10T22:42:05.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f33f8c00640 1 -- 172.21.15.103:0/2757994853 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33f4004e00 con 0x7f33fc0cf260 2024-09-10T22:42:05.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f33f8c00640 1 -- 172.21.15.103:0/2757994853 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f40b2040 con 0x7f33fc0cf260 2024-09-10T22:42:05.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f3403000640 1 -- 172.21.15.103:0/2757994853 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33fc1f8de0 con 0x7f33fc0cf260 2024-09-10T22:42:05.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f3403000640 1 -- 172.21.15.103:0/2757994853 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33fc1f93a0 con 0x7f33fc0cf260 2024-09-10T22:42:05.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f3403000640 1 -- 172.21.15.103:0/2757994853 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33fc150b60 con 0x7f33fc0cf260 2024-09-10T22:42:05.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.272+0000 7f33f8c00640 1 -- 172.21.15.103:0/2757994853 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f33f40b5070 con 0x7f33fc0cf260 2024-09-10T22:42:05.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.276+0000 7f33f8c00640 1 --2- 172.21.15.103:0/2757994853 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33d80725e0 0x7f33d8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:05.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.276+0000 7f33f8c00640 1 -- 172.21.15.103:0/2757994853 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6417+0+0 (secure 0 0 0) 0x7f33f412cb20 con 0x7f33fc0cf260 2024-09-10T22:42:05.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.276+0000 7f33fbe00640 1 --2- 172.21.15.103:0/2757994853 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33d80725e0 0x7f33d8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:05.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.276+0000 7f33fbe00640 1 --2- 172.21.15.103:0/2757994853 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33d80725e0 0x7f33d8074aa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f33ec007fd0 tx=0x7f33ec009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:05.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.280+0000 7f33f8c00640 1 -- 172.21.15.103:0/2757994853 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f33f40166b0 con 0x7f33fc0cf260 2024-09-10T22:42:05.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:05.476+0000 7f3403000640 1 -- 172.21.15.103:0/2757994853 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f33fc150880 con 0x7f33fc0cf260 2024-09-10T22:42:06.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.084+0000 7f33f8c00640 1 -- 172.21.15.103:0/2757994853 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v47) ==== 104+0+0 (secure 0 0 0) 0x7f33f40f7840 con 0x7f33fc0cf260 2024-09-10T22:42:06.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.088+0000 7f3403000640 1 -- 172.21.15.103:0/2757994853 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33d80725e0 msgr2=0x7f33d8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:06.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.088+0000 7f3403000640 1 --2- 172.21.15.103:0/2757994853 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33d80725e0 0x7f33d8074aa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f33ec007fd0 tx=0x7f33ec009040 comp rx=0 tx=0).stop 2024-09-10T22:42:06.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.088+0000 7f3403000640 1 -- 172.21.15.103:0/2757994853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33fc0cf260 msgr2=0x7f33fc149d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:06.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.088+0000 7f3403000640 1 --2- 172.21.15.103:0/2757994853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33fc0cf260 0x7f33fc149d00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f33f40b0040 tx=0x7f33f40a5f90 comp rx=0 tx=0).stop 2024-09-10T22:42:06.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.088+0000 7f3403000640 1 -- 172.21.15.103:0/2757994853 shutdown_connections 2024-09-10T22:42:06.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.088+0000 7f3403000640 1 --2- 172.21.15.103:0/2757994853 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33d80725e0 0x7f33d8074aa0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:06.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.088+0000 7f3403000640 1 --2- 172.21.15.103:0/2757994853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33fc0cf260 0x7f33fc149d00 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:06.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.088+0000 7f3403000640 1 --2- 172.21.15.103:0/2757994853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33fc0b2c10 0x7f33fc14ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:06.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.088+0000 7f3403000640 1 --2- 172.21.15.103:0/2757994853 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33fc072500 0x7f33fc146eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:06.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.088+0000 7f3403000640 1 -- 172.21.15.103:0/2757994853 >> 172.21.15.103:0/2757994853 conn(0x7f33fc06cc00 msgr2=0x7f33fc154320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:06.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.088+0000 7f3403000640 1 -- 172.21.15.103:0/2757994853 shutdown_connections 2024-09-10T22:42:06.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.088+0000 7f3403000640 1 -- 172.21.15.103:0/2757994853 wait complete. 2024-09-10T22:42:06.113 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T22:42:06.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e48400640 1 -- 172.21.15.103:0/3566764295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400cd500 msgr2=0x7f7e4015f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:06.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e48400640 1 --2- 172.21.15.103:0/3566764295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400cd500 0x7f7e4015f890 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7e400ce200 tx=0x7f7e3801cd80 comp rx=0 tx=0).stop 2024-09-10T22:42:06.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e48400640 1 -- 172.21.15.103:0/3566764295 shutdown_connections 2024-09-10T22:42:06.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e48400640 1 --2- 172.21.15.103:0/3566764295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400cd500 0x7f7e4015f890 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:06.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e48400640 1 --2- 172.21.15.103:0/3566764295 >> v2:172.21.15.131:3300/0 conn(0x7f7e400cdd00 0x7f7e400ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:06.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e48400640 1 -- 172.21.15.103:0/3566764295 >> 172.21.15.103:0/3566764295 conn(0x7f7e400d1a20 msgr2=0x7f7e400d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:06.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e48400640 1 -- 172.21.15.103:0/3566764295 shutdown_connections 2024-09-10T22:42:06.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e48400640 1 -- 172.21.15.103:0/3566764295 wait complete. 2024-09-10T22:42:06.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e48400640 1 Processor -- start 2024-09-10T22:42:06.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e48400640 1 -- start start 2024-09-10T22:42:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e48400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e400cd500 0x7f7e40154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e48400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400cdd00 0x7f7e400b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e48400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e4015f1a0 0x7f7e400cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e48400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7e40168f60 con 0x7f7e400cdd00 2024-09-10T22:42:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e48400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7e40168de0 con 0x7f7e400cd500 2024-09-10T22:42:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e48400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7e401690e0 con 0x7f7e4015f1a0 2024-09-10T22:42:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e45000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400cdd00 0x7f7e400b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e45000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400cdd00 0x7f7e400b4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35710/0 (socket says 172.21.15.103:35710) 2024-09-10T22:42:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e45000640 1 -- 172.21.15.103:0/2159417214 learned_addr learned my addr 172.21.15.103:0/2159417214 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e45a00640 1 --2- 172.21.15.103:0/2159417214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e400cd500 0x7f7e40154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e46400640 1 --2- 172.21.15.103:0/2159417214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e4015f1a0 0x7f7e400cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e45000640 1 -- 172.21.15.103:0/2159417214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e4015f1a0 msgr2=0x7f7e400cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e45000640 1 --2- 172.21.15.103:0/2159417214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e4015f1a0 0x7f7e400cf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e45000640 1 -- 172.21.15.103:0/2159417214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e400cd500 msgr2=0x7f7e40154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e45000640 1 --2- 172.21.15.103:0/2159417214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e400cd500 0x7f7e40154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e45000640 1 -- 172.21.15.103:0/2159417214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e40157110 con 0x7f7e400cdd00 2024-09-10T22:42:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e45a00640 1 --2- 172.21.15.103:0/2159417214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e400cd500 0x7f7e40154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.304+0000 7f7e45000640 1 --2- 172.21.15.103:0/2159417214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400cdd00 0x7f7e400b4870 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00d980 tx=0x7f7e2c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.308+0000 7f7e3d600640 1 -- 172.21.15.103:0/2159417214 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c017070 con 0x7f7e400cdd00 2024-09-10T22:42:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.308+0000 7f7e3d600640 1 -- 172.21.15.103:0/2159417214 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e2c009d60 con 0x7f7e400cdd00 2024-09-10T22:42:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.308+0000 7f7e3d600640 1 -- 172.21.15.103:0/2159417214 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c005280 con 0x7f7e400cdd00 2024-09-10T22:42:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.308+0000 7f7e48400640 1 -- 172.21.15.103:0/2159417214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e401573f0 con 0x7f7e400cdd00 2024-09-10T22:42:06.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.308+0000 7f7e48400640 1 -- 172.21.15.103:0/2159417214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e40158960 con 0x7f7e400cdd00 2024-09-10T22:42:06.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.308+0000 7f7e48400640 1 -- 172.21.15.103:0/2159417214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e4015f890 con 0x7f7e400cdd00 2024-09-10T22:42:06.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.308+0000 7f7e3d600640 1 -- 172.21.15.103:0/2159417214 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7e2c005420 con 0x7f7e400cdd00 2024-09-10T22:42:06.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.308+0000 7f7e3d600640 1 --2- 172.21.15.103:0/2159417214 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7e200725e0 0x7f7e20074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:06.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.308+0000 7f7e3d600640 1 -- 172.21.15.103:0/2159417214 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6417+0+0 (secure 0 0 0) 0x7f7e2c093700 con 0x7f7e400cdd00 2024-09-10T22:42:06.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.308+0000 7f7e45a00640 1 --2- 172.21.15.103:0/2159417214 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7e200725e0 0x7f7e20074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:06.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.312+0000 7f7e45a00640 1 --2- 172.21.15.103:0/2159417214 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7e200725e0 0x7f7e20074aa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7e40158f50 tx=0x7f7e34009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:06.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.312+0000 7f7e3d600640 1 -- 172.21.15.103:0/2159417214 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7e2c05eb00 con 0x7f7e400cdd00 2024-09-10T22:42:06.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:06.480+0000 7f7e48400640 1 -- 172.21.15.103:0/2159417214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7e400b08c0 con 0x7f7e400cdd00 2024-09-10T22:42:07.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.256+0000 7f7e3d600640 1 -- 172.21.15.103:0/2159417214 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v59) ==== 181+0+0 (secure 0 0 0) 0x7f7e2c067220 con 0x7f7e400cdd00 2024-09-10T22:42:07.257 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2024-09-10T22:42:07.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.260+0000 7f7e48400640 1 -- 172.21.15.103:0/2159417214 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7e200725e0 msgr2=0x7f7e20074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:07.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.260+0000 7f7e48400640 1 --2- 172.21.15.103:0/2159417214 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7e200725e0 0x7f7e20074aa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7e40158f50 tx=0x7f7e34009040 comp rx=0 tx=0).stop 2024-09-10T22:42:07.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.260+0000 7f7e48400640 1 -- 172.21.15.103:0/2159417214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400cdd00 msgr2=0x7f7e400b4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:07.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.260+0000 7f7e48400640 1 --2- 172.21.15.103:0/2159417214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400cdd00 0x7f7e400b4870 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00d980 tx=0x7f7e2c00de40 comp rx=0 tx=0).stop 2024-09-10T22:42:07.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.260+0000 7f7e48400640 1 -- 172.21.15.103:0/2159417214 shutdown_connections 2024-09-10T22:42:07.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.260+0000 7f7e48400640 1 --2- 172.21.15.103:0/2159417214 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7e200725e0 0x7f7e20074aa0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:07.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.260+0000 7f7e48400640 1 --2- 172.21.15.103:0/2159417214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e4015f1a0 0x7f7e400cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:07.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.260+0000 7f7e48400640 1 --2- 172.21.15.103:0/2159417214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400cdd00 0x7f7e400b4870 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:07.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.260+0000 7f7e48400640 1 --2- 172.21.15.103:0/2159417214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e400cd500 0x7f7e40154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:07.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.260+0000 7f7e48400640 1 -- 172.21.15.103:0/2159417214 >> 172.21.15.103:0/2159417214 conn(0x7f7e400d1a20 msgr2=0x7f7e40071c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:07.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.264+0000 7f7e48400640 1 -- 172.21.15.103:0/2159417214 shutdown_connections 2024-09-10T22:42:07.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.264+0000 7f7e48400640 1 -- 172.21.15.103:0/2159417214 wait complete. 2024-09-10T22:42:07.293 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T22:42:07.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.440+0000 7fe432c00640 1 -- 172.21.15.103:0/165386568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe42c0cd500 msgr2=0x7fe42c15f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:07.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.440+0000 7fe432c00640 1 --2- 172.21.15.103:0/165386568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe42c0cd500 0x7fe42c15f890 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0d2b20 tx=0x7fe42401c8c0 comp rx=0 tx=0).stop 2024-09-10T22:42:07.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.440+0000 7fe432c00640 1 -- 172.21.15.103:0/165386568 shutdown_connections 2024-09-10T22:42:07.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.440+0000 7fe432c00640 1 --2- 172.21.15.103:0/165386568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe42c0cd500 0x7fe42c15f890 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:07.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.440+0000 7fe432c00640 1 --2- 172.21.15.103:0/165386568 >> v2:172.21.15.131:3300/0 conn(0x7fe42c15f1a0 0x7fe42c0ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:07.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.440+0000 7fe432c00640 1 -- 172.21.15.103:0/165386568 >> 172.21.15.103:0/165386568 conn(0x7fe42c0d1a20 msgr2=0x7fe42c0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:07.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.440+0000 7fe432c00640 1 -- 172.21.15.103:0/165386568 shutdown_connections 2024-09-10T22:42:07.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.440+0000 7fe432c00640 1 -- 172.21.15.103:0/165386568 wait complete. 2024-09-10T22:42:07.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe432c00640 1 Processor -- start 2024-09-10T22:42:07.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe432c00640 1 -- start start 2024-09-10T22:42:07.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe432c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe42c0cd500 0x7fe42c155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:07.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe432c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe42c0cdd00 0x7fe42c0c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:07.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe432c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe42c15f1a0 0x7fe42c0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:07.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe432c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c168f60 con 0x7fe42c15f1a0 2024-09-10T22:42:07.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe432c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c168de0 con 0x7fe42c0cdd00 2024-09-10T22:42:07.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe432c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe42c1690e0 con 0x7fe42c0cd500 2024-09-10T22:42:07.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe430c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe42c15f1a0 0x7fe42c0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:07.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe430c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe42c15f1a0 0x7fe42c0b1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34408/0 (socket says 172.21.15.103:34408) 2024-09-10T22:42:07.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe430c00640 1 -- 172.21.15.103:0/3053498975 learned_addr learned my addr 172.21.15.103:0/3053498975 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:07.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe423400640 1 --2- 172.21.15.103:0/3053498975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe42c0cdd00 0x7fe42c0c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:07.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe42be00640 1 --2- 172.21.15.103:0/3053498975 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe42c0cd500 0x7fe42c155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:07.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe430c00640 1 -- 172.21.15.103:0/3053498975 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe42c0cd500 msgr2=0x7fe42c155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:07.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe430c00640 1 --2- 172.21.15.103:0/3053498975 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe42c0cd500 0x7fe42c155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:07.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe430c00640 1 -- 172.21.15.103:0/3053498975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe42c0cdd00 msgr2=0x7fe42c0c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:07.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe430c00640 1 --2- 172.21.15.103:0/3053498975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe42c0cdd00 0x7fe42c0c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:07.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe430c00640 1 -- 172.21.15.103:0/3053498975 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c0c6790 con 0x7fe42c15f1a0 2024-09-10T22:42:07.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe423400640 1 --2- 172.21.15.103:0/3053498975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe42c0cdd00 0x7fe42c0c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:07.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe430c00640 1 --2- 172.21.15.103:0/3053498975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe42c15f1a0 0x7fe42c0b1c70 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe424009850 tx=0x7fe4240a5610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:07.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe428c00640 1 -- 172.21.15.103:0/3053498975 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4240bd070 con 0x7fe42c15f1a0 2024-09-10T22:42:07.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe428c00640 1 -- 172.21.15.103:0/3053498975 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4240043b0 con 0x7fe42c15f1a0 2024-09-10T22:42:07.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe428c00640 1 -- 172.21.15.103:0/3053498975 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4240b2040 con 0x7fe42c15f1a0 2024-09-10T22:42:07.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe432c00640 1 -- 172.21.15.103:0/3053498975 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42c0c64b0 con 0x7fe42c15f1a0 2024-09-10T22:42:07.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.444+0000 7fe432c00640 1 -- 172.21.15.103:0/3053498975 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe42c0c7440 con 0x7fe42c15f1a0 2024-09-10T22:42:07.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.448+0000 7fe432c00640 1 -- 172.21.15.103:0/3053498975 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe42c15f890 con 0x7fe42c15f1a0 2024-09-10T22:42:07.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.448+0000 7fe428c00640 1 -- 172.21.15.103:0/3053498975 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe424003860 con 0x7fe42c15f1a0 2024-09-10T22:42:07.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.448+0000 7fe428c00640 1 --2- 172.21.15.103:0/3053498975 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4080725e0 0x7fe408074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:07.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.448+0000 7fe428c00640 1 -- 172.21.15.103:0/3053498975 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5979+0+0 (secure 0 0 0) 0x7fe42412d1e0 con 0x7fe42c15f1a0 2024-09-10T22:42:07.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.448+0000 7fe42be00640 1 --2- 172.21.15.103:0/3053498975 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4080725e0 0x7fe408074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:07.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.452+0000 7fe42be00640 1 --2- 172.21.15.103:0/3053498975 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4080725e0 0x7fe408074aa0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe41c005c50 tx=0x7fe41c005be0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:07.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.452+0000 7fe428c00640 1 -- 172.21.15.103:0/3053498975 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe4240164b0 con 0x7fe42c15f1a0 2024-09-10T22:42:07.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:07.620+0000 7fe432c00640 1 -- 172.21.15.103:0/3053498975 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe42c0aeb10 con 0x7fe42c15f1a0 2024-09-10T22:42:08.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.280+0000 7fe428c00640 1 -- 172.21.15.103:0/3053498975 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v60) ==== 169+0+0 (secure 0 0 0) 0x7fe4240f8710 con 0x7fe42c15f1a0 2024-09-10T22:42:08.281 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2024-09-10T22:42:08.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.280+0000 7fe432c00640 1 -- 172.21.15.103:0/3053498975 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4080725e0 msgr2=0x7fe408074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:08.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.280+0000 7fe432c00640 1 --2- 172.21.15.103:0/3053498975 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4080725e0 0x7fe408074aa0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe41c005c50 tx=0x7fe41c005be0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.280+0000 7fe432c00640 1 -- 172.21.15.103:0/3053498975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe42c15f1a0 msgr2=0x7fe42c0b1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:08.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.280+0000 7fe432c00640 1 --2- 172.21.15.103:0/3053498975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe42c15f1a0 0x7fe42c0b1c70 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe424009850 tx=0x7fe4240a5610 comp rx=0 tx=0).stop 2024-09-10T22:42:08.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.280+0000 7fe432c00640 1 -- 172.21.15.103:0/3053498975 shutdown_connections 2024-09-10T22:42:08.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.280+0000 7fe432c00640 1 --2- 172.21.15.103:0/3053498975 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe4080725e0 0x7fe408074aa0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.280+0000 7fe432c00640 1 --2- 172.21.15.103:0/3053498975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe42c15f1a0 0x7fe42c0b1c70 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.280+0000 7fe432c00640 1 --2- 172.21.15.103:0/3053498975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe42c0cdd00 0x7fe42c0c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.280+0000 7fe432c00640 1 --2- 172.21.15.103:0/3053498975 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe42c0cd500 0x7fe42c155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.280+0000 7fe432c00640 1 -- 172.21.15.103:0/3053498975 >> 172.21.15.103:0/3053498975 conn(0x7fe42c0d1a20 msgr2=0x7fe42c0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:08.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.280+0000 7fe432c00640 1 -- 172.21.15.103:0/3053498975 shutdown_connections 2024-09-10T22:42:08.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.280+0000 7fe432c00640 1 -- 172.21.15.103:0/3053498975 wait complete. 2024-09-10T22:42:08.310 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T22:42:08.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.459+0000 7f3d6fc00640 1 -- 172.21.15.103:0/3000708019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d4c005220 msgr2=0x7f3d4c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:08.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.459+0000 7f3d6fc00640 1 --2- 172.21.15.103:0/3000708019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d4c005220 0x7f3d4c00b9d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3d60006fd0 tx=0x7f3d6001ca20 comp rx=0 tx=0).stop 2024-09-10T22:42:08.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.459+0000 7f3d6fc00640 1 -- 172.21.15.103:0/3000708019 shutdown_connections 2024-09-10T22:42:08.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.459+0000 7f3d6fc00640 1 --2- 172.21.15.103:0/3000708019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d4c005220 0x7f3d4c00b9d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.459+0000 7f3d6fc00640 1 -- 172.21.15.103:0/3000708019 >> 172.21.15.103:0/3000708019 conn(0x7f3d6806cc00 msgr2=0x7f3d6806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:08.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.459+0000 7f3d6fc00640 1 -- 172.21.15.103:0/3000708019 shutdown_connections 2024-09-10T22:42:08.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.459+0000 7f3d6fc00640 1 -- 172.21.15.103:0/3000708019 wait complete. 2024-09-10T22:42:08.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.463+0000 7f3d6fc00640 1 Processor -- start 2024-09-10T22:42:08.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.463+0000 7f3d6fc00640 1 -- start start 2024-09-10T22:42:08.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.463+0000 7f3d6fc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d4c005220 0x7f3d68073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:08.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.463+0000 7f3d6fc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d6815ad60 0x7f3d6815e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:08.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.463+0000 7f3d6fc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d68073cd0 0x7f3d68142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:08.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.463+0000 7f3d6fc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6815f6f0 con 0x7f3d68073cd0 2024-09-10T22:42:08.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.463+0000 7f3d6fc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6815f000 con 0x7f3d4c005220 2024-09-10T22:42:08.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.463+0000 7f3d6fc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3d6815f870 con 0x7f3d6815ad60 2024-09-10T22:42:08.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.463+0000 7f3d6dc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d68073cd0 0x7f3d68142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:08.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.463+0000 7f3d6dc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d68073cd0 0x7f3d68142da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34428/0 (socket says 172.21.15.103:34428) 2024-09-10T22:42:08.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.463+0000 7f3d6dc00640 1 -- 172.21.15.103:0/4243605836 learned_addr learned my addr 172.21.15.103:0/4243605836 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:08.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.463+0000 7f3d6d200640 1 --2- 172.21.15.103:0/4243605836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d4c005220 0x7f3d68073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:08.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.463+0000 7f3d5fe00640 1 --2- 172.21.15.103:0/4243605836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d6815ad60 0x7f3d6815e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:08.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.463+0000 7f3d6dc00640 1 -- 172.21.15.103:0/4243605836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d6815ad60 msgr2=0x7f3d6815e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:08.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.463+0000 7f3d6dc00640 1 --2- 172.21.15.103:0/4243605836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d6815ad60 0x7f3d6815e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.463+0000 7f3d6dc00640 1 -- 172.21.15.103:0/4243605836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d4c005220 msgr2=0x7f3d68073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:08.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.463+0000 7f3d6dc00640 1 --2- 172.21.15.103:0/4243605836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d4c005220 0x7f3d68073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.463+0000 7f3d6dc00640 1 -- 172.21.15.103:0/4243605836 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d68073670 con 0x7f3d68073cd0 2024-09-10T22:42:08.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.467+0000 7f3d6dc00640 1 --2- 172.21.15.103:0/4243605836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d68073cd0 0x7f3d68142da0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3d6001d2c0 tx=0x7f3d60006cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:08.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.467+0000 7f3d65600640 1 -- 172.21.15.103:0/4243605836 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d600a5a20 con 0x7f3d68073cd0 2024-09-10T22:42:08.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.467+0000 7f3d65600640 1 -- 172.21.15.103:0/4243605836 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d600b2070 con 0x7f3d68073cd0 2024-09-10T22:42:08.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.467+0000 7f3d6fc00640 1 -- 172.21.15.103:0/4243605836 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d6815da40 con 0x7f3d68073cd0 2024-09-10T22:42:08.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.467+0000 7f3d65600640 1 -- 172.21.15.103:0/4243605836 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d600060d0 con 0x7f3d68073cd0 2024-09-10T22:42:08.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.467+0000 7f3d6fc00640 1 -- 172.21.15.103:0/4243605836 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d6815e000 con 0x7f3d68073cd0 2024-09-10T22:42:08.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.467+0000 7f3d6fc00640 1 -- 172.21.15.103:0/4243605836 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d6806eb80 con 0x7f3d68073cd0 2024-09-10T22:42:08.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.467+0000 7f3d65600640 1 -- 172.21.15.103:0/4243605836 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3d60006270 con 0x7f3d68073cd0 2024-09-10T22:42:08.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.467+0000 7f3d65600640 1 --2- 172.21.15.103:0/4243605836 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3d440725e0 0x7f3d44074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:08.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.467+0000 7f3d65600640 1 -- 172.21.15.103:0/4243605836 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5507+0+0 (secure 0 0 0) 0x7f3d6012cd80 con 0x7f3d68073cd0 2024-09-10T22:42:08.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.467+0000 7f3d6d200640 1 --2- 172.21.15.103:0/4243605836 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3d440725e0 0x7f3d44074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:08.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.471+0000 7f3d6d200640 1 --2- 172.21.15.103:0/4243605836 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3d440725e0 0x7f3d44074aa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3d58001230 tx=0x7f3d580067b0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:08.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.471+0000 7f3d65600640 1 -- 172.21.15.103:0/4243605836 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3d60016730 con 0x7f3d68073cd0 2024-09-10T22:42:08.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.639+0000 7f3d6fc00640 1 -- 172.21.15.103:0/4243605836 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f3d68150f80 con 0x7f3d68073cd0 2024-09-10T22:42:08.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.643+0000 7f3d65600640 1 -- 172.21.15.103:0/4243605836 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v31) ==== 71+0+0 (secure 0 0 0) 0x7f3d600f85a0 con 0x7f3d68073cd0 2024-09-10T22:42:08.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.647+0000 7f3d6fc00640 1 -- 172.21.15.103:0/4243605836 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3d440725e0 msgr2=0x7f3d44074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:08.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.647+0000 7f3d6fc00640 1 --2- 172.21.15.103:0/4243605836 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3d440725e0 0x7f3d44074aa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3d58001230 tx=0x7f3d580067b0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.647+0000 7f3d6fc00640 1 -- 172.21.15.103:0/4243605836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d68073cd0 msgr2=0x7f3d68142da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:08.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.647+0000 7f3d6fc00640 1 --2- 172.21.15.103:0/4243605836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d68073cd0 0x7f3d68142da0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3d6001d2c0 tx=0x7f3d60006cb0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.647+0000 7f3d6fc00640 1 -- 172.21.15.103:0/4243605836 shutdown_connections 2024-09-10T22:42:08.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.647+0000 7f3d6fc00640 1 --2- 172.21.15.103:0/4243605836 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3d440725e0 0x7f3d44074aa0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.647+0000 7f3d6fc00640 1 --2- 172.21.15.103:0/4243605836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d68073cd0 0x7f3d68142da0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.647+0000 7f3d6fc00640 1 --2- 172.21.15.103:0/4243605836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d6815ad60 0x7f3d6815e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.647+0000 7f3d6fc00640 1 --2- 172.21.15.103:0/4243605836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d4c005220 0x7f3d68073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.647+0000 7f3d6fc00640 1 -- 172.21.15.103:0/4243605836 >> 172.21.15.103:0/4243605836 conn(0x7f3d6806cc00 msgr2=0x7f3d680ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:08.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.647+0000 7f3d6fc00640 1 -- 172.21.15.103:0/4243605836 shutdown_connections 2024-09-10T22:42:08.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.647+0000 7f3d6fc00640 1 -- 172.21.15.103:0/4243605836 wait complete. 2024-09-10T22:42:08.669 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0' 2024-09-10T22:42:08.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.807+0000 7f303d800640 1 -- 172.21.15.103:0/2945577462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30380cf9f0 msgr2=0x7f303806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:08.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.807+0000 7f303d800640 1 --2- 172.21.15.103:0/2945577462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30380cf9f0 0x7f303806eb80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f3038072490 tx=0x7f302801c8c0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.807+0000 7f303d800640 1 -- 172.21.15.103:0/2945577462 shutdown_connections 2024-09-10T22:42:08.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.807+0000 7f303d800640 1 --2- 172.21.15.103:0/2945577462 >> v2:172.21.15.131:3300/0 conn(0x7f303806f0c0 0x7f3038073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.807+0000 7f303d800640 1 --2- 172.21.15.103:0/2945577462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30380cf9f0 0x7f303806eb80 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.807+0000 7f303d800640 1 -- 172.21.15.103:0/2945577462 >> 172.21.15.103:0/2945577462 conn(0x7f303806cc00 msgr2=0x7f303806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:08.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.807+0000 7f303d800640 1 -- 172.21.15.103:0/2945577462 shutdown_connections 2024-09-10T22:42:08.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.807+0000 7f303d800640 1 -- 172.21.15.103:0/2945577462 wait complete. 2024-09-10T22:42:08.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.807+0000 7f303d800640 1 Processor -- start 2024-09-10T22:42:08.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.807+0000 7f303d800640 1 -- start start 2024-09-10T22:42:08.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f303d800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f303806f0c0 0x7f30381f8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:08.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f303d800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30380cf9f0 0x7f30381f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:08.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f303d800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30380cfdd0 0x7f3038147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:08.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f303d800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f30380cd660 con 0x7f30380cfdd0 2024-09-10T22:42:08.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f303d800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f30380cd4e0 con 0x7f303806f0c0 2024-09-10T22:42:08.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f303d800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f30380cd7e0 con 0x7f30380cf9f0 2024-09-10T22:42:08.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f3037400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30380cfdd0 0x7f3038147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:08.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f3037400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30380cfdd0 0x7f3038147dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34460/0 (socket says 172.21.15.103:34460) 2024-09-10T22:42:08.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f3037400640 1 -- 172.21.15.103:0/4108736879 learned_addr learned my addr 172.21.15.103:0/4108736879 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:08.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f3036a00640 1 --2- 172.21.15.103:0/4108736879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f303806f0c0 0x7f30381f8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:08.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f3036000640 1 --2- 172.21.15.103:0/4108736879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30380cf9f0 0x7f30381f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:08.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f3037400640 1 -- 172.21.15.103:0/4108736879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30380cf9f0 msgr2=0x7f30381f8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:08.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f3037400640 1 --2- 172.21.15.103:0/4108736879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30380cf9f0 0x7f30381f8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f3037400640 1 -- 172.21.15.103:0/4108736879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f303806f0c0 msgr2=0x7f30381f8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:08.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f3037400640 1 --2- 172.21.15.103:0/4108736879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f303806f0c0 0x7f30381f8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:08.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f3037400640 1 -- 172.21.15.103:0/4108736879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3038148cd0 con 0x7f30380cfdd0 2024-09-10T22:42:08.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f3036000640 1 --2- 172.21.15.103:0/4108736879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30380cf9f0 0x7f30381f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:08.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f3037400640 1 --2- 172.21.15.103:0/4108736879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30380cfdd0 0x7f3038147dc0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f303000c730 tx=0x7f303000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f302ea00640 1 -- 172.21.15.103:0/4108736879 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3030003ba0 con 0x7f30380cfdd0 2024-09-10T22:42:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f302ea00640 1 -- 172.21.15.103:0/4108736879 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3030003d40 con 0x7f30380cfdd0 2024-09-10T22:42:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f302ea00640 1 -- 172.21.15.103:0/4108736879 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3030005330 con 0x7f30380cfdd0 2024-09-10T22:42:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f303d800640 1 -- 172.21.15.103:0/4108736879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3038148fb0 con 0x7f30380cfdd0 2024-09-10T22:42:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f303d800640 1 -- 172.21.15.103:0/4108736879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3038132190 con 0x7f30380cfdd0 2024-09-10T22:42:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.811+0000 7f303d800640 1 -- 172.21.15.103:0/4108736879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f303806eb80 con 0x7f30380cfdd0 2024-09-10T22:42:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.815+0000 7f302ea00640 1 -- 172.21.15.103:0/4108736879 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f303000a640 con 0x7f30380cfdd0 2024-09-10T22:42:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.815+0000 7f302ea00640 1 --2- 172.21.15.103:0/4108736879 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3018072610 0x7f3018074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.815+0000 7f302ea00640 1 -- 172.21.15.103:0/4108736879 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5507+0+0 (secure 0 0 0) 0x7f3030092fd0 con 0x7f30380cfdd0 2024-09-10T22:42:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.815+0000 7f3036a00640 1 --2- 172.21.15.103:0/4108736879 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3018072610 0x7f3018074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:08.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.815+0000 7f3036a00640 1 --2- 172.21.15.103:0/4108736879 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3018072610 0x7f3018074ad0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f30280af000 tx=0x7f302801b100 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:08.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:08.819+0000 7f302ea00640 1 -- 172.21.15.103:0/4108736879 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f303005e800 con 0x7f30380cfdd0 2024-09-10T22:42:09.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.039+0000 7f303d800640 1 -- 172.21.15.103:0/4108736879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]} v 0) -- 0x7f30381581f0 con 0x7f30380cfdd0 2024-09-10T22:42:09.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.279+0000 7f302ea00640 1 -- 172.21.15.103:0/4108736879 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]}]=0 v184) ==== 143+0+0 (secure 0 0 0) 0x7f303005e100 con 0x7f30380cfdd0 2024-09-10T22:42:09.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.283+0000 7f303d800640 1 -- 172.21.15.103:0/4108736879 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3018072610 msgr2=0x7f3018074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:09.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.283+0000 7f303d800640 1 --2- 172.21.15.103:0/4108736879 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3018072610 0x7f3018074ad0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f30280af000 tx=0x7f302801b100 comp rx=0 tx=0).stop 2024-09-10T22:42:09.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.283+0000 7f303d800640 1 -- 172.21.15.103:0/4108736879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30380cfdd0 msgr2=0x7f3038147dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:09.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.283+0000 7f303d800640 1 --2- 172.21.15.103:0/4108736879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30380cfdd0 0x7f3038147dc0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f303000c730 tx=0x7f303000cbf0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.283+0000 7f303d800640 1 -- 172.21.15.103:0/4108736879 shutdown_connections 2024-09-10T22:42:09.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.283+0000 7f303d800640 1 --2- 172.21.15.103:0/4108736879 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3018072610 0x7f3018074ad0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.283+0000 7f303d800640 1 --2- 172.21.15.103:0/4108736879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30380cfdd0 0x7f3038147dc0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.283+0000 7f303d800640 1 --2- 172.21.15.103:0/4108736879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30380cf9f0 0x7f30381f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.283+0000 7f303d800640 1 --2- 172.21.15.103:0/4108736879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f303806f0c0 0x7f30381f8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.283+0000 7f303d800640 1 -- 172.21.15.103:0/4108736879 >> 172.21.15.103:0/4108736879 conn(0x7f303806cc00 msgr2=0x7f3038073680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:09.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.283+0000 7f303d800640 1 -- 172.21.15.103:0/4108736879 shutdown_connections 2024-09-10T22:42:09.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.283+0000 7f303d800640 1 -- 172.21.15.103:0/4108736879 wait complete. 2024-09-10T22:42:09.305 INFO:tasks.cephfs_test_runner:test_scrub_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2024-09-10T22:42:09.305 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace (tasks.cephfs.test_multimds_misc.TestScrub2) 2024-09-10T22:42:09.305 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:42:09.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.443+0000 7f6e20a00640 1 -- 172.21.15.103:0/2423199661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e00003a60 msgr2=0x7f6e00003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:09.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.443+0000 7f6e20a00640 1 --2- 172.21.15.103:0/2423199661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e00003a60 0x7f6e00003e80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0016f0 tx=0x7f6e0c01c750 comp rx=0 tx=0).stop 2024-09-10T22:42:09.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.443+0000 7f6e20a00640 1 -- 172.21.15.103:0/2423199661 shutdown_connections 2024-09-10T22:42:09.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.443+0000 7f6e20a00640 1 --2- 172.21.15.103:0/2423199661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e00003a60 0x7f6e00003e80 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.443+0000 7f6e20a00640 1 -- 172.21.15.103:0/2423199661 >> 172.21.15.103:0/2423199661 conn(0x7f6e1c0d1a20 msgr2=0x7f6e1c0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:09.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.443+0000 7f6e20a00640 1 -- 172.21.15.103:0/2423199661 shutdown_connections 2024-09-10T22:42:09.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.443+0000 7f6e20a00640 1 -- 172.21.15.103:0/2423199661 wait complete. 2024-09-10T22:42:09.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e20a00640 1 Processor -- start 2024-09-10T22:42:09.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e20a00640 1 -- start start 2024-09-10T22:42:09.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e20a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e00003a60 0x7f6e1c150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e20a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e1c0cb140 0x7f6e1c0b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e20a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e1c1ecb30 0x7f6e1c1ecfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e20a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c0cd970 con 0x7f6e00003a60 2024-09-10T22:42:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e20a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c0cd7f0 con 0x7f6e1c0cb140 2024-09-10T22:42:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e20a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6e1c0cdaf0 con 0x7f6e1c1ecb30 2024-09-10T22:42:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e19e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e00003a60 0x7f6e1c150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e19e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e00003a60 0x7f6e1c150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34478/0 (socket says 172.21.15.103:34478) 2024-09-10T22:42:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e19e00640 1 -- 172.21.15.103:0/2799380315 learned_addr learned my addr 172.21.15.103:0/2799380315 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e11400640 1 --2- 172.21.15.103:0/2799380315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e1c0cb140 0x7f6e1c0b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e1a800640 1 --2- 172.21.15.103:0/2799380315 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e1c1ecb30 0x7f6e1c1ecfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e19e00640 1 -- 172.21.15.103:0/2799380315 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e1c1ecb30 msgr2=0x7f6e1c1ecfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e19e00640 1 --2- 172.21.15.103:0/2799380315 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e1c1ecb30 0x7f6e1c1ecfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e19e00640 1 -- 172.21.15.103:0/2799380315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e1c0cb140 msgr2=0x7f6e1c0b6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:09.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e19e00640 1 --2- 172.21.15.103:0/2799380315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e1c0cb140 0x7f6e1c0b6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e19e00640 1 -- 172.21.15.103:0/2799380315 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1c1f7420 con 0x7f6e00003a60 2024-09-10T22:42:09.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e19e00640 1 --2- 172.21.15.103:0/2799380315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e00003a60 0x7f6e1c150fa0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c01b020 tx=0x7f6e0c006500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:09.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e12a00640 1 -- 172.21.15.103:0/2799380315 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c0b9070 con 0x7f6e00003a60 2024-09-10T22:42:09.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e12a00640 1 -- 172.21.15.103:0/2799380315 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e0c0af040 con 0x7f6e00003a60 2024-09-10T22:42:09.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e12a00640 1 -- 172.21.15.103:0/2799380315 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c0ae070 con 0x7f6e00003a60 2024-09-10T22:42:09.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e20a00640 1 -- 172.21.15.103:0/2799380315 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e1c1f7700 con 0x7f6e00003a60 2024-09-10T22:42:09.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.447+0000 7f6e20a00640 1 -- 172.21.15.103:0/2799380315 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e1c1f7cc0 con 0x7f6e00003a60 2024-09-10T22:42:09.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.451+0000 7f6e20a00640 1 -- 172.21.15.103:0/2799380315 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e1c0d02d0 con 0x7f6e00003a60 2024-09-10T22:42:09.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.451+0000 7f6e12a00640 1 -- 172.21.15.103:0/2799380315 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6e0c003910 con 0x7f6e00003a60 2024-09-10T22:42:09.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.451+0000 7f6e12a00640 1 --2- 172.21.15.103:0/2799380315 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6df80725e0 0x7f6df8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:09.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.451+0000 7f6e12a00640 1 -- 172.21.15.103:0/2799380315 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5507+0+0 (secure 0 0 0) 0x7f6e0c12c220 con 0x7f6e00003a60 2024-09-10T22:42:09.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.451+0000 7f6e11400640 1 --2- 172.21.15.103:0/2799380315 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6df80725e0 0x7f6df8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:09.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.451+0000 7f6e11400640 1 --2- 172.21.15.103:0/2799380315 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6df80725e0 0x7f6df8074aa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c15e6e0 tx=0x7f6e04006040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:09.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.455+0000 7f6e12a00640 1 -- 172.21.15.103:0/2799380315 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6e0c0164b0 con 0x7f6e00003a60 2024-09-10T22:42:09.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.623+0000 7f6e20a00640 1 -- 172.21.15.103:0/2799380315 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e1c0af500 con 0x7f6e00003a60 2024-09-10T22:42:09.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.623+0000 7f6e12a00640 1 -- 172.21.15.103:0/2799380315 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+13629 (secure 0 0 0) 0x7f6e0c0f72d0 con 0x7f6e00003a60 2024-09-10T22:42:09.629 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:09.629 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":60,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:42:08.274516+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6832/343761048":"2024-09-11T22:42:05.082623+0000","172.21.15.103:6834/3910783847":"2024-09-11T22:42:05.082616+0000","172.21.15.103:6833/3910783847":"2024-09-11T22:42:05.082616+0000","172.21.15.103:6835/343761048":"2024-09-11T22:42:05.082623+0000","172.21.15.131:6837/3348473142":"2024-09-11T22:42:05.082601+0000","172.21.15.131:6835/3348473142":"2024-09-11T22:42:05.082601+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:42:09.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.627+0000 7f6e20a00640 1 -- 172.21.15.103:0/2799380315 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6df80725e0 msgr2=0x7f6df8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:09.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.627+0000 7f6e20a00640 1 --2- 172.21.15.103:0/2799380315 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6df80725e0 0x7f6df8074aa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c15e6e0 tx=0x7f6e04006040 comp rx=0 tx=0).stop 2024-09-10T22:42:09.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.627+0000 7f6e20a00640 1 -- 172.21.15.103:0/2799380315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e00003a60 msgr2=0x7f6e1c150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:09.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.627+0000 7f6e20a00640 1 --2- 172.21.15.103:0/2799380315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e00003a60 0x7f6e1c150fa0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c01b020 tx=0x7f6e0c006500 comp rx=0 tx=0).stop 2024-09-10T22:42:09.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.627+0000 7f6e20a00640 1 -- 172.21.15.103:0/2799380315 shutdown_connections 2024-09-10T22:42:09.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.627+0000 7f6e20a00640 1 --2- 172.21.15.103:0/2799380315 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6df80725e0 0x7f6df8074aa0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.627+0000 7f6e20a00640 1 --2- 172.21.15.103:0/2799380315 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e1c1ecb30 0x7f6e1c1ecfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.627+0000 7f6e20a00640 1 --2- 172.21.15.103:0/2799380315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e1c0cb140 0x7f6e1c0b6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.627+0000 7f6e20a00640 1 --2- 172.21.15.103:0/2799380315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e00003a60 0x7f6e1c150fa0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.627+0000 7f6e20a00640 1 -- 172.21.15.103:0/2799380315 >> 172.21.15.103:0/2799380315 conn(0x7f6e1c0d1a20 msgr2=0x7f6e1c071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.627+0000 7f6e20a00640 1 -- 172.21.15.103:0/2799380315 shutdown_connections 2024-09-10T22:42:09.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.627+0000 7f6e20a00640 1 -- 172.21.15.103:0/2799380315 wait complete. 2024-09-10T22:42:09.648 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T22:38:39.639064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T22:42:09.648 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T22:42:09.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.787+0000 7f1c96600640 1 -- 172.21.15.103:0/2112763368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c900cf790 msgr2=0x7f1c900cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:09.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.787+0000 7f1c96600640 1 --2- 172.21.15.103:0/2112763368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c900cf790 0x7f1c900cfc20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009c80 tx=0x7f1c8801cd10 comp rx=0 tx=0).stop 2024-09-10T22:42:09.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.787+0000 7f1c96600640 1 -- 172.21.15.103:0/2112763368 shutdown_connections 2024-09-10T22:42:09.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.787+0000 7f1c96600640 1 --2- 172.21.15.103:0/2112763368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c900cf790 0x7f1c900cfc20 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.787+0000 7f1c96600640 1 --2- 172.21.15.103:0/2112763368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c900aeb40 0x7f1c90072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.787+0000 7f1c96600640 1 -- 172.21.15.103:0/2112763368 >> 172.21.15.103:0/2112763368 conn(0x7f1c9006cc00 msgr2=0x7f1c9006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:09.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.787+0000 7f1c96600640 1 -- 172.21.15.103:0/2112763368 shutdown_connections 2024-09-10T22:42:09.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.787+0000 7f1c96600640 1 -- 172.21.15.103:0/2112763368 wait complete. 2024-09-10T22:42:09.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c96600640 1 Processor -- start 2024-09-10T22:42:09.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c96600640 1 -- start start 2024-09-10T22:42:09.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c96600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c900aeb40 0x7f1c9014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:09.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c96600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c900cc120 0x7f1c9014ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:09.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c96600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c900cf790 0x7f1c901523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:09.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c96600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1c90168d00 con 0x7f1c900cf790 2024-09-10T22:42:09.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c96600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1c90168b80 con 0x7f1c900cc120 2024-09-10T22:42:09.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c96600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1c90168e80 con 0x7f1c900aeb40 2024-09-10T22:42:09.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c8fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c900cf790 0x7f1c901523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:09.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c8fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c900cf790 0x7f1c901523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34506/0 (socket says 172.21.15.103:34506) 2024-09-10T22:42:09.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c8fe00640 1 -- 172.21.15.103:0/4055078155 learned_addr learned my addr 172.21.15.103:0/4055078155 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:09.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c8fe00640 1 -- 172.21.15.103:0/4055078155 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c900aeb40 msgr2=0x7f1c9014e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:09.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c8fe00640 1 --2- 172.21.15.103:0/4055078155 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c900aeb40 0x7f1c9014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c8fe00640 1 -- 172.21.15.103:0/4055078155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c900cc120 msgr2=0x7f1c9014ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:09.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c8fe00640 1 --2- 172.21.15.103:0/4055078155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c900cc120 0x7f1c9014ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c8fe00640 1 -- 172.21.15.103:0/4055078155 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c90152920 con 0x7f1c900cf790 2024-09-10T22:42:09.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c8fe00640 1 --2- 172.21.15.103:0/4055078155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c900cf790 0x7f1c901523e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f1c8801b3c0 tx=0x7f1c880093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:09.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c87e00640 1 -- 172.21.15.103:0/4055078155 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c880b2040 con 0x7f1c900cf790 2024-09-10T22:42:09.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c87e00640 1 -- 172.21.15.103:0/4055078155 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c88004200 con 0x7f1c900cf790 2024-09-10T22:42:09.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c87e00640 1 -- 172.21.15.103:0/4055078155 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c88004650 con 0x7f1c900cf790 2024-09-10T22:42:09.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c96600640 1 -- 172.21.15.103:0/4055078155 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c9014f700 con 0x7f1c900cf790 2024-09-10T22:42:09.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.791+0000 7f1c96600640 1 -- 172.21.15.103:0/4055078155 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c9014fcc0 con 0x7f1c900cf790 2024-09-10T22:42:09.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.795+0000 7f1c96600640 1 -- 172.21.15.103:0/4055078155 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c90072e30 con 0x7f1c900cf790 2024-09-10T22:42:09.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.795+0000 7f1c87e00640 1 -- 172.21.15.103:0/4055078155 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1c880b5070 con 0x7f1c900cf790 2024-09-10T22:42:09.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.795+0000 7f1c87e00640 1 --2- 172.21.15.103:0/4055078155 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1c6c0725e0 0x7f1c6c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:09.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.795+0000 7f1c87e00640 1 -- 172.21.15.103:0/4055078155 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5507+0+0 (secure 0 0 0) 0x7f1c8812d620 con 0x7f1c900cf790 2024-09-10T22:42:09.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.795+0000 7f1c8f400640 1 --2- 172.21.15.103:0/4055078155 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1c6c0725e0 0x7f1c6c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:09.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.799+0000 7f1c8f400640 1 --2- 172.21.15.103:0/4055078155 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1c6c0725e0 0x7f1c6c074aa0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1c80007fd0 tx=0x7f1c800078e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:09.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.799+0000 7f1c87e00640 1 -- 172.21.15.103:0/4055078155 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1c88016990 con 0x7f1c900cf790 2024-09-10T22:42:09.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.963+0000 7f1c96600640 1 -- 172.21.15.103:0/4055078155 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1c901594e0 con 0x7f1c900cf790 2024-09-10T22:42:09.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.963+0000 7f1c87e00640 1 -- 172.21.15.103:0/4055078155 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7f1c880f8db0 con 0x7f1c900cf790 2024-09-10T22:42:09.967 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-09-10T22:42:09.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.967+0000 7f1c96600640 1 -- 172.21.15.103:0/4055078155 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1c6c0725e0 msgr2=0x7f1c6c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:09.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.967+0000 7f1c96600640 1 --2- 172.21.15.103:0/4055078155 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1c6c0725e0 0x7f1c6c074aa0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1c80007fd0 tx=0x7f1c800078e0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.967+0000 7f1c96600640 1 -- 172.21.15.103:0/4055078155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c900cf790 msgr2=0x7f1c901523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:09.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.967+0000 7f1c96600640 1 --2- 172.21.15.103:0/4055078155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c900cf790 0x7f1c901523e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f1c8801b3c0 tx=0x7f1c880093d0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.967+0000 7f1c96600640 1 -- 172.21.15.103:0/4055078155 shutdown_connections 2024-09-10T22:42:09.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.967+0000 7f1c96600640 1 --2- 172.21.15.103:0/4055078155 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1c6c0725e0 0x7f1c6c074aa0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.967+0000 7f1c96600640 1 --2- 172.21.15.103:0/4055078155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c900cf790 0x7f1c901523e0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.967+0000 7f1c96600640 1 --2- 172.21.15.103:0/4055078155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c900cc120 0x7f1c9014ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.967+0000 7f1c96600640 1 --2- 172.21.15.103:0/4055078155 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c900aeb40 0x7f1c9014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:09.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.967+0000 7f1c96600640 1 -- 172.21.15.103:0/4055078155 >> 172.21.15.103:0/4055078155 conn(0x7f1c9006cc00 msgr2=0x7f1c900ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:09.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.967+0000 7f1c96600640 1 -- 172.21.15.103:0/4055078155 shutdown_connections 2024-09-10T22:42:09.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:09.967+0000 7f1c96600640 1 -- 172.21.15.103:0/4055078155 wait complete. 2024-09-10T22:42:09.987 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace' 2024-09-10T22:42:10.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.127+0000 7f9bd2600640 1 -- 172.21.15.103:0/2318073486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc0d2540 msgr2=0x7f9bcc0d0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:10.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.127+0000 7f9bd2600640 1 --2- 172.21.15.103:0/2318073486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc0d2540 0x7f9bcc0d0000 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc074650 tx=0x7f9bb801c5d0 comp rx=0 tx=0).stop 2024-09-10T22:42:10.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.127+0000 7f9bd2600640 1 -- 172.21.15.103:0/2318073486 shutdown_connections 2024-09-10T22:42:10.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.127+0000 7f9bd2600640 1 --2- 172.21.15.103:0/2318073486 >> v2:172.21.15.131:3300/0 conn(0x7f9bcc0d0540 0x7f9bcc0ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:10.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.127+0000 7f9bd2600640 1 --2- 172.21.15.103:0/2318073486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc0d2540 0x7f9bcc0d0000 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:10.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.127+0000 7f9bd2600640 1 --2- 172.21.15.103:0/2318073486 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9bcc15bcb0 0x7f9bcc0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:10.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.127+0000 7f9bd2600640 1 -- 172.21.15.103:0/2318073486 >> 172.21.15.103:0/2318073486 conn(0x7f9bcc0d1a20 msgr2=0x7f9bcc0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:10.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.127+0000 7f9bd2600640 1 -- 172.21.15.103:0/2318073486 shutdown_connections 2024-09-10T22:42:10.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.127+0000 7f9bd2600640 1 -- 172.21.15.103:0/2318073486 wait complete. 2024-09-10T22:42:10.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bd2600640 1 Processor -- start 2024-09-10T22:42:10.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bd2600640 1 -- start start 2024-09-10T22:42:10.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bd2600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9bcc0d0540 0x7f9bcc0cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:10.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bd2600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc0d2540 0x7f9bcc1f5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:10.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bd2600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bcc15bcb0 0x7f9bcc159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:10.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bd2600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc0b1a10 con 0x7f9bcc0d2540 2024-09-10T22:42:10.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bd2600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc0b1890 con 0x7f9bcc15bcb0 2024-09-10T22:42:10.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bd2600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9bcc0b1b90 con 0x7f9bcc0d0540 2024-09-10T22:42:10.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bcaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc0d2540 0x7f9bcc1f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:10.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bcaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc0d2540 0x7f9bcc1f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34524/0 (socket says 172.21.15.103:34524) 2024-09-10T22:42:10.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bcaa00640 1 -- 172.21.15.103:0/4137586844 learned_addr learned my addr 172.21.15.103:0/4137586844 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:10.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bcbe00640 1 --2- 172.21.15.103:0/4137586844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bcc15bcb0 0x7f9bcc159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:10.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bcaa00640 1 -- 172.21.15.103:0/4137586844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9bcc0d0540 msgr2=0x7f9bcc0cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:10.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bcaa00640 1 --2- 172.21.15.103:0/4137586844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9bcc0d0540 0x7f9bcc0cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:10.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bcaa00640 1 -- 172.21.15.103:0/4137586844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bcc15bcb0 msgr2=0x7f9bcc159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:10.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bcaa00640 1 --2- 172.21.15.103:0/4137586844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bcc15bcb0 0x7f9bcc159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:10.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bcaa00640 1 -- 172.21.15.103:0/4137586844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bcc1f5cb0 con 0x7f9bcc0d2540 2024-09-10T22:42:10.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bcaa00640 1 --2- 172.21.15.103:0/4137586844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc0d2540 0x7f9bcc1f5770 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8009850 tx=0x7f9bb80a64e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:10.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bc3400640 1 -- 172.21.15.103:0/4137586844 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb80ac070 con 0x7f9bcc0d2540 2024-09-10T22:42:10.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bc3400640 1 -- 172.21.15.103:0/4137586844 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bb8004340 con 0x7f9bcc0d2540 2024-09-10T22:42:10.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bc3400640 1 -- 172.21.15.103:0/4137586844 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8005320 con 0x7f9bcc0d2540 2024-09-10T22:42:10.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bd2600640 1 -- 172.21.15.103:0/4137586844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bcc0c9c70 con 0x7f9bcc0d2540 2024-09-10T22:42:10.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.131+0000 7f9bd2600640 1 -- 172.21.15.103:0/4137586844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bcc0ca230 con 0x7f9bcc0d2540 2024-09-10T22:42:10.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.135+0000 7f9bd2600640 1 -- 172.21.15.103:0/4137586844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bcc0008e0 con 0x7f9bcc0d2540 2024-09-10T22:42:10.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.135+0000 7f9bc3400640 1 -- 172.21.15.103:0/4137586844 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9bb80054c0 con 0x7f9bcc0d2540 2024-09-10T22:42:10.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.135+0000 7f9bc3400640 1 --2- 172.21.15.103:0/4137586844 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9bac0725e0 0x7f9bac074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:10.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.135+0000 7f9bc3400640 1 -- 172.21.15.103:0/4137586844 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5507+0+0 (secure 0 0 0) 0x7f9bb812d880 con 0x7f9bcc0d2540 2024-09-10T22:42:10.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.139+0000 7f9bcb400640 1 --2- 172.21.15.103:0/4137586844 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9bac0725e0 0x7f9bac074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:10.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.139+0000 7f9bcb400640 1 --2- 172.21.15.103:0/4137586844 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9bac0725e0 0x7f9bac074aa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0058d0 tx=0x7f9bbc005860 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:10.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.139+0000 7f9bc3400640 1 -- 172.21.15.103:0/4137586844 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9bcc1f5cb0 con 0x7f9bcc0d2540 2024-09-10T22:42:10.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:10.367+0000 7f9bd2600640 1 -- 172.21.15.103:0/4137586844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]} v 0) -- 0x7f9bcc15a4f0 con 0x7f9bcc0d2540 2024-09-10T22:42:11.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.287+0000 7f9bc3400640 1 -- 172.21.15.103:0/4137586844 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]}]=0 v186) ==== 145+0+0 (secure 0 0 0) 0x7f9bb80164b0 con 0x7f9bcc0d2540 2024-09-10T22:42:11.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.291+0000 7f9bd2600640 1 -- 172.21.15.103:0/4137586844 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9bac0725e0 msgr2=0x7f9bac074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:11.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.291+0000 7f9bd2600640 1 --2- 172.21.15.103:0/4137586844 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9bac0725e0 0x7f9bac074aa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0058d0 tx=0x7f9bbc005860 comp rx=0 tx=0).stop 2024-09-10T22:42:11.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.291+0000 7f9bd2600640 1 -- 172.21.15.103:0/4137586844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc0d2540 msgr2=0x7f9bcc1f5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:11.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.291+0000 7f9bd2600640 1 --2- 172.21.15.103:0/4137586844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc0d2540 0x7f9bcc1f5770 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8009850 tx=0x7f9bb80a64e0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.291+0000 7f9bd2600640 1 -- 172.21.15.103:0/4137586844 shutdown_connections 2024-09-10T22:42:11.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.291+0000 7f9bd2600640 1 --2- 172.21.15.103:0/4137586844 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9bac0725e0 0x7f9bac074aa0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.291+0000 7f9bd2600640 1 --2- 172.21.15.103:0/4137586844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bcc15bcb0 0x7f9bcc159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.291+0000 7f9bd2600640 1 --2- 172.21.15.103:0/4137586844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bcc0d2540 0x7f9bcc1f5770 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.291+0000 7f9bd2600640 1 --2- 172.21.15.103:0/4137586844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9bcc0d0540 0x7f9bcc0cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.291+0000 7f9bd2600640 1 -- 172.21.15.103:0/4137586844 >> 172.21.15.103:0/4137586844 conn(0x7f9bcc0d1a20 msgr2=0x7f9bcc0d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:11.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.291+0000 7f9bd2600640 1 -- 172.21.15.103:0/4137586844 shutdown_connections 2024-09-10T22:42:11.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.291+0000 7f9bd2600640 1 -- 172.21.15.103:0/4137586844 wait complete. 2024-09-10T22:42:11.316 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T22:42:11.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.459+0000 7f6df8400640 1 -- 172.21.15.103:0/3704727855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6df00cc120 msgr2=0x7f6df00aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:11.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.459+0000 7f6df8400640 1 --2- 172.21.15.103:0/3704727855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6df00cc120 0x7f6df00aeb40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6de4009900 tx=0x7f6de401c820 comp rx=0 tx=0).stop 2024-09-10T22:42:11.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.459+0000 7f6df8400640 1 -- 172.21.15.103:0/3704727855 shutdown_connections 2024-09-10T22:42:11.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.459+0000 7f6df8400640 1 --2- 172.21.15.103:0/3704727855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6df00cc120 0x7f6df00aeb40 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.459+0000 7f6df8400640 1 -- 172.21.15.103:0/3704727855 >> 172.21.15.103:0/3704727855 conn(0x7f6df006cc00 msgr2=0x7f6df006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:11.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.459+0000 7f6df8400640 1 -- 172.21.15.103:0/3704727855 shutdown_connections 2024-09-10T22:42:11.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.459+0000 7f6df8400640 1 -- 172.21.15.103:0/3704727855 wait complete. 2024-09-10T22:42:11.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.459+0000 7f6df8400640 1 Processor -- start 2024-09-10T22:42:11.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.459+0000 7f6df8400640 1 -- start start 2024-09-10T22:42:11.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df8400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6df00cc120 0x7f6df014fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:11.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df8400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6df00cf790 0x7f6df015b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:11.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df8400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6df015c970 0x7f6df00b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:11.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df8400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6df016a250 con 0x7f6df015c970 2024-09-10T22:42:11.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df8400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6df016a0d0 con 0x7f6df00cf790 2024-09-10T22:42:11.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df8400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6df016a3d0 con 0x7f6df00cc120 2024-09-10T22:42:11.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df6400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6df015c970 0x7f6df00b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:11.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df6400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6df015c970 0x7f6df00b0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34538/0 (socket says 172.21.15.103:34538) 2024-09-10T22:42:11.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df6400640 1 -- 172.21.15.103:0/403962099 learned_addr learned my addr 172.21.15.103:0/403962099 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:11.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df5000640 1 --2- 172.21.15.103:0/403962099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6df00cf790 0x7f6df015b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:11.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df5a00640 1 --2- 172.21.15.103:0/403962099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6df00cc120 0x7f6df014fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:11.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df6400640 1 -- 172.21.15.103:0/403962099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6df00cc120 msgr2=0x7f6df014fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:11.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df6400640 1 --2- 172.21.15.103:0/403962099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6df00cc120 0x7f6df014fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df6400640 1 -- 172.21.15.103:0/403962099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6df00cf790 msgr2=0x7f6df015b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:11.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df6400640 1 --2- 172.21.15.103:0/403962099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6df00cf790 0x7f6df015b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df6400640 1 -- 172.21.15.103:0/403962099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df0150410 con 0x7f6df015c970 2024-09-10T22:42:11.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df6400640 1 --2- 172.21.15.103:0/403962099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6df015c970 0x7f6df00b0eb0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6de800c760 tx=0x7f6de800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:11.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6ded600640 1 -- 172.21.15.103:0/403962099 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de8003db0 con 0x7f6df015c970 2024-09-10T22:42:11.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6ded600640 1 -- 172.21.15.103:0/403962099 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6de8005070 con 0x7f6df015c970 2024-09-10T22:42:11.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df8400640 1 -- 172.21.15.103:0/403962099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df01f5980 con 0x7f6df015c970 2024-09-10T22:42:11.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6ded600640 1 -- 172.21.15.103:0/403962099 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de80054c0 con 0x7f6df015c970 2024-09-10T22:42:11.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df8400640 1 -- 172.21.15.103:0/403962099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df01f5f20 con 0x7f6df015c970 2024-09-10T22:42:11.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6df8400640 1 -- 172.21.15.103:0/403962099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df00aeb40 con 0x7f6df015c970 2024-09-10T22:42:11.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.463+0000 7f6ded600640 1 -- 172.21.15.103:0/403962099 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6de8005660 con 0x7f6df015c970 2024-09-10T22:42:11.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.467+0000 7f6ded600640 1 --2- 172.21.15.103:0/403962099 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6dd00725e0 0x7f6dd0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:11.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.467+0000 7f6ded600640 1 -- 172.21.15.103:0/403962099 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5507+0+0 (secure 0 0 0) 0x7f6de8092e70 con 0x7f6df015c970 2024-09-10T22:42:11.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.467+0000 7f6df5a00640 1 --2- 172.21.15.103:0/403962099 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6dd00725e0 0x7f6dd0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:11.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.467+0000 7f6df5a00640 1 --2- 172.21.15.103:0/403962099 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6dd00725e0 0x7f6dd0074aa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6de40af000 tx=0x7f6de401b060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:11.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.471+0000 7f6ded600640 1 -- 172.21.15.103:0/403962099 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6de805dfb0 con 0x7f6df015c970 2024-09-10T22:42:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.635+0000 7f6df8400640 1 -- 172.21.15.103:0/403962099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f6df00b3480 con 0x7f6df015c970 2024-09-10T22:42:11.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.635+0000 7f6ded600640 1 -- 172.21.15.103:0/403962099 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+1998 (secure 0 0 0) 0x7f6de80629e0 con 0x7f6df015c970 2024-09-10T22:42:11.639 INFO:teuthology.orchestra.run.smithi103.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T22:42:11.639 INFO:teuthology.orchestra.run.smithi103.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T22:42:11.639 INFO:teuthology.orchestra.run.smithi103.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T22:42:11.639 INFO:teuthology.orchestra.run.smithi103.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T22:42:11.640 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4853.781452 2024-09-10T22:42:11.640 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 8222.655229 2024-09-10T22:42:11.640 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4587.934032 2024-09-10T22:42:11.640 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4814.972817 2024-09-10T22:42:11.640 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3485.951614 2024-09-10T22:42:11.640 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3821.456289 2024-09-10T22:42:11.640 INFO:teuthology.orchestra.run.smithi103.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3533.610209 2024-09-10T22:42:11.640 INFO:teuthology.orchestra.run.smithi103.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3752.830807 2024-09-10T22:42:11.640 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced debug_mds 20/20 2024-09-10T22:42:11.640 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T22:42:11.640 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced debug_ms 2/2 2024-09-10T22:42:11.640 INFO:teuthology.orchestra.run.smithi103.stdout:mds dev mds_debug_frag true 2024-09-10T22:42:11.640 INFO:teuthology.orchestra.run.smithi103.stdout:mds dev mds_debug_scatterstat true 2024-09-10T22:42:11.641 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T22:42:11.641 INFO:teuthology.orchestra.run.smithi103.stdout:mds dev mds_verify_scatter true 2024-09-10T22:42:11.641 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T22:42:11.641 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T22:42:11.641 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T22:42:11.641 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced client_mount_timeout 600 2024-09-10T22:42:11.641 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced debug_client 20/20 2024-09-10T22:42:11.641 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced debug_ms 1/1 2024-09-10T22:42:11.641 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T22:42:11.641 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T22:42:11.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.639+0000 7f6df8400640 1 -- 172.21.15.103:0/403962099 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6dd00725e0 msgr2=0x7f6dd0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:11.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.639+0000 7f6df8400640 1 --2- 172.21.15.103:0/403962099 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6dd00725e0 0x7f6dd0074aa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6de40af000 tx=0x7f6de401b060 comp rx=0 tx=0).stop 2024-09-10T22:42:11.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.639+0000 7f6df8400640 1 -- 172.21.15.103:0/403962099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6df015c970 msgr2=0x7f6df00b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:11.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.639+0000 7f6df8400640 1 --2- 172.21.15.103:0/403962099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6df015c970 0x7f6df00b0eb0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6de800c760 tx=0x7f6de800cc20 comp rx=0 tx=0).stop 2024-09-10T22:42:11.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.639+0000 7f6df8400640 1 -- 172.21.15.103:0/403962099 shutdown_connections 2024-09-10T22:42:11.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.639+0000 7f6df8400640 1 --2- 172.21.15.103:0/403962099 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6dd00725e0 0x7f6dd0074aa0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.639+0000 7f6df8400640 1 --2- 172.21.15.103:0/403962099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6df015c970 0x7f6df00b0eb0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.639+0000 7f6df8400640 1 --2- 172.21.15.103:0/403962099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6df00cf790 0x7f6df015b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.639+0000 7f6df8400640 1 --2- 172.21.15.103:0/403962099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6df00cc120 0x7f6df014fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.639+0000 7f6df8400640 1 -- 172.21.15.103:0/403962099 >> 172.21.15.103:0/403962099 conn(0x7f6df006cc00 msgr2=0x7f6df00ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:11.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.639+0000 7f6df8400640 1 -- 172.21.15.103:0/403962099 shutdown_connections 2024-09-10T22:42:11.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.639+0000 7f6df8400640 1 -- 172.21.15.103:0/403962099 wait complete. 2024-09-10T22:42:11.661 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T22:42:11.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.803+0000 7f0893e00640 1 -- 172.21.15.103:0/2937951514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08940b06e0 msgr2=0x7f0894166730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:11.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.803+0000 7f0893e00640 1 --2- 172.21.15.103:0/2937951514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08940b06e0 0x7f0894166730 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f088c009bc0 tx=0x7f088c01ca80 comp rx=0 tx=0).stop 2024-09-10T22:42:11.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.803+0000 7f0893e00640 1 -- 172.21.15.103:0/2937951514 shutdown_connections 2024-09-10T22:42:11.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.803+0000 7f0893e00640 1 --2- 172.21.15.103:0/2937951514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08940b06e0 0x7f0894166730 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.803+0000 7f0893e00640 1 -- 172.21.15.103:0/2937951514 >> 172.21.15.103:0/2937951514 conn(0x7f08940d18f0 msgr2=0x7f08940d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:11.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.803+0000 7f0893e00640 1 -- 172.21.15.103:0/2937951514 shutdown_connections 2024-09-10T22:42:11.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.803+0000 7f0893e00640 1 -- 172.21.15.103:0/2937951514 wait complete. 2024-09-10T22:42:11.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.803+0000 7f0893e00640 1 Processor -- start 2024-09-10T22:42:11.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.803+0000 7f0893e00640 1 -- start start 2024-09-10T22:42:11.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f0893e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08940714d0 0x7f089414dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:11.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f0893e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08940b06e0 0x7f089414d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:11.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f0893e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f089415f0e0 0x7f0894158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:11.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f0893e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0894169980 con 0x7f08940b06e0 2024-09-10T22:42:11.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f0893e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0894169800 con 0x7f089415f0e0 2024-09-10T22:42:11.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f0893e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0894169b00 con 0x7f08940714d0 2024-09-10T22:42:11.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f088a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08940b06e0 0x7f089414d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:11.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f088a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08940b06e0 0x7f089414d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34552/0 (socket says 172.21.15.103:34552) 2024-09-10T22:42:11.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f088a000640 1 -- 172.21.15.103:0/1941841470 learned_addr learned my addr 172.21.15.103:0/1941841470 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:11.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f0892a00640 1 --2- 172.21.15.103:0/1941841470 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08940714d0 0x7f089414dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:11.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f0893400640 1 --2- 172.21.15.103:0/1941841470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f089415f0e0 0x7f0894158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:11.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f088a000640 1 -- 172.21.15.103:0/1941841470 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08940714d0 msgr2=0x7f089414dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:11.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f088a000640 1 --2- 172.21.15.103:0/1941841470 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08940714d0 0x7f089414dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f088a000640 1 -- 172.21.15.103:0/1941841470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f089415f0e0 msgr2=0x7f0894158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:11.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f088a000640 1 --2- 172.21.15.103:0/1941841470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f089415f0e0 0x7f0894158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f088a000640 1 -- 172.21.15.103:0/1941841470 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0894157bc0 con 0x7f08940b06e0 2024-09-10T22:42:11.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f0893400640 1 --2- 172.21.15.103:0/1941841470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f089415f0e0 0x7f0894158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:11.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f088a000640 1 --2- 172.21.15.103:0/1941841470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08940b06e0 0x7f089414d460 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f087c00c4d0 tx=0x7f087c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:11.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f088b400640 1 -- 172.21.15.103:0/1941841470 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c016020 con 0x7f08940b06e0 2024-09-10T22:42:11.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f088b400640 1 -- 172.21.15.103:0/1941841470 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f087c012920 con 0x7f08940b06e0 2024-09-10T22:42:11.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f088b400640 1 -- 172.21.15.103:0/1941841470 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c012d70 con 0x7f08940b06e0 2024-09-10T22:42:11.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f0893e00640 1 -- 172.21.15.103:0/1941841470 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0894157ea0 con 0x7f08940b06e0 2024-09-10T22:42:11.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f0893e00640 1 -- 172.21.15.103:0/1941841470 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0894158460 con 0x7f08940b06e0 2024-09-10T22:42:11.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f0893e00640 1 -- 172.21.15.103:0/1941841470 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08940affd0 con 0x7f08940b06e0 2024-09-10T22:42:11.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.807+0000 7f088b400640 1 -- 172.21.15.103:0/1941841470 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f087c01b400 con 0x7f08940b06e0 2024-09-10T22:42:11.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.811+0000 7f088b400640 1 --2- 172.21.15.103:0/1941841470 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f08700725e0 0x7f0870074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:11.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.811+0000 7f088b400640 1 -- 172.21.15.103:0/1941841470 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5507+0+0 (secure 0 0 0) 0x7f087c093590 con 0x7f08940b06e0 2024-09-10T22:42:11.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.811+0000 7f0892a00640 1 --2- 172.21.15.103:0/1941841470 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f08700725e0 0x7f0870074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:11.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.811+0000 7f0892a00640 1 --2- 172.21.15.103:0/1941841470 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f08700725e0 0x7f0870074aa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0884000f70 tx=0x7f0884009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:11.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.815+0000 7f088b400640 1 -- 172.21.15.103:0/1941841470 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f087c020020 con 0x7f08940b06e0 2024-09-10T22:42:11.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.979+0000 7f0893e00640 1 -- 172.21.15.103:0/1941841470 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f08940b7370 con 0x7f08940b06e0 2024-09-10T22:42:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.983+0000 7f088b400640 1 -- 172.21.15.103:0/1941841470 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f087c05ec90 con 0x7f08940b06e0 2024-09-10T22:42:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.983+0000 7f0893e00640 1 -- 172.21.15.103:0/1941841470 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f08700725e0 msgr2=0x7f0870074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.983+0000 7f0893e00640 1 --2- 172.21.15.103:0/1941841470 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f08700725e0 0x7f0870074aa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0884000f70 tx=0x7f0884009040 comp rx=0 tx=0).stop 2024-09-10T22:42:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.983+0000 7f0893e00640 1 -- 172.21.15.103:0/1941841470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08940b06e0 msgr2=0x7f089414d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.983+0000 7f0893e00640 1 --2- 172.21.15.103:0/1941841470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08940b06e0 0x7f089414d460 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f087c00c4d0 tx=0x7f087c00c990 comp rx=0 tx=0).stop 2024-09-10T22:42:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.983+0000 7f0893e00640 1 -- 172.21.15.103:0/1941841470 shutdown_connections 2024-09-10T22:42:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.983+0000 7f0893e00640 1 --2- 172.21.15.103:0/1941841470 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f08700725e0 0x7f0870074aa0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.983+0000 7f0893e00640 1 --2- 172.21.15.103:0/1941841470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f089415f0e0 0x7f0894158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.983+0000 7f0893e00640 1 --2- 172.21.15.103:0/1941841470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08940b06e0 0x7f089414d460 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.983+0000 7f0893e00640 1 --2- 172.21.15.103:0/1941841470 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08940714d0 0x7f089414dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.983+0000 7f0893e00640 1 -- 172.21.15.103:0/1941841470 >> 172.21.15.103:0/1941841470 conn(0x7f08940d18f0 msgr2=0x7f089415d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.983+0000 7f0893e00640 1 -- 172.21.15.103:0/1941841470 shutdown_connections 2024-09-10T22:42:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:11.983+0000 7f0893e00640 1 -- 172.21.15.103:0/1941841470 wait complete. 2024-09-10T22:42:12.007 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T22:42:12.007 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:42:12.106 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:42:12.173 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T22:42:12.174 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:42:12.174 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:42:12.182 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350248k,nr_inodes=4087562,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3542 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T22:42:12.183 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:42:12.183 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:42:12.192 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:42:12.192 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:42:12.192 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:42:12.236 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350248k,nr_inodes=4087562,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3542 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T22:42:12.236 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:42:12.236 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:42:12.245 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:42:12.245 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T22:42:12.245 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:42:12.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.423+0000 7f01d9400640 1 -- 172.21.15.103:0/4140052578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01b8003a10 msgr2=0x7f01b8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:12.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.423+0000 7f01d9400640 1 --2- 172.21.15.103:0/4140052578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01b8003a10 0x7f01b8003e30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f01c4009b90 tx=0x7f01c401d270 comp rx=0 tx=0).stop 2024-09-10T22:42:12.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.423+0000 7f01d3200640 1 -- 172.21.15.103:0/4140052578 reap_dead start 2024-09-10T22:42:12.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.423+0000 7f01d9400640 1 -- 172.21.15.103:0/4140052578 shutdown_connections 2024-09-10T22:42:12.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.423+0000 7f01d9400640 1 -- 172.21.15.103:0/4140052578 >> 172.21.15.103:0/4140052578 conn(0x7f01d406cc00 msgr2=0x7f01d406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:12.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.423+0000 7f01d9400640 1 -- 172.21.15.103:0/4140052578 shutdown_connections 2024-09-10T22:42:12.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.423+0000 7f01d9400640 1 -- 172.21.15.103:0/4140052578 wait complete. 2024-09-10T22:42:12.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.423+0000 7f01d9400640 1 Processor -- start 2024-09-10T22:42:12.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.423+0000 7f01d9400640 1 -- start start 2024-09-10T22:42:12.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d9400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01b8003a10 0x7f01d414ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:12.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d9400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01d4159830 0x7f01d41528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d9400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01d414b490 0x7f01d4152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d9400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f01d40cd5c0 con 0x7f01b8003a10 2024-09-10T22:42:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d9400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f01d40cd440 con 0x7f01d414b490 2024-09-10T22:42:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d9400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f01d40cd740 con 0x7f01d4159830 2024-09-10T22:42:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01b8003a10 0x7f01d414ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01b8003a10 0x7f01d414ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34576/0 (socket says 172.21.15.103:34576) 2024-09-10T22:42:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d2800640 1 -- 172.21.15.103:0/3849169858 learned_addr learned my addr 172.21.15.103:0/3849169858 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d1e00640 1 --2- 172.21.15.103:0/3849169858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01d4159830 0x7f01d41528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d3200640 1 --2- 172.21.15.103:0/3849169858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01d414b490 0x7f01d4152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d2800640 1 -- 172.21.15.103:0/3849169858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01d4159830 msgr2=0x7f01d41528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d2800640 1 --2- 172.21.15.103:0/3849169858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01d4159830 0x7f01d41528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d2800640 1 -- 172.21.15.103:0/3849169858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01d414b490 msgr2=0x7f01d4152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d2800640 1 --2- 172.21.15.103:0/3849169858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01d414b490 0x7f01d4152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:12.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d2800640 1 -- 172.21.15.103:0/3849169858 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d4159ee0 con 0x7f01b8003a10 2024-09-10T22:42:12.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d2800640 1 --2- 172.21.15.103:0/3849169858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01b8003a10 0x7f01d414ac30 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f01c401d0a0 tx=0x7f01c4005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:12.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01caa00640 1 -- 172.21.15.103:0/3849169858 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c40ba070 con 0x7f01b8003a10 2024-09-10T22:42:12.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01caa00640 1 -- 172.21.15.103:0/3849169858 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01c40ac7b0 con 0x7f01b8003a10 2024-09-10T22:42:12.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01caa00640 1 -- 172.21.15.103:0/3849169858 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c40b1040 con 0x7f01b8003a10 2024-09-10T22:42:12.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d9400640 1 -- 172.21.15.103:0/3849169858 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01d41584d0 con 0x7f01b8003a10 2024-09-10T22:42:12.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d9400640 1 -- 172.21.15.103:0/3849169858 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01d4158a70 con 0x7f01b8003a10 2024-09-10T22:42:12.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.427+0000 7f01d9400640 1 -- 172.21.15.103:0/3849169858 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01d4073610 con 0x7f01b8003a10 2024-09-10T22:42:12.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.431+0000 7f01caa00640 1 -- 172.21.15.103:0/3849169858 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f01c40046d0 con 0x7f01b8003a10 2024-09-10T22:42:12.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.431+0000 7f01caa00640 1 --2- 172.21.15.103:0/3849169858 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f01b40725e0 0x7f01b4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:12.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.431+0000 7f01caa00640 1 -- 172.21.15.103:0/3849169858 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5507+0+0 (secure 0 0 0) 0x7f01c412df80 con 0x7f01b8003a10 2024-09-10T22:42:12.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.431+0000 7f01d1e00640 1 --2- 172.21.15.103:0/3849169858 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f01b40725e0 0x7f01b4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:12.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.431+0000 7f01d1e00640 1 --2- 172.21.15.103:0/3849169858 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f01b40725e0 0x7f01b4074aa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f01c0001ec0 tx=0x7f01c0006040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:12.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.435+0000 7f01caa00640 1 -- 172.21.15.103:0/3849169858 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f01c4016fc0 con 0x7f01b8003a10 2024-09-10T22:42:12.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.635+0000 7f01d9400640 1 -- 172.21.15.103:0/3849169858 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01d4073ad0 con 0x7f01b8003a10 2024-09-10T22:42:12.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.635+0000 7f01caa00640 1 -- 172.21.15.103:0/3849169858 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+3923 (secure 0 0 0) 0x7f01c40f90c0 con 0x7f01b8003a10 2024-09-10T22:42:12.638 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:12.638 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":47,"btime":"2024-09-10T22:42:06:084800+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/1187797704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1187797704},{"type":"v1","addr":"172.21.15.131:6836","nonce":1187797704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5576,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3087722832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3087722832},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087722832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6189,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/1413418732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1413418732},{"type":"v1","addr":"172.21.15.103:6833","nonce":1413418732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/3415945490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3415945490},{"type":"v1","addr":"172.21.15.103:6835","nonce":3415945490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[]} 2024-09-10T22:42:12.638 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 47 2024-09-10T22:42:12.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.635+0000 7f01d9400640 1 -- 172.21.15.103:0/3849169858 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f01b40725e0 msgr2=0x7f01b4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:12.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.635+0000 7f01d9400640 1 --2- 172.21.15.103:0/3849169858 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f01b40725e0 0x7f01b4074aa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f01c0001ec0 tx=0x7f01c0006040 comp rx=0 tx=0).stop 2024-09-10T22:42:12.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.635+0000 7f01d9400640 1 -- 172.21.15.103:0/3849169858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01b8003a10 msgr2=0x7f01d414ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:12.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.635+0000 7f01d9400640 1 --2- 172.21.15.103:0/3849169858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01b8003a10 0x7f01d414ac30 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f01c401d0a0 tx=0x7f01c4005620 comp rx=0 tx=0).stop 2024-09-10T22:42:12.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.635+0000 7f01d9400640 1 -- 172.21.15.103:0/3849169858 shutdown_connections 2024-09-10T22:42:12.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.635+0000 7f01d9400640 1 --2- 172.21.15.103:0/3849169858 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f01b40725e0 0x7f01b4074aa0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:12.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.635+0000 7f01d9400640 1 --2- 172.21.15.103:0/3849169858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01d414b490 0x7f01d4152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:12.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.635+0000 7f01d9400640 1 --2- 172.21.15.103:0/3849169858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01d4159830 0x7f01d41528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:12.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.635+0000 7f01d9400640 1 --2- 172.21.15.103:0/3849169858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01b8003a10 0x7f01d414ac30 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:12.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.635+0000 7f01d9400640 1 -- 172.21.15.103:0/3849169858 >> 172.21.15.103:0/3849169858 conn(0x7f01d406cc00 msgr2=0x7f01d40b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:12.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.635+0000 7f01d9400640 1 -- 172.21.15.103:0/3849169858 shutdown_connections 2024-09-10T22:42:12.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.635+0000 7f01d9400640 1 -- 172.21.15.103:0/3849169858 wait complete. 2024-09-10T22:42:12.659 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T22:42:12.660 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T22:42:12.660 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T22:42:12.660 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:42:12.660 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T22:42:12.660 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T22:42:12.660 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T22:42:12.661 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:42:12.661 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T22:42:12.661 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T22:42:12.661 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T22:42:12.661 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:42:12.661 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T22:42:12.661 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T22:42:12.661 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T22:42:12.662 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:42:12.672 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T22:42:12.673 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T22:42:12.674 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T22:42:12.674 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T22:42:12.676 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T22:42:12.676 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T22:42:12.677 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T22:42:12.677 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T22:42:12.723 INFO:tasks.ceph.mds.c:Started 2024-09-10T22:42:12.723 DEBUG:teuthology.parallel:result is None 2024-09-10T22:42:12.725 INFO:tasks.ceph.mds.a:Started 2024-09-10T22:42:12.725 DEBUG:teuthology.parallel:result is None 2024-09-10T22:42:12.727 INFO:tasks.ceph.mds.b:Started 2024-09-10T22:42:12.727 DEBUG:teuthology.parallel:result is None 2024-09-10T22:42:12.728 INFO:tasks.ceph.mds.d:Started 2024-09-10T22:42:12.728 DEBUG:teuthology.parallel:result is None 2024-09-10T22:42:12.729 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T22:42:12.807 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-09-10T22:42:12.810 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-09-10T22:42:12.819 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2024-09-10T22:42:12.821 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2024-09-10T22:42:12.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.875+0000 7f39b8e00640 1 -- 172.21.15.103:0/4064465728 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39b40cf790 msgr2=0x7f39b40cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:12.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.875+0000 7f39b8e00640 1 --2- 172.21.15.103:0/4064465728 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39b40cf790 0x7f39b40cfc20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009bf0 tx=0x7f39ac01cb50 comp rx=0 tx=0).stop 2024-09-10T22:42:12.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.875+0000 7f39b8e00640 1 -- 172.21.15.103:0/4064465728 shutdown_connections 2024-09-10T22:42:12.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.875+0000 7f39b8e00640 1 --2- 172.21.15.103:0/4064465728 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39b40cf790 0x7f39b40cfc20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:12.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.875+0000 7f39b8e00640 1 -- 172.21.15.103:0/4064465728 >> 172.21.15.103:0/4064465728 conn(0x7f39b406cc00 msgr2=0x7f39b406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:12.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.875+0000 7f39b8e00640 1 -- 172.21.15.103:0/4064465728 shutdown_connections 2024-09-10T22:42:12.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.875+0000 7f39b8e00640 1 -- 172.21.15.103:0/4064465728 wait complete. 2024-09-10T22:42:12.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b8e00640 1 Processor -- start 2024-09-10T22:42:12.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b8e00640 1 -- start start 2024-09-10T22:42:12.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b8e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39b40aeb40 0x7f39b41543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:12.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b8e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39b40cc120 0x7f39b40af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:12.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b8e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39b40cf790 0x7f39b415a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:12.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b8e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f39b4169f60 con 0x7f39b40cf790 2024-09-10T22:42:12.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b8e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f39b4169de0 con 0x7f39b40aeb40 2024-09-10T22:42:12.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b8e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f39b416a0e0 con 0x7f39b40cc120 2024-09-10T22:42:12.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39b40cf790 0x7f39b415a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:12.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39b40cf790 0x7f39b415a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34616/0 (socket says 172.21.15.103:34616) 2024-09-10T22:42:12.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b2800640 1 -- 172.21.15.103:0/3483283875 learned_addr learned my addr 172.21.15.103:0/3483283875 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:12.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b1e00640 1 --2- 172.21.15.103:0/3483283875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39b40aeb40 0x7f39b41543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:12.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b1400640 1 --2- 172.21.15.103:0/3483283875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39b40cc120 0x7f39b40af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:12.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b2800640 1 -- 172.21.15.103:0/3483283875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39b40cc120 msgr2=0x7f39b40af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:12.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b2800640 1 --2- 172.21.15.103:0/3483283875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39b40cc120 0x7f39b40af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:12.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b2800640 1 -- 172.21.15.103:0/3483283875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39b40aeb40 msgr2=0x7f39b41543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:12.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b2800640 1 --2- 172.21.15.103:0/3483283875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39b40aeb40 0x7f39b41543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:12.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b2800640 1 -- 172.21.15.103:0/3483283875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b40af8b0 con 0x7f39b40cf790 2024-09-10T22:42:12.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b2800640 1 --2- 172.21.15.103:0/3483283875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39b40cf790 0x7f39b415a5f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f39ac01c5c0 tx=0x7f39ac005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:12.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39aa000640 1 -- 172.21.15.103:0/3483283875 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac0b2040 con 0x7f39b40cf790 2024-09-10T22:42:12.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39aa000640 1 -- 172.21.15.103:0/3483283875 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39ac0bb070 con 0x7f39b40cf790 2024-09-10T22:42:12.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b8e00640 1 -- 172.21.15.103:0/3483283875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b41fb5d0 con 0x7f39b40cf790 2024-09-10T22:42:12.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39aa000640 1 -- 172.21.15.103:0/3483283875 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac0045f0 con 0x7f39b40cf790 2024-09-10T22:42:12.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.879+0000 7f39b8e00640 1 -- 172.21.15.103:0/3483283875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b41667a0 con 0x7f39b40cf790 2024-09-10T22:42:12.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.883+0000 7f39b8e00640 1 -- 172.21.15.103:0/3483283875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b40cfc20 con 0x7f39b40cf790 2024-09-10T22:42:12.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.883+0000 7f39aa000640 1 -- 172.21.15.103:0/3483283875 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f39ac0b5070 con 0x7f39b40cf790 2024-09-10T22:42:12.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.883+0000 7f39aa000640 1 --2- 172.21.15.103:0/3483283875 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f39940725e0 0x7f3994074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:12.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.883+0000 7f39aa000640 1 -- 172.21.15.103:0/3483283875 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5507+0+0 (secure 0 0 0) 0x7f39ac12d670 con 0x7f39b40cf790 2024-09-10T22:42:12.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.883+0000 7f39b1e00640 1 --2- 172.21.15.103:0/3483283875 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f39940725e0 0x7f3994074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:12.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.883+0000 7f39b1e00640 1 --2- 172.21.15.103:0/3483283875 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f39940725e0 0x7f3994074aa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f39a4000f70 tx=0x7f39a4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:12.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:12.887+0000 7f39aa000640 1 -- 172.21.15.103:0/3483283875 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f39ac0167d0 con 0x7f39b40cf790 2024-09-10T22:42:13.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.059+0000 7f39b8e00640 1 -- 172.21.15.103:0/3483283875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f39b4075df0 con 0x7f39b40cf790 2024-09-10T22:42:13.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.303+0000 7f39aa000640 1 -- 172.21.15.103:0/3483283875 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v62) ==== 97+0+0 (secure 0 0 0) 0x7f39ac0f8730 con 0x7f39b40cf790 2024-09-10T22:42:13.308 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blocklist entries 2024-09-10T22:42:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.307+0000 7f39b8e00640 1 -- 172.21.15.103:0/3483283875 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f39940725e0 msgr2=0x7f3994074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.307+0000 7f39b8e00640 1 --2- 172.21.15.103:0/3483283875 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f39940725e0 0x7f3994074aa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f39a4000f70 tx=0x7f39a4009040 comp rx=0 tx=0).stop 2024-09-10T22:42:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.307+0000 7f39b8e00640 1 -- 172.21.15.103:0/3483283875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39b40cf790 msgr2=0x7f39b415a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.307+0000 7f39b8e00640 1 --2- 172.21.15.103:0/3483283875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39b40cf790 0x7f39b415a5f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f39ac01c5c0 tx=0x7f39ac005a60 comp rx=0 tx=0).stop 2024-09-10T22:42:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.307+0000 7f39b8e00640 1 -- 172.21.15.103:0/3483283875 shutdown_connections 2024-09-10T22:42:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.307+0000 7f39b8e00640 1 --2- 172.21.15.103:0/3483283875 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f39940725e0 0x7f3994074aa0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.307+0000 7f39b8e00640 1 --2- 172.21.15.103:0/3483283875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39b40cf790 0x7f39b415a5f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.307+0000 7f39b8e00640 1 --2- 172.21.15.103:0/3483283875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39b40cc120 0x7f39b40af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.307+0000 7f39b8e00640 1 --2- 172.21.15.103:0/3483283875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39b40aeb40 0x7f39b41543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.307+0000 7f39b8e00640 1 -- 172.21.15.103:0/3483283875 >> 172.21.15.103:0/3483283875 conn(0x7f39b406cc00 msgr2=0x7f39b4155f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.307+0000 7f39b8e00640 1 -- 172.21.15.103:0/3483283875 shutdown_connections 2024-09-10T22:42:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.307+0000 7f39b8e00640 1 -- 172.21.15.103:0/3483283875 wait complete. 2024-09-10T22:42:13.333 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T22:42:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.471+0000 7fd83d600640 1 -- 172.21.15.103:0/3904171195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8380b3320 msgr2=0x7fd838072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.471+0000 7fd83d600640 1 --2- 172.21.15.103:0/3904171195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8380b3320 0x7fd838072500 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd824009840 tx=0x7fd82401c820 comp rx=0 tx=0).stop 2024-09-10T22:42:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.471+0000 7fd83d600640 1 -- 172.21.15.103:0/3904171195 shutdown_connections 2024-09-10T22:42:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.471+0000 7fd83d600640 1 --2- 172.21.15.103:0/3904171195 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd838072a40 0x7fd838157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.471+0000 7fd83d600640 1 --2- 172.21.15.103:0/3904171195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8380b3320 0x7fd838072500 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.471+0000 7fd83d600640 1 -- 172.21.15.103:0/3904171195 >> 172.21.15.103:0/3904171195 conn(0x7fd83806cc00 msgr2=0x7fd83806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.471+0000 7fd83d600640 1 -- 172.21.15.103:0/3904171195 shutdown_connections 2024-09-10T22:42:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.471+0000 7fd83d600640 1 -- 172.21.15.103:0/3904171195 wait complete. 2024-09-10T22:42:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd83d600640 1 Processor -- start 2024-09-10T22:42:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd83d600640 1 -- start start 2024-09-10T22:42:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd83d600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd838072a40 0x7fd838143470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd83d600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8380b3320 0x7fd8380af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd83d600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8380cf260 0x7fd8380ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd83d600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd83806e980 con 0x7fd8380b3320 2024-09-10T22:42:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd83d600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd83806e800 con 0x7fd8380cf260 2024-09-10T22:42:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd83d600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd83806eb00 con 0x7fd838072a40 2024-09-10T22:42:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd836000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8380b3320 0x7fd8380af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd836000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8380b3320 0x7fd8380af4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34624/0 (socket says 172.21.15.103:34624) 2024-09-10T22:42:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd836000640 1 -- 172.21.15.103:0/2046141443 learned_addr learned my addr 172.21.15.103:0/2046141443 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd836a00640 1 --2- 172.21.15.103:0/2046141443 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd838072a40 0x7fd838143470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd837400640 1 --2- 172.21.15.103:0/2046141443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8380cf260 0x7fd8380ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd836000640 1 -- 172.21.15.103:0/2046141443 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd838072a40 msgr2=0x7fd838143470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd836000640 1 --2- 172.21.15.103:0/2046141443 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd838072a40 0x7fd838143470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd836000640 1 -- 172.21.15.103:0/2046141443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8380cf260 msgr2=0x7fd8380ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:13.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd836000640 1 --2- 172.21.15.103:0/2046141443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8380cf260 0x7fd8380ae7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:13.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd836000640 1 -- 172.21.15.103:0/2046141443 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd838147f10 con 0x7fd8380b3320 2024-09-10T22:42:13.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd836a00640 1 --2- 172.21.15.103:0/2046141443 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd838072a40 0x7fd838143470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:13.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd837400640 1 --2- 172.21.15.103:0/2046141443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8380cf260 0x7fd8380ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:13.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd836000640 1 --2- 172.21.15.103:0/2046141443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8380b3320 0x7fd8380af4e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd824009790 tx=0x7fd8240a5680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:13.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd82ea00640 1 -- 172.21.15.103:0/2046141443 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8240b2040 con 0x7fd8380b3320 2024-09-10T22:42:13.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd82ea00640 1 -- 172.21.15.103:0/2046141443 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd824004430 con 0x7fd8380b3320 2024-09-10T22:42:13.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd82ea00640 1 -- 172.21.15.103:0/2046141443 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824005280 con 0x7fd8380b3320 2024-09-10T22:42:13.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd83d600640 1 -- 172.21.15.103:0/2046141443 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8381481f0 con 0x7fd8380b3320 2024-09-10T22:42:13.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.475+0000 7fd83d600640 1 -- 172.21.15.103:0/2046141443 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd838149860 con 0x7fd8380b3320 2024-09-10T22:42:13.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.479+0000 7fd83d600640 1 -- 172.21.15.103:0/2046141443 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd838157090 con 0x7fd8380b3320 2024-09-10T22:42:13.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.479+0000 7fd82ea00640 1 -- 172.21.15.103:0/2046141443 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd8240b5070 con 0x7fd8380b3320 2024-09-10T22:42:13.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.479+0000 7fd82ea00640 1 --2- 172.21.15.103:0/2046141443 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd818072610 0x7fd818074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:13.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.479+0000 7fd82ea00640 1 -- 172.21.15.103:0/2046141443 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5249+0+0 (secure 0 0 0) 0x7fd82412c8d0 con 0x7fd8380b3320 2024-09-10T22:42:13.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.479+0000 7fd836a00640 1 --2- 172.21.15.103:0/2046141443 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd818072610 0x7fd818074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:13.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.479+0000 7fd836a00640 1 --2- 172.21.15.103:0/2046141443 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd818072610 0x7fd818074ad0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd828000f70 tx=0x7fd828009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:13.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.483+0000 7fd82ea00640 1 -- 172.21.15.103:0/2046141443 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd824016410 con 0x7fd8380b3320 2024-09-10T22:42:13.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.707+0000 7fd83d600640 1 -- 172.21.15.103:0/2046141443 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd838149a30 con 0x7fd8380b3320 2024-09-10T22:42:13.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.707+0000 7fd82ea00640 1 -- 172.21.15.103:0/2046141443 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7fd8240f8160 con 0x7fd8380b3320 2024-09-10T22:42:13.710 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:13.711 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:42:13.711 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2024-09-10T22:42:13.711 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.711 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2024-09-10T22:42:13.711 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmh8HQHBAAZlp4CnHLegqhgWrgXoyltw==", 2024-09-10T22:42:13.711 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.711 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:42:13.711 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:42:13.711 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:42:13.711 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:42:13.711 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.711 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:13.711 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.712 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2024-09-10T22:42:13.712 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmpYUNKRAAstv0pZDy3081UKcsSWnWIg==", 2024-09-10T22:42:13.712 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.712 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:42:13.712 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:42:13.712 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:42:13.712 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:42:13.712 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.712 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:13.712 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.712 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.c", 2024-09-10T22:42:13.712 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBm8I0TJBAAmW480qKYYrolVm7+SlJ97w==", 2024-09-10T22:42:13.712 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.713 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:42:13.713 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:42:13.713 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:42:13.713 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:42:13.713 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.713 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:13.713 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.713 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.d", 2024-09-10T22:42:13.713 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmB55uMBAA1VqVuUEAk1i2LFBoZXiRmA==", 2024-09-10T22:42:13.713 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.713 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:42:13.713 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:42:13.714 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:42:13.714 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:42:13.714 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.714 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:13.714 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.714 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2024-09-10T22:42:13.714 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA/yuBm+fNzNRAAwt8IZXd3mcEh5UbXc924UQ==", 2024-09-10T22:42:13.714 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.714 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:42:13.714 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:42:13.714 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:42:13.714 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.714 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:13.715 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.715 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2024-09-10T22:42:13.715 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBDyuBmNBfvDhAAcBNATtrJNZ4RFzYXqWt2pg==", 2024-09-10T22:42:13.715 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.715 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:42:13.715 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:42:13.715 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:42:13.715 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.715 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:13.715 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.715 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2024-09-10T22:42:13.715 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBGyuBmJD9HJBAAgq8tqoeDT8WNr7pMxQCCJw==", 2024-09-10T22:42:13.715 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.716 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:42:13.716 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:42:13.716 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:42:13.716 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.716 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:13.716 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.716 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2024-09-10T22:42:13.716 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBJyuBmzxWIOhAA4yOLmTZAY0MRLj+w3mhCeQ==", 2024-09-10T22:42:13.716 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.716 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:42:13.716 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:42:13.716 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:42:13.716 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.716 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:13.717 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.717 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2024-09-10T22:42:13.717 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBQyuBm3pi6ABAAnwu13uYkLRJuU5y+DE2Isw==", 2024-09-10T22:42:13.717 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.717 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:42:13.717 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:42:13.717 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:42:13.717 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.717 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:13.717 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.721 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2024-09-10T22:42:13.721 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBTyuBmkaPVFhAALlwgsnQ/dUJVLTK2iAh6Ww==", 2024-09-10T22:42:13.721 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.721 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:42:13.722 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:42:13.722 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:42:13.722 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.722 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:13.722 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.722 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2024-09-10T22:42:13.722 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBWyuBmL2kKKxAAbxeyAuzd994tvNfKKs+WIA==", 2024-09-10T22:42:13.722 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.722 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:42:13.722 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:42:13.722 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:42:13.722 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.722 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:13.723 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.723 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2024-09-10T22:42:13.723 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBayuBmUmSwBBAAWTFVgtYXlyEI+rJzGIM+Aw==", 2024-09-10T22:42:13.723 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.723 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:42:13.723 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:42:13.723 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:42:13.723 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.723 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:13.723 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.723 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2024-09-10T22:42:13.723 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmtOhZNBAAeszxWpV60NIn/zOInT5Zzw==", 2024-09-10T22:42:13.723 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.723 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:42:13.724 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2024-09-10T22:42:13.724 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T22:42:13.724 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.724 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:13.724 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.724 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2024-09-10T22:42:13.724 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9yuBmu20iAhAASacT/hh3sxW1XU/XD6uDjA==", 2024-09-10T22:42:13.724 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.724 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:42:13.724 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:42:13.725 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:42:13.725 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:42:13.725 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.725 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:13.725 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.725 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2024-09-10T22:42:13.725 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmd1E5OhAAfidEn8dwfGna8gwefsYtUg==", 2024-09-10T22:42:13.725 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.725 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:42:13.725 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:42:13.725 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:42:13.726 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:42:13.726 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.726 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:13.726 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.726 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2024-09-10T22:42:13.726 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9yuBmGGhVCBAAAs3y0cfqMN0t0/PTNsVEQw==", 2024-09-10T22:42:13.726 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.726 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:42:13.726 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:42:13.726 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:42:13.726 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:42:13.726 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.726 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:13.727 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.727 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2024-09-10T22:42:13.727 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmsY75ABAAYeEF+hTiVUtmqzwU0IIpjA==", 2024-09-10T22:42:13.727 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.727 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-09-10T22:42:13.727 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:42:13.727 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:42:13.727 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:42:13.727 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.727 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:13.727 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.727 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2024-09-10T22:42:13.727 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmghJQGBAAXvlC58nhT9H/c71/ToGCSw==", 2024-09-10T22:42:13.727 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.728 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-09-10T22:42:13.728 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2024-09-10T22:42:13.728 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:42:13.728 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.728 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:13.728 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:13.728 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2024-09-10T22:42:13.728 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBma9x+FBAAQrKkw3eGcKnLxSqVz/DHJQ==", 2024-09-10T22:42:13.728 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:42:13.728 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-09-10T22:42:13.728 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2024-09-10T22:42:13.728 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:42:13.728 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.729 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:13.729 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T22:42:13.729 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:42:13.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.711+0000 7fd83d600640 1 -- 172.21.15.103:0/2046141443 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd818072610 msgr2=0x7fd818074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:13.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.711+0000 7fd83d600640 1 --2- 172.21.15.103:0/2046141443 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd818072610 0x7fd818074ad0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd828000f70 tx=0x7fd828009040 comp rx=0 tx=0).stop 2024-09-10T22:42:13.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.711+0000 7fd83d600640 1 -- 172.21.15.103:0/2046141443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8380b3320 msgr2=0x7fd8380af4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:13.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.711+0000 7fd83d600640 1 --2- 172.21.15.103:0/2046141443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8380b3320 0x7fd8380af4e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd824009790 tx=0x7fd8240a5680 comp rx=0 tx=0).stop 2024-09-10T22:42:13.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.711+0000 7fd83d600640 1 -- 172.21.15.103:0/2046141443 shutdown_connections 2024-09-10T22:42:13.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.711+0000 7fd83d600640 1 --2- 172.21.15.103:0/2046141443 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd818072610 0x7fd818074ad0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:13.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.711+0000 7fd83d600640 1 --2- 172.21.15.103:0/2046141443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8380cf260 0x7fd8380ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:13.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.711+0000 7fd83d600640 1 --2- 172.21.15.103:0/2046141443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8380b3320 0x7fd8380af4e0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:13.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.711+0000 7fd83d600640 1 --2- 172.21.15.103:0/2046141443 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd838072a40 0x7fd838143470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:13.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.711+0000 7fd83d600640 1 -- 172.21.15.103:0/2046141443 >> 172.21.15.103:0/2046141443 conn(0x7fd83806cc00 msgr2=0x7fd838152760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:13.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.711+0000 7fd83d600640 1 -- 172.21.15.103:0/2046141443 shutdown_connections 2024-09-10T22:42:13.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.711+0000 7fd83d600640 1 -- 172.21.15.103:0/2046141443 wait complete. 2024-09-10T22:42:13.733 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T22:42:13.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.871+0000 7f239ec00640 1 -- 172.21.15.103:0/1289196140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f237c003c70 msgr2=0x7f237c004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:13.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.871+0000 7f239ec00640 1 --2- 172.21.15.103:0/1289196140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f237c003c70 0x7f237c004070 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2388001f50 tx=0x7f238801cc40 comp rx=0 tx=0).stop 2024-09-10T22:42:13.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.871+0000 7f239cc00640 1 -- 172.21.15.103:0/1289196140 reap_dead start 2024-09-10T22:42:13.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.871+0000 7f239ec00640 1 -- 172.21.15.103:0/1289196140 shutdown_connections 2024-09-10T22:42:13.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.871+0000 7f239ec00640 1 -- 172.21.15.103:0/1289196140 >> 172.21.15.103:0/1289196140 conn(0x7f23980d1ac0 msgr2=0x7f23980d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:13.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.871+0000 7f239ec00640 1 -- 172.21.15.103:0/1289196140 shutdown_connections 2024-09-10T22:42:13.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.871+0000 7f239ec00640 1 -- 172.21.15.103:0/1289196140 wait complete. 2024-09-10T22:42:13.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f239ec00640 1 Processor -- start 2024-09-10T22:42:13.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f239ec00640 1 -- start start 2024-09-10T22:42:13.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f239ec00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f237c003c70 0x7f239814ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:13.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f239ec00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23981f85a0 0x7f23980b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:13.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f239ec00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23980b2b00 0x7f2398071650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:13.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f239ec00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f23981676a0 con 0x7f23981f85a0 2024-09-10T22:42:13.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f239ec00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2398167520 con 0x7f237c003c70 2024-09-10T22:42:13.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f239ec00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2398167820 con 0x7f23980b2b00 2024-09-10T22:42:13.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f2397400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23981f85a0 0x7f23980b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:13.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f2397400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23981f85a0 0x7f23980b25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34638/0 (socket says 172.21.15.103:34638) 2024-09-10T22:42:13.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f2397400640 1 -- 172.21.15.103:0/389209818 learned_addr learned my addr 172.21.15.103:0/389209818 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:13.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f239cc00640 1 --2- 172.21.15.103:0/389209818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23980b2b00 0x7f2398071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:13.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f2397e00640 1 --2- 172.21.15.103:0/389209818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f237c003c70 0x7f239814ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:13.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f2397400640 1 -- 172.21.15.103:0/389209818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23980b2b00 msgr2=0x7f2398071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:13.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f2397400640 1 --2- 172.21.15.103:0/389209818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23980b2b00 0x7f2398071650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:13.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f2397400640 1 -- 172.21.15.103:0/389209818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f237c003c70 msgr2=0x7f239814ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:13.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f2397400640 1 --2- 172.21.15.103:0/389209818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f237c003c70 0x7f239814ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:13.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f2397400640 1 -- 172.21.15.103:0/389209818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23981fae40 con 0x7f23981f85a0 2024-09-10T22:42:13.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f2397400640 1 --2- 172.21.15.103:0/389209818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23981f85a0 0x7f23980b25c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2384006630 tx=0x7f23840039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:13.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f238fe00640 1 -- 172.21.15.103:0/389209818 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2384015070 con 0x7f23981f85a0 2024-09-10T22:42:13.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f238fe00640 1 -- 172.21.15.103:0/389209818 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2384011860 con 0x7f23981f85a0 2024-09-10T22:42:13.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f239ec00640 1 -- 172.21.15.103:0/389209818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23981fb120 con 0x7f23981f85a0 2024-09-10T22:42:13.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f238fe00640 1 -- 172.21.15.103:0/389209818 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2384011cb0 con 0x7f23981f85a0 2024-09-10T22:42:13.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.875+0000 7f239ec00640 1 -- 172.21.15.103:0/389209818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23981fb6e0 con 0x7f23981f85a0 2024-09-10T22:42:13.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.879+0000 7f239ec00640 1 -- 172.21.15.103:0/389209818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23981fb8e0 con 0x7f23981f85a0 2024-09-10T22:42:13.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.879+0000 7f238fe00640 1 -- 172.21.15.103:0/389209818 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f23840103c0 con 0x7f23981f85a0 2024-09-10T22:42:13.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.879+0000 7f238fe00640 1 --2- 172.21.15.103:0/389209818 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f23780725e0 0x7f2378074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:13.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.879+0000 7f238fe00640 1 -- 172.21.15.103:0/389209818 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5249+0+0 (secure 0 0 0) 0x7f2384093f80 con 0x7f23981f85a0 2024-09-10T22:42:13.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.879+0000 7f2397e00640 1 --2- 172.21.15.103:0/389209818 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f23780725e0 0x7f2378074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:13.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.879+0000 7f2397e00640 1 --2- 172.21.15.103:0/389209818 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f23780725e0 0x7f2378074aa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f23880a9000 tx=0x7f2388019a80 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:13.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:13.883+0000 7f238fe00640 1 -- 172.21.15.103:0/389209818 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f23981fb8e0 con 0x7f23981f85a0 2024-09-10T22:42:14.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.051+0000 7f239ec00640 1 -- 172.21.15.103:0/389209818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f23980ce0c0 con 0x7f23981f85a0 2024-09-10T22:42:14.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.051+0000 7f238fe00640 1 -- 172.21.15.103:0/389209818 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) ==== 84+0+65 (secure 0 0 0) 0x7f238405f1b0 con 0x7f23981f85a0 2024-09-10T22:42:14.055 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:14.055 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-09-10T22:42:14.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:42:14.055 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2024-09-10T22:42:14.055 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": ".mgr" 2024-09-10T22:42:14.055 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:14.055 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-09-10T22:42:14.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.055+0000 7f239ec00640 1 -- 172.21.15.103:0/389209818 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f23780725e0 msgr2=0x7f2378074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:14.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.055+0000 7f239ec00640 1 --2- 172.21.15.103:0/389209818 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f23780725e0 0x7f2378074aa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f23880a9000 tx=0x7f2388019a80 comp rx=0 tx=0).stop 2024-09-10T22:42:14.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.055+0000 7f239ec00640 1 -- 172.21.15.103:0/389209818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23981f85a0 msgr2=0x7f23980b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:14.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.055+0000 7f239ec00640 1 --2- 172.21.15.103:0/389209818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23981f85a0 0x7f23980b25c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2384006630 tx=0x7f23840039d0 comp rx=0 tx=0).stop 2024-09-10T22:42:14.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.055+0000 7f239ec00640 1 -- 172.21.15.103:0/389209818 shutdown_connections 2024-09-10T22:42:14.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.055+0000 7f239ec00640 1 --2- 172.21.15.103:0/389209818 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f23780725e0 0x7f2378074aa0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:14.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.055+0000 7f239ec00640 1 --2- 172.21.15.103:0/389209818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23980b2b00 0x7f2398071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:14.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.055+0000 7f239ec00640 1 --2- 172.21.15.103:0/389209818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23981f85a0 0x7f23980b25c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:14.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.055+0000 7f239ec00640 1 --2- 172.21.15.103:0/389209818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f237c003c70 0x7f239814ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:14.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.055+0000 7f239ec00640 1 -- 172.21.15.103:0/389209818 >> 172.21.15.103:0/389209818 conn(0x7f23980d1ac0 msgr2=0x7f23980ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:14.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.055+0000 7f239ec00640 1 -- 172.21.15.103:0/389209818 shutdown_connections 2024-09-10T22:42:14.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.055+0000 7f239ec00640 1 -- 172.21.15.103:0/389209818 wait complete. 2024-09-10T22:42:14.075 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T22:42:14.075 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T22:42:14.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9027c00640 1 -- 172.21.15.103:0/1604537831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90200d2540 msgr2=0x7f90200b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:14.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9027c00640 1 --2- 172.21.15.103:0/1604537831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90200d2540 0x7f90200b1490 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9018009bc0 tx=0x7f901801cb70 comp rx=0 tx=0).stop 2024-09-10T22:42:14.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9027c00640 1 -- 172.21.15.103:0/1604537831 shutdown_connections 2024-09-10T22:42:14.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9027c00640 1 --2- 172.21.15.103:0/1604537831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90200d2540 0x7f90200b1490 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:14.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9027c00640 1 --2- 172.21.15.103:0/1604537831 >> v2:172.21.15.131:3300/0 conn(0x7f90200d0710 0x7f90200cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:14.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9027c00640 1 -- 172.21.15.103:0/1604537831 >> 172.21.15.103:0/1604537831 conn(0x7f90200d1a20 msgr2=0x7f90200d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:14.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9027c00640 1 -- 172.21.15.103:0/1604537831 shutdown_connections 2024-09-10T22:42:14.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9027c00640 1 -- 172.21.15.103:0/1604537831 wait complete. 2024-09-10T22:42:14.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9027c00640 1 Processor -- start 2024-09-10T22:42:14.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9027c00640 1 -- start start 2024-09-10T22:42:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9027c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90200d0710 0x7f90200b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9027c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90200d2540 0x7f90200c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9027c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f902015bcb0 0x7f90200c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9027c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9020168960 con 0x7f902015bcb0 2024-09-10T22:42:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9027c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f90201687e0 con 0x7f90200d2540 2024-09-10T22:42:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9027c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9020168ae0 con 0x7f90200d0710 2024-09-10T22:42:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9025c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f902015bcb0 0x7f90200c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9025c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f902015bcb0 0x7f90200c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34654/0 (socket says 172.21.15.103:34654) 2024-09-10T22:42:14.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9025c00640 1 -- 172.21.15.103:0/3125053057 learned_addr learned my addr 172.21.15.103:0/3125053057 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:14.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9017e00640 1 --2- 172.21.15.103:0/3125053057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90200d2540 0x7f90200c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:14.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.219+0000 7f9025200640 1 --2- 172.21.15.103:0/3125053057 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90200d0710 0x7f90200b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:14.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.223+0000 7f9025c00640 1 -- 172.21.15.103:0/3125053057 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90200d0710 msgr2=0x7f90200b71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:14.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.223+0000 7f9025c00640 1 --2- 172.21.15.103:0/3125053057 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90200d0710 0x7f90200b71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:14.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.223+0000 7f9025c00640 1 -- 172.21.15.103:0/3125053057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90200d2540 msgr2=0x7f90200c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:14.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.223+0000 7f9025c00640 1 --2- 172.21.15.103:0/3125053057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90200d2540 0x7f90200c4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:14.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.223+0000 7f9025c00640 1 -- 172.21.15.103:0/3125053057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90200caf70 con 0x7f902015bcb0 2024-09-10T22:42:14.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.223+0000 7f9025c00640 1 --2- 172.21.15.103:0/3125053057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f902015bcb0 0x7f90200c8af0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f901801a7a0 tx=0x7f9018009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:14.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.223+0000 7f901d600640 1 -- 172.21.15.103:0/3125053057 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90180b2040 con 0x7f902015bcb0 2024-09-10T22:42:14.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.223+0000 7f901d600640 1 -- 172.21.15.103:0/3125053057 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9018004d40 con 0x7f902015bcb0 2024-09-10T22:42:14.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.223+0000 7f9027c00640 1 -- 172.21.15.103:0/3125053057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f902014f680 con 0x7f902015bcb0 2024-09-10T22:42:14.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.223+0000 7f901d600640 1 -- 172.21.15.103:0/3125053057 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018004240 con 0x7f902015bcb0 2024-09-10T22:42:14.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.223+0000 7f9027c00640 1 -- 172.21.15.103:0/3125053057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90200cb4c0 con 0x7f902015bcb0 2024-09-10T22:42:14.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.223+0000 7f9027c00640 1 -- 172.21.15.103:0/3125053057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90200cf5f0 con 0x7f902015bcb0 2024-09-10T22:42:14.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.223+0000 7f901d600640 1 -- 172.21.15.103:0/3125053057 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f90180b5070 con 0x7f902015bcb0 2024-09-10T22:42:14.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.223+0000 7f901d600640 1 --2- 172.21.15.103:0/3125053057 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8ffc0725e0 0x7f8ffc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:14.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.223+0000 7f901d600640 1 -- 172.21.15.103:0/3125053057 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5249+0+0 (secure 0 0 0) 0x7f901812cbd0 con 0x7f902015bcb0 2024-09-10T22:42:14.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.227+0000 7f9025200640 1 --2- 172.21.15.103:0/3125053057 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8ffc0725e0 0x7f8ffc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:14.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.227+0000 7f9025200640 1 --2- 172.21.15.103:0/3125053057 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8ffc0725e0 0x7f8ffc074aa0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9010007fd0 tx=0x7f9010007ea0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:14.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.227+0000 7f901d600640 1 -- 172.21.15.103:0/3125053057 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9018016790 con 0x7f902015bcb0 2024-09-10T22:42:14.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:14.399+0000 7f9027c00640 1 -- 172.21.15.103:0/3125053057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9020075d40 con 0x7f902015bcb0 2024-09-10T22:42:15.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.319+0000 7f901d600640 1 -- 172.21.15.103:0/3125053057 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v65) ==== 138+0+0 (secure 0 0 0) 0x7f90180f7d80 con 0x7f902015bcb0 2024-09-10T22:42:15.322 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2024-09-10T22:42:15.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.323+0000 7f9027c00640 1 -- 172.21.15.103:0/3125053057 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8ffc0725e0 msgr2=0x7f8ffc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:15.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.323+0000 7f9027c00640 1 --2- 172.21.15.103:0/3125053057 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8ffc0725e0 0x7f8ffc074aa0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9010007fd0 tx=0x7f9010007ea0 comp rx=0 tx=0).stop 2024-09-10T22:42:15.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.323+0000 7f9027c00640 1 -- 172.21.15.103:0/3125053057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f902015bcb0 msgr2=0x7f90200c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:15.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.323+0000 7f9027c00640 1 --2- 172.21.15.103:0/3125053057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f902015bcb0 0x7f90200c8af0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f901801a7a0 tx=0x7f9018009300 comp rx=0 tx=0).stop 2024-09-10T22:42:15.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.323+0000 7f9027c00640 1 -- 172.21.15.103:0/3125053057 shutdown_connections 2024-09-10T22:42:15.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.323+0000 7f9027c00640 1 --2- 172.21.15.103:0/3125053057 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8ffc0725e0 0x7f8ffc074aa0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:15.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.323+0000 7f9027c00640 1 --2- 172.21.15.103:0/3125053057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f902015bcb0 0x7f90200c8af0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:15.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.323+0000 7f9027c00640 1 --2- 172.21.15.103:0/3125053057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90200d2540 0x7f90200c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:15.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.323+0000 7f9027c00640 1 --2- 172.21.15.103:0/3125053057 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90200d0710 0x7f90200b71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:15.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.323+0000 7f9027c00640 1 -- 172.21.15.103:0/3125053057 >> 172.21.15.103:0/3125053057 conn(0x7f90200d1a20 msgr2=0x7f90200d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:15.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.323+0000 7f9027c00640 1 -- 172.21.15.103:0/3125053057 shutdown_connections 2024-09-10T22:42:15.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.323+0000 7f9027c00640 1 -- 172.21.15.103:0/3125053057 wait complete. 2024-09-10T22:42:15.352 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T22:42:15.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.499+0000 7fb6dba00640 1 -- 172.21.15.103:0/271232272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6b8004d50 msgr2=0x7fb6b80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:15.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.499+0000 7fb6dba00640 1 --2- 172.21.15.103:0/271232272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6b8004d50 0x7fb6b80051d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc009b90 tx=0x7fb6cc01d270 comp rx=0 tx=0).stop 2024-09-10T22:42:15.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.499+0000 7fb6d9a00640 1 -- 172.21.15.103:0/271232272 reap_dead start 2024-09-10T22:42:15.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.499+0000 7fb6dba00640 1 -- 172.21.15.103:0/271232272 shutdown_connections 2024-09-10T22:42:15.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.499+0000 7fb6dba00640 1 -- 172.21.15.103:0/271232272 >> 172.21.15.103:0/271232272 conn(0x7fb6d40cf7f0 msgr2=0x7fb6d40cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:15.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.499+0000 7fb6dba00640 1 -- 172.21.15.103:0/271232272 shutdown_connections 2024-09-10T22:42:15.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.499+0000 7fb6dba00640 1 -- 172.21.15.103:0/271232272 wait complete. 2024-09-10T22:42:15.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.499+0000 7fb6dba00640 1 Processor -- start 2024-09-10T22:42:15.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.499+0000 7fb6dba00640 1 -- start start 2024-09-10T22:42:15.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.499+0000 7fb6dba00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6b8004d50 0x7fb6d4148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:15.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.499+0000 7fb6dba00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d40cb1a0 0x7fb6d41596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:15.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.499+0000 7fb6dba00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6d4159c30 0x7fb6d414a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:15.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6dba00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d4072e80 con 0x7fb6d40cb1a0 2024-09-10T22:42:15.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6dba00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d415ac10 con 0x7fb6b8004d50 2024-09-10T22:42:15.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6dba00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d4073000 con 0x7fb6d4159c30 2024-09-10T22:42:15.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6d3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d40cb1a0 0x7fb6d41596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:15.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6d3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d40cb1a0 0x7fb6d41596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34664/0 (socket says 172.21.15.103:34664) 2024-09-10T22:42:15.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6d3e00640 1 -- 172.21.15.103:0/3261266533 learned_addr learned my addr 172.21.15.103:0/3261266533 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:15.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6d9000640 1 --2- 172.21.15.103:0/3261266533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6b8004d50 0x7fb6d4148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:15.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6d9a00640 1 --2- 172.21.15.103:0/3261266533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6d4159c30 0x7fb6d414a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:15.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6d3e00640 1 -- 172.21.15.103:0/3261266533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6d4159c30 msgr2=0x7fb6d414a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:15.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6d3e00640 1 --2- 172.21.15.103:0/3261266533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6d4159c30 0x7fb6d414a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:15.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6d3e00640 1 -- 172.21.15.103:0/3261266533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6b8004d50 msgr2=0x7fb6d4148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:15.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6d3e00640 1 --2- 172.21.15.103:0/3261266533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6b8004d50 0x7fb6d4148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:15.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6d3e00640 1 -- 172.21.15.103:0/3261266533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d414ae30 con 0x7fb6d40cb1a0 2024-09-10T22:42:15.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6d3e00640 1 --2- 172.21.15.103:0/3261266533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d40cb1a0 0x7fb6d41596f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0000c10 tx=0x7fb6c00066c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:15.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6d0c00640 1 -- 172.21.15.103:0/3261266533 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0015070 con 0x7fb6d40cb1a0 2024-09-10T22:42:15.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6d0c00640 1 -- 172.21.15.103:0/3261266533 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6c0011900 con 0x7fb6d40cb1a0 2024-09-10T22:42:15.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6dba00640 1 -- 172.21.15.103:0/3261266533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6d40cccb0 con 0x7fb6d40cb1a0 2024-09-10T22:42:15.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6d0c00640 1 -- 172.21.15.103:0/3261266533 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0011d50 con 0x7fb6d40cb1a0 2024-09-10T22:42:15.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6dba00640 1 -- 172.21.15.103:0/3261266533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6d40cd270 con 0x7fb6d40cb1a0 2024-09-10T22:42:15.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6dba00640 1 -- 172.21.15.103:0/3261266533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6d415bbd0 con 0x7fb6d40cb1a0 2024-09-10T22:42:15.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.503+0000 7fb6d0c00640 1 -- 172.21.15.103:0/3261266533 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb6c00103c0 con 0x7fb6d40cb1a0 2024-09-10T22:42:15.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.507+0000 7fb6d0c00640 1 --2- 172.21.15.103:0/3261266533 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb6b40725e0 0x7fb6b4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:15.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.507+0000 7fb6d0c00640 1 -- 172.21.15.103:0/3261266533 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5619+0+0 (secure 0 0 0) 0x7fb6c00944e0 con 0x7fb6d40cb1a0 2024-09-10T22:42:15.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.507+0000 7fb6d9000640 1 --2- 172.21.15.103:0/3261266533 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb6b40725e0 0x7fb6b4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:15.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.507+0000 7fb6d9000640 1 --2- 172.21.15.103:0/3261266533 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb6b40725e0 0x7fb6b4074aa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4011550 tx=0x7fb6c4009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:15.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.507+0000 7fb6d0c00640 1 -- 172.21.15.103:0/3261266533 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb6c005f6f0 con 0x7fb6d40cb1a0 2024-09-10T22:42:15.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:15.675+0000 7fb6dba00640 1 -- 172.21.15.103:0/3261266533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb6d415a040 con 0x7fb6d40cb1a0 2024-09-10T22:42:16.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.327+0000 7fb6d0c00640 1 -- 172.21.15.103:0/3261266533 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v66) ==== 170+0+0 (secure 0 0 0) 0x7fb6c0064120 con 0x7fb6d40cb1a0 2024-09-10T22:42:16.329 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2024-09-10T22:42:16.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.331+0000 7fb6dba00640 1 -- 172.21.15.103:0/3261266533 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb6b40725e0 msgr2=0x7fb6b4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:16.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.331+0000 7fb6dba00640 1 --2- 172.21.15.103:0/3261266533 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb6b40725e0 0x7fb6b4074aa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4011550 tx=0x7fb6c4009500 comp rx=0 tx=0).stop 2024-09-10T22:42:16.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.331+0000 7fb6dba00640 1 -- 172.21.15.103:0/3261266533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d40cb1a0 msgr2=0x7fb6d41596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:16.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.331+0000 7fb6dba00640 1 --2- 172.21.15.103:0/3261266533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d40cb1a0 0x7fb6d41596f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0000c10 tx=0x7fb6c00066c0 comp rx=0 tx=0).stop 2024-09-10T22:42:16.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.331+0000 7fb6dba00640 1 -- 172.21.15.103:0/3261266533 shutdown_connections 2024-09-10T22:42:16.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.331+0000 7fb6dba00640 1 --2- 172.21.15.103:0/3261266533 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb6b40725e0 0x7fb6b4074aa0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:16.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.331+0000 7fb6dba00640 1 --2- 172.21.15.103:0/3261266533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6d4159c30 0x7fb6d414a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:16.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.331+0000 7fb6dba00640 1 --2- 172.21.15.103:0/3261266533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d40cb1a0 0x7fb6d41596f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:16.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.331+0000 7fb6dba00640 1 --2- 172.21.15.103:0/3261266533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6b8004d50 0x7fb6d4148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:16.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.331+0000 7fb6dba00640 1 -- 172.21.15.103:0/3261266533 >> 172.21.15.103:0/3261266533 conn(0x7fb6d40cf7f0 msgr2=0x7fb6d40b3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:16.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.331+0000 7fb6dba00640 1 -- 172.21.15.103:0/3261266533 shutdown_connections 2024-09-10T22:42:16.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.331+0000 7fb6dba00640 1 -- 172.21.15.103:0/3261266533 wait complete. 2024-09-10T22:42:16.369 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T22:42:16.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.511+0000 7fb5ffe00640 1 -- 172.21.15.103:0/1753609801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5f80b09c0 msgr2=0x7fb5f80ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:16.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.511+0000 7fb5ffe00640 1 --2- 172.21.15.103:0/1753609801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5f80b09c0 0x7fb5f80ce600 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009900 tx=0x7fb5e401c850 comp rx=0 tx=0).stop 2024-09-10T22:42:16.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.511+0000 7fb5ffe00640 1 -- 172.21.15.103:0/1753609801 shutdown_connections 2024-09-10T22:42:16.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.511+0000 7fb5ffe00640 1 --2- 172.21.15.103:0/1753609801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5f80b09c0 0x7fb5f80ce600 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:16.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.511+0000 7fb5ffe00640 1 --2- 172.21.15.103:0/1753609801 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5f815be30 0x7fb5f80ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:16.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.511+0000 7fb5ffe00640 1 -- 172.21.15.103:0/1753609801 >> 172.21.15.103:0/1753609801 conn(0x7fb5f80d1ac0 msgr2=0x7fb5f80d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:16.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.511+0000 7fb5ffe00640 1 -- 172.21.15.103:0/1753609801 shutdown_connections 2024-09-10T22:42:16.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.511+0000 7fb5ffe00640 1 -- 172.21.15.103:0/1753609801 wait complete. 2024-09-10T22:42:16.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5ffe00640 1 Processor -- start 2024-09-10T22:42:16.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5ffe00640 1 -- start start 2024-09-10T22:42:16.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5ffe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5f80b09c0 0x7fb5f80cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:16.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5ffe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5f80ceb40 0x7fb5f8157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:16.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5ffe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5f815be30 0x7fb5f8151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:16.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5ffe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f81691b0 con 0x7fb5f80ceb40 2024-09-10T22:42:16.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5ffe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f8169030 con 0x7fb5f80b09c0 2024-09-10T22:42:16.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5ffe00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f8169330 con 0x7fb5f815be30 2024-09-10T22:42:16.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5fca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5f80ceb40 0x7fb5f8157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:16.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5fca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5f80ceb40 0x7fb5f8157e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34676/0 (socket says 172.21.15.103:34676) 2024-09-10T22:42:16.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5fca00640 1 -- 172.21.15.103:0/762127504 learned_addr learned my addr 172.21.15.103:0/762127504 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:16.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5fd400640 1 --2- 172.21.15.103:0/762127504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5f80b09c0 0x7fb5f80cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:16.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5fde00640 1 --2- 172.21.15.103:0/762127504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5f815be30 0x7fb5f8151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:16.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5fca00640 1 -- 172.21.15.103:0/762127504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5f815be30 msgr2=0x7fb5f8151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:16.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5fca00640 1 --2- 172.21.15.103:0/762127504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5f815be30 0x7fb5f8151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:16.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5fca00640 1 -- 172.21.15.103:0/762127504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5f80b09c0 msgr2=0x7fb5f80cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:16.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5fca00640 1 --2- 172.21.15.103:0/762127504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5f80b09c0 0x7fb5f80cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:16.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5fca00640 1 -- 172.21.15.103:0/762127504 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f80cb080 con 0x7fb5f80ceb40 2024-09-10T22:42:16.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5fca00640 1 --2- 172.21.15.103:0/762127504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5f80ceb40 0x7fb5f8157e80 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009850 tx=0x7fb5e40a6f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:16.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5f5600640 1 -- 172.21.15.103:0/762127504 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40bc030 con 0x7fb5f80ceb40 2024-09-10T22:42:16.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5f5600640 1 -- 172.21.15.103:0/762127504 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5e40042b0 con 0x7fb5f80ceb40 2024-09-10T22:42:16.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5f5600640 1 -- 172.21.15.103:0/762127504 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4003860 con 0x7fb5f80ceb40 2024-09-10T22:42:16.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5ffe00640 1 -- 172.21.15.103:0/762127504 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f806fce0 con 0x7fb5f80ceb40 2024-09-10T22:42:16.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.515+0000 7fb5ffe00640 1 -- 172.21.15.103:0/762127504 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f80c5970 con 0x7fb5f80ceb40 2024-09-10T22:42:16.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.519+0000 7fb5ffe00640 1 -- 172.21.15.103:0/762127504 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f81599a0 con 0x7fb5f80ceb40 2024-09-10T22:42:16.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.519+0000 7fb5f5600640 1 -- 172.21.15.103:0/762127504 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb5e4003a00 con 0x7fb5f80ceb40 2024-09-10T22:42:16.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.519+0000 7fb5f5600640 1 --2- 172.21.15.103:0/762127504 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb5d80725e0 0x7fb5d8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:16.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.519+0000 7fb5f5600640 1 -- 172.21.15.103:0/762127504 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6001+0+0 (secure 0 0 0) 0x7fb5e412e830 con 0x7fb5f80ceb40 2024-09-10T22:42:16.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.519+0000 7fb5fd400640 1 --2- 172.21.15.103:0/762127504 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb5d80725e0 0x7fb5d8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:16.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.523+0000 7fb5fd400640 1 --2- 172.21.15.103:0/762127504 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb5d80725e0 0x7fb5d8074aa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0098f0 tx=0x7fb5ec006f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:16.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.523+0000 7fb5f5600640 1 -- 172.21.15.103:0/762127504 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb5e40c6070 con 0x7fb5f80ceb40 2024-09-10T22:42:16.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:16.723+0000 7fb5ffe00640 1 -- 172.21.15.103:0/762127504 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb5f8159670 con 0x7fb5f80ceb40 2024-09-10T22:42:16.764 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:42:16.768 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:42:17.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.327+0000 7fb5f5600640 1 -- 172.21.15.103:0/762127504 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v50) ==== 173+0+0 (secure 0 0 0) 0x7fb5e40164d0 con 0x7fb5f80ceb40 2024-09-10T22:42:17.331 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 9 and data pool 10 2024-09-10T22:42:17.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.331+0000 7fb5ffe00640 1 -- 172.21.15.103:0/762127504 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb5d80725e0 msgr2=0x7fb5d8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:17.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.331+0000 7fb5ffe00640 1 --2- 172.21.15.103:0/762127504 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb5d80725e0 0x7fb5d8074aa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0098f0 tx=0x7fb5ec006f90 comp rx=0 tx=0).stop 2024-09-10T22:42:17.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.331+0000 7fb5ffe00640 1 -- 172.21.15.103:0/762127504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5f80ceb40 msgr2=0x7fb5f8157e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:17.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.331+0000 7fb5ffe00640 1 --2- 172.21.15.103:0/762127504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5f80ceb40 0x7fb5f8157e80 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009850 tx=0x7fb5e40a6f60 comp rx=0 tx=0).stop 2024-09-10T22:42:17.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.335+0000 7fb5ffe00640 1 -- 172.21.15.103:0/762127504 shutdown_connections 2024-09-10T22:42:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.335+0000 7fb5ffe00640 1 --2- 172.21.15.103:0/762127504 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb5d80725e0 0x7fb5d8074aa0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.335+0000 7fb5ffe00640 1 --2- 172.21.15.103:0/762127504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5f815be30 0x7fb5f8151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.335+0000 7fb5ffe00640 1 --2- 172.21.15.103:0/762127504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5f80ceb40 0x7fb5f8157e80 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.335+0000 7fb5ffe00640 1 --2- 172.21.15.103:0/762127504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5f80b09c0 0x7fb5f80cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.335+0000 7fb5ffe00640 1 -- 172.21.15.103:0/762127504 >> 172.21.15.103:0/762127504 conn(0x7fb5f80d1ac0 msgr2=0x7fb5f80b6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.335+0000 7fb5ffe00640 1 -- 172.21.15.103:0/762127504 shutdown_connections 2024-09-10T22:42:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.335+0000 7fb5ffe00640 1 -- 172.21.15.103:0/762127504 wait complete. 2024-09-10T22:42:17.387 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:42:17.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.527+0000 7f647fe00640 1 -- 172.21.15.103:0/3495189095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64780ae9c0 msgr2=0x7f64780aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:17.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.527+0000 7f647fe00640 1 --2- 172.21.15.103:0/3495189095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64780ae9c0 0x7f64780aee50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6470009bc0 tx=0x7f647001cb10 comp rx=0 tx=0).stop 2024-09-10T22:42:17.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.527+0000 7f647fe00640 1 -- 172.21.15.103:0/3495189095 shutdown_connections 2024-09-10T22:42:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.527+0000 7f647fe00640 1 --2- 172.21.15.103:0/3495189095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64780ae9c0 0x7f64780aee50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.527+0000 7f647fe00640 1 --2- 172.21.15.103:0/3495189095 >> v2:172.21.15.131:3300/0 conn(0x7f64780b09c0 0x7f64780ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.527+0000 7f647fe00640 1 -- 172.21.15.103:0/3495189095 >> 172.21.15.103:0/3495189095 conn(0x7f64780d1ac0 msgr2=0x7f64780d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.527+0000 7f647fe00640 1 -- 172.21.15.103:0/3495189095 shutdown_connections 2024-09-10T22:42:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.527+0000 7f647fe00640 1 -- 172.21.15.103:0/3495189095 wait complete. 2024-09-10T22:42:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647fe00640 1 Processor -- start 2024-09-10T22:42:17.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647fe00640 1 -- start start 2024-09-10T22:42:17.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647fe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64780ae9c0 0x7f647814b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:17.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64780b09c0 0x7f64780b6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:17.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f647815be30 0x7f6478070b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:17.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647fe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6478168df0 con 0x7f64780b09c0 2024-09-10T22:42:17.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647fe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6478168c70 con 0x7f647815be30 2024-09-10T22:42:17.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647fe00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6478168f70 con 0x7f64780ae9c0 2024-09-10T22:42:17.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64780b09c0 0x7f64780b6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:17.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64780b09c0 0x7f64780b6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57266/0 (socket says 172.21.15.103:57266) 2024-09-10T22:42:17.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647ca00640 1 -- 172.21.15.103:0/4232270111 learned_addr learned my addr 172.21.15.103:0/4232270111 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:17.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647d400640 1 --2- 172.21.15.103:0/4232270111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64780ae9c0 0x7f647814b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:17.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647de00640 1 --2- 172.21.15.103:0/4232270111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f647815be30 0x7f6478070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:17.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647ca00640 1 -- 172.21.15.103:0/4232270111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64780ae9c0 msgr2=0x7f647814b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:17.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647ca00640 1 --2- 172.21.15.103:0/4232270111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64780ae9c0 0x7f647814b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:17.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647ca00640 1 -- 172.21.15.103:0/4232270111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f647815be30 msgr2=0x7f6478070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:17.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647ca00640 1 --2- 172.21.15.103:0/4232270111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f647815be30 0x7f6478070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:17.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647ca00640 1 -- 172.21.15.103:0/4232270111 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647814b900 con 0x7f64780b09c0 2024-09-10T22:42:17.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647ca00640 1 --2- 172.21.15.103:0/4232270111 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64780b09c0 0x7f64780b6510 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f646400ea40 tx=0x7f646400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f6475600640 1 -- 172.21.15.103:0/4232270111 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646400ce40 con 0x7f64780b09c0 2024-09-10T22:42:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f6475600640 1 -- 172.21.15.103:0/4232270111 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6464004020 con 0x7f64780b09c0 2024-09-10T22:42:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f6475600640 1 -- 172.21.15.103:0/4232270111 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6464004470 con 0x7f64780b09c0 2024-09-10T22:42:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647fe00640 1 -- 172.21.15.103:0/4232270111 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64780b6f20 con 0x7f64780b09c0 2024-09-10T22:42:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647fe00640 1 -- 172.21.15.103:0/4232270111 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6478150f20 con 0x7f64780b09c0 2024-09-10T22:42:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.531+0000 7f647fe00640 1 -- 172.21.15.103:0/4232270111 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64780aee50 con 0x7f64780b09c0 2024-09-10T22:42:17.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.535+0000 7f6475600640 1 -- 172.21.15.103:0/4232270111 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6464003600 con 0x7f64780b09c0 2024-09-10T22:42:17.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.535+0000 7f6475600640 1 --2- 172.21.15.103:0/4232270111 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f64580725e0 0x7f6458074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:17.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.535+0000 7f6475600640 1 -- 172.21.15.103:0/4232270111 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f6464093d70 con 0x7f64780b09c0 2024-09-10T22:42:17.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.535+0000 7f647d400640 1 --2- 172.21.15.103:0/4232270111 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f64580725e0 0x7f6458074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:17.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.535+0000 7f647d400640 1 --2- 172.21.15.103:0/4232270111 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f64580725e0 0x7f6458074aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f646c001870 tx=0x7f646c001380 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:17.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.539+0000 7f6475600640 1 -- 172.21.15.103:0/4232270111 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f646405ebd0 con 0x7f64780b09c0 2024-09-10T22:42:17.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.707+0000 7f647fe00640 1 -- 172.21.15.103:0/4232270111 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64780d2640 con 0x7f64780b09c0 2024-09-10T22:42:17.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.707+0000 7f6475600640 1 -- 172.21.15.103:0/4232270111 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+17017 (secure 0 0 0) 0x7f6464063600 con 0x7f64780b09c0 2024-09-10T22:42:17.712 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:17.712 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":67,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:42:16.725575+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:42:14.413275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-10T22:42:15.686998+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:42:17.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.711+0000 7f647fe00640 1 -- 172.21.15.103:0/4232270111 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f64580725e0 msgr2=0x7f6458074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:17.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.711+0000 7f647fe00640 1 --2- 172.21.15.103:0/4232270111 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f64580725e0 0x7f6458074aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f646c001870 tx=0x7f646c001380 comp rx=0 tx=0).stop 2024-09-10T22:42:17.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.711+0000 7f647fe00640 1 -- 172.21.15.103:0/4232270111 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64780b09c0 msgr2=0x7f64780b6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:17.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.711+0000 7f647fe00640 1 --2- 172.21.15.103:0/4232270111 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64780b09c0 0x7f64780b6510 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f646400ea40 tx=0x7f646400ef00 comp rx=0 tx=0).stop 2024-09-10T22:42:17.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.711+0000 7f647fe00640 1 -- 172.21.15.103:0/4232270111 shutdown_connections 2024-09-10T22:42:17.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.711+0000 7f647fe00640 1 --2- 172.21.15.103:0/4232270111 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f64580725e0 0x7f6458074aa0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:17.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.711+0000 7f647fe00640 1 --2- 172.21.15.103:0/4232270111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f647815be30 0x7f6478070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:17.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.711+0000 7f647fe00640 1 --2- 172.21.15.103:0/4232270111 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64780b09c0 0x7f64780b6510 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:17.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.711+0000 7f647fe00640 1 --2- 172.21.15.103:0/4232270111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64780ae9c0 0x7f647814b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:17.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.711+0000 7f647fe00640 1 -- 172.21.15.103:0/4232270111 >> 172.21.15.103:0/4232270111 conn(0x7f64780d1ac0 msgr2=0x7f6478158f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:17.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.711+0000 7f647fe00640 1 -- 172.21.15.103:0/4232270111 shutdown_connections 2024-09-10T22:42:17.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.711+0000 7f647fe00640 1 -- 172.21.15.103:0/4232270111 wait complete. 2024-09-10T22:42:17.734 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:42:17.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.871+0000 7fca03c00640 1 -- 172.21.15.103:0/2404227705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9fc15be30 msgr2=0x7fc9fc0ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:17.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.871+0000 7fca03c00640 1 --2- 172.21.15.103:0/2404227705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9fc15be30 0x7fc9fc0ce0c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec009bc0 tx=0x7fc9ec01cb10 comp rx=0 tx=0).stop 2024-09-10T22:42:17.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.871+0000 7fca03c00640 1 -- 172.21.15.103:0/2404227705 shutdown_connections 2024-09-10T22:42:17.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.871+0000 7fca03c00640 1 --2- 172.21.15.103:0/2404227705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9fc0b09c0 0x7fc9fc0ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:17.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.871+0000 7fca03c00640 1 --2- 172.21.15.103:0/2404227705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9fc15be30 0x7fc9fc0ce0c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:17.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.871+0000 7fca03c00640 1 -- 172.21.15.103:0/2404227705 >> 172.21.15.103:0/2404227705 conn(0x7fc9fc0d1ac0 msgr2=0x7fc9fc0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:17.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.871+0000 7fca03c00640 1 -- 172.21.15.103:0/2404227705 shutdown_connections 2024-09-10T22:42:17.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.871+0000 7fca03c00640 1 -- 172.21.15.103:0/2404227705 wait complete. 2024-09-10T22:42:17.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca03c00640 1 Processor -- start 2024-09-10T22:42:17.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca03c00640 1 -- start start 2024-09-10T22:42:17.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca03c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9fc0b09c0 0x7fc9fc14b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:17.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca03c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9fc0ceb40 0x7fc9fc157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:17.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca03c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9fc15be30 0x7fc9fc15aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:17.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca03c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc1690c0 con 0x7fc9fc15be30 2024-09-10T22:42:17.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca03c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc168f40 con 0x7fc9fc0b09c0 2024-09-10T22:42:17.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca03c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc9fc169240 con 0x7fc9fc0ceb40 2024-09-10T22:42:17.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca01c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9fc15be30 0x7fc9fc15aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:17.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca01c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9fc15be30 0x7fc9fc15aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57288/0 (socket says 172.21.15.103:57288) 2024-09-10T22:42:17.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca01c00640 1 -- 172.21.15.103:0/2958186749 learned_addr learned my addr 172.21.15.103:0/2958186749 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:17.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fc9fbe00640 1 --2- 172.21.15.103:0/2958186749 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9fc0ceb40 0x7fc9fc157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:17.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca01200640 1 --2- 172.21.15.103:0/2958186749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9fc0b09c0 0x7fc9fc14b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:17.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca01c00640 1 -- 172.21.15.103:0/2958186749 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9fc0ceb40 msgr2=0x7fc9fc157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:17.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca01c00640 1 --2- 172.21.15.103:0/2958186749 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9fc0ceb40 0x7fc9fc157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:17.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca01c00640 1 -- 172.21.15.103:0/2958186749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9fc0b09c0 msgr2=0x7fc9fc14b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:17.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca01c00640 1 --2- 172.21.15.103:0/2958186749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9fc0b09c0 0x7fc9fc14b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:17.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca01c00640 1 -- 172.21.15.103:0/2958186749 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9fc15b9a0 con 0x7fc9fc15be30 2024-09-10T22:42:17.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca01c00640 1 --2- 172.21.15.103:0/2958186749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9fc15be30 0x7fc9fc15aa10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400c440 tx=0x7fc9f4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:17.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fc9f8c00640 1 -- 172.21.15.103:0/2958186749 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4011790 con 0x7fc9fc15be30 2024-09-10T22:42:17.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fc9f8c00640 1 -- 172.21.15.103:0/2958186749 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9f4017070 con 0x7fc9fc15be30 2024-09-10T22:42:17.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fc9f8c00640 1 -- 172.21.15.103:0/2958186749 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4011cc0 con 0x7fc9fc15be30 2024-09-10T22:42:17.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca03c00640 1 -- 172.21.15.103:0/2958186749 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9fc165650 con 0x7fc9fc15be30 2024-09-10T22:42:17.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.875+0000 7fca03c00640 1 -- 172.21.15.103:0/2958186749 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9fc165c10 con 0x7fc9fc15be30 2024-09-10T22:42:17.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.879+0000 7fca03c00640 1 -- 172.21.15.103:0/2958186749 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9fc0cf9c0 con 0x7fc9fc15be30 2024-09-10T22:42:17.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.879+0000 7fc9f8c00640 1 -- 172.21.15.103:0/2958186749 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc9f401c460 con 0x7fc9fc15be30 2024-09-10T22:42:17.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.879+0000 7fc9f8c00640 1 --2- 172.21.15.103:0/2958186749 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9dc0725e0 0x7fc9dc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:17.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.879+0000 7fc9f8c00640 1 -- 172.21.15.103:0/2958186749 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fc9f4093110 con 0x7fc9fc15be30 2024-09-10T22:42:17.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.879+0000 7fca01200640 1 --2- 172.21.15.103:0/2958186749 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9dc0725e0 0x7fc9dc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:17.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.879+0000 7fca01200640 1 --2- 172.21.15.103:0/2958186749 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9dc0725e0 0x7fc9dc074aa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec0af000 tx=0x7fc9ec01b350 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:17.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:17.883+0000 7fc9f8c00640 1 -- 172.21.15.103:0/2958186749 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc9f405df70 con 0x7fc9fc15be30 2024-09-10T22:42:18.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.051+0000 7fca03c00640 1 -- 172.21.15.103:0/2958186749 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9fc165fb0 con 0x7fc9fc15be30 2024-09-10T22:42:18.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.051+0000 7fc9f8c00640 1 -- 172.21.15.103:0/2958186749 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+17017 (secure 0 0 0) 0x7fc9f40629a0 con 0x7fc9fc15be30 2024-09-10T22:42:18.054 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:18.055 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":67,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:42:16.725575+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:42:14.413275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-10T22:42:15.686998+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:42:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.055+0000 7fca03c00640 1 -- 172.21.15.103:0/2958186749 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9dc0725e0 msgr2=0x7fc9dc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.055+0000 7fca03c00640 1 --2- 172.21.15.103:0/2958186749 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9dc0725e0 0x7fc9dc074aa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec0af000 tx=0x7fc9ec01b350 comp rx=0 tx=0).stop 2024-09-10T22:42:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.055+0000 7fca03c00640 1 -- 172.21.15.103:0/2958186749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9fc15be30 msgr2=0x7fc9fc15aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.055+0000 7fca03c00640 1 --2- 172.21.15.103:0/2958186749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9fc15be30 0x7fc9fc15aa10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400c440 tx=0x7fc9f4001e80 comp rx=0 tx=0).stop 2024-09-10T22:42:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.055+0000 7fca03c00640 1 -- 172.21.15.103:0/2958186749 shutdown_connections 2024-09-10T22:42:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.055+0000 7fca03c00640 1 --2- 172.21.15.103:0/2958186749 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9dc0725e0 0x7fc9dc074aa0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.055+0000 7fca03c00640 1 --2- 172.21.15.103:0/2958186749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9fc15be30 0x7fc9fc15aa10 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.055+0000 7fca03c00640 1 --2- 172.21.15.103:0/2958186749 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9fc0ceb40 0x7fc9fc157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.055+0000 7fca03c00640 1 --2- 172.21.15.103:0/2958186749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9fc0b09c0 0x7fc9fc14b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.055+0000 7fca03c00640 1 -- 172.21.15.103:0/2958186749 >> 172.21.15.103:0/2958186749 conn(0x7fc9fc0d1ac0 msgr2=0x7fc9fc0b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.055+0000 7fca03c00640 1 -- 172.21.15.103:0/2958186749 shutdown_connections 2024-09-10T22:42:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.055+0000 7fca03c00640 1 -- 172.21.15.103:0/2958186749 wait complete. 2024-09-10T22:42:18.076 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T22:42:18.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.215+0000 7f5f9e000640 1 -- 172.21.15.103:0/2330377302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f980ceb40 msgr2=0x7f5f980cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:18.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.215+0000 7f5f9e000640 1 --2- 172.21.15.103:0/2330377302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f980ceb40 0x7f5f980cf9c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5f98073840 tx=0x7f5f9001c830 comp rx=0 tx=0).stop 2024-09-10T22:42:18.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.215+0000 7f5f9e000640 1 -- 172.21.15.103:0/2330377302 shutdown_connections 2024-09-10T22:42:18.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.215+0000 7f5f9e000640 1 --2- 172.21.15.103:0/2330377302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f980ceb40 0x7f5f980cf9c0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:18.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.215+0000 7f5f9e000640 1 --2- 172.21.15.103:0/2330377302 >> v2:172.21.15.131:3300/0 conn(0x7f5f980b09c0 0x7f5f980ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:18.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.215+0000 7f5f9e000640 1 --2- 172.21.15.103:0/2330377302 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f9815be30 0x7f5f980ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:18.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.215+0000 7f5f9e000640 1 -- 172.21.15.103:0/2330377302 >> 172.21.15.103:0/2330377302 conn(0x7f5f980d1ac0 msgr2=0x7f5f980d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:18.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.215+0000 7f5f9e000640 1 -- 172.21.15.103:0/2330377302 shutdown_connections 2024-09-10T22:42:18.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.215+0000 7f5f9e000640 1 -- 172.21.15.103:0/2330377302 wait complete. 2024-09-10T22:42:18.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f9e000640 1 Processor -- start 2024-09-10T22:42:18.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f9e000640 1 -- start start 2024-09-10T22:42:18.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f9e000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f980b09c0 0x7f5f981fb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:18.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f9e000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f980ceb40 0x7f5f980ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:18.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f9e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f9815be30 0x7f5f980cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:18.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f9e000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5f980aed50 con 0x7f5f9815be30 2024-09-10T22:42:18.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f9e000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5f980aebd0 con 0x7f5f980b09c0 2024-09-10T22:42:18.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f9e000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5f980aeed0 con 0x7f5f980ceb40 2024-09-10T22:42:18.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f97e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f9815be30 0x7f5f980cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f97e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f9815be30 0x7f5f980cae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57298/0 (socket says 172.21.15.103:57298) 2024-09-10T22:42:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f97e00640 1 -- 172.21.15.103:0/3821710041 learned_addr learned my addr 172.21.15.103:0/3821710041 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f8ea00640 1 --2- 172.21.15.103:0/3821710041 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f980ceb40 0x7f5f980ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f97400640 1 --2- 172.21.15.103:0/3821710041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f980b09c0 0x7f5f981fb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f97e00640 1 -- 172.21.15.103:0/3821710041 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f980ceb40 msgr2=0x7f5f980ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f97e00640 1 --2- 172.21.15.103:0/3821710041 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f980ceb40 0x7f5f980ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f97e00640 1 -- 172.21.15.103:0/3821710041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f980b09c0 msgr2=0x7f5f981fb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f97e00640 1 --2- 172.21.15.103:0/3821710041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f980b09c0 0x7f5f981fb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f97e00640 1 -- 172.21.15.103:0/3821710041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f980cb450 con 0x7f5f9815be30 2024-09-10T22:42:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f97e00640 1 --2- 172.21.15.103:0/3821710041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f9815be30 0x7f5f980cae60 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009850 tx=0x7f5f900a66d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f8fe00640 1 -- 172.21.15.103:0/3821710041 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f900040c0 con 0x7f5f9815be30 2024-09-10T22:42:18.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f8fe00640 1 -- 172.21.15.103:0/3821710041 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f90004350 con 0x7f5f9815be30 2024-09-10T22:42:18.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f8fe00640 1 -- 172.21.15.103:0/3821710041 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f90005270 con 0x7f5f9815be30 2024-09-10T22:42:18.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f9e000640 1 -- 172.21.15.103:0/3821710041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f980cb730 con 0x7f5f9815be30 2024-09-10T22:42:18.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f9e000640 1 -- 172.21.15.103:0/3821710041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f981522a0 con 0x7f5f9815be30 2024-09-10T22:42:18.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.219+0000 7f5f9e000640 1 -- 172.21.15.103:0/3821710041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f98152830 con 0x7f5f9815be30 2024-09-10T22:42:18.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.223+0000 7f5f8fe00640 1 -- 172.21.15.103:0/3821710041 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5f90005410 con 0x7f5f9815be30 2024-09-10T22:42:18.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.223+0000 7f5f8fe00640 1 --2- 172.21.15.103:0/3821710041 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5f740725e0 0x7f5f74074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:18.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.223+0000 7f5f8fe00640 1 -- 172.21.15.103:0/3821710041 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f5f9012de20 con 0x7f5f9815be30 2024-09-10T22:42:18.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.223+0000 7f5f97400640 1 --2- 172.21.15.103:0/3821710041 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5f740725e0 0x7f5f74074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:18.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.223+0000 7f5f97400640 1 --2- 172.21.15.103:0/3821710041 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5f740725e0 0x7f5f74074aa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5f88005c50 tx=0x7f5f88005be0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:18.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.227+0000 7f5f8fe00640 1 -- 172.21.15.103:0/3821710041 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5f900c6020 con 0x7f5f9815be30 2024-09-10T22:42:18.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:18.431+0000 7f5f9e000640 1 -- 172.21.15.103:0/3821710041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5f980b44c0 con 0x7f5f9815be30 2024-09-10T22:42:19.314 INFO:tasks.ceph.mds.a.smithi103.stderr:2024-09-10T22:42:19.311+0000 7fcffee00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T22:42:19.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.355+0000 7f5f8fe00640 1 -- 172.21.15.103:0/3821710041 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v53) ==== 118+0+0 (secure 0 0 0) 0x7f5f900164b0 con 0x7f5f9815be30 2024-09-10T22:42:19.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.359+0000 7f5f9e000640 1 -- 172.21.15.103:0/3821710041 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5f740725e0 msgr2=0x7f5f74074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:19.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.359+0000 7f5f9e000640 1 --2- 172.21.15.103:0/3821710041 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5f740725e0 0x7f5f74074aa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5f88005c50 tx=0x7f5f88005be0 comp rx=0 tx=0).stop 2024-09-10T22:42:19.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.359+0000 7f5f9e000640 1 -- 172.21.15.103:0/3821710041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f9815be30 msgr2=0x7f5f980cae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:19.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.359+0000 7f5f9e000640 1 --2- 172.21.15.103:0/3821710041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f9815be30 0x7f5f980cae60 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009850 tx=0x7f5f900a66d0 comp rx=0 tx=0).stop 2024-09-10T22:42:19.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.359+0000 7f5f9e000640 1 -- 172.21.15.103:0/3821710041 shutdown_connections 2024-09-10T22:42:19.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.359+0000 7f5f9e000640 1 --2- 172.21.15.103:0/3821710041 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5f740725e0 0x7f5f74074aa0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:19.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.359+0000 7f5f9e000640 1 --2- 172.21.15.103:0/3821710041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f9815be30 0x7f5f980cae60 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:19.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.359+0000 7f5f9e000640 1 --2- 172.21.15.103:0/3821710041 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f980ceb40 0x7f5f980ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:19.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.359+0000 7f5f9e000640 1 --2- 172.21.15.103:0/3821710041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f980b09c0 0x7f5f981fb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:19.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.359+0000 7f5f9e000640 1 -- 172.21.15.103:0/3821710041 >> 172.21.15.103:0/3821710041 conn(0x7f5f980d1ac0 msgr2=0x7f5f9806e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:19.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.359+0000 7f5f9e000640 1 -- 172.21.15.103:0/3821710041 shutdown_connections 2024-09-10T22:42:19.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.359+0000 7f5f9e000640 1 -- 172.21.15.103:0/3821710041 wait complete. 2024-09-10T22:42:19.381 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T22:42:19.381 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T22:42:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.523+0000 7f0aac600640 1 -- 172.21.15.103:0/1810654196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a8c003a60 msgr2=0x7f0a8c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.523+0000 7f0aac600640 1 --2- 172.21.15.103:0/1810654196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a8c003a60 0x7f0a8c003e80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800c2e0 tx=0x7f0a9801cef0 comp rx=0 tx=0).stop 2024-09-10T22:42:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.523+0000 7f0aac600640 1 -- 172.21.15.103:0/1810654196 shutdown_connections 2024-09-10T22:42:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.523+0000 7f0aac600640 1 --2- 172.21.15.103:0/1810654196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a8c003a60 0x7f0a8c003e80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.523+0000 7f0aac600640 1 -- 172.21.15.103:0/1810654196 >> 172.21.15.103:0/1810654196 conn(0x7f0aa406cc00 msgr2=0x7f0aa406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:19.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aac600640 1 -- 172.21.15.103:0/1810654196 shutdown_connections 2024-09-10T22:42:19.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aac600640 1 -- 172.21.15.103:0/1810654196 wait complete. 2024-09-10T22:42:19.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aac600640 1 Processor -- start 2024-09-10T22:42:19.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aac600640 1 -- start start 2024-09-10T22:42:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aac600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a8c003a60 0x7f0aa40ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aac600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa40c7420 0x7f0aa414bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aac600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0aa414c490 0x7f0aa40c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aac600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa40b2c00 con 0x7f0aa414c490 2024-09-10T22:42:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aac600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa40b2a80 con 0x7f0a8c003a60 2024-09-10T22:42:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aac600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa40b2d80 con 0x7f0aa40c7420 2024-09-10T22:42:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aaa600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0aa414c490 0x7f0aa40c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aa9200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa40c7420 0x7f0aa414bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aaa600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0aa414c490 0x7f0aa40c55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57314/0 (socket says 172.21.15.103:57314) 2024-09-10T22:42:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aa9200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa40c7420 0x7f0aa414bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:41024/0 (socket says 172.21.15.103:41024) 2024-09-10T22:42:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aa9c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a8c003a60 0x7f0aa40ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aa9200640 1 -- 172.21.15.103:0/1976036766 learned_addr learned my addr 172.21.15.103:0/1976036766 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aaa600640 1 -- 172.21.15.103:0/1976036766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa40c7420 msgr2=0x7f0aa414bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aaa600640 1 --2- 172.21.15.103:0/1976036766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa40c7420 0x7f0aa414bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aaa600640 1 -- 172.21.15.103:0/1976036766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a8c003a60 msgr2=0x7f0aa40ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aaa600640 1 --2- 172.21.15.103:0/1976036766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a8c003a60 0x7f0aa40ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.527+0000 7f0aaa600640 1 -- 172.21.15.103:0/1976036766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa414cdf0 con 0x7f0aa414c490 2024-09-10T22:42:19.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.531+0000 7f0aaa600640 1 --2- 172.21.15.103:0/1976036766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0aa414c490 0x7f0aa40c55b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40cfb70 tx=0x7f0a9c0064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:19.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.531+0000 7f0aa1600640 1 -- 172.21.15.103:0/1976036766 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c001a10 con 0x7f0aa414c490 2024-09-10T22:42:19.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.531+0000 7f0aa1600640 1 -- 172.21.15.103:0/1976036766 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a9c00fa20 con 0x7f0aa414c490 2024-09-10T22:42:19.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.531+0000 7f0aac600640 1 -- 172.21.15.103:0/1976036766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa414d0d0 con 0x7f0aa414c490 2024-09-10T22:42:19.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.531+0000 7f0aa1600640 1 -- 172.21.15.103:0/1976036766 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c00fe30 con 0x7f0aa414c490 2024-09-10T22:42:19.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.531+0000 7f0aac600640 1 -- 172.21.15.103:0/1976036766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa40ca5e0 con 0x7f0aa414c490 2024-09-10T22:42:19.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.531+0000 7f0aac600640 1 -- 172.21.15.103:0/1976036766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aa415f510 con 0x7f0aa414c490 2024-09-10T22:42:19.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.531+0000 7f0aa1600640 1 -- 172.21.15.103:0/1976036766 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0a9c01d470 con 0x7f0aa414c490 2024-09-10T22:42:19.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.535+0000 7f0aa1600640 1 --2- 172.21.15.103:0/1976036766 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0a840725e0 0x7f0a84074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:19.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.535+0000 7f0aa1600640 1 -- 172.21.15.103:0/1976036766 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f0a9c093920 con 0x7f0aa414c490 2024-09-10T22:42:19.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.535+0000 7f0aa9c00640 1 --2- 172.21.15.103:0/1976036766 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0a840725e0 0x7f0a84074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:19.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.535+0000 7f0aa9c00640 1 --2- 172.21.15.103:0/1976036766 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0a840725e0 0x7f0a84074aa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0a980ab000 tx=0x7f0a98019d30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:19.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.539+0000 7f0aa1600640 1 -- 172.21.15.103:0/1976036766 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0a9c05e8b0 con 0x7f0aa414c490 2024-09-10T22:42:19.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:19.739+0000 7f0aac600640 1 -- 172.21.15.103:0/1976036766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0aa40ae7a0 con 0x7f0aa414c490 2024-09-10T22:42:20.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.355+0000 7f0aa1600640 1 -- 172.21.15.103:0/1976036766 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v54) ==== 122+0+0 (secure 0 0 0) 0x7f0a9c0632e0 con 0x7f0aa414c490 2024-09-10T22:42:20.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.359+0000 7f0aac600640 1 -- 172.21.15.103:0/1976036766 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0a840725e0 msgr2=0x7f0a84074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:20.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.359+0000 7f0aac600640 1 --2- 172.21.15.103:0/1976036766 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0a840725e0 0x7f0a84074aa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0a980ab000 tx=0x7f0a98019d30 comp rx=0 tx=0).stop 2024-09-10T22:42:20.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.359+0000 7f0aac600640 1 -- 172.21.15.103:0/1976036766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0aa414c490 msgr2=0x7f0aa40c55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:20.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.359+0000 7f0aac600640 1 --2- 172.21.15.103:0/1976036766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0aa414c490 0x7f0aa40c55b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40cfb70 tx=0x7f0a9c0064f0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.359+0000 7f0aac600640 1 -- 172.21.15.103:0/1976036766 shutdown_connections 2024-09-10T22:42:20.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.359+0000 7f0aac600640 1 --2- 172.21.15.103:0/1976036766 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0a840725e0 0x7f0a84074aa0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.359+0000 7f0aac600640 1 --2- 172.21.15.103:0/1976036766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0aa414c490 0x7f0aa40c55b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.359+0000 7f0aac600640 1 --2- 172.21.15.103:0/1976036766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa40c7420 0x7f0aa414bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.359+0000 7f0aac600640 1 --2- 172.21.15.103:0/1976036766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a8c003a60 0x7f0aa40ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.359+0000 7f0aac600640 1 -- 172.21.15.103:0/1976036766 >> 172.21.15.103:0/1976036766 conn(0x7f0aa406cc00 msgr2=0x7f0aa406e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:20.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.359+0000 7f0aac600640 1 -- 172.21.15.103:0/1976036766 shutdown_connections 2024-09-10T22:42:20.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.359+0000 7f0aac600640 1 -- 172.21.15.103:0/1976036766 wait complete. 2024-09-10T22:42:20.385 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T22:42:20.386 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:42:20.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.523+0000 7fd57be00640 1 -- 172.21.15.103:0/683873456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd57c0af5b0 msgr2=0x7fd57c0af9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:20.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.523+0000 7fd57be00640 1 --2- 172.21.15.103:0/683873456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd57c0af5b0 0x7fd57c0af9e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd574009c80 tx=0x7fd57401ccb0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.523+0000 7fd57be00640 1 -- 172.21.15.103:0/683873456 shutdown_connections 2024-09-10T22:42:20.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.523+0000 7fd57be00640 1 --2- 172.21.15.103:0/683873456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd57c0af5b0 0x7fd57c0af9e0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.523+0000 7fd57be00640 1 --2- 172.21.15.103:0/683873456 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd57c15e250 0x7fd57c15e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.523+0000 7fd57be00640 1 -- 172.21.15.103:0/683873456 >> 172.21.15.103:0/683873456 conn(0x7fd57c0d0780 msgr2=0x7fd57c0d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:20.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.523+0000 7fd57be00640 1 -- 172.21.15.103:0/683873456 shutdown_connections 2024-09-10T22:42:20.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.523+0000 7fd57be00640 1 -- 172.21.15.103:0/683873456 wait complete. 2024-09-10T22:42:20.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57be00640 1 Processor -- start 2024-09-10T22:42:20.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57be00640 1 -- start start 2024-09-10T22:42:20.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd57c073700 0x7fd57c1f52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:20.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd57c0af5b0 0x7fd57c0cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:20.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd57c15e250 0x7fd57c157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:20.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57be00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c15b970 con 0x7fd57c073700 2024-09-10T22:42:20.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57be00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c15b7f0 con 0x7fd57c0af5b0 2024-09-10T22:42:20.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57be00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd57c167dd0 con 0x7fd57c15e250 2024-09-10T22:42:20.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd57c073700 0x7fd57c1f52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:20.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd57c073700 0x7fd57c1f52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57326/0 (socket says 172.21.15.103:57326) 2024-09-10T22:42:20.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57aa00640 1 -- 172.21.15.103:0/4223367132 learned_addr learned my addr 172.21.15.103:0/4223367132 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:20.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd572000640 1 --2- 172.21.15.103:0/4223367132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd57c0af5b0 0x7fd57c0cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:20.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57b400640 1 --2- 172.21.15.103:0/4223367132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd57c15e250 0x7fd57c157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:20.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57aa00640 1 -- 172.21.15.103:0/4223367132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd57c15e250 msgr2=0x7fd57c157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:20.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57aa00640 1 --2- 172.21.15.103:0/4223367132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd57c15e250 0x7fd57c157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57aa00640 1 -- 172.21.15.103:0/4223367132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd57c0af5b0 msgr2=0x7fd57c0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:20.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57aa00640 1 --2- 172.21.15.103:0/4223367132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd57c0af5b0 0x7fd57c0cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57aa00640 1 -- 172.21.15.103:0/4223367132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57c1f6250 con 0x7fd57c073700 2024-09-10T22:42:20.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57aa00640 1 --2- 172.21.15.103:0/4223367132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd57c073700 0x7fd57c1f52f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd56c00b410 tx=0x7fd56c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:20.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd573400640 1 -- 172.21.15.103:0/4223367132 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c015020 con 0x7fd57c073700 2024-09-10T22:42:20.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd573400640 1 -- 172.21.15.103:0/4223367132 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd56c011920 con 0x7fd57c073700 2024-09-10T22:42:20.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57be00640 1 -- 172.21.15.103:0/4223367132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd57c153aa0 con 0x7fd57c073700 2024-09-10T22:42:20.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd573400640 1 -- 172.21.15.103:0/4223367132 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c011d70 con 0x7fd57c073700 2024-09-10T22:42:20.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.527+0000 7fd57be00640 1 -- 172.21.15.103:0/4223367132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd57c1f5f70 con 0x7fd57c073700 2024-09-10T22:42:20.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.531+0000 7fd57be00640 1 -- 172.21.15.103:0/4223367132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd57c0af9e0 con 0x7fd57c073700 2024-09-10T22:42:20.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.531+0000 7fd573400640 1 -- 172.21.15.103:0/4223367132 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd56c01a400 con 0x7fd57c073700 2024-09-10T22:42:20.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.531+0000 7fd573400640 1 --2- 172.21.15.103:0/4223367132 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5580725e0 0x7fd558074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:20.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.531+0000 7fd573400640 1 -- 172.21.15.103:0/4223367132 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fd56c0934d0 con 0x7fd57c073700 2024-09-10T22:42:20.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.531+0000 7fd572000640 1 --2- 172.21.15.103:0/4223367132 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5580725e0 0x7fd558074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:20.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.531+0000 7fd572000640 1 --2- 172.21.15.103:0/4223367132 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5580725e0 0x7fd558074aa0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd57c157510 tx=0x7fd564007e40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:20.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.535+0000 7fd573400640 1 -- 172.21.15.103:0/4223367132 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd56c01f020 con 0x7fd57c073700 2024-09-10T22:42:20.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.735+0000 7fd57be00640 1 -- 172.21.15.103:0/4223367132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd57c06cf40 con 0x7fd57c073700 2024-09-10T22:42:20.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.735+0000 7fd573400640 1 -- 172.21.15.103:0/4223367132 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5230 (secure 0 0 0) 0x7fd56c05e3c0 con 0x7fd57c073700 2024-09-10T22:42:20.738 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:20.738 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"btime":"2024-09-10T22:42:20:358502+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2961968581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2961968581},{"type":"v1","addr":"172.21.15.131:6835","nonce":2961968581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":5630,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/360467048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":360467048},{"type":"v1","addr":"172.21.15.131:6837","nonce":360467048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/4171945106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4171945106},{"type":"v1","addr":"172.21.15.103:6833","nonce":4171945106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:42:16.725541+0000","modified":"2024-09-10T22:42:19.741456+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/714242556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":714242556},{"type":"v1","addr":"172.21.15.103:6835","nonce":714242556}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6285,"qdb_cluster":[6285]},"id":4}]} 2024-09-10T22:42:20.739 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2024-09-10T22:42:20.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.735+0000 7fd57be00640 1 -- 172.21.15.103:0/4223367132 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5580725e0 msgr2=0x7fd558074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:20.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.735+0000 7fd57be00640 1 --2- 172.21.15.103:0/4223367132 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5580725e0 0x7fd558074aa0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd57c157510 tx=0x7fd564007e40 comp rx=0 tx=0).stop 2024-09-10T22:42:20.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.735+0000 7fd57be00640 1 -- 172.21.15.103:0/4223367132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd57c073700 msgr2=0x7fd57c1f52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:20.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.735+0000 7fd57be00640 1 --2- 172.21.15.103:0/4223367132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd57c073700 0x7fd57c1f52f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd56c00b410 tx=0x7fd56c00b8d0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.735+0000 7fd57be00640 1 -- 172.21.15.103:0/4223367132 shutdown_connections 2024-09-10T22:42:20.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.735+0000 7fd57be00640 1 --2- 172.21.15.103:0/4223367132 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5580725e0 0x7fd558074aa0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.735+0000 7fd57be00640 1 --2- 172.21.15.103:0/4223367132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd57c15e250 0x7fd57c157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.735+0000 7fd57be00640 1 --2- 172.21.15.103:0/4223367132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd57c0af5b0 0x7fd57c0cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.735+0000 7fd57be00640 1 --2- 172.21.15.103:0/4223367132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd57c073700 0x7fd57c1f52f0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.735+0000 7fd57be00640 1 -- 172.21.15.103:0/4223367132 >> 172.21.15.103:0/4223367132 conn(0x7fd57c0d0780 msgr2=0x7fd57c0cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:20.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.735+0000 7fd57be00640 1 -- 172.21.15.103:0/4223367132 shutdown_connections 2024-09-10T22:42:20.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.735+0000 7fd57be00640 1 -- 172.21.15.103:0/4223367132 wait complete. 2024-09-10T22:42:20.758 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:42:20.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.899+0000 7faafa000640 1 -- 172.21.15.103:0/523178063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaf415d9f0 msgr2=0x7faaf40ace70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:20.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.899+0000 7faafa000640 1 --2- 172.21.15.103:0/523178063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaf415d9f0 0x7faaf40ace70 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7faaf4071f80 tx=0x7faadc01db30 comp rx=0 tx=0).stop 2024-09-10T22:42:20.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.899+0000 7faafa000640 1 -- 172.21.15.103:0/523178063 shutdown_connections 2024-09-10T22:42:20.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.899+0000 7faafa000640 1 --2- 172.21.15.103:0/523178063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaf415d9f0 0x7faaf40ace70 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.899+0000 7faafa000640 1 --2- 172.21.15.103:0/523178063 >> v2:172.21.15.131:3300/0 conn(0x7faaf40cf3b0 0x7faaf406df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.899+0000 7faafa000640 1 -- 172.21.15.103:0/523178063 >> 172.21.15.103:0/523178063 conn(0x7faaf40cff60 msgr2=0x7faaf40d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:20.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.899+0000 7faafa000640 1 -- 172.21.15.103:0/523178063 shutdown_connections 2024-09-10T22:42:20.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.899+0000 7faafa000640 1 -- 172.21.15.103:0/523178063 wait complete. 2024-09-10T22:42:20.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.899+0000 7faafa000640 1 Processor -- start 2024-09-10T22:42:20.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.899+0000 7faafa000640 1 -- start start 2024-09-10T22:42:20.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faafa000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faaf40c61b0 0x7faaf40b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:20.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faafa000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faaf40cf3b0 0x7faaf41503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:20.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faafa000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaf415d9f0 0x7faaf415cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:20.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faafa000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faaf406d5b0 con 0x7faaf415d9f0 2024-09-10T22:42:20.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faafa000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faaf406d430 con 0x7faaf40c61b0 2024-09-10T22:42:20.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faafa000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7faaf406d730 con 0x7faaf40cf3b0 2024-09-10T22:42:20.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faaf9600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaf415d9f0 0x7faaf415cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:20.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faaf9600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaf415d9f0 0x7faaf415cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57348/0 (socket says 172.21.15.103:57348) 2024-09-10T22:42:20.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faaf9600640 1 -- 172.21.15.103:0/1804785003 learned_addr learned my addr 172.21.15.103:0/1804785003 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:20.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faaebe00640 1 --2- 172.21.15.103:0/1804785003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faaf40cf3b0 0x7faaf41503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:20.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faaf8c00640 1 --2- 172.21.15.103:0/1804785003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faaf40c61b0 0x7faaf40b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:20.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faaf9600640 1 -- 172.21.15.103:0/1804785003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faaf40cf3b0 msgr2=0x7faaf41503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:20.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faaf9600640 1 --2- 172.21.15.103:0/1804785003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faaf40cf3b0 0x7faaf41503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faaf9600640 1 -- 172.21.15.103:0/1804785003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faaf40c61b0 msgr2=0x7faaf40b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:20.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faaf9600640 1 --2- 172.21.15.103:0/1804785003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faaf40c61b0 0x7faaf40b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:20.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faaf9600640 1 -- 172.21.15.103:0/1804785003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf40afba0 con 0x7faaf415d9f0 2024-09-10T22:42:20.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faaf8c00640 1 --2- 172.21.15.103:0/1804785003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faaf40c61b0 0x7faaf40b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:20.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faaf9600640 1 --2- 172.21.15.103:0/1804785003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaf415d9f0 0x7faaf415cc10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7faaec00c770 tx=0x7faaec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:20.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faaf1600640 1 -- 172.21.15.103:0/1804785003 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec017070 con 0x7faaf415d9f0 2024-09-10T22:42:20.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faaf1600640 1 -- 172.21.15.103:0/1804785003 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faaec005070 con 0x7faaf415d9f0 2024-09-10T22:42:20.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faafa000640 1 -- 172.21.15.103:0/1804785003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf40afe80 con 0x7faaf415d9f0 2024-09-10T22:42:20.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faaf1600640 1 -- 172.21.15.103:0/1804785003 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec0054c0 con 0x7faaf415d9f0 2024-09-10T22:42:20.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faafa000640 1 -- 172.21.15.103:0/1804785003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf40b0440 con 0x7faaf415d9f0 2024-09-10T22:42:20.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.903+0000 7faafa000640 1 -- 172.21.15.103:0/1804785003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf406df40 con 0x7faaf415d9f0 2024-09-10T22:42:20.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.907+0000 7faaf1600640 1 -- 172.21.15.103:0/1804785003 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7faaec005660 con 0x7faaf415d9f0 2024-09-10T22:42:20.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.907+0000 7faaf1600640 1 --2- 172.21.15.103:0/1804785003 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faad00725e0 0x7faad0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:20.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.907+0000 7faaf1600640 1 -- 172.21.15.103:0/1804785003 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7faaec092e00 con 0x7faaf415d9f0 2024-09-10T22:42:20.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.907+0000 7faaf8c00640 1 --2- 172.21.15.103:0/1804785003 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faad00725e0 0x7faad0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:20.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.907+0000 7faaf8c00640 1 --2- 172.21.15.103:0/1804785003 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faad00725e0 0x7faad0074aa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faae4009b40 tx=0x7faae4005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:20.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:20.911+0000 7faaf1600640 1 -- 172.21.15.103:0/1804785003 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7faaec05e2b0 con 0x7faaf415d9f0 2024-09-10T22:42:21.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.079+0000 7faafa000640 1 -- 172.21.15.103:0/1804785003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faaf41599e0 con 0x7faaf415d9f0 2024-09-10T22:42:21.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.079+0000 7faaf1600640 1 -- 172.21.15.103:0/1804785003 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+17004 (secure 0 0 0) 0x7faaec05dbb0 con 0x7faaf415d9f0 2024-09-10T22:42:21.084 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:21.084 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":68,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:42:18.345404+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:42:14.413275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-10T22:42:15.686998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:42:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.083+0000 7faafa000640 1 -- 172.21.15.103:0/1804785003 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faad00725e0 msgr2=0x7faad0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.083+0000 7faafa000640 1 --2- 172.21.15.103:0/1804785003 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faad00725e0 0x7faad0074aa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faae4009b40 tx=0x7faae4005f90 comp rx=0 tx=0).stop 2024-09-10T22:42:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.083+0000 7faafa000640 1 -- 172.21.15.103:0/1804785003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaf415d9f0 msgr2=0x7faaf415cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.083+0000 7faafa000640 1 --2- 172.21.15.103:0/1804785003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaf415d9f0 0x7faaf415cc10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7faaec00c770 tx=0x7faaec00cc30 comp rx=0 tx=0).stop 2024-09-10T22:42:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.083+0000 7faafa000640 1 -- 172.21.15.103:0/1804785003 shutdown_connections 2024-09-10T22:42:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.083+0000 7faafa000640 1 --2- 172.21.15.103:0/1804785003 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faad00725e0 0x7faad0074aa0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.083+0000 7faafa000640 1 --2- 172.21.15.103:0/1804785003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaf415d9f0 0x7faaf415cc10 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.083+0000 7faafa000640 1 --2- 172.21.15.103:0/1804785003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faaf40cf3b0 0x7faaf41503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.083+0000 7faafa000640 1 --2- 172.21.15.103:0/1804785003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faaf40c61b0 0x7faaf40b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.083+0000 7faafa000640 1 -- 172.21.15.103:0/1804785003 >> 172.21.15.103:0/1804785003 conn(0x7faaf40cff60 msgr2=0x7faaf40ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:21.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.083+0000 7faafa000640 1 -- 172.21.15.103:0/1804785003 shutdown_connections 2024-09-10T22:42:21.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.083+0000 7faafa000640 1 -- 172.21.15.103:0/1804785003 wait complete. 2024-09-10T22:42:21.105 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T22:42:21.105 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:42:21.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.243+0000 7f8186000640 1 -- 172.21.15.103:0/2066025870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8164003c70 msgr2=0x7f8164004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:21.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.243+0000 7f8186000640 1 --2- 172.21.15.103:0/2066025870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8164003c70 0x7f8164004070 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f8170009b60 tx=0x7f817001d270 comp rx=0 tx=0).stop 2024-09-10T22:42:21.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.243+0000 7f817fe00640 1 -- 172.21.15.103:0/2066025870 reap_dead start 2024-09-10T22:42:21.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.243+0000 7f8186000640 1 -- 172.21.15.103:0/2066025870 shutdown_connections 2024-09-10T22:42:21.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.243+0000 7f8186000640 1 -- 172.21.15.103:0/2066025870 >> 172.21.15.103:0/2066025870 conn(0x7f81800d1ac0 msgr2=0x7f81800d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:21.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.243+0000 7f8186000640 1 -- 172.21.15.103:0/2066025870 shutdown_connections 2024-09-10T22:42:21.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.243+0000 7f8186000640 1 -- 172.21.15.103:0/2066025870 wait complete. 2024-09-10T22:42:21.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f8186000640 1 Processor -- start 2024-09-10T22:42:21.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f8186000640 1 -- start start 2024-09-10T22:42:21.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f8186000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8164003c70 0x7f818006dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f8186000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81801572f0 0x7f8180156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f8186000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81801fae20 0x7f81801fb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f8186000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8180167c70 con 0x7f8164003c70 2024-09-10T22:42:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f8186000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f81800cef50 con 0x7f81801fae20 2024-09-10T22:42:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f8186000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8180167df0 con 0x7f81801572f0 2024-09-10T22:42:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f817f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8164003c70 0x7f818006dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f817f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8164003c70 0x7f818006dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57372/0 (socket says 172.21.15.103:57372) 2024-09-10T22:42:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f817f400640 1 -- 172.21.15.103:0/3454379097 learned_addr learned my addr 172.21.15.103:0/3454379097 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f817ea00640 1 --2- 172.21.15.103:0/3454379097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81801572f0 0x7f8180156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f817fe00640 1 --2- 172.21.15.103:0/3454379097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81801fae20 0x7f81801fb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f817f400640 1 -- 172.21.15.103:0/3454379097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81801572f0 msgr2=0x7f8180156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f817f400640 1 --2- 172.21.15.103:0/3454379097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81801572f0 0x7f8180156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f817f400640 1 -- 172.21.15.103:0/3454379097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81801fae20 msgr2=0x7f81801fb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:21.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f817f400640 1 --2- 172.21.15.103:0/3454379097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81801fae20 0x7f81801fb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f817f400640 1 -- 172.21.15.103:0/3454379097 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81800c80c0 con 0x7f8164003c70 2024-09-10T22:42:21.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f817fe00640 1 --2- 172.21.15.103:0/3454379097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81801fae20 0x7f81801fb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:21.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f817f400640 1 --2- 172.21.15.103:0/3454379097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8164003c70 0x7f818006dd10 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f81700af040 tx=0x7f8170005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:21.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f8177400640 1 -- 172.21.15.103:0/3454379097 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81700b1040 con 0x7f8164003c70 2024-09-10T22:42:21.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f8177400640 1 -- 172.21.15.103:0/3454379097 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81700bb070 con 0x7f8164003c70 2024-09-10T22:42:21.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f8177400640 1 -- 172.21.15.103:0/3454379097 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8170004290 con 0x7f8164003c70 2024-09-10T22:42:21.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f8186000640 1 -- 172.21.15.103:0/3454379097 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81800c8880 con 0x7f8164003c70 2024-09-10T22:42:21.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.247+0000 7f8186000640 1 -- 172.21.15.103:0/3454379097 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81800c9940 con 0x7f8164003c70 2024-09-10T22:42:21.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.251+0000 7f8186000640 1 -- 172.21.15.103:0/3454379097 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81800aee70 con 0x7f8164003c70 2024-09-10T22:42:21.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.251+0000 7f8177400640 1 -- 172.21.15.103:0/3454379097 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f81700046d0 con 0x7f8164003c70 2024-09-10T22:42:21.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.251+0000 7f8177400640 1 --2- 172.21.15.103:0/3454379097 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8160072610 0x7f8160074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:21.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.251+0000 7f8177400640 1 -- 172.21.15.103:0/3454379097 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f817012e270 con 0x7f8164003c70 2024-09-10T22:42:21.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.251+0000 7f817ea00640 1 --2- 172.21.15.103:0/3454379097 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8160072610 0x7f8160074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:21.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.251+0000 7f817ea00640 1 --2- 172.21.15.103:0/3454379097 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8160072610 0x7f8160074ad0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f816c001250 tx=0x7f816c006040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:21.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.255+0000 7f8177400640 1 -- 172.21.15.103:0/3454379097 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8170016f80 con 0x7f8164003c70 2024-09-10T22:42:21.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.419+0000 7f8186000640 1 -- 172.21.15.103:0/3454379097 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81800c9410 con 0x7f8160072610 2024-09-10T22:42:21.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.427+0000 7f8177400640 1 -- 172.21.15.103:0/3454379097 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250538 (secure 0 0 0) 0x7f81800c9410 con 0x7f8160072610 2024-09-10T22:42:21.432 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:21.433 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:42:21.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.431+0000 7f8186000640 1 -- 172.21.15.103:0/3454379097 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8160072610 msgr2=0x7f8160074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:21.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.431+0000 7f8186000640 1 --2- 172.21.15.103:0/3454379097 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8160072610 0x7f8160074ad0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f816c001250 tx=0x7f816c006040 comp rx=0 tx=0).stop 2024-09-10T22:42:21.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.431+0000 7f8186000640 1 -- 172.21.15.103:0/3454379097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8164003c70 msgr2=0x7f818006dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:21.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.431+0000 7f8186000640 1 --2- 172.21.15.103:0/3454379097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8164003c70 0x7f818006dd10 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f81700af040 tx=0x7f8170005590 comp rx=0 tx=0).stop 2024-09-10T22:42:21.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.431+0000 7f8186000640 1 -- 172.21.15.103:0/3454379097 shutdown_connections 2024-09-10T22:42:21.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.431+0000 7f8186000640 1 --2- 172.21.15.103:0/3454379097 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8160072610 0x7f8160074ad0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.431+0000 7f8186000640 1 --2- 172.21.15.103:0/3454379097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81801fae20 0x7f81801fb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.431+0000 7f8186000640 1 --2- 172.21.15.103:0/3454379097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81801572f0 0x7f8180156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.431+0000 7f8186000640 1 --2- 172.21.15.103:0/3454379097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8164003c70 0x7f818006dd10 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.431+0000 7f8186000640 1 -- 172.21.15.103:0/3454379097 >> 172.21.15.103:0/3454379097 conn(0x7f81800d1ac0 msgr2=0x7f818015b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:21.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.431+0000 7f8186000640 1 -- 172.21.15.103:0/3454379097 shutdown_connections 2024-09-10T22:42:21.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.431+0000 7f8186000640 1 -- 172.21.15.103:0/3454379097 wait complete. 2024-09-10T22:42:21.452 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2024-09-10T22:42:19.670649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590584,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":135,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236204,"kb_used_data":7480,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738516,"statfs":{"total":773094113280,"available":772852240384,"internally_reserved":0,"allocated":7659520,"data_stored":4090838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.347093"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:42:16.323099+0000","last_change":"2024-09-10T22:42:16.323099+0000","last_active":"2024-09-10T22:42:16.323099+0000","last_peered":"2024-09-10T22:42:16.323099+0000","last_clean":"2024-09-10T22:42:16.323099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:42:16.323099+0000","last_undegraded":"2024-09-10T22:42:16.323099+0000","last_fullsized":"2024-09-10T22:42:16.323099+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:42:16.323099+0000","last_change":"2024-09-10T22:42:16.323099+0000","last_active":"2024-09-10T22:42:16.323099+0000","last_peered":"2024-09-10T22:42:16.323099+0000","last_clean":"2024-09-10T22:42:16.323099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:42:16.323099+0000","last_undegraded":"2024-09-10T22:42:16.323099+0000","last_fullsized":"2024-09-10T22:42:16.323099+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.370607+0000","last_change":"2024-09-10T22:42:17.364028+0000","last_active":"2024-09-10T22:42:17.370607+0000","last_peered":"2024-09-10T22:42:17.370607+0000","last_clean":"2024-09-10T22:42:17.370607+0000","last_became_active":"2024-09-10T22:42:17.363739+0000","last_became_peered":"2024-09-10T22:42:17.363739+0000","last_unstale":"2024-09-10T22:42:17.370607+0000","last_undegraded":"2024-09-10T22:42:17.370607+0000","last_fullsized":"2024-09-10T22:42:17.370607+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:43.312795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.352819+0000","last_change":"2024-09-10T22:42:17.343246+0000","last_active":"2024-09-10T22:42:17.352819+0000","last_peered":"2024-09-10T22:42:17.352819+0000","last_clean":"2024-09-10T22:42:17.352819+0000","last_became_active":"2024-09-10T22:42:17.342957+0000","last_became_peered":"2024-09-10T22:42:17.342957+0000","last_unstale":"2024-09-10T22:42:17.352819+0000","last_undegraded":"2024-09-10T22:42:17.352819+0000","last_fullsized":"2024-09-10T22:42:17.352819+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:38:25.114296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354006+0000","last_change":"2024-09-10T22:42:17.359575+0000","last_active":"2024-09-10T22:42:18.354006+0000","last_peered":"2024-09-10T22:42:18.354006+0000","last_clean":"2024-09-10T22:42:18.354006+0000","last_became_active":"2024-09-10T22:42:17.358933+0000","last_became_peered":"2024-09-10T22:42:17.358933+0000","last_unstale":"2024-09-10T22:42:18.354006+0000","last_undegraded":"2024-09-10T22:42:18.354006+0000","last_fullsized":"2024-09-10T22:42:18.354006+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:23.208634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369224+0000","last_change":"2024-09-10T22:42:17.367287+0000","last_active":"2024-09-10T22:42:18.369224+0000","last_peered":"2024-09-10T22:42:18.369224+0000","last_clean":"2024-09-10T22:42:18.369224+0000","last_became_active":"2024-09-10T22:42:17.366943+0000","last_became_peered":"2024-09-10T22:42:17.366943+0000","last_unstale":"2024-09-10T22:42:18.369224+0000","last_undegraded":"2024-09-10T22:42:18.369224+0000","last_fullsized":"2024-09-10T22:42:18.369224+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:57.896020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354697+0000","last_change":"2024-09-10T22:42:17.362578+0000","last_active":"2024-09-10T22:42:18.354697+0000","last_peered":"2024-09-10T22:42:18.354697+0000","last_clean":"2024-09-10T22:42:18.354697+0000","last_became_active":"2024-09-10T22:42:17.362175+0000","last_became_peered":"2024-09-10T22:42:17.362175+0000","last_unstale":"2024-09-10T22:42:18.354697+0000","last_undegraded":"2024-09-10T22:42:18.354697+0000","last_fullsized":"2024-09-10T22:42:18.354697+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:57.071924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.370161+0000","last_change":"2024-09-10T22:42:17.361678+0000","last_active":"2024-09-10T22:42:17.370161+0000","last_peered":"2024-09-10T22:42:17.370161+0000","last_clean":"2024-09-10T22:42:17.370161+0000","last_became_active":"2024-09-10T22:42:17.361422+0000","last_became_peered":"2024-09-10T22:42:17.361422+0000","last_unstale":"2024-09-10T22:42:17.370161+0000","last_undegraded":"2024-09-10T22:42:17.370161+0000","last_fullsized":"2024-09-10T22:42:17.370161+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:32.555825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.372982+0000","last_change":"2024-09-10T22:42:17.369580+0000","last_active":"2024-09-10T22:42:17.372982+0000","last_peered":"2024-09-10T22:42:17.372982+0000","last_clean":"2024-09-10T22:42:17.372982+0000","last_became_active":"2024-09-10T22:42:17.364686+0000","last_became_peered":"2024-09-10T22:42:17.364686+0000","last_unstale":"2024-09-10T22:42:17.372982+0000","last_undegraded":"2024-09-10T22:42:17.372982+0000","last_fullsized":"2024-09-10T22:42:17.372982+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:19.484196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.376007+0000","last_change":"2024-09-10T22:42:17.372497+0000","last_active":"2024-09-10T22:42:17.376007+0000","last_peered":"2024-09-10T22:42:17.376007+0000","last_clean":"2024-09-10T22:42:17.376007+0000","last_became_active":"2024-09-10T22:42:17.372205+0000","last_became_peered":"2024-09-10T22:42:17.372205+0000","last_unstale":"2024-09-10T22:42:17.376007+0000","last_undegraded":"2024-09-10T22:42:17.376007+0000","last_fullsized":"2024-09-10T22:42:17.376007+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:53.491339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.367014+0000","last_change":"2024-09-10T22:42:17.364416+0000","last_active":"2024-09-10T22:42:17.367014+0000","last_peered":"2024-09-10T22:42:17.367014+0000","last_clean":"2024-09-10T22:42:17.367014+0000","last_became_active":"2024-09-10T22:42:17.363121+0000","last_became_peered":"2024-09-10T22:42:17.363121+0000","last_unstale":"2024-09-10T22:42:17.367014+0000","last_undegraded":"2024-09-10T22:42:17.367014+0000","last_fullsized":"2024-09-10T22:42:17.367014+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:40.369158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.367812+0000","last_change":"2024-09-10T22:42:17.361289+0000","last_active":"2024-09-10T22:42:17.367812+0000","last_peered":"2024-09-10T22:42:17.367812+0000","last_clean":"2024-09-10T22:42:17.367812+0000","last_became_active":"2024-09-10T22:42:17.360901+0000","last_became_peered":"2024-09-10T22:42:17.360901+0000","last_unstale":"2024-09-10T22:42:17.367812+0000","last_undegraded":"2024-09-10T22:42:17.367812+0000","last_fullsized":"2024-09-10T22:42:17.367812+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:10.711083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.367370+0000","last_change":"2024-09-10T22:42:17.354260+0000","last_active":"2024-09-10T22:42:17.367370+0000","last_peered":"2024-09-10T22:42:17.367370+0000","last_clean":"2024-09-10T22:42:17.367370+0000","last_became_active":"2024-09-10T22:42:17.353986+0000","last_became_peered":"2024-09-10T22:42:17.353986+0000","last_unstale":"2024-09-10T22:42:17.367370+0000","last_undegraded":"2024-09-10T22:42:17.367370+0000","last_fullsized":"2024-09-10T22:42:17.367370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:10.850604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.368045+0000","last_change":"2024-09-10T22:42:17.358479+0000","last_active":"2024-09-10T22:42:17.368045+0000","last_peered":"2024-09-10T22:42:17.368045+0000","last_clean":"2024-09-10T22:42:17.368045+0000","last_became_active":"2024-09-10T22:42:17.358137+0000","last_became_peered":"2024-09-10T22:42:17.358137+0000","last_unstale":"2024-09-10T22:42:17.368045+0000","last_undegraded":"2024-09-10T22:42:17.368045+0000","last_fullsized":"2024-09-10T22:42:17.368045+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:25.221862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.376067+0000","last_change":"2024-09-10T22:42:17.372138+0000","last_active":"2024-09-10T22:42:17.376067+0000","last_peered":"2024-09-10T22:42:17.376067+0000","last_clean":"2024-09-10T22:42:17.376067+0000","last_became_active":"2024-09-10T22:42:17.371780+0000","last_became_peered":"2024-09-10T22:42:17.371780+0000","last_unstale":"2024-09-10T22:42:17.376067+0000","last_undegraded":"2024-09-10T22:42:17.376067+0000","last_fullsized":"2024-09-10T22:42:17.376067+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:55.574902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354578+0000","last_change":"2024-09-10T22:42:17.369840+0000","last_active":"2024-09-10T22:42:18.354578+0000","last_peered":"2024-09-10T22:42:18.354578+0000","last_clean":"2024-09-10T22:42:18.354578+0000","last_became_active":"2024-09-10T22:42:17.369530+0000","last_became_peered":"2024-09-10T22:42:17.369530+0000","last_unstale":"2024-09-10T22:42:18.354578+0000","last_undegraded":"2024-09-10T22:42:18.354578+0000","last_fullsized":"2024-09-10T22:42:18.354578+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:37.534020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:42:16.323099+0000","last_change":"2024-09-10T22:42:16.323099+0000","last_active":"2024-09-10T22:42:16.323099+0000","last_peered":"2024-09-10T22:42:16.323099+0000","last_clean":"2024-09-10T22:42:16.323099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:42:16.323099+0000","last_undegraded":"2024-09-10T22:42:16.323099+0000","last_fullsized":"2024-09-10T22:42:16.323099+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.352869+0000","last_change":"2024-09-10T22:42:17.342593+0000","last_active":"2024-09-10T22:42:17.352869+0000","last_peered":"2024-09-10T22:42:17.352869+0000","last_clean":"2024-09-10T22:42:17.352869+0000","last_became_active":"2024-09-10T22:42:17.342298+0000","last_became_peered":"2024-09-10T22:42:17.342298+0000","last_unstale":"2024-09-10T22:42:17.352869+0000","last_undegraded":"2024-09-10T22:42:17.352869+0000","last_fullsized":"2024-09-10T22:42:17.352869+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:18.810630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354209+0000","last_change":"2024-09-10T22:42:17.355278+0000","last_active":"2024-09-10T22:42:18.354209+0000","last_peered":"2024-09-10T22:42:18.354209+0000","last_clean":"2024-09-10T22:42:18.354209+0000","last_became_active":"2024-09-10T22:42:17.354965+0000","last_became_peered":"2024-09-10T22:42:17.354965+0000","last_unstale":"2024-09-10T22:42:18.354209+0000","last_undegraded":"2024-09-10T22:42:18.354209+0000","last_fullsized":"2024-09-10T22:42:18.354209+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:37.210761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354062+0000","last_change":"2024-09-10T22:42:17.354717+0000","last_active":"2024-09-10T22:42:18.354062+0000","last_peered":"2024-09-10T22:42:18.354062+0000","last_clean":"2024-09-10T22:42:18.354062+0000","last_became_active":"2024-09-10T22:42:17.354446+0000","last_became_peered":"2024-09-10T22:42:17.354446+0000","last_unstale":"2024-09-10T22:42:18.354062+0000","last_undegraded":"2024-09-10T22:42:18.354062+0000","last_fullsized":"2024-09-10T22:42:18.354062+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:36:07.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.367785+0000","last_change":"2024-09-10T22:42:17.360793+0000","last_active":"2024-09-10T22:42:17.367785+0000","last_peered":"2024-09-10T22:42:17.367785+0000","last_clean":"2024-09-10T22:42:17.367785+0000","last_became_active":"2024-09-10T22:42:17.360474+0000","last_became_peered":"2024-09-10T22:42:17.360474+0000","last_unstale":"2024-09-10T22:42:17.367785+0000","last_undegraded":"2024-09-10T22:42:17.367785+0000","last_fullsized":"2024-09-10T22:42:17.367785+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:49.267921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354786+0000","last_change":"2024-09-10T22:42:17.351598+0000","last_active":"2024-09-10T22:42:18.354786+0000","last_peered":"2024-09-10T22:42:18.354786+0000","last_clean":"2024-09-10T22:42:18.354786+0000","last_became_active":"2024-09-10T22:42:17.351316+0000","last_became_peered":"2024-09-10T22:42:17.351316+0000","last_unstale":"2024-09-10T22:42:18.354786+0000","last_undegraded":"2024-09-10T22:42:18.354786+0000","last_fullsized":"2024-09-10T22:42:18.354786+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:19.185568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353836+0000","last_change":"2024-09-10T22:42:17.351598+0000","last_active":"2024-09-10T22:42:18.353836+0000","last_peered":"2024-09-10T22:42:18.353836+0000","last_clean":"2024-09-10T22:42:18.353836+0000","last_became_active":"2024-09-10T22:42:17.351287+0000","last_became_peered":"2024-09-10T22:42:17.351287+0000","last_unstale":"2024-09-10T22:42:18.353836+0000","last_undegraded":"2024-09-10T22:42:18.353836+0000","last_fullsized":"2024-09-10T22:42:18.353836+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:32.562661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.369676+0000","last_change":"2024-09-10T22:42:17.355356+0000","last_active":"2024-09-10T22:42:17.369676+0000","last_peered":"2024-09-10T22:42:17.369676+0000","last_clean":"2024-09-10T22:42:17.369676+0000","last_became_active":"2024-09-10T22:42:17.355084+0000","last_became_peered":"2024-09-10T22:42:17.355084+0000","last_unstale":"2024-09-10T22:42:17.369676+0000","last_undegraded":"2024-09-10T22:42:17.369676+0000","last_fullsized":"2024-09-10T22:42:17.369676+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:42.445602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.367401+0000","last_change":"2024-09-10T22:42:17.355044+0000","last_active":"2024-09-10T22:42:17.367401+0000","last_peered":"2024-09-10T22:42:17.367401+0000","last_clean":"2024-09-10T22:42:17.367401+0000","last_became_active":"2024-09-10T22:42:17.353776+0000","last_became_peered":"2024-09-10T22:42:17.353776+0000","last_unstale":"2024-09-10T22:42:17.367401+0000","last_undegraded":"2024-09-10T22:42:17.367401+0000","last_fullsized":"2024-09-10T22:42:17.367401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:44.074899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.367694+0000","last_change":"2024-09-10T22:42:17.360783+0000","last_active":"2024-09-10T22:42:17.367694+0000","last_peered":"2024-09-10T22:42:17.367694+0000","last_clean":"2024-09-10T22:42:17.367694+0000","last_became_active":"2024-09-10T22:42:17.360164+0000","last_became_peered":"2024-09-10T22:42:17.360164+0000","last_unstale":"2024-09-10T22:42:17.367694+0000","last_undegraded":"2024-09-10T22:42:17.367694+0000","last_fullsized":"2024-09-10T22:42:17.367694+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:25.221862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.357103+0000","last_change":"2024-09-10T22:42:17.351417+0000","last_active":"2024-09-10T22:42:17.357103+0000","last_peered":"2024-09-10T22:42:17.357103+0000","last_clean":"2024-09-10T22:42:17.357103+0000","last_became_active":"2024-09-10T22:42:17.351149+0000","last_became_peered":"2024-09-10T22:42:17.351149+0000","last_unstale":"2024-09-10T22:42:17.357103+0000","last_undegraded":"2024-09-10T22:42:17.357103+0000","last_fullsized":"2024-09-10T22:42:17.357103+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:10.973311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:42:16.323099+0000","last_change":"2024-09-10T22:42:16.323099+0000","last_active":"2024-09-10T22:42:16.323099+0000","last_peered":"2024-09-10T22:42:16.323099+0000","last_clean":"2024-09-10T22:42:16.323099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:42:16.323099+0000","last_undegraded":"2024-09-10T22:42:16.323099+0000","last_fullsized":"2024-09-10T22:42:16.323099+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.368336+0000","last_change":"2024-09-10T22:42:17.364209+0000","last_active":"2024-09-10T22:42:17.368336+0000","last_peered":"2024-09-10T22:42:17.368336+0000","last_clean":"2024-09-10T22:42:17.368336+0000","last_became_active":"2024-09-10T22:42:17.363856+0000","last_became_peered":"2024-09-10T22:42:17.363856+0000","last_unstale":"2024-09-10T22:42:17.368336+0000","last_undegraded":"2024-09-10T22:42:17.368336+0000","last_fullsized":"2024-09-10T22:42:17.368336+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:01:54.881595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.369022+0000","last_change":"2024-09-10T22:42:17.365237+0000","last_active":"2024-09-10T22:42:17.369022+0000","last_peered":"2024-09-10T22:42:17.369022+0000","last_clean":"2024-09-10T22:42:17.369022+0000","last_became_active":"2024-09-10T22:42:17.364985+0000","last_became_peered":"2024-09-10T22:42:17.364985+0000","last_unstale":"2024-09-10T22:42:17.369022+0000","last_undegraded":"2024-09-10T22:42:17.369022+0000","last_fullsized":"2024-09-10T22:42:17.369022+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:01.580486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.361299+0000","last_change":"2024-09-10T22:42:17.352234+0000","last_active":"2024-09-10T22:42:17.361299+0000","last_peered":"2024-09-10T22:42:17.361299+0000","last_clean":"2024-09-10T22:42:17.361299+0000","last_became_active":"2024-09-10T22:42:17.351925+0000","last_became_peered":"2024-09-10T22:42:17.351925+0000","last_unstale":"2024-09-10T22:42:17.361299+0000","last_undegraded":"2024-09-10T22:42:17.361299+0000","last_fullsized":"2024-09-10T22:42:17.361299+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:50:04.106244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369060+0000","last_change":"2024-09-10T22:42:17.352689+0000","last_active":"2024-09-10T22:42:18.369060+0000","last_peered":"2024-09-10T22:42:18.369060+0000","last_clean":"2024-09-10T22:42:18.369060+0000","last_became_active":"2024-09-10T22:42:17.351349+0000","last_became_peered":"2024-09-10T22:42:17.351349+0000","last_unstale":"2024-09-10T22:42:18.369060+0000","last_undegraded":"2024-09-10T22:42:18.369060+0000","last_fullsized":"2024-09-10T22:42:18.369060+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:16.329955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354479+0000","last_change":"2024-09-10T22:42:17.373511+0000","last_active":"2024-09-10T22:42:18.354479+0000","last_peered":"2024-09-10T22:42:18.354479+0000","last_clean":"2024-09-10T22:42:18.354479+0000","last_became_active":"2024-09-10T22:42:17.373106+0000","last_became_peered":"2024-09-10T22:42:17.373106+0000","last_unstale":"2024-09-10T22:42:18.354479+0000","last_undegraded":"2024-09-10T22:42:18.354479+0000","last_fullsized":"2024-09-10T22:42:18.354479+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:43.312795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T22:42:15.329048+0000","last_change":"2024-09-10T22:42:15.329048+0000","last_active":"2024-09-10T22:42:15.319953+0000","last_peered":"2024-09-10T22:42:15.319953+0000","last_clean":"2024-09-10T22:42:15.319953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:42:15.329048+0000","last_undegraded":"2024-09-10T22:42:15.329048+0000","last_fullsized":"2024-09-10T22:42:15.329048+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.363230+0000","last_change":"2024-09-10T22:42:17.357398+0000","last_active":"2024-09-10T22:42:17.363230+0000","last_peered":"2024-09-10T22:42:17.363230+0000","last_clean":"2024-09-10T22:42:17.363230+0000","last_became_active":"2024-09-10T22:42:17.357130+0000","last_became_peered":"2024-09-10T22:42:17.357130+0000","last_unstale":"2024-09-10T22:42:17.363230+0000","last_undegraded":"2024-09-10T22:42:17.363230+0000","last_fullsized":"2024-09-10T22:42:17.363230+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:03.682873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369708+0000","last_change":"2024-09-10T22:42:16.352087+0000","last_active":"2024-09-10T22:42:18.369708+0000","last_peered":"2024-09-10T22:42:18.369708+0000","last_clean":"2024-09-10T22:42:18.369708+0000","last_became_active":"2024-09-10T22:42:16.351260+0000","last_became_peered":"2024-09-10T22:42:16.351260+0000","last_unstale":"2024-09-10T22:42:18.369708+0000","last_undegraded":"2024-09-10T22:42:18.369708+0000","last_fullsized":"2024-09-10T22:42:18.369708+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:45.784521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369557+0000","last_change":"2024-09-10T22:42:17.353854+0000","last_active":"2024-09-10T22:42:18.369557+0000","last_peered":"2024-09-10T22:42:18.369557+0000","last_clean":"2024-09-10T22:42:18.369557+0000","last_became_active":"2024-09-10T22:42:17.353048+0000","last_became_peered":"2024-09-10T22:42:17.353048+0000","last_unstale":"2024-09-10T22:42:18.369557+0000","last_undegraded":"2024-09-10T22:42:18.369557+0000","last_fullsized":"2024-09-10T22:42:18.369557+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:11:56.353787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"67'2","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369321+0000","last_change":"2024-09-10T22:42:16.352834+0000","last_active":"2024-09-10T22:42:18.369321+0000","last_peered":"2024-09-10T22:42:18.369321+0000","last_clean":"2024-09-10T22:42:18.369321+0000","last_became_active":"2024-09-10T22:42:16.351594+0000","last_became_peered":"2024-09-10T22:42:16.351594+0000","last_unstale":"2024-09-10T22:42:18.369321+0000","last_undegraded":"2024-09-10T22:42:18.369321+0000","last_fullsized":"2024-09-10T22:42:18.369321+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:23.977357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.375975+0000","last_change":"2024-09-10T22:42:17.372395+0000","last_active":"2024-09-10T22:42:17.375975+0000","last_peered":"2024-09-10T22:42:17.375975+0000","last_clean":"2024-09-10T22:42:17.375975+0000","last_became_active":"2024-09-10T22:42:17.371982+0000","last_became_peered":"2024-09-10T22:42:17.371982+0000","last_unstale":"2024-09-10T22:42:17.375975+0000","last_undegraded":"2024-09-10T22:42:17.375975+0000","last_fullsized":"2024-09-10T22:42:17.375975+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:23.872763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"67'2","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369586+0000","last_change":"2024-09-10T22:42:16.350394+0000","last_active":"2024-09-10T22:42:18.369586+0000","last_peered":"2024-09-10T22:42:18.369586+0000","last_clean":"2024-09-10T22:42:18.369586+0000","last_became_active":"2024-09-10T22:42:16.350068+0000","last_became_peered":"2024-09-10T22:42:16.350068+0000","last_unstale":"2024-09-10T22:42:18.369586+0000","last_undegraded":"2024-09-10T22:42:18.369586+0000","last_fullsized":"2024-09-10T22:42:18.369586+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:58.575910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354619+0000","last_change":"2024-09-10T22:42:17.362995+0000","last_active":"2024-09-10T22:42:18.354619+0000","last_peered":"2024-09-10T22:42:18.354619+0000","last_clean":"2024-09-10T22:42:18.354619+0000","last_became_active":"2024-09-10T22:42:17.362428+0000","last_became_peered":"2024-09-10T22:42:17.362428+0000","last_unstale":"2024-09-10T22:42:18.354619+0000","last_undegraded":"2024-09-10T22:42:18.354619+0000","last_fullsized":"2024-09-10T22:42:18.354619+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:52.403585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354191+0000","last_change":"2024-09-10T22:42:16.354550+0000","last_active":"2024-09-10T22:42:18.354191+0000","last_peered":"2024-09-10T22:42:18.354191+0000","last_clean":"2024-09-10T22:42:18.354191+0000","last_became_active":"2024-09-10T22:42:16.354281+0000","last_became_peered":"2024-09-10T22:42:16.354281+0000","last_unstale":"2024-09-10T22:42:18.354191+0000","last_undegraded":"2024-09-10T22:42:18.354191+0000","last_fullsized":"2024-09-10T22:42:18.354191+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:58.575910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:42:16.323099+0000","last_change":"2024-09-10T22:42:16.323099+0000","last_active":"2024-09-10T22:42:16.323099+0000","last_peered":"2024-09-10T22:42:16.323099+0000","last_clean":"2024-09-10T22:42:16.323099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:42:16.323099+0000","last_undegraded":"2024-09-10T22:42:16.323099+0000","last_fullsized":"2024-09-10T22:42:16.323099+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353788+0000","last_change":"2024-09-10T22:42:16.353114+0000","last_active":"2024-09-10T22:42:18.353788+0000","last_peered":"2024-09-10T22:42:18.353788+0000","last_clean":"2024-09-10T22:42:18.353788+0000","last_became_active":"2024-09-10T22:42:16.352676+0000","last_became_peered":"2024-09-10T22:42:16.352676+0000","last_unstale":"2024-09-10T22:42:18.353788+0000","last_undegraded":"2024-09-10T22:42:18.353788+0000","last_fullsized":"2024-09-10T22:42:18.353788+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:43:07.517617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353613+0000","last_change":"2024-09-10T22:42:17.369289+0000","last_active":"2024-09-10T22:42:18.353613+0000","last_peered":"2024-09-10T22:42:18.353613+0000","last_clean":"2024-09-10T22:42:18.353613+0000","last_became_active":"2024-09-10T22:42:17.368967+0000","last_became_peered":"2024-09-10T22:42:17.368967+0000","last_unstale":"2024-09-10T22:42:18.353613+0000","last_undegraded":"2024-09-10T22:42:18.353613+0000","last_fullsized":"2024-09-10T22:42:18.353613+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:47.081410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353751+0000","last_change":"2024-09-10T22:42:16.363933+0000","last_active":"2024-09-10T22:42:18.353751+0000","last_peered":"2024-09-10T22:42:18.353751+0000","last_clean":"2024-09-10T22:42:18.353751+0000","last_became_active":"2024-09-10T22:42:16.363396+0000","last_became_peered":"2024-09-10T22:42:16.363396+0000","last_unstale":"2024-09-10T22:42:18.353751+0000","last_undegraded":"2024-09-10T22:42:18.353751+0000","last_fullsized":"2024-09-10T22:42:18.353751+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:34.777287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354089+0000","last_change":"2024-09-10T22:42:17.347608+0000","last_active":"2024-09-10T22:42:18.354089+0000","last_peered":"2024-09-10T22:42:18.354089+0000","last_clean":"2024-09-10T22:42:18.354089+0000","last_became_active":"2024-09-10T22:42:17.347360+0000","last_became_peered":"2024-09-10T22:42:17.347360+0000","last_unstale":"2024-09-10T22:42:18.354089+0000","last_undegraded":"2024-09-10T22:42:18.354089+0000","last_fullsized":"2024-09-10T22:42:18.354089+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:19.220235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353532+0000","last_change":"2024-09-10T22:42:16.360819+0000","last_active":"2024-09-10T22:42:18.353532+0000","last_peered":"2024-09-10T22:42:18.353532+0000","last_clean":"2024-09-10T22:42:18.353532+0000","last_became_active":"2024-09-10T22:42:16.360083+0000","last_became_peered":"2024-09-10T22:42:16.360083+0000","last_unstale":"2024-09-10T22:42:18.353532+0000","last_undegraded":"2024-09-10T22:42:18.353532+0000","last_fullsized":"2024-09-10T22:42:18.353532+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:17.807485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:42:16.323099+0000","last_change":"2024-09-10T22:42:16.323099+0000","last_active":"2024-09-10T22:42:16.323099+0000","last_peered":"2024-09-10T22:42:16.323099+0000","last_clean":"2024-09-10T22:42:16.323099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:42:16.323099+0000","last_undegraded":"2024-09-10T22:42:16.323099+0000","last_fullsized":"2024-09-10T22:42:16.323099+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.346207+0000","last_change":"2024-09-10T22:42:16.359580+0000","last_active":"2024-09-10T22:42:17.346207+0000","last_peered":"2024-09-10T22:42:17.346207+0000","last_clean":"2024-09-10T22:42:17.346207+0000","last_became_active":"2024-09-10T22:42:16.359020+0000","last_became_peered":"2024-09-10T22:42:16.359020+0000","last_unstale":"2024-09-10T22:42:17.346207+0000","last_undegraded":"2024-09-10T22:42:17.346207+0000","last_fullsized":"2024-09-10T22:42:17.346207+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:45.386074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354153+0000","last_change":"2024-09-10T22:42:17.348277+0000","last_active":"2024-09-10T22:42:18.354153+0000","last_peered":"2024-09-10T22:42:18.354153+0000","last_clean":"2024-09-10T22:42:18.354153+0000","last_became_active":"2024-09-10T22:42:17.347987+0000","last_became_peered":"2024-09-10T22:42:17.347987+0000","last_unstale":"2024-09-10T22:42:18.354153+0000","last_undegraded":"2024-09-10T22:42:18.354153+0000","last_fullsized":"2024-09-10T22:42:18.354153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:03.588148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.337839+0000","last_change":"2024-09-10T22:42:16.352770+0000","last_active":"2024-09-10T22:42:17.337839+0000","last_peered":"2024-09-10T22:42:17.337839+0000","last_clean":"2024-09-10T22:42:17.337839+0000","last_became_active":"2024-09-10T22:42:16.352502+0000","last_became_peered":"2024-09-10T22:42:16.352502+0000","last_unstale":"2024-09-10T22:42:17.337839+0000","last_undegraded":"2024-09-10T22:42:17.337839+0000","last_fullsized":"2024-09-10T22:42:17.337839+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:25.134516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354205+0000","last_change":"2024-09-10T22:42:17.366367+0000","last_active":"2024-09-10T22:42:18.354205+0000","last_peered":"2024-09-10T22:42:18.354205+0000","last_clean":"2024-09-10T22:42:18.354205+0000","last_became_active":"2024-09-10T22:42:17.366122+0000","last_became_peered":"2024-09-10T22:42:17.366122+0000","last_unstale":"2024-09-10T22:42:18.354205+0000","last_undegraded":"2024-09-10T22:42:18.354205+0000","last_fullsized":"2024-09-10T22:42:18.354205+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:32.802829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"67'3","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.381559+0000","last_change":"2024-09-10T22:42:16.361143+0000","last_active":"2024-09-10T22:42:17.381559+0000","last_peered":"2024-09-10T22:42:17.381559+0000","last_clean":"2024-09-10T22:42:17.381559+0000","last_became_active":"2024-09-10T22:42:16.358165+0000","last_became_peered":"2024-09-10T22:42:16.358165+0000","last_unstale":"2024-09-10T22:42:17.381559+0000","last_undegraded":"2024-09-10T22:42:17.381559+0000","last_fullsized":"2024-09-10T22:42:17.381559+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:25.893206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.357287+0000","last_change":"2024-09-10T22:42:17.346047+0000","last_active":"2024-09-10T22:42:17.357287+0000","last_peered":"2024-09-10T22:42:17.357287+0000","last_clean":"2024-09-10T22:42:17.357287+0000","last_became_active":"2024-09-10T22:42:17.345777+0000","last_became_peered":"2024-09-10T22:42:17.345777+0000","last_unstale":"2024-09-10T22:42:17.357287+0000","last_undegraded":"2024-09-10T22:42:17.357287+0000","last_fullsized":"2024-09-10T22:42:17.357287+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:47.680042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T22:42:15.329448+0000","last_change":"2024-09-10T22:42:15.329448+0000","last_active":"2024-09-10T22:42:15.319953+0000","last_peered":"2024-09-10T22:42:15.319953+0000","last_clean":"2024-09-10T22:42:15.319953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:42:15.329448+0000","last_undegraded":"2024-09-10T22:42:15.329448+0000","last_fullsized":"2024-09-10T22:42:15.329448+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.359104+0000","last_change":"2024-09-10T22:42:17.350514+0000","last_active":"2024-09-10T22:42:17.359104+0000","last_peered":"2024-09-10T22:42:17.359104+0000","last_clean":"2024-09-10T22:42:17.359104+0000","last_became_active":"2024-09-10T22:42:17.348425+0000","last_became_peered":"2024-09-10T22:42:17.348425+0000","last_unstale":"2024-09-10T22:42:17.359104+0000","last_undegraded":"2024-09-10T22:42:17.359104+0000","last_fullsized":"2024-09-10T22:42:17.359104+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:54.370874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"67'2","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.370854+0000","last_change":"2024-09-10T22:42:16.364567+0000","last_active":"2024-09-10T22:42:17.370854+0000","last_peered":"2024-09-10T22:42:17.370854+0000","last_clean":"2024-09-10T22:42:17.370854+0000","last_became_active":"2024-09-10T22:42:16.364191+0000","last_became_peered":"2024-09-10T22:42:16.364191+0000","last_unstale":"2024-09-10T22:42:17.370854+0000","last_undegraded":"2024-09-10T22:42:17.370854+0000","last_fullsized":"2024-09-10T22:42:17.370854+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:22.205488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.367745+0000","last_change":"2024-09-10T22:42:17.360769+0000","last_active":"2024-09-10T22:42:17.367745+0000","last_peered":"2024-09-10T22:42:17.367745+0000","last_clean":"2024-09-10T22:42:17.367745+0000","last_became_active":"2024-09-10T22:42:17.360418+0000","last_became_peered":"2024-09-10T22:42:17.360418+0000","last_unstale":"2024-09-10T22:42:17.367745+0000","last_undegraded":"2024-09-10T22:42:17.367745+0000","last_fullsized":"2024-09-10T22:42:17.367745+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:28.351645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.340434+0000","last_change":"2024-09-10T22:42:16.355687+0000","last_active":"2024-09-10T22:42:17.340434+0000","last_peered":"2024-09-10T22:42:17.340434+0000","last_clean":"2024-09-10T22:42:17.340434+0000","last_became_active":"2024-09-10T22:42:16.355065+0000","last_became_peered":"2024-09-10T22:42:16.355065+0000","last_unstale":"2024-09-10T22:42:17.340434+0000","last_undegraded":"2024-09-10T22:42:17.340434+0000","last_fullsized":"2024-09-10T22:42:17.340434+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:07.230826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353886+0000","last_change":"2024-09-10T22:42:17.363922+0000","last_active":"2024-09-10T22:42:18.353886+0000","last_peered":"2024-09-10T22:42:18.353886+0000","last_clean":"2024-09-10T22:42:18.353886+0000","last_became_active":"2024-09-10T22:42:17.363010+0000","last_became_peered":"2024-09-10T22:42:17.363010+0000","last_unstale":"2024-09-10T22:42:18.353886+0000","last_undegraded":"2024-09-10T22:42:18.353886+0000","last_fullsized":"2024-09-10T22:42:18.353886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:47.881345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.344329+0000","last_change":"2024-09-10T22:42:16.356965+0000","last_active":"2024-09-10T22:42:17.344329+0000","last_peered":"2024-09-10T22:42:17.344329+0000","last_clean":"2024-09-10T22:42:17.344329+0000","last_became_active":"2024-09-10T22:42:16.356658+0000","last_became_peered":"2024-09-10T22:42:16.356658+0000","last_unstale":"2024-09-10T22:42:17.344329+0000","last_undegraded":"2024-09-10T22:42:17.344329+0000","last_fullsized":"2024-09-10T22:42:17.344329+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:46.878199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:42:16.323099+0000","last_change":"2024-09-10T22:42:16.323099+0000","last_active":"2024-09-10T22:42:16.323099+0000","last_peered":"2024-09-10T22:42:16.323099+0000","last_clean":"2024-09-10T22:42:16.323099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:42:16.323099+0000","last_undegraded":"2024-09-10T22:42:16.323099+0000","last_fullsized":"2024-09-10T22:42:16.323099+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"67'8","reported_seq":21,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.374106+0000","last_change":"2024-09-10T22:42:16.354864+0000","last_active":"2024-09-10T22:42:17.374106+0000","last_peered":"2024-09-10T22:42:17.374106+0000","last_clean":"2024-09-10T22:42:17.374106+0000","last_became_active":"2024-09-10T22:42:16.351829+0000","last_became_peered":"2024-09-10T22:42:16.351829+0000","last_unstale":"2024-09-10T22:42:17.374106+0000","last_undegraded":"2024-09-10T22:42:17.374106+0000","last_fullsized":"2024-09-10T22:42:17.374106+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:08.649400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.373646+0000","last_change":"2024-09-10T22:42:17.365824+0000","last_active":"2024-09-10T22:42:17.373646+0000","last_peered":"2024-09-10T22:42:17.373646+0000","last_clean":"2024-09-10T22:42:17.373646+0000","last_became_active":"2024-09-10T22:42:17.365546+0000","last_became_peered":"2024-09-10T22:42:17.365546+0000","last_unstale":"2024-09-10T22:42:17.373646+0000","last_undegraded":"2024-09-10T22:42:17.373646+0000","last_fullsized":"2024-09-10T22:42:17.373646+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:34.568273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"67'1","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.369530+0000","last_change":"2024-09-10T22:42:16.355313+0000","last_active":"2024-09-10T22:42:17.369530+0000","last_peered":"2024-09-10T22:42:17.369530+0000","last_clean":"2024-09-10T22:42:17.369530+0000","last_became_active":"2024-09-10T22:42:16.354941+0000","last_became_peered":"2024-09-10T22:42:16.354941+0000","last_unstale":"2024-09-10T22:42:17.369530+0000","last_undegraded":"2024-09-10T22:42:17.369530+0000","last_fullsized":"2024-09-10T22:42:17.369530+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:55.669397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354382+0000","last_change":"2024-09-10T22:42:17.359831+0000","last_active":"2024-09-10T22:42:18.354382+0000","last_peered":"2024-09-10T22:42:18.354382+0000","last_clean":"2024-09-10T22:42:18.354382+0000","last_became_active":"2024-09-10T22:42:17.359447+0000","last_became_peered":"2024-09-10T22:42:17.359447+0000","last_unstale":"2024-09-10T22:42:18.354382+0000","last_undegraded":"2024-09-10T22:42:18.354382+0000","last_fullsized":"2024-09-10T22:42:18.354382+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:10.850604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"67'2","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.369852+0000","last_change":"2024-09-10T22:42:16.358646+0000","last_active":"2024-09-10T22:42:17.369852+0000","last_peered":"2024-09-10T22:42:17.369852+0000","last_clean":"2024-09-10T22:42:17.369852+0000","last_became_active":"2024-09-10T22:42:16.358355+0000","last_became_peered":"2024-09-10T22:42:16.358355+0000","last_unstale":"2024-09-10T22:42:17.369852+0000","last_undegraded":"2024-09-10T22:42:17.369852+0000","last_fullsized":"2024-09-10T22:42:17.369852+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:55.288608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.361806+0000","last_change":"2024-09-10T22:42:17.356267+0000","last_active":"2024-09-10T22:42:17.361806+0000","last_peered":"2024-09-10T22:42:17.361806+0000","last_clean":"2024-09-10T22:42:17.361806+0000","last_became_active":"2024-09-10T22:42:17.356002+0000","last_became_peered":"2024-09-10T22:42:17.356002+0000","last_unstale":"2024-09-10T22:42:17.361806+0000","last_undegraded":"2024-09-10T22:42:17.361806+0000","last_fullsized":"2024-09-10T22:42:17.361806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:17:17.778412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"67'1","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.381566+0000","last_change":"2024-09-10T22:42:16.361487+0000","last_active":"2024-09-10T22:42:17.381566+0000","last_peered":"2024-09-10T22:42:17.381566+0000","last_clean":"2024-09-10T22:42:17.381566+0000","last_became_active":"2024-09-10T22:42:16.360359+0000","last_became_peered":"2024-09-10T22:42:16.360359+0000","last_unstale":"2024-09-10T22:42:17.381566+0000","last_undegraded":"2024-09-10T22:42:17.381566+0000","last_fullsized":"2024-09-10T22:42:17.381566+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:36.207615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354218+0000","last_change":"2024-09-10T22:42:17.356211+0000","last_active":"2024-09-10T22:42:18.354218+0000","last_peered":"2024-09-10T22:42:18.354218+0000","last_clean":"2024-09-10T22:42:18.354218+0000","last_became_active":"2024-09-10T22:42:17.355685+0000","last_became_peered":"2024-09-10T22:42:17.355685+0000","last_unstale":"2024-09-10T22:42:18.354218+0000","last_undegraded":"2024-09-10T22:42:18.354218+0000","last_fullsized":"2024-09-10T22:42:18.354218+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:18.379271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354159+0000","last_change":"2024-09-10T22:42:16.356419+0000","last_active":"2024-09-10T22:42:18.354159+0000","last_peered":"2024-09-10T22:42:18.354159+0000","last_clean":"2024-09-10T22:42:18.354159+0000","last_became_active":"2024-09-10T22:42:16.356158+0000","last_became_peered":"2024-09-10T22:42:16.356158+0000","last_unstale":"2024-09-10T22:42:18.354159+0000","last_undegraded":"2024-09-10T22:42:18.354159+0000","last_fullsized":"2024-09-10T22:42:18.354159+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:50:15.238051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369124+0000","last_change":"2024-09-10T22:42:17.353644+0000","last_active":"2024-09-10T22:42:18.369124+0000","last_peered":"2024-09-10T22:42:18.369124+0000","last_clean":"2024-09-10T22:42:18.369124+0000","last_became_active":"2024-09-10T22:42:17.351025+0000","last_became_peered":"2024-09-10T22:42:17.351025+0000","last_unstale":"2024-09-10T22:42:18.369124+0000","last_undegraded":"2024-09-10T22:42:18.369124+0000","last_fullsized":"2024-09-10T22:42:18.369124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:33.928181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"67'2","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369233+0000","last_change":"2024-09-10T22:42:16.363748+0000","last_active":"2024-09-10T22:42:18.369233+0000","last_peered":"2024-09-10T22:42:18.369233+0000","last_clean":"2024-09-10T22:42:18.369233+0000","last_became_active":"2024-09-10T22:42:16.363454+0000","last_became_peered":"2024-09-10T22:42:16.363454+0000","last_unstale":"2024-09-10T22:42:18.369233+0000","last_undegraded":"2024-09-10T22:42:18.369233+0000","last_fullsized":"2024-09-10T22:42:18.369233+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:34.777287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.367513+0000","last_change":"2024-09-10T22:42:17.354860+0000","last_active":"2024-09-10T22:42:17.367513+0000","last_peered":"2024-09-10T22:42:17.367513+0000","last_clean":"2024-09-10T22:42:17.367513+0000","last_became_active":"2024-09-10T22:42:17.353974+0000","last_became_peered":"2024-09-10T22:42:17.353974+0000","last_unstale":"2024-09-10T22:42:17.367513+0000","last_undegraded":"2024-09-10T22:42:17.367513+0000","last_fullsized":"2024-09-10T22:42:17.367513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:31.860952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.340660+0000","last_change":"2024-09-10T22:42:16.356017+0000","last_active":"2024-09-10T22:42:17.340660+0000","last_peered":"2024-09-10T22:42:17.340660+0000","last_clean":"2024-09-10T22:42:17.340660+0000","last_became_active":"2024-09-10T22:42:16.355613+0000","last_became_peered":"2024-09-10T22:42:16.355613+0000","last_unstale":"2024-09-10T22:42:17.340660+0000","last_undegraded":"2024-09-10T22:42:17.340660+0000","last_fullsized":"2024-09-10T22:42:17.340660+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:48.565796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353913+0000","last_change":"2024-09-10T22:42:17.365175+0000","last_active":"2024-09-10T22:42:18.353913+0000","last_peered":"2024-09-10T22:42:18.353913+0000","last_clean":"2024-09-10T22:42:18.353913+0000","last_became_active":"2024-09-10T22:42:17.364816+0000","last_became_peered":"2024-09-10T22:42:17.364816+0000","last_unstale":"2024-09-10T22:42:18.353913+0000","last_undegraded":"2024-09-10T22:42:18.353913+0000","last_fullsized":"2024-09-10T22:42:18.353913+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:46.389220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.368988+0000","last_change":"2024-09-10T22:42:16.348719+0000","last_active":"2024-09-10T22:42:18.368988+0000","last_peered":"2024-09-10T22:42:18.368988+0000","last_clean":"2024-09-10T22:42:18.368988+0000","last_became_active":"2024-09-10T22:42:16.348337+0000","last_became_peered":"2024-09-10T22:42:16.348337+0000","last_unstale":"2024-09-10T22:42:18.368988+0000","last_undegraded":"2024-09-10T22:42:18.368988+0000","last_fullsized":"2024-09-10T22:42:18.368988+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:52.488193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369488+0000","last_change":"2024-09-10T22:42:17.352866+0000","last_active":"2024-09-10T22:42:18.369488+0000","last_peered":"2024-09-10T22:42:18.369488+0000","last_clean":"2024-09-10T22:42:18.369488+0000","last_became_active":"2024-09-10T22:42:17.351362+0000","last_became_peered":"2024-09-10T22:42:17.351362+0000","last_unstale":"2024-09-10T22:42:18.369488+0000","last_undegraded":"2024-09-10T22:42:18.369488+0000","last_fullsized":"2024-09-10T22:42:18.369488+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:40.112325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"67'2","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.374613+0000","last_change":"2024-09-10T22:42:16.355408+0000","last_active":"2024-09-10T22:42:17.374613+0000","last_peered":"2024-09-10T22:42:17.374613+0000","last_clean":"2024-09-10T22:42:17.374613+0000","last_became_active":"2024-09-10T22:42:16.355111+0000","last_became_peered":"2024-09-10T22:42:16.355111+0000","last_unstale":"2024-09-10T22:42:17.374613+0000","last_undegraded":"2024-09-10T22:42:17.374613+0000","last_fullsized":"2024-09-10T22:42:17.374613+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:16.743017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354964+0000","last_change":"2024-09-10T22:42:17.359482+0000","last_active":"2024-09-10T22:42:18.354964+0000","last_peered":"2024-09-10T22:42:18.354964+0000","last_clean":"2024-09-10T22:42:18.354964+0000","last_became_active":"2024-09-10T22:42:17.359251+0000","last_became_peered":"2024-09-10T22:42:17.359251+0000","last_unstale":"2024-09-10T22:42:18.354964+0000","last_undegraded":"2024-09-10T22:42:18.354964+0000","last_fullsized":"2024-09-10T22:42:18.354964+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:44.419352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.343067+0000","last_change":"2024-09-10T22:42:16.354043+0000","last_active":"2024-09-10T22:42:17.343067+0000","last_peered":"2024-09-10T22:42:17.343067+0000","last_clean":"2024-09-10T22:42:17.343067+0000","last_became_active":"2024-09-10T22:42:16.353224+0000","last_became_peered":"2024-09-10T22:42:16.353224+0000","last_unstale":"2024-09-10T22:42:17.343067+0000","last_undegraded":"2024-09-10T22:42:17.343067+0000","last_fullsized":"2024-09-10T22:42:17.343067+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:17.376125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.367853+0000","last_change":"2024-09-10T22:42:17.361482+0000","last_active":"2024-09-10T22:42:17.367853+0000","last_peered":"2024-09-10T22:42:17.367853+0000","last_clean":"2024-09-10T22:42:17.367853+0000","last_became_active":"2024-09-10T22:42:17.360841+0000","last_became_peered":"2024-09-10T22:42:17.360841+0000","last_unstale":"2024-09-10T22:42:17.367853+0000","last_undegraded":"2024-09-10T22:42:17.367853+0000","last_fullsized":"2024-09-10T22:42:17.367853+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:15.398042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369368+0000","last_change":"2024-09-10T22:42:16.351669+0000","last_active":"2024-09-10T22:42:18.369368+0000","last_peered":"2024-09-10T22:42:18.369368+0000","last_clean":"2024-09-10T22:42:18.369368+0000","last_became_active":"2024-09-10T22:42:16.351170+0000","last_became_peered":"2024-09-10T22:42:16.351170+0000","last_unstale":"2024-09-10T22:42:18.369368+0000","last_undegraded":"2024-09-10T22:42:18.369368+0000","last_fullsized":"2024-09-10T22:42:18.369368+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:43:07.517617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354416+0000","last_change":"2024-09-10T22:42:17.355951+0000","last_active":"2024-09-10T22:42:18.354416+0000","last_peered":"2024-09-10T22:42:18.354416+0000","last_clean":"2024-09-10T22:42:18.354416+0000","last_became_active":"2024-09-10T22:42:17.355424+0000","last_became_peered":"2024-09-10T22:42:17.355424+0000","last_unstale":"2024-09-10T22:42:18.354416+0000","last_undegraded":"2024-09-10T22:42:18.354416+0000","last_fullsized":"2024-09-10T22:42:18.354416+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:25.221862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T22:42:15.329012+0000","last_change":"2024-09-10T22:42:15.329012+0000","last_active":"2024-09-10T22:42:15.319953+0000","last_peered":"2024-09-10T22:42:15.319953+0000","last_clean":"2024-09-10T22:42:15.319953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:42:15.329012+0000","last_undegraded":"2024-09-10T22:42:15.329012+0000","last_fullsized":"2024-09-10T22:42:15.329012+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353567+0000","last_change":"2024-09-10T22:42:17.362743+0000","last_active":"2024-09-10T22:42:18.353567+0000","last_peered":"2024-09-10T22:42:18.353567+0000","last_clean":"2024-09-10T22:42:18.353567+0000","last_became_active":"2024-09-10T22:42:17.362451+0000","last_became_peered":"2024-09-10T22:42:17.362451+0000","last_unstale":"2024-09-10T22:42:18.353567+0000","last_undegraded":"2024-09-10T22:42:18.353567+0000","last_fullsized":"2024-09-10T22:42:18.353567+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:58.419409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.347338+0000","last_change":"2024-09-10T22:42:16.360801+0000","last_active":"2024-09-10T22:42:17.347338+0000","last_peered":"2024-09-10T22:42:17.347338+0000","last_clean":"2024-09-10T22:42:17.347338+0000","last_became_active":"2024-09-10T22:42:16.360511+0000","last_became_peered":"2024-09-10T22:42:16.360511+0000","last_unstale":"2024-09-10T22:42:17.347338+0000","last_undegraded":"2024-09-10T22:42:17.347338+0000","last_fullsized":"2024-09-10T22:42:17.347338+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:31.799683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.357425+0000","last_change":"2024-09-10T22:42:17.346780+0000","last_active":"2024-09-10T22:42:17.357425+0000","last_peered":"2024-09-10T22:42:17.357425+0000","last_clean":"2024-09-10T22:42:17.357425+0000","last_became_active":"2024-09-10T22:42:17.346500+0000","last_became_peered":"2024-09-10T22:42:17.346500+0000","last_unstale":"2024-09-10T22:42:17.357425+0000","last_undegraded":"2024-09-10T22:42:17.357425+0000","last_fullsized":"2024-09-10T22:42:17.357425+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:11.493736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354315+0000","last_change":"2024-09-10T22:42:16.351463+0000","last_active":"2024-09-10T22:42:18.354315+0000","last_peered":"2024-09-10T22:42:18.354315+0000","last_clean":"2024-09-10T22:42:18.354315+0000","last_became_active":"2024-09-10T22:42:16.351129+0000","last_became_peered":"2024-09-10T22:42:16.351129+0000","last_unstale":"2024-09-10T22:42:18.354315+0000","last_undegraded":"2024-09-10T22:42:18.354315+0000","last_fullsized":"2024-09-10T22:42:18.354315+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:45.784521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T22:42:16.323099+0000","last_change":"2024-09-10T22:42:16.323099+0000","last_active":"2024-09-10T22:42:16.323099+0000","last_peered":"2024-09-10T22:42:16.323099+0000","last_clean":"2024-09-10T22:42:16.323099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:42:16.323099+0000","last_undegraded":"2024-09-10T22:42:16.323099+0000","last_fullsized":"2024-09-10T22:42:16.323099+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353874+0000","last_change":"2024-09-10T22:42:16.363423+0000","last_active":"2024-09-10T22:42:18.353874+0000","last_peered":"2024-09-10T22:42:18.353874+0000","last_clean":"2024-09-10T22:42:18.353874+0000","last_became_active":"2024-09-10T22:42:16.363148+0000","last_became_peered":"2024-09-10T22:42:16.363148+0000","last_unstale":"2024-09-10T22:42:18.353874+0000","last_undegraded":"2024-09-10T22:42:18.353874+0000","last_fullsized":"2024-09-10T22:42:18.353874+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:23.977357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354742+0000","last_change":"2024-09-10T22:42:17.361850+0000","last_active":"2024-09-10T22:42:18.354742+0000","last_peered":"2024-09-10T22:42:18.354742+0000","last_clean":"2024-09-10T22:42:18.354742+0000","last_became_active":"2024-09-10T22:42:17.361571+0000","last_became_peered":"2024-09-10T22:42:17.361571+0000","last_unstale":"2024-09-10T22:42:18.354742+0000","last_undegraded":"2024-09-10T22:42:18.354742+0000","last_fullsized":"2024-09-10T22:42:18.354742+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:59.816275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-09-10T22:42:15.328945+0000","last_change":"2024-09-10T22:42:15.328945+0000","last_active":"2024-09-10T22:42:15.319953+0000","last_peered":"2024-09-10T22:42:15.319953+0000","last_clean":"2024-09-10T22:42:15.319953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:42:15.328945+0000","last_undegraded":"2024-09-10T22:42:15.328945+0000","last_fullsized":"2024-09-10T22:42:15.328945+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354319+0000","last_change":"2024-09-10T22:42:17.373377+0000","last_active":"2024-09-10T22:42:18.354319+0000","last_peered":"2024-09-10T22:42:18.354319+0000","last_clean":"2024-09-10T22:42:18.354319+0000","last_became_active":"2024-09-10T22:42:17.373033+0000","last_became_peered":"2024-09-10T22:42:17.373033+0000","last_unstale":"2024-09-10T22:42:18.354319+0000","last_undegraded":"2024-09-10T22:42:18.354319+0000","last_fullsized":"2024-09-10T22:42:18.354319+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:44.074899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353600+0000","last_change":"2024-09-10T22:42:16.355349+0000","last_active":"2024-09-10T22:42:18.353600+0000","last_peered":"2024-09-10T22:42:18.353600+0000","last_clean":"2024-09-10T22:42:18.353600+0000","last_became_active":"2024-09-10T22:42:16.355015+0000","last_became_peered":"2024-09-10T22:42:16.355015+0000","last_unstale":"2024-09-10T22:42:18.353600+0000","last_undegraded":"2024-09-10T22:42:18.353600+0000","last_fullsized":"2024-09-10T22:42:18.353600+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:00.402852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":194,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.345893+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:42:17.345893+0000","last_peered":"2024-09-10T22:42:17.345893+0000","last_clean":"2024-09-10T22:42:17.345893+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:42:17.345893+0000","last_undegraded":"2024-09-10T22:42:17.345893+0000","last_fullsized":"2024-09-10T22:42:17.345893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":7},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1413120,"data_stored":953820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":369402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":362698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":815104,"data_stored":364288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":802816,"data_stored":362676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":369368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509487,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28408,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343432,"statfs":{"total":96636764160,"available":96607674368,"internally_reserved":0,"allocated":1409024,"data_stored":959736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":778240,"data_stored":348850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:42:21.513 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:42:21.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.651+0000 7f2d9e800640 1 -- 172.21.15.103:0/749904100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d980b0ac0 msgr2=0x7f2d9806de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:21.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.651+0000 7f2d9e800640 1 --2- 172.21.15.103:0/749904100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d980b0ac0 0x7f2d9806de60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2d98072f20 tx=0x7f2d8401f0b0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.651+0000 7f2d9e800640 1 -- 172.21.15.103:0/749904100 shutdown_connections 2024-09-10T22:42:21.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.651+0000 7f2d9e800640 1 --2- 172.21.15.103:0/749904100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d980b0ac0 0x7f2d9806de60 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.651+0000 7f2d9e800640 1 --2- 172.21.15.103:0/749904100 >> v2:172.21.15.131:3300/0 conn(0x7f2d9815d920 0x7f2d9806f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.651+0000 7f2d9e800640 1 -- 172.21.15.103:0/749904100 >> 172.21.15.103:0/749904100 conn(0x7f2d9809a9f0 msgr2=0x7f2d9809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:21.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.651+0000 7f2d9e800640 1 -- 172.21.15.103:0/749904100 shutdown_connections 2024-09-10T22:42:21.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.651+0000 7f2d9e800640 1 -- 172.21.15.103:0/749904100 wait complete. 2024-09-10T22:42:21.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.651+0000 7f2d9e800640 1 Processor -- start 2024-09-10T22:42:21.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.651+0000 7f2d9e800640 1 -- start start 2024-09-10T22:42:21.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9e800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d9806e3a0 0x7f2d980c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:21.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d980b0ac0 0x7f2d980b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:21.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9e800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d9815d920 0x7f2d9814b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:21.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9e800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2d980d1660 con 0x7f2d980b0ac0 2024-09-10T22:42:21.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9e800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2d980d0d40 con 0x7f2d9815d920 2024-09-10T22:42:21.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9e800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2d980d17e0 con 0x7f2d9806e3a0 2024-09-10T22:42:21.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d980b0ac0 0x7f2d980b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:21.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d980b0ac0 0x7f2d980b6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57390/0 (socket says 172.21.15.103:57390) 2024-09-10T22:42:21.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9ca00640 1 -- 172.21.15.103:0/1983297795 learned_addr learned my addr 172.21.15.103:0/1983297795 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:21.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9d400640 1 --2- 172.21.15.103:0/1983297795 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d9806e3a0 0x7f2d980c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:21.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9de00640 1 --2- 172.21.15.103:0/1983297795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d9815d920 0x7f2d9814b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:21.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9ca00640 1 -- 172.21.15.103:0/1983297795 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d9806e3a0 msgr2=0x7f2d980c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:21.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9ca00640 1 --2- 172.21.15.103:0/1983297795 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d9806e3a0 0x7f2d980c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9ca00640 1 -- 172.21.15.103:0/1983297795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d9815d920 msgr2=0x7f2d9814b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:21.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9ca00640 1 --2- 172.21.15.103:0/1983297795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d9815d920 0x7f2d9814b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9ca00640 1 -- 172.21.15.103:0/1983297795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d980b28f0 con 0x7f2d980b0ac0 2024-09-10T22:42:21.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9d400640 1 --2- 172.21.15.103:0/1983297795 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d9806e3a0 0x7f2d980c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:21.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9de00640 1 --2- 172.21.15.103:0/1983297795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d9815d920 0x7f2d9814b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:21.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9ca00640 1 --2- 172.21.15.103:0/1983297795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d980b0ac0 0x7f2d980b6f90 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2d840b3040 tx=0x7f2d84005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:21.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d95600640 1 -- 172.21.15.103:0/1983297795 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d840be070 con 0x7f2d980b0ac0 2024-09-10T22:42:21.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d95600640 1 -- 172.21.15.103:0/1983297795 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d84005400 con 0x7f2d980b0ac0 2024-09-10T22:42:21.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9e800640 1 -- 172.21.15.103:0/1983297795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d981f4f40 con 0x7f2d980b0ac0 2024-09-10T22:42:21.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d95600640 1 -- 172.21.15.103:0/1983297795 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d840b5040 con 0x7f2d980b0ac0 2024-09-10T22:42:21.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9e800640 1 -- 172.21.15.103:0/1983297795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d980b2e70 con 0x7f2d980b0ac0 2024-09-10T22:42:21.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d9e800640 1 -- 172.21.15.103:0/1983297795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d980d1c90 con 0x7f2d980b0ac0 2024-09-10T22:42:21.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.655+0000 7f2d95600640 1 -- 172.21.15.103:0/1983297795 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2d840b8030 con 0x7f2d980b0ac0 2024-09-10T22:42:21.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.659+0000 7f2d95600640 1 --2- 172.21.15.103:0/1983297795 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2d780725e0 0x7f2d78074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:21.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.659+0000 7f2d95600640 1 -- 172.21.15.103:0/1983297795 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f2d84130240 con 0x7f2d980b0ac0 2024-09-10T22:42:21.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.659+0000 7f2d9d400640 1 --2- 172.21.15.103:0/1983297795 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2d780725e0 0x7f2d78074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:21.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.659+0000 7f2d9d400640 1 --2- 172.21.15.103:0/1983297795 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2d780725e0 0x7f2d78074aa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c005fd0 tx=0x7f2d8c005de0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:21.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.663+0000 7f2d95600640 1 -- 172.21.15.103:0/1983297795 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2d84018c10 con 0x7f2d980b0ac0 2024-09-10T22:42:21.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.827+0000 7f2d9e800640 1 -- 172.21.15.103:0/1983297795 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d980d05c0 con 0x7f2d780725e0 2024-09-10T22:42:21.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.831+0000 7f2d95600640 1 -- 172.21.15.103:0/1983297795 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252027 (secure 0 0 0) 0x7f2d980d05c0 con 0x7f2d780725e0 2024-09-10T22:42:21.837 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:21.839 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:42:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.835+0000 7f2d9e800640 1 -- 172.21.15.103:0/1983297795 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2d780725e0 msgr2=0x7f2d78074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.835+0000 7f2d9e800640 1 --2- 172.21.15.103:0/1983297795 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2d780725e0 0x7f2d78074aa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c005fd0 tx=0x7f2d8c005de0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.835+0000 7f2d9e800640 1 -- 172.21.15.103:0/1983297795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d980b0ac0 msgr2=0x7f2d980b6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.835+0000 7f2d9e800640 1 --2- 172.21.15.103:0/1983297795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d980b0ac0 0x7f2d980b6f90 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2d840b3040 tx=0x7f2d84005760 comp rx=0 tx=0).stop 2024-09-10T22:42:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.835+0000 7f2d9e800640 1 -- 172.21.15.103:0/1983297795 shutdown_connections 2024-09-10T22:42:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.835+0000 7f2d9e800640 1 --2- 172.21.15.103:0/1983297795 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2d780725e0 0x7f2d78074aa0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.835+0000 7f2d9e800640 1 --2- 172.21.15.103:0/1983297795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d9815d920 0x7f2d9814b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.835+0000 7f2d9e800640 1 --2- 172.21.15.103:0/1983297795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d980b0ac0 0x7f2d980b6f90 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.835+0000 7f2d9e800640 1 --2- 172.21.15.103:0/1983297795 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d9806e3a0 0x7f2d980c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.835+0000 7f2d9e800640 1 -- 172.21.15.103:0/1983297795 >> 172.21.15.103:0/1983297795 conn(0x7f2d9809a9f0 msgr2=0x7f2d9815b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.835+0000 7f2d9e800640 1 -- 172.21.15.103:0/1983297795 shutdown_connections 2024-09-10T22:42:21.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:21.835+0000 7f2d9e800640 1 -- 172.21.15.103:0/1983297795 wait complete. 2024-09-10T22:42:21.857 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-09-10T22:42:21.671245+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":99,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236260,"kb_used_data":7544,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738460,"statfs":{"total":773094113280,"available":772852183040,"internally_reserved":0,"allocated":7725056,"data_stored":4113732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001453"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:19.530249+0000","last_change":"2024-09-10T22:42:17.369280+0000","last_active":"2024-09-10T22:42:19.530249+0000","last_peered":"2024-09-10T22:42:19.530249+0000","last_clean":"2024-09-10T22:42:19.530249+0000","last_became_active":"2024-09-10T22:42:17.369084+0000","last_became_peered":"2024-09-10T22:42:17.369084+0000","last_unstale":"2024-09-10T22:42:19.530249+0000","last_undegraded":"2024-09-10T22:42:19.530249+0000","last_fullsized":"2024-09-10T22:42:19.530249+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:27.986992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:19.530123+0000","last_change":"2024-09-10T22:42:17.359442+0000","last_active":"2024-09-10T22:42:19.530123+0000","last_peered":"2024-09-10T22:42:19.530123+0000","last_clean":"2024-09-10T22:42:19.530123+0000","last_became_active":"2024-09-10T22:42:17.359137+0000","last_became_peered":"2024-09-10T22:42:17.359137+0000","last_unstale":"2024-09-10T22:42:19.530123+0000","last_undegraded":"2024-09-10T22:42:19.530123+0000","last_fullsized":"2024-09-10T22:42:19.530123+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:31.808033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.370607+0000","last_change":"2024-09-10T22:42:17.364028+0000","last_active":"2024-09-10T22:42:17.370607+0000","last_peered":"2024-09-10T22:42:17.370607+0000","last_clean":"2024-09-10T22:42:17.370607+0000","last_became_active":"2024-09-10T22:42:17.363739+0000","last_became_peered":"2024-09-10T22:42:17.363739+0000","last_unstale":"2024-09-10T22:42:17.370607+0000","last_undegraded":"2024-09-10T22:42:17.370607+0000","last_fullsized":"2024-09-10T22:42:17.370607+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:43.312795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.352819+0000","last_change":"2024-09-10T22:42:17.343246+0000","last_active":"2024-09-10T22:42:17.352819+0000","last_peered":"2024-09-10T22:42:17.352819+0000","last_clean":"2024-09-10T22:42:17.352819+0000","last_became_active":"2024-09-10T22:42:17.342957+0000","last_became_peered":"2024-09-10T22:42:17.342957+0000","last_unstale":"2024-09-10T22:42:17.352819+0000","last_undegraded":"2024-09-10T22:42:17.352819+0000","last_fullsized":"2024-09-10T22:42:17.352819+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:38:25.114296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354006+0000","last_change":"2024-09-10T22:42:17.359575+0000","last_active":"2024-09-10T22:42:18.354006+0000","last_peered":"2024-09-10T22:42:18.354006+0000","last_clean":"2024-09-10T22:42:18.354006+0000","last_became_active":"2024-09-10T22:42:17.358933+0000","last_became_peered":"2024-09-10T22:42:17.358933+0000","last_unstale":"2024-09-10T22:42:18.354006+0000","last_undegraded":"2024-09-10T22:42:18.354006+0000","last_fullsized":"2024-09-10T22:42:18.354006+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:23.208634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369224+0000","last_change":"2024-09-10T22:42:17.367287+0000","last_active":"2024-09-10T22:42:18.369224+0000","last_peered":"2024-09-10T22:42:18.369224+0000","last_clean":"2024-09-10T22:42:18.369224+0000","last_became_active":"2024-09-10T22:42:17.366943+0000","last_became_peered":"2024-09-10T22:42:17.366943+0000","last_unstale":"2024-09-10T22:42:18.369224+0000","last_undegraded":"2024-09-10T22:42:18.369224+0000","last_fullsized":"2024-09-10T22:42:18.369224+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:57.896020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354697+0000","last_change":"2024-09-10T22:42:17.362578+0000","last_active":"2024-09-10T22:42:18.354697+0000","last_peered":"2024-09-10T22:42:18.354697+0000","last_clean":"2024-09-10T22:42:18.354697+0000","last_became_active":"2024-09-10T22:42:17.362175+0000","last_became_peered":"2024-09-10T22:42:17.362175+0000","last_unstale":"2024-09-10T22:42:18.354697+0000","last_undegraded":"2024-09-10T22:42:18.354697+0000","last_fullsized":"2024-09-10T22:42:18.354697+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:57.071924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.370161+0000","last_change":"2024-09-10T22:42:17.361678+0000","last_active":"2024-09-10T22:42:17.370161+0000","last_peered":"2024-09-10T22:42:17.370161+0000","last_clean":"2024-09-10T22:42:17.370161+0000","last_became_active":"2024-09-10T22:42:17.361422+0000","last_became_peered":"2024-09-10T22:42:17.361422+0000","last_unstale":"2024-09-10T22:42:17.370161+0000","last_undegraded":"2024-09-10T22:42:17.370161+0000","last_fullsized":"2024-09-10T22:42:17.370161+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:32.555825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.372982+0000","last_change":"2024-09-10T22:42:17.369580+0000","last_active":"2024-09-10T22:42:17.372982+0000","last_peered":"2024-09-10T22:42:17.372982+0000","last_clean":"2024-09-10T22:42:17.372982+0000","last_became_active":"2024-09-10T22:42:17.364686+0000","last_became_peered":"2024-09-10T22:42:17.364686+0000","last_unstale":"2024-09-10T22:42:17.372982+0000","last_undegraded":"2024-09-10T22:42:17.372982+0000","last_fullsized":"2024-09-10T22:42:17.372982+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:19.484196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.376007+0000","last_change":"2024-09-10T22:42:17.372497+0000","last_active":"2024-09-10T22:42:17.376007+0000","last_peered":"2024-09-10T22:42:17.376007+0000","last_clean":"2024-09-10T22:42:17.376007+0000","last_became_active":"2024-09-10T22:42:17.372205+0000","last_became_peered":"2024-09-10T22:42:17.372205+0000","last_unstale":"2024-09-10T22:42:17.376007+0000","last_undegraded":"2024-09-10T22:42:17.376007+0000","last_fullsized":"2024-09-10T22:42:17.376007+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:53.491339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.367014+0000","last_change":"2024-09-10T22:42:17.364416+0000","last_active":"2024-09-10T22:42:17.367014+0000","last_peered":"2024-09-10T22:42:17.367014+0000","last_clean":"2024-09-10T22:42:17.367014+0000","last_became_active":"2024-09-10T22:42:17.363121+0000","last_became_peered":"2024-09-10T22:42:17.363121+0000","last_unstale":"2024-09-10T22:42:17.367014+0000","last_undegraded":"2024-09-10T22:42:17.367014+0000","last_fullsized":"2024-09-10T22:42:17.367014+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:24:40.369158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.367812+0000","last_change":"2024-09-10T22:42:17.361289+0000","last_active":"2024-09-10T22:42:17.367812+0000","last_peered":"2024-09-10T22:42:17.367812+0000","last_clean":"2024-09-10T22:42:17.367812+0000","last_became_active":"2024-09-10T22:42:17.360901+0000","last_became_peered":"2024-09-10T22:42:17.360901+0000","last_unstale":"2024-09-10T22:42:17.367812+0000","last_undegraded":"2024-09-10T22:42:17.367812+0000","last_fullsized":"2024-09-10T22:42:17.367812+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:10.711083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.367370+0000","last_change":"2024-09-10T22:42:17.354260+0000","last_active":"2024-09-10T22:42:17.367370+0000","last_peered":"2024-09-10T22:42:17.367370+0000","last_clean":"2024-09-10T22:42:17.367370+0000","last_became_active":"2024-09-10T22:42:17.353986+0000","last_became_peered":"2024-09-10T22:42:17.353986+0000","last_unstale":"2024-09-10T22:42:17.367370+0000","last_undegraded":"2024-09-10T22:42:17.367370+0000","last_fullsized":"2024-09-10T22:42:17.367370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:10.850604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.368045+0000","last_change":"2024-09-10T22:42:17.358479+0000","last_active":"2024-09-10T22:42:17.368045+0000","last_peered":"2024-09-10T22:42:17.368045+0000","last_clean":"2024-09-10T22:42:17.368045+0000","last_became_active":"2024-09-10T22:42:17.358137+0000","last_became_peered":"2024-09-10T22:42:17.358137+0000","last_unstale":"2024-09-10T22:42:17.368045+0000","last_undegraded":"2024-09-10T22:42:17.368045+0000","last_fullsized":"2024-09-10T22:42:17.368045+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:25.221862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.376067+0000","last_change":"2024-09-10T22:42:17.372138+0000","last_active":"2024-09-10T22:42:17.376067+0000","last_peered":"2024-09-10T22:42:17.376067+0000","last_clean":"2024-09-10T22:42:17.376067+0000","last_became_active":"2024-09-10T22:42:17.371780+0000","last_became_peered":"2024-09-10T22:42:17.371780+0000","last_unstale":"2024-09-10T22:42:17.376067+0000","last_undegraded":"2024-09-10T22:42:17.376067+0000","last_fullsized":"2024-09-10T22:42:17.376067+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:55.574902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354578+0000","last_change":"2024-09-10T22:42:17.369840+0000","last_active":"2024-09-10T22:42:18.354578+0000","last_peered":"2024-09-10T22:42:18.354578+0000","last_clean":"2024-09-10T22:42:18.354578+0000","last_became_active":"2024-09-10T22:42:17.369530+0000","last_became_peered":"2024-09-10T22:42:17.369530+0000","last_unstale":"2024-09-10T22:42:18.354578+0000","last_undegraded":"2024-09-10T22:42:18.354578+0000","last_fullsized":"2024-09-10T22:42:18.354578+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:37.534020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:19.530225+0000","last_change":"2024-09-10T22:42:17.369651+0000","last_active":"2024-09-10T22:42:19.530225+0000","last_peered":"2024-09-10T22:42:19.530225+0000","last_clean":"2024-09-10T22:42:19.530225+0000","last_became_active":"2024-09-10T22:42:17.369516+0000","last_became_peered":"2024-09-10T22:42:17.369516+0000","last_unstale":"2024-09-10T22:42:19.530225+0000","last_undegraded":"2024-09-10T22:42:19.530225+0000","last_fullsized":"2024-09-10T22:42:19.530225+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:44.675552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.352869+0000","last_change":"2024-09-10T22:42:17.342593+0000","last_active":"2024-09-10T22:42:17.352869+0000","last_peered":"2024-09-10T22:42:17.352869+0000","last_clean":"2024-09-10T22:42:17.352869+0000","last_became_active":"2024-09-10T22:42:17.342298+0000","last_became_peered":"2024-09-10T22:42:17.342298+0000","last_unstale":"2024-09-10T22:42:17.352869+0000","last_undegraded":"2024-09-10T22:42:17.352869+0000","last_fullsized":"2024-09-10T22:42:17.352869+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:18.810630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354209+0000","last_change":"2024-09-10T22:42:17.355278+0000","last_active":"2024-09-10T22:42:18.354209+0000","last_peered":"2024-09-10T22:42:18.354209+0000","last_clean":"2024-09-10T22:42:18.354209+0000","last_became_active":"2024-09-10T22:42:17.354965+0000","last_became_peered":"2024-09-10T22:42:17.354965+0000","last_unstale":"2024-09-10T22:42:18.354209+0000","last_undegraded":"2024-09-10T22:42:18.354209+0000","last_fullsized":"2024-09-10T22:42:18.354209+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:37.210761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354062+0000","last_change":"2024-09-10T22:42:17.354717+0000","last_active":"2024-09-10T22:42:18.354062+0000","last_peered":"2024-09-10T22:42:18.354062+0000","last_clean":"2024-09-10T22:42:18.354062+0000","last_became_active":"2024-09-10T22:42:17.354446+0000","last_became_peered":"2024-09-10T22:42:17.354446+0000","last_unstale":"2024-09-10T22:42:18.354062+0000","last_undegraded":"2024-09-10T22:42:18.354062+0000","last_fullsized":"2024-09-10T22:42:18.354062+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:36:07.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.367785+0000","last_change":"2024-09-10T22:42:17.360793+0000","last_active":"2024-09-10T22:42:17.367785+0000","last_peered":"2024-09-10T22:42:17.367785+0000","last_clean":"2024-09-10T22:42:17.367785+0000","last_became_active":"2024-09-10T22:42:17.360474+0000","last_became_peered":"2024-09-10T22:42:17.360474+0000","last_unstale":"2024-09-10T22:42:17.367785+0000","last_undegraded":"2024-09-10T22:42:17.367785+0000","last_fullsized":"2024-09-10T22:42:17.367785+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:49.267921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354786+0000","last_change":"2024-09-10T22:42:17.351598+0000","last_active":"2024-09-10T22:42:18.354786+0000","last_peered":"2024-09-10T22:42:18.354786+0000","last_clean":"2024-09-10T22:42:18.354786+0000","last_became_active":"2024-09-10T22:42:17.351316+0000","last_became_peered":"2024-09-10T22:42:17.351316+0000","last_unstale":"2024-09-10T22:42:18.354786+0000","last_undegraded":"2024-09-10T22:42:18.354786+0000","last_fullsized":"2024-09-10T22:42:18.354786+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:19.185568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353836+0000","last_change":"2024-09-10T22:42:17.351598+0000","last_active":"2024-09-10T22:42:18.353836+0000","last_peered":"2024-09-10T22:42:18.353836+0000","last_clean":"2024-09-10T22:42:18.353836+0000","last_became_active":"2024-09-10T22:42:17.351287+0000","last_became_peered":"2024-09-10T22:42:17.351287+0000","last_unstale":"2024-09-10T22:42:18.353836+0000","last_undegraded":"2024-09-10T22:42:18.353836+0000","last_fullsized":"2024-09-10T22:42:18.353836+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:32.562661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.369676+0000","last_change":"2024-09-10T22:42:17.355356+0000","last_active":"2024-09-10T22:42:17.369676+0000","last_peered":"2024-09-10T22:42:17.369676+0000","last_clean":"2024-09-10T22:42:17.369676+0000","last_became_active":"2024-09-10T22:42:17.355084+0000","last_became_peered":"2024-09-10T22:42:17.355084+0000","last_unstale":"2024-09-10T22:42:17.369676+0000","last_undegraded":"2024-09-10T22:42:17.369676+0000","last_fullsized":"2024-09-10T22:42:17.369676+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:42.445602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.367401+0000","last_change":"2024-09-10T22:42:17.355044+0000","last_active":"2024-09-10T22:42:17.367401+0000","last_peered":"2024-09-10T22:42:17.367401+0000","last_clean":"2024-09-10T22:42:17.367401+0000","last_became_active":"2024-09-10T22:42:17.353776+0000","last_became_peered":"2024-09-10T22:42:17.353776+0000","last_unstale":"2024-09-10T22:42:17.367401+0000","last_undegraded":"2024-09-10T22:42:17.367401+0000","last_fullsized":"2024-09-10T22:42:17.367401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:44.074899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.367694+0000","last_change":"2024-09-10T22:42:17.360783+0000","last_active":"2024-09-10T22:42:17.367694+0000","last_peered":"2024-09-10T22:42:17.367694+0000","last_clean":"2024-09-10T22:42:17.367694+0000","last_became_active":"2024-09-10T22:42:17.360164+0000","last_became_peered":"2024-09-10T22:42:17.360164+0000","last_unstale":"2024-09-10T22:42:17.367694+0000","last_undegraded":"2024-09-10T22:42:17.367694+0000","last_fullsized":"2024-09-10T22:42:17.367694+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:25.221862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.357103+0000","last_change":"2024-09-10T22:42:17.351417+0000","last_active":"2024-09-10T22:42:17.357103+0000","last_peered":"2024-09-10T22:42:17.357103+0000","last_clean":"2024-09-10T22:42:17.357103+0000","last_became_active":"2024-09-10T22:42:17.351149+0000","last_became_peered":"2024-09-10T22:42:17.351149+0000","last_unstale":"2024-09-10T22:42:17.357103+0000","last_undegraded":"2024-09-10T22:42:17.357103+0000","last_fullsized":"2024-09-10T22:42:17.357103+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:10.973311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:19.529944+0000","last_change":"2024-09-10T22:42:17.364669+0000","last_active":"2024-09-10T22:42:19.529944+0000","last_peered":"2024-09-10T22:42:19.529944+0000","last_clean":"2024-09-10T22:42:19.529944+0000","last_became_active":"2024-09-10T22:42:17.359980+0000","last_became_peered":"2024-09-10T22:42:17.359980+0000","last_unstale":"2024-09-10T22:42:19.529944+0000","last_undegraded":"2024-09-10T22:42:19.529944+0000","last_fullsized":"2024-09-10T22:42:19.529944+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:02.490999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.368336+0000","last_change":"2024-09-10T22:42:17.364209+0000","last_active":"2024-09-10T22:42:17.368336+0000","last_peered":"2024-09-10T22:42:17.368336+0000","last_clean":"2024-09-10T22:42:17.368336+0000","last_became_active":"2024-09-10T22:42:17.363856+0000","last_became_peered":"2024-09-10T22:42:17.363856+0000","last_unstale":"2024-09-10T22:42:17.368336+0000","last_undegraded":"2024-09-10T22:42:17.368336+0000","last_fullsized":"2024-09-10T22:42:17.368336+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:01:54.881595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.369022+0000","last_change":"2024-09-10T22:42:17.365237+0000","last_active":"2024-09-10T22:42:17.369022+0000","last_peered":"2024-09-10T22:42:17.369022+0000","last_clean":"2024-09-10T22:42:17.369022+0000","last_became_active":"2024-09-10T22:42:17.364985+0000","last_became_peered":"2024-09-10T22:42:17.364985+0000","last_unstale":"2024-09-10T22:42:17.369022+0000","last_undegraded":"2024-09-10T22:42:17.369022+0000","last_fullsized":"2024-09-10T22:42:17.369022+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:01.580486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.361299+0000","last_change":"2024-09-10T22:42:17.352234+0000","last_active":"2024-09-10T22:42:17.361299+0000","last_peered":"2024-09-10T22:42:17.361299+0000","last_clean":"2024-09-10T22:42:17.361299+0000","last_became_active":"2024-09-10T22:42:17.351925+0000","last_became_peered":"2024-09-10T22:42:17.351925+0000","last_unstale":"2024-09-10T22:42:17.361299+0000","last_undegraded":"2024-09-10T22:42:17.361299+0000","last_fullsized":"2024-09-10T22:42:17.361299+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:50:04.106244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369060+0000","last_change":"2024-09-10T22:42:17.352689+0000","last_active":"2024-09-10T22:42:18.369060+0000","last_peered":"2024-09-10T22:42:18.369060+0000","last_clean":"2024-09-10T22:42:18.369060+0000","last_became_active":"2024-09-10T22:42:17.351349+0000","last_became_peered":"2024-09-10T22:42:17.351349+0000","last_unstale":"2024-09-10T22:42:18.369060+0000","last_undegraded":"2024-09-10T22:42:18.369060+0000","last_fullsized":"2024-09-10T22:42:18.369060+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:16.329955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354479+0000","last_change":"2024-09-10T22:42:17.373511+0000","last_active":"2024-09-10T22:42:18.354479+0000","last_peered":"2024-09-10T22:42:18.354479+0000","last_clean":"2024-09-10T22:42:18.354479+0000","last_became_active":"2024-09-10T22:42:17.373106+0000","last_became_peered":"2024-09-10T22:42:17.373106+0000","last_unstale":"2024-09-10T22:42:18.354479+0000","last_undegraded":"2024-09-10T22:42:18.354479+0000","last_fullsized":"2024-09-10T22:42:18.354479+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:43.312795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"67'4","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:19.530259+0000","last_change":"2024-09-10T22:42:16.356972+0000","last_active":"2024-09-10T22:42:19.530259+0000","last_peered":"2024-09-10T22:42:19.530259+0000","last_clean":"2024-09-10T22:42:19.530259+0000","last_became_active":"2024-09-10T22:42:16.356625+0000","last_became_peered":"2024-09-10T22:42:16.356625+0000","last_unstale":"2024-09-10T22:42:19.530259+0000","last_undegraded":"2024-09-10T22:42:19.530259+0000","last_fullsized":"2024-09-10T22:42:19.530259+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:28.820302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.363230+0000","last_change":"2024-09-10T22:42:17.357398+0000","last_active":"2024-09-10T22:42:17.363230+0000","last_peered":"2024-09-10T22:42:17.363230+0000","last_clean":"2024-09-10T22:42:17.363230+0000","last_became_active":"2024-09-10T22:42:17.357130+0000","last_became_peered":"2024-09-10T22:42:17.357130+0000","last_unstale":"2024-09-10T22:42:17.363230+0000","last_undegraded":"2024-09-10T22:42:17.363230+0000","last_fullsized":"2024-09-10T22:42:17.363230+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:03.682873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369708+0000","last_change":"2024-09-10T22:42:16.352087+0000","last_active":"2024-09-10T22:42:18.369708+0000","last_peered":"2024-09-10T22:42:18.369708+0000","last_clean":"2024-09-10T22:42:18.369708+0000","last_became_active":"2024-09-10T22:42:16.351260+0000","last_became_peered":"2024-09-10T22:42:16.351260+0000","last_unstale":"2024-09-10T22:42:18.369708+0000","last_undegraded":"2024-09-10T22:42:18.369708+0000","last_fullsized":"2024-09-10T22:42:18.369708+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:45.784521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369557+0000","last_change":"2024-09-10T22:42:17.353854+0000","last_active":"2024-09-10T22:42:18.369557+0000","last_peered":"2024-09-10T22:42:18.369557+0000","last_clean":"2024-09-10T22:42:18.369557+0000","last_became_active":"2024-09-10T22:42:17.353048+0000","last_became_peered":"2024-09-10T22:42:17.353048+0000","last_unstale":"2024-09-10T22:42:18.369557+0000","last_undegraded":"2024-09-10T22:42:18.369557+0000","last_fullsized":"2024-09-10T22:42:18.369557+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:11:56.353787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"67'2","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369321+0000","last_change":"2024-09-10T22:42:16.352834+0000","last_active":"2024-09-10T22:42:18.369321+0000","last_peered":"2024-09-10T22:42:18.369321+0000","last_clean":"2024-09-10T22:42:18.369321+0000","last_became_active":"2024-09-10T22:42:16.351594+0000","last_became_peered":"2024-09-10T22:42:16.351594+0000","last_unstale":"2024-09-10T22:42:18.369321+0000","last_undegraded":"2024-09-10T22:42:18.369321+0000","last_fullsized":"2024-09-10T22:42:18.369321+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:23.977357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.375975+0000","last_change":"2024-09-10T22:42:17.372395+0000","last_active":"2024-09-10T22:42:17.375975+0000","last_peered":"2024-09-10T22:42:17.375975+0000","last_clean":"2024-09-10T22:42:17.375975+0000","last_became_active":"2024-09-10T22:42:17.371982+0000","last_became_peered":"2024-09-10T22:42:17.371982+0000","last_unstale":"2024-09-10T22:42:17.375975+0000","last_undegraded":"2024-09-10T22:42:17.375975+0000","last_fullsized":"2024-09-10T22:42:17.375975+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:23.872763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"67'2","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369586+0000","last_change":"2024-09-10T22:42:16.350394+0000","last_active":"2024-09-10T22:42:18.369586+0000","last_peered":"2024-09-10T22:42:18.369586+0000","last_clean":"2024-09-10T22:42:18.369586+0000","last_became_active":"2024-09-10T22:42:16.350068+0000","last_became_peered":"2024-09-10T22:42:16.350068+0000","last_unstale":"2024-09-10T22:42:18.369586+0000","last_undegraded":"2024-09-10T22:42:18.369586+0000","last_fullsized":"2024-09-10T22:42:18.369586+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:58.575910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354619+0000","last_change":"2024-09-10T22:42:17.362995+0000","last_active":"2024-09-10T22:42:18.354619+0000","last_peered":"2024-09-10T22:42:18.354619+0000","last_clean":"2024-09-10T22:42:18.354619+0000","last_became_active":"2024-09-10T22:42:17.362428+0000","last_became_peered":"2024-09-10T22:42:17.362428+0000","last_unstale":"2024-09-10T22:42:18.354619+0000","last_undegraded":"2024-09-10T22:42:18.354619+0000","last_fullsized":"2024-09-10T22:42:18.354619+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:52.403585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354191+0000","last_change":"2024-09-10T22:42:16.354550+0000","last_active":"2024-09-10T22:42:18.354191+0000","last_peered":"2024-09-10T22:42:18.354191+0000","last_clean":"2024-09-10T22:42:18.354191+0000","last_became_active":"2024-09-10T22:42:16.354281+0000","last_became_peered":"2024-09-10T22:42:16.354281+0000","last_unstale":"2024-09-10T22:42:18.354191+0000","last_undegraded":"2024-09-10T22:42:18.354191+0000","last_fullsized":"2024-09-10T22:42:18.354191+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:58.575910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:19.529657+0000","last_change":"2024-09-10T22:42:17.365388+0000","last_active":"2024-09-10T22:42:19.529657+0000","last_peered":"2024-09-10T22:42:19.529657+0000","last_clean":"2024-09-10T22:42:19.529657+0000","last_became_active":"2024-09-10T22:42:17.365124+0000","last_became_peered":"2024-09-10T22:42:17.365124+0000","last_unstale":"2024-09-10T22:42:19.529657+0000","last_undegraded":"2024-09-10T22:42:19.529657+0000","last_fullsized":"2024-09-10T22:42:19.529657+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:20.956465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"67'1","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353788+0000","last_change":"2024-09-10T22:42:16.353114+0000","last_active":"2024-09-10T22:42:18.353788+0000","last_peered":"2024-09-10T22:42:18.353788+0000","last_clean":"2024-09-10T22:42:18.353788+0000","last_became_active":"2024-09-10T22:42:16.352676+0000","last_became_peered":"2024-09-10T22:42:16.352676+0000","last_unstale":"2024-09-10T22:42:18.353788+0000","last_undegraded":"2024-09-10T22:42:18.353788+0000","last_fullsized":"2024-09-10T22:42:18.353788+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:43:07.517617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353613+0000","last_change":"2024-09-10T22:42:17.369289+0000","last_active":"2024-09-10T22:42:18.353613+0000","last_peered":"2024-09-10T22:42:18.353613+0000","last_clean":"2024-09-10T22:42:18.353613+0000","last_became_active":"2024-09-10T22:42:17.368967+0000","last_became_peered":"2024-09-10T22:42:17.368967+0000","last_unstale":"2024-09-10T22:42:18.353613+0000","last_undegraded":"2024-09-10T22:42:18.353613+0000","last_fullsized":"2024-09-10T22:42:18.353613+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:47.081410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353751+0000","last_change":"2024-09-10T22:42:16.363933+0000","last_active":"2024-09-10T22:42:18.353751+0000","last_peered":"2024-09-10T22:42:18.353751+0000","last_clean":"2024-09-10T22:42:18.353751+0000","last_became_active":"2024-09-10T22:42:16.363396+0000","last_became_peered":"2024-09-10T22:42:16.363396+0000","last_unstale":"2024-09-10T22:42:18.353751+0000","last_undegraded":"2024-09-10T22:42:18.353751+0000","last_fullsized":"2024-09-10T22:42:18.353751+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:34.777287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354089+0000","last_change":"2024-09-10T22:42:17.347608+0000","last_active":"2024-09-10T22:42:18.354089+0000","last_peered":"2024-09-10T22:42:18.354089+0000","last_clean":"2024-09-10T22:42:18.354089+0000","last_became_active":"2024-09-10T22:42:17.347360+0000","last_became_peered":"2024-09-10T22:42:17.347360+0000","last_unstale":"2024-09-10T22:42:18.354089+0000","last_undegraded":"2024-09-10T22:42:18.354089+0000","last_fullsized":"2024-09-10T22:42:18.354089+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:19.220235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353532+0000","last_change":"2024-09-10T22:42:16.360819+0000","last_active":"2024-09-10T22:42:18.353532+0000","last_peered":"2024-09-10T22:42:18.353532+0000","last_clean":"2024-09-10T22:42:18.353532+0000","last_became_active":"2024-09-10T22:42:16.360083+0000","last_became_peered":"2024-09-10T22:42:16.360083+0000","last_unstale":"2024-09-10T22:42:18.353532+0000","last_undegraded":"2024-09-10T22:42:18.353532+0000","last_fullsized":"2024-09-10T22:42:18.353532+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:17.807485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:19.529953+0000","last_change":"2024-09-10T22:42:17.365828+0000","last_active":"2024-09-10T22:42:19.529953+0000","last_peered":"2024-09-10T22:42:19.529953+0000","last_clean":"2024-09-10T22:42:19.529953+0000","last_became_active":"2024-09-10T22:42:17.365528+0000","last_became_peered":"2024-09-10T22:42:17.365528+0000","last_unstale":"2024-09-10T22:42:19.529953+0000","last_undegraded":"2024-09-10T22:42:19.529953+0000","last_fullsized":"2024-09-10T22:42:19.529953+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:33:40.717373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.346207+0000","last_change":"2024-09-10T22:42:16.359580+0000","last_active":"2024-09-10T22:42:17.346207+0000","last_peered":"2024-09-10T22:42:17.346207+0000","last_clean":"2024-09-10T22:42:17.346207+0000","last_became_active":"2024-09-10T22:42:16.359020+0000","last_became_peered":"2024-09-10T22:42:16.359020+0000","last_unstale":"2024-09-10T22:42:17.346207+0000","last_undegraded":"2024-09-10T22:42:17.346207+0000","last_fullsized":"2024-09-10T22:42:17.346207+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:45.386074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354153+0000","last_change":"2024-09-10T22:42:17.348277+0000","last_active":"2024-09-10T22:42:18.354153+0000","last_peered":"2024-09-10T22:42:18.354153+0000","last_clean":"2024-09-10T22:42:18.354153+0000","last_became_active":"2024-09-10T22:42:17.347987+0000","last_became_peered":"2024-09-10T22:42:17.347987+0000","last_unstale":"2024-09-10T22:42:18.354153+0000","last_undegraded":"2024-09-10T22:42:18.354153+0000","last_fullsized":"2024-09-10T22:42:18.354153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:03.588148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.337839+0000","last_change":"2024-09-10T22:42:16.352770+0000","last_active":"2024-09-10T22:42:17.337839+0000","last_peered":"2024-09-10T22:42:17.337839+0000","last_clean":"2024-09-10T22:42:17.337839+0000","last_became_active":"2024-09-10T22:42:16.352502+0000","last_became_peered":"2024-09-10T22:42:16.352502+0000","last_unstale":"2024-09-10T22:42:17.337839+0000","last_undegraded":"2024-09-10T22:42:17.337839+0000","last_fullsized":"2024-09-10T22:42:17.337839+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:25.134516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354205+0000","last_change":"2024-09-10T22:42:17.366367+0000","last_active":"2024-09-10T22:42:18.354205+0000","last_peered":"2024-09-10T22:42:18.354205+0000","last_clean":"2024-09-10T22:42:18.354205+0000","last_became_active":"2024-09-10T22:42:17.366122+0000","last_became_peered":"2024-09-10T22:42:17.366122+0000","last_unstale":"2024-09-10T22:42:18.354205+0000","last_undegraded":"2024-09-10T22:42:18.354205+0000","last_fullsized":"2024-09-10T22:42:18.354205+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:32.802829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"67'3","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.381559+0000","last_change":"2024-09-10T22:42:16.361143+0000","last_active":"2024-09-10T22:42:17.381559+0000","last_peered":"2024-09-10T22:42:17.381559+0000","last_clean":"2024-09-10T22:42:17.381559+0000","last_became_active":"2024-09-10T22:42:16.358165+0000","last_became_peered":"2024-09-10T22:42:16.358165+0000","last_unstale":"2024-09-10T22:42:17.381559+0000","last_undegraded":"2024-09-10T22:42:17.381559+0000","last_fullsized":"2024-09-10T22:42:17.381559+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:25.893206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.357287+0000","last_change":"2024-09-10T22:42:17.346047+0000","last_active":"2024-09-10T22:42:17.357287+0000","last_peered":"2024-09-10T22:42:17.357287+0000","last_clean":"2024-09-10T22:42:17.357287+0000","last_became_active":"2024-09-10T22:42:17.345777+0000","last_became_peered":"2024-09-10T22:42:17.345777+0000","last_unstale":"2024-09-10T22:42:17.357287+0000","last_undegraded":"2024-09-10T22:42:17.357287+0000","last_fullsized":"2024-09-10T22:42:17.357287+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:47.680042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"67'6","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:19.530003+0000","last_change":"2024-09-10T22:42:16.356936+0000","last_active":"2024-09-10T22:42:19.530003+0000","last_peered":"2024-09-10T22:42:19.530003+0000","last_clean":"2024-09-10T22:42:19.530003+0000","last_became_active":"2024-09-10T22:42:16.356342+0000","last_became_peered":"2024-09-10T22:42:16.356342+0000","last_unstale":"2024-09-10T22:42:19.530003+0000","last_undegraded":"2024-09-10T22:42:19.530003+0000","last_fullsized":"2024-09-10T22:42:19.530003+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:31.375490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.359104+0000","last_change":"2024-09-10T22:42:17.350514+0000","last_active":"2024-09-10T22:42:17.359104+0000","last_peered":"2024-09-10T22:42:17.359104+0000","last_clean":"2024-09-10T22:42:17.359104+0000","last_became_active":"2024-09-10T22:42:17.348425+0000","last_became_peered":"2024-09-10T22:42:17.348425+0000","last_unstale":"2024-09-10T22:42:17.359104+0000","last_undegraded":"2024-09-10T22:42:17.359104+0000","last_fullsized":"2024-09-10T22:42:17.359104+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:54.370874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"67'2","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.370854+0000","last_change":"2024-09-10T22:42:16.364567+0000","last_active":"2024-09-10T22:42:17.370854+0000","last_peered":"2024-09-10T22:42:17.370854+0000","last_clean":"2024-09-10T22:42:17.370854+0000","last_became_active":"2024-09-10T22:42:16.364191+0000","last_became_peered":"2024-09-10T22:42:16.364191+0000","last_unstale":"2024-09-10T22:42:17.370854+0000","last_undegraded":"2024-09-10T22:42:17.370854+0000","last_fullsized":"2024-09-10T22:42:17.370854+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:22.205488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.367745+0000","last_change":"2024-09-10T22:42:17.360769+0000","last_active":"2024-09-10T22:42:17.367745+0000","last_peered":"2024-09-10T22:42:17.367745+0000","last_clean":"2024-09-10T22:42:17.367745+0000","last_became_active":"2024-09-10T22:42:17.360418+0000","last_became_peered":"2024-09-10T22:42:17.360418+0000","last_unstale":"2024-09-10T22:42:17.367745+0000","last_undegraded":"2024-09-10T22:42:17.367745+0000","last_fullsized":"2024-09-10T22:42:17.367745+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:28.351645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.340434+0000","last_change":"2024-09-10T22:42:16.355687+0000","last_active":"2024-09-10T22:42:17.340434+0000","last_peered":"2024-09-10T22:42:17.340434+0000","last_clean":"2024-09-10T22:42:17.340434+0000","last_became_active":"2024-09-10T22:42:16.355065+0000","last_became_peered":"2024-09-10T22:42:16.355065+0000","last_unstale":"2024-09-10T22:42:17.340434+0000","last_undegraded":"2024-09-10T22:42:17.340434+0000","last_fullsized":"2024-09-10T22:42:17.340434+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:07.230826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353886+0000","last_change":"2024-09-10T22:42:17.363922+0000","last_active":"2024-09-10T22:42:18.353886+0000","last_peered":"2024-09-10T22:42:18.353886+0000","last_clean":"2024-09-10T22:42:18.353886+0000","last_became_active":"2024-09-10T22:42:17.363010+0000","last_became_peered":"2024-09-10T22:42:17.363010+0000","last_unstale":"2024-09-10T22:42:18.353886+0000","last_undegraded":"2024-09-10T22:42:18.353886+0000","last_fullsized":"2024-09-10T22:42:18.353886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:47.881345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.344329+0000","last_change":"2024-09-10T22:42:16.356965+0000","last_active":"2024-09-10T22:42:17.344329+0000","last_peered":"2024-09-10T22:42:17.344329+0000","last_clean":"2024-09-10T22:42:17.344329+0000","last_became_active":"2024-09-10T22:42:16.356658+0000","last_became_peered":"2024-09-10T22:42:16.356658+0000","last_unstale":"2024-09-10T22:42:17.344329+0000","last_undegraded":"2024-09-10T22:42:17.344329+0000","last_fullsized":"2024-09-10T22:42:17.344329+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:46.878199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:19.529817+0000","last_change":"2024-09-10T22:42:17.374171+0000","last_active":"2024-09-10T22:42:19.529817+0000","last_peered":"2024-09-10T22:42:19.529817+0000","last_clean":"2024-09-10T22:42:19.529817+0000","last_became_active":"2024-09-10T22:42:17.369010+0000","last_became_peered":"2024-09-10T22:42:17.369010+0000","last_unstale":"2024-09-10T22:42:19.529817+0000","last_undegraded":"2024-09-10T22:42:19.529817+0000","last_fullsized":"2024-09-10T22:42:19.529817+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:14.172057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"67'8","reported_seq":21,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.374106+0000","last_change":"2024-09-10T22:42:16.354864+0000","last_active":"2024-09-10T22:42:17.374106+0000","last_peered":"2024-09-10T22:42:17.374106+0000","last_clean":"2024-09-10T22:42:17.374106+0000","last_became_active":"2024-09-10T22:42:16.351829+0000","last_became_peered":"2024-09-10T22:42:16.351829+0000","last_unstale":"2024-09-10T22:42:17.374106+0000","last_undegraded":"2024-09-10T22:42:17.374106+0000","last_fullsized":"2024-09-10T22:42:17.374106+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:08.649400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.373646+0000","last_change":"2024-09-10T22:42:17.365824+0000","last_active":"2024-09-10T22:42:17.373646+0000","last_peered":"2024-09-10T22:42:17.373646+0000","last_clean":"2024-09-10T22:42:17.373646+0000","last_became_active":"2024-09-10T22:42:17.365546+0000","last_became_peered":"2024-09-10T22:42:17.365546+0000","last_unstale":"2024-09-10T22:42:17.373646+0000","last_undegraded":"2024-09-10T22:42:17.373646+0000","last_fullsized":"2024-09-10T22:42:17.373646+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:34.568273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"67'1","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.369530+0000","last_change":"2024-09-10T22:42:16.355313+0000","last_active":"2024-09-10T22:42:17.369530+0000","last_peered":"2024-09-10T22:42:17.369530+0000","last_clean":"2024-09-10T22:42:17.369530+0000","last_became_active":"2024-09-10T22:42:16.354941+0000","last_became_peered":"2024-09-10T22:42:16.354941+0000","last_unstale":"2024-09-10T22:42:17.369530+0000","last_undegraded":"2024-09-10T22:42:17.369530+0000","last_fullsized":"2024-09-10T22:42:17.369530+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:55.669397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354382+0000","last_change":"2024-09-10T22:42:17.359831+0000","last_active":"2024-09-10T22:42:18.354382+0000","last_peered":"2024-09-10T22:42:18.354382+0000","last_clean":"2024-09-10T22:42:18.354382+0000","last_became_active":"2024-09-10T22:42:17.359447+0000","last_became_peered":"2024-09-10T22:42:17.359447+0000","last_unstale":"2024-09-10T22:42:18.354382+0000","last_undegraded":"2024-09-10T22:42:18.354382+0000","last_fullsized":"2024-09-10T22:42:18.354382+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:10.850604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"67'2","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.369852+0000","last_change":"2024-09-10T22:42:16.358646+0000","last_active":"2024-09-10T22:42:17.369852+0000","last_peered":"2024-09-10T22:42:17.369852+0000","last_clean":"2024-09-10T22:42:17.369852+0000","last_became_active":"2024-09-10T22:42:16.358355+0000","last_became_peered":"2024-09-10T22:42:16.358355+0000","last_unstale":"2024-09-10T22:42:17.369852+0000","last_undegraded":"2024-09-10T22:42:17.369852+0000","last_fullsized":"2024-09-10T22:42:17.369852+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:55.288608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.361806+0000","last_change":"2024-09-10T22:42:17.356267+0000","last_active":"2024-09-10T22:42:17.361806+0000","last_peered":"2024-09-10T22:42:17.361806+0000","last_clean":"2024-09-10T22:42:17.361806+0000","last_became_active":"2024-09-10T22:42:17.356002+0000","last_became_peered":"2024-09-10T22:42:17.356002+0000","last_unstale":"2024-09-10T22:42:17.361806+0000","last_undegraded":"2024-09-10T22:42:17.361806+0000","last_fullsized":"2024-09-10T22:42:17.361806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:17:17.778412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"67'1","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.381566+0000","last_change":"2024-09-10T22:42:16.361487+0000","last_active":"2024-09-10T22:42:17.381566+0000","last_peered":"2024-09-10T22:42:17.381566+0000","last_clean":"2024-09-10T22:42:17.381566+0000","last_became_active":"2024-09-10T22:42:16.360359+0000","last_became_peered":"2024-09-10T22:42:16.360359+0000","last_unstale":"2024-09-10T22:42:17.381566+0000","last_undegraded":"2024-09-10T22:42:17.381566+0000","last_fullsized":"2024-09-10T22:42:17.381566+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:36.207615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354218+0000","last_change":"2024-09-10T22:42:17.356211+0000","last_active":"2024-09-10T22:42:18.354218+0000","last_peered":"2024-09-10T22:42:18.354218+0000","last_clean":"2024-09-10T22:42:18.354218+0000","last_became_active":"2024-09-10T22:42:17.355685+0000","last_became_peered":"2024-09-10T22:42:17.355685+0000","last_unstale":"2024-09-10T22:42:18.354218+0000","last_undegraded":"2024-09-10T22:42:18.354218+0000","last_fullsized":"2024-09-10T22:42:18.354218+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:18.379271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354159+0000","last_change":"2024-09-10T22:42:16.356419+0000","last_active":"2024-09-10T22:42:18.354159+0000","last_peered":"2024-09-10T22:42:18.354159+0000","last_clean":"2024-09-10T22:42:18.354159+0000","last_became_active":"2024-09-10T22:42:16.356158+0000","last_became_peered":"2024-09-10T22:42:16.356158+0000","last_unstale":"2024-09-10T22:42:18.354159+0000","last_undegraded":"2024-09-10T22:42:18.354159+0000","last_fullsized":"2024-09-10T22:42:18.354159+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:50:15.238051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369124+0000","last_change":"2024-09-10T22:42:17.353644+0000","last_active":"2024-09-10T22:42:18.369124+0000","last_peered":"2024-09-10T22:42:18.369124+0000","last_clean":"2024-09-10T22:42:18.369124+0000","last_became_active":"2024-09-10T22:42:17.351025+0000","last_became_peered":"2024-09-10T22:42:17.351025+0000","last_unstale":"2024-09-10T22:42:18.369124+0000","last_undegraded":"2024-09-10T22:42:18.369124+0000","last_fullsized":"2024-09-10T22:42:18.369124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:33.928181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"67'2","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369233+0000","last_change":"2024-09-10T22:42:16.363748+0000","last_active":"2024-09-10T22:42:18.369233+0000","last_peered":"2024-09-10T22:42:18.369233+0000","last_clean":"2024-09-10T22:42:18.369233+0000","last_became_active":"2024-09-10T22:42:16.363454+0000","last_became_peered":"2024-09-10T22:42:16.363454+0000","last_unstale":"2024-09-10T22:42:18.369233+0000","last_undegraded":"2024-09-10T22:42:18.369233+0000","last_fullsized":"2024-09-10T22:42:18.369233+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:34.777287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.367513+0000","last_change":"2024-09-10T22:42:17.354860+0000","last_active":"2024-09-10T22:42:17.367513+0000","last_peered":"2024-09-10T22:42:17.367513+0000","last_clean":"2024-09-10T22:42:17.367513+0000","last_became_active":"2024-09-10T22:42:17.353974+0000","last_became_peered":"2024-09-10T22:42:17.353974+0000","last_unstale":"2024-09-10T22:42:17.367513+0000","last_undegraded":"2024-09-10T22:42:17.367513+0000","last_fullsized":"2024-09-10T22:42:17.367513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:31.860952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.340660+0000","last_change":"2024-09-10T22:42:16.356017+0000","last_active":"2024-09-10T22:42:17.340660+0000","last_peered":"2024-09-10T22:42:17.340660+0000","last_clean":"2024-09-10T22:42:17.340660+0000","last_became_active":"2024-09-10T22:42:16.355613+0000","last_became_peered":"2024-09-10T22:42:16.355613+0000","last_unstale":"2024-09-10T22:42:17.340660+0000","last_undegraded":"2024-09-10T22:42:17.340660+0000","last_fullsized":"2024-09-10T22:42:17.340660+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:48.565796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353913+0000","last_change":"2024-09-10T22:42:17.365175+0000","last_active":"2024-09-10T22:42:18.353913+0000","last_peered":"2024-09-10T22:42:18.353913+0000","last_clean":"2024-09-10T22:42:18.353913+0000","last_became_active":"2024-09-10T22:42:17.364816+0000","last_became_peered":"2024-09-10T22:42:17.364816+0000","last_unstale":"2024-09-10T22:42:18.353913+0000","last_undegraded":"2024-09-10T22:42:18.353913+0000","last_fullsized":"2024-09-10T22:42:18.353913+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:46.389220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.368988+0000","last_change":"2024-09-10T22:42:16.348719+0000","last_active":"2024-09-10T22:42:18.368988+0000","last_peered":"2024-09-10T22:42:18.368988+0000","last_clean":"2024-09-10T22:42:18.368988+0000","last_became_active":"2024-09-10T22:42:16.348337+0000","last_became_peered":"2024-09-10T22:42:16.348337+0000","last_unstale":"2024-09-10T22:42:18.368988+0000","last_undegraded":"2024-09-10T22:42:18.368988+0000","last_fullsized":"2024-09-10T22:42:18.368988+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:04:52.488193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369488+0000","last_change":"2024-09-10T22:42:17.352866+0000","last_active":"2024-09-10T22:42:18.369488+0000","last_peered":"2024-09-10T22:42:18.369488+0000","last_clean":"2024-09-10T22:42:18.369488+0000","last_became_active":"2024-09-10T22:42:17.351362+0000","last_became_peered":"2024-09-10T22:42:17.351362+0000","last_unstale":"2024-09-10T22:42:18.369488+0000","last_undegraded":"2024-09-10T22:42:18.369488+0000","last_fullsized":"2024-09-10T22:42:18.369488+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:40.112325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"67'2","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.374613+0000","last_change":"2024-09-10T22:42:16.355408+0000","last_active":"2024-09-10T22:42:17.374613+0000","last_peered":"2024-09-10T22:42:17.374613+0000","last_clean":"2024-09-10T22:42:17.374613+0000","last_became_active":"2024-09-10T22:42:16.355111+0000","last_became_peered":"2024-09-10T22:42:16.355111+0000","last_unstale":"2024-09-10T22:42:17.374613+0000","last_undegraded":"2024-09-10T22:42:17.374613+0000","last_fullsized":"2024-09-10T22:42:17.374613+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:16.743017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354964+0000","last_change":"2024-09-10T22:42:17.359482+0000","last_active":"2024-09-10T22:42:18.354964+0000","last_peered":"2024-09-10T22:42:18.354964+0000","last_clean":"2024-09-10T22:42:18.354964+0000","last_became_active":"2024-09-10T22:42:17.359251+0000","last_became_peered":"2024-09-10T22:42:17.359251+0000","last_unstale":"2024-09-10T22:42:18.354964+0000","last_undegraded":"2024-09-10T22:42:18.354964+0000","last_fullsized":"2024-09-10T22:42:18.354964+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:44.419352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.343067+0000","last_change":"2024-09-10T22:42:16.354043+0000","last_active":"2024-09-10T22:42:17.343067+0000","last_peered":"2024-09-10T22:42:17.343067+0000","last_clean":"2024-09-10T22:42:17.343067+0000","last_became_active":"2024-09-10T22:42:16.353224+0000","last_became_peered":"2024-09-10T22:42:16.353224+0000","last_unstale":"2024-09-10T22:42:17.343067+0000","last_undegraded":"2024-09-10T22:42:17.343067+0000","last_fullsized":"2024-09-10T22:42:17.343067+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:17.376125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.367853+0000","last_change":"2024-09-10T22:42:17.361482+0000","last_active":"2024-09-10T22:42:17.367853+0000","last_peered":"2024-09-10T22:42:17.367853+0000","last_clean":"2024-09-10T22:42:17.367853+0000","last_became_active":"2024-09-10T22:42:17.360841+0000","last_became_peered":"2024-09-10T22:42:17.360841+0000","last_unstale":"2024-09-10T22:42:17.367853+0000","last_undegraded":"2024-09-10T22:42:17.367853+0000","last_fullsized":"2024-09-10T22:42:17.367853+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:15.398042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.369368+0000","last_change":"2024-09-10T22:42:16.351669+0000","last_active":"2024-09-10T22:42:18.369368+0000","last_peered":"2024-09-10T22:42:18.369368+0000","last_clean":"2024-09-10T22:42:18.369368+0000","last_became_active":"2024-09-10T22:42:16.351170+0000","last_became_peered":"2024-09-10T22:42:16.351170+0000","last_unstale":"2024-09-10T22:42:18.369368+0000","last_undegraded":"2024-09-10T22:42:18.369368+0000","last_fullsized":"2024-09-10T22:42:18.369368+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:43:07.517617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354416+0000","last_change":"2024-09-10T22:42:17.355951+0000","last_active":"2024-09-10T22:42:18.354416+0000","last_peered":"2024-09-10T22:42:18.354416+0000","last_clean":"2024-09-10T22:42:18.354416+0000","last_became_active":"2024-09-10T22:42:17.355424+0000","last_became_peered":"2024-09-10T22:42:17.355424+0000","last_unstale":"2024-09-10T22:42:18.354416+0000","last_undegraded":"2024-09-10T22:42:18.354416+0000","last_fullsized":"2024-09-10T22:42:18.354416+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:25.221862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:19.530007+0000","last_change":"2024-09-10T22:42:16.356624+0000","last_active":"2024-09-10T22:42:19.530007+0000","last_peered":"2024-09-10T22:42:19.530007+0000","last_clean":"2024-09-10T22:42:19.530007+0000","last_became_active":"2024-09-10T22:42:16.355994+0000","last_became_peered":"2024-09-10T22:42:16.355994+0000","last_unstale":"2024-09-10T22:42:19.530007+0000","last_undegraded":"2024-09-10T22:42:19.530007+0000","last_fullsized":"2024-09-10T22:42:19.530007+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:11.220738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353567+0000","last_change":"2024-09-10T22:42:17.362743+0000","last_active":"2024-09-10T22:42:18.353567+0000","last_peered":"2024-09-10T22:42:18.353567+0000","last_clean":"2024-09-10T22:42:18.353567+0000","last_became_active":"2024-09-10T22:42:17.362451+0000","last_became_peered":"2024-09-10T22:42:17.362451+0000","last_unstale":"2024-09-10T22:42:18.353567+0000","last_undegraded":"2024-09-10T22:42:18.353567+0000","last_fullsized":"2024-09-10T22:42:18.353567+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:58.419409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.347338+0000","last_change":"2024-09-10T22:42:16.360801+0000","last_active":"2024-09-10T22:42:17.347338+0000","last_peered":"2024-09-10T22:42:17.347338+0000","last_clean":"2024-09-10T22:42:17.347338+0000","last_became_active":"2024-09-10T22:42:16.360511+0000","last_became_peered":"2024-09-10T22:42:16.360511+0000","last_unstale":"2024-09-10T22:42:17.347338+0000","last_undegraded":"2024-09-10T22:42:17.347338+0000","last_fullsized":"2024-09-10T22:42:17.347338+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:31.799683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.357425+0000","last_change":"2024-09-10T22:42:17.346780+0000","last_active":"2024-09-10T22:42:17.357425+0000","last_peered":"2024-09-10T22:42:17.357425+0000","last_clean":"2024-09-10T22:42:17.357425+0000","last_became_active":"2024-09-10T22:42:17.346500+0000","last_became_peered":"2024-09-10T22:42:17.346500+0000","last_unstale":"2024-09-10T22:42:17.357425+0000","last_undegraded":"2024-09-10T22:42:17.357425+0000","last_fullsized":"2024-09-10T22:42:17.357425+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:11.493736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354315+0000","last_change":"2024-09-10T22:42:16.351463+0000","last_active":"2024-09-10T22:42:18.354315+0000","last_peered":"2024-09-10T22:42:18.354315+0000","last_clean":"2024-09-10T22:42:18.354315+0000","last_became_active":"2024-09-10T22:42:16.351129+0000","last_became_peered":"2024-09-10T22:42:16.351129+0000","last_unstale":"2024-09-10T22:42:18.354315+0000","last_undegraded":"2024-09-10T22:42:18.354315+0000","last_fullsized":"2024-09-10T22:42:18.354315+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:45.784521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:19.529724+0000","last_change":"2024-09-10T22:42:17.363603+0000","last_active":"2024-09-10T22:42:19.529724+0000","last_peered":"2024-09-10T22:42:19.529724+0000","last_clean":"2024-09-10T22:42:19.529724+0000","last_became_active":"2024-09-10T22:42:17.363326+0000","last_became_peered":"2024-09-10T22:42:17.363326+0000","last_unstale":"2024-09-10T22:42:19.529724+0000","last_undegraded":"2024-09-10T22:42:19.529724+0000","last_fullsized":"2024-09-10T22:42:19.529724+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:06.377003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353874+0000","last_change":"2024-09-10T22:42:16.363423+0000","last_active":"2024-09-10T22:42:18.353874+0000","last_peered":"2024-09-10T22:42:18.353874+0000","last_clean":"2024-09-10T22:42:18.353874+0000","last_became_active":"2024-09-10T22:42:16.363148+0000","last_became_peered":"2024-09-10T22:42:16.363148+0000","last_unstale":"2024-09-10T22:42:18.353874+0000","last_undegraded":"2024-09-10T22:42:18.353874+0000","last_fullsized":"2024-09-10T22:42:18.353874+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:23.977357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354742+0000","last_change":"2024-09-10T22:42:17.361850+0000","last_active":"2024-09-10T22:42:18.354742+0000","last_peered":"2024-09-10T22:42:18.354742+0000","last_clean":"2024-09-10T22:42:18.354742+0000","last_became_active":"2024-09-10T22:42:17.361571+0000","last_became_peered":"2024-09-10T22:42:17.361571+0000","last_unstale":"2024-09-10T22:42:18.354742+0000","last_undegraded":"2024-09-10T22:42:18.354742+0000","last_fullsized":"2024-09-10T22:42:18.354742+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:59.816275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:19.529509+0000","last_change":"2024-09-10T22:42:16.364011+0000","last_active":"2024-09-10T22:42:19.529509+0000","last_peered":"2024-09-10T22:42:19.529509+0000","last_clean":"2024-09-10T22:42:19.529509+0000","last_became_active":"2024-09-10T22:42:16.363738+0000","last_became_peered":"2024-09-10T22:42:16.363738+0000","last_unstale":"2024-09-10T22:42:19.529509+0000","last_undegraded":"2024-09-10T22:42:19.529509+0000","last_fullsized":"2024-09-10T22:42:19.529509+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:46.821408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.354319+0000","last_change":"2024-09-10T22:42:17.373377+0000","last_active":"2024-09-10T22:42:18.354319+0000","last_peered":"2024-09-10T22:42:18.354319+0000","last_clean":"2024-09-10T22:42:18.354319+0000","last_became_active":"2024-09-10T22:42:17.373033+0000","last_became_peered":"2024-09-10T22:42:17.373033+0000","last_unstale":"2024-09-10T22:42:18.354319+0000","last_undegraded":"2024-09-10T22:42:18.354319+0000","last_fullsized":"2024-09-10T22:42:18.354319+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:16.323099+0000","last_clean_scrub_stamp":"2024-09-10T22:42:16.323099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:44.074899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-10T22:42:18.353600+0000","last_change":"2024-09-10T22:42:16.355349+0000","last_active":"2024-09-10T22:42:18.353600+0000","last_peered":"2024-09-10T22:42:18.353600+0000","last_clean":"2024-09-10T22:42:18.353600+0000","last_became_active":"2024-09-10T22:42:16.355015+0000","last_became_peered":"2024-09-10T22:42:16.355015+0000","last_unstale":"2024-09-10T22:42:18.353600+0000","last_undegraded":"2024-09-10T22:42:18.353600+0000","last_fullsized":"2024-09-10T22:42:18.353600+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:42:15.319953+0000","last_clean_scrub_stamp":"2024-09-10T22:42:15.319953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:00.402852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":194,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T22:42:17.345893+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:42:17.345893+0000","last_peered":"2024-09-10T22:42:17.345893+0000","last_clean":"2024-09-10T22:42:17.345893+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:42:17.345893+0000","last_undegraded":"2024-09-10T22:42:17.345893+0000","last_fullsized":"2024-09-10T22:42:17.345893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1413120,"data_stored":953820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":369402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":362698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":815104,"data_stored":364288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":802816,"data_stored":362676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":369368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509487,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28408,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343432,"statfs":{"total":96636764160,"available":96607674368,"internally_reserved":0,"allocated":1409024,"data_stored":959736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":843776,"data_stored":371744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:42:21.862 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T22:42:21.862 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T22:42:22.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.043+0000 7f6efb200640 1 -- 172.21.15.103:0/1486753691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef40b0ba0 msgr2=0x7f6ef40ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:22.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.043+0000 7f6efb200640 1 --2- 172.21.15.103:0/1486753691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef40b0ba0 0x7f6ef40ce950 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009bc0 tx=0x7f6eec01cb10 comp rx=0 tx=0).stop 2024-09-10T22:42:22.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.043+0000 7f6efb200640 1 -- 172.21.15.103:0/1486753691 shutdown_connections 2024-09-10T22:42:22.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.043+0000 7f6efb200640 1 --2- 172.21.15.103:0/1486753691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef40b0ba0 0x7f6ef40ce950 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:22.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.043+0000 7f6efb200640 1 --2- 172.21.15.103:0/1486753691 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ef415f010 0x7f6ef40d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:22.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.043+0000 7f6efb200640 1 -- 172.21.15.103:0/1486753691 >> 172.21.15.103:0/1486753691 conn(0x7f6ef40d1b40 msgr2=0x7f6ef40d1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:22.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.043+0000 7f6efb200640 1 -- 172.21.15.103:0/1486753691 shutdown_connections 2024-09-10T22:42:22.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.043+0000 7f6efb200640 1 -- 172.21.15.103:0/1486753691 wait complete. 2024-09-10T22:42:22.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6efb200640 1 Processor -- start 2024-09-10T22:42:22.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6efb200640 1 -- start start 2024-09-10T22:42:22.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6efb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef40b0ba0 0x7f6ef4155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:22.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6efb200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef415f010 0x7f6ef4147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:22.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6efb200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ef415f3f0 0x7f6ef415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:22.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6efb200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef4168a10 con 0x7f6ef40b0ba0 2024-09-10T22:42:22.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6efb200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef4168890 con 0x7f6ef415f010 2024-09-10T22:42:22.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6efb200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef4168b90 con 0x7f6ef415f3f0 2024-09-10T22:42:22.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6ef3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef40b0ba0 0x7f6ef4155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:22.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6ef3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef40b0ba0 0x7f6ef4155ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57396/0 (socket says 172.21.15.103:57396) 2024-09-10T22:42:22.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6ef3e00640 1 -- 172.21.15.103:0/2580199958 learned_addr learned my addr 172.21.15.103:0/2580199958 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:22.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6ef9200640 1 --2- 172.21.15.103:0/2580199958 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ef415f3f0 0x7f6ef415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6eeb400640 1 --2- 172.21.15.103:0/2580199958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef415f010 0x7f6ef4147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6ef3e00640 1 -- 172.21.15.103:0/2580199958 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ef415f3f0 msgr2=0x7f6ef415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6ef3e00640 1 --2- 172.21.15.103:0/2580199958 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ef415f3f0 0x7f6ef415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6ef3e00640 1 -- 172.21.15.103:0/2580199958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef415f010 msgr2=0x7f6ef4147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6ef3e00640 1 --2- 172.21.15.103:0/2580199958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef415f010 0x7f6ef4147f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6ef3e00640 1 -- 172.21.15.103:0/2580199958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef4166580 con 0x7f6ef40b0ba0 2024-09-10T22:42:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6ef9200640 1 --2- 172.21.15.103:0/2580199958 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ef415f3f0 0x7f6ef415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6eeb400640 1 --2- 172.21.15.103:0/2580199958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef415f010 0x7f6ef4147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6ef3e00640 1 --2- 172.21.15.103:0/2580199958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef40b0ba0 0x7f6ef4155ec0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400e9d0 tx=0x7f6ee400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6ef0c00640 1 -- 172.21.15.103:0/2580199958 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee400cde0 con 0x7f6ef40b0ba0 2024-09-10T22:42:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6ef0c00640 1 -- 172.21.15.103:0/2580199958 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ee4004020 con 0x7f6ef40b0ba0 2024-09-10T22:42:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6ef0c00640 1 -- 172.21.15.103:0/2580199958 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4004450 con 0x7f6ef40b0ba0 2024-09-10T22:42:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6efb200640 1 -- 172.21.15.103:0/2580199958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef4156400 con 0x7f6ef40b0ba0 2024-09-10T22:42:22.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.047+0000 7f6efb200640 1 -- 172.21.15.103:0/2580199958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef4155100 con 0x7f6ef40b0ba0 2024-09-10T22:42:22.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.051+0000 7f6efb200640 1 -- 172.21.15.103:0/2580199958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef4155b00 con 0x7f6ef40b0ba0 2024-09-10T22:42:22.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.051+0000 7f6ef0c00640 1 -- 172.21.15.103:0/2580199958 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6ee4003600 con 0x7f6ef40b0ba0 2024-09-10T22:42:22.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.051+0000 7f6ef0c00640 1 --2- 172.21.15.103:0/2580199958 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6ed00725e0 0x7f6ed0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:22.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.051+0000 7f6ef0c00640 1 -- 172.21.15.103:0/2580199958 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f6ee4093e00 con 0x7f6ef40b0ba0 2024-09-10T22:42:22.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.051+0000 7f6eeb400640 1 --2- 172.21.15.103:0/2580199958 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6ed00725e0 0x7f6ed0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:22.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.055+0000 7f6eeb400640 1 --2- 172.21.15.103:0/2580199958 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6ed00725e0 0x7f6ed0074aa0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6ef41fa5b0 tx=0x7f6edc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:22.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.055+0000 7f6ef0c00640 1 -- 172.21.15.103:0/2580199958 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6ef4166580 con 0x7f6ef40b0ba0 2024-09-10T22:42:22.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.279+0000 7f6efb200640 1 -- 172.21.15.103:0/2580199958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f6ef40d04e0 con 0x7f6ef40b0ba0 2024-09-10T22:42:22.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.283+0000 7f6ef0c00640 1 -- 172.21.15.103:0/2580199958 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f6ee405f3e0 con 0x7f6ef40b0ba0 2024-09-10T22:42:22.285 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-09-10T22:42:22.285 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA8yuBmtOhZNBAAeszxWpV60NIn/zOInT5Zzw== 2024-09-10T22:42:22.285 INFO:teuthology.orchestra.run.smithi103.stdout: caps mds = "allow" 2024-09-10T22:42:22.285 INFO:teuthology.orchestra.run.smithi103.stdout: caps mon = "allow r" 2024-09-10T22:42:22.285 INFO:teuthology.orchestra.run.smithi103.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T22:42:22.285 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2024-09-10T22:42:22.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.283+0000 7f6efb200640 1 -- 172.21.15.103:0/2580199958 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6ed00725e0 msgr2=0x7f6ed0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:22.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.283+0000 7f6efb200640 1 --2- 172.21.15.103:0/2580199958 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6ed00725e0 0x7f6ed0074aa0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6ef41fa5b0 tx=0x7f6edc009040 comp rx=0 tx=0).stop 2024-09-10T22:42:22.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.283+0000 7f6efb200640 1 -- 172.21.15.103:0/2580199958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef40b0ba0 msgr2=0x7f6ef4155ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:22.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.283+0000 7f6efb200640 1 --2- 172.21.15.103:0/2580199958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef40b0ba0 0x7f6ef4155ec0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400e9d0 tx=0x7f6ee400ee90 comp rx=0 tx=0).stop 2024-09-10T22:42:22.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.283+0000 7f6efb200640 1 -- 172.21.15.103:0/2580199958 shutdown_connections 2024-09-10T22:42:22.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.283+0000 7f6efb200640 1 --2- 172.21.15.103:0/2580199958 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6ed00725e0 0x7f6ed0074aa0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:22.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.283+0000 7f6efb200640 1 --2- 172.21.15.103:0/2580199958 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ef415f3f0 0x7f6ef415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:22.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.283+0000 7f6efb200640 1 --2- 172.21.15.103:0/2580199958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef415f010 0x7f6ef4147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:22.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.283+0000 7f6efb200640 1 --2- 172.21.15.103:0/2580199958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef40b0ba0 0x7f6ef4155ec0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:22.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.283+0000 7f6efb200640 1 -- 172.21.15.103:0/2580199958 >> 172.21.15.103:0/2580199958 conn(0x7f6ef40d1b40 msgr2=0x7f6ef40b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:22.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.283+0000 7f6efb200640 1 -- 172.21.15.103:0/2580199958 shutdown_connections 2024-09-10T22:42:22.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.283+0000 7f6efb200640 1 -- 172.21.15.103:0/2580199958 wait complete. 2024-09-10T22:42:22.307 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:42:22.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.447+0000 7f78d2a00640 1 -- 172.21.15.103:0/3988127598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78b0003c40 msgr2=0x7f78b0004040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:22.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.447+0000 7f78d2a00640 1 --2- 172.21.15.103:0/3988127598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78b0003c40 0x7f78b0004040 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f78bc001860 tx=0x7f78bc01c880 comp rx=0 tx=0).stop 2024-09-10T22:42:22.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.447+0000 7f78d2a00640 1 -- 172.21.15.103:0/3988127598 shutdown_connections 2024-09-10T22:42:22.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.447+0000 7f78d2a00640 1 --2- 172.21.15.103:0/3988127598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78b0003c40 0x7f78b0004040 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:22.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.447+0000 7f78d2a00640 1 -- 172.21.15.103:0/3988127598 >> 172.21.15.103:0/3988127598 conn(0x7f78cc06cc00 msgr2=0x7f78cc06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:22.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.447+0000 7f78d2a00640 1 -- 172.21.15.103:0/3988127598 shutdown_connections 2024-09-10T22:42:22.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.447+0000 7f78d2a00640 1 -- 172.21.15.103:0/3988127598 wait complete. 2024-09-10T22:42:22.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78d2a00640 1 Processor -- start 2024-09-10T22:42:22.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78d2a00640 1 -- start start 2024-09-10T22:42:22.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78d2a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b0003c40 0x7f78cc140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:22.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78d2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78cc1688b0 0x7f78cc1599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:22.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78d2a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78cc0b1e10 0x7f78cc0ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:22.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78d2a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc157530 con 0x7f78cc1688b0 2024-09-10T22:42:22.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78d2a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc1573b0 con 0x7f78b0003c40 2024-09-10T22:42:22.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78d2a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f78cc1576b0 con 0x7f78cc0b1e10 2024-09-10T22:42:22.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78cb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78cc1688b0 0x7f78cc1599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:22.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78cbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b0003c40 0x7f78cc140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:22.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78cb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78cc1688b0 0x7f78cc1599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57418/0 (socket says 172.21.15.103:57418) 2024-09-10T22:42:22.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78cb400640 1 -- 172.21.15.103:0/805044346 learned_addr learned my addr 172.21.15.103:0/805044346 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:22.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78d0a00640 1 --2- 172.21.15.103:0/805044346 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78cc0b1e10 0x7f78cc0ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:22.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78cb400640 1 -- 172.21.15.103:0/805044346 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78cc0b1e10 msgr2=0x7f78cc0ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:22.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78cb400640 1 --2- 172.21.15.103:0/805044346 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78cc0b1e10 0x7f78cc0ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:22.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78cb400640 1 -- 172.21.15.103:0/805044346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b0003c40 msgr2=0x7f78cc140920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:22.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78cb400640 1 --2- 172.21.15.103:0/805044346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b0003c40 0x7f78cc140920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:22.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78cb400640 1 -- 172.21.15.103:0/805044346 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78cc1fafc0 con 0x7f78cc1688b0 2024-09-10T22:42:22.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78cb400640 1 --2- 172.21.15.103:0/805044346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78cc1688b0 0x7f78cc1599d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f78b8011a10 tx=0x7f78b8011e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:22.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78c3e00640 1 -- 172.21.15.103:0/805044346 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8004460 con 0x7f78cc1688b0 2024-09-10T22:42:22.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78c3e00640 1 -- 172.21.15.103:0/805044346 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78b800f9a0 con 0x7f78cc1688b0 2024-09-10T22:42:22.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78c3e00640 1 -- 172.21.15.103:0/805044346 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b800fdd0 con 0x7f78cc1688b0 2024-09-10T22:42:22.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78d2a00640 1 -- 172.21.15.103:0/805044346 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78cc1fb2a0 con 0x7f78cc1688b0 2024-09-10T22:42:22.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78d2a00640 1 -- 172.21.15.103:0/805044346 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78cc1fb860 con 0x7f78cc1688b0 2024-09-10T22:42:22.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.451+0000 7f78d2a00640 1 -- 172.21.15.103:0/805044346 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78cc06d2c0 con 0x7f78cc1688b0 2024-09-10T22:42:22.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.455+0000 7f78c3e00640 1 -- 172.21.15.103:0/805044346 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f78b8018070 con 0x7f78cc1688b0 2024-09-10T22:42:22.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.455+0000 7f78c3e00640 1 --2- 172.21.15.103:0/805044346 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f78ac0725e0 0x7f78ac074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:22.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.455+0000 7f78c3e00640 1 -- 172.21.15.103:0/805044346 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f78b8093ff0 con 0x7f78cc1688b0 2024-09-10T22:42:22.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.455+0000 7f78cbe00640 1 --2- 172.21.15.103:0/805044346 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f78ac0725e0 0x7f78ac074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:22.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.455+0000 7f78cbe00640 1 --2- 172.21.15.103:0/805044346 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f78ac0725e0 0x7f78ac074aa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f78bc001830 tx=0x7f78bc0196c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:22.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.459+0000 7f78c3e00640 1 -- 172.21.15.103:0/805044346 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f78b805f590 con 0x7f78cc1688b0 2024-09-10T22:42:22.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.659+0000 7f78d2a00640 1 -- 172.21.15.103:0/805044346 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78cc1fbc40 con 0x7f78cc1688b0 2024-09-10T22:42:22.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.659+0000 7f78c3e00640 1 -- 172.21.15.103:0/805044346 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5230 (secure 0 0 0) 0x7f78b805ee90 con 0x7f78cc1688b0 2024-09-10T22:42:22.662 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:22.662 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"btime":"2024-09-10T22:42:20:358502+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2961968581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2961968581},{"type":"v1","addr":"172.21.15.131:6835","nonce":2961968581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":5630,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/360467048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":360467048},{"type":"v1","addr":"172.21.15.131:6837","nonce":360467048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/4171945106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4171945106},{"type":"v1","addr":"172.21.15.103:6833","nonce":4171945106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:42:16.725541+0000","modified":"2024-09-10T22:42:19.741456+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/714242556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":714242556},{"type":"v1","addr":"172.21.15.103:6835","nonce":714242556}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6285,"qdb_cluster":[6285]},"id":4}]} 2024-09-10T22:42:22.663 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2024-09-10T22:42:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.663+0000 7f78d2a00640 1 -- 172.21.15.103:0/805044346 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f78ac0725e0 msgr2=0x7f78ac074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.663+0000 7f78d2a00640 1 --2- 172.21.15.103:0/805044346 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f78ac0725e0 0x7f78ac074aa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f78bc001830 tx=0x7f78bc0196c0 comp rx=0 tx=0).stop 2024-09-10T22:42:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.663+0000 7f78d2a00640 1 -- 172.21.15.103:0/805044346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78cc1688b0 msgr2=0x7f78cc1599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.663+0000 7f78d2a00640 1 --2- 172.21.15.103:0/805044346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78cc1688b0 0x7f78cc1599d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f78b8011a10 tx=0x7f78b8011e10 comp rx=0 tx=0).stop 2024-09-10T22:42:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.663+0000 7f78d2a00640 1 -- 172.21.15.103:0/805044346 shutdown_connections 2024-09-10T22:42:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.663+0000 7f78d2a00640 1 --2- 172.21.15.103:0/805044346 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f78ac0725e0 0x7f78ac074aa0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.663+0000 7f78d2a00640 1 --2- 172.21.15.103:0/805044346 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78cc0b1e10 0x7f78cc0ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.663+0000 7f78d2a00640 1 --2- 172.21.15.103:0/805044346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78cc1688b0 0x7f78cc1599d0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:22.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.663+0000 7f78d2a00640 1 --2- 172.21.15.103:0/805044346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b0003c40 0x7f78cc140920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:22.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.663+0000 7f78d2a00640 1 -- 172.21.15.103:0/805044346 >> 172.21.15.103:0/805044346 conn(0x7f78cc06cc00 msgr2=0x7f78cc15f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:22.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.663+0000 7f78d2a00640 1 -- 172.21.15.103:0/805044346 shutdown_connections 2024-09-10T22:42:22.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:22.663+0000 7f78d2a00640 1 -- 172.21.15.103:0/805044346 wait complete. 2024-09-10T22:42:23.086 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:42:16.725541+0000', 'modified': '2024-09-10T22:42:19.741456+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6285': {'gid': 6285, 'name': 'a', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/714242556', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6834', 'nonce': 714242556}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 714242556}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6285, 'qdb_cluster': [6285]} 2024-09-10T22:42:23.086 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T22:42:23.086 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T22:42:23.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.227+0000 7fa199000640 1 -- 172.21.15.103:0/105578968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa178003a60 msgr2=0x7fa178003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:23.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.227+0000 7fa199000640 1 --2- 172.21.15.103:0/105578968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa178003a60 0x7fa178003e80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa18400c630 tx=0x7fa18401d260 comp rx=0 tx=0).stop 2024-09-10T22:42:23.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.227+0000 7fa199000640 1 -- 172.21.15.103:0/105578968 shutdown_connections 2024-09-10T22:42:23.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.227+0000 7fa199000640 1 --2- 172.21.15.103:0/105578968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa178003a60 0x7fa178003e80 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.227+0000 7fa199000640 1 -- 172.21.15.103:0/105578968 >> 172.21.15.103:0/105578968 conn(0x7fa1940d1ac0 msgr2=0x7fa1940d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:23.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.227+0000 7fa199000640 1 -- 172.21.15.103:0/105578968 shutdown_connections 2024-09-10T22:42:23.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.227+0000 7fa199000640 1 -- 172.21.15.103:0/105578968 wait complete. 2024-09-10T22:42:23.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.227+0000 7fa199000640 1 Processor -- start 2024-09-10T22:42:23.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.227+0000 7fa199000640 1 -- start start 2024-09-10T22:42:23.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.227+0000 7fa199000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa178003a60 0x7fa1940c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.227+0000 7fa199000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1941521f0 0x7fa1941518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.227+0000 7fa199000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1940ca040 0x7fa19415a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.227+0000 7fa199000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa1940cec60 con 0x7fa1940ca040 2024-09-10T22:42:23.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa199000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa1940ceae0 con 0x7fa178003a60 2024-09-10T22:42:23.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa199000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa1940ae9c0 con 0x7fa1941521f0 2024-09-10T22:42:23.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa192800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1940ca040 0x7fa19415a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa192800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1940ca040 0x7fa19415a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57432/0 (socket says 172.21.15.103:57432) 2024-09-10T22:42:23.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa192800640 1 -- 172.21.15.103:0/713418136 learned_addr learned my addr 172.21.15.103:0/713418136 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:23.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa191400640 1 --2- 172.21.15.103:0/713418136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1941521f0 0x7fa1941518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa191e00640 1 --2- 172.21.15.103:0/713418136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa178003a60 0x7fa1940c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa192800640 1 -- 172.21.15.103:0/713418136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1941521f0 msgr2=0x7fa1941518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:23.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa192800640 1 --2- 172.21.15.103:0/713418136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1941521f0 0x7fa1941518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa192800640 1 -- 172.21.15.103:0/713418136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa178003a60 msgr2=0x7fa1940c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:23.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa192800640 1 --2- 172.21.15.103:0/713418136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa178003a60 0x7fa1940c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa192800640 1 -- 172.21.15.103:0/713418136 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1940ca940 con 0x7fa1940ca040 2024-09-10T22:42:23.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa192800640 1 --2- 172.21.15.103:0/713418136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1940ca040 0x7fa19415a800 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa1940b3580 tx=0x7fa18c011be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:23.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa18a000640 1 -- 172.21.15.103:0/713418136 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c004440 con 0x7fa1940ca040 2024-09-10T22:42:23.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa18a000640 1 -- 172.21.15.103:0/713418136 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa18c016070 con 0x7fa1940ca040 2024-09-10T22:42:23.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa18a000640 1 -- 172.21.15.103:0/713418136 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c00faf0 con 0x7fa1940ca040 2024-09-10T22:42:23.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa199000640 1 -- 172.21.15.103:0/713418136 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1940cac20 con 0x7fa1940ca040 2024-09-10T22:42:23.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa199000640 1 -- 172.21.15.103:0/713418136 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa194151e10 con 0x7fa1940ca040 2024-09-10T22:42:23.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.231+0000 7fa18a000640 1 -- 172.21.15.103:0/713418136 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa18c023030 con 0x7fa1940ca040 2024-09-10T22:42:23.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa19c43b000 1 Processor -- start 2024-09-10T22:42:23.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa18a000640 1 --2- 172.21.15.103:0/713418136 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa174072610 0x7fa174074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa19c43b000 1 -- start start 2024-09-10T22:42:23.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa18a000640 1 -- 172.21.15.103:0/713418136 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fa18c093ad0 con 0x7fa1940ca040 2024-09-10T22:42:23.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa191400640 1 --2- 172.21.15.103:0/713418136 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa174072610 0x7fa174074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa19c43b000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4bfa9d0 0x55d1c4bfadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa19c43b000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4bfb2f0 0x55d1c4bae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa19c43b000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4baee10 0x55d1c4baf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa19c43b000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d1c4acf3f0 con 0x55d1c4bfa9d0 2024-09-10T22:42:23.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa19c43b000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d1c4a0cb20 con 0x55d1c4baee10 2024-09-10T22:42:23.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa19c43b000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55d1c49fbf50 con 0x55d1c4bfb2f0 2024-09-10T22:42:23.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa191e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4bfa9d0 0x55d1c4bfadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa191e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4bfa9d0 0x55d1c4bfadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57438/0 (socket says 172.21.15.103:57438) 2024-09-10T22:42:23.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa191e00640 1 -- 172.21.15.103:0/1675678169 learned_addr learned my addr 172.21.15.103:0/1675678169 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:23.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa191400640 1 --2- 172.21.15.103:0/713418136 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa174072610 0x7fa174074ad0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa1941f87f0 tx=0x7fa180006b50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:23.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa191400640 1 --2- 172.21.15.103:0/1675678169 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4bfb2f0 0x55d1c4bae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa192800640 1 --2- 172.21.15.103:0/1675678169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4baee10 0x55d1c4baf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa191e00640 1 -- 172.21.15.103:0/1675678169 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4bfb2f0 msgr2=0x55d1c4bae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:23.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa191e00640 1 --2- 172.21.15.103:0/1675678169 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4bfb2f0 0x55d1c4bae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa191e00640 1 -- 172.21.15.103:0/1675678169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4baee10 msgr2=0x55d1c4baf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:23.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa191e00640 1 --2- 172.21.15.103:0/1675678169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4baee10 0x55d1c4baf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa191e00640 1 -- 172.21.15.103:0/1675678169 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1c49c3590 con 0x55d1c4bfa9d0 2024-09-10T22:42:23.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa191e00640 1 --2- 172.21.15.103:0/1675678169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4bfa9d0 0x55d1c4bfadb0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa18401bb30 tx=0x7fa178005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac86b576ce090c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:23.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa17ea00640 1 -- 172.21.15.103:0/1675678169 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184001880 con 0x55d1c4bfa9d0 2024-09-10T22:42:23.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa17ea00640 1 -- 172.21.15.103:0/1675678169 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa184003980 con 0x55d1c4bfa9d0 2024-09-10T22:42:23.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa17ea00640 1 -- 172.21.15.103:0/1675678169 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184001a80 con 0x55d1c4bfa9d0 2024-09-10T22:42:23.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa19c43b000 1 -- 172.21.15.103:0/1675678169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4bfa9d0 msgr2=0x55d1c4bfadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:23.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa19c43b000 1 --2- 172.21.15.103:0/1675678169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4bfa9d0 0x55d1c4bfadb0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa18401bb30 tx=0x7fa178005840 comp rx=0 tx=0).stop 2024-09-10T22:42:23.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa19c43b000 1 -- 172.21.15.103:0/1675678169 shutdown_connections 2024-09-10T22:42:23.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa19c43b000 1 --2- 172.21.15.103:0/1675678169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4baee10 0x55d1c4baf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa19c43b000 1 --2- 172.21.15.103:0/1675678169 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4bfb2f0 0x55d1c4bae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa19c43b000 1 --2- 172.21.15.103:0/1675678169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4bfa9d0 0x55d1c4bfadb0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa19c43b000 1 -- 172.21.15.103:0/1675678169 >> 172.21.15.103:0/1675678169 conn(0x55d1c4a98130 msgr2=0x55d1c4bdde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:23.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa19c43b000 1 -- 172.21.15.103:0/1675678169 shutdown_connections 2024-09-10T22:42:23.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.235+0000 7fa19c43b000 1 -- 172.21.15.103:0/1675678169 wait complete. 2024-09-10T22:42:23.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa19c43b000 1 -- start start 2024-09-10T22:42:23.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa19c43b000 1 Processor -- start 2024-09-10T22:42:23.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa19c43b000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4baee10 0x55d1c4bb06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa19c43b000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4bfa9d0 0x55d1c4bb0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa19c43b000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4bfb2f0 0x55d1c4bb1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa19c43b000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d1c49965d0 con 0x55d1c4bfb2f0 2024-09-10T22:42:23.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa19c43b000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d1c49ffd60 con 0x55d1c4bfa9d0 2024-09-10T22:42:23.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa19c43b000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55d1c49a2500 con 0x55d1c4baee10 2024-09-10T22:42:23.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa19c43b000 10 client.0 _ll_register_callbacks cb 0x55d1c49a6810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:42:23.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa192800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4bfb2f0 0x55d1c4bb1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa192800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4bfb2f0 0x55d1c4bb1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57450/0 (socket says 172.21.15.103:57450) 2024-09-10T22:42:23.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa192800640 1 -- 172.21.15.103:0/4077005138 learned_addr learned my addr 172.21.15.103:0/4077005138 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:23.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa191e00640 1 --2- 172.21.15.103:0/4077005138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4baee10 0x55d1c4bb06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa191400640 1 --2- 172.21.15.103:0/4077005138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4bfa9d0 0x55d1c4bb0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa192800640 1 -- 172.21.15.103:0/4077005138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4baee10 msgr2=0x55d1c4bb06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:23.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa192800640 1 --2- 172.21.15.103:0/4077005138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4baee10 0x55d1c4bb06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa192800640 1 -- 172.21.15.103:0/4077005138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4bfa9d0 msgr2=0x55d1c4bb0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:23.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa192800640 1 --2- 172.21.15.103:0/4077005138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4bfa9d0 0x55d1c4bb0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa192800640 1 -- 172.21.15.103:0/4077005138 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1c499a170 con 0x55d1c4bfb2f0 2024-09-10T22:42:23.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa192800640 1 --2- 172.21.15.103:0/4077005138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4bfb2f0 0x55d1c4bb1120 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa18c05baf0 tx=0x7fa18c05e290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47d943b2f2ab627 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:23.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa173400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:42:23.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa173400640 1 -- 172.21.15.103:0/4077005138 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c00fea0 con 0x55d1c4bfb2f0 2024-09-10T22:42:23.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa19c43b000 1 -- 172.21.15.103:0/4077005138 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d1c49940f0 con 0x55d1c4bfb2f0 2024-09-10T22:42:23.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa173400640 1 -- 172.21.15.103:0/4077005138 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fa18c05fdb0 con 0x55d1c4bfb2f0 2024-09-10T22:42:23.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa173400640 1 -- 172.21.15.103:0/4077005138 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fa18c05e880 con 0x55d1c4bfb2f0 2024-09-10T22:42:23.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa19c43b000 10 client.6402 fetch_fsmap learned FSMap version 54 2024-09-10T22:42:23.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa19c43b000 1 -- 172.21.15.103:0/4077005138 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x55d1c4a80ef0 con 0x55d1c4bfb2f0 2024-09-10T22:42:23.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa173400640 1 -- 172.21.15.103:0/4077005138 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55d1c49940f0 con 0x55d1c4bfb2f0 2024-09-10T22:42:23.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa173400640 1 -- 172.21.15.103:0/4077005138 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 54) ==== 3502+0+0 (secure 0 0 0) 0x7fa18c05dae0 con 0x55d1c4bfb2f0 2024-09-10T22:42:23.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa19c43b000 10 client.6402 fetch_fsmap finished waiting for FSMap version 54 2024-09-10T22:42:23.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa19c43b000 10 client.6402 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T22:42:23.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa19c43b000 20 client.6402 populate_metadata read hostname 'smithi103' 2024-09-10T22:42:23.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa19c43b000 1 --2- 172.21.15.103:0/4077005138 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55d1c4bb1b30 0x55d1c4c10370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa19c43b000 4 client.6402 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:42:23.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa19c43b000 1 -- 172.21.15.103:0/4077005138 --> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1c4a0ea70 con 0x55d1c4bb1b30 2024-09-10T22:42:23.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa191e00640 1 --2- 172.21.15.103:0/4077005138 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55d1c4bb1b30 0x55d1c4c10370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa191e00640 1 --2- 172.21.15.103:0/4077005138 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55d1c4bb1b30 0x55d1c4c10370 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6634904a7109861e server_cookie=535b49f3cf3c98a2 in_seq=0 out_seq=0 2024-09-10T22:42:23.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.239+0000 7fa173400640 10 client.6402 ms_handle_connect on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:23.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.243+0000 7fa173400640 1 -- 172.21.15.103:0/4077005138 <== mds.0 v2:172.21.15.103:6834/714242556 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d1c4a0ea70 con 0x55d1c4bb1b30 2024-09-10T22:42:23.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.243+0000 7fa173400640 10 client.6402 handle_command_reply: tid=0 2024-09-10T22:42:23.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.243+0000 7fa19c43b000 1 client.6402 shutdown 2024-09-10T22:42:23.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.243+0000 7fa19c43b000 1 -- 172.21.15.103:0/4077005138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4bfb2f0 msgr2=0x55d1c4bb1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:23.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.243+0000 7fa19c43b000 1 --2- 172.21.15.103:0/4077005138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4bfb2f0 0x55d1c4bb1120 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa18c05baf0 tx=0x7fa18c05e290 comp rx=0 tx=0).stop 2024-09-10T22:42:23.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.243+0000 7fa19c43b000 1 -- 172.21.15.103:0/4077005138 shutdown_connections 2024-09-10T22:42:23.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.243+0000 7fa19c43b000 1 --2- 172.21.15.103:0/4077005138 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55d1c4bb1b30 0x55d1c4c10370 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.243+0000 7fa19c43b000 1 --2- 172.21.15.103:0/4077005138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4bfb2f0 0x55d1c4bb1120 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.243+0000 7fa19c43b000 1 --2- 172.21.15.103:0/4077005138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4bfa9d0 0x55d1c4bb0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.243+0000 7fa19c43b000 1 --2- 172.21.15.103:0/4077005138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4baee10 0x55d1c4bb06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.243+0000 7fa173400640 0 client.6402 ms_handle_reset on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:23.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.243+0000 7fa19c43b000 1 -- 172.21.15.103:0/4077005138 >> 172.21.15.103:0/4077005138 conn(0x55d1c4a98130 msgr2=0x55d1c4badfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:23.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.243+0000 7fa19c43b000 1 -- 172.21.15.103:0/4077005138 shutdown_connections 2024-09-10T22:42:23.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.243+0000 7fa19c43b000 1 -- 172.21.15.103:0/4077005138 wait complete. 2024-09-10T22:42:23.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.243+0000 7fa19c43b000 20 client.6402 trim_cache size 0 max 16384 2024-09-10T22:42:23.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.259+0000 7fa19c43b000 1 Processor -- start 2024-09-10T22:42:23.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.259+0000 7fa19c43b000 1 -- start start 2024-09-10T22:42:23.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa19c43b000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4baee10 0x55d1c4bae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa19c43b000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4bfa9d0 0x55d1c4bae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa19c43b000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4bfb2f0 0x55d1c4c01ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa19c43b000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa19406fc90 con 0x55d1c4baee10 2024-09-10T22:42:23.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa19c43b000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa19406eff0 con 0x55d1c4bfb2f0 2024-09-10T22:42:23.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa19c43b000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa19406f640 con 0x55d1c4bfa9d0 2024-09-10T22:42:23.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa191e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4baee10 0x55d1c4bae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa191e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4baee10 0x55d1c4bae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57464/0 (socket says 172.21.15.103:57464) 2024-09-10T22:42:23.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa191e00640 1 -- 172.21.15.103:0/3387950449 learned_addr learned my addr 172.21.15.103:0/3387950449 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:23.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa191400640 1 --2- 172.21.15.103:0/3387950449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4bfa9d0 0x55d1c4bae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa192800640 1 --2- 172.21.15.103:0/3387950449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4bfb2f0 0x55d1c4c01ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa191e00640 1 -- 172.21.15.103:0/3387950449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4bfa9d0 msgr2=0x55d1c4bae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:23.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa191e00640 1 --2- 172.21.15.103:0/3387950449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4bfa9d0 0x55d1c4bae5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa191e00640 1 -- 172.21.15.103:0/3387950449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4bfb2f0 msgr2=0x55d1c4c01ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:23.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa191e00640 1 --2- 172.21.15.103:0/3387950449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4bfb2f0 0x55d1c4c01ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa191e00640 1 -- 172.21.15.103:0/3387950449 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1c4a57d90 con 0x55d1c4baee10 2024-09-10T22:42:23.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa192800640 1 --2- 172.21.15.103:0/3387950449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4bfb2f0 0x55d1c4c01ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:23.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa191e00640 1 --2- 172.21.15.103:0/3387950449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4baee10 0x55d1c4bae0b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa1840012f0 tx=0x7fa18401d260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2146e090e3a02e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:23.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa17e000640 1 -- 172.21.15.103:0/3387950449 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1840bf070 con 0x55d1c4baee10 2024-09-10T22:42:23.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa17e000640 1 -- 172.21.15.103:0/3387950449 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1840c0040 con 0x55d1c4baee10 2024-09-10T22:42:23.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa17e000640 1 -- 172.21.15.103:0/3387950449 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184003ce0 con 0x55d1c4baee10 2024-09-10T22:42:23.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa19c43b000 1 -- 172.21.15.103:0/3387950449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4baee10 msgr2=0x55d1c4bae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:23.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa19c43b000 1 --2- 172.21.15.103:0/3387950449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4baee10 0x55d1c4bae0b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa1840012f0 tx=0x7fa18401d260 comp rx=0 tx=0).stop 2024-09-10T22:42:23.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa19c43b000 1 -- 172.21.15.103:0/3387950449 shutdown_connections 2024-09-10T22:42:23.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa19c43b000 1 --2- 172.21.15.103:0/3387950449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4bfb2f0 0x55d1c4c01ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa19c43b000 1 --2- 172.21.15.103:0/3387950449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4bfa9d0 0x55d1c4bae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa19c43b000 1 --2- 172.21.15.103:0/3387950449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4baee10 0x55d1c4bae0b0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa19c43b000 1 -- 172.21.15.103:0/3387950449 >> 172.21.15.103:0/3387950449 conn(0x55d1c4a98130 msgr2=0x55d1c4bdaf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:23.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa19c43b000 1 -- 172.21.15.103:0/3387950449 shutdown_connections 2024-09-10T22:42:23.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa19c43b000 1 -- 172.21.15.103:0/3387950449 wait complete. 2024-09-10T22:42:23.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa19c43b000 1 -- start start 2024-09-10T22:42:23.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.263+0000 7fa19c43b000 1 Processor -- start 2024-09-10T22:42:23.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4baee10 0x55d1c4c78ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4bfa9d0 0x55d1c4c79410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4bfb2f0 0x55d1c4c79950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d1c4a80a60 con 0x55d1c4baee10 2024-09-10T22:42:23.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d1c49c7ec0 con 0x55d1c4bfa9d0 2024-09-10T22:42:23.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55d1c4a04390 con 0x55d1c4bfb2f0 2024-09-10T22:42:23.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 10 client.0 _ll_register_callbacks cb 0x7fa18c05e650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:42:23.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa191e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4baee10 0x55d1c4c78ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa191e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4baee10 0x55d1c4c78ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57468/0 (socket says 172.21.15.103:57468) 2024-09-10T22:42:23.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa191e00640 1 -- 172.21.15.103:0/565588478 learned_addr learned my addr 172.21.15.103:0/565588478 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:23.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa192800640 1 --2- 172.21.15.103:0/565588478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4bfb2f0 0x55d1c4c79950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa191400640 1 --2- 172.21.15.103:0/565588478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4bfa9d0 0x55d1c4c79410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa191e00640 1 -- 172.21.15.103:0/565588478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4bfb2f0 msgr2=0x55d1c4c79950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:23.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa191e00640 1 --2- 172.21.15.103:0/565588478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4bfb2f0 0x55d1c4c79950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa191e00640 1 -- 172.21.15.103:0/565588478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4bfa9d0 msgr2=0x55d1c4c79410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:23.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa191e00640 1 --2- 172.21.15.103:0/565588478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4bfa9d0 0x55d1c4c79410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa191e00640 1 -- 172.21.15.103:0/565588478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1c49c2a90 con 0x55d1c4baee10 2024-09-10T22:42:23.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa192800640 1 --2- 172.21.15.103:0/565588478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4bfb2f0 0x55d1c4c79950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:23.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa191e00640 1 --2- 172.21.15.103:0/565588478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4baee10 0x55d1c4c78ed0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa18400c630 tx=0x7fa184001520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60f035c2f1205d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:23.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa173400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:42:23.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa173400640 1 -- 172.21.15.103:0/565588478 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1840d5060 con 0x55d1c4baee10 2024-09-10T22:42:23.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa173400640 1 -- 172.21.15.103:0/565588478 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fa184003ca0 con 0x55d1c4baee10 2024-09-10T22:42:23.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 -- 172.21.15.103:0/565588478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1840c0040 con 0x55d1c4baee10 2024-09-10T22:42:23.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa173400640 1 -- 172.21.15.103:0/565588478 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fa1840db050 con 0x55d1c4baee10 2024-09-10T22:42:23.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 10 client.6408 fetch_fsmap learned FSMap version 54 2024-09-10T22:42:23.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 -- 172.21.15.103:0/565588478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x55d1c49a1050 con 0x55d1c4baee10 2024-09-10T22:42:23.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa173400640 1 -- 172.21.15.103:0/565588478 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1840c0040 con 0x55d1c4baee10 2024-09-10T22:42:23.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa173400640 1 -- 172.21.15.103:0/565588478 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 54) ==== 3502+0+0 (secure 0 0 0) 0x7fa1840de020 con 0x55d1c4baee10 2024-09-10T22:42:23.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 10 client.6408 fetch_fsmap finished waiting for FSMap version 54 2024-09-10T22:42:23.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 10 client.6408 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T22:42:23.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 20 client.6408 populate_metadata read hostname 'smithi103' 2024-09-10T22:42:23.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 --2- 172.21.15.103:0/565588478 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55d1c4c04d20 0x55d1c4c05100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 4 client.6408 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:42:23.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 -- 172.21.15.103:0/565588478 --> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] -- command(tid 0: {"prefix": "status"}) -- 0x55d1c4a0a520 con 0x55d1c4c04d20 2024-09-10T22:42:23.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa191400640 1 --2- 172.21.15.103:0/565588478 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55d1c4c04d20 0x55d1c4c05100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa191400640 1 --2- 172.21.15.103:0/565588478 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55d1c4c04d20 0x55d1c4c05100 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebf00b598935d885 server_cookie=9be90e0dd391a584 in_seq=0 out_seq=0 2024-09-10T22:42:23.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa173400640 10 client.6408 ms_handle_connect on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:23.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa173400640 1 -- 172.21.15.103:0/565588478 <== mds.0 v2:172.21.15.103:6834/714242556 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55d1c4a0a520 con 0x55d1c4c04d20 2024-09-10T22:42:23.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa173400640 10 client.6408 handle_command_reply: tid=0 2024-09-10T22:42:23.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 client.6408 shutdown 2024-09-10T22:42:23.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 -- 172.21.15.103:0/565588478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4baee10 msgr2=0x55d1c4c78ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:23.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 --2- 172.21.15.103:0/565588478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4baee10 0x55d1c4c78ed0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa18400c630 tx=0x7fa184001520 comp rx=0 tx=0).stop 2024-09-10T22:42:23.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 -- 172.21.15.103:0/565588478 shutdown_connections 2024-09-10T22:42:23.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 --2- 172.21.15.103:0/565588478 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55d1c4c04d20 0x55d1c4c05100 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 --2- 172.21.15.103:0/565588478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1c4bfb2f0 0x55d1c4c79950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 --2- 172.21.15.103:0/565588478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1c4bfa9d0 0x55d1c4c79410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa173400640 0 client.6408 ms_handle_reset on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:23.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 --2- 172.21.15.103:0/565588478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d1c4baee10 0x55d1c4c78ed0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 -- 172.21.15.103:0/565588478 >> 172.21.15.103:0/565588478 conn(0x55d1c4a98130 msgr2=0x55d1c4bad0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:23.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 -- 172.21.15.103:0/565588478 shutdown_connections 2024-09-10T22:42:23.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 1 -- 172.21.15.103:0/565588478 wait complete. 2024-09-10T22:42:23.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.267+0000 7fa19c43b000 20 client.6408 trim_cache size 0 max 16384 2024-09-10T22:42:23.278 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:42:23.278 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:42:23.278 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-10T22:42:23.279 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6285, 2024-09-10T22:42:23.279 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:42:23.279 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:42:23.279 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:42:23.279 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 5.9390531869999998, 2024-09-10T22:42:23.279 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 54, 2024-09-10T22:42:23.279 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 68, 2024-09-10T22:42:23.279 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 68, 2024-09-10T22:42:23.279 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 10.456503479 2024-09-10T22:42:23.279 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:42:23.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.271+0000 7fa199000640 1 -- 172.21.15.103:0/713418136 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa174072610 msgr2=0x7fa174074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:23.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.271+0000 7fa199000640 1 --2- 172.21.15.103:0/713418136 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa174072610 0x7fa174074ad0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa1941f87f0 tx=0x7fa180006b50 comp rx=0 tx=0).stop 2024-09-10T22:42:23.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.271+0000 7fa199000640 1 -- 172.21.15.103:0/713418136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1940ca040 msgr2=0x7fa19415a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:23.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.271+0000 7fa199000640 1 --2- 172.21.15.103:0/713418136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1940ca040 0x7fa19415a800 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa1940b3580 tx=0x7fa18c011be0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.271+0000 7fa199000640 1 -- 172.21.15.103:0/713418136 shutdown_connections 2024-09-10T22:42:23.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.271+0000 7fa199000640 1 --2- 172.21.15.103:0/713418136 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa174072610 0x7fa174074ad0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.271+0000 7fa199000640 1 --2- 172.21.15.103:0/713418136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1940ca040 0x7fa19415a800 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.271+0000 7fa199000640 1 --2- 172.21.15.103:0/713418136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1941521f0 0x7fa1941518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.271+0000 7fa199000640 1 --2- 172.21.15.103:0/713418136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa178003a60 0x7fa1940c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.271+0000 7fa199000640 1 -- 172.21.15.103:0/713418136 >> 172.21.15.103:0/713418136 conn(0x7fa1940d1ac0 msgr2=0x7fa1940b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:23.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.271+0000 7fa199000640 1 -- 172.21.15.103:0/713418136 shutdown_connections 2024-09-10T22:42:23.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.271+0000 7fa199000640 1 -- 172.21.15.103:0/713418136 wait complete. 2024-09-10T22:42:23.291 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T22:42:23.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.431+0000 7f9714200640 1 -- 172.21.15.103:0/1140323457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f970c06d310 msgr2=0x7f970c0d14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:23.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.431+0000 7f9714200640 1 --2- 172.21.15.103:0/1140323457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f970c06d310 0x7f970c0d14c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f96f8009840 tx=0x7f96f801c790 comp rx=0 tx=0).stop 2024-09-10T22:42:23.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.431+0000 7f9714200640 1 -- 172.21.15.103:0/1140323457 shutdown_connections 2024-09-10T22:42:23.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.431+0000 7f9714200640 1 --2- 172.21.15.103:0/1140323457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f970c06d7a0 0x7f970c0cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.431+0000 7f9714200640 1 --2- 172.21.15.103:0/1140323457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f970c06d310 0x7f970c0d14c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.431+0000 7f9714200640 1 -- 172.21.15.103:0/1140323457 >> 172.21.15.103:0/1140323457 conn(0x7f970c0d09d0 msgr2=0x7f970c0d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:23.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.431+0000 7f9714200640 1 -- 172.21.15.103:0/1140323457 shutdown_connections 2024-09-10T22:42:23.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.431+0000 7f9714200640 1 -- 172.21.15.103:0/1140323457 wait complete. 2024-09-10T22:42:23.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9714200640 1 Processor -- start 2024-09-10T22:42:23.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9714200640 1 -- start start 2024-09-10T22:42:23.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9714200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c06d310 0x7f970c147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9714200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f970c06d7a0 0x7f970c14fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9714200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f970c1529e0 0x7f970c150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9714200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f970c168950 con 0x7f970c06d310 2024-09-10T22:42:23.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9714200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f970c1687d0 con 0x7f970c1529e0 2024-09-10T22:42:23.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9714200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f970c168ad0 con 0x7f970c06d7a0 2024-09-10T22:42:23.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9711800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c06d310 0x7f970c147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9711800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c06d310 0x7f970c147990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57484/0 (socket says 172.21.15.103:57484) 2024-09-10T22:42:23.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9711800640 1 -- 172.21.15.103:0/1715752009 learned_addr learned my addr 172.21.15.103:0/1715752009 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:23.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9710e00640 1 --2- 172.21.15.103:0/1715752009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f970c06d7a0 0x7f970c14fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9712200640 1 --2- 172.21.15.103:0/1715752009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f970c1529e0 0x7f970c150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9711800640 1 -- 172.21.15.103:0/1715752009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f970c06d7a0 msgr2=0x7f970c14fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:23.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9711800640 1 --2- 172.21.15.103:0/1715752009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f970c06d7a0 0x7f970c14fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9711800640 1 -- 172.21.15.103:0/1715752009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f970c1529e0 msgr2=0x7f970c150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:23.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9711800640 1 --2- 172.21.15.103:0/1715752009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f970c1529e0 0x7f970c150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9711800640 1 -- 172.21.15.103:0/1715752009 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970c1484d0 con 0x7f970c06d310 2024-09-10T22:42:23.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9712200640 1 --2- 172.21.15.103:0/1715752009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f970c1529e0 0x7f970c150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:42:23.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9711800640 1 --2- 172.21.15.103:0/1715752009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c06d310 0x7f970c147990 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f970000c3f0 tx=0x7f970000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:23.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9709600640 1 -- 172.21.15.103:0/1715752009 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97000052d0 con 0x7f970c06d310 2024-09-10T22:42:23.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9709600640 1 -- 172.21.15.103:0/1715752009 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9700007020 con 0x7f970c06d310 2024-09-10T22:42:23.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9714200640 1 -- 172.21.15.103:0/1715752009 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f970c137640 con 0x7f970c06d310 2024-09-10T22:42:23.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9709600640 1 -- 172.21.15.103:0/1715752009 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9700007470 con 0x7f970c06d310 2024-09-10T22:42:23.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9714200640 1 -- 172.21.15.103:0/1715752009 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f970c137c00 con 0x7f970c06d310 2024-09-10T22:42:23.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.435+0000 7f9714200640 1 -- 172.21.15.103:0/1715752009 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f970c0d14c0 con 0x7f970c06d310 2024-09-10T22:42:23.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.439+0000 7f9709600640 1 -- 172.21.15.103:0/1715752009 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f97000067e0 con 0x7f970c06d310 2024-09-10T22:42:23.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.439+0000 7f9709600640 1 --2- 172.21.15.103:0/1715752009 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f96ec0725e0 0x7f96ec074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:23.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.439+0000 7f9709600640 1 -- 172.21.15.103:0/1715752009 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f97000928d0 con 0x7f970c06d310 2024-09-10T22:42:23.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.439+0000 7f9710e00640 1 --2- 172.21.15.103:0/1715752009 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f96ec0725e0 0x7f96ec074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:23.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.439+0000 7f9710e00640 1 --2- 172.21.15.103:0/1715752009 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f96ec0725e0 0x7f96ec074aa0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f96f80af000 tx=0x7f96f801afd0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:23.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.443+0000 7f9709600640 1 -- 172.21.15.103:0/1715752009 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9700001090 con 0x7f970c06d310 2024-09-10T22:42:23.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.643+0000 7f9714200640 1 -- 172.21.15.103:0/1715752009 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f970c0cda00 con 0x7f970c06d310 2024-09-10T22:42:23.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.643+0000 7f9709600640 1 -- 172.21.15.103:0/1715752009 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) ==== 53+0+73 (secure 0 0 0) 0x7f970005d6b0 con 0x7f970c06d310 2024-09-10T22:42:23.647 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T22:42:23.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.647+0000 7f9714200640 1 -- 172.21.15.103:0/1715752009 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f96ec0725e0 msgr2=0x7f96ec074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:23.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.647+0000 7f9714200640 1 --2- 172.21.15.103:0/1715752009 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f96ec0725e0 0x7f96ec074aa0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f96f80af000 tx=0x7f96f801afd0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.647+0000 7f9714200640 1 -- 172.21.15.103:0/1715752009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c06d310 msgr2=0x7f970c147990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:23.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.647+0000 7f9714200640 1 --2- 172.21.15.103:0/1715752009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c06d310 0x7f970c147990 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f970000c3f0 tx=0x7f970000c8b0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.647+0000 7f9714200640 1 -- 172.21.15.103:0/1715752009 shutdown_connections 2024-09-10T22:42:23.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.647+0000 7f9714200640 1 --2- 172.21.15.103:0/1715752009 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f96ec0725e0 0x7f96ec074aa0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.647+0000 7f9714200640 1 --2- 172.21.15.103:0/1715752009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f970c1529e0 0x7f970c150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.647+0000 7f9714200640 1 --2- 172.21.15.103:0/1715752009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f970c06d7a0 0x7f970c14fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.647+0000 7f9714200640 1 --2- 172.21.15.103:0/1715752009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c06d310 0x7f970c147990 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:23.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.647+0000 7f9714200640 1 -- 172.21.15.103:0/1715752009 >> 172.21.15.103:0/1715752009 conn(0x7f970c0d09d0 msgr2=0x7f970c165cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:23.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.647+0000 7f9714200640 1 -- 172.21.15.103:0/1715752009 shutdown_connections 2024-09-10T22:42:23.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23.647+0000 7f9714200640 1 -- 172.21.15.103:0/1715752009 wait complete. 2024-09-10T22:42:23.669 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T22:42:23.669 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T22:42:23.669 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-10T22:42:23.669 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T22:42:23.669 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T22:42:23.669 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T22:42:23.669 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T22:42:23.669 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T22:42:23.669 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:42:23.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:23.670 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-10T22:42:23.678 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T22:42:23.678 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T22:42:23.679 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T22:42:23.679 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:42:23.679 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-10T22:42:23.679 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:42:23.679 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:42:23.679 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:42:23.679 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-10T22:42:23.679 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:42:23.679 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:42:23.679 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-10T22:42:23.679 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:42:23.679 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-10T22:42:23.679 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T22:42:23.679 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-10T22:42:23.680 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-10T22:42:23.680 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42238sec preferred_lft 42238sec 2024-09-10T22:42:23.680 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2024-09-10T22:42:23.680 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:42:23.680 INFO:teuthology.orchestra.run.smithi103.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T22:42:23.680 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 02:42:c3:dd:ba:ba brd ff:ff:ff:ff:ff:ff 2024-09-10T22:42:23.680 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T22:42:23.680 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:42:23.680 INFO:teuthology.orchestra.run.smithi103.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T22:42:23.680 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T22:42:23.680 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T22:42:23.680 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:42:23.680 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T22:42:23.681 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:42:23.681 INFO:teuthology.orchestra.run.smithi103.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T22:42:23.681 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:42:23.681 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T22:42:23.681 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:42:23.681 INFO:teuthology.orchestra.run.smithi103.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T22:42:23.681 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:42:23.681 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T22:42:23.681 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:42:23.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:23.682 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T22:42:23.745 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-10T22:42:23.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:23.748 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-10T22:42:23.809 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-10T22:42:23.810 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T22:42:23.810 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-10T22:42:23.810 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T22:42:23.810 INFO:teuthology.orchestra.run.smithi103.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-10T22:42:23.810 INFO:teuthology.orchestra.run.smithi103.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T22:42:23.810 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T22:42:23.810 INFO:teuthology.orchestra.run.smithi103.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:42:23.810 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:42:23.810 INFO:teuthology.orchestra.run.smithi103.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:42:23.810 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T22:42:23.811 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:42:23.811 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:42:23.811 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T22:42:23.811 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T22:42:23.811 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T22:42:23.811 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:42:23.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:42:23.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:42:23.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:23.949 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-10T22:42:23.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T22:42:23.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T22:42:23.958 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:42:23.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:23.958 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-10T22:42:24.019 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T22:42:24.019 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:42:24.019 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T22:42:24.067 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:42:24.068 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:42:24.068 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T22:42:24.119 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:42:24.180 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:42:24.233 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:42:24.233 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:42:24.233 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:42:24.233 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:42:24.234 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:42:24.234 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:42:24.234 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:42:24.234 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:42:24.234 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:42:24.234 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:42:24.234 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:42:24.234 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:42:24.234 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:42:24.234 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:42:24.234 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:42:24.234 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:42:24.234 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:42:24.234 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:42:24.235 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:42:24.235 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:42:24.235 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:42:24.235 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:42:24.235 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:42:24.235 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:42:24.235 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:42:24.235 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:42:24.235 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:42:24.235 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:42:24.235 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:42:24.235 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:42:24.235 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:42:24.236 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:42:24.236 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:42:24.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:24.237 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:42:24.291 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T22:42:24.292 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T22:42:24.342 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:42:24.365 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:42:24.417 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:42:24.417 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:42:24.417 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:42:24.417 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:42:24.418 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:42:24.418 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:42:24.418 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:42:24.418 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:42:24.418 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:42:24.418 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:42:24.418 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:42:24.418 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:42:24.418 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:42:24.418 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:42:24.419 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:42:24.419 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:42:24.419 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:42:24.419 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:42:24.419 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:42:24.419 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:42:24.419 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:42:24.419 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:42:24.419 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:42:24.419 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:42:24.419 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:42:24.419 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:42:24.419 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:42:24.420 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:42:24.420 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:42:24.420 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:42:24.420 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:42:24.420 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:42:24.420 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:42:24.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:24.421 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:42:24.439 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2024-09-10T22:42:24.435+0000 7f8f62a4a580 -1 init, newargv = 0x558526f2c800 newargc=15 2024-09-10T22:42:24.439 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[42422]: starting ceph client 2024-09-10T22:42:24.445 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[42422]: starting fuse 2024-09-10T22:42:24.447 INFO:teuthology.orchestra.run.smithi103.stdout:44 2024-09-10T22:42:24.447 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T22:42:24.448 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-09-10T22:42:24.448 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-09-10T22:42:24.448 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-09-10T22:42:24.448 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:42:24.448 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-09-10T22:42:24.448 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:42:24.448 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-09-10T22:42:24.448 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T22:42:24.448 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-09-10T22:42:24.448 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T22:42:24.448 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:42:24.448 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-09-10T22:42:24.448 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-09-10T22:42:24.449 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-09-10T22:42:24.449 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-09-10T22:42:24.449 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:42:24.449 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-09-10T22:42:24.449 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T22:42:24.449 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T22:42:24.449 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T22:42:24.449 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-09-10T22:42:24.449 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-09-10T22:42:24.449 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-09-10T22:42:24.449 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T22:42:24.449 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:42:24.449 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.0")) 2024-09-10T22:42:24.449 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:42:24.567 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.42422.asok 2024-09-10T22:42:24.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:42:24.578 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.42422.asok 2024-09-10T22:42:24.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:24.578 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.42422.asok status 2024-09-10T22:42:24.751 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:42:24.751 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-09-10T22:42:24.751 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T22:42:24.751 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:42:24.751 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2024-09-10T22:42:24.751 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-09-10T22:42:24.751 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T22:42:24.751 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "42422", 2024-09-10T22:42:24.751 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-09-10T22:42:24.751 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:24.751 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-09-10T22:42:24.752 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-09-10T22:42:24.752 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6420, 2024-09-10T22:42:24.752 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-09-10T22:42:24.752 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-09-10T22:42:24.752 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-09-10T22:42:24.752 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6420 2024-09-10T22:42:24.752 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:24.752 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T22:42:24.752 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T22:42:24.752 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-10T22:42:24.752 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2564393695 2024-09-10T22:42:24.752 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:24.752 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:24.752 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T22:42:24.753 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T22:42:24.753 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-10T22:42:24.753 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2564393695 2024-09-10T22:42:24.753 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:24.753 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.6420 192.168.0.1:0/2564393695", 2024-09-10T22:42:24.753 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/2564393695", 2024-09-10T22:42:24.753 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-09-10T22:42:24.753 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 54, 2024-09-10T22:42:24.753 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 68, 2024-09-10T22:42:24.753 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-09-10T22:42:24.753 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-09-10T22:42:24.753 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-09-10T22:42:24.753 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:42:24.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:24.766 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-09-10T22:42:24.766 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T22:42:24.775 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-09-10T22:42:24.775 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T22:42:24.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:24.776 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T22:42:24.839 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-10T22:42:25.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.019+0000 7fea8f000640 1 -- 172.21.15.103:0/2790755408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea8815f1a0 msgr2=0x7fea880ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:25.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.019+0000 7fea8f000640 1 --2- 172.21.15.103:0/2790755408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea8815f1a0 0x7fea880ae7f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fea78009c80 tx=0x7fea7801cda0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.019+0000 7fea8f000640 1 -- 172.21.15.103:0/2790755408 shutdown_connections 2024-09-10T22:42:25.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.019+0000 7fea8f000640 1 --2- 172.21.15.103:0/2790755408 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea880cdd00 0x7fea880ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.019+0000 7fea8f000640 1 --2- 172.21.15.103:0/2790755408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea8815f1a0 0x7fea880ae7f0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.019+0000 7fea8f000640 1 -- 172.21.15.103:0/2790755408 >> 172.21.15.103:0/2790755408 conn(0x7fea880d1a20 msgr2=0x7fea880d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:25.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.019+0000 7fea8f000640 1 -- 172.21.15.103:0/2790755408 shutdown_connections 2024-09-10T22:42:25.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.019+0000 7fea8f000640 1 -- 172.21.15.103:0/2790755408 wait complete. 2024-09-10T22:42:25.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8f000640 1 Processor -- start 2024-09-10T22:42:25.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8f000640 1 -- start start 2024-09-10T22:42:25.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8f000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea880cd330 0x7fea880b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:25.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8f000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea880cdd00 0x7fea88071790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:25.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8f000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea8815f1a0 0x7fea88156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:25.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8f000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fea88169070 con 0x7fea8815f1a0 2024-09-10T22:42:25.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8f000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fea88168ef0 con 0x7fea880cd330 2024-09-10T22:42:25.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8f000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fea881691f0 con 0x7fea880cdd00 2024-09-10T22:42:25.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea8815f1a0 0x7fea88156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:25.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea8815f1a0 0x7fea88156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57502/0 (socket says 172.21.15.103:57502) 2024-09-10T22:42:25.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8d000640 1 -- 172.21.15.103:0/1494089149 learned_addr learned my addr 172.21.15.103:0/1494089149 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:25.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8d000640 1 -- 172.21.15.103:0/1494089149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea880cdd00 msgr2=0x7fea88071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:25.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea87400640 1 --2- 172.21.15.103:0/1494089149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea880cdd00 0x7fea88071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:25.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea87e00640 1 --2- 172.21.15.103:0/1494089149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea880cd330 0x7fea880b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:25.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8d000640 1 --2- 172.21.15.103:0/1494089149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea880cdd00 0x7fea88071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8d000640 1 -- 172.21.15.103:0/1494089149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea880cd330 msgr2=0x7fea880b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:25.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8d000640 1 --2- 172.21.15.103:0/1494089149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea880cd330 0x7fea880b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8d000640 1 -- 172.21.15.103:0/1494089149 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea880b3290 con 0x7fea8815f1a0 2024-09-10T22:42:25.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea87400640 1 --2- 172.21.15.103:0/1494089149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea880cdd00 0x7fea88071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:25.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea87e00640 1 --2- 172.21.15.103:0/1494089149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea880cd330 0x7fea880b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:25.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8d000640 1 --2- 172.21.15.103:0/1494089149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea8815f1a0 0x7fea88156ab0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fea8000c4d0 tx=0x7fea8000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:25.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea7fe00640 1 -- 172.21.15.103:0/1494089149 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea800052d0 con 0x7fea8815f1a0 2024-09-10T22:42:25.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea7fe00640 1 -- 172.21.15.103:0/1494089149 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea80005470 con 0x7fea8815f1a0 2024-09-10T22:42:25.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea7fe00640 1 -- 172.21.15.103:0/1494089149 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea80012870 con 0x7fea8815f1a0 2024-09-10T22:42:25.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8f000640 1 -- 172.21.15.103:0/1494089149 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea8815bf90 con 0x7fea8815f1a0 2024-09-10T22:42:25.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8f000640 1 -- 172.21.15.103:0/1494089149 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea8815c230 con 0x7fea8815f1a0 2024-09-10T22:42:25.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.023+0000 7fea8f000640 1 -- 172.21.15.103:0/1494089149 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea880d2550 con 0x7fea8815f1a0 2024-09-10T22:42:25.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.027+0000 7fea7fe00640 1 -- 172.21.15.103:0/1494089149 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fea80003600 con 0x7fea8815f1a0 2024-09-10T22:42:25.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.027+0000 7fea7fe00640 1 --2- 172.21.15.103:0/1494089149 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fea640725e0 0x7fea64074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:25.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.027+0000 7fea7fe00640 1 -- 172.21.15.103:0/1494089149 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7fea80092fb0 con 0x7fea8815f1a0 2024-09-10T22:42:25.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.027+0000 7fea87e00640 1 --2- 172.21.15.103:0/1494089149 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fea640725e0 0x7fea64074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:25.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.027+0000 7fea87e00640 1 --2- 172.21.15.103:0/1494089149 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fea640725e0 0x7fea64074aa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fea780af000 tx=0x7fea7801b5e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:25.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.031+0000 7fea7fe00640 1 -- 172.21.15.103:0/1494089149 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fea880b3290 con 0x7fea8815f1a0 2024-09-10T22:42:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.231+0000 7fea8f000640 1 -- 172.21.15.103:0/1494089149 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fea880b3c30 con 0x7fea8815f1a0 2024-09-10T22:42:25.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.379+0000 7fea7fe00640 1 -- 172.21.15.103:0/1494089149 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v55) ==== 105+0+0 (secure 0 0 0) 0x7fea8005e460 con 0x7fea8815f1a0 2024-09-10T22:42:25.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.383+0000 7fea8f000640 1 -- 172.21.15.103:0/1494089149 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fea640725e0 msgr2=0x7fea64074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:25.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.383+0000 7fea8f000640 1 --2- 172.21.15.103:0/1494089149 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fea640725e0 0x7fea64074aa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fea780af000 tx=0x7fea7801b5e0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.383+0000 7fea8f000640 1 -- 172.21.15.103:0/1494089149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea8815f1a0 msgr2=0x7fea88156ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:25.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.383+0000 7fea8f000640 1 --2- 172.21.15.103:0/1494089149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea8815f1a0 0x7fea88156ab0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fea8000c4d0 tx=0x7fea8000c990 comp rx=0 tx=0).stop 2024-09-10T22:42:25.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.383+0000 7fea8f000640 1 -- 172.21.15.103:0/1494089149 shutdown_connections 2024-09-10T22:42:25.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.383+0000 7fea8f000640 1 --2- 172.21.15.103:0/1494089149 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fea640725e0 0x7fea64074aa0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.383+0000 7fea8f000640 1 --2- 172.21.15.103:0/1494089149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea8815f1a0 0x7fea88156ab0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.383+0000 7fea8f000640 1 --2- 172.21.15.103:0/1494089149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea880cdd00 0x7fea88071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.383+0000 7fea8f000640 1 --2- 172.21.15.103:0/1494089149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea880cd330 0x7fea880b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.383+0000 7fea8f000640 1 -- 172.21.15.103:0/1494089149 >> 172.21.15.103:0/1494089149 conn(0x7fea880d1a20 msgr2=0x7fea880720a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:25.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.383+0000 7fea8f000640 1 -- 172.21.15.103:0/1494089149 shutdown_connections 2024-09-10T22:42:25.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.383+0000 7fea8f000640 1 -- 172.21.15.103:0/1494089149 wait complete. 2024-09-10T22:42:25.413 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:42:25.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f872dc00640 1 -- 172.21.15.103:0/3265866904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87280cf790 msgr2=0x7f87280cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:25.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f872dc00640 1 --2- 172.21.15.103:0/3265866904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87280cf790 0x7f87280cfc20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8720009900 tx=0x7f872001c850 comp rx=0 tx=0).stop 2024-09-10T22:42:25.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f872dc00640 1 -- 172.21.15.103:0/3265866904 shutdown_connections 2024-09-10T22:42:25.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f872dc00640 1 --2- 172.21.15.103:0/3265866904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87280cf790 0x7f87280cfc20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f872dc00640 1 --2- 172.21.15.103:0/3265866904 >> v2:172.21.15.131:3300/0 conn(0x7f87280cc120 0x7f87280aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f872dc00640 1 -- 172.21.15.103:0/3265866904 >> 172.21.15.103:0/3265866904 conn(0x7f872806cc00 msgr2=0x7f872806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:25.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f872dc00640 1 -- 172.21.15.103:0/3265866904 shutdown_connections 2024-09-10T22:42:25.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f872dc00640 1 -- 172.21.15.103:0/3265866904 wait complete. 2024-09-10T22:42:25.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f872dc00640 1 Processor -- start 2024-09-10T22:42:25.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f872dc00640 1 -- start start 2024-09-10T22:42:25.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f872dc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87280cc120 0x7f87281fa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:25.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f872dc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87280cf790 0x7f8728164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:25.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f872dc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f872815c970 0x7f872815d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:25.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f872dc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8728168ba0 con 0x7f87280cc120 2024-09-10T22:42:25.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f872dc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8728168a20 con 0x7f872815c970 2024-09-10T22:42:25.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f872dc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8728168d20 con 0x7f87280cf790 2024-09-10T22:42:25.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f8726a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87280cc120 0x7f87281fa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:25.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f8726a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87280cc120 0x7f87281fa810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57506/0 (socket says 172.21.15.103:57506) 2024-09-10T22:42:25.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f8726a00640 1 -- 172.21.15.103:0/4099408462 learned_addr learned my addr 172.21.15.103:0/4099408462 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:25.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f871e000640 1 --2- 172.21.15.103:0/4099408462 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87280cf790 0x7f8728164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:25.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f8727400640 1 --2- 172.21.15.103:0/4099408462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f872815c970 0x7f872815d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:25.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f8726a00640 1 -- 172.21.15.103:0/4099408462 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87280cf790 msgr2=0x7f8728164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:25.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f8726a00640 1 --2- 172.21.15.103:0/4099408462 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87280cf790 0x7f8728164cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f8726a00640 1 -- 172.21.15.103:0/4099408462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f872815c970 msgr2=0x7f872815d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:25.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f8726a00640 1 --2- 172.21.15.103:0/4099408462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f872815c970 0x7f872815d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.555+0000 7f8726a00640 1 -- 172.21.15.103:0/4099408462 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87281509c0 con 0x7f87280cc120 2024-09-10T22:42:25.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.559+0000 7f8726a00640 1 --2- 172.21.15.103:0/4099408462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87280cc120 0x7f87281fa810 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8718009d90 tx=0x7f871800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:25.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.559+0000 7f871f400640 1 -- 172.21.15.103:0/4099408462 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8718003b80 con 0x7f87280cc120 2024-09-10T22:42:25.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.559+0000 7f871f400640 1 -- 172.21.15.103:0/4099408462 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8718003d20 con 0x7f87280cc120 2024-09-10T22:42:25.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.559+0000 7f871f400640 1 -- 172.21.15.103:0/4099408462 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8718004280 con 0x7f87280cc120 2024-09-10T22:42:25.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.559+0000 7f872dc00640 1 -- 172.21.15.103:0/4099408462 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87281faea0 con 0x7f87280cc120 2024-09-10T22:42:25.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.559+0000 7f872dc00640 1 -- 172.21.15.103:0/4099408462 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87281fb460 con 0x7f87280cc120 2024-09-10T22:42:25.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.559+0000 7f872dc00640 1 -- 172.21.15.103:0/4099408462 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87280cfc20 con 0x7f87280cc120 2024-09-10T22:42:25.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.559+0000 7f871f400640 1 -- 172.21.15.103:0/4099408462 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8718004420 con 0x7f87280cc120 2024-09-10T22:42:25.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.559+0000 7f871f400640 1 --2- 172.21.15.103:0/4099408462 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f87040725e0 0x7f8704074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:25.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.559+0000 7f871f400640 1 -- 172.21.15.103:0/4099408462 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f8718093fa0 con 0x7f87280cc120 2024-09-10T22:42:25.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.559+0000 7f871e000640 1 --2- 172.21.15.103:0/4099408462 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f87040725e0 0x7f8704074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:25.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.563+0000 7f871e000640 1 --2- 172.21.15.103:0/4099408462 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f87040725e0 0x7f8704074aa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8728165840 tx=0x7f8710009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:25.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.563+0000 7f871f400640 1 -- 172.21.15.103:0/4099408462 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f871805ef10 con 0x7f87280cc120 2024-09-10T22:42:25.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.763+0000 7f872dc00640 1 -- 172.21.15.103:0/4099408462 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87280ce8b0 con 0x7f87280cc120 2024-09-10T22:42:25.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.763+0000 7f871f400640 1 -- 172.21.15.103:0/4099408462 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5246 (secure 0 0 0) 0x7f8718063940 con 0x7f87280cc120 2024-09-10T22:42:25.767 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:25.767 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":56,"btime":"2024-09-10T22:42:25:386643+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2961968581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2961968581},{"type":"v1","addr":"172.21.15.131:6835","nonce":2961968581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":5630,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/360467048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":360467048},{"type":"v1","addr":"172.21.15.131:6837","nonce":360467048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:42:16.725541+0000","modified":"2024-09-10T22:42:25.386632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":6285,"mds_1":6276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6276":{"gid":6276,"name":"c","rank":1,"incarnation":56,"state":"up:creating","state_seq":1,"addr":"172.21.15.103:6833/4171945106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4171945106},{"type":"v1","addr":"172.21.15.103:6833","nonce":4171945106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/714242556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":714242556},{"type":"v1","addr":"172.21.15.103:6835","nonce":714242556}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6285,"qdb_cluster":[6285]},"id":4}]} 2024-09-10T22:42:25.768 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 56 2024-09-10T22:42:25.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.767+0000 7f872dc00640 1 -- 172.21.15.103:0/4099408462 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f87040725e0 msgr2=0x7f8704074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:25.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.767+0000 7f872dc00640 1 --2- 172.21.15.103:0/4099408462 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f87040725e0 0x7f8704074aa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8728165840 tx=0x7f8710009040 comp rx=0 tx=0).stop 2024-09-10T22:42:25.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.767+0000 7f872dc00640 1 -- 172.21.15.103:0/4099408462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87280cc120 msgr2=0x7f87281fa810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:25.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.767+0000 7f872dc00640 1 --2- 172.21.15.103:0/4099408462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87280cc120 0x7f87281fa810 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8718009d90 tx=0x7f871800c6a0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.767+0000 7f872dc00640 1 -- 172.21.15.103:0/4099408462 shutdown_connections 2024-09-10T22:42:25.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.767+0000 7f872dc00640 1 --2- 172.21.15.103:0/4099408462 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f87040725e0 0x7f8704074aa0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.767+0000 7f872dc00640 1 --2- 172.21.15.103:0/4099408462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f872815c970 0x7f872815d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.767+0000 7f872dc00640 1 --2- 172.21.15.103:0/4099408462 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87280cf790 0x7f8728164cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.767+0000 7f872dc00640 1 --2- 172.21.15.103:0/4099408462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87280cc120 0x7f87281fa810 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:25.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.767+0000 7f872dc00640 1 -- 172.21.15.103:0/4099408462 >> 172.21.15.103:0/4099408462 conn(0x7f872806cc00 msgr2=0x7f87280af970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:25.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.767+0000 7f872dc00640 1 -- 172.21.15.103:0/4099408462 shutdown_connections 2024-09-10T22:42:25.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:25.767+0000 7f872dc00640 1 -- 172.21.15.103:0/4099408462 wait complete. 2024-09-10T22:42:26.191 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:42:16.725541+0000', 'modified': '2024-09-10T22:42:25.386632+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 6285, 'mds_1': 6276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6276': {'gid': 6276, 'name': 'c', 'rank': 1, 'incarnation': 56, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.103:6833/4171945106', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6832', 'nonce': 4171945106}, {'type': 'v1', 'addr': '172.21.15.103:6833', 'nonce': 4171945106}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_6285': {'gid': 6285, 'name': 'a', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/714242556', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6834', 'nonce': 714242556}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 714242556}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6285, 'qdb_cluster': [6285]} 2024-09-10T22:42:26.191 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6276:up:creating 2024-09-10T22:42:27.192 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:42:27.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f784a400640 1 -- 172.21.15.103:0/1850999929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78440cf260 msgr2=0x7f78440b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:27.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f784a400640 1 --2- 172.21.15.103:0/1850999929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78440cf260 0x7f78440b2c10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f78440b4f10 tx=0x7f783401dbf0 comp rx=0 tx=0).stop 2024-09-10T22:42:27.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f784a400640 1 -- 172.21.15.103:0/1850999929 shutdown_connections 2024-09-10T22:42:27.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f784a400640 1 --2- 172.21.15.103:0/1850999929 >> v2:172.21.15.131:3300/0 conn(0x7f78440b3150 0x7f7844072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:27.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f784a400640 1 --2- 172.21.15.103:0/1850999929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78440cf260 0x7f78440b2c10 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:27.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f784a400640 1 -- 172.21.15.103:0/1850999929 >> 172.21.15.103:0/1850999929 conn(0x7f784406cc00 msgr2=0x7f784406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:27.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f784a400640 1 -- 172.21.15.103:0/1850999929 shutdown_connections 2024-09-10T22:42:27.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f784a400640 1 -- 172.21.15.103:0/1850999929 wait complete. 2024-09-10T22:42:27.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f784a400640 1 Processor -- start 2024-09-10T22:42:27.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f784a400640 1 -- start start 2024-09-10T22:42:27.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f784a400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7844072a40 0x7f784414fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:27.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f784a400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78440b3150 0x7f7844149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:27.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f784a400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78440cf260 0x7f78440b1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:27.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f784a400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f784406e800 con 0x7f78440b3150 2024-09-10T22:42:27.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f784a400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7844157e20 con 0x7f7844072a40 2024-09-10T22:42:27.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f784a400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f784406e980 con 0x7f78440cf260 2024-09-10T22:42:27.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f7842a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78440b3150 0x7f7844149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:27.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f7842a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78440b3150 0x7f7844149640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39216/0 (socket says 172.21.15.103:39216) 2024-09-10T22:42:27.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f7842a00640 1 -- 172.21.15.103:0/336197419 learned_addr learned my addr 172.21.15.103:0/336197419 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:27.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f7843400640 1 --2- 172.21.15.103:0/336197419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7844072a40 0x7f784414fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:27.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f7843e00640 1 --2- 172.21.15.103:0/336197419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78440cf260 0x7f78440b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:27.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f7842a00640 1 -- 172.21.15.103:0/336197419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78440cf260 msgr2=0x7f78440b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:27.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f7842a00640 1 --2- 172.21.15.103:0/336197419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78440cf260 0x7f78440b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:27.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f7842a00640 1 -- 172.21.15.103:0/336197419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7844072a40 msgr2=0x7f784414fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:27.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f7842a00640 1 --2- 172.21.15.103:0/336197419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7844072a40 0x7f784414fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:27.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.343+0000 7f7842a00640 1 -- 172.21.15.103:0/336197419 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7844151a90 con 0x7f78440b3150 2024-09-10T22:42:27.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.347+0000 7f7842a00640 1 --2- 172.21.15.103:0/336197419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78440b3150 0x7f7844149640 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f783000d9b0 tx=0x7f783000de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:27.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.347+0000 7f783b400640 1 -- 172.21.15.103:0/336197419 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830017070 con 0x7f78440b3150 2024-09-10T22:42:27.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.347+0000 7f783b400640 1 -- 172.21.15.103:0/336197419 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7830004310 con 0x7f78440b3150 2024-09-10T22:42:27.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.347+0000 7f783b400640 1 -- 172.21.15.103:0/336197419 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830009c30 con 0x7f78440b3150 2024-09-10T22:42:27.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.347+0000 7f784a400640 1 -- 172.21.15.103:0/336197419 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f784414cd10 con 0x7f78440b3150 2024-09-10T22:42:27.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.347+0000 7f784a400640 1 -- 172.21.15.103:0/336197419 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f784414d2d0 con 0x7f78440b3150 2024-09-10T22:42:27.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.347+0000 7f784a400640 1 -- 172.21.15.103:0/336197419 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7844072500 con 0x7f78440b3150 2024-09-10T22:42:27.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.347+0000 7f783b400640 1 -- 172.21.15.103:0/336197419 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7830023060 con 0x7f78440b3150 2024-09-10T22:42:27.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.347+0000 7f783b400640 1 --2- 172.21.15.103:0/336197419 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7824072610 0x7f7824074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:27.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.347+0000 7f783b400640 1 -- 172.21.15.103:0/336197419 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f7830092ea0 con 0x7f78440b3150 2024-09-10T22:42:27.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.347+0000 7f7843400640 1 --2- 172.21.15.103:0/336197419 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7824072610 0x7f7824074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:27.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.351+0000 7f7843400640 1 --2- 172.21.15.103:0/336197419 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7824072610 0x7f7824074ad0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f78340b0000 tx=0x7f783401c430 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:27.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.351+0000 7f783b400640 1 -- 172.21.15.103:0/336197419 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f783005dd00 con 0x7f78440b3150 2024-09-10T22:42:27.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.555+0000 7f784a400640 1 -- 172.21.15.103:0/336197419 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78440ae7e0 con 0x7f78440b3150 2024-09-10T22:42:27.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.559+0000 7f783b400640 1 -- 172.21.15.103:0/336197419 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5268 (secure 0 0 0) 0x7f7830062730 con 0x7f78440b3150 2024-09-10T22:42:27.576 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:27.576 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":59,"btime":"2024-09-10T22:42:27:402561+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2961968581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2961968581},{"type":"v1","addr":"172.21.15.131:6835","nonce":2961968581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:42:16.725541+0000","modified":"2024-09-10T22:42:27.402557+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6285,"mds_1":6276,"mds_2":5630},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5630":{"gid":5630,"name":"b","rank":2,"incarnation":58,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6837/360467048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":360467048},{"type":"v1","addr":"172.21.15.131:6837","nonce":360467048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6276":{"gid":6276,"name":"c","rank":1,"incarnation":56,"state":"up:active","state_seq":5,"addr":"172.21.15.103:6833/4171945106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4171945106},{"type":"v1","addr":"172.21.15.103:6833","nonce":4171945106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/714242556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":714242556},{"type":"v1","addr":"172.21.15.103:6835","nonce":714242556}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6285,"qdb_cluster":[5630,6276,6285]},"id":4}]} 2024-09-10T22:42:27.576 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 59 2024-09-10T22:42:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.559+0000 7f784a400640 1 -- 172.21.15.103:0/336197419 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7824072610 msgr2=0x7f7824074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.559+0000 7f784a400640 1 --2- 172.21.15.103:0/336197419 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7824072610 0x7f7824074ad0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f78340b0000 tx=0x7f783401c430 comp rx=0 tx=0).stop 2024-09-10T22:42:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.559+0000 7f784a400640 1 -- 172.21.15.103:0/336197419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78440b3150 msgr2=0x7f7844149640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.559+0000 7f784a400640 1 --2- 172.21.15.103:0/336197419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78440b3150 0x7f7844149640 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f783000d9b0 tx=0x7f783000de70 comp rx=0 tx=0).stop 2024-09-10T22:42:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.559+0000 7f784a400640 1 -- 172.21.15.103:0/336197419 shutdown_connections 2024-09-10T22:42:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.559+0000 7f784a400640 1 --2- 172.21.15.103:0/336197419 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7824072610 0x7f7824074ad0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.559+0000 7f784a400640 1 --2- 172.21.15.103:0/336197419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78440cf260 0x7f78440b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.559+0000 7f784a400640 1 --2- 172.21.15.103:0/336197419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78440b3150 0x7f7844149640 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.559+0000 7f784a400640 1 --2- 172.21.15.103:0/336197419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7844072a40 0x7f784414fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.559+0000 7f784a400640 1 -- 172.21.15.103:0/336197419 >> 172.21.15.103:0/336197419 conn(0x7f784406cc00 msgr2=0x7f784406cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.559+0000 7f784a400640 1 -- 172.21.15.103:0/336197419 shutdown_connections 2024-09-10T22:42:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:27.559+0000 7f784a400640 1 -- 172.21.15.103:0/336197419 wait complete. 2024-09-10T22:42:27.985 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:42:16.725541+0000', 'modified': '2024-09-10T22:42:27.402557+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 6285, 'mds_1': 6276, 'mds_2': 5630}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5630': {'gid': 5630, 'name': 'b', 'rank': 2, 'incarnation': 58, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.131:6837/360467048', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6836', 'nonce': 360467048}, {'type': 'v1', 'addr': '172.21.15.131:6837', 'nonce': 360467048}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_6276': {'gid': 6276, 'name': 'c', 'rank': 1, 'incarnation': 56, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.103:6833/4171945106', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6832', 'nonce': 4171945106}, {'type': 'v1', 'addr': '172.21.15.103:6833', 'nonce': 4171945106}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_6285': {'gid': 6285, 'name': 'a', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/714242556', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6834', 'nonce': 714242556}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 714242556}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6285, 'qdb_cluster': [5630, 6276, 6285]} 2024-09-10T22:42:27.986 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T22:42:27.986 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-10T22:42:28.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c9b400640 1 -- 172.21.15.103:0/1021797618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c940d02c0 msgr2=0x7f9c94165a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c9b400640 1 --2- 172.21.15.103:0/1021797618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c940d02c0 0x7f9c94165a30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009c80 tx=0x7f9c8c01cd10 comp rx=0 tx=0).stop 2024-09-10T22:42:28.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c9b400640 1 -- 172.21.15.103:0/1021797618 shutdown_connections 2024-09-10T22:42:28.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c9b400640 1 --2- 172.21.15.103:0/1021797618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c940d02c0 0x7f9c94165a30 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c9b400640 1 --2- 172.21.15.103:0/1021797618 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9c940d1460 0x7f9c941634e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c9b400640 1 -- 172.21.15.103:0/1021797618 >> 172.21.15.103:0/1021797618 conn(0x7f9c940d0940 msgr2=0x7f9c940d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c9b400640 1 -- 172.21.15.103:0/1021797618 shutdown_connections 2024-09-10T22:42:28.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c9b400640 1 -- 172.21.15.103:0/1021797618 wait complete. 2024-09-10T22:42:28.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c9b400640 1 Processor -- start 2024-09-10T22:42:28.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c9b400640 1 -- start start 2024-09-10T22:42:28.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c9b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c9406cc00 0x7f9c94147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c9b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c940d02c0 0x7f9c941f8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c9b400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9c940d1460 0x7f9c940709f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c9b400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9c94168d90 con 0x7f9c9406cc00 2024-09-10T22:42:28.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c9b400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9c94168c10 con 0x7f9c940d02c0 2024-09-10T22:42:28.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c9b400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9c94168f10 con 0x7f9c940d1460 2024-09-10T22:42:28.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c98a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c9406cc00 0x7f9c94147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c98a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c9406cc00 0x7f9c94147d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39230/0 (socket says 172.21.15.103:39230) 2024-09-10T22:42:28.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.127+0000 7f9c98a00640 1 -- 172.21.15.103:0/3460459805 learned_addr learned my addr 172.21.15.103:0/3460459805 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:28.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.131+0000 7f9c8be00640 1 --2- 172.21.15.103:0/3460459805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c940d02c0 0x7f9c941f8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.131+0000 7f9c99400640 1 --2- 172.21.15.103:0/3460459805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9c940d1460 0x7f9c940709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.131+0000 7f9c98a00640 1 -- 172.21.15.103:0/3460459805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9c940d1460 msgr2=0x7f9c940709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.131+0000 7f9c98a00640 1 --2- 172.21.15.103:0/3460459805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9c940d1460 0x7f9c940709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.131+0000 7f9c98a00640 1 -- 172.21.15.103:0/3460459805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c940d02c0 msgr2=0x7f9c941f8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.131+0000 7f9c98a00640 1 --2- 172.21.15.103:0/3460459805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c940d02c0 0x7f9c941f8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.131+0000 7f9c98a00640 1 -- 172.21.15.103:0/3460459805 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c941f9330 con 0x7f9c9406cc00 2024-09-10T22:42:28.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.131+0000 7f9c8be00640 1 --2- 172.21.15.103:0/3460459805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c940d02c0 0x7f9c941f8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:28.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.131+0000 7f9c98a00640 1 --2- 172.21.15.103:0/3460459805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c9406cc00 0x7f9c94147d50 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400c500 tx=0x7f9c8400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.131+0000 7f9c91600640 1 -- 172.21.15.103:0/3460459805 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c84017070 con 0x7f9c9406cc00 2024-09-10T22:42:28.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.131+0000 7f9c91600640 1 -- 172.21.15.103:0/3460459805 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c840053c0 con 0x7f9c9406cc00 2024-09-10T22:42:28.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.131+0000 7f9c91600640 1 -- 172.21.15.103:0/3460459805 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c84012890 con 0x7f9c9406cc00 2024-09-10T22:42:28.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.131+0000 7f9c9b400640 1 -- 172.21.15.103:0/3460459805 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c9406f5d0 con 0x7f9c9406cc00 2024-09-10T22:42:28.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.131+0000 7f9c9b400640 1 -- 172.21.15.103:0/3460459805 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c9406fb70 con 0x7f9c9406cc00 2024-09-10T22:42:28.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.131+0000 7f9c91600640 1 -- 172.21.15.103:0/3460459805 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9c84003600 con 0x7f9c9406cc00 2024-09-10T22:42:28.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.131+0000 7f9c91600640 1 --2- 172.21.15.103:0/3460459805 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9c700725e0 0x7f9c70074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c91600640 1 -- 172.21.15.103:0/3460459805 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f9c84092a20 con 0x7f9c9406cc00 2024-09-10T22:42:28.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c9e8ac000 1 Processor -- start 2024-09-10T22:42:28.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c8be00640 1 --2- 172.21.15.103:0/3460459805 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9c700725e0 0x7f9c70074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c9e8ac000 1 -- start start 2024-09-10T22:42:28.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c8be00640 1 --2- 172.21.15.103:0/3460459805 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9c700725e0 0x7f9c70074aa0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c005fd0 tx=0x7f9c7c00a540 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c9e8ac000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97c279d0 0x558c97c27db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c9e8ac000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97c282f0 0x558c97bdb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c9e8ac000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97bdbe10 0x558c97bdc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c9e8ac000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558c97afc3f0 con 0x558c97bdbe10 2024-09-10T22:42:28.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c9e8ac000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x558c97a39b20 con 0x558c97c282f0 2024-09-10T22:42:28.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c9e8ac000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x558c97a28f50 con 0x558c97c279d0 2024-09-10T22:42:28.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c99400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97bdbe10 0x558c97bdc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c99400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97bdbe10 0x558c97bdc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39246/0 (socket says 172.21.15.103:39246) 2024-09-10T22:42:28.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c99400640 1 -- 172.21.15.103:0/1933199953 learned_addr learned my addr 172.21.15.103:0/1933199953 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:28.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c98a00640 1 --2- 172.21.15.103:0/1933199953 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97c279d0 0x558c97c27db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c8be00640 1 --2- 172.21.15.103:0/1933199953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97c282f0 0x558c97bdb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c99400640 1 -- 172.21.15.103:0/1933199953 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97c279d0 msgr2=0x558c97c27db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c99400640 1 --2- 172.21.15.103:0/1933199953 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97c279d0 0x558c97c27db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c99400640 1 -- 172.21.15.103:0/1933199953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97c282f0 msgr2=0x558c97bdb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c99400640 1 --2- 172.21.15.103:0/1933199953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97c282f0 0x558c97bdb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c99400640 1 -- 172.21.15.103:0/1933199953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c979f0590 con 0x558c97bdbe10 2024-09-10T22:42:28.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c99400640 1 --2- 172.21.15.103:0/1933199953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97bdbe10 0x558c97bdc1f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009bd0 tx=0x7f9c8c01b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a9e202c5c43e63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c89600640 1 -- 172.21.15.103:0/1933199953 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c0b2040 con 0x558c97bdbe10 2024-09-10T22:42:28.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c89600640 1 -- 172.21.15.103:0/1933199953 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c8c0a5c60 con 0x558c97bdbe10 2024-09-10T22:42:28.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c89600640 1 -- 172.21.15.103:0/1933199953 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c004cb0 con 0x558c97bdbe10 2024-09-10T22:42:28.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/1933199953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97bdbe10 msgr2=0x558c97bdc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/1933199953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97bdbe10 0x558c97bdc1f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009bd0 tx=0x7f9c8c01b550 comp rx=0 tx=0).stop 2024-09-10T22:42:28.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/1933199953 shutdown_connections 2024-09-10T22:42:28.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/1933199953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97bdbe10 0x558c97bdc1f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/1933199953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97c282f0 0x558c97bdb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/1933199953 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97c279d0 0x558c97c27db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/1933199953 >> 172.21.15.103:0/1933199953 conn(0x558c97ac5130 msgr2=0x558c97c0ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/1933199953 shutdown_connections 2024-09-10T22:42:28.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/1933199953 wait complete. 2024-09-10T22:42:28.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.135+0000 7f9c9e8ac000 1 -- start start 2024-09-10T22:42:28.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c9e8ac000 1 Processor -- start 2024-09-10T22:42:28.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c9e8ac000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97bdbe10 0x558c97c086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c9e8ac000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97c279d0 0x558c97c08e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c9e8ac000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c282f0 0x558c97c093b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c9e8ac000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558c979c35d0 con 0x558c97c282f0 2024-09-10T22:42:28.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c9e8ac000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x558c97a2cd60 con 0x558c97bdbe10 2024-09-10T22:42:28.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c9e8ac000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x558c979cf500 con 0x558c97c279d0 2024-09-10T22:42:28.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c9e8ac000 10 client.0 _ll_register_callbacks cb 0x558c979d3810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:42:28.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c99400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c282f0 0x558c97c093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c99400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c282f0 0x558c97c093b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39248/0 (socket says 172.21.15.103:39248) 2024-09-10T22:42:28.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c99400640 1 -- 172.21.15.103:0/4008072194 learned_addr learned my addr 172.21.15.103:0/4008072194 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:28.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c98a00640 1 --2- 172.21.15.103:0/4008072194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97bdbe10 0x558c97c086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c8be00640 1 --2- 172.21.15.103:0/4008072194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97c279d0 0x558c97c08e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c99400640 1 -- 172.21.15.103:0/4008072194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97c279d0 msgr2=0x558c97c08e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c99400640 1 --2- 172.21.15.103:0/4008072194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97c279d0 0x558c97c08e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c99400640 1 -- 172.21.15.103:0/4008072194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97bdbe10 msgr2=0x558c97c086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c99400640 1 --2- 172.21.15.103:0/4008072194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97bdbe10 0x558c97c086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c99400640 1 -- 172.21.15.103:0/4008072194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c979c7170 con 0x558c97c282f0 2024-09-10T22:42:28.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c99400640 1 --2- 172.21.15.103:0/4008072194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c282f0 0x558c97c093b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009bd0 tx=0x7f9c8c004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c5543a85260975 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c82000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:42:28.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c82000640 1 -- 172.21.15.103:0/4008072194 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c0b2070 con 0x558c97c282f0 2024-09-10T22:42:28.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/4008072194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558c979c10f0 con 0x558c97c282f0 2024-09-10T22:42:28.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c82000640 1 -- 172.21.15.103:0/4008072194 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f9c8c0a5b70 con 0x558c97c282f0 2024-09-10T22:42:28.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c82000640 1 -- 172.21.15.103:0/4008072194 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f9c8c0c8050 con 0x558c97c282f0 2024-09-10T22:42:28.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c9e8ac000 10 client.6453 fetch_fsmap learned FSMap version 59 2024-09-10T22:42:28.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/4008072194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) -- 0x558c97aadef0 con 0x558c97c282f0 2024-09-10T22:42:28.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c82000640 1 -- 172.21.15.103:0/4008072194 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x558c979c10f0 con 0x558c97c282f0 2024-09-10T22:42:28.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c82000640 1 -- 172.21.15.103:0/4008072194 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 59) ==== 3542+0+0 (secure 0 0 0) 0x7f9c8c0cb020 con 0x558c97c282f0 2024-09-10T22:42:28.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c9e8ac000 10 client.6453 fetch_fsmap finished waiting for FSMap version 59 2024-09-10T22:42:28.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c9e8ac000 10 client.6453 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T22:42:28.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c9e8ac000 20 client.6453 populate_metadata read hostname 'smithi103' 2024-09-10T22:42:28.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/4008072194 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x558c97c0a0f0 0x558c97c39c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c9e8ac000 4 client.6453 mds_command: new command op to 5630 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:42:28.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/4008072194 --> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c97a3ba70 con 0x558c97c0a0f0 2024-09-10T22:42:28.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c98a00640 1 --2- 172.21.15.103:0/4008072194 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x558c97c0a0f0 0x558c97c39c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c98a00640 1 --2- 172.21.15.103:0/4008072194 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x558c97c0a0f0 0x558c97c39c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d882f93b1b68aaa1 server_cookie=c42f3f7063220019 in_seq=0 out_seq=0 2024-09-10T22:42:28.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.139+0000 7f9c82000640 10 client.6453 ms_handle_connect on v2:172.21.15.131:6836/360467048 2024-09-10T22:42:28.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.143+0000 7f9c82000640 1 -- 172.21.15.103:0/4008072194 <== mds.2 v2:172.21.15.131:6836/360467048 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558c97a3ba70 con 0x558c97c0a0f0 2024-09-10T22:42:28.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.143+0000 7f9c82000640 10 client.6453 handle_command_reply: tid=0 2024-09-10T22:42:28.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.143+0000 7f9c9e8ac000 1 client.6453 shutdown 2024-09-10T22:42:28.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.143+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/4008072194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c282f0 msgr2=0x558c97c093b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.143+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/4008072194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c282f0 0x558c97c093b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009bd0 tx=0x7f9c8c004dc0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.143+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/4008072194 shutdown_connections 2024-09-10T22:42:28.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.143+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/4008072194 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x558c97c0a0f0 0x558c97c39c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.143+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/4008072194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c282f0 0x558c97c093b0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.143+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/4008072194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97c279d0 0x558c97c08e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.143+0000 7f9c82000640 0 client.6453 ms_handle_reset on v2:172.21.15.131:6836/360467048 2024-09-10T22:42:28.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.143+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/4008072194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97bdbe10 0x558c97c086a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.143+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/4008072194 >> 172.21.15.103:0/4008072194 conn(0x558c97ac5130 msgr2=0x558c97bdafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.143+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/4008072194 shutdown_connections 2024-09-10T22:42:28.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.143+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/4008072194 wait complete. 2024-09-10T22:42:28.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.143+0000 7f9c9e8ac000 20 client.6453 trim_cache size 0 max 16384 2024-09-10T22:42:28.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.159+0000 7f9c9e8ac000 1 Processor -- start 2024-09-10T22:42:28.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.159+0000 7f9c9e8ac000 1 -- start start 2024-09-10T22:42:28.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c9e8ac000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97bdbe10 0x558c97c26cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c9e8ac000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97c279d0 0x558c97c27200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c9e8ac000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c282f0 0x558c97bda0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c9e8ac000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9c94202300 con 0x558c97c282f0 2024-09-10T22:42:28.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c9e8ac000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9414d1b0 con 0x558c97c279d0 2024-09-10T22:42:28.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c9e8ac000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9c9414d880 con 0x558c97bdbe10 2024-09-10T22:42:28.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c99400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c282f0 0x558c97bda0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c99400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c282f0 0x558c97bda0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39262/0 (socket says 172.21.15.103:39262) 2024-09-10T22:42:28.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c99400640 1 -- 172.21.15.103:0/2660917936 learned_addr learned my addr 172.21.15.103:0/2660917936 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:28.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c8be00640 1 --2- 172.21.15.103:0/2660917936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97c279d0 0x558c97c27200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c98a00640 1 --2- 172.21.15.103:0/2660917936 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97bdbe10 0x558c97c26cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c99400640 1 -- 172.21.15.103:0/2660917936 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97bdbe10 msgr2=0x558c97c26cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c99400640 1 --2- 172.21.15.103:0/2660917936 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97bdbe10 0x558c97c26cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c99400640 1 -- 172.21.15.103:0/2660917936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97c279d0 msgr2=0x558c97c27200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c99400640 1 --2- 172.21.15.103:0/2660917936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97c279d0 0x558c97c27200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c99400640 1 -- 172.21.15.103:0/2660917936 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c97a84d90 con 0x558c97c282f0 2024-09-10T22:42:28.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c99400640 1 --2- 172.21.15.103:0/2660917936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c282f0 0x558c97bda0a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c01cd50 tx=0x7f9c8c003a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1d3a9b2b73a2a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c88c00640 1 -- 172.21.15.103:0/2660917936 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c0b2040 con 0x558c97c282f0 2024-09-10T22:42:28.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c88c00640 1 -- 172.21.15.103:0/2660917936 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c8c0b7470 con 0x558c97c282f0 2024-09-10T22:42:28.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c88c00640 1 -- 172.21.15.103:0/2660917936 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c0b78c0 con 0x558c97c282f0 2024-09-10T22:42:28.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/2660917936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c282f0 msgr2=0x558c97bda0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/2660917936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c282f0 0x558c97bda0a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c01cd50 tx=0x7f9c8c003a20 comp rx=0 tx=0).stop 2024-09-10T22:42:28.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/2660917936 shutdown_connections 2024-09-10T22:42:28.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/2660917936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c282f0 0x558c97bda0a0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/2660917936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97c279d0 0x558c97c27200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/2660917936 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97bdbe10 0x558c97c26cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/2660917936 >> 172.21.15.103:0/2660917936 conn(0x558c97ac5130 msgr2=0x558c97c265b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/2660917936 shutdown_connections 2024-09-10T22:42:28.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/2660917936 wait complete. 2024-09-10T22:42:28.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c9e8ac000 1 -- start start 2024-09-10T22:42:28.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.163+0000 7f9c9e8ac000 1 Processor -- start 2024-09-10T22:42:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97bdbe10 0x558c97c9dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c279d0 0x558c97c9e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97c282f0 0x558c97c9e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558c979f4ec0 con 0x558c97c279d0 2024-09-10T22:42:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9414efa0 con 0x558c97bdbe10 2024-09-10T22:42:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x558c979c35d0 con 0x558c97c282f0 2024-09-10T22:42:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 10 client.0 _ll_register_callbacks cb 0x7f9c7c014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:42:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c8be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c279d0 0x558c97c9e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c8be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c279d0 0x558c97c9e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39272/0 (socket says 172.21.15.103:39272) 2024-09-10T22:42:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c8be00640 1 -- 172.21.15.103:0/3039846709 learned_addr learned my addr 172.21.15.103:0/3039846709 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c99400640 1 --2- 172.21.15.103:0/3039846709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97c282f0 0x558c97c9e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c98a00640 1 --2- 172.21.15.103:0/3039846709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97bdbe10 0x558c97c9dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c8be00640 1 -- 172.21.15.103:0/3039846709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97c282f0 msgr2=0x558c97c9e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c8be00640 1 --2- 172.21.15.103:0/3039846709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97c282f0 0x558c97c9e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c8be00640 1 -- 172.21.15.103:0/3039846709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97bdbe10 msgr2=0x558c97c9dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c8be00640 1 --2- 172.21.15.103:0/3039846709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97bdbe10 0x558c97c9dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c8be00640 1 -- 172.21.15.103:0/3039846709 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c979efa90 con 0x558c97c279d0 2024-09-10T22:42:28.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c8be00640 1 --2- 172.21.15.103:0/3039846709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c279d0 0x558c97c9e140 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9c940b0530 tx=0x7f9c7c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab83c6d802fea66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c82000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:42:28.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c82000640 1 -- 172.21.15.103:0/3039846709 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c010dc0 con 0x558c97c279d0 2024-09-10T22:42:28.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c82000640 1 -- 172.21.15.103:0/3039846709 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f9c7c004020 con 0x558c97c279d0 2024-09-10T22:42:28.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/3039846709 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c8c0b7470 con 0x558c97c279d0 2024-09-10T22:42:28.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c82000640 1 -- 172.21.15.103:0/3039846709 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f9c7c034050 con 0x558c97c279d0 2024-09-10T22:42:28.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 10 client.6459 fetch_fsmap learned FSMap version 59 2024-09-10T22:42:28.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/3039846709 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) -- 0x558c979ce050 con 0x558c97c279d0 2024-09-10T22:42:28.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c82000640 1 -- 172.21.15.103:0/3039846709 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c8c0b7470 con 0x558c97c279d0 2024-09-10T22:42:28.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c82000640 1 -- 172.21.15.103:0/3039846709 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 59) ==== 3542+0+0 (secure 0 0 0) 0x7f9c7c037020 con 0x558c97c279d0 2024-09-10T22:42:28.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 10 client.6459 fetch_fsmap finished waiting for FSMap version 59 2024-09-10T22:42:28.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 10 client.6459 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T22:42:28.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 20 client.6459 populate_metadata read hostname 'smithi103' 2024-09-10T22:42:28.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/3039846709 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x558c97c3d050 0x558c97ca6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 4 client.6459 mds_command: new command op to 5630 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:42:28.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/3039846709 --> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] -- command(tid 0: {"prefix": "status"}) -- 0x558c97a37520 con 0x558c97c3d050 2024-09-10T22:42:28.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c98a00640 1 --2- 172.21.15.103:0/3039846709 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x558c97c3d050 0x558c97ca6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c98a00640 1 --2- 172.21.15.103:0/3039846709 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x558c97c3d050 0x558c97ca6e60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1d50b3f1c56939ad server_cookie=9b8f5a39d29e2de0 in_seq=0 out_seq=0 2024-09-10T22:42:28.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c82000640 10 client.6459 ms_handle_connect on v2:172.21.15.131:6836/360467048 2024-09-10T22:42:28.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c82000640 1 -- 172.21.15.103:0/3039846709 <== mds.2 v2:172.21.15.131:6836/360467048 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x558c97a37520 con 0x558c97c3d050 2024-09-10T22:42:28.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c82000640 10 client.6459 handle_command_reply: tid=0 2024-09-10T22:42:28.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 client.6459 shutdown 2024-09-10T22:42:28.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/3039846709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c279d0 msgr2=0x558c97c9e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/3039846709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c279d0 0x558c97c9e140 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9c940b0530 tx=0x7f9c7c004740 comp rx=0 tx=0).stop 2024-09-10T22:42:28.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/3039846709 shutdown_connections 2024-09-10T22:42:28.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/3039846709 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x558c97c3d050 0x558c97ca6e60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/3039846709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c97c282f0 0x558c97c9e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/3039846709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558c97c279d0 0x558c97c9e140 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 --2- 172.21.15.103:0/3039846709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c97bdbe10 0x558c97c9dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c82000640 0 client.6459 ms_handle_reset on v2:172.21.15.131:6836/360467048 2024-09-10T22:42:28.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/3039846709 >> 172.21.15.103:0/3039846709 conn(0x558c97ac5130 msgr2=0x558c97bda0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/3039846709 shutdown_connections 2024-09-10T22:42:28.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 1 -- 172.21.15.103:0/3039846709 wait complete. 2024-09-10T22:42:28.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.167+0000 7f9c9e8ac000 20 client.6459 trim_cache size 0 max 16384 2024-09-10T22:42:28.177 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:42:28.178 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:42:28.178 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 2, 2024-09-10T22:42:28.178 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5630, 2024-09-10T22:42:28.178 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:42:28.178 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:42:28.178 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:42:28.178 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 1.7679082800000001, 2024-09-10T22:42:28.178 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 59, 2024-09-10T22:42:28.178 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 68, 2024-09-10T22:42:28.178 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 68, 2024-09-10T22:42:28.178 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 15.346265386000001 2024-09-10T22:42:28.178 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:42:28.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.171+0000 7f9c9b400640 1 -- 172.21.15.103:0/3460459805 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9c700725e0 msgr2=0x7f9c70074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.171+0000 7f9c9b400640 1 --2- 172.21.15.103:0/3460459805 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9c700725e0 0x7f9c70074aa0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c005fd0 tx=0x7f9c7c00a540 comp rx=0 tx=0).stop 2024-09-10T22:42:28.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.171+0000 7f9c9b400640 1 -- 172.21.15.103:0/3460459805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c9406cc00 msgr2=0x7f9c94147d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.171+0000 7f9c9b400640 1 --2- 172.21.15.103:0/3460459805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c9406cc00 0x7f9c94147d50 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400c500 tx=0x7f9c8400c9c0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.171+0000 7f9c9b400640 1 -- 172.21.15.103:0/3460459805 shutdown_connections 2024-09-10T22:42:28.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.171+0000 7f9c9b400640 1 --2- 172.21.15.103:0/3460459805 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9c700725e0 0x7f9c70074aa0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.171+0000 7f9c9b400640 1 --2- 172.21.15.103:0/3460459805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9c940d1460 0x7f9c940709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.171+0000 7f9c9b400640 1 --2- 172.21.15.103:0/3460459805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c940d02c0 0x7f9c941f8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.171+0000 7f9c9b400640 1 --2- 172.21.15.103:0/3460459805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c9406cc00 0x7f9c94147d50 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.171+0000 7f9c9b400640 1 -- 172.21.15.103:0/3460459805 >> 172.21.15.103:0/3460459805 conn(0x7f9c940d0940 msgr2=0x7f9c9414c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.171+0000 7f9c9b400640 1 -- 172.21.15.103:0/3460459805 shutdown_connections 2024-09-10T22:42:28.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.171+0000 7f9c9b400640 1 -- 172.21.15.103:0/3460459805 wait complete. 2024-09-10T22:42:28.192 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T22:42:28.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f52400640 1 -- 172.21.15.103:0/118834649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f30003a10 msgr2=0x7f3f30003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f52400640 1 --2- 172.21.15.103:0/118834649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f30003a10 0x7f3f30003e30 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00c2e0 tx=0x7f3f3c01cfc0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f4be00640 1 -- 172.21.15.103:0/118834649 reap_dead start 2024-09-10T22:42:28.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f52400640 1 -- 172.21.15.103:0/118834649 shutdown_connections 2024-09-10T22:42:28.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f52400640 1 -- 172.21.15.103:0/118834649 >> 172.21.15.103:0/118834649 conn(0x7f3f4c0d1ac0 msgr2=0x7f3f4c0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f52400640 1 -- 172.21.15.103:0/118834649 shutdown_connections 2024-09-10T22:42:28.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f52400640 1 -- 172.21.15.103:0/118834649 wait complete. 2024-09-10T22:42:28.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f52400640 1 Processor -- start 2024-09-10T22:42:28.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f52400640 1 -- start start 2024-09-10T22:42:28.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f52400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f30003a10 0x7f3f4c0712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f52400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f4c0b7110 0x7f3f4c155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f52400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f4c0b35b0 0x7f3f4c0b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f52400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c0af960 con 0x7f3f4c0b35b0 2024-09-10T22:42:28.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f52400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c0af7e0 con 0x7f3f30003a10 2024-09-10T22:42:28.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f52400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3f4c0afae0 con 0x7f3f4c0b7110 2024-09-10T22:42:28.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f4be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f4c0b35b0 0x7f3f4c0b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f4be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f4c0b35b0 0x7f3f4c0b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39286/0 (socket says 172.21.15.103:39286) 2024-09-10T22:42:28.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f4be00640 1 -- 172.21.15.103:0/1052209791 learned_addr learned my addr 172.21.15.103:0/1052209791 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:28.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f42a00640 1 --2- 172.21.15.103:0/1052209791 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f4c0b7110 0x7f3f4c155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f4b400640 1 --2- 172.21.15.103:0/1052209791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f30003a10 0x7f3f4c0712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f4be00640 1 -- 172.21.15.103:0/1052209791 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f4c0b7110 msgr2=0x7f3f4c155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f4be00640 1 --2- 172.21.15.103:0/1052209791 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f4c0b7110 0x7f3f4c155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f4be00640 1 -- 172.21.15.103:0/1052209791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f30003a10 msgr2=0x7f3f4c0712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f4be00640 1 --2- 172.21.15.103:0/1052209791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f30003a10 0x7f3f4c0712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.335+0000 7f3f4be00640 1 -- 172.21.15.103:0/1052209791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c0b6550 con 0x7f3f4c0b35b0 2024-09-10T22:42:28.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.339+0000 7f3f4be00640 1 --2- 172.21.15.103:0/1052209791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f4c0b35b0 0x7f3f4c0b3a60 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0b3580 tx=0x7f3f44011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.339+0000 7f3f43e00640 1 -- 172.21.15.103:0/1052209791 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f44004b30 con 0x7f3f4c0b35b0 2024-09-10T22:42:28.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.339+0000 7f3f43e00640 1 -- 172.21.15.103:0/1052209791 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f44004cd0 con 0x7f3f4c0b35b0 2024-09-10T22:42:28.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.339+0000 7f3f43e00640 1 -- 172.21.15.103:0/1052209791 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f44003be0 con 0x7f3f4c0b35b0 2024-09-10T22:42:28.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.339+0000 7f3f52400640 1 -- 172.21.15.103:0/1052209791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4c0b6830 con 0x7f3f4c0b35b0 2024-09-10T22:42:28.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.339+0000 7f3f52400640 1 -- 172.21.15.103:0/1052209791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4c156080 con 0x7f3f4c0b35b0 2024-09-10T22:42:28.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.339+0000 7f3f43e00640 1 -- 172.21.15.103:0/1052209791 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3f44018070 con 0x7f3f4c0b35b0 2024-09-10T22:42:28.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.339+0000 7f3f43e00640 1 --2- 172.21.15.103:0/1052209791 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3f28072610 0x7f3f28074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.339+0000 7f3f43e00640 1 -- 172.21.15.103:0/1052209791 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f3f44093b20 con 0x7f3f4c0b35b0 2024-09-10T22:42:28.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.339+0000 7f3f5580c000 1 Processor -- start 2024-09-10T22:42:28.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f4b400640 1 --2- 172.21.15.103:0/1052209791 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3f28072610 0x7f3f28074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f5580c000 1 -- start start 2024-09-10T22:42:28.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f4b400640 1 --2- 172.21.15.103:0/1052209791 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3f28072610 0x7f3f28074ad0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0ac000 tx=0x7f3f3c019e00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f5580c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a2769d0 0x562d4a276db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f5580c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2772f0 0x562d4a22a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f5580c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a22ae10 0x562d4a22b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f5580c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562d4a14b3f0 con 0x562d4a2772f0 2024-09-10T22:42:28.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f5580c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562d4a088b20 con 0x562d4a2769d0 2024-09-10T22:42:28.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f5580c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x562d4a077f50 con 0x562d4a22ae10 2024-09-10T22:42:28.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f42a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2772f0 0x562d4a22a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f42a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2772f0 0x562d4a22a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39294/0 (socket says 172.21.15.103:39294) 2024-09-10T22:42:28.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f42a00640 1 -- 172.21.15.103:0/2114947430 learned_addr learned my addr 172.21.15.103:0/2114947430 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:28.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f4b400640 1 --2- 172.21.15.103:0/2114947430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a2769d0 0x562d4a276db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f4be00640 1 --2- 172.21.15.103:0/2114947430 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a22ae10 0x562d4a22b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f42a00640 1 -- 172.21.15.103:0/2114947430 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a22ae10 msgr2=0x562d4a22b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f42a00640 1 --2- 172.21.15.103:0/2114947430 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a22ae10 0x562d4a22b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f42a00640 1 -- 172.21.15.103:0/2114947430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a2769d0 msgr2=0x562d4a276db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f42a00640 1 --2- 172.21.15.103:0/2114947430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a2769d0 0x562d4a276db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f42a00640 1 -- 172.21.15.103:0/2114947430 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d4a03f590 con 0x562d4a2772f0 2024-09-10T22:42:28.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f42a00640 1 --2- 172.21.15.103:0/2114947430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2772f0 0x562d4a22a8d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009cb0 tx=0x7f3f34012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b450b4f4ebf073f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f3be00640 1 -- 172.21.15.103:0/2114947430 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f34009e60 con 0x562d4a2772f0 2024-09-10T22:42:28.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f3be00640 1 -- 172.21.15.103:0/2114947430 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f340120d0 con 0x562d4a2772f0 2024-09-10T22:42:28.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f3be00640 1 -- 172.21.15.103:0/2114947430 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f34010690 con 0x562d4a2772f0 2024-09-10T22:42:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f5580c000 1 -- 172.21.15.103:0/2114947430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2772f0 msgr2=0x562d4a22a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f5580c000 1 --2- 172.21.15.103:0/2114947430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2772f0 0x562d4a22a8d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009cb0 tx=0x7f3f34012820 comp rx=0 tx=0).stop 2024-09-10T22:42:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f5580c000 1 -- 172.21.15.103:0/2114947430 shutdown_connections 2024-09-10T22:42:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f5580c000 1 --2- 172.21.15.103:0/2114947430 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a22ae10 0x562d4a22b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f5580c000 1 --2- 172.21.15.103:0/2114947430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2772f0 0x562d4a22a8d0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f5580c000 1 --2- 172.21.15.103:0/2114947430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a2769d0 0x562d4a276db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f5580c000 1 -- 172.21.15.103:0/2114947430 >> 172.21.15.103:0/2114947430 conn(0x562d4a114130 msgr2=0x562d4a259e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f5580c000 1 -- 172.21.15.103:0/2114947430 shutdown_connections 2024-09-10T22:42:28.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f5580c000 1 -- 172.21.15.103:0/2114947430 wait complete. 2024-09-10T22:42:28.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.343+0000 7f3f5580c000 1 -- start start 2024-09-10T22:42:28.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f5580c000 1 Processor -- start 2024-09-10T22:42:28.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f5580c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a22ae10 0x562d4a2576a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f5580c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2769d0 0x562d4a257e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f5580c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a2772f0 0x562d4a2583b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f5580c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562d4a0125d0 con 0x562d4a2769d0 2024-09-10T22:42:28.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f5580c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562d4a07bd60 con 0x562d4a22ae10 2024-09-10T22:42:28.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f5580c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x562d4a01e500 con 0x562d4a2772f0 2024-09-10T22:42:28.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f5580c000 10 client.0 _ll_register_callbacks cb 0x562d4a022810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:42:28.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f42a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2769d0 0x562d4a257e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f42a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2769d0 0x562d4a257e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39296/0 (socket says 172.21.15.103:39296) 2024-09-10T22:42:28.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f42a00640 1 -- 172.21.15.103:0/4255174913 learned_addr learned my addr 172.21.15.103:0/4255174913 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:28.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f4b400640 1 --2- 172.21.15.103:0/4255174913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a22ae10 0x562d4a2576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f4be00640 1 --2- 172.21.15.103:0/4255174913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a2772f0 0x562d4a2583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f42a00640 1 -- 172.21.15.103:0/4255174913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a2772f0 msgr2=0x562d4a2583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f42a00640 1 --2- 172.21.15.103:0/4255174913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a2772f0 0x562d4a2583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f42a00640 1 -- 172.21.15.103:0/4255174913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a22ae10 msgr2=0x562d4a2576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f42a00640 1 --2- 172.21.15.103:0/4255174913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a22ae10 0x562d4a2576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f42a00640 1 -- 172.21.15.103:0/4255174913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d4a016170 con 0x562d4a2769d0 2024-09-10T22:42:28.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f42a00640 1 --2- 172.21.15.103:0/4255174913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2769d0 0x562d4a257e70 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3f34012fd0 tx=0x7f3f34004f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4196301b500902ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f38c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:42:28.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f38c00640 1 -- 172.21.15.103:0/4255174913 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f340120d0 con 0x562d4a2769d0 2024-09-10T22:42:28.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f5580c000 1 -- 172.21.15.103:0/4255174913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562d4a0100f0 con 0x562d4a2769d0 2024-09-10T22:42:28.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f38c00640 1 -- 172.21.15.103:0/4255174913 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f3f34004030 con 0x562d4a2769d0 2024-09-10T22:42:28.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f38c00640 1 -- 172.21.15.103:0/4255174913 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f3f3402c050 con 0x562d4a2769d0 2024-09-10T22:42:28.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f5580c000 10 client.6471 fetch_fsmap learned FSMap version 59 2024-09-10T22:42:28.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f5580c000 1 -- 172.21.15.103:0/4255174913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) -- 0x562d4a0fcef0 con 0x562d4a2769d0 2024-09-10T22:42:28.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f38c00640 1 -- 172.21.15.103:0/4255174913 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x562d4a0100f0 con 0x562d4a2769d0 2024-09-10T22:42:28.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f38c00640 1 -- 172.21.15.103:0/4255174913 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 59) ==== 3542+0+0 (secure 0 0 0) 0x7f3f3402f020 con 0x562d4a2769d0 2024-09-10T22:42:28.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f5580c000 10 client.6471 fetch_fsmap finished waiting for FSMap version 59 2024-09-10T22:42:28.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f5580c000 10 client.6471 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:42:28.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f5580c000 20 client.6471 populate_metadata read hostname 'smithi103' 2024-09-10T22:42:28.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f5580c000 1 --2- 172.21.15.103:0/4255174913 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x562d4a2590f0 0x562d4a288c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f5580c000 4 client.6471 mds_command: new command op to 6276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:42:28.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f5580c000 1 -- 172.21.15.103:0/4255174913 --> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d4a08aa70 con 0x562d4a2590f0 2024-09-10T22:42:28.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.347+0000 7f3f4b400640 1 --2- 172.21.15.103:0/4255174913 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x562d4a2590f0 0x562d4a288c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.351+0000 7f3f4b400640 1 --2- 172.21.15.103:0/4255174913 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x562d4a2590f0 0x562d4a288c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=60ac59efa3d93923 server_cookie=c20b80937a21fcab in_seq=0 out_seq=0 2024-09-10T22:42:28.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.351+0000 7f3f38c00640 10 client.6471 ms_handle_connect on v2:172.21.15.103:6832/4171945106 2024-09-10T22:42:28.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.351+0000 7f3f38c00640 1 -- 172.21.15.103:0/4255174913 <== mds.1 v2:172.21.15.103:6832/4171945106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562d4a08aa70 con 0x562d4a2590f0 2024-09-10T22:42:28.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.351+0000 7f3f38c00640 10 client.6471 handle_command_reply: tid=0 2024-09-10T22:42:28.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.351+0000 7f3f5580c000 1 client.6471 shutdown 2024-09-10T22:42:28.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.351+0000 7f3f5580c000 1 -- 172.21.15.103:0/4255174913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2769d0 msgr2=0x562d4a257e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.351+0000 7f3f5580c000 1 --2- 172.21.15.103:0/4255174913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2769d0 0x562d4a257e70 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3f34012fd0 tx=0x7f3f34004f20 comp rx=0 tx=0).stop 2024-09-10T22:42:28.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.351+0000 7f3f5580c000 1 -- 172.21.15.103:0/4255174913 shutdown_connections 2024-09-10T22:42:28.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.351+0000 7f3f5580c000 1 --2- 172.21.15.103:0/4255174913 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x562d4a2590f0 0x562d4a288c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.351+0000 7f3f5580c000 1 --2- 172.21.15.103:0/4255174913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a2772f0 0x562d4a2583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.351+0000 7f3f5580c000 1 --2- 172.21.15.103:0/4255174913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2769d0 0x562d4a257e70 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.351+0000 7f3f5580c000 1 --2- 172.21.15.103:0/4255174913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a22ae10 0x562d4a2576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.351+0000 7f3f38c00640 0 client.6471 ms_handle_reset on v2:172.21.15.103:6832/4171945106 2024-09-10T22:42:28.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.351+0000 7f3f5580c000 1 -- 172.21.15.103:0/4255174913 >> 172.21.15.103:0/4255174913 conn(0x562d4a114130 msgr2=0x562d4a229fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.351+0000 7f3f5580c000 1 -- 172.21.15.103:0/4255174913 shutdown_connections 2024-09-10T22:42:28.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.351+0000 7f3f5580c000 1 -- 172.21.15.103:0/4255174913 wait complete. 2024-09-10T22:42:28.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.351+0000 7f3f5580c000 20 client.6471 trim_cache size 0 max 16384 2024-09-10T22:42:28.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.367+0000 7f3f5580c000 1 Processor -- start 2024-09-10T22:42:28.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.367+0000 7f3f5580c000 1 -- start start 2024-09-10T22:42:28.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f5580c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a22ae10 0x562d4a2e8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f5580c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a2769d0 0x562d4a2e9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f5580c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a2772f0 0x562d4a2e9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f5580c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c204cb0 con 0x562d4a22ae10 2024-09-10T22:42:28.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f5580c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c203f70 con 0x562d4a2772f0 2024-09-10T22:42:28.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f5580c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3f4c2045e0 con 0x562d4a2769d0 2024-09-10T22:42:28.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f4b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a22ae10 0x562d4a2e8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f4b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a22ae10 0x562d4a2e8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39310/0 (socket says 172.21.15.103:39310) 2024-09-10T22:42:28.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f4b400640 1 -- 172.21.15.103:0/1861377656 learned_addr learned my addr 172.21.15.103:0/1861377656 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:28.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f4be00640 1 --2- 172.21.15.103:0/1861377656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a2772f0 0x562d4a2e9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f42a00640 1 --2- 172.21.15.103:0/1861377656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a2769d0 0x562d4a2e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f4b400640 1 -- 172.21.15.103:0/1861377656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a2769d0 msgr2=0x562d4a2e9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f4b400640 1 --2- 172.21.15.103:0/1861377656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a2769d0 0x562d4a2e9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f4b400640 1 -- 172.21.15.103:0/1861377656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a2772f0 msgr2=0x562d4a2e9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f4b400640 1 --2- 172.21.15.103:0/1861377656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a2772f0 0x562d4a2e9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f4b400640 1 -- 172.21.15.103:0/1861377656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d4a0d3d90 con 0x562d4a22ae10 2024-09-10T22:42:28.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f4be00640 1 --2- 172.21.15.103:0/1861377656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a2772f0 0x562d4a2e9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:28.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f42a00640 1 --2- 172.21.15.103:0/1861377656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a2769d0 0x562d4a2e9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:28.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f4b400640 1 --2- 172.21.15.103:0/1861377656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a22ae10 0x562d4a2e8bc0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00c2e0 tx=0x7f3f3c0b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd45886a4aeabd9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f3b400640 1 -- 172.21.15.103:0/1861377656 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c0064f0 con 0x562d4a22ae10 2024-09-10T22:42:28.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f3b400640 1 -- 172.21.15.103:0/1861377656 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f3c003600 con 0x562d4a22ae10 2024-09-10T22:42:28.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f3b400640 1 -- 172.21.15.103:0/1861377656 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c003a30 con 0x562d4a22ae10 2024-09-10T22:42:28.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f5580c000 1 -- 172.21.15.103:0/1861377656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a22ae10 msgr2=0x562d4a2e8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f5580c000 1 --2- 172.21.15.103:0/1861377656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a22ae10 0x562d4a2e8bc0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00c2e0 tx=0x7f3f3c0b8000 comp rx=0 tx=0).stop 2024-09-10T22:42:28.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f5580c000 1 -- 172.21.15.103:0/1861377656 shutdown_connections 2024-09-10T22:42:28.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f5580c000 1 --2- 172.21.15.103:0/1861377656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a2772f0 0x562d4a2e9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f5580c000 1 --2- 172.21.15.103:0/1861377656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a2769d0 0x562d4a2e9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f5580c000 1 --2- 172.21.15.103:0/1861377656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a22ae10 0x562d4a2e8bc0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f5580c000 1 -- 172.21.15.103:0/1861377656 >> 172.21.15.103:0/1861377656 conn(0x562d4a114130 msgr2=0x562d4a283fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f5580c000 1 -- 172.21.15.103:0/1861377656 shutdown_connections 2024-09-10T22:42:28.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f5580c000 1 -- 172.21.15.103:0/1861377656 wait complete. 2024-09-10T22:42:28.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f5580c000 1 -- start start 2024-09-10T22:42:28.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.371+0000 7f3f5580c000 1 Processor -- start 2024-09-10T22:42:28.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a22ae10 0x562d4a28a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2769d0 0x562d4a28acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a2772f0 0x562d4a28b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562d4a0fca60 con 0x562d4a2769d0 2024-09-10T22:42:28.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562d4a0878f0 con 0x562d4a2772f0 2024-09-10T22:42:28.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x562d4a137730 con 0x562d4a22ae10 2024-09-10T22:42:28.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 10 client.0 _ll_register_callbacks cb 0x7f3f34009b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:42:28.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f42a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2769d0 0x562d4a28acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f42a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2769d0 0x562d4a28acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39318/0 (socket says 172.21.15.103:39318) 2024-09-10T22:42:28.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f42a00640 1 -- 172.21.15.103:0/3226217468 learned_addr learned my addr 172.21.15.103:0/3226217468 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:28.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f4b400640 1 --2- 172.21.15.103:0/3226217468 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a22ae10 0x562d4a28a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f4be00640 1 --2- 172.21.15.103:0/3226217468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a2772f0 0x562d4a28b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f42a00640 1 -- 172.21.15.103:0/3226217468 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a22ae10 msgr2=0x562d4a28a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f42a00640 1 --2- 172.21.15.103:0/3226217468 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a22ae10 0x562d4a28a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f42a00640 1 -- 172.21.15.103:0/3226217468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a2772f0 msgr2=0x562d4a28b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f42a00640 1 --2- 172.21.15.103:0/3226217468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a2772f0 0x562d4a28b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f42a00640 1 -- 172.21.15.103:0/3226217468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d4a03ea90 con 0x562d4a2769d0 2024-09-10T22:42:28.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f42a00640 1 --2- 172.21.15.103:0/3226217468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2769d0 0x562d4a28acd0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3f34012da0 tx=0x7f3f34005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c05e9e9c0c4db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f38c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:42:28.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f38c00640 1 -- 172.21.15.103:0/3226217468 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f340053b0 con 0x562d4a2769d0 2024-09-10T22:42:28.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f38c00640 1 -- 172.21.15.103:0/3226217468 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f3f34005550 con 0x562d4a2769d0 2024-09-10T22:42:28.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 -- 172.21.15.103:0/3226217468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f3c003600 con 0x562d4a2769d0 2024-09-10T22:42:28.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f38c00640 1 -- 172.21.15.103:0/3226217468 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f3f34038050 con 0x562d4a2769d0 2024-09-10T22:42:28.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 10 client.6477 fetch_fsmap learned FSMap version 59 2024-09-10T22:42:28.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 -- 172.21.15.103:0/3226217468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) -- 0x562d4a01d050 con 0x562d4a2769d0 2024-09-10T22:42:28.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f38c00640 1 -- 172.21.15.103:0/3226217468 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f3c003600 con 0x562d4a2769d0 2024-09-10T22:42:28.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f38c00640 1 -- 172.21.15.103:0/3226217468 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 59) ==== 3542+0+0 (secure 0 0 0) 0x7f3f3403b020 con 0x562d4a2769d0 2024-09-10T22:42:28.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 10 client.6477 fetch_fsmap finished waiting for FSMap version 59 2024-09-10T22:42:28.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 10 client.6477 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:42:28.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 20 client.6477 populate_metadata read hostname 'smithi103' 2024-09-10T22:42:28.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 --2- 172.21.15.103:0/3226217468 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x562d4a28bb40 0x562d4a2f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 4 client.6477 mds_command: new command op to 6276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:42:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 -- 172.21.15.103:0/3226217468 --> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] -- command(tid 0: {"prefix": "status"}) -- 0x562d4a086520 con 0x562d4a28bb40 2024-09-10T22:42:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f4b400640 1 --2- 172.21.15.103:0/3226217468 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x562d4a28bb40 0x562d4a2f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f4b400640 1 --2- 172.21.15.103:0/3226217468 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x562d4a28bb40 0x562d4a2f4c40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=add33a0ad5c527ac server_cookie=e5c90a2b4c54af44 in_seq=0 out_seq=0 2024-09-10T22:42:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f38c00640 10 client.6477 ms_handle_connect on v2:172.21.15.103:6832/4171945106 2024-09-10T22:42:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f38c00640 1 -- 172.21.15.103:0/3226217468 <== mds.1 v2:172.21.15.103:6832/4171945106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x562d4a086520 con 0x562d4a28bb40 2024-09-10T22:42:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f38c00640 10 client.6477 handle_command_reply: tid=0 2024-09-10T22:42:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 client.6477 shutdown 2024-09-10T22:42:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 -- 172.21.15.103:0/3226217468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2769d0 msgr2=0x562d4a28acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 --2- 172.21.15.103:0/3226217468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2769d0 0x562d4a28acd0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3f34012da0 tx=0x7f3f34005e40 comp rx=0 tx=0).stop 2024-09-10T22:42:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 -- 172.21.15.103:0/3226217468 shutdown_connections 2024-09-10T22:42:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 --2- 172.21.15.103:0/3226217468 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x562d4a28bb40 0x562d4a2f4c40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 --2- 172.21.15.103:0/3226217468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562d4a2772f0 0x562d4a28b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 --2- 172.21.15.103:0/3226217468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562d4a2769d0 0x562d4a28acd0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f38c00640 0 client.6477 ms_handle_reset on v2:172.21.15.103:6832/4171945106 2024-09-10T22:42:28.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 --2- 172.21.15.103:0/3226217468 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562d4a22ae10 0x562d4a28a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 -- 172.21.15.103:0/3226217468 >> 172.21.15.103:0/3226217468 conn(0x562d4a114130 msgr2=0x562d4a232aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 -- 172.21.15.103:0/3226217468 shutdown_connections 2024-09-10T22:42:28.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 1 -- 172.21.15.103:0/3226217468 wait complete. 2024-09-10T22:42:28.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.375+0000 7f3f5580c000 20 client.6477 trim_cache size 0 max 16384 2024-09-10T22:42:28.388 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:42:28.388 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:42:28.388 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 1, 2024-09-10T22:42:28.388 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6276, 2024-09-10T22:42:28.389 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:42:28.389 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:42:28.389 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:42:28.389 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 2.9909920909999999, 2024-09-10T22:42:28.389 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 59, 2024-09-10T22:42:28.389 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 68, 2024-09-10T22:42:28.389 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 68, 2024-09-10T22:42:28.389 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 15.568935121000001 2024-09-10T22:42:28.389 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:42:28.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.379+0000 7f3f52400640 1 -- 172.21.15.103:0/1052209791 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3f28072610 msgr2=0x7f3f28074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.379+0000 7f3f52400640 1 --2- 172.21.15.103:0/1052209791 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3f28072610 0x7f3f28074ad0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0ac000 tx=0x7f3f3c019e00 comp rx=0 tx=0).stop 2024-09-10T22:42:28.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.379+0000 7f3f52400640 1 -- 172.21.15.103:0/1052209791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f4c0b35b0 msgr2=0x7f3f4c0b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.379+0000 7f3f52400640 1 --2- 172.21.15.103:0/1052209791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f4c0b35b0 0x7f3f4c0b3a60 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0b3580 tx=0x7f3f44011ef0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.379+0000 7f3f52400640 1 -- 172.21.15.103:0/1052209791 shutdown_connections 2024-09-10T22:42:28.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.379+0000 7f3f52400640 1 --2- 172.21.15.103:0/1052209791 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3f28072610 0x7f3f28074ad0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.379+0000 7f3f52400640 1 --2- 172.21.15.103:0/1052209791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f4c0b35b0 0x7f3f4c0b3a60 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.379+0000 7f3f52400640 1 --2- 172.21.15.103:0/1052209791 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f4c0b7110 0x7f3f4c155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.379+0000 7f3f52400640 1 --2- 172.21.15.103:0/1052209791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f30003a10 0x7f3f4c0712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.379+0000 7f3f52400640 1 -- 172.21.15.103:0/1052209791 >> 172.21.15.103:0/1052209791 conn(0x7f3f4c0d1ac0 msgr2=0x7f3f4c0ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.379+0000 7f3f52400640 1 -- 172.21.15.103:0/1052209791 shutdown_connections 2024-09-10T22:42:28.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.379+0000 7f3f52400640 1 -- 172.21.15.103:0/1052209791 wait complete. 2024-09-10T22:42:28.399 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T22:42:28.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.539+0000 7f89f6400640 1 -- 172.21.15.103:0/2524802695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89f00739e0 msgr2=0x7f89f0070a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.539+0000 7f89f6400640 1 --2- 172.21.15.103:0/2524802695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89f00739e0 0x7f89f0070a40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f89f00d0700 tx=0x7f89dc01c800 comp rx=0 tx=0).stop 2024-09-10T22:42:28.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.539+0000 7f89f6400640 1 -- 172.21.15.103:0/2524802695 shutdown_connections 2024-09-10T22:42:28.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.539+0000 7f89f6400640 1 --2- 172.21.15.103:0/2524802695 >> v2:172.21.15.131:3300/0 conn(0x7f89f006f290 0x7f89f015b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.539+0000 7f89f6400640 1 --2- 172.21.15.103:0/2524802695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89f00739e0 0x7f89f0070a40 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.539+0000 7f89f6400640 1 -- 172.21.15.103:0/2524802695 >> 172.21.15.103:0/2524802695 conn(0x7f89f00b2300 msgr2=0x7f89f00b2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.539+0000 7f89f6400640 1 -- 172.21.15.103:0/2524802695 shutdown_connections 2024-09-10T22:42:28.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.539+0000 7f89f6400640 1 -- 172.21.15.103:0/2524802695 wait complete. 2024-09-10T22:42:28.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f6400640 1 Processor -- start 2024-09-10T22:42:28.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f6400640 1 -- start start 2024-09-10T22:42:28.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f6400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89f006f290 0x7f89f0151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f6400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89f00739e0 0x7f89f01fa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f6400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89f00d0320 0x7f89f006cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f6400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f89f01677f0 con 0x7f89f006f290 2024-09-10T22:42:28.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f6400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f89f0167670 con 0x7f89f00739e0 2024-09-10T22:42:28.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f6400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f89f0167970 con 0x7f89f00d0320 2024-09-10T22:42:28.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f5000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89f006f290 0x7f89f0151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f5000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89f006f290 0x7f89f0151300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39342/0 (socket says 172.21.15.103:39342) 2024-09-10T22:42:28.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f5000640 1 -- 172.21.15.103:0/3221834028 learned_addr learned my addr 172.21.15.103:0/3221834028 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:28.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89efe00640 1 --2- 172.21.15.103:0/3221834028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89f00739e0 0x7f89f01fa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f5a00640 1 --2- 172.21.15.103:0/3221834028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89f00d0320 0x7f89f006cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f5000640 1 -- 172.21.15.103:0/3221834028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89f00d0320 msgr2=0x7f89f006cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f5000640 1 --2- 172.21.15.103:0/3221834028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89f00d0320 0x7f89f006cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f5000640 1 -- 172.21.15.103:0/3221834028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89f00739e0 msgr2=0x7f89f01fa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f5000640 1 --2- 172.21.15.103:0/3221834028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89f00739e0 0x7f89f01fa8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f5000640 1 -- 172.21.15.103:0/3221834028 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f0151840 con 0x7f89f006f290 2024-09-10T22:42:28.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f5a00640 1 --2- 172.21.15.103:0/3221834028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89f00d0320 0x7f89f006cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:28.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f5000640 1 --2- 172.21.15.103:0/3221834028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89f006f290 0x7f89f0151300 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f89e000c3e0 tx=0x7f89e000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89ecc00640 1 -- 172.21.15.103:0/3221834028 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0011790 con 0x7f89f006f290 2024-09-10T22:42:28.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89ecc00640 1 -- 172.21.15.103:0/3221834028 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89e0017070 con 0x7f89f006f290 2024-09-10T22:42:28.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89ecc00640 1 -- 172.21.15.103:0/3221834028 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0011ca0 con 0x7f89f006f290 2024-09-10T22:42:28.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f6400640 1 -- 172.21.15.103:0/3221834028 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f01fae30 con 0x7f89f006f290 2024-09-10T22:42:28.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.543+0000 7f89f6400640 1 -- 172.21.15.103:0/3221834028 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f01f6c40 con 0x7f89f006f290 2024-09-10T22:42:28.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.547+0000 7f89ecc00640 1 -- 172.21.15.103:0/3221834028 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f89e001c460 con 0x7f89f006f290 2024-09-10T22:42:28.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.547+0000 7f89ecc00640 1 --2- 172.21.15.103:0/3221834028 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f89d00725e0 0x7f89d0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.547+0000 7f89ecc00640 1 -- 172.21.15.103:0/3221834028 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f89e00931e0 con 0x7f89f006f290 2024-09-10T22:42:28.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.547+0000 7f89fadd8000 1 Processor -- start 2024-09-10T22:42:28.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.547+0000 7f89efe00640 1 --2- 172.21.15.103:0/3221834028 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f89d00725e0 0x7f89d0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.547+0000 7f89fadd8000 1 -- start start 2024-09-10T22:42:28.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.547+0000 7f89efe00640 1 --2- 172.21.15.103:0/3221834028 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f89d00725e0 0x7f89d0074aa0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0af000 tx=0x7f89dc01b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.547+0000 7f89fadd8000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583068ff9d0 0x5583068ffdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.547+0000 7f89fadd8000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583069002f0 0x5583068b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.547+0000 7f89fadd8000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 0x5583068b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.547+0000 7f89fadd8000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5583067d43f0 con 0x5583068b3e10 2024-09-10T22:42:28.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.547+0000 7f89fadd8000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x558306711b20 con 0x5583068ff9d0 2024-09-10T22:42:28.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.547+0000 7f89fadd8000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x558306700f50 con 0x5583069002f0 2024-09-10T22:42:28.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.547+0000 7f89f5a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 0x5583068b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.547+0000 7f89f5a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 0x5583068b41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39354/0 (socket says 172.21.15.103:39354) 2024-09-10T22:42:28.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.547+0000 7f89f5a00640 1 -- 172.21.15.103:0/2608432810 learned_addr learned my addr 172.21.15.103:0/2608432810 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:28.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.547+0000 7f89efe00640 1 --2- 172.21.15.103:0/2608432810 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583069002f0 0x5583068b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.547+0000 7f89f5000640 1 --2- 172.21.15.103:0/2608432810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583068ff9d0 0x5583068ffdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89f5a00640 1 -- 172.21.15.103:0/2608432810 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583069002f0 msgr2=0x5583068b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89f5a00640 1 --2- 172.21.15.103:0/2608432810 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583069002f0 0x5583068b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89f5a00640 1 -- 172.21.15.103:0/2608432810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583068ff9d0 msgr2=0x5583068ffdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89f5a00640 1 --2- 172.21.15.103:0/2608432810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583068ff9d0 0x5583068ffdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89f5a00640 1 -- 172.21.15.103:0/2608432810 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583066c8590 con 0x5583068b3e10 2024-09-10T22:42:28.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89f5a00640 1 --2- 172.21.15.103:0/2608432810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 0x5583068b41f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f89e800f390 tx=0x7f89e800f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52868bb7b464a4ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89e5600640 1 -- 172.21.15.103:0/2608432810 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e8003b80 con 0x5583068b3e10 2024-09-10T22:42:28.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89e5600640 1 -- 172.21.15.103:0/2608432810 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89e8003e10 con 0x5583068b3e10 2024-09-10T22:42:28.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89e5600640 1 -- 172.21.15.103:0/2608432810 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e8004280 con 0x5583068b3e10 2024-09-10T22:42:28.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89fadd8000 1 -- 172.21.15.103:0/2608432810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 msgr2=0x5583068b41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89fadd8000 1 --2- 172.21.15.103:0/2608432810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 0x5583068b41f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f89e800f390 tx=0x7f89e800f850 comp rx=0 tx=0).stop 2024-09-10T22:42:28.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89fadd8000 1 -- 172.21.15.103:0/2608432810 shutdown_connections 2024-09-10T22:42:28.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89fadd8000 1 --2- 172.21.15.103:0/2608432810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 0x5583068b41f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89fadd8000 1 --2- 172.21.15.103:0/2608432810 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583069002f0 0x5583068b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89fadd8000 1 --2- 172.21.15.103:0/2608432810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583068ff9d0 0x5583068ffdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89fadd8000 1 -- 172.21.15.103:0/2608432810 >> 172.21.15.103:0/2608432810 conn(0x55830679d130 msgr2=0x5583068e2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89fadd8000 1 -- 172.21.15.103:0/2608432810 shutdown_connections 2024-09-10T22:42:28.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89fadd8000 1 -- 172.21.15.103:0/2608432810 wait complete. 2024-09-10T22:42:28.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89fadd8000 1 -- start start 2024-09-10T22:42:28.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89fadd8000 1 Processor -- start 2024-09-10T22:42:28.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89fadd8000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583068b3e10 0x5583068b5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89fadd8000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068ff9d0 0x5583068b5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89fadd8000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583069002f0 0x5583068b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89fadd8000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55830669b5d0 con 0x5583068ff9d0 2024-09-10T22:42:28.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89fadd8000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x558306704d60 con 0x5583068b3e10 2024-09-10T22:42:28.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89fadd8000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5583066a7500 con 0x5583069002f0 2024-09-10T22:42:28.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89fadd8000 10 client.0 _ll_register_callbacks cb 0x5583066ab810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:42:28.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89efe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068ff9d0 0x5583068b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89f5000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583068b3e10 0x5583068b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89efe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068ff9d0 0x5583068b5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39370/0 (socket says 172.21.15.103:39370) 2024-09-10T22:42:28.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89efe00640 1 -- 172.21.15.103:0/575724629 learned_addr learned my addr 172.21.15.103:0/575724629 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:28.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89f5a00640 1 --2- 172.21.15.103:0/575724629 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583069002f0 0x5583068b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89efe00640 1 -- 172.21.15.103:0/575724629 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583069002f0 msgr2=0x5583068b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89efe00640 1 --2- 172.21.15.103:0/575724629 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583069002f0 0x5583068b5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89efe00640 1 -- 172.21.15.103:0/575724629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583068b3e10 msgr2=0x5583068b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89efe00640 1 --2- 172.21.15.103:0/575724629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583068b3e10 0x5583068b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.551+0000 7f89efe00640 1 -- 172.21.15.103:0/575724629 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55830669f170 con 0x5583068ff9d0 2024-09-10T22:42:28.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89efe00640 1 --2- 172.21.15.103:0/575724629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068ff9d0 0x5583068b5780 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009790 tx=0x7f89dc0091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfbcba9ba02431e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89da000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:42:28.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89da000640 1 -- 172.21.15.103:0/575724629 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc005600 con 0x5583068ff9d0 2024-09-10T22:42:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89da000640 1 -- 172.21.15.103:0/575724629 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f89dc0046d0 con 0x5583068ff9d0 2024-09-10T22:42:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 1 -- 172.21.15.103:0/575724629 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5583066990f0 con 0x5583068ff9d0 2024-09-10T22:42:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89da000640 1 -- 172.21.15.103:0/575724629 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f89dc0048d0 con 0x5583068ff9d0 2024-09-10T22:42:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 10 client.6492 fetch_fsmap learned FSMap version 59 2024-09-10T22:42:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 1 -- 172.21.15.103:0/575724629 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) -- 0x558306785ef0 con 0x5583068ff9d0 2024-09-10T22:42:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89da000640 1 -- 172.21.15.103:0/575724629 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5583066990f0 con 0x5583068ff9d0 2024-09-10T22:42:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89da000640 1 -- 172.21.15.103:0/575724629 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 59) ==== 3542+0+0 (secure 0 0 0) 0x7f89dc004b60 con 0x5583068ff9d0 2024-09-10T22:42:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 10 client.6492 fetch_fsmap finished waiting for FSMap version 59 2024-09-10T22:42:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 10 client.6492 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T22:42:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 20 client.6492 populate_metadata read hostname 'smithi103' 2024-09-10T22:42:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 1 --2- 172.21.15.103:0/575724629 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55830690ec70 0x558306911060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 4 client.6492 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:42:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 1 -- 172.21.15.103:0/575724629 --> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558306713a70 con 0x55830690ec70 2024-09-10T22:42:28.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89f5000640 1 --2- 172.21.15.103:0/575724629 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55830690ec70 0x558306911060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89f5000640 1 --2- 172.21.15.103:0/575724629 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55830690ec70 0x558306911060 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48c46fac0dee9cf5 server_cookie=530a38de3c0f660 in_seq=0 out_seq=0 2024-09-10T22:42:28.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89da000640 10 client.6492 ms_handle_connect on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:28.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89da000640 1 -- 172.21.15.103:0/575724629 <== mds.0 v2:172.21.15.103:6834/714242556 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558306713a70 con 0x55830690ec70 2024-09-10T22:42:28.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89da000640 10 client.6492 handle_command_reply: tid=0 2024-09-10T22:42:28.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 1 client.6492 shutdown 2024-09-10T22:42:28.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 1 -- 172.21.15.103:0/575724629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068ff9d0 msgr2=0x5583068b5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 1 --2- 172.21.15.103:0/575724629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068ff9d0 0x5583068b5780 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009790 tx=0x7f89dc0091e0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 1 -- 172.21.15.103:0/575724629 shutdown_connections 2024-09-10T22:42:28.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 1 --2- 172.21.15.103:0/575724629 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55830690ec70 0x558306911060 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 1 --2- 172.21.15.103:0/575724629 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583069002f0 0x5583068b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 1 --2- 172.21.15.103:0/575724629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068ff9d0 0x5583068b5780 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89da000640 0 client.6492 ms_handle_reset on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:28.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 1 --2- 172.21.15.103:0/575724629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583068b3e10 0x5583068b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 1 -- 172.21.15.103:0/575724629 >> 172.21.15.103:0/575724629 conn(0x55830679d130 msgr2=0x5583068b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 1 -- 172.21.15.103:0/575724629 shutdown_connections 2024-09-10T22:42:28.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 1 -- 172.21.15.103:0/575724629 wait complete. 2024-09-10T22:42:28.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.555+0000 7f89fadd8000 20 client.6492 trim_cache size 0 max 16384 2024-09-10T22:42:28.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89fadd8000 1 Processor -- start 2024-09-10T22:42:28.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89fadd8000 1 -- start start 2024-09-10T22:42:28.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89fadd8000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 0x5583069715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89fadd8000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583068ff9d0 0x558306971b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89fadd8000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583069002f0 0x558306972050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89fadd8000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f89f0202f90 con 0x5583068b3e10 2024-09-10T22:42:28.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89fadd8000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f89f0203660 con 0x5583068ff9d0 2024-09-10T22:42:28.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89fadd8000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f89f01f89d0 con 0x5583069002f0 2024-09-10T22:42:28.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89f5000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 0x5583069715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89f5000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 0x5583069715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39378/0 (socket says 172.21.15.103:39378) 2024-09-10T22:42:28.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89f5000640 1 -- 172.21.15.103:0/3177207270 learned_addr learned my addr 172.21.15.103:0/3177207270 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:28.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89efe00640 1 --2- 172.21.15.103:0/3177207270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583068ff9d0 0x558306971b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89f5a00640 1 --2- 172.21.15.103:0/3177207270 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583069002f0 0x558306972050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89f5000640 1 -- 172.21.15.103:0/3177207270 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583069002f0 msgr2=0x558306972050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89f5000640 1 --2- 172.21.15.103:0/3177207270 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583069002f0 0x558306972050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89f5000640 1 -- 172.21.15.103:0/3177207270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583068ff9d0 msgr2=0x558306971b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89f5000640 1 --2- 172.21.15.103:0/3177207270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583068ff9d0 0x558306971b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89f5000640 1 -- 172.21.15.103:0/3177207270 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55830675cd90 con 0x5583068b3e10 2024-09-10T22:42:28.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89f5000640 1 --2- 172.21.15.103:0/3177207270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 0x5583069715d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f89e005dd30 tx=0x7f89e001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969449eee8b51216 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89e4c00640 1 -- 172.21.15.103:0/3177207270 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e008f070 con 0x5583068b3e10 2024-09-10T22:42:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89e4c00640 1 -- 172.21.15.103:0/3177207270 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89e005e030 con 0x5583068b3e10 2024-09-10T22:42:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89e4c00640 1 -- 172.21.15.103:0/3177207270 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0077070 con 0x5583068b3e10 2024-09-10T22:42:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89fadd8000 1 -- 172.21.15.103:0/3177207270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 msgr2=0x5583069715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89fadd8000 1 --2- 172.21.15.103:0/3177207270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 0x5583069715d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f89e005dd30 tx=0x7f89e001e040 comp rx=0 tx=0).stop 2024-09-10T22:42:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89fadd8000 1 -- 172.21.15.103:0/3177207270 shutdown_connections 2024-09-10T22:42:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89fadd8000 1 --2- 172.21.15.103:0/3177207270 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583069002f0 0x558306972050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89fadd8000 1 --2- 172.21.15.103:0/3177207270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583068ff9d0 0x558306971b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89fadd8000 1 --2- 172.21.15.103:0/3177207270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 0x5583069715d0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89fadd8000 1 -- 172.21.15.103:0/3177207270 >> 172.21.15.103:0/3177207270 conn(0x55830679d130 msgr2=0x5583068b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.575+0000 7f89fadd8000 1 -- 172.21.15.103:0/3177207270 shutdown_connections 2024-09-10T22:42:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 1 -- 172.21.15.103:0/3177207270 wait complete. 2024-09-10T22:42:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 1 -- start start 2024-09-10T22:42:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 1 Processor -- start 2024-09-10T22:42:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 0x558306915c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583068ff9d0 0x558306931580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583069002f0 0x558306931ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558306785a60 con 0x5583068b3e10 2024-09-10T22:42:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5583066ccec0 con 0x5583069002f0 2024-09-10T22:42:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x558306709390 con 0x5583068ff9d0 2024-09-10T22:42:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 10 client.0 _ll_register_callbacks cb 0x7f89e80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:42:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89f5000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 0x558306915c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89f5000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 0x558306915c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39380/0 (socket says 172.21.15.103:39380) 2024-09-10T22:42:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89f5000640 1 -- 172.21.15.103:0/272465253 learned_addr learned my addr 172.21.15.103:0/272465253 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89efe00640 1 --2- 172.21.15.103:0/272465253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583068ff9d0 0x558306931580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89f5a00640 1 --2- 172.21.15.103:0/272465253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583069002f0 0x558306931ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89f5000640 1 -- 172.21.15.103:0/272465253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583068ff9d0 msgr2=0x558306931580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89f5000640 1 --2- 172.21.15.103:0/272465253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583068ff9d0 0x558306931580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89f5000640 1 -- 172.21.15.103:0/272465253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583069002f0 msgr2=0x558306931ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89f5000640 1 --2- 172.21.15.103:0/272465253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583069002f0 0x558306931ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89f5000640 1 -- 172.21.15.103:0/272465253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583066c7a90 con 0x5583068b3e10 2024-09-10T22:42:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89f5a00640 1 --2- 172.21.15.103:0/272465253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583069002f0 0x558306931ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89f5000640 1 --2- 172.21.15.103:0/272465253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 0x558306915c50 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f89e005dd30 tx=0x7f89e005dc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d79c6f03602ae09 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89da000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:42:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89da000640 1 -- 172.21.15.103:0/272465253 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e008f070 con 0x5583068b3e10 2024-09-10T22:42:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89da000640 1 -- 172.21.15.103:0/272465253 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f89e005a2a0 con 0x5583068b3e10 2024-09-10T22:42:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 1 -- 172.21.15.103:0/272465253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89e005e030 con 0x5583068b3e10 2024-09-10T22:42:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89da000640 1 -- 172.21.15.103:0/272465253 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f89e0077040 con 0x5583068b3e10 2024-09-10T22:42:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 10 client.6498 fetch_fsmap learned FSMap version 59 2024-09-10T22:42:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 1 -- 172.21.15.103:0/272465253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) -- 0x5583066a6050 con 0x5583068b3e10 2024-09-10T22:42:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89da000640 1 -- 172.21.15.103:0/272465253 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89e005e030 con 0x5583068b3e10 2024-09-10T22:42:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89da000640 1 -- 172.21.15.103:0/272465253 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 59) ==== 3542+0+0 (secure 0 0 0) 0x7f89e005d290 con 0x5583068b3e10 2024-09-10T22:42:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 10 client.6498 fetch_fsmap finished waiting for FSMap version 59 2024-09-10T22:42:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 10 client.6498 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T22:42:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 20 client.6498 populate_metadata read hostname 'smithi103' 2024-09-10T22:42:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 1 --2- 172.21.15.103:0/272465253 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x558306932000 0x55830697d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 4 client.6498 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:42:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89fadd8000 1 -- 172.21.15.103:0/272465253 --> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] -- command(tid 0: {"prefix": "status"}) -- 0x55830670f520 con 0x558306932000 2024-09-10T22:42:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.579+0000 7f89efe00640 1 --2- 172.21.15.103:0/272465253 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x558306932000 0x55830697d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89efe00640 1 --2- 172.21.15.103:0/272465253 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x558306932000 0x55830697d650 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a8ba5a5e22399ee server_cookie=28bf8945ca9db0b in_seq=0 out_seq=0 2024-09-10T22:42:28.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89da000640 10 client.6498 ms_handle_connect on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:28.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89da000640 1 -- 172.21.15.103:0/272465253 <== mds.0 v2:172.21.15.103:6834/714242556 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55830670f520 con 0x558306932000 2024-09-10T22:42:28.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89da000640 10 client.6498 handle_command_reply: tid=0 2024-09-10T22:42:28.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89fadd8000 1 client.6498 shutdown 2024-09-10T22:42:28.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89fadd8000 1 -- 172.21.15.103:0/272465253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 msgr2=0x558306915c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89fadd8000 1 --2- 172.21.15.103:0/272465253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 0x558306915c50 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f89e005dd30 tx=0x7f89e005dc80 comp rx=0 tx=0).stop 2024-09-10T22:42:28.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89fadd8000 1 -- 172.21.15.103:0/272465253 shutdown_connections 2024-09-10T22:42:28.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89fadd8000 1 --2- 172.21.15.103:0/272465253 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x558306932000 0x55830697d650 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89fadd8000 1 --2- 172.21.15.103:0/272465253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583069002f0 0x558306931ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89fadd8000 1 --2- 172.21.15.103:0/272465253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5583068ff9d0 0x558306931580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89da000640 0 client.6498 ms_handle_reset on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:28.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89fadd8000 1 --2- 172.21.15.103:0/272465253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583068b3e10 0x558306915c50 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89fadd8000 1 -- 172.21.15.103:0/272465253 >> 172.21.15.103:0/272465253 conn(0x55830679d130 msgr2=0x558306911060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89fadd8000 1 -- 172.21.15.103:0/272465253 shutdown_connections 2024-09-10T22:42:28.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89fadd8000 1 -- 172.21.15.103:0/272465253 wait complete. 2024-09-10T22:42:28.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89fadd8000 20 client.6498 trim_cache size 0 max 16384 2024-09-10T22:42:28.591 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:42:28.591 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:42:28.591 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-10T22:42:28.591 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6285, 2024-09-10T22:42:28.591 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:42:28.591 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:42:28.592 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:42:28.592 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 11.252499133000001, 2024-09-10T22:42:28.592 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 59, 2024-09-10T22:42:28.592 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 68, 2024-09-10T22:42:28.592 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 68, 2024-09-10T22:42:28.592 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 15.769950522 2024-09-10T22:42:28.592 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:42:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89f6400640 1 -- 172.21.15.103:0/3221834028 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f89d00725e0 msgr2=0x7f89d0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89f6400640 1 --2- 172.21.15.103:0/3221834028 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f89d00725e0 0x7f89d0074aa0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0af000 tx=0x7f89dc01b040 comp rx=0 tx=0).stop 2024-09-10T22:42:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89f6400640 1 -- 172.21.15.103:0/3221834028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89f006f290 msgr2=0x7f89f0151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89f6400640 1 --2- 172.21.15.103:0/3221834028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89f006f290 0x7f89f0151300 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f89e000c3e0 tx=0x7f89e000c8a0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89f6400640 1 -- 172.21.15.103:0/3221834028 shutdown_connections 2024-09-10T22:42:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89f6400640 1 --2- 172.21.15.103:0/3221834028 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f89d00725e0 0x7f89d0074aa0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89f6400640 1 --2- 172.21.15.103:0/3221834028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89f00d0320 0x7f89f006cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89f6400640 1 --2- 172.21.15.103:0/3221834028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89f00739e0 0x7f89f01fa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89f6400640 1 --2- 172.21.15.103:0/3221834028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89f006f290 0x7f89f0151300 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89f6400640 1 -- 172.21.15.103:0/3221834028 >> 172.21.15.103:0/3221834028 conn(0x7f89f00b2300 msgr2=0x7f89f00afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89f6400640 1 -- 172.21.15.103:0/3221834028 shutdown_connections 2024-09-10T22:42:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.583+0000 7f89f6400640 1 -- 172.21.15.103:0/3221834028 wait complete. 2024-09-10T22:42:28.605 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:42:28.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.743+0000 7f1336200640 1 -- 172.21.15.103:0/2258245218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13300ae9c0 msgr2=0x7f13300aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.743+0000 7f1336200640 1 --2- 172.21.15.103:0/2258245218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13300ae9c0 0x7f13300aee10 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f13300cbf40 tx=0x7f132801c830 comp rx=0 tx=0).stop 2024-09-10T22:42:28.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.743+0000 7f1336200640 1 -- 172.21.15.103:0/2258245218 shutdown_connections 2024-09-10T22:42:28.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.743+0000 7f1336200640 1 --2- 172.21.15.103:0/2258245218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13300ae9c0 0x7f13300aee10 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.743+0000 7f1336200640 1 --2- 172.21.15.103:0/2258245218 >> v2:172.21.15.131:3300/0 conn(0x7f13300b09c0 0x7f13300ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.743+0000 7f1336200640 1 -- 172.21.15.103:0/2258245218 >> 172.21.15.103:0/2258245218 conn(0x7f13300d1ac0 msgr2=0x7f13300d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.743+0000 7f1336200640 1 -- 172.21.15.103:0/2258245218 shutdown_connections 2024-09-10T22:42:28.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.743+0000 7f1336200640 1 -- 172.21.15.103:0/2258245218 wait complete. 2024-09-10T22:42:28.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f1336200640 1 Processor -- start 2024-09-10T22:42:28.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f1336200640 1 -- start start 2024-09-10T22:42:28.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f1336200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13300ae9c0 0x7f133014fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f1336200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13300b09c0 0x7f13300cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f1336200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f133015be30 0x7f13300b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f1336200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1330168df0 con 0x7f13300ae9c0 2024-09-10T22:42:28.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f1336200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1330168c70 con 0x7f133015be30 2024-09-10T22:42:28.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f1336200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1330168f70 con 0x7f13300b09c0 2024-09-10T22:42:28.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f132f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13300ae9c0 0x7f133014fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f132f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13300ae9c0 0x7f133014fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39410/0 (socket says 172.21.15.103:39410) 2024-09-10T22:42:28.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f132f400640 1 -- 172.21.15.103:0/4265396087 learned_addr learned my addr 172.21.15.103:0/4265396087 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:28.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f132ea00640 1 --2- 172.21.15.103:0/4265396087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13300b09c0 0x7f13300cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f132fe00640 1 --2- 172.21.15.103:0/4265396087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f133015be30 0x7f13300b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f132f400640 1 -- 172.21.15.103:0/4265396087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13300b09c0 msgr2=0x7f13300cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f132f400640 1 --2- 172.21.15.103:0/4265396087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13300b09c0 0x7f13300cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f132f400640 1 -- 172.21.15.103:0/4265396087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f133015be30 msgr2=0x7f13300b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f132f400640 1 --2- 172.21.15.103:0/4265396087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f133015be30 0x7f13300b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f132f400640 1 -- 172.21.15.103:0/4265396087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13300d1100 con 0x7f13300ae9c0 2024-09-10T22:42:28.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f132f400640 1 --2- 172.21.15.103:0/4265396087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13300ae9c0 0x7f133014fde0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f132000c730 tx=0x7f132000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f1327400640 1 -- 172.21.15.103:0/4265396087 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1320003b80 con 0x7f13300ae9c0 2024-09-10T22:42:28.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f1327400640 1 -- 172.21.15.103:0/4265396087 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1320003d40 con 0x7f13300ae9c0 2024-09-10T22:42:28.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f1327400640 1 -- 172.21.15.103:0/4265396087 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132000aab0 con 0x7f13300ae9c0 2024-09-10T22:42:28.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f1336200640 1 -- 172.21.15.103:0/4265396087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13300b6060 con 0x7f13300ae9c0 2024-09-10T22:42:28.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f1336200640 1 -- 172.21.15.103:0/4265396087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13300c92d0 con 0x7f13300ae9c0 2024-09-10T22:42:28.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.747+0000 7f1336200640 1 -- 172.21.15.103:0/4265396087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13300aee10 con 0x7f13300ae9c0 2024-09-10T22:42:28.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.751+0000 7f1327400640 1 -- 172.21.15.103:0/4265396087 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f132000ac50 con 0x7f13300ae9c0 2024-09-10T22:42:28.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.751+0000 7f1327400640 1 --2- 172.21.15.103:0/4265396087 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f13100725e0 0x7f1310074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:28.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.751+0000 7f1327400640 1 -- 172.21.15.103:0/4265396087 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6101+0+0 (secure 0 0 0) 0x7f13200931b0 con 0x7f13300ae9c0 2024-09-10T22:42:28.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.751+0000 7f132ea00640 1 --2- 172.21.15.103:0/4265396087 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f13100725e0 0x7f1310074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:28.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.751+0000 7f132ea00640 1 --2- 172.21.15.103:0/4265396087 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f13100725e0 0x7f1310074aa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f13301fac40 tx=0x7f131c00b390 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:28.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.755+0000 7f1327400640 1 -- 172.21.15.103:0/4265396087 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f132005e010 con 0x7f13300ae9c0 2024-09-10T22:42:28.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.955+0000 7f1336200640 1 -- 172.21.15.103:0/4265396087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13300c94a0 con 0x7f13300ae9c0 2024-09-10T22:42:28.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.955+0000 7f1327400640 1 -- 172.21.15.103:0/4265396087 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5268 (secure 0 0 0) 0x7f1320062a40 con 0x7f13300ae9c0 2024-09-10T22:42:28.958 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:42:28.958 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":59,"btime":"2024-09-10T22:42:27:402561+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2961968581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2961968581},{"type":"v1","addr":"172.21.15.131:6835","nonce":2961968581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:42:16.725541+0000","modified":"2024-09-10T22:42:27.402557+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6285,"mds_1":6276,"mds_2":5630},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5630":{"gid":5630,"name":"b","rank":2,"incarnation":58,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6837/360467048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":360467048},{"type":"v1","addr":"172.21.15.131:6837","nonce":360467048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6276":{"gid":6276,"name":"c","rank":1,"incarnation":56,"state":"up:active","state_seq":5,"addr":"172.21.15.103:6833/4171945106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4171945106},{"type":"v1","addr":"172.21.15.103:6833","nonce":4171945106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/714242556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":714242556},{"type":"v1","addr":"172.21.15.103:6835","nonce":714242556}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6285,"qdb_cluster":[5630,6276,6285]},"id":4}]} 2024-09-10T22:42:28.959 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 59 2024-09-10T22:42:28.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.955+0000 7f1336200640 1 -- 172.21.15.103:0/4265396087 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f13100725e0 msgr2=0x7f1310074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.955+0000 7f1336200640 1 --2- 172.21.15.103:0/4265396087 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f13100725e0 0x7f1310074aa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f13301fac40 tx=0x7f131c00b390 comp rx=0 tx=0).stop 2024-09-10T22:42:28.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.959+0000 7f1336200640 1 -- 172.21.15.103:0/4265396087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13300ae9c0 msgr2=0x7f133014fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:28.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.959+0000 7f1336200640 1 --2- 172.21.15.103:0/4265396087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13300ae9c0 0x7f133014fde0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f132000c730 tx=0x7f132000cbf0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.959+0000 7f1336200640 1 -- 172.21.15.103:0/4265396087 shutdown_connections 2024-09-10T22:42:28.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.959+0000 7f1336200640 1 --2- 172.21.15.103:0/4265396087 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f13100725e0 0x7f1310074aa0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.959+0000 7f1336200640 1 --2- 172.21.15.103:0/4265396087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f133015be30 0x7f13300b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.959+0000 7f1336200640 1 --2- 172.21.15.103:0/4265396087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13300b09c0 0x7f13300cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.959+0000 7f1336200640 1 --2- 172.21.15.103:0/4265396087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13300ae9c0 0x7f133014fde0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:28.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.959+0000 7f1336200640 1 -- 172.21.15.103:0/4265396087 >> 172.21.15.103:0/4265396087 conn(0x7f13300d1ac0 msgr2=0x7f133006f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:28.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.959+0000 7f1336200640 1 -- 172.21.15.103:0/4265396087 shutdown_connections 2024-09-10T22:42:28.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:28.959+0000 7f1336200640 1 -- 172.21.15.103:0/4265396087 wait complete. 2024-09-10T22:42:28.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:28.981 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-10T22:42:29.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:29.010 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-10T22:42:29.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:29.068 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2024-09-10T22:42:29.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:29.122 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2024-09-10T22:42:29.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:29.174 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2024-09-10T22:42:29.231 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:42:29.430 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:42:29.430 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:42:29.431 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:42:31.432 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:42:31.599 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:42:31.599 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:42:31.599 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:42:33.600 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:42:33.767 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:42:33.768 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:42:33.768 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:42:35.769 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:42:35.936 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:42:35.936 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:42:35.937 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:42:37.938 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:42:38.102 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}}] 2024-09-10T22:42:38.103 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:42:38.103 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:42:40.104 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:42:40.270 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2024-09-10T22:42:40.271 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-10T22:42:40.271 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:42:40.272 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:42:40.429 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:42:40.430 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:42:40.430 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:42:42.431 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:42:42.598 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:42:42.598 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:42:42.599 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:42:44.600 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:42:44.773 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:42:44.774 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:42:44.774 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:42:44.775 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-09-10T22:42:44.941 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-10T22:42:44.941 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:42:44.942 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:42:44.942 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2024-09-10T22:42:45.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.083+0000 7f8681a00640 1 -- 172.21.15.103:0/164051994 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f867c0cc120 msgr2=0x7f867c0aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.083+0000 7f8681a00640 1 --2- 172.21.15.103:0/164051994 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f867c0cc120 0x7f867c0aeb40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f866c009900 tx=0x7f866c01c850 comp rx=0 tx=0).stop 2024-09-10T22:42:45.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.083+0000 7f8681a00640 1 -- 172.21.15.103:0/164051994 shutdown_connections 2024-09-10T22:42:45.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.083+0000 7f8681a00640 1 --2- 172.21.15.103:0/164051994 >> v2:172.21.15.131:3300/0 conn(0x7f867c0cf790 0x7f867c0cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.083+0000 7f8681a00640 1 --2- 172.21.15.103:0/164051994 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f867c0cc120 0x7f867c0aeb40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.083+0000 7f8681a00640 1 -- 172.21.15.103:0/164051994 >> 172.21.15.103:0/164051994 conn(0x7f867c06cc00 msgr2=0x7f867c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:45.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.083+0000 7f8681a00640 1 -- 172.21.15.103:0/164051994 shutdown_connections 2024-09-10T22:42:45.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.083+0000 7f8681a00640 1 -- 172.21.15.103:0/164051994 wait complete. 2024-09-10T22:42:45.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8681a00640 1 Processor -- start 2024-09-10T22:42:45.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8681a00640 1 -- start start 2024-09-10T22:42:45.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8681a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f867c0cc120 0x7f867c147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8681a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f867c0cf790 0x7f867c1f7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8681a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f867c15c970 0x7f867c0a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8681a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f867c168bf0 con 0x7f867c0cf790 2024-09-10T22:42:45.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8681a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f867c168a70 con 0x7f867c0cc120 2024-09-10T22:42:45.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8681a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f867c168d70 con 0x7f867c15c970 2024-09-10T22:42:45.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8672000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f867c0cf790 0x7f867c1f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8672000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f867c0cf790 0x7f867c1f7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55246/0 (socket says 172.21.15.103:55246) 2024-09-10T22:42:45.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8672000640 1 -- 172.21.15.103:0/379237962 learned_addr learned my addr 172.21.15.103:0/379237962 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:45.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f867b400640 1 --2- 172.21.15.103:0/379237962 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f867c15c970 0x7f867c0a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f867aa00640 1 --2- 172.21.15.103:0/379237962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f867c0cc120 0x7f867c147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8672000640 1 -- 172.21.15.103:0/379237962 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f867c15c970 msgr2=0x7f867c0a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8672000640 1 --2- 172.21.15.103:0/379237962 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f867c15c970 0x7f867c0a9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8672000640 1 -- 172.21.15.103:0/379237962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f867c0cc120 msgr2=0x7f867c147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8672000640 1 --2- 172.21.15.103:0/379237962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f867c0cc120 0x7f867c147420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8672000640 1 -- 172.21.15.103:0/379237962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867c1f8110 con 0x7f867c0cf790 2024-09-10T22:42:45.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f867aa00640 1 --2- 172.21.15.103:0/379237962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f867c0cc120 0x7f867c147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:42:45.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8672000640 1 --2- 172.21.15.103:0/379237962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f867c0cf790 0x7f867c1f7730 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f866400c430 tx=0x7f866400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:45.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8673400640 1 -- 172.21.15.103:0/379237962 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664017070 con 0x7f867c0cf790 2024-09-10T22:42:45.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8673400640 1 -- 172.21.15.103:0/379237962 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86640053c0 con 0x7f867c0cf790 2024-09-10T22:42:45.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8673400640 1 -- 172.21.15.103:0/379237962 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664003860 con 0x7f867c0cf790 2024-09-10T22:42:45.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8681a00640 1 -- 172.21.15.103:0/379237962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f867c1f83f0 con 0x7f867c0cf790 2024-09-10T22:42:45.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.087+0000 7f8681a00640 1 -- 172.21.15.103:0/379237962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f867c06f270 con 0x7f867c0cf790 2024-09-10T22:42:45.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f8673400640 1 -- 172.21.15.103:0/379237962 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8664003a00 con 0x7f867c0cf790 2024-09-10T22:42:45.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f8673400640 1 --2- 172.21.15.103:0/379237962 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f86580725e0 0x7f8658074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f8673400640 1 -- 172.21.15.103:0/379237962 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f8664092ab0 con 0x7f867c0cf790 2024-09-10T22:42:45.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f8684d46000 1 Processor -- start 2024-09-10T22:42:45.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f8684d46000 1 -- start start 2024-09-10T22:42:45.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f867aa00640 1 --2- 172.21.15.103:0/379237962 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f86580725e0 0x7f8658074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f8684d46000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 0x5648f4245580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f8684d46000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f4245ac0 0x5648f41fb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f867aa00640 1 --2- 172.21.15.103:0/379237962 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f86580725e0 0x7f8658074aa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f866c0af000 tx=0x7f866c01b090 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:45.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f8684d46000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f41fbbc0 0x5648f41fbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f8684d46000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5648f40e3cb0 con 0x5648f42451a0 2024-09-10T22:42:45.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f8684d46000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5648f3ff9310 con 0x5648f4245ac0 2024-09-10T22:42:45.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f8684d46000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5648f4056b90 con 0x5648f41fbbc0 2024-09-10T22:42:45.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f867aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 0x5648f4245580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f867aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 0x5648f4245580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55256/0 (socket says 172.21.15.103:55256) 2024-09-10T22:42:45.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f867aa00640 1 -- 172.21.15.103:0/1387633966 learned_addr learned my addr 172.21.15.103:0/1387633966 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:45.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f867b400640 1 --2- 172.21.15.103:0/1387633966 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f41fbbc0 0x5648f41fbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f8672000640 1 --2- 172.21.15.103:0/1387633966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f4245ac0 0x5648f41fb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f867aa00640 1 -- 172.21.15.103:0/1387633966 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f41fbbc0 msgr2=0x5648f41fbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f867aa00640 1 --2- 172.21.15.103:0/1387633966 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f41fbbc0 0x5648f41fbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.091+0000 7f867aa00640 1 -- 172.21.15.103:0/1387633966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f4245ac0 msgr2=0x5648f41fb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f867aa00640 1 --2- 172.21.15.103:0/1387633966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f4245ac0 0x5648f41fb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f867aa00640 1 -- 172.21.15.103:0/1387633966 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648f3ffac60 con 0x5648f42451a0 2024-09-10T22:42:45.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f867aa00640 1 --2- 172.21.15.103:0/1387633966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 0x5648f4245580 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f866c009900 tx=0x7f866c0b5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6557358eef5da9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:45.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f866b400640 1 -- 172.21.15.103:0/1387633966 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c0c9070 con 0x5648f42451a0 2024-09-10T22:42:45.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f866b400640 1 -- 172.21.15.103:0/1387633966 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f866c0b3040 con 0x5648f42451a0 2024-09-10T22:42:45.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f866b400640 1 -- 172.21.15.103:0/1387633966 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c0049f0 con 0x5648f42451a0 2024-09-10T22:42:45.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8684d46000 1 -- 172.21.15.103:0/1387633966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 msgr2=0x5648f4245580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8684d46000 1 --2- 172.21.15.103:0/1387633966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 0x5648f4245580 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f866c009900 tx=0x7f866c0b5000 comp rx=0 tx=0).stop 2024-09-10T22:42:45.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8684d46000 1 -- 172.21.15.103:0/1387633966 shutdown_connections 2024-09-10T22:42:45.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8684d46000 1 --2- 172.21.15.103:0/1387633966 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f41fbbc0 0x5648f41fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8684d46000 1 --2- 172.21.15.103:0/1387633966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f4245ac0 0x5648f41fb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8684d46000 1 --2- 172.21.15.103:0/1387633966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 0x5648f4245580 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8684d46000 1 -- 172.21.15.103:0/1387633966 >> 172.21.15.103:0/1387633966 conn(0x5648f4201d20 msgr2=0x5648f41f9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:45.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8684d46000 1 -- 172.21.15.103:0/1387633966 shutdown_connections 2024-09-10T22:42:45.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8684d46000 1 -- 172.21.15.103:0/1387633966 wait complete. 2024-09-10T22:42:45.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8684d46000 1 -- start start 2024-09-10T22:42:45.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8684d46000 1 Processor -- start 2024-09-10T22:42:45.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8684d46000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f41fbbc0 0x5648f424c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8684d46000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 0x5648f424ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8684d46000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f4245ac0 0x5648f424cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8684d46000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5648f4049dd0 con 0x5648f42451a0 2024-09-10T22:42:45.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8684d46000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5648f4045fc0 con 0x5648f41fbbc0 2024-09-10T22:42:45.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8684d46000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5648f3feb4b0 con 0x5648f4245ac0 2024-09-10T22:42:45.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8684d46000 10 client.0 _ll_register_callbacks cb 0x5648f3fc97d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:42:45.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8672000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 0x5648f424ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8672000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 0x5648f424ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55258/0 (socket says 172.21.15.103:55258) 2024-09-10T22:42:45.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8672000640 1 -- 172.21.15.103:0/2461812185 learned_addr learned my addr 172.21.15.103:0/2461812185 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:45.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f867aa00640 1 --2- 172.21.15.103:0/2461812185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f41fbbc0 0x5648f424c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f867b400640 1 --2- 172.21.15.103:0/2461812185 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f4245ac0 0x5648f424cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8672000640 1 -- 172.21.15.103:0/2461812185 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f4245ac0 msgr2=0x5648f424cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8672000640 1 --2- 172.21.15.103:0/2461812185 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f4245ac0 0x5648f424cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8672000640 1 -- 172.21.15.103:0/2461812185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f41fbbc0 msgr2=0x5648f424c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8672000640 1 --2- 172.21.15.103:0/2461812185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f41fbbc0 0x5648f424c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f8672000640 1 -- 172.21.15.103:0/2461812185 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648f3fe41f0 con 0x5648f42451a0 2024-09-10T22:42:45.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.095+0000 7f867aa00640 1 --2- 172.21.15.103:0/2461812185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f41fbbc0 0x5648f424c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:45.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8672000640 1 --2- 172.21.15.103:0/2461812185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 0x5648f424ca70 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f866405aa70 tx=0x7f8664059d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3e307a66cb71ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:45.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f865fe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:42:45.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f865fe00640 1 -- 172.21.15.103:0/2461812185 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664062230 con 0x5648f42451a0 2024-09-10T22:42:45.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f865fe00640 1 -- 172.21.15.103:0/2461812185 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f866405ca60 con 0x5648f42451a0 2024-09-10T22:42:45.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 1 -- 172.21.15.103:0/2461812185 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5648f3fde330 con 0x5648f42451a0 2024-09-10T22:42:45.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f865fe00640 1 -- 172.21.15.103:0/2461812185 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f8664066c50 con 0x5648f42451a0 2024-09-10T22:42:45.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 10 client.6513 fetch_fsmap learned FSMap version 61 2024-09-10T22:42:45.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 1 -- 172.21.15.103:0/2461812185 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x5648f3fcafa0 con 0x5648f42451a0 2024-09-10T22:42:45.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f865fe00640 1 -- 172.21.15.103:0/2461812185 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5648f3fde330 con 0x5648f42451a0 2024-09-10T22:42:45.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f865fe00640 1 -- 172.21.15.103:0/2461812185 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 61) ==== 3554+0+0 (secure 0 0 0) 0x7f8664077150 con 0x5648f42451a0 2024-09-10T22:42:45.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 10 client.6513 fetch_fsmap finished waiting for FSMap version 61 2024-09-10T22:42:45.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 10 client.6513 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-10T22:42:45.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 20 client.6513 populate_metadata read hostname 'smithi103' 2024-09-10T22:42:45.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 1 --2- 172.21.15.103:0/2461812185 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x5648f4254900 0x5648f4256cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 4 client.6513 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:42:45.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 1 -- 172.21.15.103:0/2461812185 --> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648f4058ae0 con 0x5648f4254900 2024-09-10T22:42:45.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f867aa00640 1 --2- 172.21.15.103:0/2461812185 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x5648f4254900 0x5648f4256cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f867aa00640 1 --2- 172.21.15.103:0/2461812185 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x5648f4254900 0x5648f4256cf0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73931c963028c427 server_cookie=d7bd9dd6e49812ef in_seq=0 out_seq=0 2024-09-10T22:42:45.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f865fe00640 10 client.6513 ms_handle_connect on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:45.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f865fe00640 1 -- 172.21.15.103:0/2461812185 <== mds.0 v2:172.21.15.103:6834/714242556 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5648f4058ae0 con 0x5648f4254900 2024-09-10T22:42:45.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f865fe00640 10 client.6513 handle_command_reply: tid=0 2024-09-10T22:42:45.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 1 client.6513 shutdown 2024-09-10T22:42:45.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 1 -- 172.21.15.103:0/2461812185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 msgr2=0x5648f424ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 1 --2- 172.21.15.103:0/2461812185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 0x5648f424ca70 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f866405aa70 tx=0x7f8664059d20 comp rx=0 tx=0).stop 2024-09-10T22:42:45.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 1 -- 172.21.15.103:0/2461812185 shutdown_connections 2024-09-10T22:42:45.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 1 --2- 172.21.15.103:0/2461812185 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x5648f4254900 0x5648f4256cf0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 1 --2- 172.21.15.103:0/2461812185 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f4245ac0 0x5648f424cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 1 --2- 172.21.15.103:0/2461812185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 0x5648f424ca70 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 1 --2- 172.21.15.103:0/2461812185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f41fbbc0 0x5648f424c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f865fe00640 0 client.6513 ms_handle_reset on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:45.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 1 -- 172.21.15.103:0/2461812185 >> 172.21.15.103:0/2461812185 conn(0x5648f4201d20 msgr2=0x5648f41f9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:45.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 1 -- 172.21.15.103:0/2461812185 shutdown_connections 2024-09-10T22:42:45.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 1 -- 172.21.15.103:0/2461812185 wait complete. 2024-09-10T22:42:45.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.099+0000 7f8684d46000 20 client.6513 trim_cache size 0 max 16384 2024-09-10T22:42:45.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f8684d46000 1 Processor -- start 2024-09-10T22:42:45.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f8684d46000 1 -- start start 2024-09-10T22:42:45.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f8684d46000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f41fbbc0 0x5648f42b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f8684d46000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 0x5648f42b6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f8684d46000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f4245ac0 0x5648f42b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f8684d46000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f867c204840 con 0x5648f42451a0 2024-09-10T22:42:45.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f8684d46000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f867c203a10 con 0x5648f41fbbc0 2024-09-10T22:42:45.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f8684d46000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f867c204110 con 0x5648f4245ac0 2024-09-10T22:42:45.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f8672000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 0x5648f42b6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f8672000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 0x5648f42b6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55266/0 (socket says 172.21.15.103:55266) 2024-09-10T22:42:45.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f8672000640 1 -- 172.21.15.103:0/4169009844 learned_addr learned my addr 172.21.15.103:0/4169009844 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:45.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f867b400640 1 --2- 172.21.15.103:0/4169009844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f4245ac0 0x5648f42b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f867aa00640 1 --2- 172.21.15.103:0/4169009844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f41fbbc0 0x5648f42b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f8672000640 1 -- 172.21.15.103:0/4169009844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f4245ac0 msgr2=0x5648f42b74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f8672000640 1 --2- 172.21.15.103:0/4169009844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f4245ac0 0x5648f42b74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f8672000640 1 -- 172.21.15.103:0/4169009844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f41fbbc0 msgr2=0x5648f42b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f8672000640 1 --2- 172.21.15.103:0/4169009844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f41fbbc0 0x5648f42b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f8672000640 1 -- 172.21.15.103:0/4169009844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648f40a3660 con 0x5648f42451a0 2024-09-10T22:42:45.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f8672000640 1 --2- 172.21.15.103:0/4169009844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 0x5648f42b6f60 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8664066e10 tx=0x7f8664059c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92cd75cd92d50f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:45.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f866aa00640 1 -- 172.21.15.103:0/4169009844 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866405d310 con 0x5648f42451a0 2024-09-10T22:42:45.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f866aa00640 1 -- 172.21.15.103:0/4169009844 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8664062020 con 0x5648f42451a0 2024-09-10T22:42:45.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.115+0000 7f866aa00640 1 -- 172.21.15.103:0/4169009844 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664062230 con 0x5648f42451a0 2024-09-10T22:42:45.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 -- 172.21.15.103:0/4169009844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 msgr2=0x5648f42b6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 --2- 172.21.15.103:0/4169009844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 0x5648f42b6f60 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8664066e10 tx=0x7f8664059c80 comp rx=0 tx=0).stop 2024-09-10T22:42:45.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 -- 172.21.15.103:0/4169009844 shutdown_connections 2024-09-10T22:42:45.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 --2- 172.21.15.103:0/4169009844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f4245ac0 0x5648f42b74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 --2- 172.21.15.103:0/4169009844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f42451a0 0x5648f42b6f60 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 --2- 172.21.15.103:0/4169009844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f41fbbc0 0x5648f42b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 -- 172.21.15.103:0/4169009844 >> 172.21.15.103:0/4169009844 conn(0x5648f4201d20 msgr2=0x5648f41fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:45.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 -- 172.21.15.103:0/4169009844 shutdown_connections 2024-09-10T22:42:45.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 -- 172.21.15.103:0/4169009844 wait complete. 2024-09-10T22:42:45.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 -- start start 2024-09-10T22:42:45.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 Processor -- start 2024-09-10T22:42:45.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f41fbbc0 0x5648f425b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f42451a0 0x5648f425bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f4245ac0 0x5648f4277210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5648f4049dd0 con 0x5648f4245ac0 2024-09-10T22:42:45.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5648f4204d40 con 0x5648f41fbbc0 2024-09-10T22:42:45.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5648f4202100 con 0x5648f42451a0 2024-09-10T22:42:45.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 10 client.0 _ll_register_callbacks cb 0x7f8664001050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:42:45.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f867b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f4245ac0 0x5648f4277210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f867b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f4245ac0 0x5648f4277210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55282/0 (socket says 172.21.15.103:55282) 2024-09-10T22:42:45.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f867b400640 1 -- 172.21.15.103:0/832072453 learned_addr learned my addr 172.21.15.103:0/832072453 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:45.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8672000640 1 --2- 172.21.15.103:0/832072453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f42451a0 0x5648f425bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f867aa00640 1 --2- 172.21.15.103:0/832072453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f41fbbc0 0x5648f425b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f867b400640 1 -- 172.21.15.103:0/832072453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f42451a0 msgr2=0x5648f425bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f867b400640 1 --2- 172.21.15.103:0/832072453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f42451a0 0x5648f425bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f867b400640 1 -- 172.21.15.103:0/832072453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f41fbbc0 msgr2=0x5648f425b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f867b400640 1 --2- 172.21.15.103:0/832072453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f41fbbc0 0x5648f425b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f867b400640 1 -- 172.21.15.103:0/832072453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648f4010090 con 0x5648f4245ac0 2024-09-10T22:42:45.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8672000640 1 --2- 172.21.15.103:0/832072453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f42451a0 0x5648f425bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:42:45.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f867b400640 1 --2- 172.21.15.103:0/832072453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f4245ac0 0x5648f4277210 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8674010c20 tx=0x7f867400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab58a4ebe42e27c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:45.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f865fe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:42:45.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f865fe00640 1 -- 172.21.15.103:0/832072453 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8674022060 con 0x5648f4245ac0 2024-09-10T22:42:45.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f865fe00640 1 -- 172.21.15.103:0/832072453 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f8674009dd0 con 0x5648f4245ac0 2024-09-10T22:42:45.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 -- 172.21.15.103:0/832072453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8664062020 con 0x5648f4245ac0 2024-09-10T22:42:45.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f865fe00640 1 -- 172.21.15.103:0/832072453 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f8674028050 con 0x5648f4245ac0 2024-09-10T22:42:45.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 10 client.6519 fetch_fsmap learned FSMap version 61 2024-09-10T22:42:45.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.119+0000 7f8684d46000 1 -- 172.21.15.103:0/832072453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x5648f3fdc5f0 con 0x5648f4245ac0 2024-09-10T22:42:45.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.123+0000 7f865fe00640 1 -- 172.21.15.103:0/832072453 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8664062020 con 0x5648f4245ac0 2024-09-10T22:42:45.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.123+0000 7f865fe00640 1 -- 172.21.15.103:0/832072453 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 61) ==== 3554+0+0 (secure 0 0 0) 0x7f867402b020 con 0x5648f4245ac0 2024-09-10T22:42:45.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.123+0000 7f8684d46000 10 client.6519 fetch_fsmap finished waiting for FSMap version 61 2024-09-10T22:42:45.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.123+0000 7f8684d46000 10 client.6519 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-10T22:42:45.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.123+0000 7f8684d46000 20 client.6519 populate_metadata read hostname 'smithi103' 2024-09-10T22:42:45.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.123+0000 7f8684d46000 1 --2- 172.21.15.103:0/832072453 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x5648f42ba640 0x5648f42baa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.123+0000 7f8684d46000 4 client.6519 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:42:45.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.123+0000 7f8684d46000 1 -- 172.21.15.103:0/832072453 --> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5648f4054590 con 0x5648f42ba640 2024-09-10T22:42:45.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.123+0000 7f867aa00640 1 --2- 172.21.15.103:0/832072453 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x5648f42ba640 0x5648f42baa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.123+0000 7f867aa00640 1 --2- 172.21.15.103:0/832072453 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x5648f42ba640 0x5648f42baa50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=442992d37a27f827 server_cookie=81126a4a3bb8e754 in_seq=0 out_seq=0 2024-09-10T22:42:45.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.123+0000 7f865fe00640 10 client.6519 ms_handle_connect on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:45.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f865fe00640 1 -- 172.21.15.103:0/832072453 <== mds.0 v2:172.21.15.103:6834/714242556 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5648f4054590 con 0x5648f42ba640 2024-09-10T22:42:45.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f865fe00640 10 client.6519 handle_command_reply: tid=0 2024-09-10T22:42:45.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8684d46000 1 client.6519 shutdown 2024-09-10T22:42:45.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8684d46000 1 -- 172.21.15.103:0/832072453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f4245ac0 msgr2=0x5648f4277210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8684d46000 1 --2- 172.21.15.103:0/832072453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f4245ac0 0x5648f4277210 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8674010c20 tx=0x7f867400f790 comp rx=0 tx=0).stop 2024-09-10T22:42:45.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8684d46000 1 -- 172.21.15.103:0/832072453 shutdown_connections 2024-09-10T22:42:45.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8684d46000 1 --2- 172.21.15.103:0/832072453 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x5648f42ba640 0x5648f42baa50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8684d46000 1 --2- 172.21.15.103:0/832072453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5648f4245ac0 0x5648f4277210 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8684d46000 1 --2- 172.21.15.103:0/832072453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5648f42451a0 0x5648f425bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8684d46000 1 --2- 172.21.15.103:0/832072453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648f41fbbc0 0x5648f425b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f865fe00640 0 client.6519 ms_handle_reset on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:45.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8684d46000 1 -- 172.21.15.103:0/832072453 >> 172.21.15.103:0/832072453 conn(0x5648f4201d20 msgr2=0x5648f4256cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:45.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8684d46000 1 -- 172.21.15.103:0/832072453 shutdown_connections 2024-09-10T22:42:45.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8684d46000 1 -- 172.21.15.103:0/832072453 wait complete. 2024-09-10T22:42:45.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8684d46000 20 client.6519 trim_cache size 0 max 16384 2024-09-10T22:42:45.147 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:42:45.147 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:42:45.147 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:42:45.147 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:42:45.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8681a00640 1 -- 172.21.15.103:0/379237962 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f86580725e0 msgr2=0x7f8658074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8681a00640 1 --2- 172.21.15.103:0/379237962 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f86580725e0 0x7f8658074aa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f866c0af000 tx=0x7f866c01b090 comp rx=0 tx=0).stop 2024-09-10T22:42:45.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8681a00640 1 -- 172.21.15.103:0/379237962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f867c0cf790 msgr2=0x7f867c1f7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8681a00640 1 --2- 172.21.15.103:0/379237962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f867c0cf790 0x7f867c1f7730 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f866400c430 tx=0x7f866400c830 comp rx=0 tx=0).stop 2024-09-10T22:42:45.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8681a00640 1 -- 172.21.15.103:0/379237962 shutdown_connections 2024-09-10T22:42:45.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8681a00640 1 --2- 172.21.15.103:0/379237962 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f86580725e0 0x7f8658074aa0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8681a00640 1 --2- 172.21.15.103:0/379237962 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f867c15c970 0x7f867c0a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8681a00640 1 --2- 172.21.15.103:0/379237962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f867c0cf790 0x7f867c1f7730 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8681a00640 1 --2- 172.21.15.103:0/379237962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f867c0cc120 0x7f867c147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8681a00640 1 -- 172.21.15.103:0/379237962 >> 172.21.15.103:0/379237962 conn(0x7f867c06cc00 msgr2=0x7f867c15c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:45.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8681a00640 1 -- 172.21.15.103:0/379237962 shutdown_connections 2024-09-10T22:42:45.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.139+0000 7f8681a00640 1 -- 172.21.15.103:0/379237962 wait complete. 2024-09-10T22:42:45.161 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:1 flush journal 2024-09-10T22:42:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.303+0000 7f9e3a200640 1 -- 172.21.15.103:0/427744253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e340d04a0 msgr2=0x7f9e340affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.303+0000 7f9e3a200640 1 --2- 172.21.15.103:0/427744253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e340d04a0 0x7f9e340affd0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f9e34069ca0 tx=0x7f9e1c01c810 comp rx=0 tx=0).stop 2024-09-10T22:42:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.303+0000 7f9e3a200640 1 -- 172.21.15.103:0/427744253 shutdown_connections 2024-09-10T22:42:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.303+0000 7f9e3a200640 1 --2- 172.21.15.103:0/427744253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e340714d0 0x7f9e340b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.303+0000 7f9e3a200640 1 --2- 172.21.15.103:0/427744253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e340d04a0 0x7f9e340affd0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.303+0000 7f9e3a200640 1 --2- 172.21.15.103:0/427744253 >> v2:172.21.15.131:3300/0 conn(0x7f9e3415f0e0 0x7f9e340cff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.303+0000 7f9e3a200640 1 -- 172.21.15.103:0/427744253 >> 172.21.15.103:0/427744253 conn(0x7f9e340d18f0 msgr2=0x7f9e340d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.303+0000 7f9e3a200640 1 -- 172.21.15.103:0/427744253 shutdown_connections 2024-09-10T22:42:45.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.303+0000 7f9e3a200640 1 -- 172.21.15.103:0/427744253 wait complete. 2024-09-10T22:42:45.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.303+0000 7f9e3a200640 1 Processor -- start 2024-09-10T22:42:45.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.303+0000 7f9e3a200640 1 -- start start 2024-09-10T22:42:45.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e3a200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e340714d0 0x7f9e34165010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e3a200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e340d04a0 0x7f9e341fa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e3a200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e3415f0e0 0x7f9e341fab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e3a200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9e34070430 con 0x7f9e3415f0e0 2024-09-10T22:42:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e3a200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9e340af2d0 con 0x7f9e340d04a0 2024-09-10T22:42:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e3a200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9e340705b0 con 0x7f9e340714d0 2024-09-10T22:42:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e39800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e3415f0e0 0x7f9e341fab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e39800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e3415f0e0 0x7f9e341fab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55292/0 (socket says 172.21.15.103:55292) 2024-09-10T22:42:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e39800640 1 -- 172.21.15.103:0/1131002968 learned_addr learned my addr 172.21.15.103:0/1131002968 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e38e00640 1 --2- 172.21.15.103:0/1131002968 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e340714d0 0x7f9e34165010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e2be00640 1 --2- 172.21.15.103:0/1131002968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e340d04a0 0x7f9e341fa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e39800640 1 -- 172.21.15.103:0/1131002968 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e340714d0 msgr2=0x7f9e34165010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e39800640 1 --2- 172.21.15.103:0/1131002968 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e340714d0 0x7f9e34165010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e39800640 1 -- 172.21.15.103:0/1131002968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e340d04a0 msgr2=0x7f9e341fa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e39800640 1 --2- 172.21.15.103:0/1131002968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e340d04a0 0x7f9e341fa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e39800640 1 -- 172.21.15.103:0/1131002968 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e340c6f20 con 0x7f9e3415f0e0 2024-09-10T22:42:45.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e39800640 1 --2- 172.21.15.103:0/1131002968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e3415f0e0 0x7f9e341fab00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00e990 tx=0x7f9e2c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:45.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e31600640 1 -- 172.21.15.103:0/1131002968 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c004d30 con 0x7f9e3415f0e0 2024-09-10T22:42:45.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e31600640 1 -- 172.21.15.103:0/1131002968 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e2c00caa0 con 0x7f9e3415f0e0 2024-09-10T22:42:45.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e31600640 1 -- 172.21.15.103:0/1131002968 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c005020 con 0x7f9e3415f0e0 2024-09-10T22:42:45.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e3a200640 1 -- 172.21.15.103:0/1131002968 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e340c7190 con 0x7f9e3415f0e0 2024-09-10T22:42:45.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.307+0000 7f9e3a200640 1 -- 172.21.15.103:0/1131002968 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e3406eef0 con 0x7f9e3415f0e0 2024-09-10T22:42:45.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e31600640 1 -- 172.21.15.103:0/1131002968 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9e2c00f040 con 0x7f9e3415f0e0 2024-09-10T22:42:45.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e31600640 1 --2- 172.21.15.103:0/1131002968 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9e100725e0 0x7f9e10074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e3ecd2000 1 Processor -- start 2024-09-10T22:42:45.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e31600640 1 -- 172.21.15.103:0/1131002968 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f9e2c093820 con 0x7f9e3415f0e0 2024-09-10T22:42:45.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e3ecd2000 1 -- start start 2024-09-10T22:42:45.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e38e00640 1 --2- 172.21.15.103:0/1131002968 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9e100725e0 0x7f9e10074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e3ecd2000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55840281d1a0 0x55840281d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e3ecd2000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281dac0 0x5584027d3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e3ecd2000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584027d3bc0 0x5584027d3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e3ecd2000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5584026bbcb0 con 0x55840281dac0 2024-09-10T22:42:45.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e3ecd2000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5584025d1310 con 0x5584027d3bc0 2024-09-10T22:42:45.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e3ecd2000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55840262eb90 con 0x55840281d1a0 2024-09-10T22:42:45.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e38e00640 1 --2- 172.21.15.103:0/1131002968 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9e100725e0 0x7f9e10074aa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400bb50 tx=0x7f9e2400b2e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:45.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e2be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281dac0 0x5584027d3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e38e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55840281d1a0 0x55840281d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e2be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281dac0 0x5584027d3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55298/0 (socket says 172.21.15.103:55298) 2024-09-10T22:42:45.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e2be00640 1 -- 172.21.15.103:0/1961603785 learned_addr learned my addr 172.21.15.103:0/1961603785 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:45.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e39800640 1 --2- 172.21.15.103:0/1961603785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584027d3bc0 0x5584027d3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e2be00640 1 -- 172.21.15.103:0/1961603785 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55840281d1a0 msgr2=0x55840281d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e2be00640 1 --2- 172.21.15.103:0/1961603785 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55840281d1a0 0x55840281d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e2be00640 1 -- 172.21.15.103:0/1961603785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584027d3bc0 msgr2=0x5584027d3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e2be00640 1 --2- 172.21.15.103:0/1961603785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584027d3bc0 0x5584027d3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e2be00640 1 -- 172.21.15.103:0/1961603785 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584025d2c60 con 0x55840281dac0 2024-09-10T22:42:45.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e2be00640 1 --2- 172.21.15.103:0/1961603785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281dac0 0x5584027d3680 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0b0040 tx=0x7f9e1c0195b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e344ab7d559e4463 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:45.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e29600640 1 -- 172.21.15.103:0/1961603785 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c0ba020 con 0x55840281dac0 2024-09-10T22:42:45.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e29600640 1 -- 172.21.15.103:0/1961603785 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e1c0043f0 con 0x55840281dac0 2024-09-10T22:42:45.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.311+0000 7f9e29600640 1 -- 172.21.15.103:0/1961603785 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c0b2040 con 0x55840281dac0 2024-09-10T22:42:45.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1961603785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281dac0 msgr2=0x5584027d3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/1961603785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281dac0 0x5584027d3680 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0b0040 tx=0x7f9e1c0195b0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1961603785 shutdown_connections 2024-09-10T22:42:45.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/1961603785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584027d3bc0 0x5584027d3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/1961603785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281dac0 0x5584027d3680 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/1961603785 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55840281d1a0 0x55840281d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1961603785 >> 172.21.15.103:0/1961603785 conn(0x5584027d9d20 msgr2=0x5584027d1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:45.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1961603785 shutdown_connections 2024-09-10T22:42:45.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1961603785 wait complete. 2024-09-10T22:42:45.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 -- start start 2024-09-10T22:42:45.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 Processor -- start 2024-09-10T22:42:45.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584027d3bc0 0x558402824530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55840281d1a0 0x558402824a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55840281dac0 0x558402824fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558402621dd0 con 0x5584027d3bc0 2024-09-10T22:42:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55840261dfc0 con 0x55840281d1a0 2024-09-10T22:42:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5584025c34b0 con 0x55840281dac0 2024-09-10T22:42:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 10 client.0 _ll_register_callbacks cb 0x5584025a17d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:42:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e38e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584027d3bc0 0x558402824530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e39800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55840281dac0 0x558402824fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e38e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584027d3bc0 0x558402824530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55300/0 (socket says 172.21.15.103:55300) 2024-09-10T22:42:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e38e00640 1 -- 172.21.15.103:0/1539972818 learned_addr learned my addr 172.21.15.103:0/1539972818 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e2be00640 1 --2- 172.21.15.103:0/1539972818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55840281d1a0 0x558402824a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e38e00640 1 -- 172.21.15.103:0/1539972818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55840281dac0 msgr2=0x558402824fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e38e00640 1 --2- 172.21.15.103:0/1539972818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55840281dac0 0x558402824fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e38e00640 1 -- 172.21.15.103:0/1539972818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55840281d1a0 msgr2=0x558402824a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e38e00640 1 --2- 172.21.15.103:0/1539972818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55840281d1a0 0x558402824a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e38e00640 1 -- 172.21.15.103:0/1539972818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584025bc1f0 con 0x5584027d3bc0 2024-09-10T22:42:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e38e00640 1 --2- 172.21.15.103:0/1539972818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584027d3bc0 0x558402824530 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9e240116c0 tx=0x7f9e24004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a80cd8eb26d0c2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e22000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:42:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e22000640 1 -- 172.21.15.103:0/1539972818 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2401e780 con 0x5584027d3bc0 2024-09-10T22:42:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e22000640 1 -- 172.21.15.103:0/1539972818 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f9e24029d00 con 0x5584027d3bc0 2024-09-10T22:42:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1539972818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5584025b6330 con 0x5584027d3bc0 2024-09-10T22:42:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e22000640 1 -- 172.21.15.103:0/1539972818 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f9e2401e920 con 0x5584027d3bc0 2024-09-10T22:42:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 10 client.6531 fetch_fsmap learned FSMap version 61 2024-09-10T22:42:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.315+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1539972818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x5584025a2fa0 con 0x5584027d3bc0 2024-09-10T22:42:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e22000640 1 -- 172.21.15.103:0/1539972818 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5584025b6330 con 0x5584027d3bc0 2024-09-10T22:42:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e22000640 1 -- 172.21.15.103:0/1539972818 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 61) ==== 3554+0+0 (secure 0 0 0) 0x7f9e24030050 con 0x5584027d3bc0 2024-09-10T22:42:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e3ecd2000 10 client.6531 fetch_fsmap finished waiting for FSMap version 61 2024-09-10T22:42:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e3ecd2000 10 client.6531 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.c 2024-09-10T22:42:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e3ecd2000 20 client.6531 populate_metadata read hostname 'smithi103' 2024-09-10T22:42:45.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/1539972818 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x55840282c900 0x55840282ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e3ecd2000 4 client.6531 mds_command: new command op to 6276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:42:45.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1539972818 --> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558402630ae0 con 0x55840282c900 2024-09-10T22:42:45.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e2be00640 1 --2- 172.21.15.103:0/1539972818 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x55840282c900 0x55840282ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e2be00640 1 --2- 172.21.15.103:0/1539972818 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x55840282c900 0x55840282ecf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=52f0fd014b24918 server_cookie=4060b9269ab58143 in_seq=0 out_seq=0 2024-09-10T22:42:45.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e22000640 10 client.6531 ms_handle_connect on v2:172.21.15.103:6832/4171945106 2024-09-10T22:42:45.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e22000640 1 -- 172.21.15.103:0/1539972818 <== mds.1 v2:172.21.15.103:6832/4171945106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558402630ae0 con 0x55840282c900 2024-09-10T22:42:45.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e22000640 10 client.6531 handle_command_reply: tid=0 2024-09-10T22:42:45.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e3ecd2000 1 client.6531 shutdown 2024-09-10T22:42:45.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1539972818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584027d3bc0 msgr2=0x558402824530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/1539972818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584027d3bc0 0x558402824530 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9e240116c0 tx=0x7f9e24004740 comp rx=0 tx=0).stop 2024-09-10T22:42:45.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1539972818 shutdown_connections 2024-09-10T22:42:45.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/1539972818 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x55840282c900 0x55840282ecf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/1539972818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55840281dac0 0x558402824fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/1539972818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55840281d1a0 0x558402824a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e22000640 0 client.6531 ms_handle_reset on v2:172.21.15.103:6832/4171945106 2024-09-10T22:42:45.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/1539972818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584027d3bc0 0x558402824530 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1539972818 >> 172.21.15.103:0/1539972818 conn(0x5584027d9d20 msgr2=0x5584027d1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:45.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1539972818 shutdown_connections 2024-09-10T22:42:45.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1539972818 wait complete. 2024-09-10T22:42:45.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.319+0000 7f9e3ecd2000 20 client.6531 trim_cache size 0 max 16384 2024-09-10T22:42:45.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e3ecd2000 1 Processor -- start 2024-09-10T22:42:45.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e3ecd2000 1 -- start start 2024-09-10T22:42:45.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e3ecd2000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584027d3bc0 0x55840282adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e3ecd2000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55840281d1a0 0x5584027d3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e3ecd2000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281dac0 0x5584027d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e3ecd2000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9e34204380 con 0x55840281dac0 2024-09-10T22:42:45.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e3ecd2000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9e34203550 con 0x5584027d3bc0 2024-09-10T22:42:45.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e3ecd2000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9e34203c50 con 0x55840281d1a0 2024-09-10T22:42:45.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e39800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281dac0 0x5584027d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e39800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281dac0 0x5584027d35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55306/0 (socket says 172.21.15.103:55306) 2024-09-10T22:42:45.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e39800640 1 -- 172.21.15.103:0/2157844661 learned_addr learned my addr 172.21.15.103:0/2157844661 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:45.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e38e00640 1 --2- 172.21.15.103:0/2157844661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584027d3bc0 0x55840282adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e2be00640 1 --2- 172.21.15.103:0/2157844661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55840281d1a0 0x5584027d3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e39800640 1 -- 172.21.15.103:0/2157844661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55840281d1a0 msgr2=0x5584027d3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e39800640 1 --2- 172.21.15.103:0/2157844661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55840281d1a0 0x5584027d3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e39800640 1 -- 172.21.15.103:0/2157844661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584027d3bc0 msgr2=0x55840282adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e39800640 1 --2- 172.21.15.103:0/2157844661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584027d3bc0 0x55840282adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e39800640 1 -- 172.21.15.103:0/2157844661 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55840267b660 con 0x55840281dac0 2024-09-10T22:42:45.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e38e00640 1 --2- 172.21.15.103:0/2157844661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584027d3bc0 0x55840282adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:45.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e39800640 1 --2- 172.21.15.103:0/2157844661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281dac0 0x5584027d35b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c05e6b0 tx=0x7f9e2c093040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3f2a8e7b0d003c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:45.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e28c00640 1 -- 172.21.15.103:0/2157844661 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c01f040 con 0x55840281dac0 2024-09-10T22:42:45.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e28c00640 1 -- 172.21.15.103:0/2157844661 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e2c063150 con 0x55840281dac0 2024-09-10T22:42:45.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e28c00640 1 -- 172.21.15.103:0/2157844661 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c067b70 con 0x55840281dac0 2024-09-10T22:42:45.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/2157844661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281dac0 msgr2=0x5584027d35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.335+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/2157844661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281dac0 0x5584027d35b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c05e6b0 tx=0x7f9e2c093040 comp rx=0 tx=0).stop 2024-09-10T22:42:45.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/2157844661 shutdown_connections 2024-09-10T22:42:45.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/2157844661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281dac0 0x5584027d35b0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/2157844661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55840281d1a0 0x5584027d3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/2157844661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584027d3bc0 0x55840282adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/2157844661 >> 172.21.15.103:0/2157844661 conn(0x5584027d9d20 msgr2=0x5584027d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:45.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/2157844661 shutdown_connections 2024-09-10T22:42:45.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/2157844661 wait complete. 2024-09-10T22:42:45.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 -- start start 2024-09-10T22:42:45.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 Processor -- start 2024-09-10T22:42:45.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5584027d3bc0 0x558402829fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281d1a0 0x55840282a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55840281dac0 0x55840284f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558402621dd0 con 0x55840281d1a0 2024-09-10T22:42:45.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x558402618ec0 con 0x55840281dac0 2024-09-10T22:42:45.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5584027dcd40 con 0x5584027d3bc0 2024-09-10T22:42:45.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 10 client.0 _ll_register_callbacks cb 0x7f9e24010bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:42:45.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e2be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281d1a0 0x55840282a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e2be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281d1a0 0x55840282a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55320/0 (socket says 172.21.15.103:55320) 2024-09-10T22:42:45.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e2be00640 1 -- 172.21.15.103:0/1692443282 learned_addr learned my addr 172.21.15.103:0/1692443282 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:45.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e39800640 1 --2- 172.21.15.103:0/1692443282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55840281dac0 0x55840284f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e38e00640 1 --2- 172.21.15.103:0/1692443282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5584027d3bc0 0x558402829fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e2be00640 1 -- 172.21.15.103:0/1692443282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5584027d3bc0 msgr2=0x558402829fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e2be00640 1 --2- 172.21.15.103:0/1692443282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5584027d3bc0 0x558402829fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e2be00640 1 -- 172.21.15.103:0/1692443282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55840281dac0 msgr2=0x55840284f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e2be00640 1 --2- 172.21.15.103:0/1692443282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55840281dac0 0x55840284f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e2be00640 1 -- 172.21.15.103:0/1692443282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584025e8090 con 0x55840281d1a0 2024-09-10T22:42:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e2be00640 1 --2- 172.21.15.103:0/1692443282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281d1a0 0x55840282a500 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0982a0 tx=0x7f9e1c009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce417a642091f0f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e22000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:42:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e22000640 1 -- 172.21.15.103:0/1692443282 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c0ba040 con 0x55840281d1a0 2024-09-10T22:42:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e22000640 1 -- 172.21.15.103:0/1692443282 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f9e1c004380 con 0x55840281d1a0 2024-09-10T22:42:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1692443282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e2c063150 con 0x55840281d1a0 2024-09-10T22:42:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e22000640 1 -- 172.21.15.103:0/1692443282 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f9e1c0b2040 con 0x55840281d1a0 2024-09-10T22:42:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 10 client.6537 fetch_fsmap learned FSMap version 61 2024-09-10T22:42:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1692443282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x5584025b45f0 con 0x55840281d1a0 2024-09-10T22:42:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e22000640 1 -- 172.21.15.103:0/1692443282 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e2c063150 con 0x55840281d1a0 2024-09-10T22:42:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e22000640 1 -- 172.21.15.103:0/1692443282 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 61) ==== 3554+0+0 (secure 0 0 0) 0x7f9e1c0b5050 con 0x55840281d1a0 2024-09-10T22:42:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 10 client.6537 fetch_fsmap finished waiting for FSMap version 61 2024-09-10T22:42:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 10 client.6537 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.c 2024-09-10T22:42:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 20 client.6537 populate_metadata read hostname 'smithi103' 2024-09-10T22:42:45.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/1692443282 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x55840284fb40 0x558402892640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 4 client.6537 mds_command: new command op to 6276 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:42:45.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1692443282 --> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55840262c590 con 0x55840284fb40 2024-09-10T22:42:45.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.339+0000 7f9e38e00640 1 --2- 172.21.15.103:0/1692443282 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x55840284fb40 0x558402892640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.343+0000 7f9e38e00640 1 --2- 172.21.15.103:0/1692443282 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x55840284fb40 0x558402892640 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f46c1a067894a63b server_cookie=8afc95666d78fd3d in_seq=0 out_seq=0 2024-09-10T22:42:45.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.343+0000 7f9e22000640 10 client.6537 ms_handle_connect on v2:172.21.15.103:6832/4171945106 2024-09-10T22:42:45.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e22000640 1 -- 172.21.15.103:0/1692443282 <== mds.1 v2:172.21.15.103:6832/4171945106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55840262c590 con 0x55840284fb40 2024-09-10T22:42:45.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e22000640 10 client.6537 handle_command_reply: tid=0 2024-09-10T22:42:45.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3ecd2000 1 client.6537 shutdown 2024-09-10T22:42:45.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1692443282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281d1a0 msgr2=0x55840282a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/1692443282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281d1a0 0x55840282a500 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0982a0 tx=0x7f9e1c009610 comp rx=0 tx=0).stop 2024-09-10T22:42:45.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1692443282 shutdown_connections 2024-09-10T22:42:45.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/1692443282 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x55840284fb40 0x558402892640 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/1692443282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55840281dac0 0x55840284f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/1692443282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55840281d1a0 0x55840282a500 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3ecd2000 1 --2- 172.21.15.103:0/1692443282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5584027d3bc0 0x558402829fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e22000640 0 client.6537 ms_handle_reset on v2:172.21.15.103:6832/4171945106 2024-09-10T22:42:45.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1692443282 >> 172.21.15.103:0/1692443282 conn(0x5584027d9d20 msgr2=0x5584027d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:45.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1692443282 shutdown_connections 2024-09-10T22:42:45.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3ecd2000 1 -- 172.21.15.103:0/1692443282 wait complete. 2024-09-10T22:42:45.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3ecd2000 20 client.6537 trim_cache size 0 max 16384 2024-09-10T22:42:45.358 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:42:45.359 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:42:45.359 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:42:45.359 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:42:45.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3a200640 1 -- 172.21.15.103:0/1131002968 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9e100725e0 msgr2=0x7f9e10074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3a200640 1 --2- 172.21.15.103:0/1131002968 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9e100725e0 0x7f9e10074aa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400bb50 tx=0x7f9e2400b2e0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3a200640 1 -- 172.21.15.103:0/1131002968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e3415f0e0 msgr2=0x7f9e341fab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3a200640 1 --2- 172.21.15.103:0/1131002968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e3415f0e0 0x7f9e341fab00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00e990 tx=0x7f9e2c00ee50 comp rx=0 tx=0).stop 2024-09-10T22:42:45.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3a200640 1 -- 172.21.15.103:0/1131002968 shutdown_connections 2024-09-10T22:42:45.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3a200640 1 --2- 172.21.15.103:0/1131002968 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9e100725e0 0x7f9e10074aa0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3a200640 1 --2- 172.21.15.103:0/1131002968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e3415f0e0 0x7f9e341fab00 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3a200640 1 --2- 172.21.15.103:0/1131002968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e340d04a0 0x7f9e341fa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3a200640 1 --2- 172.21.15.103:0/1131002968 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e340714d0 0x7f9e34165010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3a200640 1 -- 172.21.15.103:0/1131002968 >> 172.21.15.103:0/1131002968 conn(0x7f9e340d18f0 msgr2=0x7f9e3415d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:45.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3a200640 1 -- 172.21.15.103:0/1131002968 shutdown_connections 2024-09-10T22:42:45.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.355+0000 7f9e3a200640 1 -- 172.21.15.103:0/1131002968 wait complete. 2024-09-10T22:42:45.376 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:2 flush journal 2024-09-10T22:42:45.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.519+0000 7f3857400640 1 -- 172.21.15.103:0/3555988898 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38500b09c0 msgr2=0x7f38500ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.519+0000 7f3857400640 1 --2- 172.21.15.103:0/3555988898 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38500b09c0 0x7f38500ce7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f383c009870 tx=0x7f383c01c7d0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.519+0000 7f3857400640 1 -- 172.21.15.103:0/3555988898 shutdown_connections 2024-09-10T22:42:45.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.519+0000 7f3857400640 1 --2- 172.21.15.103:0/3555988898 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38500b09c0 0x7f38500ce7d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.519+0000 7f3857400640 1 -- 172.21.15.103:0/3555988898 >> 172.21.15.103:0/3555988898 conn(0x7f38500d1ac0 msgr2=0x7f38500d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:45.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.519+0000 7f3857400640 1 -- 172.21.15.103:0/3555988898 shutdown_connections 2024-09-10T22:42:45.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.519+0000 7f3857400640 1 -- 172.21.15.103:0/3555988898 wait complete. 2024-09-10T22:42:45.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.519+0000 7f3857400640 1 Processor -- start 2024-09-10T22:42:45.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.519+0000 7f3857400640 1 -- start start 2024-09-10T22:42:45.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f3857400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38500ae9c0 0x7f3850147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f3857400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38500b09c0 0x7f3850153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f3857400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f385015be30 0x7f38501586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f3857400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3850169e00 con 0x7f38500b09c0 2024-09-10T22:42:45.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f3857400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3850169c80 con 0x7f38500ae9c0 2024-09-10T22:42:45.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f3857400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3850169f80 con 0x7f385015be30 2024-09-10T22:42:45.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f384fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38500b09c0 0x7f3850153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f384fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38500b09c0 0x7f3850153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55330/0 (socket says 172.21.15.103:55330) 2024-09-10T22:42:45.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f384fe00640 1 -- 172.21.15.103:0/566321950 learned_addr learned my addr 172.21.15.103:0/566321950 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:45.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f3854a00640 1 --2- 172.21.15.103:0/566321950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38500ae9c0 0x7f3850147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f3855400640 1 --2- 172.21.15.103:0/566321950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f385015be30 0x7f38501586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f384fe00640 1 -- 172.21.15.103:0/566321950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f385015be30 msgr2=0x7f38501586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f384fe00640 1 --2- 172.21.15.103:0/566321950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f385015be30 0x7f38501586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f384fe00640 1 -- 172.21.15.103:0/566321950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38500ae9c0 msgr2=0x7f3850147fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f384fe00640 1 --2- 172.21.15.103:0/566321950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38500ae9c0 0x7f3850147fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f384fe00640 1 -- 172.21.15.103:0/566321950 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3850148660 con 0x7f38500b09c0 2024-09-10T22:42:45.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f384fe00640 1 --2- 172.21.15.103:0/566321950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38500b09c0 0x7f3850153490 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f383c0193e0 tx=0x7f383c005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:45.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f384cc00640 1 -- 172.21.15.103:0/566321950 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c0b2040 con 0x7f38500b09c0 2024-09-10T22:42:45.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f384cc00640 1 -- 172.21.15.103:0/566321950 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f383c004040 con 0x7f38500b09c0 2024-09-10T22:42:45.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f384cc00640 1 -- 172.21.15.103:0/566321950 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c004430 con 0x7f38500b09c0 2024-09-10T22:42:45.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f3857400640 1 -- 172.21.15.103:0/566321950 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38501488d0 con 0x7f38500b09c0 2024-09-10T22:42:45.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f3857400640 1 -- 172.21.15.103:0/566321950 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3850148e90 con 0x7f38500b09c0 2024-09-10T22:42:45.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.523+0000 7f384cc00640 1 -- 172.21.15.103:0/566321950 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f383c0b5070 con 0x7f38500b09c0 2024-09-10T22:42:45.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f384cc00640 1 --2- 172.21.15.103:0/566321950 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3830072610 0x7f3830074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f384cc00640 1 -- 172.21.15.103:0/566321950 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f383c12cbf0 con 0x7f38500b09c0 2024-09-10T22:42:45.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f385a86a000 1 Processor -- start 2024-09-10T22:42:45.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f385a86a000 1 -- start start 2024-09-10T22:42:45.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f3854a00640 1 --2- 172.21.15.103:0/566321950 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3830072610 0x7f3830074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f3854a00640 1 --2- 172.21.15.103:0/566321950 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3830072610 0x7f3830074ad0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3844001870 tx=0x7f3844001380 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:45.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f385a86a000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a44b600 0x56059a44b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f385a86a000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44bf20 0x56059a401a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f385a86a000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 0x56059a4023b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f385a86a000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56059a2e5cb0 con 0x56059a401fd0 2024-09-10T22:42:45.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f385a86a000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56059a1fb310 con 0x56059a44b600 2024-09-10T22:42:45.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f385a86a000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56059a258b90 con 0x56059a44bf20 2024-09-10T22:42:45.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f3855400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 0x56059a4023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f3855400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 0x56059a4023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55342/0 (socket says 172.21.15.103:55342) 2024-09-10T22:42:45.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f3855400640 1 -- 172.21.15.103:0/3502503589 learned_addr learned my addr 172.21.15.103:0/3502503589 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:45.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f3854a00640 1 --2- 172.21.15.103:0/3502503589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a44b600 0x56059a44b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f384fe00640 1 --2- 172.21.15.103:0/3502503589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44bf20 0x56059a401a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f3855400640 1 -- 172.21.15.103:0/3502503589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44bf20 msgr2=0x56059a401a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f3855400640 1 --2- 172.21.15.103:0/3502503589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44bf20 0x56059a401a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f3855400640 1 -- 172.21.15.103:0/3502503589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a44b600 msgr2=0x56059a44b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f3855400640 1 --2- 172.21.15.103:0/3502503589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a44b600 0x56059a44b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f3855400640 1 -- 172.21.15.103:0/3502503589 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56059a1fcc60 con 0x56059a401fd0 2024-09-10T22:42:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f3854a00640 1 --2- 172.21.15.103:0/3502503589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a44b600 0x56059a44b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f3855400640 1 --2- 172.21.15.103:0/3502503589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 0x56059a4023b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3848001f70 tx=0x7f38480016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697f48b321005133 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f3841600640 1 -- 172.21.15.103:0/3502503589 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384800fe50 con 0x56059a401fd0 2024-09-10T22:42:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f3841600640 1 -- 172.21.15.103:0/3502503589 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3848018070 con 0x56059a401fd0 2024-09-10T22:42:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f3841600640 1 -- 172.21.15.103:0/3502503589 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848003be0 con 0x56059a401fd0 2024-09-10T22:42:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f385a86a000 1 -- 172.21.15.103:0/3502503589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 msgr2=0x56059a4023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.527+0000 7f385a86a000 1 --2- 172.21.15.103:0/3502503589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 0x56059a4023b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3848001f70 tx=0x7f38480016b0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 1 -- 172.21.15.103:0/3502503589 shutdown_connections 2024-09-10T22:42:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 1 --2- 172.21.15.103:0/3502503589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 0x56059a4023b0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 1 --2- 172.21.15.103:0/3502503589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44bf20 0x56059a401a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 1 --2- 172.21.15.103:0/3502503589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a44b600 0x56059a44b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 1 -- 172.21.15.103:0/3502503589 >> 172.21.15.103:0/3502503589 conn(0x56059a403d20 msgr2=0x56059a3fbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 1 -- 172.21.15.103:0/3502503589 shutdown_connections 2024-09-10T22:42:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 1 -- 172.21.15.103:0/3502503589 wait complete. 2024-09-10T22:42:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 1 -- start start 2024-09-10T22:42:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 1 Processor -- start 2024-09-10T22:42:45.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a401fd0 0x56059a4359f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44b600 0x56059a435f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a44bf20 0x56059a436470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56059a24bdd0 con 0x56059a44bf20 2024-09-10T22:42:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56059a247fc0 con 0x56059a401fd0 2024-09-10T22:42:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56059a1ed4b0 con 0x56059a44b600 2024-09-10T22:42:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 10 client.0 _ll_register_callbacks cb 0x56059a1cb7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:42:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f3855400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a44bf20 0x56059a436470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f3854a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a401fd0 0x56059a4359f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f3854a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a401fd0 0x56059a4359f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:37848/0 (socket says 172.21.15.103:37848) 2024-09-10T22:42:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f3854a00640 1 -- 172.21.15.103:0/3936732565 learned_addr learned my addr 172.21.15.103:0/3936732565 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f384fe00640 1 --2- 172.21.15.103:0/3936732565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44b600 0x56059a435f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f3854a00640 1 -- 172.21.15.103:0/3936732565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44b600 msgr2=0x56059a435f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f3854a00640 1 --2- 172.21.15.103:0/3936732565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44b600 0x56059a435f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f3854a00640 1 -- 172.21.15.103:0/3936732565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a44bf20 msgr2=0x56059a436470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f3854a00640 1 --2- 172.21.15.103:0/3936732565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a44bf20 0x56059a436470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f3854a00640 1 -- 172.21.15.103:0/3936732565 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56059a1e61f0 con 0x56059a401fd0 2024-09-10T22:42:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f3855400640 1 --2- 172.21.15.103:0/3936732565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a44bf20 0x56059a436470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:42:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f3854a00640 1 --2- 172.21.15.103:0/3936732565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a401fd0 0x56059a4359f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3844007b00 tx=0x7f3844007d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36b22630f90ad891 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f3836000640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-10T22:42:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f3836000640 1 -- 172.21.15.103:0/3936732565 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3844015610 con 0x56059a401fd0 2024-09-10T22:42:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f3836000640 1 -- 172.21.15.103:0/3936732565 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f38440157b0 con 0x56059a401fd0 2024-09-10T22:42:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 1 -- 172.21.15.103:0/3936732565 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56059a1e0330 con 0x56059a401fd0 2024-09-10T22:42:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f3836000640 1 -- 172.21.15.103:0/3936732565 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f38440159b0 con 0x56059a401fd0 2024-09-10T22:42:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 10 client.6286 fetch_fsmap learned FSMap version 61 2024-09-10T22:42:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f385a86a000 1 -- 172.21.15.103:0/3936732565 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x56059a1ccfa0 con 0x56059a401fd0 2024-09-10T22:42:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.531+0000 7f3836000640 1 -- 172.21.15.103:0/3936732565 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56059a1e0330 con 0x56059a401fd0 2024-09-10T22:42:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f3836000640 1 -- 172.21.15.103:0/3936732565 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 61) ==== 3554+0+0 (secure 0 0 0) 0x7f3844031080 con 0x56059a401fd0 2024-09-10T22:42:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f385a86a000 10 client.6286 fetch_fsmap finished waiting for FSMap version 61 2024-09-10T22:42:45.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f385a86a000 10 client.6286 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.b 2024-09-10T22:42:45.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f385a86a000 20 client.6286 populate_metadata read hostname 'smithi103' 2024-09-10T22:42:45.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f385a86a000 1 --2- 172.21.15.103:0/3936732565 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x56059a436e80 0x56059a45c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f385a86a000 4 client.6286 mds_command: new command op to 5630 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:42:45.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f385a86a000 1 -- 172.21.15.103:0/3936732565 --> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56059a25aae0 con 0x56059a436e80 2024-09-10T22:42:45.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f384fe00640 1 --2- 172.21.15.103:0/3936732565 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x56059a436e80 0x56059a45c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f384fe00640 1 --2- 172.21.15.103:0/3936732565 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x56059a436e80 0x56059a45c8b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a305d8429d5d3f22 server_cookie=d4578f5e2fb0371e in_seq=0 out_seq=0 2024-09-10T22:42:45.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f3836000640 10 client.6286 ms_handle_connect on v2:172.21.15.131:6836/360467048 2024-09-10T22:42:45.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f3836000640 1 -- 172.21.15.103:0/3936732565 <== mds.2 v2:172.21.15.131:6836/360467048 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56059a25aae0 con 0x56059a436e80 2024-09-10T22:42:45.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f3836000640 10 client.6286 handle_command_reply: tid=0 2024-09-10T22:42:45.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f385a86a000 1 client.6286 shutdown 2024-09-10T22:42:45.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f385a86a000 1 -- 172.21.15.103:0/3936732565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a401fd0 msgr2=0x56059a4359f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f385a86a000 1 --2- 172.21.15.103:0/3936732565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a401fd0 0x56059a4359f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3844007b00 tx=0x7f3844007d10 comp rx=0 tx=0).stop 2024-09-10T22:42:45.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f385a86a000 1 -- 172.21.15.103:0/3936732565 shutdown_connections 2024-09-10T22:42:45.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f385a86a000 1 --2- 172.21.15.103:0/3936732565 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x56059a436e80 0x56059a45c8b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f385a86a000 1 --2- 172.21.15.103:0/3936732565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a44bf20 0x56059a436470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f385a86a000 1 --2- 172.21.15.103:0/3936732565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44b600 0x56059a435f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f3836000640 0 client.6286 ms_handle_reset on v2:172.21.15.131:6836/360467048 2024-09-10T22:42:45.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f385a86a000 1 --2- 172.21.15.103:0/3936732565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a401fd0 0x56059a4359f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f385a86a000 1 -- 172.21.15.103:0/3936732565 >> 172.21.15.103:0/3936732565 conn(0x56059a403d20 msgr2=0x56059a4032e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:45.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f385a86a000 1 -- 172.21.15.103:0/3936732565 shutdown_connections 2024-09-10T22:42:45.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f385a86a000 1 -- 172.21.15.103:0/3936732565 wait complete. 2024-09-10T22:42:45.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.535+0000 7f385a86a000 20 client.6286 trim_cache size 0 max 16384 2024-09-10T22:42:45.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f385a86a000 1 Processor -- start 2024-09-10T22:42:45.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f385a86a000 1 -- start start 2024-09-10T22:42:45.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f385a86a000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 0x56059a4bdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f385a86a000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a44b600 0x56059a4be160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f385a86a000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44bf20 0x56059a4be6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f385a86a000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f38502002f0 con 0x56059a401fd0 2024-09-10T22:42:45.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f385a86a000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f385006f8d0 con 0x56059a44b600 2024-09-10T22:42:45.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f385a86a000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f38501ffbe0 con 0x56059a44bf20 2024-09-10T22:42:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f3854a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 0x56059a4bdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f3854a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 0x56059a4bdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55366/0 (socket says 172.21.15.103:55366) 2024-09-10T22:42:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f384fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a44b600 0x56059a4be160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f3854a00640 1 -- 172.21.15.103:0/2325337036 learned_addr learned my addr 172.21.15.103:0/2325337036 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f3855400640 1 --2- 172.21.15.103:0/2325337036 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44bf20 0x56059a4be6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f3854a00640 1 -- 172.21.15.103:0/2325337036 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44bf20 msgr2=0x56059a4be6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f3854a00640 1 --2- 172.21.15.103:0/2325337036 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44bf20 0x56059a4be6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f3854a00640 1 -- 172.21.15.103:0/2325337036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a44b600 msgr2=0x56059a4be160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f3854a00640 1 --2- 172.21.15.103:0/2325337036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a44b600 0x56059a4be160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f3854a00640 1 -- 172.21.15.103:0/2325337036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56059a44bd50 con 0x56059a401fd0 2024-09-10T22:42:45.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f384fe00640 1 --2- 172.21.15.103:0/2325337036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a44b600 0x56059a4be160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:42:45.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f3854a00640 1 --2- 172.21.15.103:0/2325337036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 0x56059a4bdc20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3844021460 tx=0x7f384400fe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58da513ee6b01af3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:45.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f3840c00640 1 -- 172.21.15.103:0/2325337036 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38440214e0 con 0x56059a401fd0 2024-09-10T22:42:45.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f3840c00640 1 -- 172.21.15.103:0/2325337036 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3844034070 con 0x56059a401fd0 2024-09-10T22:42:45.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f3840c00640 1 -- 172.21.15.103:0/2325337036 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3844021a70 con 0x56059a401fd0 2024-09-10T22:42:45.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f385a86a000 1 -- 172.21.15.103:0/2325337036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 msgr2=0x56059a4bdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f385a86a000 1 --2- 172.21.15.103:0/2325337036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 0x56059a4bdc20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3844021460 tx=0x7f384400fe00 comp rx=0 tx=0).stop 2024-09-10T22:42:45.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f385a86a000 1 -- 172.21.15.103:0/2325337036 shutdown_connections 2024-09-10T22:42:45.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f385a86a000 1 --2- 172.21.15.103:0/2325337036 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44bf20 0x56059a4be6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f385a86a000 1 --2- 172.21.15.103:0/2325337036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a44b600 0x56059a4be160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.551+0000 7f385a86a000 1 --2- 172.21.15.103:0/2325337036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 0x56059a4bdc20 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 1 -- 172.21.15.103:0/2325337036 >> 172.21.15.103:0/2325337036 conn(0x56059a403d20 msgr2=0x56059a3fb740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:45.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 1 -- 172.21.15.103:0/2325337036 shutdown_connections 2024-09-10T22:42:45.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 1 -- 172.21.15.103:0/2325337036 wait complete. 2024-09-10T22:42:45.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 1 -- start start 2024-09-10T22:42:45.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 1 Processor -- start 2024-09-10T22:42:45.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 0x56059a45fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a44b600 0x56059a460000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44bf20 0x56059a47de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56059a1ed700 con 0x56059a401fd0 2024-09-10T22:42:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56059a242ec0 con 0x56059a44b600 2024-09-10T22:42:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56059a24bdd0 con 0x56059a44bf20 2024-09-10T22:42:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 10 client.0 _ll_register_callbacks cb 0x7f3844007a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:42:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f3854a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 0x56059a45fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f3854a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 0x56059a45fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55376/0 (socket says 172.21.15.103:55376) 2024-09-10T22:42:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f3854a00640 1 -- 172.21.15.103:0/565175959 learned_addr learned my addr 172.21.15.103:0/565175959 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f384fe00640 1 --2- 172.21.15.103:0/565175959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a44b600 0x56059a460000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f3855400640 1 --2- 172.21.15.103:0/565175959 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44bf20 0x56059a47de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f3854a00640 1 -- 172.21.15.103:0/565175959 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44bf20 msgr2=0x56059a47de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f3854a00640 1 --2- 172.21.15.103:0/565175959 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44bf20 0x56059a47de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f3854a00640 1 -- 172.21.15.103:0/565175959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a44b600 msgr2=0x56059a460000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f3854a00640 1 --2- 172.21.15.103:0/565175959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a44b600 0x56059a460000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f3854a00640 1 -- 172.21.15.103:0/565175959 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56059a2a5660 con 0x56059a401fd0 2024-09-10T22:42:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f3854a00640 1 --2- 172.21.15.103:0/565175959 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 0x56059a45fac0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f384400fe90 tx=0x7f38440215f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabb58a1b8860618 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f3836000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:42:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f3836000640 1 -- 172.21.15.103:0/565175959 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3844046060 con 0x56059a401fd0 2024-09-10T22:42:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f3836000640 1 -- 172.21.15.103:0/565175959 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f3844021be0 con 0x56059a401fd0 2024-09-10T22:42:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 1 -- 172.21.15.103:0/565175959 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3844034070 con 0x56059a401fd0 2024-09-10T22:42:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f3836000640 1 -- 172.21.15.103:0/565175959 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f384404c050 con 0x56059a401fd0 2024-09-10T22:42:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 10 client.6555 fetch_fsmap learned FSMap version 61 2024-09-10T22:42:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 1 -- 172.21.15.103:0/565175959 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x56059a212090 con 0x56059a401fd0 2024-09-10T22:42:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f3836000640 1 -- 172.21.15.103:0/565175959 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3844034070 con 0x56059a401fd0 2024-09-10T22:42:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f3836000640 1 -- 172.21.15.103:0/565175959 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 61) ==== 3554+0+0 (secure 0 0 0) 0x7f384404f020 con 0x56059a401fd0 2024-09-10T22:42:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 10 client.6555 fetch_fsmap finished waiting for FSMap version 61 2024-09-10T22:42:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 10 client.6555 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.b 2024-09-10T22:42:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 20 client.6555 populate_metadata read hostname 'smithi103' 2024-09-10T22:42:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 1 --2- 172.21.15.103:0/565175959 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x56059a47e810 0x56059a4c1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 4 client.6555 mds_command: new command op to 5630 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:42:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.555+0000 7f385a86a000 1 -- 172.21.15.103:0/565175959 --> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56059a256590 con 0x56059a47e810 2024-09-10T22:42:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.559+0000 7f384fe00640 1 --2- 172.21.15.103:0/565175959 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x56059a47e810 0x56059a4c1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.559+0000 7f384fe00640 1 --2- 172.21.15.103:0/565175959 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x56059a47e810 0x56059a4c1a90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=25e5b28c7ec42c49 server_cookie=c32244c9f11e5764 in_seq=0 out_seq=0 2024-09-10T22:42:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.559+0000 7f3836000640 10 client.6555 ms_handle_connect on v2:172.21.15.131:6836/360467048 2024-09-10T22:42:45.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f3836000640 1 -- 172.21.15.103:0/565175959 <== mds.2 v2:172.21.15.131:6836/360467048 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56059a256590 con 0x56059a47e810 2024-09-10T22:42:45.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f3836000640 10 client.6555 handle_command_reply: tid=0 2024-09-10T22:42:45.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f385a86a000 1 client.6555 shutdown 2024-09-10T22:42:45.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f385a86a000 1 -- 172.21.15.103:0/565175959 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 msgr2=0x56059a45fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f385a86a000 1 --2- 172.21.15.103:0/565175959 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 0x56059a45fac0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f384400fe90 tx=0x7f38440215f0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f385a86a000 1 -- 172.21.15.103:0/565175959 shutdown_connections 2024-09-10T22:42:45.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f385a86a000 1 --2- 172.21.15.103:0/565175959 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x56059a47e810 0x56059a4c1a90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f385a86a000 1 --2- 172.21.15.103:0/565175959 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56059a44bf20 0x56059a47de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f385a86a000 1 --2- 172.21.15.103:0/565175959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56059a44b600 0x56059a460000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f385a86a000 1 --2- 172.21.15.103:0/565175959 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56059a401fd0 0x56059a45fac0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f3836000640 0 client.6555 ms_handle_reset on v2:172.21.15.131:6836/360467048 2024-09-10T22:42:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f385a86a000 1 -- 172.21.15.103:0/565175959 >> 172.21.15.103:0/565175959 conn(0x56059a403d20 msgr2=0x56059a3fbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f385a86a000 1 -- 172.21.15.103:0/565175959 shutdown_connections 2024-09-10T22:42:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f385a86a000 1 -- 172.21.15.103:0/565175959 wait complete. 2024-09-10T22:42:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f385a86a000 20 client.6555 trim_cache size 0 max 16384 2024-09-10T22:42:45.572 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:42:45.572 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:42:45.572 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:42:45.573 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:42:45.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f3857400640 1 -- 172.21.15.103:0/566321950 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3830072610 msgr2=0x7f3830074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f3857400640 1 --2- 172.21.15.103:0/566321950 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3830072610 0x7f3830074ad0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3844001870 tx=0x7f3844001380 comp rx=0 tx=0).stop 2024-09-10T22:42:45.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f3857400640 1 -- 172.21.15.103:0/566321950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38500b09c0 msgr2=0x7f3850153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:45.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f3857400640 1 --2- 172.21.15.103:0/566321950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38500b09c0 0x7f3850153490 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f383c0193e0 tx=0x7f383c005760 comp rx=0 tx=0).stop 2024-09-10T22:42:45.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f3857400640 1 -- 172.21.15.103:0/566321950 shutdown_connections 2024-09-10T22:42:45.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f3857400640 1 --2- 172.21.15.103:0/566321950 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3830072610 0x7f3830074ad0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f3857400640 1 --2- 172.21.15.103:0/566321950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f385015be30 0x7f38501586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f3857400640 1 --2- 172.21.15.103:0/566321950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38500b09c0 0x7f3850153490 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f3857400640 1 --2- 172.21.15.103:0/566321950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38500ae9c0 0x7f3850147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:45.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f3857400640 1 -- 172.21.15.103:0/566321950 >> 172.21.15.103:0/566321950 conn(0x7f38500d1ac0 msgr2=0x7f3850154720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:45.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f3857400640 1 -- 172.21.15.103:0/566321950 shutdown_connections 2024-09-10T22:42:45.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45.567+0000 7f3857400640 1 -- 172.21.15.103:0/566321950 wait complete. 2024-09-10T22:42:45.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:45.591 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2024-09-10T22:42:45.625 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/ 2024-09-10T22:42:45.625 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4 2024-09-10T22:42:45.625 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5 2024-09-10T22:42:45.625 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5/d6 2024-09-10T22:42:45.625 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5/d6/d7 2024-09-10T22:42:45.625 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2024-09-10T22:42:45.626 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:42:45.626 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:42:45.626 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:42:45.626 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:42:45.626 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2024-09-10T22:42:45.626 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:42:45.732 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627778 2024-09-10T22:42:45.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:42:45.741 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:42:45.741 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:42:45.741 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:42:45.742 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:42:45.742 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2024-09-10T22:42:45.742 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:42:45.848 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627779 2024-09-10T22:42:45.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:42:45.858 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:42:45.858 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:42:45.858 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:42:45.858 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:42:45.858 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2024-09-10T22:42:45.858 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:42:45.968 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627780 2024-09-10T22:42:45.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:42:45.977 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:42:45.977 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:42:45.977 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:42:45.977 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:42:45.977 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2024-09-10T22:42:45.977 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:42:46.084 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627781 2024-09-10T22:42:46.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:42:46.093 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:42:46.093 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:42:46.093 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:42:46.093 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:42:46.093 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2024-09-10T22:42:46.093 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:42:46.200 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627782 2024-09-10T22:42:46.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:42:46.209 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:42:46.209 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:42:46.209 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:42:46.209 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:42:46.209 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2024-09-10T22:42:46.209 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:42:46.316 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627783 2024-09-10T22:42:46.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:42:46.325 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2024-09-10T22:42:46.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f1833833080 1 Processor -- start 2024-09-10T22:42:46.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f1833833080 1 -- start start 2024-09-10T22:42:46.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f1833833080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558268449db0 0x558268494710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f1833833080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55826848b4d0 0x55826847ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f1833833080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558268520510 0x55826847b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f1833833080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55826839aa00 con 0x55826848b4d0 2024-09-10T22:42:46.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f1833833080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5582683f8f40 con 0x558268449db0 2024-09-10T22:42:46.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f1833833080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x558268521360 con 0x558268520510 2024-09-10T22:42:46.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f182be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55826848b4d0 0x55826847ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f182be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55826848b4d0 0x55826847ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55392/0 (socket says 172.21.15.103:55392) 2024-09-10T22:42:46.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f182be00640 1 -- 172.21.15.103:0/3643955070 learned_addr learned my addr 172.21.15.103:0/3643955070 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:46.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f1830a00640 1 --2- 172.21.15.103:0/3643955070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558268449db0 0x558268494710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f1831400640 1 --2- 172.21.15.103:0/3643955070 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558268520510 0x55826847b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f182be00640 1 -- 172.21.15.103:0/3643955070 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558268520510 msgr2=0x55826847b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:46.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f182be00640 1 --2- 172.21.15.103:0/3643955070 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558268520510 0x55826847b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f182be00640 1 -- 172.21.15.103:0/3643955070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558268449db0 msgr2=0x558268494710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:46.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f182be00640 1 --2- 172.21.15.103:0/3643955070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558268449db0 0x558268494710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f182be00640 1 -- 172.21.15.103:0/3643955070 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558268373c10 con 0x55826848b4d0 2024-09-10T22:42:46.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.411+0000 7f182be00640 1 --2- 172.21.15.103:0/3643955070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55826848b4d0 0x55826847ab30 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f181c00b2a0 tx=0x7f181c00b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9c00a9af724ed6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f182aa00640 1 -- 172.21.15.103:0/3643955070 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c00a040 con 0x55826848b4d0 2024-09-10T22:42:46.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f182aa00640 1 -- 172.21.15.103:0/3643955070 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f181c00f620 con 0x55826848b4d0 2024-09-10T22:42:46.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f182aa00640 1 -- 172.21.15.103:0/3643955070 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c00fa70 con 0x55826848b4d0 2024-09-10T22:42:46.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 -- 172.21.15.103:0/3643955070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55826848b4d0 msgr2=0x55826847ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 --2- 172.21.15.103:0/3643955070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55826848b4d0 0x55826847ab30 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f181c00b2a0 tx=0x7f181c00b760 comp rx=0 tx=0).stop 2024-09-10T22:42:46.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 -- 172.21.15.103:0/3643955070 shutdown_connections 2024-09-10T22:42:46.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 --2- 172.21.15.103:0/3643955070 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558268520510 0x55826847b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 --2- 172.21.15.103:0/3643955070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55826848b4d0 0x55826847ab30 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 --2- 172.21.15.103:0/3643955070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558268449db0 0x558268494710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 -- 172.21.15.103:0/3643955070 >> 172.21.15.103:0/3643955070 conn(0x55826844bc80 msgr2=0x55826848f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:46.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 -- 172.21.15.103:0/3643955070 shutdown_connections 2024-09-10T22:42:46.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 -- 172.21.15.103:0/3643955070 wait complete. 2024-09-10T22:42:46.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 Processor -- start 2024-09-10T22:42:46.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 -- start start 2024-09-10T22:42:46.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558268449db0 0x558268528cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55826848b4d0 0x558268518940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558268520510 0x55826844a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55826851eaf0 con 0x558268520510 2024-09-10T22:42:46.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55826851ed90 con 0x55826848b4d0 2024-09-10T22:42:46.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55826851f030 con 0x558268449db0 2024-09-10T22:42:46.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1831400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558268520510 0x55826844a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1831400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558268520510 0x55826844a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55402/0 (socket says 172.21.15.103:55402) 2024-09-10T22:42:46.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1831400640 1 -- 172.21.15.103:0/1307474082 learned_addr learned my addr 172.21.15.103:0/1307474082 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:46.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1830a00640 1 --2- 172.21.15.103:0/1307474082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558268449db0 0x558268528cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f182be00640 1 --2- 172.21.15.103:0/1307474082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55826848b4d0 0x558268518940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1831400640 1 -- 172.21.15.103:0/1307474082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558268449db0 msgr2=0x558268528cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1831400640 1 --2- 172.21.15.103:0/1307474082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558268449db0 0x558268528cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1831400640 1 -- 172.21.15.103:0/1307474082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55826848b4d0 msgr2=0x558268518940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1831400640 1 --2- 172.21.15.103:0/1307474082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55826848b4d0 0x558268518940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1831400640 1 -- 172.21.15.103:0/1307474082 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55826851a070 con 0x558268520510 2024-09-10T22:42:46.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1831400640 1 --2- 172.21.15.103:0/1307474082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558268520510 0x55826844a190 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f182c00f690 tx=0x7f182c00fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1829600640 1 -- 172.21.15.103:0/1307474082 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c004220 con 0x558268520510 2024-09-10T22:42:46.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1829600640 1 -- 172.21.15.103:0/1307474082 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f182c014070 con 0x558268520510 2024-09-10T22:42:46.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 -- 172.21.15.103:0/1307474082 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55826851a310 con 0x558268520510 2024-09-10T22:42:46.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1829600640 1 -- 172.21.15.103:0/1307474082 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c00ca50 con 0x558268520510 2024-09-10T22:42:46.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.415+0000 7f1833833080 1 -- 172.21.15.103:0/1307474082 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55826851ab60 con 0x558268520510 2024-09-10T22:42:46.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.419+0000 7f1829600640 1 -- 172.21.15.103:0/1307474082 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f182c00cbf0 con 0x558268520510 2024-09-10T22:42:46.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.419+0000 7f1829600640 1 --2- 172.21.15.103:0/1307474082 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1810070ff0 0x7f18100734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.419+0000 7f1829600640 1 -- 172.21.15.103:0/1307474082 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f182c092ab0 con 0x558268520510 2024-09-10T22:42:46.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.419+0000 7f1833833080 1 --2- 172.21.15.103:0/1307474082 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x5582685198b0 0x55826851b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.419+0000 7f1833833080 1 -- 172.21.15.103:0/1307474082 --> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] -- osd_op(unknown.0.0:1 9.12 9:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70) -- 0x55826851b540 con 0x5582685198b0 2024-09-10T22:42:46.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.419+0000 7f1830a00640 1 --2- 172.21.15.103:0/1307474082 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1810070ff0 0x7f18100734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.419+0000 7f182be00640 1 --2- 172.21.15.103:0/1307474082 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x5582685198b0 0x55826851b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.419+0000 7f1830a00640 1 --2- 172.21.15.103:0/1307474082 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1810070ff0 0x7f18100734b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f18240ab000 tx=0x7f18240199c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.419+0000 7f182be00640 1 --2- 172.21.15.103:0/1307474082 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x5582685198b0 0x55826851b000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.423+0000 7f182be00640 1 -- 172.21.15.103:0/1307474082 <== osd.5 v2:172.21.15.131:6800/175724775 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v70'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f181c00d040 con 0x5582685198b0 2024-09-10T22:42:46.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.423+0000 7f1833833080 1 -- 172.21.15.103:0/1307474082 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x5582685198b0 msgr2=0x55826851b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.423+0000 7f1833833080 1 --2- 172.21.15.103:0/1307474082 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x5582685198b0 0x55826851b000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.423+0000 7f1833833080 1 -- 172.21.15.103:0/1307474082 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1810070ff0 msgr2=0x7f18100734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.423+0000 7f1833833080 1 --2- 172.21.15.103:0/1307474082 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1810070ff0 0x7f18100734b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f18240ab000 tx=0x7f18240199c0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.423+0000 7f1833833080 1 -- 172.21.15.103:0/1307474082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558268520510 msgr2=0x55826844a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.423+0000 7f1833833080 1 --2- 172.21.15.103:0/1307474082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558268520510 0x55826844a190 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f182c00f690 tx=0x7f182c00fa90 comp rx=0 tx=0).stop 2024-09-10T22:42:46.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.423+0000 7f1831400640 1 -- 172.21.15.103:0/1307474082 reap_dead start 2024-09-10T22:42:46.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.423+0000 7f1833833080 1 -- 172.21.15.103:0/1307474082 shutdown_connections 2024-09-10T22:42:46.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.423+0000 7f1833833080 1 -- 172.21.15.103:0/1307474082 >> 172.21.15.103:0/1307474082 conn(0x55826844bc80 msgr2=0x55826851f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:46.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.423+0000 7f1833833080 1 -- 172.21.15.103:0/1307474082 shutdown_connections 2024-09-10T22:42:46.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.423+0000 7f1833833080 1 -- 172.21.15.103:0/1307474082 wait complete. 2024-09-10T22:42:46.431 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2024-09-10T22:42:46.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18fba48080 1 Processor -- start 2024-09-10T22:42:46.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18fba48080 1 -- start start 2024-09-10T22:42:46.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18fba48080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18dc003100 0x556beb0179a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18fba48080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556beb149b00 0x556beb149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18fba48080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556beb14a420 0x556beb14a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18fba48080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556beaf93f40 con 0x556beb149b00 2024-09-10T22:42:46.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18fba48080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x556beafa0d00 con 0x7f18dc003100 2024-09-10T22:42:46.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18fba48080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x556beaf35a00 con 0x556beb14a420 2024-09-10T22:42:46.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18f7600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556beb149b00 0x556beb149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18f7600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556beb149b00 0x556beb149ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55412/0 (socket says 172.21.15.103:55412) 2024-09-10T22:42:46.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18f7600640 1 -- 172.21.15.103:0/1396856040 learned_addr learned my addr 172.21.15.103:0/1396856040 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:46.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18f8000640 1 --2- 172.21.15.103:0/1396856040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18dc003100 0x556beb0179a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18f8a00640 1 --2- 172.21.15.103:0/1396856040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556beb14a420 0x556beb14a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18f7600640 1 -- 172.21.15.103:0/1396856040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556beb14a420 msgr2=0x556beb14a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:46.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18f7600640 1 --2- 172.21.15.103:0/1396856040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556beb14a420 0x556beb14a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18f7600640 1 -- 172.21.15.103:0/1396856040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18dc003100 msgr2=0x556beb0179a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:46.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18f7600640 1 --2- 172.21.15.103:0/1396856040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18dc003100 0x556beb0179a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18f7600640 1 -- 172.21.15.103:0/1396856040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556beb08a540 con 0x556beb149b00 2024-09-10T22:42:46.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18f7600640 1 --2- 172.21.15.103:0/1396856040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556beb149b00 0x556beb149ee0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f18e4096a30 tx=0x7f18dc004130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6a13c5d4c9bfa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18f6200640 1 -- 172.21.15.103:0/1396856040 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e40ba070 con 0x556beb149b00 2024-09-10T22:42:46.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18f6200640 1 -- 172.21.15.103:0/1396856040 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18e40abaa0 con 0x556beb149b00 2024-09-10T22:42:46.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.519+0000 7f18f6200640 1 -- 172.21.15.103:0/1396856040 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e40b0040 con 0x556beb149b00 2024-09-10T22:42:46.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 -- 172.21.15.103:0/1396856040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556beb149b00 msgr2=0x556beb149ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 --2- 172.21.15.103:0/1396856040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556beb149b00 0x556beb149ee0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f18e4096a30 tx=0x7f18dc004130 comp rx=0 tx=0).stop 2024-09-10T22:42:46.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 -- 172.21.15.103:0/1396856040 shutdown_connections 2024-09-10T22:42:46.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 --2- 172.21.15.103:0/1396856040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556beb14a420 0x556beb14a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 --2- 172.21.15.103:0/1396856040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556beb149b00 0x556beb149ee0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 --2- 172.21.15.103:0/1396856040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18dc003100 0x556beb0179a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 -- 172.21.15.103:0/1396856040 >> 172.21.15.103:0/1396856040 conn(0x556beafe8f30 msgr2=0x556beb02fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:46.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 -- 172.21.15.103:0/1396856040 shutdown_connections 2024-09-10T22:42:46.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 -- 172.21.15.103:0/1396856040 wait complete. 2024-09-10T22:42:46.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 Processor -- start 2024-09-10T22:42:46.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 -- start start 2024-09-10T22:42:46.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556beb14a420 0x556beb0173d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18dc003100 0x556beb0a2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556beb14b9b0 0x556beb016440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556beb018050 con 0x556beb14b9b0 2024-09-10T22:42:46.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x556beb0182f0 con 0x556beb14a420 2024-09-10T22:42:46.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x556beb018590 con 0x7f18dc003100 2024-09-10T22:42:46.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18f8a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556beb14b9b0 0x556beb016440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18f8a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556beb14b9b0 0x556beb016440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55422/0 (socket says 172.21.15.103:55422) 2024-09-10T22:42:46.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18f8a00640 1 -- 172.21.15.103:0/1306153242 learned_addr learned my addr 172.21.15.103:0/1306153242 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:46.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18f8000640 1 --2- 172.21.15.103:0/1306153242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556beb14a420 0x556beb0173d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18f7600640 1 --2- 172.21.15.103:0/1306153242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18dc003100 0x556beb0a2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18f8a00640 1 -- 172.21.15.103:0/1306153242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18dc003100 msgr2=0x556beb0a2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18f8a00640 1 --2- 172.21.15.103:0/1306153242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18dc003100 0x556beb0a2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18f8a00640 1 -- 172.21.15.103:0/1306153242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556beb14a420 msgr2=0x556beb0173d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18f8a00640 1 --2- 172.21.15.103:0/1306153242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556beb14a420 0x556beb0173d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18f8a00640 1 -- 172.21.15.103:0/1306153242 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556beb14c160 con 0x556beb14b9b0 2024-09-10T22:42:46.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18f8a00640 1 --2- 172.21.15.103:0/1306153242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556beb14b9b0 0x556beb016440 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f18f0004fd0 tx=0x7f18f000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18f4e00640 1 -- 172.21.15.103:0/1306153242 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0004020 con 0x556beb14b9b0 2024-09-10T22:42:46.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18f4e00640 1 -- 172.21.15.103:0/1306153242 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18f00041c0 con 0x556beb14b9b0 2024-09-10T22:42:46.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18f4e00640 1 -- 172.21.15.103:0/1306153242 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f000fad0 con 0x556beb14b9b0 2024-09-10T22:42:46.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 -- 172.21.15.103:0/1306153242 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556beb14bec0 con 0x556beb14b9b0 2024-09-10T22:42:46.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.523+0000 7f18fba48080 1 -- 172.21.15.103:0/1306153242 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556beafe6270 con 0x556beb14b9b0 2024-09-10T22:42:46.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.527+0000 7f18f4e00640 1 -- 172.21.15.103:0/1306153242 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f18f000fc70 con 0x556beb14b9b0 2024-09-10T22:42:46.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.527+0000 7f18f4e00640 1 --2- 172.21.15.103:0/1306153242 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f18d8070ff0 0x7f18d80734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.527+0000 7f18f4e00640 1 -- 172.21.15.103:0/1306153242 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f18f00929d0 con 0x556beb14b9b0 2024-09-10T22:42:46.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.527+0000 7f18f8000640 1 --2- 172.21.15.103:0/1306153242 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f18d8070ff0 0x7f18d80734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.527+0000 7f18fba48080 1 --2- 172.21.15.103:0/1306153242 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x556beafe6ec0 0x556beafe72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.527+0000 7f18fba48080 1 -- 172.21.15.103:0/1306153242 --> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] -- osd_op(unknown.0.0:1 9.12 9:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70) -- 0x556beb0a2bc0 con 0x556beafe6ec0 2024-09-10T22:42:46.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.527+0000 7f18f7600640 1 --2- 172.21.15.103:0/1306153242 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x556beafe6ec0 0x556beafe72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.527+0000 7f18f8000640 1 --2- 172.21.15.103:0/1306153242 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f18d8070ff0 0x7f18d80734b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f18e8001d90 tx=0x7f18e8003040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.527+0000 7f18f7600640 1 --2- 172.21.15.103:0/1306153242 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x556beafe6ec0 0x556beafe72a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.531+0000 7f18f7600640 1 -- 172.21.15.103:0/1306153242 <== osd.5 v2:172.21.15.131:6800/175724775 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v70'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f18e40b3040 con 0x556beafe6ec0 2024-09-10T22:42:46.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.531+0000 7f18fba48080 1 -- 172.21.15.103:0/1306153242 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x556beafe6ec0 msgr2=0x556beafe72a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.531+0000 7f18fba48080 1 --2- 172.21.15.103:0/1306153242 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x556beafe6ec0 0x556beafe72a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.531+0000 7f18fba48080 1 -- 172.21.15.103:0/1306153242 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f18d8070ff0 msgr2=0x7f18d80734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.531+0000 7f18fba48080 1 --2- 172.21.15.103:0/1306153242 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f18d8070ff0 0x7f18d80734b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f18e8001d90 tx=0x7f18e8003040 comp rx=0 tx=0).stop 2024-09-10T22:42:46.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.531+0000 7f18fba48080 1 -- 172.21.15.103:0/1306153242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556beb14b9b0 msgr2=0x556beb016440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.531+0000 7f18fba48080 1 --2- 172.21.15.103:0/1306153242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556beb14b9b0 0x556beb016440 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f18f0004fd0 tx=0x7f18f000dac0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.531+0000 7f18f8a00640 1 -- 172.21.15.103:0/1306153242 reap_dead start 2024-09-10T22:42:46.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.531+0000 7f18fba48080 1 -- 172.21.15.103:0/1306153242 shutdown_connections 2024-09-10T22:42:46.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.531+0000 7f18fba48080 1 -- 172.21.15.103:0/1306153242 >> 172.21.15.103:0/1306153242 conn(0x556beafe8f30 msgr2=0x556beb0bbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:46.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.531+0000 7f18fba48080 1 -- 172.21.15.103:0/1306153242 shutdown_connections 2024-09-10T22:42:46.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.531+0000 7f18fba48080 1 -- 172.21.15.103:0/1306153242 wait complete. 2024-09-10T22:42:46.539 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2024-09-10T22:42:46.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d297c080 1 Processor -- start 2024-09-10T22:42:46.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d297c080 1 -- start start 2024-09-10T22:42:46.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d297c080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563181b684c0 0x563181c37300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d297c080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563181c40740 0x563181c3ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d297c080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563181c40b20 0x563181c37bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d297c080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563181b16f40 con 0x563181b684c0 2024-09-10T22:42:46.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d297c080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563181b23d00 con 0x563181c40b20 2024-09-10T22:42:46.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d297c080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563181ab8a00 con 0x563181c40740 2024-09-10T22:42:46.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9cfc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563181b684c0 0x563181c37300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9cfc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563181b684c0 0x563181c37300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55438/0 (socket says 172.21.15.103:55438) 2024-09-10T22:42:46.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9cfc00640 1 -- 172.21.15.103:0/880960712 learned_addr learned my addr 172.21.15.103:0/880960712 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:46.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9c7200640 1 --2- 172.21.15.103:0/880960712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563181c40740 0x563181c3ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d0600640 1 --2- 172.21.15.103:0/880960712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563181c40b20 0x563181c37bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9cfc00640 1 -- 172.21.15.103:0/880960712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563181c40740 msgr2=0x563181c3ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:46.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9cfc00640 1 --2- 172.21.15.103:0/880960712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563181c40740 0x563181c3ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9cfc00640 1 -- 172.21.15.103:0/880960712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563181c40b20 msgr2=0x563181c37bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:46.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9cfc00640 1 --2- 172.21.15.103:0/880960712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563181c40b20 0x563181c37bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9cfc00640 1 -- 172.21.15.103:0/880960712 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563181b980f0 con 0x563181b684c0 2024-09-10T22:42:46.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d0600640 1 --2- 172.21.15.103:0/880960712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563181c40b20 0x563181c37bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:46.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9cfc00640 1 --2- 172.21.15.103:0/880960712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563181b684c0 0x563181c37300 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000b2e0 tx=0x7fb9c000b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab828f856334dfb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9ce800640 1 -- 172.21.15.103:0/880960712 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0016070 con 0x563181b684c0 2024-09-10T22:42:46.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9ce800640 1 -- 172.21.15.103:0/880960712 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9c000d4c0 con 0x563181b684c0 2024-09-10T22:42:46.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9ce800640 1 -- 172.21.15.103:0/880960712 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c000d730 con 0x563181b684c0 2024-09-10T22:42:46.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d297c080 1 -- 172.21.15.103:0/880960712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563181b684c0 msgr2=0x563181c37300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d297c080 1 --2- 172.21.15.103:0/880960712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563181b684c0 0x563181c37300 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000b2e0 tx=0x7fb9c000b7a0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d297c080 1 -- 172.21.15.103:0/880960712 shutdown_connections 2024-09-10T22:42:46.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d297c080 1 --2- 172.21.15.103:0/880960712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563181c40b20 0x563181c37bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d297c080 1 --2- 172.21.15.103:0/880960712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563181c40740 0x563181c3ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d297c080 1 --2- 172.21.15.103:0/880960712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563181b684c0 0x563181c37300 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d297c080 1 -- 172.21.15.103:0/880960712 >> 172.21.15.103:0/880960712 conn(0x563181b69c80 msgr2=0x563181b9a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:46.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d297c080 1 -- 172.21.15.103:0/880960712 shutdown_connections 2024-09-10T22:42:46.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.583+0000 7fb9d297c080 1 -- 172.21.15.103:0/880960712 wait complete. 2024-09-10T22:42:46.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d297c080 1 Processor -- start 2024-09-10T22:42:46.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d297c080 1 -- start start 2024-09-10T22:42:46.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d297c080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563181b684c0 0x563181c4bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d297c080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563181c40740 0x563181c3ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d297c080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563181c40b20 0x563181c3b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d297c080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563181bb40f0 con 0x563181c40b20 2024-09-10T22:42:46.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d297c080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563181b98390 con 0x563181b684c0 2024-09-10T22:42:46.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d297c080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563181b98630 con 0x563181c40740 2024-09-10T22:42:46.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d0600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563181c40b20 0x563181c3b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d0600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563181c40b20 0x563181c3b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55448/0 (socket says 172.21.15.103:55448) 2024-09-10T22:42:46.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d0600640 1 -- 172.21.15.103:0/4029367714 learned_addr learned my addr 172.21.15.103:0/4029367714 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:46.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9c7200640 1 --2- 172.21.15.103:0/4029367714 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563181c40740 0x563181c3ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9cfc00640 1 --2- 172.21.15.103:0/4029367714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563181b684c0 0x563181c4bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d0600640 1 -- 172.21.15.103:0/4029367714 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563181c40740 msgr2=0x563181c3ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d0600640 1 --2- 172.21.15.103:0/4029367714 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563181c40740 0x563181c3ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d0600640 1 -- 172.21.15.103:0/4029367714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563181b684c0 msgr2=0x563181c4bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d0600640 1 --2- 172.21.15.103:0/4029367714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563181b684c0 0x563181c4bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d0600640 1 -- 172.21.15.103:0/4029367714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563181c39d70 con 0x563181c40b20 2024-09-10T22:42:46.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d0600640 1 --2- 172.21.15.103:0/4029367714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563181c40b20 0x563181c3b3b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8003250 tx=0x7fb9c800c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9cd400640 1 -- 172.21.15.103:0/4029367714 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8015030 con 0x563181c40b20 2024-09-10T22:42:46.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9cd400640 1 -- 172.21.15.103:0/4029367714 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9c800ce10 con 0x563181c40b20 2024-09-10T22:42:46.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9cd400640 1 -- 172.21.15.103:0/4029367714 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8011860 con 0x563181c40b20 2024-09-10T22:42:46.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d297c080 1 -- 172.21.15.103:0/4029367714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563181c3a010 con 0x563181c40b20 2024-09-10T22:42:46.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.587+0000 7fb9d297c080 1 -- 172.21.15.103:0/4029367714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563181c3a550 con 0x563181c40b20 2024-09-10T22:42:46.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.591+0000 7fb9cd400640 1 -- 172.21.15.103:0/4029367714 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb9c8022060 con 0x563181c40b20 2024-09-10T22:42:46.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.591+0000 7fb9cd400640 1 --2- 172.21.15.103:0/4029367714 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb9ac070fc0 0x7fb9ac073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.591+0000 7fb9cd400640 1 -- 172.21.15.103:0/4029367714 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7fb9c8092050 con 0x563181c40b20 2024-09-10T22:42:46.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.591+0000 7fb9d297c080 1 --2- 172.21.15.103:0/4029367714 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x563181cd9e80 0x563181cda260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.591+0000 7fb9cfc00640 1 --2- 172.21.15.103:0/4029367714 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb9ac070fc0 0x7fb9ac073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.591+0000 7fb9d297c080 1 -- 172.21.15.103:0/4029367714 --> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] -- osd_op(unknown.0.0:1 9.5 9:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70) -- 0x563181cda7a0 con 0x563181cd9e80 2024-09-10T22:42:46.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.591+0000 7fb9c7200640 1 --2- 172.21.15.103:0/4029367714 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x563181cd9e80 0x563181cda260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.591+0000 7fb9cfc00640 1 --2- 172.21.15.103:0/4029367714 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb9ac070fc0 0x7fb9ac073480 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000b2e0 tx=0x7fb9c0001090 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.591+0000 7fb9c7200640 1 --2- 172.21.15.103:0/4029367714 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x563181cd9e80 0x563181cda260 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.591+0000 7fb9c7200640 1 -- 172.21.15.103:0/4029367714 <== osd.0 v2:172.21.15.103:6808/2662233365 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v70'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb9b80b3040 con 0x563181cd9e80 2024-09-10T22:42:46.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.595+0000 7fb9d297c080 1 -- 172.21.15.103:0/4029367714 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x563181cd9e80 msgr2=0x563181cda260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.595+0000 7fb9d297c080 1 --2- 172.21.15.103:0/4029367714 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x563181cd9e80 0x563181cda260 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.595+0000 7fb9d297c080 1 -- 172.21.15.103:0/4029367714 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb9ac070fc0 msgr2=0x7fb9ac073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.595+0000 7fb9d297c080 1 --2- 172.21.15.103:0/4029367714 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb9ac070fc0 0x7fb9ac073480 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000b2e0 tx=0x7fb9c0001090 comp rx=0 tx=0).stop 2024-09-10T22:42:46.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.595+0000 7fb9d297c080 1 -- 172.21.15.103:0/4029367714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563181c40b20 msgr2=0x563181c3b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.595+0000 7fb9d297c080 1 --2- 172.21.15.103:0/4029367714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563181c40b20 0x563181c3b3b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8003250 tx=0x7fb9c800c5e0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.595+0000 7fb9d0600640 1 -- 172.21.15.103:0/4029367714 reap_dead start 2024-09-10T22:42:46.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.595+0000 7fb9d297c080 1 -- 172.21.15.103:0/4029367714 shutdown_connections 2024-09-10T22:42:46.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.595+0000 7fb9d297c080 1 -- 172.21.15.103:0/4029367714 >> 172.21.15.103:0/4029367714 conn(0x563181b69c80 msgr2=0x563181c368d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:46.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.595+0000 7fb9d297c080 1 -- 172.21.15.103:0/4029367714 shutdown_connections 2024-09-10T22:42:46.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.595+0000 7fb9d297c080 1 -- 172.21.15.103:0/4029367714 wait complete. 2024-09-10T22:42:46.603 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2024-09-10T22:42:46.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 Processor -- start 2024-09-10T22:42:46.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 -- start start 2024-09-10T22:42:46.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ba57d57a0 0x562ba588dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562ba588ebe0 0x562ba58b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ba58a9210 0x562ba58a8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562ba5723a00 con 0x562ba58a9210 2024-09-10T22:42:46.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562ba5781f40 con 0x562ba57d57a0 2024-09-10T22:42:46.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x562ba58922d0 con 0x562ba588ebe0 2024-09-10T22:42:46.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef66000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ba58a9210 0x562ba58a8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef66000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ba58a9210 0x562ba58a8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60002/0 (socket says 172.21.15.103:60002) 2024-09-10T22:42:46.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef66000640 1 -- 172.21.15.103:0/1231719743 learned_addr learned my addr 172.21.15.103:0/1231719743 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:46.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef65600640 1 --2- 172.21.15.103:0/1231719743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ba57d57a0 0x562ba588dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef64c00640 1 --2- 172.21.15.103:0/1231719743 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562ba588ebe0 0x562ba58b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef66000640 1 -- 172.21.15.103:0/1231719743 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562ba588ebe0 msgr2=0x562ba58b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:46.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef66000640 1 --2- 172.21.15.103:0/1231719743 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562ba588ebe0 0x562ba58b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef66000640 1 -- 172.21.15.103:0/1231719743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ba57d57a0 msgr2=0x562ba588dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:46.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef66000640 1 --2- 172.21.15.103:0/1231719743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ba57d57a0 0x562ba588dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef66000640 1 -- 172.21.15.103:0/1231719743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ba56fcc10 con 0x562ba58a9210 2024-09-10T22:42:46.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef65600640 1 --2- 172.21.15.103:0/1231719743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ba57d57a0 0x562ba588dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:46.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef66000640 1 --2- 172.21.15.103:0/1231719743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ba58a9210 0x562ba58a8410 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fef60001630 tx=0x7fef60001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a8c1f2a60879c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef5f400640 1 -- 172.21.15.103:0/1231719743 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef60016070 con 0x562ba58a9210 2024-09-10T22:42:46.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef5f400640 1 -- 172.21.15.103:0/1231719743 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef6000f800 con 0x562ba58a9210 2024-09-10T22:42:46.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef5f400640 1 -- 172.21.15.103:0/1231719743 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6000fc30 con 0x562ba58a9210 2024-09-10T22:42:46.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 -- 172.21.15.103:0/1231719743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ba58a9210 msgr2=0x562ba58a8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 --2- 172.21.15.103:0/1231719743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ba58a9210 0x562ba58a8410 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fef60001630 tx=0x7fef60001af0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 -- 172.21.15.103:0/1231719743 shutdown_connections 2024-09-10T22:42:46.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 --2- 172.21.15.103:0/1231719743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ba58a9210 0x562ba58a8410 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 --2- 172.21.15.103:0/1231719743 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562ba588ebe0 0x562ba58b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 --2- 172.21.15.103:0/1231719743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ba57d57a0 0x562ba588dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 -- 172.21.15.103:0/1231719743 >> 172.21.15.103:0/1231719743 conn(0x562ba57d4c80 msgr2=0x562ba57d5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:46.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 -- 172.21.15.103:0/1231719743 shutdown_connections 2024-09-10T22:42:46.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 -- 172.21.15.103:0/1231719743 wait complete. 2024-09-10T22:42:46.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 Processor -- start 2024-09-10T22:42:46.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.647+0000 7fef68e4d080 1 -- start start 2024-09-10T22:42:46.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef68e4d080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562ba57d57a0 0x562ba58a7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef68e4d080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ba588ebe0 0x562ba58911b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef68e4d080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ba58a9210 0x562ba5804ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef68e4d080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562ba58b5b80 con 0x562ba58a9210 2024-09-10T22:42:46.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef68e4d080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562ba58b5920 con 0x562ba588ebe0 2024-09-10T22:42:46.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef68e4d080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x562ba58b5e20 con 0x562ba57d57a0 2024-09-10T22:42:46.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef66000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ba58a9210 0x562ba5804ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef66000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ba58a9210 0x562ba5804ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60016/0 (socket says 172.21.15.103:60016) 2024-09-10T22:42:46.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef66000640 1 -- 172.21.15.103:0/1471077873 learned_addr learned my addr 172.21.15.103:0/1471077873 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:46.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef65600640 1 --2- 172.21.15.103:0/1471077873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562ba57d57a0 0x562ba58a7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef64c00640 1 --2- 172.21.15.103:0/1471077873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ba588ebe0 0x562ba58911b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef66000640 1 -- 172.21.15.103:0/1471077873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562ba57d57a0 msgr2=0x562ba58a7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef66000640 1 --2- 172.21.15.103:0/1471077873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562ba57d57a0 0x562ba58a7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef66000640 1 -- 172.21.15.103:0/1471077873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ba588ebe0 msgr2=0x562ba58911b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef66000640 1 --2- 172.21.15.103:0/1471077873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ba588ebe0 0x562ba58911b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef66000640 1 -- 172.21.15.103:0/1471077873 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ba5818170 con 0x562ba58a9210 2024-09-10T22:42:46.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef66000640 1 --2- 172.21.15.103:0/1471077873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ba58a9210 0x562ba5804ab0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fef60009040 tx=0x7fef6000ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef5e000640 1 -- 172.21.15.103:0/1471077873 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef60021020 con 0x562ba58a9210 2024-09-10T22:42:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef5e000640 1 -- 172.21.15.103:0/1471077873 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef60017040 con 0x562ba58a9210 2024-09-10T22:42:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef68e4d080 1 -- 172.21.15.103:0/1471077873 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ba58176f0 con 0x562ba58a9210 2024-09-10T22:42:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef5e000640 1 -- 172.21.15.103:0/1471077873 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef60016070 con 0x562ba58a9210 2024-09-10T22:42:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef68e4d080 1 -- 172.21.15.103:0/1471077873 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ba5817c30 con 0x562ba58a9210 2024-09-10T22:42:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.651+0000 7fef5e000640 1 -- 172.21.15.103:0/1471077873 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fef6001dc60 con 0x562ba58a9210 2024-09-10T22:42:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.655+0000 7fef5e000640 1 --2- 172.21.15.103:0/1471077873 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fef48070ff0 0x7fef480734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.655+0000 7fef5e000640 1 -- 172.21.15.103:0/1471077873 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7fef60093be0 con 0x562ba58a9210 2024-09-10T22:42:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.655+0000 7fef68e4d080 1 --2- 172.21.15.103:0/1471077873 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x562ba5817200 0x562ba5945d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.655+0000 7fef65600640 1 --2- 172.21.15.103:0/1471077873 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fef48070ff0 0x7fef480734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.655+0000 7fef68e4d080 1 -- 172.21.15.103:0/1471077873 --> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] -- osd_op(unknown.0.0:1 9.9 9:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70) -- 0x562ba59462b0 con 0x562ba5817200 2024-09-10T22:42:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.655+0000 7fef64c00640 1 --2- 172.21.15.103:0/1471077873 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x562ba5817200 0x562ba5945d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.655+0000 7fef65600640 1 --2- 172.21.15.103:0/1471077873 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fef48070ff0 0x7fef480734b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fef58004fd0 tx=0x7fef58004a70 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.655+0000 7fef64c00640 1 --2- 172.21.15.103:0/1471077873 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x562ba5817200 0x562ba5945d70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.655+0000 7fef64c00640 1 -- 172.21.15.103:0/1471077873 <== osd.0 v2:172.21.15.103:6808/2662233365 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v70'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fef540ab980 con 0x562ba5817200 2024-09-10T22:42:46.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.655+0000 7fef68e4d080 1 -- 172.21.15.103:0/1471077873 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x562ba5817200 msgr2=0x562ba5945d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.655+0000 7fef68e4d080 1 --2- 172.21.15.103:0/1471077873 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x562ba5817200 0x562ba5945d70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.655+0000 7fef68e4d080 1 -- 172.21.15.103:0/1471077873 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fef48070ff0 msgr2=0x7fef480734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.655+0000 7fef68e4d080 1 --2- 172.21.15.103:0/1471077873 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fef48070ff0 0x7fef480734b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fef58004fd0 tx=0x7fef58004a70 comp rx=0 tx=0).stop 2024-09-10T22:42:46.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.655+0000 7fef68e4d080 1 -- 172.21.15.103:0/1471077873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ba58a9210 msgr2=0x562ba5804ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.655+0000 7fef68e4d080 1 --2- 172.21.15.103:0/1471077873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ba58a9210 0x562ba5804ab0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fef60009040 tx=0x7fef6000ff70 comp rx=0 tx=0).stop 2024-09-10T22:42:46.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.655+0000 7fef66000640 1 -- 172.21.15.103:0/1471077873 reap_dead start 2024-09-10T22:42:46.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.655+0000 7fef68e4d080 1 -- 172.21.15.103:0/1471077873 shutdown_connections 2024-09-10T22:42:46.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.655+0000 7fef68e4d080 1 -- 172.21.15.103:0/1471077873 >> 172.21.15.103:0/1471077873 conn(0x562ba57d4c80 msgr2=0x562ba57d5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:46.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.659+0000 7fef68e4d080 1 -- 172.21.15.103:0/1471077873 shutdown_connections 2024-09-10T22:42:46.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.659+0000 7fef68e4d080 1 -- 172.21.15.103:0/1471077873 wait complete. 2024-09-10T22:42:46.665 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2024-09-10T22:42:46.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 Processor -- start 2024-09-10T22:42:46.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 -- start start 2024-09-10T22:42:46.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55747e939570 0x55747e9b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55747e9b6e00 0x55747e929dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55747e9d04f0 0x55747e92a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55747e8a5f40 con 0x55747e9d04f0 2024-09-10T22:42:46.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55747e8b2d00 con 0x55747e9b6e00 2024-09-10T22:42:46.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55747e847a00 con 0x55747e939570 2024-09-10T22:42:46.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378da00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55747e9d04f0 0x55747e92a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378da00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55747e9d04f0 0x55747e92a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60036/0 (socket says 172.21.15.103:60036) 2024-09-10T22:42:46.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378da00640 1 -- 172.21.15.103:0/3619321710 learned_addr learned my addr 172.21.15.103:0/3619321710 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:46.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f3787e00640 1 --2- 172.21.15.103:0/3619321710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55747e9b6e00 0x55747e929dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378d000640 1 --2- 172.21.15.103:0/3619321710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55747e939570 0x55747e9b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378da00640 1 -- 172.21.15.103:0/3619321710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55747e939570 msgr2=0x55747e9b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:46.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378da00640 1 --2- 172.21.15.103:0/3619321710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55747e939570 0x55747e9b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378da00640 1 -- 172.21.15.103:0/3619321710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55747e9b6e00 msgr2=0x55747e929dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:46.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378da00640 1 --2- 172.21.15.103:0/3619321710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55747e9b6e00 0x55747e929dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378da00640 1 -- 172.21.15.103:0/3619321710 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55747e943b70 con 0x55747e9d04f0 2024-09-10T22:42:46.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378da00640 1 --2- 172.21.15.103:0/3619321710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55747e9d04f0 0x55747e92a300 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3788006fb0 tx=0x7f3788001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738f7a76d3260a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f3786a00640 1 -- 172.21.15.103:0/3619321710 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3788017070 con 0x55747e9d04f0 2024-09-10T22:42:46.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f3786a00640 1 -- 172.21.15.103:0/3619321710 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3788002790 con 0x55747e9d04f0 2024-09-10T22:42:46.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f3786a00640 1 -- 172.21.15.103:0/3619321710 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3788002be0 con 0x55747e9d04f0 2024-09-10T22:42:46.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 -- 172.21.15.103:0/3619321710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55747e9d04f0 msgr2=0x55747e92a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 --2- 172.21.15.103:0/3619321710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55747e9d04f0 0x55747e92a300 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3788006fb0 tx=0x7f3788001b10 comp rx=0 tx=0).stop 2024-09-10T22:42:46.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 -- 172.21.15.103:0/3619321710 shutdown_connections 2024-09-10T22:42:46.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 --2- 172.21.15.103:0/3619321710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55747e9d04f0 0x55747e92a300 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 --2- 172.21.15.103:0/3619321710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55747e9b6e00 0x55747e929dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 --2- 172.21.15.103:0/3619321710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55747e939570 0x55747e9b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 -- 172.21.15.103:0/3619321710 >> 172.21.15.103:0/3619321710 conn(0x55747e8faf30 msgr2=0x55747e93bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:46.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 -- 172.21.15.103:0/3619321710 shutdown_connections 2024-09-10T22:42:46.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 -- 172.21.15.103:0/3619321710 wait complete. 2024-09-10T22:42:46.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 Processor -- start 2024-09-10T22:42:46.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.751+0000 7f378fde8080 1 -- start start 2024-09-10T22:42:46.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f378fde8080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55747e939570 0x55747e9cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f378fde8080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55747e9b6e00 0x55747e9d4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f378fde8080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55747e9d04f0 0x55747e9d4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f378fde8080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55747e929680 con 0x55747e939570 2024-09-10T22:42:46.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f378fde8080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55747e9293e0 con 0x55747e9b6e00 2024-09-10T22:42:46.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f378fde8080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55747e929920 con 0x55747e9d04f0 2024-09-10T22:42:46.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f378d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55747e939570 0x55747e9cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f378d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55747e939570 0x55747e9cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60042/0 (socket says 172.21.15.103:60042) 2024-09-10T22:42:46.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f378d000640 1 -- 172.21.15.103:0/597852331 learned_addr learned my addr 172.21.15.103:0/597852331 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:46.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f3787e00640 1 --2- 172.21.15.103:0/597852331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55747e9b6e00 0x55747e9d4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f378da00640 1 --2- 172.21.15.103:0/597852331 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55747e9d04f0 0x55747e9d4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f378d000640 1 -- 172.21.15.103:0/597852331 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55747e9d04f0 msgr2=0x55747e9d4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f378d000640 1 --2- 172.21.15.103:0/597852331 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55747e9d04f0 0x55747e9d4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f378d000640 1 -- 172.21.15.103:0/597852331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55747e9b6e00 msgr2=0x55747e9d4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f378d000640 1 --2- 172.21.15.103:0/597852331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55747e9b6e00 0x55747e9d4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f378d000640 1 -- 172.21.15.103:0/597852331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55747e9d2470 con 0x55747e939570 2024-09-10T22:42:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f378d000640 1 --2- 172.21.15.103:0/597852331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55747e939570 0x55747e9cc440 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f378000dee0 tx=0x7f378000b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f3785600640 1 -- 172.21.15.103:0/597852331 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780014020 con 0x55747e939570 2024-09-10T22:42:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f3785600640 1 -- 172.21.15.103:0/597852331 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3780001500 con 0x55747e939570 2024-09-10T22:42:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f3785600640 1 -- 172.21.15.103:0/597852331 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378000a040 con 0x55747e939570 2024-09-10T22:42:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f378fde8080 1 -- 172.21.15.103:0/597852331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55747e9d2710 con 0x55747e939570 2024-09-10T22:42:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f378fde8080 1 -- 172.21.15.103:0/597852331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55747e9d2c50 con 0x55747e939570 2024-09-10T22:42:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.755+0000 7f3785600640 1 -- 172.21.15.103:0/597852331 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3780001950 con 0x55747e939570 2024-09-10T22:42:46.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f3785600640 1 --2- 172.21.15.103:0/597852331 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f376c070ff0 0x7f376c0734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f3785600640 1 -- 172.21.15.103:0/597852331 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f3780092290 con 0x55747e939570 2024-09-10T22:42:46.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f3787e00640 1 --2- 172.21.15.103:0/597852331 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f376c070ff0 0x7f376c0734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f378fde8080 1 --2- 172.21.15.103:0/597852331 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55747e9d30f0 0x55747e9d34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f378fde8080 1 -- 172.21.15.103:0/597852331 --> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] -- osd_op(unknown.0.0:1 9.5 9:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70) -- 0x55747e9d3a10 con 0x55747e9d30f0 2024-09-10T22:42:46.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f378da00640 1 --2- 172.21.15.103:0/597852331 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55747e9d30f0 0x55747e9d34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f3787e00640 1 --2- 172.21.15.103:0/597852331 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f376c070ff0 0x7f376c0734b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f37780ab000 tx=0x7f37780199e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f378da00640 1 --2- 172.21.15.103:0/597852331 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55747e9d30f0 0x55747e9d34d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f378da00640 1 -- 172.21.15.103:0/597852331 <== osd.0 v2:172.21.15.103:6808/2662233365 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v70'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f378800f070 con 0x55747e9d30f0 2024-09-10T22:42:46.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f378fde8080 1 -- 172.21.15.103:0/597852331 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55747e9d30f0 msgr2=0x55747e9d34d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f378fde8080 1 --2- 172.21.15.103:0/597852331 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55747e9d30f0 0x55747e9d34d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f378fde8080 1 -- 172.21.15.103:0/597852331 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f376c070ff0 msgr2=0x7f376c0734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f378fde8080 1 --2- 172.21.15.103:0/597852331 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f376c070ff0 0x7f376c0734b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f37780ab000 tx=0x7f37780199e0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f378fde8080 1 -- 172.21.15.103:0/597852331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55747e939570 msgr2=0x55747e9cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f378fde8080 1 --2- 172.21.15.103:0/597852331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55747e939570 0x55747e9cc440 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f378000dee0 tx=0x7f378000b5c0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f378da00640 1 -- 172.21.15.103:0/597852331 reap_dead start 2024-09-10T22:42:46.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f378fde8080 1 -- 172.21.15.103:0/597852331 shutdown_connections 2024-09-10T22:42:46.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f378fde8080 1 -- 172.21.15.103:0/597852331 >> 172.21.15.103:0/597852331 conn(0x55747e8faf30 msgr2=0x55747e93cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:46.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f378fde8080 1 -- 172.21.15.103:0/597852331 shutdown_connections 2024-09-10T22:42:46.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.759+0000 7f378fde8080 1 -- 172.21.15.103:0/597852331 wait complete. 2024-09-10T22:42:46.768 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2024-09-10T22:42:46.828 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:42:46.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f4582218080 1 Processor -- start 2024-09-10T22:42:46.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f4582218080 1 -- start start 2024-09-10T22:42:46.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f4582218080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a766380380 0x55a766368890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f4582218080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a7663f5e00 0x55a76637ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f4582218080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a76637be80 0x55a766337750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f4582218080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a766286a00 con 0x55a76637be80 2024-09-10T22:42:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f4582218080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a7662e4f40 con 0x55a766380380 2024-09-10T22:42:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f4582218080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a76640e2a0 con 0x55a7663f5e00 2024-09-10T22:42:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f457fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a76637be80 0x55a766337750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f457fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a76637be80 0x55a766337750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60060/0 (socket says 172.21.15.103:60060) 2024-09-10T22:42:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f457fe00640 1 -- 172.21.15.103:0/1133101774 learned_addr learned my addr 172.21.15.103:0/1133101774 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f457f400640 1 --2- 172.21.15.103:0/1133101774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a766380380 0x55a766368890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f457ea00640 1 --2- 172.21.15.103:0/1133101774 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a7663f5e00 0x55a76637ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f457fe00640 1 -- 172.21.15.103:0/1133101774 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a7663f5e00 msgr2=0x55a76637ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:46.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f457fe00640 1 --2- 172.21.15.103:0/1133101774 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a7663f5e00 0x55a76637ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f457fe00640 1 -- 172.21.15.103:0/1133101774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a766380380 msgr2=0x55a766368890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:46.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f457fe00640 1 --2- 172.21.15.103:0/1133101774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a766380380 0x55a766368890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.866 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:42:46.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f457fe00640 1 -- 172.21.15.103:0/1133101774 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a76625fc10 con 0x55a76637be80 2024-09-10T22:42:46.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f457ea00640 1 --2- 172.21.15.103:0/1133101774 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a7663f5e00 0x55a76637ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:46.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f457fe00640 1 --2- 172.21.15.103:0/1133101774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a76637be80 0x55a766337750 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f457800c720 tx=0x7f457800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0710e163af0481 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f457d600640 1 -- 172.21.15.103:0/1133101774 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4578004020 con 0x55a76637be80 2024-09-10T22:42:46.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f457d600640 1 -- 172.21.15.103:0/1133101774 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45780042b0 con 0x55a76637be80 2024-09-10T22:42:46.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f457d600640 1 -- 172.21.15.103:0/1133101774 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457800aa80 con 0x55a76637be80 2024-09-10T22:42:46.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f4582218080 1 -- 172.21.15.103:0/1133101774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a76637be80 msgr2=0x55a766337750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.859+0000 7f4582218080 1 --2- 172.21.15.103:0/1133101774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a76637be80 0x55a766337750 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f457800c720 tx=0x7f457800cbe0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4582218080 1 -- 172.21.15.103:0/1133101774 shutdown_connections 2024-09-10T22:42:46.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4582218080 1 --2- 172.21.15.103:0/1133101774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a76637be80 0x55a766337750 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4582218080 1 --2- 172.21.15.103:0/1133101774 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a7663f5e00 0x55a76637ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4582218080 1 --2- 172.21.15.103:0/1133101774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a766380380 0x55a766368890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4582218080 1 -- 172.21.15.103:0/1133101774 >> 172.21.15.103:0/1133101774 conn(0x55a766339f30 msgr2=0x55a7663819b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:46.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4582218080 1 -- 172.21.15.103:0/1133101774 shutdown_connections 2024-09-10T22:42:46.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4582218080 1 -- 172.21.15.103:0/1133101774 wait complete. 2024-09-10T22:42:46.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4582218080 1 Processor -- start 2024-09-10T22:42:46.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4582218080 1 -- start start 2024-09-10T22:42:46.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4582218080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a76637be80 0x55a7663657b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4582218080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a766380380 0x55a76640cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4582218080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a7663f5e00 0x55a7664a83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4582218080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a766338df0 con 0x55a76637be80 2024-09-10T22:42:46.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4582218080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a76637c400 con 0x55a766380380 2024-09-10T22:42:46.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4582218080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a7663f4890 con 0x55a7663f5e00 2024-09-10T22:42:46.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f457f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a76637be80 0x55a7663657b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f457f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a76637be80 0x55a7663657b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60072/0 (socket says 172.21.15.103:60072) 2024-09-10T22:42:46.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f457f400640 1 -- 172.21.15.103:0/3150316650 learned_addr learned my addr 172.21.15.103:0/3150316650 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:46.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f457ea00640 1 --2- 172.21.15.103:0/3150316650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a766380380 0x55a76640cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f457fe00640 1 --2- 172.21.15.103:0/3150316650 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a7663f5e00 0x55a7664a83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f457f400640 1 -- 172.21.15.103:0/3150316650 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a7663f5e00 msgr2=0x55a7664a83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f457f400640 1 --2- 172.21.15.103:0/3150316650 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a7663f5e00 0x55a7664a83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f457f400640 1 -- 172.21.15.103:0/3150316650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a766380380 msgr2=0x55a76640cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f457f400640 1 --2- 172.21.15.103:0/3150316650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a766380380 0x55a76640cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f457f400640 1 -- 172.21.15.103:0/3150316650 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a76637dde0 con 0x55a76637be80 2024-09-10T22:42:46.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f457f400640 1 --2- 172.21.15.103:0/3150316650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a76637be80 0x55a7663657b0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f4570019750 tx=0x7f45700aca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4577e00640 1 -- 172.21.15.103:0/3150316650 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45700b8440 con 0x55a76637be80 2024-09-10T22:42:46.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4577e00640 1 -- 172.21.15.103:0/3150316650 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45700b86d0 con 0x55a76637be80 2024-09-10T22:42:46.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4582218080 1 -- 172.21.15.103:0/3150316650 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a76637e080 con 0x55a76637be80 2024-09-10T22:42:46.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4577e00640 1 -- 172.21.15.103:0/3150316650 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45700b8ae0 con 0x55a76637be80 2024-09-10T22:42:46.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.863+0000 7f4582218080 1 -- 172.21.15.103:0/3150316650 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a76637e5c0 con 0x55a76637be80 2024-09-10T22:42:46.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.867+0000 7f4577e00640 1 -- 172.21.15.103:0/3150316650 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f45700b8c80 con 0x55a76637be80 2024-09-10T22:42:46.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.867+0000 7f4577e00640 1 --2- 172.21.15.103:0/3150316650 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4560070ff0 0x7f45600734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.867+0000 7f4577e00640 1 -- 172.21.15.103:0/3150316650 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f457012ded0 con 0x55a76637be80 2024-09-10T22:42:46.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.867+0000 7f457ea00640 1 --2- 172.21.15.103:0/3150316650 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4560070ff0 0x7f45600734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.867+0000 7f4582218080 1 --2- 172.21.15.103:0/3150316650 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55a76637d910 0x55a76637f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:46.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.867+0000 7f4582218080 1 -- 172.21.15.103:0/3150316650 --> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] -- osd_op(unknown.0.0:1 9.1d 9:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70) -- 0x55a76640d310 con 0x55a76637d910 2024-09-10T22:42:46.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.867+0000 7f457fe00640 1 --2- 172.21.15.103:0/3150316650 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55a76637d910 0x55a76637f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:46.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.867+0000 7f457ea00640 1 --2- 172.21.15.103:0/3150316650 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4560070ff0 0x7f45600734b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f456c003f00 tx=0x7f456c003960 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.867+0000 7f457fe00640 1 --2- 172.21.15.103:0/3150316650 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55a76637d910 0x55a76637f210 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:46.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.871+0000 7f457fe00640 1 -- 172.21.15.103:0/3150316650 <== osd.0 v2:172.21.15.103:6808/2662233365 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v70'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4578002030 con 0x55a76637d910 2024-09-10T22:42:46.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.871+0000 7f4582218080 1 -- 172.21.15.103:0/3150316650 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55a76637d910 msgr2=0x55a76637f210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.871+0000 7f4582218080 1 --2- 172.21.15.103:0/3150316650 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55a76637d910 0x55a76637f210 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:46.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.871+0000 7f4582218080 1 -- 172.21.15.103:0/3150316650 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4560070ff0 msgr2=0x7f45600734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.871+0000 7f4582218080 1 --2- 172.21.15.103:0/3150316650 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4560070ff0 0x7f45600734b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f456c003f00 tx=0x7f456c003960 comp rx=0 tx=0).stop 2024-09-10T22:42:46.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.871+0000 7f4582218080 1 -- 172.21.15.103:0/3150316650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a76637be80 msgr2=0x55a7663657b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:46.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.871+0000 7f4582218080 1 --2- 172.21.15.103:0/3150316650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a76637be80 0x55a7663657b0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f4570019750 tx=0x7f45700aca20 comp rx=0 tx=0).stop 2024-09-10T22:42:46.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.871+0000 7f457fe00640 1 -- 172.21.15.103:0/3150316650 reap_dead start 2024-09-10T22:42:46.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.871+0000 7f4582218080 1 -- 172.21.15.103:0/3150316650 shutdown_connections 2024-09-10T22:42:46.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.871+0000 7f4582218080 1 -- 172.21.15.103:0/3150316650 >> 172.21.15.103:0/3150316650 conn(0x55a766339f30 msgr2=0x55a7663f4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:46.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.871+0000 7f4582218080 1 -- 172.21.15.103:0/3150316650 shutdown_connections 2024-09-10T22:42:46.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:46.875+0000 7f4582218080 1 -- 172.21.15.103:0/3150316650 wait complete. 2024-09-10T22:42:46.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:46.881 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start /d1/d2/d3 recursive,force 2024-09-10T22:42:47.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.091+0000 7f1874000640 1 -- 172.21.15.103:0/1813221491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f186c0ae9c0 msgr2=0x7f186c0aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:47.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.091+0000 7f1874000640 1 --2- 172.21.15.103:0/1813221491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f186c0ae9c0 0x7f186c0aee50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1864009900 tx=0x7f186401c850 comp rx=0 tx=0).stop 2024-09-10T22:42:47.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.091+0000 7f1874000640 1 -- 172.21.15.103:0/1813221491 shutdown_connections 2024-09-10T22:42:47.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.091+0000 7f1874000640 1 --2- 172.21.15.103:0/1813221491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f186c0ae9c0 0x7f186c0aee50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.091+0000 7f1874000640 1 --2- 172.21.15.103:0/1813221491 >> v2:172.21.15.131:3300/0 conn(0x7f186c0b09c0 0x7f186c0ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.091+0000 7f1874000640 1 -- 172.21.15.103:0/1813221491 >> 172.21.15.103:0/1813221491 conn(0x7f186c0d1ac0 msgr2=0x7f186c0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:47.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.091+0000 7f1874000640 1 -- 172.21.15.103:0/1813221491 shutdown_connections 2024-09-10T22:42:47.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.091+0000 7f1874000640 1 -- 172.21.15.103:0/1813221491 wait complete. 2024-09-10T22:42:47.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1874000640 1 Processor -- start 2024-09-10T22:42:47.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1874000640 1 -- start start 2024-09-10T22:42:47.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1874000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f186c0ae9c0 0x7f186c150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1874000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f186c0b09c0 0x7f186c150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1874000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f186c15be30 0x7f186c070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1874000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f186c168df0 con 0x7f186c0ae9c0 2024-09-10T22:42:47.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1874000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f186c168c70 con 0x7f186c0b09c0 2024-09-10T22:42:47.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1874000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f186c168f70 con 0x7f186c15be30 2024-09-10T22:42:47.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1871600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f186c0ae9c0 0x7f186c150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1871600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f186c0ae9c0 0x7f186c150f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60074/0 (socket says 172.21.15.103:60074) 2024-09-10T22:42:47.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1871600640 1 -- 172.21.15.103:0/2351804602 learned_addr learned my addr 172.21.15.103:0/2351804602 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:47.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1870c00640 1 --2- 172.21.15.103:0/2351804602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f186c0b09c0 0x7f186c150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1872000640 1 --2- 172.21.15.103:0/2351804602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f186c15be30 0x7f186c070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1871600640 1 -- 172.21.15.103:0/2351804602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f186c15be30 msgr2=0x7f186c070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:47.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1871600640 1 --2- 172.21.15.103:0/2351804602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f186c15be30 0x7f186c070600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1871600640 1 -- 172.21.15.103:0/2351804602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f186c0b09c0 msgr2=0x7f186c150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:47.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1871600640 1 --2- 172.21.15.103:0/2351804602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f186c0b09c0 0x7f186c150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1871600640 1 -- 172.21.15.103:0/2351804602 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186c0b0f70 con 0x7f186c0ae9c0 2024-09-10T22:42:47.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1871600640 1 --2- 172.21.15.103:0/2351804602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f186c0ae9c0 0x7f186c150f30 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f186000c780 tx=0x7f186000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:47.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.095+0000 7f1869600640 1 -- 172.21.15.103:0/2351804602 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860017070 con 0x7f186c0ae9c0 2024-09-10T22:42:47.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.099+0000 7f1869600640 1 -- 172.21.15.103:0/2351804602 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1860005070 con 0x7f186c0ae9c0 2024-09-10T22:42:47.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.099+0000 7f1874000640 1 -- 172.21.15.103:0/2351804602 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f186c151660 con 0x7f186c0ae9c0 2024-09-10T22:42:47.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.099+0000 7f1869600640 1 -- 172.21.15.103:0/2351804602 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860005480 con 0x7f186c0ae9c0 2024-09-10T22:42:47.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.099+0000 7f1874000640 1 -- 172.21.15.103:0/2351804602 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f186c0b5e60 con 0x7f186c0ae9c0 2024-09-10T22:42:47.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.099+0000 7f1869600640 1 -- 172.21.15.103:0/2351804602 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1860005620 con 0x7f186c0ae9c0 2024-09-10T22:42:47.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.099+0000 7f1869600640 1 --2- 172.21.15.103:0/2351804602 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f184c0725e0 0x7f184c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.099+0000 7f1869600640 1 -- 172.21.15.103:0/2351804602 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f1860092df0 con 0x7f186c0ae9c0 2024-09-10T22:42:47.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.099+0000 7f18774e6000 1 Processor -- start 2024-09-10T22:42:47.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.099+0000 7f18774e6000 1 -- start start 2024-09-10T22:42:47.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.099+0000 7f1870c00640 1 --2- 172.21.15.103:0/2351804602 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f184c0725e0 0x7f184c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f1870c00640 1 --2- 172.21.15.103:0/2351804602 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f184c0725e0 0x7f184c074aa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f186c0b3550 tx=0x7f18580091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:47.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f18774e6000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624efe5470 0x55624efe5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f18774e6000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624ef9bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f18774e6000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624ef9c0b0 0x55624ef9c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f18774e6000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55624edf7bb0 con 0x55624efe5d90 2024-09-10T22:42:47.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f18774e6000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55624ede6fe0 con 0x55624ef9c0b0 2024-09-10T22:42:47.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f18774e6000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55624edeadf0 con 0x55624efe5470 2024-09-10T22:42:47.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f1870c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624ef9bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f1870c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624ef9bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60080/0 (socket says 172.21.15.103:60080) 2024-09-10T22:42:47.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f1870c00640 1 -- 172.21.15.103:0/4181076059 learned_addr learned my addr 172.21.15.103:0/4181076059 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:47.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f1871600640 1 --2- 172.21.15.103:0/4181076059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624efe5470 0x55624efe5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f1870c00640 1 -- 172.21.15.103:0/4181076059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624efe5470 msgr2=0x55624efe5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:47.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f1872000640 1 --2- 172.21.15.103:0/4181076059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624ef9c0b0 0x55624ef9c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f1870c00640 1 --2- 172.21.15.103:0/4181076059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624efe5470 0x55624efe5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f1870c00640 1 -- 172.21.15.103:0/4181076059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624ef9c0b0 msgr2=0x55624ef9c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f1870c00640 1 --2- 172.21.15.103:0/4181076059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624ef9c0b0 0x55624ef9c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f1870c00640 1 -- 172.21.15.103:0/4181076059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55624edc24a0 con 0x55624efe5d90 2024-09-10T22:42:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f1871600640 1 --2- 172.21.15.103:0/4181076059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624efe5470 0x55624efe5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f1872000640 1 --2- 172.21.15.103:0/4181076059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624ef9c0b0 0x55624ef9c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f1870c00640 1 --2- 172.21.15.103:0/4181076059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624ef9bb70 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f185800e630 tx=0x7f1858014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7e0537c51cab35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f185e000640 1 -- 172.21.15.103:0/4181076059 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1858004020 con 0x55624efe5d90 2024-09-10T22:42:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f185e000640 1 -- 172.21.15.103:0/4181076059 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18580042b0 con 0x55624efe5d90 2024-09-10T22:42:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f185e000640 1 -- 172.21.15.103:0/4181076059 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1858003840 con 0x55624efe5d90 2024-09-10T22:42:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f18774e6000 1 -- 172.21.15.103:0/4181076059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 msgr2=0x55624ef9bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f18774e6000 1 --2- 172.21.15.103:0/4181076059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624ef9bb70 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f185800e630 tx=0x7f1858014000 comp rx=0 tx=0).stop 2024-09-10T22:42:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f18774e6000 1 -- 172.21.15.103:0/4181076059 shutdown_connections 2024-09-10T22:42:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f18774e6000 1 --2- 172.21.15.103:0/4181076059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624ef9c0b0 0x55624ef9c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f18774e6000 1 --2- 172.21.15.103:0/4181076059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624ef9bb70 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f18774e6000 1 --2- 172.21.15.103:0/4181076059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624efe5470 0x55624efe5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f18774e6000 1 -- 172.21.15.103:0/4181076059 >> 172.21.15.103:0/4181076059 conn(0x55624ef98060 msgr2=0x55624ef9a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f18774e6000 1 -- 172.21.15.103:0/4181076059 shutdown_connections 2024-09-10T22:42:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f18774e6000 1 -- 172.21.15.103:0/4181076059 wait complete. 2024-09-10T22:42:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f18774e6000 1 -- start start 2024-09-10T22:42:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.103+0000 7f18774e6000 1 Processor -- start 2024-09-10T22:42:47.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f18774e6000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624ef9c0b0 0x55624efa6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f18774e6000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624efe5470 0x55624efa6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f18774e6000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624efa6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f18774e6000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55624eea2a10 con 0x55624efe5d90 2024-09-10T22:42:47.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f18774e6000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55624ed90b30 con 0x55624ef9c0b0 2024-09-10T22:42:47.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f18774e6000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55624ed8d990 con 0x55624efe5470 2024-09-10T22:42:47.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f18774e6000 10 client.0 _ll_register_callbacks cb 0x55624ee9dc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:42:47.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1872000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624efa6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1872000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624efa6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60082/0 (socket says 172.21.15.103:60082) 2024-09-10T22:42:47.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1872000640 1 -- 172.21.15.103:0/1321498922 learned_addr learned my addr 172.21.15.103:0/1321498922 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:47.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1871600640 1 --2- 172.21.15.103:0/1321498922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624ef9c0b0 0x55624efa6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1870c00640 1 --2- 172.21.15.103:0/1321498922 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624efe5470 0x55624efa6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1872000640 1 -- 172.21.15.103:0/1321498922 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624efe5470 msgr2=0x55624efa6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:47.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1872000640 1 --2- 172.21.15.103:0/1321498922 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624efe5470 0x55624efa6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1872000640 1 -- 172.21.15.103:0/1321498922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624ef9c0b0 msgr2=0x55624efa6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1872000640 1 --2- 172.21.15.103:0/1321498922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624ef9c0b0 0x55624efa6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1872000640 1 -- 172.21.15.103:0/1321498922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55624ee30600 con 0x55624efe5d90 2024-09-10T22:42:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1872000640 1 --2- 172.21.15.103:0/1321498922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624efa6eb0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1864009230 tx=0x7f1864004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72145cdf6596095 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1852a00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:42:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1852a00640 1 -- 172.21.15.103:0/1321498922 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18640ba020 con 0x55624efe5d90 2024-09-10T22:42:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1852a00640 1 -- 172.21.15.103:0/1321498922 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f1864005220 con 0x55624efe5d90 2024-09-10T22:42:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f18774e6000 1 -- 172.21.15.103:0/1321498922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55624ed7f240 con 0x55624efe5d90 2024-09-10T22:42:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1852a00640 1 -- 172.21.15.103:0/1321498922 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f18640c1050 con 0x55624efe5d90 2024-09-10T22:42:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f18774e6000 10 client.6627 fetch_fsmap learned FSMap version 61 2024-09-10T22:42:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f18774e6000 1 -- 172.21.15.103:0/1321498922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55624ed9a350 con 0x55624efe5d90 2024-09-10T22:42:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1852a00640 1 -- 172.21.15.103:0/1321498922 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55624ed7f240 con 0x55624efe5d90 2024-09-10T22:42:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1852a00640 1 -- 172.21.15.103:0/1321498922 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 61) ==== 3554+0+0 (secure 0 0 0) 0x7f18640c4020 con 0x55624efe5d90 2024-09-10T22:42:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f18774e6000 10 client.6627 fetch_fsmap finished waiting for FSMap version 61 2024-09-10T22:42:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f18774e6000 10 client.6627 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-10T22:42:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f18774e6000 20 client.6627 populate_metadata read hostname 'smithi103' 2024-09-10T22:42:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f18774e6000 1 --2- 172.21.15.103:0/1321498922 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55624eff4710 0x55624eff6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f18774e6000 4 client.6627 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:42:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f18774e6000 1 -- 172.21.15.103:0/1321498922 --> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55624edf9b00 con 0x55624eff4710 2024-09-10T22:42:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1871600640 1 --2- 172.21.15.103:0/1321498922 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55624eff4710 0x55624eff6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1871600640 1 --2- 172.21.15.103:0/1321498922 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55624eff4710 0x55624eff6b00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a463fd68afba14b server_cookie=4916a61fb78f752c in_seq=0 out_seq=0 2024-09-10T22:42:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1852a00640 10 client.6627 ms_handle_connect on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1852a00640 1 -- 172.21.15.103:0/1321498922 <== mds.0 v2:172.21.15.103:6834/714242556 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55624edf9b00 con 0x55624eff4710 2024-09-10T22:42:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f1852a00640 10 client.6627 handle_command_reply: tid=0 2024-09-10T22:42:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.107+0000 7f18774e6000 1 client.6627 shutdown 2024-09-10T22:42:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.111+0000 7f18774e6000 1 -- 172.21.15.103:0/1321498922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 msgr2=0x55624efa6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.111+0000 7f18774e6000 1 --2- 172.21.15.103:0/1321498922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624efa6eb0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1864009230 tx=0x7f1864004560 comp rx=0 tx=0).stop 2024-09-10T22:42:47.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.111+0000 7f18774e6000 1 -- 172.21.15.103:0/1321498922 shutdown_connections 2024-09-10T22:42:47.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.111+0000 7f18774e6000 1 --2- 172.21.15.103:0/1321498922 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55624eff4710 0x55624eff6b00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.111+0000 7f18774e6000 1 --2- 172.21.15.103:0/1321498922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624efa6eb0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.111+0000 7f18774e6000 1 --2- 172.21.15.103:0/1321498922 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624efe5470 0x55624efa6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.111+0000 7f1852a00640 0 client.6627 ms_handle_reset on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:47.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.111+0000 7f18774e6000 1 --2- 172.21.15.103:0/1321498922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624ef9c0b0 0x55624efa6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.111+0000 7f18774e6000 1 -- 172.21.15.103:0/1321498922 >> 172.21.15.103:0/1321498922 conn(0x55624ef98060 msgr2=0x55624ef9ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:47.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.111+0000 7f18774e6000 1 -- 172.21.15.103:0/1321498922 shutdown_connections 2024-09-10T22:42:47.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.111+0000 7f18774e6000 1 -- 172.21.15.103:0/1321498922 wait complete. 2024-09-10T22:42:47.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.111+0000 7f18774e6000 20 client.6627 trim_cache size 0 max 16384 2024-09-10T22:42:47.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f18774e6000 1 Processor -- start 2024-09-10T22:42:47.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f18774e6000 1 -- start start 2024-09-10T22:42:47.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f18774e6000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624ef9c0b0 0x55624efa13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f18774e6000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624efe5470 0x55624efa18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f18774e6000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624eff4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f18774e6000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f186c203a10 con 0x55624efe5d90 2024-09-10T22:42:47.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f18774e6000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f186c204110 con 0x55624ef9c0b0 2024-09-10T22:42:47.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f18774e6000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f186c202b00 con 0x55624efe5470 2024-09-10T22:42:47.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f1872000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624eff4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f1872000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624eff4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60096/0 (socket says 172.21.15.103:60096) 2024-09-10T22:42:47.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f1872000640 1 -- 172.21.15.103:0/487453962 learned_addr learned my addr 172.21.15.103:0/487453962 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:47.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f1871600640 1 --2- 172.21.15.103:0/487453962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624ef9c0b0 0x55624efa13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f1870c00640 1 --2- 172.21.15.103:0/487453962 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624efe5470 0x55624efa18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f1872000640 1 -- 172.21.15.103:0/487453962 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624efe5470 msgr2=0x55624efa18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:47.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f1872000640 1 --2- 172.21.15.103:0/487453962 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624efe5470 0x55624efa18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f1872000640 1 -- 172.21.15.103:0/487453962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624ef9c0b0 msgr2=0x55624efa13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:47.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f1872000640 1 --2- 172.21.15.103:0/487453962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624ef9c0b0 0x55624efa13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f1872000640 1 -- 172.21.15.103:0/487453962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55624ed85100 con 0x55624efe5d90 2024-09-10T22:42:47.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f1871600640 1 --2- 172.21.15.103:0/487453962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624ef9c0b0 0x55624efa13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:47.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f1870c00640 1 --2- 172.21.15.103:0/487453962 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624efe5470 0x55624efa18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:42:47.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.127+0000 7f1872000640 1 --2- 172.21.15.103:0/487453962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624eff4af0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f186401a480 tx=0x7f186401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7875e4eb27f8a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:47.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f185d600640 1 -- 172.21.15.103:0/487453962 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18640ca070 con 0x55624efe5d90 2024-09-10T22:42:47.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f185d600640 1 -- 172.21.15.103:0/487453962 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1864003600 con 0x55624efe5d90 2024-09-10T22:42:47.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f185d600640 1 -- 172.21.15.103:0/487453962 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18640ba050 con 0x55624efe5d90 2024-09-10T22:42:47.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 1 -- 172.21.15.103:0/487453962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 msgr2=0x55624eff4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:47.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 1 --2- 172.21.15.103:0/487453962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624eff4af0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f186401a480 tx=0x7f186401c850 comp rx=0 tx=0).stop 2024-09-10T22:42:47.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 1 -- 172.21.15.103:0/487453962 shutdown_connections 2024-09-10T22:42:47.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 1 --2- 172.21.15.103:0/487453962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624eff4af0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 1 --2- 172.21.15.103:0/487453962 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624efe5470 0x55624efa18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 1 --2- 172.21.15.103:0/487453962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624ef9c0b0 0x55624efa13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 1 -- 172.21.15.103:0/487453962 >> 172.21.15.103:0/487453962 conn(0x55624ef98060 msgr2=0x55624ef9b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:47.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 1 -- 172.21.15.103:0/487453962 shutdown_connections 2024-09-10T22:42:47.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 1 -- 172.21.15.103:0/487453962 wait complete. 2024-09-10T22:42:47.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 1 -- start start 2024-09-10T22:42:47.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 1 Processor -- start 2024-09-10T22:42:47.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624ef9c0b0 0x55624f05ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624efe5470 0x55624f05b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624f05b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55624edea100 con 0x55624efe5d90 2024-09-10T22:42:47.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55624edb4a90 con 0x55624efe5470 2024-09-10T22:42:47.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55624edef420 con 0x55624ef9c0b0 2024-09-10T22:42:47.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 10 client.0 _ll_register_callbacks cb 0x7f1858005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:42:47.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f1872000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624f05b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f1872000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624f05b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60112/0 (socket says 172.21.15.103:60112) 2024-09-10T22:42:47.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f1872000640 1 -- 172.21.15.103:0/551152029 learned_addr learned my addr 172.21.15.103:0/551152029 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:47.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f1870c00640 1 --2- 172.21.15.103:0/551152029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624efe5470 0x55624f05b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f1871600640 1 --2- 172.21.15.103:0/551152029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624ef9c0b0 0x55624f05ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f1872000640 1 -- 172.21.15.103:0/551152029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624ef9c0b0 msgr2=0x55624f05ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:47.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f1872000640 1 --2- 172.21.15.103:0/551152029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624ef9c0b0 0x55624f05ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f1872000640 1 -- 172.21.15.103:0/551152029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624efe5470 msgr2=0x55624f05b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:47.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f1872000640 1 --2- 172.21.15.103:0/551152029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624efe5470 0x55624f05b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f1872000640 1 -- 172.21.15.103:0/551152029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55624ee6c290 con 0x55624efe5d90 2024-09-10T22:42:47.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f1871600640 1 --2- 172.21.15.103:0/551152029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624ef9c0b0 0x55624f05ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:47.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f1870c00640 1 --2- 172.21.15.103:0/551152029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624efe5470 0x55624f05b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:47.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f1872000640 1 --2- 172.21.15.103:0/551152029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624f05b910 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f1864009850 tx=0x7f1864003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5071234d25fddbc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:47.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f1852a00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:42:47.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f1852a00640 1 -- 172.21.15.103:0/551152029 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18640ba070 con 0x55624efe5d90 2024-09-10T22:42:47.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f18774e6000 1 -- 172.21.15.103:0/551152029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1864003600 con 0x55624efe5d90 2024-09-10T22:42:47.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.131+0000 7f1852a00640 1 -- 172.21.15.103:0/551152029 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f1864003e00 con 0x55624efe5d90 2024-09-10T22:42:47.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f1852a00640 1 -- 172.21.15.103:0/551152029 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f18640ca070 con 0x55624efe5d90 2024-09-10T22:42:47.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 10 client.6633 fetch_fsmap learned FSMap version 61 2024-09-10T22:42:47.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 1 -- 172.21.15.103:0/551152029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55624ed7d600 con 0x55624efe5d90 2024-09-10T22:42:47.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f1852a00640 1 -- 172.21.15.103:0/551152029 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1864003600 con 0x55624efe5d90 2024-09-10T22:42:47.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f1852a00640 1 -- 172.21.15.103:0/551152029 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 61) ==== 3554+0+0 (secure 0 0 0) 0x7f18640c4040 con 0x55624efe5d90 2024-09-10T22:42:47.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 10 client.6633 fetch_fsmap finished waiting for FSMap version 61 2024-09-10T22:42:47.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 10 client.6633 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-10T22:42:47.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 20 client.6633 populate_metadata read hostname 'smithi103' 2024-09-10T22:42:47.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 1 --2- 172.21.15.103:0/551152029 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55624eff8290 0x55624eff86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 4 client.6633 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2024-09-10T22:42:47.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 1 -- 172.21.15.103:0/551152029 --> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) -- 0x55624edf55b0 con 0x55624eff8290 2024-09-10T22:42:47.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f1871600640 1 --2- 172.21.15.103:0/551152029 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55624eff8290 0x55624eff86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f1852a00640 10 client.6633 ms_handle_connect on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:47.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f1871600640 1 --2- 172.21.15.103:0/551152029 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55624eff8290 0x55624eff86a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c23c80ab9b584bcd server_cookie=f4fdb20ba3752742 in_seq=0 out_seq=0 2024-09-10T22:42:47.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f1852a00640 1 -- 172.21.15.103:0/551152029 <== mds.0 v2:172.21.15.103:6834/714242556 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55624edf55b0 con 0x55624eff8290 2024-09-10T22:42:47.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f1852a00640 10 client.6633 handle_command_reply: tid=0 2024-09-10T22:42:47.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 1 client.6633 shutdown 2024-09-10T22:42:47.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 1 -- 172.21.15.103:0/551152029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 msgr2=0x55624f05b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:47.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 1 --2- 172.21.15.103:0/551152029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624f05b910 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f1864009850 tx=0x7f1864003c10 comp rx=0 tx=0).stop 2024-09-10T22:42:47.142 INFO:tasks.ceph.mds.a.smithi103.stderr:2024-09-10T22:42:47.135+0000 7fcff9e00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-10T22:42:29.000542+0000 1=0+1) n(v3 rc2024-09-10T22:42:29.229423+0000 6=0+6) (inest mix dirty) (ifile excl) caps={6420=pAsLsXsFsx/AsLsXsFsx@9},l=6420 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55ce1e74ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:42:29.000542+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:42:29.229423+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-10T22:42:29.000542+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-10T22:42:29.229423+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-10T22:42:47.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 1 -- 172.21.15.103:0/551152029 shutdown_connections 2024-09-10T22:42:47.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 1 --2- 172.21.15.103:0/551152029 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55624eff8290 0x55624eff86a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 1 --2- 172.21.15.103:0/551152029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55624efe5d90 0x55624f05b910 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 1 --2- 172.21.15.103:0/551152029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55624efe5470 0x55624f05b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 1 --2- 172.21.15.103:0/551152029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55624ef9c0b0 0x55624f05ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 1 -- 172.21.15.103:0/551152029 >> 172.21.15.103:0/551152029 conn(0x55624ef98060 msgr2=0x55624efa0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:47.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f1852a00640 0 client.6633 ms_handle_reset on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:47.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 1 -- 172.21.15.103:0/551152029 shutdown_connections 2024-09-10T22:42:47.143 INFO:tasks.ceph.mds.b.smithi131.stderr:2024-09-10T22:42:47.135+0000 7f7da0c00640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-10T22:42:29.007786+0000 1=0+1) n(v0 rc2024-09-10T22:42:29.007786+0000 2=0+2) (inest lock) (ifile excl) caps={6420=pAsLsXsFsx/-@6},l=6420 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55c873a3e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:42:29.007786+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:42:29.007786+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-10T22:42:29.007786+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-10T22:42:29.007786+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-10T22:42:47.143 INFO:tasks.ceph.mds.b.smithi131.stderr:2024-09-10T22:42:47.135+0000 7f7da0c00640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) caps={6420=pAsLsXsFs/-@3},l=6420 | request=0 lock=0 importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55c873a41700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-10T22:42:47.143 INFO:tasks.ceph.mds.c.smithi103.stderr:2024-09-10T22:42:47.135+0000 7fd5ab800640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-10T22:42:29.004185+0000 1=0+1) n(v2 rc2024-09-10T22:42:29.229423+0000 4=0+4) (inest lock) caps={6420=pAsLsXsFs/-@8},l=6420 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x562824830680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:42:29.004185+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:42:29.229423+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-10T22:42:29.004185+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-10T22:42:29.229423+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-10T22:42:47.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 1 -- 172.21.15.103:0/551152029 wait complete. 2024-09-10T22:42:47.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f18774e6000 20 client.6633 trim_cache size 0 max 16384 2024-09-10T22:42:47.144 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:42:47.144 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0, 2024-09-10T22:42:47.145 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_tag": "8aa8487b-9642-44c9-9a20-cec64ead3c08", 2024-09-10T22:42:47.145 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": "asynchronous" 2024-09-10T22:42:47.145 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:42:47.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f1874000640 1 -- 172.21.15.103:0/2351804602 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f184c0725e0 msgr2=0x7f184c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:47.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f1874000640 1 --2- 172.21.15.103:0/2351804602 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f184c0725e0 0x7f184c074aa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f186c0b3550 tx=0x7f18580091e0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f1874000640 1 -- 172.21.15.103:0/2351804602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f186c0ae9c0 msgr2=0x7f186c150f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:47.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.135+0000 7f1874000640 1 --2- 172.21.15.103:0/2351804602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f186c0ae9c0 0x7f186c150f30 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f186000c780 tx=0x7f186000cc40 comp rx=0 tx=0).stop 2024-09-10T22:42:47.146 INFO:tasks.ceph.mds.a.smithi103.stderr:2024-09-10T22:42:47.139+0000 7fd002000640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-10T22:42:29.002402+0000 1=0+1) n(v4 rc2024-09-10T22:42:29.229423+0000 5=0+5) (inest sync->mix g=1,2) caps={6420=pAsLsXsFs/-@11} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55ce1e74f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:42:29.002402+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:42:29.229423+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-10T22:42:29.002402+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-10T22:42:29.229423+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-10T22:42:47.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.139+0000 7f1874000640 1 -- 172.21.15.103:0/2351804602 shutdown_connections 2024-09-10T22:42:47.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.139+0000 7f1874000640 1 --2- 172.21.15.103:0/2351804602 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f184c0725e0 0x7f184c074aa0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.139+0000 7f1874000640 1 --2- 172.21.15.103:0/2351804602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f186c15be30 0x7f186c070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.139+0000 7f1874000640 1 --2- 172.21.15.103:0/2351804602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f186c0b09c0 0x7f186c150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.139+0000 7f1874000640 1 --2- 172.21.15.103:0/2351804602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f186c0ae9c0 0x7f186c150f30 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.139+0000 7f1874000640 1 -- 172.21.15.103:0/2351804602 >> 172.21.15.103:0/2351804602 conn(0x7f186c0d1ac0 msgr2=0x7f186c153fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:47.147 INFO:tasks.ceph.mds.c.smithi103.stderr:2024-09-10T22:42:47.139+0000 7fd5b3a00640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-10T22:42:29.006019+0000 1=0+1) n(v1 rc2024-09-10T22:42:29.229423+0000 3=0+3) (inest sync->mix g=0,2 scatter_wanted) caps={6420=pAsLsXsFs/-@7} | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x562823914000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:42:29.006019+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:42:29.007786+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-10T22:42:29.006019+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-10T22:42:29.229423+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-10T22:42:47.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.139+0000 7f1874000640 1 -- 172.21.15.103:0/2351804602 shutdown_connections 2024-09-10T22:42:47.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.139+0000 7f1874000640 1 -- 172.21.15.103:0/2351804602 wait complete. 2024-09-10T22:42:47.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:42:47.159 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-09-10T22:42:47.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.299+0000 7fe53be00640 1 -- 172.21.15.103:0/3945542667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe51c0051d0 msgr2=0x7fe51c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:47.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.299+0000 7fe53be00640 1 --2- 172.21.15.103:0/3945542667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe51c0051d0 0x7fe51c00b9d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe52c001e60 tx=0x7fe52c01cbe0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.299+0000 7fe53be00640 1 -- 172.21.15.103:0/3945542667 shutdown_connections 2024-09-10T22:42:47.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.299+0000 7fe53be00640 1 --2- 172.21.15.103:0/3945542667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe51c0051d0 0x7fe51c00b9d0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.299+0000 7fe53be00640 1 -- 172.21.15.103:0/3945542667 >> 172.21.15.103:0/3945542667 conn(0x7fe5340cd3c0 msgr2=0x7fe5340cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:47.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe53be00640 1 -- 172.21.15.103:0/3945542667 shutdown_connections 2024-09-10T22:42:47.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe53be00640 1 -- 172.21.15.103:0/3945542667 wait complete. 2024-09-10T22:42:47.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe53be00640 1 Processor -- start 2024-09-10T22:42:47.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe53be00640 1 -- start start 2024-09-10T22:42:47.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe53be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe51c0051d0 0x7fe5341f4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe53be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5341501b0 0x7fe534151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe53be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe534150630 0x7fe53415aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe53be00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe53406cd80 con 0x7fe51c0051d0 2024-09-10T22:42:47.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe53be00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe53406cc00 con 0x7fe5341501b0 2024-09-10T22:42:47.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe53be00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe53406cf00 con 0x7fe534150630 2024-09-10T22:42:47.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe539400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe51c0051d0 0x7fe5341f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe539400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe51c0051d0 0x7fe5341f4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60136/0 (socket says 172.21.15.103:60136) 2024-09-10T22:42:47.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe539400640 1 -- 172.21.15.103:0/2716902954 learned_addr learned my addr 172.21.15.103:0/2716902954 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:47.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe539e00640 1 --2- 172.21.15.103:0/2716902954 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe534150630 0x7fe53415aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe538a00640 1 --2- 172.21.15.103:0/2716902954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5341501b0 0x7fe534151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe539400640 1 -- 172.21.15.103:0/2716902954 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe534150630 msgr2=0x7fe53415aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:47.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe539400640 1 --2- 172.21.15.103:0/2716902954 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe534150630 0x7fe53415aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe539400640 1 -- 172.21.15.103:0/2716902954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5341501b0 msgr2=0x7fe534151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:47.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe539400640 1 --2- 172.21.15.103:0/2716902954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5341501b0 0x7fe534151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe539400640 1 -- 172.21.15.103:0/2716902954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53415dc30 con 0x7fe51c0051d0 2024-09-10T22:42:47.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe539e00640 1 --2- 172.21.15.103:0/2716902954 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe534150630 0x7fe53415aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:47.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe539400640 1 --2- 172.21.15.103:0/2716902954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe51c0051d0 0x7fe5341f4b20 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe528000fe0 tx=0x7fe5280039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:47.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe531600640 1 -- 172.21.15.103:0/2716902954 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe528015070 con 0x7fe51c0051d0 2024-09-10T22:42:47.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe531600640 1 -- 172.21.15.103:0/2716902954 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe528011920 con 0x7fe51c0051d0 2024-09-10T22:42:47.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe53be00640 1 -- 172.21.15.103:0/2716902954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe53415df10 con 0x7fe51c0051d0 2024-09-10T22:42:47.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.303+0000 7fe531600640 1 -- 172.21.15.103:0/2716902954 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe528011d70 con 0x7fe51c0051d0 2024-09-10T22:42:47.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.307+0000 7fe53be00640 1 -- 172.21.15.103:0/2716902954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe534151a40 con 0x7fe51c0051d0 2024-09-10T22:42:47.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.307+0000 7fe531600640 1 -- 172.21.15.103:0/2716902954 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe528010420 con 0x7fe51c0051d0 2024-09-10T22:42:47.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.307+0000 7fe531600640 1 --2- 172.21.15.103:0/2716902954 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe5140725e0 0x7fe514074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.307+0000 7fe531600640 1 -- 172.21.15.103:0/2716902954 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7fe5280944d0 con 0x7fe51c0051d0 2024-09-10T22:42:47.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.307+0000 7fe53f1ed000 1 Processor -- start 2024-09-10T22:42:47.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.307+0000 7fe53f1ed000 1 -- start start 2024-09-10T22:42:47.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.307+0000 7fe538a00640 1 --2- 172.21.15.103:0/2716902954 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe5140725e0 0x7fe514074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe538a00640 1 --2- 172.21.15.103:0/2716902954 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe5140725e0 0x7fe514074aa0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe53415b6a0 tx=0x7fe5200091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:47.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe53f1ed000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e588b51a0 0x560e588b5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe53f1ed000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e588b5ac0 0x560e5886b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe53f1ed000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5886bbc0 0x560e5886bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe53f1ed000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560e58753cb0 con 0x560e588b5ac0 2024-09-10T22:42:47.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe53f1ed000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560e58669310 con 0x560e5886bbc0 2024-09-10T22:42:47.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe53f1ed000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560e586c6b90 con 0x560e588b51a0 2024-09-10T22:42:47.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe538a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e588b5ac0 0x560e5886b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe538a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e588b5ac0 0x560e5886b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60152/0 (socket says 172.21.15.103:60152) 2024-09-10T22:42:47.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe538a00640 1 -- 172.21.15.103:0/255784512 learned_addr learned my addr 172.21.15.103:0/255784512 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:47.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe539400640 1 --2- 172.21.15.103:0/255784512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e588b51a0 0x560e588b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe539e00640 1 --2- 172.21.15.103:0/255784512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5886bbc0 0x560e5886bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe538a00640 1 -- 172.21.15.103:0/255784512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e588b51a0 msgr2=0x560e588b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:47.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe538a00640 1 --2- 172.21.15.103:0/255784512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e588b51a0 0x560e588b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe538a00640 1 -- 172.21.15.103:0/255784512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5886bbc0 msgr2=0x560e5886bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:47.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe538a00640 1 --2- 172.21.15.103:0/255784512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5886bbc0 0x560e5886bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe538a00640 1 -- 172.21.15.103:0/255784512 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e5866ac60 con 0x560e588b5ac0 2024-09-10T22:42:47.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe538a00640 1 --2- 172.21.15.103:0/255784512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e588b5ac0 0x560e5886b680 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe520012ee0 tx=0x7fe520017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e24f2e43f21127 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:47.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe526000640 1 -- 172.21.15.103:0/255784512 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5200044d0 con 0x560e588b5ac0 2024-09-10T22:42:47.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe526000640 1 -- 172.21.15.103:0/255784512 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe520003b80 con 0x560e588b5ac0 2024-09-10T22:42:47.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe526000640 1 -- 172.21.15.103:0/255784512 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe520005020 con 0x560e588b5ac0 2024-09-10T22:42:47.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe53f1ed000 1 -- 172.21.15.103:0/255784512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e588b5ac0 msgr2=0x560e5886b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:47.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/255784512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e588b5ac0 0x560e5886b680 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe520012ee0 tx=0x7fe520017000 comp rx=0 tx=0).stop 2024-09-10T22:42:47.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe53f1ed000 1 -- 172.21.15.103:0/255784512 shutdown_connections 2024-09-10T22:42:47.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/255784512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5886bbc0 0x560e5886bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/255784512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e588b5ac0 0x560e5886b680 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/255784512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e588b51a0 0x560e588b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe53f1ed000 1 -- 172.21.15.103:0/255784512 >> 172.21.15.103:0/255784512 conn(0x560e58871d20 msgr2=0x560e58869f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:47.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe53f1ed000 1 -- 172.21.15.103:0/255784512 shutdown_connections 2024-09-10T22:42:47.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe53f1ed000 1 -- 172.21.15.103:0/255784512 wait complete. 2024-09-10T22:42:47.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe53f1ed000 1 -- start start 2024-09-10T22:42:47.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.311+0000 7fe53f1ed000 1 Processor -- start 2024-09-10T22:42:47.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e5886bbc0 0x560e588bc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e588b51a0 0x560e588bca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e588b5ac0 0x560e588bcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560e586b9dd0 con 0x560e5886bbc0 2024-09-10T22:42:47.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560e586b5fc0 con 0x560e588b51a0 2024-09-10T22:42:47.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560e5865b4b0 con 0x560e588b5ac0 2024-09-10T22:42:47.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 10 client.0 _ll_register_callbacks cb 0x560e586397d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:42:47.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe539400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e5886bbc0 0x560e588bc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe539400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e5886bbc0 0x560e588bc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60154/0 (socket says 172.21.15.103:60154) 2024-09-10T22:42:47.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe539400640 1 -- 172.21.15.103:0/2198561196 learned_addr learned my addr 172.21.15.103:0/2198561196 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:47.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe538a00640 1 --2- 172.21.15.103:0/2198561196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e588b51a0 0x560e588bca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe539e00640 1 --2- 172.21.15.103:0/2198561196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e588b5ac0 0x560e588bcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe539400640 1 -- 172.21.15.103:0/2198561196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e588b5ac0 msgr2=0x560e588bcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:47.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe539400640 1 --2- 172.21.15.103:0/2198561196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e588b5ac0 0x560e588bcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe539400640 1 -- 172.21.15.103:0/2198561196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e588b51a0 msgr2=0x560e588bca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:47.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe539400640 1 --2- 172.21.15.103:0/2198561196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e588b51a0 0x560e588bca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe539400640 1 -- 172.21.15.103:0/2198561196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e586541f0 con 0x560e5886bbc0 2024-09-10T22:42:47.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe538a00640 1 --2- 172.21.15.103:0/2198561196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e588b51a0 0x560e588bca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:42:47.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe539400640 1 --2- 172.21.15.103:0/2198561196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e5886bbc0 0x560e588bc530 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe52805f220 tx=0x7fe52805eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2936fb510c7fc5fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:47.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe51aa00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:42:47.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe51aa00640 1 -- 172.21.15.103:0/2198561196 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52801f040 con 0x560e5886bbc0 2024-09-10T22:42:47.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 -- 172.21.15.103:0/2198561196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560e5864e330 con 0x560e5886bbc0 2024-09-10T22:42:47.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe51aa00640 1 -- 172.21.15.103:0/2198561196 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7fe5280940d0 con 0x560e5886bbc0 2024-09-10T22:42:47.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe51aa00640 1 -- 172.21.15.103:0/2198561196 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fe528063d70 con 0x560e5886bbc0 2024-09-10T22:42:47.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 10 client.6645 fetch_fsmap learned FSMap version 61 2024-09-10T22:42:47.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 -- 172.21.15.103:0/2198561196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x560e5863afa0 con 0x560e5886bbc0 2024-09-10T22:42:47.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe51aa00640 1 -- 172.21.15.103:0/2198561196 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560e5864e330 con 0x560e5886bbc0 2024-09-10T22:42:47.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe51aa00640 1 -- 172.21.15.103:0/2198561196 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 61) ==== 3554+0+0 (secure 0 0 0) 0x7fe528068300 con 0x560e5886bbc0 2024-09-10T22:42:47.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 10 client.6645 fetch_fsmap finished waiting for FSMap version 61 2024-09-10T22:42:47.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 10 client.6645 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-10T22:42:47.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 20 client.6645 populate_metadata read hostname 'smithi103' 2024-09-10T22:42:47.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/2198561196 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x560e588c4900 0x560e588c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 4 client.6645 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:42:47.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 -- 172.21.15.103:0/2198561196 --> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e586c8ae0 con 0x560e588c4900 2024-09-10T22:42:47.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe538a00640 1 --2- 172.21.15.103:0/2198561196 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x560e588c4900 0x560e588c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe51aa00640 10 client.6645 ms_handle_connect on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:47.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe538a00640 1 --2- 172.21.15.103:0/2198561196 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x560e588c4900 0x560e588c6cf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c5c3cad65b6b165 server_cookie=c1f42f7984e43d0f in_seq=0 out_seq=0 2024-09-10T22:42:47.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe51aa00640 1 -- 172.21.15.103:0/2198561196 <== mds.0 v2:172.21.15.103:6834/714242556 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560e586c8ae0 con 0x560e588c4900 2024-09-10T22:42:47.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe51aa00640 10 client.6645 handle_command_reply: tid=0 2024-09-10T22:42:47.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 client.6645 shutdown 2024-09-10T22:42:47.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 -- 172.21.15.103:0/2198561196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e5886bbc0 msgr2=0x560e588bc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:47.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/2198561196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e5886bbc0 0x560e588bc530 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe52805f220 tx=0x7fe52805eac0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 -- 172.21.15.103:0/2198561196 shutdown_connections 2024-09-10T22:42:47.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/2198561196 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x560e588c4900 0x560e588c6cf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/2198561196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e588b5ac0 0x560e588bcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/2198561196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e588b51a0 0x560e588bca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/2198561196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e5886bbc0 0x560e588bc530 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 -- 172.21.15.103:0/2198561196 >> 172.21.15.103:0/2198561196 conn(0x560e58871d20 msgr2=0x560e58869f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:47.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe51aa00640 0 client.6645 ms_handle_reset on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:47.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 -- 172.21.15.103:0/2198561196 shutdown_connections 2024-09-10T22:42:47.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 1 -- 172.21.15.103:0/2198561196 wait complete. 2024-09-10T22:42:47.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.315+0000 7fe53f1ed000 20 client.6645 trim_cache size 0 max 16384 2024-09-10T22:42:47.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe53f1ed000 1 Processor -- start 2024-09-10T22:42:47.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe53f1ed000 1 -- start start 2024-09-10T22:42:47.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe53f1ed000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e58871d20 0x560e58928060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe53f1ed000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e5886bbc0 0x560e589285a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe53f1ed000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e588b51a0 0x560e58928ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe53f1ed000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe534201b50 con 0x560e588b51a0 2024-09-10T22:42:47.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe53f1ed000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe534200d20 con 0x560e58871d20 2024-09-10T22:42:47.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe53f1ed000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe534201420 con 0x560e5886bbc0 2024-09-10T22:42:47.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe539e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e588b51a0 0x560e58928ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe539e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e588b51a0 0x560e58928ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60158/0 (socket says 172.21.15.103:60158) 2024-09-10T22:42:47.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe539e00640 1 -- 172.21.15.103:0/3344531963 learned_addr learned my addr 172.21.15.103:0/3344531963 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:47.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe539e00640 1 -- 172.21.15.103:0/3344531963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e5886bbc0 msgr2=0x560e589285a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:47.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe539e00640 1 --2- 172.21.15.103:0/3344531963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e5886bbc0 0x560e589285a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe539e00640 1 -- 172.21.15.103:0/3344531963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e58871d20 msgr2=0x560e58928060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:47.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe539e00640 1 --2- 172.21.15.103:0/3344531963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e58871d20 0x560e58928060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe539e00640 1 -- 172.21.15.103:0/3344531963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e58713660 con 0x560e588b51a0 2024-09-10T22:42:47.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe539e00640 1 --2- 172.21.15.103:0/3344531963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e588b51a0 0x560e58928ae0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe52c001e60 tx=0x7fe51c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8211f5c449f6a79e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:47.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe525600640 1 -- 172.21.15.103:0/3344531963 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c0a5bf0 con 0x560e588b51a0 2024-09-10T22:42:47.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe525600640 1 -- 172.21.15.103:0/3344531963 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe52c0a5d90 con 0x560e588b51a0 2024-09-10T22:42:47.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.335+0000 7fe525600640 1 -- 172.21.15.103:0/3344531963 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c003be0 con 0x560e588b51a0 2024-09-10T22:42:47.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 -- 172.21.15.103:0/3344531963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e588b51a0 msgr2=0x560e58928ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:47.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/3344531963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e588b51a0 0x560e58928ae0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe52c001e60 tx=0x7fe51c005840 comp rx=0 tx=0).stop 2024-09-10T22:42:47.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 -- 172.21.15.103:0/3344531963 shutdown_connections 2024-09-10T22:42:47.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/3344531963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e588b51a0 0x560e58928ae0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/3344531963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e5886bbc0 0x560e589285a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/3344531963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e58871d20 0x560e58928060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 -- 172.21.15.103:0/3344531963 >> 172.21.15.103:0/3344531963 conn(0x560e58868270 msgr2=0x560e5886bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:47.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 -- 172.21.15.103:0/3344531963 shutdown_connections 2024-09-10T22:42:47.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 -- 172.21.15.103:0/3344531963 wait complete. 2024-09-10T22:42:47.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 -- start start 2024-09-10T22:42:47.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 Processor -- start 2024-09-10T22:42:47.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e5886bbc0 0x560e5892b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e58871d20 0x560e5892bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e588b51a0 0x560e5892c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560e586b5fc0 con 0x560e58871d20 2024-09-10T22:42:47.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560e586b9dd0 con 0x560e588b51a0 2024-09-10T22:42:47.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560e58874d40 con 0x560e5886bbc0 2024-09-10T22:42:47.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 10 client.0 _ll_register_callbacks cb 0x7fe528011f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:42:47.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe538a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e58871d20 0x560e5892bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe538a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e58871d20 0x560e5892bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60170/0 (socket says 172.21.15.103:60170) 2024-09-10T22:42:47.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe538a00640 1 -- 172.21.15.103:0/2491343282 learned_addr learned my addr 172.21.15.103:0/2491343282 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:42:47.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe539e00640 1 --2- 172.21.15.103:0/2491343282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e588b51a0 0x560e5892c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe539400640 1 --2- 172.21.15.103:0/2491343282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e5886bbc0 0x560e5892b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe538a00640 1 -- 172.21.15.103:0/2491343282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e5886bbc0 msgr2=0x560e5892b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:47.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe538a00640 1 --2- 172.21.15.103:0/2491343282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e5886bbc0 0x560e5892b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe538a00640 1 -- 172.21.15.103:0/2491343282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e588b51a0 msgr2=0x560e5892c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:42:47.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe538a00640 1 --2- 172.21.15.103:0/2491343282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e588b51a0 0x560e5892c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe538a00640 1 -- 172.21.15.103:0/2491343282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e58680090 con 0x560e58871d20 2024-09-10T22:42:47.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe538a00640 1 --2- 172.21.15.103:0/2491343282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e58871d20 0x560e5892bce0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe520013010 tx=0x7fe520009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08d0a9f3537313f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:42:47.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe51aa00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:42:47.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe51aa00640 1 -- 172.21.15.103:0/2491343282 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe520003e00 con 0x560e58871d20 2024-09-10T22:42:47.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe51aa00640 1 -- 172.21.15.103:0/2491343282 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7fe520005020 con 0x560e58871d20 2024-09-10T22:42:47.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 -- 172.21.15.103:0/2491343282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe52c0a5d90 con 0x560e58871d20 2024-09-10T22:42:47.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe51aa00640 1 -- 172.21.15.103:0/2491343282 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fe52003e050 con 0x560e58871d20 2024-09-10T22:42:47.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 10 client.6651 fetch_fsmap learned FSMap version 61 2024-09-10T22:42:47.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.339+0000 7fe53f1ed000 1 -- 172.21.15.103:0/2491343282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x560e5864c5f0 con 0x560e58871d20 2024-09-10T22:42:47.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe51aa00640 1 -- 172.21.15.103:0/2491343282 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe52c0a5d90 con 0x560e58871d20 2024-09-10T22:42:47.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe51aa00640 1 -- 172.21.15.103:0/2491343282 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 61) ==== 3554+0+0 (secure 0 0 0) 0x7fe520041020 con 0x560e58871d20 2024-09-10T22:42:47.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53f1ed000 10 client.6651 fetch_fsmap finished waiting for FSMap version 61 2024-09-10T22:42:47.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53f1ed000 10 client.6651 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-10T22:42:47.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53f1ed000 20 client.6651 populate_metadata read hostname 'smithi103' 2024-09-10T22:42:47.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/2491343282 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x560e588b5ac0 0x560e588e79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:42:47.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53f1ed000 4 client.6651 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:42:47.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53f1ed000 1 -- 172.21.15.103:0/2491343282 --> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560e586c4590 con 0x560e588b5ac0 2024-09-10T22:42:47.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe539400640 1 --2- 172.21.15.103:0/2491343282 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x560e588b5ac0 0x560e588e79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:42:47.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe539400640 1 --2- 172.21.15.103:0/2491343282 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x560e588b5ac0 0x560e588e79c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bb7edc801da6eac server_cookie=ade034d9fddd948f in_seq=0 out_seq=0 2024-09-10T22:42:47.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe51aa00640 10 client.6651 ms_handle_connect on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:47.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe51aa00640 1 -- 172.21.15.103:0/2491343282 <== mds.0 v2:172.21.15.103:6834/714242556 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x560e586c4590 con 0x560e588b5ac0 2024-09-10T22:42:47.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe51aa00640 10 client.6651 handle_command_reply: tid=0 2024-09-10T22:42:47.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53f1ed000 1 client.6651 shutdown 2024-09-10T22:42:47.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53f1ed000 1 -- 172.21.15.103:0/2491343282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e58871d20 msgr2=0x560e5892bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:47.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/2491343282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e58871d20 0x560e5892bce0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe520013010 tx=0x7fe520009fd0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53f1ed000 1 -- 172.21.15.103:0/2491343282 shutdown_connections 2024-09-10T22:42:47.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/2491343282 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x560e588b5ac0 0x560e588e79c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/2491343282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e588b51a0 0x560e5892c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/2491343282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e58871d20 0x560e5892bce0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe51aa00640 0 client.6651 ms_handle_reset on v2:172.21.15.103:6834/714242556 2024-09-10T22:42:47.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53f1ed000 1 --2- 172.21.15.103:0/2491343282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560e5886bbc0 0x560e5892b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53f1ed000 1 -- 172.21.15.103:0/2491343282 >> 172.21.15.103:0/2491343282 conn(0x560e58868270 msgr2=0x560e5886c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:47.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53f1ed000 1 -- 172.21.15.103:0/2491343282 shutdown_connections 2024-09-10T22:42:47.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53f1ed000 1 -- 172.21.15.103:0/2491343282 wait complete. 2024-09-10T22:42:47.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53f1ed000 20 client.6651 trim_cache size 0 max 16384 2024-09-10T22:42:47.350 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:42:47.350 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:42:47.350 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:42:47.350 INFO:teuthology.orchestra.run.smithi103.stdout: "8aa8487b-9642-44c9-9a20-cec64ead3c08": { 2024-09-10T22:42:47.350 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:42:47.350 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "8aa8487b-9642-44c9-9a20-cec64ead3c08", 2024-09-10T22:42:47.350 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:42:47.350 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:47.351 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:42:47.351 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_stats": { 2024-09-10T22:42:47.351 INFO:teuthology.orchestra.run.smithi103.stdout: "8aa8487b-9642-44c9-9a20-cec64ead3c08": { 2024-09-10T22:42:47.351 INFO:teuthology.orchestra.run.smithi103.stdout: "start_time": "2024-09-10T22:42:47.135451+0000", 2024-09-10T22:42:47.351 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:42:47.351 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_started": 0, 2024-09-10T22:42:47.351 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_passed": 0, 2024-09-10T22:42:47.351 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_failed": 0, 2024-09-10T22:42:47.351 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_skipped": 0 2024-09-10T22:42:47.351 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:47.351 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:42:47.351 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:42:47.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53be00640 1 -- 172.21.15.103:0/2716902954 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe5140725e0 msgr2=0x7fe514074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:47.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53be00640 1 --2- 172.21.15.103:0/2716902954 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe5140725e0 0x7fe514074aa0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe53415b6a0 tx=0x7fe5200091e0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53be00640 1 -- 172.21.15.103:0/2716902954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe51c0051d0 msgr2=0x7fe5341f4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:42:47.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53be00640 1 --2- 172.21.15.103:0/2716902954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe51c0051d0 0x7fe5341f4b20 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe528000fe0 tx=0x7fe5280039d0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53be00640 1 -- 172.21.15.103:0/2716902954 shutdown_connections 2024-09-10T22:42:47.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53be00640 1 --2- 172.21.15.103:0/2716902954 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe5140725e0 0x7fe514074aa0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53be00640 1 --2- 172.21.15.103:0/2716902954 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe534150630 0x7fe53415aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53be00640 1 --2- 172.21.15.103:0/2716902954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5341501b0 0x7fe534151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53be00640 1 --2- 172.21.15.103:0/2716902954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe51c0051d0 0x7fe5341f4b20 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:42:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53be00640 1 -- 172.21.15.103:0/2716902954 >> 172.21.15.103:0/2716902954 conn(0x7fe5340cd3c0 msgr2=0x7fe53415cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:42:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53be00640 1 -- 172.21.15.103:0/2716902954 shutdown_connections 2024-09-10T22:42:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:42:47.343+0000 7fe53be00640 1 -- 172.21.15.103:0/2716902954 wait complete. 2024-09-10T22:42:47.365 INFO:tasks.cephfs.filesystem:scrub status for tag:8aa8487b-9642-44c9-9a20-cec64ead3c08 - {'path': '/d1/d2/d3', 'tag': '8aa8487b-9642-44c9-9a20-cec64ead3c08', 'options': 'recursive,force'} 2024-09-10T22:42:49.778 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-10T22:42:49.775+0000 7fb5aec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-10T22:42:59.097 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-10T22:42:59.095+0000 7fb5aec00640 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-10T22:43:16.926 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:43:16.931 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:43:17.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:43:17.366 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-09-10T22:43:17.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.518+0000 7fdecac00640 1 -- 172.21.15.103:0/963853383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec415f2e0 msgr2=0x7fdec415f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.518+0000 7fdecac00640 1 --2- 172.21.15.103:0/963853383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec415f2e0 0x7fdec415f6f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fdec4072490 tx=0x7fdebc01cd80 comp rx=0 tx=0).stop 2024-09-10T22:43:17.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.518+0000 7fdecac00640 1 -- 172.21.15.103:0/963853383 shutdown_connections 2024-09-10T22:43:17.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.518+0000 7fdecac00640 1 --2- 172.21.15.103:0/963853383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec415f2e0 0x7fdec415f6f0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.518+0000 7fdecac00640 1 --2- 172.21.15.103:0/963853383 >> v2:172.21.15.131:3300/0 conn(0x7fdec40cfdd0 0x7fdec415eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.518+0000 7fdecac00640 1 -- 172.21.15.103:0/963853383 >> 172.21.15.103:0/963853383 conn(0x7fdec406cc00 msgr2=0x7fdec406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:17.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.518+0000 7fdecac00640 1 -- 172.21.15.103:0/963853383 shutdown_connections 2024-09-10T22:43:17.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.518+0000 7fdecac00640 1 -- 172.21.15.103:0/963853383 wait complete. 2024-09-10T22:43:17.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.518+0000 7fdecac00640 1 Processor -- start 2024-09-10T22:43:17.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.518+0000 7fdecac00640 1 -- start start 2024-09-10T22:43:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.518+0000 7fdecac00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec40cf9f0 0x7fdec4157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.518+0000 7fdecac00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdec40cfdd0 0x7fdec414a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.518+0000 7fdecac00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdec415f2e0 0x7fdec40ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.518+0000 7fdecac00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdec40cd690 con 0x7fdec40cf9f0 2024-09-10T22:43:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.518+0000 7fdecac00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdec40cd510 con 0x7fdec40cfdd0 2024-09-10T22:43:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.518+0000 7fdecac00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdec40cd810 con 0x7fdec415f2e0 2024-09-10T22:43:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.522+0000 7fdec3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec40cf9f0 0x7fdec4157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.522+0000 7fdec3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec40cf9f0 0x7fdec4157c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51090/0 (socket says 172.21.15.103:51090) 2024-09-10T22:43:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.522+0000 7fdec3e00640 1 -- 172.21.15.103:0/1500724332 learned_addr learned my addr 172.21.15.103:0/1500724332 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.522+0000 7fdebb400640 1 --2- 172.21.15.103:0/1500724332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdec40cfdd0 0x7fdec414a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.522+0000 7fdec8c00640 1 --2- 172.21.15.103:0/1500724332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdec415f2e0 0x7fdec40ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.522+0000 7fdec3e00640 1 -- 172.21.15.103:0/1500724332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdec415f2e0 msgr2=0x7fdec40ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.522+0000 7fdec3e00640 1 --2- 172.21.15.103:0/1500724332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdec415f2e0 0x7fdec40ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.522+0000 7fdec3e00640 1 -- 172.21.15.103:0/1500724332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdec40cfdd0 msgr2=0x7fdec414a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.522+0000 7fdec3e00640 1 --2- 172.21.15.103:0/1500724332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdec40cfdd0 0x7fdec414a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.522+0000 7fdec3e00640 1 -- 172.21.15.103:0/1500724332 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec414a660 con 0x7fdec40cf9f0 2024-09-10T22:43:17.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.522+0000 7fdec8c00640 1 --2- 172.21.15.103:0/1500724332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdec415f2e0 0x7fdec40ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:17.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.522+0000 7fdec3e00640 1 --2- 172.21.15.103:0/1500724332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec40cf9f0 0x7fdec4157c70 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400c490 tx=0x7fdeb4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:17.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.522+0000 7fdec0c00640 1 -- 172.21.15.103:0/1500724332 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4017070 con 0x7fdec40cf9f0 2024-09-10T22:43:17.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.522+0000 7fdec0c00640 1 -- 172.21.15.103:0/1500724332 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdeb4003600 con 0x7fdec40cf9f0 2024-09-10T22:43:17.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.522+0000 7fdec0c00640 1 -- 172.21.15.103:0/1500724332 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4003a90 con 0x7fdec40cf9f0 2024-09-10T22:43:17.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.522+0000 7fdecac00640 1 -- 172.21.15.103:0/1500724332 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec41fb950 con 0x7fdec40cf9f0 2024-09-10T22:43:17.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.522+0000 7fdecac00640 1 -- 172.21.15.103:0/1500724332 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec40b02c0 con 0x7fdec40cf9f0 2024-09-10T22:43:17.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.522+0000 7fdec0c00640 1 -- 172.21.15.103:0/1500724332 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdeb4003c30 con 0x7fdec40cf9f0 2024-09-10T22:43:17.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdec0c00640 1 --2- 172.21.15.103:0/1500724332 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdea0072610 0x7fdea0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdec0c00640 1 -- 172.21.15.103:0/1500724332 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7fdeb4092660 con 0x7fdec40cf9f0 2024-09-10T22:43:17.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdece096000 1 Processor -- start 2024-09-10T22:43:17.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdebb400640 1 --2- 172.21.15.103:0/1500724332 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdea0072610 0x7fdea0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdece096000 1 -- start start 2024-09-10T22:43:17.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdebb400640 1 --2- 172.21.15.103:0/1500724332 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdea0072610 0x7fdea0074ad0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdeac006fd0 tx=0x7fdeac008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:17.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdece096000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d92c1a0 0x55ec5d92c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdece096000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92cac0 0x55ec5d8e2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdece096000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d8e2bc0 0x55ec5d8e2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdece096000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ec5d7cacb0 con 0x55ec5d92cac0 2024-09-10T22:43:17.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdece096000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ec5d6e0310 con 0x55ec5d8e2bc0 2024-09-10T22:43:17.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdece096000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ec5d73db90 con 0x55ec5d92c1a0 2024-09-10T22:43:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdebb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92cac0 0x55ec5d8e2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdebb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92cac0 0x55ec5d8e2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51098/0 (socket says 172.21.15.103:51098) 2024-09-10T22:43:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdebb400640 1 -- 172.21.15.103:0/2448243354 learned_addr learned my addr 172.21.15.103:0/2448243354 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdec3e00640 1 --2- 172.21.15.103:0/2448243354 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d92c1a0 0x55ec5d92c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdec8c00640 1 --2- 172.21.15.103:0/2448243354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d8e2bc0 0x55ec5d8e2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdebb400640 1 -- 172.21.15.103:0/2448243354 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d92c1a0 msgr2=0x55ec5d92c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdebb400640 1 --2- 172.21.15.103:0/2448243354 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d92c1a0 0x55ec5d92c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdebb400640 1 -- 172.21.15.103:0/2448243354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d8e2bc0 msgr2=0x55ec5d8e2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdebb400640 1 --2- 172.21.15.103:0/2448243354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d8e2bc0 0x55ec5d8e2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdebb400640 1 -- 172.21.15.103:0/2448243354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec5d6e1c60 con 0x55ec5d92cac0 2024-09-10T22:43:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdec3e00640 1 --2- 172.21.15.103:0/2448243354 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d92c1a0 0x55ec5d92c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:17.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdec8c00640 1 --2- 172.21.15.103:0/2448243354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d8e2bc0 0x55ec5d8e2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:17.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdebb400640 1 --2- 172.21.15.103:0/2448243354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92cac0 0x55ec5d8e2680 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fdeac009fd0 tx=0x7fdeac010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df538987cd89cee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:17.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdeb8c00640 1 -- 172.21.15.103:0/2448243354 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac024070 con 0x55ec5d92cac0 2024-09-10T22:43:17.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdeb8c00640 1 -- 172.21.15.103:0/2448243354 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdeac014ac0 con 0x55ec5d92cac0 2024-09-10T22:43:17.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdeb8c00640 1 -- 172.21.15.103:0/2448243354 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac01f400 con 0x55ec5d92cac0 2024-09-10T22:43:17.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdece096000 1 -- 172.21.15.103:0/2448243354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92cac0 msgr2=0x55ec5d8e2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdece096000 1 --2- 172.21.15.103:0/2448243354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92cac0 0x55ec5d8e2680 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fdeac009fd0 tx=0x7fdeac010000 comp rx=0 tx=0).stop 2024-09-10T22:43:17.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdece096000 1 -- 172.21.15.103:0/2448243354 shutdown_connections 2024-09-10T22:43:17.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdece096000 1 --2- 172.21.15.103:0/2448243354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d8e2bc0 0x55ec5d8e2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdece096000 1 --2- 172.21.15.103:0/2448243354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92cac0 0x55ec5d8e2680 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdece096000 1 --2- 172.21.15.103:0/2448243354 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d92c1a0 0x55ec5d92c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdece096000 1 -- 172.21.15.103:0/2448243354 >> 172.21.15.103:0/2448243354 conn(0x55ec5d8e8d20 msgr2=0x55ec5d8e0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdece096000 1 -- 172.21.15.103:0/2448243354 shutdown_connections 2024-09-10T22:43:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.526+0000 7fdece096000 1 -- 172.21.15.103:0/2448243354 wait complete. 2024-09-10T22:43:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdece096000 1 -- start start 2024-09-10T22:43:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdece096000 1 Processor -- start 2024-09-10T22:43:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdece096000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d8e2bc0 0x55ec5d933530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdece096000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d92c1a0 0x55ec5d933a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdece096000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92cac0 0x55ec5d933fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdece096000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ec5d730dd0 con 0x55ec5d92cac0 2024-09-10T22:43:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdece096000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ec5d72cfc0 con 0x55ec5d8e2bc0 2024-09-10T22:43:17.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdece096000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ec5d6d24b0 con 0x55ec5d92c1a0 2024-09-10T22:43:17.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdece096000 10 client.0 _ll_register_callbacks cb 0x55ec5d6b07d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:43:17.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdec8c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92cac0 0x55ec5d933fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdec3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d8e2bc0 0x55ec5d933530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdec8c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92cac0 0x55ec5d933fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51106/0 (socket says 172.21.15.103:51106) 2024-09-10T22:43:17.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdec8c00640 1 -- 172.21.15.103:0/1621276217 learned_addr learned my addr 172.21.15.103:0/1621276217 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:17.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdebb400640 1 --2- 172.21.15.103:0/1621276217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d92c1a0 0x55ec5d933a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdec8c00640 1 -- 172.21.15.103:0/1621276217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d92c1a0 msgr2=0x55ec5d933a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdec8c00640 1 --2- 172.21.15.103:0/1621276217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d92c1a0 0x55ec5d933a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdec8c00640 1 -- 172.21.15.103:0/1621276217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d8e2bc0 msgr2=0x55ec5d933530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdec8c00640 1 --2- 172.21.15.103:0/1621276217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d8e2bc0 0x55ec5d933530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdec8c00640 1 -- 172.21.15.103:0/1621276217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec5d6cb1f0 con 0x55ec5d92cac0 2024-09-10T22:43:17.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdec3e00640 1 --2- 172.21.15.103:0/1621276217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d8e2bc0 0x55ec5d933530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:43:17.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdebb400640 1 --2- 172.21.15.103:0/1621276217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d92c1a0 0x55ec5d933a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:43:17.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdec8c00640 1 --2- 172.21.15.103:0/1621276217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92cac0 0x55ec5d933fb0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009bd0 tx=0x7fdebc0092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fac3c482aa4a3ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:17.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdeb1600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:43:17.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdeb1600640 1 -- 172.21.15.103:0/1621276217 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0b2040 con 0x55ec5d92cac0 2024-09-10T22:43:17.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdece096000 1 -- 172.21.15.103:0/1621276217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ec5d6c5330 con 0x55ec5d92cac0 2024-09-10T22:43:17.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdeb1600640 1 -- 172.21.15.103:0/1621276217 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7fdebc0a5d00 con 0x55ec5d92cac0 2024-09-10T22:43:17.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdeb1600640 1 -- 172.21.15.103:0/1621276217 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7fdebc0c4050 con 0x55ec5d92cac0 2024-09-10T22:43:17.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdece096000 10 client.6663 fetch_fsmap learned FSMap version 64 2024-09-10T22:43:17.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdece096000 1 -- 172.21.15.103:0/1621276217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) -- 0x55ec5d6b1fa0 con 0x55ec5d92cac0 2024-09-10T22:43:17.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdeb1600640 1 -- 172.21.15.103:0/1621276217 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ec5d6c5330 con 0x55ec5d92cac0 2024-09-10T22:43:17.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.530+0000 7fdeb1600640 1 -- 172.21.15.103:0/1621276217 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 64) ==== 3558+0+0 (secure 0 0 0) 0x7fdebc0c7020 con 0x55ec5d92cac0 2024-09-10T22:43:17.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdece096000 10 client.6663 fetch_fsmap finished waiting for FSMap version 64 2024-09-10T22:43:17.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdece096000 10 client.6663 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-10T22:43:17.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdece096000 20 client.6663 populate_metadata read hostname 'smithi103' 2024-09-10T22:43:17.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdece096000 1 --2- 172.21.15.103:0/1621276217 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55ec5d93b900 0x55ec5d93dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdece096000 4 client.6663 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:43:17.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdece096000 1 -- 172.21.15.103:0/1621276217 --> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec5d73fae0 con 0x55ec5d93b900 2024-09-10T22:43:17.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdec3e00640 1 --2- 172.21.15.103:0/1621276217 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55ec5d93b900 0x55ec5d93dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdec3e00640 1 --2- 172.21.15.103:0/1621276217 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55ec5d93b900 0x55ec5d93dcf0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afd188708b65c38e server_cookie=94a5a128395ab33a in_seq=0 out_seq=0 2024-09-10T22:43:17.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdeb1600640 10 client.6663 ms_handle_connect on v2:172.21.15.103:6834/714242556 2024-09-10T22:43:17.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdeb1600640 1 -- 172.21.15.103:0/1621276217 <== mds.0 v2:172.21.15.103:6834/714242556 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ec5d73fae0 con 0x55ec5d93b900 2024-09-10T22:43:17.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdeb1600640 10 client.6663 handle_command_reply: tid=0 2024-09-10T22:43:17.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdece096000 1 client.6663 shutdown 2024-09-10T22:43:17.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdece096000 1 -- 172.21.15.103:0/1621276217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92cac0 msgr2=0x55ec5d933fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdece096000 1 --2- 172.21.15.103:0/1621276217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92cac0 0x55ec5d933fb0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009bd0 tx=0x7fdebc0092c0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdece096000 1 -- 172.21.15.103:0/1621276217 shutdown_connections 2024-09-10T22:43:17.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdece096000 1 --2- 172.21.15.103:0/1621276217 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55ec5d93b900 0x55ec5d93dcf0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdece096000 1 --2- 172.21.15.103:0/1621276217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92cac0 0x55ec5d933fb0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdece096000 1 --2- 172.21.15.103:0/1621276217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d92c1a0 0x55ec5d933a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdeb1600640 0 client.6663 ms_handle_reset on v2:172.21.15.103:6834/714242556 2024-09-10T22:43:17.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdece096000 1 --2- 172.21.15.103:0/1621276217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d8e2bc0 0x55ec5d933530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdece096000 1 -- 172.21.15.103:0/1621276217 >> 172.21.15.103:0/1621276217 conn(0x55ec5d8e8d20 msgr2=0x55ec5d8e0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:17.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdece096000 1 -- 172.21.15.103:0/1621276217 shutdown_connections 2024-09-10T22:43:17.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdece096000 1 -- 172.21.15.103:0/1621276217 wait complete. 2024-09-10T22:43:17.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.534+0000 7fdece096000 20 client.6663 trim_cache size 0 max 16384 2024-09-10T22:43:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.550+0000 7fdece096000 1 Processor -- start 2024-09-10T22:43:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.550+0000 7fdece096000 1 -- start start 2024-09-10T22:43:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdece096000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d8e2bc0 0x55ec5d936550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdece096000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d92c1a0 0x55ec5d936a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdece096000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d92cac0 0x55ec5d936fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdece096000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdec4204640 con 0x55ec5d8e2bc0 2024-09-10T22:43:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdece096000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdec42037e0 con 0x55ec5d92cac0 2024-09-10T22:43:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdece096000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdec4203f10 con 0x55ec5d92c1a0 2024-09-10T22:43:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdec3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d8e2bc0 0x55ec5d936550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdec3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d8e2bc0 0x55ec5d936550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51114/0 (socket says 172.21.15.103:51114) 2024-09-10T22:43:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdec3e00640 1 -- 172.21.15.103:0/1149769189 learned_addr learned my addr 172.21.15.103:0/1149769189 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdec3e00640 1 -- 172.21.15.103:0/1149769189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d92c1a0 msgr2=0x55ec5d936a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdec3e00640 1 --2- 172.21.15.103:0/1149769189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d92c1a0 0x55ec5d936a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdec3e00640 1 -- 172.21.15.103:0/1149769189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d92cac0 msgr2=0x55ec5d936fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdec3e00640 1 --2- 172.21.15.103:0/1149769189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d92cac0 0x55ec5d936fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdec3e00640 1 -- 172.21.15.103:0/1149769189 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec5d78a660 con 0x55ec5d8e2bc0 2024-09-10T22:43:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdec3e00640 1 --2- 172.21.15.103:0/1149769189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d8e2bc0 0x55ec5d936550 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fdeb405d3a0 tx=0x7fdeb4005060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a435e5c50c35b4d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdeb3e00640 1 -- 172.21.15.103:0/1149769189 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4061ef0 con 0x55ec5d8e2bc0 2024-09-10T22:43:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdeb3e00640 1 -- 172.21.15.103:0/1149769189 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdeb4066910 con 0x55ec5d8e2bc0 2024-09-10T22:43:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdeb3e00640 1 -- 172.21.15.103:0/1149769189 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb405c8d0 con 0x55ec5d8e2bc0 2024-09-10T22:43:17.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdece096000 1 -- 172.21.15.103:0/1149769189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d8e2bc0 msgr2=0x55ec5d936550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdece096000 1 --2- 172.21.15.103:0/1149769189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d8e2bc0 0x55ec5d936550 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fdeb405d3a0 tx=0x7fdeb4005060 comp rx=0 tx=0).stop 2024-09-10T22:43:17.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdece096000 1 -- 172.21.15.103:0/1149769189 shutdown_connections 2024-09-10T22:43:17.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdece096000 1 --2- 172.21.15.103:0/1149769189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d92cac0 0x55ec5d936fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdece096000 1 --2- 172.21.15.103:0/1149769189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d92c1a0 0x55ec5d936a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdece096000 1 --2- 172.21.15.103:0/1149769189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d8e2bc0 0x55ec5d936550 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdece096000 1 -- 172.21.15.103:0/1149769189 >> 172.21.15.103:0/1149769189 conn(0x55ec5d8e8d20 msgr2=0x55ec5d8e2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:17.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdece096000 1 -- 172.21.15.103:0/1149769189 shutdown_connections 2024-09-10T22:43:17.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdece096000 1 -- 172.21.15.103:0/1149769189 wait complete. 2024-09-10T22:43:17.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdece096000 1 -- start start 2024-09-10T22:43:17.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.554+0000 7fdece096000 1 Processor -- start 2024-09-10T22:43:17.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d8e2bc0 0x55ec5d939100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92c1a0 0x55ec5d939640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d92cac0 0x55ec5d95e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ec5d72cfc0 con 0x55ec5d92c1a0 2024-09-10T22:43:17.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ec5d730dd0 con 0x55ec5d92cac0 2024-09-10T22:43:17.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ec5d8ebd40 con 0x55ec5d8e2bc0 2024-09-10T22:43:17.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 10 client.0 _ll_register_callbacks cb 0x7fdebc0b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:43:17.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdebb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92c1a0 0x55ec5d939640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdebb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92c1a0 0x55ec5d939640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51116/0 (socket says 172.21.15.103:51116) 2024-09-10T22:43:17.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdebb400640 1 -- 172.21.15.103:0/2561107285 learned_addr learned my addr 172.21.15.103:0/2561107285 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:17.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdec3e00640 1 --2- 172.21.15.103:0/2561107285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d8e2bc0 0x55ec5d939100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdec8c00640 1 --2- 172.21.15.103:0/2561107285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d92cac0 0x55ec5d95e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdebb400640 1 -- 172.21.15.103:0/2561107285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d8e2bc0 msgr2=0x55ec5d939100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdebb400640 1 --2- 172.21.15.103:0/2561107285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d8e2bc0 0x55ec5d939100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdebb400640 1 -- 172.21.15.103:0/2561107285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d92cac0 msgr2=0x55ec5d95e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdebb400640 1 --2- 172.21.15.103:0/2561107285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d92cac0 0x55ec5d95e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdebb400640 1 -- 172.21.15.103:0/2561107285 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec5d6f7090 con 0x55ec5d92c1a0 2024-09-10T22:43:17.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdebb400640 1 --2- 172.21.15.103:0/2561107285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92c1a0 0x55ec5d939640 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x55ec5d7385e0 tx=0x7fdeac014f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa94e5f2a0b962d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:17.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdeb1600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:43:17.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdeb1600640 1 -- 172.21.15.103:0/2561107285 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac024040 con 0x55ec5d92c1a0 2024-09-10T22:43:17.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdeb1600640 1 -- 172.21.15.103:0/2561107285 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7fdeac02a650 con 0x55ec5d92c1a0 2024-09-10T22:43:17.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 -- 172.21.15.103:0/2561107285 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdeb4066910 con 0x55ec5d92c1a0 2024-09-10T22:43:17.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdeb1600640 1 -- 172.21.15.103:0/2561107285 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7fdeac0059d0 con 0x55ec5d92c1a0 2024-09-10T22:43:17.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 10 client.6669 fetch_fsmap learned FSMap version 64 2024-09-10T22:43:17.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 -- 172.21.15.103:0/2561107285 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) -- 0x55ec5d6c35f0 con 0x55ec5d92c1a0 2024-09-10T22:43:17.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdeb1600640 1 -- 172.21.15.103:0/2561107285 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdeb4066910 con 0x55ec5d92c1a0 2024-09-10T22:43:17.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdeb1600640 1 -- 172.21.15.103:0/2561107285 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 64) ==== 3558+0+0 (secure 0 0 0) 0x7fdeac013070 con 0x55ec5d92c1a0 2024-09-10T22:43:17.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 10 client.6669 fetch_fsmap finished waiting for FSMap version 64 2024-09-10T22:43:17.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 10 client.6669 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-10T22:43:17.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 20 client.6669 populate_metadata read hostname 'smithi103' 2024-09-10T22:43:17.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 --2- 172.21.15.103:0/2561107285 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55ec5d9a2090 0x55ec5d9a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 4 client.6669 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:43:17.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 -- 172.21.15.103:0/2561107285 --> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ec5d73b590 con 0x55ec5d9a2090 2024-09-10T22:43:17.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdec3e00640 1 --2- 172.21.15.103:0/2561107285 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55ec5d9a2090 0x55ec5d9a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdec3e00640 1 --2- 172.21.15.103:0/2561107285 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55ec5d9a2090 0x55ec5d9a24a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ff0336da5c08a36 server_cookie=2f74b4b37034ca5d in_seq=0 out_seq=0 2024-09-10T22:43:17.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdeb1600640 10 client.6669 ms_handle_connect on v2:172.21.15.103:6834/714242556 2024-09-10T22:43:17.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdeb1600640 1 -- 172.21.15.103:0/2561107285 <== mds.0 v2:172.21.15.103:6834/714242556 1 ==== command_reply(tid 0: 0 ) ==== 8+0+382 (crc 0 0 0) 0x55ec5d73b590 con 0x55ec5d9a2090 2024-09-10T22:43:17.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdeb1600640 10 client.6669 handle_command_reply: tid=0 2024-09-10T22:43:17.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 client.6669 shutdown 2024-09-10T22:43:17.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 -- 172.21.15.103:0/2561107285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92c1a0 msgr2=0x55ec5d939640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 --2- 172.21.15.103:0/2561107285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92c1a0 0x55ec5d939640 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x55ec5d7385e0 tx=0x7fdeac014f60 comp rx=0 tx=0).stop 2024-09-10T22:43:17.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 -- 172.21.15.103:0/2561107285 shutdown_connections 2024-09-10T22:43:17.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 --2- 172.21.15.103:0/2561107285 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x55ec5d9a2090 0x55ec5d9a24a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 --2- 172.21.15.103:0/2561107285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec5d92cac0 0x55ec5d95e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 --2- 172.21.15.103:0/2561107285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ec5d92c1a0 0x55ec5d939640 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 --2- 172.21.15.103:0/2561107285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ec5d8e2bc0 0x55ec5d939100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdeb1600640 0 client.6669 ms_handle_reset on v2:172.21.15.103:6834/714242556 2024-09-10T22:43:17.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 -- 172.21.15.103:0/2561107285 >> 172.21.15.103:0/2561107285 conn(0x55ec5d8e8d20 msgr2=0x55ec5d8e2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:17.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 -- 172.21.15.103:0/2561107285 shutdown_connections 2024-09-10T22:43:17.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 1 -- 172.21.15.103:0/2561107285 wait complete. 2024-09-10T22:43:17.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.558+0000 7fdece096000 20 client.6669 trim_cache size 0 max 16384 2024-09-10T22:43:17.569 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:43:17.569 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "no active scrubs running", 2024-09-10T22:43:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": {}, 2024-09-10T22:43:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_stats": { 2024-09-10T22:43:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "8aa8487b-9642-44c9-9a20-cec64ead3c08": { 2024-09-10T22:43:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "start_time": "2024-09-10T22:42:47.135451+0000", 2024-09-10T22:43:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:43:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_started": 0, 2024-09-10T22:43:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_passed": 0, 2024-09-10T22:43:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_failed": 0, 2024-09-10T22:43:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_skipped": 0 2024-09-10T22:43:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:17.570 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:43:17.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.562+0000 7fdecac00640 1 -- 172.21.15.103:0/1500724332 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdea0072610 msgr2=0x7fdea0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.562+0000 7fdecac00640 1 --2- 172.21.15.103:0/1500724332 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdea0072610 0x7fdea0074ad0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdeac006fd0 tx=0x7fdeac008040 comp rx=0 tx=0).stop 2024-09-10T22:43:17.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.562+0000 7fdecac00640 1 -- 172.21.15.103:0/1500724332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec40cf9f0 msgr2=0x7fdec4157c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.562+0000 7fdecac00640 1 --2- 172.21.15.103:0/1500724332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec40cf9f0 0x7fdec4157c70 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400c490 tx=0x7fdeb4001e80 comp rx=0 tx=0).stop 2024-09-10T22:43:17.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.562+0000 7fdecac00640 1 -- 172.21.15.103:0/1500724332 shutdown_connections 2024-09-10T22:43:17.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.562+0000 7fdecac00640 1 --2- 172.21.15.103:0/1500724332 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdea0072610 0x7fdea0074ad0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.562+0000 7fdecac00640 1 --2- 172.21.15.103:0/1500724332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdec415f2e0 0x7fdec40ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.562+0000 7fdecac00640 1 --2- 172.21.15.103:0/1500724332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdec40cfdd0 0x7fdec414a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.562+0000 7fdecac00640 1 --2- 172.21.15.103:0/1500724332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec40cf9f0 0x7fdec4157c70 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.562+0000 7fdecac00640 1 -- 172.21.15.103:0/1500724332 >> 172.21.15.103:0/1500724332 conn(0x7fdec406cc00 msgr2=0x7fdec4072500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:17.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.562+0000 7fdecac00640 1 -- 172.21.15.103:0/1500724332 shutdown_connections 2024-09-10T22:43:17.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.562+0000 7fdecac00640 1 -- 172.21.15.103:0/1500724332 wait complete. 2024-09-10T22:43:17.583 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:43:17.584 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 damage ls 2024-09-10T22:43:17.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f4400640 1 -- 172.21.15.103:0/1358763460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ec0cc130 msgr2=0x7f23ec0adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f4400640 1 --2- 172.21.15.103:0/1358763460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ec0cc130 0x7f23ec0adba0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f23e0009900 tx=0x7f23e001c8e0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f4400640 1 -- 172.21.15.103:0/1358763460 shutdown_connections 2024-09-10T22:43:17.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f4400640 1 --2- 172.21.15.103:0/1358763460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23ec0ad5f0 0x7f23ec0b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f4400640 1 --2- 172.21.15.103:0/1358763460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ec0cc130 0x7f23ec0adba0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f4400640 1 -- 172.21.15.103:0/1358763460 >> 172.21.15.103:0/1358763460 conn(0x7f23ec0b1c00 msgr2=0x7f23ec0b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:17.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f4400640 1 -- 172.21.15.103:0/1358763460 shutdown_connections 2024-09-10T22:43:17.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f4400640 1 -- 172.21.15.103:0/1358763460 wait complete. 2024-09-10T22:43:17.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f4400640 1 Processor -- start 2024-09-10T22:43:17.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f4400640 1 -- start start 2024-09-10T22:43:17.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f4400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ec06de20 0x7f23ec0c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f4400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23ec0ad5f0 0x7f23ec09b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f4400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23ec0cc130 0x7f23ec154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f4400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec1678b0 con 0x7f23ec06de20 2024-09-10T22:43:17.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f4400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec167730 con 0x7f23ec0cc130 2024-09-10T22:43:17.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f4400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f23ec167a30 con 0x7f23ec0ad5f0 2024-09-10T22:43:17.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f1a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ec06de20 0x7f23ec0c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f1a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ec06de20 0x7f23ec0c7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51130/0 (socket says 172.21.15.103:51130) 2024-09-10T22:43:17.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f1a00640 1 -- 172.21.15.103:0/434031211 learned_addr learned my addr 172.21.15.103:0/434031211 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:17.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f2400640 1 --2- 172.21.15.103:0/434031211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23ec0cc130 0x7f23ec154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f1000640 1 --2- 172.21.15.103:0/434031211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23ec0ad5f0 0x7f23ec09b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f1a00640 1 -- 172.21.15.103:0/434031211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23ec0ad5f0 msgr2=0x7f23ec09b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f1a00640 1 --2- 172.21.15.103:0/434031211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23ec0ad5f0 0x7f23ec09b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f1a00640 1 -- 172.21.15.103:0/434031211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23ec0cc130 msgr2=0x7f23ec154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f1a00640 1 --2- 172.21.15.103:0/434031211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23ec0cc130 0x7f23ec154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.726+0000 7f23f1a00640 1 -- 172.21.15.103:0/434031211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ec09ba30 con 0x7f23ec06de20 2024-09-10T22:43:17.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.730+0000 7f23f1a00640 1 --2- 172.21.15.103:0/434031211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ec06de20 0x7f23ec0c7560 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f23e00b0040 tx=0x7f23e00a5620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:17.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.730+0000 7f23e9600640 1 -- 172.21.15.103:0/434031211 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e00b2040 con 0x7f23ec06de20 2024-09-10T22:43:17.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.730+0000 7f23e9600640 1 -- 172.21.15.103:0/434031211 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23e00043b0 con 0x7f23ec06de20 2024-09-10T22:43:17.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.730+0000 7f23e9600640 1 -- 172.21.15.103:0/434031211 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e0005280 con 0x7f23ec06de20 2024-09-10T22:43:17.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.730+0000 7f23f4400640 1 -- 172.21.15.103:0/434031211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23ec0c7b80 con 0x7f23ec06de20 2024-09-10T22:43:17.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.730+0000 7f23f4400640 1 -- 172.21.15.103:0/434031211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23ec0c8140 con 0x7f23ec06de20 2024-09-10T22:43:17.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.730+0000 7f23e9600640 1 -- 172.21.15.103:0/434031211 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f23e00046d0 con 0x7f23ec06de20 2024-09-10T22:43:17.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.730+0000 7f23f77f5000 1 Processor -- start 2024-09-10T22:43:17.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.730+0000 7f23e9600640 1 --2- 172.21.15.103:0/434031211 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f23cc0725e0 0x7f23cc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.730+0000 7f23f77f5000 1 -- start start 2024-09-10T22:43:17.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.730+0000 7f23e9600640 1 -- 172.21.15.103:0/434031211 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f23e012cf70 con 0x7f23ec06de20 2024-09-10T22:43:17.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f2400640 1 --2- 172.21.15.103:0/434031211 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f23cc0725e0 0x7f23cc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f77f5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4bf30 0x5624f2b4c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f77f5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2b4c850 0x5624f2aff3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f77f5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2aff920 0x5624f2affd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f77f5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5624f29e9d30 con 0x5624f2b4bf30 2024-09-10T22:43:17.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f77f5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5624f295daf0 con 0x5624f2aff920 2024-09-10T22:43:17.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f77f5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5624f294cf20 con 0x5624f2b4c850 2024-09-10T22:43:17.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f2400640 1 --2- 172.21.15.103:0/434031211 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f23cc0725e0 0x7f23cc074aa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f23e40092f0 tx=0x7f23e4009650 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:17.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f1a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4bf30 0x5624f2b4c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f1a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4bf30 0x5624f2b4c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51146/0 (socket says 172.21.15.103:51146) 2024-09-10T22:43:17.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f1a00640 1 -- 172.21.15.103:0/2777674769 learned_addr learned my addr 172.21.15.103:0/2777674769 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:17.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f2400640 1 --2- 172.21.15.103:0/2777674769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2aff920 0x5624f2affd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f1000640 1 --2- 172.21.15.103:0/2777674769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2b4c850 0x5624f2aff3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f1a00640 1 -- 172.21.15.103:0/2777674769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2b4c850 msgr2=0x5624f2aff3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f1a00640 1 --2- 172.21.15.103:0/2777674769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2b4c850 0x5624f2aff3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f1a00640 1 -- 172.21.15.103:0/2777674769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2aff920 msgr2=0x5624f2affd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f1a00640 1 --2- 172.21.15.103:0/2777674769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2aff920 0x5624f2affd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f1a00640 1 -- 172.21.15.103:0/2777674769 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624f28ce100 con 0x5624f2b4bf30 2024-09-10T22:43:17.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f1a00640 1 --2- 172.21.15.103:0/2777674769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4bf30 0x5624f2b4c310 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f23e001ce50 tx=0x7f23e00f7b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e615255f5441f43 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:17.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23de000640 1 -- 172.21.15.103:0/2777674769 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e00f7860 con 0x5624f2b4bf30 2024-09-10T22:43:17.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23de000640 1 -- 172.21.15.103:0/2777674769 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23e00fc780 con 0x5624f2b4bf30 2024-09-10T22:43:17.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23de000640 1 -- 172.21.15.103:0/2777674769 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e01011a0 con 0x5624f2b4bf30 2024-09-10T22:43:17.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f77f5000 1 -- 172.21.15.103:0/2777674769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4bf30 msgr2=0x5624f2b4c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f77f5000 1 --2- 172.21.15.103:0/2777674769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4bf30 0x5624f2b4c310 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f23e001ce50 tx=0x7f23e00f7b20 comp rx=0 tx=0).stop 2024-09-10T22:43:17.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f77f5000 1 -- 172.21.15.103:0/2777674769 shutdown_connections 2024-09-10T22:43:17.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f77f5000 1 --2- 172.21.15.103:0/2777674769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2aff920 0x5624f2affd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f77f5000 1 --2- 172.21.15.103:0/2777674769 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2b4c850 0x5624f2aff3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f77f5000 1 --2- 172.21.15.103:0/2777674769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4bf30 0x5624f2b4c310 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f77f5000 1 -- 172.21.15.103:0/2777674769 >> 172.21.15.103:0/2777674769 conn(0x5624f2b2cff0 msgr2=0x5624f2b2f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:17.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f77f5000 1 -- 172.21.15.103:0/2777674769 shutdown_connections 2024-09-10T22:43:17.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f77f5000 1 -- 172.21.15.103:0/2777674769 wait complete. 2024-09-10T22:43:17.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f77f5000 1 -- start start 2024-09-10T22:43:17.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.734+0000 7f23f77f5000 1 Processor -- start 2024-09-10T22:43:17.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2aff920 0x5624f2b57510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2b4bf30 0x5624f2b57a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 0x5624f2b57f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5624f28f24e0 con 0x5624f2b4c850 2024-09-10T22:43:17.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5624f2950d30 con 0x5624f2b4bf30 2024-09-10T22:43:17.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5624f2612680 con 0x5624f2aff920 2024-09-10T22:43:17.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 10 client.0 _ll_register_callbacks cb 0x5624f2aed0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:43:17.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f2400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 0x5624f2b57f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f2400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 0x5624f2b57f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51162/0 (socket says 172.21.15.103:51162) 2024-09-10T22:43:17.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f2400640 1 -- 172.21.15.103:0/487921761 learned_addr learned my addr 172.21.15.103:0/487921761 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:17.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f1a00640 1 --2- 172.21.15.103:0/487921761 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2aff920 0x5624f2b57510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f1000640 1 --2- 172.21.15.103:0/487921761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2b4bf30 0x5624f2b57a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f2400640 1 -- 172.21.15.103:0/487921761 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2aff920 msgr2=0x5624f2b57510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f2400640 1 --2- 172.21.15.103:0/487921761 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2aff920 0x5624f2b57510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f2400640 1 -- 172.21.15.103:0/487921761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2b4bf30 msgr2=0x5624f2b57a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f2400640 1 --2- 172.21.15.103:0/487921761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2b4bf30 0x5624f2b57a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f2400640 1 -- 172.21.15.103:0/487921761 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624f2901c40 con 0x5624f2b4c850 2024-09-10T22:43:17.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f1a00640 1 --2- 172.21.15.103:0/487921761 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2aff920 0x5624f2b57510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:43:17.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f2400640 1 --2- 172.21.15.103:0/487921761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 0x5624f2b57f90 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f23e4011950 tx=0x7f23e4004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b201f42e748724b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:17.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23d2a00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:43:17.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23d2a00640 1 -- 172.21.15.103:0/487921761 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e401dd40 con 0x5624f2b4c850 2024-09-10T22:43:17.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23d2a00640 1 -- 172.21.15.103:0/487921761 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f23e401e420 con 0x5624f2b4c850 2024-09-10T22:43:17.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 -- 172.21.15.103:0/487921761 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5624f28e5310 con 0x5624f2b4c850 2024-09-10T22:43:17.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23d2a00640 1 -- 172.21.15.103:0/487921761 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f23e4030050 con 0x5624f2b4c850 2024-09-10T22:43:17.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 10 client.6681 fetch_fsmap learned FSMap version 64 2024-09-10T22:43:17.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 -- 172.21.15.103:0/487921761 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) -- 0x5624f294bbc0 con 0x5624f2b4c850 2024-09-10T22:43:17.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23d2a00640 1 -- 172.21.15.103:0/487921761 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5624f28e5310 con 0x5624f2b4c850 2024-09-10T22:43:17.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23d2a00640 1 -- 172.21.15.103:0/487921761 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 64) ==== 3558+0+0 (secure 0 0 0) 0x7f23e4033020 con 0x5624f2b4c850 2024-09-10T22:43:17.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 10 client.6681 fetch_fsmap finished waiting for FSMap version 64 2024-09-10T22:43:17.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 10 client.6681 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-10T22:43:17.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 20 client.6681 populate_metadata read hostname 'smithi103' 2024-09-10T22:43:17.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 --2- 172.21.15.103:0/487921761 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x5624f2b5f8e0 0x5624f2b61cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 4 client.6681 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:43:17.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 -- 172.21.15.103:0/487921761 --> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624f295fa40 con 0x5624f2b5f8e0 2024-09-10T22:43:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f1a00640 1 --2- 172.21.15.103:0/487921761 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x5624f2b5f8e0 0x5624f2b61cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f1a00640 1 --2- 172.21.15.103:0/487921761 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x5624f2b5f8e0 0x5624f2b61cd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a84099edb18da77 server_cookie=2845b9de524500c7 in_seq=0 out_seq=0 2024-09-10T22:43:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23d2a00640 10 client.6681 ms_handle_connect on v2:172.21.15.103:6834/714242556 2024-09-10T22:43:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23d2a00640 1 -- 172.21.15.103:0/487921761 <== mds.0 v2:172.21.15.103:6834/714242556 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5624f295fa40 con 0x5624f2b5f8e0 2024-09-10T22:43:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23d2a00640 10 client.6681 handle_command_reply: tid=0 2024-09-10T22:43:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 client.6681 shutdown 2024-09-10T22:43:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 -- 172.21.15.103:0/487921761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 msgr2=0x5624f2b57f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 --2- 172.21.15.103:0/487921761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 0x5624f2b57f90 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f23e4011950 tx=0x7f23e4004ac0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 -- 172.21.15.103:0/487921761 shutdown_connections 2024-09-10T22:43:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 --2- 172.21.15.103:0/487921761 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x5624f2b5f8e0 0x5624f2b61cd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 --2- 172.21.15.103:0/487921761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 0x5624f2b57f90 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 --2- 172.21.15.103:0/487921761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2b4bf30 0x5624f2b57a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 --2- 172.21.15.103:0/487921761 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2aff920 0x5624f2b57510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 -- 172.21.15.103:0/487921761 >> 172.21.15.103:0/487921761 conn(0x5624f2b2cff0 msgr2=0x5624f2b07350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:17.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23d2a00640 0 client.6681 ms_handle_reset on v2:172.21.15.103:6834/714242556 2024-09-10T22:43:17.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.738+0000 7f23f77f5000 1 -- 172.21.15.103:0/487921761 shutdown_connections 2024-09-10T22:43:17.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.742+0000 7f23f77f5000 1 -- 172.21.15.103:0/487921761 wait complete. 2024-09-10T22:43:17.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.742+0000 7f23f77f5000 20 client.6681 trim_cache size 0 max 16384 2024-09-10T22:43:17.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f77f5000 1 Processor -- start 2024-09-10T22:43:17.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f77f5000 1 -- start start 2024-09-10T22:43:17.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f77f5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2aff920 0x5624f2b5db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f77f5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2b4bf30 0x5624f2b306d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f77f5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 0x5624f2b30c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f77f5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec2002f0 con 0x5624f2b4c850 2024-09-10T22:43:17.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f77f5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec0747b0 con 0x5624f2aff920 2024-09-10T22:43:17.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f77f5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f23ec09d0b0 con 0x5624f2b4bf30 2024-09-10T22:43:17.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f2400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 0x5624f2b30c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f2400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 0x5624f2b30c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51164/0 (socket says 172.21.15.103:51164) 2024-09-10T22:43:17.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f2400640 1 -- 172.21.15.103:0/2393831063 learned_addr learned my addr 172.21.15.103:0/2393831063 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:17.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f1a00640 1 --2- 172.21.15.103:0/2393831063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2aff920 0x5624f2b5db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f1000640 1 --2- 172.21.15.103:0/2393831063 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2b4bf30 0x5624f2b306d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f2400640 1 -- 172.21.15.103:0/2393831063 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2b4bf30 msgr2=0x5624f2b306d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f2400640 1 --2- 172.21.15.103:0/2393831063 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2b4bf30 0x5624f2b306d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f2400640 1 -- 172.21.15.103:0/2393831063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2aff920 msgr2=0x5624f2b5db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f2400640 1 --2- 172.21.15.103:0/2393831063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2aff920 0x5624f2b5db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f2400640 1 -- 172.21.15.103:0/2393831063 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624f28eb1d0 con 0x5624f2b4c850 2024-09-10T22:43:17.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f1a00640 1 --2- 172.21.15.103:0/2393831063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2aff920 0x5624f2b5db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:43:17.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.754+0000 7f23f2400640 1 --2- 172.21.15.103:0/2393831063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 0x5624f2b30c10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f23e401d780 tx=0x7f23e4004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a2be350061c6b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:17.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23dd600640 1 -- 172.21.15.103:0/2393831063 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e401dd40 con 0x5624f2b4c850 2024-09-10T22:43:17.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23dd600640 1 -- 172.21.15.103:0/2393831063 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23e401e6c0 con 0x5624f2b4c850 2024-09-10T22:43:17.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23dd600640 1 -- 172.21.15.103:0/2393831063 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e401ea90 con 0x5624f2b4c850 2024-09-10T22:43:17.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f77f5000 1 -- 172.21.15.103:0/2393831063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 msgr2=0x5624f2b30c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f77f5000 1 --2- 172.21.15.103:0/2393831063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 0x5624f2b30c10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f23e401d780 tx=0x7f23e4004a50 comp rx=0 tx=0).stop 2024-09-10T22:43:17.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f77f5000 1 -- 172.21.15.103:0/2393831063 shutdown_connections 2024-09-10T22:43:17.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f77f5000 1 --2- 172.21.15.103:0/2393831063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 0x5624f2b30c10 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f77f5000 1 --2- 172.21.15.103:0/2393831063 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2b4bf30 0x5624f2b306d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f77f5000 1 --2- 172.21.15.103:0/2393831063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2aff920 0x5624f2b5db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f77f5000 1 -- 172.21.15.103:0/2393831063 >> 172.21.15.103:0/2393831063 conn(0x5624f2b2cff0 msgr2=0x5624f2b06940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:17.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f77f5000 1 -- 172.21.15.103:0/2393831063 shutdown_connections 2024-09-10T22:43:17.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f77f5000 1 -- 172.21.15.103:0/2393831063 wait complete. 2024-09-10T22:43:17.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f77f5000 1 -- start start 2024-09-10T22:43:17.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f77f5000 1 Processor -- start 2024-09-10T22:43:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f77f5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2aff920 0x5624f2bc6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f77f5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2b4bf30 0x5624f2bc6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f77f5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 0x5624f2bc74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f77f5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5624f2950d30 con 0x5624f2b4c850 2024-09-10T22:43:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f77f5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5624f2918890 con 0x5624f2aff920 2024-09-10T22:43:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f77f5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5624f2b0ad70 con 0x5624f2b4bf30 2024-09-10T22:43:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f77f5000 10 client.0 _ll_register_callbacks cb 0x7f23e4009bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:43:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f2400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 0x5624f2bc74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f2400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 0x5624f2bc74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51168/0 (socket says 172.21.15.103:51168) 2024-09-10T22:43:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f2400640 1 -- 172.21.15.103:0/1433756087 learned_addr learned my addr 172.21.15.103:0/1433756087 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f1000640 1 --2- 172.21.15.103:0/1433756087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2b4bf30 0x5624f2bc6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f1a00640 1 --2- 172.21.15.103:0/1433756087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2aff920 0x5624f2bc6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f2400640 1 -- 172.21.15.103:0/1433756087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2b4bf30 msgr2=0x5624f2bc6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f2400640 1 --2- 172.21.15.103:0/1433756087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2b4bf30 0x5624f2bc6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f2400640 1 -- 172.21.15.103:0/1433756087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2aff920 msgr2=0x5624f2bc6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f2400640 1 --2- 172.21.15.103:0/1433756087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2aff920 0x5624f2bc6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f2400640 1 -- 172.21.15.103:0/1433756087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624f2913970 con 0x5624f2b4c850 2024-09-10T22:43:17.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23f2400640 1 --2- 172.21.15.103:0/1433756087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 0x5624f2bc74c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f23e4000f70 tx=0x7f23e401dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cdb27977ca8236 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:17.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23d2a00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:43:17.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23d2a00640 1 -- 172.21.15.103:0/1433756087 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e401ec80 con 0x5624f2b4c850 2024-09-10T22:43:17.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.758+0000 7f23d2a00640 1 -- 172.21.15.103:0/1433756087 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f23e403e410 con 0x5624f2b4c850 2024-09-10T22:43:17.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 1 -- 172.21.15.103:0/1433756087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23e401e6c0 con 0x5624f2b4c850 2024-09-10T22:43:17.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23d2a00640 1 -- 172.21.15.103:0/1433756087 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f23e404e050 con 0x5624f2b4c850 2024-09-10T22:43:17.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 10 client.6687 fetch_fsmap learned FSMap version 64 2024-09-10T22:43:17.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 1 -- 172.21.15.103:0/1433756087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) -- 0x5624f28e3560 con 0x5624f2b4c850 2024-09-10T22:43:17.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23d2a00640 1 -- 172.21.15.103:0/1433756087 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23e401e6c0 con 0x5624f2b4c850 2024-09-10T22:43:17.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23d2a00640 1 -- 172.21.15.103:0/1433756087 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 64) ==== 3558+0+0 (secure 0 0 0) 0x7f23e4051020 con 0x5624f2b4c850 2024-09-10T22:43:17.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 10 client.6687 fetch_fsmap finished waiting for FSMap version 64 2024-09-10T22:43:17.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 10 client.6687 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-10T22:43:17.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 20 client.6687 populate_metadata read hostname 'smithi103' 2024-09-10T22:43:17.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 1 --2- 172.21.15.103:0/1433756087 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x5624f2b5bf70 0x5624f2b5c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 4 client.6687 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:43:17.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 1 -- 172.21.15.103:0/1433756087 --> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5624f2b67ff0 con 0x5624f2b5bf70 2024-09-10T22:43:17.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f1a00640 1 --2- 172.21.15.103:0/1433756087 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x5624f2b5bf70 0x5624f2b5c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f1a00640 1 --2- 172.21.15.103:0/1433756087 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x5624f2b5bf70 0x5624f2b5c380 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e276a3802bf97d6e server_cookie=18d3777f63472479 in_seq=0 out_seq=0 2024-09-10T22:43:17.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23d2a00640 10 client.6687 ms_handle_connect on v2:172.21.15.103:6834/714242556 2024-09-10T22:43:17.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23d2a00640 1 -- 172.21.15.103:0/1433756087 <== mds.0 v2:172.21.15.103:6834/714242556 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x5624f2b67ff0 con 0x5624f2b5bf70 2024-09-10T22:43:17.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23d2a00640 10 client.6687 handle_command_reply: tid=0 2024-09-10T22:43:17.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 1 client.6687 shutdown 2024-09-10T22:43:17.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 1 -- 172.21.15.103:0/1433756087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 msgr2=0x5624f2bc74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 1 --2- 172.21.15.103:0/1433756087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 0x5624f2bc74c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f23e4000f70 tx=0x7f23e401dd70 comp rx=0 tx=0).stop 2024-09-10T22:43:17.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 1 -- 172.21.15.103:0/1433756087 shutdown_connections 2024-09-10T22:43:17.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 1 --2- 172.21.15.103:0/1433756087 >> [v2:172.21.15.103:6834/714242556,v1:172.21.15.103:6835/714242556] conn(0x5624f2b5bf70 0x5624f2b5c380 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 1 --2- 172.21.15.103:0/1433756087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624f2b4c850 0x5624f2bc74c0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 1 --2- 172.21.15.103:0/1433756087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5624f2b4bf30 0x5624f2bc6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 1 --2- 172.21.15.103:0/1433756087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624f2aff920 0x5624f2bc6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23d2a00640 0 client.6687 ms_handle_reset on v2:172.21.15.103:6834/714242556 2024-09-10T22:43:17.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 1 -- 172.21.15.103:0/1433756087 >> 172.21.15.103:0/1433756087 conn(0x5624f2b2cff0 msgr2=0x5624f2b06940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:17.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 1 -- 172.21.15.103:0/1433756087 shutdown_connections 2024-09-10T22:43:17.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 1 -- 172.21.15.103:0/1433756087 wait complete. 2024-09-10T22:43:17.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f77f5000 20 client.6687 trim_cache size 0 max 16384 2024-09-10T22:43:17.771 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-09-10T22:43:17.771 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:17.771 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-10T22:43:17.771 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 58758693, 2024-09-10T22:43:17.771 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511627779, 2024-09-10T22:43:17.771 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3/d4" 2024-09-10T22:43:17.771 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:17.771 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:17.771 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-10T22:43:17.771 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 776332481, 2024-09-10T22:43:17.772 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511627778, 2024-09-10T22:43:17.772 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3" 2024-09-10T22:43:17.772 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:17.772 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-09-10T22:43:17.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f4400640 1 -- 172.21.15.103:0/434031211 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f23cc0725e0 msgr2=0x7f23cc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f4400640 1 --2- 172.21.15.103:0/434031211 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f23cc0725e0 0x7f23cc074aa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f23e40092f0 tx=0x7f23e4009650 comp rx=0 tx=0).stop 2024-09-10T22:43:17.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f4400640 1 -- 172.21.15.103:0/434031211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ec06de20 msgr2=0x7f23ec0c7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f4400640 1 --2- 172.21.15.103:0/434031211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ec06de20 0x7f23ec0c7560 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f23e00b0040 tx=0x7f23e00a5620 comp rx=0 tx=0).stop 2024-09-10T22:43:17.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f4400640 1 -- 172.21.15.103:0/434031211 shutdown_connections 2024-09-10T22:43:17.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f4400640 1 --2- 172.21.15.103:0/434031211 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f23cc0725e0 0x7f23cc074aa0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f4400640 1 --2- 172.21.15.103:0/434031211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23ec0cc130 0x7f23ec154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f4400640 1 --2- 172.21.15.103:0/434031211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23ec0ad5f0 0x7f23ec09b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f4400640 1 --2- 172.21.15.103:0/434031211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23ec06de20 0x7f23ec0c7560 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f4400640 1 -- 172.21.15.103:0/434031211 >> 172.21.15.103:0/434031211 conn(0x7f23ec0b1c00 msgr2=0x7f23ec0b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:17.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f4400640 1 -- 172.21.15.103:0/434031211 shutdown_connections 2024-09-10T22:43:17.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.762+0000 7f23f4400640 1 -- 172.21.15.103:0/434031211 wait complete. 2024-09-10T22:43:17.785 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:1 damage ls 2024-09-10T22:43:17.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f056c400640 1 -- 172.21.15.103:0/2334666685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0564072500 msgr2=0x7f05640729b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f056c400640 1 --2- 172.21.15.103:0/2334666685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0564072500 0x7f05640729b0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f05640d0340 tx=0x7f055c01cd80 comp rx=0 tx=0).stop 2024-09-10T22:43:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f056c400640 1 -- 172.21.15.103:0/2334666685 shutdown_connections 2024-09-10T22:43:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f056c400640 1 --2- 172.21.15.103:0/2334666685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0564072500 0x7f05640729b0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f056c400640 1 --2- 172.21.15.103:0/2334666685 >> v2:172.21.15.131:3300/0 conn(0x7f05640b2c10 0x7f05640b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f056c400640 1 --2- 172.21.15.103:0/2334666685 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05640cf260 0x7f05640cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f056c400640 1 -- 172.21.15.103:0/2334666685 >> 172.21.15.103:0/2334666685 conn(0x7f056406cc00 msgr2=0x7f056406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f056c400640 1 -- 172.21.15.103:0/2334666685 shutdown_connections 2024-09-10T22:43:17.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f056c400640 1 -- 172.21.15.103:0/2334666685 wait complete. 2024-09-10T22:43:17.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f056c400640 1 Processor -- start 2024-09-10T22:43:17.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f056c400640 1 -- start start 2024-09-10T22:43:17.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f056c400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0564072500 0x7f05641492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f056c400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05640b2c10 0x7f056413a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f056c400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05640cf260 0x7f056414c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f056c400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0564157c30 con 0x7f0564072500 2024-09-10T22:43:17.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f056c400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0564157ab0 con 0x7f05640cf260 2024-09-10T22:43:17.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f056c400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0564157db0 con 0x7f05640b2c10 2024-09-10T22:43:17.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f0569a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0564072500 0x7f05641492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f0569a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0564072500 0x7f05641492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51192/0 (socket says 172.21.15.103:51192) 2024-09-10T22:43:17.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f0569a00640 1 -- 172.21.15.103:0/962497656 learned_addr learned my addr 172.21.15.103:0/962497656 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:17.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f056a400640 1 --2- 172.21.15.103:0/962497656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05640cf260 0x7f056414c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.926+0000 7f0569000640 1 --2- 172.21.15.103:0/962497656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05640b2c10 0x7f056413a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.930+0000 7f0569a00640 1 -- 172.21.15.103:0/962497656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05640b2c10 msgr2=0x7f056413a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.930+0000 7f0569a00640 1 --2- 172.21.15.103:0/962497656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05640b2c10 0x7f056413a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.930+0000 7f0569a00640 1 -- 172.21.15.103:0/962497656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05640cf260 msgr2=0x7f056414c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.930+0000 7f0569a00640 1 --2- 172.21.15.103:0/962497656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05640cf260 0x7f056414c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.930+0000 7f0569a00640 1 -- 172.21.15.103:0/962497656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05641f9580 con 0x7f0564072500 2024-09-10T22:43:17.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.930+0000 7f056a400640 1 --2- 172.21.15.103:0/962497656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05640cf260 0x7f056414c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:17.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.930+0000 7f0569000640 1 --2- 172.21.15.103:0/962497656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05640b2c10 0x7f056413a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:17.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.930+0000 7f0569a00640 1 --2- 172.21.15.103:0/962497656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0564072500 0x7f05641492f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f055800b410 tx=0x7f055800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:17.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.930+0000 7f0561600640 1 -- 172.21.15.103:0/962497656 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558015020 con 0x7f0564072500 2024-09-10T22:43:17.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.930+0000 7f0561600640 1 -- 172.21.15.103:0/962497656 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0558011920 con 0x7f0564072500 2024-09-10T22:43:17.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.930+0000 7f0561600640 1 -- 172.21.15.103:0/962497656 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558011d70 con 0x7f0564072500 2024-09-10T22:43:17.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.930+0000 7f056c400640 1 -- 172.21.15.103:0/962497656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f056414c8e0 con 0x7f0564072500 2024-09-10T22:43:17.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.930+0000 7f056c400640 1 -- 172.21.15.103:0/962497656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f056414dfa0 con 0x7f0564072500 2024-09-10T22:43:17.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.930+0000 7f0561600640 1 -- 172.21.15.103:0/962497656 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f055801a400 con 0x7f0564072500 2024-09-10T22:43:17.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.930+0000 7f0561600640 1 --2- 172.21.15.103:0/962497656 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05440725e0 0x7f0544074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.930+0000 7f0561600640 1 -- 172.21.15.103:0/962497656 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f05580938b0 con 0x7f0564072500 2024-09-10T22:43:17.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.930+0000 7f056f88d000 1 Processor -- start 2024-09-10T22:43:17.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056f88d000 1 -- start start 2024-09-10T22:43:17.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f0569000640 1 --2- 172.21.15.103:0/962497656 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05440725e0 0x7f0544074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056f88d000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149660f30 0x557149661310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056f88d000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149661850 0x5571496143e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056f88d000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149614920 0x557149614d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056f88d000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5571494fed30 con 0x557149660f30 2024-09-10T22:43:17.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056f88d000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557149472af0 con 0x557149661850 2024-09-10T22:43:17.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056f88d000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x557149461f20 con 0x557149614920 2024-09-10T22:43:17.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f0569000640 1 --2- 172.21.15.103:0/962497656 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05440725e0 0x7f0544074aa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f05641f85e0 tx=0x7f0550008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:17.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f0569a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149660f30 0x557149661310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f0569a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149660f30 0x557149661310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51198/0 (socket says 172.21.15.103:51198) 2024-09-10T22:43:17.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f0569a00640 1 -- 172.21.15.103:0/2704340764 learned_addr learned my addr 172.21.15.103:0/2704340764 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:17.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f0569000640 1 --2- 172.21.15.103:0/2704340764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149661850 0x5571496143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056a400640 1 --2- 172.21.15.103:0/2704340764 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149614920 0x557149614d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f0569a00640 1 -- 172.21.15.103:0/2704340764 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149614920 msgr2=0x557149614d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f0569a00640 1 --2- 172.21.15.103:0/2704340764 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149614920 0x557149614d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f0569a00640 1 -- 172.21.15.103:0/2704340764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149661850 msgr2=0x5571496143e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f0569a00640 1 --2- 172.21.15.103:0/2704340764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149661850 0x5571496143e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f0569a00640 1 -- 172.21.15.103:0/2704340764 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571493e3100 con 0x557149660f30 2024-09-10T22:43:17.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f0569a00640 1 --2- 172.21.15.103:0/2704340764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149660f30 0x557149661310 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f055800bfd0 tx=0x7f055805dfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533cc24326f9cc58 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:17.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f0556000640 1 -- 172.21.15.103:0/2704340764 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05580673a0 con 0x557149660f30 2024-09-10T22:43:17.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f0556000640 1 -- 172.21.15.103:0/2704340764 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0558063030 con 0x557149660f30 2024-09-10T22:43:17.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f0556000640 1 -- 172.21.15.103:0/2704340764 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055805da10 con 0x557149660f30 2024-09-10T22:43:17.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056f88d000 1 -- 172.21.15.103:0/2704340764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149660f30 msgr2=0x557149661310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056f88d000 1 --2- 172.21.15.103:0/2704340764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149660f30 0x557149661310 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f055800bfd0 tx=0x7f055805dfb0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056f88d000 1 -- 172.21.15.103:0/2704340764 shutdown_connections 2024-09-10T22:43:17.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056f88d000 1 --2- 172.21.15.103:0/2704340764 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149614920 0x557149614d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056f88d000 1 --2- 172.21.15.103:0/2704340764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149661850 0x5571496143e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056f88d000 1 --2- 172.21.15.103:0/2704340764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149660f30 0x557149661310 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056f88d000 1 -- 172.21.15.103:0/2704340764 >> 172.21.15.103:0/2704340764 conn(0x557149641ff0 msgr2=0x5571496443e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:17.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056f88d000 1 -- 172.21.15.103:0/2704340764 shutdown_connections 2024-09-10T22:43:17.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056f88d000 1 -- 172.21.15.103:0/2704340764 wait complete. 2024-09-10T22:43:17.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056f88d000 1 -- start start 2024-09-10T22:43:17.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.934+0000 7f056f88d000 1 Processor -- start 2024-09-10T22:43:17.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f056f88d000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149614920 0x557149643420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f056f88d000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149660f30 0x557149643960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f056f88d000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149661850 0x557149643ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f056f88d000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5571494074e0 con 0x557149614920 2024-09-10T22:43:17.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f056f88d000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557149465d30 con 0x557149660f30 2024-09-10T22:43:17.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f056f88d000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x557149127680 con 0x557149661850 2024-09-10T22:43:17.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f056f88d000 10 client.0 _ll_register_callbacks cb 0x5571496020e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:43:17.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f0569a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149614920 0x557149643420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f0569a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149614920 0x557149643420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51202/0 (socket says 172.21.15.103:51202) 2024-09-10T22:43:17.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f0569a00640 1 -- 172.21.15.103:0/2234599227 learned_addr learned my addr 172.21.15.103:0/2234599227 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:17.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f0569000640 1 --2- 172.21.15.103:0/2234599227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149660f30 0x557149643960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f056a400640 1 --2- 172.21.15.103:0/2234599227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149661850 0x557149643ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f0569a00640 1 -- 172.21.15.103:0/2234599227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149661850 msgr2=0x557149643ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f0569a00640 1 --2- 172.21.15.103:0/2234599227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149661850 0x557149643ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f0569a00640 1 -- 172.21.15.103:0/2234599227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149660f30 msgr2=0x557149643960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f0569a00640 1 --2- 172.21.15.103:0/2234599227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149660f30 0x557149643960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f0569a00640 1 -- 172.21.15.103:0/2234599227 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557149416c40 con 0x557149614920 2024-09-10T22:43:17.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f0569a00640 1 --2- 172.21.15.103:0/2234599227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149614920 0x557149643420 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f055800bfd0 tx=0x7f055805aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0be4780759a2f21 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:17.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f054aa00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:43:17.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f054aa00640 1 -- 172.21.15.103:0/2234599227 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558063030 con 0x557149614920 2024-09-10T22:43:17.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f054aa00640 1 -- 172.21.15.103:0/2234599227 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f055801a720 con 0x557149614920 2024-09-10T22:43:17.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f056f88d000 1 -- 172.21.15.103:0/2234599227 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5571493fa310 con 0x557149614920 2024-09-10T22:43:17.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f054aa00640 1 -- 172.21.15.103:0/2234599227 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f0558091050 con 0x557149614920 2024-09-10T22:43:17.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f056f88d000 10 client.6699 fetch_fsmap learned FSMap version 64 2024-09-10T22:43:17.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f056f88d000 1 -- 172.21.15.103:0/2234599227 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) -- 0x557149460bc0 con 0x557149614920 2024-09-10T22:43:17.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f054aa00640 1 -- 172.21.15.103:0/2234599227 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5571493fa310 con 0x557149614920 2024-09-10T22:43:17.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f054aa00640 1 -- 172.21.15.103:0/2234599227 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 64) ==== 3558+0+0 (secure 0 0 0) 0x7f0558065230 con 0x557149614920 2024-09-10T22:43:17.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f056f88d000 10 client.6699 fetch_fsmap finished waiting for FSMap version 64 2024-09-10T22:43:17.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f056f88d000 10 client.6699 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.c 2024-09-10T22:43:17.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f056f88d000 20 client.6699 populate_metadata read hostname 'smithi103' 2024-09-10T22:43:17.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f056f88d000 1 --2- 172.21.15.103:0/2234599227 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x5571496448b0 0x5571496731f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f056f88d000 4 client.6699 mds_command: new command op to 6276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:43:17.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f056f88d000 1 -- 172.21.15.103:0/2234599227 --> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557149474a40 con 0x5571496448b0 2024-09-10T22:43:17.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f0569000640 1 --2- 172.21.15.103:0/2234599227 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x5571496448b0 0x5571496731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f0569000640 1 --2- 172.21.15.103:0/2234599227 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x5571496448b0 0x5571496731f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cbaa94b4296a796e server_cookie=fc48bfaf27220c26 in_seq=0 out_seq=0 2024-09-10T22:43:17.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f054aa00640 10 client.6699 ms_handle_connect on v2:172.21.15.103:6832/4171945106 2024-09-10T22:43:17.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f054aa00640 1 -- 172.21.15.103:0/2234599227 <== mds.1 v2:172.21.15.103:6832/4171945106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557149474a40 con 0x5571496448b0 2024-09-10T22:43:17.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f054aa00640 10 client.6699 handle_command_reply: tid=0 2024-09-10T22:43:17.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.938+0000 7f056f88d000 1 client.6699 shutdown 2024-09-10T22:43:17.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.942+0000 7f056f88d000 1 -- 172.21.15.103:0/2234599227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149614920 msgr2=0x557149643420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.942+0000 7f056f88d000 1 --2- 172.21.15.103:0/2234599227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149614920 0x557149643420 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f055800bfd0 tx=0x7f055805aa70 comp rx=0 tx=0).stop 2024-09-10T22:43:17.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.942+0000 7f056f88d000 1 -- 172.21.15.103:0/2234599227 shutdown_connections 2024-09-10T22:43:17.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.942+0000 7f056f88d000 1 --2- 172.21.15.103:0/2234599227 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x5571496448b0 0x5571496731f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.942+0000 7f056f88d000 1 --2- 172.21.15.103:0/2234599227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149661850 0x557149643ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.942+0000 7f056f88d000 1 --2- 172.21.15.103:0/2234599227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149660f30 0x557149643960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.942+0000 7f054aa00640 0 client.6699 ms_handle_reset on v2:172.21.15.103:6832/4171945106 2024-09-10T22:43:17.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.942+0000 7f056f88d000 1 --2- 172.21.15.103:0/2234599227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149614920 0x557149643420 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.942+0000 7f056f88d000 1 -- 172.21.15.103:0/2234599227 >> 172.21.15.103:0/2234599227 conn(0x557149641ff0 msgr2=0x557149613ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:17.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.942+0000 7f056f88d000 1 -- 172.21.15.103:0/2234599227 shutdown_connections 2024-09-10T22:43:17.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.942+0000 7f056f88d000 1 -- 172.21.15.103:0/2234599227 wait complete. 2024-09-10T22:43:17.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.942+0000 7f056f88d000 20 client.6699 trim_cache size 0 max 16384 2024-09-10T22:43:17.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f056f88d000 1 Processor -- start 2024-09-10T22:43:17.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f056f88d000 1 -- start start 2024-09-10T22:43:17.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f056f88d000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149614920 0x557149676860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f056f88d000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149660f30 0x55714965fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f056f88d000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149661850 0x5571496602e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f056f88d000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0564202450 con 0x557149660f30 2024-09-10T22:43:17.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f056f88d000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f05642015f0 con 0x557149614920 2024-09-10T22:43:17.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f056f88d000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0564201d20 con 0x557149661850 2024-09-10T22:43:17.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f0569000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149660f30 0x55714965fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f0569000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149660f30 0x55714965fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51214/0 (socket says 172.21.15.103:51214) 2024-09-10T22:43:17.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f0569000640 1 -- 172.21.15.103:0/3398282610 learned_addr learned my addr 172.21.15.103:0/3398282610 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:17.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f056a400640 1 --2- 172.21.15.103:0/3398282610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149661850 0x5571496602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f0569a00640 1 --2- 172.21.15.103:0/3398282610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149614920 0x557149676860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f0569000640 1 -- 172.21.15.103:0/3398282610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149661850 msgr2=0x5571496602e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f0569000640 1 --2- 172.21.15.103:0/3398282610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149661850 0x5571496602e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f0569000640 1 -- 172.21.15.103:0/3398282610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149614920 msgr2=0x557149676860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f0569000640 1 --2- 172.21.15.103:0/3398282610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149614920 0x557149676860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f0569000640 1 -- 172.21.15.103:0/3398282610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571494001d0 con 0x557149660f30 2024-09-10T22:43:17.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f056a400640 1 --2- 172.21.15.103:0/3398282610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149661850 0x5571496602e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:17.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f0569a00640 1 --2- 172.21.15.103:0/3398282610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149614920 0x557149676860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:17.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.954+0000 7f0569000640 1 --2- 172.21.15.103:0/3398282610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149660f30 0x55714965fda0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f055000cb90 tx=0x7f0550012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d7f32867dc155e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:17.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f0555600640 1 -- 172.21.15.103:0/3398282610 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055000cd80 con 0x557149660f30 2024-09-10T22:43:17.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f0555600640 1 -- 172.21.15.103:0/3398282610 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f055002b030 con 0x557149660f30 2024-09-10T22:43:17.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f0555600640 1 -- 172.21.15.103:0/3398282610 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0550022ad0 con 0x557149660f30 2024-09-10T22:43:17.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 1 -- 172.21.15.103:0/3398282610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149660f30 msgr2=0x55714965fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 1 --2- 172.21.15.103:0/3398282610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149660f30 0x55714965fda0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f055000cb90 tx=0x7f0550012000 comp rx=0 tx=0).stop 2024-09-10T22:43:17.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 1 -- 172.21.15.103:0/3398282610 shutdown_connections 2024-09-10T22:43:17.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 1 --2- 172.21.15.103:0/3398282610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149661850 0x5571496602e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 1 --2- 172.21.15.103:0/3398282610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149660f30 0x55714965fda0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 1 --2- 172.21.15.103:0/3398282610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149614920 0x557149676860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 1 -- 172.21.15.103:0/3398282610 >> 172.21.15.103:0/3398282610 conn(0x557149641ff0 msgr2=0x55714966dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:17.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 1 -- 172.21.15.103:0/3398282610 shutdown_connections 2024-09-10T22:43:17.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 1 -- 172.21.15.103:0/3398282610 wait complete. 2024-09-10T22:43:17.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 1 -- start start 2024-09-10T22:43:17.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 1 Processor -- start 2024-09-10T22:43:17.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149614920 0x5571496d6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149660f30 0x5571496d72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149661850 0x5571496d7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x557149424690 con 0x557149614920 2024-09-10T22:43:17.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557149521ff0 con 0x557149661850 2024-09-10T22:43:17.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55714946a360 con 0x557149660f30 2024-09-10T22:43:17.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 10 client.0 _ll_register_callbacks cb 0x7f0558082070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:43:17.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f0569a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149614920 0x5571496d6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f0569a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149614920 0x5571496d6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51222/0 (socket says 172.21.15.103:51222) 2024-09-10T22:43:17.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f0569a00640 1 -- 172.21.15.103:0/2372429591 learned_addr learned my addr 172.21.15.103:0/2372429591 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:17.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f0569000640 1 --2- 172.21.15.103:0/2372429591 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149660f30 0x5571496d72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056a400640 1 --2- 172.21.15.103:0/2372429591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149661850 0x5571496d7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f0569a00640 1 -- 172.21.15.103:0/2372429591 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149660f30 msgr2=0x5571496d72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f0569a00640 1 --2- 172.21.15.103:0/2372429591 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149660f30 0x5571496d72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f0569a00640 1 -- 172.21.15.103:0/2372429591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149661850 msgr2=0x5571496d7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f0569a00640 1 --2- 172.21.15.103:0/2372429591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149661850 0x5571496d7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f0569a00640 1 -- 172.21.15.103:0/2372429591 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557149428970 con 0x557149614920 2024-09-10T22:43:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f0569a00640 1 --2- 172.21.15.103:0/2372429591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149614920 0x5571496d6db0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0558065700 tx=0x7f055805e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5ccb2baccab0f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f054aa00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:43:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f054aa00640 1 -- 172.21.15.103:0/2372429591 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055805a3f0 con 0x557149614920 2024-09-10T22:43:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f054aa00640 1 -- 172.21.15.103:0/2372429591 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f055801a930 con 0x557149614920 2024-09-10T22:43:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.958+0000 7f056f88d000 1 -- 172.21.15.103:0/2372429591 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f055002b030 con 0x557149614920 2024-09-10T22:43:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f054aa00640 1 -- 172.21.15.103:0/2372429591 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f055805e320 con 0x557149614920 2024-09-10T22:43:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 10 client.6705 fetch_fsmap learned FSMap version 64 2024-09-10T22:43:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 1 -- 172.21.15.103:0/2372429591 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) -- 0x5571493f8560 con 0x557149614920 2024-09-10T22:43:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f054aa00640 1 -- 172.21.15.103:0/2372429591 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f055002b030 con 0x557149614920 2024-09-10T22:43:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f054aa00640 1 -- 172.21.15.103:0/2372429591 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 64) ==== 3558+0+0 (secure 0 0 0) 0x7f0558059ea0 con 0x557149614920 2024-09-10T22:43:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 10 client.6705 fetch_fsmap finished waiting for FSMap version 64 2024-09-10T22:43:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 10 client.6705 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.c 2024-09-10T22:43:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 20 client.6705 populate_metadata read hostname 'smithi103' 2024-09-10T22:43:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 1 --2- 172.21.15.103:0/2372429591 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x5571496739a0 0x557149673db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 4 client.6705 mds_command: new command op to 6276 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:43:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 1 -- 172.21.15.103:0/2372429591 --> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5571494704f0 con 0x5571496739a0 2024-09-10T22:43:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f0569000640 1 --2- 172.21.15.103:0/2372429591 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x5571496739a0 0x557149673db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f0569000640 1 --2- 172.21.15.103:0/2372429591 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x5571496739a0 0x557149673db0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e2e818bbdbc2d395 server_cookie=e37bb0de8d46b74b in_seq=0 out_seq=0 2024-09-10T22:43:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f054aa00640 10 client.6705 ms_handle_connect on v2:172.21.15.103:6832/4171945106 2024-09-10T22:43:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f054aa00640 1 -- 172.21.15.103:0/2372429591 <== mds.1 v2:172.21.15.103:6832/4171945106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+283 (crc 0 0 0) 0x5571494704f0 con 0x5571496739a0 2024-09-10T22:43:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f054aa00640 10 client.6705 handle_command_reply: tid=0 2024-09-10T22:43:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 1 client.6705 shutdown 2024-09-10T22:43:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 1 -- 172.21.15.103:0/2372429591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149614920 msgr2=0x5571496d6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 1 --2- 172.21.15.103:0/2372429591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149614920 0x5571496d6db0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0558065700 tx=0x7f055805e060 comp rx=0 tx=0).stop 2024-09-10T22:43:17.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 1 -- 172.21.15.103:0/2372429591 shutdown_connections 2024-09-10T22:43:17.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 1 --2- 172.21.15.103:0/2372429591 >> [v2:172.21.15.103:6832/4171945106,v1:172.21.15.103:6833/4171945106] conn(0x5571496739a0 0x557149673db0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 1 --2- 172.21.15.103:0/2372429591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557149661850 0x5571496d7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 1 --2- 172.21.15.103:0/2372429591 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557149660f30 0x5571496d72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f054aa00640 0 client.6705 ms_handle_reset on v2:172.21.15.103:6832/4171945106 2024-09-10T22:43:17.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 1 --2- 172.21.15.103:0/2372429591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557149614920 0x5571496d6db0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 1 -- 172.21.15.103:0/2372429591 >> 172.21.15.103:0/2372429591 conn(0x557149641ff0 msgr2=0x55714966e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:17.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 1 -- 172.21.15.103:0/2372429591 shutdown_connections 2024-09-10T22:43:17.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 1 -- 172.21.15.103:0/2372429591 wait complete. 2024-09-10T22:43:17.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056f88d000 20 client.6705 trim_cache size 0 max 16384 2024-09-10T22:43:17.972 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-09-10T22:43:17.972 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:17.972 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-10T22:43:17.972 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 451236674, 2024-09-10T22:43:17.972 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511627780, 2024-09-10T22:43:17.972 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3/d4/d5" 2024-09-10T22:43:17.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:17.973 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:17.973 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-10T22:43:17.973 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4023935228, 2024-09-10T22:43:17.973 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511627781, 2024-09-10T22:43:17.973 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3/d4/d5/d6" 2024-09-10T22:43:17.973 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:17.973 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-09-10T22:43:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056c400640 1 -- 172.21.15.103:0/962497656 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05440725e0 msgr2=0x7f0544074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056c400640 1 --2- 172.21.15.103:0/962497656 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05440725e0 0x7f0544074aa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f05641f85e0 tx=0x7f0550008040 comp rx=0 tx=0).stop 2024-09-10T22:43:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056c400640 1 -- 172.21.15.103:0/962497656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0564072500 msgr2=0x7f05641492f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056c400640 1 --2- 172.21.15.103:0/962497656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0564072500 0x7f05641492f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f055800b410 tx=0x7f055800b8d0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056c400640 1 -- 172.21.15.103:0/962497656 shutdown_connections 2024-09-10T22:43:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056c400640 1 --2- 172.21.15.103:0/962497656 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05440725e0 0x7f0544074aa0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056c400640 1 --2- 172.21.15.103:0/962497656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05640cf260 0x7f056414c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056c400640 1 --2- 172.21.15.103:0/962497656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05640b2c10 0x7f056413a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056c400640 1 --2- 172.21.15.103:0/962497656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0564072500 0x7f05641492f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056c400640 1 -- 172.21.15.103:0/962497656 >> 172.21.15.103:0/962497656 conn(0x7f056406cc00 msgr2=0x7f05640b1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:17.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056c400640 1 -- 172.21.15.103:0/962497656 shutdown_connections 2024-09-10T22:43:17.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:17.962+0000 7f056c400640 1 -- 172.21.15.103:0/962497656 wait complete. 2024-09-10T22:43:17.985 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:2 damage ls 2024-09-10T22:43:18.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f38a5600640 1 -- 172.21.15.103:0/2570842176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38840051d0 msgr2=0x7f388400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:18.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f38a5600640 1 --2- 172.21.15.103:0/2570842176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38840051d0 0x7f388400b9d0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f3898009ee0 tx=0x7f389801d630 comp rx=0 tx=0).stop 2024-09-10T22:43:18.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f38a5600640 1 -- 172.21.15.103:0/2570842176 shutdown_connections 2024-09-10T22:43:18.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f38a5600640 1 --2- 172.21.15.103:0/2570842176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38840051d0 0x7f388400b9d0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f38a5600640 1 -- 172.21.15.103:0/2570842176 >> 172.21.15.103:0/2570842176 conn(0x7f38a00d1a20 msgr2=0x7f38a00d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:18.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f38a5600640 1 -- 172.21.15.103:0/2570842176 shutdown_connections 2024-09-10T22:43:18.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f38a5600640 1 -- 172.21.15.103:0/2570842176 wait complete. 2024-09-10T22:43:18.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f38a5600640 1 Processor -- start 2024-09-10T22:43:18.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f38a5600640 1 -- start start 2024-09-10T22:43:18.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f38a5600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38840051d0 0x7f38a01f87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f38a5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38a00b6fd0 0x7f38a0159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f38a5600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a00cab10 0x7f38a00cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f38a5600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f38a00d26c0 con 0x7f38a00b6fd0 2024-09-10T22:43:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f38a5600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f38a00d2540 con 0x7f38a00cab10 2024-09-10T22:43:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f38a5600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f38a00d2840 con 0x7f38840051d0 2024-09-10T22:43:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f3896000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38a00b6fd0 0x7f38a0159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f3896000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38a00b6fd0 0x7f38a0159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51236/0 (socket says 172.21.15.103:51236) 2024-09-10T22:43:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f3896000640 1 -- 172.21.15.103:0/424878953 learned_addr learned my addr 172.21.15.103:0/424878953 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f3896000640 1 -- 172.21.15.103:0/424878953 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38840051d0 msgr2=0x7f38a01f87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f3896000640 1 --2- 172.21.15.103:0/424878953 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38840051d0 0x7f38a01f87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f3896000640 1 -- 172.21.15.103:0/424878953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a00cab10 msgr2=0x7f38a00cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f3896000640 1 --2- 172.21.15.103:0/424878953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a00cab10 0x7f38a00cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.126+0000 7f3896000640 1 -- 172.21.15.103:0/424878953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a01f4830 con 0x7f38a00b6fd0 2024-09-10T22:43:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.130+0000 7f3896000640 1 --2- 172.21.15.103:0/424878953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38a00b6fd0 0x7f38a0159c90 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f3888004e30 tx=0x7f3888001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:18.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.130+0000 7f3897400640 1 -- 172.21.15.103:0/424878953 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888015020 con 0x7f38a00b6fd0 2024-09-10T22:43:18.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.130+0000 7f3897400640 1 -- 172.21.15.103:0/424878953 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3888011960 con 0x7f38a00b6fd0 2024-09-10T22:43:18.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.130+0000 7f3897400640 1 -- 172.21.15.103:0/424878953 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888011d90 con 0x7f38a00b6fd0 2024-09-10T22:43:18.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.130+0000 7f38a5600640 1 -- 172.21.15.103:0/424878953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a01f4ad0 con 0x7f38a00b6fd0 2024-09-10T22:43:18.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.130+0000 7f38a5600640 1 -- 172.21.15.103:0/424878953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a01f5090 con 0x7f38a00b6fd0 2024-09-10T22:43:18.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.130+0000 7f3897400640 1 -- 172.21.15.103:0/424878953 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f388801a400 con 0x7f38a00b6fd0 2024-09-10T22:43:18.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.130+0000 7f3897400640 1 --2- 172.21.15.103:0/424878953 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f387c0725e0 0x7f387c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.130+0000 7f38a8a48000 1 Processor -- start 2024-09-10T22:43:18.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.130+0000 7f3897400640 1 -- 172.21.15.103:0/424878953 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f38880941c0 con 0x7f38a00b6fd0 2024-09-10T22:43:18.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.130+0000 7f38a8a48000 1 -- start start 2024-09-10T22:43:18.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f389ea00640 1 --2- 172.21.15.103:0/424878953 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f387c0725e0 0x7f387c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f38a8a48000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c170bf30 0x5592c170c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f38a8a48000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c170c850 0x5592c16bf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f38a8a48000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c16bf920 0x5592c16bfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f38a8a48000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5592c15a9d30 con 0x5592c16bf920 2024-09-10T22:43:18.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f38a8a48000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5592c151daf0 con 0x5592c170bf30 2024-09-10T22:43:18.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f38a8a48000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5592c150cf20 con 0x5592c170c850 2024-09-10T22:43:18.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f389f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c16bf920 0x5592c16bfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f389f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c16bf920 0x5592c16bfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51248/0 (socket says 172.21.15.103:51248) 2024-09-10T22:43:18.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f389f400640 1 -- 172.21.15.103:0/2827322735 learned_addr learned my addr 172.21.15.103:0/2827322735 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:18.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f389ea00640 1 --2- 172.21.15.103:0/2827322735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c170bf30 0x5592c170c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f3896000640 1 --2- 172.21.15.103:0/2827322735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c170c850 0x5592c16bf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f389ea00640 1 --2- 172.21.15.103:0/424878953 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f387c0725e0 0x7f387c074aa0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3890001ec0 tx=0x7f3890000ee0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:18.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f389f400640 1 -- 172.21.15.103:0/2827322735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c170c850 msgr2=0x5592c16bf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:18.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f389f400640 1 --2- 172.21.15.103:0/2827322735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c170c850 0x5592c16bf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f389f400640 1 -- 172.21.15.103:0/2827322735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c170bf30 msgr2=0x5592c170c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:18.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f389f400640 1 --2- 172.21.15.103:0/2827322735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c170bf30 0x5592c170c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f389f400640 1 -- 172.21.15.103:0/2827322735 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592c148e100 con 0x5592c16bf920 2024-09-10T22:43:18.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f389f400640 1 --2- 172.21.15.103:0/2827322735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c16bf920 0x5592c16bfd00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f389801ded0 tx=0x7f3898009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d70a69ae811100 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:18.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f388f400640 1 -- 172.21.15.103:0/2827322735 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898004a50 con 0x5592c16bf920 2024-09-10T22:43:18.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f388f400640 1 -- 172.21.15.103:0/2827322735 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3898004bf0 con 0x5592c16bf920 2024-09-10T22:43:18.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f388f400640 1 -- 172.21.15.103:0/2827322735 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898003980 con 0x5592c16bf920 2024-09-10T22:43:18.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f38a8a48000 1 -- 172.21.15.103:0/2827322735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c16bf920 msgr2=0x5592c16bfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:18.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f38a8a48000 1 --2- 172.21.15.103:0/2827322735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c16bf920 0x5592c16bfd00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f389801ded0 tx=0x7f3898009e70 comp rx=0 tx=0).stop 2024-09-10T22:43:18.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f38a8a48000 1 -- 172.21.15.103:0/2827322735 shutdown_connections 2024-09-10T22:43:18.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f38a8a48000 1 --2- 172.21.15.103:0/2827322735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c16bf920 0x5592c16bfd00 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f38a8a48000 1 --2- 172.21.15.103:0/2827322735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c170c850 0x5592c16bf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f38a8a48000 1 --2- 172.21.15.103:0/2827322735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c170bf30 0x5592c170c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f38a8a48000 1 -- 172.21.15.103:0/2827322735 >> 172.21.15.103:0/2827322735 conn(0x5592c16ecff0 msgr2=0x5592c16ef3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:18.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f38a8a48000 1 -- 172.21.15.103:0/2827322735 shutdown_connections 2024-09-10T22:43:18.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f38a8a48000 1 -- 172.21.15.103:0/2827322735 wait complete. 2024-09-10T22:43:18.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f38a8a48000 1 -- start start 2024-09-10T22:43:18.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.134+0000 7f38a8a48000 1 Processor -- start 2024-09-10T22:43:18.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f38a8a48000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c16bf920 0x5592c16ee420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f38a8a48000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c170bf30 0x5592c16ee960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f38a8a48000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 0x5592c16eeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f38a8a48000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5592c14b24e0 con 0x5592c170c850 2024-09-10T22:43:18.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f38a8a48000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5592c1510d30 con 0x5592c16bf920 2024-09-10T22:43:18.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f38a8a48000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5592c11d2680 con 0x5592c170bf30 2024-09-10T22:43:18.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f38a8a48000 10 client.0 _ll_register_callbacks cb 0x5592c16ad0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:43:18.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f389f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 0x5592c16eeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f389f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 0x5592c16eeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51256/0 (socket says 172.21.15.103:51256) 2024-09-10T22:43:18.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f389f400640 1 -- 172.21.15.103:0/3950898093 learned_addr learned my addr 172.21.15.103:0/3950898093 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:18.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f3896000640 1 --2- 172.21.15.103:0/3950898093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c170bf30 0x5592c16ee960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f389ea00640 1 --2- 172.21.15.103:0/3950898093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c16bf920 0x5592c16ee420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f389f400640 1 -- 172.21.15.103:0/3950898093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c170bf30 msgr2=0x5592c16ee960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:18.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f389f400640 1 --2- 172.21.15.103:0/3950898093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c170bf30 0x5592c16ee960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f389f400640 1 -- 172.21.15.103:0/3950898093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c16bf920 msgr2=0x5592c16ee420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:18.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f389f400640 1 --2- 172.21.15.103:0/3950898093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c16bf920 0x5592c16ee420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f389f400640 1 -- 172.21.15.103:0/3950898093 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592c14c1c40 con 0x5592c170c850 2024-09-10T22:43:18.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f389f400640 1 --2- 172.21.15.103:0/3950898093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 0x5592c16eeea0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f389801ded0 tx=0x7f3898009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b7bb3593e92c0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:18.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f3883e00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:43:18.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f3883e00640 1 -- 172.21.15.103:0/3950898093 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898003980 con 0x5592c170c850 2024-09-10T22:43:18.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f38a8a48000 1 -- 172.21.15.103:0/3950898093 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5592c14a5310 con 0x5592c170c850 2024-09-10T22:43:18.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f3883e00640 1 -- 172.21.15.103:0/3950898093 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f3898003b20 con 0x5592c170c850 2024-09-10T22:43:18.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f3883e00640 1 -- 172.21.15.103:0/3950898093 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f38980c6050 con 0x5592c170c850 2024-09-10T22:43:18.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f38a8a48000 10 client.6717 fetch_fsmap learned FSMap version 64 2024-09-10T22:43:18.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f38a8a48000 1 -- 172.21.15.103:0/3950898093 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) -- 0x5592c150bbc0 con 0x5592c170c850 2024-09-10T22:43:18.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f3883e00640 1 -- 172.21.15.103:0/3950898093 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5592c14a5310 con 0x5592c170c850 2024-09-10T22:43:18.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f3883e00640 1 -- 172.21.15.103:0/3950898093 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 64) ==== 3558+0+0 (secure 0 0 0) 0x7f38980c9020 con 0x5592c170c850 2024-09-10T22:43:18.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f38a8a48000 10 client.6717 fetch_fsmap finished waiting for FSMap version 64 2024-09-10T22:43:18.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f38a8a48000 10 client.6717 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.b 2024-09-10T22:43:18.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f38a8a48000 20 client.6717 populate_metadata read hostname 'smithi103' 2024-09-10T22:43:18.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f38a8a48000 1 --2- 172.21.15.103:0/3950898093 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x5592c16ef8b0 0x5592c171e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f38a8a48000 4 client.6717 mds_command: new command op to 5630 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:43:18.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f38a8a48000 1 -- 172.21.15.103:0/3950898093 --> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592c151fa40 con 0x5592c16ef8b0 2024-09-10T22:43:18.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f389ea00640 1 --2- 172.21.15.103:0/3950898093 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x5592c16ef8b0 0x5592c171e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f389ea00640 1 --2- 172.21.15.103:0/3950898093 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x5592c16ef8b0 0x5592c171e1f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dc56586d60390aa7 server_cookie=c4130dc4ed90e1e9 in_seq=0 out_seq=0 2024-09-10T22:43:18.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.138+0000 7f3883e00640 10 client.6717 ms_handle_connect on v2:172.21.15.131:6836/360467048 2024-09-10T22:43:18.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.142+0000 7f3883e00640 1 -- 172.21.15.103:0/3950898093 <== mds.2 v2:172.21.15.131:6836/360467048 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5592c151fa40 con 0x5592c16ef8b0 2024-09-10T22:43:18.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.142+0000 7f3883e00640 10 client.6717 handle_command_reply: tid=0 2024-09-10T22:43:18.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.142+0000 7f38a8a48000 1 client.6717 shutdown 2024-09-10T22:43:18.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.142+0000 7f38a8a48000 1 -- 172.21.15.103:0/3950898093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 msgr2=0x5592c16eeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:18.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.142+0000 7f38a8a48000 1 --2- 172.21.15.103:0/3950898093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 0x5592c16eeea0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f389801ded0 tx=0x7f3898009920 comp rx=0 tx=0).stop 2024-09-10T22:43:18.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.142+0000 7f38a8a48000 1 -- 172.21.15.103:0/3950898093 shutdown_connections 2024-09-10T22:43:18.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.142+0000 7f38a8a48000 1 --2- 172.21.15.103:0/3950898093 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x5592c16ef8b0 0x5592c171e1f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.142+0000 7f38a8a48000 1 --2- 172.21.15.103:0/3950898093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 0x5592c16eeea0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.142+0000 7f38a8a48000 1 --2- 172.21.15.103:0/3950898093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c170bf30 0x5592c16ee960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.142+0000 7f38a8a48000 1 --2- 172.21.15.103:0/3950898093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c16bf920 0x5592c16ee420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.142+0000 7f3883e00640 0 client.6717 ms_handle_reset on v2:172.21.15.131:6836/360467048 2024-09-10T22:43:18.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.142+0000 7f38a8a48000 1 -- 172.21.15.103:0/3950898093 >> 172.21.15.103:0/3950898093 conn(0x5592c16ecff0 msgr2=0x5592c16beae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:18.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.142+0000 7f38a8a48000 1 -- 172.21.15.103:0/3950898093 shutdown_connections 2024-09-10T22:43:18.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.142+0000 7f38a8a48000 1 -- 172.21.15.103:0/3950898093 wait complete. 2024-09-10T22:43:18.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.142+0000 7f38a8a48000 20 client.6717 trim_cache size 0 max 16384 2024-09-10T22:43:18.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.154+0000 7f38a8a48000 1 Processor -- start 2024-09-10T22:43:18.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.154+0000 7f38a8a48000 1 -- start start 2024-09-10T22:43:18.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.154+0000 7f38a8a48000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c16bf920 0x5592c170ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.154+0000 7f38a8a48000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c170bf30 0x5592c170b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.154+0000 7f38a8a48000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 0x5592c171c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.154+0000 7f38a8a48000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f38a0201e70 con 0x5592c170c850 2024-09-10T22:43:18.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.154+0000 7f38a8a48000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f38a02010b0 con 0x5592c170bf30 2024-09-10T22:43:18.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.154+0000 7f38a8a48000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f38a0201740 con 0x5592c16bf920 2024-09-10T22:43:18.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.154+0000 7f389f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 0x5592c171c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.154+0000 7f389f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 0x5592c171c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51258/0 (socket says 172.21.15.103:51258) 2024-09-10T22:43:18.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.154+0000 7f389f400640 1 -- 172.21.15.103:0/2992821006 learned_addr learned my addr 172.21.15.103:0/2992821006 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:18.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f3896000640 1 --2- 172.21.15.103:0/2992821006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c170bf30 0x5592c170b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f389ea00640 1 --2- 172.21.15.103:0/2992821006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c16bf920 0x5592c170ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f389f400640 1 -- 172.21.15.103:0/2992821006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c16bf920 msgr2=0x5592c170ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:18.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f389f400640 1 --2- 172.21.15.103:0/2992821006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c16bf920 0x5592c170ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f389f400640 1 -- 172.21.15.103:0/2992821006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c170bf30 msgr2=0x5592c170b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:18.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f389f400640 1 --2- 172.21.15.103:0/2992821006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c170bf30 0x5592c170b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f389f400640 1 -- 172.21.15.103:0/2992821006 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592c14ab1d0 con 0x5592c170c850 2024-09-10T22:43:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f389f400640 1 --2- 172.21.15.103:0/2992821006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 0x5592c171c1e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f389801beb0 tx=0x7f38980093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef60186b5e49d940 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f388ea00640 1 -- 172.21.15.103:0/2992821006 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38980ba070 con 0x5592c170c850 2024-09-10T22:43:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f388ea00640 1 -- 172.21.15.103:0/2992821006 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3898003a70 con 0x5592c170c850 2024-09-10T22:43:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f388ea00640 1 -- 172.21.15.103:0/2992821006 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898003f00 con 0x5592c170c850 2024-09-10T22:43:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f38a8a48000 1 -- 172.21.15.103:0/2992821006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 msgr2=0x5592c171c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f38a8a48000 1 --2- 172.21.15.103:0/2992821006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 0x5592c171c1e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f389801beb0 tx=0x7f38980093e0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f38a8a48000 1 -- 172.21.15.103:0/2992821006 shutdown_connections 2024-09-10T22:43:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f38a8a48000 1 --2- 172.21.15.103:0/2992821006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 0x5592c171c1e0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f38a8a48000 1 --2- 172.21.15.103:0/2992821006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c170bf30 0x5592c170b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f38a8a48000 1 --2- 172.21.15.103:0/2992821006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c16bf920 0x5592c170ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f38a8a48000 1 -- 172.21.15.103:0/2992821006 >> 172.21.15.103:0/2992821006 conn(0x5592c16ecff0 msgr2=0x5592c1718ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f38a8a48000 1 -- 172.21.15.103:0/2992821006 shutdown_connections 2024-09-10T22:43:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f38a8a48000 1 -- 172.21.15.103:0/2992821006 wait complete. 2024-09-10T22:43:18.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f38a8a48000 1 -- start start 2024-09-10T22:43:18.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f38a8a48000 1 Processor -- start 2024-09-10T22:43:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f38a8a48000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c16bf920 0x5592c178ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f38a8a48000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c170bf30 0x5592c178b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f38a8a48000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 0x5592c178b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f38a8a48000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5592c1510d30 con 0x5592c170c850 2024-09-10T22:43:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f38a8a48000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5592c14d8890 con 0x5592c170bf30 2024-09-10T22:43:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f38a8a48000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5592c14cf690 con 0x5592c16bf920 2024-09-10T22:43:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f38a8a48000 10 client.0 _ll_register_callbacks cb 0x7f3890001760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:43:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f389f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 0x5592c178b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f389f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 0x5592c178b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51266/0 (socket says 172.21.15.103:51266) 2024-09-10T22:43:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f389f400640 1 -- 172.21.15.103:0/1798361677 learned_addr learned my addr 172.21.15.103:0/1798361677 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f389ea00640 1 --2- 172.21.15.103:0/1798361677 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c16bf920 0x5592c178ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f3896000640 1 --2- 172.21.15.103:0/1798361677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c170bf30 0x5592c178b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f389f400640 1 -- 172.21.15.103:0/1798361677 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c16bf920 msgr2=0x5592c178ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f389f400640 1 --2- 172.21.15.103:0/1798361677 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c16bf920 0x5592c178ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f389f400640 1 -- 172.21.15.103:0/1798361677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c170bf30 msgr2=0x5592c178b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f389f400640 1 --2- 172.21.15.103:0/1798361677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c170bf30 0x5592c178b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.158+0000 7f389f400640 1 -- 172.21.15.103:0/1798361677 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592c14d3970 con 0x5592c170c850 2024-09-10T22:43:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f389f400640 1 --2- 172.21.15.103:0/1798361677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 0x5592c178b600 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f389801db10 tx=0x7f38980a7be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ca1e1fcdda8316 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f3883e00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:43:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f3883e00640 1 -- 172.21.15.103:0/1798361677 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38980ba070 con 0x5592c170c850 2024-09-10T22:43:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f3883e00640 1 -- 172.21.15.103:0/1798361677 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f3898002040 con 0x5592c170c850 2024-09-10T22:43:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 1 -- 172.21.15.103:0/1798361677 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3898003a70 con 0x5592c170c850 2024-09-10T22:43:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f3883e00640 1 -- 172.21.15.103:0/1798361677 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f38980db050 con 0x5592c170c850 2024-09-10T22:43:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 10 client.6723 fetch_fsmap learned FSMap version 64 2024-09-10T22:43:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 1 -- 172.21.15.103:0/1798361677 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) -- 0x5592c14a3560 con 0x5592c170c850 2024-09-10T22:43:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f3883e00640 1 -- 172.21.15.103:0/1798361677 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3898003a70 con 0x5592c170c850 2024-09-10T22:43:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f3883e00640 1 -- 172.21.15.103:0/1798361677 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 64) ==== 3558+0+0 (secure 0 0 0) 0x7f38980de020 con 0x5592c170c850 2024-09-10T22:43:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 10 client.6723 fetch_fsmap finished waiting for FSMap version 64 2024-09-10T22:43:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 10 client.6723 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.b 2024-09-10T22:43:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 20 client.6723 populate_metadata read hostname 'smithi103' 2024-09-10T22:43:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 1 --2- 172.21.15.103:0/1798361677 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x5592c171f3a0 0x5592c171f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 4 client.6723 mds_command: new command op to 5630 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:43:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 1 -- 172.21.15.103:0/1798361677 --> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5592c151b4f0 con 0x5592c171f3a0 2024-09-10T22:43:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f389ea00640 1 --2- 172.21.15.103:0/1798361677 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x5592c171f3a0 0x5592c171f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f3883e00640 10 client.6723 ms_handle_connect on v2:172.21.15.131:6836/360467048 2024-09-10T22:43:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f389ea00640 1 --2- 172.21.15.103:0/1798361677 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x5592c171f3a0 0x5592c171f780 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f3b44a6d34375845 server_cookie=809c38251de57929 in_seq=0 out_seq=0 2024-09-10T22:43:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f3883e00640 1 -- 172.21.15.103:0/1798361677 <== mds.2 v2:172.21.15.131:6836/360467048 1 ==== command_reply(tid 0: 0 ) ==== 8+0+296 (crc 0 0 0) 0x5592c151b4f0 con 0x5592c171f3a0 2024-09-10T22:43:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f3883e00640 10 client.6723 handle_command_reply: tid=0 2024-09-10T22:43:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 1 client.6723 shutdown 2024-09-10T22:43:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 1 -- 172.21.15.103:0/1798361677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 msgr2=0x5592c178b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 1 --2- 172.21.15.103:0/1798361677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 0x5592c178b600 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f389801db10 tx=0x7f38980a7be0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 1 -- 172.21.15.103:0/1798361677 shutdown_connections 2024-09-10T22:43:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 1 --2- 172.21.15.103:0/1798361677 >> [v2:172.21.15.131:6836/360467048,v1:172.21.15.131:6837/360467048] conn(0x5592c171f3a0 0x5592c171f780 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 1 --2- 172.21.15.103:0/1798361677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5592c170c850 0x5592c178b600 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 1 --2- 172.21.15.103:0/1798361677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c170bf30 0x5592c178b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f3883e00640 0 client.6723 ms_handle_reset on v2:172.21.15.131:6836/360467048 2024-09-10T22:43:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 1 --2- 172.21.15.103:0/1798361677 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5592c16bf920 0x5592c178ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 1 -- 172.21.15.103:0/1798361677 >> 172.21.15.103:0/1798361677 conn(0x5592c16ecff0 msgr2=0x5592c1709d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:18.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 1 -- 172.21.15.103:0/1798361677 shutdown_connections 2024-09-10T22:43:18.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 1 -- 172.21.15.103:0/1798361677 wait complete. 2024-09-10T22:43:18.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a8a48000 20 client.6723 trim_cache size 0 max 16384 2024-09-10T22:43:18.171 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-09-10T22:43:18.171 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:18.171 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-10T22:43:18.171 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2987705263, 2024-09-10T22:43:18.171 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511627782, 2024-09-10T22:43:18.171 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3/d4/d5/d6/d7" 2024-09-10T22:43:18.171 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:18.171 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:18.172 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-09-10T22:43:18.172 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4167479804, 2024-09-10T22:43:18.172 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511627783, 2024-09-10T22:43:18.172 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3/d4/d5/d6/d7/d8" 2024-09-10T22:43:18.172 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:18.172 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-09-10T22:43:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a5600640 1 -- 172.21.15.103:0/424878953 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f387c0725e0 msgr2=0x7f387c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a5600640 1 --2- 172.21.15.103:0/424878953 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f387c0725e0 0x7f387c074aa0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3890001ec0 tx=0x7f3890000ee0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a5600640 1 -- 172.21.15.103:0/424878953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38a00b6fd0 msgr2=0x7f38a0159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a5600640 1 --2- 172.21.15.103:0/424878953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38a00b6fd0 0x7f38a0159c90 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f3888004e30 tx=0x7f3888001640 comp rx=0 tx=0).stop 2024-09-10T22:43:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a5600640 1 -- 172.21.15.103:0/424878953 shutdown_connections 2024-09-10T22:43:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a5600640 1 --2- 172.21.15.103:0/424878953 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f387c0725e0 0x7f387c074aa0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a5600640 1 --2- 172.21.15.103:0/424878953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a00cab10 0x7f38a00cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a5600640 1 --2- 172.21.15.103:0/424878953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38a00b6fd0 0x7f38a0159c90 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a5600640 1 --2- 172.21.15.103:0/424878953 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38840051d0 0x7f38a01f87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a5600640 1 -- 172.21.15.103:0/424878953 >> 172.21.15.103:0/424878953 conn(0x7f38a00d1a20 msgr2=0x7f38a0070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:18.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a5600640 1 -- 172.21.15.103:0/424878953 shutdown_connections 2024-09-10T22:43:18.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.162+0000 7f38a5600640 1 -- 172.21.15.103:0/424878953 wait complete. 2024-09-10T22:43:18.187 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T22:43:18.187 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:43:18.275 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:43:18.380 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T22:43:18.380 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:43:18.380 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:43:18.381 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:43:18.389 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:43:18.390 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:43:18.440 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T22:43:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.622+0000 7f6bdd000640 1 -- 172.21.15.103:0/3103602108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bd80b3320 msgr2=0x7f6bd8072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.622+0000 7f6bdd000640 1 --2- 172.21.15.103:0/3103602108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bd80b3320 0x7f6bd8072500 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009900 tx=0x7f6bc401c8e0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.622+0000 7f6bdd000640 1 -- 172.21.15.103:0/3103602108 shutdown_connections 2024-09-10T22:43:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.622+0000 7f6bdd000640 1 --2- 172.21.15.103:0/3103602108 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bd8072a40 0x7f6bd8157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.622+0000 7f6bdd000640 1 --2- 172.21.15.103:0/3103602108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bd80b3320 0x7f6bd8072500 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.622+0000 7f6bdd000640 1 -- 172.21.15.103:0/3103602108 >> 172.21.15.103:0/3103602108 conn(0x7f6bd806cc00 msgr2=0x7f6bd806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.622+0000 7f6bdd000640 1 -- 172.21.15.103:0/3103602108 shutdown_connections 2024-09-10T22:43:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.622+0000 7f6bdd000640 1 -- 172.21.15.103:0/3103602108 wait complete. 2024-09-10T22:43:18.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.622+0000 7f6bdd000640 1 Processor -- start 2024-09-10T22:43:18.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.622+0000 7f6bdd000640 1 -- start start 2024-09-10T22:43:18.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.622+0000 7f6bdd000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bd8072a40 0x7f6bd80b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.622+0000 7f6bdd000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bd80b3320 0x7f6bd814b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.622+0000 7f6bdd000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bd80cf260 0x7f6bd80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bdd000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd806e960 con 0x7f6bd8072a40 2024-09-10T22:43:18.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bdd000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd806e7e0 con 0x7f6bd80b3320 2024-09-10T22:43:18.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bdd000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd806eae0 con 0x7f6bd80cf260 2024-09-10T22:43:18.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bd5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bd8072a40 0x7f6bd80b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bd5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bd8072a40 0x7f6bd80b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51294/0 (socket says 172.21.15.103:51294) 2024-09-10T22:43:18.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bd5e00640 1 -- 172.21.15.103:0/1089725871 learned_addr learned my addr 172.21.15.103:0/1089725871 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:18.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bd5400640 1 --2- 172.21.15.103:0/1089725871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bd80b3320 0x7f6bd814b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bd6800640 1 --2- 172.21.15.103:0/1089725871 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bd80cf260 0x7f6bd80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bd5e00640 1 -- 172.21.15.103:0/1089725871 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bd80cf260 msgr2=0x7f6bd80b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:18.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bd5e00640 1 --2- 172.21.15.103:0/1089725871 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bd80cf260 0x7f6bd80b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bd5e00640 1 -- 172.21.15.103:0/1089725871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bd80b3320 msgr2=0x7f6bd814b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:18.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bd5e00640 1 --2- 172.21.15.103:0/1089725871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bd80b3320 0x7f6bd814b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bd5e00640 1 -- 172.21.15.103:0/1089725871 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd80b0f10 con 0x7f6bd8072a40 2024-09-10T22:43:18.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bd5e00640 1 --2- 172.21.15.103:0/1089725871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bd8072a40 0x7f6bd80b1fb0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800c760 tx=0x7f6bc800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:18.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bce000640 1 -- 172.21.15.103:0/1089725871 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8003b80 con 0x7f6bd8072a40 2024-09-10T22:43:18.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bce000640 1 -- 172.21.15.103:0/1089725871 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6bc8003d40 con 0x7f6bd8072a40 2024-09-10T22:43:18.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bce000640 1 -- 172.21.15.103:0/1089725871 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc800aab0 con 0x7f6bd8072a40 2024-09-10T22:43:18.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bdd000640 1 -- 172.21.15.103:0/1089725871 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd80b11f0 con 0x7f6bd8072a40 2024-09-10T22:43:18.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bdd000640 1 -- 172.21.15.103:0/1089725871 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bd80b17b0 con 0x7f6bd8072a40 2024-09-10T22:43:18.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bdd000640 1 -- 172.21.15.103:0/1089725871 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bd80b1be0 con 0x7f6bd8072a40 2024-09-10T22:43:18.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.626+0000 7f6bce000640 1 -- 172.21.15.103:0/1089725871 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6bc800ac50 con 0x7f6bd8072a40 2024-09-10T22:43:18.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.630+0000 7f6bce000640 1 --2- 172.21.15.103:0/1089725871 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6bb8072610 0x7f6bb8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:18.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.630+0000 7f6bce000640 1 -- 172.21.15.103:0/1089725871 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f6bc8093330 con 0x7f6bd8072a40 2024-09-10T22:43:18.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.630+0000 7f6bd5400640 1 --2- 172.21.15.103:0/1089725871 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6bb8072610 0x7f6bb8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:18.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.630+0000 7f6bd5400640 1 --2- 172.21.15.103:0/1089725871 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6bb8072610 0x7f6bb8074ad0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40af000 tx=0x7f6bc401b120 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:18.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.634+0000 7f6bce000640 1 -- 172.21.15.103:0/1089725871 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6bc805e750 con 0x7f6bd8072a40 2024-09-10T22:43:18.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.806+0000 7f6bdd000640 1 -- 172.21.15.103:0/1089725871 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6bd80adb70 con 0x7f6bd8072a40 2024-09-10T22:43:18.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.806+0000 7f6bce000640 1 -- 172.21.15.103:0/1089725871 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v70) ==== 80+0+0 (secure 0 0 0) 0x7f6bc8065e20 con 0x7f6bd8072a40 2024-09-10T22:43:18.812 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T22:43:18.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.810+0000 7f6bdd000640 1 -- 172.21.15.103:0/1089725871 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6bb8072610 msgr2=0x7f6bb8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:18.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.810+0000 7f6bdd000640 1 --2- 172.21.15.103:0/1089725871 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6bb8072610 0x7f6bb8074ad0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40af000 tx=0x7f6bc401b120 comp rx=0 tx=0).stop 2024-09-10T22:43:18.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.810+0000 7f6bdd000640 1 -- 172.21.15.103:0/1089725871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bd8072a40 msgr2=0x7f6bd80b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:18.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.810+0000 7f6bdd000640 1 --2- 172.21.15.103:0/1089725871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bd8072a40 0x7f6bd80b1fb0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800c760 tx=0x7f6bc800cc20 comp rx=0 tx=0).stop 2024-09-10T22:43:18.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.810+0000 7f6bdd000640 1 -- 172.21.15.103:0/1089725871 shutdown_connections 2024-09-10T22:43:18.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.810+0000 7f6bdd000640 1 --2- 172.21.15.103:0/1089725871 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6bb8072610 0x7f6bb8074ad0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.810+0000 7f6bdd000640 1 --2- 172.21.15.103:0/1089725871 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bd80cf260 0x7f6bd80b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.810+0000 7f6bdd000640 1 --2- 172.21.15.103:0/1089725871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bd80b3320 0x7f6bd814b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.810+0000 7f6bdd000640 1 --2- 172.21.15.103:0/1089725871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bd8072a40 0x7f6bd80b1fb0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:18.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.810+0000 7f6bdd000640 1 -- 172.21.15.103:0/1089725871 >> 172.21.15.103:0/1089725871 conn(0x7f6bd806cc00 msgr2=0x7f6bd8151b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:18.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.810+0000 7f6bdd000640 1 -- 172.21.15.103:0/1089725871 shutdown_connections 2024-09-10T22:43:18.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:18.810+0000 7f6bdd000640 1 -- 172.21.15.103:0/1089725871 wait complete. 2024-09-10T22:43:18.834 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-09-10T22:43:18.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:43:18.835 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T22:43:18.852 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[42422]: fuse finished with error 0 and tester_r 0 2024-09-10T22:43:18.855 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:43:18.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:43:18.855 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T22:43:18.948 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:43:18.948 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:43:18.948 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:43:18.957 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:43:18.958 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:43:18.958 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:43:18.958 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:43:19.000 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350248k,nr_inodes=4087562,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3542 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T22:43:19.000 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:43:19.000 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:43:19.000 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:43:19.009 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:43:19.009 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:43:19.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.174+0000 7f2df8a00640 1 -- 172.21.15.103:0/976806257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df40cf790 msgr2=0x7f2df40cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:19.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.174+0000 7f2df8a00640 1 --2- 172.21.15.103:0/976806257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df40cf790 0x7f2df40cfc20 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f2dec009c80 tx=0x7f2dec01cd10 comp rx=0 tx=0).stop 2024-09-10T22:43:19.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.174+0000 7f2df8a00640 1 -- 172.21.15.103:0/976806257 shutdown_connections 2024-09-10T22:43:19.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.174+0000 7f2df8a00640 1 --2- 172.21.15.103:0/976806257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df40cf790 0x7f2df40cfc20 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.174+0000 7f2df8a00640 1 --2- 172.21.15.103:0/976806257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2df40aeb40 0x7f2df4072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.174+0000 7f2df8a00640 1 -- 172.21.15.103:0/976806257 >> 172.21.15.103:0/976806257 conn(0x7f2df406cc00 msgr2=0x7f2df406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:19.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.174+0000 7f2df8a00640 1 -- 172.21.15.103:0/976806257 shutdown_connections 2024-09-10T22:43:19.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.174+0000 7f2df8a00640 1 -- 172.21.15.103:0/976806257 wait complete. 2024-09-10T22:43:19.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df8a00640 1 Processor -- start 2024-09-10T22:43:19.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df8a00640 1 -- start start 2024-09-10T22:43:19.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df8a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2df40aeb40 0x7f2df41547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:19.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df8a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df40cc120 0x7f2df40b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:19.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df8a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2df40cf790 0x7f2df4162670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:19.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df8a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2df4168c50 con 0x7f2df40cc120 2024-09-10T22:43:19.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df8a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2df4168ad0 con 0x7f2df40cf790 2024-09-10T22:43:19.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df8a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2df4168dd0 con 0x7f2df40aeb40 2024-09-10T22:43:19.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df40cc120 0x7f2df40b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:19.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df40cc120 0x7f2df40b1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51316/0 (socket says 172.21.15.103:51316) 2024-09-10T22:43:19.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df1400640 1 -- 172.21.15.103:0/3789412761 learned_addr learned my addr 172.21.15.103:0/3789412761 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:19.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df1e00640 1 --2- 172.21.15.103:0/3789412761 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2df40aeb40 0x7f2df41547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:19.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df2800640 1 --2- 172.21.15.103:0/3789412761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2df40cf790 0x7f2df4162670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:19.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df1400640 1 -- 172.21.15.103:0/3789412761 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2df40aeb40 msgr2=0x7f2df41547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:19.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df1400640 1 --2- 172.21.15.103:0/3789412761 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2df40aeb40 0x7f2df41547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df1400640 1 -- 172.21.15.103:0/3789412761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2df40cf790 msgr2=0x7f2df4162670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:19.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df1400640 1 --2- 172.21.15.103:0/3789412761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2df40cf790 0x7f2df4162670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df1400640 1 -- 172.21.15.103:0/3789412761 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df4154fa0 con 0x7f2df40cc120 2024-09-10T22:43:19.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df1400640 1 --2- 172.21.15.103:0/3789412761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df40cc120 0x7f2df40b1cb0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2de000d980 tx=0x7f2de000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:19.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2dea000640 1 -- 172.21.15.103:0/3789412761 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0017070 con 0x7f2df40cc120 2024-09-10T22:43:19.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2dea000640 1 -- 172.21.15.103:0/3789412761 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2de0009d60 con 0x7f2df40cc120 2024-09-10T22:43:19.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df8a00640 1 -- 172.21.15.103:0/3789412761 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df4155240 con 0x7f2df40cc120 2024-09-10T22:43:19.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2dea000640 1 -- 172.21.15.103:0/3789412761 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0005280 con 0x7f2df40cc120 2024-09-10T22:43:19.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.178+0000 7f2df8a00640 1 -- 172.21.15.103:0/3789412761 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df4155800 con 0x7f2df40cc120 2024-09-10T22:43:19.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.182+0000 7f2df8a00640 1 -- 172.21.15.103:0/3789412761 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2df4072e30 con 0x7f2df40cc120 2024-09-10T22:43:19.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.182+0000 7f2dea000640 1 -- 172.21.15.103:0/3789412761 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2de0005420 con 0x7f2df40cc120 2024-09-10T22:43:19.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.182+0000 7f2dea000640 1 --2- 172.21.15.103:0/3789412761 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2dd40725e0 0x7f2dd4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:19.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.182+0000 7f2dea000640 1 -- 172.21.15.103:0/3789412761 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f2de0093610 con 0x7f2df40cc120 2024-09-10T22:43:19.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.182+0000 7f2df1e00640 1 --2- 172.21.15.103:0/3789412761 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2dd40725e0 0x7f2dd4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:19.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.182+0000 7f2df1e00640 1 --2- 172.21.15.103:0/3789412761 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2dd40725e0 0x7f2dd4074aa0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2de4007fd0 tx=0x7f2de4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:19.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.186+0000 7f2dea000640 1 -- 172.21.15.103:0/3789412761 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2de005e3e0 con 0x7f2df40cc120 2024-09-10T22:43:19.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.386+0000 7f2df8a00640 1 -- 172.21.15.103:0/3789412761 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2df40008e0 con 0x7f2df40cc120 2024-09-10T22:43:19.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.386+0000 7f2dea000640 1 -- 172.21.15.103:0/3789412761 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5277 (secure 0 0 0) 0x7f2de0067150 con 0x7f2df40cc120 2024-09-10T22:43:19.391 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:19.391 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":64,"btime":"2024-09-10T22:42:50:788014+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2961968581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2961968581},{"type":"v1","addr":"172.21.15.131:6835","nonce":2961968581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:42:16.725541+0000","modified":"2024-09-10T22:42:50.419978+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6285,"mds_1":6276,"mds_2":5630},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5630":{"gid":5630,"name":"b","rank":2,"incarnation":58,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6837/360467048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":360467048},{"type":"v1","addr":"172.21.15.131:6837","nonce":360467048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6276":{"gid":6276,"name":"c","rank":1,"incarnation":56,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6833/4171945106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4171945106},{"type":"v1","addr":"172.21.15.103:6833","nonce":4171945106}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/714242556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":714242556},{"type":"v1","addr":"172.21.15.103:6835","nonce":714242556}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6285,"qdb_cluster":[6285,6276,5630]},"id":4}]} 2024-09-10T22:43:19.392 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 64 2024-09-10T22:43:19.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.390+0000 7f2df8a00640 1 -- 172.21.15.103:0/3789412761 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2dd40725e0 msgr2=0x7f2dd4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:19.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.390+0000 7f2df8a00640 1 --2- 172.21.15.103:0/3789412761 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2dd40725e0 0x7f2dd4074aa0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2de4007fd0 tx=0x7f2de4009040 comp rx=0 tx=0).stop 2024-09-10T22:43:19.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.390+0000 7f2df8a00640 1 -- 172.21.15.103:0/3789412761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df40cc120 msgr2=0x7f2df40b1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:19.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.390+0000 7f2df8a00640 1 --2- 172.21.15.103:0/3789412761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df40cc120 0x7f2df40b1cb0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2de000d980 tx=0x7f2de000de40 comp rx=0 tx=0).stop 2024-09-10T22:43:19.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.390+0000 7f2df8a00640 1 -- 172.21.15.103:0/3789412761 shutdown_connections 2024-09-10T22:43:19.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.390+0000 7f2df8a00640 1 --2- 172.21.15.103:0/3789412761 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2dd40725e0 0x7f2dd4074aa0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.390+0000 7f2df8a00640 1 --2- 172.21.15.103:0/3789412761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2df40cf790 0x7f2df4162670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.390+0000 7f2df8a00640 1 --2- 172.21.15.103:0/3789412761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df40cc120 0x7f2df40b1cb0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.390+0000 7f2df8a00640 1 --2- 172.21.15.103:0/3789412761 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2df40aeb40 0x7f2df41547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.390+0000 7f2df8a00640 1 -- 172.21.15.103:0/3789412761 >> 172.21.15.103:0/3789412761 conn(0x7f2df406cc00 msgr2=0x7f2df415c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:19.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.390+0000 7f2df8a00640 1 -- 172.21.15.103:0/3789412761 shutdown_connections 2024-09-10T22:43:19.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.390+0000 7f2df8a00640 1 -- 172.21.15.103:0/3789412761 wait complete. 2024-09-10T22:43:19.414 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:43:19.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.550+0000 7f315de00640 1 -- 172.21.15.103:0/84220554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31580b09c0 msgr2=0x7f31580ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:19.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.550+0000 7f315de00640 1 --2- 172.21.15.103:0/84220554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31580b09c0 0x7f31580ce7d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f3140009840 tx=0x7f314001c790 comp rx=0 tx=0).stop 2024-09-10T22:43:19.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.550+0000 7f315de00640 1 -- 172.21.15.103:0/84220554 shutdown_connections 2024-09-10T22:43:19.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.550+0000 7f315de00640 1 --2- 172.21.15.103:0/84220554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31580b09c0 0x7f31580ce7d0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.550+0000 7f315de00640 1 -- 172.21.15.103:0/84220554 >> 172.21.15.103:0/84220554 conn(0x7f31580d1ac0 msgr2=0x7f31580d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:19.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.550+0000 7f315de00640 1 -- 172.21.15.103:0/84220554 shutdown_connections 2024-09-10T22:43:19.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.550+0000 7f315de00640 1 -- 172.21.15.103:0/84220554 wait complete. 2024-09-10T22:43:19.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f315de00640 1 Processor -- start 2024-09-10T22:43:19.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f315de00640 1 -- start start 2024-09-10T22:43:19.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f315de00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31580ae9c0 0x7f31580b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:19.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f315de00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31580b09c0 0x7f3158157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:19.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f315de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f315815be30 0x7f315806ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:19.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f315de00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3158169e00 con 0x7f315815be30 2024-09-10T22:43:19.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f315de00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3158169c80 con 0x7f31580b09c0 2024-09-10T22:43:19.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f315de00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3158169f80 con 0x7f31580ae9c0 2024-09-10T22:43:19.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f3157400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f315815be30 0x7f315806ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:19.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f3157400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f315815be30 0x7f315806ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51336/0 (socket says 172.21.15.103:51336) 2024-09-10T22:43:19.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f3157400640 1 -- 172.21.15.103:0/921616445 learned_addr learned my addr 172.21.15.103:0/921616445 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:19.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f314e000640 1 --2- 172.21.15.103:0/921616445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31580b09c0 0x7f3158157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:19.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f3156a00640 1 --2- 172.21.15.103:0/921616445 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31580ae9c0 0x7f31580b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:19.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f3157400640 1 -- 172.21.15.103:0/921616445 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31580ae9c0 msgr2=0x7f31580b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:19.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f3157400640 1 --2- 172.21.15.103:0/921616445 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31580ae9c0 0x7f31580b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f3157400640 1 -- 172.21.15.103:0/921616445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31580b09c0 msgr2=0x7f3158157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:19.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f3157400640 1 --2- 172.21.15.103:0/921616445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31580b09c0 0x7f3158157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f3157400640 1 -- 172.21.15.103:0/921616445 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3158159f80 con 0x7f315815be30 2024-09-10T22:43:19.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f3156a00640 1 --2- 172.21.15.103:0/921616445 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31580ae9c0 0x7f31580b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:43:19.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f3157400640 1 --2- 172.21.15.103:0/921616445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f315815be30 0x7f315806ee40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f315000c7d0 tx=0x7f315000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:19.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f314fe00640 1 -- 172.21.15.103:0/921616445 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3150003b80 con 0x7f315815be30 2024-09-10T22:43:19.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f314fe00640 1 -- 172.21.15.103:0/921616445 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3150003d40 con 0x7f315815be30 2024-09-10T22:43:19.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f315de00640 1 -- 172.21.15.103:0/921616445 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315815a240 con 0x7f315815be30 2024-09-10T22:43:19.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f314fe00640 1 -- 172.21.15.103:0/921616445 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315000aab0 con 0x7f315815be30 2024-09-10T22:43:19.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.554+0000 7f315de00640 1 -- 172.21.15.103:0/921616445 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315815a800 con 0x7f315815be30 2024-09-10T22:43:19.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.558+0000 7f315de00640 1 -- 172.21.15.103:0/921616445 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31580aee10 con 0x7f315815be30 2024-09-10T22:43:19.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.558+0000 7f314fe00640 1 -- 172.21.15.103:0/921616445 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f315000ac50 con 0x7f315815be30 2024-09-10T22:43:19.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.558+0000 7f314fe00640 1 --2- 172.21.15.103:0/921616445 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31340725e0 0x7f3134074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:19.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.558+0000 7f314fe00640 1 -- 172.21.15.103:0/921616445 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f3150093260 con 0x7f315815be30 2024-09-10T22:43:19.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.558+0000 7f3156a00640 1 --2- 172.21.15.103:0/921616445 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31340725e0 0x7f3134074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:19.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.558+0000 7f3156a00640 1 --2- 172.21.15.103:0/921616445 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31340725e0 0x7f3134074aa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f31480046c0 tx=0x7f3148009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:19.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.562+0000 7f314fe00640 1 -- 172.21.15.103:0/921616445 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f315005e710 con 0x7f315815be30 2024-09-10T22:43:19.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.762+0000 7f315de00640 1 -- 172.21.15.103:0/921616445 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3158154e10 con 0x7f315815be30 2024-09-10T22:43:19.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.762+0000 7f314fe00640 1 -- 172.21.15.103:0/921616445 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5277 (secure 0 0 0) 0x7f315005e010 con 0x7f315815be30 2024-09-10T22:43:19.765 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:19.766 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":64,"btime":"2024-09-10T22:42:50:788014+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2961968581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2961968581},{"type":"v1","addr":"172.21.15.131:6835","nonce":2961968581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:42:16.725541+0000","modified":"2024-09-10T22:42:50.419978+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6285,"mds_1":6276,"mds_2":5630},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5630":{"gid":5630,"name":"b","rank":2,"incarnation":58,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6837/360467048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":360467048},{"type":"v1","addr":"172.21.15.131:6837","nonce":360467048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6276":{"gid":6276,"name":"c","rank":1,"incarnation":56,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6833/4171945106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4171945106},{"type":"v1","addr":"172.21.15.103:6833","nonce":4171945106}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/714242556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":714242556},{"type":"v1","addr":"172.21.15.103:6835","nonce":714242556}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6285,"qdb_cluster":[6285,6276,5630]},"id":4}]} 2024-09-10T22:43:19.766 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 64 2024-09-10T22:43:19.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.762+0000 7f315de00640 1 -- 172.21.15.103:0/921616445 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31340725e0 msgr2=0x7f3134074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:19.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.762+0000 7f315de00640 1 --2- 172.21.15.103:0/921616445 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31340725e0 0x7f3134074aa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f31480046c0 tx=0x7f3148009040 comp rx=0 tx=0).stop 2024-09-10T22:43:19.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.762+0000 7f315de00640 1 -- 172.21.15.103:0/921616445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f315815be30 msgr2=0x7f315806ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:19.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.762+0000 7f315de00640 1 --2- 172.21.15.103:0/921616445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f315815be30 0x7f315806ee40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f315000c7d0 tx=0x7f315000cc90 comp rx=0 tx=0).stop 2024-09-10T22:43:19.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.762+0000 7f315de00640 1 -- 172.21.15.103:0/921616445 shutdown_connections 2024-09-10T22:43:19.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.762+0000 7f315de00640 1 --2- 172.21.15.103:0/921616445 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31340725e0 0x7f3134074aa0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.762+0000 7f315de00640 1 --2- 172.21.15.103:0/921616445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f315815be30 0x7f315806ee40 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.762+0000 7f315de00640 1 --2- 172.21.15.103:0/921616445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31580b09c0 0x7f3158157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.762+0000 7f315de00640 1 --2- 172.21.15.103:0/921616445 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31580ae9c0 0x7f31580b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.762+0000 7f315de00640 1 -- 172.21.15.103:0/921616445 >> 172.21.15.103:0/921616445 conn(0x7f31580d1ac0 msgr2=0x7f31580b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:19.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.762+0000 7f315de00640 1 -- 172.21.15.103:0/921616445 shutdown_connections 2024-09-10T22:43:19.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.762+0000 7f315de00640 1 -- 172.21.15.103:0/921616445 wait complete. 2024-09-10T22:43:19.788 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:43:19.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.926+0000 7f553a000640 1 -- 172.21.15.103:0/1803252708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55340ae9c0 msgr2=0x7f55340aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:19.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.926+0000 7f553a000640 1 --2- 172.21.15.103:0/1803252708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55340ae9c0 0x7f55340aee50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f552c009c80 tx=0x7f552c01cd10 comp rx=0 tx=0).stop 2024-09-10T22:43:19.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.926+0000 7f553a000640 1 -- 172.21.15.103:0/1803252708 shutdown_connections 2024-09-10T22:43:19.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.926+0000 7f553a000640 1 --2- 172.21.15.103:0/1803252708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55340ae9c0 0x7f55340aee50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.926+0000 7f553a000640 1 --2- 172.21.15.103:0/1803252708 >> v2:172.21.15.131:3300/0 conn(0x7f553415be30 0x7f55340ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.926+0000 7f553a000640 1 -- 172.21.15.103:0/1803252708 >> 172.21.15.103:0/1803252708 conn(0x7f55340d1ac0 msgr2=0x7f55340d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:19.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.926+0000 7f553a000640 1 -- 172.21.15.103:0/1803252708 shutdown_connections 2024-09-10T22:43:19.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.926+0000 7f553a000640 1 -- 172.21.15.103:0/1803252708 wait complete. 2024-09-10T22:43:19.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f553a000640 1 Processor -- start 2024-09-10T22:43:19.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f553a000640 1 -- start start 2024-09-10T22:43:19.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f553a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55340ae9c0 0x7f5534155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:19.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f553a000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55340b09c0 0x7f55341f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:19.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f553a000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f553415be30 0x7f553414ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:19.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f553a000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5534168df0 con 0x7f55340ae9c0 2024-09-10T22:43:19.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f553a000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5534168c70 con 0x7f553415be30 2024-09-10T22:43:19.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f553a000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5534168f70 con 0x7f55340b09c0 2024-09-10T22:43:19.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f5533400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55340ae9c0 0x7f5534155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:19.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f5533400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55340ae9c0 0x7f5534155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51342/0 (socket says 172.21.15.103:51342) 2024-09-10T22:43:19.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f5533400640 1 -- 172.21.15.103:0/297279894 learned_addr learned my addr 172.21.15.103:0/297279894 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:19.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f552aa00640 1 --2- 172.21.15.103:0/297279894 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55340b09c0 0x7f55341f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:19.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f5533e00640 1 --2- 172.21.15.103:0/297279894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f553415be30 0x7f553414ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:19.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f5533400640 1 -- 172.21.15.103:0/297279894 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55340b09c0 msgr2=0x7f55341f7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:19.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f5533400640 1 --2- 172.21.15.103:0/297279894 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55340b09c0 0x7f55341f7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f5533400640 1 -- 172.21.15.103:0/297279894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f553415be30 msgr2=0x7f553414ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:19.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f5533400640 1 --2- 172.21.15.103:0/297279894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f553415be30 0x7f553414ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:19.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f5533400640 1 -- 172.21.15.103:0/297279894 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553414d1f0 con 0x7f55340ae9c0 2024-09-10T22:43:19.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f5533400640 1 --2- 172.21.15.103:0/297279894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55340ae9c0 0x7f5534155450 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f552400e970 tx=0x7f552400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:19.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f552be00640 1 -- 172.21.15.103:0/297279894 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552400cd20 con 0x7f55340ae9c0 2024-09-10T22:43:19.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f552be00640 1 -- 172.21.15.103:0/297279894 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5524004020 con 0x7f55340ae9c0 2024-09-10T22:43:19.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f552be00640 1 -- 172.21.15.103:0/297279894 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524004470 con 0x7f55340ae9c0 2024-09-10T22:43:19.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f553a000640 1 -- 172.21.15.103:0/297279894 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553414d530 con 0x7f55340ae9c0 2024-09-10T22:43:19.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f553a000640 1 -- 172.21.15.103:0/297279894 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55341f8560 con 0x7f55340ae9c0 2024-09-10T22:43:19.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.930+0000 7f553a000640 1 -- 172.21.15.103:0/297279894 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55340aee50 con 0x7f55340ae9c0 2024-09-10T22:43:19.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.934+0000 7f552be00640 1 -- 172.21.15.103:0/297279894 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5524003600 con 0x7f55340ae9c0 2024-09-10T22:43:19.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.934+0000 7f552be00640 1 --2- 172.21.15.103:0/297279894 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5510072610 0x7f5510074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:19.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.934+0000 7f552be00640 1 -- 172.21.15.103:0/297279894 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f5524093d20 con 0x7f55340ae9c0 2024-09-10T22:43:19.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.934+0000 7f552aa00640 1 --2- 172.21.15.103:0/297279894 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5510072610 0x7f5510074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:19.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.934+0000 7f552aa00640 1 --2- 172.21.15.103:0/297279894 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5510072610 0x7f5510074ad0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f55340c8af0 tx=0x7f551c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:19.938+0000 7f552be00640 1 -- 172.21.15.103:0/297279894 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f552405eaf0 con 0x7f55340ae9c0 2024-09-10T22:43:20.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.102+0000 7f553a000640 1 -- 172.21.15.103:0/297279894 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5534072280 con 0x7f55340ae9c0 2024-09-10T22:43:20.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.106+0000 7f552be00640 1 -- 172.21.15.103:0/297279894 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+17243 (secure 0 0 0) 0x7f5524063520 con 0x7f55340ae9c0 2024-09-10T22:43:20.109 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:20.110 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":70,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:42:32.426437+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:42:14.413275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-10T22:42:15.686998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.10","mappings":[{"from":7,"to":2}]},{"pgid":"10.2","mappings":[{"from":4,"to":5}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.19","mappings":[{"from":1,"to":3}]},{"pgid":"10.3d","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:43:20.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.106+0000 7f553a000640 1 -- 172.21.15.103:0/297279894 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5510072610 msgr2=0x7f5510074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:20.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.106+0000 7f553a000640 1 --2- 172.21.15.103:0/297279894 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5510072610 0x7f5510074ad0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f55340c8af0 tx=0x7f551c009040 comp rx=0 tx=0).stop 2024-09-10T22:43:20.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.106+0000 7f553a000640 1 -- 172.21.15.103:0/297279894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55340ae9c0 msgr2=0x7f5534155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:20.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.106+0000 7f553a000640 1 --2- 172.21.15.103:0/297279894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55340ae9c0 0x7f5534155450 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f552400e970 tx=0x7f552400ee30 comp rx=0 tx=0).stop 2024-09-10T22:43:20.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.106+0000 7f553a000640 1 -- 172.21.15.103:0/297279894 shutdown_connections 2024-09-10T22:43:20.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.106+0000 7f553a000640 1 --2- 172.21.15.103:0/297279894 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5510072610 0x7f5510074ad0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.106+0000 7f553a000640 1 --2- 172.21.15.103:0/297279894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f553415be30 0x7f553414ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.106+0000 7f553a000640 1 --2- 172.21.15.103:0/297279894 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55340b09c0 0x7f55341f7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.106+0000 7f553a000640 1 --2- 172.21.15.103:0/297279894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55340ae9c0 0x7f5534155450 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.106+0000 7f553a000640 1 -- 172.21.15.103:0/297279894 >> 172.21.15.103:0/297279894 conn(0x7f55340d1ac0 msgr2=0x7f55340ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:20.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.106+0000 7f553a000640 1 -- 172.21.15.103:0/297279894 shutdown_connections 2024-09-10T22:43:20.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.106+0000 7f553a000640 1 -- 172.21.15.103:0/297279894 wait complete. 2024-09-10T22:43:20.131 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T22:43:20.132 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:43:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.270+0000 7f724ae00640 1 -- 172.21.15.103:0/1405378295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7228003a10 msgr2=0x7f7228003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.270+0000 7f724ae00640 1 --2- 172.21.15.103:0/1405378295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7228003a10 0x7f7228003df0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7234001ec0 tx=0x7f723401cc20 comp rx=0 tx=0).stop 2024-09-10T22:43:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.270+0000 7f724ae00640 1 -- 172.21.15.103:0/1405378295 shutdown_connections 2024-09-10T22:43:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.270+0000 7f724ae00640 1 --2- 172.21.15.103:0/1405378295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7228003a10 0x7f7228003df0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.270+0000 7f724ae00640 1 -- 172.21.15.103:0/1405378295 >> 172.21.15.103:0/1405378295 conn(0x7f72440d1ab0 msgr2=0x7f72440d1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.270+0000 7f724ae00640 1 -- 172.21.15.103:0/1405378295 shutdown_connections 2024-09-10T22:43:20.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.270+0000 7f724ae00640 1 -- 172.21.15.103:0/1405378295 wait complete. 2024-09-10T22:43:20.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.270+0000 7f724ae00640 1 Processor -- start 2024-09-10T22:43:20.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.270+0000 7f724ae00640 1 -- start start 2024-09-10T22:43:20.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f724ae00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7228003a10 0x7f72440c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:20.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f724ae00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f724415e370 0x7f7244152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:20.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f724ae00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72440b6620 0x7f72440b6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:20.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f724ae00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f72440ce4c0 con 0x7f724415e370 2024-09-10T22:43:20.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f724ae00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f72440d0820 con 0x7f72440b6620 2024-09-10T22:43:20.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f724ae00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f72440ce640 con 0x7f7228003a10 2024-09-10T22:43:20.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f723b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f724415e370 0x7f7244152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:20.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f723b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f724415e370 0x7f7244152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51358/0 (socket says 172.21.15.103:51358) 2024-09-10T22:43:20.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f723b400640 1 -- 172.21.15.103:0/3265503194 learned_addr learned my addr 172.21.15.103:0/3265503194 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:20.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f7243e00640 1 --2- 172.21.15.103:0/3265503194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7228003a10 0x7f72440c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:20.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f7248e00640 1 --2- 172.21.15.103:0/3265503194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72440b6620 0x7f72440b6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:20.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f723b400640 1 -- 172.21.15.103:0/3265503194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7228003a10 msgr2=0x7f72440c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:20.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f723b400640 1 --2- 172.21.15.103:0/3265503194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7228003a10 0x7f72440c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f723b400640 1 -- 172.21.15.103:0/3265503194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72440b6620 msgr2=0x7f72440b6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:20.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f723b400640 1 --2- 172.21.15.103:0/3265503194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72440b6620 0x7f72440b6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f723b400640 1 -- 172.21.15.103:0/3265503194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72440c8ef0 con 0x7f724415e370 2024-09-10T22:43:20.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f723b400640 1 --2- 172.21.15.103:0/3265503194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f724415e370 0x7f7244152b00 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f722c006400 tx=0x7f722c0039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:20.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f7240c00640 1 -- 172.21.15.103:0/3265503194 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c015070 con 0x7f724415e370 2024-09-10T22:43:20.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f7240c00640 1 -- 172.21.15.103:0/3265503194 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f722c011860 con 0x7f724415e370 2024-09-10T22:43:20.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f7240c00640 1 -- 172.21.15.103:0/3265503194 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c011cb0 con 0x7f724415e370 2024-09-10T22:43:20.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f724ae00640 1 -- 172.21.15.103:0/3265503194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72440b5b40 con 0x7f724415e370 2024-09-10T22:43:20.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f724ae00640 1 -- 172.21.15.103:0/3265503194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72440b6100 con 0x7f724415e370 2024-09-10T22:43:20.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f724ae00640 1 -- 172.21.15.103:0/3265503194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72440b6300 con 0x7f724415e370 2024-09-10T22:43:20.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.274+0000 7f7240c00640 1 -- 172.21.15.103:0/3265503194 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f722c0103c0 con 0x7f724415e370 2024-09-10T22:43:20.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.278+0000 7f7240c00640 1 --2- 172.21.15.103:0/3265503194 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f72200725e0 0x7f7220074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:20.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.278+0000 7f7240c00640 1 -- 172.21.15.103:0/3265503194 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f722c0941d0 con 0x7f724415e370 2024-09-10T22:43:20.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.278+0000 7f7243e00640 1 --2- 172.21.15.103:0/3265503194 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f72200725e0 0x7f7220074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:20.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.278+0000 7f7243e00640 1 --2- 172.21.15.103:0/3265503194 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f72200725e0 0x7f7220074aa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f72340ac000 tx=0x7f72340199c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:20.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.282+0000 7f7240c00640 1 -- 172.21.15.103:0/3265503194 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f72440b6300 con 0x7f724415e370 2024-09-10T22:43:20.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.482+0000 7f724ae00640 1 -- 172.21.15.103:0/3265503194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72440b5930 con 0x7f724415e370 2024-09-10T22:43:20.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.482+0000 7f7240c00640 1 -- 172.21.15.103:0/3265503194 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5277 (secure 0 0 0) 0x7f722c05f040 con 0x7f724415e370 2024-09-10T22:43:20.487 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:20.487 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":64,"btime":"2024-09-10T22:42:50:788014+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2961968581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2961968581},{"type":"v1","addr":"172.21.15.131:6835","nonce":2961968581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:42:16.725541+0000","modified":"2024-09-10T22:42:50.419978+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6285,"mds_1":6276,"mds_2":5630},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5630":{"gid":5630,"name":"b","rank":2,"incarnation":58,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6837/360467048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":360467048},{"type":"v1","addr":"172.21.15.131:6837","nonce":360467048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6276":{"gid":6276,"name":"c","rank":1,"incarnation":56,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6833/4171945106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4171945106},{"type":"v1","addr":"172.21.15.103:6833","nonce":4171945106}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/714242556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":714242556},{"type":"v1","addr":"172.21.15.103:6835","nonce":714242556}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6285,"qdb_cluster":[6285,6276,5630]},"id":4}]} 2024-09-10T22:43:20.487 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 64 2024-09-10T22:43:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.486+0000 7f724ae00640 1 -- 172.21.15.103:0/3265503194 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f72200725e0 msgr2=0x7f7220074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.486+0000 7f724ae00640 1 --2- 172.21.15.103:0/3265503194 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f72200725e0 0x7f7220074aa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f72340ac000 tx=0x7f72340199c0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.486+0000 7f724ae00640 1 -- 172.21.15.103:0/3265503194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f724415e370 msgr2=0x7f7244152b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.486+0000 7f724ae00640 1 --2- 172.21.15.103:0/3265503194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f724415e370 0x7f7244152b00 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f722c006400 tx=0x7f722c0039d0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.486+0000 7f724ae00640 1 -- 172.21.15.103:0/3265503194 shutdown_connections 2024-09-10T22:43:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.486+0000 7f724ae00640 1 --2- 172.21.15.103:0/3265503194 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f72200725e0 0x7f7220074aa0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.486+0000 7f724ae00640 1 --2- 172.21.15.103:0/3265503194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72440b6620 0x7f72440b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.486+0000 7f724ae00640 1 --2- 172.21.15.103:0/3265503194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f724415e370 0x7f7244152b00 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.486+0000 7f724ae00640 1 --2- 172.21.15.103:0/3265503194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7228003a10 0x7f72440c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.486+0000 7f724ae00640 1 -- 172.21.15.103:0/3265503194 >> 172.21.15.103:0/3265503194 conn(0x7f72440d1ab0 msgr2=0x7f72440706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.486+0000 7f724ae00640 1 -- 172.21.15.103:0/3265503194 shutdown_connections 2024-09-10T22:43:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.486+0000 7f724ae00640 1 -- 172.21.15.103:0/3265503194 wait complete. 2024-09-10T22:43:20.509 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:43:20.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.646+0000 7f3352000640 1 -- 172.21.15.103:0/1195558373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f334c0cf3b0 msgr2=0x7f334c06df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:20.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.646+0000 7f3352000640 1 --2- 172.21.15.103:0/1195558373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f334c0cf3b0 0x7f334c06df40 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f334c15e3c0 tx=0x7f333c01c8a0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.646+0000 7f3352000640 1 -- 172.21.15.103:0/1195558373 shutdown_connections 2024-09-10T22:43:20.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.646+0000 7f3352000640 1 --2- 172.21.15.103:0/1195558373 >> v2:172.21.15.131:3300/0 conn(0x7f334c0c61b0 0x7f334c0c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.646+0000 7f3352000640 1 --2- 172.21.15.103:0/1195558373 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f334c15d9f0 0x7f334c0ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.646+0000 7f3352000640 1 --2- 172.21.15.103:0/1195558373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f334c0cf3b0 0x7f334c06df40 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.646+0000 7f3352000640 1 -- 172.21.15.103:0/1195558373 >> 172.21.15.103:0/1195558373 conn(0x7f334c0cff60 msgr2=0x7f334c0d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:20.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.646+0000 7f3352000640 1 -- 172.21.15.103:0/1195558373 shutdown_connections 2024-09-10T22:43:20.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.646+0000 7f3352000640 1 -- 172.21.15.103:0/1195558373 wait complete. 2024-09-10T22:43:20.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3352000640 1 Processor -- start 2024-09-10T22:43:20.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3352000640 1 -- start start 2024-09-10T22:43:20.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3352000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f334c0c61b0 0x7f334c1fb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:20.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3352000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f334c0cf3b0 0x7f334c1421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:20.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3352000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f334c15d9f0 0x7f334c0b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:20.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3352000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f334c06d490 con 0x7f334c15d9f0 2024-09-10T22:43:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3352000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f334c06d310 con 0x7f334c0cf3b0 2024-09-10T22:43:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3352000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f334c06d610 con 0x7f334c0c61b0 2024-09-10T22:43:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3351600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f334c15d9f0 0x7f334c0b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3351600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f334c15d9f0 0x7f334c0b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51374/0 (socket says 172.21.15.103:51374) 2024-09-10T22:43:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3351600640 1 -- 172.21.15.103:0/2410387345 learned_addr learned my addr 172.21.15.103:0/2410387345 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3350c00640 1 --2- 172.21.15.103:0/2410387345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f334c0c61b0 0x7f334c1fb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3343e00640 1 --2- 172.21.15.103:0/2410387345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f334c0cf3b0 0x7f334c1421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3351600640 1 -- 172.21.15.103:0/2410387345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f334c0c61b0 msgr2=0x7f334c1fb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3351600640 1 --2- 172.21.15.103:0/2410387345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f334c0c61b0 0x7f334c1fb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3351600640 1 -- 172.21.15.103:0/2410387345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f334c0cf3b0 msgr2=0x7f334c1421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:20.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3351600640 1 --2- 172.21.15.103:0/2410387345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f334c0cf3b0 0x7f334c1421b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3351600640 1 -- 172.21.15.103:0/2410387345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334c142a00 con 0x7f334c15d9f0 2024-09-10T22:43:20.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3351600640 1 --2- 172.21.15.103:0/2410387345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f334c15d9f0 0x7f334c0b0cb0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f334400b970 tx=0x7f334400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:20.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3349600640 1 -- 172.21.15.103:0/2410387345 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3344019070 con 0x7f334c15d9f0 2024-09-10T22:43:20.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3349600640 1 -- 172.21.15.103:0/2410387345 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f334400cc50 con 0x7f334c15d9f0 2024-09-10T22:43:20.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3352000640 1 -- 172.21.15.103:0/2410387345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f334c142ce0 con 0x7f334c15d9f0 2024-09-10T22:43:20.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3349600640 1 -- 172.21.15.103:0/2410387345 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33440146a0 con 0x7f334c15d9f0 2024-09-10T22:43:20.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.650+0000 7f3352000640 1 -- 172.21.15.103:0/2410387345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f334c0c8760 con 0x7f334c15d9f0 2024-09-10T22:43:20.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.654+0000 7f3352000640 1 -- 172.21.15.103:0/2410387345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f334c06df40 con 0x7f334c15d9f0 2024-09-10T22:43:20.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.654+0000 7f3349600640 1 -- 172.21.15.103:0/2410387345 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f334401d3b0 con 0x7f334c15d9f0 2024-09-10T22:43:20.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.654+0000 7f3349600640 1 --2- 172.21.15.103:0/2410387345 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33280725e0 0x7f3328074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.654+0000 7f3349600640 1 -- 172.21.15.103:0/2410387345 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f33440933e0 con 0x7f334c15d9f0 2024-09-10T22:43:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.654+0000 7f3350c00640 1 --2- 172.21.15.103:0/2410387345 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33280725e0 0x7f3328074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.654+0000 7f3350c00640 1 --2- 172.21.15.103:0/2410387345 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33280725e0 0x7f3328074aa0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f333c0af000 tx=0x7f333c01b0e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:20.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.658+0000 7f3349600640 1 -- 172.21.15.103:0/2410387345 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f334405e2e0 con 0x7f334c15d9f0 2024-09-10T22:43:20.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.858+0000 7f3352000640 1 -- 172.21.15.103:0/2410387345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f334c155080 con 0x7f334c15d9f0 2024-09-10T22:43:20.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.862+0000 7f3349600640 1 -- 172.21.15.103:0/2410387345 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5277 (secure 0 0 0) 0x7f3344062d10 con 0x7f334c15d9f0 2024-09-10T22:43:20.867 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:20.867 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":64,"btime":"2024-09-10T22:42:50:788014+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2961968581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2961968581},{"type":"v1","addr":"172.21.15.131:6835","nonce":2961968581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:42:16.725541+0000","modified":"2024-09-10T22:42:50.419978+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6285,"mds_1":6276,"mds_2":5630},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5630":{"gid":5630,"name":"b","rank":2,"incarnation":58,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6837/360467048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":360467048},{"type":"v1","addr":"172.21.15.131:6837","nonce":360467048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6276":{"gid":6276,"name":"c","rank":1,"incarnation":56,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6833/4171945106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4171945106},{"type":"v1","addr":"172.21.15.103:6833","nonce":4171945106}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/714242556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":714242556},{"type":"v1","addr":"172.21.15.103:6835","nonce":714242556}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6285,"qdb_cluster":[6285,6276,5630]},"id":4}]} 2024-09-10T22:43:20.867 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 64 2024-09-10T22:43:20.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.866+0000 7f3352000640 1 -- 172.21.15.103:0/2410387345 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33280725e0 msgr2=0x7f3328074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:20.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.866+0000 7f3352000640 1 --2- 172.21.15.103:0/2410387345 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33280725e0 0x7f3328074aa0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f333c0af000 tx=0x7f333c01b0e0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.866+0000 7f3352000640 1 -- 172.21.15.103:0/2410387345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f334c15d9f0 msgr2=0x7f334c0b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:20.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.866+0000 7f3352000640 1 --2- 172.21.15.103:0/2410387345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f334c15d9f0 0x7f334c0b0cb0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f334400b970 tx=0x7f334400be30 comp rx=0 tx=0).stop 2024-09-10T22:43:20.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.866+0000 7f3352000640 1 -- 172.21.15.103:0/2410387345 shutdown_connections 2024-09-10T22:43:20.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.866+0000 7f3352000640 1 --2- 172.21.15.103:0/2410387345 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33280725e0 0x7f3328074aa0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.866+0000 7f3352000640 1 --2- 172.21.15.103:0/2410387345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f334c15d9f0 0x7f334c0b0cb0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.866+0000 7f3352000640 1 --2- 172.21.15.103:0/2410387345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f334c0cf3b0 0x7f334c1421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.866+0000 7f3352000640 1 --2- 172.21.15.103:0/2410387345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f334c0c61b0 0x7f334c1fb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:20.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.866+0000 7f3352000640 1 -- 172.21.15.103:0/2410387345 >> 172.21.15.103:0/2410387345 conn(0x7f334c0cff60 msgr2=0x7f334c0cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:20.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.866+0000 7f3352000640 1 -- 172.21.15.103:0/2410387345 shutdown_connections 2024-09-10T22:43:20.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:20.866+0000 7f3352000640 1 -- 172.21.15.103:0/2410387345 wait complete. 2024-09-10T22:43:20.889 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:43:21.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.026+0000 7f7675a00640 1 -- 172.21.15.103:0/2824001188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f767006d310 msgr2=0x7f76700b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:21.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.026+0000 7f7675a00640 1 --2- 172.21.15.103:0/2824001188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f767006d310 0x7f76700b3bf0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7670156440 tx=0x7f765c01c8c0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.026+0000 7f7675a00640 1 -- 172.21.15.103:0/2824001188 shutdown_connections 2024-09-10T22:43:21.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.026+0000 7f7675a00640 1 --2- 172.21.15.103:0/2824001188 >> v2:172.21.15.131:3300/0 conn(0x7f767015be00 0x7f76700b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.026+0000 7f7675a00640 1 --2- 172.21.15.103:0/2824001188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f767006d310 0x7f76700b3bf0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.026+0000 7f7675a00640 1 -- 172.21.15.103:0/2824001188 >> 172.21.15.103:0/2824001188 conn(0x7f767006dd10 msgr2=0x7f767006e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:21.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.026+0000 7f7675a00640 1 -- 172.21.15.103:0/2824001188 shutdown_connections 2024-09-10T22:43:21.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.026+0000 7f7675a00640 1 -- 172.21.15.103:0/2824001188 wait complete. 2024-09-10T22:43:21.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.026+0000 7f7675a00640 1 Processor -- start 2024-09-10T22:43:21.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.026+0000 7f7675a00640 1 -- start start 2024-09-10T22:43:21.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f7675a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f767006d310 0x7f76701fbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f7675a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76700afe90 0x7f7670150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f7675a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f767015be00 0x7f7670141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f7675a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7670169120 con 0x7f76700afe90 2024-09-10T22:43:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f7675a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7670168fa0 con 0x7f767006d310 2024-09-10T22:43:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f7675a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f76701692a0 con 0x7f767015be00 2024-09-10T22:43:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f766f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76700afe90 0x7f7670150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f766f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76700afe90 0x7f7670150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51380/0 (socket says 172.21.15.103:51380) 2024-09-10T22:43:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f766f400640 1 -- 172.21.15.103:0/3824973789 learned_addr learned my addr 172.21.15.103:0/3824973789 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f766f400640 1 -- 172.21.15.103:0/3824973789 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f767015be00 msgr2=0x7f7670141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f766f400640 1 --2- 172.21.15.103:0/3824973789 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f767015be00 0x7f7670141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f766f400640 1 -- 172.21.15.103:0/3824973789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f767006d310 msgr2=0x7f76701fbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f766fe00640 1 --2- 172.21.15.103:0/3824973789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f767006d310 0x7f76701fbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f766f400640 1 --2- 172.21.15.103:0/3824973789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f767006d310 0x7f76701fbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f766f400640 1 -- 172.21.15.103:0/3824973789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767014f750 con 0x7f76700afe90 2024-09-10T22:43:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f766fe00640 1 --2- 172.21.15.103:0/3824973789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f767006d310 0x7f76701fbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f766f400640 1 --2- 172.21.15.103:0/3824973789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76700afe90 0x7f7670150d20 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f765c009850 tx=0x7f765c005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f7667e00640 1 -- 172.21.15.103:0/3824973789 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c0b2040 con 0x7f76700afe90 2024-09-10T22:43:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f7667e00640 1 -- 172.21.15.103:0/3824973789 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f765c0bd070 con 0x7f76700afe90 2024-09-10T22:43:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f7667e00640 1 -- 172.21.15.103:0/3824973789 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c003600 con 0x7f76700afe90 2024-09-10T22:43:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f7675a00640 1 -- 172.21.15.103:0/3824973789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767014fa30 con 0x7f76700afe90 2024-09-10T22:43:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f7675a00640 1 -- 172.21.15.103:0/3824973789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f767014fff0 con 0x7f76700afe90 2024-09-10T22:43:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.030+0000 7f7675a00640 1 -- 172.21.15.103:0/3824973789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f767006cc00 con 0x7f76700afe90 2024-09-10T22:43:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.034+0000 7f7667e00640 1 -- 172.21.15.103:0/3824973789 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f765c0037a0 con 0x7f76700afe90 2024-09-10T22:43:21.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.034+0000 7f7667e00640 1 --2- 172.21.15.103:0/3824973789 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76500725e0 0x7f7650074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:21.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.034+0000 7f7667e00640 1 -- 172.21.15.103:0/3824973789 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f765c12df40 con 0x7f76700afe90 2024-09-10T22:43:21.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.034+0000 7f766fe00640 1 --2- 172.21.15.103:0/3824973789 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76500725e0 0x7f7650074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:21.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.034+0000 7f766fe00640 1 --2- 172.21.15.103:0/3824973789 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76500725e0 0x7f7650074aa0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7660000f70 tx=0x7f7660009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:21.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.038+0000 7f7667e00640 1 -- 172.21.15.103:0/3824973789 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f765c0164b0 con 0x7f76700afe90 2024-09-10T22:43:21.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.202+0000 7f7675a00640 1 -- 172.21.15.103:0/3824973789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f767006acc0 con 0x7f76700afe90 2024-09-10T22:43:21.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.202+0000 7f7667e00640 1 -- 172.21.15.103:0/3824973789 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+17243 (secure 0 0 0) 0x7f765c0f93f0 con 0x7f76700afe90 2024-09-10T22:43:21.207 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:21.207 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":70,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:42:32.426437+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:42:14.413275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-10T22:42:15.686998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.10","mappings":[{"from":7,"to":2}]},{"pgid":"10.2","mappings":[{"from":4,"to":5}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.19","mappings":[{"from":1,"to":3}]},{"pgid":"10.3d","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:43:21.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.206+0000 7f7675a00640 1 -- 172.21.15.103:0/3824973789 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76500725e0 msgr2=0x7f7650074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:21.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.206+0000 7f7675a00640 1 --2- 172.21.15.103:0/3824973789 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76500725e0 0x7f7650074aa0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7660000f70 tx=0x7f7660009040 comp rx=0 tx=0).stop 2024-09-10T22:43:21.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.206+0000 7f7675a00640 1 -- 172.21.15.103:0/3824973789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76700afe90 msgr2=0x7f7670150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:21.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.206+0000 7f7675a00640 1 --2- 172.21.15.103:0/3824973789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76700afe90 0x7f7670150d20 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f765c009850 tx=0x7f765c005e70 comp rx=0 tx=0).stop 2024-09-10T22:43:21.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.206+0000 7f7675a00640 1 -- 172.21.15.103:0/3824973789 shutdown_connections 2024-09-10T22:43:21.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.206+0000 7f7675a00640 1 --2- 172.21.15.103:0/3824973789 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76500725e0 0x7f7650074aa0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.206+0000 7f7675a00640 1 --2- 172.21.15.103:0/3824973789 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f767015be00 0x7f7670141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.206+0000 7f7675a00640 1 --2- 172.21.15.103:0/3824973789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76700afe90 0x7f7670150d20 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.206+0000 7f7675a00640 1 --2- 172.21.15.103:0/3824973789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f767006d310 0x7f76701fbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.206+0000 7f7675a00640 1 -- 172.21.15.103:0/3824973789 >> 172.21.15.103:0/3824973789 conn(0x7f767006dd10 msgr2=0x7f7670144e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:21.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.206+0000 7f7675a00640 1 -- 172.21.15.103:0/3824973789 shutdown_connections 2024-09-10T22:43:21.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.206+0000 7f7675a00640 1 -- 172.21.15.103:0/3824973789 wait complete. 2024-09-10T22:43:21.230 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T22:43:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.370+0000 7f1bfb200640 1 -- 172.21.15.103:0/4178142976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bfc0714d0 msgr2=0x7f1bfc0affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.370+0000 7f1bfb200640 1 --2- 172.21.15.103:0/4178142976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bfc0714d0 0x7f1bfc0affd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1be8009840 tx=0x7f1be801c790 comp rx=0 tx=0).stop 2024-09-10T22:43:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.370+0000 7f1bfb200640 1 -- 172.21.15.103:0/4178142976 shutdown_connections 2024-09-10T22:43:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.370+0000 7f1bfb200640 1 --2- 172.21.15.103:0/4178142976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bfc0b0510 0x7f1bfc070430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.370+0000 7f1bfb200640 1 --2- 172.21.15.103:0/4178142976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bfc0714d0 0x7f1bfc0affd0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.370+0000 7f1bfb200640 1 -- 172.21.15.103:0/4178142976 >> 172.21.15.103:0/4178142976 conn(0x7f1bfc0d18f0 msgr2=0x7f1bfc0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.370+0000 7f1bfb200640 1 -- 172.21.15.103:0/4178142976 shutdown_connections 2024-09-10T22:43:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.370+0000 7f1bfb200640 1 -- 172.21.15.103:0/4178142976 wait complete. 2024-09-10T22:43:21.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bfb200640 1 Processor -- start 2024-09-10T22:43:21.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bfb200640 1 -- start start 2024-09-10T22:43:21.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bfb200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bfc0714d0 0x7f1bfc14e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:21.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bfb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bfc0b0510 0x7f1bfc0b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:21.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bfb200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bfc15f0e0 0x7f1bfc155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:21.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bfb200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc168b20 con 0x7f1bfc0b0510 2024-09-10T22:43:21.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bfb200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc1689a0 con 0x7f1bfc0714d0 2024-09-10T22:43:21.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bfb200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1bfc168ca0 con 0x7f1bfc15f0e0 2024-09-10T22:43:21.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bf9400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bfc0b0510 0x7f1bfc0b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:21.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bf9400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bfc0b0510 0x7f1bfc0b64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51394/0 (socket says 172.21.15.103:51394) 2024-09-10T22:43:21.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bf9e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bfc0714d0 0x7f1bfc14e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:21.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bf9400640 1 -- 172.21.15.103:0/1100697908 learned_addr learned my addr 172.21.15.103:0/1100697908 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:21.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bfa800640 1 --2- 172.21.15.103:0/1100697908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bfc15f0e0 0x7f1bfc155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:21.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bf9400640 1 -- 172.21.15.103:0/1100697908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bfc15f0e0 msgr2=0x7f1bfc155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:21.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bf9400640 1 --2- 172.21.15.103:0/1100697908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bfc15f0e0 0x7f1bfc155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bf9400640 1 -- 172.21.15.103:0/1100697908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bfc0714d0 msgr2=0x7f1bfc14e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:21.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bf9400640 1 --2- 172.21.15.103:0/1100697908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bfc0714d0 0x7f1bfc14e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bf9400640 1 -- 172.21.15.103:0/1100697908 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bfc14e610 con 0x7f1bfc0b0510 2024-09-10T22:43:21.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bf9400640 1 --2- 172.21.15.103:0/1100697908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bfc0b0510 0x7f1bfc0b64d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1be8009790 tx=0x7f1be80a5540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:21.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bf2000640 1 -- 172.21.15.103:0/1100697908 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be80b2040 con 0x7f1bfc0b0510 2024-09-10T22:43:21.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bf2000640 1 -- 172.21.15.103:0/1100697908 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1be80043b0 con 0x7f1bfc0b0510 2024-09-10T22:43:21.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bfb200640 1 -- 172.21.15.103:0/1100697908 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bfc0b6e20 con 0x7f1bfc0b0510 2024-09-10T22:43:21.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bf2000640 1 -- 172.21.15.103:0/1100697908 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be8005280 con 0x7f1bfc0b0510 2024-09-10T22:43:21.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.374+0000 7f1bfb200640 1 -- 172.21.15.103:0/1100697908 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bfc0b73e0 con 0x7f1bfc0b0510 2024-09-10T22:43:21.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.378+0000 7f1bfb200640 1 -- 172.21.15.103:0/1100697908 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bfc0affd0 con 0x7f1bfc0b0510 2024-09-10T22:43:21.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.378+0000 7f1bf2000640 1 -- 172.21.15.103:0/1100697908 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1be80b5070 con 0x7f1bfc0b0510 2024-09-10T22:43:21.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.378+0000 7f1bf2000640 1 --2- 172.21.15.103:0/1100697908 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1bdc072610 0x7f1bdc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:21.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.378+0000 7f1bf2000640 1 -- 172.21.15.103:0/1100697908 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6246+0+0 (secure 0 0 0) 0x7f1be812cb30 con 0x7f1bfc0b0510 2024-09-10T22:43:21.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.378+0000 7f1bf9e00640 1 --2- 172.21.15.103:0/1100697908 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1bdc072610 0x7f1bdc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:21.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.378+0000 7f1bf9e00640 1 --2- 172.21.15.103:0/1100697908 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1bdc072610 0x7f1bdc074ad0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1bec007fd0 tx=0x7f1bec007ea0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:21.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.382+0000 7f1bf2000640 1 -- 172.21.15.103:0/1100697908 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1be8016410 con 0x7f1bfc0b0510 2024-09-10T22:43:21.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.578+0000 7f1bfb200640 1 -- 172.21.15.103:0/1100697908 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1bfc0b6a10 con 0x7f1bfc0b0510 2024-09-10T22:43:21.584 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-10T22:43:21.582+0000 7fb5aba00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:43:21.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.582+0000 7f1bf2000640 1 -- 172.21.15.103:0/1100697908 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v65) ==== 161+0+0 (secure 0 0 0) 0x7f1be80f7900 con 0x7f1bfc0b0510 2024-09-10T22:43:21.586 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T22:43:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.586+0000 7f1bfb200640 1 -- 172.21.15.103:0/1100697908 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1bdc072610 msgr2=0x7f1bdc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.586+0000 7f1bfb200640 1 --2- 172.21.15.103:0/1100697908 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1bdc072610 0x7f1bdc074ad0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1bec007fd0 tx=0x7f1bec007ea0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.586+0000 7f1bfb200640 1 -- 172.21.15.103:0/1100697908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bfc0b0510 msgr2=0x7f1bfc0b64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.586+0000 7f1bfb200640 1 --2- 172.21.15.103:0/1100697908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bfc0b0510 0x7f1bfc0b64d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1be8009790 tx=0x7f1be80a5540 comp rx=0 tx=0).stop 2024-09-10T22:43:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.586+0000 7f1bfb200640 1 -- 172.21.15.103:0/1100697908 shutdown_connections 2024-09-10T22:43:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.586+0000 7f1bfb200640 1 --2- 172.21.15.103:0/1100697908 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1bdc072610 0x7f1bdc074ad0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.586+0000 7f1bfb200640 1 --2- 172.21.15.103:0/1100697908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bfc15f0e0 0x7f1bfc155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.586+0000 7f1bfb200640 1 --2- 172.21.15.103:0/1100697908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bfc0b0510 0x7f1bfc0b64d0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.586+0000 7f1bfb200640 1 --2- 172.21.15.103:0/1100697908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bfc0714d0 0x7f1bfc14e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.586+0000 7f1bfb200640 1 -- 172.21.15.103:0/1100697908 >> 172.21.15.103:0/1100697908 conn(0x7f1bfc0d18f0 msgr2=0x7f1bfc159c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:21.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.586+0000 7f1bfb200640 1 -- 172.21.15.103:0/1100697908 shutdown_connections 2024-09-10T22:43:21.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.586+0000 7f1bfb200640 1 -- 172.21.15.103:0/1100697908 wait complete. 2024-09-10T22:43:21.603 INFO:tasks.ceph.mds.b.smithi131.stderr: -1474> 2024-09-10T22:42:47.135+0000 7f7da0c00640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-10T22:42:29.007786+0000 1=0+1) n(v0 rc2024-09-10T22:42:29.007786+0000 2=0+2) (inest lock) (ifile excl) caps={6420=pAsLsXsFsx/-@6},l=6420 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55c873a3e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:42:29.007786+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:42:29.007786+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-10T22:42:29.007786+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-10T22:42:29.007786+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-10T22:43:21.603 INFO:tasks.ceph.mds.b.smithi131.stderr: -1460> 2024-09-10T22:42:47.135+0000 7f7da0c00640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) caps={6420=pAsLsXsFs/-@3},l=6420 | request=0 lock=0 importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55c873a41700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-10T22:43:21.606 INFO:tasks.ceph.mds.c.smithi103.stderr: -1610> 2024-09-10T22:42:47.135+0000 7fd5ab800640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-10T22:42:29.004185+0000 1=0+1) n(v2 rc2024-09-10T22:42:29.229423+0000 4=0+4) (inest lock) caps={6420=pAsLsXsFs/-@8},l=6420 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x562824830680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:42:29.004185+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:42:29.229423+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-10T22:42:29.004185+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-10T22:42:29.229423+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-10T22:43:21.606 INFO:tasks.ceph.mds.c.smithi103.stderr: -1476> 2024-09-10T22:42:47.139+0000 7fd5b3a00640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-10T22:42:29.006019+0000 1=0+1) n(v1 rc2024-09-10T22:42:29.229423+0000 3=0+3) (inest sync->mix g=0,2 scatter_wanted) caps={6420=pAsLsXsFs/-@7} | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x562823914000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:42:29.006019+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:42:29.007786+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-10T22:42:29.006019+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-10T22:42:29.229423+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-10T22:43:21.608 INFO:tasks.ceph.mds.a.smithi103.stderr: -3553> 2024-09-10T22:42:47.135+0000 7fcff9e00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-10T22:42:29.000542+0000 1=0+1) n(v3 rc2024-09-10T22:42:29.229423+0000 6=0+6) (inest mix dirty) (ifile excl) caps={6420=pAsLsXsFsx/AsLsXsFsx@9},l=6420 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55ce1e74ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:42:29.000542+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:42:29.229423+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-10T22:42:29.000542+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-10T22:42:29.229423+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-10T22:43:21.608 INFO:tasks.ceph.mds.a.smithi103.stderr: -3414> 2024-09-10T22:42:47.139+0000 7fd002000640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-10T22:42:29.002402+0000 1=0+1) n(v4 rc2024-09-10T22:42:29.229423+0000 5=0+5) (inest sync->mix g=1,2) caps={6420=pAsLsXsFs/-@11} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55ce1e74f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:42:29.002402+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:42:29.229423+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-10T22:42:29.002402+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-10T22:42:29.229423+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-10T22:43:21.613 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T22:43:21.648 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2024-09-10T22:43:21.648 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-09-10T22:43:21.654 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-09-10T22:43:21.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.758+0000 7ff33a000640 1 -- 172.21.15.103:0/1681648868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3340d4750 msgr2=0x7ff3340d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:21.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.758+0000 7ff33a000640 1 --2- 172.21.15.103:0/1681648868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3340d4750 0x7ff3340d1830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff32c009870 tx=0x7ff32c01f050 comp rx=0 tx=0).stop 2024-09-10T22:43:21.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.758+0000 7ff33a000640 1 -- 172.21.15.103:0/1681648868 shutdown_connections 2024-09-10T22:43:21.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.758+0000 7ff33a000640 1 --2- 172.21.15.103:0/1681648868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3340d4750 0x7ff3340d1830 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.758+0000 7ff33a000640 1 -- 172.21.15.103:0/1681648868 >> 172.21.15.103:0/1681648868 conn(0x7ff3340d3c60 msgr2=0x7ff3340d4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:21.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.758+0000 7ff33a000640 1 -- 172.21.15.103:0/1681648868 shutdown_connections 2024-09-10T22:43:21.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.758+0000 7ff33a000640 1 -- 172.21.15.103:0/1681648868 wait complete. 2024-09-10T22:43:21.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff33a000640 1 Processor -- start 2024-09-10T22:43:21.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff33a000640 1 -- start start 2024-09-10T22:43:21.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff33a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3340d21a0 0x7ff3341530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:21.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff33a000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3340d4750 0x7ff334160400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:21.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff33a000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff334160940 0x7ff3340cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:21.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff33a000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff3340b41c0 con 0x7ff3340d21a0 2024-09-10T22:43:21.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff33a000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff3340b4040 con 0x7ff334160940 2024-09-10T22:43:21.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff33a000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff3340b4340 con 0x7ff3340d4750 2024-09-10T22:43:21.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff333400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3340d21a0 0x7ff3341530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:21.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff333400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3340d21a0 0x7ff3341530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51446/0 (socket says 172.21.15.103:51446) 2024-09-10T22:43:21.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff333400640 1 -- 172.21.15.103:0/408925929 learned_addr learned my addr 172.21.15.103:0/408925929 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:21.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff32aa00640 1 --2- 172.21.15.103:0/408925929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3340d4750 0x7ff334160400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:21.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff333e00640 1 --2- 172.21.15.103:0/408925929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff334160940 0x7ff3340cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:21.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff333400640 1 -- 172.21.15.103:0/408925929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3340d4750 msgr2=0x7ff334160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:21.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff333400640 1 --2- 172.21.15.103:0/408925929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3340d4750 0x7ff334160400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff333400640 1 -- 172.21.15.103:0/408925929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff334160940 msgr2=0x7ff3340cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:21.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff333400640 1 --2- 172.21.15.103:0/408925929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff334160940 0x7ff3340cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:21.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff333400640 1 -- 172.21.15.103:0/408925929 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33415e3c0 con 0x7ff3340d21a0 2024-09-10T22:43:21.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff333400640 1 --2- 172.21.15.103:0/408925929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3340d21a0 0x7ff3341530c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ff32400c8a0 tx=0x7ff32400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:21.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff32be00640 1 -- 172.21.15.103:0/408925929 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff324003b80 con 0x7ff3340d21a0 2024-09-10T22:43:21.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff32be00640 1 -- 172.21.15.103:0/408925929 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff324003d40 con 0x7ff3340d21a0 2024-09-10T22:43:21.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff32be00640 1 -- 172.21.15.103:0/408925929 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32400aab0 con 0x7ff3340d21a0 2024-09-10T22:43:21.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff33a000640 1 -- 172.21.15.103:0/408925929 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33415e6a0 con 0x7ff3340d21a0 2024-09-10T22:43:21.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.762+0000 7ff33a000640 1 -- 172.21.15.103:0/408925929 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff33415ec60 con 0x7ff3340d21a0 2024-09-10T22:43:21.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.766+0000 7ff33a000640 1 -- 172.21.15.103:0/408925929 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3340b48d0 con 0x7ff3340d21a0 2024-09-10T22:43:21.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.766+0000 7ff32be00640 1 -- 172.21.15.103:0/408925929 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff32400ac50 con 0x7ff3340d21a0 2024-09-10T22:43:21.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.766+0000 7ff32be00640 1 --2- 172.21.15.103:0/408925929 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff3100725e0 0x7ff310074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:21.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.766+0000 7ff32be00640 1 -- 172.21.15.103:0/408925929 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6504+0+0 (secure 0 0 0) 0x7ff324093320 con 0x7ff3340d21a0 2024-09-10T22:43:21.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.766+0000 7ff32aa00640 1 --2- 172.21.15.103:0/408925929 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff3100725e0 0x7ff310074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:21.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.766+0000 7ff32aa00640 1 --2- 172.21.15.103:0/408925929 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff3100725e0 0x7ff310074aa0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff3340c7e00 tx=0x7ff31c001380 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:21.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.770+0000 7ff32be00640 1 -- 172.21.15.103:0/408925929 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff32405e000 con 0x7ff3340d21a0 2024-09-10T22:43:21.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:21.970+0000 7ff33a000640 1 -- 172.21.15.103:0/408925929 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff33406e5d0 con 0x7ff3340d21a0 2024-09-10T22:43:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.590+0000 7ff32be00640 1 -- 172.21.15.103:0/408925929 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v66) ==== 104+0+0 (secure 0 0 0) 0x7ff324062a30 con 0x7ff3340d21a0 2024-09-10T22:43:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.594+0000 7ff33a000640 1 -- 172.21.15.103:0/408925929 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff3100725e0 msgr2=0x7ff310074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.594+0000 7ff33a000640 1 --2- 172.21.15.103:0/408925929 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff3100725e0 0x7ff310074aa0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff3340c7e00 tx=0x7ff31c001380 comp rx=0 tx=0).stop 2024-09-10T22:43:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.594+0000 7ff33a000640 1 -- 172.21.15.103:0/408925929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3340d21a0 msgr2=0x7ff3341530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.594+0000 7ff33a000640 1 --2- 172.21.15.103:0/408925929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3340d21a0 0x7ff3341530c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ff32400c8a0 tx=0x7ff32400cd60 comp rx=0 tx=0).stop 2024-09-10T22:43:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.594+0000 7ff33a000640 1 -- 172.21.15.103:0/408925929 shutdown_connections 2024-09-10T22:43:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.594+0000 7ff33a000640 1 --2- 172.21.15.103:0/408925929 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff3100725e0 0x7ff310074aa0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.594+0000 7ff33a000640 1 --2- 172.21.15.103:0/408925929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff334160940 0x7ff3340cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.594+0000 7ff33a000640 1 --2- 172.21.15.103:0/408925929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3340d4750 0x7ff334160400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.594+0000 7ff33a000640 1 --2- 172.21.15.103:0/408925929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3340d21a0 0x7ff3341530c0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.594+0000 7ff33a000640 1 -- 172.21.15.103:0/408925929 >> 172.21.15.103:0/408925929 conn(0x7ff3340d3c60 msgr2=0x7ff33415d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.594+0000 7ff33a000640 1 -- 172.21.15.103:0/408925929 shutdown_connections 2024-09-10T22:43:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.594+0000 7ff33a000640 1 -- 172.21.15.103:0/408925929 wait complete. 2024-09-10T22:43:22.620 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T22:43:22.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.806+0000 7f35aea00640 1 -- 172.21.15.103:0/2295745667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35a80cfdd0 msgr2=0x7f35a8073b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:22.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.806+0000 7f35aea00640 1 --2- 172.21.15.103:0/2295745667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35a80cfdd0 0x7f35a8073b50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f35a80748a0 tx=0x7f35a001c8c0 comp rx=0 tx=0).stop 2024-09-10T22:43:22.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.806+0000 7f35aea00640 1 -- 172.21.15.103:0/2295745667 shutdown_connections 2024-09-10T22:43:22.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.806+0000 7f35aea00640 1 --2- 172.21.15.103:0/2295745667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35a80cfdd0 0x7f35a8073b50 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:22.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.806+0000 7f35aea00640 1 --2- 172.21.15.103:0/2295745667 >> v2:172.21.15.131:3300/0 conn(0x7f35a806f0c0 0x7f35a8073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:22.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.806+0000 7f35aea00640 1 --2- 172.21.15.103:0/2295745667 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35a80cf9f0 0x7f35a806eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:22.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.806+0000 7f35aea00640 1 -- 172.21.15.103:0/2295745667 >> 172.21.15.103:0/2295745667 conn(0x7f35a806cc00 msgr2=0x7f35a806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:22.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.806+0000 7f35aea00640 1 -- 172.21.15.103:0/2295745667 shutdown_connections 2024-09-10T22:43:22.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.806+0000 7f35aea00640 1 -- 172.21.15.103:0/2295745667 wait complete. 2024-09-10T22:43:22.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.806+0000 7f35aea00640 1 Processor -- start 2024-09-10T22:43:22.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.806+0000 7f35aea00640 1 -- start start 2024-09-10T22:43:22.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35aea00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35a806f0c0 0x7f35a81f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:22.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35aea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35a80cf9f0 0x7f35a8145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:22.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35aea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35a80cfdd0 0x7f35a8151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:22.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35aea00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f35a80ccab0 con 0x7f35a80cfdd0 2024-09-10T22:43:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35aea00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f35a80cc930 con 0x7f35a80cf9f0 2024-09-10T22:43:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35aea00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f35a80ccc30 con 0x7f35a806f0c0 2024-09-10T22:43:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35aca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35a80cfdd0 0x7f35a8151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35aca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35a80cfdd0 0x7f35a8151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51466/0 (socket says 172.21.15.103:51466) 2024-09-10T22:43:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35aca00640 1 -- 172.21.15.103:0/219363753 learned_addr learned my addr 172.21.15.103:0/219363753 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35a7e00640 1 --2- 172.21.15.103:0/219363753 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35a806f0c0 0x7f35a81f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f359f400640 1 --2- 172.21.15.103:0/219363753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35a80cf9f0 0x7f35a8145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35aca00640 1 -- 172.21.15.103:0/219363753 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35a806f0c0 msgr2=0x7f35a81f6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35aca00640 1 --2- 172.21.15.103:0/219363753 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35a806f0c0 0x7f35a81f6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35aca00640 1 -- 172.21.15.103:0/219363753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35a80cf9f0 msgr2=0x7f35a8145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35aca00640 1 --2- 172.21.15.103:0/219363753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35a80cf9f0 0x7f35a8145a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35aca00640 1 -- 172.21.15.103:0/219363753 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a815e5b0 con 0x7f35a80cfdd0 2024-09-10T22:43:22.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35aca00640 1 --2- 172.21.15.103:0/219363753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35a80cfdd0 0x7f35a8151450 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f35a0009850 tx=0x7f35a0005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:22.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35a4c00640 1 -- 172.21.15.103:0/219363753 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a00b2040 con 0x7f35a80cfdd0 2024-09-10T22:43:22.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35a4c00640 1 -- 172.21.15.103:0/219363753 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35a0004330 con 0x7f35a80cfdd0 2024-09-10T22:43:22.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35a4c00640 1 -- 172.21.15.103:0/219363753 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a00052d0 con 0x7f35a80cfdd0 2024-09-10T22:43:22.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35aea00640 1 -- 172.21.15.103:0/219363753 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35a8149680 con 0x7f35a80cfdd0 2024-09-10T22:43:22.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35aea00640 1 -- 172.21.15.103:0/219363753 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35a8149c40 con 0x7f35a80cfdd0 2024-09-10T22:43:22.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.810+0000 7f35aea00640 1 -- 172.21.15.103:0/219363753 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35a806eb80 con 0x7f35a80cfdd0 2024-09-10T22:43:22.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.814+0000 7f35a4c00640 1 -- 172.21.15.103:0/219363753 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f35a0005470 con 0x7f35a80cfdd0 2024-09-10T22:43:22.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.814+0000 7f35a4c00640 1 --2- 172.21.15.103:0/219363753 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35840725e0 0x7f3584074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:22.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.814+0000 7f35a4c00640 1 -- 172.21.15.103:0/219363753 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6504+0+0 (secure 0 0 0) 0x7f35a012cb70 con 0x7f35a80cfdd0 2024-09-10T22:43:22.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.814+0000 7f35a7e00640 1 --2- 172.21.15.103:0/219363753 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35840725e0 0x7f3584074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:22.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.814+0000 7f35a7e00640 1 --2- 172.21.15.103:0/219363753 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35840725e0 0x7f3584074aa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3598009ed0 tx=0x7f3598009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:22.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.818+0000 7f35a4c00640 1 -- 172.21.15.103:0/219363753 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f35a00164b0 con 0x7f35a80cfdd0 2024-09-10T22:43:22.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:22.982+0000 7f35aea00640 1 -- 172.21.15.103:0/219363753 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f35a814f1d0 con 0x7f35a80cfdd0 2024-09-10T22:43:23.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:23.870+0000 7f35a4c00640 1 -- 172.21.15.103:0/219363753 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v72) ==== 181+0+0 (secure 0 0 0) 0x7f35a00f7e90 con 0x7f35a80cfdd0 2024-09-10T22:43:23.873 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2024-09-10T22:43:23.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:23.874+0000 7f35aea00640 1 -- 172.21.15.103:0/219363753 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35840725e0 msgr2=0x7f3584074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:23.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:23.874+0000 7f35aea00640 1 --2- 172.21.15.103:0/219363753 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35840725e0 0x7f3584074aa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3598009ed0 tx=0x7f3598009500 comp rx=0 tx=0).stop 2024-09-10T22:43:23.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:23.874+0000 7f35aea00640 1 -- 172.21.15.103:0/219363753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35a80cfdd0 msgr2=0x7f35a8151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:23.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:23.874+0000 7f35aea00640 1 --2- 172.21.15.103:0/219363753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35a80cfdd0 0x7f35a8151450 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f35a0009850 tx=0x7f35a0005df0 comp rx=0 tx=0).stop 2024-09-10T22:43:23.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:23.874+0000 7f35aea00640 1 -- 172.21.15.103:0/219363753 shutdown_connections 2024-09-10T22:43:23.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:23.874+0000 7f35aea00640 1 --2- 172.21.15.103:0/219363753 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35840725e0 0x7f3584074aa0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:23.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:23.874+0000 7f35aea00640 1 --2- 172.21.15.103:0/219363753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35a80cfdd0 0x7f35a8151450 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:23.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:23.874+0000 7f35aea00640 1 --2- 172.21.15.103:0/219363753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35a80cf9f0 0x7f35a8145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:23.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:23.874+0000 7f35aea00640 1 --2- 172.21.15.103:0/219363753 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35a806f0c0 0x7f35a81f6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:23.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:23.874+0000 7f35aea00640 1 -- 172.21.15.103:0/219363753 >> 172.21.15.103:0/219363753 conn(0x7f35a806cc00 msgr2=0x7f35a80cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:23.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:23.874+0000 7f35aea00640 1 -- 172.21.15.103:0/219363753 shutdown_connections 2024-09-10T22:43:23.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:23.878+0000 7f35aea00640 1 -- 172.21.15.103:0/219363753 wait complete. 2024-09-10T22:43:23.903 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T22:43:24.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa38dc00640 1 -- 172.21.15.103:0/4053708826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3880cf790 msgr2=0x7fa3880cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:24.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa38dc00640 1 --2- 172.21.15.103:0/4053708826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3880cf790 0x7fa3880cfc40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa380009bc0 tx=0x7fa38001cb10 comp rx=0 tx=0).stop 2024-09-10T22:43:24.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa38dc00640 1 -- 172.21.15.103:0/4053708826 shutdown_connections 2024-09-10T22:43:24.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa38dc00640 1 --2- 172.21.15.103:0/4053708826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3880cf790 0x7fa3880cfc40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:24.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa38dc00640 1 --2- 172.21.15.103:0/4053708826 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3880cc120 0x7fa3880aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:24.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa38dc00640 1 -- 172.21.15.103:0/4053708826 >> 172.21.15.103:0/4053708826 conn(0x7fa38806cc00 msgr2=0x7fa38806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:24.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa38dc00640 1 -- 172.21.15.103:0/4053708826 shutdown_connections 2024-09-10T22:43:24.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa38dc00640 1 -- 172.21.15.103:0/4053708826 wait complete. 2024-09-10T22:43:24.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa38dc00640 1 Processor -- start 2024-09-10T22:43:24.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa38dc00640 1 -- start start 2024-09-10T22:43:24.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa38dc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3880cc120 0x7fa3880ce350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:24.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa38dc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3880cf790 0x7fa388150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:24.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa38dc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38815c970 0x7fa3881508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:24.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa38dc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa388168c40 con 0x7fa3880cc120 2024-09-10T22:43:24.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa38dc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa388168ac0 con 0x7fa3880cf790 2024-09-10T22:43:24.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa38dc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa388168dc0 con 0x7fa38815c970 2024-09-10T22:43:24.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa386a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3880cc120 0x7fa3880ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:24.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa386a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3880cc120 0x7fa3880ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51480/0 (socket says 172.21.15.103:51480) 2024-09-10T22:43:24.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.046+0000 7fa386a00640 1 -- 172.21.15.103:0/1142801901 learned_addr learned my addr 172.21.15.103:0/1142801901 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:24.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.050+0000 7fa37e000640 1 --2- 172.21.15.103:0/1142801901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3880cf790 0x7fa388150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:24.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.050+0000 7fa387400640 1 --2- 172.21.15.103:0/1142801901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38815c970 0x7fa3881508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:24.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.050+0000 7fa386a00640 1 -- 172.21.15.103:0/1142801901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38815c970 msgr2=0x7fa3881508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:24.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.050+0000 7fa386a00640 1 --2- 172.21.15.103:0/1142801901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38815c970 0x7fa3881508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:24.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.050+0000 7fa386a00640 1 -- 172.21.15.103:0/1142801901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3880cf790 msgr2=0x7fa388150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:24.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.050+0000 7fa386a00640 1 --2- 172.21.15.103:0/1142801901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3880cf790 0x7fa388150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:24.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.050+0000 7fa386a00640 1 -- 172.21.15.103:0/1142801901 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3880b3c00 con 0x7fa3880cc120 2024-09-10T22:43:24.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.050+0000 7fa37e000640 1 --2- 172.21.15.103:0/1142801901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3880cf790 0x7fa388150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:24.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.050+0000 7fa387400640 1 --2- 172.21.15.103:0/1142801901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38815c970 0x7fa3881508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:24.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.050+0000 7fa386a00640 1 --2- 172.21.15.103:0/1142801901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3880cc120 0x7fa3880ce350 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fa37800e9d0 tx=0x7fa37800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:24.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.050+0000 7fa37f400640 1 -- 172.21.15.103:0/1142801901 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37800cde0 con 0x7fa3880cc120 2024-09-10T22:43:24.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.050+0000 7fa38dc00640 1 -- 172.21.15.103:0/1142801901 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa388150df0 con 0x7fa3880cc120 2024-09-10T22:43:24.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.050+0000 7fa37f400640 1 -- 172.21.15.103:0/1142801901 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa378004020 con 0x7fa3880cc120 2024-09-10T22:43:24.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.050+0000 7fa37f400640 1 -- 172.21.15.103:0/1142801901 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378004450 con 0x7fa3880cc120 2024-09-10T22:43:24.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.050+0000 7fa38dc00640 1 -- 172.21.15.103:0/1142801901 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3881fb290 con 0x7fa3880cc120 2024-09-10T22:43:24.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.050+0000 7fa38dc00640 1 -- 172.21.15.103:0/1142801901 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3880cfc40 con 0x7fa3880cc120 2024-09-10T22:43:24.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.050+0000 7fa37f400640 1 -- 172.21.15.103:0/1142801901 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa378003600 con 0x7fa3880cc120 2024-09-10T22:43:24.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.054+0000 7fa37f400640 1 --2- 172.21.15.103:0/1142801901 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa3640725e0 0x7fa364074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:24.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.054+0000 7fa37f400640 1 -- 172.21.15.103:0/1142801901 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6037+0+0 (secure 0 0 0) 0x7fa378093f70 con 0x7fa3880cc120 2024-09-10T22:43:24.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.054+0000 7fa37e000640 1 --2- 172.21.15.103:0/1142801901 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa3640725e0 0x7fa364074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:24.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.054+0000 7fa37e000640 1 --2- 172.21.15.103:0/1142801901 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa3640725e0 0x7fa364074aa0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa370007fd0 tx=0x7fa370009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:24.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.054+0000 7fa37f400640 1 -- 172.21.15.103:0/1142801901 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa388150df0 con 0x7fa3880cc120 2024-09-10T22:43:24.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.226+0000 7fa38dc00640 1 -- 172.21.15.103:0/1142801901 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa3880af370 con 0x7fa3880cc120 2024-09-10T22:43:24.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.870+0000 7fa37f400640 1 -- 172.21.15.103:0/1142801901 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v73) ==== 169+0+0 (secure 0 0 0) 0x7fa37805f3e0 con 0x7fa3880cc120 2024-09-10T22:43:24.875 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2024-09-10T22:43:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.874+0000 7fa38dc00640 1 -- 172.21.15.103:0/1142801901 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa3640725e0 msgr2=0x7fa364074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.874+0000 7fa38dc00640 1 --2- 172.21.15.103:0/1142801901 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa3640725e0 0x7fa364074aa0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa370007fd0 tx=0x7fa370009040 comp rx=0 tx=0).stop 2024-09-10T22:43:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.874+0000 7fa38dc00640 1 -- 172.21.15.103:0/1142801901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3880cc120 msgr2=0x7fa3880ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.874+0000 7fa38dc00640 1 --2- 172.21.15.103:0/1142801901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3880cc120 0x7fa3880ce350 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fa37800e9d0 tx=0x7fa37800ee90 comp rx=0 tx=0).stop 2024-09-10T22:43:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.874+0000 7fa38dc00640 1 -- 172.21.15.103:0/1142801901 shutdown_connections 2024-09-10T22:43:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.874+0000 7fa38dc00640 1 --2- 172.21.15.103:0/1142801901 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa3640725e0 0x7fa364074aa0 secure :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa370007fd0 tx=0x7fa370009040 comp rx=0 tx=0).stop 2024-09-10T22:43:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.874+0000 7fa38dc00640 1 --2- 172.21.15.103:0/1142801901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38815c970 0x7fa3881508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.874+0000 7fa38dc00640 1 --2- 172.21.15.103:0/1142801901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3880cf790 0x7fa388150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.874+0000 7fa38dc00640 1 --2- 172.21.15.103:0/1142801901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3880cc120 0x7fa3880ce350 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.874+0000 7fa38dc00640 1 -- 172.21.15.103:0/1142801901 >> 172.21.15.103:0/1142801901 conn(0x7fa38806cc00 msgr2=0x7fa3880ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.874+0000 7fa38dc00640 1 -- 172.21.15.103:0/1142801901 shutdown_connections 2024-09-10T22:43:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:24.874+0000 7fa38dc00640 1 -- 172.21.15.103:0/1142801901 wait complete. 2024-09-10T22:43:24.905 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T22:43:25.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.042+0000 7f05bca00640 1 -- 172.21.15.103:0/3150491627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05b80cf9f0 msgr2=0x7f05b806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:25.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.042+0000 7f05bca00640 1 --2- 172.21.15.103:0/3150491627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05b80cf9f0 0x7f05b806eb80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f05a8009bc0 tx=0x7f05a801cac0 comp rx=0 tx=0).stop 2024-09-10T22:43:25.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.042+0000 7f05bca00640 1 -- 172.21.15.103:0/3150491627 shutdown_connections 2024-09-10T22:43:25.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.042+0000 7f05bca00640 1 --2- 172.21.15.103:0/3150491627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05b80cf9f0 0x7f05b806eb80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:25.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.042+0000 7f05bca00640 1 -- 172.21.15.103:0/3150491627 >> 172.21.15.103:0/3150491627 conn(0x7f05b806cc00 msgr2=0x7f05b806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:25.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05bca00640 1 -- 172.21.15.103:0/3150491627 shutdown_connections 2024-09-10T22:43:25.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05bca00640 1 -- 172.21.15.103:0/3150491627 wait complete. 2024-09-10T22:43:25.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05bca00640 1 Processor -- start 2024-09-10T22:43:25.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05bca00640 1 -- start start 2024-09-10T22:43:25.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05bca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b806f0c0 0x7f05b8147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:25.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05bca00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05b80cf9f0 0x7f05b80abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:25.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05bca00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05b80cfdd0 0x7f05b814e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:25.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05bca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f05b8168f20 con 0x7f05b806f0c0 2024-09-10T22:43:25.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05bca00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f05b8168da0 con 0x7f05b80cfdd0 2024-09-10T22:43:25.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05bca00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f05b81690a0 con 0x7f05b80cf9f0 2024-09-10T22:43:25.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05b5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b806f0c0 0x7f05b8147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:25.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05b5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b806f0c0 0x7f05b8147c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51494/0 (socket says 172.21.15.103:51494) 2024-09-10T22:43:25.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05b5e00640 1 -- 172.21.15.103:0/1342764572 learned_addr learned my addr 172.21.15.103:0/1342764572 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:25.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05b5e00640 1 -- 172.21.15.103:0/1342764572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05b80cf9f0 msgr2=0x7f05b80abbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:25.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05ad400640 1 --2- 172.21.15.103:0/1342764572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05b80cf9f0 0x7f05b80abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:25.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05b6800640 1 --2- 172.21.15.103:0/1342764572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05b80cfdd0 0x7f05b814e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:25.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05b5e00640 1 --2- 172.21.15.103:0/1342764572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05b80cf9f0 0x7f05b80abbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:25.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05b5e00640 1 -- 172.21.15.103:0/1342764572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05b80cfdd0 msgr2=0x7f05b814e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:25.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05b5e00640 1 --2- 172.21.15.103:0/1342764572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05b80cfdd0 0x7f05b814e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:25.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05b5e00640 1 -- 172.21.15.103:0/1342764572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b80ac380 con 0x7f05b806f0c0 2024-09-10T22:43:25.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05ad400640 1 --2- 172.21.15.103:0/1342764572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05b80cf9f0 0x7f05b80abbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:25.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05b6800640 1 --2- 172.21.15.103:0/1342764572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05b80cfdd0 0x7f05b814e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:25.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05b5e00640 1 --2- 172.21.15.103:0/1342764572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b806f0c0 0x7f05b8147c20 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f05a80196d0 tx=0x7f05a8009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:25.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05aea00640 1 -- 172.21.15.103:0/1342764572 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a80b2040 con 0x7f05b806f0c0 2024-09-10T22:43:25.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05aea00640 1 -- 172.21.15.103:0/1342764572 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05a8004c50 con 0x7f05b806f0c0 2024-09-10T22:43:25.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05bca00640 1 -- 172.21.15.103:0/1342764572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b80ac660 con 0x7f05b806f0c0 2024-09-10T22:43:25.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.046+0000 7f05aea00640 1 -- 172.21.15.103:0/1342764572 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a8004040 con 0x7f05b806f0c0 2024-09-10T22:43:25.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.050+0000 7f05bca00640 1 -- 172.21.15.103:0/1342764572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b80acc20 con 0x7f05b806f0c0 2024-09-10T22:43:25.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.050+0000 7f05bca00640 1 -- 172.21.15.103:0/1342764572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05b806eb80 con 0x7f05b806f0c0 2024-09-10T22:43:25.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.050+0000 7f05aea00640 1 -- 172.21.15.103:0/1342764572 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f05a80b5070 con 0x7f05b806f0c0 2024-09-10T22:43:25.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.050+0000 7f05aea00640 1 --2- 172.21.15.103:0/1342764572 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05940725e0 0x7f0594074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:25.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.050+0000 7f05aea00640 1 -- 172.21.15.103:0/1342764572 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5507+0+0 (secure 0 0 0) 0x7f05a812cee0 con 0x7f05b806f0c0 2024-09-10T22:43:25.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.050+0000 7f05ad400640 1 --2- 172.21.15.103:0/1342764572 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05940725e0 0x7f0594074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:25.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.054+0000 7f05ad400640 1 --2- 172.21.15.103:0/1342764572 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05940725e0 0x7f0594074aa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f05b806ad00 tx=0x7f05a0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:25.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.054+0000 7f05aea00640 1 -- 172.21.15.103:0/1342764572 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f05a80166b0 con 0x7f05b806f0c0 2024-09-10T22:43:25.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.222+0000 7f05bca00640 1 -- 172.21.15.103:0/1342764572 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f05b80ad3e0 con 0x7f05b806f0c0 2024-09-10T22:43:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.226+0000 7f05aea00640 1 -- 172.21.15.103:0/1342764572 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v33) ==== 71+0+0 (secure 0 0 0) 0x7f05a80f8670 con 0x7f05b806f0c0 2024-09-10T22:43:25.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.226+0000 7f05bca00640 1 -- 172.21.15.103:0/1342764572 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05940725e0 msgr2=0x7f0594074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:25.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.226+0000 7f05bca00640 1 --2- 172.21.15.103:0/1342764572 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05940725e0 0x7f0594074aa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f05b806ad00 tx=0x7f05a0009040 comp rx=0 tx=0).stop 2024-09-10T22:43:25.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.226+0000 7f05bca00640 1 -- 172.21.15.103:0/1342764572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b806f0c0 msgr2=0x7f05b8147c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:25.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.226+0000 7f05bca00640 1 --2- 172.21.15.103:0/1342764572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b806f0c0 0x7f05b8147c20 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f05a80196d0 tx=0x7f05a8009200 comp rx=0 tx=0).stop 2024-09-10T22:43:25.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.226+0000 7f05bca00640 1 -- 172.21.15.103:0/1342764572 shutdown_connections 2024-09-10T22:43:25.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.226+0000 7f05bca00640 1 --2- 172.21.15.103:0/1342764572 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05940725e0 0x7f0594074aa0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.226+0000 7f05bca00640 1 --2- 172.21.15.103:0/1342764572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05b80cfdd0 0x7f05b814e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.226+0000 7f05bca00640 1 --2- 172.21.15.103:0/1342764572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05b80cf9f0 0x7f05b80abbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.226+0000 7f05bca00640 1 --2- 172.21.15.103:0/1342764572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b806f0c0 0x7f05b8147c20 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.226+0000 7f05bca00640 1 -- 172.21.15.103:0/1342764572 >> 172.21.15.103:0/1342764572 conn(0x7f05b806cc00 msgr2=0x7f05b80b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.226+0000 7f05bca00640 1 -- 172.21.15.103:0/1342764572 shutdown_connections 2024-09-10T22:43:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.226+0000 7f05bca00640 1 -- 172.21.15.103:0/1342764572 wait complete. 2024-09-10T22:43:25.251 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace' 2024-09-10T22:43:25.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.390+0000 7f97b1400640 1 -- 172.21.15.103:0/1188056401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97ac0cc120 msgr2=0x7f97ac0aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:25.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.390+0000 7f97b1400640 1 --2- 172.21.15.103:0/1188056401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97ac0cc120 0x7f97ac0aeb40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0d0870 tx=0x7f979c01c770 comp rx=0 tx=0).stop 2024-09-10T22:43:25.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.390+0000 7f97b1400640 1 -- 172.21.15.103:0/1188056401 shutdown_connections 2024-09-10T22:43:25.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.390+0000 7f97b1400640 1 --2- 172.21.15.103:0/1188056401 >> v2:172.21.15.131:3300/0 conn(0x7f97ac0cf790 0x7f97ac0cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:25.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.390+0000 7f97b1400640 1 --2- 172.21.15.103:0/1188056401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97ac0cc120 0x7f97ac0aeb40 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:25.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.390+0000 7f97b1400640 1 -- 172.21.15.103:0/1188056401 >> 172.21.15.103:0/1188056401 conn(0x7f97ac06cc00 msgr2=0x7f97ac06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:25.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.390+0000 7f97b1400640 1 -- 172.21.15.103:0/1188056401 shutdown_connections 2024-09-10T22:43:25.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.390+0000 7f97b1400640 1 -- 172.21.15.103:0/1188056401 wait complete. 2024-09-10T22:43:25.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.390+0000 7f97b1400640 1 Processor -- start 2024-09-10T22:43:25.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.390+0000 7f97b1400640 1 -- start start 2024-09-10T22:43:25.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97b1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97ac0cc120 0x7f97ac1558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:25.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97b1400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97ac0cf790 0x7f97ac140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:25.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97b1400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97ac15c970 0x7f97ac165470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:25.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97b1400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac168b40 con 0x7f97ac0cc120 2024-09-10T22:43:25.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97b1400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac1689c0 con 0x7f97ac0cf790 2024-09-10T22:43:25.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97b1400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f97ac168cc0 con 0x7f97ac15c970 2024-09-10T22:43:25.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97aa800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97ac0cc120 0x7f97ac1558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:25.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97aa800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97ac0cc120 0x7f97ac1558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51508/0 (socket says 172.21.15.103:51508) 2024-09-10T22:43:25.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97aa800640 1 -- 172.21.15.103:0/2999305876 learned_addr learned my addr 172.21.15.103:0/2999305876 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:25.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97a1e00640 1 --2- 172.21.15.103:0/2999305876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97ac0cf790 0x7f97ac140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:25.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97ab200640 1 --2- 172.21.15.103:0/2999305876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97ac15c970 0x7f97ac165470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:25.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97aa800640 1 -- 172.21.15.103:0/2999305876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97ac15c970 msgr2=0x7f97ac165470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:25.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97aa800640 1 --2- 172.21.15.103:0/2999305876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97ac15c970 0x7f97ac165470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:25.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97aa800640 1 -- 172.21.15.103:0/2999305876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97ac0cf790 msgr2=0x7f97ac140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:25.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97aa800640 1 --2- 172.21.15.103:0/2999305876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97ac0cf790 0x7f97ac140da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:25.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97aa800640 1 -- 172.21.15.103:0/2999305876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ac068cc0 con 0x7f97ac0cc120 2024-09-10T22:43:25.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97aa800640 1 --2- 172.21.15.103:0/2999305876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97ac0cc120 0x7f97ac1558c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f979c000c10 tx=0x7f979c0a5630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:25.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97a3400640 1 -- 172.21.15.103:0/2999305876 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c0b2040 con 0x7f97ac0cc120 2024-09-10T22:43:25.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97a3400640 1 -- 172.21.15.103:0/2999305876 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f979c004340 con 0x7f97ac0cc120 2024-09-10T22:43:25.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97b1400640 1 -- 172.21.15.103:0/2999305876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97ac1561f0 con 0x7f97ac0cc120 2024-09-10T22:43:25.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97a3400640 1 -- 172.21.15.103:0/2999305876 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c0044f0 con 0x7f97ac0cc120 2024-09-10T22:43:25.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97b1400640 1 -- 172.21.15.103:0/2999305876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97ac155f10 con 0x7f97ac0cc120 2024-09-10T22:43:25.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97b1400640 1 -- 172.21.15.103:0/2999305876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97ac0cfc20 con 0x7f97ac0cc120 2024-09-10T22:43:25.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.394+0000 7f97a3400640 1 -- 172.21.15.103:0/2999305876 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f979c0b5070 con 0x7f97ac0cc120 2024-09-10T22:43:25.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.398+0000 7f97a3400640 1 --2- 172.21.15.103:0/2999305876 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9788072610 0x7f9788074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:25.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.398+0000 7f97a3400640 1 -- 172.21.15.103:0/2999305876 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5507+0+0 (secure 0 0 0) 0x7f979c12dc60 con 0x7f97ac0cc120 2024-09-10T22:43:25.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.398+0000 7f97a1e00640 1 --2- 172.21.15.103:0/2999305876 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9788072610 0x7f9788074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:25.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.398+0000 7f97a1e00640 1 --2- 172.21.15.103:0/2999305876 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9788072610 0x7f9788074ad0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f97ac15afd0 tx=0x7f9794009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:25.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.398+0000 7f97a3400640 1 -- 172.21.15.103:0/2999305876 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f979c0163f0 con 0x7f97ac0cc120 2024-09-10T22:43:25.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.622+0000 7f97b1400640 1 -- 172.21.15.103:0/2999305876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]} v 0) -- 0x7f97ac0aec40 con 0x7f97ac0cc120 2024-09-10T22:43:25.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.886+0000 7f97a3400640 1 -- 172.21.15.103:0/2999305876 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]}]=0 v241) ==== 142+0+0 (secure 0 0 0) 0x7f979c0f9470 con 0x7f97ac0cc120 2024-09-10T22:43:25.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.890+0000 7f97b1400640 1 -- 172.21.15.103:0/2999305876 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9788072610 msgr2=0x7f9788074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:25.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.890+0000 7f97b1400640 1 --2- 172.21.15.103:0/2999305876 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9788072610 0x7f9788074ad0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f97ac15afd0 tx=0x7f9794009040 comp rx=0 tx=0).stop 2024-09-10T22:43:25.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.890+0000 7f97b1400640 1 -- 172.21.15.103:0/2999305876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97ac0cc120 msgr2=0x7f97ac1558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:25.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.890+0000 7f97b1400640 1 --2- 172.21.15.103:0/2999305876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97ac0cc120 0x7f97ac1558c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f979c000c10 tx=0x7f979c0a5630 comp rx=0 tx=0).stop 2024-09-10T22:43:25.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.890+0000 7f97b1400640 1 -- 172.21.15.103:0/2999305876 shutdown_connections 2024-09-10T22:43:25.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.890+0000 7f97b1400640 1 --2- 172.21.15.103:0/2999305876 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9788072610 0x7f9788074ad0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:25.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.890+0000 7f97b1400640 1 --2- 172.21.15.103:0/2999305876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97ac15c970 0x7f97ac165470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:25.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.890+0000 7f97b1400640 1 --2- 172.21.15.103:0/2999305876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97ac0cf790 0x7f97ac140da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:25.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.890+0000 7f97b1400640 1 --2- 172.21.15.103:0/2999305876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97ac0cc120 0x7f97ac1558c0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:25.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.890+0000 7f97b1400640 1 -- 172.21.15.103:0/2999305876 >> 172.21.15.103:0/2999305876 conn(0x7f97ac06cc00 msgr2=0x7f97ac15bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:25.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.890+0000 7f97b1400640 1 -- 172.21.15.103:0/2999305876 shutdown_connections 2024-09-10T22:43:25.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:25.890+0000 7f97b1400640 1 -- 172.21.15.103:0/2999305876 wait complete. 2024-09-10T22:43:25.914 INFO:tasks.cephfs_test_runner:test_scrub_backtrace (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2024-09-10T22:43:25.914 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_non_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2024-09-10T22:43:25.915 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:43:26.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.054+0000 7f293ca00640 1 -- 172.21.15.103:0/2712504219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29380ae9c0 msgr2=0x7f29380aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:26.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.054+0000 7f293ca00640 1 --2- 172.21.15.103:0/2712504219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29380ae9c0 0x7f29380aee10 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f29380cbf40 tx=0x7f293001ccf0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.054+0000 7f293ca00640 1 -- 172.21.15.103:0/2712504219 shutdown_connections 2024-09-10T22:43:26.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.054+0000 7f293ca00640 1 --2- 172.21.15.103:0/2712504219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29380ae9c0 0x7f29380aee10 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.054+0000 7f293ca00640 1 --2- 172.21.15.103:0/2712504219 >> v2:172.21.15.131:3300/0 conn(0x7f29380b09c0 0x7f29380ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.054+0000 7f293ca00640 1 -- 172.21.15.103:0/2712504219 >> 172.21.15.103:0/2712504219 conn(0x7f29380d1ac0 msgr2=0x7f29380d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:26.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.054+0000 7f293ca00640 1 -- 172.21.15.103:0/2712504219 shutdown_connections 2024-09-10T22:43:26.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.054+0000 7f293ca00640 1 -- 172.21.15.103:0/2712504219 wait complete. 2024-09-10T22:43:26.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.054+0000 7f293ca00640 1 Processor -- start 2024-09-10T22:43:26.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f293ca00640 1 -- start start 2024-09-10T22:43:26.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f293ca00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29380ae9c0 0x7f29380b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:26.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f293ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29380b09c0 0x7f293814d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:26.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f293ca00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f293815be30 0x7f293814ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:26.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f293ca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2938168c70 con 0x7f29380b09c0 2024-09-10T22:43:26.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f293ca00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f29380cef00 con 0x7f29380ae9c0 2024-09-10T22:43:26.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f293ca00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2938168df0 con 0x7f293815be30 2024-09-10T22:43:26.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f292fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29380b09c0 0x7f293814d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:26.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f292fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29380b09c0 0x7f293814d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51534/0 (socket says 172.21.15.103:51534) 2024-09-10T22:43:26.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f292fe00640 1 -- 172.21.15.103:0/3954959056 learned_addr learned my addr 172.21.15.103:0/3954959056 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:26.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f2935e00640 1 --2- 172.21.15.103:0/3954959056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29380ae9c0 0x7f29380b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:26.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f2936800640 1 --2- 172.21.15.103:0/3954959056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f293815be30 0x7f293814ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:26.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f292fe00640 1 -- 172.21.15.103:0/3954959056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f293815be30 msgr2=0x7f293814ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:26.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f292fe00640 1 --2- 172.21.15.103:0/3954959056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f293815be30 0x7f293814ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f292fe00640 1 -- 172.21.15.103:0/3954959056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29380ae9c0 msgr2=0x7f29380b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:26.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f292fe00640 1 --2- 172.21.15.103:0/3954959056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29380ae9c0 0x7f29380b1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f292fe00640 1 -- 172.21.15.103:0/3954959056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293814e6d0 con 0x7f29380b09c0 2024-09-10T22:43:26.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f2935e00640 1 --2- 172.21.15.103:0/3954959056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29380ae9c0 0x7f29380b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:43:26.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f2936800640 1 --2- 172.21.15.103:0/3954959056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f293815be30 0x7f293814ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:43:26.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f292fe00640 1 --2- 172.21.15.103:0/3954959056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29380b09c0 0x7f293814d630 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f292000b580 tx=0x7f292000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:26.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f292e000640 1 -- 172.21.15.103:0/3954959056 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920014070 con 0x7f29380b09c0 2024-09-10T22:43:26.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f292e000640 1 -- 172.21.15.103:0/3954959056 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2920010980 con 0x7f29380b09c0 2024-09-10T22:43:26.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f292e000640 1 -- 172.21.15.103:0/3954959056 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920010dd0 con 0x7f29380b09c0 2024-09-10T22:43:26.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f293ca00640 1 -- 172.21.15.103:0/3954959056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29380b5e80 con 0x7f29380b09c0 2024-09-10T22:43:26.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f293ca00640 1 -- 172.21.15.103:0/3954959056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29380b6400 con 0x7f29380b09c0 2024-09-10T22:43:26.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.058+0000 7f293ca00640 1 -- 172.21.15.103:0/3954959056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29380aee10 con 0x7f29380b09c0 2024-09-10T22:43:26.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.062+0000 7f292e000640 1 -- 172.21.15.103:0/3954959056 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f292000f3c0 con 0x7f29380b09c0 2024-09-10T22:43:26.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.062+0000 7f292e000640 1 --2- 172.21.15.103:0/3954959056 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f29140725e0 0x7f2914074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:26.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.062+0000 7f292e000640 1 -- 172.21.15.103:0/3954959056 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5507+0+0 (secure 0 0 0) 0x7f2920093390 con 0x7f29380b09c0 2024-09-10T22:43:26.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.062+0000 7f2935e00640 1 --2- 172.21.15.103:0/3954959056 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f29140725e0 0x7f2914074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:26.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.062+0000 7f2935e00640 1 --2- 172.21.15.103:0/3954959056 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f29140725e0 0x7f2914074aa0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f29280016b0 tx=0x7f2928009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:26.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.066+0000 7f292e000640 1 -- 172.21.15.103:0/3954959056 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f293814e6d0 con 0x7f29380b09c0 2024-09-10T22:43:26.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.234+0000 7f293ca00640 1 -- 172.21.15.103:0/3954959056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29380008e0 con 0x7f29380b09c0 2024-09-10T22:43:26.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.234+0000 7f292e000640 1 -- 172.21.15.103:0/3954959056 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+13628 (secure 0 0 0) 0x7f292005eaa0 con 0x7f29380b09c0 2024-09-10T22:43:26.240 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:26.240 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":73,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:43:24.873447+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6835/714242556":"2024-09-11T22:43:21.584691+0000","172.21.15.103:6834/714242556":"2024-09-11T22:43:21.584691+0000","172.21.15.103:6833/4171945106":"2024-09-11T22:43:21.584686+0000","172.21.15.103:6832/4171945106":"2024-09-11T22:43:21.584686+0000","172.21.15.131:6837/360467048":"2024-09-11T22:43:21.584673+0000","172.21.15.131:6836/360467048":"2024-09-11T22:43:21.584673+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:43:26.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.238+0000 7f293ca00640 1 -- 172.21.15.103:0/3954959056 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f29140725e0 msgr2=0x7f2914074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:26.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.238+0000 7f293ca00640 1 --2- 172.21.15.103:0/3954959056 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f29140725e0 0x7f2914074aa0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f29280016b0 tx=0x7f2928009040 comp rx=0 tx=0).stop 2024-09-10T22:43:26.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.238+0000 7f293ca00640 1 -- 172.21.15.103:0/3954959056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29380b09c0 msgr2=0x7f293814d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:26.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.238+0000 7f293ca00640 1 --2- 172.21.15.103:0/3954959056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29380b09c0 0x7f293814d630 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f292000b580 tx=0x7f292000ba40 comp rx=0 tx=0).stop 2024-09-10T22:43:26.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.238+0000 7f293ca00640 1 -- 172.21.15.103:0/3954959056 shutdown_connections 2024-09-10T22:43:26.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.238+0000 7f293ca00640 1 --2- 172.21.15.103:0/3954959056 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f29140725e0 0x7f2914074aa0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.238+0000 7f293ca00640 1 --2- 172.21.15.103:0/3954959056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f293815be30 0x7f293814ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.238+0000 7f293ca00640 1 --2- 172.21.15.103:0/3954959056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29380b09c0 0x7f293814d630 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.238+0000 7f293ca00640 1 --2- 172.21.15.103:0/3954959056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29380ae9c0 0x7f29380b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.238+0000 7f293ca00640 1 -- 172.21.15.103:0/3954959056 >> 172.21.15.103:0/3954959056 conn(0x7f29380d1ac0 msgr2=0x7f2938151070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:26.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.238+0000 7f293ca00640 1 -- 172.21.15.103:0/3954959056 shutdown_connections 2024-09-10T22:43:26.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.238+0000 7f293ca00640 1 -- 172.21.15.103:0/3954959056 wait complete. 2024-09-10T22:43:26.262 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T22:38:39.639064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T22:43:26.263 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T22:43:26.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.402+0000 7f9f8b200640 1 -- 172.21.15.103:0/1209916949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f68003a10 msgr2=0x7f9f68003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:26.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.402+0000 7f9f8b200640 1 --2- 172.21.15.103:0/1209916949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f68003a10 0x7f9f68003e30 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f9f74005fd0 tx=0x7f9f7401ccc0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.402+0000 7f9f89200640 1 -- 172.21.15.103:0/1209916949 reap_dead start 2024-09-10T22:43:26.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f8b200640 1 -- 172.21.15.103:0/1209916949 shutdown_connections 2024-09-10T22:43:26.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f8b200640 1 -- 172.21.15.103:0/1209916949 >> 172.21.15.103:0/1209916949 conn(0x7f9f840d1a20 msgr2=0x7f9f840d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:26.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f8b200640 1 -- 172.21.15.103:0/1209916949 shutdown_connections 2024-09-10T22:43:26.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f8b200640 1 -- 172.21.15.103:0/1209916949 wait complete. 2024-09-10T22:43:26.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f8b200640 1 Processor -- start 2024-09-10T22:43:26.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f8b200640 1 -- start start 2024-09-10T22:43:26.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f8b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f68003a10 0x7f9f840b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:26.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f8b200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f84158c90 0x7f9f840af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:26.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f8b200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f84159110 0x7f9f840afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:26.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f8b200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9f84166dd0 con 0x7f9f68003a10 2024-09-10T22:43:26.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f8b200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9f84166f50 con 0x7f9f84159110 2024-09-10T22:43:26.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f8b200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9f841670d0 con 0x7f9f84158c90 2024-09-10T22:43:26.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f83e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f68003a10 0x7f9f840b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:26.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f83e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f68003a10 0x7f9f840b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51544/0 (socket says 172.21.15.103:51544) 2024-09-10T22:43:26.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f83e00640 1 -- 172.21.15.103:0/3317313895 learned_addr learned my addr 172.21.15.103:0/3317313895 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:26.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f89200640 1 --2- 172.21.15.103:0/3317313895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f84159110 0x7f9f840afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:26.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f7b400640 1 --2- 172.21.15.103:0/3317313895 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f84158c90 0x7f9f840af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:26.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f83e00640 1 -- 172.21.15.103:0/3317313895 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f84158c90 msgr2=0x7f9f840af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:26.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f83e00640 1 --2- 172.21.15.103:0/3317313895 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f84158c90 0x7f9f840af5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f83e00640 1 -- 172.21.15.103:0/3317313895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f84159110 msgr2=0x7f9f840afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:26.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f83e00640 1 --2- 172.21.15.103:0/3317313895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f84159110 0x7f9f840afb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f83e00640 1 -- 172.21.15.103:0/3317313895 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f841fb8a0 con 0x7f9f68003a10 2024-09-10T22:43:26.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f83e00640 1 --2- 172.21.15.103:0/3317313895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f68003a10 0x7f9f840b2cd0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400ba60 tx=0x7f9f740056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:26.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.406+0000 7f9f80c00640 1 -- 172.21.15.103:0/3317313895 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f740ab040 con 0x7f9f68003a10 2024-09-10T22:43:26.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.410+0000 7f9f80c00640 1 -- 172.21.15.103:0/3317313895 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f74004020 con 0x7f9f68003a10 2024-09-10T22:43:26.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.410+0000 7f9f80c00640 1 -- 172.21.15.103:0/3317313895 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f74004430 con 0x7f9f68003a10 2024-09-10T22:43:26.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.410+0000 7f9f8b200640 1 -- 172.21.15.103:0/3317313895 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f841fbb80 con 0x7f9f68003a10 2024-09-10T22:43:26.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.410+0000 7f9f8b200640 1 -- 172.21.15.103:0/3317313895 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f841fc140 con 0x7f9f68003a10 2024-09-10T22:43:26.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.410+0000 7f9f8b200640 1 -- 172.21.15.103:0/3317313895 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f840ae7f0 con 0x7f9f68003a10 2024-09-10T22:43:26.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.410+0000 7f9f80c00640 1 -- 172.21.15.103:0/3317313895 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9f740b8070 con 0x7f9f68003a10 2024-09-10T22:43:26.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.410+0000 7f9f80c00640 1 --2- 172.21.15.103:0/3317313895 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9f600725e0 0x7f9f60074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:26.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.410+0000 7f9f80c00640 1 -- 172.21.15.103:0/3317313895 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5507+0+0 (secure 0 0 0) 0x7f9f7412e3c0 con 0x7f9f68003a10 2024-09-10T22:43:26.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.410+0000 7f9f7b400640 1 --2- 172.21.15.103:0/3317313895 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9f600725e0 0x7f9f60074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:26.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.414+0000 7f9f7b400640 1 --2- 172.21.15.103:0/3317313895 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9f600725e0 0x7f9f60074aa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9f8415a720 tx=0x7f9f6c0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:26.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.414+0000 7f9f80c00640 1 -- 172.21.15.103:0/3317313895 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9f740169d0 con 0x7f9f68003a10 2024-09-10T22:43:26.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.582+0000 7f9f8b200640 1 -- 172.21.15.103:0/3317313895 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9f84071b80 con 0x7f9f68003a10 2024-09-10T22:43:26.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.582+0000 7f9f80c00640 1 -- 172.21.15.103:0/3317313895 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f9f740f9b40 con 0x7f9f68003a10 2024-09-10T22:43:26.586 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-09-10T22:43:26.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.582+0000 7f9f8b200640 1 -- 172.21.15.103:0/3317313895 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9f600725e0 msgr2=0x7f9f60074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:26.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.582+0000 7f9f8b200640 1 --2- 172.21.15.103:0/3317313895 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9f600725e0 0x7f9f60074aa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9f8415a720 tx=0x7f9f6c0091e0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.582+0000 7f9f8b200640 1 -- 172.21.15.103:0/3317313895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f68003a10 msgr2=0x7f9f840b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:26.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.582+0000 7f9f8b200640 1 --2- 172.21.15.103:0/3317313895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f68003a10 0x7f9f840b2cd0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400ba60 tx=0x7f9f740056e0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.582+0000 7f9f8b200640 1 -- 172.21.15.103:0/3317313895 shutdown_connections 2024-09-10T22:43:26.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.582+0000 7f9f8b200640 1 --2- 172.21.15.103:0/3317313895 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9f600725e0 0x7f9f60074aa0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.582+0000 7f9f8b200640 1 --2- 172.21.15.103:0/3317313895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f84159110 0x7f9f840afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.582+0000 7f9f8b200640 1 --2- 172.21.15.103:0/3317313895 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f84158c90 0x7f9f840af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.582+0000 7f9f8b200640 1 --2- 172.21.15.103:0/3317313895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f68003a10 0x7f9f840b2cd0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.582+0000 7f9f8b200640 1 -- 172.21.15.103:0/3317313895 >> 172.21.15.103:0/3317313895 conn(0x7f9f840d1a20 msgr2=0x7f9f8415d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:26.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.586+0000 7f9f8b200640 1 -- 172.21.15.103:0/3317313895 shutdown_connections 2024-09-10T22:43:26.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.586+0000 7f9f8b200640 1 -- 172.21.15.103:0/3317313895 wait complete. 2024-09-10T22:43:26.607 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0' 2024-09-10T22:43:26.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5f0a00640 1 -- 172.21.15.103:0/475161823 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5ec0cc120 msgr2=0x7fd5ec0aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:26.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5f0a00640 1 --2- 172.21.15.103:0/475161823 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5ec0cc120 0x7fd5ec0aeb40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009c80 tx=0x7fd5dc01cce0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5f0a00640 1 -- 172.21.15.103:0/475161823 shutdown_connections 2024-09-10T22:43:26.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5f0a00640 1 --2- 172.21.15.103:0/475161823 >> v2:172.21.15.131:3300/0 conn(0x7fd5ec15c970 0x7fd5ec072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5f0a00640 1 --2- 172.21.15.103:0/475161823 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5ec0cc120 0x7fd5ec0aeb40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5f0a00640 1 -- 172.21.15.103:0/475161823 >> 172.21.15.103:0/475161823 conn(0x7fd5ec06cc00 msgr2=0x7fd5ec06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:26.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5f0a00640 1 -- 172.21.15.103:0/475161823 shutdown_connections 2024-09-10T22:43:26.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5f0a00640 1 -- 172.21.15.103:0/475161823 wait complete. 2024-09-10T22:43:26.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5f0a00640 1 Processor -- start 2024-09-10T22:43:26.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5f0a00640 1 -- start start 2024-09-10T22:43:26.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5f0a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5ec0cc120 0x7fd5ec1f7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:26.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5f0a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5ec0cf790 0x7fd5ec146310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:26.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5f0a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5ec15c970 0x7fd5ec153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:26.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5f0a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ec169030 con 0x7fd5ec0cf790 2024-09-10T22:43:26.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5f0a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ec168eb0 con 0x7fd5ec15c970 2024-09-10T22:43:26.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5f0a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd5ec1691b0 con 0x7fd5ec0cc120 2024-09-10T22:43:26.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5e9400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5ec0cf790 0x7fd5ec146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:26.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5e9400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5ec0cf790 0x7fd5ec146310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38578/0 (socket says 172.21.15.103:38578) 2024-09-10T22:43:26.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.746+0000 7fd5e9400640 1 -- 172.21.15.103:0/3879732282 learned_addr learned my addr 172.21.15.103:0/3879732282 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:26.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.750+0000 7fd5e9e00640 1 --2- 172.21.15.103:0/3879732282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5ec0cc120 0x7fd5ec1f7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:26.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.750+0000 7fd5ea800640 1 --2- 172.21.15.103:0/3879732282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5ec15c970 0x7fd5ec153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:26.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.750+0000 7fd5e9400640 1 -- 172.21.15.103:0/3879732282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5ec0cc120 msgr2=0x7fd5ec1f7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:26.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.750+0000 7fd5e9400640 1 --2- 172.21.15.103:0/3879732282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5ec0cc120 0x7fd5ec1f7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.750+0000 7fd5e9400640 1 -- 172.21.15.103:0/3879732282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5ec15c970 msgr2=0x7fd5ec153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:26.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.750+0000 7fd5e9400640 1 --2- 172.21.15.103:0/3879732282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5ec15c970 0x7fd5ec153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:26.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.750+0000 7fd5e9400640 1 -- 172.21.15.103:0/3879732282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5ec1f7600 con 0x7fd5ec0cf790 2024-09-10T22:43:26.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.750+0000 7fd5e9e00640 1 --2- 172.21.15.103:0/3879732282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5ec0cc120 0x7fd5ec1f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:43:26.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.750+0000 7fd5e9400640 1 --2- 172.21.15.103:0/3879732282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5ec0cf790 0x7fd5ec146310 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800e7a0 tx=0x7fd5d800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:26.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.750+0000 7fd5e2000640 1 -- 172.21.15.103:0/3879732282 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d800cc60 con 0x7fd5ec0cf790 2024-09-10T22:43:26.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.750+0000 7fd5e2000640 1 -- 172.21.15.103:0/3879732282 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5d800ce00 con 0x7fd5ec0cf790 2024-09-10T22:43:26.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.750+0000 7fd5e2000640 1 -- 172.21.15.103:0/3879732282 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8004280 con 0x7fd5ec0cf790 2024-09-10T22:43:26.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.750+0000 7fd5f0a00640 1 -- 172.21.15.103:0/3879732282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5ec0b1ef0 con 0x7fd5ec0cf790 2024-09-10T22:43:26.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.750+0000 7fd5f0a00640 1 -- 172.21.15.103:0/3879732282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5ec1f78a0 con 0x7fd5ec0cf790 2024-09-10T22:43:26.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.750+0000 7fd5f0a00640 1 -- 172.21.15.103:0/3879732282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5ec072e30 con 0x7fd5ec0cf790 2024-09-10T22:43:26.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.750+0000 7fd5e2000640 1 -- 172.21.15.103:0/3879732282 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd5d8003600 con 0x7fd5ec0cf790 2024-09-10T22:43:26.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.754+0000 7fd5e2000640 1 --2- 172.21.15.103:0/3879732282 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5cc0725e0 0x7fd5cc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:26.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.754+0000 7fd5e2000640 1 -- 172.21.15.103:0/3879732282 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5507+0+0 (secure 0 0 0) 0x7fd5d8093b90 con 0x7fd5ec0cf790 2024-09-10T22:43:26.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.754+0000 7fd5e9e00640 1 --2- 172.21.15.103:0/3879732282 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5cc0725e0 0x7fd5cc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:26.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.754+0000 7fd5e9e00640 1 --2- 172.21.15.103:0/3879732282 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5cc0725e0 0x7fd5cc074aa0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0af000 tx=0x7fd5dc01b520 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:26.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.758+0000 7fd5e2000640 1 -- 172.21.15.103:0/3879732282 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd5d805f210 con 0x7fd5ec0cf790 2024-09-10T22:43:26.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:26.982+0000 7fd5f0a00640 1 -- 172.21.15.103:0/3879732282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]} v 0) -- 0x7fd5ec0cece0 con 0x7fd5ec0cf790 2024-09-10T22:43:27.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:27.894+0000 7fd5e2000640 1 -- 172.21.15.103:0/3879732282 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]}]=0 v243) ==== 144+0+0 (secure 0 0 0) 0x7fd5d805eb10 con 0x7fd5ec0cf790 2024-09-10T22:43:27.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:27.898+0000 7fd5f0a00640 1 -- 172.21.15.103:0/3879732282 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5cc0725e0 msgr2=0x7fd5cc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:27.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:27.898+0000 7fd5f0a00640 1 --2- 172.21.15.103:0/3879732282 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5cc0725e0 0x7fd5cc074aa0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0af000 tx=0x7fd5dc01b520 comp rx=0 tx=0).stop 2024-09-10T22:43:27.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:27.898+0000 7fd5f0a00640 1 -- 172.21.15.103:0/3879732282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5ec0cf790 msgr2=0x7fd5ec146310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:27.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:27.898+0000 7fd5f0a00640 1 --2- 172.21.15.103:0/3879732282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5ec0cf790 0x7fd5ec146310 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800e7a0 tx=0x7fd5d800ec60 comp rx=0 tx=0).stop 2024-09-10T22:43:27.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:27.898+0000 7fd5f0a00640 1 -- 172.21.15.103:0/3879732282 shutdown_connections 2024-09-10T22:43:27.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:27.898+0000 7fd5f0a00640 1 --2- 172.21.15.103:0/3879732282 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5cc0725e0 0x7fd5cc074aa0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:27.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:27.898+0000 7fd5f0a00640 1 --2- 172.21.15.103:0/3879732282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5ec15c970 0x7fd5ec153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:27.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:27.898+0000 7fd5f0a00640 1 --2- 172.21.15.103:0/3879732282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5ec0cf790 0x7fd5ec146310 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:27.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:27.898+0000 7fd5f0a00640 1 --2- 172.21.15.103:0/3879732282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5ec0cc120 0x7fd5ec1f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:27.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:27.898+0000 7fd5f0a00640 1 -- 172.21.15.103:0/3879732282 >> 172.21.15.103:0/3879732282 conn(0x7fd5ec06cc00 msgr2=0x7fd5ec0b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:27.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:27.898+0000 7fd5f0a00640 1 -- 172.21.15.103:0/3879732282 shutdown_connections 2024-09-10T22:43:27.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:27.898+0000 7fd5f0a00640 1 -- 172.21.15.103:0/3879732282 wait complete. 2024-09-10T22:43:27.927 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T22:43:28.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.070+0000 7f39d7800640 1 -- 172.21.15.103:0/446780290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d00cdd00 msgr2=0x7f39d00ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:28.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.070+0000 7f39d7800640 1 --2- 172.21.15.103:0/446780290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d00cdd00 0x7f39d00ccdf0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f39b8009900 tx=0x7f39b801c8e0 comp rx=0 tx=0).stop 2024-09-10T22:43:28.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.070+0000 7f39d7800640 1 -- 172.21.15.103:0/446780290 shutdown_connections 2024-09-10T22:43:28.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.070+0000 7f39d7800640 1 --2- 172.21.15.103:0/446780290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d00cdd00 0x7f39d00ccdf0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:28.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.070+0000 7f39d7800640 1 --2- 172.21.15.103:0/446780290 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39d015f1a0 0x7f39d00ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:28.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.070+0000 7f39d7800640 1 -- 172.21.15.103:0/446780290 >> 172.21.15.103:0/446780290 conn(0x7f39d00d1a20 msgr2=0x7f39d00d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:28.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.070+0000 7f39d7800640 1 -- 172.21.15.103:0/446780290 shutdown_connections 2024-09-10T22:43:28.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.070+0000 7f39d7800640 1 -- 172.21.15.103:0/446780290 wait complete. 2024-09-10T22:43:28.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.070+0000 7f39d7800640 1 Processor -- start 2024-09-10T22:43:28.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.070+0000 7f39d7800640 1 -- start start 2024-09-10T22:43:28.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.070+0000 7f39d7800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d00cd330 0x7f39d006f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:28.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.070+0000 7f39d7800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39d00cdd00 0x7f39d01559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:28.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.070+0000 7f39d7800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39d015f1a0 0x7f39d0156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:28.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39d7800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f39d0169120 con 0x7f39d00cd330 2024-09-10T22:43:28.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39d7800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f39d0168fa0 con 0x7f39d015f1a0 2024-09-10T22:43:28.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39d7800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f39d01692a0 con 0x7f39d00cdd00 2024-09-10T22:43:28.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39d4e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d00cd330 0x7f39d006f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:28.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39d4e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d00cd330 0x7f39d006f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38588/0 (socket says 172.21.15.103:38588) 2024-09-10T22:43:28.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39d4e00640 1 -- 172.21.15.103:0/2572285488 learned_addr learned my addr 172.21.15.103:0/2572285488 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:28.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39c7e00640 1 --2- 172.21.15.103:0/2572285488 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39d00cdd00 0x7f39d01559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:28.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39d5800640 1 --2- 172.21.15.103:0/2572285488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39d015f1a0 0x7f39d0156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:28.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39d4e00640 1 -- 172.21.15.103:0/2572285488 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39d00cdd00 msgr2=0x7f39d01559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:28.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39d4e00640 1 --2- 172.21.15.103:0/2572285488 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39d00cdd00 0x7f39d01559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:28.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39d4e00640 1 -- 172.21.15.103:0/2572285488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39d015f1a0 msgr2=0x7f39d0156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:28.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39d4e00640 1 --2- 172.21.15.103:0/2572285488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39d015f1a0 0x7f39d0156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:28.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39d4e00640 1 -- 172.21.15.103:0/2572285488 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d01536e0 con 0x7f39d00cd330 2024-09-10T22:43:28.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39d4e00640 1 --2- 172.21.15.103:0/2572285488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d00cd330 0x7f39d006f7a0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f39c000d720 tx=0x7f39c000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:28.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39cd600640 1 -- 172.21.15.103:0/2572285488 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c0017070 con 0x7f39d00cd330 2024-09-10T22:43:28.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39cd600640 1 -- 172.21.15.103:0/2572285488 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39c0009d20 con 0x7f39d00cd330 2024-09-10T22:43:28.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39cd600640 1 -- 172.21.15.103:0/2572285488 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c0005280 con 0x7f39d00cd330 2024-09-10T22:43:28.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39d7800640 1 -- 172.21.15.103:0/2572285488 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d01539c0 con 0x7f39d00cd330 2024-09-10T22:43:28.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39d7800640 1 -- 172.21.15.103:0/2572285488 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d0153f80 con 0x7f39d00cd330 2024-09-10T22:43:28.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39d7800640 1 -- 172.21.15.103:0/2572285488 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d00ccdf0 con 0x7f39d00cd330 2024-09-10T22:43:28.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.074+0000 7f39cd600640 1 -- 172.21.15.103:0/2572285488 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f39c0005420 con 0x7f39d00cd330 2024-09-10T22:43:28.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.078+0000 7f39cd600640 1 --2- 172.21.15.103:0/2572285488 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f39ac0725e0 0x7f39ac074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:28.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.078+0000 7f39cd600640 1 -- 172.21.15.103:0/2572285488 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5507+0+0 (secure 0 0 0) 0x7f39c0093200 con 0x7f39d00cd330 2024-09-10T22:43:28.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.078+0000 7f39c7e00640 1 --2- 172.21.15.103:0/2572285488 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f39ac0725e0 0x7f39ac074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:28.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.078+0000 7f39c7e00640 1 --2- 172.21.15.103:0/2572285488 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f39ac0725e0 0x7f39ac074aa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f39b80af000 tx=0x7f39b801b120 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:28.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.082+0000 7f39cd600640 1 -- 172.21.15.103:0/2572285488 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f39c005e350 con 0x7f39d00cd330 2024-09-10T22:43:28.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.254+0000 7f39d7800640 1 -- 172.21.15.103:0/2572285488 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f39d006fce0 con 0x7f39d00cd330 2024-09-10T22:43:28.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.254+0000 7f39cd600640 1 -- 172.21.15.103:0/2572285488 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+1998 (secure 0 0 0) 0x7f39c00670c0 con 0x7f39d00cd330 2024-09-10T22:43:28.258 INFO:teuthology.orchestra.run.smithi103.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T22:43:28.259 INFO:teuthology.orchestra.run.smithi103.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T22:43:28.259 INFO:teuthology.orchestra.run.smithi103.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T22:43:28.259 INFO:teuthology.orchestra.run.smithi103.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T22:43:28.259 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4853.781452 2024-09-10T22:43:28.259 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 8222.655229 2024-09-10T22:43:28.259 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4587.934032 2024-09-10T22:43:28.259 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4814.972817 2024-09-10T22:43:28.259 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3485.951614 2024-09-10T22:43:28.259 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3821.456289 2024-09-10T22:43:28.259 INFO:teuthology.orchestra.run.smithi103.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3533.610209 2024-09-10T22:43:28.259 INFO:teuthology.orchestra.run.smithi103.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3752.830807 2024-09-10T22:43:28.259 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced debug_mds 20/20 2024-09-10T22:43:28.259 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T22:43:28.259 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced debug_ms 2/2 2024-09-10T22:43:28.260 INFO:teuthology.orchestra.run.smithi103.stdout:mds dev mds_debug_frag true 2024-09-10T22:43:28.260 INFO:teuthology.orchestra.run.smithi103.stdout:mds dev mds_debug_scatterstat true 2024-09-10T22:43:28.260 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T22:43:28.260 INFO:teuthology.orchestra.run.smithi103.stdout:mds dev mds_verify_scatter true 2024-09-10T22:43:28.260 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T22:43:28.260 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T22:43:28.260 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T22:43:28.260 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced client_mount_timeout 600 2024-09-10T22:43:28.260 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced debug_client 20/20 2024-09-10T22:43:28.260 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced debug_ms 1/1 2024-09-10T22:43:28.260 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T22:43:28.260 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T22:43:28.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.258+0000 7f39d7800640 1 -- 172.21.15.103:0/2572285488 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f39ac0725e0 msgr2=0x7f39ac074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:28.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.258+0000 7f39d7800640 1 --2- 172.21.15.103:0/2572285488 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f39ac0725e0 0x7f39ac074aa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f39b80af000 tx=0x7f39b801b120 comp rx=0 tx=0).stop 2024-09-10T22:43:28.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.258+0000 7f39d7800640 1 -- 172.21.15.103:0/2572285488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d00cd330 msgr2=0x7f39d006f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:28.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.258+0000 7f39d7800640 1 --2- 172.21.15.103:0/2572285488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d00cd330 0x7f39d006f7a0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f39c000d720 tx=0x7f39c000dbe0 comp rx=0 tx=0).stop 2024-09-10T22:43:28.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.258+0000 7f39d7800640 1 -- 172.21.15.103:0/2572285488 shutdown_connections 2024-09-10T22:43:28.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.258+0000 7f39d7800640 1 --2- 172.21.15.103:0/2572285488 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f39ac0725e0 0x7f39ac074aa0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:28.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.258+0000 7f39d7800640 1 --2- 172.21.15.103:0/2572285488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39d015f1a0 0x7f39d0156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:28.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.258+0000 7f39d7800640 1 --2- 172.21.15.103:0/2572285488 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39d00cdd00 0x7f39d01559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:28.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.258+0000 7f39d7800640 1 --2- 172.21.15.103:0/2572285488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d00cd330 0x7f39d006f7a0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:28.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.258+0000 7f39d7800640 1 -- 172.21.15.103:0/2572285488 >> 172.21.15.103:0/2572285488 conn(0x7f39d00d1a20 msgr2=0x7f39d0158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:28.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.258+0000 7f39d7800640 1 -- 172.21.15.103:0/2572285488 shutdown_connections 2024-09-10T22:43:28.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.258+0000 7f39d7800640 1 -- 172.21.15.103:0/2572285488 wait complete. 2024-09-10T22:43:28.280 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T22:43:28.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0948e00640 1 -- 172.21.15.103:0/773999082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f094406f5d0 msgr2=0x7f0944157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:28.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0948e00640 1 --2- 172.21.15.103:0/773999082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f094406f5d0 0x7f0944157bf0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f09440718e0 tx=0x7f093c01cd80 comp rx=0 tx=0).stop 2024-09-10T22:43:28.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0948e00640 1 -- 172.21.15.103:0/773999082 shutdown_connections 2024-09-10T22:43:28.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0948e00640 1 --2- 172.21.15.103:0/773999082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f094406f5d0 0x7f0944157bf0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:28.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0948e00640 1 --2- 172.21.15.103:0/773999082 >> v2:172.21.15.131:3300/0 conn(0x7f09440cd0f0 0x7f094415ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:28.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0948e00640 1 -- 172.21.15.103:0/773999082 >> 172.21.15.103:0/773999082 conn(0x7f09440d0940 msgr2=0x7f09440d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:28.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0948e00640 1 -- 172.21.15.103:0/773999082 shutdown_connections 2024-09-10T22:43:28.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0948e00640 1 -- 172.21.15.103:0/773999082 wait complete. 2024-09-10T22:43:28.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0948e00640 1 Processor -- start 2024-09-10T22:43:28.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0948e00640 1 -- start start 2024-09-10T22:43:28.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0948e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f094406f5d0 0x7f09440cf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:28.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0948e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09440afe20 0x7f09440ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:28.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0948e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09440cd0f0 0x7f094413e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:28.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0948e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f09440b44a0 con 0x7f09440cd0f0 2024-09-10T22:43:28.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0948e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f09440b4320 con 0x7f09440afe20 2024-09-10T22:43:28.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0948e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f09440b4620 con 0x7f094406f5d0 2024-09-10T22:43:28.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0942800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09440cd0f0 0x7f094413e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:28.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0942800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09440cd0f0 0x7f094413e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38592/0 (socket says 172.21.15.103:38592) 2024-09-10T22:43:28.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0942800640 1 -- 172.21.15.103:0/2003220093 learned_addr learned my addr 172.21.15.103:0/2003220093 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:28.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0939400640 1 --2- 172.21.15.103:0/2003220093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09440afe20 0x7f09440ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:28.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.422+0000 7f0941e00640 1 --2- 172.21.15.103:0/2003220093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f094406f5d0 0x7f09440cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:28.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.426+0000 7f0942800640 1 -- 172.21.15.103:0/2003220093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f094406f5d0 msgr2=0x7f09440cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:28.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.426+0000 7f0942800640 1 --2- 172.21.15.103:0/2003220093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f094406f5d0 0x7f09440cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:28.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.426+0000 7f0942800640 1 -- 172.21.15.103:0/2003220093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09440afe20 msgr2=0x7f09440ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:28.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.426+0000 7f0942800640 1 --2- 172.21.15.103:0/2003220093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09440afe20 0x7f09440ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:28.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.426+0000 7f0942800640 1 -- 172.21.15.103:0/2003220093 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09440ce860 con 0x7f09440cd0f0 2024-09-10T22:43:28.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.426+0000 7f0941e00640 1 --2- 172.21.15.103:0/2003220093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f094406f5d0 0x7f09440cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:43:28.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.426+0000 7f0942800640 1 --2- 172.21.15.103:0/2003220093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09440cd0f0 0x7f094413e200 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f093c019990 tx=0x7f093c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:28.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.426+0000 7f093aa00640 1 -- 172.21.15.103:0/2003220093 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c0bb070 con 0x7f09440cd0f0 2024-09-10T22:43:28.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.426+0000 7f093aa00640 1 -- 172.21.15.103:0/2003220093 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f093c004b40 con 0x7f09440cd0f0 2024-09-10T22:43:28.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.426+0000 7f0948e00640 1 -- 172.21.15.103:0/2003220093 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09440ceb40 con 0x7f09440cd0f0 2024-09-10T22:43:28.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.426+0000 7f093aa00640 1 -- 172.21.15.103:0/2003220093 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c0b2040 con 0x7f09440cd0f0 2024-09-10T22:43:28.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.426+0000 7f0948e00640 1 -- 172.21.15.103:0/2003220093 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09440cf100 con 0x7f09440cd0f0 2024-09-10T22:43:28.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.426+0000 7f0948e00640 1 -- 172.21.15.103:0/2003220093 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09440b4bb0 con 0x7f09440cd0f0 2024-09-10T22:43:28.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.426+0000 7f093aa00640 1 -- 172.21.15.103:0/2003220093 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f093c0b5030 con 0x7f09440cd0f0 2024-09-10T22:43:28.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.426+0000 7f093aa00640 1 --2- 172.21.15.103:0/2003220093 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f09200725e0 0x7f0920074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:28.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.426+0000 7f093aa00640 1 -- 172.21.15.103:0/2003220093 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5507+0+0 (secure 0 0 0) 0x7f093c12cef0 con 0x7f09440cd0f0 2024-09-10T22:43:28.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.430+0000 7f0941e00640 1 --2- 172.21.15.103:0/2003220093 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f09200725e0 0x7f0920074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:28.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.430+0000 7f0941e00640 1 --2- 172.21.15.103:0/2003220093 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f09200725e0 0x7f0920074aa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f09440ccb90 tx=0x7f0934009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:28.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.430+0000 7f093aa00640 1 -- 172.21.15.103:0/2003220093 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f093c016970 con 0x7f09440cd0f0 2024-09-10T22:43:28.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.594+0000 7f0948e00640 1 -- 172.21.15.103:0/2003220093 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f094415db80 con 0x7f09440cd0f0 2024-09-10T22:43:28.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.598+0000 7f093aa00640 1 -- 172.21.15.103:0/2003220093 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f093c0f7fa0 con 0x7f09440cd0f0 2024-09-10T22:43:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.602+0000 7f0948e00640 1 -- 172.21.15.103:0/2003220093 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f09200725e0 msgr2=0x7f0920074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.602+0000 7f0948e00640 1 --2- 172.21.15.103:0/2003220093 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f09200725e0 0x7f0920074aa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f09440ccb90 tx=0x7f0934009040 comp rx=0 tx=0).stop 2024-09-10T22:43:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.602+0000 7f0948e00640 1 -- 172.21.15.103:0/2003220093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09440cd0f0 msgr2=0x7f094413e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.602+0000 7f0948e00640 1 --2- 172.21.15.103:0/2003220093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09440cd0f0 0x7f094413e200 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f093c019990 tx=0x7f093c004270 comp rx=0 tx=0).stop 2024-09-10T22:43:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.602+0000 7f0948e00640 1 -- 172.21.15.103:0/2003220093 shutdown_connections 2024-09-10T22:43:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.602+0000 7f0948e00640 1 --2- 172.21.15.103:0/2003220093 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f09200725e0 0x7f0920074aa0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.602+0000 7f0948e00640 1 --2- 172.21.15.103:0/2003220093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09440cd0f0 0x7f094413e200 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.602+0000 7f0948e00640 1 --2- 172.21.15.103:0/2003220093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09440afe20 0x7f09440ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.602+0000 7f0948e00640 1 --2- 172.21.15.103:0/2003220093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f094406f5d0 0x7f09440cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.602+0000 7f0948e00640 1 -- 172.21.15.103:0/2003220093 >> 172.21.15.103:0/2003220093 conn(0x7f09440d0940 msgr2=0x7f09440d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.602+0000 7f0948e00640 1 -- 172.21.15.103:0/2003220093 shutdown_connections 2024-09-10T22:43:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:28.602+0000 7f0948e00640 1 -- 172.21.15.103:0/2003220093 wait complete. 2024-09-10T22:43:28.626 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T22:43:28.626 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:43:28.730 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:43:28.824 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T22:43:28.824 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:43:28.824 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:43:28.833 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350248k,nr_inodes=4087562,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3542 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T22:43:28.833 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:43:28.834 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:43:28.843 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:43:28.843 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:43:28.843 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:43:28.884 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350248k,nr_inodes=4087562,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3542 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T22:43:28.884 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:43:28.884 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:43:28.893 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:43:28.893 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T22:43:28.894 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:43:29.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.066+0000 7f8021000640 1 -- 172.21.15.103:0/199241574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f801c0ce690 msgr2=0x7f801c0ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:29.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.066+0000 7f8021000640 1 --2- 172.21.15.103:0/199241574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f801c0ce690 0x7f801c0ceb00 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f801c06e410 tx=0x7f800801c800 comp rx=0 tx=0).stop 2024-09-10T22:43:29.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.066+0000 7f8021000640 1 -- 172.21.15.103:0/199241574 shutdown_connections 2024-09-10T22:43:29.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.066+0000 7f8021000640 1 --2- 172.21.15.103:0/199241574 >> v2:172.21.15.131:3300/0 conn(0x7f801c06eb00 0x7f801c06ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:29.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.066+0000 7f8021000640 1 --2- 172.21.15.103:0/199241574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f801c0ce690 0x7f801c0ceb00 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:29.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.066+0000 7f8021000640 1 -- 172.21.15.103:0/199241574 >> 172.21.15.103:0/199241574 conn(0x7f801c0cff60 msgr2=0x7f801c0d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:29.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.066+0000 7f8021000640 1 -- 172.21.15.103:0/199241574 shutdown_connections 2024-09-10T22:43:29.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.066+0000 7f8021000640 1 -- 172.21.15.103:0/199241574 wait complete. 2024-09-10T22:43:29.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.066+0000 7f8021000640 1 Processor -- start 2024-09-10T22:43:29.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.066+0000 7f8021000640 1 -- start start 2024-09-10T22:43:29.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f8021000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f801c06eb00 0x7f801c1580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:29.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f8021000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f801c0ce690 0x7f801c156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:29.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f8021000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f801c15b6d0 0x7f801c156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:29.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f8021000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f801c168810 con 0x7f801c06eb00 2024-09-10T22:43:29.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f8021000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f801c168690 con 0x7f801c15b6d0 2024-09-10T22:43:29.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f8021000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f801c168990 con 0x7f801c0ce690 2024-09-10T22:43:29.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f801b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f801c06eb00 0x7f801c1580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:29.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f801b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f801c06eb00 0x7f801c1580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38612/0 (socket says 172.21.15.103:38612) 2024-09-10T22:43:29.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f801b400640 1 -- 172.21.15.103:0/393598588 learned_addr learned my addr 172.21.15.103:0/393598588 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:29.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f801aa00640 1 --2- 172.21.15.103:0/393598588 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f801c0ce690 0x7f801c156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:29.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f801b400640 1 -- 172.21.15.103:0/393598588 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f801c0ce690 msgr2=0x7f801c156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:29.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f801b400640 1 --2- 172.21.15.103:0/393598588 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f801c0ce690 0x7f801c156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:29.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f801b400640 1 -- 172.21.15.103:0/393598588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f801c15b6d0 msgr2=0x7f801c156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:29.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f801b400640 1 --2- 172.21.15.103:0/393598588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f801c15b6d0 0x7f801c156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:29.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f801b400640 1 -- 172.21.15.103:0/393598588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f801c0b2fc0 con 0x7f801c06eb00 2024-09-10T22:43:29.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f801b400640 1 --2- 172.21.15.103:0/393598588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f801c06eb00 0x7f801c1580d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f800c001ec0 tx=0x7f800c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:29.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f8013400640 1 -- 172.21.15.103:0/393598588 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c017070 con 0x7f801c06eb00 2024-09-10T22:43:29.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f8013400640 1 -- 172.21.15.103:0/393598588 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f800c003600 con 0x7f801c06eb00 2024-09-10T22:43:29.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f8013400640 1 -- 172.21.15.103:0/393598588 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c003a50 con 0x7f801c06eb00 2024-09-10T22:43:29.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f8021000640 1 -- 172.21.15.103:0/393598588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f801c0b32a0 con 0x7f801c06eb00 2024-09-10T22:43:29.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f8021000640 1 -- 172.21.15.103:0/393598588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f801c0b3d80 con 0x7f801c06eb00 2024-09-10T22:43:29.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f8021000640 1 -- 172.21.15.103:0/393598588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f801c0ceb00 con 0x7f801c06eb00 2024-09-10T22:43:29.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.070+0000 7f8013400640 1 -- 172.21.15.103:0/393598588 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f800c003bf0 con 0x7f801c06eb00 2024-09-10T22:43:29.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.074+0000 7f8013400640 1 --2- 172.21.15.103:0/393598588 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7ffc0725e0 0x7f7ffc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:29.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.074+0000 7f8013400640 1 -- 172.21.15.103:0/393598588 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5507+0+0 (secure 0 0 0) 0x7f800c092790 con 0x7f801c06eb00 2024-09-10T22:43:29.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.074+0000 7f801aa00640 1 --2- 172.21.15.103:0/393598588 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7ffc0725e0 0x7f7ffc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:29.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.074+0000 7f801aa00640 1 --2- 172.21.15.103:0/393598588 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7ffc0725e0 0x7f7ffc074aa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f80080af000 tx=0x7f800801b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:29.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.078+0000 7f8013400640 1 -- 172.21.15.103:0/393598588 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f800c05df20 con 0x7f801c06eb00 2024-09-10T22:43:29.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.274+0000 7f8021000640 1 -- 172.21.15.103:0/393598588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f801c158ec0 con 0x7f801c06eb00 2024-09-10T22:43:29.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.274+0000 7f8013400640 1 -- 172.21.15.103:0/393598588 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+3923 (secure 0 0 0) 0x7f800c05d820 con 0x7f801c06eb00 2024-09-10T22:43:29.280 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:29.281 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":66,"btime":"2024-09-10T22:43:22:587257+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2961968581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2961968581},{"type":"v1","addr":"172.21.15.131:6835","nonce":2961968581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/3919875831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3919875831},{"type":"v1","addr":"172.21.15.103:6833","nonce":3919875831}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6783,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/4188698159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":4188698159},{"type":"v1","addr":"172.21.15.131:6837","nonce":4188698159}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6789,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/2194067296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2194067296},{"type":"v1","addr":"172.21.15.103:6835","nonce":2194067296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[]} 2024-09-10T22:43:29.281 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 66 2024-09-10T22:43:29.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.278+0000 7f8021000640 1 -- 172.21.15.103:0/393598588 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7ffc0725e0 msgr2=0x7f7ffc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:29.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.278+0000 7f8021000640 1 --2- 172.21.15.103:0/393598588 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7ffc0725e0 0x7f7ffc074aa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f80080af000 tx=0x7f800801b040 comp rx=0 tx=0).stop 2024-09-10T22:43:29.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.278+0000 7f8021000640 1 -- 172.21.15.103:0/393598588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f801c06eb00 msgr2=0x7f801c1580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:29.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.278+0000 7f8021000640 1 --2- 172.21.15.103:0/393598588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f801c06eb00 0x7f801c1580d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f800c001ec0 tx=0x7f800c00c890 comp rx=0 tx=0).stop 2024-09-10T22:43:29.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.278+0000 7f8021000640 1 -- 172.21.15.103:0/393598588 shutdown_connections 2024-09-10T22:43:29.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.278+0000 7f8021000640 1 --2- 172.21.15.103:0/393598588 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7ffc0725e0 0x7f7ffc074aa0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:29.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.278+0000 7f8021000640 1 --2- 172.21.15.103:0/393598588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f801c15b6d0 0x7f801c156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:29.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.278+0000 7f8021000640 1 --2- 172.21.15.103:0/393598588 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f801c0ce690 0x7f801c156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:29.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.278+0000 7f8021000640 1 --2- 172.21.15.103:0/393598588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f801c06eb00 0x7f801c1580d0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:29.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.278+0000 7f8021000640 1 -- 172.21.15.103:0/393598588 >> 172.21.15.103:0/393598588 conn(0x7f801c0cff60 msgr2=0x7f801c0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:29.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.278+0000 7f8021000640 1 -- 172.21.15.103:0/393598588 shutdown_connections 2024-09-10T22:43:29.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.278+0000 7f8021000640 1 -- 172.21.15.103:0/393598588 wait complete. 2024-09-10T22:43:29.301 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T22:43:29.302 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T22:43:29.302 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T22:43:29.302 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:43:29.302 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T22:43:29.302 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T22:43:29.302 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T22:43:29.302 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:43:29.303 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T22:43:29.303 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T22:43:29.303 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T22:43:29.303 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:43:29.303 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T22:43:29.303 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T22:43:29.304 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T22:43:29.304 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:43:29.314 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T22:43:29.315 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T22:43:29.316 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T22:43:29.316 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T22:43:29.318 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T22:43:29.318 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T22:43:29.318 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T22:43:29.319 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T22:43:29.364 INFO:tasks.ceph.mds.d:Started 2024-09-10T22:43:29.365 DEBUG:teuthology.parallel:result is None 2024-09-10T22:43:29.366 INFO:tasks.ceph.mds.a:Started 2024-09-10T22:43:29.367 DEBUG:teuthology.parallel:result is None 2024-09-10T22:43:29.367 INFO:tasks.ceph.mds.b:Started 2024-09-10T22:43:29.367 DEBUG:teuthology.parallel:result is None 2024-09-10T22:43:29.368 INFO:tasks.ceph.mds.c:Started 2024-09-10T22:43:29.369 DEBUG:teuthology.parallel:result is None 2024-09-10T22:43:29.369 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T22:43:29.452 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-09-10T22:43:29.452 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-09-10T22:43:29.456 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2024-09-10T22:43:29.457 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2024-09-10T22:43:29.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.514+0000 7fc8bf600640 1 -- 172.21.15.103:0/2149052479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b80ae9c0 msgr2=0x7fc8b80aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:29.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.514+0000 7fc8bf600640 1 --2- 172.21.15.103:0/2149052479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b80ae9c0 0x7fc8b80aee70 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009bc0 tx=0x7fc8b001cb10 comp rx=0 tx=0).stop 2024-09-10T22:43:29.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.514+0000 7fc8bf600640 1 -- 172.21.15.103:0/2149052479 shutdown_connections 2024-09-10T22:43:29.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.514+0000 7fc8bf600640 1 --2- 172.21.15.103:0/2149052479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b80ae9c0 0x7fc8b80aee70 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:29.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.514+0000 7fc8bf600640 1 --2- 172.21.15.103:0/2149052479 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8b815be30 0x7fc8b80ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:29.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.514+0000 7fc8bf600640 1 -- 172.21.15.103:0/2149052479 >> 172.21.15.103:0/2149052479 conn(0x7fc8b80d1ac0 msgr2=0x7fc8b80d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:29.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.514+0000 7fc8bf600640 1 -- 172.21.15.103:0/2149052479 shutdown_connections 2024-09-10T22:43:29.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.514+0000 7fc8bf600640 1 -- 172.21.15.103:0/2149052479 wait complete. 2024-09-10T22:43:29.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8bf600640 1 Processor -- start 2024-09-10T22:43:29.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8bf600640 1 -- start start 2024-09-10T22:43:29.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8bf600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8b80ae9c0 0x7fc8b8071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:29.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8bf600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b80b09c0 0x7fc8b8071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:29.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8bf600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8b815be30 0x7fc8b81f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:29.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8bf600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8168df0 con 0x7fc8b80b09c0 2024-09-10T22:43:29.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8bf600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8168c70 con 0x7fc8b80ae9c0 2024-09-10T22:43:29.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8bf600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b8168f70 con 0x7fc8b815be30 2024-09-10T22:43:29.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8b7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b80b09c0 0x7fc8b8071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:29.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8b7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b80b09c0 0x7fc8b8071d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38670/0 (socket says 172.21.15.103:38670) 2024-09-10T22:43:29.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8b7e00640 1 -- 172.21.15.103:0/1019517972 learned_addr learned my addr 172.21.15.103:0/1019517972 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:29.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8bcc00640 1 --2- 172.21.15.103:0/1019517972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8b80ae9c0 0x7fc8b8071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:29.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8bd600640 1 --2- 172.21.15.103:0/1019517972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8b815be30 0x7fc8b81f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:29.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8b7e00640 1 -- 172.21.15.103:0/1019517972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8b815be30 msgr2=0x7fc8b81f8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:29.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8b7e00640 1 --2- 172.21.15.103:0/1019517972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8b815be30 0x7fc8b81f8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:29.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8b7e00640 1 -- 172.21.15.103:0/1019517972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8b80ae9c0 msgr2=0x7fc8b8071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:29.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8b7e00640 1 --2- 172.21.15.103:0/1019517972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8b80ae9c0 0x7fc8b8071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:29.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8b7e00640 1 -- 172.21.15.103:0/1019517972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b80c8cc0 con 0x7fc8b80b09c0 2024-09-10T22:43:29.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8b7e00640 1 --2- 172.21.15.103:0/1019517972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b80b09c0 0x7fc8b8071d90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400c400 tx=0x7fc8a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:29.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8b4c00640 1 -- 172.21.15.103:0/1019517972 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4011790 con 0x7fc8b80b09c0 2024-09-10T22:43:29.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8b4c00640 1 -- 172.21.15.103:0/1019517972 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8a4017070 con 0x7fc8b80b09c0 2024-09-10T22:43:29.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8b4c00640 1 -- 172.21.15.103:0/1019517972 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4011d00 con 0x7fc8b80b09c0 2024-09-10T22:43:29.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8bf600640 1 -- 172.21.15.103:0/1019517972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b80c8fa0 con 0x7fc8b80b09c0 2024-09-10T22:43:29.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.518+0000 7fc8bf600640 1 -- 172.21.15.103:0/1019517972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b80c9560 con 0x7fc8b80b09c0 2024-09-10T22:43:29.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.522+0000 7fc8bf600640 1 -- 172.21.15.103:0/1019517972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b80c9760 con 0x7fc8b80b09c0 2024-09-10T22:43:29.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.522+0000 7fc8b4c00640 1 -- 172.21.15.103:0/1019517972 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc8a401c460 con 0x7fc8b80b09c0 2024-09-10T22:43:29.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.522+0000 7fc8b4c00640 1 --2- 172.21.15.103:0/1019517972 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc8980725e0 0x7fc898074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:29.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.522+0000 7fc8b4c00640 1 -- 172.21.15.103:0/1019517972 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5507+0+0 (secure 0 0 0) 0x7fc8a4092e50 con 0x7fc8b80b09c0 2024-09-10T22:43:29.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.522+0000 7fc8bcc00640 1 --2- 172.21.15.103:0/1019517972 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc8980725e0 0x7fc898074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:29.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.522+0000 7fc8bcc00640 1 --2- 172.21.15.103:0/1019517972 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc8980725e0 0x7fc898074aa0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00bb50 tx=0x7fc8ac00b2e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:29.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.526+0000 7fc8b4c00640 1 -- 172.21.15.103:0/1019517972 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc8b80c9760 con 0x7fc8b80b09c0 2024-09-10T22:43:29.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.706+0000 7fc8bf600640 1 -- 172.21.15.103:0/1019517972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fc8b80aee70 con 0x7fc8b80b09c0 2024-09-10T22:43:29.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.914+0000 7fc8b4c00640 1 -- 172.21.15.103:0/1019517972 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v75) ==== 97+0+0 (secure 0 0 0) 0x7fc8a405df90 con 0x7fc8b80b09c0 2024-09-10T22:43:29.920 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blocklist entries 2024-09-10T22:43:29.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.918+0000 7fc8bf600640 1 -- 172.21.15.103:0/1019517972 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc8980725e0 msgr2=0x7fc898074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:29.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.918+0000 7fc8bf600640 1 --2- 172.21.15.103:0/1019517972 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc8980725e0 0x7fc898074aa0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00bb50 tx=0x7fc8ac00b2e0 comp rx=0 tx=0).stop 2024-09-10T22:43:29.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.918+0000 7fc8bf600640 1 -- 172.21.15.103:0/1019517972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b80b09c0 msgr2=0x7fc8b8071d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:29.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.918+0000 7fc8bf600640 1 --2- 172.21.15.103:0/1019517972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b80b09c0 0x7fc8b8071d90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400c400 tx=0x7fc8a400c8c0 comp rx=0 tx=0).stop 2024-09-10T22:43:29.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.918+0000 7fc8bf600640 1 -- 172.21.15.103:0/1019517972 shutdown_connections 2024-09-10T22:43:29.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.918+0000 7fc8bf600640 1 --2- 172.21.15.103:0/1019517972 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc8980725e0 0x7fc898074aa0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:29.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.918+0000 7fc8bf600640 1 --2- 172.21.15.103:0/1019517972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8b815be30 0x7fc8b81f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:29.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.918+0000 7fc8bf600640 1 --2- 172.21.15.103:0/1019517972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b80b09c0 0x7fc8b8071d90 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:29.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.918+0000 7fc8bf600640 1 --2- 172.21.15.103:0/1019517972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8b80ae9c0 0x7fc8b8071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:29.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.918+0000 7fc8bf600640 1 -- 172.21.15.103:0/1019517972 >> 172.21.15.103:0/1019517972 conn(0x7fc8b80d1ac0 msgr2=0x7fc8b80b6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:29.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.918+0000 7fc8bf600640 1 -- 172.21.15.103:0/1019517972 shutdown_connections 2024-09-10T22:43:29.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:29.918+0000 7fc8bf600640 1 -- 172.21.15.103:0/1019517972 wait complete. 2024-09-10T22:43:29.943 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T22:43:30.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.078+0000 7f6726a00640 1 -- 172.21.15.103:0/102174429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67200b3150 msgr2=0x7f6720072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:30.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.078+0000 7f6726a00640 1 --2- 172.21.15.103:0/102174429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67200b3150 0x7f6720072500 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f6708009840 tx=0x7f670801c820 comp rx=0 tx=0).stop 2024-09-10T22:43:30.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f6726a00640 1 -- 172.21.15.103:0/102174429 shutdown_connections 2024-09-10T22:43:30.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f6726a00640 1 --2- 172.21.15.103:0/102174429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67200b3150 0x7f6720072500 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f6726a00640 1 --2- 172.21.15.103:0/102174429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f67200cf260 0x7f67200b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f6726a00640 1 -- 172.21.15.103:0/102174429 >> 172.21.15.103:0/102174429 conn(0x7f672006cc00 msgr2=0x7f672006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:30.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f6726a00640 1 -- 172.21.15.103:0/102174429 shutdown_connections 2024-09-10T22:43:30.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f6726a00640 1 -- 172.21.15.103:0/102174429 wait complete. 2024-09-10T22:43:30.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f6726a00640 1 Processor -- start 2024-09-10T22:43:30.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f6726a00640 1 -- start start 2024-09-10T22:43:30.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f6726a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6720072a40 0x7f6720148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:30.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f6726a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f67200b3150 0x7f67201f70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:30.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f6726a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67200cf260 0x7f67201fb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:30.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f6726a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f672006e7e0 con 0x7f6720072a40 2024-09-10T22:43:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f6726a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f672006e960 con 0x7f67200cf260 2024-09-10T22:43:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f6726a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f672006eae0 con 0x7f67200b3150 2024-09-10T22:43:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f671fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6720072a40 0x7f6720148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f671fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6720072a40 0x7f6720148e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38684/0 (socket says 172.21.15.103:38684) 2024-09-10T22:43:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f671fe00640 1 -- 172.21.15.103:0/3840957744 learned_addr learned my addr 172.21.15.103:0/3840957744 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f6724a00640 1 --2- 172.21.15.103:0/3840957744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67200cf260 0x7f67201fb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f6717400640 1 --2- 172.21.15.103:0/3840957744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f67200b3150 0x7f67201f70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f671fe00640 1 -- 172.21.15.103:0/3840957744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f67200b3150 msgr2=0x7f67201f70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f671fe00640 1 --2- 172.21.15.103:0/3840957744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f67200b3150 0x7f67201f70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f671fe00640 1 -- 172.21.15.103:0/3840957744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67200cf260 msgr2=0x7f67201fb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f671fe00640 1 --2- 172.21.15.103:0/3840957744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67200cf260 0x7f67201fb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f671fe00640 1 -- 172.21.15.103:0/3840957744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67201fb6b0 con 0x7f6720072a40 2024-09-10T22:43:30.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f6717400640 1 --2- 172.21.15.103:0/3840957744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f67200b3150 0x7f67201f70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:30.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f6724a00640 1 --2- 172.21.15.103:0/3840957744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67200cf260 0x7f67201fb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:30.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f671fe00640 1 --2- 172.21.15.103:0/3840957744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6720072a40 0x7f6720148e60 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f671000ea90 tx=0x7f671000ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:30.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.082+0000 7f671cc00640 1 -- 172.21.15.103:0/3840957744 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671001b070 con 0x7f6720072a40 2024-09-10T22:43:30.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.086+0000 7f671cc00640 1 -- 172.21.15.103:0/3840957744 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f671000ccb0 con 0x7f6720072a40 2024-09-10T22:43:30.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.086+0000 7f671cc00640 1 -- 172.21.15.103:0/3840957744 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710016670 con 0x7f6720072a40 2024-09-10T22:43:30.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.086+0000 7f6726a00640 1 -- 172.21.15.103:0/3840957744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67201f7750 con 0x7f6720072a40 2024-09-10T22:43:30.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.086+0000 7f6726a00640 1 -- 172.21.15.103:0/3840957744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67201f7d10 con 0x7f6720072a40 2024-09-10T22:43:30.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.086+0000 7f6726a00640 1 -- 172.21.15.103:0/3840957744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6720072500 con 0x7f6720072a40 2024-09-10T22:43:30.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.086+0000 7f671cc00640 1 -- 172.21.15.103:0/3840957744 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f671000b040 con 0x7f6720072a40 2024-09-10T22:43:30.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.086+0000 7f671cc00640 1 --2- 172.21.15.103:0/3840957744 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f66fc072610 0x7f66fc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:30.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.086+0000 7f671cc00640 1 -- 172.21.15.103:0/3840957744 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5249+0+0 (secure 0 0 0) 0x7f6710093200 con 0x7f6720072a40 2024-09-10T22:43:30.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.086+0000 7f6717400640 1 --2- 172.21.15.103:0/3840957744 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f66fc072610 0x7f66fc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:30.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.090+0000 7f6717400640 1 --2- 172.21.15.103:0/3840957744 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f66fc072610 0x7f66fc074ad0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f67080af000 tx=0x7f670801b060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:30.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.090+0000 7f671cc00640 1 -- 172.21.15.103:0/3840957744 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f67201fb6b0 con 0x7f6720072a40 2024-09-10T22:43:30.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.314+0000 7f6726a00640 1 -- 172.21.15.103:0/3840957744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6720152e20 con 0x7f6720072a40 2024-09-10T22:43:30.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.314+0000 7f671cc00640 1 -- 172.21.15.103:0/3840957744 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f671005e3b0 con 0x7f6720072a40 2024-09-10T22:43:30.318 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:30.318 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:43:30.318 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2024-09-10T22:43:30.318 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.318 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2024-09-10T22:43:30.318 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmh8HQHBAAZlp4CnHLegqhgWrgXoyltw==", 2024-09-10T22:43:30.318 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.318 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:43:30.318 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:43:30.318 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:43:30.318 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:43:30.318 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.319 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:30.319 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.319 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2024-09-10T22:43:30.319 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmpYUNKRAAstv0pZDy3081UKcsSWnWIg==", 2024-09-10T22:43:30.319 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.319 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:43:30.319 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:43:30.319 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:43:30.319 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:43:30.319 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.319 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:30.319 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.319 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.c", 2024-09-10T22:43:30.320 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBm8I0TJBAAmW480qKYYrolVm7+SlJ97w==", 2024-09-10T22:43:30.320 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.320 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:43:30.320 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:43:30.320 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:43:30.320 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:43:30.320 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.320 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:30.320 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.320 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.d", 2024-09-10T22:43:30.320 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmB55uMBAA1VqVuUEAk1i2LFBoZXiRmA==", 2024-09-10T22:43:30.320 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.320 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:43:30.321 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:43:30.321 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:43:30.321 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:43:30.321 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.321 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:30.321 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.321 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2024-09-10T22:43:30.321 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA/yuBm+fNzNRAAwt8IZXd3mcEh5UbXc924UQ==", 2024-09-10T22:43:30.321 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.321 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:43:30.321 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:43:30.321 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:43:30.321 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.321 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:30.322 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.322 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2024-09-10T22:43:30.322 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBDyuBmNBfvDhAAcBNATtrJNZ4RFzYXqWt2pg==", 2024-09-10T22:43:30.322 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.322 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:43:30.322 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:43:30.322 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:43:30.322 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.322 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:30.322 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.322 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2024-09-10T22:43:30.322 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBGyuBmJD9HJBAAgq8tqoeDT8WNr7pMxQCCJw==", 2024-09-10T22:43:30.322 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.323 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:43:30.323 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:43:30.323 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:43:30.323 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.323 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:30.323 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.323 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2024-09-10T22:43:30.323 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBJyuBmzxWIOhAA4yOLmTZAY0MRLj+w3mhCeQ==", 2024-09-10T22:43:30.323 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.323 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:43:30.323 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:43:30.323 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:43:30.323 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.323 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:30.324 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.324 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2024-09-10T22:43:30.324 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBQyuBm3pi6ABAAnwu13uYkLRJuU5y+DE2Isw==", 2024-09-10T22:43:30.324 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.324 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:43:30.324 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:43:30.324 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:43:30.324 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.324 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:30.324 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.324 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2024-09-10T22:43:30.324 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBTyuBmkaPVFhAALlwgsnQ/dUJVLTK2iAh6Ww==", 2024-09-10T22:43:30.324 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.325 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:43:30.325 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:43:30.325 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:43:30.325 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:30.325 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.325 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2024-09-10T22:43:30.325 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBWyuBmL2kKKxAAbxeyAuzd994tvNfKKs+WIA==", 2024-09-10T22:43:30.325 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.325 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:43:30.325 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:43:30.325 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:43:30.325 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:30.326 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.326 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2024-09-10T22:43:30.326 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBayuBmUmSwBBAAWTFVgtYXlyEI+rJzGIM+Aw==", 2024-09-10T22:43:30.326 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.326 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:43:30.326 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:43:30.326 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:43:30.326 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:30.326 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.326 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2024-09-10T22:43:30.326 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmtOhZNBAAeszxWpV60NIn/zOInT5Zzw==", 2024-09-10T22:43:30.326 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.326 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:43:30.327 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2024-09-10T22:43:30.327 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T22:43:30.327 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.327 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:30.327 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.327 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2024-09-10T22:43:30.327 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9yuBmu20iAhAASacT/hh3sxW1XU/XD6uDjA==", 2024-09-10T22:43:30.327 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.327 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:43:30.327 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:43:30.327 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:43:30.327 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:43:30.327 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.327 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:30.328 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.328 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2024-09-10T22:43:30.328 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmd1E5OhAAfidEn8dwfGna8gwefsYtUg==", 2024-09-10T22:43:30.328 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.328 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:43:30.328 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:43:30.328 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:43:30.328 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:43:30.328 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:30.328 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.328 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2024-09-10T22:43:30.328 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9yuBmGGhVCBAAAs3y0cfqMN0t0/PTNsVEQw==", 2024-09-10T22:43:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:43:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:43:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:43:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:43:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2024-09-10T22:43:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmsY75ABAAYeEF+hTiVUtmqzwU0IIpjA==", 2024-09-10T22:43:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-09-10T22:43:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:43:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:43:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:43:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2024-09-10T22:43:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmghJQGBAAXvlC58nhT9H/c71/ToGCSw==", 2024-09-10T22:43:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-09-10T22:43:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2024-09-10T22:43:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:43:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2024-09-10T22:43:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBma9x+FBAAQrKkw3eGcKnLxSqVz/DHJQ==", 2024-09-10T22:43:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:43:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-09-10T22:43:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2024-09-10T22:43:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:43:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T22:43:30.331 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:43:30.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.314+0000 7f6726a00640 1 -- 172.21.15.103:0/3840957744 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f66fc072610 msgr2=0x7f66fc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:30.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.314+0000 7f6726a00640 1 --2- 172.21.15.103:0/3840957744 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f66fc072610 0x7f66fc074ad0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f67080af000 tx=0x7f670801b060 comp rx=0 tx=0).stop 2024-09-10T22:43:30.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.314+0000 7f6726a00640 1 -- 172.21.15.103:0/3840957744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6720072a40 msgr2=0x7f6720148e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:30.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.314+0000 7f6726a00640 1 --2- 172.21.15.103:0/3840957744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6720072a40 0x7f6720148e60 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f671000ea90 tx=0x7f671000ef50 comp rx=0 tx=0).stop 2024-09-10T22:43:30.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.314+0000 7f6726a00640 1 -- 172.21.15.103:0/3840957744 shutdown_connections 2024-09-10T22:43:30.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.314+0000 7f6726a00640 1 --2- 172.21.15.103:0/3840957744 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f66fc072610 0x7f66fc074ad0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.314+0000 7f6726a00640 1 --2- 172.21.15.103:0/3840957744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67200cf260 0x7f67201fb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.314+0000 7f6726a00640 1 --2- 172.21.15.103:0/3840957744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f67200b3150 0x7f67201f70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.314+0000 7f6726a00640 1 --2- 172.21.15.103:0/3840957744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6720072a40 0x7f6720148e60 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.314+0000 7f6726a00640 1 -- 172.21.15.103:0/3840957744 >> 172.21.15.103:0/3840957744 conn(0x7f672006cc00 msgr2=0x7f672015cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.314+0000 7f6726a00640 1 -- 172.21.15.103:0/3840957744 shutdown_connections 2024-09-10T22:43:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.314+0000 7f6726a00640 1 -- 172.21.15.103:0/3840957744 wait complete. 2024-09-10T22:43:30.339 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T22:43:30.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.478+0000 7f9afd600640 1 -- 172.21.15.103:0/1623454104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9af80b4b20 msgr2=0x7f9af815d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:30.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.478+0000 7f9afd600640 1 --2- 172.21.15.103:0/1623454104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9af80b4b20 0x7f9af815d6a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f9af80d03c0 tx=0x7f9ae001d140 comp rx=0 tx=0).stop 2024-09-10T22:43:30.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.478+0000 7f9afd600640 1 -- 172.21.15.103:0/1623454104 shutdown_connections 2024-09-10T22:43:30.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.478+0000 7f9afd600640 1 --2- 172.21.15.103:0/1623454104 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af8073c30 0x7f9af80740e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.478+0000 7f9afd600640 1 --2- 172.21.15.103:0/1623454104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9af80b4b20 0x7f9af815d6a0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.478+0000 7f9afd600640 1 --2- 172.21.15.103:0/1623454104 >> v2:172.21.15.131:3300/0 conn(0x7f9af8150a50 0x7f9af815aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.478+0000 7f9afd600640 1 -- 172.21.15.103:0/1623454104 >> 172.21.15.103:0/1623454104 conn(0x7f9af806cc00 msgr2=0x7f9af806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:30.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.478+0000 7f9afd600640 1 -- 172.21.15.103:0/1623454104 shutdown_connections 2024-09-10T22:43:30.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.478+0000 7f9afd600640 1 -- 172.21.15.103:0/1623454104 wait complete. 2024-09-10T22:43:30.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.478+0000 7f9afd600640 1 Processor -- start 2024-09-10T22:43:30.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.478+0000 7f9afd600640 1 -- start start 2024-09-10T22:43:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.478+0000 7f9afd600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9af8073c30 0x7f9af81f86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.478+0000 7f9afd600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af80b4b20 0x7f9af80ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.478+0000 7f9afd600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9af8150a50 0x7f9af806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.478+0000 7f9afd600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9af806e520 con 0x7f9af8150a50 2024-09-10T22:43:30.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.478+0000 7f9afd600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9af80732c0 con 0x7f9af8073c30 2024-09-10T22:43:30.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9afd600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9af806e6a0 con 0x7f9af80b4b20 2024-09-10T22:43:30.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9af7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9af8150a50 0x7f9af806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:30.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9af7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9af8150a50 0x7f9af806ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38708/0 (socket says 172.21.15.103:38708) 2024-09-10T22:43:30.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9af7400640 1 -- 172.21.15.103:0/1119528503 learned_addr learned my addr 172.21.15.103:0/1119528503 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:30.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9af6a00640 1 --2- 172.21.15.103:0/1119528503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9af8073c30 0x7f9af81f86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:30.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9aee000640 1 --2- 172.21.15.103:0/1119528503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af80b4b20 0x7f9af80ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:30.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9af7400640 1 -- 172.21.15.103:0/1119528503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af80b4b20 msgr2=0x7f9af80ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:30.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9af7400640 1 --2- 172.21.15.103:0/1119528503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af80b4b20 0x7f9af80ab940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9af7400640 1 -- 172.21.15.103:0/1119528503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9af8073c30 msgr2=0x7f9af81f86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:30.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9af7400640 1 --2- 172.21.15.103:0/1119528503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9af8073c30 0x7f9af81f86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9af7400640 1 -- 172.21.15.103:0/1119528503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af80a98b0 con 0x7f9af8150a50 2024-09-10T22:43:30.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9af7400640 1 --2- 172.21.15.103:0/1119528503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9af8150a50 0x7f9af806ead0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f9af000c970 tx=0x7f9af000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:30.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9aef400640 1 -- 172.21.15.103:0/1119528503 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0007bb0 con 0x7f9af8150a50 2024-09-10T22:43:30.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9aef400640 1 -- 172.21.15.103:0/1119528503 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9af000f450 con 0x7f9af8150a50 2024-09-10T22:43:30.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9afd600640 1 -- 172.21.15.103:0/1119528503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af81f8f00 con 0x7f9af8150a50 2024-09-10T22:43:30.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9aef400640 1 -- 172.21.15.103:0/1119528503 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0007e60 con 0x7f9af8150a50 2024-09-10T22:43:30.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9afd600640 1 -- 172.21.15.103:0/1119528503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af81f94c0 con 0x7f9af8150a50 2024-09-10T22:43:30.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9afd600640 1 -- 172.21.15.103:0/1119528503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af80740e0 con 0x7f9af8150a50 2024-09-10T22:43:30.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.482+0000 7f9aef400640 1 -- 172.21.15.103:0/1119528503 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9af000f8a0 con 0x7f9af8150a50 2024-09-10T22:43:30.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.486+0000 7f9aef400640 1 --2- 172.21.15.103:0/1119528503 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9ad40725e0 0x7f9ad4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:30.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.486+0000 7f9aef400640 1 -- 172.21.15.103:0/1119528503 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5249+0+0 (secure 0 0 0) 0x7f9af0093730 con 0x7f9af8150a50 2024-09-10T22:43:30.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.486+0000 7f9af6a00640 1 --2- 172.21.15.103:0/1119528503 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9ad40725e0 0x7f9ad4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:30.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.486+0000 7f9af6a00640 1 --2- 172.21.15.103:0/1119528503 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9ad40725e0 0x7f9ad4074aa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8005fd0 tx=0x7f9ae800a590 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:30.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.490+0000 7f9aef400640 1 -- 172.21.15.103:0/1119528503 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9af0014030 con 0x7f9af8150a50 2024-09-10T22:43:30.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.658+0000 7f9afd600640 1 -- 172.21.15.103:0/1119528503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f9af81505f0 con 0x7f9af8150a50 2024-09-10T22:43:30.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.658+0000 7f9aef400640 1 -- 172.21.15.103:0/1119528503 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) ==== 84+0+65 (secure 0 0 0) 0x7f9af005e980 con 0x7f9af8150a50 2024-09-10T22:43:30.663 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:30.663 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-09-10T22:43:30.664 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:43:30.664 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2024-09-10T22:43:30.664 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": ".mgr" 2024-09-10T22:43:30.664 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:30.664 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-09-10T22:43:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.662+0000 7f9afd600640 1 -- 172.21.15.103:0/1119528503 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9ad40725e0 msgr2=0x7f9ad4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.662+0000 7f9afd600640 1 --2- 172.21.15.103:0/1119528503 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9ad40725e0 0x7f9ad4074aa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8005fd0 tx=0x7f9ae800a590 comp rx=0 tx=0).stop 2024-09-10T22:43:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.662+0000 7f9afd600640 1 -- 172.21.15.103:0/1119528503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9af8150a50 msgr2=0x7f9af806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.662+0000 7f9afd600640 1 --2- 172.21.15.103:0/1119528503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9af8150a50 0x7f9af806ead0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f9af000c970 tx=0x7f9af000ce30 comp rx=0 tx=0).stop 2024-09-10T22:43:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.662+0000 7f9afd600640 1 -- 172.21.15.103:0/1119528503 shutdown_connections 2024-09-10T22:43:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.662+0000 7f9afd600640 1 --2- 172.21.15.103:0/1119528503 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9ad40725e0 0x7f9ad4074aa0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.662+0000 7f9afd600640 1 --2- 172.21.15.103:0/1119528503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9af8150a50 0x7f9af806ead0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.662+0000 7f9afd600640 1 --2- 172.21.15.103:0/1119528503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af80b4b20 0x7f9af80ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.662+0000 7f9afd600640 1 --2- 172.21.15.103:0/1119528503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9af8073c30 0x7f9af81f86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.662+0000 7f9afd600640 1 -- 172.21.15.103:0/1119528503 >> 172.21.15.103:0/1119528503 conn(0x7f9af806cc00 msgr2=0x7f9af806cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.662+0000 7f9afd600640 1 -- 172.21.15.103:0/1119528503 shutdown_connections 2024-09-10T22:43:30.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.662+0000 7f9afd600640 1 -- 172.21.15.103:0/1119528503 wait complete. 2024-09-10T22:43:30.685 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T22:43:30.686 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T22:43:30.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.826+0000 7fc27a800640 1 -- 172.21.15.103:0/1264303940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27406f0c0 msgr2=0x7fc274073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:30.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.826+0000 7fc27a800640 1 --2- 172.21.15.103:0/1264303940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27406f0c0 0x7fc274073610 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fc25c009840 tx=0x7fc25c01c820 comp rx=0 tx=0).stop 2024-09-10T22:43:30.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.826+0000 7fc27a800640 1 -- 172.21.15.103:0/1264303940 shutdown_connections 2024-09-10T22:43:30.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.826+0000 7fc27a800640 1 --2- 172.21.15.103:0/1264303940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27406f0c0 0x7fc274073610 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.826+0000 7fc27a800640 1 --2- 172.21.15.103:0/1264303940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2740cf9f0 0x7fc27406eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.826+0000 7fc27a800640 1 -- 172.21.15.103:0/1264303940 >> 172.21.15.103:0/1264303940 conn(0x7fc27406cc00 msgr2=0x7fc27406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:30.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.826+0000 7fc27a800640 1 -- 172.21.15.103:0/1264303940 shutdown_connections 2024-09-10T22:43:30.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.826+0000 7fc27a800640 1 -- 172.21.15.103:0/1264303940 wait complete. 2024-09-10T22:43:30.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc27a800640 1 Processor -- start 2024-09-10T22:43:30.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc27a800640 1 -- start start 2024-09-10T22:43:30.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc27a800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc27406f0c0 0x7fc274139c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:30.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc27a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2740cf9f0 0x7fc2741368f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:30.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc27a800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2740cfdd0 0x7fc274159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:30.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc27a800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc2740cd690 con 0x7fc2740cf9f0 2024-09-10T22:43:30.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc27a800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc2740cd510 con 0x7fc2740cfdd0 2024-09-10T22:43:30.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc27a800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc2740cd810 con 0x7fc27406f0c0 2024-09-10T22:43:30.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc26aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2740cf9f0 0x7fc2741368f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:30.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc26aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2740cf9f0 0x7fc2741368f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38724/0 (socket says 172.21.15.103:38724) 2024-09-10T22:43:30.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc26aa00640 1 -- 172.21.15.103:0/2963735179 learned_addr learned my addr 172.21.15.103:0/2963735179 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:30.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc273400640 1 --2- 172.21.15.103:0/2963735179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc27406f0c0 0x7fc274139c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:30.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc273e00640 1 --2- 172.21.15.103:0/2963735179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2740cfdd0 0x7fc274159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:30.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc26aa00640 1 -- 172.21.15.103:0/2963735179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc27406f0c0 msgr2=0x7fc274139c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:30.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc26aa00640 1 --2- 172.21.15.103:0/2963735179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc27406f0c0 0x7fc274139c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc26aa00640 1 -- 172.21.15.103:0/2963735179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2740cfdd0 msgr2=0x7fc274159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:30.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc26aa00640 1 --2- 172.21.15.103:0/2963735179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2740cfdd0 0x7fc274159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:30.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc26aa00640 1 -- 172.21.15.103:0/2963735179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27413a170 con 0x7fc2740cf9f0 2024-09-10T22:43:30.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc273400640 1 --2- 172.21.15.103:0/2963735179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc27406f0c0 0x7fc274139c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:30.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc273e00640 1 --2- 172.21.15.103:0/2963735179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2740cfdd0 0x7fc274159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:30.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc26aa00640 1 --2- 172.21.15.103:0/2963735179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2740cf9f0 0x7fc2741368f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc25c01aed0 tx=0x7fc25c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:30.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc26be00640 1 -- 172.21.15.103:0/2963735179 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c0bb070 con 0x7fc2740cf9f0 2024-09-10T22:43:30.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc26be00640 1 -- 172.21.15.103:0/2963735179 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc25c005030 con 0x7fc2740cf9f0 2024-09-10T22:43:30.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc27a800640 1 -- 172.21.15.103:0/2963735179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2740b0d40 con 0x7fc2740cf9f0 2024-09-10T22:43:30.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc26be00640 1 -- 172.21.15.103:0/2963735179 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c0b2040 con 0x7fc2740cf9f0 2024-09-10T22:43:30.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc27a800640 1 -- 172.21.15.103:0/2963735179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2740b1300 con 0x7fc2740cf9f0 2024-09-10T22:43:30.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.830+0000 7fc27a800640 1 -- 172.21.15.103:0/2963735179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc27406eb80 con 0x7fc2740cf9f0 2024-09-10T22:43:30.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.834+0000 7fc26be00640 1 -- 172.21.15.103:0/2963735179 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc25c0b5030 con 0x7fc2740cf9f0 2024-09-10T22:43:30.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.834+0000 7fc26be00640 1 --2- 172.21.15.103:0/2963735179 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc2500725e0 0x7fc250074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:30.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.834+0000 7fc26be00640 1 -- 172.21.15.103:0/2963735179 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5249+0+0 (secure 0 0 0) 0x7fc25c12cb70 con 0x7fc2740cf9f0 2024-09-10T22:43:30.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.834+0000 7fc273400640 1 --2- 172.21.15.103:0/2963735179 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc2500725e0 0x7fc250074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:30.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.834+0000 7fc273400640 1 --2- 172.21.15.103:0/2963735179 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc2500725e0 0x7fc250074aa0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc264005fd0 tx=0x7fc264005da0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:30.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:30.838+0000 7fc26be00640 1 -- 172.21.15.103:0/2963735179 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc25c016410 con 0x7fc2740cf9f0 2024-09-10T22:43:31.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:31.006+0000 7fc27a800640 1 -- 172.21.15.103:0/2963735179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc274150370 con 0x7fc2740cf9f0 2024-09-10T22:43:31.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:31.922+0000 7fc26be00640 1 -- 172.21.15.103:0/2963735179 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) ==== 138+0+0 (secure 0 0 0) 0x7fc25c0f8400 con 0x7fc2740cf9f0 2024-09-10T22:43:31.926 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2024-09-10T22:43:31.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:31.926+0000 7fc27a800640 1 -- 172.21.15.103:0/2963735179 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc2500725e0 msgr2=0x7fc250074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:31.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:31.926+0000 7fc27a800640 1 --2- 172.21.15.103:0/2963735179 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc2500725e0 0x7fc250074aa0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc264005fd0 tx=0x7fc264005da0 comp rx=0 tx=0).stop 2024-09-10T22:43:31.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:31.926+0000 7fc27a800640 1 -- 172.21.15.103:0/2963735179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2740cf9f0 msgr2=0x7fc2741368f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:31.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:31.926+0000 7fc27a800640 1 --2- 172.21.15.103:0/2963735179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2740cf9f0 0x7fc2741368f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc25c01aed0 tx=0x7fc25c0040c0 comp rx=0 tx=0).stop 2024-09-10T22:43:31.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:31.926+0000 7fc27a800640 1 -- 172.21.15.103:0/2963735179 shutdown_connections 2024-09-10T22:43:31.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:31.926+0000 7fc27a800640 1 --2- 172.21.15.103:0/2963735179 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc2500725e0 0x7fc250074aa0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:31.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:31.926+0000 7fc27a800640 1 --2- 172.21.15.103:0/2963735179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2740cfdd0 0x7fc274159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:31.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:31.926+0000 7fc27a800640 1 --2- 172.21.15.103:0/2963735179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2740cf9f0 0x7fc2741368f0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:31.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:31.926+0000 7fc27a800640 1 --2- 172.21.15.103:0/2963735179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc27406f0c0 0x7fc274139c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:31.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:31.926+0000 7fc27a800640 1 -- 172.21.15.103:0/2963735179 >> 172.21.15.103:0/2963735179 conn(0x7fc27406cc00 msgr2=0x7fc27406cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:31.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:31.926+0000 7fc27a800640 1 -- 172.21.15.103:0/2963735179 shutdown_connections 2024-09-10T22:43:31.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:31.926+0000 7fc27a800640 1 -- 172.21.15.103:0/2963735179 wait complete. 2024-09-10T22:43:31.956 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T22:43:32.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.102+0000 7fd55c600640 1 -- 172.21.15.103:0/1755283141 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55415e3e0 msgr2=0x7fd554070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:32.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.102+0000 7fd55c600640 1 --2- 172.21.15.103:0/1755283141 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55415e3e0 0x7fd554070510 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fd548009c80 tx=0x7fd54801cda0 comp rx=0 tx=0).stop 2024-09-10T22:43:32.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.102+0000 7fd55c600640 1 -- 172.21.15.103:0/1755283141 shutdown_connections 2024-09-10T22:43:32.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.102+0000 7fd55c600640 1 --2- 172.21.15.103:0/1755283141 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd55406cc00 0x7fd55406d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:32.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.102+0000 7fd55c600640 1 --2- 172.21.15.103:0/1755283141 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55415e3e0 0x7fd554070510 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:32.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.102+0000 7fd55c600640 1 -- 172.21.15.103:0/1755283141 >> 172.21.15.103:0/1755283141 conn(0x7fd5540b1c70 msgr2=0x7fd5540b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:32.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd55c600640 1 -- 172.21.15.103:0/1755283141 shutdown_connections 2024-09-10T22:43:32.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd55c600640 1 -- 172.21.15.103:0/1755283141 wait complete. 2024-09-10T22:43:32.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd55c600640 1 Processor -- start 2024-09-10T22:43:32.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd55c600640 1 -- start start 2024-09-10T22:43:32.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd55c600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55406cc00 0x7fd554146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:32.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd55c600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd55415e3e0 0x7fd55415a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:32.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd55c600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd55415e7c0 0x7fd554159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:32.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd55c600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd554167d60 con 0x7fd55406cc00 2024-09-10T22:43:32.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd55c600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd5540ae200 con 0x7fd55415e3e0 2024-09-10T22:43:32.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd55c600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd554167ee0 con 0x7fd55415e7c0 2024-09-10T22:43:32.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd559c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55406cc00 0x7fd554146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:32.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd559c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55406cc00 0x7fd554146c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38736/0 (socket says 172.21.15.103:38736) 2024-09-10T22:43:32.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd559c00640 1 -- 172.21.15.103:0/2168051577 learned_addr learned my addr 172.21.15.103:0/2168051577 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:32.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd55a600640 1 --2- 172.21.15.103:0/2168051577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd55415e7c0 0x7fd554159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:32.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd559200640 1 --2- 172.21.15.103:0/2168051577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd55415e3e0 0x7fd55415a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:32.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd559c00640 1 -- 172.21.15.103:0/2168051577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd55415e7c0 msgr2=0x7fd554159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:32.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd559c00640 1 --2- 172.21.15.103:0/2168051577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd55415e7c0 0x7fd554159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:32.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd559c00640 1 -- 172.21.15.103:0/2168051577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd55415e3e0 msgr2=0x7fd55415a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:32.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd559c00640 1 --2- 172.21.15.103:0/2168051577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd55415e3e0 0x7fd55415a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:32.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd559c00640 1 -- 172.21.15.103:0/2168051577 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55409b2a0 con 0x7fd55406cc00 2024-09-10T22:43:32.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd559200640 1 --2- 172.21.15.103:0/2168051577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd55415e3e0 0x7fd55415a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:32.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd559c00640 1 --2- 172.21.15.103:0/2168051577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55406cc00 0x7fd554146c10 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fd548000f90 tx=0x7fd548009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:32.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd551600640 1 -- 172.21.15.103:0/2168051577 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5480bb070 con 0x7fd55406cc00 2024-09-10T22:43:32.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd551600640 1 -- 172.21.15.103:0/2168051577 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd548004d40 con 0x7fd55406cc00 2024-09-10T22:43:32.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd551600640 1 -- 172.21.15.103:0/2168051577 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5480b2040 con 0x7fd55406cc00 2024-09-10T22:43:32.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd55c600640 1 -- 172.21.15.103:0/2168051577 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd55409b540 con 0x7fd55406cc00 2024-09-10T22:43:32.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.106+0000 7fd55c600640 1 -- 172.21.15.103:0/2168051577 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd55409bb00 con 0x7fd55406cc00 2024-09-10T22:43:32.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.110+0000 7fd55c600640 1 -- 172.21.15.103:0/2168051577 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd55406d090 con 0x7fd55406cc00 2024-09-10T22:43:32.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.110+0000 7fd551600640 1 -- 172.21.15.103:0/2168051577 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd5480b5030 con 0x7fd55406cc00 2024-09-10T22:43:32.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.110+0000 7fd551600640 1 --2- 172.21.15.103:0/2168051577 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5340725e0 0x7fd534074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:32.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.110+0000 7fd551600640 1 -- 172.21.15.103:0/2168051577 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5619+0+0 (secure 0 0 0) 0x7fd54812d1f0 con 0x7fd55406cc00 2024-09-10T22:43:32.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.110+0000 7fd559200640 1 --2- 172.21.15.103:0/2168051577 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5340725e0 0x7fd534074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:32.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.114+0000 7fd559200640 1 --2- 172.21.15.103:0/2168051577 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5340725e0 0x7fd534074aa0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd554154b00 tx=0x7fd540009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:32.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.114+0000 7fd551600640 1 -- 172.21.15.103:0/2168051577 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd548016990 con 0x7fd55406cc00 2024-09-10T22:43:32.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.282+0000 7fd55c600640 1 -- 172.21.15.103:0/2168051577 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd5540cebf0 con 0x7fd55406cc00 2024-09-10T22:43:32.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.930+0000 7fd551600640 1 -- 172.21.15.103:0/2168051577 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) ==== 170+0+0 (secure 0 0 0) 0x7fd5480f8990 con 0x7fd55406cc00 2024-09-10T22:43:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2024-09-10T22:43:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.934+0000 7fd55c600640 1 -- 172.21.15.103:0/2168051577 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5340725e0 msgr2=0x7fd534074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.934+0000 7fd55c600640 1 --2- 172.21.15.103:0/2168051577 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5340725e0 0x7fd534074aa0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd554154b00 tx=0x7fd540009040 comp rx=0 tx=0).stop 2024-09-10T22:43:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.934+0000 7fd55c600640 1 -- 172.21.15.103:0/2168051577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55406cc00 msgr2=0x7fd554146c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.934+0000 7fd55c600640 1 --2- 172.21.15.103:0/2168051577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55406cc00 0x7fd554146c10 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fd548000f90 tx=0x7fd548009340 comp rx=0 tx=0).stop 2024-09-10T22:43:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.934+0000 7fd55c600640 1 -- 172.21.15.103:0/2168051577 shutdown_connections 2024-09-10T22:43:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.934+0000 7fd55c600640 1 --2- 172.21.15.103:0/2168051577 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5340725e0 0x7fd534074aa0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.934+0000 7fd55c600640 1 --2- 172.21.15.103:0/2168051577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd55415e7c0 0x7fd554159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.934+0000 7fd55c600640 1 --2- 172.21.15.103:0/2168051577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd55415e3e0 0x7fd55415a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.934+0000 7fd55c600640 1 --2- 172.21.15.103:0/2168051577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd55406cc00 0x7fd554146c10 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.934+0000 7fd55c600640 1 -- 172.21.15.103:0/2168051577 >> 172.21.15.103:0/2168051577 conn(0x7fd5540b1c70 msgr2=0x7fd5540cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:32.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.934+0000 7fd55c600640 1 -- 172.21.15.103:0/2168051577 shutdown_connections 2024-09-10T22:43:32.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:32.934+0000 7fd55c600640 1 -- 172.21.15.103:0/2168051577 wait complete. 2024-09-10T22:43:32.976 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T22:43:33.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.118+0000 7f3220200640 1 -- 172.21.15.103:0/3468334524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32180af9d0 msgr2=0x7f3218166a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:33.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.118+0000 7f3220200640 1 --2- 172.21.15.103:0/3468334524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32180af9d0 0x7f3218166a50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3210009bc0 tx=0x7f321001cb10 comp rx=0 tx=0).stop 2024-09-10T22:43:33.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.118+0000 7f3220200640 1 -- 172.21.15.103:0/3468334524 shutdown_connections 2024-09-10T22:43:33.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.118+0000 7f3220200640 1 --2- 172.21.15.103:0/3468334524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32180af9d0 0x7f3218166a50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:33.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.118+0000 7f3220200640 1 -- 172.21.15.103:0/3468334524 >> 172.21.15.103:0/3468334524 conn(0x7f32180d1ac0 msgr2=0x7f32180d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:33.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.118+0000 7f3220200640 1 -- 172.21.15.103:0/3468334524 shutdown_connections 2024-09-10T22:43:33.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.118+0000 7f3220200640 1 -- 172.21.15.103:0/3468334524 wait complete. 2024-09-10T22:43:33.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f3220200640 1 Processor -- start 2024-09-10T22:43:33.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f3220200640 1 -- start start 2024-09-10T22:43:33.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f3220200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32180af9d0 0x7f32181facd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:33.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f3220200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32180b09c0 0x7f32181f8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:33.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f3220200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f321815be30 0x7f3218153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:33.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f3220200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3218169ca0 con 0x7f32180af9d0 2024-09-10T22:43:33.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f3220200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3218169b20 con 0x7f32180b09c0 2024-09-10T22:43:33.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f3220200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3218169e20 con 0x7f321815be30 2024-09-10T22:43:33.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f321d800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32180af9d0 0x7f32181facd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:33.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f321d800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32180af9d0 0x7f32181facd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38752/0 (socket says 172.21.15.103:38752) 2024-09-10T22:43:33.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f321d800640 1 -- 172.21.15.103:0/2524407100 learned_addr learned my addr 172.21.15.103:0/2524407100 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:33.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f321e200640 1 --2- 172.21.15.103:0/2524407100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f321815be30 0x7f3218153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:33.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f321ce00640 1 --2- 172.21.15.103:0/2524407100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32180b09c0 0x7f32181f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:33.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f321d800640 1 -- 172.21.15.103:0/2524407100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f321815be30 msgr2=0x7f3218153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:33.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f321d800640 1 --2- 172.21.15.103:0/2524407100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f321815be30 0x7f3218153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:33.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f321d800640 1 -- 172.21.15.103:0/2524407100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32180b09c0 msgr2=0x7f32181f8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:33.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f321d800640 1 --2- 172.21.15.103:0/2524407100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32180b09c0 0x7f32181f8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:33.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f321d800640 1 -- 172.21.15.103:0/2524407100 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32181fb360 con 0x7f32180af9d0 2024-09-10T22:43:33.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f321e200640 1 --2- 172.21.15.103:0/2524407100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f321815be30 0x7f3218153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:43:33.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f321d800640 1 --2- 172.21.15.103:0/2524407100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32180af9d0 0x7f32181facd0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f320c001ec0 tx=0x7f320c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:33.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f3215600640 1 -- 172.21.15.103:0/2524407100 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c017070 con 0x7f32180af9d0 2024-09-10T22:43:33.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f3215600640 1 -- 172.21.15.103:0/2524407100 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f320c003600 con 0x7f32180af9d0 2024-09-10T22:43:33.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f3215600640 1 -- 172.21.15.103:0/2524407100 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c003a50 con 0x7f32180af9d0 2024-09-10T22:43:33.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f3220200640 1 -- 172.21.15.103:0/2524407100 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32181fb640 con 0x7f32180af9d0 2024-09-10T22:43:33.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.122+0000 7f3220200640 1 -- 172.21.15.103:0/2524407100 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3218154c90 con 0x7f32180af9d0 2024-09-10T22:43:33.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.126+0000 7f3220200640 1 -- 172.21.15.103:0/2524407100 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32180ce0c0 con 0x7f32180af9d0 2024-09-10T22:43:33.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.126+0000 7f3215600640 1 -- 172.21.15.103:0/2524407100 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f320c003bf0 con 0x7f32180af9d0 2024-09-10T22:43:33.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.126+0000 7f3215600640 1 --2- 172.21.15.103:0/2524407100 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31f80725e0 0x7f31f8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:33.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.126+0000 7f3215600640 1 -- 172.21.15.103:0/2524407100 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6001+0+0 (secure 0 0 0) 0x7f320c0929b0 con 0x7f32180af9d0 2024-09-10T22:43:33.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.126+0000 7f321ce00640 1 --2- 172.21.15.103:0/2524407100 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31f80725e0 0x7f31f8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:33.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.126+0000 7f321ce00640 1 --2- 172.21.15.103:0/2524407100 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31f80725e0 0x7f31f8074aa0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f32181fbdd0 tx=0x7f3204009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:33.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.130+0000 7f3215600640 1 -- 172.21.15.103:0/2524407100 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f320c05df50 con 0x7f32180af9d0 2024-09-10T22:43:33.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.330+0000 7f3220200640 1 -- 172.21.15.103:0/2524407100 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3218072160 con 0x7f32180af9d0 2024-09-10T22:43:33.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.934+0000 7f3215600640 1 -- 172.21.15.103:0/2524407100 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v69) ==== 174+0+0 (secure 0 0 0) 0x7f320c05d850 con 0x7f32180af9d0 2024-09-10T22:43:33.937 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 11 and data pool 12 2024-09-10T22:43:33.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.934+0000 7f3220200640 1 -- 172.21.15.103:0/2524407100 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31f80725e0 msgr2=0x7f31f8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:33.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.934+0000 7f3220200640 1 --2- 172.21.15.103:0/2524407100 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31f80725e0 0x7f31f8074aa0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f32181fbdd0 tx=0x7f3204009040 comp rx=0 tx=0).stop 2024-09-10T22:43:33.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.934+0000 7f3220200640 1 -- 172.21.15.103:0/2524407100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32180af9d0 msgr2=0x7f32181facd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:33.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.934+0000 7f3220200640 1 --2- 172.21.15.103:0/2524407100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32180af9d0 0x7f32181facd0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f320c001ec0 tx=0x7f320c00c890 comp rx=0 tx=0).stop 2024-09-10T22:43:33.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.934+0000 7f3220200640 1 -- 172.21.15.103:0/2524407100 shutdown_connections 2024-09-10T22:43:33.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.934+0000 7f3220200640 1 --2- 172.21.15.103:0/2524407100 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31f80725e0 0x7f31f8074aa0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:33.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.938+0000 7f3220200640 1 --2- 172.21.15.103:0/2524407100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f321815be30 0x7f3218153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:33.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.938+0000 7f3220200640 1 --2- 172.21.15.103:0/2524407100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32180b09c0 0x7f32181f8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:33.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.938+0000 7f3220200640 1 --2- 172.21.15.103:0/2524407100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32180af9d0 0x7f32181facd0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:33.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.938+0000 7f3220200640 1 -- 172.21.15.103:0/2524407100 >> 172.21.15.103:0/2524407100 conn(0x7f32180d1ac0 msgr2=0x7f32180b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:33.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.938+0000 7f3220200640 1 -- 172.21.15.103:0/2524407100 shutdown_connections 2024-09-10T22:43:33.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:33.938+0000 7f3220200640 1 -- 172.21.15.103:0/2524407100 wait complete. 2024-09-10T22:43:33.990 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:43:34.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.130+0000 7f3fc8800640 1 -- 172.21.15.103:0/2962798143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fc00b0030 msgr2=0x7f3fc00afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.130+0000 7f3fc8800640 1 --2- 172.21.15.103:0/2962798143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fc00b0030 0x7f3fc00afac0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009900 tx=0x7f3fb001c700 comp rx=0 tx=0).stop 2024-09-10T22:43:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.130+0000 7f3fc8800640 1 -- 172.21.15.103:0/2962798143 shutdown_connections 2024-09-10T22:43:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.130+0000 7f3fc8800640 1 --2- 172.21.15.103:0/2962798143 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fc015b690 0x7f3fc0073510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.130+0000 7f3fc8800640 1 --2- 172.21.15.103:0/2962798143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fc00b0030 0x7f3fc00afac0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.130+0000 7f3fc8800640 1 -- 172.21.15.103:0/2962798143 >> 172.21.15.103:0/2962798143 conn(0x7f3fc00cd3c0 msgr2=0x7f3fc00cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.130+0000 7f3fc8800640 1 -- 172.21.15.103:0/2962798143 shutdown_connections 2024-09-10T22:43:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.130+0000 7f3fc8800640 1 -- 172.21.15.103:0/2962798143 wait complete. 2024-09-10T22:43:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.130+0000 7f3fc8800640 1 Processor -- start 2024-09-10T22:43:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.130+0000 7f3fc8800640 1 -- start start 2024-09-10T22:43:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.130+0000 7f3fc8800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fc00b0030 0x7f3fc014c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.130+0000 7f3fc8800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fc015b2b0 0x7f3fc0155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.130+0000 7f3fc8800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc015b690 0x7f3fc0154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.130+0000 7f3fc8800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc0167a80 con 0x7f3fc015b690 2024-09-10T22:43:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.130+0000 7f3fc8800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc0167900 con 0x7f3fc00b0030 2024-09-10T22:43:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.130+0000 7f3fc8800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc0167c00 con 0x7f3fc015b2b0 2024-09-10T22:43:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.134+0000 7f3fc6800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc015b690 0x7f3fc0154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.134+0000 7f3fc5400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fc015b2b0 0x7f3fc0155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.134+0000 7f3fc6800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc015b690 0x7f3fc0154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38754/0 (socket says 172.21.15.103:38754) 2024-09-10T22:43:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.134+0000 7f3fc6800640 1 -- 172.21.15.103:0/3855968997 learned_addr learned my addr 172.21.15.103:0/3855968997 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.134+0000 7f3fc5e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fc00b0030 0x7f3fc014c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.134+0000 7f3fc6800640 1 -- 172.21.15.103:0/3855968997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fc015b2b0 msgr2=0x7f3fc0155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.134+0000 7f3fc6800640 1 --2- 172.21.15.103:0/3855968997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fc015b2b0 0x7f3fc0155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.134+0000 7f3fc6800640 1 -- 172.21.15.103:0/3855968997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fc00b0030 msgr2=0x7f3fc014c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.134+0000 7f3fc6800640 1 --2- 172.21.15.103:0/3855968997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fc00b0030 0x7f3fc014c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.134+0000 7f3fc6800640 1 -- 172.21.15.103:0/3855968997 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc014c720 con 0x7f3fc015b690 2024-09-10T22:43:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.134+0000 7f3fc6800640 1 --2- 172.21.15.103:0/3855968997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc015b690 0x7f3fc0154690 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00ec70 tx=0x7f3fbc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.134+0000 7f3fba000640 1 -- 172.21.15.103:0/3855968997 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc003b80 con 0x7f3fc015b690 2024-09-10T22:43:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.134+0000 7f3fba000640 1 -- 172.21.15.103:0/3855968997 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fbc003d20 con 0x7f3fc015b690 2024-09-10T22:43:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.134+0000 7f3fc8800640 1 -- 172.21.15.103:0/3855968997 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc0156290 con 0x7f3fc015b690 2024-09-10T22:43:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.134+0000 7f3fba000640 1 -- 172.21.15.103:0/3855968997 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc004280 con 0x7f3fc015b690 2024-09-10T22:43:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.134+0000 7f3fc8800640 1 -- 172.21.15.103:0/3855968997 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc01f9470 con 0x7f3fc015b690 2024-09-10T22:43:34.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.134+0000 7f3fc8800640 1 -- 172.21.15.103:0/3855968997 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fc0073510 con 0x7f3fc015b690 2024-09-10T22:43:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.134+0000 7f3fba000640 1 -- 172.21.15.103:0/3855968997 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3fbc004420 con 0x7f3fc015b690 2024-09-10T22:43:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.138+0000 7f3fba000640 1 --2- 172.21.15.103:0/3855968997 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3fa40725e0 0x7f3fa4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:34.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.138+0000 7f3fba000640 1 -- 172.21.15.103:0/3855968997 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6101+0+0 (secure 0 0 0) 0x7f3fbc094130 con 0x7f3fc015b690 2024-09-10T22:43:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.138+0000 7f3fc5e00640 1 --2- 172.21.15.103:0/3855968997 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3fa40725e0 0x7f3fa4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:34.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.138+0000 7f3fc5e00640 1 --2- 172.21.15.103:0/3855968997 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3fa40725e0 0x7f3fa4074aa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4007fd0 tx=0x7f3fb4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.138+0000 7f3fba000640 1 -- 172.21.15.103:0/3855968997 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3fc014c720 con 0x7f3fc015b690 2024-09-10T22:43:34.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.306+0000 7f3fc8800640 1 -- 172.21.15.103:0/3855968997 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3fc0150c00 con 0x7f3fc015b690 2024-09-10T22:43:34.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.306+0000 7f3fba000640 1 -- 172.21.15.103:0/3855968997 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+17078 (secure 0 0 0) 0x7f3fbc05f0c0 con 0x7f3fc015b690 2024-09-10T22:43:34.312 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:34.312 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":80,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:43:33.337130+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:43:31.019531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-10T22:43:32.295197+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:43:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.310+0000 7f3fc8800640 1 -- 172.21.15.103:0/3855968997 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3fa40725e0 msgr2=0x7f3fa4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.310+0000 7f3fc8800640 1 --2- 172.21.15.103:0/3855968997 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3fa40725e0 0x7f3fa4074aa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4007fd0 tx=0x7f3fb4009040 comp rx=0 tx=0).stop 2024-09-10T22:43:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.310+0000 7f3fc8800640 1 -- 172.21.15.103:0/3855968997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc015b690 msgr2=0x7f3fc0154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.310+0000 7f3fc8800640 1 --2- 172.21.15.103:0/3855968997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc015b690 0x7f3fc0154690 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00ec70 tx=0x7f3fbc00c6a0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.310+0000 7f3fc8800640 1 -- 172.21.15.103:0/3855968997 shutdown_connections 2024-09-10T22:43:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.310+0000 7f3fc8800640 1 --2- 172.21.15.103:0/3855968997 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3fa40725e0 0x7f3fa4074aa0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.310+0000 7f3fc8800640 1 --2- 172.21.15.103:0/3855968997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc015b690 0x7f3fc0154690 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.310+0000 7f3fc8800640 1 --2- 172.21.15.103:0/3855968997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fc015b2b0 0x7f3fc0155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.310+0000 7f3fc8800640 1 --2- 172.21.15.103:0/3855968997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fc00b0030 0x7f3fc014c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.310+0000 7f3fc8800640 1 -- 172.21.15.103:0/3855968997 >> 172.21.15.103:0/3855968997 conn(0x7f3fc00cd3c0 msgr2=0x7f3fc0074d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.310+0000 7f3fc8800640 1 -- 172.21.15.103:0/3855968997 shutdown_connections 2024-09-10T22:43:34.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.310+0000 7f3fc8800640 1 -- 172.21.15.103:0/3855968997 wait complete. 2024-09-10T22:43:34.333 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:43:34.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e8600640 1 -- 172.21.15.103:0/1605734741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2c8005e60 msgr2=0x7fb2c80062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:34.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e8600640 1 --2- 172.21.15.103:0/1605734741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2c8005e60 0x7fb2c80062e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009eb0 tx=0x7fb2d801d5b0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e6600640 1 -- 172.21.15.103:0/1605734741 reap_dead start 2024-09-10T22:43:34.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e8600640 1 -- 172.21.15.103:0/1605734741 shutdown_connections 2024-09-10T22:43:34.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e8600640 1 -- 172.21.15.103:0/1605734741 >> 172.21.15.103:0/1605734741 conn(0x7fb2e006cc00 msgr2=0x7fb2e006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:34.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e8600640 1 -- 172.21.15.103:0/1605734741 shutdown_connections 2024-09-10T22:43:34.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e8600640 1 -- 172.21.15.103:0/1605734741 wait complete. 2024-09-10T22:43:34.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e8600640 1 Processor -- start 2024-09-10T22:43:34.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e8600640 1 -- start start 2024-09-10T22:43:34.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e8600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2c8005e60 0x7fb2e0156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:34.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e8600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2e0154280 0x7fb2e01566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:34.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e8600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2e0146e40 0x7fb2e01472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:34.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e8600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e00cfb90 con 0x7fb2e0154280 2024-09-10T22:43:34.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e8600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e00cfa10 con 0x7fb2e0146e40 2024-09-10T22:43:34.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e8600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb2e00cfd10 con 0x7fb2c8005e60 2024-09-10T22:43:34.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e5200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2e0154280 0x7fb2e01566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:34.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e5200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2e0154280 0x7fb2e01566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38768/0 (socket says 172.21.15.103:38768) 2024-09-10T22:43:34.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e5200640 1 -- 172.21.15.103:0/1764915000 learned_addr learned my addr 172.21.15.103:0/1764915000 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:34.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e6600640 1 --2- 172.21.15.103:0/1764915000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2e0146e40 0x7fb2e01472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:34.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e5c00640 1 --2- 172.21.15.103:0/1764915000 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2c8005e60 0x7fb2e0156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:34.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e5200640 1 -- 172.21.15.103:0/1764915000 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2c8005e60 msgr2=0x7fb2e0156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:34.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e5200640 1 --2- 172.21.15.103:0/1764915000 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2c8005e60 0x7fb2e0156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e5200640 1 -- 172.21.15.103:0/1764915000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2e0146e40 msgr2=0x7fb2e01472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:34.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e5200640 1 --2- 172.21.15.103:0/1764915000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2e0146e40 0x7fb2e01472d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e5200640 1 -- 172.21.15.103:0/1764915000 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e0072a40 con 0x7fb2e0154280 2024-09-10T22:43:34.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e6600640 1 --2- 172.21.15.103:0/1764915000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2e0146e40 0x7fb2e01472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:43:34.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2e5200640 1 --2- 172.21.15.103:0/1764915000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2e0154280 0x7fb2e01566c0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc003f30 tx=0x7fb2cc001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:34.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.474+0000 7fb2dd600640 1 -- 172.21.15.103:0/1764915000 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc011640 con 0x7fb2e0154280 2024-09-10T22:43:34.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.478+0000 7fb2dd600640 1 -- 172.21.15.103:0/1764915000 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2cc016020 con 0x7fb2e0154280 2024-09-10T22:43:34.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.478+0000 7fb2dd600640 1 -- 172.21.15.103:0/1764915000 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc011a80 con 0x7fb2e0154280 2024-09-10T22:43:34.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.478+0000 7fb2e8600640 1 -- 172.21.15.103:0/1764915000 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e01f7ca0 con 0x7fb2e0154280 2024-09-10T22:43:34.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.478+0000 7fb2e8600640 1 -- 172.21.15.103:0/1764915000 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e01f8260 con 0x7fb2e0154280 2024-09-10T22:43:34.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.478+0000 7fb2e8600640 1 -- 172.21.15.103:0/1764915000 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2e0073190 con 0x7fb2e0154280 2024-09-10T22:43:34.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.478+0000 7fb2dd600640 1 -- 172.21.15.103:0/1764915000 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb2cc011c20 con 0x7fb2e0154280 2024-09-10T22:43:34.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.478+0000 7fb2dd600640 1 --2- 172.21.15.103:0/1764915000 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb2c0072610 0x7fb2c0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:34.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.478+0000 7fb2dd600640 1 -- 172.21.15.103:0/1764915000 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6101+0+0 (secure 0 0 0) 0x7fb2cc094180 con 0x7fb2e0154280 2024-09-10T22:43:34.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.478+0000 7fb2e5c00640 1 --2- 172.21.15.103:0/1764915000 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb2c0072610 0x7fb2c0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:34.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.482+0000 7fb2e5c00640 1 --2- 172.21.15.103:0/1764915000 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb2c0072610 0x7fb2c0074ad0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4001d70 tx=0x7fb2d4001cc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:34.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.482+0000 7fb2dd600640 1 -- 172.21.15.103:0/1764915000 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb2cc020020 con 0x7fb2e0154280 2024-09-10T22:43:34.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.650+0000 7fb2e8600640 1 -- 172.21.15.103:0/1764915000 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2e00aeed0 con 0x7fb2e0154280 2024-09-10T22:43:34.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.650+0000 7fb2dd600640 1 -- 172.21.15.103:0/1764915000 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+17078 (secure 0 0 0) 0x7fb2cc05f630 con 0x7fb2e0154280 2024-09-10T22:43:34.655 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:34.655 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":80,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:43:33.337130+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:43:31.019531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-10T22:43:32.295197+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:43:34.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.654+0000 7fb2e8600640 1 -- 172.21.15.103:0/1764915000 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb2c0072610 msgr2=0x7fb2c0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:34.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.654+0000 7fb2e8600640 1 --2- 172.21.15.103:0/1764915000 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb2c0072610 0x7fb2c0074ad0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4001d70 tx=0x7fb2d4001cc0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.654+0000 7fb2e8600640 1 -- 172.21.15.103:0/1764915000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2e0154280 msgr2=0x7fb2e01566c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:34.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.654+0000 7fb2e8600640 1 --2- 172.21.15.103:0/1764915000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2e0154280 0x7fb2e01566c0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc003f30 tx=0x7fb2cc001700 comp rx=0 tx=0).stop 2024-09-10T22:43:34.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.654+0000 7fb2e8600640 1 -- 172.21.15.103:0/1764915000 shutdown_connections 2024-09-10T22:43:34.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.654+0000 7fb2e8600640 1 --2- 172.21.15.103:0/1764915000 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb2c0072610 0x7fb2c0074ad0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.654+0000 7fb2e8600640 1 --2- 172.21.15.103:0/1764915000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2e0146e40 0x7fb2e01472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.654+0000 7fb2e8600640 1 --2- 172.21.15.103:0/1764915000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2e0154280 0x7fb2e01566c0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.654+0000 7fb2e8600640 1 --2- 172.21.15.103:0/1764915000 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2c8005e60 0x7fb2e0156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.654+0000 7fb2e8600640 1 -- 172.21.15.103:0/1764915000 >> 172.21.15.103:0/1764915000 conn(0x7fb2e006cc00 msgr2=0x7fb2e0150020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:34.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.654+0000 7fb2e8600640 1 -- 172.21.15.103:0/1764915000 shutdown_connections 2024-09-10T22:43:34.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.654+0000 7fb2e8600640 1 -- 172.21.15.103:0/1764915000 wait complete. 2024-09-10T22:43:34.678 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T22:43:34.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe246200640 1 -- 172.21.15.103:0/3291233436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2400d1460 msgr2=0x7fe2400cf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:34.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe246200640 1 --2- 172.21.15.103:0/3291233436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2400d1460 0x7fe2400cf2b0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fe240051070 tx=0x7fe22801c830 comp rx=0 tx=0).stop 2024-09-10T22:43:34.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe246200640 1 -- 172.21.15.103:0/3291233436 shutdown_connections 2024-09-10T22:43:34.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe246200640 1 --2- 172.21.15.103:0/3291233436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2400d1460 0x7fe2400cf2b0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe246200640 1 --2- 172.21.15.103:0/3291233436 >> v2:172.21.15.131:3300/0 conn(0x7fe24006cc00 0x7fe24006cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe246200640 1 -- 172.21.15.103:0/3291233436 >> 172.21.15.103:0/3291233436 conn(0x7fe2400d0940 msgr2=0x7fe2400d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:34.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe246200640 1 -- 172.21.15.103:0/3291233436 shutdown_connections 2024-09-10T22:43:34.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe246200640 1 -- 172.21.15.103:0/3291233436 wait complete. 2024-09-10T22:43:34.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe246200640 1 Processor -- start 2024-09-10T22:43:34.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe246200640 1 -- start start 2024-09-10T22:43:34.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe246200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe24006cc00 0x7fe240145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:34.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe246200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe240071be0 0x7fe2401fb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:34.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe246200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2400d1460 0x7fe2400b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:34.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe246200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe2401688a0 con 0x7fe2400d1460 2024-09-10T22:43:34.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe246200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe240168720 con 0x7fe240071be0 2024-09-10T22:43:34.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe246200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe240168a20 con 0x7fe24006cc00 2024-09-10T22:43:34.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe23fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2400d1460 0x7fe2400b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:34.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe23fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2400d1460 0x7fe2400b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38792/0 (socket says 172.21.15.103:38792) 2024-09-10T22:43:34.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe23f400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe24006cc00 0x7fe240145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:34.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe23fe00640 1 -- 172.21.15.103:0/679969831 learned_addr learned my addr 172.21.15.103:0/679969831 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:34.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe236a00640 1 --2- 172.21.15.103:0/679969831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe240071be0 0x7fe2401fb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:34.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe23fe00640 1 -- 172.21.15.103:0/679969831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe24006cc00 msgr2=0x7fe240145ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:34.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe23fe00640 1 --2- 172.21.15.103:0/679969831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe24006cc00 0x7fe240145ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe23fe00640 1 -- 172.21.15.103:0/679969831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe240071be0 msgr2=0x7fe2401fb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:34.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe23fe00640 1 --2- 172.21.15.103:0/679969831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe240071be0 0x7fe2401fb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:34.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.822+0000 7fe23fe00640 1 -- 172.21.15.103:0/679969831 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24014ba50 con 0x7fe2400d1460 2024-09-10T22:43:34.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.826+0000 7fe23fe00640 1 --2- 172.21.15.103:0/679969831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2400d1460 0x7fe2400b4ed0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe23800c7c0 tx=0x7fe23800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:34.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.826+0000 7fe237e00640 1 -- 172.21.15.103:0/679969831 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe238003b80 con 0x7fe2400d1460 2024-09-10T22:43:34.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.826+0000 7fe237e00640 1 -- 172.21.15.103:0/679969831 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe238003d20 con 0x7fe2400d1460 2024-09-10T22:43:34.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.826+0000 7fe237e00640 1 -- 172.21.15.103:0/679969831 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23800aab0 con 0x7fe2400d1460 2024-09-10T22:43:34.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.826+0000 7fe246200640 1 -- 172.21.15.103:0/679969831 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe240135500 con 0x7fe2400d1460 2024-09-10T22:43:34.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.826+0000 7fe246200640 1 -- 172.21.15.103:0/679969831 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe240135ac0 con 0x7fe2400d1460 2024-09-10T22:43:34.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.826+0000 7fe246200640 1 -- 172.21.15.103:0/679969831 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe24006cfe0 con 0x7fe2400d1460 2024-09-10T22:43:34.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.826+0000 7fe237e00640 1 -- 172.21.15.103:0/679969831 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe23800ac50 con 0x7fe2400d1460 2024-09-10T22:43:34.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.826+0000 7fe237e00640 1 --2- 172.21.15.103:0/679969831 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe21c0725e0 0x7fe21c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:34.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.826+0000 7fe237e00640 1 -- 172.21.15.103:0/679969831 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6101+0+0 (secure 0 0 0) 0x7fe238093160 con 0x7fe2400d1460 2024-09-10T22:43:34.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.826+0000 7fe23f400640 1 --2- 172.21.15.103:0/679969831 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe21c0725e0 0x7fe21c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:34.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.830+0000 7fe23f400640 1 --2- 172.21.15.103:0/679969831 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe21c0725e0 0x7fe21c074aa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe230009be0 tx=0x7fe2300091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:34.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:34.830+0000 7fe237e00640 1 -- 172.21.15.103:0/679969831 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe23805e060 con 0x7fe2400d1460 2024-09-10T22:43:34.921 INFO:tasks.ceph.mds.c.smithi103.stderr:2024-09-10T22:43:34.918+0000 7f084f800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T22:43:35.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:35.034+0000 7fe246200640 1 -- 172.21.15.103:0/679969831 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe2400cd0c0 con 0x7fe2400d1460 2024-09-10T22:43:35.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:35.958+0000 7fe237e00640 1 -- 172.21.15.103:0/679969831 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v71) ==== 118+0+0 (secure 0 0 0) 0x7fe238062a90 con 0x7fe2400d1460 2024-09-10T22:43:35.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:35.958+0000 7fe246200640 1 -- 172.21.15.103:0/679969831 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe21c0725e0 msgr2=0x7fe21c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:35.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:35.958+0000 7fe246200640 1 --2- 172.21.15.103:0/679969831 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe21c0725e0 0x7fe21c074aa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe230009be0 tx=0x7fe2300091e0 comp rx=0 tx=0).stop 2024-09-10T22:43:35.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:35.958+0000 7fe246200640 1 -- 172.21.15.103:0/679969831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2400d1460 msgr2=0x7fe2400b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:35.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:35.958+0000 7fe246200640 1 --2- 172.21.15.103:0/679969831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2400d1460 0x7fe2400b4ed0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe23800c7c0 tx=0x7fe23800cc80 comp rx=0 tx=0).stop 2024-09-10T22:43:35.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:35.958+0000 7fe246200640 1 -- 172.21.15.103:0/679969831 shutdown_connections 2024-09-10T22:43:35.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:35.958+0000 7fe246200640 1 --2- 172.21.15.103:0/679969831 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe21c0725e0 0x7fe21c074aa0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:35.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:35.958+0000 7fe246200640 1 --2- 172.21.15.103:0/679969831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2400d1460 0x7fe2400b4ed0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:35.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:35.958+0000 7fe246200640 1 --2- 172.21.15.103:0/679969831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe240071be0 0x7fe2401fb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:35.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:35.958+0000 7fe246200640 1 --2- 172.21.15.103:0/679969831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe24006cc00 0x7fe240145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:35.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:35.958+0000 7fe246200640 1 -- 172.21.15.103:0/679969831 >> 172.21.15.103:0/679969831 conn(0x7fe2400d0940 msgr2=0x7fe2400cf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:35.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:35.958+0000 7fe246200640 1 -- 172.21.15.103:0/679969831 shutdown_connections 2024-09-10T22:43:35.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:35.958+0000 7fe246200640 1 -- 172.21.15.103:0/679969831 wait complete. 2024-09-10T22:43:35.988 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T22:43:35.988 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T22:43:36.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.134+0000 7f0fbda00640 1 -- 172.21.15.103:0/2816230066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fb80cf9f0 msgr2=0x7f0fb806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:36.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.134+0000 7f0fbda00640 1 --2- 172.21.15.103:0/2816230066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fb80cf9f0 0x7f0fb806eb80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8072490 tx=0x7f0fa801c8c0 comp rx=0 tx=0).stop 2024-09-10T22:43:36.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.134+0000 7f0fbda00640 1 -- 172.21.15.103:0/2816230066 shutdown_connections 2024-09-10T22:43:36.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.134+0000 7f0fbda00640 1 --2- 172.21.15.103:0/2816230066 >> v2:172.21.15.131:3300/0 conn(0x7f0fb806f0c0 0x7f0fb8073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:36.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.134+0000 7f0fbda00640 1 --2- 172.21.15.103:0/2816230066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fb80cf9f0 0x7f0fb806eb80 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:36.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.134+0000 7f0fbda00640 1 -- 172.21.15.103:0/2816230066 >> 172.21.15.103:0/2816230066 conn(0x7f0fb806cc00 msgr2=0x7f0fb806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:36.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.134+0000 7f0fbda00640 1 -- 172.21.15.103:0/2816230066 shutdown_connections 2024-09-10T22:43:36.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.134+0000 7f0fbda00640 1 -- 172.21.15.103:0/2816230066 wait complete. 2024-09-10T22:43:36.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.134+0000 7f0fbda00640 1 Processor -- start 2024-09-10T22:43:36.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.134+0000 7f0fbda00640 1 -- start start 2024-09-10T22:43:36.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fbda00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fb806f0c0 0x7f0fb8147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:36.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fbda00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fb80cf9f0 0x7f0fb814dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:36.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fbda00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fb80cfdd0 0x7f0fb81fb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:36.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fbda00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb80cd6c0 con 0x7f0fb80cfdd0 2024-09-10T22:43:36.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fbda00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb80cd540 con 0x7f0fb806f0c0 2024-09-10T22:43:36.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fbda00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb80cd840 con 0x7f0fb80cf9f0 2024-09-10T22:43:36.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fb7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fb80cfdd0 0x7f0fb81fb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:36.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fb7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fb80cfdd0 0x7f0fb81fb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38812/0 (socket says 172.21.15.103:38812) 2024-09-10T22:43:36.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fb7400640 1 -- 172.21.15.103:0/4045986003 learned_addr learned my addr 172.21.15.103:0/4045986003 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:36.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fb6a00640 1 --2- 172.21.15.103:0/4045986003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fb806f0c0 0x7f0fb8147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:36.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fae000640 1 --2- 172.21.15.103:0/4045986003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fb80cf9f0 0x7f0fb814dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:36.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fb7400640 1 -- 172.21.15.103:0/4045986003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fb80cf9f0 msgr2=0x7f0fb814dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:36.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fb7400640 1 --2- 172.21.15.103:0/4045986003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fb80cf9f0 0x7f0fb814dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:36.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fb7400640 1 -- 172.21.15.103:0/4045986003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fb806f0c0 msgr2=0x7f0fb8147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:36.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fb7400640 1 --2- 172.21.15.103:0/4045986003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fb806f0c0 0x7f0fb8147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:36.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fb7400640 1 -- 172.21.15.103:0/4045986003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb8148020 con 0x7f0fb80cfdd0 2024-09-10T22:43:36.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fb7400640 1 --2- 172.21.15.103:0/4045986003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fb80cfdd0 0x7f0fb81fb5e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000c760 tx=0x7f0fb000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:36.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0faf400640 1 -- 172.21.15.103:0/4045986003 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0016020 con 0x7f0fb80cfdd0 2024-09-10T22:43:36.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0faf400640 1 -- 172.21.15.103:0/4045986003 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fb000ce10 con 0x7f0fb80cfdd0 2024-09-10T22:43:36.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fbda00640 1 -- 172.21.15.103:0/4045986003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb81482a0 con 0x7f0fb80cfdd0 2024-09-10T22:43:36.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0faf400640 1 -- 172.21.15.103:0/4045986003 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0003c00 con 0x7f0fb80cfdd0 2024-09-10T22:43:36.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fbda00640 1 -- 172.21.15.103:0/4045986003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb8148860 con 0x7f0fb80cfdd0 2024-09-10T22:43:36.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0fbda00640 1 -- 172.21.15.103:0/4045986003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb806eb80 con 0x7f0fb80cfdd0 2024-09-10T22:43:36.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.138+0000 7f0faf400640 1 -- 172.21.15.103:0/4045986003 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0fb000a850 con 0x7f0fb80cfdd0 2024-09-10T22:43:36.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.142+0000 7f0faf400640 1 --2- 172.21.15.103:0/4045986003 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f94072610 0x7f0f94074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:36.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.142+0000 7f0faf400640 1 -- 172.21.15.103:0/4045986003 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f0fb0092ff0 con 0x7f0fb80cfdd0 2024-09-10T22:43:36.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.142+0000 7f0fb6a00640 1 --2- 172.21.15.103:0/4045986003 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f94072610 0x7f0f94074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:36.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.142+0000 7f0fb6a00640 1 --2- 172.21.15.103:0/4045986003 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f94072610 0x7f0f94074ad0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80af000 tx=0x7f0fa801b100 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:36.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.146+0000 7f0faf400640 1 -- 172.21.15.103:0/4045986003 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0fb0020020 con 0x7f0fb80cfdd0 2024-09-10T22:43:36.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.346+0000 7f0fbda00640 1 -- 172.21.15.103:0/4045986003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0fb8151470 con 0x7f0fb80cfdd0 2024-09-10T22:43:36.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.958+0000 7f0faf400640 1 -- 172.21.15.103:0/4045986003 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v72) ==== 122+0+0 (secure 0 0 0) 0x7f0fb8148020 con 0x7f0fb80cfdd0 2024-09-10T22:43:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.962+0000 7f0fbda00640 1 -- 172.21.15.103:0/4045986003 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f94072610 msgr2=0x7f0f94074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.962+0000 7f0fbda00640 1 --2- 172.21.15.103:0/4045986003 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f94072610 0x7f0f94074ad0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80af000 tx=0x7f0fa801b100 comp rx=0 tx=0).stop 2024-09-10T22:43:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.962+0000 7f0fbda00640 1 -- 172.21.15.103:0/4045986003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fb80cfdd0 msgr2=0x7f0fb81fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.962+0000 7f0fbda00640 1 --2- 172.21.15.103:0/4045986003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fb80cfdd0 0x7f0fb81fb5e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000c760 tx=0x7f0fb000cc20 comp rx=0 tx=0).stop 2024-09-10T22:43:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.962+0000 7f0fbda00640 1 -- 172.21.15.103:0/4045986003 shutdown_connections 2024-09-10T22:43:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.962+0000 7f0fbda00640 1 --2- 172.21.15.103:0/4045986003 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0f94072610 0x7f0f94074ad0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.962+0000 7f0fbda00640 1 --2- 172.21.15.103:0/4045986003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fb80cfdd0 0x7f0fb81fb5e0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.962+0000 7f0fbda00640 1 --2- 172.21.15.103:0/4045986003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fb80cf9f0 0x7f0fb814dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.962+0000 7f0fbda00640 1 --2- 172.21.15.103:0/4045986003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fb806f0c0 0x7f0fb8147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.962+0000 7f0fbda00640 1 -- 172.21.15.103:0/4045986003 >> 172.21.15.103:0/4045986003 conn(0x7f0fb806cc00 msgr2=0x7f0fb81523a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.962+0000 7f0fbda00640 1 -- 172.21.15.103:0/4045986003 shutdown_connections 2024-09-10T22:43:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:36.962+0000 7f0fbda00640 1 -- 172.21.15.103:0/4045986003 wait complete. 2024-09-10T22:43:36.986 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T22:43:36.986 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:43:37.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f2022000640 1 -- 172.21.15.103:0/1970472194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201c15b9e0 msgr2=0x7f201c0cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:37.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f2022000640 1 --2- 172.21.15.103:0/1970472194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201c15b9e0 0x7f201c0cc970 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f200c009900 tx=0x7f200c01c8e0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f2022000640 1 -- 172.21.15.103:0/1970472194 shutdown_connections 2024-09-10T22:43:37.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f2022000640 1 --2- 172.21.15.103:0/1970472194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201c15b9e0 0x7f201c0cc970 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f2022000640 1 -- 172.21.15.103:0/1970472194 >> 172.21.15.103:0/1970472194 conn(0x7f201c0b1c00 msgr2=0x7f201c0b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:37.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f2022000640 1 -- 172.21.15.103:0/1970472194 shutdown_connections 2024-09-10T22:43:37.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f2022000640 1 -- 172.21.15.103:0/1970472194 wait complete. 2024-09-10T22:43:37.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f2022000640 1 Processor -- start 2024-09-10T22:43:37.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f2022000640 1 -- start start 2024-09-10T22:43:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f2022000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f201c06e1d0 0x7f201c1fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f2022000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f201c0ad8f0 0x7f201c0cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f2022000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201c15b9e0 0x7f201c14d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f2022000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f201c16a370 con 0x7f201c15b9e0 2024-09-10T22:43:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f2022000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f201c16a1f0 con 0x7f201c0ad8f0 2024-09-10T22:43:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f2022000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f201c16a4f0 con 0x7f201c06e1d0 2024-09-10T22:43:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f201be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201c15b9e0 0x7f201c14d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:37.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f201b400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f201c06e1d0 0x7f201c1fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:37.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f2012a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f201c0ad8f0 0x7f201c0cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:37.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f201be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201c15b9e0 0x7f201c14d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40142/0 (socket says 172.21.15.103:40142) 2024-09-10T22:43:37.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f201be00640 1 -- 172.21.15.103:0/2425242399 learned_addr learned my addr 172.21.15.103:0/2425242399 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:37.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f201be00640 1 -- 172.21.15.103:0/2425242399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f201c06e1d0 msgr2=0x7f201c1fbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:37.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f201be00640 1 --2- 172.21.15.103:0/2425242399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f201c06e1d0 0x7f201c1fbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f201be00640 1 -- 172.21.15.103:0/2425242399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f201c0ad8f0 msgr2=0x7f201c0cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:37.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f201be00640 1 --2- 172.21.15.103:0/2425242399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f201c0ad8f0 0x7f201c0cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f201be00640 1 -- 172.21.15.103:0/2425242399 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201c14df10 con 0x7f201c15b9e0 2024-09-10T22:43:37.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.126+0000 7f201be00640 1 --2- 172.21.15.103:0/2425242399 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201c15b9e0 0x7f201c14d4e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f201400c780 tx=0x7f201400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:37.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.130+0000 7f2013e00640 1 -- 172.21.15.103:0/2425242399 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2014004b70 con 0x7f201c15b9e0 2024-09-10T22:43:37.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.130+0000 7f2013e00640 1 -- 172.21.15.103:0/2425242399 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2014004e00 con 0x7f201c15b9e0 2024-09-10T22:43:37.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.130+0000 7f2013e00640 1 -- 172.21.15.103:0/2425242399 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201400aa90 con 0x7f201c15b9e0 2024-09-10T22:43:37.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.130+0000 7f2022000640 1 -- 172.21.15.103:0/2425242399 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f201c14e690 con 0x7f201c15b9e0 2024-09-10T22:43:37.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.130+0000 7f2022000640 1 -- 172.21.15.103:0/2425242399 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f201c14efd0 con 0x7f201c15b9e0 2024-09-10T22:43:37.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.130+0000 7f2022000640 1 -- 172.21.15.103:0/2425242399 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f201c0cc970 con 0x7f201c15b9e0 2024-09-10T22:43:37.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.130+0000 7f2013e00640 1 -- 172.21.15.103:0/2425242399 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f201400ac30 con 0x7f201c15b9e0 2024-09-10T22:43:37.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.130+0000 7f2013e00640 1 --2- 172.21.15.103:0/2425242399 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1ff80725e0 0x7f1ff8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:37.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.130+0000 7f2013e00640 1 -- 172.21.15.103:0/2425242399 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f20140935e0 con 0x7f201c15b9e0 2024-09-10T22:43:37.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.130+0000 7f201b400640 1 --2- 172.21.15.103:0/2425242399 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1ff80725e0 0x7f1ff8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:37.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.134+0000 7f201b400640 1 --2- 172.21.15.103:0/2425242399 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1ff80725e0 0x7f1ff8074aa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f200c0af000 tx=0x7f200c01b120 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:37.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.134+0000 7f2013e00640 1 -- 172.21.15.103:0/2425242399 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2014020070 con 0x7f201c15b9e0 2024-09-10T22:43:37.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.334+0000 7f2022000640 1 -- 172.21.15.103:0/2425242399 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f201c1f7c20 con 0x7f201c15b9e0 2024-09-10T22:43:37.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.334+0000 7f2013e00640 1 -- 172.21.15.103:0/2425242399 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5231 (secure 0 0 0) 0x7f201c14df10 con 0x7f201c15b9e0 2024-09-10T22:43:37.337 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:37.337 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":72,"btime":"2024-09-10T22:43:36:960842+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6047,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/2402286786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2402286786},{"type":"v1","addr":"172.21.15.103:6834","nonce":2402286786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68},{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/4254729752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":4254729752},{"type":"v1","addr":"172.21.15.131:6837","nonce":4254729752}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68},{"gid":6592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/134240629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":134240629},{"type":"v1","addr":"172.21.15.131:6836","nonce":134240629}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:43:33.337095+0000","modified":"2024-09-10T22:43:36.351104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6873},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6873":{"gid":6873,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/249667943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":249667943},{"type":"v1","addr":"172.21.15.103:6835","nonce":249667943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6873,"qdb_cluster":[6873]},"id":5}]} 2024-09-10T22:43:37.337 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 72 2024-09-10T22:43:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.334+0000 7f2022000640 1 -- 172.21.15.103:0/2425242399 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1ff80725e0 msgr2=0x7f1ff8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.334+0000 7f2022000640 1 --2- 172.21.15.103:0/2425242399 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1ff80725e0 0x7f1ff8074aa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f200c0af000 tx=0x7f200c01b120 comp rx=0 tx=0).stop 2024-09-10T22:43:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.334+0000 7f2022000640 1 -- 172.21.15.103:0/2425242399 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201c15b9e0 msgr2=0x7f201c14d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.334+0000 7f2022000640 1 --2- 172.21.15.103:0/2425242399 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201c15b9e0 0x7f201c14d4e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f201400c780 tx=0x7f201400cc40 comp rx=0 tx=0).stop 2024-09-10T22:43:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.334+0000 7f2022000640 1 -- 172.21.15.103:0/2425242399 shutdown_connections 2024-09-10T22:43:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.334+0000 7f2022000640 1 --2- 172.21.15.103:0/2425242399 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1ff80725e0 0x7f1ff8074aa0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.334+0000 7f2022000640 1 --2- 172.21.15.103:0/2425242399 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201c15b9e0 0x7f201c14d4e0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.334+0000 7f2022000640 1 --2- 172.21.15.103:0/2425242399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f201c0ad8f0 0x7f201c0cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.334+0000 7f2022000640 1 --2- 172.21.15.103:0/2425242399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f201c06e1d0 0x7f201c1fbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.334+0000 7f2022000640 1 -- 172.21.15.103:0/2425242399 >> 172.21.15.103:0/2425242399 conn(0x7f201c0b1c00 msgr2=0x7f201c074300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:37.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.334+0000 7f2022000640 1 -- 172.21.15.103:0/2425242399 shutdown_connections 2024-09-10T22:43:37.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.334+0000 7f2022000640 1 -- 172.21.15.103:0/2425242399 wait complete. 2024-09-10T22:43:37.359 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:43:37.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bbc800640 1 -- 172.21.15.103:0/711541048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb40cf260 msgr2=0x7f3bb40b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:37.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bbc800640 1 --2- 172.21.15.103:0/711541048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb40cf260 0x7f3bb40b2c10 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800a950 tx=0x7f3ba801db70 comp rx=0 tx=0).stop 2024-09-10T22:43:37.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bbc800640 1 -- 172.21.15.103:0/711541048 shutdown_connections 2024-09-10T22:43:37.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bbc800640 1 --2- 172.21.15.103:0/711541048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb40cf260 0x7f3bb40b2c10 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bbc800640 1 -- 172.21.15.103:0/711541048 >> 172.21.15.103:0/711541048 conn(0x7f3bb406cc00 msgr2=0x7f3bb406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:37.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bbc800640 1 -- 172.21.15.103:0/711541048 shutdown_connections 2024-09-10T22:43:37.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bbc800640 1 -- 172.21.15.103:0/711541048 wait complete. 2024-09-10T22:43:37.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bbc800640 1 Processor -- start 2024-09-10T22:43:37.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bbc800640 1 -- start start 2024-09-10T22:43:37.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bbc800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb4072c10 0x7f3bb415d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:37.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bbc800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb40b3150 0x7f3bb41433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:37.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bbc800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb40cf260 0x7f3bb415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:37.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bbc800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb4167e40 con 0x7f3bb4072c10 2024-09-10T22:43:37.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bbc800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb4157ea0 con 0x7f3bb40cf260 2024-09-10T22:43:37.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bbc800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3bb4167fc0 con 0x7f3bb40b3150 2024-09-10T22:43:37.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bb9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb4072c10 0x7f3bb415d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:37.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bb9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb4072c10 0x7f3bb415d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40160/0 (socket says 172.21.15.103:40160) 2024-09-10T22:43:37.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bb9e00640 1 -- 172.21.15.103:0/1207348887 learned_addr learned my addr 172.21.15.103:0/1207348887 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:37.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bb9e00640 1 -- 172.21.15.103:0/1207348887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb40b3150 msgr2=0x7f3bb41433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:37.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bb9e00640 1 --2- 172.21.15.103:0/1207348887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb40b3150 0x7f3bb41433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bb9e00640 1 -- 172.21.15.103:0/1207348887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb40cf260 msgr2=0x7f3bb415c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:37.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bb9e00640 1 --2- 172.21.15.103:0/1207348887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb40cf260 0x7f3bb415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bb9e00640 1 -- 172.21.15.103:0/1207348887 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb40b0450 con 0x7f3bb4072c10 2024-09-10T22:43:37.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.498+0000 7f3bb9e00640 1 --2- 172.21.15.103:0/1207348887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb4072c10 0x7f3bb415d120 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8000c10 tx=0x7f3ba8005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:37.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.502+0000 7f3bae000640 1 -- 172.21.15.103:0/1207348887 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba80b3040 con 0x7f3bb4072c10 2024-09-10T22:43:37.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.502+0000 7f3bae000640 1 -- 172.21.15.103:0/1207348887 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ba80038c0 con 0x7f3bb4072c10 2024-09-10T22:43:37.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.502+0000 7f3bae000640 1 -- 172.21.15.103:0/1207348887 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8003cd0 con 0x7f3bb4072c10 2024-09-10T22:43:37.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.502+0000 7f3bbc800640 1 -- 172.21.15.103:0/1207348887 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bb415d790 con 0x7f3bb4072c10 2024-09-10T22:43:37.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.502+0000 7f3bbc800640 1 -- 172.21.15.103:0/1207348887 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bb415dd50 con 0x7f3bb4072c10 2024-09-10T22:43:37.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.502+0000 7f3bbc800640 1 -- 172.21.15.103:0/1207348887 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bb4158c70 con 0x7f3bb4072c10 2024-09-10T22:43:37.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.502+0000 7f3bae000640 1 -- 172.21.15.103:0/1207348887 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3ba800b040 con 0x7f3bb4072c10 2024-09-10T22:43:37.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.502+0000 7f3bae000640 1 --2- 172.21.15.103:0/1207348887 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3b980725e0 0x7f3b98074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:37.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.502+0000 7f3bae000640 1 -- 172.21.15.103:0/1207348887 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f3ba812db90 con 0x7f3bb4072c10 2024-09-10T22:43:37.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.502+0000 7f3bb9400640 1 --2- 172.21.15.103:0/1207348887 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3b980725e0 0x7f3b98074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:37.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.506+0000 7f3bb9400640 1 --2- 172.21.15.103:0/1207348887 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3b980725e0 0x7f3b98074aa0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4153d40 tx=0x7f3ba40079c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:37.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.506+0000 7f3bae000640 1 -- 172.21.15.103:0/1207348887 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3ba8017760 con 0x7f3bb4072c10 2024-09-10T22:43:37.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.670+0000 7f3bbc800640 1 -- 172.21.15.103:0/1207348887 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3bb4072880 con 0x7f3bb4072c10 2024-09-10T22:43:37.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.674+0000 7f3bae000640 1 -- 172.21.15.103:0/1207348887 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+17065 (secure 0 0 0) 0x7f3ba80f90d0 con 0x7f3bb4072c10 2024-09-10T22:43:37.677 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:37.677 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":81,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:43:34.948634+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:43:31.019531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-10T22:43:32.295197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:43:37.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.674+0000 7f3bbc800640 1 -- 172.21.15.103:0/1207348887 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3b980725e0 msgr2=0x7f3b98074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:37.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.674+0000 7f3bbc800640 1 --2- 172.21.15.103:0/1207348887 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3b980725e0 0x7f3b98074aa0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4153d40 tx=0x7f3ba40079c0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.674+0000 7f3bbc800640 1 -- 172.21.15.103:0/1207348887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb4072c10 msgr2=0x7f3bb415d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:37.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.674+0000 7f3bbc800640 1 --2- 172.21.15.103:0/1207348887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb4072c10 0x7f3bb415d120 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8000c10 tx=0x7f3ba8005760 comp rx=0 tx=0).stop 2024-09-10T22:43:37.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.674+0000 7f3bbc800640 1 -- 172.21.15.103:0/1207348887 shutdown_connections 2024-09-10T22:43:37.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.674+0000 7f3bbc800640 1 --2- 172.21.15.103:0/1207348887 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3b980725e0 0x7f3b98074aa0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.674+0000 7f3bbc800640 1 --2- 172.21.15.103:0/1207348887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb40cf260 0x7f3bb415c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.674+0000 7f3bbc800640 1 --2- 172.21.15.103:0/1207348887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb40b3150 0x7f3bb41433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.674+0000 7f3bbc800640 1 --2- 172.21.15.103:0/1207348887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb4072c10 0x7f3bb415d120 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.674+0000 7f3bbc800640 1 -- 172.21.15.103:0/1207348887 >> 172.21.15.103:0/1207348887 conn(0x7f3bb406cc00 msgr2=0x7f3bb41512c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:37.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.674+0000 7f3bbc800640 1 -- 172.21.15.103:0/1207348887 shutdown_connections 2024-09-10T22:43:37.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.674+0000 7f3bbc800640 1 -- 172.21.15.103:0/1207348887 wait complete. 2024-09-10T22:43:37.698 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T22:43:37.698 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:43:37.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae26000640 1 -- 172.21.15.103:0/2126881170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae200aeb40 msgr2=0x7fae20072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:37.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae26000640 1 --2- 172.21.15.103:0/2126881170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae200aeb40 0x7fae20072e30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fae08009840 tx=0x7fae0801c760 comp rx=0 tx=0).stop 2024-09-10T22:43:37.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae26000640 1 -- 172.21.15.103:0/2126881170 shutdown_connections 2024-09-10T22:43:37.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae26000640 1 --2- 172.21.15.103:0/2126881170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae200aeb40 0x7fae20072e30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae26000640 1 -- 172.21.15.103:0/2126881170 >> 172.21.15.103:0/2126881170 conn(0x7fae2006cc00 msgr2=0x7fae2006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:37.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae26000640 1 -- 172.21.15.103:0/2126881170 shutdown_connections 2024-09-10T22:43:37.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae26000640 1 -- 172.21.15.103:0/2126881170 wait complete. 2024-09-10T22:43:37.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae26000640 1 Processor -- start 2024-09-10T22:43:37.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae26000640 1 -- start start 2024-09-10T22:43:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae26000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae200aeb40 0x7fae2014f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae26000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae200cc120 0x7fae2014c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae26000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae200cf790 0x7fae2015f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae26000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae2016a250 con 0x7fae200aeb40 2024-09-10T22:43:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae26000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fae2016a0d0 con 0x7fae200cf790 2024-09-10T22:43:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae26000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fae2016a3d0 con 0x7fae200cc120 2024-09-10T22:43:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae1f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae200aeb40 0x7fae2014f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae1f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae200aeb40 0x7fae2014f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40164/0 (socket says 172.21.15.103:40164) 2024-09-10T22:43:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae1f400640 1 -- 172.21.15.103:0/3042427484 learned_addr learned my addr 172.21.15.103:0/3042427484 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae16a00640 1 --2- 172.21.15.103:0/3042427484 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae200cc120 0x7fae2014c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.838+0000 7fae1fe00640 1 --2- 172.21.15.103:0/3042427484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae200cf790 0x7fae2015f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.842+0000 7fae1f400640 1 -- 172.21.15.103:0/3042427484 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae200cc120 msgr2=0x7fae2014c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.842+0000 7fae1f400640 1 --2- 172.21.15.103:0/3042427484 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae200cc120 0x7fae2014c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.842+0000 7fae1f400640 1 -- 172.21.15.103:0/3042427484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae200cf790 msgr2=0x7fae2015f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.842+0000 7fae1f400640 1 --2- 172.21.15.103:0/3042427484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae200cf790 0x7fae2015f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.842+0000 7fae1f400640 1 -- 172.21.15.103:0/3042427484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2014cbd0 con 0x7fae200aeb40 2024-09-10T22:43:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.842+0000 7fae1f400640 1 --2- 172.21.15.103:0/3042427484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae200aeb40 0x7fae2014f310 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fae1000c7f0 tx=0x7fae1000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.842+0000 7fae17e00640 1 -- 172.21.15.103:0/3042427484 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10017070 con 0x7fae200aeb40 2024-09-10T22:43:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.842+0000 7fae17e00640 1 -- 172.21.15.103:0/3042427484 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae10005070 con 0x7fae200aeb40 2024-09-10T22:43:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.842+0000 7fae17e00640 1 -- 172.21.15.103:0/3042427484 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae100054c0 con 0x7fae200aeb40 2024-09-10T22:43:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.842+0000 7fae26000640 1 -- 172.21.15.103:0/3042427484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2015db50 con 0x7fae200aeb40 2024-09-10T22:43:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.842+0000 7fae26000640 1 -- 172.21.15.103:0/3042427484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae2015e110 con 0x7fae200aeb40 2024-09-10T22:43:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.842+0000 7fae26000640 1 -- 172.21.15.103:0/3042427484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae20072e30 con 0x7fae200aeb40 2024-09-10T22:43:37.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.842+0000 7fae17e00640 1 -- 172.21.15.103:0/3042427484 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fae10005660 con 0x7fae200aeb40 2024-09-10T22:43:37.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.842+0000 7fae17e00640 1 --2- 172.21.15.103:0/3042427484 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fadfc0725e0 0x7fadfc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:37.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.842+0000 7fae17e00640 1 -- 172.21.15.103:0/3042427484 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fae10092e60 con 0x7fae200aeb40 2024-09-10T22:43:37.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.846+0000 7fae16a00640 1 --2- 172.21.15.103:0/3042427484 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fadfc0725e0 0x7fadfc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:37.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.846+0000 7fae16a00640 1 --2- 172.21.15.103:0/3042427484 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fadfc0725e0 0x7fadfc074aa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fae080af000 tx=0x7fae0801afa0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:37.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:37.846+0000 7fae17e00640 1 -- 172.21.15.103:0/3042427484 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fae1005e310 con 0x7fae200aeb40 2024-09-10T22:43:38.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.010+0000 7fae26000640 1 -- 172.21.15.103:0/3042427484 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fae200b2b50 con 0x7fadfc0725e0 2024-09-10T22:43:38.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.018+0000 7fae17e00640 1 -- 172.21.15.103:0/3042427484 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247353 (secure 0 0 0) 0x7fae200b2b50 con 0x7fadfc0725e0 2024-09-10T22:43:38.024 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:38.025 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:43:38.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.022+0000 7fae26000640 1 -- 172.21.15.103:0/3042427484 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fadfc0725e0 msgr2=0x7fadfc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:38.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.022+0000 7fae26000640 1 --2- 172.21.15.103:0/3042427484 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fadfc0725e0 0x7fadfc074aa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fae080af000 tx=0x7fae0801afa0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.022+0000 7fae26000640 1 -- 172.21.15.103:0/3042427484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae200aeb40 msgr2=0x7fae2014f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:38.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.022+0000 7fae26000640 1 --2- 172.21.15.103:0/3042427484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae200aeb40 0x7fae2014f310 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fae1000c7f0 tx=0x7fae1000ccb0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.022+0000 7fae26000640 1 -- 172.21.15.103:0/3042427484 shutdown_connections 2024-09-10T22:43:38.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.022+0000 7fae26000640 1 --2- 172.21.15.103:0/3042427484 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fadfc0725e0 0x7fadfc074aa0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.022+0000 7fae26000640 1 --2- 172.21.15.103:0/3042427484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae200cf790 0x7fae2015f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.022+0000 7fae26000640 1 --2- 172.21.15.103:0/3042427484 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae200cc120 0x7fae2014c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.022+0000 7fae26000640 1 --2- 172.21.15.103:0/3042427484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae200aeb40 0x7fae2014f310 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.022+0000 7fae26000640 1 -- 172.21.15.103:0/3042427484 >> 172.21.15.103:0/3042427484 conn(0x7fae2006cc00 msgr2=0x7fae20153f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:38.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.022+0000 7fae26000640 1 -- 172.21.15.103:0/3042427484 shutdown_connections 2024-09-10T22:43:38.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.022+0000 7fae26000640 1 -- 172.21.15.103:0/3042427484 wait complete. 2024-09-10T22:43:38.045 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-09-10T22:43:37.692567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249880,"kb_used_data":8680,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754724840,"statfs":{"total":773094113280,"available":772838236160,"internally_reserved":0,"allocated":8888320,"data_stored":4694195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.764481"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.951475+0000","last_change":"2024-09-10T22:43:32.951475+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.951475+0000","last_undegraded":"2024-09-10T22:43:32.951475+0000","last_fullsized":"2024-09-10T22:43:32.951475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947322+0000","last_change":"2024-09-10T22:43:32.947322+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947322+0000","last_undegraded":"2024-09-10T22:43:32.947322+0000","last_fullsized":"2024-09-10T22:43:32.947322+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985233+0000","last_change":"2024-09-10T22:43:33.973232+0000","last_active":"2024-09-10T22:43:34.985233+0000","last_peered":"2024-09-10T22:43:34.985233+0000","last_clean":"2024-09-10T22:43:34.985233+0000","last_became_active":"2024-09-10T22:43:33.972856+0000","last_became_peered":"2024-09-10T22:43:33.972856+0000","last_unstale":"2024-09-10T22:43:34.985233+0000","last_undegraded":"2024-09-10T22:43:34.985233+0000","last_fullsized":"2024-09-10T22:43:34.985233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:34.575975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.946226+0000","last_change":"2024-09-10T22:43:32.946226+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.946226+0000","last_undegraded":"2024-09-10T22:43:32.946226+0000","last_fullsized":"2024-09-10T22:43:32.946226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.953166+0000","last_change":"2024-09-10T22:43:32.953166+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.953166+0000","last_undegraded":"2024-09-10T22:43:32.953166+0000","last_fullsized":"2024-09-10T22:43:32.953166+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941315+0000","last_change":"2024-09-10T22:43:32.941315+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941315+0000","last_undegraded":"2024-09-10T22:43:32.941315+0000","last_fullsized":"2024-09-10T22:43:32.941315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948239+0000","last_change":"2024-09-10T22:43:32.948239+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948239+0000","last_undegraded":"2024-09-10T22:43:32.948239+0000","last_fullsized":"2024-09-10T22:43:32.948239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.954722+0000","last_change":"2024-09-10T22:43:32.954722+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.954722+0000","last_undegraded":"2024-09-10T22:43:32.954722+0000","last_fullsized":"2024-09-10T22:43:32.954722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941603+0000","last_change":"2024-09-10T22:43:32.941603+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941603+0000","last_undegraded":"2024-09-10T22:43:32.941603+0000","last_fullsized":"2024-09-10T22:43:32.941603+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945152+0000","last_change":"2024-09-10T22:43:32.945152+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945152+0000","last_undegraded":"2024-09-10T22:43:32.945152+0000","last_fullsized":"2024-09-10T22:43:32.945152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947411+0000","last_change":"2024-09-10T22:43:32.947411+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947411+0000","last_undegraded":"2024-09-10T22:43:32.947411+0000","last_fullsized":"2024-09-10T22:43:32.947411+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945801+0000","last_change":"2024-09-10T22:43:32.945801+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945801+0000","last_undegraded":"2024-09-10T22:43:32.945801+0000","last_fullsized":"2024-09-10T22:43:32.945801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.952726+0000","last_change":"2024-09-10T22:43:32.952726+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.952726+0000","last_undegraded":"2024-09-10T22:43:32.952726+0000","last_fullsized":"2024-09-10T22:43:32.952726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.940828+0000","last_change":"2024-09-10T22:43:32.940828+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.940828+0000","last_undegraded":"2024-09-10T22:43:32.940828+0000","last_fullsized":"2024-09-10T22:43:32.940828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945854+0000","last_change":"2024-09-10T22:43:32.945854+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945854+0000","last_undegraded":"2024-09-10T22:43:32.945854+0000","last_fullsized":"2024-09-10T22:43:32.945854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948406+0000","last_change":"2024-09-10T22:43:32.948406+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948406+0000","last_undegraded":"2024-09-10T22:43:32.948406+0000","last_fullsized":"2024-09-10T22:43:32.948406+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.949052+0000","last_change":"2024-09-10T22:43:32.949052+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.949052+0000","last_undegraded":"2024-09-10T22:43:32.949052+0000","last_fullsized":"2024-09-10T22:43:32.949052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985109+0000","last_change":"2024-09-10T22:43:33.969132+0000","last_active":"2024-09-10T22:43:34.985109+0000","last_peered":"2024-09-10T22:43:34.985109+0000","last_clean":"2024-09-10T22:43:34.985109+0000","last_became_active":"2024-09-10T22:43:33.966818+0000","last_became_peered":"2024-09-10T22:43:33.966818+0000","last_unstale":"2024-09-10T22:43:34.985109+0000","last_undegraded":"2024-09-10T22:43:34.985109+0000","last_fullsized":"2024-09-10T22:43:34.985109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:46.251681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941375+0000","last_change":"2024-09-10T22:43:32.941375+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941375+0000","last_undegraded":"2024-09-10T22:43:32.941375+0000","last_fullsized":"2024-09-10T22:43:32.941375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948950+0000","last_change":"2024-09-10T22:43:32.948950+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948950+0000","last_undegraded":"2024-09-10T22:43:32.948950+0000","last_fullsized":"2024-09-10T22:43:32.948950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.942523+0000","last_change":"2024-09-10T22:43:32.942523+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.942523+0000","last_undegraded":"2024-09-10T22:43:32.942523+0000","last_fullsized":"2024-09-10T22:43:32.942523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.956163+0000","last_change":"2024-09-10T22:43:32.956163+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.956163+0000","last_undegraded":"2024-09-10T22:43:32.956163+0000","last_fullsized":"2024-09-10T22:43:32.956163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941593+0000","last_change":"2024-09-10T22:43:32.941593+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941593+0000","last_undegraded":"2024-09-10T22:43:32.941593+0000","last_fullsized":"2024-09-10T22:43:32.941593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.946286+0000","last_change":"2024-09-10T22:43:32.946286+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.946286+0000","last_undegraded":"2024-09-10T22:43:32.946286+0000","last_fullsized":"2024-09-10T22:43:32.946286+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945893+0000","last_change":"2024-09-10T22:43:32.945893+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945893+0000","last_undegraded":"2024-09-10T22:43:32.945893+0000","last_fullsized":"2024-09-10T22:43:32.945893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.944646+0000","last_change":"2024-09-10T22:43:32.944646+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.944646+0000","last_undegraded":"2024-09-10T22:43:32.944646+0000","last_fullsized":"2024-09-10T22:43:32.944646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.952160+0000","last_change":"2024-09-10T22:43:32.952160+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.952160+0000","last_undegraded":"2024-09-10T22:43:32.952160+0000","last_fullsized":"2024-09-10T22:43:32.952160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948502+0000","last_change":"2024-09-10T22:43:32.948502+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948502+0000","last_undegraded":"2024-09-10T22:43:32.948502+0000","last_fullsized":"2024-09-10T22:43:32.948502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945870+0000","last_change":"2024-09-10T22:43:32.945870+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945870+0000","last_undegraded":"2024-09-10T22:43:32.945870+0000","last_fullsized":"2024-09-10T22:43:32.945870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948973+0000","last_change":"2024-09-10T22:43:32.948973+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948973+0000","last_undegraded":"2024-09-10T22:43:32.948973+0000","last_fullsized":"2024-09-10T22:43:32.948973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984879+0000","last_change":"2024-09-10T22:43:33.960463+0000","last_active":"2024-09-10T22:43:34.984879+0000","last_peered":"2024-09-10T22:43:34.984879+0000","last_clean":"2024-09-10T22:43:34.984879+0000","last_became_active":"2024-09-10T22:43:33.957699+0000","last_became_peered":"2024-09-10T22:43:33.957699+0000","last_unstale":"2024-09-10T22:43:34.984879+0000","last_undegraded":"2024-09-10T22:43:34.984879+0000","last_fullsized":"2024-09-10T22:43:34.984879+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:17.832049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947954+0000","last_change":"2024-09-10T22:43:32.947954+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947954+0000","last_undegraded":"2024-09-10T22:43:32.947954+0000","last_fullsized":"2024-09-10T22:43:32.947954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984549+0000","last_change":"2024-09-10T22:43:33.966343+0000","last_active":"2024-09-10T22:43:34.984549+0000","last_peered":"2024-09-10T22:43:34.984549+0000","last_clean":"2024-09-10T22:43:34.984549+0000","last_became_active":"2024-09-10T22:43:33.966077+0000","last_became_peered":"2024-09-10T22:43:33.966077+0000","last_unstale":"2024-09-10T22:43:34.984549+0000","last_undegraded":"2024-09-10T22:43:34.984549+0000","last_fullsized":"2024-09-10T22:43:34.984549+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:11.532561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.965154+0000","last_change":"2024-09-10T22:43:32.957567+0000","last_active":"2024-09-10T22:43:32.965154+0000","last_peered":"2024-09-10T22:43:32.965154+0000","last_clean":"2024-09-10T22:43:32.965154+0000","last_became_active":"2024-09-10T22:43:32.957316+0000","last_became_peered":"2024-09-10T22:43:32.957316+0000","last_unstale":"2024-09-10T22:43:32.965154+0000","last_undegraded":"2024-09-10T22:43:32.965154+0000","last_fullsized":"2024-09-10T22:43:32.965154+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:08.694787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.943839+0000","last_change":"2024-09-10T22:43:32.943839+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.943839+0000","last_undegraded":"2024-09-10T22:43:32.943839+0000","last_fullsized":"2024-09-10T22:43:32.943839+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964327+0000","last_change":"2024-09-10T22:43:32.962321+0000","last_active":"2024-09-10T22:43:32.964327+0000","last_peered":"2024-09-10T22:43:32.964327+0000","last_clean":"2024-09-10T22:43:32.964327+0000","last_became_active":"2024-09-10T22:43:32.961642+0000","last_became_peered":"2024-09-10T22:43:32.961642+0000","last_unstale":"2024-09-10T22:43:32.964327+0000","last_undegraded":"2024-09-10T22:43:32.964327+0000","last_fullsized":"2024-09-10T22:43:32.964327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:54.835911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.942392+0000","last_change":"2024-09-10T22:43:32.942392+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.942392+0000","last_undegraded":"2024-09-10T22:43:32.942392+0000","last_fullsized":"2024-09-10T22:43:32.942392+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.971260+0000","last_change":"2024-09-10T22:43:32.964868+0000","last_active":"2024-09-10T22:43:32.971260+0000","last_peered":"2024-09-10T22:43:32.971260+0000","last_clean":"2024-09-10T22:43:32.971260+0000","last_became_active":"2024-09-10T22:43:32.964629+0000","last_became_peered":"2024-09-10T22:43:32.964629+0000","last_unstale":"2024-09-10T22:43:32.971260+0000","last_undegraded":"2024-09-10T22:43:32.971260+0000","last_fullsized":"2024-09-10T22:43:32.971260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:11.767542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941614+0000","last_change":"2024-09-10T22:43:32.941614+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941614+0000","last_undegraded":"2024-09-10T22:43:32.941614+0000","last_fullsized":"2024-09-10T22:43:32.941614+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.961669+0000","last_change":"2024-09-10T22:43:32.957956+0000","last_active":"2024-09-10T22:43:32.961669+0000","last_peered":"2024-09-10T22:43:32.961669+0000","last_clean":"2024-09-10T22:43:32.961669+0000","last_became_active":"2024-09-10T22:43:32.957370+0000","last_became_peered":"2024-09-10T22:43:32.957370+0000","last_unstale":"2024-09-10T22:43:32.961669+0000","last_undegraded":"2024-09-10T22:43:32.961669+0000","last_fullsized":"2024-09-10T22:43:32.961669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:13.681326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.944400+0000","last_change":"2024-09-10T22:43:32.944400+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.944400+0000","last_undegraded":"2024-09-10T22:43:32.944400+0000","last_fullsized":"2024-09-10T22:43:32.944400+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964022+0000","last_change":"2024-09-10T22:43:32.958500+0000","last_active":"2024-09-10T22:43:32.964022+0000","last_peered":"2024-09-10T22:43:32.964022+0000","last_clean":"2024-09-10T22:43:32.964022+0000","last_became_active":"2024-09-10T22:43:32.957266+0000","last_became_peered":"2024-09-10T22:43:32.957266+0000","last_unstale":"2024-09-10T22:43:32.964022+0000","last_undegraded":"2024-09-10T22:43:32.964022+0000","last_fullsized":"2024-09-10T22:43:32.964022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:02.384231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945488+0000","last_change":"2024-09-10T22:43:32.945488+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945488+0000","last_undegraded":"2024-09-10T22:43:32.945488+0000","last_fullsized":"2024-09-10T22:43:32.945488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.958460+0000","last_change":"2024-09-10T22:43:32.954519+0000","last_active":"2024-09-10T22:43:32.958460+0000","last_peered":"2024-09-10T22:43:32.958460+0000","last_clean":"2024-09-10T22:43:32.958460+0000","last_became_active":"2024-09-10T22:43:32.954235+0000","last_became_peered":"2024-09-10T22:43:32.954235+0000","last_unstale":"2024-09-10T22:43:32.958460+0000","last_undegraded":"2024-09-10T22:43:32.958460+0000","last_fullsized":"2024-09-10T22:43:32.958460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:29.999024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941897+0000","last_change":"2024-09-10T22:43:32.941897+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941897+0000","last_undegraded":"2024-09-10T22:43:32.941897+0000","last_fullsized":"2024-09-10T22:43:32.941897+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.962716+0000","last_change":"2024-09-10T22:43:32.953990+0000","last_active":"2024-09-10T22:43:32.962716+0000","last_peered":"2024-09-10T22:43:32.962716+0000","last_clean":"2024-09-10T22:43:32.962716+0000","last_became_active":"2024-09-10T22:43:32.953759+0000","last_became_peered":"2024-09-10T22:43:32.953759+0000","last_unstale":"2024-09-10T22:43:32.962716+0000","last_undegraded":"2024-09-10T22:43:32.962716+0000","last_fullsized":"2024-09-10T22:43:32.962716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:31.925280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948623+0000","last_change":"2024-09-10T22:43:32.948623+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948623+0000","last_undegraded":"2024-09-10T22:43:32.948623+0000","last_fullsized":"2024-09-10T22:43:32.948623+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.971105+0000","last_change":"2024-09-10T22:43:32.966902+0000","last_active":"2024-09-10T22:43:32.971105+0000","last_peered":"2024-09-10T22:43:32.971105+0000","last_clean":"2024-09-10T22:43:32.971105+0000","last_became_active":"2024-09-10T22:43:32.966674+0000","last_became_peered":"2024-09-10T22:43:32.966674+0000","last_unstale":"2024-09-10T22:43:32.971105+0000","last_undegraded":"2024-09-10T22:43:32.971105+0000","last_fullsized":"2024-09-10T22:43:32.971105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:05.242861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.944324+0000","last_change":"2024-09-10T22:43:32.944324+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.944324+0000","last_undegraded":"2024-09-10T22:43:32.944324+0000","last_fullsized":"2024-09-10T22:43:32.944324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964304+0000","last_change":"2024-09-10T22:43:32.960867+0000","last_active":"2024-09-10T22:43:32.964304+0000","last_peered":"2024-09-10T22:43:32.964304+0000","last_clean":"2024-09-10T22:43:32.964304+0000","last_became_active":"2024-09-10T22:43:32.960572+0000","last_became_peered":"2024-09-10T22:43:32.960572+0000","last_unstale":"2024-09-10T22:43:32.964304+0000","last_undegraded":"2024-09-10T22:43:32.964304+0000","last_fullsized":"2024-09-10T22:43:32.964304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:29.999024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.944516+0000","last_change":"2024-09-10T22:43:32.944516+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.944516+0000","last_undegraded":"2024-09-10T22:43:32.944516+0000","last_fullsized":"2024-09-10T22:43:32.944516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.959985+0000","last_change":"2024-09-10T22:43:32.956895+0000","last_active":"2024-09-10T22:43:32.959985+0000","last_peered":"2024-09-10T22:43:32.959985+0000","last_clean":"2024-09-10T22:43:32.959985+0000","last_became_active":"2024-09-10T22:43:32.956558+0000","last_became_peered":"2024-09-10T22:43:32.956558+0000","last_unstale":"2024-09-10T22:43:32.959985+0000","last_undegraded":"2024-09-10T22:43:32.959985+0000","last_fullsized":"2024-09-10T22:43:32.959985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:54.835911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.940234+0000","last_change":"2024-09-10T22:43:32.940234+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.940234+0000","last_undegraded":"2024-09-10T22:43:32.940234+0000","last_fullsized":"2024-09-10T22:43:32.940234+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.969693+0000","last_change":"2024-09-10T22:43:32.966412+0000","last_active":"2024-09-10T22:43:32.969693+0000","last_peered":"2024-09-10T22:43:32.969693+0000","last_clean":"2024-09-10T22:43:32.969693+0000","last_became_active":"2024-09-10T22:43:32.966135+0000","last_became_peered":"2024-09-10T22:43:32.966135+0000","last_unstale":"2024-09-10T22:43:32.969693+0000","last_undegraded":"2024-09-10T22:43:32.969693+0000","last_fullsized":"2024-09-10T22:43:32.969693+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:44.606825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984806+0000","last_change":"2024-09-10T22:43:33.970411+0000","last_active":"2024-09-10T22:43:34.984806+0000","last_peered":"2024-09-10T22:43:34.984806+0000","last_clean":"2024-09-10T22:43:34.984806+0000","last_became_active":"2024-09-10T22:43:33.969898+0000","last_became_peered":"2024-09-10T22:43:33.969898+0000","last_unstale":"2024-09-10T22:43:34.984806+0000","last_undegraded":"2024-09-10T22:43:34.984806+0000","last_fullsized":"2024-09-10T22:43:34.984806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:52.448989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.961695+0000","last_change":"2024-09-10T22:43:32.958074+0000","last_active":"2024-09-10T22:43:32.961695+0000","last_peered":"2024-09-10T22:43:32.961695+0000","last_clean":"2024-09-10T22:43:32.961695+0000","last_became_active":"2024-09-10T22:43:32.957692+0000","last_became_peered":"2024-09-10T22:43:32.957692+0000","last_unstale":"2024-09-10T22:43:32.961695+0000","last_undegraded":"2024-09-10T22:43:32.961695+0000","last_fullsized":"2024-09-10T22:43:32.961695+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:21:46.363669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945092+0000","last_change":"2024-09-10T22:43:32.945092+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945092+0000","last_undegraded":"2024-09-10T22:43:32.945092+0000","last_fullsized":"2024-09-10T22:43:32.945092+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.958387+0000","last_change":"2024-09-10T22:43:32.953419+0000","last_active":"2024-09-10T22:43:32.958387+0000","last_peered":"2024-09-10T22:43:32.958387+0000","last_clean":"2024-09-10T22:43:32.958387+0000","last_became_active":"2024-09-10T22:43:32.953109+0000","last_became_peered":"2024-09-10T22:43:32.953109+0000","last_unstale":"2024-09-10T22:43:32.958387+0000","last_undegraded":"2024-09-10T22:43:32.958387+0000","last_fullsized":"2024-09-10T22:43:32.958387+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:53.675442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947164+0000","last_change":"2024-09-10T22:43:32.947164+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947164+0000","last_undegraded":"2024-09-10T22:43:32.947164+0000","last_fullsized":"2024-09-10T22:43:32.947164+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.971773+0000","last_change":"2024-09-10T22:43:32.968272+0000","last_active":"2024-09-10T22:43:32.971773+0000","last_peered":"2024-09-10T22:43:32.971773+0000","last_clean":"2024-09-10T22:43:32.971773+0000","last_became_active":"2024-09-10T22:43:32.967987+0000","last_became_peered":"2024-09-10T22:43:32.967987+0000","last_unstale":"2024-09-10T22:43:32.971773+0000","last_undegraded":"2024-09-10T22:43:32.971773+0000","last_fullsized":"2024-09-10T22:43:32.971773+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:10:05.503295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947167+0000","last_change":"2024-09-10T22:43:32.947167+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947167+0000","last_undegraded":"2024-09-10T22:43:32.947167+0000","last_fullsized":"2024-09-10T22:43:32.947167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.969684+0000","last_change":"2024-09-10T22:43:32.964152+0000","last_active":"2024-09-10T22:43:32.969684+0000","last_peered":"2024-09-10T22:43:32.969684+0000","last_clean":"2024-09-10T22:43:32.969684+0000","last_became_active":"2024-09-10T22:43:32.963908+0000","last_became_peered":"2024-09-10T22:43:32.963908+0000","last_unstale":"2024-09-10T22:43:32.969684+0000","last_undegraded":"2024-09-10T22:43:32.969684+0000","last_fullsized":"2024-09-10T22:43:32.969684+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:27.359912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948148+0000","last_change":"2024-09-10T22:43:32.948148+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948148+0000","last_undegraded":"2024-09-10T22:43:32.948148+0000","last_fullsized":"2024-09-10T22:43:32.948148+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964536+0000","last_change":"2024-09-10T22:43:32.957309+0000","last_active":"2024-09-10T22:43:32.964536+0000","last_peered":"2024-09-10T22:43:32.964536+0000","last_clean":"2024-09-10T22:43:32.964536+0000","last_became_active":"2024-09-10T22:43:32.956954+0000","last_became_peered":"2024-09-10T22:43:32.956954+0000","last_unstale":"2024-09-10T22:43:32.964536+0000","last_undegraded":"2024-09-10T22:43:32.964536+0000","last_fullsized":"2024-09-10T22:43:32.964536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:17.047894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.940872+0000","last_change":"2024-09-10T22:43:32.940872+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.940872+0000","last_undegraded":"2024-09-10T22:43:32.940872+0000","last_fullsized":"2024-09-10T22:43:32.940872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.971745+0000","last_change":"2024-09-10T22:43:32.967130+0000","last_active":"2024-09-10T22:43:32.971745+0000","last_peered":"2024-09-10T22:43:32.971745+0000","last_clean":"2024-09-10T22:43:32.971745+0000","last_became_active":"2024-09-10T22:43:32.966886+0000","last_became_peered":"2024-09-10T22:43:32.966886+0000","last_unstale":"2024-09-10T22:43:32.971745+0000","last_undegraded":"2024-09-10T22:43:32.971745+0000","last_fullsized":"2024-09-10T22:43:32.971745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:13:26.884998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.956136+0000","last_change":"2024-09-10T22:43:32.956136+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.956136+0000","last_undegraded":"2024-09-10T22:43:32.956136+0000","last_fullsized":"2024-09-10T22:43:32.956136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.968847+0000","last_change":"2024-09-10T22:43:32.963980+0000","last_active":"2024-09-10T22:43:32.968847+0000","last_peered":"2024-09-10T22:43:32.968847+0000","last_clean":"2024-09-10T22:43:32.968847+0000","last_became_active":"2024-09-10T22:43:32.962919+0000","last_became_peered":"2024-09-10T22:43:32.962919+0000","last_unstale":"2024-09-10T22:43:32.968847+0000","last_undegraded":"2024-09-10T22:43:32.968847+0000","last_fullsized":"2024-09-10T22:43:32.968847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:17.002563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.956625+0000","last_change":"2024-09-10T22:43:32.956625+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.956625+0000","last_undegraded":"2024-09-10T22:43:32.956625+0000","last_fullsized":"2024-09-10T22:43:32.956625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.965287+0000","last_change":"2024-09-10T22:43:32.960405+0000","last_active":"2024-09-10T22:43:32.965287+0000","last_peered":"2024-09-10T22:43:32.965287+0000","last_clean":"2024-09-10T22:43:32.965287+0000","last_became_active":"2024-09-10T22:43:32.958442+0000","last_became_peered":"2024-09-10T22:43:32.958442+0000","last_unstale":"2024-09-10T22:43:32.965287+0000","last_undegraded":"2024-09-10T22:43:32.965287+0000","last_fullsized":"2024-09-10T22:43:32.965287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:14.818760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941442+0000","last_change":"2024-09-10T22:43:32.941442+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941442+0000","last_undegraded":"2024-09-10T22:43:32.941442+0000","last_fullsized":"2024-09-10T22:43:32.941442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984708+0000","last_change":"2024-09-10T22:43:32.964908+0000","last_active":"2024-09-10T22:43:34.984708+0000","last_peered":"2024-09-10T22:43:34.984708+0000","last_clean":"2024-09-10T22:43:34.984708+0000","last_became_active":"2024-09-10T22:43:32.964611+0000","last_became_peered":"2024-09-10T22:43:32.964611+0000","last_unstale":"2024-09-10T22:43:34.984708+0000","last_undegraded":"2024-09-10T22:43:34.984708+0000","last_fullsized":"2024-09-10T22:43:34.984708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:02.693878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.943946+0000","last_change":"2024-09-10T22:43:32.943946+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.943946+0000","last_undegraded":"2024-09-10T22:43:32.943946+0000","last_fullsized":"2024-09-10T22:43:32.943946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.967678+0000","last_change":"2024-09-10T22:43:32.961790+0000","last_active":"2024-09-10T22:43:32.967678+0000","last_peered":"2024-09-10T22:43:32.967678+0000","last_clean":"2024-09-10T22:43:32.967678+0000","last_became_active":"2024-09-10T22:43:32.961323+0000","last_became_peered":"2024-09-10T22:43:32.961323+0000","last_unstale":"2024-09-10T22:43:32.967678+0000","last_undegraded":"2024-09-10T22:43:32.967678+0000","last_fullsized":"2024-09-10T22:43:32.967678+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:15.339385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.943860+0000","last_change":"2024-09-10T22:43:32.943860+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.943860+0000","last_undegraded":"2024-09-10T22:43:32.943860+0000","last_fullsized":"2024-09-10T22:43:32.943860+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.967675+0000","last_change":"2024-09-10T22:43:32.960678+0000","last_active":"2024-09-10T22:43:32.967675+0000","last_peered":"2024-09-10T22:43:32.967675+0000","last_clean":"2024-09-10T22:43:32.967675+0000","last_became_active":"2024-09-10T22:43:32.959289+0000","last_became_peered":"2024-09-10T22:43:32.959289+0000","last_unstale":"2024-09-10T22:43:32.967675+0000","last_undegraded":"2024-09-10T22:43:32.967675+0000","last_fullsized":"2024-09-10T22:43:32.967675+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:56.905762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947725+0000","last_change":"2024-09-10T22:43:32.947725+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947725+0000","last_undegraded":"2024-09-10T22:43:32.947725+0000","last_fullsized":"2024-09-10T22:43:32.947725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964622+0000","last_change":"2024-09-10T22:43:32.958892+0000","last_active":"2024-09-10T22:43:32.964622+0000","last_peered":"2024-09-10T22:43:32.964622+0000","last_clean":"2024-09-10T22:43:32.964622+0000","last_became_active":"2024-09-10T22:43:32.957384+0000","last_became_peered":"2024-09-10T22:43:32.957384+0000","last_unstale":"2024-09-10T22:43:32.964622+0000","last_undegraded":"2024-09-10T22:43:32.964622+0000","last_fullsized":"2024-09-10T22:43:32.964622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:54.693425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941617+0000","last_change":"2024-09-10T22:43:32.941617+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941617+0000","last_undegraded":"2024-09-10T22:43:32.941617+0000","last_fullsized":"2024-09-10T22:43:32.941617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.966361+0000","last_change":"2024-09-10T22:43:32.962599+0000","last_active":"2024-09-10T22:43:32.966361+0000","last_peered":"2024-09-10T22:43:32.966361+0000","last_clean":"2024-09-10T22:43:32.966361+0000","last_became_active":"2024-09-10T22:43:32.962196+0000","last_became_peered":"2024-09-10T22:43:32.962196+0000","last_unstale":"2024-09-10T22:43:32.966361+0000","last_undegraded":"2024-09-10T22:43:32.966361+0000","last_fullsized":"2024-09-10T22:43:32.966361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:21.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947694+0000","last_change":"2024-09-10T22:43:32.947694+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947694+0000","last_undegraded":"2024-09-10T22:43:32.947694+0000","last_fullsized":"2024-09-10T22:43:32.947694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.959386+0000","last_change":"2024-09-10T22:43:32.953544+0000","last_active":"2024-09-10T22:43:32.959386+0000","last_peered":"2024-09-10T22:43:32.959386+0000","last_clean":"2024-09-10T22:43:32.959386+0000","last_became_active":"2024-09-10T22:43:32.951997+0000","last_became_peered":"2024-09-10T22:43:32.951997+0000","last_unstale":"2024-09-10T22:43:32.959386+0000","last_undegraded":"2024-09-10T22:43:32.959386+0000","last_fullsized":"2024-09-10T22:43:32.959386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:09.778155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941761+0000","last_change":"2024-09-10T22:43:32.941761+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941761+0000","last_undegraded":"2024-09-10T22:43:32.941761+0000","last_fullsized":"2024-09-10T22:43:32.941761+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.966445+0000","last_change":"2024-09-10T22:43:32.962093+0000","last_active":"2024-09-10T22:43:32.966445+0000","last_peered":"2024-09-10T22:43:32.966445+0000","last_clean":"2024-09-10T22:43:32.966445+0000","last_became_active":"2024-09-10T22:43:32.961715+0000","last_became_peered":"2024-09-10T22:43:32.961715+0000","last_unstale":"2024-09-10T22:43:32.966445+0000","last_undegraded":"2024-09-10T22:43:32.966445+0000","last_fullsized":"2024-09-10T22:43:32.966445+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:21.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.943830+0000","last_change":"2024-09-10T22:43:32.943830+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.943830+0000","last_undegraded":"2024-09-10T22:43:32.943830+0000","last_fullsized":"2024-09-10T22:43:32.943830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.963636+0000","last_change":"2024-09-10T22:43:32.960870+0000","last_active":"2024-09-10T22:43:32.963636+0000","last_peered":"2024-09-10T22:43:32.963636+0000","last_clean":"2024-09-10T22:43:32.963636+0000","last_became_active":"2024-09-10T22:43:32.960525+0000","last_became_peered":"2024-09-10T22:43:32.960525+0000","last_unstale":"2024-09-10T22:43:32.963636+0000","last_undegraded":"2024-09-10T22:43:32.963636+0000","last_fullsized":"2024-09-10T22:43:32.963636+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:53.675442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.946720+0000","last_change":"2024-09-10T22:43:32.946720+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.946720+0000","last_undegraded":"2024-09-10T22:43:32.946720+0000","last_fullsized":"2024-09-10T22:43:32.946720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.961451+0000","last_change":"2024-09-10T22:43:32.957617+0000","last_active":"2024-09-10T22:43:32.961451+0000","last_peered":"2024-09-10T22:43:32.961451+0000","last_clean":"2024-09-10T22:43:32.961451+0000","last_became_active":"2024-09-10T22:43:32.957258+0000","last_became_peered":"2024-09-10T22:43:32.957258+0000","last_unstale":"2024-09-10T22:43:32.961451+0000","last_undegraded":"2024-09-10T22:43:32.961451+0000","last_fullsized":"2024-09-10T22:43:32.961451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:56.607363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.946666+0000","last_change":"2024-09-10T22:43:32.946666+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.946666+0000","last_undegraded":"2024-09-10T22:43:32.946666+0000","last_fullsized":"2024-09-10T22:43:32.946666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.967276+0000","last_change":"2024-09-10T22:43:32.963621+0000","last_active":"2024-09-10T22:43:32.967276+0000","last_peered":"2024-09-10T22:43:32.967276+0000","last_clean":"2024-09-10T22:43:32.967276+0000","last_became_active":"2024-09-10T22:43:32.962527+0000","last_became_peered":"2024-09-10T22:43:32.962527+0000","last_unstale":"2024-09-10T22:43:32.967276+0000","last_undegraded":"2024-09-10T22:43:32.967276+0000","last_fullsized":"2024-09-10T22:43:32.967276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:44.356842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985281+0000","last_change":"2024-09-10T22:43:33.973798+0000","last_active":"2024-09-10T22:43:34.985281+0000","last_peered":"2024-09-10T22:43:34.985281+0000","last_clean":"2024-09-10T22:43:34.985281+0000","last_became_active":"2024-09-10T22:43:33.973289+0000","last_became_peered":"2024-09-10T22:43:33.973289+0000","last_unstale":"2024-09-10T22:43:34.985281+0000","last_undegraded":"2024-09-10T22:43:34.985281+0000","last_fullsized":"2024-09-10T22:43:34.985281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:55.398034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.961857+0000","last_change":"2024-09-10T22:43:32.958396+0000","last_active":"2024-09-10T22:43:32.961857+0000","last_peered":"2024-09-10T22:43:32.961857+0000","last_clean":"2024-09-10T22:43:32.961857+0000","last_became_active":"2024-09-10T22:43:32.957943+0000","last_became_peered":"2024-09-10T22:43:32.957943+0000","last_unstale":"2024-09-10T22:43:32.961857+0000","last_undegraded":"2024-09-10T22:43:32.961857+0000","last_fullsized":"2024-09-10T22:43:32.961857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:34.240762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985487+0000","last_change":"2024-09-10T22:43:33.963110+0000","last_active":"2024-09-10T22:43:34.985487+0000","last_peered":"2024-09-10T22:43:34.985487+0000","last_clean":"2024-09-10T22:43:34.985487+0000","last_became_active":"2024-09-10T22:43:33.962823+0000","last_became_peered":"2024-09-10T22:43:33.962823+0000","last_unstale":"2024-09-10T22:43:34.985487+0000","last_undegraded":"2024-09-10T22:43:34.985487+0000","last_fullsized":"2024-09-10T22:43:34.985487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:43.287722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984617+0000","last_change":"2024-09-10T22:43:32.962997+0000","last_active":"2024-09-10T22:43:34.984617+0000","last_peered":"2024-09-10T22:43:34.984617+0000","last_clean":"2024-09-10T22:43:34.984617+0000","last_became_active":"2024-09-10T22:43:32.961399+0000","last_became_peered":"2024-09-10T22:43:32.961399+0000","last_unstale":"2024-09-10T22:43:34.984617+0000","last_undegraded":"2024-09-10T22:43:34.984617+0000","last_fullsized":"2024-09-10T22:43:34.984617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:56.079546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.951693+0000","last_change":"2024-09-10T22:43:32.951693+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.951693+0000","last_undegraded":"2024-09-10T22:43:32.951693+0000","last_fullsized":"2024-09-10T22:43:32.951693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.967563+0000","last_change":"2024-09-10T22:43:32.959873+0000","last_active":"2024-09-10T22:43:32.967563+0000","last_peered":"2024-09-10T22:43:32.967563+0000","last_clean":"2024-09-10T22:43:32.967563+0000","last_became_active":"2024-09-10T22:43:32.959583+0000","last_became_peered":"2024-09-10T22:43:32.959583+0000","last_unstale":"2024-09-10T22:43:32.967563+0000","last_undegraded":"2024-09-10T22:43:32.967563+0000","last_fullsized":"2024-09-10T22:43:32.967563+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:57.043203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":218,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.952078+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:43:32.952078+0000","last_peered":"2024-09-10T22:43:32.952078+0000","last_clean":"2024-09-10T22:43:32.952078+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:43:32.952078+0000","last_undegraded":"2024-09-10T22:43:32.952078+0000","last_fullsized":"2024-09-10T22:43:32.952078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509502,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1552384,"data_stored":1027804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509502,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509503,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509502,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509502,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1552384,"data_stored":1027804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":991232,"data_stored":451407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:43:38.049 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:43:38.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.226+0000 7f85eba00640 1 -- 172.21.15.103:0/1051513279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc004810 msgr2=0x7f85cc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:38.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.226+0000 7f85eba00640 1 --2- 172.21.15.103:0/1051513279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc004810 0x7f85cc004c90 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f85d0006fb0 tx=0x7f85d001cf00 comp rx=0 tx=0).stop 2024-09-10T22:43:38.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.226+0000 7f85e9a00640 1 -- 172.21.15.103:0/1051513279 reap_dead start 2024-09-10T22:43:38.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.226+0000 7f85eba00640 1 -- 172.21.15.103:0/1051513279 shutdown_connections 2024-09-10T22:43:38.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.226+0000 7f85eba00640 1 -- 172.21.15.103:0/1051513279 >> 172.21.15.103:0/1051513279 conn(0x7f85e40d1a20 msgr2=0x7f85e40d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:38.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.226+0000 7f85eba00640 1 -- 172.21.15.103:0/1051513279 shutdown_connections 2024-09-10T22:43:38.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.226+0000 7f85eba00640 1 -- 172.21.15.103:0/1051513279 wait complete. 2024-09-10T22:43:38.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.226+0000 7f85eba00640 1 Processor -- start 2024-09-10T22:43:38.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.226+0000 7f85eba00640 1 -- start start 2024-09-10T22:43:38.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85eba00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85cc004810 0x7f85e415e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:38.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85eba00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85e415d170 0x7f85e4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:38.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85eba00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85e40c8f60 0x7f85e40c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:38.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85eba00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f85e4164bb0 con 0x7f85e415d170 2024-09-10T22:43:38.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85eba00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f85e415f580 con 0x7f85e40c8f60 2024-09-10T22:43:38.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85eba00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f85e4164d30 con 0x7f85cc004810 2024-09-10T22:43:38.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85e3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85e415d170 0x7f85e4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:38.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85e3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85e415d170 0x7f85e4159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40178/0 (socket says 172.21.15.103:40178) 2024-09-10T22:43:38.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85e3e00640 1 -- 172.21.15.103:0/55127784 learned_addr learned my addr 172.21.15.103:0/55127784 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:38.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85e9000640 1 --2- 172.21.15.103:0/55127784 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85cc004810 0x7f85e415e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:38.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85e9a00640 1 --2- 172.21.15.103:0/55127784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85e40c8f60 0x7f85e40c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:38.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85e3e00640 1 -- 172.21.15.103:0/55127784 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85cc004810 msgr2=0x7f85e415e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:38.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85e3e00640 1 --2- 172.21.15.103:0/55127784 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85cc004810 0x7f85e415e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85e3e00640 1 -- 172.21.15.103:0/55127784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85e40c8f60 msgr2=0x7f85e40c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:38.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85e3e00640 1 --2- 172.21.15.103:0/55127784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85e40c8f60 0x7f85e40c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85e3e00640 1 -- 172.21.15.103:0/55127784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e40c4b90 con 0x7f85e415d170 2024-09-10T22:43:38.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85e3e00640 1 --2- 172.21.15.103:0/55127784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85e415d170 0x7f85e4159fa0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f85d001c9c0 tx=0x7f85d0006be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:38.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85e0c00640 1 -- 172.21.15.103:0/55127784 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d00060d0 con 0x7f85e415d170 2024-09-10T22:43:38.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85e0c00640 1 -- 172.21.15.103:0/55127784 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85d0003600 con 0x7f85e415d170 2024-09-10T22:43:38.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85e0c00640 1 -- 172.21.15.103:0/55127784 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d0003a10 con 0x7f85e415d170 2024-09-10T22:43:38.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85eba00640 1 -- 172.21.15.103:0/55127784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e40b5400 con 0x7f85e415d170 2024-09-10T22:43:38.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85eba00640 1 -- 172.21.15.103:0/55127784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e40b56a0 con 0x7f85e415d170 2024-09-10T22:43:38.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85eba00640 1 -- 172.21.15.103:0/55127784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85e40b5230 con 0x7f85e415d170 2024-09-10T22:43:38.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.230+0000 7f85e0c00640 1 -- 172.21.15.103:0/55127784 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f85d0003bb0 con 0x7f85e415d170 2024-09-10T22:43:38.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.234+0000 7f85e0c00640 1 --2- 172.21.15.103:0/55127784 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f85c4072610 0x7f85c4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:38.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.234+0000 7f85e0c00640 1 -- 172.21.15.103:0/55127784 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f85d012dc60 con 0x7f85e415d170 2024-09-10T22:43:38.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.234+0000 7f85e9000640 1 --2- 172.21.15.103:0/55127784 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f85c4072610 0x7f85c4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:38.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.234+0000 7f85e9000640 1 --2- 172.21.15.103:0/55127784 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f85c4072610 0x7f85c4074ad0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f85d8000c10 tx=0x7f85d800ab10 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:38.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.238+0000 7f85e0c00640 1 -- 172.21.15.103:0/55127784 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f85d0016cb0 con 0x7f85e415d170 2024-09-10T22:43:38.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.398+0000 7f85eba00640 1 -- 172.21.15.103:0/55127784 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f85e40ccdf0 con 0x7f85c4072610 2024-09-10T22:43:38.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.402+0000 7f85e0c00640 1 -- 172.21.15.103:0/55127784 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247353 (secure 0 0 0) 0x7f85e40ccdf0 con 0x7f85c4072610 2024-09-10T22:43:38.409 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:38.411 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:43:38.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.406+0000 7f85eba00640 1 -- 172.21.15.103:0/55127784 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f85c4072610 msgr2=0x7f85c4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:38.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.406+0000 7f85eba00640 1 --2- 172.21.15.103:0/55127784 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f85c4072610 0x7f85c4074ad0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f85d8000c10 tx=0x7f85d800ab10 comp rx=0 tx=0).stop 2024-09-10T22:43:38.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.406+0000 7f85eba00640 1 -- 172.21.15.103:0/55127784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85e415d170 msgr2=0x7f85e4159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:38.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.406+0000 7f85eba00640 1 --2- 172.21.15.103:0/55127784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85e415d170 0x7f85e4159fa0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f85d001c9c0 tx=0x7f85d0006be0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.406+0000 7f85eba00640 1 -- 172.21.15.103:0/55127784 shutdown_connections 2024-09-10T22:43:38.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.406+0000 7f85eba00640 1 --2- 172.21.15.103:0/55127784 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f85c4072610 0x7f85c4074ad0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.406+0000 7f85eba00640 1 --2- 172.21.15.103:0/55127784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85e40c8f60 0x7f85e40c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.406+0000 7f85eba00640 1 --2- 172.21.15.103:0/55127784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85e415d170 0x7f85e4159fa0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.406+0000 7f85eba00640 1 --2- 172.21.15.103:0/55127784 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85cc004810 0x7f85e415e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.406+0000 7f85eba00640 1 -- 172.21.15.103:0/55127784 >> 172.21.15.103:0/55127784 conn(0x7f85e40d1a20 msgr2=0x7f85e415abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:38.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.406+0000 7f85eba00640 1 -- 172.21.15.103:0/55127784 shutdown_connections 2024-09-10T22:43:38.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.406+0000 7f85eba00640 1 -- 172.21.15.103:0/55127784 wait complete. 2024-09-10T22:43:38.430 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-09-10T22:43:37.692567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249880,"kb_used_data":8680,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754724840,"statfs":{"total":773094113280,"available":772838236160,"internally_reserved":0,"allocated":8888320,"data_stored":4694195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.764481"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.951475+0000","last_change":"2024-09-10T22:43:32.951475+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.951475+0000","last_undegraded":"2024-09-10T22:43:32.951475+0000","last_fullsized":"2024-09-10T22:43:32.951475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947322+0000","last_change":"2024-09-10T22:43:32.947322+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947322+0000","last_undegraded":"2024-09-10T22:43:32.947322+0000","last_fullsized":"2024-09-10T22:43:32.947322+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985233+0000","last_change":"2024-09-10T22:43:33.973232+0000","last_active":"2024-09-10T22:43:34.985233+0000","last_peered":"2024-09-10T22:43:34.985233+0000","last_clean":"2024-09-10T22:43:34.985233+0000","last_became_active":"2024-09-10T22:43:33.972856+0000","last_became_peered":"2024-09-10T22:43:33.972856+0000","last_unstale":"2024-09-10T22:43:34.985233+0000","last_undegraded":"2024-09-10T22:43:34.985233+0000","last_fullsized":"2024-09-10T22:43:34.985233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:34.575975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.946226+0000","last_change":"2024-09-10T22:43:32.946226+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.946226+0000","last_undegraded":"2024-09-10T22:43:32.946226+0000","last_fullsized":"2024-09-10T22:43:32.946226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.953166+0000","last_change":"2024-09-10T22:43:32.953166+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.953166+0000","last_undegraded":"2024-09-10T22:43:32.953166+0000","last_fullsized":"2024-09-10T22:43:32.953166+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941315+0000","last_change":"2024-09-10T22:43:32.941315+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941315+0000","last_undegraded":"2024-09-10T22:43:32.941315+0000","last_fullsized":"2024-09-10T22:43:32.941315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948239+0000","last_change":"2024-09-10T22:43:32.948239+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948239+0000","last_undegraded":"2024-09-10T22:43:32.948239+0000","last_fullsized":"2024-09-10T22:43:32.948239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.954722+0000","last_change":"2024-09-10T22:43:32.954722+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.954722+0000","last_undegraded":"2024-09-10T22:43:32.954722+0000","last_fullsized":"2024-09-10T22:43:32.954722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941603+0000","last_change":"2024-09-10T22:43:32.941603+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941603+0000","last_undegraded":"2024-09-10T22:43:32.941603+0000","last_fullsized":"2024-09-10T22:43:32.941603+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945152+0000","last_change":"2024-09-10T22:43:32.945152+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945152+0000","last_undegraded":"2024-09-10T22:43:32.945152+0000","last_fullsized":"2024-09-10T22:43:32.945152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947411+0000","last_change":"2024-09-10T22:43:32.947411+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947411+0000","last_undegraded":"2024-09-10T22:43:32.947411+0000","last_fullsized":"2024-09-10T22:43:32.947411+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945801+0000","last_change":"2024-09-10T22:43:32.945801+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945801+0000","last_undegraded":"2024-09-10T22:43:32.945801+0000","last_fullsized":"2024-09-10T22:43:32.945801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.952726+0000","last_change":"2024-09-10T22:43:32.952726+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.952726+0000","last_undegraded":"2024-09-10T22:43:32.952726+0000","last_fullsized":"2024-09-10T22:43:32.952726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.940828+0000","last_change":"2024-09-10T22:43:32.940828+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.940828+0000","last_undegraded":"2024-09-10T22:43:32.940828+0000","last_fullsized":"2024-09-10T22:43:32.940828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945854+0000","last_change":"2024-09-10T22:43:32.945854+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945854+0000","last_undegraded":"2024-09-10T22:43:32.945854+0000","last_fullsized":"2024-09-10T22:43:32.945854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948406+0000","last_change":"2024-09-10T22:43:32.948406+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948406+0000","last_undegraded":"2024-09-10T22:43:32.948406+0000","last_fullsized":"2024-09-10T22:43:32.948406+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.949052+0000","last_change":"2024-09-10T22:43:32.949052+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.949052+0000","last_undegraded":"2024-09-10T22:43:32.949052+0000","last_fullsized":"2024-09-10T22:43:32.949052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985109+0000","last_change":"2024-09-10T22:43:33.969132+0000","last_active":"2024-09-10T22:43:34.985109+0000","last_peered":"2024-09-10T22:43:34.985109+0000","last_clean":"2024-09-10T22:43:34.985109+0000","last_became_active":"2024-09-10T22:43:33.966818+0000","last_became_peered":"2024-09-10T22:43:33.966818+0000","last_unstale":"2024-09-10T22:43:34.985109+0000","last_undegraded":"2024-09-10T22:43:34.985109+0000","last_fullsized":"2024-09-10T22:43:34.985109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:46.251681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941375+0000","last_change":"2024-09-10T22:43:32.941375+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941375+0000","last_undegraded":"2024-09-10T22:43:32.941375+0000","last_fullsized":"2024-09-10T22:43:32.941375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948950+0000","last_change":"2024-09-10T22:43:32.948950+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948950+0000","last_undegraded":"2024-09-10T22:43:32.948950+0000","last_fullsized":"2024-09-10T22:43:32.948950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.942523+0000","last_change":"2024-09-10T22:43:32.942523+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.942523+0000","last_undegraded":"2024-09-10T22:43:32.942523+0000","last_fullsized":"2024-09-10T22:43:32.942523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.956163+0000","last_change":"2024-09-10T22:43:32.956163+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.956163+0000","last_undegraded":"2024-09-10T22:43:32.956163+0000","last_fullsized":"2024-09-10T22:43:32.956163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941593+0000","last_change":"2024-09-10T22:43:32.941593+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941593+0000","last_undegraded":"2024-09-10T22:43:32.941593+0000","last_fullsized":"2024-09-10T22:43:32.941593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.946286+0000","last_change":"2024-09-10T22:43:32.946286+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.946286+0000","last_undegraded":"2024-09-10T22:43:32.946286+0000","last_fullsized":"2024-09-10T22:43:32.946286+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945893+0000","last_change":"2024-09-10T22:43:32.945893+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945893+0000","last_undegraded":"2024-09-10T22:43:32.945893+0000","last_fullsized":"2024-09-10T22:43:32.945893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.944646+0000","last_change":"2024-09-10T22:43:32.944646+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.944646+0000","last_undegraded":"2024-09-10T22:43:32.944646+0000","last_fullsized":"2024-09-10T22:43:32.944646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.952160+0000","last_change":"2024-09-10T22:43:32.952160+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.952160+0000","last_undegraded":"2024-09-10T22:43:32.952160+0000","last_fullsized":"2024-09-10T22:43:32.952160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948502+0000","last_change":"2024-09-10T22:43:32.948502+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948502+0000","last_undegraded":"2024-09-10T22:43:32.948502+0000","last_fullsized":"2024-09-10T22:43:32.948502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945870+0000","last_change":"2024-09-10T22:43:32.945870+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945870+0000","last_undegraded":"2024-09-10T22:43:32.945870+0000","last_fullsized":"2024-09-10T22:43:32.945870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948973+0000","last_change":"2024-09-10T22:43:32.948973+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948973+0000","last_undegraded":"2024-09-10T22:43:32.948973+0000","last_fullsized":"2024-09-10T22:43:32.948973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984879+0000","last_change":"2024-09-10T22:43:33.960463+0000","last_active":"2024-09-10T22:43:34.984879+0000","last_peered":"2024-09-10T22:43:34.984879+0000","last_clean":"2024-09-10T22:43:34.984879+0000","last_became_active":"2024-09-10T22:43:33.957699+0000","last_became_peered":"2024-09-10T22:43:33.957699+0000","last_unstale":"2024-09-10T22:43:34.984879+0000","last_undegraded":"2024-09-10T22:43:34.984879+0000","last_fullsized":"2024-09-10T22:43:34.984879+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:17.832049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947954+0000","last_change":"2024-09-10T22:43:32.947954+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947954+0000","last_undegraded":"2024-09-10T22:43:32.947954+0000","last_fullsized":"2024-09-10T22:43:32.947954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984549+0000","last_change":"2024-09-10T22:43:33.966343+0000","last_active":"2024-09-10T22:43:34.984549+0000","last_peered":"2024-09-10T22:43:34.984549+0000","last_clean":"2024-09-10T22:43:34.984549+0000","last_became_active":"2024-09-10T22:43:33.966077+0000","last_became_peered":"2024-09-10T22:43:33.966077+0000","last_unstale":"2024-09-10T22:43:34.984549+0000","last_undegraded":"2024-09-10T22:43:34.984549+0000","last_fullsized":"2024-09-10T22:43:34.984549+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:11.532561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.965154+0000","last_change":"2024-09-10T22:43:32.957567+0000","last_active":"2024-09-10T22:43:32.965154+0000","last_peered":"2024-09-10T22:43:32.965154+0000","last_clean":"2024-09-10T22:43:32.965154+0000","last_became_active":"2024-09-10T22:43:32.957316+0000","last_became_peered":"2024-09-10T22:43:32.957316+0000","last_unstale":"2024-09-10T22:43:32.965154+0000","last_undegraded":"2024-09-10T22:43:32.965154+0000","last_fullsized":"2024-09-10T22:43:32.965154+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:08.694787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.943839+0000","last_change":"2024-09-10T22:43:32.943839+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.943839+0000","last_undegraded":"2024-09-10T22:43:32.943839+0000","last_fullsized":"2024-09-10T22:43:32.943839+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964327+0000","last_change":"2024-09-10T22:43:32.962321+0000","last_active":"2024-09-10T22:43:32.964327+0000","last_peered":"2024-09-10T22:43:32.964327+0000","last_clean":"2024-09-10T22:43:32.964327+0000","last_became_active":"2024-09-10T22:43:32.961642+0000","last_became_peered":"2024-09-10T22:43:32.961642+0000","last_unstale":"2024-09-10T22:43:32.964327+0000","last_undegraded":"2024-09-10T22:43:32.964327+0000","last_fullsized":"2024-09-10T22:43:32.964327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:54.835911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.942392+0000","last_change":"2024-09-10T22:43:32.942392+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.942392+0000","last_undegraded":"2024-09-10T22:43:32.942392+0000","last_fullsized":"2024-09-10T22:43:32.942392+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.971260+0000","last_change":"2024-09-10T22:43:32.964868+0000","last_active":"2024-09-10T22:43:32.971260+0000","last_peered":"2024-09-10T22:43:32.971260+0000","last_clean":"2024-09-10T22:43:32.971260+0000","last_became_active":"2024-09-10T22:43:32.964629+0000","last_became_peered":"2024-09-10T22:43:32.964629+0000","last_unstale":"2024-09-10T22:43:32.971260+0000","last_undegraded":"2024-09-10T22:43:32.971260+0000","last_fullsized":"2024-09-10T22:43:32.971260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:11.767542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941614+0000","last_change":"2024-09-10T22:43:32.941614+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941614+0000","last_undegraded":"2024-09-10T22:43:32.941614+0000","last_fullsized":"2024-09-10T22:43:32.941614+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.961669+0000","last_change":"2024-09-10T22:43:32.957956+0000","last_active":"2024-09-10T22:43:32.961669+0000","last_peered":"2024-09-10T22:43:32.961669+0000","last_clean":"2024-09-10T22:43:32.961669+0000","last_became_active":"2024-09-10T22:43:32.957370+0000","last_became_peered":"2024-09-10T22:43:32.957370+0000","last_unstale":"2024-09-10T22:43:32.961669+0000","last_undegraded":"2024-09-10T22:43:32.961669+0000","last_fullsized":"2024-09-10T22:43:32.961669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:13.681326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.944400+0000","last_change":"2024-09-10T22:43:32.944400+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.944400+0000","last_undegraded":"2024-09-10T22:43:32.944400+0000","last_fullsized":"2024-09-10T22:43:32.944400+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964022+0000","last_change":"2024-09-10T22:43:32.958500+0000","last_active":"2024-09-10T22:43:32.964022+0000","last_peered":"2024-09-10T22:43:32.964022+0000","last_clean":"2024-09-10T22:43:32.964022+0000","last_became_active":"2024-09-10T22:43:32.957266+0000","last_became_peered":"2024-09-10T22:43:32.957266+0000","last_unstale":"2024-09-10T22:43:32.964022+0000","last_undegraded":"2024-09-10T22:43:32.964022+0000","last_fullsized":"2024-09-10T22:43:32.964022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:02.384231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945488+0000","last_change":"2024-09-10T22:43:32.945488+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945488+0000","last_undegraded":"2024-09-10T22:43:32.945488+0000","last_fullsized":"2024-09-10T22:43:32.945488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.958460+0000","last_change":"2024-09-10T22:43:32.954519+0000","last_active":"2024-09-10T22:43:32.958460+0000","last_peered":"2024-09-10T22:43:32.958460+0000","last_clean":"2024-09-10T22:43:32.958460+0000","last_became_active":"2024-09-10T22:43:32.954235+0000","last_became_peered":"2024-09-10T22:43:32.954235+0000","last_unstale":"2024-09-10T22:43:32.958460+0000","last_undegraded":"2024-09-10T22:43:32.958460+0000","last_fullsized":"2024-09-10T22:43:32.958460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:29.999024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941897+0000","last_change":"2024-09-10T22:43:32.941897+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941897+0000","last_undegraded":"2024-09-10T22:43:32.941897+0000","last_fullsized":"2024-09-10T22:43:32.941897+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.962716+0000","last_change":"2024-09-10T22:43:32.953990+0000","last_active":"2024-09-10T22:43:32.962716+0000","last_peered":"2024-09-10T22:43:32.962716+0000","last_clean":"2024-09-10T22:43:32.962716+0000","last_became_active":"2024-09-10T22:43:32.953759+0000","last_became_peered":"2024-09-10T22:43:32.953759+0000","last_unstale":"2024-09-10T22:43:32.962716+0000","last_undegraded":"2024-09-10T22:43:32.962716+0000","last_fullsized":"2024-09-10T22:43:32.962716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:31.925280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948623+0000","last_change":"2024-09-10T22:43:32.948623+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948623+0000","last_undegraded":"2024-09-10T22:43:32.948623+0000","last_fullsized":"2024-09-10T22:43:32.948623+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.971105+0000","last_change":"2024-09-10T22:43:32.966902+0000","last_active":"2024-09-10T22:43:32.971105+0000","last_peered":"2024-09-10T22:43:32.971105+0000","last_clean":"2024-09-10T22:43:32.971105+0000","last_became_active":"2024-09-10T22:43:32.966674+0000","last_became_peered":"2024-09-10T22:43:32.966674+0000","last_unstale":"2024-09-10T22:43:32.971105+0000","last_undegraded":"2024-09-10T22:43:32.971105+0000","last_fullsized":"2024-09-10T22:43:32.971105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:05.242861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.944324+0000","last_change":"2024-09-10T22:43:32.944324+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.944324+0000","last_undegraded":"2024-09-10T22:43:32.944324+0000","last_fullsized":"2024-09-10T22:43:32.944324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964304+0000","last_change":"2024-09-10T22:43:32.960867+0000","last_active":"2024-09-10T22:43:32.964304+0000","last_peered":"2024-09-10T22:43:32.964304+0000","last_clean":"2024-09-10T22:43:32.964304+0000","last_became_active":"2024-09-10T22:43:32.960572+0000","last_became_peered":"2024-09-10T22:43:32.960572+0000","last_unstale":"2024-09-10T22:43:32.964304+0000","last_undegraded":"2024-09-10T22:43:32.964304+0000","last_fullsized":"2024-09-10T22:43:32.964304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:29.999024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.944516+0000","last_change":"2024-09-10T22:43:32.944516+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.944516+0000","last_undegraded":"2024-09-10T22:43:32.944516+0000","last_fullsized":"2024-09-10T22:43:32.944516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.959985+0000","last_change":"2024-09-10T22:43:32.956895+0000","last_active":"2024-09-10T22:43:32.959985+0000","last_peered":"2024-09-10T22:43:32.959985+0000","last_clean":"2024-09-10T22:43:32.959985+0000","last_became_active":"2024-09-10T22:43:32.956558+0000","last_became_peered":"2024-09-10T22:43:32.956558+0000","last_unstale":"2024-09-10T22:43:32.959985+0000","last_undegraded":"2024-09-10T22:43:32.959985+0000","last_fullsized":"2024-09-10T22:43:32.959985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:54.835911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.940234+0000","last_change":"2024-09-10T22:43:32.940234+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.940234+0000","last_undegraded":"2024-09-10T22:43:32.940234+0000","last_fullsized":"2024-09-10T22:43:32.940234+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.969693+0000","last_change":"2024-09-10T22:43:32.966412+0000","last_active":"2024-09-10T22:43:32.969693+0000","last_peered":"2024-09-10T22:43:32.969693+0000","last_clean":"2024-09-10T22:43:32.969693+0000","last_became_active":"2024-09-10T22:43:32.966135+0000","last_became_peered":"2024-09-10T22:43:32.966135+0000","last_unstale":"2024-09-10T22:43:32.969693+0000","last_undegraded":"2024-09-10T22:43:32.969693+0000","last_fullsized":"2024-09-10T22:43:32.969693+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:44.606825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984806+0000","last_change":"2024-09-10T22:43:33.970411+0000","last_active":"2024-09-10T22:43:34.984806+0000","last_peered":"2024-09-10T22:43:34.984806+0000","last_clean":"2024-09-10T22:43:34.984806+0000","last_became_active":"2024-09-10T22:43:33.969898+0000","last_became_peered":"2024-09-10T22:43:33.969898+0000","last_unstale":"2024-09-10T22:43:34.984806+0000","last_undegraded":"2024-09-10T22:43:34.984806+0000","last_fullsized":"2024-09-10T22:43:34.984806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:52.448989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.961695+0000","last_change":"2024-09-10T22:43:32.958074+0000","last_active":"2024-09-10T22:43:32.961695+0000","last_peered":"2024-09-10T22:43:32.961695+0000","last_clean":"2024-09-10T22:43:32.961695+0000","last_became_active":"2024-09-10T22:43:32.957692+0000","last_became_peered":"2024-09-10T22:43:32.957692+0000","last_unstale":"2024-09-10T22:43:32.961695+0000","last_undegraded":"2024-09-10T22:43:32.961695+0000","last_fullsized":"2024-09-10T22:43:32.961695+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:21:46.363669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945092+0000","last_change":"2024-09-10T22:43:32.945092+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945092+0000","last_undegraded":"2024-09-10T22:43:32.945092+0000","last_fullsized":"2024-09-10T22:43:32.945092+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.958387+0000","last_change":"2024-09-10T22:43:32.953419+0000","last_active":"2024-09-10T22:43:32.958387+0000","last_peered":"2024-09-10T22:43:32.958387+0000","last_clean":"2024-09-10T22:43:32.958387+0000","last_became_active":"2024-09-10T22:43:32.953109+0000","last_became_peered":"2024-09-10T22:43:32.953109+0000","last_unstale":"2024-09-10T22:43:32.958387+0000","last_undegraded":"2024-09-10T22:43:32.958387+0000","last_fullsized":"2024-09-10T22:43:32.958387+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:53.675442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947164+0000","last_change":"2024-09-10T22:43:32.947164+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947164+0000","last_undegraded":"2024-09-10T22:43:32.947164+0000","last_fullsized":"2024-09-10T22:43:32.947164+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.971773+0000","last_change":"2024-09-10T22:43:32.968272+0000","last_active":"2024-09-10T22:43:32.971773+0000","last_peered":"2024-09-10T22:43:32.971773+0000","last_clean":"2024-09-10T22:43:32.971773+0000","last_became_active":"2024-09-10T22:43:32.967987+0000","last_became_peered":"2024-09-10T22:43:32.967987+0000","last_unstale":"2024-09-10T22:43:32.971773+0000","last_undegraded":"2024-09-10T22:43:32.971773+0000","last_fullsized":"2024-09-10T22:43:32.971773+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:10:05.503295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947167+0000","last_change":"2024-09-10T22:43:32.947167+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947167+0000","last_undegraded":"2024-09-10T22:43:32.947167+0000","last_fullsized":"2024-09-10T22:43:32.947167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.969684+0000","last_change":"2024-09-10T22:43:32.964152+0000","last_active":"2024-09-10T22:43:32.969684+0000","last_peered":"2024-09-10T22:43:32.969684+0000","last_clean":"2024-09-10T22:43:32.969684+0000","last_became_active":"2024-09-10T22:43:32.963908+0000","last_became_peered":"2024-09-10T22:43:32.963908+0000","last_unstale":"2024-09-10T22:43:32.969684+0000","last_undegraded":"2024-09-10T22:43:32.969684+0000","last_fullsized":"2024-09-10T22:43:32.969684+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:27.359912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948148+0000","last_change":"2024-09-10T22:43:32.948148+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948148+0000","last_undegraded":"2024-09-10T22:43:32.948148+0000","last_fullsized":"2024-09-10T22:43:32.948148+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964536+0000","last_change":"2024-09-10T22:43:32.957309+0000","last_active":"2024-09-10T22:43:32.964536+0000","last_peered":"2024-09-10T22:43:32.964536+0000","last_clean":"2024-09-10T22:43:32.964536+0000","last_became_active":"2024-09-10T22:43:32.956954+0000","last_became_peered":"2024-09-10T22:43:32.956954+0000","last_unstale":"2024-09-10T22:43:32.964536+0000","last_undegraded":"2024-09-10T22:43:32.964536+0000","last_fullsized":"2024-09-10T22:43:32.964536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:17.047894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.940872+0000","last_change":"2024-09-10T22:43:32.940872+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.940872+0000","last_undegraded":"2024-09-10T22:43:32.940872+0000","last_fullsized":"2024-09-10T22:43:32.940872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.971745+0000","last_change":"2024-09-10T22:43:32.967130+0000","last_active":"2024-09-10T22:43:32.971745+0000","last_peered":"2024-09-10T22:43:32.971745+0000","last_clean":"2024-09-10T22:43:32.971745+0000","last_became_active":"2024-09-10T22:43:32.966886+0000","last_became_peered":"2024-09-10T22:43:32.966886+0000","last_unstale":"2024-09-10T22:43:32.971745+0000","last_undegraded":"2024-09-10T22:43:32.971745+0000","last_fullsized":"2024-09-10T22:43:32.971745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:13:26.884998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.956136+0000","last_change":"2024-09-10T22:43:32.956136+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.956136+0000","last_undegraded":"2024-09-10T22:43:32.956136+0000","last_fullsized":"2024-09-10T22:43:32.956136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.968847+0000","last_change":"2024-09-10T22:43:32.963980+0000","last_active":"2024-09-10T22:43:32.968847+0000","last_peered":"2024-09-10T22:43:32.968847+0000","last_clean":"2024-09-10T22:43:32.968847+0000","last_became_active":"2024-09-10T22:43:32.962919+0000","last_became_peered":"2024-09-10T22:43:32.962919+0000","last_unstale":"2024-09-10T22:43:32.968847+0000","last_undegraded":"2024-09-10T22:43:32.968847+0000","last_fullsized":"2024-09-10T22:43:32.968847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:17.002563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.956625+0000","last_change":"2024-09-10T22:43:32.956625+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.956625+0000","last_undegraded":"2024-09-10T22:43:32.956625+0000","last_fullsized":"2024-09-10T22:43:32.956625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.965287+0000","last_change":"2024-09-10T22:43:32.960405+0000","last_active":"2024-09-10T22:43:32.965287+0000","last_peered":"2024-09-10T22:43:32.965287+0000","last_clean":"2024-09-10T22:43:32.965287+0000","last_became_active":"2024-09-10T22:43:32.958442+0000","last_became_peered":"2024-09-10T22:43:32.958442+0000","last_unstale":"2024-09-10T22:43:32.965287+0000","last_undegraded":"2024-09-10T22:43:32.965287+0000","last_fullsized":"2024-09-10T22:43:32.965287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:14.818760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941442+0000","last_change":"2024-09-10T22:43:32.941442+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941442+0000","last_undegraded":"2024-09-10T22:43:32.941442+0000","last_fullsized":"2024-09-10T22:43:32.941442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984708+0000","last_change":"2024-09-10T22:43:32.964908+0000","last_active":"2024-09-10T22:43:34.984708+0000","last_peered":"2024-09-10T22:43:34.984708+0000","last_clean":"2024-09-10T22:43:34.984708+0000","last_became_active":"2024-09-10T22:43:32.964611+0000","last_became_peered":"2024-09-10T22:43:32.964611+0000","last_unstale":"2024-09-10T22:43:34.984708+0000","last_undegraded":"2024-09-10T22:43:34.984708+0000","last_fullsized":"2024-09-10T22:43:34.984708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:02.693878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.943946+0000","last_change":"2024-09-10T22:43:32.943946+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.943946+0000","last_undegraded":"2024-09-10T22:43:32.943946+0000","last_fullsized":"2024-09-10T22:43:32.943946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.967678+0000","last_change":"2024-09-10T22:43:32.961790+0000","last_active":"2024-09-10T22:43:32.967678+0000","last_peered":"2024-09-10T22:43:32.967678+0000","last_clean":"2024-09-10T22:43:32.967678+0000","last_became_active":"2024-09-10T22:43:32.961323+0000","last_became_peered":"2024-09-10T22:43:32.961323+0000","last_unstale":"2024-09-10T22:43:32.967678+0000","last_undegraded":"2024-09-10T22:43:32.967678+0000","last_fullsized":"2024-09-10T22:43:32.967678+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:15.339385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.943860+0000","last_change":"2024-09-10T22:43:32.943860+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.943860+0000","last_undegraded":"2024-09-10T22:43:32.943860+0000","last_fullsized":"2024-09-10T22:43:32.943860+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.967675+0000","last_change":"2024-09-10T22:43:32.960678+0000","last_active":"2024-09-10T22:43:32.967675+0000","last_peered":"2024-09-10T22:43:32.967675+0000","last_clean":"2024-09-10T22:43:32.967675+0000","last_became_active":"2024-09-10T22:43:32.959289+0000","last_became_peered":"2024-09-10T22:43:32.959289+0000","last_unstale":"2024-09-10T22:43:32.967675+0000","last_undegraded":"2024-09-10T22:43:32.967675+0000","last_fullsized":"2024-09-10T22:43:32.967675+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:56.905762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947725+0000","last_change":"2024-09-10T22:43:32.947725+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947725+0000","last_undegraded":"2024-09-10T22:43:32.947725+0000","last_fullsized":"2024-09-10T22:43:32.947725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964622+0000","last_change":"2024-09-10T22:43:32.958892+0000","last_active":"2024-09-10T22:43:32.964622+0000","last_peered":"2024-09-10T22:43:32.964622+0000","last_clean":"2024-09-10T22:43:32.964622+0000","last_became_active":"2024-09-10T22:43:32.957384+0000","last_became_peered":"2024-09-10T22:43:32.957384+0000","last_unstale":"2024-09-10T22:43:32.964622+0000","last_undegraded":"2024-09-10T22:43:32.964622+0000","last_fullsized":"2024-09-10T22:43:32.964622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:54.693425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941617+0000","last_change":"2024-09-10T22:43:32.941617+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941617+0000","last_undegraded":"2024-09-10T22:43:32.941617+0000","last_fullsized":"2024-09-10T22:43:32.941617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.966361+0000","last_change":"2024-09-10T22:43:32.962599+0000","last_active":"2024-09-10T22:43:32.966361+0000","last_peered":"2024-09-10T22:43:32.966361+0000","last_clean":"2024-09-10T22:43:32.966361+0000","last_became_active":"2024-09-10T22:43:32.962196+0000","last_became_peered":"2024-09-10T22:43:32.962196+0000","last_unstale":"2024-09-10T22:43:32.966361+0000","last_undegraded":"2024-09-10T22:43:32.966361+0000","last_fullsized":"2024-09-10T22:43:32.966361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:21.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947694+0000","last_change":"2024-09-10T22:43:32.947694+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947694+0000","last_undegraded":"2024-09-10T22:43:32.947694+0000","last_fullsized":"2024-09-10T22:43:32.947694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.959386+0000","last_change":"2024-09-10T22:43:32.953544+0000","last_active":"2024-09-10T22:43:32.959386+0000","last_peered":"2024-09-10T22:43:32.959386+0000","last_clean":"2024-09-10T22:43:32.959386+0000","last_became_active":"2024-09-10T22:43:32.951997+0000","last_became_peered":"2024-09-10T22:43:32.951997+0000","last_unstale":"2024-09-10T22:43:32.959386+0000","last_undegraded":"2024-09-10T22:43:32.959386+0000","last_fullsized":"2024-09-10T22:43:32.959386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:09.778155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941761+0000","last_change":"2024-09-10T22:43:32.941761+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941761+0000","last_undegraded":"2024-09-10T22:43:32.941761+0000","last_fullsized":"2024-09-10T22:43:32.941761+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.966445+0000","last_change":"2024-09-10T22:43:32.962093+0000","last_active":"2024-09-10T22:43:32.966445+0000","last_peered":"2024-09-10T22:43:32.966445+0000","last_clean":"2024-09-10T22:43:32.966445+0000","last_became_active":"2024-09-10T22:43:32.961715+0000","last_became_peered":"2024-09-10T22:43:32.961715+0000","last_unstale":"2024-09-10T22:43:32.966445+0000","last_undegraded":"2024-09-10T22:43:32.966445+0000","last_fullsized":"2024-09-10T22:43:32.966445+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:21.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.943830+0000","last_change":"2024-09-10T22:43:32.943830+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.943830+0000","last_undegraded":"2024-09-10T22:43:32.943830+0000","last_fullsized":"2024-09-10T22:43:32.943830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.963636+0000","last_change":"2024-09-10T22:43:32.960870+0000","last_active":"2024-09-10T22:43:32.963636+0000","last_peered":"2024-09-10T22:43:32.963636+0000","last_clean":"2024-09-10T22:43:32.963636+0000","last_became_active":"2024-09-10T22:43:32.960525+0000","last_became_peered":"2024-09-10T22:43:32.960525+0000","last_unstale":"2024-09-10T22:43:32.963636+0000","last_undegraded":"2024-09-10T22:43:32.963636+0000","last_fullsized":"2024-09-10T22:43:32.963636+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:53.675442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.946720+0000","last_change":"2024-09-10T22:43:32.946720+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.946720+0000","last_undegraded":"2024-09-10T22:43:32.946720+0000","last_fullsized":"2024-09-10T22:43:32.946720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.961451+0000","last_change":"2024-09-10T22:43:32.957617+0000","last_active":"2024-09-10T22:43:32.961451+0000","last_peered":"2024-09-10T22:43:32.961451+0000","last_clean":"2024-09-10T22:43:32.961451+0000","last_became_active":"2024-09-10T22:43:32.957258+0000","last_became_peered":"2024-09-10T22:43:32.957258+0000","last_unstale":"2024-09-10T22:43:32.961451+0000","last_undegraded":"2024-09-10T22:43:32.961451+0000","last_fullsized":"2024-09-10T22:43:32.961451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:56.607363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.946666+0000","last_change":"2024-09-10T22:43:32.946666+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.946666+0000","last_undegraded":"2024-09-10T22:43:32.946666+0000","last_fullsized":"2024-09-10T22:43:32.946666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.967276+0000","last_change":"2024-09-10T22:43:32.963621+0000","last_active":"2024-09-10T22:43:32.967276+0000","last_peered":"2024-09-10T22:43:32.967276+0000","last_clean":"2024-09-10T22:43:32.967276+0000","last_became_active":"2024-09-10T22:43:32.962527+0000","last_became_peered":"2024-09-10T22:43:32.962527+0000","last_unstale":"2024-09-10T22:43:32.967276+0000","last_undegraded":"2024-09-10T22:43:32.967276+0000","last_fullsized":"2024-09-10T22:43:32.967276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:44.356842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985281+0000","last_change":"2024-09-10T22:43:33.973798+0000","last_active":"2024-09-10T22:43:34.985281+0000","last_peered":"2024-09-10T22:43:34.985281+0000","last_clean":"2024-09-10T22:43:34.985281+0000","last_became_active":"2024-09-10T22:43:33.973289+0000","last_became_peered":"2024-09-10T22:43:33.973289+0000","last_unstale":"2024-09-10T22:43:34.985281+0000","last_undegraded":"2024-09-10T22:43:34.985281+0000","last_fullsized":"2024-09-10T22:43:34.985281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:55.398034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.961857+0000","last_change":"2024-09-10T22:43:32.958396+0000","last_active":"2024-09-10T22:43:32.961857+0000","last_peered":"2024-09-10T22:43:32.961857+0000","last_clean":"2024-09-10T22:43:32.961857+0000","last_became_active":"2024-09-10T22:43:32.957943+0000","last_became_peered":"2024-09-10T22:43:32.957943+0000","last_unstale":"2024-09-10T22:43:32.961857+0000","last_undegraded":"2024-09-10T22:43:32.961857+0000","last_fullsized":"2024-09-10T22:43:32.961857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:34.240762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985487+0000","last_change":"2024-09-10T22:43:33.963110+0000","last_active":"2024-09-10T22:43:34.985487+0000","last_peered":"2024-09-10T22:43:34.985487+0000","last_clean":"2024-09-10T22:43:34.985487+0000","last_became_active":"2024-09-10T22:43:33.962823+0000","last_became_peered":"2024-09-10T22:43:33.962823+0000","last_unstale":"2024-09-10T22:43:34.985487+0000","last_undegraded":"2024-09-10T22:43:34.985487+0000","last_fullsized":"2024-09-10T22:43:34.985487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:43.287722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984617+0000","last_change":"2024-09-10T22:43:32.962997+0000","last_active":"2024-09-10T22:43:34.984617+0000","last_peered":"2024-09-10T22:43:34.984617+0000","last_clean":"2024-09-10T22:43:34.984617+0000","last_became_active":"2024-09-10T22:43:32.961399+0000","last_became_peered":"2024-09-10T22:43:32.961399+0000","last_unstale":"2024-09-10T22:43:34.984617+0000","last_undegraded":"2024-09-10T22:43:34.984617+0000","last_fullsized":"2024-09-10T22:43:34.984617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:56.079546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.951693+0000","last_change":"2024-09-10T22:43:32.951693+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.951693+0000","last_undegraded":"2024-09-10T22:43:32.951693+0000","last_fullsized":"2024-09-10T22:43:32.951693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.967563+0000","last_change":"2024-09-10T22:43:32.959873+0000","last_active":"2024-09-10T22:43:32.967563+0000","last_peered":"2024-09-10T22:43:32.967563+0000","last_clean":"2024-09-10T22:43:32.967563+0000","last_became_active":"2024-09-10T22:43:32.959583+0000","last_became_peered":"2024-09-10T22:43:32.959583+0000","last_unstale":"2024-09-10T22:43:32.967563+0000","last_undegraded":"2024-09-10T22:43:32.967563+0000","last_fullsized":"2024-09-10T22:43:32.967563+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:57.043203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":218,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.952078+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:43:32.952078+0000","last_peered":"2024-09-10T22:43:32.952078+0000","last_clean":"2024-09-10T22:43:32.952078+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:43:32.952078+0000","last_undegraded":"2024-09-10T22:43:32.952078+0000","last_fullsized":"2024-09-10T22:43:32.952078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509502,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1552384,"data_stored":1027804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509502,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509503,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509502,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509502,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1552384,"data_stored":1027804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":991232,"data_stored":451407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:43:38.434 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:43:38.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.610+0000 7f24e7200640 1 -- 172.21.15.103:0/442150470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24e8161430 msgr2=0x7f24e80d1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:38.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.610+0000 7f24e7200640 1 --2- 172.21.15.103:0/442150470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24e8161430 0x7f24e80d1310 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f24d8009840 tx=0x7f24d801c760 comp rx=0 tx=0).stop 2024-09-10T22:43:38.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.610+0000 7f24e7200640 1 -- 172.21.15.103:0/442150470 shutdown_connections 2024-09-10T22:43:38.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.610+0000 7f24e7200640 1 --2- 172.21.15.103:0/442150470 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24e80cfee0 0x7f24e80ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.610+0000 7f24e7200640 1 --2- 172.21.15.103:0/442150470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24e8161430 0x7f24e80d1310 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.610+0000 7f24e7200640 1 -- 172.21.15.103:0/442150470 >> 172.21.15.103:0/442150470 conn(0x7f24e80d18d0 msgr2=0x7f24e80d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:38.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.610+0000 7f24e7200640 1 -- 172.21.15.103:0/442150470 shutdown_connections 2024-09-10T22:43:38.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.610+0000 7f24e7200640 1 -- 172.21.15.103:0/442150470 wait complete. 2024-09-10T22:43:38.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.610+0000 7f24e7200640 1 Processor -- start 2024-09-10T22:43:38.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.610+0000 7f24e7200640 1 -- start start 2024-09-10T22:43:38.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.610+0000 7f24e7200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24e80cfee0 0x7f24e81554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:38.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.610+0000 7f24e7200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24e80d0a00 0x7f24e814cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:38.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.610+0000 7f24e7200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24e8161430 0x7f24e815ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:38.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.610+0000 7f24e7200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f24e816aaa0 con 0x7f24e80cfee0 2024-09-10T22:43:38.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.610+0000 7f24e7200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f24e80af580 con 0x7f24e80d0a00 2024-09-10T22:43:38.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.610+0000 7f24e7200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f24e816ac20 con 0x7f24e8161430 2024-09-10T22:43:38.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.610+0000 7f24e5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24e80cfee0 0x7f24e81554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:38.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.610+0000 7f24e5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24e80cfee0 0x7f24e81554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40198/0 (socket says 172.21.15.103:40198) 2024-09-10T22:43:38.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.614+0000 7f24e5e00640 1 -- 172.21.15.103:0/3933813656 learned_addr learned my addr 172.21.15.103:0/3933813656 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:38.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.614+0000 7f24e6800640 1 --2- 172.21.15.103:0/3933813656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24e8161430 0x7f24e815ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:38.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.614+0000 7f24dd400640 1 --2- 172.21.15.103:0/3933813656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24e80d0a00 0x7f24e814cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:38.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.614+0000 7f24e5e00640 1 -- 172.21.15.103:0/3933813656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24e8161430 msgr2=0x7f24e815ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:38.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.614+0000 7f24e5e00640 1 --2- 172.21.15.103:0/3933813656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24e8161430 0x7f24e815ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.614+0000 7f24e5e00640 1 -- 172.21.15.103:0/3933813656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24e80d0a00 msgr2=0x7f24e814cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:38.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.614+0000 7f24e5e00640 1 --2- 172.21.15.103:0/3933813656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24e80d0a00 0x7f24e814cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.614+0000 7f24e5e00640 1 -- 172.21.15.103:0/3933813656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e815bc80 con 0x7f24e80cfee0 2024-09-10T22:43:38.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.614+0000 7f24e5e00640 1 --2- 172.21.15.103:0/3933813656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24e80cfee0 0x7f24e81554c0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f24d8009790 tx=0x7f24d8005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:38.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.614+0000 7f24dea00640 1 -- 172.21.15.103:0/3933813656 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d80b2040 con 0x7f24e80cfee0 2024-09-10T22:43:38.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.614+0000 7f24dea00640 1 -- 172.21.15.103:0/3933813656 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24d8004330 con 0x7f24e80cfee0 2024-09-10T22:43:38.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.614+0000 7f24dea00640 1 -- 172.21.15.103:0/3933813656 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d8003800 con 0x7f24e80cfee0 2024-09-10T22:43:38.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.614+0000 7f24e7200640 1 -- 172.21.15.103:0/3933813656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e815bf60 con 0x7f24e80cfee0 2024-09-10T22:43:38.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.614+0000 7f24e7200640 1 -- 172.21.15.103:0/3933813656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e8154cc0 con 0x7f24e80cfee0 2024-09-10T22:43:38.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.614+0000 7f24e7200640 1 -- 172.21.15.103:0/3933813656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e80ae620 con 0x7f24e80cfee0 2024-09-10T22:43:38.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.614+0000 7f24dea00640 1 -- 172.21.15.103:0/3933813656 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f24d80b5070 con 0x7f24e80cfee0 2024-09-10T22:43:38.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.614+0000 7f24dea00640 1 --2- 172.21.15.103:0/3933813656 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f24c40725e0 0x7f24c4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:38.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.618+0000 7f24dea00640 1 -- 172.21.15.103:0/3933813656 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f24d812c8a0 con 0x7f24e80cfee0 2024-09-10T22:43:38.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.618+0000 7f24dd400640 1 --2- 172.21.15.103:0/3933813656 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f24c40725e0 0x7f24c4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:38.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.618+0000 7f24dd400640 1 --2- 172.21.15.103:0/3933813656 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f24c40725e0 0x7f24c4074aa0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f24e81fa4c0 tx=0x7f24d0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:38.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.618+0000 7f24dea00640 1 -- 172.21.15.103:0/3933813656 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f24d8016410 con 0x7f24e80cfee0 2024-09-10T22:43:38.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.786+0000 7f24e7200640 1 -- 172.21.15.103:0/3933813656 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f24e815fde0 con 0x7f24c40725e0 2024-09-10T22:43:38.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.790+0000 7f24dea00640 1 -- 172.21.15.103:0/3933813656 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247353 (secure 0 0 0) 0x7f24e815fde0 con 0x7f24c40725e0 2024-09-10T22:43:38.796 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:38.797 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:43:38.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.794+0000 7f24e7200640 1 -- 172.21.15.103:0/3933813656 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f24c40725e0 msgr2=0x7f24c4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:38.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.794+0000 7f24e7200640 1 --2- 172.21.15.103:0/3933813656 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f24c40725e0 0x7f24c4074aa0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f24e81fa4c0 tx=0x7f24d0009040 comp rx=0 tx=0).stop 2024-09-10T22:43:38.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.794+0000 7f24e7200640 1 -- 172.21.15.103:0/3933813656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24e80cfee0 msgr2=0x7f24e81554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:38.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.794+0000 7f24e7200640 1 --2- 172.21.15.103:0/3933813656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24e80cfee0 0x7f24e81554c0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f24d8009790 tx=0x7f24d8005db0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.794+0000 7f24e7200640 1 -- 172.21.15.103:0/3933813656 shutdown_connections 2024-09-10T22:43:38.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.794+0000 7f24e7200640 1 --2- 172.21.15.103:0/3933813656 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f24c40725e0 0x7f24c4074aa0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.794+0000 7f24e7200640 1 --2- 172.21.15.103:0/3933813656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24e8161430 0x7f24e815ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.794+0000 7f24e7200640 1 --2- 172.21.15.103:0/3933813656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24e80d0a00 0x7f24e814cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.794+0000 7f24e7200640 1 --2- 172.21.15.103:0/3933813656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24e80cfee0 0x7f24e81554c0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:38.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.794+0000 7f24e7200640 1 -- 172.21.15.103:0/3933813656 >> 172.21.15.103:0/3933813656 conn(0x7f24e80d18d0 msgr2=0x7f24e80709b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:38.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.794+0000 7f24e7200640 1 -- 172.21.15.103:0/3933813656 shutdown_connections 2024-09-10T22:43:38.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:38.794+0000 7f24e7200640 1 -- 172.21.15.103:0/3933813656 wait complete. 2024-09-10T22:43:38.816 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-09-10T22:43:37.692567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249880,"kb_used_data":8680,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754724840,"statfs":{"total":773094113280,"available":772838236160,"internally_reserved":0,"allocated":8888320,"data_stored":4694195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.764481"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.951475+0000","last_change":"2024-09-10T22:43:32.951475+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.951475+0000","last_undegraded":"2024-09-10T22:43:32.951475+0000","last_fullsized":"2024-09-10T22:43:32.951475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947322+0000","last_change":"2024-09-10T22:43:32.947322+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947322+0000","last_undegraded":"2024-09-10T22:43:32.947322+0000","last_fullsized":"2024-09-10T22:43:32.947322+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985233+0000","last_change":"2024-09-10T22:43:33.973232+0000","last_active":"2024-09-10T22:43:34.985233+0000","last_peered":"2024-09-10T22:43:34.985233+0000","last_clean":"2024-09-10T22:43:34.985233+0000","last_became_active":"2024-09-10T22:43:33.972856+0000","last_became_peered":"2024-09-10T22:43:33.972856+0000","last_unstale":"2024-09-10T22:43:34.985233+0000","last_undegraded":"2024-09-10T22:43:34.985233+0000","last_fullsized":"2024-09-10T22:43:34.985233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:34.575975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.946226+0000","last_change":"2024-09-10T22:43:32.946226+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.946226+0000","last_undegraded":"2024-09-10T22:43:32.946226+0000","last_fullsized":"2024-09-10T22:43:32.946226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.953166+0000","last_change":"2024-09-10T22:43:32.953166+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.953166+0000","last_undegraded":"2024-09-10T22:43:32.953166+0000","last_fullsized":"2024-09-10T22:43:32.953166+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941315+0000","last_change":"2024-09-10T22:43:32.941315+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941315+0000","last_undegraded":"2024-09-10T22:43:32.941315+0000","last_fullsized":"2024-09-10T22:43:32.941315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948239+0000","last_change":"2024-09-10T22:43:32.948239+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948239+0000","last_undegraded":"2024-09-10T22:43:32.948239+0000","last_fullsized":"2024-09-10T22:43:32.948239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.954722+0000","last_change":"2024-09-10T22:43:32.954722+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.954722+0000","last_undegraded":"2024-09-10T22:43:32.954722+0000","last_fullsized":"2024-09-10T22:43:32.954722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941603+0000","last_change":"2024-09-10T22:43:32.941603+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941603+0000","last_undegraded":"2024-09-10T22:43:32.941603+0000","last_fullsized":"2024-09-10T22:43:32.941603+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945152+0000","last_change":"2024-09-10T22:43:32.945152+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945152+0000","last_undegraded":"2024-09-10T22:43:32.945152+0000","last_fullsized":"2024-09-10T22:43:32.945152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947411+0000","last_change":"2024-09-10T22:43:32.947411+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947411+0000","last_undegraded":"2024-09-10T22:43:32.947411+0000","last_fullsized":"2024-09-10T22:43:32.947411+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945801+0000","last_change":"2024-09-10T22:43:32.945801+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945801+0000","last_undegraded":"2024-09-10T22:43:32.945801+0000","last_fullsized":"2024-09-10T22:43:32.945801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.952726+0000","last_change":"2024-09-10T22:43:32.952726+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.952726+0000","last_undegraded":"2024-09-10T22:43:32.952726+0000","last_fullsized":"2024-09-10T22:43:32.952726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.940828+0000","last_change":"2024-09-10T22:43:32.940828+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.940828+0000","last_undegraded":"2024-09-10T22:43:32.940828+0000","last_fullsized":"2024-09-10T22:43:32.940828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945854+0000","last_change":"2024-09-10T22:43:32.945854+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945854+0000","last_undegraded":"2024-09-10T22:43:32.945854+0000","last_fullsized":"2024-09-10T22:43:32.945854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948406+0000","last_change":"2024-09-10T22:43:32.948406+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948406+0000","last_undegraded":"2024-09-10T22:43:32.948406+0000","last_fullsized":"2024-09-10T22:43:32.948406+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.949052+0000","last_change":"2024-09-10T22:43:32.949052+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.949052+0000","last_undegraded":"2024-09-10T22:43:32.949052+0000","last_fullsized":"2024-09-10T22:43:32.949052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985109+0000","last_change":"2024-09-10T22:43:33.969132+0000","last_active":"2024-09-10T22:43:34.985109+0000","last_peered":"2024-09-10T22:43:34.985109+0000","last_clean":"2024-09-10T22:43:34.985109+0000","last_became_active":"2024-09-10T22:43:33.966818+0000","last_became_peered":"2024-09-10T22:43:33.966818+0000","last_unstale":"2024-09-10T22:43:34.985109+0000","last_undegraded":"2024-09-10T22:43:34.985109+0000","last_fullsized":"2024-09-10T22:43:34.985109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:46.251681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941375+0000","last_change":"2024-09-10T22:43:32.941375+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941375+0000","last_undegraded":"2024-09-10T22:43:32.941375+0000","last_fullsized":"2024-09-10T22:43:32.941375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948950+0000","last_change":"2024-09-10T22:43:32.948950+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948950+0000","last_undegraded":"2024-09-10T22:43:32.948950+0000","last_fullsized":"2024-09-10T22:43:32.948950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.942523+0000","last_change":"2024-09-10T22:43:32.942523+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.942523+0000","last_undegraded":"2024-09-10T22:43:32.942523+0000","last_fullsized":"2024-09-10T22:43:32.942523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.956163+0000","last_change":"2024-09-10T22:43:32.956163+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.956163+0000","last_undegraded":"2024-09-10T22:43:32.956163+0000","last_fullsized":"2024-09-10T22:43:32.956163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941593+0000","last_change":"2024-09-10T22:43:32.941593+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941593+0000","last_undegraded":"2024-09-10T22:43:32.941593+0000","last_fullsized":"2024-09-10T22:43:32.941593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.946286+0000","last_change":"2024-09-10T22:43:32.946286+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.946286+0000","last_undegraded":"2024-09-10T22:43:32.946286+0000","last_fullsized":"2024-09-10T22:43:32.946286+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945893+0000","last_change":"2024-09-10T22:43:32.945893+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945893+0000","last_undegraded":"2024-09-10T22:43:32.945893+0000","last_fullsized":"2024-09-10T22:43:32.945893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.944646+0000","last_change":"2024-09-10T22:43:32.944646+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.944646+0000","last_undegraded":"2024-09-10T22:43:32.944646+0000","last_fullsized":"2024-09-10T22:43:32.944646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.952160+0000","last_change":"2024-09-10T22:43:32.952160+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.952160+0000","last_undegraded":"2024-09-10T22:43:32.952160+0000","last_fullsized":"2024-09-10T22:43:32.952160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948502+0000","last_change":"2024-09-10T22:43:32.948502+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948502+0000","last_undegraded":"2024-09-10T22:43:32.948502+0000","last_fullsized":"2024-09-10T22:43:32.948502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945870+0000","last_change":"2024-09-10T22:43:32.945870+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945870+0000","last_undegraded":"2024-09-10T22:43:32.945870+0000","last_fullsized":"2024-09-10T22:43:32.945870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948973+0000","last_change":"2024-09-10T22:43:32.948973+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948973+0000","last_undegraded":"2024-09-10T22:43:32.948973+0000","last_fullsized":"2024-09-10T22:43:32.948973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984879+0000","last_change":"2024-09-10T22:43:33.960463+0000","last_active":"2024-09-10T22:43:34.984879+0000","last_peered":"2024-09-10T22:43:34.984879+0000","last_clean":"2024-09-10T22:43:34.984879+0000","last_became_active":"2024-09-10T22:43:33.957699+0000","last_became_peered":"2024-09-10T22:43:33.957699+0000","last_unstale":"2024-09-10T22:43:34.984879+0000","last_undegraded":"2024-09-10T22:43:34.984879+0000","last_fullsized":"2024-09-10T22:43:34.984879+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:17.832049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947954+0000","last_change":"2024-09-10T22:43:32.947954+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947954+0000","last_undegraded":"2024-09-10T22:43:32.947954+0000","last_fullsized":"2024-09-10T22:43:32.947954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984549+0000","last_change":"2024-09-10T22:43:33.966343+0000","last_active":"2024-09-10T22:43:34.984549+0000","last_peered":"2024-09-10T22:43:34.984549+0000","last_clean":"2024-09-10T22:43:34.984549+0000","last_became_active":"2024-09-10T22:43:33.966077+0000","last_became_peered":"2024-09-10T22:43:33.966077+0000","last_unstale":"2024-09-10T22:43:34.984549+0000","last_undegraded":"2024-09-10T22:43:34.984549+0000","last_fullsized":"2024-09-10T22:43:34.984549+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:11.532561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.965154+0000","last_change":"2024-09-10T22:43:32.957567+0000","last_active":"2024-09-10T22:43:32.965154+0000","last_peered":"2024-09-10T22:43:32.965154+0000","last_clean":"2024-09-10T22:43:32.965154+0000","last_became_active":"2024-09-10T22:43:32.957316+0000","last_became_peered":"2024-09-10T22:43:32.957316+0000","last_unstale":"2024-09-10T22:43:32.965154+0000","last_undegraded":"2024-09-10T22:43:32.965154+0000","last_fullsized":"2024-09-10T22:43:32.965154+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:08.694787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.943839+0000","last_change":"2024-09-10T22:43:32.943839+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.943839+0000","last_undegraded":"2024-09-10T22:43:32.943839+0000","last_fullsized":"2024-09-10T22:43:32.943839+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964327+0000","last_change":"2024-09-10T22:43:32.962321+0000","last_active":"2024-09-10T22:43:32.964327+0000","last_peered":"2024-09-10T22:43:32.964327+0000","last_clean":"2024-09-10T22:43:32.964327+0000","last_became_active":"2024-09-10T22:43:32.961642+0000","last_became_peered":"2024-09-10T22:43:32.961642+0000","last_unstale":"2024-09-10T22:43:32.964327+0000","last_undegraded":"2024-09-10T22:43:32.964327+0000","last_fullsized":"2024-09-10T22:43:32.964327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:54.835911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.942392+0000","last_change":"2024-09-10T22:43:32.942392+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.942392+0000","last_undegraded":"2024-09-10T22:43:32.942392+0000","last_fullsized":"2024-09-10T22:43:32.942392+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.971260+0000","last_change":"2024-09-10T22:43:32.964868+0000","last_active":"2024-09-10T22:43:32.971260+0000","last_peered":"2024-09-10T22:43:32.971260+0000","last_clean":"2024-09-10T22:43:32.971260+0000","last_became_active":"2024-09-10T22:43:32.964629+0000","last_became_peered":"2024-09-10T22:43:32.964629+0000","last_unstale":"2024-09-10T22:43:32.971260+0000","last_undegraded":"2024-09-10T22:43:32.971260+0000","last_fullsized":"2024-09-10T22:43:32.971260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:11.767542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941614+0000","last_change":"2024-09-10T22:43:32.941614+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941614+0000","last_undegraded":"2024-09-10T22:43:32.941614+0000","last_fullsized":"2024-09-10T22:43:32.941614+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.961669+0000","last_change":"2024-09-10T22:43:32.957956+0000","last_active":"2024-09-10T22:43:32.961669+0000","last_peered":"2024-09-10T22:43:32.961669+0000","last_clean":"2024-09-10T22:43:32.961669+0000","last_became_active":"2024-09-10T22:43:32.957370+0000","last_became_peered":"2024-09-10T22:43:32.957370+0000","last_unstale":"2024-09-10T22:43:32.961669+0000","last_undegraded":"2024-09-10T22:43:32.961669+0000","last_fullsized":"2024-09-10T22:43:32.961669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:13.681326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.944400+0000","last_change":"2024-09-10T22:43:32.944400+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.944400+0000","last_undegraded":"2024-09-10T22:43:32.944400+0000","last_fullsized":"2024-09-10T22:43:32.944400+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964022+0000","last_change":"2024-09-10T22:43:32.958500+0000","last_active":"2024-09-10T22:43:32.964022+0000","last_peered":"2024-09-10T22:43:32.964022+0000","last_clean":"2024-09-10T22:43:32.964022+0000","last_became_active":"2024-09-10T22:43:32.957266+0000","last_became_peered":"2024-09-10T22:43:32.957266+0000","last_unstale":"2024-09-10T22:43:32.964022+0000","last_undegraded":"2024-09-10T22:43:32.964022+0000","last_fullsized":"2024-09-10T22:43:32.964022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:02.384231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945488+0000","last_change":"2024-09-10T22:43:32.945488+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945488+0000","last_undegraded":"2024-09-10T22:43:32.945488+0000","last_fullsized":"2024-09-10T22:43:32.945488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.958460+0000","last_change":"2024-09-10T22:43:32.954519+0000","last_active":"2024-09-10T22:43:32.958460+0000","last_peered":"2024-09-10T22:43:32.958460+0000","last_clean":"2024-09-10T22:43:32.958460+0000","last_became_active":"2024-09-10T22:43:32.954235+0000","last_became_peered":"2024-09-10T22:43:32.954235+0000","last_unstale":"2024-09-10T22:43:32.958460+0000","last_undegraded":"2024-09-10T22:43:32.958460+0000","last_fullsized":"2024-09-10T22:43:32.958460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:29.999024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941897+0000","last_change":"2024-09-10T22:43:32.941897+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941897+0000","last_undegraded":"2024-09-10T22:43:32.941897+0000","last_fullsized":"2024-09-10T22:43:32.941897+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.962716+0000","last_change":"2024-09-10T22:43:32.953990+0000","last_active":"2024-09-10T22:43:32.962716+0000","last_peered":"2024-09-10T22:43:32.962716+0000","last_clean":"2024-09-10T22:43:32.962716+0000","last_became_active":"2024-09-10T22:43:32.953759+0000","last_became_peered":"2024-09-10T22:43:32.953759+0000","last_unstale":"2024-09-10T22:43:32.962716+0000","last_undegraded":"2024-09-10T22:43:32.962716+0000","last_fullsized":"2024-09-10T22:43:32.962716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:31.925280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948623+0000","last_change":"2024-09-10T22:43:32.948623+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948623+0000","last_undegraded":"2024-09-10T22:43:32.948623+0000","last_fullsized":"2024-09-10T22:43:32.948623+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.971105+0000","last_change":"2024-09-10T22:43:32.966902+0000","last_active":"2024-09-10T22:43:32.971105+0000","last_peered":"2024-09-10T22:43:32.971105+0000","last_clean":"2024-09-10T22:43:32.971105+0000","last_became_active":"2024-09-10T22:43:32.966674+0000","last_became_peered":"2024-09-10T22:43:32.966674+0000","last_unstale":"2024-09-10T22:43:32.971105+0000","last_undegraded":"2024-09-10T22:43:32.971105+0000","last_fullsized":"2024-09-10T22:43:32.971105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:05.242861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.944324+0000","last_change":"2024-09-10T22:43:32.944324+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.944324+0000","last_undegraded":"2024-09-10T22:43:32.944324+0000","last_fullsized":"2024-09-10T22:43:32.944324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964304+0000","last_change":"2024-09-10T22:43:32.960867+0000","last_active":"2024-09-10T22:43:32.964304+0000","last_peered":"2024-09-10T22:43:32.964304+0000","last_clean":"2024-09-10T22:43:32.964304+0000","last_became_active":"2024-09-10T22:43:32.960572+0000","last_became_peered":"2024-09-10T22:43:32.960572+0000","last_unstale":"2024-09-10T22:43:32.964304+0000","last_undegraded":"2024-09-10T22:43:32.964304+0000","last_fullsized":"2024-09-10T22:43:32.964304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:29.999024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.944516+0000","last_change":"2024-09-10T22:43:32.944516+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.944516+0000","last_undegraded":"2024-09-10T22:43:32.944516+0000","last_fullsized":"2024-09-10T22:43:32.944516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.959985+0000","last_change":"2024-09-10T22:43:32.956895+0000","last_active":"2024-09-10T22:43:32.959985+0000","last_peered":"2024-09-10T22:43:32.959985+0000","last_clean":"2024-09-10T22:43:32.959985+0000","last_became_active":"2024-09-10T22:43:32.956558+0000","last_became_peered":"2024-09-10T22:43:32.956558+0000","last_unstale":"2024-09-10T22:43:32.959985+0000","last_undegraded":"2024-09-10T22:43:32.959985+0000","last_fullsized":"2024-09-10T22:43:32.959985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:54.835911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.940234+0000","last_change":"2024-09-10T22:43:32.940234+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.940234+0000","last_undegraded":"2024-09-10T22:43:32.940234+0000","last_fullsized":"2024-09-10T22:43:32.940234+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.969693+0000","last_change":"2024-09-10T22:43:32.966412+0000","last_active":"2024-09-10T22:43:32.969693+0000","last_peered":"2024-09-10T22:43:32.969693+0000","last_clean":"2024-09-10T22:43:32.969693+0000","last_became_active":"2024-09-10T22:43:32.966135+0000","last_became_peered":"2024-09-10T22:43:32.966135+0000","last_unstale":"2024-09-10T22:43:32.969693+0000","last_undegraded":"2024-09-10T22:43:32.969693+0000","last_fullsized":"2024-09-10T22:43:32.969693+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:44.606825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984806+0000","last_change":"2024-09-10T22:43:33.970411+0000","last_active":"2024-09-10T22:43:34.984806+0000","last_peered":"2024-09-10T22:43:34.984806+0000","last_clean":"2024-09-10T22:43:34.984806+0000","last_became_active":"2024-09-10T22:43:33.969898+0000","last_became_peered":"2024-09-10T22:43:33.969898+0000","last_unstale":"2024-09-10T22:43:34.984806+0000","last_undegraded":"2024-09-10T22:43:34.984806+0000","last_fullsized":"2024-09-10T22:43:34.984806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:52.448989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.961695+0000","last_change":"2024-09-10T22:43:32.958074+0000","last_active":"2024-09-10T22:43:32.961695+0000","last_peered":"2024-09-10T22:43:32.961695+0000","last_clean":"2024-09-10T22:43:32.961695+0000","last_became_active":"2024-09-10T22:43:32.957692+0000","last_became_peered":"2024-09-10T22:43:32.957692+0000","last_unstale":"2024-09-10T22:43:32.961695+0000","last_undegraded":"2024-09-10T22:43:32.961695+0000","last_fullsized":"2024-09-10T22:43:32.961695+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:21:46.363669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945092+0000","last_change":"2024-09-10T22:43:32.945092+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945092+0000","last_undegraded":"2024-09-10T22:43:32.945092+0000","last_fullsized":"2024-09-10T22:43:32.945092+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.958387+0000","last_change":"2024-09-10T22:43:32.953419+0000","last_active":"2024-09-10T22:43:32.958387+0000","last_peered":"2024-09-10T22:43:32.958387+0000","last_clean":"2024-09-10T22:43:32.958387+0000","last_became_active":"2024-09-10T22:43:32.953109+0000","last_became_peered":"2024-09-10T22:43:32.953109+0000","last_unstale":"2024-09-10T22:43:32.958387+0000","last_undegraded":"2024-09-10T22:43:32.958387+0000","last_fullsized":"2024-09-10T22:43:32.958387+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:53.675442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947164+0000","last_change":"2024-09-10T22:43:32.947164+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947164+0000","last_undegraded":"2024-09-10T22:43:32.947164+0000","last_fullsized":"2024-09-10T22:43:32.947164+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.971773+0000","last_change":"2024-09-10T22:43:32.968272+0000","last_active":"2024-09-10T22:43:32.971773+0000","last_peered":"2024-09-10T22:43:32.971773+0000","last_clean":"2024-09-10T22:43:32.971773+0000","last_became_active":"2024-09-10T22:43:32.967987+0000","last_became_peered":"2024-09-10T22:43:32.967987+0000","last_unstale":"2024-09-10T22:43:32.971773+0000","last_undegraded":"2024-09-10T22:43:32.971773+0000","last_fullsized":"2024-09-10T22:43:32.971773+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:10:05.503295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947167+0000","last_change":"2024-09-10T22:43:32.947167+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947167+0000","last_undegraded":"2024-09-10T22:43:32.947167+0000","last_fullsized":"2024-09-10T22:43:32.947167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.969684+0000","last_change":"2024-09-10T22:43:32.964152+0000","last_active":"2024-09-10T22:43:32.969684+0000","last_peered":"2024-09-10T22:43:32.969684+0000","last_clean":"2024-09-10T22:43:32.969684+0000","last_became_active":"2024-09-10T22:43:32.963908+0000","last_became_peered":"2024-09-10T22:43:32.963908+0000","last_unstale":"2024-09-10T22:43:32.969684+0000","last_undegraded":"2024-09-10T22:43:32.969684+0000","last_fullsized":"2024-09-10T22:43:32.969684+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:27.359912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948148+0000","last_change":"2024-09-10T22:43:32.948148+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948148+0000","last_undegraded":"2024-09-10T22:43:32.948148+0000","last_fullsized":"2024-09-10T22:43:32.948148+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964536+0000","last_change":"2024-09-10T22:43:32.957309+0000","last_active":"2024-09-10T22:43:32.964536+0000","last_peered":"2024-09-10T22:43:32.964536+0000","last_clean":"2024-09-10T22:43:32.964536+0000","last_became_active":"2024-09-10T22:43:32.956954+0000","last_became_peered":"2024-09-10T22:43:32.956954+0000","last_unstale":"2024-09-10T22:43:32.964536+0000","last_undegraded":"2024-09-10T22:43:32.964536+0000","last_fullsized":"2024-09-10T22:43:32.964536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:17.047894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.940872+0000","last_change":"2024-09-10T22:43:32.940872+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.940872+0000","last_undegraded":"2024-09-10T22:43:32.940872+0000","last_fullsized":"2024-09-10T22:43:32.940872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.971745+0000","last_change":"2024-09-10T22:43:32.967130+0000","last_active":"2024-09-10T22:43:32.971745+0000","last_peered":"2024-09-10T22:43:32.971745+0000","last_clean":"2024-09-10T22:43:32.971745+0000","last_became_active":"2024-09-10T22:43:32.966886+0000","last_became_peered":"2024-09-10T22:43:32.966886+0000","last_unstale":"2024-09-10T22:43:32.971745+0000","last_undegraded":"2024-09-10T22:43:32.971745+0000","last_fullsized":"2024-09-10T22:43:32.971745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:13:26.884998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.956136+0000","last_change":"2024-09-10T22:43:32.956136+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.956136+0000","last_undegraded":"2024-09-10T22:43:32.956136+0000","last_fullsized":"2024-09-10T22:43:32.956136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.968847+0000","last_change":"2024-09-10T22:43:32.963980+0000","last_active":"2024-09-10T22:43:32.968847+0000","last_peered":"2024-09-10T22:43:32.968847+0000","last_clean":"2024-09-10T22:43:32.968847+0000","last_became_active":"2024-09-10T22:43:32.962919+0000","last_became_peered":"2024-09-10T22:43:32.962919+0000","last_unstale":"2024-09-10T22:43:32.968847+0000","last_undegraded":"2024-09-10T22:43:32.968847+0000","last_fullsized":"2024-09-10T22:43:32.968847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:17.002563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.956625+0000","last_change":"2024-09-10T22:43:32.956625+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.956625+0000","last_undegraded":"2024-09-10T22:43:32.956625+0000","last_fullsized":"2024-09-10T22:43:32.956625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.965287+0000","last_change":"2024-09-10T22:43:32.960405+0000","last_active":"2024-09-10T22:43:32.965287+0000","last_peered":"2024-09-10T22:43:32.965287+0000","last_clean":"2024-09-10T22:43:32.965287+0000","last_became_active":"2024-09-10T22:43:32.958442+0000","last_became_peered":"2024-09-10T22:43:32.958442+0000","last_unstale":"2024-09-10T22:43:32.965287+0000","last_undegraded":"2024-09-10T22:43:32.965287+0000","last_fullsized":"2024-09-10T22:43:32.965287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:14.818760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941442+0000","last_change":"2024-09-10T22:43:32.941442+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941442+0000","last_undegraded":"2024-09-10T22:43:32.941442+0000","last_fullsized":"2024-09-10T22:43:32.941442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984708+0000","last_change":"2024-09-10T22:43:32.964908+0000","last_active":"2024-09-10T22:43:34.984708+0000","last_peered":"2024-09-10T22:43:34.984708+0000","last_clean":"2024-09-10T22:43:34.984708+0000","last_became_active":"2024-09-10T22:43:32.964611+0000","last_became_peered":"2024-09-10T22:43:32.964611+0000","last_unstale":"2024-09-10T22:43:34.984708+0000","last_undegraded":"2024-09-10T22:43:34.984708+0000","last_fullsized":"2024-09-10T22:43:34.984708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:02.693878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.943946+0000","last_change":"2024-09-10T22:43:32.943946+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.943946+0000","last_undegraded":"2024-09-10T22:43:32.943946+0000","last_fullsized":"2024-09-10T22:43:32.943946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.967678+0000","last_change":"2024-09-10T22:43:32.961790+0000","last_active":"2024-09-10T22:43:32.967678+0000","last_peered":"2024-09-10T22:43:32.967678+0000","last_clean":"2024-09-10T22:43:32.967678+0000","last_became_active":"2024-09-10T22:43:32.961323+0000","last_became_peered":"2024-09-10T22:43:32.961323+0000","last_unstale":"2024-09-10T22:43:32.967678+0000","last_undegraded":"2024-09-10T22:43:32.967678+0000","last_fullsized":"2024-09-10T22:43:32.967678+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:15.339385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.943860+0000","last_change":"2024-09-10T22:43:32.943860+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.943860+0000","last_undegraded":"2024-09-10T22:43:32.943860+0000","last_fullsized":"2024-09-10T22:43:32.943860+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.967675+0000","last_change":"2024-09-10T22:43:32.960678+0000","last_active":"2024-09-10T22:43:32.967675+0000","last_peered":"2024-09-10T22:43:32.967675+0000","last_clean":"2024-09-10T22:43:32.967675+0000","last_became_active":"2024-09-10T22:43:32.959289+0000","last_became_peered":"2024-09-10T22:43:32.959289+0000","last_unstale":"2024-09-10T22:43:32.967675+0000","last_undegraded":"2024-09-10T22:43:32.967675+0000","last_fullsized":"2024-09-10T22:43:32.967675+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:56.905762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947725+0000","last_change":"2024-09-10T22:43:32.947725+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947725+0000","last_undegraded":"2024-09-10T22:43:32.947725+0000","last_fullsized":"2024-09-10T22:43:32.947725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964622+0000","last_change":"2024-09-10T22:43:32.958892+0000","last_active":"2024-09-10T22:43:32.964622+0000","last_peered":"2024-09-10T22:43:32.964622+0000","last_clean":"2024-09-10T22:43:32.964622+0000","last_became_active":"2024-09-10T22:43:32.957384+0000","last_became_peered":"2024-09-10T22:43:32.957384+0000","last_unstale":"2024-09-10T22:43:32.964622+0000","last_undegraded":"2024-09-10T22:43:32.964622+0000","last_fullsized":"2024-09-10T22:43:32.964622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:54.693425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941617+0000","last_change":"2024-09-10T22:43:32.941617+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941617+0000","last_undegraded":"2024-09-10T22:43:32.941617+0000","last_fullsized":"2024-09-10T22:43:32.941617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.966361+0000","last_change":"2024-09-10T22:43:32.962599+0000","last_active":"2024-09-10T22:43:32.966361+0000","last_peered":"2024-09-10T22:43:32.966361+0000","last_clean":"2024-09-10T22:43:32.966361+0000","last_became_active":"2024-09-10T22:43:32.962196+0000","last_became_peered":"2024-09-10T22:43:32.962196+0000","last_unstale":"2024-09-10T22:43:32.966361+0000","last_undegraded":"2024-09-10T22:43:32.966361+0000","last_fullsized":"2024-09-10T22:43:32.966361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:21.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947694+0000","last_change":"2024-09-10T22:43:32.947694+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947694+0000","last_undegraded":"2024-09-10T22:43:32.947694+0000","last_fullsized":"2024-09-10T22:43:32.947694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.959386+0000","last_change":"2024-09-10T22:43:32.953544+0000","last_active":"2024-09-10T22:43:32.959386+0000","last_peered":"2024-09-10T22:43:32.959386+0000","last_clean":"2024-09-10T22:43:32.959386+0000","last_became_active":"2024-09-10T22:43:32.951997+0000","last_became_peered":"2024-09-10T22:43:32.951997+0000","last_unstale":"2024-09-10T22:43:32.959386+0000","last_undegraded":"2024-09-10T22:43:32.959386+0000","last_fullsized":"2024-09-10T22:43:32.959386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:09.778155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941761+0000","last_change":"2024-09-10T22:43:32.941761+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941761+0000","last_undegraded":"2024-09-10T22:43:32.941761+0000","last_fullsized":"2024-09-10T22:43:32.941761+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.966445+0000","last_change":"2024-09-10T22:43:32.962093+0000","last_active":"2024-09-10T22:43:32.966445+0000","last_peered":"2024-09-10T22:43:32.966445+0000","last_clean":"2024-09-10T22:43:32.966445+0000","last_became_active":"2024-09-10T22:43:32.961715+0000","last_became_peered":"2024-09-10T22:43:32.961715+0000","last_unstale":"2024-09-10T22:43:32.966445+0000","last_undegraded":"2024-09-10T22:43:32.966445+0000","last_fullsized":"2024-09-10T22:43:32.966445+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:21.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.943830+0000","last_change":"2024-09-10T22:43:32.943830+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.943830+0000","last_undegraded":"2024-09-10T22:43:32.943830+0000","last_fullsized":"2024-09-10T22:43:32.943830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.963636+0000","last_change":"2024-09-10T22:43:32.960870+0000","last_active":"2024-09-10T22:43:32.963636+0000","last_peered":"2024-09-10T22:43:32.963636+0000","last_clean":"2024-09-10T22:43:32.963636+0000","last_became_active":"2024-09-10T22:43:32.960525+0000","last_became_peered":"2024-09-10T22:43:32.960525+0000","last_unstale":"2024-09-10T22:43:32.963636+0000","last_undegraded":"2024-09-10T22:43:32.963636+0000","last_fullsized":"2024-09-10T22:43:32.963636+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:53.675442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.946720+0000","last_change":"2024-09-10T22:43:32.946720+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.946720+0000","last_undegraded":"2024-09-10T22:43:32.946720+0000","last_fullsized":"2024-09-10T22:43:32.946720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.961451+0000","last_change":"2024-09-10T22:43:32.957617+0000","last_active":"2024-09-10T22:43:32.961451+0000","last_peered":"2024-09-10T22:43:32.961451+0000","last_clean":"2024-09-10T22:43:32.961451+0000","last_became_active":"2024-09-10T22:43:32.957258+0000","last_became_peered":"2024-09-10T22:43:32.957258+0000","last_unstale":"2024-09-10T22:43:32.961451+0000","last_undegraded":"2024-09-10T22:43:32.961451+0000","last_fullsized":"2024-09-10T22:43:32.961451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:56.607363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.946666+0000","last_change":"2024-09-10T22:43:32.946666+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.946666+0000","last_undegraded":"2024-09-10T22:43:32.946666+0000","last_fullsized":"2024-09-10T22:43:32.946666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.967276+0000","last_change":"2024-09-10T22:43:32.963621+0000","last_active":"2024-09-10T22:43:32.967276+0000","last_peered":"2024-09-10T22:43:32.967276+0000","last_clean":"2024-09-10T22:43:32.967276+0000","last_became_active":"2024-09-10T22:43:32.962527+0000","last_became_peered":"2024-09-10T22:43:32.962527+0000","last_unstale":"2024-09-10T22:43:32.967276+0000","last_undegraded":"2024-09-10T22:43:32.967276+0000","last_fullsized":"2024-09-10T22:43:32.967276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:44.356842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985281+0000","last_change":"2024-09-10T22:43:33.973798+0000","last_active":"2024-09-10T22:43:34.985281+0000","last_peered":"2024-09-10T22:43:34.985281+0000","last_clean":"2024-09-10T22:43:34.985281+0000","last_became_active":"2024-09-10T22:43:33.973289+0000","last_became_peered":"2024-09-10T22:43:33.973289+0000","last_unstale":"2024-09-10T22:43:34.985281+0000","last_undegraded":"2024-09-10T22:43:34.985281+0000","last_fullsized":"2024-09-10T22:43:34.985281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:55.398034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.961857+0000","last_change":"2024-09-10T22:43:32.958396+0000","last_active":"2024-09-10T22:43:32.961857+0000","last_peered":"2024-09-10T22:43:32.961857+0000","last_clean":"2024-09-10T22:43:32.961857+0000","last_became_active":"2024-09-10T22:43:32.957943+0000","last_became_peered":"2024-09-10T22:43:32.957943+0000","last_unstale":"2024-09-10T22:43:32.961857+0000","last_undegraded":"2024-09-10T22:43:32.961857+0000","last_fullsized":"2024-09-10T22:43:32.961857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:34.240762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985487+0000","last_change":"2024-09-10T22:43:33.963110+0000","last_active":"2024-09-10T22:43:34.985487+0000","last_peered":"2024-09-10T22:43:34.985487+0000","last_clean":"2024-09-10T22:43:34.985487+0000","last_became_active":"2024-09-10T22:43:33.962823+0000","last_became_peered":"2024-09-10T22:43:33.962823+0000","last_unstale":"2024-09-10T22:43:34.985487+0000","last_undegraded":"2024-09-10T22:43:34.985487+0000","last_fullsized":"2024-09-10T22:43:34.985487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:43.287722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984617+0000","last_change":"2024-09-10T22:43:32.962997+0000","last_active":"2024-09-10T22:43:34.984617+0000","last_peered":"2024-09-10T22:43:34.984617+0000","last_clean":"2024-09-10T22:43:34.984617+0000","last_became_active":"2024-09-10T22:43:32.961399+0000","last_became_peered":"2024-09-10T22:43:32.961399+0000","last_unstale":"2024-09-10T22:43:34.984617+0000","last_undegraded":"2024-09-10T22:43:34.984617+0000","last_fullsized":"2024-09-10T22:43:34.984617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:56.079546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.951693+0000","last_change":"2024-09-10T22:43:32.951693+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.951693+0000","last_undegraded":"2024-09-10T22:43:32.951693+0000","last_fullsized":"2024-09-10T22:43:32.951693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.967563+0000","last_change":"2024-09-10T22:43:32.959873+0000","last_active":"2024-09-10T22:43:32.967563+0000","last_peered":"2024-09-10T22:43:32.967563+0000","last_clean":"2024-09-10T22:43:32.967563+0000","last_became_active":"2024-09-10T22:43:32.959583+0000","last_became_peered":"2024-09-10T22:43:32.959583+0000","last_unstale":"2024-09-10T22:43:32.967563+0000","last_undegraded":"2024-09-10T22:43:32.967563+0000","last_fullsized":"2024-09-10T22:43:32.967563+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:57.043203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":218,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.952078+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:43:32.952078+0000","last_peered":"2024-09-10T22:43:32.952078+0000","last_clean":"2024-09-10T22:43:32.952078+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:43:32.952078+0000","last_undegraded":"2024-09-10T22:43:32.952078+0000","last_fullsized":"2024-09-10T22:43:32.952078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509502,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1552384,"data_stored":1027804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509502,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509503,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509502,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509502,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1552384,"data_stored":1027804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":991232,"data_stored":451407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:43:38.820 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3f is not active+clean 2024-09-10T22:43:38.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.951475+0000', 'last_change': '2024-09-10T22:43:32.951475+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.951475+0000', 'last_undegraded': '2024-09-10T22:43:32.951475+0000', 'last_fullsized': '2024-09-10T22:43:32.951475+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T22:43:38.820 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3e is not active+clean 2024-09-10T22:43:38.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.947322+0000', 'last_change': '2024-09-10T22:43:32.947322+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.947322+0000', 'last_undegraded': '2024-09-10T22:43:32.947322+0000', 'last_fullsized': '2024-09-10T22:43:32.947322+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:43:38.820 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3c is not active+clean 2024-09-10T22:43:38.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.946226+0000', 'last_change': '2024-09-10T22:43:32.946226+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.946226+0000', 'last_undegraded': '2024-09-10T22:43:32.946226+0000', 'last_fullsized': '2024-09-10T22:43:32.946226+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T22:43:38.821 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3b is not active+clean 2024-09-10T22:43:38.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.953166+0000', 'last_change': '2024-09-10T22:43:32.953166+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.953166+0000', 'last_undegraded': '2024-09-10T22:43:32.953166+0000', 'last_fullsized': '2024-09-10T22:43:32.953166+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T22:43:38.821 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3a is not active+clean 2024-09-10T22:43:38.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.941315+0000', 'last_change': '2024-09-10T22:43:32.941315+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.941315+0000', 'last_undegraded': '2024-09-10T22:43:32.941315+0000', 'last_fullsized': '2024-09-10T22:43:32.941315+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T22:43:38.821 INFO:tasks.ceph.ceph_manager.ceph:PG 12.39 is not active+clean 2024-09-10T22:43:38.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.948239+0000', 'last_change': '2024-09-10T22:43:32.948239+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.948239+0000', 'last_undegraded': '2024-09-10T22:43:32.948239+0000', 'last_fullsized': '2024-09-10T22:43:32.948239+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T22:43:38.821 INFO:tasks.ceph.ceph_manager.ceph:PG 12.38 is not active+clean 2024-09-10T22:43:38.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.954722+0000', 'last_change': '2024-09-10T22:43:32.954722+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.954722+0000', 'last_undegraded': '2024-09-10T22:43:32.954722+0000', 'last_fullsized': '2024-09-10T22:43:32.954722+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T22:43:38.821 INFO:tasks.ceph.ceph_manager.ceph:PG 12.37 is not active+clean 2024-09-10T22:43:38.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.941603+0000', 'last_change': '2024-09-10T22:43:32.941603+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.941603+0000', 'last_undegraded': '2024-09-10T22:43:32.941603+0000', 'last_fullsized': '2024-09-10T22:43:32.941603+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:43:38.821 INFO:tasks.ceph.ceph_manager.ceph:PG 12.36 is not active+clean 2024-09-10T22:43:38.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.945152+0000', 'last_change': '2024-09-10T22:43:32.945152+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.945152+0000', 'last_undegraded': '2024-09-10T22:43:32.945152+0000', 'last_fullsized': '2024-09-10T22:43:32.945152+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T22:43:38.822 INFO:tasks.ceph.ceph_manager.ceph:PG 12.35 is not active+clean 2024-09-10T22:43:38.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.947411+0000', 'last_change': '2024-09-10T22:43:32.947411+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.947411+0000', 'last_undegraded': '2024-09-10T22:43:32.947411+0000', 'last_fullsized': '2024-09-10T22:43:32.947411+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:43:38.822 INFO:tasks.ceph.ceph_manager.ceph:PG 12.34 is not active+clean 2024-09-10T22:43:38.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.945801+0000', 'last_change': '2024-09-10T22:43:32.945801+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.945801+0000', 'last_undegraded': '2024-09-10T22:43:32.945801+0000', 'last_fullsized': '2024-09-10T22:43:32.945801+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T22:43:38.822 INFO:tasks.ceph.ceph_manager.ceph:PG 12.33 is not active+clean 2024-09-10T22:43:38.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.952726+0000', 'last_change': '2024-09-10T22:43:32.952726+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.952726+0000', 'last_undegraded': '2024-09-10T22:43:32.952726+0000', 'last_fullsized': '2024-09-10T22:43:32.952726+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T22:43:38.822 INFO:tasks.ceph.ceph_manager.ceph:PG 12.32 is not active+clean 2024-09-10T22:43:38.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.940828+0000', 'last_change': '2024-09-10T22:43:32.940828+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.940828+0000', 'last_undegraded': '2024-09-10T22:43:32.940828+0000', 'last_fullsized': '2024-09-10T22:43:32.940828+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T22:43:38.822 INFO:tasks.ceph.ceph_manager.ceph:PG 12.31 is not active+clean 2024-09-10T22:43:38.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.945854+0000', 'last_change': '2024-09-10T22:43:32.945854+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.945854+0000', 'last_undegraded': '2024-09-10T22:43:32.945854+0000', 'last_fullsized': '2024-09-10T22:43:32.945854+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:43:38.822 INFO:tasks.ceph.ceph_manager.ceph:PG 12.30 is not active+clean 2024-09-10T22:43:38.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.948406+0000', 'last_change': '2024-09-10T22:43:32.948406+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.948406+0000', 'last_undegraded': '2024-09-10T22:43:32.948406+0000', 'last_fullsized': '2024-09-10T22:43:32.948406+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T22:43:38.823 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2f is not active+clean 2024-09-10T22:43:38.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.949052+0000', 'last_change': '2024-09-10T22:43:32.949052+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.949052+0000', 'last_undegraded': '2024-09-10T22:43:32.949052+0000', 'last_fullsized': '2024-09-10T22:43:32.949052+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T22:43:38.823 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2d is not active+clean 2024-09-10T22:43:38.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.941375+0000', 'last_change': '2024-09-10T22:43:32.941375+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.941375+0000', 'last_undegraded': '2024-09-10T22:43:32.941375+0000', 'last_fullsized': '2024-09-10T22:43:32.941375+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T22:43:38.823 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2c is not active+clean 2024-09-10T22:43:38.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.948950+0000', 'last_change': '2024-09-10T22:43:32.948950+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.948950+0000', 'last_undegraded': '2024-09-10T22:43:32.948950+0000', 'last_fullsized': '2024-09-10T22:43:32.948950+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T22:43:38.823 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2b is not active+clean 2024-09-10T22:43:38.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.942523+0000', 'last_change': '2024-09-10T22:43:32.942523+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.942523+0000', 'last_undegraded': '2024-09-10T22:43:32.942523+0000', 'last_fullsized': '2024-09-10T22:43:32.942523+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:43:38.823 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2a is not active+clean 2024-09-10T22:43:38.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.956163+0000', 'last_change': '2024-09-10T22:43:32.956163+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.956163+0000', 'last_undegraded': '2024-09-10T22:43:32.956163+0000', 'last_fullsized': '2024-09-10T22:43:32.956163+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T22:43:38.823 INFO:tasks.ceph.ceph_manager.ceph:PG 12.29 is not active+clean 2024-09-10T22:43:38.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.941593+0000', 'last_change': '2024-09-10T22:43:32.941593+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.941593+0000', 'last_undegraded': '2024-09-10T22:43:32.941593+0000', 'last_fullsized': '2024-09-10T22:43:32.941593+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:43:38.824 INFO:tasks.ceph.ceph_manager.ceph:PG 12.28 is not active+clean 2024-09-10T22:43:38.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.946286+0000', 'last_change': '2024-09-10T22:43:32.946286+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.946286+0000', 'last_undegraded': '2024-09-10T22:43:32.946286+0000', 'last_fullsized': '2024-09-10T22:43:32.946286+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:43:38.824 INFO:tasks.ceph.ceph_manager.ceph:PG 12.27 is not active+clean 2024-09-10T22:43:38.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.945893+0000', 'last_change': '2024-09-10T22:43:32.945893+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.945893+0000', 'last_undegraded': '2024-09-10T22:43:32.945893+0000', 'last_fullsized': '2024-09-10T22:43:32.945893+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:43:38.824 INFO:tasks.ceph.ceph_manager.ceph:PG 12.26 is not active+clean 2024-09-10T22:43:38.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.944646+0000', 'last_change': '2024-09-10T22:43:32.944646+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.944646+0000', 'last_undegraded': '2024-09-10T22:43:32.944646+0000', 'last_fullsized': '2024-09-10T22:43:32.944646+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T22:43:38.824 INFO:tasks.ceph.ceph_manager.ceph:PG 12.25 is not active+clean 2024-09-10T22:43:38.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.952160+0000', 'last_change': '2024-09-10T22:43:32.952160+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.952160+0000', 'last_undegraded': '2024-09-10T22:43:32.952160+0000', 'last_fullsized': '2024-09-10T22:43:32.952160+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T22:43:38.824 INFO:tasks.ceph.ceph_manager.ceph:PG 12.24 is not active+clean 2024-09-10T22:43:38.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.948502+0000', 'last_change': '2024-09-10T22:43:32.948502+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.948502+0000', 'last_undegraded': '2024-09-10T22:43:32.948502+0000', 'last_fullsized': '2024-09-10T22:43:32.948502+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T22:43:38.825 INFO:tasks.ceph.ceph_manager.ceph:PG 12.23 is not active+clean 2024-09-10T22:43:38.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.945870+0000', 'last_change': '2024-09-10T22:43:32.945870+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.945870+0000', 'last_undegraded': '2024-09-10T22:43:32.945870+0000', 'last_fullsized': '2024-09-10T22:43:32.945870+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:43:38.825 INFO:tasks.ceph.ceph_manager.ceph:PG 12.22 is not active+clean 2024-09-10T22:43:38.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.948973+0000', 'last_change': '2024-09-10T22:43:32.948973+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.948973+0000', 'last_undegraded': '2024-09-10T22:43:32.948973+0000', 'last_fullsized': '2024-09-10T22:43:32.948973+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T22:43:38.825 INFO:tasks.ceph.ceph_manager.ceph:PG 12.20 is not active+clean 2024-09-10T22:43:38.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.947954+0000', 'last_change': '2024-09-10T22:43:32.947954+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.947954+0000', 'last_undegraded': '2024-09-10T22:43:32.947954+0000', 'last_fullsized': '2024-09-10T22:43:32.947954+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T22:43:38.825 INFO:tasks.ceph.ceph_manager.ceph:PG 12.19 is not active+clean 2024-09-10T22:43:38.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.943839+0000', 'last_change': '2024-09-10T22:43:32.943839+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.943839+0000', 'last_undegraded': '2024-09-10T22:43:32.943839+0000', 'last_fullsized': '2024-09-10T22:43:32.943839+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:43:38.825 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1a is not active+clean 2024-09-10T22:43:38.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.942392+0000', 'last_change': '2024-09-10T22:43:32.942392+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.942392+0000', 'last_undegraded': '2024-09-10T22:43:32.942392+0000', 'last_fullsized': '2024-09-10T22:43:32.942392+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:43:38.825 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1b is not active+clean 2024-09-10T22:43:38.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.941614+0000', 'last_change': '2024-09-10T22:43:32.941614+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.941614+0000', 'last_undegraded': '2024-09-10T22:43:32.941614+0000', 'last_fullsized': '2024-09-10T22:43:32.941614+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:43:38.826 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1c is not active+clean 2024-09-10T22:43:38.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.944400+0000', 'last_change': '2024-09-10T22:43:32.944400+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.944400+0000', 'last_undegraded': '2024-09-10T22:43:32.944400+0000', 'last_fullsized': '2024-09-10T22:43:32.944400+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:43:38.826 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1d is not active+clean 2024-09-10T22:43:38.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.945488+0000', 'last_change': '2024-09-10T22:43:32.945488+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.945488+0000', 'last_undegraded': '2024-09-10T22:43:32.945488+0000', 'last_fullsized': '2024-09-10T22:43:32.945488+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:43:38.826 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1e is not active+clean 2024-09-10T22:43:38.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.941897+0000', 'last_change': '2024-09-10T22:43:32.941897+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.941897+0000', 'last_undegraded': '2024-09-10T22:43:32.941897+0000', 'last_fullsized': '2024-09-10T22:43:32.941897+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:43:38.826 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1f is not active+clean 2024-09-10T22:43:38.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.948623+0000', 'last_change': '2024-09-10T22:43:32.948623+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.948623+0000', 'last_undegraded': '2024-09-10T22:43:32.948623+0000', 'last_fullsized': '2024-09-10T22:43:32.948623+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T22:43:38.826 INFO:tasks.ceph.ceph_manager.ceph:PG 12.10 is not active+clean 2024-09-10T22:43:38.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.944324+0000', 'last_change': '2024-09-10T22:43:32.944324+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.944324+0000', 'last_undegraded': '2024-09-10T22:43:32.944324+0000', 'last_fullsized': '2024-09-10T22:43:32.944324+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:43:38.827 INFO:tasks.ceph.ceph_manager.ceph:PG 12.11 is not active+clean 2024-09-10T22:43:38.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.944516+0000', 'last_change': '2024-09-10T22:43:32.944516+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.944516+0000', 'last_undegraded': '2024-09-10T22:43:32.944516+0000', 'last_fullsized': '2024-09-10T22:43:32.944516+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T22:43:38.827 INFO:tasks.ceph.ceph_manager.ceph:PG 12.12 is not active+clean 2024-09-10T22:43:38.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.940234+0000', 'last_change': '2024-09-10T22:43:32.940234+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.940234+0000', 'last_undegraded': '2024-09-10T22:43:32.940234+0000', 'last_fullsized': '2024-09-10T22:43:32.940234+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T22:43:38.827 INFO:tasks.ceph.ceph_manager.ceph:PG 12.14 is not active+clean 2024-09-10T22:43:38.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.945092+0000', 'last_change': '2024-09-10T22:43:32.945092+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.945092+0000', 'last_undegraded': '2024-09-10T22:43:32.945092+0000', 'last_fullsized': '2024-09-10T22:43:32.945092+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T22:43:38.827 INFO:tasks.ceph.ceph_manager.ceph:PG 12.15 is not active+clean 2024-09-10T22:43:38.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.947164+0000', 'last_change': '2024-09-10T22:43:32.947164+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.947164+0000', 'last_undegraded': '2024-09-10T22:43:32.947164+0000', 'last_fullsized': '2024-09-10T22:43:32.947164+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T22:43:38.827 INFO:tasks.ceph.ceph_manager.ceph:PG 12.16 is not active+clean 2024-09-10T22:43:38.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.947167+0000', 'last_change': '2024-09-10T22:43:32.947167+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.947167+0000', 'last_undegraded': '2024-09-10T22:43:32.947167+0000', 'last_fullsized': '2024-09-10T22:43:32.947167+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T22:43:38.827 INFO:tasks.ceph.ceph_manager.ceph:PG 12.17 is not active+clean 2024-09-10T22:43:38.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.948148+0000', 'last_change': '2024-09-10T22:43:32.948148+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.948148+0000', 'last_undegraded': '2024-09-10T22:43:32.948148+0000', 'last_fullsized': '2024-09-10T22:43:32.948148+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T22:43:38.828 INFO:tasks.ceph.ceph_manager.ceph:PG 12.8 is not active+clean 2024-09-10T22:43:38.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.940872+0000', 'last_change': '2024-09-10T22:43:32.940872+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.940872+0000', 'last_undegraded': '2024-09-10T22:43:32.940872+0000', 'last_fullsized': '2024-09-10T22:43:32.940872+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T22:43:38.828 INFO:tasks.ceph.ceph_manager.ceph:PG 12.9 is not active+clean 2024-09-10T22:43:38.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.956136+0000', 'last_change': '2024-09-10T22:43:32.956136+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.956136+0000', 'last_undegraded': '2024-09-10T22:43:32.956136+0000', 'last_fullsized': '2024-09-10T22:43:32.956136+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T22:43:38.828 INFO:tasks.ceph.ceph_manager.ceph:PG 12.a is not active+clean 2024-09-10T22:43:38.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.956625+0000', 'last_change': '2024-09-10T22:43:32.956625+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.956625+0000', 'last_undegraded': '2024-09-10T22:43:32.956625+0000', 'last_fullsized': '2024-09-10T22:43:32.956625+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T22:43:38.828 INFO:tasks.ceph.ceph_manager.ceph:PG 12.b is not active+clean 2024-09-10T22:43:38.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.941442+0000', 'last_change': '2024-09-10T22:43:32.941442+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.941442+0000', 'last_undegraded': '2024-09-10T22:43:32.941442+0000', 'last_fullsized': '2024-09-10T22:43:32.941442+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T22:43:38.828 INFO:tasks.ceph.ceph_manager.ceph:PG 12.c is not active+clean 2024-09-10T22:43:38.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.943946+0000', 'last_change': '2024-09-10T22:43:32.943946+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.943946+0000', 'last_undegraded': '2024-09-10T22:43:32.943946+0000', 'last_fullsized': '2024-09-10T22:43:32.943946+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:43:38.828 INFO:tasks.ceph.ceph_manager.ceph:PG 12.e is not active+clean 2024-09-10T22:43:38.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.943860+0000', 'last_change': '2024-09-10T22:43:32.943860+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.943860+0000', 'last_undegraded': '2024-09-10T22:43:32.943860+0000', 'last_fullsized': '2024-09-10T22:43:32.943860+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:43:38.829 INFO:tasks.ceph.ceph_manager.ceph:PG 12.f is not active+clean 2024-09-10T22:43:38.829 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.947725+0000', 'last_change': '2024-09-10T22:43:32.947725+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.947725+0000', 'last_undegraded': '2024-09-10T22:43:32.947725+0000', 'last_fullsized': '2024-09-10T22:43:32.947725+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T22:43:38.829 INFO:tasks.ceph.ceph_manager.ceph:PG 12.0 is not active+clean 2024-09-10T22:43:38.829 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.941617+0000', 'last_change': '2024-09-10T22:43:32.941617+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.941617+0000', 'last_undegraded': '2024-09-10T22:43:32.941617+0000', 'last_fullsized': '2024-09-10T22:43:32.941617+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:43:38.829 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1 is not active+clean 2024-09-10T22:43:38.829 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.947694+0000', 'last_change': '2024-09-10T22:43:32.947694+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.947694+0000', 'last_undegraded': '2024-09-10T22:43:32.947694+0000', 'last_fullsized': '2024-09-10T22:43:32.947694+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T22:43:38.829 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2 is not active+clean 2024-09-10T22:43:38.829 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.941761+0000', 'last_change': '2024-09-10T22:43:32.941761+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.941761+0000', 'last_undegraded': '2024-09-10T22:43:32.941761+0000', 'last_fullsized': '2024-09-10T22:43:32.941761+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:43:38.829 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3 is not active+clean 2024-09-10T22:43:38.829 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.943830+0000', 'last_change': '2024-09-10T22:43:32.943830+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.943830+0000', 'last_undegraded': '2024-09-10T22:43:32.943830+0000', 'last_fullsized': '2024-09-10T22:43:32.943830+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:43:38.829 INFO:tasks.ceph.ceph_manager.ceph:PG 12.4 is not active+clean 2024-09-10T22:43:38.830 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.946720+0000', 'last_change': '2024-09-10T22:43:32.946720+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.946720+0000', 'last_undegraded': '2024-09-10T22:43:32.946720+0000', 'last_fullsized': '2024-09-10T22:43:32.946720+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T22:43:38.830 INFO:tasks.ceph.ceph_manager.ceph:PG 12.5 is not active+clean 2024-09-10T22:43:38.830 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.946666+0000', 'last_change': '2024-09-10T22:43:32.946666+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.946666+0000', 'last_undegraded': '2024-09-10T22:43:32.946666+0000', 'last_fullsized': '2024-09-10T22:43:32.946666+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T22:43:38.830 INFO:tasks.ceph.ceph_manager.ceph:PG 12.d is not active+clean 2024-09-10T22:43:38.830 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:43:32.951693+0000', 'last_change': '2024-09-10T22:43:32.951693+0000', 'last_active': '2024-09-10T22:43:32.926440+0000', 'last_peered': '2024-09-10T22:43:32.926440+0000', 'last_clean': '2024-09-10T22:43:32.926440+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:43:32.951693+0000', 'last_undegraded': '2024-09-10T22:43:32.951693+0000', 'last_fullsized': '2024-09-10T22:43:32.951693+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'last_clean_scrub_stamp': '2024-09-10T22:43:32.926440+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T22:43:38.830 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:43:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.002+0000 7f959aa00640 1 -- 172.21.15.103:0/3469849408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9578003ab0 msgr2=0x7f9578003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.002+0000 7f959aa00640 1 --2- 172.21.15.103:0/3469849408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9578003ab0 0x7f9578003ed0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f95840016f0 tx=0x7f958401c750 comp rx=0 tx=0).stop 2024-09-10T22:43:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.002+0000 7f959aa00640 1 -- 172.21.15.103:0/3469849408 shutdown_connections 2024-09-10T22:43:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.002+0000 7f959aa00640 1 --2- 172.21.15.103:0/3469849408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9578003ab0 0x7f9578003ed0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.002+0000 7f959aa00640 1 -- 172.21.15.103:0/3469849408 >> 172.21.15.103:0/3469849408 conn(0x7f95940d1ac0 msgr2=0x7f95940d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.002+0000 7f959aa00640 1 -- 172.21.15.103:0/3469849408 shutdown_connections 2024-09-10T22:43:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.002+0000 7f959aa00640 1 -- 172.21.15.103:0/3469849408 wait complete. 2024-09-10T22:43:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f959aa00640 1 Processor -- start 2024-09-10T22:43:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f959aa00640 1 -- start start 2024-09-10T22:43:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f959aa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9578003ab0 0x7f9594149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f959aa00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f959406f5c0 0x7f95940b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f959aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959406fa40 0x7f95940b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f959aa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f95940cec60 con 0x7f959406fa40 2024-09-10T22:43:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f959aa00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f95940ceae0 con 0x7f9578003ab0 2024-09-10T22:43:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f959aa00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f95940ae9c0 con 0x7f959406f5c0 2024-09-10T22:43:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f9598a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959406fa40 0x7f95940b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f9598a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959406fa40 0x7f95940b3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40224/0 (socket says 172.21.15.103:40224) 2024-09-10T22:43:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f9598a00640 1 -- 172.21.15.103:0/2982585634 learned_addr learned my addr 172.21.15.103:0/2982585634 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f9593e00640 1 --2- 172.21.15.103:0/2982585634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9578003ab0 0x7f9594149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f9593400640 1 --2- 172.21.15.103:0/2982585634 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f959406f5c0 0x7f95940b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f9598a00640 1 -- 172.21.15.103:0/2982585634 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f959406f5c0 msgr2=0x7f95940b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f9598a00640 1 --2- 172.21.15.103:0/2982585634 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f959406f5c0 0x7f95940b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f9598a00640 1 -- 172.21.15.103:0/2982585634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9578003ab0 msgr2=0x7f9594149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f9598a00640 1 --2- 172.21.15.103:0/2982585634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9578003ab0 0x7f9594149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f9598a00640 1 -- 172.21.15.103:0/2982585634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959414a410 con 0x7f959406fa40 2024-09-10T22:43:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f9598a00640 1 --2- 172.21.15.103:0/2982585634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959406fa40 0x7f95940b3af0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f95940b3580 tx=0x7f958c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f958be00640 1 -- 172.21.15.103:0/2982585634 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c004b30 con 0x7f959406fa40 2024-09-10T22:43:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f958be00640 1 -- 172.21.15.103:0/2982585634 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f958c004cd0 con 0x7f959406fa40 2024-09-10T22:43:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f959aa00640 1 -- 172.21.15.103:0/2982585634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959406dd10 con 0x7f959406fa40 2024-09-10T22:43:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f958be00640 1 -- 172.21.15.103:0/2982585634 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c003be0 con 0x7f959406fa40 2024-09-10T22:43:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f959aa00640 1 -- 172.21.15.103:0/2982585634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f959406e2d0 con 0x7f959406fa40 2024-09-10T22:43:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.006+0000 7f959aa00640 1 -- 172.21.15.103:0/2982585634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95940cede0 con 0x7f959406fa40 2024-09-10T22:43:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.010+0000 7f958be00640 1 -- 172.21.15.103:0/2982585634 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f958c018070 con 0x7f959406fa40 2024-09-10T22:43:39.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.010+0000 7f958be00640 1 --2- 172.21.15.103:0/2982585634 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9574072610 0x7f9574074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:39.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.010+0000 7f958be00640 1 -- 172.21.15.103:0/2982585634 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f958c093c60 con 0x7f959406fa40 2024-09-10T22:43:39.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.010+0000 7f9593e00640 1 --2- 172.21.15.103:0/2982585634 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9574072610 0x7f9574074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:39.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.010+0000 7f9593e00640 1 --2- 172.21.15.103:0/2982585634 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9574072610 0x7f9574074ad0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f95840016c0 tx=0x7f9584019540 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:39.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.014+0000 7f958be00640 1 -- 172.21.15.103:0/2982585634 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f958c05eb50 con 0x7f959406fa40 2024-09-10T22:43:39.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.234+0000 7f959aa00640 1 -- 172.21.15.103:0/2982585634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f95940b4180 con 0x7f959406fa40 2024-09-10T22:43:39.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.234+0000 7f958be00640 1 -- 172.21.15.103:0/2982585634 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1077 (secure 0 0 0) 0x7f958c063580 con 0x7f959406fa40 2024-09-10T22:43:39.240 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:39.240 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":314,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":81,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":57},{"state_name":"active+clean","count":40}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":255877120,"bytes_avail":772838236160,"bytes_total":773094113280,"inactive_pgs_ratio":0.58762884140014648},"fsmap":{"epoch":72,"btime":"2024-09-10T22:43:36:960842+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6873}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-10T22:43:21.688460+0000","services":{}},"progress_events":{}} 2024-09-10T22:43:39.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.238+0000 7f959aa00640 1 -- 172.21.15.103:0/2982585634 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9574072610 msgr2=0x7f9574074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:39.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.238+0000 7f959aa00640 1 --2- 172.21.15.103:0/2982585634 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9574072610 0x7f9574074ad0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f95840016c0 tx=0x7f9584019540 comp rx=0 tx=0).stop 2024-09-10T22:43:39.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.238+0000 7f959aa00640 1 -- 172.21.15.103:0/2982585634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959406fa40 msgr2=0x7f95940b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:39.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.238+0000 7f959aa00640 1 --2- 172.21.15.103:0/2982585634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959406fa40 0x7f95940b3af0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f95940b3580 tx=0x7f958c00f3c0 comp rx=0 tx=0).stop 2024-09-10T22:43:39.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.238+0000 7f959aa00640 1 -- 172.21.15.103:0/2982585634 shutdown_connections 2024-09-10T22:43:39.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.238+0000 7f959aa00640 1 --2- 172.21.15.103:0/2982585634 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9574072610 0x7f9574074ad0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:39.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.238+0000 7f959aa00640 1 --2- 172.21.15.103:0/2982585634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959406fa40 0x7f95940b3af0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:39.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.238+0000 7f959aa00640 1 --2- 172.21.15.103:0/2982585634 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f959406f5c0 0x7f95940b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:39.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.238+0000 7f959aa00640 1 --2- 172.21.15.103:0/2982585634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9578003ab0 0x7f9594149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:39.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.238+0000 7f959aa00640 1 -- 172.21.15.103:0/2982585634 >> 172.21.15.103:0/2982585634 conn(0x7f95940d1ac0 msgr2=0x7f95940d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:39.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.238+0000 7f959aa00640 1 -- 172.21.15.103:0/2982585634 shutdown_connections 2024-09-10T22:43:39.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.238+0000 7f959aa00640 1 -- 172.21.15.103:0/2982585634 wait complete. 2024-09-10T22:43:39.262 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T22:43:39.262 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:43:39.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.398+0000 7fa273e00640 1 -- 172.21.15.103:0/129531258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa26c072c10 msgr2=0x7fa26c157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:39.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.398+0000 7fa273e00640 1 --2- 172.21.15.103:0/129531258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa26c072c10 0x7fa26c157090 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fa26400ad90 tx=0x7fa26401dcb0 comp rx=0 tx=0).stop 2024-09-10T22:43:39.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.398+0000 7fa273e00640 1 -- 172.21.15.103:0/129531258 shutdown_connections 2024-09-10T22:43:39.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.398+0000 7fa273e00640 1 --2- 172.21.15.103:0/129531258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa26c072c10 0x7fa26c157090 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:39.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.398+0000 7fa273e00640 1 --2- 172.21.15.103:0/129531258 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa26c0cf260 0x7fa26c0b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:39.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.398+0000 7fa273e00640 1 -- 172.21.15.103:0/129531258 >> 172.21.15.103:0/129531258 conn(0x7fa26c06cc00 msgr2=0x7fa26c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:39.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.398+0000 7fa273e00640 1 -- 172.21.15.103:0/129531258 shutdown_connections 2024-09-10T22:43:39.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.398+0000 7fa273e00640 1 -- 172.21.15.103:0/129531258 wait complete. 2024-09-10T22:43:39.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa273e00640 1 Processor -- start 2024-09-10T22:43:39.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa273e00640 1 -- start start 2024-09-10T22:43:39.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa273e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa26c072c10 0x7fa26c148000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:39.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa273e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa26c0b3150 0x7fa26c155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:39.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa273e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa26c0cf260 0x7fa26c14aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:39.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa273e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa26c06e980 con 0x7fa26c0b3150 2024-09-10T22:43:39.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa273e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa26c06e800 con 0x7fa26c0cf260 2024-09-10T22:43:39.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa273e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa26c06eb00 con 0x7fa26c072c10 2024-09-10T22:43:39.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa270a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa26c0b3150 0x7fa26c155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:39.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa270a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa26c0b3150 0x7fa26c155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40242/0 (socket says 172.21.15.103:40242) 2024-09-10T22:43:39.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa270a00640 1 -- 172.21.15.103:0/814679610 learned_addr learned my addr 172.21.15.103:0/814679610 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:39.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa270a00640 1 -- 172.21.15.103:0/814679610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa26c072c10 msgr2=0x7fa26c148000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:39.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa270a00640 1 --2- 172.21.15.103:0/814679610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa26c072c10 0x7fa26c148000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:39.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa270a00640 1 -- 172.21.15.103:0/814679610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa26c0cf260 msgr2=0x7fa26c14aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:39.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa270a00640 1 --2- 172.21.15.103:0/814679610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa26c0cf260 0x7fa26c14aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:39.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa270a00640 1 -- 172.21.15.103:0/814679610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa26c14c4f0 con 0x7fa26c0b3150 2024-09-10T22:43:39.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa270a00640 1 --2- 172.21.15.103:0/814679610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa26c0b3150 0x7fa26c155810 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fa25800c410 tx=0x7fa25800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:39.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa269600640 1 -- 172.21.15.103:0/814679610 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa258011790 con 0x7fa26c0b3150 2024-09-10T22:43:39.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa269600640 1 -- 172.21.15.103:0/814679610 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa258017070 con 0x7fa26c0b3150 2024-09-10T22:43:39.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa269600640 1 -- 172.21.15.103:0/814679610 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa258011d00 con 0x7fa26c0b3150 2024-09-10T22:43:39.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa273e00640 1 -- 172.21.15.103:0/814679610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa26c14c7d0 con 0x7fa26c0b3150 2024-09-10T22:43:39.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.402+0000 7fa273e00640 1 -- 172.21.15.103:0/814679610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa26c148540 con 0x7fa26c0b3150 2024-09-10T22:43:39.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.406+0000 7fa273e00640 1 -- 172.21.15.103:0/814679610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa26c157090 con 0x7fa26c0b3150 2024-09-10T22:43:39.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.406+0000 7fa269600640 1 -- 172.21.15.103:0/814679610 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa25801c460 con 0x7fa26c0b3150 2024-09-10T22:43:39.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.406+0000 7fa269600640 1 --2- 172.21.15.103:0/814679610 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa24c0725e0 0x7fa24c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:39.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.406+0000 7fa269600640 1 -- 172.21.15.103:0/814679610 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fa258093110 con 0x7fa26c0b3150 2024-09-10T22:43:39.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.406+0000 7fa271400640 1 --2- 172.21.15.103:0/814679610 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa24c0725e0 0x7fa24c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:39.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.410+0000 7fa271400640 1 --2- 172.21.15.103:0/814679610 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa24c0725e0 0x7fa24c074aa0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa260009690 tx=0x7fa260006c00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:39.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.410+0000 7fa269600640 1 -- 172.21.15.103:0/814679610 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa258021020 con 0x7fa26c0b3150 2024-09-10T22:43:39.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.594+0000 7fa273e00640 1 -- 172.21.15.103:0/814679610 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa26c0aee40 con 0x7fa24c0725e0 2024-09-10T22:43:39.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.598+0000 7fa269600640 1 -- 172.21.15.103:0/814679610 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247353 (secure 0 0 0) 0x7fa26c0aee40 con 0x7fa24c0725e0 2024-09-10T22:43:39.604 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:39.605 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:43:39.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.602+0000 7fa273e00640 1 -- 172.21.15.103:0/814679610 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa24c0725e0 msgr2=0x7fa24c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:39.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.602+0000 7fa273e00640 1 --2- 172.21.15.103:0/814679610 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa24c0725e0 0x7fa24c074aa0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa260009690 tx=0x7fa260006c00 comp rx=0 tx=0).stop 2024-09-10T22:43:39.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.602+0000 7fa273e00640 1 -- 172.21.15.103:0/814679610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa26c0b3150 msgr2=0x7fa26c155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:39.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.602+0000 7fa273e00640 1 --2- 172.21.15.103:0/814679610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa26c0b3150 0x7fa26c155810 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fa25800c410 tx=0x7fa25800c8d0 comp rx=0 tx=0).stop 2024-09-10T22:43:39.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.602+0000 7fa273e00640 1 -- 172.21.15.103:0/814679610 shutdown_connections 2024-09-10T22:43:39.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.602+0000 7fa273e00640 1 --2- 172.21.15.103:0/814679610 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa24c0725e0 0x7fa24c074aa0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:39.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.602+0000 7fa273e00640 1 --2- 172.21.15.103:0/814679610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa26c0cf260 0x7fa26c14aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:39.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.602+0000 7fa273e00640 1 --2- 172.21.15.103:0/814679610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa26c0b3150 0x7fa26c155810 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:39.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.602+0000 7fa273e00640 1 --2- 172.21.15.103:0/814679610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa26c072c10 0x7fa26c148000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:39.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.602+0000 7fa273e00640 1 -- 172.21.15.103:0/814679610 >> 172.21.15.103:0/814679610 conn(0x7fa26c06cc00 msgr2=0x7fa26c152420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:39.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.602+0000 7fa273e00640 1 -- 172.21.15.103:0/814679610 shutdown_connections 2024-09-10T22:43:39.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:39.602+0000 7fa273e00640 1 -- 172.21.15.103:0/814679610 wait complete. 2024-09-10T22:43:39.624 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-09-10T22:43:37.692567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249880,"kb_used_data":8680,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754724840,"statfs":{"total":773094113280,"available":772838236160,"internally_reserved":0,"allocated":8888320,"data_stored":4694195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.764481"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.951475+0000","last_change":"2024-09-10T22:43:32.951475+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.951475+0000","last_undegraded":"2024-09-10T22:43:32.951475+0000","last_fullsized":"2024-09-10T22:43:32.951475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947322+0000","last_change":"2024-09-10T22:43:32.947322+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947322+0000","last_undegraded":"2024-09-10T22:43:32.947322+0000","last_fullsized":"2024-09-10T22:43:32.947322+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985233+0000","last_change":"2024-09-10T22:43:33.973232+0000","last_active":"2024-09-10T22:43:34.985233+0000","last_peered":"2024-09-10T22:43:34.985233+0000","last_clean":"2024-09-10T22:43:34.985233+0000","last_became_active":"2024-09-10T22:43:33.972856+0000","last_became_peered":"2024-09-10T22:43:33.972856+0000","last_unstale":"2024-09-10T22:43:34.985233+0000","last_undegraded":"2024-09-10T22:43:34.985233+0000","last_fullsized":"2024-09-10T22:43:34.985233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:34.575975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.946226+0000","last_change":"2024-09-10T22:43:32.946226+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.946226+0000","last_undegraded":"2024-09-10T22:43:32.946226+0000","last_fullsized":"2024-09-10T22:43:32.946226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.953166+0000","last_change":"2024-09-10T22:43:32.953166+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.953166+0000","last_undegraded":"2024-09-10T22:43:32.953166+0000","last_fullsized":"2024-09-10T22:43:32.953166+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941315+0000","last_change":"2024-09-10T22:43:32.941315+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941315+0000","last_undegraded":"2024-09-10T22:43:32.941315+0000","last_fullsized":"2024-09-10T22:43:32.941315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948239+0000","last_change":"2024-09-10T22:43:32.948239+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948239+0000","last_undegraded":"2024-09-10T22:43:32.948239+0000","last_fullsized":"2024-09-10T22:43:32.948239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.954722+0000","last_change":"2024-09-10T22:43:32.954722+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.954722+0000","last_undegraded":"2024-09-10T22:43:32.954722+0000","last_fullsized":"2024-09-10T22:43:32.954722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941603+0000","last_change":"2024-09-10T22:43:32.941603+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941603+0000","last_undegraded":"2024-09-10T22:43:32.941603+0000","last_fullsized":"2024-09-10T22:43:32.941603+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945152+0000","last_change":"2024-09-10T22:43:32.945152+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945152+0000","last_undegraded":"2024-09-10T22:43:32.945152+0000","last_fullsized":"2024-09-10T22:43:32.945152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947411+0000","last_change":"2024-09-10T22:43:32.947411+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947411+0000","last_undegraded":"2024-09-10T22:43:32.947411+0000","last_fullsized":"2024-09-10T22:43:32.947411+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945801+0000","last_change":"2024-09-10T22:43:32.945801+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945801+0000","last_undegraded":"2024-09-10T22:43:32.945801+0000","last_fullsized":"2024-09-10T22:43:32.945801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.952726+0000","last_change":"2024-09-10T22:43:32.952726+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.952726+0000","last_undegraded":"2024-09-10T22:43:32.952726+0000","last_fullsized":"2024-09-10T22:43:32.952726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.940828+0000","last_change":"2024-09-10T22:43:32.940828+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.940828+0000","last_undegraded":"2024-09-10T22:43:32.940828+0000","last_fullsized":"2024-09-10T22:43:32.940828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945854+0000","last_change":"2024-09-10T22:43:32.945854+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945854+0000","last_undegraded":"2024-09-10T22:43:32.945854+0000","last_fullsized":"2024-09-10T22:43:32.945854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948406+0000","last_change":"2024-09-10T22:43:32.948406+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948406+0000","last_undegraded":"2024-09-10T22:43:32.948406+0000","last_fullsized":"2024-09-10T22:43:32.948406+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.949052+0000","last_change":"2024-09-10T22:43:32.949052+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.949052+0000","last_undegraded":"2024-09-10T22:43:32.949052+0000","last_fullsized":"2024-09-10T22:43:32.949052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985109+0000","last_change":"2024-09-10T22:43:33.969132+0000","last_active":"2024-09-10T22:43:34.985109+0000","last_peered":"2024-09-10T22:43:34.985109+0000","last_clean":"2024-09-10T22:43:34.985109+0000","last_became_active":"2024-09-10T22:43:33.966818+0000","last_became_peered":"2024-09-10T22:43:33.966818+0000","last_unstale":"2024-09-10T22:43:34.985109+0000","last_undegraded":"2024-09-10T22:43:34.985109+0000","last_fullsized":"2024-09-10T22:43:34.985109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:46.251681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941375+0000","last_change":"2024-09-10T22:43:32.941375+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941375+0000","last_undegraded":"2024-09-10T22:43:32.941375+0000","last_fullsized":"2024-09-10T22:43:32.941375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948950+0000","last_change":"2024-09-10T22:43:32.948950+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948950+0000","last_undegraded":"2024-09-10T22:43:32.948950+0000","last_fullsized":"2024-09-10T22:43:32.948950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.942523+0000","last_change":"2024-09-10T22:43:32.942523+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.942523+0000","last_undegraded":"2024-09-10T22:43:32.942523+0000","last_fullsized":"2024-09-10T22:43:32.942523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.956163+0000","last_change":"2024-09-10T22:43:32.956163+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.956163+0000","last_undegraded":"2024-09-10T22:43:32.956163+0000","last_fullsized":"2024-09-10T22:43:32.956163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941593+0000","last_change":"2024-09-10T22:43:32.941593+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941593+0000","last_undegraded":"2024-09-10T22:43:32.941593+0000","last_fullsized":"2024-09-10T22:43:32.941593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.946286+0000","last_change":"2024-09-10T22:43:32.946286+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.946286+0000","last_undegraded":"2024-09-10T22:43:32.946286+0000","last_fullsized":"2024-09-10T22:43:32.946286+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945893+0000","last_change":"2024-09-10T22:43:32.945893+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945893+0000","last_undegraded":"2024-09-10T22:43:32.945893+0000","last_fullsized":"2024-09-10T22:43:32.945893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.944646+0000","last_change":"2024-09-10T22:43:32.944646+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.944646+0000","last_undegraded":"2024-09-10T22:43:32.944646+0000","last_fullsized":"2024-09-10T22:43:32.944646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.952160+0000","last_change":"2024-09-10T22:43:32.952160+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.952160+0000","last_undegraded":"2024-09-10T22:43:32.952160+0000","last_fullsized":"2024-09-10T22:43:32.952160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948502+0000","last_change":"2024-09-10T22:43:32.948502+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948502+0000","last_undegraded":"2024-09-10T22:43:32.948502+0000","last_fullsized":"2024-09-10T22:43:32.948502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945870+0000","last_change":"2024-09-10T22:43:32.945870+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945870+0000","last_undegraded":"2024-09-10T22:43:32.945870+0000","last_fullsized":"2024-09-10T22:43:32.945870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948973+0000","last_change":"2024-09-10T22:43:32.948973+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948973+0000","last_undegraded":"2024-09-10T22:43:32.948973+0000","last_fullsized":"2024-09-10T22:43:32.948973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984879+0000","last_change":"2024-09-10T22:43:33.960463+0000","last_active":"2024-09-10T22:43:34.984879+0000","last_peered":"2024-09-10T22:43:34.984879+0000","last_clean":"2024-09-10T22:43:34.984879+0000","last_became_active":"2024-09-10T22:43:33.957699+0000","last_became_peered":"2024-09-10T22:43:33.957699+0000","last_unstale":"2024-09-10T22:43:34.984879+0000","last_undegraded":"2024-09-10T22:43:34.984879+0000","last_fullsized":"2024-09-10T22:43:34.984879+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:17.832049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947954+0000","last_change":"2024-09-10T22:43:32.947954+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947954+0000","last_undegraded":"2024-09-10T22:43:32.947954+0000","last_fullsized":"2024-09-10T22:43:32.947954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984549+0000","last_change":"2024-09-10T22:43:33.966343+0000","last_active":"2024-09-10T22:43:34.984549+0000","last_peered":"2024-09-10T22:43:34.984549+0000","last_clean":"2024-09-10T22:43:34.984549+0000","last_became_active":"2024-09-10T22:43:33.966077+0000","last_became_peered":"2024-09-10T22:43:33.966077+0000","last_unstale":"2024-09-10T22:43:34.984549+0000","last_undegraded":"2024-09-10T22:43:34.984549+0000","last_fullsized":"2024-09-10T22:43:34.984549+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:11.532561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.965154+0000","last_change":"2024-09-10T22:43:32.957567+0000","last_active":"2024-09-10T22:43:32.965154+0000","last_peered":"2024-09-10T22:43:32.965154+0000","last_clean":"2024-09-10T22:43:32.965154+0000","last_became_active":"2024-09-10T22:43:32.957316+0000","last_became_peered":"2024-09-10T22:43:32.957316+0000","last_unstale":"2024-09-10T22:43:32.965154+0000","last_undegraded":"2024-09-10T22:43:32.965154+0000","last_fullsized":"2024-09-10T22:43:32.965154+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:08.694787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.943839+0000","last_change":"2024-09-10T22:43:32.943839+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.943839+0000","last_undegraded":"2024-09-10T22:43:32.943839+0000","last_fullsized":"2024-09-10T22:43:32.943839+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964327+0000","last_change":"2024-09-10T22:43:32.962321+0000","last_active":"2024-09-10T22:43:32.964327+0000","last_peered":"2024-09-10T22:43:32.964327+0000","last_clean":"2024-09-10T22:43:32.964327+0000","last_became_active":"2024-09-10T22:43:32.961642+0000","last_became_peered":"2024-09-10T22:43:32.961642+0000","last_unstale":"2024-09-10T22:43:32.964327+0000","last_undegraded":"2024-09-10T22:43:32.964327+0000","last_fullsized":"2024-09-10T22:43:32.964327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:54.835911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.942392+0000","last_change":"2024-09-10T22:43:32.942392+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.942392+0000","last_undegraded":"2024-09-10T22:43:32.942392+0000","last_fullsized":"2024-09-10T22:43:32.942392+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.971260+0000","last_change":"2024-09-10T22:43:32.964868+0000","last_active":"2024-09-10T22:43:32.971260+0000","last_peered":"2024-09-10T22:43:32.971260+0000","last_clean":"2024-09-10T22:43:32.971260+0000","last_became_active":"2024-09-10T22:43:32.964629+0000","last_became_peered":"2024-09-10T22:43:32.964629+0000","last_unstale":"2024-09-10T22:43:32.971260+0000","last_undegraded":"2024-09-10T22:43:32.971260+0000","last_fullsized":"2024-09-10T22:43:32.971260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:11.767542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941614+0000","last_change":"2024-09-10T22:43:32.941614+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941614+0000","last_undegraded":"2024-09-10T22:43:32.941614+0000","last_fullsized":"2024-09-10T22:43:32.941614+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.961669+0000","last_change":"2024-09-10T22:43:32.957956+0000","last_active":"2024-09-10T22:43:32.961669+0000","last_peered":"2024-09-10T22:43:32.961669+0000","last_clean":"2024-09-10T22:43:32.961669+0000","last_became_active":"2024-09-10T22:43:32.957370+0000","last_became_peered":"2024-09-10T22:43:32.957370+0000","last_unstale":"2024-09-10T22:43:32.961669+0000","last_undegraded":"2024-09-10T22:43:32.961669+0000","last_fullsized":"2024-09-10T22:43:32.961669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:13.681326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.944400+0000","last_change":"2024-09-10T22:43:32.944400+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.944400+0000","last_undegraded":"2024-09-10T22:43:32.944400+0000","last_fullsized":"2024-09-10T22:43:32.944400+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964022+0000","last_change":"2024-09-10T22:43:32.958500+0000","last_active":"2024-09-10T22:43:32.964022+0000","last_peered":"2024-09-10T22:43:32.964022+0000","last_clean":"2024-09-10T22:43:32.964022+0000","last_became_active":"2024-09-10T22:43:32.957266+0000","last_became_peered":"2024-09-10T22:43:32.957266+0000","last_unstale":"2024-09-10T22:43:32.964022+0000","last_undegraded":"2024-09-10T22:43:32.964022+0000","last_fullsized":"2024-09-10T22:43:32.964022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:02.384231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945488+0000","last_change":"2024-09-10T22:43:32.945488+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945488+0000","last_undegraded":"2024-09-10T22:43:32.945488+0000","last_fullsized":"2024-09-10T22:43:32.945488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.958460+0000","last_change":"2024-09-10T22:43:32.954519+0000","last_active":"2024-09-10T22:43:32.958460+0000","last_peered":"2024-09-10T22:43:32.958460+0000","last_clean":"2024-09-10T22:43:32.958460+0000","last_became_active":"2024-09-10T22:43:32.954235+0000","last_became_peered":"2024-09-10T22:43:32.954235+0000","last_unstale":"2024-09-10T22:43:32.958460+0000","last_undegraded":"2024-09-10T22:43:32.958460+0000","last_fullsized":"2024-09-10T22:43:32.958460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:29.999024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941897+0000","last_change":"2024-09-10T22:43:32.941897+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941897+0000","last_undegraded":"2024-09-10T22:43:32.941897+0000","last_fullsized":"2024-09-10T22:43:32.941897+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.962716+0000","last_change":"2024-09-10T22:43:32.953990+0000","last_active":"2024-09-10T22:43:32.962716+0000","last_peered":"2024-09-10T22:43:32.962716+0000","last_clean":"2024-09-10T22:43:32.962716+0000","last_became_active":"2024-09-10T22:43:32.953759+0000","last_became_peered":"2024-09-10T22:43:32.953759+0000","last_unstale":"2024-09-10T22:43:32.962716+0000","last_undegraded":"2024-09-10T22:43:32.962716+0000","last_fullsized":"2024-09-10T22:43:32.962716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:31.925280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948623+0000","last_change":"2024-09-10T22:43:32.948623+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948623+0000","last_undegraded":"2024-09-10T22:43:32.948623+0000","last_fullsized":"2024-09-10T22:43:32.948623+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.971105+0000","last_change":"2024-09-10T22:43:32.966902+0000","last_active":"2024-09-10T22:43:32.971105+0000","last_peered":"2024-09-10T22:43:32.971105+0000","last_clean":"2024-09-10T22:43:32.971105+0000","last_became_active":"2024-09-10T22:43:32.966674+0000","last_became_peered":"2024-09-10T22:43:32.966674+0000","last_unstale":"2024-09-10T22:43:32.971105+0000","last_undegraded":"2024-09-10T22:43:32.971105+0000","last_fullsized":"2024-09-10T22:43:32.971105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:05.242861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.944324+0000","last_change":"2024-09-10T22:43:32.944324+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.944324+0000","last_undegraded":"2024-09-10T22:43:32.944324+0000","last_fullsized":"2024-09-10T22:43:32.944324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964304+0000","last_change":"2024-09-10T22:43:32.960867+0000","last_active":"2024-09-10T22:43:32.964304+0000","last_peered":"2024-09-10T22:43:32.964304+0000","last_clean":"2024-09-10T22:43:32.964304+0000","last_became_active":"2024-09-10T22:43:32.960572+0000","last_became_peered":"2024-09-10T22:43:32.960572+0000","last_unstale":"2024-09-10T22:43:32.964304+0000","last_undegraded":"2024-09-10T22:43:32.964304+0000","last_fullsized":"2024-09-10T22:43:32.964304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:29.999024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.944516+0000","last_change":"2024-09-10T22:43:32.944516+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.944516+0000","last_undegraded":"2024-09-10T22:43:32.944516+0000","last_fullsized":"2024-09-10T22:43:32.944516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.959985+0000","last_change":"2024-09-10T22:43:32.956895+0000","last_active":"2024-09-10T22:43:32.959985+0000","last_peered":"2024-09-10T22:43:32.959985+0000","last_clean":"2024-09-10T22:43:32.959985+0000","last_became_active":"2024-09-10T22:43:32.956558+0000","last_became_peered":"2024-09-10T22:43:32.956558+0000","last_unstale":"2024-09-10T22:43:32.959985+0000","last_undegraded":"2024-09-10T22:43:32.959985+0000","last_fullsized":"2024-09-10T22:43:32.959985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:54.835911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.940234+0000","last_change":"2024-09-10T22:43:32.940234+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.940234+0000","last_undegraded":"2024-09-10T22:43:32.940234+0000","last_fullsized":"2024-09-10T22:43:32.940234+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.969693+0000","last_change":"2024-09-10T22:43:32.966412+0000","last_active":"2024-09-10T22:43:32.969693+0000","last_peered":"2024-09-10T22:43:32.969693+0000","last_clean":"2024-09-10T22:43:32.969693+0000","last_became_active":"2024-09-10T22:43:32.966135+0000","last_became_peered":"2024-09-10T22:43:32.966135+0000","last_unstale":"2024-09-10T22:43:32.969693+0000","last_undegraded":"2024-09-10T22:43:32.969693+0000","last_fullsized":"2024-09-10T22:43:32.969693+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:44.606825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984806+0000","last_change":"2024-09-10T22:43:33.970411+0000","last_active":"2024-09-10T22:43:34.984806+0000","last_peered":"2024-09-10T22:43:34.984806+0000","last_clean":"2024-09-10T22:43:34.984806+0000","last_became_active":"2024-09-10T22:43:33.969898+0000","last_became_peered":"2024-09-10T22:43:33.969898+0000","last_unstale":"2024-09-10T22:43:34.984806+0000","last_undegraded":"2024-09-10T22:43:34.984806+0000","last_fullsized":"2024-09-10T22:43:34.984806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:52.448989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.961695+0000","last_change":"2024-09-10T22:43:32.958074+0000","last_active":"2024-09-10T22:43:32.961695+0000","last_peered":"2024-09-10T22:43:32.961695+0000","last_clean":"2024-09-10T22:43:32.961695+0000","last_became_active":"2024-09-10T22:43:32.957692+0000","last_became_peered":"2024-09-10T22:43:32.957692+0000","last_unstale":"2024-09-10T22:43:32.961695+0000","last_undegraded":"2024-09-10T22:43:32.961695+0000","last_fullsized":"2024-09-10T22:43:32.961695+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:21:46.363669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.945092+0000","last_change":"2024-09-10T22:43:32.945092+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.945092+0000","last_undegraded":"2024-09-10T22:43:32.945092+0000","last_fullsized":"2024-09-10T22:43:32.945092+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.958387+0000","last_change":"2024-09-10T22:43:32.953419+0000","last_active":"2024-09-10T22:43:32.958387+0000","last_peered":"2024-09-10T22:43:32.958387+0000","last_clean":"2024-09-10T22:43:32.958387+0000","last_became_active":"2024-09-10T22:43:32.953109+0000","last_became_peered":"2024-09-10T22:43:32.953109+0000","last_unstale":"2024-09-10T22:43:32.958387+0000","last_undegraded":"2024-09-10T22:43:32.958387+0000","last_fullsized":"2024-09-10T22:43:32.958387+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:53.675442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947164+0000","last_change":"2024-09-10T22:43:32.947164+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947164+0000","last_undegraded":"2024-09-10T22:43:32.947164+0000","last_fullsized":"2024-09-10T22:43:32.947164+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.971773+0000","last_change":"2024-09-10T22:43:32.968272+0000","last_active":"2024-09-10T22:43:32.971773+0000","last_peered":"2024-09-10T22:43:32.971773+0000","last_clean":"2024-09-10T22:43:32.971773+0000","last_became_active":"2024-09-10T22:43:32.967987+0000","last_became_peered":"2024-09-10T22:43:32.967987+0000","last_unstale":"2024-09-10T22:43:32.971773+0000","last_undegraded":"2024-09-10T22:43:32.971773+0000","last_fullsized":"2024-09-10T22:43:32.971773+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:10:05.503295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947167+0000","last_change":"2024-09-10T22:43:32.947167+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947167+0000","last_undegraded":"2024-09-10T22:43:32.947167+0000","last_fullsized":"2024-09-10T22:43:32.947167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.969684+0000","last_change":"2024-09-10T22:43:32.964152+0000","last_active":"2024-09-10T22:43:32.969684+0000","last_peered":"2024-09-10T22:43:32.969684+0000","last_clean":"2024-09-10T22:43:32.969684+0000","last_became_active":"2024-09-10T22:43:32.963908+0000","last_became_peered":"2024-09-10T22:43:32.963908+0000","last_unstale":"2024-09-10T22:43:32.969684+0000","last_undegraded":"2024-09-10T22:43:32.969684+0000","last_fullsized":"2024-09-10T22:43:32.969684+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:27.359912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.948148+0000","last_change":"2024-09-10T22:43:32.948148+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.948148+0000","last_undegraded":"2024-09-10T22:43:32.948148+0000","last_fullsized":"2024-09-10T22:43:32.948148+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964536+0000","last_change":"2024-09-10T22:43:32.957309+0000","last_active":"2024-09-10T22:43:32.964536+0000","last_peered":"2024-09-10T22:43:32.964536+0000","last_clean":"2024-09-10T22:43:32.964536+0000","last_became_active":"2024-09-10T22:43:32.956954+0000","last_became_peered":"2024-09-10T22:43:32.956954+0000","last_unstale":"2024-09-10T22:43:32.964536+0000","last_undegraded":"2024-09-10T22:43:32.964536+0000","last_fullsized":"2024-09-10T22:43:32.964536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:17.047894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.940872+0000","last_change":"2024-09-10T22:43:32.940872+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.940872+0000","last_undegraded":"2024-09-10T22:43:32.940872+0000","last_fullsized":"2024-09-10T22:43:32.940872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.971745+0000","last_change":"2024-09-10T22:43:32.967130+0000","last_active":"2024-09-10T22:43:32.971745+0000","last_peered":"2024-09-10T22:43:32.971745+0000","last_clean":"2024-09-10T22:43:32.971745+0000","last_became_active":"2024-09-10T22:43:32.966886+0000","last_became_peered":"2024-09-10T22:43:32.966886+0000","last_unstale":"2024-09-10T22:43:32.971745+0000","last_undegraded":"2024-09-10T22:43:32.971745+0000","last_fullsized":"2024-09-10T22:43:32.971745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:13:26.884998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.956136+0000","last_change":"2024-09-10T22:43:32.956136+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.956136+0000","last_undegraded":"2024-09-10T22:43:32.956136+0000","last_fullsized":"2024-09-10T22:43:32.956136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.968847+0000","last_change":"2024-09-10T22:43:32.963980+0000","last_active":"2024-09-10T22:43:32.968847+0000","last_peered":"2024-09-10T22:43:32.968847+0000","last_clean":"2024-09-10T22:43:32.968847+0000","last_became_active":"2024-09-10T22:43:32.962919+0000","last_became_peered":"2024-09-10T22:43:32.962919+0000","last_unstale":"2024-09-10T22:43:32.968847+0000","last_undegraded":"2024-09-10T22:43:32.968847+0000","last_fullsized":"2024-09-10T22:43:32.968847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:17.002563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.956625+0000","last_change":"2024-09-10T22:43:32.956625+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.956625+0000","last_undegraded":"2024-09-10T22:43:32.956625+0000","last_fullsized":"2024-09-10T22:43:32.956625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.965287+0000","last_change":"2024-09-10T22:43:32.960405+0000","last_active":"2024-09-10T22:43:32.965287+0000","last_peered":"2024-09-10T22:43:32.965287+0000","last_clean":"2024-09-10T22:43:32.965287+0000","last_became_active":"2024-09-10T22:43:32.958442+0000","last_became_peered":"2024-09-10T22:43:32.958442+0000","last_unstale":"2024-09-10T22:43:32.965287+0000","last_undegraded":"2024-09-10T22:43:32.965287+0000","last_fullsized":"2024-09-10T22:43:32.965287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:14.818760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941442+0000","last_change":"2024-09-10T22:43:32.941442+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941442+0000","last_undegraded":"2024-09-10T22:43:32.941442+0000","last_fullsized":"2024-09-10T22:43:32.941442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984708+0000","last_change":"2024-09-10T22:43:32.964908+0000","last_active":"2024-09-10T22:43:34.984708+0000","last_peered":"2024-09-10T22:43:34.984708+0000","last_clean":"2024-09-10T22:43:34.984708+0000","last_became_active":"2024-09-10T22:43:32.964611+0000","last_became_peered":"2024-09-10T22:43:32.964611+0000","last_unstale":"2024-09-10T22:43:34.984708+0000","last_undegraded":"2024-09-10T22:43:34.984708+0000","last_fullsized":"2024-09-10T22:43:34.984708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:02.693878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.943946+0000","last_change":"2024-09-10T22:43:32.943946+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.943946+0000","last_undegraded":"2024-09-10T22:43:32.943946+0000","last_fullsized":"2024-09-10T22:43:32.943946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.967678+0000","last_change":"2024-09-10T22:43:32.961790+0000","last_active":"2024-09-10T22:43:32.967678+0000","last_peered":"2024-09-10T22:43:32.967678+0000","last_clean":"2024-09-10T22:43:32.967678+0000","last_became_active":"2024-09-10T22:43:32.961323+0000","last_became_peered":"2024-09-10T22:43:32.961323+0000","last_unstale":"2024-09-10T22:43:32.967678+0000","last_undegraded":"2024-09-10T22:43:32.967678+0000","last_fullsized":"2024-09-10T22:43:32.967678+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:15.339385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.943860+0000","last_change":"2024-09-10T22:43:32.943860+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.943860+0000","last_undegraded":"2024-09-10T22:43:32.943860+0000","last_fullsized":"2024-09-10T22:43:32.943860+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.967675+0000","last_change":"2024-09-10T22:43:32.960678+0000","last_active":"2024-09-10T22:43:32.967675+0000","last_peered":"2024-09-10T22:43:32.967675+0000","last_clean":"2024-09-10T22:43:32.967675+0000","last_became_active":"2024-09-10T22:43:32.959289+0000","last_became_peered":"2024-09-10T22:43:32.959289+0000","last_unstale":"2024-09-10T22:43:32.967675+0000","last_undegraded":"2024-09-10T22:43:32.967675+0000","last_fullsized":"2024-09-10T22:43:32.967675+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:56.905762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947725+0000","last_change":"2024-09-10T22:43:32.947725+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947725+0000","last_undegraded":"2024-09-10T22:43:32.947725+0000","last_fullsized":"2024-09-10T22:43:32.947725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.964622+0000","last_change":"2024-09-10T22:43:32.958892+0000","last_active":"2024-09-10T22:43:32.964622+0000","last_peered":"2024-09-10T22:43:32.964622+0000","last_clean":"2024-09-10T22:43:32.964622+0000","last_became_active":"2024-09-10T22:43:32.957384+0000","last_became_peered":"2024-09-10T22:43:32.957384+0000","last_unstale":"2024-09-10T22:43:32.964622+0000","last_undegraded":"2024-09-10T22:43:32.964622+0000","last_fullsized":"2024-09-10T22:43:32.964622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:54.693425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941617+0000","last_change":"2024-09-10T22:43:32.941617+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941617+0000","last_undegraded":"2024-09-10T22:43:32.941617+0000","last_fullsized":"2024-09-10T22:43:32.941617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.966361+0000","last_change":"2024-09-10T22:43:32.962599+0000","last_active":"2024-09-10T22:43:32.966361+0000","last_peered":"2024-09-10T22:43:32.966361+0000","last_clean":"2024-09-10T22:43:32.966361+0000","last_became_active":"2024-09-10T22:43:32.962196+0000","last_became_peered":"2024-09-10T22:43:32.962196+0000","last_unstale":"2024-09-10T22:43:32.966361+0000","last_undegraded":"2024-09-10T22:43:32.966361+0000","last_fullsized":"2024-09-10T22:43:32.966361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:21.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.947694+0000","last_change":"2024-09-10T22:43:32.947694+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.947694+0000","last_undegraded":"2024-09-10T22:43:32.947694+0000","last_fullsized":"2024-09-10T22:43:32.947694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.959386+0000","last_change":"2024-09-10T22:43:32.953544+0000","last_active":"2024-09-10T22:43:32.959386+0000","last_peered":"2024-09-10T22:43:32.959386+0000","last_clean":"2024-09-10T22:43:32.959386+0000","last_became_active":"2024-09-10T22:43:32.951997+0000","last_became_peered":"2024-09-10T22:43:32.951997+0000","last_unstale":"2024-09-10T22:43:32.959386+0000","last_undegraded":"2024-09-10T22:43:32.959386+0000","last_fullsized":"2024-09-10T22:43:32.959386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:09.778155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.941761+0000","last_change":"2024-09-10T22:43:32.941761+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.941761+0000","last_undegraded":"2024-09-10T22:43:32.941761+0000","last_fullsized":"2024-09-10T22:43:32.941761+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.966445+0000","last_change":"2024-09-10T22:43:32.962093+0000","last_active":"2024-09-10T22:43:32.966445+0000","last_peered":"2024-09-10T22:43:32.966445+0000","last_clean":"2024-09-10T22:43:32.966445+0000","last_became_active":"2024-09-10T22:43:32.961715+0000","last_became_peered":"2024-09-10T22:43:32.961715+0000","last_unstale":"2024-09-10T22:43:32.966445+0000","last_undegraded":"2024-09-10T22:43:32.966445+0000","last_fullsized":"2024-09-10T22:43:32.966445+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:21.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.943830+0000","last_change":"2024-09-10T22:43:32.943830+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.943830+0000","last_undegraded":"2024-09-10T22:43:32.943830+0000","last_fullsized":"2024-09-10T22:43:32.943830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.963636+0000","last_change":"2024-09-10T22:43:32.960870+0000","last_active":"2024-09-10T22:43:32.963636+0000","last_peered":"2024-09-10T22:43:32.963636+0000","last_clean":"2024-09-10T22:43:32.963636+0000","last_became_active":"2024-09-10T22:43:32.960525+0000","last_became_peered":"2024-09-10T22:43:32.960525+0000","last_unstale":"2024-09-10T22:43:32.963636+0000","last_undegraded":"2024-09-10T22:43:32.963636+0000","last_fullsized":"2024-09-10T22:43:32.963636+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:53.675442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.946720+0000","last_change":"2024-09-10T22:43:32.946720+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.946720+0000","last_undegraded":"2024-09-10T22:43:32.946720+0000","last_fullsized":"2024-09-10T22:43:32.946720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.961451+0000","last_change":"2024-09-10T22:43:32.957617+0000","last_active":"2024-09-10T22:43:32.961451+0000","last_peered":"2024-09-10T22:43:32.961451+0000","last_clean":"2024-09-10T22:43:32.961451+0000","last_became_active":"2024-09-10T22:43:32.957258+0000","last_became_peered":"2024-09-10T22:43:32.957258+0000","last_unstale":"2024-09-10T22:43:32.961451+0000","last_undegraded":"2024-09-10T22:43:32.961451+0000","last_fullsized":"2024-09-10T22:43:32.961451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:56.607363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.946666+0000","last_change":"2024-09-10T22:43:32.946666+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.946666+0000","last_undegraded":"2024-09-10T22:43:32.946666+0000","last_fullsized":"2024-09-10T22:43:32.946666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.967276+0000","last_change":"2024-09-10T22:43:32.963621+0000","last_active":"2024-09-10T22:43:32.967276+0000","last_peered":"2024-09-10T22:43:32.967276+0000","last_clean":"2024-09-10T22:43:32.967276+0000","last_became_active":"2024-09-10T22:43:32.962527+0000","last_became_peered":"2024-09-10T22:43:32.962527+0000","last_unstale":"2024-09-10T22:43:32.967276+0000","last_undegraded":"2024-09-10T22:43:32.967276+0000","last_fullsized":"2024-09-10T22:43:32.967276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:44.356842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985281+0000","last_change":"2024-09-10T22:43:33.973798+0000","last_active":"2024-09-10T22:43:34.985281+0000","last_peered":"2024-09-10T22:43:34.985281+0000","last_clean":"2024-09-10T22:43:34.985281+0000","last_became_active":"2024-09-10T22:43:33.973289+0000","last_became_peered":"2024-09-10T22:43:33.973289+0000","last_unstale":"2024-09-10T22:43:34.985281+0000","last_undegraded":"2024-09-10T22:43:34.985281+0000","last_fullsized":"2024-09-10T22:43:34.985281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:55.398034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.961857+0000","last_change":"2024-09-10T22:43:32.958396+0000","last_active":"2024-09-10T22:43:32.961857+0000","last_peered":"2024-09-10T22:43:32.961857+0000","last_clean":"2024-09-10T22:43:32.961857+0000","last_became_active":"2024-09-10T22:43:32.957943+0000","last_became_peered":"2024-09-10T22:43:32.957943+0000","last_unstale":"2024-09-10T22:43:32.961857+0000","last_undegraded":"2024-09-10T22:43:32.961857+0000","last_fullsized":"2024-09-10T22:43:32.961857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:34.240762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985487+0000","last_change":"2024-09-10T22:43:33.963110+0000","last_active":"2024-09-10T22:43:34.985487+0000","last_peered":"2024-09-10T22:43:34.985487+0000","last_clean":"2024-09-10T22:43:34.985487+0000","last_became_active":"2024-09-10T22:43:33.962823+0000","last_became_peered":"2024-09-10T22:43:33.962823+0000","last_unstale":"2024-09-10T22:43:34.985487+0000","last_undegraded":"2024-09-10T22:43:34.985487+0000","last_fullsized":"2024-09-10T22:43:34.985487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:43.287722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984617+0000","last_change":"2024-09-10T22:43:32.962997+0000","last_active":"2024-09-10T22:43:34.984617+0000","last_peered":"2024-09-10T22:43:34.984617+0000","last_clean":"2024-09-10T22:43:34.984617+0000","last_became_active":"2024-09-10T22:43:32.961399+0000","last_became_peered":"2024-09-10T22:43:32.961399+0000","last_unstale":"2024-09-10T22:43:34.984617+0000","last_undegraded":"2024-09-10T22:43:34.984617+0000","last_fullsized":"2024-09-10T22:43:34.984617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:56.079546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-10T22:43:32.951693+0000","last_change":"2024-09-10T22:43:32.951693+0000","last_active":"2024-09-10T22:43:32.926440+0000","last_peered":"2024-09-10T22:43:32.926440+0000","last_clean":"2024-09-10T22:43:32.926440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:43:32.951693+0000","last_undegraded":"2024-09-10T22:43:32.951693+0000","last_fullsized":"2024-09-10T22:43:32.951693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.967563+0000","last_change":"2024-09-10T22:43:32.959873+0000","last_active":"2024-09-10T22:43:32.967563+0000","last_peered":"2024-09-10T22:43:32.967563+0000","last_clean":"2024-09-10T22:43:32.967563+0000","last_became_active":"2024-09-10T22:43:32.959583+0000","last_became_peered":"2024-09-10T22:43:32.959583+0000","last_unstale":"2024-09-10T22:43:32.967563+0000","last_undegraded":"2024-09-10T22:43:32.967563+0000","last_fullsized":"2024-09-10T22:43:32.967563+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:57.043203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":218,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-10T22:43:32.952078+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:43:32.952078+0000","last_peered":"2024-09-10T22:43:32.952078+0000","last_clean":"2024-09-10T22:43:32.952078+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:43:32.952078+0000","last_undegraded":"2024-09-10T22:43:32.952078+0000","last_fullsized":"2024-09-10T22:43:32.952078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509502,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1552384,"data_stored":1027804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509502,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509503,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509502,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":958464,"data_stored":437436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509502,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1552384,"data_stored":1027804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":991232,"data_stored":451407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:43:42.629 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:43:42.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.778+0000 7fdad8800640 1 -- 172.21.15.103:0/492181841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad015be30 msgr2=0x7fdad00ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:42.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.778+0000 7fdad8800640 1 --2- 172.21.15.103:0/492181841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad015be30 0x7fdad00ce0c0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009840 tx=0x7fdac401c790 comp rx=0 tx=0).stop 2024-09-10T22:43:42.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.778+0000 7fdad8800640 1 -- 172.21.15.103:0/492181841 shutdown_connections 2024-09-10T22:43:42.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.778+0000 7fdad8800640 1 --2- 172.21.15.103:0/492181841 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdad00b09c0 0x7fdad00ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:42.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.778+0000 7fdad8800640 1 --2- 172.21.15.103:0/492181841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad015be30 0x7fdad00ce0c0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:42.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.778+0000 7fdad8800640 1 -- 172.21.15.103:0/492181841 >> 172.21.15.103:0/492181841 conn(0x7fdad00d1ac0 msgr2=0x7fdad00d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:42.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.778+0000 7fdad8800640 1 -- 172.21.15.103:0/492181841 shutdown_connections 2024-09-10T22:43:42.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.778+0000 7fdad8800640 1 -- 172.21.15.103:0/492181841 wait complete. 2024-09-10T22:43:42.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.778+0000 7fdad8800640 1 Processor -- start 2024-09-10T22:43:42.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.778+0000 7fdad8800640 1 -- start start 2024-09-10T22:43:42.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad8800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdad00b09c0 0x7fdad014cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:42.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad8800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad00ceb40 0x7fdad006f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:42.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad8800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdad015be30 0x7fdad014ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:42.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad8800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdad0169070 con 0x7fdad00ceb40 2024-09-10T22:43:42.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad8800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdad0168ef0 con 0x7fdad00b09c0 2024-09-10T22:43:42.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad8800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdad01691f0 con 0x7fdad015be30 2024-09-10T22:43:42.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad00ceb40 0x7fdad006f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:42.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad00ceb40 0x7fdad006f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40260/0 (socket says 172.21.15.103:40260) 2024-09-10T22:43:42.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad5400640 1 -- 172.21.15.103:0/77607862 learned_addr learned my addr 172.21.15.103:0/77607862 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:42.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad5e00640 1 --2- 172.21.15.103:0/77607862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdad00b09c0 0x7fdad014cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:42.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad6800640 1 --2- 172.21.15.103:0/77607862 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdad015be30 0x7fdad014ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:42.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad5400640 1 -- 172.21.15.103:0/77607862 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdad015be30 msgr2=0x7fdad014ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:42.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad5400640 1 --2- 172.21.15.103:0/77607862 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdad015be30 0x7fdad014ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:42.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad5400640 1 -- 172.21.15.103:0/77607862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdad00b09c0 msgr2=0x7fdad014cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:42.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad5400640 1 --2- 172.21.15.103:0/77607862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdad00b09c0 0x7fdad014cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:42.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad5400640 1 -- 172.21.15.103:0/77607862 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad006fba0 con 0x7fdad00ceb40 2024-09-10T22:43:42.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad6800640 1 --2- 172.21.15.103:0/77607862 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdad015be30 0x7fdad014ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:42.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad5400640 1 --2- 172.21.15.103:0/77607862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad00ceb40 0x7fdad006f660 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fdac000c9a0 tx=0x7fdac000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:42.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdaca000640 1 -- 172.21.15.103:0/77607862 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac0007c70 con 0x7fdad00ceb40 2024-09-10T22:43:42.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdaca000640 1 -- 172.21.15.103:0/77607862 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdac000f450 con 0x7fdad00ceb40 2024-09-10T22:43:42.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdaca000640 1 -- 172.21.15.103:0/77607862 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac000f8a0 con 0x7fdad00ceb40 2024-09-10T22:43:42.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad8800640 1 -- 172.21.15.103:0/77607862 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdad0165e50 con 0x7fdad00ceb40 2024-09-10T22:43:42.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad8800640 1 -- 172.21.15.103:0/77607862 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdad0166410 con 0x7fdad00ceb40 2024-09-10T22:43:42.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdad8800640 1 -- 172.21.15.103:0/77607862 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdad01667f0 con 0x7fdad00ceb40 2024-09-10T22:43:42.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.782+0000 7fdaca000640 1 -- 172.21.15.103:0/77607862 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdac000fa40 con 0x7fdad00ceb40 2024-09-10T22:43:42.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.786+0000 7fdaca000640 1 --2- 172.21.15.103:0/77607862 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdab40725e0 0x7fdab4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:42.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.786+0000 7fdaca000640 1 -- 172.21.15.103:0/77607862 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fdac0093c50 con 0x7fdad00ceb40 2024-09-10T22:43:42.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.786+0000 7fdad5e00640 1 --2- 172.21.15.103:0/77607862 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdab40725e0 0x7fdab4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:42.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.786+0000 7fdad5e00640 1 --2- 172.21.15.103:0/77607862 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdab40725e0 0x7fdab4074aa0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdac40ae000 tx=0x7fdac401afd0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:42.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.790+0000 7fdaca000640 1 -- 172.21.15.103:0/77607862 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdad01667f0 con 0x7fdad00ceb40 2024-09-10T22:43:42.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.950+0000 7fdad8800640 1 -- 172.21.15.103:0/77607862 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdad00cf9c0 con 0x7fdab40725e0 2024-09-10T22:43:42.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.954+0000 7fdaca000640 1 -- 172.21.15.103:0/77607862 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252051 (secure 0 0 0) 0x7fdad00cf9c0 con 0x7fdab40725e0 2024-09-10T22:43:42.962 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:42.963 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:43:42.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.958+0000 7fdad8800640 1 -- 172.21.15.103:0/77607862 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdab40725e0 msgr2=0x7fdab4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:42.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.958+0000 7fdad8800640 1 --2- 172.21.15.103:0/77607862 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdab40725e0 0x7fdab4074aa0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdac40ae000 tx=0x7fdac401afd0 comp rx=0 tx=0).stop 2024-09-10T22:43:42.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.958+0000 7fdad8800640 1 -- 172.21.15.103:0/77607862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad00ceb40 msgr2=0x7fdad006f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:42.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.958+0000 7fdad8800640 1 --2- 172.21.15.103:0/77607862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad00ceb40 0x7fdad006f660 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fdac000c9a0 tx=0x7fdac000ce60 comp rx=0 tx=0).stop 2024-09-10T22:43:42.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.958+0000 7fdad8800640 1 -- 172.21.15.103:0/77607862 shutdown_connections 2024-09-10T22:43:42.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.958+0000 7fdad8800640 1 --2- 172.21.15.103:0/77607862 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdab40725e0 0x7fdab4074aa0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:42.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.958+0000 7fdad8800640 1 --2- 172.21.15.103:0/77607862 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdad015be30 0x7fdad014ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:42.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.958+0000 7fdad8800640 1 --2- 172.21.15.103:0/77607862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad00ceb40 0x7fdad006f660 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:42.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.958+0000 7fdad8800640 1 --2- 172.21.15.103:0/77607862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdad00b09c0 0x7fdad014cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:42.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.958+0000 7fdad8800640 1 -- 172.21.15.103:0/77607862 >> 172.21.15.103:0/77607862 conn(0x7fdad00d1ac0 msgr2=0x7fdad0070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:42.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.958+0000 7fdad8800640 1 -- 172.21.15.103:0/77607862 shutdown_connections 2024-09-10T22:43:42.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:42.958+0000 7fdad8800640 1 -- 172.21.15.103:0/77607862 wait complete. 2024-09-10T22:43:42.983 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-10T22:43:41.693645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258444,"kb_used_data":8904,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716276,"statfs":{"total":773094113280,"available":772829466624,"internally_reserved":0,"allocated":9117696,"data_stored":4795916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002257"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.986160+0000","last_change":"2024-09-10T22:43:33.964207+0000","last_active":"2024-09-10T22:43:34.986160+0000","last_peered":"2024-09-10T22:43:34.986160+0000","last_clean":"2024-09-10T22:43:34.986160+0000","last_became_active":"2024-09-10T22:43:33.963923+0000","last_became_peered":"2024-09-10T22:43:33.963923+0000","last_unstale":"2024-09-10T22:43:34.986160+0000","last_undegraded":"2024-09-10T22:43:34.986160+0000","last_fullsized":"2024-09-10T22:43:34.986160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:04:53.807949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984045+0000","last_change":"2024-09-10T22:43:33.982954+0000","last_active":"2024-09-10T22:43:34.984045+0000","last_peered":"2024-09-10T22:43:34.984045+0000","last_clean":"2024-09-10T22:43:34.984045+0000","last_became_active":"2024-09-10T22:43:33.982737+0000","last_became_peered":"2024-09-10T22:43:33.982737+0000","last_unstale":"2024-09-10T22:43:34.984045+0000","last_undegraded":"2024-09-10T22:43:34.984045+0000","last_fullsized":"2024-09-10T22:43:34.984045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:20:43.287462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985233+0000","last_change":"2024-09-10T22:43:33.973232+0000","last_active":"2024-09-10T22:43:34.985233+0000","last_peered":"2024-09-10T22:43:34.985233+0000","last_clean":"2024-09-10T22:43:34.985233+0000","last_became_active":"2024-09-10T22:43:33.972856+0000","last_became_peered":"2024-09-10T22:43:33.972856+0000","last_unstale":"2024-09-10T22:43:34.985233+0000","last_undegraded":"2024-09-10T22:43:34.985233+0000","last_fullsized":"2024-09-10T22:43:34.985233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:34.575975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.959515+0000","last_change":"2024-09-10T22:43:33.966368+0000","last_active":"2024-09-10T22:43:34.959515+0000","last_peered":"2024-09-10T22:43:34.959515+0000","last_clean":"2024-09-10T22:43:34.959515+0000","last_became_active":"2024-09-10T22:43:33.965871+0000","last_became_peered":"2024-09-10T22:43:33.965871+0000","last_unstale":"2024-09-10T22:43:34.959515+0000","last_undegraded":"2024-09-10T22:43:34.959515+0000","last_fullsized":"2024-09-10T22:43:34.959515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:51.746085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.957338+0000","last_change":"2024-09-10T22:43:33.960336+0000","last_active":"2024-09-10T22:43:34.957338+0000","last_peered":"2024-09-10T22:43:34.957338+0000","last_clean":"2024-09-10T22:43:34.957338+0000","last_became_active":"2024-09-10T22:43:33.959856+0000","last_became_peered":"2024-09-10T22:43:33.959856+0000","last_unstale":"2024-09-10T22:43:34.957338+0000","last_undegraded":"2024-09-10T22:43:34.957338+0000","last_fullsized":"2024-09-10T22:43:34.957338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:30:53.814101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985650+0000","last_change":"2024-09-10T22:43:33.946584+0000","last_active":"2024-09-10T22:43:34.985650+0000","last_peered":"2024-09-10T22:43:34.985650+0000","last_clean":"2024-09-10T22:43:34.985650+0000","last_became_active":"2024-09-10T22:43:33.946270+0000","last_became_peered":"2024-09-10T22:43:33.946270+0000","last_unstale":"2024-09-10T22:43:34.985650+0000","last_undegraded":"2024-09-10T22:43:34.985650+0000","last_fullsized":"2024-09-10T22:43:34.985650+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:04:53.807949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984906+0000","last_change":"2024-09-10T22:43:33.971702+0000","last_active":"2024-09-10T22:43:34.984906+0000","last_peered":"2024-09-10T22:43:34.984906+0000","last_clean":"2024-09-10T22:43:34.984906+0000","last_became_active":"2024-09-10T22:43:33.970108+0000","last_became_peered":"2024-09-10T22:43:33.970108+0000","last_unstale":"2024-09-10T22:43:34.984906+0000","last_undegraded":"2024-09-10T22:43:34.984906+0000","last_fullsized":"2024-09-10T22:43:34.984906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:12.774318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.957178+0000","last_change":"2024-09-10T22:43:33.960676+0000","last_active":"2024-09-10T22:43:34.957178+0000","last_peered":"2024-09-10T22:43:34.957178+0000","last_clean":"2024-09-10T22:43:34.957178+0000","last_became_active":"2024-09-10T22:43:33.960408+0000","last_became_peered":"2024-09-10T22:43:33.960408+0000","last_unstale":"2024-09-10T22:43:34.957178+0000","last_undegraded":"2024-09-10T22:43:34.957178+0000","last_fullsized":"2024-09-10T22:43:34.957178+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:04.484686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.959921+0000","last_change":"2024-09-10T22:43:33.949734+0000","last_active":"2024-09-10T22:43:34.959921+0000","last_peered":"2024-09-10T22:43:34.959921+0000","last_clean":"2024-09-10T22:43:34.959921+0000","last_became_active":"2024-09-10T22:43:33.949411+0000","last_became_peered":"2024-09-10T22:43:33.949411+0000","last_unstale":"2024-09-10T22:43:34.959921+0000","last_undegraded":"2024-09-10T22:43:34.959921+0000","last_fullsized":"2024-09-10T22:43:34.959921+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:23:19.369897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.959760+0000","last_change":"2024-09-10T22:43:33.961335+0000","last_active":"2024-09-10T22:43:34.959760+0000","last_peered":"2024-09-10T22:43:34.959760+0000","last_clean":"2024-09-10T22:43:34.959760+0000","last_became_active":"2024-09-10T22:43:33.961052+0000","last_became_peered":"2024-09-10T22:43:33.961052+0000","last_unstale":"2024-09-10T22:43:34.959760+0000","last_undegraded":"2024-09-10T22:43:34.959760+0000","last_fullsized":"2024-09-10T22:43:34.959760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:20.672532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.983970+0000","last_change":"2024-09-10T22:43:33.980061+0000","last_active":"2024-09-10T22:43:34.983970+0000","last_peered":"2024-09-10T22:43:34.983970+0000","last_clean":"2024-09-10T22:43:34.983970+0000","last_became_active":"2024-09-10T22:43:33.979811+0000","last_became_peered":"2024-09-10T22:43:33.979811+0000","last_unstale":"2024-09-10T22:43:34.983970+0000","last_undegraded":"2024-09-10T22:43:34.983970+0000","last_fullsized":"2024-09-10T22:43:34.983970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:14.157200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.959728+0000","last_change":"2024-09-10T22:43:33.972210+0000","last_active":"2024-09-10T22:43:34.959728+0000","last_peered":"2024-09-10T22:43:34.959728+0000","last_clean":"2024-09-10T22:43:34.959728+0000","last_became_active":"2024-09-10T22:43:33.971951+0000","last_became_peered":"2024-09-10T22:43:33.971951+0000","last_unstale":"2024-09-10T22:43:34.959728+0000","last_undegraded":"2024-09-10T22:43:34.959728+0000","last_fullsized":"2024-09-10T22:43:34.959728+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:51.776928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.957307+0000","last_change":"2024-09-10T22:43:33.976672+0000","last_active":"2024-09-10T22:43:34.957307+0000","last_peered":"2024-09-10T22:43:34.957307+0000","last_clean":"2024-09-10T22:43:34.957307+0000","last_became_active":"2024-09-10T22:43:33.976465+0000","last_became_peered":"2024-09-10T22:43:33.976465+0000","last_unstale":"2024-09-10T22:43:34.957307+0000","last_undegraded":"2024-09-10T22:43:34.957307+0000","last_fullsized":"2024-09-10T22:43:34.957307+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:13.275883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985622+0000","last_change":"2024-09-10T22:43:33.946216+0000","last_active":"2024-09-10T22:43:34.985622+0000","last_peered":"2024-09-10T22:43:34.985622+0000","last_clean":"2024-09-10T22:43:34.985622+0000","last_became_active":"2024-09-10T22:43:33.945904+0000","last_became_peered":"2024-09-10T22:43:33.945904+0000","last_unstale":"2024-09-10T22:43:34.985622+0000","last_undegraded":"2024-09-10T22:43:34.985622+0000","last_fullsized":"2024-09-10T22:43:34.985622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:50.203674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.983422+0000","last_change":"2024-09-10T22:43:33.974565+0000","last_active":"2024-09-10T22:43:34.983422+0000","last_peered":"2024-09-10T22:43:34.983422+0000","last_clean":"2024-09-10T22:43:34.983422+0000","last_became_active":"2024-09-10T22:43:33.974296+0000","last_became_peered":"2024-09-10T22:43:33.974296+0000","last_unstale":"2024-09-10T22:43:34.983422+0000","last_undegraded":"2024-09-10T22:43:34.983422+0000","last_fullsized":"2024-09-10T22:43:34.983422+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:30.927345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985111+0000","last_change":"2024-09-10T22:43:33.961193+0000","last_active":"2024-09-10T22:43:34.985111+0000","last_peered":"2024-09-10T22:43:34.985111+0000","last_clean":"2024-09-10T22:43:34.985111+0000","last_became_active":"2024-09-10T22:43:33.960830+0000","last_became_peered":"2024-09-10T22:43:33.960830+0000","last_unstale":"2024-09-10T22:43:34.985111+0000","last_undegraded":"2024-09-10T22:43:34.985111+0000","last_fullsized":"2024-09-10T22:43:34.985111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:19.889884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.957795+0000","last_change":"2024-09-10T22:43:33.961085+0000","last_active":"2024-09-10T22:43:34.957795+0000","last_peered":"2024-09-10T22:43:34.957795+0000","last_clean":"2024-09-10T22:43:34.957795+0000","last_became_active":"2024-09-10T22:43:33.960939+0000","last_became_peered":"2024-09-10T22:43:33.960939+0000","last_unstale":"2024-09-10T22:43:34.957795+0000","last_undegraded":"2024-09-10T22:43:34.957795+0000","last_fullsized":"2024-09-10T22:43:34.957795+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:59.048943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985109+0000","last_change":"2024-09-10T22:43:33.969132+0000","last_active":"2024-09-10T22:43:34.985109+0000","last_peered":"2024-09-10T22:43:34.985109+0000","last_clean":"2024-09-10T22:43:34.985109+0000","last_became_active":"2024-09-10T22:43:33.966818+0000","last_became_peered":"2024-09-10T22:43:33.966818+0000","last_unstale":"2024-09-10T22:43:34.985109+0000","last_undegraded":"2024-09-10T22:43:34.985109+0000","last_fullsized":"2024-09-10T22:43:34.985109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:46.251681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985791+0000","last_change":"2024-09-10T22:43:33.960040+0000","last_active":"2024-09-10T22:43:34.985791+0000","last_peered":"2024-09-10T22:43:34.985791+0000","last_clean":"2024-09-10T22:43:34.985791+0000","last_became_active":"2024-09-10T22:43:33.959797+0000","last_became_peered":"2024-09-10T22:43:33.959797+0000","last_unstale":"2024-09-10T22:43:34.985791+0000","last_undegraded":"2024-09-10T22:43:34.985791+0000","last_fullsized":"2024-09-10T22:43:34.985791+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:14.853941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.957637+0000","last_change":"2024-09-10T22:43:33.957907+0000","last_active":"2024-09-10T22:43:34.957637+0000","last_peered":"2024-09-10T22:43:34.957637+0000","last_clean":"2024-09-10T22:43:34.957637+0000","last_became_active":"2024-09-10T22:43:33.957649+0000","last_became_peered":"2024-09-10T22:43:33.957649+0000","last_unstale":"2024-09-10T22:43:34.957637+0000","last_undegraded":"2024-09-10T22:43:34.957637+0000","last_fullsized":"2024-09-10T22:43:34.957637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:12.895094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.959850+0000","last_change":"2024-09-10T22:43:33.961718+0000","last_active":"2024-09-10T22:43:34.959850+0000","last_peered":"2024-09-10T22:43:34.959850+0000","last_clean":"2024-09-10T22:43:34.959850+0000","last_became_active":"2024-09-10T22:43:33.960104+0000","last_became_peered":"2024-09-10T22:43:33.960104+0000","last_unstale":"2024-09-10T22:43:34.959850+0000","last_undegraded":"2024-09-10T22:43:34.959850+0000","last_fullsized":"2024-09-10T22:43:34.959850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:35.786665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.957292+0000","last_change":"2024-09-10T22:43:33.975653+0000","last_active":"2024-09-10T22:43:34.957292+0000","last_peered":"2024-09-10T22:43:34.957292+0000","last_clean":"2024-09-10T22:43:34.957292+0000","last_became_active":"2024-09-10T22:43:33.975395+0000","last_became_peered":"2024-09-10T22:43:33.975395+0000","last_unstale":"2024-09-10T22:43:34.957292+0000","last_undegraded":"2024-09-10T22:43:34.957292+0000","last_fullsized":"2024-09-10T22:43:34.957292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:02.992561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.959076+0000","last_change":"2024-09-10T22:43:33.957850+0000","last_active":"2024-09-10T22:43:34.959076+0000","last_peered":"2024-09-10T22:43:34.959076+0000","last_clean":"2024-09-10T22:43:34.959076+0000","last_became_active":"2024-09-10T22:43:33.956939+0000","last_became_peered":"2024-09-10T22:43:33.956939+0000","last_unstale":"2024-09-10T22:43:34.959076+0000","last_undegraded":"2024-09-10T22:43:34.959076+0000","last_fullsized":"2024-09-10T22:43:34.959076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:28.848892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.983399+0000","last_change":"2024-09-10T22:43:33.976887+0000","last_active":"2024-09-10T22:43:34.983399+0000","last_peered":"2024-09-10T22:43:34.983399+0000","last_clean":"2024-09-10T22:43:34.983399+0000","last_became_active":"2024-09-10T22:43:33.974263+0000","last_became_peered":"2024-09-10T22:43:33.974263+0000","last_unstale":"2024-09-10T22:43:34.983399+0000","last_undegraded":"2024-09-10T22:43:34.983399+0000","last_fullsized":"2024-09-10T22:43:34.983399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:25.796059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984002+0000","last_change":"2024-09-10T22:43:33.979755+0000","last_active":"2024-09-10T22:43:34.984002+0000","last_peered":"2024-09-10T22:43:34.984002+0000","last_clean":"2024-09-10T22:43:34.984002+0000","last_became_active":"2024-09-10T22:43:33.979520+0000","last_became_peered":"2024-09-10T22:43:33.979520+0000","last_unstale":"2024-09-10T22:43:34.984002+0000","last_undegraded":"2024-09-10T22:43:34.984002+0000","last_fullsized":"2024-09-10T22:43:34.984002+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:50.650902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.959998+0000","last_change":"2024-09-10T22:43:33.973310+0000","last_active":"2024-09-10T22:43:34.959998+0000","last_peered":"2024-09-10T22:43:34.959998+0000","last_clean":"2024-09-10T22:43:34.959998+0000","last_became_active":"2024-09-10T22:43:33.973036+0000","last_became_peered":"2024-09-10T22:43:33.973036+0000","last_unstale":"2024-09-10T22:43:34.959998+0000","last_undegraded":"2024-09-10T22:43:34.959998+0000","last_fullsized":"2024-09-10T22:43:34.959998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:11.465849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985912+0000","last_change":"2024-09-10T22:43:33.963010+0000","last_active":"2024-09-10T22:43:34.985912+0000","last_peered":"2024-09-10T22:43:34.985912+0000","last_clean":"2024-09-10T22:43:34.985912+0000","last_became_active":"2024-09-10T22:43:33.962476+0000","last_became_peered":"2024-09-10T22:43:33.962476+0000","last_unstale":"2024-09-10T22:43:34.985912+0000","last_undegraded":"2024-09-10T22:43:34.985912+0000","last_fullsized":"2024-09-10T22:43:34.985912+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:18.640160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.957680+0000","last_change":"2024-09-10T22:43:33.967246+0000","last_active":"2024-09-10T22:43:34.957680+0000","last_peered":"2024-09-10T22:43:34.957680+0000","last_clean":"2024-09-10T22:43:34.957680+0000","last_became_active":"2024-09-10T22:43:33.966715+0000","last_became_peered":"2024-09-10T22:43:33.966715+0000","last_unstale":"2024-09-10T22:43:34.957680+0000","last_undegraded":"2024-09-10T22:43:34.957680+0000","last_fullsized":"2024-09-10T22:43:34.957680+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:43.499693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.983658+0000","last_change":"2024-09-10T22:43:33.980945+0000","last_active":"2024-09-10T22:43:34.983658+0000","last_peered":"2024-09-10T22:43:34.983658+0000","last_clean":"2024-09-10T22:43:34.983658+0000","last_became_active":"2024-09-10T22:43:33.979501+0000","last_became_peered":"2024-09-10T22:43:33.979501+0000","last_unstale":"2024-09-10T22:43:34.983658+0000","last_undegraded":"2024-09-10T22:43:34.983658+0000","last_fullsized":"2024-09-10T22:43:34.983658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:17.250922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985540+0000","last_change":"2024-09-10T22:43:33.973633+0000","last_active":"2024-09-10T22:43:34.985540+0000","last_peered":"2024-09-10T22:43:34.985540+0000","last_clean":"2024-09-10T22:43:34.985540+0000","last_became_active":"2024-09-10T22:43:33.972772+0000","last_became_peered":"2024-09-10T22:43:33.972772+0000","last_unstale":"2024-09-10T22:43:34.985540+0000","last_undegraded":"2024-09-10T22:43:34.985540+0000","last_fullsized":"2024-09-10T22:43:34.985540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:50.825899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984879+0000","last_change":"2024-09-10T22:43:33.960463+0000","last_active":"2024-09-10T22:43:34.984879+0000","last_peered":"2024-09-10T22:43:34.984879+0000","last_clean":"2024-09-10T22:43:34.984879+0000","last_became_active":"2024-09-10T22:43:33.957699+0000","last_became_peered":"2024-09-10T22:43:33.957699+0000","last_unstale":"2024-09-10T22:43:34.984879+0000","last_undegraded":"2024-09-10T22:43:34.984879+0000","last_fullsized":"2024-09-10T22:43:34.984879+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:17.832049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985325+0000","last_change":"2024-09-10T22:43:33.958104+0000","last_active":"2024-09-10T22:43:34.985325+0000","last_peered":"2024-09-10T22:43:34.985325+0000","last_clean":"2024-09-10T22:43:34.985325+0000","last_became_active":"2024-09-10T22:43:33.957615+0000","last_became_peered":"2024-09-10T22:43:33.957615+0000","last_unstale":"2024-09-10T22:43:34.985325+0000","last_undegraded":"2024-09-10T22:43:34.985325+0000","last_fullsized":"2024-09-10T22:43:34.985325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:07.553268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984549+0000","last_change":"2024-09-10T22:43:33.966343+0000","last_active":"2024-09-10T22:43:34.984549+0000","last_peered":"2024-09-10T22:43:34.984549+0000","last_clean":"2024-09-10T22:43:34.984549+0000","last_became_active":"2024-09-10T22:43:33.966077+0000","last_became_peered":"2024-09-10T22:43:33.966077+0000","last_unstale":"2024-09-10T22:43:34.984549+0000","last_undegraded":"2024-09-10T22:43:34.984549+0000","last_fullsized":"2024-09-10T22:43:34.984549+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:11.532561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"80'4","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.957794+0000","last_change":"2024-09-10T22:43:32.957567+0000","last_active":"2024-09-10T22:43:34.957794+0000","last_peered":"2024-09-10T22:43:34.957794+0000","last_clean":"2024-09-10T22:43:34.957794+0000","last_became_active":"2024-09-10T22:43:32.957316+0000","last_became_peered":"2024-09-10T22:43:32.957316+0000","last_unstale":"2024-09-10T22:43:34.957794+0000","last_undegraded":"2024-09-10T22:43:34.957794+0000","last_fullsized":"2024-09-10T22:43:34.957794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:51.384242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.983455+0000","last_change":"2024-09-10T22:43:33.972215+0000","last_active":"2024-09-10T22:43:34.983455+0000","last_peered":"2024-09-10T22:43:34.983455+0000","last_clean":"2024-09-10T22:43:34.983455+0000","last_became_active":"2024-09-10T22:43:33.971928+0000","last_became_peered":"2024-09-10T22:43:33.971928+0000","last_unstale":"2024-09-10T22:43:34.983455+0000","last_undegraded":"2024-09-10T22:43:34.983455+0000","last_fullsized":"2024-09-10T22:43:34.983455+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:52.896985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985945+0000","last_change":"2024-09-10T22:43:32.962321+0000","last_active":"2024-09-10T22:43:34.985945+0000","last_peered":"2024-09-10T22:43:34.985945+0000","last_clean":"2024-09-10T22:43:34.985945+0000","last_became_active":"2024-09-10T22:43:32.961642+0000","last_became_peered":"2024-09-10T22:43:32.961642+0000","last_unstale":"2024-09-10T22:43:34.985945+0000","last_undegraded":"2024-09-10T22:43:34.985945+0000","last_fullsized":"2024-09-10T22:43:34.985945+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:31.925280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.959284+0000","last_change":"2024-09-10T22:43:33.959690+0000","last_active":"2024-09-10T22:43:34.959284+0000","last_peered":"2024-09-10T22:43:34.959284+0000","last_clean":"2024-09-10T22:43:34.959284+0000","last_became_active":"2024-09-10T22:43:33.959402+0000","last_became_peered":"2024-09-10T22:43:33.959402+0000","last_unstale":"2024-09-10T22:43:34.959284+0000","last_undegraded":"2024-09-10T22:43:34.959284+0000","last_fullsized":"2024-09-10T22:43:34.959284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:50.104545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985813+0000","last_change":"2024-09-10T22:43:32.964868+0000","last_active":"2024-09-10T22:43:34.985813+0000","last_peered":"2024-09-10T22:43:34.985813+0000","last_clean":"2024-09-10T22:43:34.985813+0000","last_became_active":"2024-09-10T22:43:32.964629+0000","last_became_peered":"2024-09-10T22:43:32.964629+0000","last_unstale":"2024-09-10T22:43:34.985813+0000","last_undegraded":"2024-09-10T22:43:34.985813+0000","last_fullsized":"2024-09-10T22:43:34.985813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:17.047894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.959472+0000","last_change":"2024-09-10T22:43:33.962750+0000","last_active":"2024-09-10T22:43:34.959472+0000","last_peered":"2024-09-10T22:43:34.959472+0000","last_clean":"2024-09-10T22:43:34.959472+0000","last_became_active":"2024-09-10T22:43:33.960589+0000","last_became_peered":"2024-09-10T22:43:33.960589+0000","last_unstale":"2024-09-10T22:43:34.959472+0000","last_undegraded":"2024-09-10T22:43:34.959472+0000","last_fullsized":"2024-09-10T22:43:34.959472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:01.682499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985003+0000","last_change":"2024-09-10T22:43:32.957956+0000","last_active":"2024-09-10T22:43:34.985003+0000","last_peered":"2024-09-10T22:43:34.985003+0000","last_clean":"2024-09-10T22:43:34.985003+0000","last_became_active":"2024-09-10T22:43:32.957370+0000","last_became_peered":"2024-09-10T22:43:32.957370+0000","last_unstale":"2024-09-10T22:43:34.985003+0000","last_undegraded":"2024-09-10T22:43:34.985003+0000","last_fullsized":"2024-09-10T22:43:34.985003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:13.492585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.983788+0000","last_change":"2024-09-10T22:43:33.982633+0000","last_active":"2024-09-10T22:43:34.983788+0000","last_peered":"2024-09-10T22:43:34.983788+0000","last_clean":"2024-09-10T22:43:34.983788+0000","last_became_active":"2024-09-10T22:43:33.982356+0000","last_became_peered":"2024-09-10T22:43:33.982356+0000","last_unstale":"2024-09-10T22:43:34.983788+0000","last_undegraded":"2024-09-10T22:43:34.983788+0000","last_fullsized":"2024-09-10T22:43:34.983788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:05.472902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.959669+0000","last_change":"2024-09-10T22:43:32.958500+0000","last_active":"2024-09-10T22:43:34.959669+0000","last_peered":"2024-09-10T22:43:34.959669+0000","last_clean":"2024-09-10T22:43:34.959669+0000","last_became_active":"2024-09-10T22:43:32.957266+0000","last_became_peered":"2024-09-10T22:43:32.957266+0000","last_unstale":"2024-09-10T22:43:34.959669+0000","last_undegraded":"2024-09-10T22:43:34.959669+0000","last_fullsized":"2024-09-10T22:43:34.959669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:31.837761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984169+0000","last_change":"2024-09-10T22:43:33.983355+0000","last_active":"2024-09-10T22:43:34.984169+0000","last_peered":"2024-09-10T22:43:34.984169+0000","last_clean":"2024-09-10T22:43:34.984169+0000","last_became_active":"2024-09-10T22:43:33.980560+0000","last_became_peered":"2024-09-10T22:43:33.980560+0000","last_unstale":"2024-09-10T22:43:34.984169+0000","last_undegraded":"2024-09-10T22:43:34.984169+0000","last_fullsized":"2024-09-10T22:43:34.984169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:04.308312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.959224+0000","last_change":"2024-09-10T22:43:32.954519+0000","last_active":"2024-09-10T22:43:34.959224+0000","last_peered":"2024-09-10T22:43:34.959224+0000","last_clean":"2024-09-10T22:43:34.959224+0000","last_became_active":"2024-09-10T22:43:32.954235+0000","last_became_peered":"2024-09-10T22:43:32.954235+0000","last_unstale":"2024-09-10T22:43:34.959224+0000","last_undegraded":"2024-09-10T22:43:34.959224+0000","last_fullsized":"2024-09-10T22:43:34.959224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:23.930394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.959673+0000","last_change":"2024-09-10T22:43:33.952266+0000","last_active":"2024-09-10T22:43:34.959673+0000","last_peered":"2024-09-10T22:43:34.959673+0000","last_clean":"2024-09-10T22:43:34.959673+0000","last_became_active":"2024-09-10T22:43:33.951987+0000","last_became_peered":"2024-09-10T22:43:33.951987+0000","last_unstale":"2024-09-10T22:43:34.959673+0000","last_undegraded":"2024-09-10T22:43:34.959673+0000","last_fullsized":"2024-09-10T22:43:34.959673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:22.188960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.983592+0000","last_change":"2024-09-10T22:43:32.953990+0000","last_active":"2024-09-10T22:43:34.983592+0000","last_peered":"2024-09-10T22:43:34.983592+0000","last_clean":"2024-09-10T22:43:34.983592+0000","last_became_active":"2024-09-10T22:43:32.953759+0000","last_became_peered":"2024-09-10T22:43:32.953759+0000","last_unstale":"2024-09-10T22:43:34.983592+0000","last_undegraded":"2024-09-10T22:43:34.983592+0000","last_fullsized":"2024-09-10T22:43:34.983592+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:33:52.965656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985367+0000","last_change":"2024-09-10T22:43:33.971400+0000","last_active":"2024-09-10T22:43:34.985367+0000","last_peered":"2024-09-10T22:43:34.985367+0000","last_clean":"2024-09-10T22:43:34.985367+0000","last_became_active":"2024-09-10T22:43:33.970455+0000","last_became_peered":"2024-09-10T22:43:33.970455+0000","last_unstale":"2024-09-10T22:43:34.985367+0000","last_undegraded":"2024-09-10T22:43:34.985367+0000","last_fullsized":"2024-09-10T22:43:34.985367+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:10.784930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.957012+0000","last_change":"2024-09-10T22:43:32.966902+0000","last_active":"2024-09-10T22:43:34.957012+0000","last_peered":"2024-09-10T22:43:34.957012+0000","last_clean":"2024-09-10T22:43:34.957012+0000","last_became_active":"2024-09-10T22:43:32.966674+0000","last_became_peered":"2024-09-10T22:43:32.966674+0000","last_unstale":"2024-09-10T22:43:34.957012+0000","last_undegraded":"2024-09-10T22:43:34.957012+0000","last_fullsized":"2024-09-10T22:43:34.957012+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:12.160931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.983399+0000","last_change":"2024-09-10T22:43:33.974560+0000","last_active":"2024-09-10T22:43:34.983399+0000","last_peered":"2024-09-10T22:43:34.983399+0000","last_clean":"2024-09-10T22:43:34.983399+0000","last_became_active":"2024-09-10T22:43:33.974315+0000","last_became_peered":"2024-09-10T22:43:33.974315+0000","last_unstale":"2024-09-10T22:43:34.983399+0000","last_undegraded":"2024-09-10T22:43:34.983399+0000","last_fullsized":"2024-09-10T22:43:34.983399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:18.751585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.986182+0000","last_change":"2024-09-10T22:43:32.960867+0000","last_active":"2024-09-10T22:43:34.986182+0000","last_peered":"2024-09-10T22:43:34.986182+0000","last_clean":"2024-09-10T22:43:34.986182+0000","last_became_active":"2024-09-10T22:43:32.960572+0000","last_became_peered":"2024-09-10T22:43:32.960572+0000","last_unstale":"2024-09-10T22:43:34.986182+0000","last_undegraded":"2024-09-10T22:43:34.986182+0000","last_fullsized":"2024-09-10T22:43:34.986182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:14.083848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.958999+0000","last_change":"2024-09-10T22:43:33.967830+0000","last_active":"2024-09-10T22:43:34.958999+0000","last_peered":"2024-09-10T22:43:34.958999+0000","last_clean":"2024-09-10T22:43:34.958999+0000","last_became_active":"2024-09-10T22:43:33.967143+0000","last_became_peered":"2024-09-10T22:43:33.967143+0000","last_unstale":"2024-09-10T22:43:34.958999+0000","last_undegraded":"2024-09-10T22:43:34.958999+0000","last_fullsized":"2024-09-10T22:43:34.958999+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:54.896059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.960172+0000","last_change":"2024-09-10T22:43:32.956895+0000","last_active":"2024-09-10T22:43:34.960172+0000","last_peered":"2024-09-10T22:43:34.960172+0000","last_clean":"2024-09-10T22:43:34.960172+0000","last_became_active":"2024-09-10T22:43:32.956558+0000","last_became_peered":"2024-09-10T22:43:32.956558+0000","last_unstale":"2024-09-10T22:43:34.960172+0000","last_undegraded":"2024-09-10T22:43:34.960172+0000","last_fullsized":"2024-09-10T22:43:34.960172+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:29.747466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985920+0000","last_change":"2024-09-10T22:43:33.957576+0000","last_active":"2024-09-10T22:43:34.985920+0000","last_peered":"2024-09-10T22:43:34.985920+0000","last_clean":"2024-09-10T22:43:34.985920+0000","last_became_active":"2024-09-10T22:43:33.957097+0000","last_became_peered":"2024-09-10T22:43:33.957097+0000","last_unstale":"2024-09-10T22:43:34.985920+0000","last_undegraded":"2024-09-10T22:43:34.985920+0000","last_fullsized":"2024-09-10T22:43:34.985920+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:01.367411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"80'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.957880+0000","last_change":"2024-09-10T22:43:32.966412+0000","last_active":"2024-09-10T22:43:34.957880+0000","last_peered":"2024-09-10T22:43:34.957880+0000","last_clean":"2024-09-10T22:43:34.957880+0000","last_became_active":"2024-09-10T22:43:32.966135+0000","last_became_peered":"2024-09-10T22:43:32.966135+0000","last_unstale":"2024-09-10T22:43:34.957880+0000","last_undegraded":"2024-09-10T22:43:34.957880+0000","last_fullsized":"2024-09-10T22:43:34.957880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:05.559357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984806+0000","last_change":"2024-09-10T22:43:33.970411+0000","last_active":"2024-09-10T22:43:34.984806+0000","last_peered":"2024-09-10T22:43:34.984806+0000","last_clean":"2024-09-10T22:43:34.984806+0000","last_became_active":"2024-09-10T22:43:33.969898+0000","last_became_peered":"2024-09-10T22:43:33.969898+0000","last_unstale":"2024-09-10T22:43:34.984806+0000","last_undegraded":"2024-09-10T22:43:34.984806+0000","last_fullsized":"2024-09-10T22:43:34.984806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:52.448989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"80'6","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985129+0000","last_change":"2024-09-10T22:43:32.958074+0000","last_active":"2024-09-10T22:43:34.985129+0000","last_peered":"2024-09-10T22:43:34.985129+0000","last_clean":"2024-09-10T22:43:34.985129+0000","last_became_active":"2024-09-10T22:43:32.957692+0000","last_became_peered":"2024-09-10T22:43:32.957692+0000","last_unstale":"2024-09-10T22:43:34.985129+0000","last_undegraded":"2024-09-10T22:43:34.985129+0000","last_fullsized":"2024-09-10T22:43:34.985129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:55.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.959973+0000","last_change":"2024-09-10T22:43:33.961864+0000","last_active":"2024-09-10T22:43:34.959973+0000","last_peered":"2024-09-10T22:43:34.959973+0000","last_clean":"2024-09-10T22:43:34.959973+0000","last_became_active":"2024-09-10T22:43:33.959938+0000","last_became_peered":"2024-09-10T22:43:33.959938+0000","last_unstale":"2024-09-10T22:43:34.959973+0000","last_undegraded":"2024-09-10T22:43:34.959973+0000","last_fullsized":"2024-09-10T22:43:34.959973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:27.879174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.958839+0000","last_change":"2024-09-10T22:43:32.953419+0000","last_active":"2024-09-10T22:43:34.958839+0000","last_peered":"2024-09-10T22:43:34.958839+0000","last_clean":"2024-09-10T22:43:34.958839+0000","last_became_active":"2024-09-10T22:43:32.953109+0000","last_became_peered":"2024-09-10T22:43:32.953109+0000","last_unstale":"2024-09-10T22:43:34.958839+0000","last_undegraded":"2024-09-10T22:43:34.958839+0000","last_fullsized":"2024-09-10T22:43:34.958839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:28.007104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984979+0000","last_change":"2024-09-10T22:43:33.962171+0000","last_active":"2024-09-10T22:43:34.984979+0000","last_peered":"2024-09-10T22:43:34.984979+0000","last_clean":"2024-09-10T22:43:34.984979+0000","last_became_active":"2024-09-10T22:43:33.961854+0000","last_became_peered":"2024-09-10T22:43:33.961854+0000","last_unstale":"2024-09-10T22:43:34.984979+0000","last_undegraded":"2024-09-10T22:43:34.984979+0000","last_fullsized":"2024-09-10T22:43:34.984979+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:13:27.891773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985590+0000","last_change":"2024-09-10T22:43:32.968272+0000","last_active":"2024-09-10T22:43:34.985590+0000","last_peered":"2024-09-10T22:43:34.985590+0000","last_clean":"2024-09-10T22:43:34.985590+0000","last_became_active":"2024-09-10T22:43:32.967987+0000","last_became_peered":"2024-09-10T22:43:32.967987+0000","last_unstale":"2024-09-10T22:43:34.985590+0000","last_undegraded":"2024-09-10T22:43:34.985590+0000","last_fullsized":"2024-09-10T22:43:34.985590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:51.796309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985544+0000","last_change":"2024-09-10T22:43:33.969200+0000","last_active":"2024-09-10T22:43:34.985544+0000","last_peered":"2024-09-10T22:43:34.985544+0000","last_clean":"2024-09-10T22:43:34.985544+0000","last_became_active":"2024-09-10T22:43:33.968811+0000","last_became_peered":"2024-09-10T22:43:33.968811+0000","last_unstale":"2024-09-10T22:43:34.985544+0000","last_undegraded":"2024-09-10T22:43:34.985544+0000","last_fullsized":"2024-09-10T22:43:34.985544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:33:53.972432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.957127+0000","last_change":"2024-09-10T22:43:32.964152+0000","last_active":"2024-09-10T22:43:34.957127+0000","last_peered":"2024-09-10T22:43:34.957127+0000","last_clean":"2024-09-10T22:43:34.957127+0000","last_became_active":"2024-09-10T22:43:32.963908+0000","last_became_peered":"2024-09-10T22:43:32.963908+0000","last_unstale":"2024-09-10T22:43:34.957127+0000","last_undegraded":"2024-09-10T22:43:34.957127+0000","last_fullsized":"2024-09-10T22:43:34.957127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:22.501095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985376+0000","last_change":"2024-09-10T22:43:33.962139+0000","last_active":"2024-09-10T22:43:34.985376+0000","last_peered":"2024-09-10T22:43:34.985376+0000","last_clean":"2024-09-10T22:43:34.985376+0000","last_became_active":"2024-09-10T22:43:33.961810+0000","last_became_peered":"2024-09-10T22:43:33.961810+0000","last_unstale":"2024-09-10T22:43:34.985376+0000","last_undegraded":"2024-09-10T22:43:34.985376+0000","last_fullsized":"2024-09-10T22:43:34.985376+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:32.932056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"80'8","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.983600+0000","last_change":"2024-09-10T22:43:32.957309+0000","last_active":"2024-09-10T22:43:34.983600+0000","last_peered":"2024-09-10T22:43:34.983600+0000","last_clean":"2024-09-10T22:43:34.983600+0000","last_became_active":"2024-09-10T22:43:32.956954+0000","last_became_peered":"2024-09-10T22:43:32.956954+0000","last_unstale":"2024-09-10T22:43:34.983600+0000","last_undegraded":"2024-09-10T22:43:34.983600+0000","last_fullsized":"2024-09-10T22:43:34.983600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:14.083848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984662+0000","last_change":"2024-09-10T22:43:33.955351+0000","last_active":"2024-09-10T22:43:34.984662+0000","last_peered":"2024-09-10T22:43:34.984662+0000","last_clean":"2024-09-10T22:43:34.984662+0000","last_became_active":"2024-09-10T22:43:33.955082+0000","last_became_peered":"2024-09-10T22:43:33.955082+0000","last_unstale":"2024-09-10T22:43:34.984662+0000","last_undegraded":"2024-09-10T22:43:34.984662+0000","last_fullsized":"2024-09-10T22:43:34.984662+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:18.640160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.986251+0000","last_change":"2024-09-10T22:43:32.967130+0000","last_active":"2024-09-10T22:43:34.986251+0000","last_peered":"2024-09-10T22:43:34.986251+0000","last_clean":"2024-09-10T22:43:34.986251+0000","last_became_active":"2024-09-10T22:43:32.966886+0000","last_became_peered":"2024-09-10T22:43:32.966886+0000","last_unstale":"2024-09-10T22:43:34.986251+0000","last_undegraded":"2024-09-10T22:43:34.986251+0000","last_fullsized":"2024-09-10T22:43:34.986251+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:44.095444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.957086+0000","last_change":"2024-09-10T22:43:33.960111+0000","last_active":"2024-09-10T22:43:34.957086+0000","last_peered":"2024-09-10T22:43:34.957086+0000","last_clean":"2024-09-10T22:43:34.957086+0000","last_became_active":"2024-09-10T22:43:33.959799+0000","last_became_peered":"2024-09-10T22:43:33.959799+0000","last_unstale":"2024-09-10T22:43:34.957086+0000","last_undegraded":"2024-09-10T22:43:34.957086+0000","last_fullsized":"2024-09-10T22:43:34.957086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:49.406170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.959836+0000","last_change":"2024-09-10T22:43:32.963980+0000","last_active":"2024-09-10T22:43:34.959836+0000","last_peered":"2024-09-10T22:43:34.959836+0000","last_clean":"2024-09-10T22:43:34.959836+0000","last_became_active":"2024-09-10T22:43:32.962919+0000","last_became_peered":"2024-09-10T22:43:32.962919+0000","last_unstale":"2024-09-10T22:43:34.959836+0000","last_undegraded":"2024-09-10T22:43:34.959836+0000","last_fullsized":"2024-09-10T22:43:34.959836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:24.986010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.957200+0000","last_change":"2024-09-10T22:43:33.971237+0000","last_active":"2024-09-10T22:43:34.957200+0000","last_peered":"2024-09-10T22:43:34.957200+0000","last_clean":"2024-09-10T22:43:34.957200+0000","last_became_active":"2024-09-10T22:43:33.970996+0000","last_became_peered":"2024-09-10T22:43:33.970996+0000","last_unstale":"2024-09-10T22:43:34.957200+0000","last_undegraded":"2024-09-10T22:43:34.957200+0000","last_fullsized":"2024-09-10T22:43:34.957200+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:03.684751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.957802+0000","last_change":"2024-09-10T22:43:32.960405+0000","last_active":"2024-09-10T22:43:34.957802+0000","last_peered":"2024-09-10T22:43:34.957802+0000","last_clean":"2024-09-10T22:43:34.957802+0000","last_became_active":"2024-09-10T22:43:32.958442+0000","last_became_peered":"2024-09-10T22:43:32.958442+0000","last_unstale":"2024-09-10T22:43:34.957802+0000","last_undegraded":"2024-09-10T22:43:34.957802+0000","last_fullsized":"2024-09-10T22:43:34.957802+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:08.049971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985789+0000","last_change":"2024-09-10T22:43:33.958179+0000","last_active":"2024-09-10T22:43:34.985789+0000","last_peered":"2024-09-10T22:43:34.985789+0000","last_clean":"2024-09-10T22:43:34.985789+0000","last_became_active":"2024-09-10T22:43:33.957939+0000","last_became_peered":"2024-09-10T22:43:33.957939+0000","last_unstale":"2024-09-10T22:43:34.985789+0000","last_undegraded":"2024-09-10T22:43:34.985789+0000","last_fullsized":"2024-09-10T22:43:34.985789+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:28:43.631875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984708+0000","last_change":"2024-09-10T22:43:32.964908+0000","last_active":"2024-09-10T22:43:34.984708+0000","last_peered":"2024-09-10T22:43:34.984708+0000","last_clean":"2024-09-10T22:43:34.984708+0000","last_became_active":"2024-09-10T22:43:32.964611+0000","last_became_peered":"2024-09-10T22:43:32.964611+0000","last_unstale":"2024-09-10T22:43:34.984708+0000","last_undegraded":"2024-09-10T22:43:34.984708+0000","last_fullsized":"2024-09-10T22:43:34.984708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:02.693878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.983819+0000","last_change":"2024-09-10T22:43:33.972589+0000","last_active":"2024-09-10T22:43:34.983819+0000","last_peered":"2024-09-10T22:43:34.983819+0000","last_clean":"2024-09-10T22:43:34.983819+0000","last_became_active":"2024-09-10T22:43:33.972020+0000","last_became_peered":"2024-09-10T22:43:33.972020+0000","last_unstale":"2024-09-10T22:43:34.983819+0000","last_undegraded":"2024-09-10T22:43:34.983819+0000","last_fullsized":"2024-09-10T22:43:34.983819+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:17.466739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985732+0000","last_change":"2024-09-10T22:43:32.961790+0000","last_active":"2024-09-10T22:43:34.985732+0000","last_peered":"2024-09-10T22:43:34.985732+0000","last_clean":"2024-09-10T22:43:34.985732+0000","last_became_active":"2024-09-10T22:43:32.961323+0000","last_became_peered":"2024-09-10T22:43:32.961323+0000","last_unstale":"2024-09-10T22:43:34.985732+0000","last_undegraded":"2024-09-10T22:43:34.985732+0000","last_fullsized":"2024-09-10T22:43:34.985732+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:28.983530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984036+0000","last_change":"2024-09-10T22:43:33.978199+0000","last_active":"2024-09-10T22:43:34.984036+0000","last_peered":"2024-09-10T22:43:34.984036+0000","last_clean":"2024-09-10T22:43:34.984036+0000","last_became_active":"2024-09-10T22:43:33.977853+0000","last_became_peered":"2024-09-10T22:43:33.977853+0000","last_unstale":"2024-09-10T22:43:34.984036+0000","last_undegraded":"2024-09-10T22:43:34.984036+0000","last_fullsized":"2024-09-10T22:43:34.984036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:24.977259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985277+0000","last_change":"2024-09-10T22:43:32.960678+0000","last_active":"2024-09-10T22:43:34.985277+0000","last_peered":"2024-09-10T22:43:34.985277+0000","last_clean":"2024-09-10T22:43:34.985277+0000","last_became_active":"2024-09-10T22:43:32.959289+0000","last_became_peered":"2024-09-10T22:43:32.959289+0000","last_unstale":"2024-09-10T22:43:34.985277+0000","last_undegraded":"2024-09-10T22:43:34.985277+0000","last_fullsized":"2024-09-10T22:43:34.985277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:52.690791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985600+0000","last_change":"2024-09-10T22:43:33.971766+0000","last_active":"2024-09-10T22:43:34.985600+0000","last_peered":"2024-09-10T22:43:34.985600+0000","last_clean":"2024-09-10T22:43:34.985600+0000","last_became_active":"2024-09-10T22:43:33.971009+0000","last_became_peered":"2024-09-10T22:43:33.971009+0000","last_unstale":"2024-09-10T22:43:34.985600+0000","last_undegraded":"2024-09-10T22:43:34.985600+0000","last_fullsized":"2024-09-10T22:43:34.985600+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:15.090624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984828+0000","last_change":"2024-09-10T22:43:32.958892+0000","last_active":"2024-09-10T22:43:34.984828+0000","last_peered":"2024-09-10T22:43:34.984828+0000","last_clean":"2024-09-10T22:43:34.984828+0000","last_became_active":"2024-09-10T22:43:32.957384+0000","last_became_peered":"2024-09-10T22:43:32.957384+0000","last_unstale":"2024-09-10T22:43:34.984828+0000","last_undegraded":"2024-09-10T22:43:34.984828+0000","last_fullsized":"2024-09-10T22:43:34.984828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:44.095444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.958986+0000","last_change":"2024-09-10T22:43:33.958481+0000","last_active":"2024-09-10T22:43:34.958986+0000","last_peered":"2024-09-10T22:43:34.958986+0000","last_clean":"2024-09-10T22:43:34.958986+0000","last_became_active":"2024-09-10T22:43:33.958057+0000","last_became_peered":"2024-09-10T22:43:33.958057+0000","last_unstale":"2024-09-10T22:43:34.958986+0000","last_undegraded":"2024-09-10T22:43:34.958986+0000","last_fullsized":"2024-09-10T22:43:34.958986+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:08:55.280889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.959834+0000","last_change":"2024-09-10T22:43:32.962599+0000","last_active":"2024-09-10T22:43:34.959834+0000","last_peered":"2024-09-10T22:43:34.959834+0000","last_clean":"2024-09-10T22:43:34.959834+0000","last_became_active":"2024-09-10T22:43:32.962196+0000","last_became_peered":"2024-09-10T22:43:32.962196+0000","last_unstale":"2024-09-10T22:43:34.959834+0000","last_undegraded":"2024-09-10T22:43:34.959834+0000","last_fullsized":"2024-09-10T22:43:34.959834+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:57.086309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984982+0000","last_change":"2024-09-10T22:43:33.959922+0000","last_active":"2024-09-10T22:43:34.984982+0000","last_peered":"2024-09-10T22:43:34.984982+0000","last_clean":"2024-09-10T22:43:34.984982+0000","last_became_active":"2024-09-10T22:43:33.959644+0000","last_became_peered":"2024-09-10T22:43:33.959644+0000","last_unstale":"2024-09-10T22:43:34.984982+0000","last_undegraded":"2024-09-10T22:43:34.984982+0000","last_fullsized":"2024-09-10T22:43:34.984982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:18.054669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984151+0000","last_change":"2024-09-10T22:43:32.953544+0000","last_active":"2024-09-10T22:43:34.984151+0000","last_peered":"2024-09-10T22:43:34.984151+0000","last_clean":"2024-09-10T22:43:34.984151+0000","last_became_active":"2024-09-10T22:43:32.951997+0000","last_became_peered":"2024-09-10T22:43:32.951997+0000","last_unstale":"2024-09-10T22:43:34.984151+0000","last_undegraded":"2024-09-10T22:43:34.984151+0000","last_fullsized":"2024-09-10T22:43:34.984151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:44.095444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.959299+0000","last_change":"2024-09-10T22:43:33.950866+0000","last_active":"2024-09-10T22:43:34.959299+0000","last_peered":"2024-09-10T22:43:34.959299+0000","last_clean":"2024-09-10T22:43:34.959299+0000","last_became_active":"2024-09-10T22:43:33.950259+0000","last_became_peered":"2024-09-10T22:43:33.950259+0000","last_unstale":"2024-09-10T22:43:34.959299+0000","last_undegraded":"2024-09-10T22:43:34.959299+0000","last_fullsized":"2024-09-10T22:43:34.959299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:43.476816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.986025+0000","last_change":"2024-09-10T22:43:32.962093+0000","last_active":"2024-09-10T22:43:34.986025+0000","last_peered":"2024-09-10T22:43:34.986025+0000","last_clean":"2024-09-10T22:43:34.986025+0000","last_became_active":"2024-09-10T22:43:32.961715+0000","last_became_peered":"2024-09-10T22:43:32.961715+0000","last_unstale":"2024-09-10T22:43:34.986025+0000","last_undegraded":"2024-09-10T22:43:34.986025+0000","last_fullsized":"2024-09-10T22:43:34.986025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:33:52.965656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.983671+0000","last_change":"2024-09-10T22:43:33.979394+0000","last_active":"2024-09-10T22:43:34.983671+0000","last_peered":"2024-09-10T22:43:34.983671+0000","last_clean":"2024-09-10T22:43:34.983671+0000","last_became_active":"2024-09-10T22:43:33.978332+0000","last_became_peered":"2024-09-10T22:43:33.978332+0000","last_unstale":"2024-09-10T22:43:34.983671+0000","last_undegraded":"2024-09-10T22:43:34.983671+0000","last_fullsized":"2024-09-10T22:43:34.983671+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:36.926281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985752+0000","last_change":"2024-09-10T22:43:32.960870+0000","last_active":"2024-09-10T22:43:34.985752+0000","last_peered":"2024-09-10T22:43:34.985752+0000","last_clean":"2024-09-10T22:43:34.985752+0000","last_became_active":"2024-09-10T22:43:32.960525+0000","last_became_peered":"2024-09-10T22:43:32.960525+0000","last_unstale":"2024-09-10T22:43:34.985752+0000","last_undegraded":"2024-09-10T22:43:34.985752+0000","last_fullsized":"2024-09-10T22:43:34.985752+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:09.778155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985030+0000","last_change":"2024-09-10T22:43:33.964601+0000","last_active":"2024-09-10T22:43:34.985030+0000","last_peered":"2024-09-10T22:43:34.985030+0000","last_clean":"2024-09-10T22:43:34.985030+0000","last_became_active":"2024-09-10T22:43:33.960388+0000","last_became_peered":"2024-09-10T22:43:33.960388+0000","last_unstale":"2024-09-10T22:43:34.985030+0000","last_undegraded":"2024-09-10T22:43:34.985030+0000","last_fullsized":"2024-09-10T22:43:34.985030+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:10:06.510070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985064+0000","last_change":"2024-09-10T22:43:32.957617+0000","last_active":"2024-09-10T22:43:34.985064+0000","last_peered":"2024-09-10T22:43:34.985064+0000","last_clean":"2024-09-10T22:43:34.985064+0000","last_became_active":"2024-09-10T22:43:32.957258+0000","last_became_peered":"2024-09-10T22:43:32.957258+0000","last_unstale":"2024-09-10T22:43:34.985064+0000","last_undegraded":"2024-09-10T22:43:34.985064+0000","last_fullsized":"2024-09-10T22:43:34.985064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:06.758655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985258+0000","last_change":"2024-09-10T22:43:33.968135+0000","last_active":"2024-09-10T22:43:34.985258+0000","last_peered":"2024-09-10T22:43:34.985258+0000","last_clean":"2024-09-10T22:43:34.985258+0000","last_became_active":"2024-09-10T22:43:33.967802+0000","last_became_peered":"2024-09-10T22:43:33.967802+0000","last_unstale":"2024-09-10T22:43:34.985258+0000","last_undegraded":"2024-09-10T22:43:34.985258+0000","last_fullsized":"2024-09-10T22:43:34.985258+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:52.803085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.957311+0000","last_change":"2024-09-10T22:43:32.963621+0000","last_active":"2024-09-10T22:43:34.957311+0000","last_peered":"2024-09-10T22:43:34.957311+0000","last_clean":"2024-09-10T22:43:34.957311+0000","last_became_active":"2024-09-10T22:43:32.962527+0000","last_became_peered":"2024-09-10T22:43:32.962527+0000","last_unstale":"2024-09-10T22:43:34.957311+0000","last_undegraded":"2024-09-10T22:43:34.957311+0000","last_fullsized":"2024-09-10T22:43:34.957311+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:10.074933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985281+0000","last_change":"2024-09-10T22:43:33.973798+0000","last_active":"2024-09-10T22:43:34.985281+0000","last_peered":"2024-09-10T22:43:34.985281+0000","last_clean":"2024-09-10T22:43:34.985281+0000","last_became_active":"2024-09-10T22:43:33.973289+0000","last_became_peered":"2024-09-10T22:43:33.973289+0000","last_unstale":"2024-09-10T22:43:34.985281+0000","last_undegraded":"2024-09-10T22:43:34.985281+0000","last_fullsized":"2024-09-10T22:43:34.985281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:55.398034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985182+0000","last_change":"2024-09-10T22:43:32.958396+0000","last_active":"2024-09-10T22:43:34.985182+0000","last_peered":"2024-09-10T22:43:34.985182+0000","last_clean":"2024-09-10T22:43:34.985182+0000","last_became_active":"2024-09-10T22:43:32.957943+0000","last_became_peered":"2024-09-10T22:43:32.957943+0000","last_unstale":"2024-09-10T22:43:34.985182+0000","last_undegraded":"2024-09-10T22:43:34.985182+0000","last_fullsized":"2024-09-10T22:43:34.985182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:11.950352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985487+0000","last_change":"2024-09-10T22:43:33.963110+0000","last_active":"2024-09-10T22:43:34.985487+0000","last_peered":"2024-09-10T22:43:34.985487+0000","last_clean":"2024-09-10T22:43:34.985487+0000","last_became_active":"2024-09-10T22:43:33.962823+0000","last_became_peered":"2024-09-10T22:43:33.962823+0000","last_unstale":"2024-09-10T22:43:34.985487+0000","last_undegraded":"2024-09-10T22:43:34.985487+0000","last_fullsized":"2024-09-10T22:43:34.985487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:43.287722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.984617+0000","last_change":"2024-09-10T22:43:32.962997+0000","last_active":"2024-09-10T22:43:34.984617+0000","last_peered":"2024-09-10T22:43:34.984617+0000","last_clean":"2024-09-10T22:43:34.984617+0000","last_became_active":"2024-09-10T22:43:32.961399+0000","last_became_peered":"2024-09-10T22:43:32.961399+0000","last_unstale":"2024-09-10T22:43:34.984617+0000","last_undegraded":"2024-09-10T22:43:34.984617+0000","last_fullsized":"2024-09-10T22:43:34.984617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:56.079546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985983+0000","last_change":"2024-09-10T22:43:33.964885+0000","last_active":"2024-09-10T22:43:34.985983+0000","last_peered":"2024-09-10T22:43:34.985983+0000","last_clean":"2024-09-10T22:43:34.985983+0000","last_became_active":"2024-09-10T22:43:33.963278+0000","last_became_peered":"2024-09-10T22:43:33.963278+0000","last_unstale":"2024-09-10T22:43:34.985983+0000","last_undegraded":"2024-09-10T22:43:34.985983+0000","last_fullsized":"2024-09-10T22:43:34.985983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:32.926440+0000","last_clean_scrub_stamp":"2024-09-10T22:43:32.926440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:50.203674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985963+0000","last_change":"2024-09-10T22:43:32.959873+0000","last_active":"2024-09-10T22:43:34.985963+0000","last_peered":"2024-09-10T22:43:34.985963+0000","last_clean":"2024-09-10T22:43:34.985963+0000","last_became_active":"2024-09-10T22:43:32.959583+0000","last_became_peered":"2024-09-10T22:43:32.959583+0000","last_unstale":"2024-09-10T22:43:34.985963+0000","last_undegraded":"2024-09-10T22:43:34.985963+0000","last_fullsized":"2024-09-10T22:43:34.985963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:43:31.919664+0000","last_clean_scrub_stamp":"2024-09-10T22:43:31.919664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:56.749509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":222,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-10T22:43:34.985333+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:43:34.985333+0000","last_peered":"2024-09-10T22:43:34.985333+0000","last_clean":"2024-09-10T22:43:34.985333+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:43:34.985333+0000","last_undegraded":"2024-09-10T22:43:34.985333+0000","last_fullsized":"2024-09-10T22:43:34.985333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509503,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1581056,"data_stored":1041685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509503,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":995328,"data_stored":452907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509504,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":987136,"data_stored":451329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509503,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1003520,"data_stored":453011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509503,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":987136,"data_stored":451877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509503,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":995328,"data_stored":452037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509503,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1576960,"data_stored":1041663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":991232,"data_stored":451407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:43:42.990 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T22:43:42.990 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T22:43:43.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.166+0000 7fd5f1e00640 1 -- 172.21.15.103:0/365720226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5d0004d50 msgr2=0x7fd5d00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:43.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.166+0000 7fd5f1e00640 1 --2- 172.21.15.103:0/365720226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5d0004d50 0x7fd5d00051d0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400c310 tx=0x7fd5e401cf20 comp rx=0 tx=0).stop 2024-09-10T22:43:43.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5eb400640 1 -- 172.21.15.103:0/365720226 reap_dead start 2024-09-10T22:43:43.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5f1e00640 1 -- 172.21.15.103:0/365720226 shutdown_connections 2024-09-10T22:43:43.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5f1e00640 1 -- 172.21.15.103:0/365720226 >> 172.21.15.103:0/365720226 conn(0x7fd5ec0d1b40 msgr2=0x7fd5ec0d1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:43.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5f1e00640 1 -- 172.21.15.103:0/365720226 shutdown_connections 2024-09-10T22:43:43.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5f1e00640 1 -- 172.21.15.103:0/365720226 wait complete. 2024-09-10T22:43:43.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5f1e00640 1 Processor -- start 2024-09-10T22:43:43.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5f1e00640 1 -- start start 2024-09-10T22:43:43.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5f1e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5d0004d50 0x7fd5ec157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:43.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5f1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5ec1f8860 0x7fd5ec15e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:43.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5f1e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5ec15ac20 0x7fd5ec15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:43.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5f1e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ec167d90 con 0x7fd5ec1f8860 2024-09-10T22:43:43.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5f1e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ec167c10 con 0x7fd5d0004d50 2024-09-10T22:43:43.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5f1e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd5ec167f10 con 0x7fd5ec15ac20 2024-09-10T22:43:43.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5e2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5ec1f8860 0x7fd5ec15e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:43.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5e2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5ec1f8860 0x7fd5ec15e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40290/0 (socket says 172.21.15.103:40290) 2024-09-10T22:43:43.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5e2000640 1 -- 172.21.15.103:0/309456291 learned_addr learned my addr 172.21.15.103:0/309456291 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:43.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5eaa00640 1 --2- 172.21.15.103:0/309456291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5d0004d50 0x7fd5ec157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:43.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5eb400640 1 --2- 172.21.15.103:0/309456291 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5ec15ac20 0x7fd5ec15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:43.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5e2000640 1 -- 172.21.15.103:0/309456291 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5ec15ac20 msgr2=0x7fd5ec15b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:43.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5e2000640 1 --2- 172.21.15.103:0/309456291 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5ec15ac20 0x7fd5ec15b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:43.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5e2000640 1 -- 172.21.15.103:0/309456291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5d0004d50 msgr2=0x7fd5ec157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:43.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5e2000640 1 --2- 172.21.15.103:0/309456291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5d0004d50 0x7fd5ec157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:43.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5e2000640 1 -- 172.21.15.103:0/309456291 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5ec15a920 con 0x7fd5ec1f8860 2024-09-10T22:43:43.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5eaa00640 1 --2- 172.21.15.103:0/309456291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5d0004d50 0x7fd5ec157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:43:43.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5e2000640 1 --2- 172.21.15.103:0/309456291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5ec1f8860 0x7fd5ec15e150 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4006660 tx=0x7fd5d40017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:43.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.170+0000 7fd5e3e00640 1 -- 172.21.15.103:0/309456291 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4011700 con 0x7fd5ec1f8860 2024-09-10T22:43:43.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.174+0000 7fd5e3e00640 1 -- 172.21.15.103:0/309456291 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5d4016020 con 0x7fd5ec1f8860 2024-09-10T22:43:43.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.174+0000 7fd5e3e00640 1 -- 172.21.15.103:0/309456291 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4011b40 con 0x7fd5ec1f8860 2024-09-10T22:43:43.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.174+0000 7fd5f1e00640 1 -- 172.21.15.103:0/309456291 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5ec156eb0 con 0x7fd5ec1f8860 2024-09-10T22:43:43.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.174+0000 7fd5f1e00640 1 -- 172.21.15.103:0/309456291 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5ec157470 con 0x7fd5ec1f8860 2024-09-10T22:43:43.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.174+0000 7fd5f1e00640 1 -- 172.21.15.103:0/309456291 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5ec0b14a0 con 0x7fd5ec1f8860 2024-09-10T22:43:43.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.174+0000 7fd5e3e00640 1 -- 172.21.15.103:0/309456291 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd5d4011ce0 con 0x7fd5ec1f8860 2024-09-10T22:43:43.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.174+0000 7fd5e3e00640 1 --2- 172.21.15.103:0/309456291 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5c8072610 0x7fd5c8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:43.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.174+0000 7fd5e3e00640 1 -- 172.21.15.103:0/309456291 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fd5d4094130 con 0x7fd5ec1f8860 2024-09-10T22:43:43.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.174+0000 7fd5eaa00640 1 --2- 172.21.15.103:0/309456291 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5c8072610 0x7fd5c8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:43.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.178+0000 7fd5eaa00640 1 --2- 172.21.15.103:0/309456291 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5c8072610 0x7fd5c8074ad0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec1fc490 tx=0x7fd5dc009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:43.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.178+0000 7fd5e3e00640 1 -- 172.21.15.103:0/309456291 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd5d4020020 con 0x7fd5ec1f8860 2024-09-10T22:43:43.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.406+0000 7fd5f1e00640 1 -- 172.21.15.103:0/309456291 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd5ec06e710 con 0x7fd5ec1f8860 2024-09-10T22:43:43.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.410+0000 7fd5e3e00640 1 -- 172.21.15.103:0/309456291 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7fd5d405f5e0 con 0x7fd5ec1f8860 2024-09-10T22:43:43.415 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-09-10T22:43:43.415 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA8yuBmtOhZNBAAeszxWpV60NIn/zOInT5Zzw== 2024-09-10T22:43:43.415 INFO:teuthology.orchestra.run.smithi103.stdout: caps mds = "allow" 2024-09-10T22:43:43.415 INFO:teuthology.orchestra.run.smithi103.stdout: caps mon = "allow r" 2024-09-10T22:43:43.415 INFO:teuthology.orchestra.run.smithi103.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T22:43:43.416 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2024-09-10T22:43:43.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.414+0000 7fd5f1e00640 1 -- 172.21.15.103:0/309456291 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5c8072610 msgr2=0x7fd5c8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:43.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.414+0000 7fd5f1e00640 1 --2- 172.21.15.103:0/309456291 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5c8072610 0x7fd5c8074ad0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec1fc490 tx=0x7fd5dc009500 comp rx=0 tx=0).stop 2024-09-10T22:43:43.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.414+0000 7fd5f1e00640 1 -- 172.21.15.103:0/309456291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5ec1f8860 msgr2=0x7fd5ec15e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:43.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.414+0000 7fd5f1e00640 1 --2- 172.21.15.103:0/309456291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5ec1f8860 0x7fd5ec15e150 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4006660 tx=0x7fd5d40017e0 comp rx=0 tx=0).stop 2024-09-10T22:43:43.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.414+0000 7fd5f1e00640 1 -- 172.21.15.103:0/309456291 shutdown_connections 2024-09-10T22:43:43.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.414+0000 7fd5f1e00640 1 --2- 172.21.15.103:0/309456291 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd5c8072610 0x7fd5c8074ad0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:43.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.414+0000 7fd5f1e00640 1 --2- 172.21.15.103:0/309456291 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5ec15ac20 0x7fd5ec15b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:43.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.414+0000 7fd5f1e00640 1 --2- 172.21.15.103:0/309456291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5ec1f8860 0x7fd5ec15e150 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:43.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.414+0000 7fd5f1e00640 1 --2- 172.21.15.103:0/309456291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5d0004d50 0x7fd5ec157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:43.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.414+0000 7fd5f1e00640 1 -- 172.21.15.103:0/309456291 >> 172.21.15.103:0/309456291 conn(0x7fd5ec0d1b40 msgr2=0x7fd5ec1600e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:43.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.414+0000 7fd5f1e00640 1 -- 172.21.15.103:0/309456291 shutdown_connections 2024-09-10T22:43:43.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.414+0000 7fd5f1e00640 1 -- 172.21.15.103:0/309456291 wait complete. 2024-09-10T22:43:43.437 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:43:43.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.574+0000 7fd2ac200640 1 -- 172.21.15.103:0/1739279680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2a4151a50 msgr2=0x7fd2a40b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:43.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.574+0000 7fd2ac200640 1 --2- 172.21.15.103:0/1739279680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2a4151a50 0x7fd2a40b3960 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40cd540 tx=0x7fd29801c600 comp rx=0 tx=0).stop 2024-09-10T22:43:43.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.574+0000 7fd2ac200640 1 -- 172.21.15.103:0/1739279680 shutdown_connections 2024-09-10T22:43:43.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.574+0000 7fd2ac200640 1 --2- 172.21.15.103:0/1739279680 >> v2:172.21.15.131:3300/0 conn(0x7fd2a4073b50 0x7fd2a415e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:43.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.574+0000 7fd2ac200640 1 --2- 172.21.15.103:0/1739279680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2a40b3ea0 0x7fd2a4073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:43.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.574+0000 7fd2ac200640 1 --2- 172.21.15.103:0/1739279680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2a4151a50 0x7fd2a40b3960 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:43.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.574+0000 7fd2ac200640 1 -- 172.21.15.103:0/1739279680 >> 172.21.15.103:0/1739279680 conn(0x7fd2a40b2660 msgr2=0x7fd2a40b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:43.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.574+0000 7fd2ac200640 1 -- 172.21.15.103:0/1739279680 shutdown_connections 2024-09-10T22:43:43.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.574+0000 7fd2ac200640 1 -- 172.21.15.103:0/1739279680 wait complete. 2024-09-10T22:43:43.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.574+0000 7fd2ac200640 1 Processor -- start 2024-09-10T22:43:43.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.574+0000 7fd2ac200640 1 -- start start 2024-09-10T22:43:43.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2ac200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2a4073b50 0x7fd2a413ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:43.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2ac200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2a40b3ea0 0x7fd2a413f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:43.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2ac200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2a4151a50 0x7fd2a41fa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:43.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2ac200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a406d3c0 con 0x7fd2a4151a50 2024-09-10T22:43:43.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2ac200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a406d240 con 0x7fd2a40b3ea0 2024-09-10T22:43:43.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2ac200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd2a406d540 con 0x7fd2a4073b50 2024-09-10T22:43:43.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2aa200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2a4151a50 0x7fd2a41fa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:43.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2aa200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2a4151a50 0x7fd2a41fa6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40314/0 (socket says 172.21.15.103:40314) 2024-09-10T22:43:43.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2aa200640 1 -- 172.21.15.103:0/1416468318 learned_addr learned my addr 172.21.15.103:0/1416468318 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:43.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2a8e00640 1 --2- 172.21.15.103:0/1416468318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2a40b3ea0 0x7fd2a413f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:43.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2a9800640 1 --2- 172.21.15.103:0/1416468318 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2a4073b50 0x7fd2a413ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:43.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2aa200640 1 -- 172.21.15.103:0/1416468318 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2a4073b50 msgr2=0x7fd2a413ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:43.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2aa200640 1 --2- 172.21.15.103:0/1416468318 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2a4073b50 0x7fd2a413ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:43.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2aa200640 1 -- 172.21.15.103:0/1416468318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2a40b3ea0 msgr2=0x7fd2a413f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:43.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2aa200640 1 --2- 172.21.15.103:0/1416468318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2a40b3ea0 0x7fd2a413f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:43.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2aa200640 1 -- 172.21.15.103:0/1416468318 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a414df00 con 0x7fd2a4151a50 2024-09-10T22:43:43.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2aa200640 1 --2- 172.21.15.103:0/1416468318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2a4151a50 0x7fd2a41fa6c0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00cd10 tx=0x7fd29c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:43.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2a1600640 1 -- 172.21.15.103:0/1416468318 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c00f450 con 0x7fd2a4151a50 2024-09-10T22:43:43.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2a1600640 1 -- 172.21.15.103:0/1416468318 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd29c00f6e0 con 0x7fd2a4151a50 2024-09-10T22:43:43.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2ac200640 1 -- 172.21.15.103:0/1416468318 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2a4150c90 con 0x7fd2a4151a50 2024-09-10T22:43:43.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2a1600640 1 -- 172.21.15.103:0/1416468318 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c00fb30 con 0x7fd2a4151a50 2024-09-10T22:43:43.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2ac200640 1 -- 172.21.15.103:0/1416468318 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2a414e1a0 con 0x7fd2a4151a50 2024-09-10T22:43:43.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.578+0000 7fd2ac200640 1 -- 172.21.15.103:0/1416468318 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2a406dae0 con 0x7fd2a4151a50 2024-09-10T22:43:43.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.582+0000 7fd2a1600640 1 -- 172.21.15.103:0/1416468318 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd29c00fcd0 con 0x7fd2a4151a50 2024-09-10T22:43:43.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.582+0000 7fd2a1600640 1 --2- 172.21.15.103:0/1416468318 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2840725e0 0x7fd284074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:43.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.582+0000 7fd2a1600640 1 -- 172.21.15.103:0/1416468318 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fd29c093ec0 con 0x7fd2a4151a50 2024-09-10T22:43:43.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.582+0000 7fd2a9800640 1 --2- 172.21.15.103:0/1416468318 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2840725e0 0x7fd284074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:43.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.582+0000 7fd2a9800640 1 --2- 172.21.15.103:0/1416468318 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2840725e0 0x7fd284074aa0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd2980af000 tx=0x7fd29801ae40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:43.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.586+0000 7fd2a1600640 1 -- 172.21.15.103:0/1416468318 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd29c014030 con 0x7fd2a4151a50 2024-09-10T22:43:43.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.782+0000 7fd2ac200640 1 -- 172.21.15.103:0/1416468318 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2a4074cf0 con 0x7fd2a4151a50 2024-09-10T22:43:43.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.782+0000 7fd2a1600640 1 -- 172.21.15.103:0/1416468318 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5231 (secure 0 0 0) 0x7fd29c05ed20 con 0x7fd2a4151a50 2024-09-10T22:43:43.787 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:43.788 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":72,"btime":"2024-09-10T22:43:36:960842+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6047,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/2402286786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2402286786},{"type":"v1","addr":"172.21.15.103:6834","nonce":2402286786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68},{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/4254729752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":4254729752},{"type":"v1","addr":"172.21.15.131:6837","nonce":4254729752}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68},{"gid":6592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/134240629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":134240629},{"type":"v1","addr":"172.21.15.131:6836","nonce":134240629}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:43:33.337095+0000","modified":"2024-09-10T22:43:36.351104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6873},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6873":{"gid":6873,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/249667943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":249667943},{"type":"v1","addr":"172.21.15.103:6835","nonce":249667943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6873,"qdb_cluster":[6873]},"id":5}]} 2024-09-10T22:43:43.788 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 72 2024-09-10T22:43:43.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.786+0000 7fd2ac200640 1 -- 172.21.15.103:0/1416468318 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2840725e0 msgr2=0x7fd284074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:43.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.786+0000 7fd2ac200640 1 --2- 172.21.15.103:0/1416468318 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2840725e0 0x7fd284074aa0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd2980af000 tx=0x7fd29801ae40 comp rx=0 tx=0).stop 2024-09-10T22:43:43.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.786+0000 7fd2ac200640 1 -- 172.21.15.103:0/1416468318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2a4151a50 msgr2=0x7fd2a41fa6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:43.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.786+0000 7fd2ac200640 1 --2- 172.21.15.103:0/1416468318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2a4151a50 0x7fd2a41fa6c0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00cd10 tx=0x7fd29c00a620 comp rx=0 tx=0).stop 2024-09-10T22:43:43.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.786+0000 7fd2ac200640 1 -- 172.21.15.103:0/1416468318 shutdown_connections 2024-09-10T22:43:43.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.786+0000 7fd2ac200640 1 --2- 172.21.15.103:0/1416468318 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2840725e0 0x7fd284074aa0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:43.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.786+0000 7fd2ac200640 1 --2- 172.21.15.103:0/1416468318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2a4151a50 0x7fd2a41fa6c0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:43.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.786+0000 7fd2ac200640 1 --2- 172.21.15.103:0/1416468318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2a40b3ea0 0x7fd2a413f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:43.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.786+0000 7fd2ac200640 1 --2- 172.21.15.103:0/1416468318 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2a4073b50 0x7fd2a413ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:43.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.786+0000 7fd2ac200640 1 -- 172.21.15.103:0/1416468318 >> 172.21.15.103:0/1416468318 conn(0x7fd2a40b2660 msgr2=0x7fd2a40cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:43.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.786+0000 7fd2ac200640 1 -- 172.21.15.103:0/1416468318 shutdown_connections 2024-09-10T22:43:43.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:43.786+0000 7fd2ac200640 1 -- 172.21.15.103:0/1416468318 wait complete. 2024-09-10T22:43:44.212 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:43:33.337095+0000', 'modified': '2024-09-10T22:43:36.351104+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6873}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6873': {'gid': 6873, 'name': 'c', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/249667943', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6833', 'nonce': 249667943}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 249667943}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6873, 'qdb_cluster': [6873]} 2024-09-10T22:43:44.212 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T22:43:44.212 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T22:43:44.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.350+0000 7f6020000640 1 -- 172.21.15.103:0/1267108989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60180b09c0 msgr2=0x7f60180ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:44.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.350+0000 7f6020000640 1 --2- 172.21.15.103:0/1267108989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60180b09c0 0x7f60180ce600 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f6004009900 tx=0x7f600401c850 comp rx=0 tx=0).stop 2024-09-10T22:43:44.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.350+0000 7f6020000640 1 -- 172.21.15.103:0/1267108989 shutdown_connections 2024-09-10T22:43:44.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.350+0000 7f6020000640 1 --2- 172.21.15.103:0/1267108989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60180b09c0 0x7f60180ce600 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.350+0000 7f6020000640 1 --2- 172.21.15.103:0/1267108989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f601815be30 0x7f60180ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.350+0000 7f6020000640 1 -- 172.21.15.103:0/1267108989 >> 172.21.15.103:0/1267108989 conn(0x7f60180d1ac0 msgr2=0x7f60180d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:44.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.350+0000 7f6020000640 1 -- 172.21.15.103:0/1267108989 shutdown_connections 2024-09-10T22:43:44.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.350+0000 7f6020000640 1 -- 172.21.15.103:0/1267108989 wait complete. 2024-09-10T22:43:44.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f6020000640 1 Processor -- start 2024-09-10T22:43:44.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f6020000640 1 -- start start 2024-09-10T22:43:44.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f6020000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60180b09c0 0x7f60180c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f6020000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60180ceb40 0x7f60181583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f6020000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f601815be30 0x7f60180c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f6020000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f60181691b0 con 0x7f60180ceb40 2024-09-10T22:43:44.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f6020000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6018169030 con 0x7f601815be30 2024-09-10T22:43:44.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f6020000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6018169330 con 0x7f60180b09c0 2024-09-10T22:43:44.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f601cc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60180ceb40 0x7f60181583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f601cc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60180ceb40 0x7f60181583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40332/0 (socket says 172.21.15.103:40332) 2024-09-10T22:43:44.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f601cc00640 1 -- 172.21.15.103:0/2132610479 learned_addr learned my addr 172.21.15.103:0/2132610479 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f601d600640 1 --2- 172.21.15.103:0/2132610479 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60180b09c0 0x7f60180c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f601e000640 1 --2- 172.21.15.103:0/2132610479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f601815be30 0x7f60180c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f601cc00640 1 -- 172.21.15.103:0/2132610479 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60180b09c0 msgr2=0x7f60180c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f601cc00640 1 --2- 172.21.15.103:0/2132610479 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60180b09c0 0x7f60180c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f601cc00640 1 -- 172.21.15.103:0/2132610479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f601815be30 msgr2=0x7f60180c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f601cc00640 1 --2- 172.21.15.103:0/2132610479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f601815be30 0x7f60180c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f601cc00640 1 -- 172.21.15.103:0/2132610479 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60180c90d0 con 0x7f60180ceb40 2024-09-10T22:43:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f601cc00640 1 --2- 172.21.15.103:0/2132610479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60180ceb40 0x7f60181583d0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6004009850 tx=0x7f60040a66a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f6015600640 1 -- 172.21.15.103:0/2132610479 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60040bc020 con 0x7f60180ceb40 2024-09-10T22:43:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f6015600640 1 -- 172.21.15.103:0/2132610479 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60040043b0 con 0x7f60180ceb40 2024-09-10T22:43:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f6020000640 1 -- 172.21.15.103:0/2132610479 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60181f7c80 con 0x7f60180ceb40 2024-09-10T22:43:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.354+0000 7f6015600640 1 -- 172.21.15.103:0/2132610479 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6004005290 con 0x7f60180ceb40 2024-09-10T22:43:44.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.358+0000 7f6020000640 1 -- 172.21.15.103:0/2132610479 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60181f8240 con 0x7f60180ceb40 2024-09-10T22:43:44.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.358+0000 7f6015600640 1 -- 172.21.15.103:0/2132610479 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6004005430 con 0x7f60180ceb40 2024-09-10T22:43:44.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.358+0000 7f6015600640 1 --2- 172.21.15.103:0/2132610479 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5ff80725e0 0x7f5ff8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f6015600640 1 -- 172.21.15.103:0/2132610479 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f600412da10 con 0x7f60180ceb40 2024-09-10T22:43:44.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f602333e000 1 Processor -- start 2024-09-10T22:43:44.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f601d600640 1 --2- 172.21.15.103:0/2132610479 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5ff80725e0 0x7f5ff8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f602333e000 1 -- start start 2024-09-10T22:43:44.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f601d600640 1 --2- 172.21.15.103:0/2132610479 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5ff80725e0 0x7f5ff8074aa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f600c009e60 tx=0x7f600c0095b0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:44.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f602333e000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167129d0 0x55be16712db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f602333e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be167132f0 0x55be166c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f602333e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be166c6e10 0x55be166c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f602333e000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55be165e73f0 con 0x55be167129d0 2024-09-10T22:43:44.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f602333e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55be16524b20 con 0x55be167132f0 2024-09-10T22:43:44.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f602333e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55be16513f50 con 0x55be166c6e10 2024-09-10T22:43:44.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f601d600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167129d0 0x55be16712db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f601d600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167129d0 0x55be16712db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40338/0 (socket says 172.21.15.103:40338) 2024-09-10T22:43:44.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f601d600640 1 -- 172.21.15.103:0/3647389547 learned_addr learned my addr 172.21.15.103:0/3647389547 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:44.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f601cc00640 1 --2- 172.21.15.103:0/3647389547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be167132f0 0x55be166c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f601e000640 1 --2- 172.21.15.103:0/3647389547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be166c6e10 0x55be166c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f601d600640 1 -- 172.21.15.103:0/3647389547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be166c6e10 msgr2=0x55be166c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:44.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f601d600640 1 --2- 172.21.15.103:0/3647389547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be166c6e10 0x55be166c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f601d600640 1 -- 172.21.15.103:0/3647389547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be167132f0 msgr2=0x55be166c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:44.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f601d600640 1 --2- 172.21.15.103:0/3647389547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be167132f0 0x55be166c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f601d600640 1 -- 172.21.15.103:0/3647389547 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be164db590 con 0x55be167129d0 2024-09-10T22:43:44.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f601e000640 1 --2- 172.21.15.103:0/3647389547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be166c6e10 0x55be166c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:43:44.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f601cc00640 1 --2- 172.21.15.103:0/3647389547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be167132f0 0x55be166c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:43:44.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f601d600640 1 --2- 172.21.15.103:0/3647389547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167129d0 0x55be16712db0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f600c003cd0 tx=0x7f600c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2453fa43798fb3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:44.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f600a000640 1 -- 172.21.15.103:0/3647389547 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c003dc0 con 0x55be167129d0 2024-09-10T22:43:44.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f600a000640 1 -- 172.21.15.103:0/3647389547 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f600c016070 con 0x55be167129d0 2024-09-10T22:43:44.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f600a000640 1 -- 172.21.15.103:0/3647389547 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c005020 con 0x55be167129d0 2024-09-10T22:43:44.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f602333e000 1 -- 172.21.15.103:0/3647389547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167129d0 msgr2=0x55be16712db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:44.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f602333e000 1 --2- 172.21.15.103:0/3647389547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167129d0 0x55be16712db0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f600c003cd0 tx=0x7f600c014000 comp rx=0 tx=0).stop 2024-09-10T22:43:44.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f602333e000 1 -- 172.21.15.103:0/3647389547 shutdown_connections 2024-09-10T22:43:44.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f602333e000 1 --2- 172.21.15.103:0/3647389547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be166c6e10 0x55be166c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f602333e000 1 --2- 172.21.15.103:0/3647389547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be167132f0 0x55be166c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f602333e000 1 --2- 172.21.15.103:0/3647389547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167129d0 0x55be16712db0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f602333e000 1 -- 172.21.15.103:0/3647389547 >> 172.21.15.103:0/3647389547 conn(0x55be165b0130 msgr2=0x55be166f5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:44.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f602333e000 1 -- 172.21.15.103:0/3647389547 shutdown_connections 2024-09-10T22:43:44.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.362+0000 7f602333e000 1 -- 172.21.15.103:0/3647389547 wait complete. 2024-09-10T22:43:44.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f602333e000 1 -- start start 2024-09-10T22:43:44.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f602333e000 1 Processor -- start 2024-09-10T22:43:44.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f602333e000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be166c6e10 0x55be166f36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f602333e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be167129d0 0x55be166f3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f602333e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be167132f0 0x55be166f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f602333e000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55be164ae5d0 con 0x55be166c6e10 2024-09-10T22:43:44.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f602333e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55be16517d60 con 0x55be167132f0 2024-09-10T22:43:44.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f602333e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55be164ba500 con 0x55be167129d0 2024-09-10T22:43:44.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f602333e000 10 client.0 _ll_register_callbacks cb 0x55be164be810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:43:44.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f601d600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be166c6e10 0x55be166f36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f601d600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be166c6e10 0x55be166f36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40352/0 (socket says 172.21.15.103:40352) 2024-09-10T22:43:44.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f601d600640 1 -- 172.21.15.103:0/3789164941 learned_addr learned my addr 172.21.15.103:0/3789164941 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:44.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f601e000640 1 --2- 172.21.15.103:0/3789164941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be167132f0 0x55be166f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f601cc00640 1 --2- 172.21.15.103:0/3789164941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be167129d0 0x55be166f3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f601d600640 1 -- 172.21.15.103:0/3789164941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be167129d0 msgr2=0x55be166f3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:44.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f601d600640 1 --2- 172.21.15.103:0/3789164941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be167129d0 0x55be166f3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f601d600640 1 -- 172.21.15.103:0/3789164941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be167132f0 msgr2=0x55be166f43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:44.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f601d600640 1 --2- 172.21.15.103:0/3789164941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be167132f0 0x55be166f43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f601d600640 1 -- 172.21.15.103:0/3789164941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be164b2170 con 0x55be166c6e10 2024-09-10T22:43:44.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f601d600640 1 --2- 172.21.15.103:0/3789164941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be166c6e10 0x55be166f36a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x55be164c5130 tx=0x7f600c012700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4537bf7589548cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:44.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f5ffea00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:43:44.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f5ffea00640 1 -- 172.21.15.103:0/3789164941 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c012b00 con 0x55be166c6e10 2024-09-10T22:43:44.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f5ffea00640 1 -- 172.21.15.103:0/3789164941 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f600c012ca0 con 0x55be166c6e10 2024-09-10T22:43:44.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f602333e000 1 -- 172.21.15.103:0/3789164941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55be164ac0f0 con 0x55be166c6e10 2024-09-10T22:43:44.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f5ffea00640 1 -- 172.21.15.103:0/3789164941 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f600c03b050 con 0x55be166c6e10 2024-09-10T22:43:44.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f602333e000 10 client.7032 fetch_fsmap learned FSMap version 72 2024-09-10T22:43:44.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f602333e000 1 -- 172.21.15.103:0/3789164941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x55be16598ef0 con 0x55be166c6e10 2024-09-10T22:43:44.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f5ffea00640 1 -- 172.21.15.103:0/3789164941 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55be164ac0f0 con 0x55be166c6e10 2024-09-10T22:43:44.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f5ffea00640 1 -- 172.21.15.103:0/3789164941 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 72) ==== 3502+0+0 (secure 0 0 0) 0x7f600c03e020 con 0x55be166c6e10 2024-09-10T22:43:44.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f602333e000 10 client.7032 fetch_fsmap finished waiting for FSMap version 72 2024-09-10T22:43:44.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f602333e000 10 client.7032 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:43:44.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f602333e000 20 client.7032 populate_metadata read hostname 'smithi103' 2024-09-10T22:43:44.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f602333e000 1 --2- 172.21.15.103:0/3789164941 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x55be166f50f0 0x55be16724c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f602333e000 4 client.7032 mds_command: new command op to 6873 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:43:44.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f602333e000 1 -- 172.21.15.103:0/3789164941 --> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be16526a70 con 0x55be166f50f0 2024-09-10T22:43:44.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.366+0000 7f601cc00640 1 --2- 172.21.15.103:0/3789164941 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x55be166f50f0 0x55be16724c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.370+0000 7f601cc00640 1 --2- 172.21.15.103:0/3789164941 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x55be166f50f0 0x55be16724c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aae6efcd939e5ee server_cookie=b95dd8539ad64f9d in_seq=0 out_seq=0 2024-09-10T22:43:44.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.370+0000 7f5ffea00640 10 client.7032 ms_handle_connect on v2:172.21.15.103:6833/249667943 2024-09-10T22:43:44.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.370+0000 7f5ffea00640 1 -- 172.21.15.103:0/3789164941 <== mds.0 v2:172.21.15.103:6833/249667943 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55be16526a70 con 0x55be166f50f0 2024-09-10T22:43:44.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.370+0000 7f5ffea00640 10 client.7032 handle_command_reply: tid=0 2024-09-10T22:43:44.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.370+0000 7f602333e000 1 client.7032 shutdown 2024-09-10T22:43:44.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.370+0000 7f602333e000 1 -- 172.21.15.103:0/3789164941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be166c6e10 msgr2=0x55be166f36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:44.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.370+0000 7f602333e000 1 --2- 172.21.15.103:0/3789164941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be166c6e10 0x55be166f36a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x55be164c5130 tx=0x7f600c012700 comp rx=0 tx=0).stop 2024-09-10T22:43:44.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.370+0000 7f602333e000 1 -- 172.21.15.103:0/3789164941 shutdown_connections 2024-09-10T22:43:44.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.370+0000 7f602333e000 1 --2- 172.21.15.103:0/3789164941 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x55be166f50f0 0x55be16724c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.370+0000 7f602333e000 1 --2- 172.21.15.103:0/3789164941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be167132f0 0x55be166f43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.370+0000 7f602333e000 1 --2- 172.21.15.103:0/3789164941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be167129d0 0x55be166f3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.370+0000 7f602333e000 1 --2- 172.21.15.103:0/3789164941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be166c6e10 0x55be166f36a0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.370+0000 7f602333e000 1 -- 172.21.15.103:0/3789164941 >> 172.21.15.103:0/3789164941 conn(0x55be165b0130 msgr2=0x55be166c5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:44.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.370+0000 7f5ffea00640 0 client.7032 ms_handle_reset on v2:172.21.15.103:6833/249667943 2024-09-10T22:43:44.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.370+0000 7f602333e000 1 -- 172.21.15.103:0/3789164941 shutdown_connections 2024-09-10T22:43:44.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.370+0000 7f602333e000 1 -- 172.21.15.103:0/3789164941 wait complete. 2024-09-10T22:43:44.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.370+0000 7f602333e000 20 client.7032 trim_cache size 0 max 16384 2024-09-10T22:43:44.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.386+0000 7f602333e000 1 Processor -- start 2024-09-10T22:43:44.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.386+0000 7f602333e000 1 -- start start 2024-09-10T22:43:44.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f602333e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be166c6e10 0x55be16711cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f602333e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be167129d0 0x55be16712200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f602333e000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167132f0 0x55be166c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f602333e000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6018204920 con 0x55be167132f0 2024-09-10T22:43:44.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f602333e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6018203960 con 0x55be166c6e10 2024-09-10T22:43:44.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f602333e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f60181fb960 con 0x55be167129d0 2024-09-10T22:43:44.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f601e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167132f0 0x55be166c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f601e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167132f0 0x55be166c50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40366/0 (socket says 172.21.15.103:40366) 2024-09-10T22:43:44.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f601e000640 1 -- 172.21.15.103:0/1729136254 learned_addr learned my addr 172.21.15.103:0/1729136254 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:44.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f601d600640 1 --2- 172.21.15.103:0/1729136254 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be166c6e10 0x55be16711cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f601cc00640 1 --2- 172.21.15.103:0/1729136254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be167129d0 0x55be16712200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f601e000640 1 -- 172.21.15.103:0/1729136254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be167129d0 msgr2=0x55be16712200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:44.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f601e000640 1 --2- 172.21.15.103:0/1729136254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be167129d0 0x55be16712200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f601e000640 1 -- 172.21.15.103:0/1729136254 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be166c6e10 msgr2=0x55be16711cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:44.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f601e000640 1 --2- 172.21.15.103:0/1729136254 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be166c6e10 0x55be16711cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f601e000640 1 -- 172.21.15.103:0/1729136254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be1656fd90 con 0x55be167132f0 2024-09-10T22:43:44.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f601cc00640 1 --2- 172.21.15.103:0/1729136254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be167129d0 0x55be16712200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:44.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f601e000640 1 --2- 172.21.15.103:0/1729136254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167132f0 0x55be166c50a0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f6010004fd0 tx=0x7f6010007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e631c56c0484c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:44.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f6009600640 1 -- 172.21.15.103:0/1729136254 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601001a070 con 0x55be167132f0 2024-09-10T22:43:44.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f6009600640 1 -- 172.21.15.103:0/1729136254 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6010014bf0 con 0x55be167132f0 2024-09-10T22:43:44.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f6009600640 1 -- 172.21.15.103:0/1729136254 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601001f460 con 0x55be167132f0 2024-09-10T22:43:44.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f602333e000 1 -- 172.21.15.103:0/1729136254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167132f0 msgr2=0x55be166c50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:44.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f602333e000 1 --2- 172.21.15.103:0/1729136254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167132f0 0x55be166c50a0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f6010004fd0 tx=0x7f6010007dc0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f602333e000 1 -- 172.21.15.103:0/1729136254 shutdown_connections 2024-09-10T22:43:44.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f602333e000 1 --2- 172.21.15.103:0/1729136254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167132f0 0x55be166c50a0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f602333e000 1 --2- 172.21.15.103:0/1729136254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be167129d0 0x55be16712200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f602333e000 1 --2- 172.21.15.103:0/1729136254 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be166c6e10 0x55be16711cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f602333e000 1 -- 172.21.15.103:0/1729136254 >> 172.21.15.103:0/1729136254 conn(0x55be165b0130 msgr2=0x55be167115b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:44.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f602333e000 1 -- 172.21.15.103:0/1729136254 shutdown_connections 2024-09-10T22:43:44.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f602333e000 1 -- 172.21.15.103:0/1729136254 wait complete. 2024-09-10T22:43:44.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f602333e000 1 -- start start 2024-09-10T22:43:44.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.390+0000 7f602333e000 1 Processor -- start 2024-09-10T22:43:44.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be166c6e10 0x55be167889f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167129d0 0x55be16788f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be167132f0 0x55be16789470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55be1651c390 con 0x55be167129d0 2024-09-10T22:43:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55be165238f0 con 0x55be166c6e10 2024-09-10T22:43:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55be165d3730 con 0x55be167132f0 2024-09-10T22:43:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 10 client.0 _ll_register_callbacks cb 0x7f600c003ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:43:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f601cc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167129d0 0x55be16788f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f601cc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167129d0 0x55be16788f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40378/0 (socket says 172.21.15.103:40378) 2024-09-10T22:43:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f601cc00640 1 -- 172.21.15.103:0/1742837960 learned_addr learned my addr 172.21.15.103:0/1742837960 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f601e000640 1 --2- 172.21.15.103:0/1742837960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be167132f0 0x55be16789470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f601d600640 1 --2- 172.21.15.103:0/1742837960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be166c6e10 0x55be167889f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f601cc00640 1 -- 172.21.15.103:0/1742837960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be167132f0 msgr2=0x55be16789470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f601cc00640 1 --2- 172.21.15.103:0/1742837960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be167132f0 0x55be16789470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f601cc00640 1 -- 172.21.15.103:0/1742837960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be166c6e10 msgr2=0x55be167889f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f601cc00640 1 --2- 172.21.15.103:0/1742837960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be166c6e10 0x55be167889f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f601cc00640 1 -- 172.21.15.103:0/1742837960 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be164daa90 con 0x55be167129d0 2024-09-10T22:43:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f601cc00640 1 --2- 172.21.15.103:0/1742837960 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167129d0 0x55be16788f30 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f60040f8600 tx=0x7f60040fd260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3584bfc066fd10 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f5ffea00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:43:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f5ffea00640 1 -- 172.21.15.103:0/1742837960 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600412d040 con 0x55be167129d0 2024-09-10T22:43:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f5ffea00640 1 -- 172.21.15.103:0/1742837960 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f6004111cc0 con 0x55be167129d0 2024-09-10T22:43:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 -- 172.21.15.103:0/1742837960 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6010014bf0 con 0x55be167129d0 2024-09-10T22:43:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f5ffea00640 1 -- 172.21.15.103:0/1742837960 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f6004111ec0 con 0x55be167129d0 2024-09-10T22:43:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 10 client.7038 fetch_fsmap learned FSMap version 72 2024-09-10T22:43:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 -- 172.21.15.103:0/1742837960 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x55be164b9050 con 0x55be167129d0 2024-09-10T22:43:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f5ffea00640 1 -- 172.21.15.103:0/1742837960 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6010014bf0 con 0x55be167129d0 2024-09-10T22:43:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f5ffea00640 1 -- 172.21.15.103:0/1742837960 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 72) ==== 3502+0+0 (secure 0 0 0) 0x7f60040f9b80 con 0x55be167129d0 2024-09-10T22:43:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 10 client.7038 fetch_fsmap finished waiting for FSMap version 72 2024-09-10T22:43:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 10 client.7038 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:43:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 20 client.7038 populate_metadata read hostname 'smithi103' 2024-09-10T22:43:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 --2- 172.21.15.103:0/1742837960 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x55be16727070 0x55be16727450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 4 client.7038 mds_command: new command op to 6873 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:43:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 -- 172.21.15.103:0/1742837960 --> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] -- command(tid 0: {"prefix": "status"}) -- 0x55be16522520 con 0x55be16727070 2024-09-10T22:43:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f601d600640 1 --2- 172.21.15.103:0/1742837960 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x55be16727070 0x55be16727450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f601d600640 1 --2- 172.21.15.103:0/1742837960 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x55be16727070 0x55be16727450 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c23ba8472c5e513f server_cookie=22e89f4ba0c2556e in_seq=0 out_seq=0 2024-09-10T22:43:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f5ffea00640 10 client.7038 ms_handle_connect on v2:172.21.15.103:6833/249667943 2024-09-10T22:43:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f5ffea00640 1 -- 172.21.15.103:0/1742837960 <== mds.0 v2:172.21.15.103:6833/249667943 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55be16522520 con 0x55be16727070 2024-09-10T22:43:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f5ffea00640 10 client.7038 handle_command_reply: tid=0 2024-09-10T22:43:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 client.7038 shutdown 2024-09-10T22:43:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 -- 172.21.15.103:0/1742837960 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167129d0 msgr2=0x55be16788f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 --2- 172.21.15.103:0/1742837960 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167129d0 0x55be16788f30 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f60040f8600 tx=0x7f60040fd260 comp rx=0 tx=0).stop 2024-09-10T22:43:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 -- 172.21.15.103:0/1742837960 shutdown_connections 2024-09-10T22:43:44.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 --2- 172.21.15.103:0/1742837960 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x55be16727070 0x55be16727450 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 --2- 172.21.15.103:0/1742837960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55be167132f0 0x55be16789470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f5ffea00640 0 client.7038 ms_handle_reset on v2:172.21.15.103:6833/249667943 2024-09-10T22:43:44.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 --2- 172.21.15.103:0/1742837960 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55be167129d0 0x55be16788f30 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 --2- 172.21.15.103:0/1742837960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55be166c6e10 0x55be167889f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 -- 172.21.15.103:0/1742837960 >> 172.21.15.103:0/1742837960 conn(0x55be165b0130 msgr2=0x55be166c50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:44.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 -- 172.21.15.103:0/1742837960 shutdown_connections 2024-09-10T22:43:44.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 1 -- 172.21.15.103:0/1742837960 wait complete. 2024-09-10T22:43:44.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.394+0000 7f602333e000 20 client.7038 trim_cache size 0 max 16384 2024-09-10T22:43:44.404 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:43:44.405 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:43:44.405 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-10T22:43:44.405 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6873, 2024-09-10T22:43:44.405 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:43:44.405 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:43:44.405 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:43:44.405 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 10.461759786, 2024-09-10T22:43:44.405 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 72, 2024-09-10T22:43:44.405 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 81, 2024-09-10T22:43:44.405 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 81, 2024-09-10T22:43:44.405 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 14.943670857000001 2024-09-10T22:43:44.405 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:43:44.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.398+0000 7f6020000640 1 -- 172.21.15.103:0/2132610479 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5ff80725e0 msgr2=0x7f5ff8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:44.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.398+0000 7f6020000640 1 --2- 172.21.15.103:0/2132610479 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5ff80725e0 0x7f5ff8074aa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f600c009e60 tx=0x7f600c0095b0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.398+0000 7f6020000640 1 -- 172.21.15.103:0/2132610479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60180ceb40 msgr2=0x7f60181583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:44.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.398+0000 7f6020000640 1 --2- 172.21.15.103:0/2132610479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60180ceb40 0x7f60181583d0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6004009850 tx=0x7f60040a66a0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.398+0000 7f6020000640 1 -- 172.21.15.103:0/2132610479 shutdown_connections 2024-09-10T22:43:44.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.398+0000 7f6020000640 1 --2- 172.21.15.103:0/2132610479 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5ff80725e0 0x7f5ff8074aa0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.398+0000 7f6020000640 1 --2- 172.21.15.103:0/2132610479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f601815be30 0x7f60180c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.398+0000 7f6020000640 1 --2- 172.21.15.103:0/2132610479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60180ceb40 0x7f60181583d0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.398+0000 7f6020000640 1 --2- 172.21.15.103:0/2132610479 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60180b09c0 0x7f60180c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.398+0000 7f6020000640 1 -- 172.21.15.103:0/2132610479 >> 172.21.15.103:0/2132610479 conn(0x7f60180d1ac0 msgr2=0x7f6018165c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:44.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.398+0000 7f6020000640 1 -- 172.21.15.103:0/2132610479 shutdown_connections 2024-09-10T22:43:44.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.398+0000 7f6020000640 1 -- 172.21.15.103:0/2132610479 wait complete. 2024-09-10T22:43:44.422 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T22:43:44.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.558+0000 7f1792c00640 1 -- 172.21.15.103:0/1445172202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f178c0717a0 msgr2=0x7f178c0afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:44.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.558+0000 7f1792c00640 1 --2- 172.21.15.103:0/1445172202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f178c0717a0 0x7f178c0afc60 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f178c0b14a0 tx=0x7f178401c790 comp rx=0 tx=0).stop 2024-09-10T22:43:44.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.558+0000 7f1792c00640 1 -- 172.21.15.103:0/1445172202 shutdown_connections 2024-09-10T22:43:44.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.558+0000 7f1792c00640 1 --2- 172.21.15.103:0/1445172202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f178c0717a0 0x7f178c0afc60 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.558+0000 7f1792c00640 1 --2- 172.21.15.103:0/1445172202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f178c0d25f0 0x7f178c0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.558+0000 7f1792c00640 1 -- 172.21.15.103:0/1445172202 >> 172.21.15.103:0/1445172202 conn(0x7f178c0d1ad0 msgr2=0x7f178c0d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:44.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.558+0000 7f1792c00640 1 -- 172.21.15.103:0/1445172202 shutdown_connections 2024-09-10T22:43:44.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.558+0000 7f1792c00640 1 -- 172.21.15.103:0/1445172202 wait complete. 2024-09-10T22:43:44.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f1792c00640 1 Processor -- start 2024-09-10T22:43:44.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f1792c00640 1 -- start start 2024-09-10T22:43:44.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f1792c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f178c0717a0 0x7f178c0b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f1792c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f178c0cfda0 0x7f178c154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f1792c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f178c0d25f0 0x7f178c155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f1792c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f178c169160 con 0x7f178c0717a0 2024-09-10T22:43:44.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f1792c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f178c168fe0 con 0x7f178c0d25f0 2024-09-10T22:43:44.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f1792c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f178c1692e0 con 0x7f178c0cfda0 2024-09-10T22:43:44.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f178be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f178c0717a0 0x7f178c0b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f178be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f178c0717a0 0x7f178c0b14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40396/0 (socket says 172.21.15.103:40396) 2024-09-10T22:43:44.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f178be00640 1 -- 172.21.15.103:0/3248809017 learned_addr learned my addr 172.21.15.103:0/3248809017 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:44.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f1790c00640 1 --2- 172.21.15.103:0/3248809017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f178c0d25f0 0x7f178c155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f1783400640 1 --2- 172.21.15.103:0/3248809017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f178c0cfda0 0x7f178c154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f178be00640 1 -- 172.21.15.103:0/3248809017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f178c0cfda0 msgr2=0x7f178c154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:44.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f178be00640 1 --2- 172.21.15.103:0/3248809017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f178c0cfda0 0x7f178c154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f178be00640 1 -- 172.21.15.103:0/3248809017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f178c0d25f0 msgr2=0x7f178c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:44.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f178be00640 1 --2- 172.21.15.103:0/3248809017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f178c0d25f0 0x7f178c155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f178be00640 1 -- 172.21.15.103:0/3248809017 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178c0c9a70 con 0x7f178c0717a0 2024-09-10T22:43:44.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f178be00640 1 --2- 172.21.15.103:0/3248809017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f178c0717a0 0x7f178c0b14a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f177c00c870 tx=0x7f177c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:44.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f1788c00640 1 -- 172.21.15.103:0/3248809017 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c003b80 con 0x7f178c0717a0 2024-09-10T22:43:44.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f1788c00640 1 -- 172.21.15.103:0/3248809017 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f177c003d20 con 0x7f178c0717a0 2024-09-10T22:43:44.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f1788c00640 1 -- 172.21.15.103:0/3248809017 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c00aab0 con 0x7f178c0717a0 2024-09-10T22:43:44.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f1792c00640 1 -- 172.21.15.103:0/3248809017 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f178c158ed0 con 0x7f178c0717a0 2024-09-10T22:43:44.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.562+0000 7f1792c00640 1 -- 172.21.15.103:0/3248809017 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f178c156150 con 0x7f178c0717a0 2024-09-10T22:43:44.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.566+0000 7f1792c00640 1 -- 172.21.15.103:0/3248809017 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f178c15eca0 con 0x7f178c0717a0 2024-09-10T22:43:44.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.566+0000 7f1788c00640 1 -- 172.21.15.103:0/3248809017 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f177c00ac50 con 0x7f178c0717a0 2024-09-10T22:43:44.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.566+0000 7f1788c00640 1 --2- 172.21.15.103:0/3248809017 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f17680725e0 0x7f1768074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:44.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.566+0000 7f1788c00640 1 -- 172.21.15.103:0/3248809017 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f177c0931b0 con 0x7f178c0717a0 2024-09-10T22:43:44.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.566+0000 7f1783400640 1 --2- 172.21.15.103:0/3248809017 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f17680725e0 0x7f1768074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:44.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.566+0000 7f1783400640 1 --2- 172.21.15.103:0/3248809017 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f17680725e0 0x7f1768074aa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f178c159700 tx=0x7f177400b2e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:44.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.570+0000 7f1788c00640 1 -- 172.21.15.103:0/3248809017 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f178c0c9a70 con 0x7f178c0717a0 2024-09-10T22:43:44.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.770+0000 7f1792c00640 1 -- 172.21.15.103:0/3248809017 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f178c0b7600 con 0x7f178c0717a0 2024-09-10T22:43:44.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.770+0000 7f1788c00640 1 -- 172.21.15.103:0/3248809017 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) ==== 53+0+73 (secure 0 0 0) 0x7f177c05e0b0 con 0x7f178c0717a0 2024-09-10T22:43:44.776 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T22:43:44.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.774+0000 7f1792c00640 1 -- 172.21.15.103:0/3248809017 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f17680725e0 msgr2=0x7f1768074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:44.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.774+0000 7f1792c00640 1 --2- 172.21.15.103:0/3248809017 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f17680725e0 0x7f1768074aa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f178c159700 tx=0x7f177400b2e0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.774+0000 7f1792c00640 1 -- 172.21.15.103:0/3248809017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f178c0717a0 msgr2=0x7f178c0b14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:44.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.774+0000 7f1792c00640 1 --2- 172.21.15.103:0/3248809017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f178c0717a0 0x7f178c0b14a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f177c00c870 tx=0x7f177c00cd30 comp rx=0 tx=0).stop 2024-09-10T22:43:44.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.774+0000 7f1792c00640 1 -- 172.21.15.103:0/3248809017 shutdown_connections 2024-09-10T22:43:44.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.774+0000 7f1792c00640 1 --2- 172.21.15.103:0/3248809017 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f17680725e0 0x7f1768074aa0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.774+0000 7f1792c00640 1 --2- 172.21.15.103:0/3248809017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f178c0d25f0 0x7f178c155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.774+0000 7f1792c00640 1 --2- 172.21.15.103:0/3248809017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f178c0cfda0 0x7f178c154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.774+0000 7f1792c00640 1 --2- 172.21.15.103:0/3248809017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f178c0717a0 0x7f178c0b14a0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:44.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.774+0000 7f1792c00640 1 -- 172.21.15.103:0/3248809017 >> 172.21.15.103:0/3248809017 conn(0x7f178c0d1ad0 msgr2=0x7f178c0b5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:44.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.774+0000 7f1792c00640 1 -- 172.21.15.103:0/3248809017 shutdown_connections 2024-09-10T22:43:44.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:44.774+0000 7f1792c00640 1 -- 172.21.15.103:0/3248809017 wait complete. 2024-09-10T22:43:44.797 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T22:43:44.797 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T22:43:44.798 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-10T22:43:44.798 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T22:43:44.798 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T22:43:44.798 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T22:43:44.798 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T22:43:44.798 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T22:43:44.798 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:43:44.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:43:44.798 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-10T22:43:44.808 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T22:43:44.808 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T22:43:44.808 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T22:43:44.808 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:43:44.808 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-10T22:43:44.808 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:43:44.808 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:43:44.808 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:43:44.808 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-10T22:43:44.808 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:43:44.808 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:43:44.809 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-10T22:43:44.809 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:43:44.809 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-10T22:43:44.809 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T22:43:44.809 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-10T22:43:44.809 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-10T22:43:44.809 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42157sec preferred_lft 42157sec 2024-09-10T22:43:44.809 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2024-09-10T22:43:44.809 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:43:44.809 INFO:teuthology.orchestra.run.smithi103.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T22:43:44.809 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 02:42:c3:dd:ba:ba brd ff:ff:ff:ff:ff:ff 2024-09-10T22:43:44.809 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T22:43:44.809 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:43:44.810 INFO:teuthology.orchestra.run.smithi103.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T22:43:44.810 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T22:43:44.810 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T22:43:44.810 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:43:44.810 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T22:43:44.810 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:43:44.810 INFO:teuthology.orchestra.run.smithi103.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T22:43:44.810 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:43:44.810 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T22:43:44.810 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:43:44.810 INFO:teuthology.orchestra.run.smithi103.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T22:43:44.810 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:43:44.810 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T22:43:44.811 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:43:44.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:43:44.811 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T22:43:44.869 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-10T22:43:44.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:43:44.871 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-10T22:43:44.922 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-10T22:43:44.923 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T22:43:44.923 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-10T22:43:44.923 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T22:43:44.923 INFO:teuthology.orchestra.run.smithi103.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-10T22:43:44.923 INFO:teuthology.orchestra.run.smithi103.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T22:43:44.923 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T22:43:44.923 INFO:teuthology.orchestra.run.smithi103.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:43:44.923 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:43:44.923 INFO:teuthology.orchestra.run.smithi103.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:43:44.923 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T22:43:44.924 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:43:44.924 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:43:44.924 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T22:43:44.924 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T22:43:44.924 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T22:43:44.924 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:43:45.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:43:45.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:43:45.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:43:45.062 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-10T22:43:45.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T22:43:45.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T22:43:45.071 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:43:45.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:43:45.071 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-10T22:43:45.132 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T22:43:45.132 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:43:45.133 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T22:43:45.184 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:43:45.185 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:43:45.185 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T22:43:45.238 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:43:45.300 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:43:45.361 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:43:45.362 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:43:45.362 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:43:45.362 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:43:45.362 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:43:45.362 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:43:45.362 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:43:45.362 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:43:45.363 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:43:45.363 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:43:45.363 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:43:45.363 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:43:45.363 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:43:45.363 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:43:45.363 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:43:45.363 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:43:45.363 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:43:45.363 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:43:45.363 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:43:45.364 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:43:45.364 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:43:45.364 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:43:45.364 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:43:45.364 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:43:45.364 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:43:45.364 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:43:45.364 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:43:45.364 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:43:45.364 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:43:45.364 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:43:45.365 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:43:45.365 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:43:45.365 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:43:45.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:43:45.366 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:43:45.416 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T22:43:45.416 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T22:43:45.463 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:43:45.483 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:43:45.541 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:43:45.541 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:43:45.541 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:43:45.541 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:43:45.541 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:43:45.541 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:43:45.542 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:43:45.542 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:43:45.542 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:43:45.542 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:43:45.542 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:43:45.542 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:43:45.542 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:43:45.542 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:43:45.542 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:43:45.542 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:43:45.542 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:43:45.542 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:43:45.542 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:43:45.543 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:43:45.543 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:43:45.543 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:43:45.543 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:43:45.543 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:43:45.543 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:43:45.543 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:43:45.543 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:43:45.543 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:43:45.543 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:43:45.543 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:43:45.543 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:43:45.543 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:43:45.543 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:43:45.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:43:45.544 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:43:45.556 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2024-09-10T22:43:45.554+0000 7fa3e5f6c580 -1 init, newargv = 0x559065148af0 newargc=15 2024-09-10T22:43:45.557 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[44639]: starting ceph client 2024-09-10T22:43:45.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[44639]: starting fuse 2024-09-10T22:43:45.566 INFO:teuthology.orchestra.run.smithi103.stdout:44 2024-09-10T22:43:45.566 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T22:43:45.566 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-09-10T22:43:45.566 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-09-10T22:43:45.566 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-09-10T22:43:45.566 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:43:45.566 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-09-10T22:43:45.566 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:43:45.567 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-09-10T22:43:45.567 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T22:43:45.567 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-09-10T22:43:45.567 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T22:43:45.567 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:43:45.567 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-09-10T22:43:45.567 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-09-10T22:43:45.567 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-09-10T22:43:45.567 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-09-10T22:43:45.567 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:43:45.567 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-09-10T22:43:45.567 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T22:43:45.567 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T22:43:45.567 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T22:43:45.567 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-09-10T22:43:45.568 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-09-10T22:43:45.568 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-09-10T22:43:45.568 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T22:43:45.568 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:43:45.568 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.0")) 2024-09-10T22:43:45.568 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:43:45.691 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.44639.asok 2024-09-10T22:43:45.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:43:45.702 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44639.asok 2024-09-10T22:43:45.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:43:45.702 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44639.asok status 2024-09-10T22:43:45.875 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:43:45.875 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-09-10T22:43:45.875 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T22:43:45.875 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:43:45.875 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2024-09-10T22:43:45.875 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-09-10T22:43:45.876 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T22:43:45.876 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "44639", 2024-09-10T22:43:45.876 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-09-10T22:43:45.876 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:45.876 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-09-10T22:43:45.876 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-09-10T22:43:45.877 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7053, 2024-09-10T22:43:45.877 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-09-10T22:43:45.877 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-09-10T22:43:45.877 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-09-10T22:43:45.877 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7053 2024-09-10T22:43:45.877 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:45.877 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T22:43:45.878 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T22:43:45.878 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-10T22:43:45.878 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2351319776 2024-09-10T22:43:45.878 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:43:45.878 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:45.878 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T22:43:45.879 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T22:43:45.879 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-10T22:43:45.879 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2351319776 2024-09-10T22:43:45.879 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:43:45.879 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.7053 192.168.0.1:0/2351319776", 2024-09-10T22:43:45.879 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/2351319776", 2024-09-10T22:43:45.879 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-09-10T22:43:45.879 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 72, 2024-09-10T22:43:45.880 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 81, 2024-09-10T22:43:45.880 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-09-10T22:43:45.880 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-09-10T22:43:45.880 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-09-10T22:43:45.880 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:43:45.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:43:45.891 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-09-10T22:43:45.891 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T22:43:45.900 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-09-10T22:43:45.901 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T22:43:45.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:43:45.901 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T22:43:45.967 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-10T22:43:46.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f4a200640 1 -- 172.21.15.103:0/3512789903 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f440cf790 msgr2=0x7f9f440cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:46.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f4a200640 1 --2- 172.21.15.103:0/3512789903 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f440cf790 0x7f9f440cfc20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009c80 tx=0x7f9f3c01cd10 comp rx=0 tx=0).stop 2024-09-10T22:43:46.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f4a200640 1 -- 172.21.15.103:0/3512789903 shutdown_connections 2024-09-10T22:43:46.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f4a200640 1 --2- 172.21.15.103:0/3512789903 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f440cf790 0x7f9f440cfc20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:46.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f4a200640 1 --2- 172.21.15.103:0/3512789903 >> v2:172.21.15.131:3300/0 conn(0x7f9f440cc120 0x7f9f440aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:46.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f4a200640 1 -- 172.21.15.103:0/3512789903 >> 172.21.15.103:0/3512789903 conn(0x7f9f4406cc00 msgr2=0x7f9f4406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:46.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f4a200640 1 -- 172.21.15.103:0/3512789903 shutdown_connections 2024-09-10T22:43:46.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f4a200640 1 -- 172.21.15.103:0/3512789903 wait complete. 2024-09-10T22:43:46.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f4a200640 1 Processor -- start 2024-09-10T22:43:46.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f4a200640 1 -- start start 2024-09-10T22:43:46.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f4a200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f440cc120 0x7f9f441508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:46.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f4a200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f440cf790 0x7f9f44153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:46.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f4a200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f4415c970 0x7f9f441568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:46.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f4a200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9f44168ba0 con 0x7f9f440cc120 2024-09-10T22:43:46.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f4a200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9f44168a20 con 0x7f9f4415c970 2024-09-10T22:43:46.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f4a200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9f44168d20 con 0x7f9f440cf790 2024-09-10T22:43:46.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f43400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f440cc120 0x7f9f441508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:46.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f43400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f440cc120 0x7f9f441508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40400/0 (socket says 172.21.15.103:40400) 2024-09-10T22:43:46.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.150+0000 7f9f43400640 1 -- 172.21.15.103:0/3086692564 learned_addr learned my addr 172.21.15.103:0/3086692564 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:46.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.154+0000 7f9f42a00640 1 --2- 172.21.15.103:0/3086692564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f440cf790 0x7f9f44153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:46.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.154+0000 7f9f43e00640 1 --2- 172.21.15.103:0/3086692564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f4415c970 0x7f9f441568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:46.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.154+0000 7f9f43400640 1 -- 172.21.15.103:0/3086692564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f440cf790 msgr2=0x7f9f44153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:46.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.154+0000 7f9f43400640 1 --2- 172.21.15.103:0/3086692564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f440cf790 0x7f9f44153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:46.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.154+0000 7f9f43400640 1 -- 172.21.15.103:0/3086692564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f4415c970 msgr2=0x7f9f441568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:46.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.154+0000 7f9f43400640 1 --2- 172.21.15.103:0/3086692564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f4415c970 0x7f9f441568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:46.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.154+0000 7f9f43400640 1 -- 172.21.15.103:0/3086692564 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f44153e70 con 0x7f9f440cc120 2024-09-10T22:43:46.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.154+0000 7f9f42a00640 1 --2- 172.21.15.103:0/3086692564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f440cf790 0x7f9f44153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:43:46.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.154+0000 7f9f43e00640 1 --2- 172.21.15.103:0/3086692564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f4415c970 0x7f9f441568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:43:46.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.154+0000 7f9f43400640 1 --2- 172.21.15.103:0/3086692564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f440cc120 0x7f9f441508e0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400ea40 tx=0x7f9f3400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:46.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.154+0000 7f9f3b400640 1 -- 172.21.15.103:0/3086692564 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3400ce40 con 0x7f9f440cc120 2024-09-10T22:43:46.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.154+0000 7f9f3b400640 1 -- 172.21.15.103:0/3086692564 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f34004020 con 0x7f9f440cc120 2024-09-10T22:43:46.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.154+0000 7f9f3b400640 1 -- 172.21.15.103:0/3086692564 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34004470 con 0x7f9f440cc120 2024-09-10T22:43:46.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.154+0000 7f9f4a200640 1 -- 172.21.15.103:0/3086692564 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f44154150 con 0x7f9f440cc120 2024-09-10T22:43:46.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.154+0000 7f9f4a200640 1 -- 172.21.15.103:0/3086692564 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f44153ad0 con 0x7f9f440cc120 2024-09-10T22:43:46.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.154+0000 7f9f4a200640 1 -- 172.21.15.103:0/3086692564 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f440cfc20 con 0x7f9f440cc120 2024-09-10T22:43:46.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.154+0000 7f9f3b400640 1 -- 172.21.15.103:0/3086692564 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9f34003600 con 0x7f9f440cc120 2024-09-10T22:43:46.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.158+0000 7f9f3b400640 1 --2- 172.21.15.103:0/3086692564 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9f240725e0 0x7f9f24074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:46.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.158+0000 7f9f3b400640 1 -- 172.21.15.103:0/3086692564 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f9f34093e20 con 0x7f9f440cc120 2024-09-10T22:43:46.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.158+0000 7f9f42a00640 1 --2- 172.21.15.103:0/3086692564 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9f240725e0 0x7f9f24074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:46.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.158+0000 7f9f42a00640 1 --2- 172.21.15.103:0/3086692564 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9f240725e0 0x7f9f24074aa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9f44164cd0 tx=0x7f9f30009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:46.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.162+0000 7f9f3b400640 1 -- 172.21.15.103:0/3086692564 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9f3405f360 con 0x7f9f440cc120 2024-09-10T22:43:46.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.362+0000 7f9f4a200640 1 -- 172.21.15.103:0/3086692564 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f9f440b0200 con 0x7f9f440cc120 2024-09-10T22:43:47.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:46.998+0000 7f9f3b400640 1 -- 172.21.15.103:0/3086692564 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v73) ==== 105+0+0 (secure 0 0 0) 0x7f9f3405ec60 con 0x7f9f440cc120 2024-09-10T22:43:47.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.002+0000 7f9f4a200640 1 -- 172.21.15.103:0/3086692564 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9f240725e0 msgr2=0x7f9f24074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:47.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.002+0000 7f9f4a200640 1 --2- 172.21.15.103:0/3086692564 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9f240725e0 0x7f9f24074aa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9f44164cd0 tx=0x7f9f30009040 comp rx=0 tx=0).stop 2024-09-10T22:43:47.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.002+0000 7f9f4a200640 1 -- 172.21.15.103:0/3086692564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f440cc120 msgr2=0x7f9f441508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:47.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.002+0000 7f9f4a200640 1 --2- 172.21.15.103:0/3086692564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f440cc120 0x7f9f441508e0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400ea40 tx=0x7f9f3400ef00 comp rx=0 tx=0).stop 2024-09-10T22:43:47.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.002+0000 7f9f4a200640 1 -- 172.21.15.103:0/3086692564 shutdown_connections 2024-09-10T22:43:47.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.002+0000 7f9f4a200640 1 --2- 172.21.15.103:0/3086692564 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9f240725e0 0x7f9f24074aa0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:47.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.002+0000 7f9f4a200640 1 --2- 172.21.15.103:0/3086692564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f4415c970 0x7f9f441568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:47.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.002+0000 7f9f4a200640 1 --2- 172.21.15.103:0/3086692564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f440cf790 0x7f9f44153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:47.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.002+0000 7f9f4a200640 1 --2- 172.21.15.103:0/3086692564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f440cc120 0x7f9f441508e0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:47.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.002+0000 7f9f4a200640 1 -- 172.21.15.103:0/3086692564 >> 172.21.15.103:0/3086692564 conn(0x7f9f4406cc00 msgr2=0x7f9f4415c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:47.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.002+0000 7f9f4a200640 1 -- 172.21.15.103:0/3086692564 shutdown_connections 2024-09-10T22:43:47.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.002+0000 7f9f4a200640 1 -- 172.21.15.103:0/3086692564 wait complete. 2024-09-10T22:43:47.033 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:43:47.131 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:43:47.135 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:43:47.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.174+0000 7f756ae00640 1 -- 172.21.15.103:0/842006080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75640b09c0 msgr2=0x7f75640ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:47.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.174+0000 7f756ae00640 1 --2- 172.21.15.103:0/842006080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75640b09c0 0x7f75640ce7d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f754c009900 tx=0x7f754c01c850 comp rx=0 tx=0).stop 2024-09-10T22:43:47.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.174+0000 7f756ae00640 1 -- 172.21.15.103:0/842006080 shutdown_connections 2024-09-10T22:43:47.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.174+0000 7f756ae00640 1 --2- 172.21.15.103:0/842006080 >> v2:172.21.15.131:3300/0 conn(0x7f75640ae9c0 0x7f75640aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:47.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.174+0000 7f756ae00640 1 --2- 172.21.15.103:0/842006080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75640b09c0 0x7f75640ce7d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:47.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.174+0000 7f756ae00640 1 -- 172.21.15.103:0/842006080 >> 172.21.15.103:0/842006080 conn(0x7f75640d1ac0 msgr2=0x7f75640d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:47.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f756ae00640 1 -- 172.21.15.103:0/842006080 shutdown_connections 2024-09-10T22:43:47.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f756ae00640 1 -- 172.21.15.103:0/842006080 wait complete. 2024-09-10T22:43:47.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f756ae00640 1 Processor -- start 2024-09-10T22:43:47.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f756ae00640 1 -- start start 2024-09-10T22:43:47.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f756ae00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75640ae9c0 0x7f7564154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f756ae00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75640b09c0 0x7f7564165e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f756ae00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f756415be30 0x7f756414e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f756ae00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7564168c70 con 0x7f75640ae9c0 2024-09-10T22:43:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f756ae00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f75640cef50 con 0x7f756415be30 2024-09-10T22:43:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f756ae00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7564168df0 con 0x7f75640b09c0 2024-09-10T22:43:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f7563e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75640ae9c0 0x7f7564154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f7563e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75640ae9c0 0x7f7564154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43622/0 (socket says 172.21.15.103:43622) 2024-09-10T22:43:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f7563e00640 1 -- 172.21.15.103:0/1316346491 learned_addr learned my addr 172.21.15.103:0/1316346491 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f755b400640 1 --2- 172.21.15.103:0/1316346491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75640b09c0 0x7f7564165e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f7568e00640 1 --2- 172.21.15.103:0/1316346491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f756415be30 0x7f756414e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f7563e00640 1 -- 172.21.15.103:0/1316346491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75640b09c0 msgr2=0x7f7564165e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:47.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f7563e00640 1 --2- 172.21.15.103:0/1316346491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75640b09c0 0x7f7564165e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:47.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f7563e00640 1 -- 172.21.15.103:0/1316346491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f756415be30 msgr2=0x7f756414e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:47.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f7563e00640 1 --2- 172.21.15.103:0/1316346491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f756415be30 0x7f756414e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:47.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f7563e00640 1 -- 172.21.15.103:0/1316346491 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75640c9110 con 0x7f75640ae9c0 2024-09-10T22:43:47.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f755b400640 1 --2- 172.21.15.103:0/1316346491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75640b09c0 0x7f7564165e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:43:47.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.178+0000 7f7563e00640 1 --2- 172.21.15.103:0/1316346491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75640ae9c0 0x7f7564154b40 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f755400c3c0 tx=0x7f755400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:47.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.182+0000 7f7560c00640 1 -- 172.21.15.103:0/1316346491 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554017070 con 0x7f75640ae9c0 2024-09-10T22:43:47.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.182+0000 7f7560c00640 1 -- 172.21.15.103:0/1316346491 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75540053c0 con 0x7f75640ae9c0 2024-09-10T22:43:47.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.182+0000 7f7560c00640 1 -- 172.21.15.103:0/1316346491 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554003860 con 0x7f75640ae9c0 2024-09-10T22:43:47.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.182+0000 7f756ae00640 1 -- 172.21.15.103:0/1316346491 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75640c93d0 con 0x7f75640ae9c0 2024-09-10T22:43:47.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.182+0000 7f756ae00640 1 -- 172.21.15.103:0/1316346491 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75640c9990 con 0x7f75640ae9c0 2024-09-10T22:43:47.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.182+0000 7f756ae00640 1 -- 172.21.15.103:0/1316346491 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75640aee50 con 0x7f75640ae9c0 2024-09-10T22:43:47.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.182+0000 7f7560c00640 1 -- 172.21.15.103:0/1316346491 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7554003a00 con 0x7f75640ae9c0 2024-09-10T22:43:47.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.182+0000 7f7560c00640 1 --2- 172.21.15.103:0/1316346491 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f75400725e0 0x7f7540074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:47.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.182+0000 7f7560c00640 1 -- 172.21.15.103:0/1316346491 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f7554092a40 con 0x7f75640ae9c0 2024-09-10T22:43:47.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.182+0000 7f755b400640 1 --2- 172.21.15.103:0/1316346491 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f75400725e0 0x7f7540074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:47.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.186+0000 7f755b400640 1 --2- 172.21.15.103:0/1316346491 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f75400725e0 0x7f7540074aa0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f754c0af000 tx=0x7f754c01b090 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:47.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.186+0000 7f7560c00640 1 -- 172.21.15.103:0/1316346491 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f755405d8a0 con 0x7f75640ae9c0 2024-09-10T22:43:47.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.386+0000 7f756ae00640 1 -- 172.21.15.103:0/1316346491 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75640b4160 con 0x7f75640ae9c0 2024-09-10T22:43:47.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.386+0000 7f7560c00640 1 -- 172.21.15.103:0/1316346491 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5247 (secure 0 0 0) 0x7f75540622d0 con 0x7f75640ae9c0 2024-09-10T22:43:47.392 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:47.392 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":74,"btime":"2024-09-10T22:43:47:005859+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6047,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/2402286786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2402286786},{"type":"v1","addr":"172.21.15.103:6834","nonce":2402286786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68},{"gid":6053,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/4254729752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":4254729752},{"type":"v1","addr":"172.21.15.131:6837","nonce":4254729752}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:43:33.337095+0000","modified":"2024-09-10T22:43:47.005833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":6873,"mds_1":6592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6592":{"gid":6592,"name":"d","rank":1,"incarnation":74,"state":"up:creating","state_seq":1,"addr":"172.21.15.131:6836/134240629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":134240629},{"type":"v1","addr":"172.21.15.131:6836","nonce":134240629}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6873":{"gid":6873,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/249667943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":249667943},{"type":"v1","addr":"172.21.15.103:6835","nonce":249667943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6873,"qdb_cluster":[6873]},"id":5}]} 2024-09-10T22:43:47.392 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 74 2024-09-10T22:43:47.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.390+0000 7f756ae00640 1 -- 172.21.15.103:0/1316346491 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f75400725e0 msgr2=0x7f7540074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:47.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.390+0000 7f756ae00640 1 --2- 172.21.15.103:0/1316346491 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f75400725e0 0x7f7540074aa0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f754c0af000 tx=0x7f754c01b090 comp rx=0 tx=0).stop 2024-09-10T22:43:47.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.390+0000 7f756ae00640 1 -- 172.21.15.103:0/1316346491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75640ae9c0 msgr2=0x7f7564154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:47.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.390+0000 7f756ae00640 1 --2- 172.21.15.103:0/1316346491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75640ae9c0 0x7f7564154b40 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f755400c3c0 tx=0x7f755400c7c0 comp rx=0 tx=0).stop 2024-09-10T22:43:47.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.390+0000 7f756ae00640 1 -- 172.21.15.103:0/1316346491 shutdown_connections 2024-09-10T22:43:47.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.390+0000 7f756ae00640 1 --2- 172.21.15.103:0/1316346491 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f75400725e0 0x7f7540074aa0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:47.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.390+0000 7f756ae00640 1 --2- 172.21.15.103:0/1316346491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f756415be30 0x7f756414e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:47.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.390+0000 7f756ae00640 1 --2- 172.21.15.103:0/1316346491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75640b09c0 0x7f7564165e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:47.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.390+0000 7f756ae00640 1 --2- 172.21.15.103:0/1316346491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75640ae9c0 0x7f7564154b40 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:47.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.390+0000 7f756ae00640 1 -- 172.21.15.103:0/1316346491 >> 172.21.15.103:0/1316346491 conn(0x7f75640d1ac0 msgr2=0x7f756414eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:47.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.390+0000 7f756ae00640 1 -- 172.21.15.103:0/1316346491 shutdown_connections 2024-09-10T22:43:47.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:47.390+0000 7f756ae00640 1 -- 172.21.15.103:0/1316346491 wait complete. 2024-09-10T22:43:47.816 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:43:33.337095+0000', 'modified': '2024-09-10T22:43:47.005833+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 6873, 'mds_1': 6592}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6592': {'gid': 6592, 'name': 'd', 'rank': 1, 'incarnation': 74, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.131:6836/134240629', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6834', 'nonce': 134240629}, {'type': 'v1', 'addr': '172.21.15.131:6836', 'nonce': 134240629}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_6873': {'gid': 6873, 'name': 'c', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/249667943', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6833', 'nonce': 249667943}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 249667943}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6873, 'qdb_cluster': [6873]} 2024-09-10T22:43:47.817 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6592:up:creating 2024-09-10T22:43:48.818 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:43:48.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.966+0000 7f0cfde00640 1 -- 172.21.15.103:0/875582824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0cf806dac0 msgr2=0x7f0cf80ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:48.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.966+0000 7f0cfde00640 1 --2- 172.21.15.103:0/875582824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0cf806dac0 0x7f0cf80ce690 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009900 tx=0x7f0ce401c8e0 comp rx=0 tx=0).stop 2024-09-10T22:43:48.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.966+0000 7f0cfde00640 1 -- 172.21.15.103:0/875582824 shutdown_connections 2024-09-10T22:43:48.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.966+0000 7f0cfde00640 1 --2- 172.21.15.103:0/875582824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0cf806dac0 0x7f0cf80ce690 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:48.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.966+0000 7f0cfde00640 1 --2- 172.21.15.103:0/875582824 >> v2:172.21.15.131:3300/0 conn(0x7f0cf815b6d0 0x7f0cf806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:48.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.966+0000 7f0cfde00640 1 -- 172.21.15.103:0/875582824 >> 172.21.15.103:0/875582824 conn(0x7f0cf80cff60 msgr2=0x7f0cf80d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:48.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.966+0000 7f0cfde00640 1 -- 172.21.15.103:0/875582824 shutdown_connections 2024-09-10T22:43:48.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cfde00640 1 -- 172.21.15.103:0/875582824 wait complete. 2024-09-10T22:43:48.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cfde00640 1 Processor -- start 2024-09-10T22:43:48.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cfde00640 1 -- start start 2024-09-10T22:43:48.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cfde00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0cf806dac0 0x7f0cf81586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:48.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cfde00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cf80cebd0 0x7f0cf8145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:48.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cfde00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cf815b6d0 0x7f0cf80cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:48.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cfde00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf8168810 con 0x7f0cf80cebd0 2024-09-10T22:43:48.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cfde00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf8168690 con 0x7f0cf815b6d0 2024-09-10T22:43:48.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cfde00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0cf8168990 con 0x7f0cf806dac0 2024-09-10T22:43:48.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cf7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cf80cebd0 0x7f0cf8145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:48.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cfca00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0cf806dac0 0x7f0cf81586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:48.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cf7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cf80cebd0 0x7f0cf8145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43624/0 (socket says 172.21.15.103:43624) 2024-09-10T22:43:48.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cf7e00640 1 -- 172.21.15.103:0/2019393138 learned_addr learned my addr 172.21.15.103:0/2019393138 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:48.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cfd400640 1 --2- 172.21.15.103:0/2019393138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cf815b6d0 0x7f0cf80cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:48.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cf7e00640 1 -- 172.21.15.103:0/2019393138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0cf806dac0 msgr2=0x7f0cf81586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:48.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cf7e00640 1 --2- 172.21.15.103:0/2019393138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0cf806dac0 0x7f0cf81586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:48.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cf7e00640 1 -- 172.21.15.103:0/2019393138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cf815b6d0 msgr2=0x7f0cf80cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:48.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cf7e00640 1 --2- 172.21.15.103:0/2019393138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cf815b6d0 0x7f0cf80cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:48.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cf7e00640 1 -- 172.21.15.103:0/2019393138 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf8158c10 con 0x7f0cf80cebd0 2024-09-10T22:43:48.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cfca00640 1 --2- 172.21.15.103:0/2019393138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0cf806dac0 0x7f0cf81586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:43:48.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cf7e00640 1 --2- 172.21.15.103:0/2019393138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cf80cebd0 0x7f0cf8145950 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009850 tx=0x7f0ce4005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:48.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cf4c00640 1 -- 172.21.15.103:0/2019393138 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40b2040 con 0x7f0cf80cebd0 2024-09-10T22:43:48.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cf4c00640 1 -- 172.21.15.103:0/2019393138 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ce40053e0 con 0x7f0cf80cebd0 2024-09-10T22:43:48.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cfde00640 1 -- 172.21.15.103:0/2019393138 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf80ada20 con 0x7f0cf80cebd0 2024-09-10T22:43:48.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cf4c00640 1 -- 172.21.15.103:0/2019393138 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40046d0 con 0x7f0cf80cebd0 2024-09-10T22:43:48.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.970+0000 7f0cfde00640 1 -- 172.21.15.103:0/2019393138 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf80c4fa0 con 0x7f0cf80cebd0 2024-09-10T22:43:48.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.974+0000 7f0cfde00640 1 -- 172.21.15.103:0/2019393138 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cf80adf40 con 0x7f0cf80cebd0 2024-09-10T22:43:48.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.974+0000 7f0cf4c00640 1 -- 172.21.15.103:0/2019393138 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0ce4004890 con 0x7f0cf80cebd0 2024-09-10T22:43:48.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.974+0000 7f0cf4c00640 1 --2- 172.21.15.103:0/2019393138 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0cd8072610 0x7f0cd8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:48.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.974+0000 7f0cf4c00640 1 -- 172.21.15.103:0/2019393138 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f0ce412cfd0 con 0x7f0cf80cebd0 2024-09-10T22:43:48.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.974+0000 7f0cfca00640 1 --2- 172.21.15.103:0/2019393138 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0cd8072610 0x7f0cd8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:48.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.978+0000 7f0cfca00640 1 --2- 172.21.15.103:0/2019393138 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0cd8072610 0x7f0cd8074ad0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80ae3a0 tx=0x7f0cec0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:48.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:48.978+0000 7f0cf4c00640 1 -- 172.21.15.103:0/2019393138 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0cf80adf40 con 0x7f0cf80cebd0 2024-09-10T22:43:49.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.178+0000 7f0cfde00640 1 -- 172.21.15.103:0/2019393138 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cf80ce690 con 0x7f0cf80cebd0 2024-09-10T22:43:49.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.178+0000 7f0cf4c00640 1 -- 172.21.15.103:0/2019393138 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5269 (secure 0 0 0) 0x7f0ce40164d0 con 0x7f0cf80cebd0 2024-09-10T22:43:49.184 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:49.184 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":77,"btime":"2024-09-10T22:43:49:022788+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6047,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/2402286786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2402286786},{"type":"v1","addr":"172.21.15.103:6834","nonce":2402286786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:43:33.337095+0000","modified":"2024-09-10T22:43:49.022783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6873,"mds_1":6592,"mds_2":6053},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6053":{"gid":6053,"name":"b","rank":2,"incarnation":76,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6837/4254729752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":4254729752},{"type":"v1","addr":"172.21.15.131:6837","nonce":4254729752}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6592":{"gid":6592,"name":"d","rank":1,"incarnation":74,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6836/134240629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":134240629},{"type":"v1","addr":"172.21.15.131:6836","nonce":134240629}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6873":{"gid":6873,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/249667943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":249667943},{"type":"v1","addr":"172.21.15.103:6835","nonce":249667943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6873,"qdb_cluster":[6053,6592,6873]},"id":5}]} 2024-09-10T22:43:49.184 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 77 2024-09-10T22:43:49.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.182+0000 7f0cfde00640 1 -- 172.21.15.103:0/2019393138 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0cd8072610 msgr2=0x7f0cd8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:49.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.182+0000 7f0cfde00640 1 --2- 172.21.15.103:0/2019393138 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0cd8072610 0x7f0cd8074ad0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80ae3a0 tx=0x7f0cec0091e0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.182+0000 7f0cfde00640 1 -- 172.21.15.103:0/2019393138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cf80cebd0 msgr2=0x7f0cf8145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:49.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.182+0000 7f0cfde00640 1 --2- 172.21.15.103:0/2019393138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cf80cebd0 0x7f0cf8145950 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009850 tx=0x7f0ce4005e70 comp rx=0 tx=0).stop 2024-09-10T22:43:49.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.182+0000 7f0cfde00640 1 -- 172.21.15.103:0/2019393138 shutdown_connections 2024-09-10T22:43:49.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.182+0000 7f0cfde00640 1 --2- 172.21.15.103:0/2019393138 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0cd8072610 0x7f0cd8074ad0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.182+0000 7f0cfde00640 1 --2- 172.21.15.103:0/2019393138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cf815b6d0 0x7f0cf80cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.182+0000 7f0cfde00640 1 --2- 172.21.15.103:0/2019393138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cf80cebd0 0x7f0cf8145950 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.182+0000 7f0cfde00640 1 --2- 172.21.15.103:0/2019393138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0cf806dac0 0x7f0cf81586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.182+0000 7f0cfde00640 1 -- 172.21.15.103:0/2019393138 >> 172.21.15.103:0/2019393138 conn(0x7f0cf80cff60 msgr2=0x7f0cf80748b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:49.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.182+0000 7f0cfde00640 1 -- 172.21.15.103:0/2019393138 shutdown_connections 2024-09-10T22:43:49.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.182+0000 7f0cfde00640 1 -- 172.21.15.103:0/2019393138 wait complete. 2024-09-10T22:43:49.608 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 77, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:43:33.337095+0000', 'modified': '2024-09-10T22:43:49.022783+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 6873, 'mds_1': 6592, 'mds_2': 6053}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6053': {'gid': 6053, 'name': 'b', 'rank': 2, 'incarnation': 76, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.131:6837/4254729752', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6835', 'nonce': 4254729752}, {'type': 'v1', 'addr': '172.21.15.131:6837', 'nonce': 4254729752}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_6592': {'gid': 6592, 'name': 'd', 'rank': 1, 'incarnation': 74, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.131:6836/134240629', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6834', 'nonce': 134240629}, {'type': 'v1', 'addr': '172.21.15.131:6836', 'nonce': 134240629}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_6873': {'gid': 6873, 'name': 'c', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/249667943', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6833', 'nonce': 249667943}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 249667943}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6873, 'qdb_cluster': [6053, 6592, 6873]} 2024-09-10T22:43:49.608 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T22:43:49.608 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-10T22:43:49.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.750+0000 7fbc9fa00640 1 -- 172.21.15.103:0/3662154904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc98073c30 msgr2=0x7fbc980740e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:49.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.750+0000 7fbc9fa00640 1 --2- 172.21.15.103:0/3662154904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc98073c30 0x7fbc980740e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbc90009c80 tx=0x7fbc9001cda0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.750+0000 7fbc9fa00640 1 -- 172.21.15.103:0/3662154904 shutdown_connections 2024-09-10T22:43:49.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.750+0000 7fbc9fa00640 1 --2- 172.21.15.103:0/3662154904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc98073c30 0x7fbc980740e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.750+0000 7fbc9fa00640 1 --2- 172.21.15.103:0/3662154904 >> v2:172.21.15.131:3300/0 conn(0x7fbc98150a50 0x7fbc9815aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.750+0000 7fbc9fa00640 1 -- 172.21.15.103:0/3662154904 >> 172.21.15.103:0/3662154904 conn(0x7fbc9806cc00 msgr2=0x7fbc9806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:49.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.750+0000 7fbc9fa00640 1 -- 172.21.15.103:0/3662154904 shutdown_connections 2024-09-10T22:43:49.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.750+0000 7fbc9fa00640 1 -- 172.21.15.103:0/3662154904 wait complete. 2024-09-10T22:43:49.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.750+0000 7fbc9fa00640 1 Processor -- start 2024-09-10T22:43:49.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.750+0000 7fbc9fa00640 1 -- start start 2024-09-10T22:43:49.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.750+0000 7fbc9fa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc98073c30 0x7fbc981fb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.750+0000 7fbc9fa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc980b4b20 0x7fbc9813c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.750+0000 7fbc9fa00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc98150a50 0x7fbc980ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.750+0000 7fbc9fa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbc98166bc0 con 0x7fbc980b4b20 2024-09-10T22:43:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.750+0000 7fbc9fa00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbc98166a40 con 0x7fbc98073c30 2024-09-10T22:43:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.750+0000 7fbc9fa00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fbc98166d40 con 0x7fbc98150a50 2024-09-10T22:43:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc8fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc980b4b20 0x7fbc9813c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc9d000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc98073c30 0x7fbc981fb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc8fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc980b4b20 0x7fbc9813c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43628/0 (socket says 172.21.15.103:43628) 2024-09-10T22:43:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc9d000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc98073c30 0x7fbc981fb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:56096/0 (socket says 172.21.15.103:56096) 2024-09-10T22:43:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc8fe00640 1 -- 172.21.15.103:0/1404089951 learned_addr learned my addr 172.21.15.103:0/1404089951 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc9da00640 1 --2- 172.21.15.103:0/1404089951 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc98150a50 0x7fbc980ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc8fe00640 1 -- 172.21.15.103:0/1404089951 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc98150a50 msgr2=0x7fbc980ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc8fe00640 1 --2- 172.21.15.103:0/1404089951 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc98150a50 0x7fbc980ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc8fe00640 1 -- 172.21.15.103:0/1404089951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc98073c30 msgr2=0x7fbc981fb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc8fe00640 1 --2- 172.21.15.103:0/1404089951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc98073c30 0x7fbc981fb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc8fe00640 1 -- 172.21.15.103:0/1404089951 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc9813c720 con 0x7fbc980b4b20 2024-09-10T22:43:49.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc9d000640 1 --2- 172.21.15.103:0/1404089951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc98073c30 0x7fbc981fb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:43:49.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc8fe00640 1 --2- 172.21.15.103:0/1404089951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc980b4b20 0x7fbc9813c1e0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000c400 tx=0x7fbc8000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:49.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc95600640 1 -- 172.21.15.103:0/1404089951 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80017070 con 0x7fbc980b4b20 2024-09-10T22:43:49.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc95600640 1 -- 172.21.15.103:0/1404089951 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc800053e0 con 0x7fbc980b4b20 2024-09-10T22:43:49.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc9fa00640 1 -- 172.21.15.103:0/1404089951 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc980b1fb0 con 0x7fbc980b4b20 2024-09-10T22:43:49.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc95600640 1 -- 172.21.15.103:0/1404089951 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80003860 con 0x7fbc980b4b20 2024-09-10T22:43:49.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc9fa00640 1 -- 172.21.15.103:0/1404089951 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc981fa8a0 con 0x7fbc980b4b20 2024-09-10T22:43:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.754+0000 7fbc95600640 1 -- 172.21.15.103:0/1404089951 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbc80003a00 con 0x7fbc980b4b20 2024-09-10T22:43:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbc95600640 1 --2- 172.21.15.103:0/1404089951 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbc740725e0 0x7fbc74074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbc95600640 1 -- 172.21.15.103:0/1404089951 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fbc80092a50 con 0x7fbc980b4b20 2024-09-10T22:43:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbca2d21000 1 Processor -- start 2024-09-10T22:43:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbca2d21000 1 -- start start 2024-09-10T22:43:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbc9d000640 1 --2- 172.21.15.103:0/1404089951 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbc740725e0 0x7fbc74074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbc9d000640 1 --2- 172.21.15.103:0/1404089951 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbc740725e0 0x7fbc74074aa0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800afd0 tx=0x7fbc8800c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbca2d21000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd2939d0 0x560fbd293db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbca2d21000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd2942f0 0x560fbd2478d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbca2d21000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd247e10 0x560fbd2481f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbca2d21000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560fbd1683f0 con 0x560fbd2939d0 2024-09-10T22:43:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbca2d21000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560fbd0a5b20 con 0x560fbd247e10 2024-09-10T22:43:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbca2d21000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560fbd094f50 con 0x560fbd2942f0 2024-09-10T22:43:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbc9d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd2939d0 0x560fbd293db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbc9d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd2939d0 0x560fbd293db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43638/0 (socket says 172.21.15.103:43638) 2024-09-10T22:43:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbc9d000640 1 -- 172.21.15.103:0/297847760 learned_addr learned my addr 172.21.15.103:0/297847760 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbc9da00640 1 --2- 172.21.15.103:0/297847760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd247e10 0x560fbd2481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbc8fe00640 1 --2- 172.21.15.103:0/297847760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd2942f0 0x560fbd2478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbc9d000640 1 -- 172.21.15.103:0/297847760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd2942f0 msgr2=0x560fbd2478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:49.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbc9d000640 1 --2- 172.21.15.103:0/297847760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd2942f0 0x560fbd2478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbc9d000640 1 -- 172.21.15.103:0/297847760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd247e10 msgr2=0x560fbd2481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:49.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbc9d000640 1 --2- 172.21.15.103:0/297847760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd247e10 0x560fbd2481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbc9d000640 1 -- 172.21.15.103:0/297847760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fbd05c590 con 0x560fbd2939d0 2024-09-10T22:43:49.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbc9d000640 1 --2- 172.21.15.103:0/297847760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd2939d0 0x560fbd293db0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fbc880185a0 tx=0x7fbc88014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff08376fecc22e1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:49.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbc8d600640 1 -- 172.21.15.103:0/297847760 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8801e040 con 0x560fbd2939d0 2024-09-10T22:43:49.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbc8d600640 1 -- 172.21.15.103:0/297847760 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc88027070 con 0x560fbd2939d0 2024-09-10T22:43:49.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbc8d600640 1 -- 172.21.15.103:0/297847760 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc880166a0 con 0x560fbd2939d0 2024-09-10T22:43:49.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbca2d21000 1 -- 172.21.15.103:0/297847760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd2939d0 msgr2=0x560fbd293db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:49.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbca2d21000 1 --2- 172.21.15.103:0/297847760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd2939d0 0x560fbd293db0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fbc880185a0 tx=0x7fbc88014000 comp rx=0 tx=0).stop 2024-09-10T22:43:49.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbca2d21000 1 -- 172.21.15.103:0/297847760 shutdown_connections 2024-09-10T22:43:49.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbca2d21000 1 --2- 172.21.15.103:0/297847760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd247e10 0x560fbd2481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbca2d21000 1 --2- 172.21.15.103:0/297847760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd2942f0 0x560fbd2478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbca2d21000 1 --2- 172.21.15.103:0/297847760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd2939d0 0x560fbd293db0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbca2d21000 1 -- 172.21.15.103:0/297847760 >> 172.21.15.103:0/297847760 conn(0x560fbd131130 msgr2=0x560fbd276e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:49.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbca2d21000 1 -- 172.21.15.103:0/297847760 shutdown_connections 2024-09-10T22:43:49.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.758+0000 7fbca2d21000 1 -- 172.21.15.103:0/297847760 wait complete. 2024-09-10T22:43:49.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbca2d21000 1 -- start start 2024-09-10T22:43:49.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbca2d21000 1 Processor -- start 2024-09-10T22:43:49.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbca2d21000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd247e10 0x560fbd249240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbca2d21000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd2939d0 0x560fbd249780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbca2d21000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd2942f0 0x560fbd249cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbca2d21000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560fbd02f5d0 con 0x560fbd247e10 2024-09-10T22:43:49.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbca2d21000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560fbd098d60 con 0x560fbd2939d0 2024-09-10T22:43:49.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbca2d21000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560fbd03b500 con 0x560fbd2942f0 2024-09-10T22:43:49.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbca2d21000 10 client.0 _ll_register_callbacks cb 0x560fbd03f810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:43:49.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc9d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd247e10 0x560fbd249240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc9d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd247e10 0x560fbd249240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43644/0 (socket says 172.21.15.103:43644) 2024-09-10T22:43:49.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc9d000640 1 -- 172.21.15.103:0/2338820606 learned_addr learned my addr 172.21.15.103:0/2338820606 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:49.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc9da00640 1 --2- 172.21.15.103:0/2338820606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd2942f0 0x560fbd249cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc8fe00640 1 --2- 172.21.15.103:0/2338820606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd2939d0 0x560fbd249780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc9d000640 1 -- 172.21.15.103:0/2338820606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd2942f0 msgr2=0x560fbd249cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:49.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc9d000640 1 --2- 172.21.15.103:0/2338820606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd2942f0 0x560fbd249cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc9d000640 1 -- 172.21.15.103:0/2338820606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd2939d0 msgr2=0x560fbd249780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:49.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc9d000640 1 --2- 172.21.15.103:0/2338820606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd2939d0 0x560fbd249780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc9d000640 1 -- 172.21.15.103:0/2338820606 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fbd033170 con 0x560fbd247e10 2024-09-10T22:43:49.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc8fe00640 1 --2- 172.21.15.103:0/2338820606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd2939d0 0x560fbd249780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:49.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc9d000640 1 --2- 172.21.15.103:0/2338820606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd247e10 0x560fbd249240 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fbc88024040 tx=0x7fbc880054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965785f03ed92ec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:49.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc86000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:43:49.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc86000640 1 -- 172.21.15.103:0/2338820606 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88004740 con 0x560fbd247e10 2024-09-10T22:43:49.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc86000640 1 -- 172.21.15.103:0/2338820606 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fbc880048e0 con 0x560fbd247e10 2024-09-10T22:43:49.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbca2d21000 1 -- 172.21.15.103:0/2338820606 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560fbd02d0f0 con 0x560fbd247e10 2024-09-10T22:43:49.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc86000640 1 -- 172.21.15.103:0/2338820606 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fbc88039050 con 0x560fbd247e10 2024-09-10T22:43:49.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbca2d21000 10 client.7071 fetch_fsmap learned FSMap version 77 2024-09-10T22:43:49.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbca2d21000 1 -- 172.21.15.103:0/2338820606 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x560fbd119ef0 con 0x560fbd247e10 2024-09-10T22:43:49.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc86000640 1 -- 172.21.15.103:0/2338820606 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560fbd02d0f0 con 0x560fbd247e10 2024-09-10T22:43:49.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc86000640 1 -- 172.21.15.103:0/2338820606 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 77) ==== 3542+0+0 (secure 0 0 0) 0x7fbc8803c020 con 0x560fbd247e10 2024-09-10T22:43:49.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbca2d21000 10 client.7071 fetch_fsmap finished waiting for FSMap version 77 2024-09-10T22:43:49.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbca2d21000 10 client.7071 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T22:43:49.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbca2d21000 20 client.7071 populate_metadata read hostname 'smithi103' 2024-09-10T22:43:49.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbca2d21000 1 --2- 172.21.15.103:0/2338820606 >> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] conn(0x560fbd2a2c70 0x560fbd2a5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbca2d21000 4 client.7071 mds_command: new command op to 6053 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:43:49.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbca2d21000 1 -- 172.21.15.103:0/2338820606 --> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fbd0a7a70 con 0x560fbd2a2c70 2024-09-10T22:43:49.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.762+0000 7fbc8fe00640 1 --2- 172.21.15.103:0/2338820606 >> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] conn(0x560fbd2a2c70 0x560fbd2a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.766+0000 7fbc86000640 10 client.7071 ms_handle_connect on v2:172.21.15.131:6835/4254729752 2024-09-10T22:43:49.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.766+0000 7fbc8fe00640 1 --2- 172.21.15.103:0/2338820606 >> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] conn(0x560fbd2a2c70 0x560fbd2a5060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cb26c5f7908640ea server_cookie=dfac7525e7cfc4e8 in_seq=0 out_seq=0 2024-09-10T22:43:49.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.766+0000 7fbc86000640 1 -- 172.21.15.103:0/2338820606 <== mds.2 v2:172.21.15.131:6835/4254729752 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560fbd0a7a70 con 0x560fbd2a2c70 2024-09-10T22:43:49.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.766+0000 7fbc86000640 10 client.7071 handle_command_reply: tid=0 2024-09-10T22:43:49.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.766+0000 7fbca2d21000 1 client.7071 shutdown 2024-09-10T22:43:49.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.766+0000 7fbca2d21000 1 -- 172.21.15.103:0/2338820606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd247e10 msgr2=0x560fbd249240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:49.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.766+0000 7fbca2d21000 1 --2- 172.21.15.103:0/2338820606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd247e10 0x560fbd249240 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fbc88024040 tx=0x7fbc880054a0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.766+0000 7fbca2d21000 1 -- 172.21.15.103:0/2338820606 shutdown_connections 2024-09-10T22:43:49.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.766+0000 7fbca2d21000 1 --2- 172.21.15.103:0/2338820606 >> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] conn(0x560fbd2a2c70 0x560fbd2a5060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.766+0000 7fbca2d21000 1 --2- 172.21.15.103:0/2338820606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd2942f0 0x560fbd249cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.766+0000 7fbca2d21000 1 --2- 172.21.15.103:0/2338820606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd2939d0 0x560fbd249780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.766+0000 7fbca2d21000 1 --2- 172.21.15.103:0/2338820606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd247e10 0x560fbd249240 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.766+0000 7fbca2d21000 1 -- 172.21.15.103:0/2338820606 >> 172.21.15.103:0/2338820606 conn(0x560fbd131130 msgr2=0x560fbd246fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:49.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.766+0000 7fbc86000640 0 client.7071 ms_handle_reset on v2:172.21.15.131:6835/4254729752 2024-09-10T22:43:49.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.766+0000 7fbca2d21000 1 -- 172.21.15.103:0/2338820606 shutdown_connections 2024-09-10T22:43:49.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.766+0000 7fbca2d21000 1 -- 172.21.15.103:0/2338820606 wait complete. 2024-09-10T22:43:49.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.766+0000 7fbca2d21000 20 client.7071 trim_cache size 0 max 16384 2024-09-10T22:43:49.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbca2d21000 1 Processor -- start 2024-09-10T22:43:49.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbca2d21000 1 -- start start 2024-09-10T22:43:49.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbca2d21000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd247e10 0x560fbd3059f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbca2d21000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd2939d0 0x560fbd305f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbca2d21000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd2942f0 0x560fbd306470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbca2d21000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbc98204750 con 0x560fbd2939d0 2024-09-10T22:43:49.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbca2d21000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbc982039b0 con 0x560fbd2942f0 2024-09-10T22:43:49.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbca2d21000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fbc98204080 con 0x560fbd247e10 2024-09-10T22:43:49.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbc8fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd2939d0 0x560fbd305f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbc9d000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd247e10 0x560fbd3059f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbc8fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd2939d0 0x560fbd305f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43658/0 (socket says 172.21.15.103:43658) 2024-09-10T22:43:49.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbc8fe00640 1 -- 172.21.15.103:0/2140954540 learned_addr learned my addr 172.21.15.103:0/2140954540 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:49.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbc9da00640 1 --2- 172.21.15.103:0/2140954540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd2942f0 0x560fbd306470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbc8fe00640 1 -- 172.21.15.103:0/2140954540 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd247e10 msgr2=0x560fbd3059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:49.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbc8fe00640 1 --2- 172.21.15.103:0/2140954540 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd247e10 0x560fbd3059f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbc8fe00640 1 -- 172.21.15.103:0/2140954540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd2942f0 msgr2=0x560fbd306470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:49.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbc8fe00640 1 --2- 172.21.15.103:0/2140954540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd2942f0 0x560fbd306470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbc8fe00640 1 -- 172.21.15.103:0/2140954540 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fbd0f0d90 con 0x560fbd2939d0 2024-09-10T22:43:49.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbc9d000640 1 --2- 172.21.15.103:0/2140954540 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd247e10 0x560fbd3059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:43:49.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbc8fe00640 1 --2- 172.21.15.103:0/2140954540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd2939d0 0x560fbd305f30 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fbc8005d640 tx=0x7fbc80000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294a0e9f54e4449c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:49.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbc8cc00640 1 -- 172.21.15.103:0/2140954540 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80066d90 con 0x560fbd2939d0 2024-09-10T22:43:49.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbc8cc00640 1 -- 172.21.15.103:0/2140954540 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc80059bb0 con 0x560fbd2939d0 2024-09-10T22:43:49.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbc8cc00640 1 -- 172.21.15.103:0/2140954540 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8005ee20 con 0x560fbd2939d0 2024-09-10T22:43:49.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbca2d21000 1 -- 172.21.15.103:0/2140954540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd2939d0 msgr2=0x560fbd305f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:49.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbca2d21000 1 --2- 172.21.15.103:0/2140954540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd2939d0 0x560fbd305f30 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fbc8005d640 tx=0x7fbc80000bd0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbca2d21000 1 -- 172.21.15.103:0/2140954540 shutdown_connections 2024-09-10T22:43:49.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbca2d21000 1 --2- 172.21.15.103:0/2140954540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd2942f0 0x560fbd306470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbca2d21000 1 --2- 172.21.15.103:0/2140954540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd2939d0 0x560fbd305f30 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbca2d21000 1 --2- 172.21.15.103:0/2140954540 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd247e10 0x560fbd3059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbca2d21000 1 -- 172.21.15.103:0/2140954540 >> 172.21.15.103:0/2140954540 conn(0x560fbd131130 msgr2=0x560fbd2a5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:49.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbca2d21000 1 -- 172.21.15.103:0/2140954540 shutdown_connections 2024-09-10T22:43:49.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.786+0000 7fbca2d21000 1 -- 172.21.15.103:0/2140954540 wait complete. 2024-09-10T22:43:49.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbca2d21000 1 -- start start 2024-09-10T22:43:49.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbca2d21000 1 Processor -- start 2024-09-10T22:43:49.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbca2d21000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd247e10 0x560fbd2aa980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbca2d21000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd2939d0 0x560fbd2c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbca2d21000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd2942f0 0x560fbd2c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbca2d21000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560fbd09d390 con 0x560fbd247e10 2024-09-10T22:43:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbca2d21000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbc980b1760 con 0x560fbd2939d0 2024-09-10T22:43:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbca2d21000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560fbd0a48f0 con 0x560fbd2942f0 2024-09-10T22:43:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbca2d21000 10 client.0 _ll_register_callbacks cb 0x7fbc88005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:43:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc9d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd247e10 0x560fbd2aa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc9d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd247e10 0x560fbd2aa980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43660/0 (socket says 172.21.15.103:43660) 2024-09-10T22:43:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc9d000640 1 -- 172.21.15.103:0/1433529780 learned_addr learned my addr 172.21.15.103:0/1433529780 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc9da00640 1 --2- 172.21.15.103:0/1433529780 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd2942f0 0x560fbd2c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc8fe00640 1 --2- 172.21.15.103:0/1433529780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd2939d0 0x560fbd2c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc9d000640 1 -- 172.21.15.103:0/1433529780 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd2942f0 msgr2=0x560fbd2c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc9d000640 1 --2- 172.21.15.103:0/1433529780 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd2942f0 0x560fbd2c5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc9d000640 1 -- 172.21.15.103:0/1433529780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd2939d0 msgr2=0x560fbd2c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc9d000640 1 --2- 172.21.15.103:0/1433529780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd2939d0 0x560fbd2c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc9d000640 1 -- 172.21.15.103:0/1433529780 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fbd05ba90 con 0x560fbd247e10 2024-09-10T22:43:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc8fe00640 1 --2- 172.21.15.103:0/1433529780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd2939d0 0x560fbd2c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:43:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc9d000640 1 --2- 172.21.15.103:0/1433529780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd247e10 0x560fbd2aa980 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800c010 tx=0x7fbc880049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3c4a808191122d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc86000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:43:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc86000640 1 -- 172.21.15.103:0/1433529780 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88041030 con 0x560fbd247e10 2024-09-10T22:43:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc86000640 1 -- 172.21.15.103:0/1433529780 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fbc88005510 con 0x560fbd247e10 2024-09-10T22:43:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbca2d21000 1 -- 172.21.15.103:0/1433529780 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc80059bb0 con 0x560fbd247e10 2024-09-10T22:43:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc86000640 1 -- 172.21.15.103:0/1433529780 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fbc8804d050 con 0x560fbd247e10 2024-09-10T22:43:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbca2d21000 10 client.7077 fetch_fsmap learned FSMap version 77 2024-09-10T22:43:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbca2d21000 1 -- 172.21.15.103:0/1433529780 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x560fbd03a050 con 0x560fbd247e10 2024-09-10T22:43:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc86000640 1 -- 172.21.15.103:0/1433529780 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc80059bb0 con 0x560fbd247e10 2024-09-10T22:43:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc86000640 1 -- 172.21.15.103:0/1433529780 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 77) ==== 3542+0+0 (secure 0 0 0) 0x7fbc88050020 con 0x560fbd247e10 2024-09-10T22:43:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbca2d21000 10 client.7077 fetch_fsmap finished waiting for FSMap version 77 2024-09-10T22:43:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbca2d21000 10 client.7077 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T22:43:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbca2d21000 20 client.7077 populate_metadata read hostname 'smithi103' 2024-09-10T22:43:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbca2d21000 1 --2- 172.21.15.103:0/1433529780 >> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] conn(0x560fbd2c6000 0x560fbd309820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbca2d21000 4 client.7077 mds_command: new command op to 6053 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:43:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbca2d21000 1 -- 172.21.15.103:0/1433529780 --> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] -- command(tid 0: {"prefix": "status"}) -- 0x560fbd0a3520 con 0x560fbd2c6000 2024-09-10T22:43:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc8fe00640 1 --2- 172.21.15.103:0/1433529780 >> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] conn(0x560fbd2c6000 0x560fbd309820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc8fe00640 1 --2- 172.21.15.103:0/1433529780 >> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] conn(0x560fbd2c6000 0x560fbd309820 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=952cb035fd18f62b server_cookie=82a783ea7cef72d9 in_seq=0 out_seq=0 2024-09-10T22:43:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.790+0000 7fbc86000640 10 client.7077 ms_handle_connect on v2:172.21.15.131:6835/4254729752 2024-09-10T22:43:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbc86000640 1 -- 172.21.15.103:0/1433529780 <== mds.2 v2:172.21.15.131:6835/4254729752 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x560fbd0a3520 con 0x560fbd2c6000 2024-09-10T22:43:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbc86000640 10 client.7077 handle_command_reply: tid=0 2024-09-10T22:43:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbca2d21000 1 client.7077 shutdown 2024-09-10T22:43:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbca2d21000 1 -- 172.21.15.103:0/1433529780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd247e10 msgr2=0x560fbd2aa980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbca2d21000 1 --2- 172.21.15.103:0/1433529780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd247e10 0x560fbd2aa980 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800c010 tx=0x7fbc880049f0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbca2d21000 1 -- 172.21.15.103:0/1433529780 shutdown_connections 2024-09-10T22:43:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbca2d21000 1 --2- 172.21.15.103:0/1433529780 >> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] conn(0x560fbd2c6000 0x560fbd309820 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbca2d21000 1 --2- 172.21.15.103:0/1433529780 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fbd2942f0 0x560fbd2c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbca2d21000 1 --2- 172.21.15.103:0/1433529780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fbd2939d0 0x560fbd2c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbca2d21000 1 --2- 172.21.15.103:0/1433529780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560fbd247e10 0x560fbd2aa980 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbc86000640 0 client.7077 ms_handle_reset on v2:172.21.15.131:6835/4254729752 2024-09-10T22:43:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbca2d21000 1 -- 172.21.15.103:0/1433529780 >> 172.21.15.103:0/1433529780 conn(0x560fbd131130 msgr2=0x560fbd2a5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:49.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbca2d21000 1 -- 172.21.15.103:0/1433529780 shutdown_connections 2024-09-10T22:43:49.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbca2d21000 1 -- 172.21.15.103:0/1433529780 wait complete. 2024-09-10T22:43:49.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbca2d21000 20 client.7077 trim_cache size 0 max 16384 2024-09-10T22:43:49.802 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:43:49.802 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:43:49.802 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 2, 2024-09-10T22:43:49.802 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6053, 2024-09-10T22:43:49.802 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:43:49.802 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:43:49.802 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:43:49.803 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 1.7702298439999999, 2024-09-10T22:43:49.803 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 77, 2024-09-10T22:43:49.803 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 81, 2024-09-10T22:43:49.803 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 81, 2024-09-10T22:43:49.803 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 20.336081079 2024-09-10T22:43:49.803 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:43:49.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbc9fa00640 1 -- 172.21.15.103:0/1404089951 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbc740725e0 msgr2=0x7fbc74074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:49.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbc9fa00640 1 --2- 172.21.15.103:0/1404089951 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbc740725e0 0x7fbc74074aa0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800afd0 tx=0x7fbc8800c040 comp rx=0 tx=0).stop 2024-09-10T22:43:49.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbc9fa00640 1 -- 172.21.15.103:0/1404089951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc980b4b20 msgr2=0x7fbc9813c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:49.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbc9fa00640 1 --2- 172.21.15.103:0/1404089951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc980b4b20 0x7fbc9813c1e0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000c400 tx=0x7fbc8000c8c0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbc9fa00640 1 -- 172.21.15.103:0/1404089951 shutdown_connections 2024-09-10T22:43:49.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbc9fa00640 1 --2- 172.21.15.103:0/1404089951 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbc740725e0 0x7fbc74074aa0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbc9fa00640 1 --2- 172.21.15.103:0/1404089951 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbc98150a50 0x7fbc980ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbc9fa00640 1 --2- 172.21.15.103:0/1404089951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc980b4b20 0x7fbc9813c1e0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbc9fa00640 1 --2- 172.21.15.103:0/1404089951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc98073c30 0x7fbc981fb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbc9fa00640 1 -- 172.21.15.103:0/1404089951 >> 172.21.15.103:0/1404089951 conn(0x7fbc9806cc00 msgr2=0x7fbc9814fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:49.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbc9fa00640 1 -- 172.21.15.103:0/1404089951 shutdown_connections 2024-09-10T22:43:49.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.794+0000 7fbc9fa00640 1 -- 172.21.15.103:0/1404089951 wait complete. 2024-09-10T22:43:49.815 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T22:43:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.954+0000 7fd1e2800640 1 -- 172.21.15.103:0/2595031600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1dc15be30 msgr2=0x7fd1dc0ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.954+0000 7fd1e2800640 1 --2- 172.21.15.103:0/2595031600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1dc15be30 0x7fd1dc0ce0c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc009840 tx=0x7fd1cc01c790 comp rx=0 tx=0).stop 2024-09-10T22:43:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.954+0000 7fd1e2800640 1 -- 172.21.15.103:0/2595031600 shutdown_connections 2024-09-10T22:43:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.954+0000 7fd1e2800640 1 --2- 172.21.15.103:0/2595031600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1dc0b09c0 0x7fd1dc0ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.954+0000 7fd1e2800640 1 --2- 172.21.15.103:0/2595031600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1dc15be30 0x7fd1dc0ce0c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.954+0000 7fd1e2800640 1 -- 172.21.15.103:0/2595031600 >> 172.21.15.103:0/2595031600 conn(0x7fd1dc0d1ac0 msgr2=0x7fd1dc0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.954+0000 7fd1e2800640 1 -- 172.21.15.103:0/2595031600 shutdown_connections 2024-09-10T22:43:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.954+0000 7fd1e2800640 1 -- 172.21.15.103:0/2595031600 wait complete. 2024-09-10T22:43:49.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1e2800640 1 Processor -- start 2024-09-10T22:43:49.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1e2800640 1 -- start start 2024-09-10T22:43:49.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1e2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1dc0b09c0 0x7fd1dc1593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1e2800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1dc0ceb40 0x7fd1dc0c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1e2800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1dc15be30 0x7fd1dc164f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1e2800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc169060 con 0x7fd1dc0b09c0 2024-09-10T22:43:49.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1e2800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc168ee0 con 0x7fd1dc0ceb40 2024-09-10T22:43:49.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1e2800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd1dc1691e0 con 0x7fd1dc15be30 2024-09-10T22:43:49.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1db400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1dc0b09c0 0x7fd1dc1593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1db400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1dc0b09c0 0x7fd1dc1593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43670/0 (socket says 172.21.15.103:43670) 2024-09-10T22:43:49.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1db400640 1 -- 172.21.15.103:0/1483182463 learned_addr learned my addr 172.21.15.103:0/1483182463 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:49.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1d3e00640 1 --2- 172.21.15.103:0/1483182463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1dc0ceb40 0x7fd1dc0c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1dbe00640 1 --2- 172.21.15.103:0/1483182463 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1dc15be30 0x7fd1dc164f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1db400640 1 -- 172.21.15.103:0/1483182463 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1dc15be30 msgr2=0x7fd1dc164f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1db400640 1 --2- 172.21.15.103:0/1483182463 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1dc15be30 0x7fd1dc164f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1db400640 1 -- 172.21.15.103:0/1483182463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1dc0ceb40 msgr2=0x7fd1dc0c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1db400640 1 --2- 172.21.15.103:0/1483182463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1dc0ceb40 0x7fd1dc0c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1db400640 1 -- 172.21.15.103:0/1483182463 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1dc159f00 con 0x7fd1dc0b09c0 2024-09-10T22:43:49.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1db400640 1 --2- 172.21.15.103:0/1483182463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1dc0b09c0 0x7fd1dc1593e0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc000c10 tx=0x7fd1cc0a6460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:49.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1d3400640 1 -- 172.21.15.103:0/1483182463 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0ac030 con 0x7fd1dc0b09c0 2024-09-10T22:43:49.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1d3400640 1 -- 172.21.15.103:0/1483182463 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1cc0053b0 con 0x7fd1dc0b09c0 2024-09-10T22:43:49.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1d3400640 1 -- 172.21.15.103:0/1483182463 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0046d0 con 0x7fd1dc0b09c0 2024-09-10T22:43:49.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1e2800640 1 -- 172.21.15.103:0/1483182463 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1dc070e60 con 0x7fd1dc0b09c0 2024-09-10T22:43:49.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.958+0000 7fd1e2800640 1 -- 172.21.15.103:0/1483182463 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1dc071420 con 0x7fd1dc0b09c0 2024-09-10T22:43:49.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.962+0000 7fd1d3400640 1 -- 172.21.15.103:0/1483182463 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd1cc004870 con 0x7fd1dc0b09c0 2024-09-10T22:43:49.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.962+0000 7fd1e5bd4000 1 Processor -- start 2024-09-10T22:43:49.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.962+0000 7fd1d3400640 1 --2- 172.21.15.103:0/1483182463 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd1b80725e0 0x7fd1b8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.962+0000 7fd1d3400640 1 -- 172.21.15.103:0/1483182463 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fd1cc12d8b0 con 0x7fd1dc0b09c0 2024-09-10T22:43:49.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.962+0000 7fd1e5bd4000 1 -- start start 2024-09-10T22:43:49.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.962+0000 7fd1d3e00640 1 --2- 172.21.15.103:0/1483182463 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd1b80725e0 0x7fd1b8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1e5bd4000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 0x5555b72d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1e5bd4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b72d22f0 0x5555b72858d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1d3e00640 1 --2- 172.21.15.103:0/1483182463 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd1b80725e0 0x7fd1b8074aa0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4009600 tx=0x7fd1c40091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:49.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1e5bd4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7285e10 0x5555b72861f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1e5bd4000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5555b71a63f0 con 0x5555b72d19d0 2024-09-10T22:43:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1e5bd4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5555b70e3b20 con 0x5555b7285e10 2024-09-10T22:43:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1e5bd4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5555b70d2f50 con 0x5555b72d22f0 2024-09-10T22:43:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1db400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 0x5555b72d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1db400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 0x5555b72d1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43680/0 (socket says 172.21.15.103:43680) 2024-09-10T22:43:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1db400640 1 -- 172.21.15.103:0/1540830160 learned_addr learned my addr 172.21.15.103:0/1540830160 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1d3e00640 1 --2- 172.21.15.103:0/1540830160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b72d22f0 0x5555b72858d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1dbe00640 1 --2- 172.21.15.103:0/1540830160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7285e10 0x5555b72861f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1db400640 1 -- 172.21.15.103:0/1540830160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b72d22f0 msgr2=0x5555b72858d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1db400640 1 --2- 172.21.15.103:0/1540830160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b72d22f0 0x5555b72858d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1db400640 1 -- 172.21.15.103:0/1540830160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7285e10 msgr2=0x5555b72861f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1db400640 1 --2- 172.21.15.103:0/1540830160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7285e10 0x5555b72861f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1db400640 1 -- 172.21.15.103:0/1540830160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555b709a590 con 0x5555b72d19d0 2024-09-10T22:43:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1db400640 1 --2- 172.21.15.103:0/1540830160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 0x5555b72d1db0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0f5ab0 tx=0x7fd1cc0f7fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f75191883bb2cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:49.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1cbe00640 1 -- 172.21.15.103:0/1540830160 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0bf040 con 0x5555b72d19d0 2024-09-10T22:43:49.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1cbe00640 1 -- 172.21.15.103:0/1540830160 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1cc0fd270 con 0x5555b72d19d0 2024-09-10T22:43:49.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1cbe00640 1 -- 172.21.15.103:0/1540830160 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc101c90 con 0x5555b72d19d0 2024-09-10T22:43:49.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/1540830160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 msgr2=0x5555b72d1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:49.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/1540830160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 0x5555b72d1db0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0f5ab0 tx=0x7fd1cc0f7fb0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/1540830160 shutdown_connections 2024-09-10T22:43:49.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/1540830160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7285e10 0x5555b72861f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/1540830160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b72d22f0 0x5555b72858d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/1540830160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 0x5555b72d1db0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/1540830160 >> 172.21.15.103:0/1540830160 conn(0x5555b716f130 msgr2=0x5555b72b4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:49.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/1540830160 shutdown_connections 2024-09-10T22:43:49.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/1540830160 wait complete. 2024-09-10T22:43:49.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1e5bd4000 1 -- start start 2024-09-10T22:43:49.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.966+0000 7fd1e5bd4000 1 Processor -- start 2024-09-10T22:43:49.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1e5bd4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7285e10 0x5555b72b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1e5bd4000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 0x5555b72b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1e5bd4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b72d22f0 0x5555b72b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1e5bd4000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5555b706d5d0 con 0x5555b72d19d0 2024-09-10T22:43:49.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1e5bd4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5555b70d6d60 con 0x5555b72d22f0 2024-09-10T22:43:49.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1e5bd4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5555b7079500 con 0x5555b7285e10 2024-09-10T22:43:49.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1e5bd4000 10 client.0 _ll_register_callbacks cb 0x5555b707d810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:43:49.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1d3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 0x5555b72b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1d3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 0x5555b72b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43696/0 (socket says 172.21.15.103:43696) 2024-09-10T22:43:49.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1d3e00640 1 -- 172.21.15.103:0/392916612 learned_addr learned my addr 172.21.15.103:0/392916612 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:49.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1db400640 1 --2- 172.21.15.103:0/392916612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7285e10 0x5555b72b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1dbe00640 1 --2- 172.21.15.103:0/392916612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b72d22f0 0x5555b72b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1d3e00640 1 -- 172.21.15.103:0/392916612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7285e10 msgr2=0x5555b72b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:49.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1d3e00640 1 --2- 172.21.15.103:0/392916612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7285e10 0x5555b72b26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1d3e00640 1 -- 172.21.15.103:0/392916612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b72d22f0 msgr2=0x5555b72b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:49.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1d3e00640 1 --2- 172.21.15.103:0/392916612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b72d22f0 0x5555b72b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1d3e00640 1 -- 172.21.15.103:0/392916612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555b7071170 con 0x5555b72d19d0 2024-09-10T22:43:49.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1db400640 1 --2- 172.21.15.103:0/392916612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7285e10 0x5555b72b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:43:49.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1d3e00640 1 --2- 172.21.15.103:0/392916612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 0x5555b72b2e70 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fd1c401dcb0 tx=0x7fd1c4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce2b49c9bf654bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:49.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:43:49.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1c8c00640 1 -- 172.21.15.103:0/392916612 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c401de60 con 0x5555b72d19d0 2024-09-10T22:43:49.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/392916612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5555b706b0f0 con 0x5555b72d19d0 2024-09-10T22:43:49.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1c8c00640 1 -- 172.21.15.103:0/392916612 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fd1c401cbd0 con 0x5555b72d19d0 2024-09-10T22:43:49.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1c8c00640 1 -- 172.21.15.103:0/392916612 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fd1c4030050 con 0x5555b72d19d0 2024-09-10T22:43:49.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1e5bd4000 10 client.7089 fetch_fsmap learned FSMap version 77 2024-09-10T22:43:49.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/392916612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x5555b7157ef0 con 0x5555b72d19d0 2024-09-10T22:43:49.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1c8c00640 1 -- 172.21.15.103:0/392916612 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5555b706b0f0 con 0x5555b72d19d0 2024-09-10T22:43:49.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1c8c00640 1 -- 172.21.15.103:0/392916612 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 77) ==== 3542+0+0 (secure 0 0 0) 0x7fd1c4033020 con 0x5555b72d19d0 2024-09-10T22:43:49.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1e5bd4000 10 client.7089 fetch_fsmap finished waiting for FSMap version 77 2024-09-10T22:43:49.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1e5bd4000 10 client.7089 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T22:43:49.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1e5bd4000 20 client.7089 populate_metadata read hostname 'smithi103' 2024-09-10T22:43:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/392916612 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x5555b72b40f0 0x5555b72e3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1e5bd4000 4 client.7089 mds_command: new command op to 6592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:43:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/392916612 --> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555b70e5a70 con 0x5555b72b40f0 2024-09-10T22:43:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1db400640 1 --2- 172.21.15.103:0/392916612 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x5555b72b40f0 0x5555b72e3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1db400640 1 --2- 172.21.15.103:0/392916612 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x5555b72b40f0 0x5555b72e3c90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fc6d9dc08f6d31db server_cookie=2ba450a1b2c2a33f in_seq=0 out_seq=0 2024-09-10T22:43:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.970+0000 7fd1c8c00640 10 client.7089 ms_handle_connect on v2:172.21.15.131:6834/134240629 2024-09-10T22:43:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.974+0000 7fd1c8c00640 1 -- 172.21.15.103:0/392916612 <== mds.1 v2:172.21.15.131:6834/134240629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5555b70e5a70 con 0x5555b72b40f0 2024-09-10T22:43:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.974+0000 7fd1c8c00640 10 client.7089 handle_command_reply: tid=0 2024-09-10T22:43:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.974+0000 7fd1e5bd4000 1 client.7089 shutdown 2024-09-10T22:43:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.974+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/392916612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 msgr2=0x5555b72b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.974+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/392916612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 0x5555b72b2e70 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fd1c401dcb0 tx=0x7fd1c4004740 comp rx=0 tx=0).stop 2024-09-10T22:43:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.974+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/392916612 shutdown_connections 2024-09-10T22:43:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.974+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/392916612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b72d22f0 0x5555b72b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.974+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/392916612 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x5555b72b40f0 0x5555b72e3c90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.974+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/392916612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 0x5555b72b2e70 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.974+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/392916612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7285e10 0x5555b72b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.974+0000 7fd1c8c00640 0 client.7089 ms_handle_reset on v2:172.21.15.131:6834/134240629 2024-09-10T22:43:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.974+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/392916612 >> 172.21.15.103:0/392916612 conn(0x5555b716f130 msgr2=0x5555b7284fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.974+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/392916612 shutdown_connections 2024-09-10T22:43:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.974+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/392916612 wait complete. 2024-09-10T22:43:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.974+0000 7fd1e5bd4000 20 client.7089 trim_cache size 0 max 16384 2024-09-10T22:43:49.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1e5bd4000 1 Processor -- start 2024-09-10T22:43:49.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1e5bd4000 1 -- start start 2024-09-10T22:43:50.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1e5bd4000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b7285e10 0x5555b7343fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1e5bd4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b72d19d0 0x5555b7344520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1e5bd4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b72d22f0 0x5555b7344a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1e5bd4000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc204890 con 0x5555b7285e10 2024-09-10T22:43:50.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1e5bd4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc203af0 con 0x5555b72d19d0 2024-09-10T22:43:50.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1e5bd4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd1dc2041c0 con 0x5555b72d22f0 2024-09-10T22:43:50.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1db400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b7285e10 0x5555b7343fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1db400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b7285e10 0x5555b7343fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43700/0 (socket says 172.21.15.103:43700) 2024-09-10T22:43:50.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1db400640 1 -- 172.21.15.103:0/3639620182 learned_addr learned my addr 172.21.15.103:0/3639620182 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:50.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1d3e00640 1 --2- 172.21.15.103:0/3639620182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b72d19d0 0x5555b7344520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1dbe00640 1 --2- 172.21.15.103:0/3639620182 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b72d22f0 0x5555b7344a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1db400640 1 -- 172.21.15.103:0/3639620182 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b72d22f0 msgr2=0x5555b7344a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:50.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1db400640 1 --2- 172.21.15.103:0/3639620182 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b72d22f0 0x5555b7344a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1db400640 1 -- 172.21.15.103:0/3639620182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b72d19d0 msgr2=0x5555b7344520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:50.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1db400640 1 --2- 172.21.15.103:0/3639620182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b72d19d0 0x5555b7344520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1db400640 1 -- 172.21.15.103:0/3639620182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555b712ed90 con 0x5555b7285e10 2024-09-10T22:43:50.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1db400640 1 --2- 172.21.15.103:0/3639620182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b7285e10 0x5555b7343fe0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc01cc70 tx=0x7fd1cc12bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3c5b43ec278274 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:50.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1cb400640 1 -- 172.21.15.103:0/3639620182 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0bf040 con 0x5555b7285e10 2024-09-10T22:43:50.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1cb400640 1 -- 172.21.15.103:0/3639620182 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1cc0f8aa0 con 0x5555b7285e10 2024-09-10T22:43:50.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1cb400640 1 -- 172.21.15.103:0/3639620182 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0f4e90 con 0x5555b7285e10 2024-09-10T22:43:50.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/3639620182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b7285e10 msgr2=0x5555b7343fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:50.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/3639620182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b7285e10 0x5555b7343fe0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc01cc70 tx=0x7fd1cc12bbb0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/3639620182 shutdown_connections 2024-09-10T22:43:50.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/3639620182 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b72d22f0 0x5555b7344a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/3639620182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b72d19d0 0x5555b7344520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/3639620182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b7285e10 0x5555b7343fe0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/3639620182 >> 172.21.15.103:0/3639620182 conn(0x5555b716f130 msgr2=0x5555b728dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:50.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/3639620182 shutdown_connections 2024-09-10T22:43:50.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/3639620182 wait complete. 2024-09-10T22:43:50.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.994+0000 7fd1e5bd4000 1 -- start start 2024-09-10T22:43:50.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1e5bd4000 1 Processor -- start 2024-09-10T22:43:50.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1e5bd4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7285e10 0x5555b7348020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1e5bd4000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 0x5555b7348560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1e5bd4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b72d22f0 0x5555b7348aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1e5bd4000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc1f8300 con 0x5555b72d19d0 2024-09-10T22:43:50.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1e5bd4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5555b72e8ce0 con 0x5555b72d22f0 2024-09-10T22:43:50.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1e5bd4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5555b70db390 con 0x5555b7285e10 2024-09-10T22:43:50.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1e5bd4000 10 client.0 _ll_register_callbacks cb 0x7fd1c401d410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:43:50.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1d3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 0x5555b7348560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1d3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 0x5555b7348560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43714/0 (socket says 172.21.15.103:43714) 2024-09-10T22:43:50.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1d3e00640 1 -- 172.21.15.103:0/473287378 learned_addr learned my addr 172.21.15.103:0/473287378 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:50.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1dbe00640 1 --2- 172.21.15.103:0/473287378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b72d22f0 0x5555b7348aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1db400640 1 --2- 172.21.15.103:0/473287378 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7285e10 0x5555b7348020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1d3e00640 1 -- 172.21.15.103:0/473287378 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7285e10 msgr2=0x5555b7348020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:50.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1d3e00640 1 --2- 172.21.15.103:0/473287378 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7285e10 0x5555b7348020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1d3e00640 1 -- 172.21.15.103:0/473287378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b72d22f0 msgr2=0x5555b7348aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:50.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1d3e00640 1 --2- 172.21.15.103:0/473287378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b72d22f0 0x5555b7348aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1d3e00640 1 -- 172.21.15.103:0/473287378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555b7099a90 con 0x5555b72d19d0 2024-09-10T22:43:50.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1db400640 1 --2- 172.21.15.103:0/473287378 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7285e10 0x5555b7348020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:43:50.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1d3e00640 1 --2- 172.21.15.103:0/473287378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 0x5555b7348560 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4016040 tx=0x7fd1c401ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbe1a6ce07cde73 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:50.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:43:50.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1c8c00640 1 -- 172.21.15.103:0/473287378 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c401de60 con 0x5555b72d19d0 2024-09-10T22:43:50.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/473287378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1cc0f8aa0 con 0x5555b72d19d0 2024-09-10T22:43:50.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1c8c00640 1 -- 172.21.15.103:0/473287378 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fd1c4003810 con 0x5555b72d19d0 2024-09-10T22:43:50.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1c8c00640 1 -- 172.21.15.103:0/473287378 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fd1c4044050 con 0x5555b72d19d0 2024-09-10T22:43:50.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1e5bd4000 10 client.7095 fetch_fsmap learned FSMap version 77 2024-09-10T22:43:50.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/473287378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x5555b7078050 con 0x5555b72d19d0 2024-09-10T22:43:50.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1c8c00640 1 -- 172.21.15.103:0/473287378 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1cc0f8aa0 con 0x5555b72d19d0 2024-09-10T22:43:50.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1c8c00640 1 -- 172.21.15.103:0/473287378 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 77) ==== 3542+0+0 (secure 0 0 0) 0x7fd1c4047020 con 0x5555b72d19d0 2024-09-10T22:43:50.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1e5bd4000 10 client.7095 fetch_fsmap finished waiting for FSMap version 77 2024-09-10T22:43:50.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1e5bd4000 10 client.7095 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T22:43:50.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1e5bd4000 20 client.7095 populate_metadata read hostname 'smithi103' 2024-09-10T22:43:50.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/473287378 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x5555b72e75c0 0x5555b72e66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1e5bd4000 4 client.7095 mds_command: new command op to 6592 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:43:50.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/473287378 --> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] -- command(tid 0: {"prefix": "status"}) -- 0x5555b70e1520 con 0x5555b72e75c0 2024-09-10T22:43:50.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1db400640 1 --2- 172.21.15.103:0/473287378 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x5555b72e75c0 0x5555b72e66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1db400640 1 --2- 172.21.15.103:0/473287378 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x5555b72e75c0 0x5555b72e66e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e5211000a6c29ecf server_cookie=9998e40da2e77f25 in_seq=0 out_seq=0 2024-09-10T22:43:50.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:49.998+0000 7fd1c8c00640 10 client.7095 ms_handle_connect on v2:172.21.15.131:6834/134240629 2024-09-10T22:43:50.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1c8c00640 1 -- 172.21.15.103:0/473287378 <== mds.1 v2:172.21.15.131:6834/134240629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5555b70e1520 con 0x5555b72e75c0 2024-09-10T22:43:50.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1c8c00640 10 client.7095 handle_command_reply: tid=0 2024-09-10T22:43:50.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e5bd4000 1 client.7095 shutdown 2024-09-10T22:43:50.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/473287378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 msgr2=0x5555b7348560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:50.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/473287378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 0x5555b7348560 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4016040 tx=0x7fd1c401ce80 comp rx=0 tx=0).stop 2024-09-10T22:43:50.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/473287378 shutdown_connections 2024-09-10T22:43:50.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/473287378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b72d22f0 0x5555b7348aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/473287378 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x5555b72e75c0 0x5555b72e66e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/473287378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555b72d19d0 0x5555b7348560 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e5bd4000 1 --2- 172.21.15.103:0/473287378 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7285e10 0x5555b7348020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1c8c00640 0 client.7095 ms_handle_reset on v2:172.21.15.131:6834/134240629 2024-09-10T22:43:50.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/473287378 >> 172.21.15.103:0/473287378 conn(0x5555b716f130 msgr2=0x5555b72d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:50.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/473287378 shutdown_connections 2024-09-10T22:43:50.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e5bd4000 1 -- 172.21.15.103:0/473287378 wait complete. 2024-09-10T22:43:50.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e5bd4000 20 client.7095 trim_cache size 0 max 16384 2024-09-10T22:43:50.015 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:43:50.015 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:43:50.015 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 1, 2024-09-10T22:43:50.015 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6592, 2024-09-10T22:43:50.015 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:43:50.015 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:43:50.015 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:43:50.015 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 2.9941236259999999, 2024-09-10T22:43:50.016 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 77, 2024-09-10T22:43:50.016 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 81, 2024-09-10T22:43:50.016 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 81, 2024-09-10T22:43:50.016 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 20.544122168000001 2024-09-10T22:43:50.016 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:43:50.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e2800640 1 -- 172.21.15.103:0/1483182463 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd1b80725e0 msgr2=0x7fd1b8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:50.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e2800640 1 --2- 172.21.15.103:0/1483182463 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd1b80725e0 0x7fd1b8074aa0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4009600 tx=0x7fd1c40091e0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e2800640 1 -- 172.21.15.103:0/1483182463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1dc0b09c0 msgr2=0x7fd1dc1593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:50.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e2800640 1 --2- 172.21.15.103:0/1483182463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1dc0b09c0 0x7fd1dc1593e0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc000c10 tx=0x7fd1cc0a6460 comp rx=0 tx=0).stop 2024-09-10T22:43:50.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e2800640 1 -- 172.21.15.103:0/1483182463 shutdown_connections 2024-09-10T22:43:50.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e2800640 1 --2- 172.21.15.103:0/1483182463 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd1b80725e0 0x7fd1b8074aa0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e2800640 1 --2- 172.21.15.103:0/1483182463 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1dc15be30 0x7fd1dc164f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e2800640 1 --2- 172.21.15.103:0/1483182463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1dc0ceb40 0x7fd1dc0c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e2800640 1 --2- 172.21.15.103:0/1483182463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1dc0b09c0 0x7fd1dc1593e0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e2800640 1 -- 172.21.15.103:0/1483182463 >> 172.21.15.103:0/1483182463 conn(0x7fd1dc0d1ac0 msgr2=0x7fd1dc0717d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:50.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e2800640 1 -- 172.21.15.103:0/1483182463 shutdown_connections 2024-09-10T22:43:50.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.002+0000 7fd1e2800640 1 -- 172.21.15.103:0/1483182463 wait complete. 2024-09-10T22:43:50.030 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T22:43:50.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa383000640 1 -- 172.21.15.103:0/2102482641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c06f810 msgr2=0x7fa37c072c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:50.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa383000640 1 --2- 172.21.15.103:0/2102482641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c06f810 0x7fa37c072c10 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fa37400a950 tx=0x7fa37401db70 comp rx=0 tx=0).stop 2024-09-10T22:43:50.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa383000640 1 -- 172.21.15.103:0/2102482641 shutdown_connections 2024-09-10T22:43:50.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa383000640 1 --2- 172.21.15.103:0/2102482641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c06f810 0x7fa37c072c10 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa383000640 1 -- 172.21.15.103:0/2102482641 >> 172.21.15.103:0/2102482641 conn(0x7fa37c06cc00 msgr2=0x7fa37c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:50.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa383000640 1 -- 172.21.15.103:0/2102482641 shutdown_connections 2024-09-10T22:43:50.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa383000640 1 -- 172.21.15.103:0/2102482641 wait complete. 2024-09-10T22:43:50.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa383000640 1 Processor -- start 2024-09-10T22:43:50.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa383000640 1 -- start start 2024-09-10T22:43:50.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa383000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa37c06f810 0x7fa37c1fba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa383000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c0b3320 0x7fa37c159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa383000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa37c0cf260 0x7fa37c1473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa383000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c167fc0 con 0x7fa37c0b3320 2024-09-10T22:43:50.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa383000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c167e40 con 0x7fa37c0cf260 2024-09-10T22:43:50.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa383000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa37c168140 con 0x7fa37c06f810 2024-09-10T22:43:50.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa37b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c0b3320 0x7fa37c159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa37b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c0b3320 0x7fa37c159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43736/0 (socket says 172.21.15.103:43736) 2024-09-10T22:43:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa37b400640 1 -- 172.21.15.103:0/1056931196 learned_addr learned my addr 172.21.15.103:0/1056931196 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa37be00640 1 --2- 172.21.15.103:0/1056931196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa37c06f810 0x7fa37c1fba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa381000640 1 --2- 172.21.15.103:0/1056931196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa37c0cf260 0x7fa37c1473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa37b400640 1 -- 172.21.15.103:0/1056931196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa37c06f810 msgr2=0x7fa37c1fba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.170+0000 7fa37b400640 1 --2- 172.21.15.103:0/1056931196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa37c06f810 0x7fa37c1fba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.174+0000 7fa37b400640 1 -- 172.21.15.103:0/1056931196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa37c0cf260 msgr2=0x7fa37c1473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.174+0000 7fa37b400640 1 --2- 172.21.15.103:0/1056931196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa37c0cf260 0x7fa37c1473f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.174+0000 7fa37b400640 1 -- 172.21.15.103:0/1056931196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37c1f7f30 con 0x7fa37c0b3320 2024-09-10T22:43:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.174+0000 7fa37be00640 1 --2- 172.21.15.103:0/1056931196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa37c06f810 0x7fa37c1fba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:43:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.174+0000 7fa37b400640 1 --2- 172.21.15.103:0/1056931196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c0b3320 0x7fa37c159390 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fa36800c500 tx=0x7fa36800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.174+0000 7fa373e00640 1 -- 172.21.15.103:0/1056931196 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa368017070 con 0x7fa37c0b3320 2024-09-10T22:43:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.174+0000 7fa373e00640 1 -- 172.21.15.103:0/1056931196 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3680053c0 con 0x7fa37c0b3320 2024-09-10T22:43:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.174+0000 7fa373e00640 1 -- 172.21.15.103:0/1056931196 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa368012890 con 0x7fa37c0b3320 2024-09-10T22:43:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.174+0000 7fa383000640 1 -- 172.21.15.103:0/1056931196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37c1f8210 con 0x7fa37c0b3320 2024-09-10T22:43:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.174+0000 7fa383000640 1 -- 172.21.15.103:0/1056931196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa37c1f87d0 con 0x7fa37c0b3320 2024-09-10T22:43:50.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.174+0000 7fa373e00640 1 -- 172.21.15.103:0/1056931196 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa368003600 con 0x7fa37c0b3320 2024-09-10T22:43:50.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.174+0000 7fa3864b4000 1 Processor -- start 2024-09-10T22:43:50.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.174+0000 7fa3864b4000 1 -- start start 2024-09-10T22:43:50.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa373e00640 1 --2- 172.21.15.103:0/1056931196 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa35c072610 0x7fa35c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa373e00640 1 -- 172.21.15.103:0/1056931196 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fa368092900 con 0x7fa37c0b3320 2024-09-10T22:43:50.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa381000640 1 --2- 172.21.15.103:0/1056931196 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa35c072610 0x7fa35c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa3864b4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdbc89d0 0x5645fdbc8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa3864b4000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc92f0 0x5645fdb7c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa3864b4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdb7ce10 0x5645fdb7d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa3864b4000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5645fda9d3f0 con 0x5645fdbc92f0 2024-09-10T22:43:50.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa3864b4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5645fd9dab20 con 0x5645fdb7ce10 2024-09-10T22:43:50.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa3864b4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5645fd9c9f50 con 0x5645fdbc89d0 2024-09-10T22:43:50.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa37b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc92f0 0x5645fdb7c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa37b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc92f0 0x5645fdb7c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43738/0 (socket says 172.21.15.103:43738) 2024-09-10T22:43:50.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa37b400640 1 -- 172.21.15.103:0/3144823203 learned_addr learned my addr 172.21.15.103:0/3144823203 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:50.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa37be00640 1 --2- 172.21.15.103:0/3144823203 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdbc89d0 0x5645fdbc8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa381000640 1 --2- 172.21.15.103:0/3144823203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdb7ce10 0x5645fdb7d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa37b400640 1 -- 172.21.15.103:0/3144823203 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdbc89d0 msgr2=0x5645fdbc8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:50.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa37b400640 1 --2- 172.21.15.103:0/3144823203 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdbc89d0 0x5645fdbc8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa37b400640 1 -- 172.21.15.103:0/3144823203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdb7ce10 msgr2=0x5645fdb7d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:50.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa37b400640 1 --2- 172.21.15.103:0/3144823203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdb7ce10 0x5645fdb7d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa37b400640 1 -- 172.21.15.103:0/3144823203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645fd991590 con 0x5645fdbc92f0 2024-09-10T22:43:50.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa381000640 1 --2- 172.21.15.103:0/3144823203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdb7ce10 0x5645fdb7d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:43:50.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa381000640 1 --2- 172.21.15.103:0/1056931196 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa35c072610 0x7fa35c074ad0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa3740b0000 tx=0x7fa37401a910 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:50.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa37b400640 1 --2- 172.21.15.103:0/3144823203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc92f0 0x5645fdb7c8d0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fa368090cb0 tx=0x7fa368000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b094350ae1feb87f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:50.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa370c00640 1 -- 172.21.15.103:0/3144823203 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa368066c40 con 0x5645fdbc92f0 2024-09-10T22:43:50.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa370c00640 1 -- 172.21.15.103:0/3144823203 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa368064450 con 0x5645fdbc92f0 2024-09-10T22:43:50.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa370c00640 1 -- 172.21.15.103:0/3144823203 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36805ca50 con 0x5645fdbc92f0 2024-09-10T22:43:50.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa3864b4000 1 -- 172.21.15.103:0/3144823203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc92f0 msgr2=0x5645fdb7c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:50.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa3864b4000 1 --2- 172.21.15.103:0/3144823203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc92f0 0x5645fdb7c8d0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fa368090cb0 tx=0x7fa368000ee0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa3864b4000 1 -- 172.21.15.103:0/3144823203 shutdown_connections 2024-09-10T22:43:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa3864b4000 1 --2- 172.21.15.103:0/3144823203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdb7ce10 0x5645fdb7d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa3864b4000 1 --2- 172.21.15.103:0/3144823203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc92f0 0x5645fdb7c8d0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa3864b4000 1 --2- 172.21.15.103:0/3144823203 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdbc89d0 0x5645fdbc8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa3864b4000 1 -- 172.21.15.103:0/3144823203 >> 172.21.15.103:0/3144823203 conn(0x5645fda66130 msgr2=0x5645fdbabe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa3864b4000 1 -- 172.21.15.103:0/3144823203 shutdown_connections 2024-09-10T22:43:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa3864b4000 1 -- 172.21.15.103:0/3144823203 wait complete. 2024-09-10T22:43:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa3864b4000 1 -- start start 2024-09-10T22:43:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.178+0000 7fa3864b4000 1 Processor -- start 2024-09-10T22:43:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdb7ce10 0x5645fdba96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc89d0 0x5645fdba9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdbc92f0 0x5645fdbaa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5645fd9645d0 con 0x5645fdbc89d0 2024-09-10T22:43:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5645fd9cdd60 con 0x5645fdbc92f0 2024-09-10T22:43:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5645fd970500 con 0x5645fdb7ce10 2024-09-10T22:43:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 10 client.0 _ll_register_callbacks cb 0x5645fd974810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:43:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa37b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc89d0 0x5645fdba9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa37b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc89d0 0x5645fdba9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43742/0 (socket says 172.21.15.103:43742) 2024-09-10T22:43:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa37b400640 1 -- 172.21.15.103:0/33499568 learned_addr learned my addr 172.21.15.103:0/33499568 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa37be00640 1 --2- 172.21.15.103:0/33499568 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdb7ce10 0x5645fdba96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa381000640 1 --2- 172.21.15.103:0/33499568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdbc92f0 0x5645fdbaa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa37b400640 1 -- 172.21.15.103:0/33499568 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdb7ce10 msgr2=0x5645fdba96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa37b400640 1 --2- 172.21.15.103:0/33499568 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdb7ce10 0x5645fdba96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa37b400640 1 -- 172.21.15.103:0/33499568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdbc92f0 msgr2=0x5645fdbaa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa37b400640 1 --2- 172.21.15.103:0/33499568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdbc92f0 0x5645fdbaa3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa37b400640 1 -- 172.21.15.103:0/33499568 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645fd968170 con 0x5645fdbc89d0 2024-09-10T22:43:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa37b400640 1 --2- 172.21.15.103:0/33499568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc89d0 0x5645fdba9e70 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fa36800c4d0 tx=0x7fa368059d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1fc1a10f438ffac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa365600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:43:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa365600640 1 -- 172.21.15.103:0/33499568 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa368064450 con 0x5645fdbc89d0 2024-09-10T22:43:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa365600640 1 -- 172.21.15.103:0/33499568 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fa3680645f0 con 0x5645fdbc89d0 2024-09-10T22:43:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 1 -- 172.21.15.103:0/33499568 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5645fd9620f0 con 0x5645fdbc89d0 2024-09-10T22:43:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa365600640 1 -- 172.21.15.103:0/33499568 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fa368059140 con 0x5645fdbc89d0 2024-09-10T22:43:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 10 client.7110 fetch_fsmap learned FSMap version 77 2024-09-10T22:43:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 1 -- 172.21.15.103:0/33499568 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x5645fda4eef0 con 0x5645fdbc89d0 2024-09-10T22:43:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa365600640 1 -- 172.21.15.103:0/33499568 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5645fd9620f0 con 0x5645fdbc89d0 2024-09-10T22:43:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa365600640 1 -- 172.21.15.103:0/33499568 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 77) ==== 3542+0+0 (secure 0 0 0) 0x7fa3680592e0 con 0x5645fdbc89d0 2024-09-10T22:43:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 10 client.7110 fetch_fsmap finished waiting for FSMap version 77 2024-09-10T22:43:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 10 client.7110 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:43:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 20 client.7110 populate_metadata read hostname 'smithi103' 2024-09-10T22:43:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 1 --2- 172.21.15.103:0/33499568 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x5645fdbab0f0 0x5645fdbdac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 4 client.7110 mds_command: new command op to 6873 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:43:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 1 -- 172.21.15.103:0/33499568 --> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645fd9dca70 con 0x5645fdbab0f0 2024-09-10T22:43:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa37be00640 1 --2- 172.21.15.103:0/33499568 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x5645fdbab0f0 0x5645fdbdac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa37be00640 1 --2- 172.21.15.103:0/33499568 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x5645fdbab0f0 0x5645fdbdac90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66e12dfb77a0aef9 server_cookie=bed35a29503e1d6d in_seq=0 out_seq=0 2024-09-10T22:43:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa365600640 10 client.7110 ms_handle_connect on v2:172.21.15.103:6833/249667943 2024-09-10T22:43:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa365600640 1 -- 172.21.15.103:0/33499568 <== mds.0 v2:172.21.15.103:6833/249667943 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5645fd9dca70 con 0x5645fdbab0f0 2024-09-10T22:43:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa365600640 10 client.7110 handle_command_reply: tid=0 2024-09-10T22:43:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 1 client.7110 shutdown 2024-09-10T22:43:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 1 -- 172.21.15.103:0/33499568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc89d0 msgr2=0x5645fdba9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 1 --2- 172.21.15.103:0/33499568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc89d0 0x5645fdba9e70 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fa36800c4d0 tx=0x7fa368059d10 comp rx=0 tx=0).stop 2024-09-10T22:43:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 1 -- 172.21.15.103:0/33499568 shutdown_connections 2024-09-10T22:43:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.182+0000 7fa3864b4000 1 --2- 172.21.15.103:0/33499568 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x5645fdbab0f0 0x5645fdbdac90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.186+0000 7fa3864b4000 1 --2- 172.21.15.103:0/33499568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdbc92f0 0x5645fdbaa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.186+0000 7fa365600640 0 client.7110 ms_handle_reset on v2:172.21.15.103:6833/249667943 2024-09-10T22:43:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.186+0000 7fa3864b4000 1 --2- 172.21.15.103:0/33499568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc89d0 0x5645fdba9e70 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.186+0000 7fa3864b4000 1 --2- 172.21.15.103:0/33499568 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdb7ce10 0x5645fdba96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.186+0000 7fa3864b4000 1 -- 172.21.15.103:0/33499568 >> 172.21.15.103:0/33499568 conn(0x5645fda66130 msgr2=0x5645fdb7bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.186+0000 7fa3864b4000 1 -- 172.21.15.103:0/33499568 shutdown_connections 2024-09-10T22:43:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.186+0000 7fa3864b4000 1 -- 172.21.15.103:0/33499568 wait complete. 2024-09-10T22:43:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.186+0000 7fa3864b4000 20 client.7110 trim_cache size 0 max 16384 2024-09-10T22:43:50.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa3864b4000 1 Processor -- start 2024-09-10T22:43:50.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa3864b4000 1 -- start start 2024-09-10T22:43:50.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa3864b4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdb7ce10 0x5645fdc3afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa3864b4000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc89d0 0x5645fdc3b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa3864b4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdbc92f0 0x5645fdc3ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa3864b4000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c203ce0 con 0x5645fdbc89d0 2024-09-10T22:43:50.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa3864b4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c2043b0 con 0x5645fdb7ce10 2024-09-10T22:43:50.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa3864b4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa37c154d80 con 0x5645fdbc92f0 2024-09-10T22:43:50.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa37b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc89d0 0x5645fdc3b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa37b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc89d0 0x5645fdc3b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43758/0 (socket says 172.21.15.103:43758) 2024-09-10T22:43:50.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa37b400640 1 -- 172.21.15.103:0/774863173 learned_addr learned my addr 172.21.15.103:0/774863173 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:50.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa37b400640 1 -- 172.21.15.103:0/774863173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdbc92f0 msgr2=0x5645fdc3ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:50.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa381000640 1 --2- 172.21.15.103:0/774863173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdbc92f0 0x5645fdc3ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa37be00640 1 --2- 172.21.15.103:0/774863173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdb7ce10 0x5645fdc3afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa37b400640 1 --2- 172.21.15.103:0/774863173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdbc92f0 0x5645fdc3ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa37b400640 1 -- 172.21.15.103:0/774863173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdb7ce10 msgr2=0x5645fdc3afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:50.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa37b400640 1 --2- 172.21.15.103:0/774863173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdb7ce10 0x5645fdc3afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa37b400640 1 -- 172.21.15.103:0/774863173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645fda25d90 con 0x5645fdbc89d0 2024-09-10T22:43:50.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa381000640 1 --2- 172.21.15.103:0/774863173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdbc92f0 0x5645fdc3ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:50.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.202+0000 7fa37be00640 1 --2- 172.21.15.103:0/774863173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdb7ce10 0x5645fdc3afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:43:50.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa37b400640 1 --2- 172.21.15.103:0/774863173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc89d0 0x5645fdc3b520 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fa368001320 tx=0x7fa368059e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0f024ed68a640 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:50.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa367e00640 1 -- 172.21.15.103:0/774863173 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3680592e0 con 0x5645fdbc89d0 2024-09-10T22:43:50.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa367e00640 1 -- 172.21.15.103:0/774863173 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa368059480 con 0x5645fdbc89d0 2024-09-10T22:43:50.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa367e00640 1 -- 172.21.15.103:0/774863173 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3680646b0 con 0x5645fdbc89d0 2024-09-10T22:43:50.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa3864b4000 1 -- 172.21.15.103:0/774863173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc89d0 msgr2=0x5645fdc3b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:50.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa3864b4000 1 --2- 172.21.15.103:0/774863173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc89d0 0x5645fdc3b520 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fa368001320 tx=0x7fa368059e40 comp rx=0 tx=0).stop 2024-09-10T22:43:50.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa3864b4000 1 -- 172.21.15.103:0/774863173 shutdown_connections 2024-09-10T22:43:50.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa3864b4000 1 --2- 172.21.15.103:0/774863173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdbc92f0 0x5645fdc3ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa3864b4000 1 --2- 172.21.15.103:0/774863173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdbc89d0 0x5645fdc3b520 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa3864b4000 1 --2- 172.21.15.103:0/774863173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdb7ce10 0x5645fdc3afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa3864b4000 1 -- 172.21.15.103:0/774863173 >> 172.21.15.103:0/774863173 conn(0x5645fda66130 msgr2=0x5645fdb84240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:50.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa3864b4000 1 -- 172.21.15.103:0/774863173 shutdown_connections 2024-09-10T22:43:50.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa3864b4000 1 -- 172.21.15.103:0/774863173 wait complete. 2024-09-10T22:43:50.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa3864b4000 1 -- start start 2024-09-10T22:43:50.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa3864b4000 1 Processor -- start 2024-09-10T22:43:50.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa3864b4000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdb7ce10 0x5645fdc3e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa3864b4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdbc89d0 0x5645fdc3ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa3864b4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdbc92f0 0x5645fdc3f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa3864b4000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5645fd9645d0 con 0x5645fdb7ce10 2024-09-10T22:43:50.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa3864b4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5645fd995ec0 con 0x5645fdbc89d0 2024-09-10T22:43:50.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa3864b4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5645fd9cdd60 con 0x5645fdbc92f0 2024-09-10T22:43:50.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa3864b4000 10 client.0 _ll_register_callbacks cb 0x7fa36c001bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:43:50.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa37be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdb7ce10 0x5645fdc3e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa37be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdb7ce10 0x5645fdc3e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43764/0 (socket says 172.21.15.103:43764) 2024-09-10T22:43:50.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa37be00640 1 -- 172.21.15.103:0/3680151663 learned_addr learned my addr 172.21.15.103:0/3680151663 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:50.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa37b400640 1 --2- 172.21.15.103:0/3680151663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdbc89d0 0x5645fdc3ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa381000640 1 --2- 172.21.15.103:0/3680151663 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdbc92f0 0x5645fdc3f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa37be00640 1 -- 172.21.15.103:0/3680151663 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdbc92f0 msgr2=0x5645fdc3f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:50.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa37be00640 1 --2- 172.21.15.103:0/3680151663 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdbc92f0 0x5645fdc3f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa37be00640 1 -- 172.21.15.103:0/3680151663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdbc89d0 msgr2=0x5645fdc3ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:43:50.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa37be00640 1 --2- 172.21.15.103:0/3680151663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdbc89d0 0x5645fdc3ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa37be00640 1 -- 172.21.15.103:0/3680151663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645fd990a90 con 0x5645fdb7ce10 2024-09-10T22:43:50.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa37be00640 1 --2- 172.21.15.103:0/3680151663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdb7ce10 0x5645fdc3e9f0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x5645fd9d4130 tx=0x7fa36c003df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c16f1cb9c5f1080 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:50.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.206+0000 7fa365600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:43:50.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa365600640 1 -- 172.21.15.103:0/3680151663 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c0047c0 con 0x5645fdb7ce10 2024-09-10T22:43:50.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 1 -- 172.21.15.103:0/3680151663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa368059480 con 0x5645fdb7ce10 2024-09-10T22:43:50.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa365600640 1 -- 172.21.15.103:0/3680151663 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fa36c013570 con 0x5645fdb7ce10 2024-09-10T22:43:50.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa365600640 1 -- 172.21.15.103:0/3680151663 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fa36c02c050 con 0x5645fdb7ce10 2024-09-10T22:43:50.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 10 client.7116 fetch_fsmap learned FSMap version 77 2024-09-10T22:43:50.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 1 -- 172.21.15.103:0/3680151663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x5645fd96f050 con 0x5645fdb7ce10 2024-09-10T22:43:50.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa365600640 1 -- 172.21.15.103:0/3680151663 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa368059480 con 0x5645fdb7ce10 2024-09-10T22:43:50.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa365600640 1 -- 172.21.15.103:0/3680151663 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 77) ==== 3542+0+0 (secure 0 0 0) 0x7fa36c02f020 con 0x5645fdb7ce10 2024-09-10T22:43:50.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 10 client.7116 fetch_fsmap finished waiting for FSMap version 77 2024-09-10T22:43:50.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 10 client.7116 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:43:50.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 20 client.7116 populate_metadata read hostname 'smithi103' 2024-09-10T22:43:50.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 1 --2- 172.21.15.103:0/3680151663 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x5645fdbde580 0x5645fdbdd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 4 client.7116 mds_command: new command op to 6873 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:43:50.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 1 -- 172.21.15.103:0/3680151663 --> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] -- command(tid 0: {"prefix": "status"}) -- 0x5645fd9d8520 con 0x5645fdbde580 2024-09-10T22:43:50.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa37b400640 1 --2- 172.21.15.103:0/3680151663 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x5645fdbde580 0x5645fdbdd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa37b400640 1 --2- 172.21.15.103:0/3680151663 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x5645fdbde580 0x5645fdbdd6a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9770528540b491f9 server_cookie=9874da0a5d5cce76 in_seq=0 out_seq=0 2024-09-10T22:43:50.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa365600640 10 client.7116 ms_handle_connect on v2:172.21.15.103:6833/249667943 2024-09-10T22:43:50.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa365600640 1 -- 172.21.15.103:0/3680151663 <== mds.0 v2:172.21.15.103:6833/249667943 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5645fd9d8520 con 0x5645fdbde580 2024-09-10T22:43:50.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa365600640 10 client.7116 handle_command_reply: tid=0 2024-09-10T22:43:50.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 1 client.7116 shutdown 2024-09-10T22:43:50.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 1 -- 172.21.15.103:0/3680151663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdb7ce10 msgr2=0x5645fdc3e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:50.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 1 --2- 172.21.15.103:0/3680151663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdb7ce10 0x5645fdc3e9f0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x5645fd9d4130 tx=0x7fa36c003df0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 1 -- 172.21.15.103:0/3680151663 shutdown_connections 2024-09-10T22:43:50.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 1 --2- 172.21.15.103:0/3680151663 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x5645fdbde580 0x5645fdbdd6a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 1 --2- 172.21.15.103:0/3680151663 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5645fdbc92f0 0x5645fdc3f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 1 --2- 172.21.15.103:0/3680151663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645fdbc89d0 0x5645fdc3ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 1 --2- 172.21.15.103:0/3680151663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645fdb7ce10 0x5645fdc3e9f0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa365600640 0 client.7116 ms_handle_reset on v2:172.21.15.103:6833/249667943 2024-09-10T22:43:50.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 1 -- 172.21.15.103:0/3680151663 >> 172.21.15.103:0/3680151663 conn(0x5645fda66130 msgr2=0x5645fdb84b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:50.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 1 -- 172.21.15.103:0/3680151663 shutdown_connections 2024-09-10T22:43:50.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 1 -- 172.21.15.103:0/3680151663 wait complete. 2024-09-10T22:43:50.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa3864b4000 20 client.7116 trim_cache size 0 max 16384 2024-09-10T22:43:50.219 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:43:50.219 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:43:50.219 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-10T22:43:50.219 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6873, 2024-09-10T22:43:50.219 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:43:50.219 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:43:50.219 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:43:50.219 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 16.276452194000001, 2024-09-10T22:43:50.220 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 77, 2024-09-10T22:43:50.220 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 81, 2024-09-10T22:43:50.220 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 81, 2024-09-10T22:43:50.220 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 20.758363168999999 2024-09-10T22:43:50.220 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:43:50.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa383000640 1 -- 172.21.15.103:0/1056931196 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa35c072610 msgr2=0x7fa35c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:50.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa383000640 1 --2- 172.21.15.103:0/1056931196 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa35c072610 0x7fa35c074ad0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa3740b0000 tx=0x7fa37401a910 comp rx=0 tx=0).stop 2024-09-10T22:43:50.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa383000640 1 -- 172.21.15.103:0/1056931196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c0b3320 msgr2=0x7fa37c159390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:50.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa383000640 1 --2- 172.21.15.103:0/1056931196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c0b3320 0x7fa37c159390 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fa36800c500 tx=0x7fa36800c9c0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa383000640 1 -- 172.21.15.103:0/1056931196 shutdown_connections 2024-09-10T22:43:50.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa383000640 1 --2- 172.21.15.103:0/1056931196 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa35c072610 0x7fa35c074ad0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa383000640 1 --2- 172.21.15.103:0/1056931196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa37c0cf260 0x7fa37c1473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa383000640 1 --2- 172.21.15.103:0/1056931196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c0b3320 0x7fa37c159390 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa383000640 1 --2- 172.21.15.103:0/1056931196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa37c06f810 0x7fa37c1fba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa383000640 1 -- 172.21.15.103:0/1056931196 >> 172.21.15.103:0/1056931196 conn(0x7fa37c06cc00 msgr2=0x7fa37c06fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:50.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa383000640 1 -- 172.21.15.103:0/1056931196 shutdown_connections 2024-09-10T22:43:50.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.210+0000 7fa383000640 1 -- 172.21.15.103:0/1056931196 wait complete. 2024-09-10T22:43:50.234 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:43:50.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.370+0000 7f5760000640 1 -- 172.21.15.103:0/126197592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57580b09c0 msgr2=0x7f57580ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:50.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.370+0000 7f5760000640 1 --2- 172.21.15.103:0/126197592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57580b09c0 0x7f57580ce600 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f5758073910 tx=0x7f574401c830 comp rx=0 tx=0).stop 2024-09-10T22:43:50.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.370+0000 7f5760000640 1 -- 172.21.15.103:0/126197592 shutdown_connections 2024-09-10T22:43:50.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.370+0000 7f5760000640 1 --2- 172.21.15.103:0/126197592 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57580ceb40 0x7f57580cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.370+0000 7f5760000640 1 --2- 172.21.15.103:0/126197592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57580b09c0 0x7f57580ce600 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.370+0000 7f5760000640 1 --2- 172.21.15.103:0/126197592 >> v2:172.21.15.131:3300/0 conn(0x7f575815be30 0x7f57580ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.370+0000 7f5760000640 1 -- 172.21.15.103:0/126197592 >> 172.21.15.103:0/126197592 conn(0x7f57580d1ac0 msgr2=0x7f57580d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:50.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.370+0000 7f5760000640 1 -- 172.21.15.103:0/126197592 shutdown_connections 2024-09-10T22:43:50.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.370+0000 7f5760000640 1 -- 172.21.15.103:0/126197592 wait complete. 2024-09-10T22:43:50.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f5760000640 1 Processor -- start 2024-09-10T22:43:50.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f5760000640 1 -- start start 2024-09-10T22:43:50.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f5760000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57580b09c0 0x7f57580c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f5760000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57580ceb40 0x7f57580b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f5760000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f575815be30 0x7f5758150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f5760000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f57580aed50 con 0x7f575815be30 2024-09-10T22:43:50.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f5760000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f57580aebd0 con 0x7f57580ceb40 2024-09-10T22:43:50.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f5760000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f57580aeed0 con 0x7f57580b09c0 2024-09-10T22:43:50.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f575e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f575815be30 0x7f5758150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f575d600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57580b09c0 0x7f57580c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f575e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f575815be30 0x7f5758150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43792/0 (socket says 172.21.15.103:43792) 2024-09-10T22:43:50.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f575e000640 1 -- 172.21.15.103:0/4134208452 learned_addr learned my addr 172.21.15.103:0/4134208452 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:43:50.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f575cc00640 1 --2- 172.21.15.103:0/4134208452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57580ceb40 0x7f57580b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f575e000640 1 -- 172.21.15.103:0/4134208452 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57580b09c0 msgr2=0x7f57580c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:50.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f575e000640 1 --2- 172.21.15.103:0/4134208452 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57580b09c0 0x7f57580c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f575e000640 1 -- 172.21.15.103:0/4134208452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57580ceb40 msgr2=0x7f57580b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:50.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f575e000640 1 --2- 172.21.15.103:0/4134208452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57580ceb40 0x7f57580b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f575e000640 1 -- 172.21.15.103:0/4134208452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5758158420 con 0x7f575815be30 2024-09-10T22:43:50.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f575e000640 1 --2- 172.21.15.103:0/4134208452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f575815be30 0x7f5758150d80 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f575000eab0 tx=0x7f575000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:50.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f5755600640 1 -- 172.21.15.103:0/4134208452 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750004b30 con 0x7f575815be30 2024-09-10T22:43:50.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f5755600640 1 -- 172.21.15.103:0/4134208452 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5750004dc0 con 0x7f575815be30 2024-09-10T22:43:50.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f5760000640 1 -- 172.21.15.103:0/4134208452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5758158700 con 0x7f575815be30 2024-09-10T22:43:50.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f5755600640 1 -- 172.21.15.103:0/4134208452 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750005280 con 0x7f575815be30 2024-09-10T22:43:50.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.374+0000 7f5760000640 1 -- 172.21.15.103:0/4134208452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5758158cc0 con 0x7f575815be30 2024-09-10T22:43:50.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.378+0000 7f5760000640 1 -- 172.21.15.103:0/4134208452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57580cf9c0 con 0x7f575815be30 2024-09-10T22:43:50.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.378+0000 7f5755600640 1 -- 172.21.15.103:0/4134208452 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5750020030 con 0x7f575815be30 2024-09-10T22:43:50.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.378+0000 7f5755600640 1 --2- 172.21.15.103:0/4134208452 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f57380725e0 0x7f5738074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:43:50.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.378+0000 7f5755600640 1 -- 172.21.15.103:0/4134208452 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f5750093e50 con 0x7f575815be30 2024-09-10T22:43:50.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.378+0000 7f575d600640 1 --2- 172.21.15.103:0/4134208452 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f57380725e0 0x7f5738074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:43:50.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.378+0000 7f575d600640 1 --2- 172.21.15.103:0/4134208452 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f57380725e0 0x7f5738074aa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5758154e50 tx=0x7f574c0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:43:50.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.382+0000 7f5755600640 1 -- 172.21.15.103:0/4134208452 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f575005ed40 con 0x7f575815be30 2024-09-10T22:43:50.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.582+0000 7f5760000640 1 -- 172.21.15.103:0/4134208452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5758069640 con 0x7f575815be30 2024-09-10T22:43:50.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.582+0000 7f5755600640 1 -- 172.21.15.103:0/4134208452 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5269 (secure 0 0 0) 0x7f5750063770 con 0x7f575815be30 2024-09-10T22:43:50.585 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:43:50.585 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":77,"btime":"2024-09-10T22:43:49:022788+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6047,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/2402286786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2402286786},{"type":"v1","addr":"172.21.15.103:6834","nonce":2402286786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:43:33.337095+0000","modified":"2024-09-10T22:43:49.022783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6873,"mds_1":6592,"mds_2":6053},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6053":{"gid":6053,"name":"b","rank":2,"incarnation":76,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6837/4254729752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":4254729752},{"type":"v1","addr":"172.21.15.131:6837","nonce":4254729752}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6592":{"gid":6592,"name":"d","rank":1,"incarnation":74,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6836/134240629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":134240629},{"type":"v1","addr":"172.21.15.131:6836","nonce":134240629}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6873":{"gid":6873,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/249667943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":249667943},{"type":"v1","addr":"172.21.15.103:6835","nonce":249667943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6873,"qdb_cluster":[6053,6592,6873]},"id":5}]} 2024-09-10T22:43:50.585 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 77 2024-09-10T22:43:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.582+0000 7f5760000640 1 -- 172.21.15.103:0/4134208452 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f57380725e0 msgr2=0x7f5738074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.582+0000 7f5760000640 1 --2- 172.21.15.103:0/4134208452 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f57380725e0 0x7f5738074aa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5758154e50 tx=0x7f574c0091e0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.582+0000 7f5760000640 1 -- 172.21.15.103:0/4134208452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f575815be30 msgr2=0x7f5758150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:43:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.582+0000 7f5760000640 1 --2- 172.21.15.103:0/4134208452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f575815be30 0x7f5758150d80 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f575000eab0 tx=0x7f575000ef70 comp rx=0 tx=0).stop 2024-09-10T22:43:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.582+0000 7f5760000640 1 -- 172.21.15.103:0/4134208452 shutdown_connections 2024-09-10T22:43:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.582+0000 7f5760000640 1 --2- 172.21.15.103:0/4134208452 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f57380725e0 0x7f5738074aa0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.582+0000 7f5760000640 1 --2- 172.21.15.103:0/4134208452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f575815be30 0x7f5758150d80 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.582+0000 7f5760000640 1 --2- 172.21.15.103:0/4134208452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57580ceb40 0x7f57580b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.582+0000 7f5760000640 1 --2- 172.21.15.103:0/4134208452 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57580b09c0 0x7f57580c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:43:50.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.582+0000 7f5760000640 1 -- 172.21.15.103:0/4134208452 >> 172.21.15.103:0/4134208452 conn(0x7f57580d1ac0 msgr2=0x7f57580d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:43:50.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.582+0000 7f5760000640 1 -- 172.21.15.103:0/4134208452 shutdown_connections 2024-09-10T22:43:50.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:43:50.582+0000 7f5760000640 1 -- 172.21.15.103:0/4134208452 wait complete. 2024-09-10T22:43:50.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:43:50.607 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-10T22:43:50.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:43:50.636 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-10T22:43:50.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:43:50.698 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2024-09-10T22:43:50.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:43:50.750 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2024-09-10T22:43:50.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:43:50.802 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2024-09-10T22:43:50.854 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:43:51.052 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:43:51.053 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:43:51.053 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:43:53.054 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:43:53.218 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:43:53.219 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:43:53.219 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:43:55.220 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:43:55.388 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:43:55.388 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:43:55.388 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:43:57.390 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:43:57.557 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:43:57.557 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:43:57.558 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:43:59.559 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:43:59.726 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}}] 2024-09-10T22:43:59.727 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:43:59.727 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:44:01.728 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:44:01.895 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2024-09-10T22:44:01.896 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-10T22:44:01.896 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:44:01.897 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-10T22:44:02.064 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-10T22:44:02.065 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:44:02.065 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:44:04.066 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-10T22:44:04.231 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-10T22:44:04.232 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:44:04.232 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:44:06.233 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-10T22:44:06.400 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2024-09-10T22:44:06.401 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-10T22:44:06.401 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:44:06.402 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-09-10T22:44:06.557 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-10T22:44:06.558 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:44:06.558 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:44:06.558 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 flush journal 2024-09-10T22:44:06.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8227e00640 1 -- 172.21.15.103:0/3495123070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82280714d0 msgr2=0x7f82280affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:06.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8227e00640 1 --2- 172.21.15.103:0/3495123070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82280714d0 0x7f82280affd0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f8210009840 tx=0x7f821001c790 comp rx=0 tx=0).stop 2024-09-10T22:44:06.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8227e00640 1 -- 172.21.15.103:0/3495123070 shutdown_connections 2024-09-10T22:44:06.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8227e00640 1 --2- 172.21.15.103:0/3495123070 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82280b0510 0x7f8228070430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8227e00640 1 --2- 172.21.15.103:0/3495123070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82280714d0 0x7f82280affd0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8227e00640 1 -- 172.21.15.103:0/3495123070 >> 172.21.15.103:0/3495123070 conn(0x7f82280d18f0 msgr2=0x7f82280d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:06.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8227e00640 1 -- 172.21.15.103:0/3495123070 shutdown_connections 2024-09-10T22:44:06.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8227e00640 1 -- 172.21.15.103:0/3495123070 wait complete. 2024-09-10T22:44:06.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8227e00640 1 Processor -- start 2024-09-10T22:44:06.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8227e00640 1 -- start start 2024-09-10T22:44:06.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8227e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82280714d0 0x7f822814af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8227e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82280b0510 0x7f8228154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8227e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f822815f0e0 0x7f8228154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8227e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8228168ad0 con 0x7f82280714d0 2024-09-10T22:44:06.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8227e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8228168950 con 0x7f822815f0e0 2024-09-10T22:44:06.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8227e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8228168c50 con 0x7f82280b0510 2024-09-10T22:44:06.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8226a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82280714d0 0x7f822814af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8226a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82280714d0 0x7f822814af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51960/0 (socket says 172.21.15.103:51960) 2024-09-10T22:44:06.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8226a00640 1 -- 172.21.15.103:0/754582388 learned_addr learned my addr 172.21.15.103:0/754582388 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:06.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f821e000640 1 --2- 172.21.15.103:0/754582388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82280b0510 0x7f8228154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.710+0000 7f8227400640 1 --2- 172.21.15.103:0/754582388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f822815f0e0 0x7f8228154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.714+0000 7f8226a00640 1 -- 172.21.15.103:0/754582388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82280b0510 msgr2=0x7f8228154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:06.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.714+0000 7f8226a00640 1 --2- 172.21.15.103:0/754582388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82280b0510 0x7f8228154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.714+0000 7f8226a00640 1 -- 172.21.15.103:0/754582388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f822815f0e0 msgr2=0x7f8228154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:06.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.714+0000 7f8226a00640 1 --2- 172.21.15.103:0/754582388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f822815f0e0 0x7f8228154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.714+0000 7f8226a00640 1 -- 172.21.15.103:0/754582388 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822814b450 con 0x7f82280714d0 2024-09-10T22:44:06.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.714+0000 7f8226a00640 1 --2- 172.21.15.103:0/754582388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82280714d0 0x7f822814af10 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f821800c430 tx=0x7f821800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:06.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.714+0000 7f821f400640 1 -- 172.21.15.103:0/754582388 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218011790 con 0x7f82280714d0 2024-09-10T22:44:06.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.714+0000 7f821f400640 1 -- 172.21.15.103:0/754582388 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8218017070 con 0x7f82280714d0 2024-09-10T22:44:06.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.714+0000 7f821f400640 1 -- 172.21.15.103:0/754582388 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218011ce0 con 0x7f82280714d0 2024-09-10T22:44:06.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.714+0000 7f8227e00640 1 -- 172.21.15.103:0/754582388 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82280b5d30 con 0x7f82280714d0 2024-09-10T22:44:06.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.714+0000 7f8227e00640 1 -- 172.21.15.103:0/754582388 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82280b62f0 con 0x7f82280714d0 2024-09-10T22:44:06.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.714+0000 7f821f400640 1 -- 172.21.15.103:0/754582388 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f821801c460 con 0x7f82280714d0 2024-09-10T22:44:06.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.714+0000 7f821f400640 1 --2- 172.21.15.103:0/754582388 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f82040725e0 0x7f8204074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.714+0000 7f821f400640 1 -- 172.21.15.103:0/754582388 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f82180930a0 con 0x7f82280714d0 2024-09-10T22:44:06.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8230d98000 1 Processor -- start 2024-09-10T22:44:06.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8230d98000 1 -- start start 2024-09-10T22:44:06.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f821e000640 1 --2- 172.21.15.103:0/754582388 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f82040725e0 0x7f8204074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8230d98000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194c1a0 0x55d48194c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8230d98000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d48194cac0 0x55d481902680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f821e000640 1 --2- 172.21.15.103:0/754582388 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f82040725e0 0x7f8204074aa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f82100af000 tx=0x7f821001afd0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:06.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8230d98000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d481902bc0 0x55d481902fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8230d98000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d4817eacb0 con 0x55d48194cac0 2024-09-10T22:44:06.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8230d98000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d481700310 con 0x55d481902bc0 2024-09-10T22:44:06.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8230d98000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55d48175db90 con 0x55d48194c1a0 2024-09-10T22:44:06.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f821e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d48194cac0 0x55d481902680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8226a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194c1a0 0x55d48194c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f821e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d48194cac0 0x55d481902680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51974/0 (socket says 172.21.15.103:51974) 2024-09-10T22:44:06.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f821e000640 1 -- 172.21.15.103:0/305623895 learned_addr learned my addr 172.21.15.103:0/305623895 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:06.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8227400640 1 --2- 172.21.15.103:0/305623895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d481902bc0 0x55d481902fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f821e000640 1 -- 172.21.15.103:0/305623895 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194c1a0 msgr2=0x55d48194c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:06.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f821e000640 1 --2- 172.21.15.103:0/305623895 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194c1a0 0x55d48194c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f821e000640 1 -- 172.21.15.103:0/305623895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d481902bc0 msgr2=0x55d481902fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:06.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f821e000640 1 --2- 172.21.15.103:0/305623895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d481902bc0 0x55d481902fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f821e000640 1 -- 172.21.15.103:0/305623895 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d481701c60 con 0x55d48194cac0 2024-09-10T22:44:06.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f821e000640 1 --2- 172.21.15.103:0/305623895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d48194cac0 0x55d481902680 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f8210009600 tx=0x7f82100b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94bab2948798859 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:06.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8217400640 1 -- 172.21.15.103:0/305623895 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82100c7070 con 0x55d48194cac0 2024-09-10T22:44:06.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8217400640 1 -- 172.21.15.103:0/305623895 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8210003a30 con 0x55d48194cac0 2024-09-10T22:44:06.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8217400640 1 -- 172.21.15.103:0/305623895 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82100b2040 con 0x55d48194cac0 2024-09-10T22:44:06.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8230d98000 1 -- 172.21.15.103:0/305623895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d48194cac0 msgr2=0x55d481902680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:06.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8230d98000 1 --2- 172.21.15.103:0/305623895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d48194cac0 0x55d481902680 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f8210009600 tx=0x7f82100b7000 comp rx=0 tx=0).stop 2024-09-10T22:44:06.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8230d98000 1 -- 172.21.15.103:0/305623895 shutdown_connections 2024-09-10T22:44:06.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8230d98000 1 --2- 172.21.15.103:0/305623895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d481902bc0 0x55d481902fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8230d98000 1 --2- 172.21.15.103:0/305623895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d48194cac0 0x55d481902680 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8230d98000 1 --2- 172.21.15.103:0/305623895 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194c1a0 0x55d48194c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8230d98000 1 -- 172.21.15.103:0/305623895 >> 172.21.15.103:0/305623895 conn(0x55d481908d20 msgr2=0x55d481900f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:06.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8230d98000 1 -- 172.21.15.103:0/305623895 shutdown_connections 2024-09-10T22:44:06.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8230d98000 1 -- 172.21.15.103:0/305623895 wait complete. 2024-09-10T22:44:06.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.718+0000 7f8230d98000 1 -- start start 2024-09-10T22:44:06.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8230d98000 1 Processor -- start 2024-09-10T22:44:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8230d98000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d481902bc0 0x55d481953530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8230d98000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194c1a0 0x55d481953a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8230d98000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48194cac0 0x55d481953fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8230d98000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d481750dd0 con 0x55d481902bc0 2024-09-10T22:44:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8230d98000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d48174cfc0 con 0x55d48194cac0 2024-09-10T22:44:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8230d98000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55d4816f24b0 con 0x55d48194c1a0 2024-09-10T22:44:06.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8230d98000 10 client.0 _ll_register_callbacks cb 0x55d4816d07d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:06.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8226a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d481902bc0 0x55d481953530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8226a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d481902bc0 0x55d481953530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51976/0 (socket says 172.21.15.103:51976) 2024-09-10T22:44:06.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8226a00640 1 -- 172.21.15.103:0/1929781429 learned_addr learned my addr 172.21.15.103:0/1929781429 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:06.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8227400640 1 --2- 172.21.15.103:0/1929781429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48194cac0 0x55d481953fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f821e000640 1 --2- 172.21.15.103:0/1929781429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194c1a0 0x55d481953a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8226a00640 1 -- 172.21.15.103:0/1929781429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194c1a0 msgr2=0x55d481953a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:06.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8226a00640 1 --2- 172.21.15.103:0/1929781429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194c1a0 0x55d481953a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8226a00640 1 -- 172.21.15.103:0/1929781429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48194cac0 msgr2=0x55d481953fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:06.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8226a00640 1 --2- 172.21.15.103:0/1929781429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48194cac0 0x55d481953fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8226a00640 1 -- 172.21.15.103:0/1929781429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4816eb1f0 con 0x55d481902bc0 2024-09-10T22:44:06.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8226a00640 1 --2- 172.21.15.103:0/1929781429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d481902bc0 0x55d481953530 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f82180913a0 tx=0x7f821805deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f315c758696e6d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:06.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f820be00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:06.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f820be00640 1 -- 172.21.15.103:0/1929781429 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218067410 con 0x55d481902bc0 2024-09-10T22:44:06.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f820be00640 1 -- 172.21.15.103:0/1929781429 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f821808bd80 con 0x55d481902bc0 2024-09-10T22:44:06.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8230d98000 1 -- 172.21.15.103:0/1929781429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d4816e5330 con 0x55d481902bc0 2024-09-10T22:44:06.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f820be00640 1 -- 172.21.15.103:0/1929781429 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f821805d220 con 0x55d481902bc0 2024-09-10T22:44:06.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8230d98000 10 client.7137 fetch_fsmap learned FSMap version 79 2024-09-10T22:44:06.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8230d98000 1 -- 172.21.15.103:0/1929781429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x55d4816d1fa0 con 0x55d481902bc0 2024-09-10T22:44:06.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f820be00640 1 -- 172.21.15.103:0/1929781429 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55d4816e5330 con 0x55d481902bc0 2024-09-10T22:44:06.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f820be00640 1 -- 172.21.15.103:0/1929781429 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 79) ==== 3554+0+0 (secure 0 0 0) 0x7f8218086070 con 0x55d481902bc0 2024-09-10T22:44:06.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8230d98000 10 client.7137 fetch_fsmap finished waiting for FSMap version 79 2024-09-10T22:44:06.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8230d98000 10 client.7137 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-10T22:44:06.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8230d98000 20 client.7137 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:06.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8230d98000 1 --2- 172.21.15.103:0/1929781429 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x55d48195b900 0x55d48195dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8230d98000 4 client.7137 mds_command: new command op to 6873 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:06.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f8230d98000 1 -- 172.21.15.103:0/1929781429 --> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d48175fae0 con 0x55d48195b900 2024-09-10T22:44:06.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f821e000640 1 --2- 172.21.15.103:0/1929781429 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x55d48195b900 0x55d48195dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f821e000640 1 --2- 172.21.15.103:0/1929781429 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x55d48195b900 0x55d48195dcf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56606b7a4ee0201c server_cookie=b91e083be0e7e06b in_seq=0 out_seq=0 2024-09-10T22:44:06.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.722+0000 7f820be00640 10 client.7137 ms_handle_connect on v2:172.21.15.103:6833/249667943 2024-09-10T22:44:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.726+0000 7f820be00640 1 -- 172.21.15.103:0/1929781429 <== mds.0 v2:172.21.15.103:6833/249667943 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d48175fae0 con 0x55d48195b900 2024-09-10T22:44:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.726+0000 7f820be00640 10 client.7137 handle_command_reply: tid=0 2024-09-10T22:44:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.726+0000 7f8230d98000 1 client.7137 shutdown 2024-09-10T22:44:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.726+0000 7f8230d98000 1 -- 172.21.15.103:0/1929781429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d481902bc0 msgr2=0x55d481953530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.726+0000 7f8230d98000 1 --2- 172.21.15.103:0/1929781429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d481902bc0 0x55d481953530 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f82180913a0 tx=0x7f821805deb0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.726+0000 7f8230d98000 1 -- 172.21.15.103:0/1929781429 shutdown_connections 2024-09-10T22:44:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.726+0000 7f8230d98000 1 --2- 172.21.15.103:0/1929781429 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x55d48195b900 0x55d48195dcf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.726+0000 7f8230d98000 1 --2- 172.21.15.103:0/1929781429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48194cac0 0x55d481953fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.726+0000 7f8230d98000 1 --2- 172.21.15.103:0/1929781429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194c1a0 0x55d481953a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.726+0000 7f8230d98000 1 --2- 172.21.15.103:0/1929781429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d481902bc0 0x55d481953530 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.726+0000 7f8230d98000 1 -- 172.21.15.103:0/1929781429 >> 172.21.15.103:0/1929781429 conn(0x55d481908d20 msgr2=0x55d481900f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:06.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.726+0000 7f820be00640 0 client.7137 ms_handle_reset on v2:172.21.15.103:6833/249667943 2024-09-10T22:44:06.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.726+0000 7f8230d98000 1 -- 172.21.15.103:0/1929781429 shutdown_connections 2024-09-10T22:44:06.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.726+0000 7f8230d98000 1 -- 172.21.15.103:0/1929781429 wait complete. 2024-09-10T22:44:06.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.726+0000 7f8230d98000 20 client.7137 trim_cache size 0 max 16384 2024-09-10T22:44:06.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.738+0000 7f8230d98000 1 Processor -- start 2024-09-10T22:44:06.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.738+0000 7f8230d98000 1 -- start start 2024-09-10T22:44:06.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d481902bc0 0x55d481902070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d48194c1a0 0x55d4819025b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194cac0 0x55d481956310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8228204130 con 0x55d48194c1a0 2024-09-10T22:44:06.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8228203300 con 0x55d481902bc0 2024-09-10T22:44:06.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8228203a00 con 0x55d48194cac0 2024-09-10T22:44:06.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f821e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d48194c1a0 0x55d4819025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f821e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d48194c1a0 0x55d4819025b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51984/0 (socket says 172.21.15.103:51984) 2024-09-10T22:44:06.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f821e000640 1 -- 172.21.15.103:0/340850052 learned_addr learned my addr 172.21.15.103:0/340850052 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:06.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8226a00640 1 --2- 172.21.15.103:0/340850052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d481902bc0 0x55d481902070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8227400640 1 --2- 172.21.15.103:0/340850052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194cac0 0x55d481956310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f821e000640 1 -- 172.21.15.103:0/340850052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194cac0 msgr2=0x55d481956310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:06.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f821e000640 1 --2- 172.21.15.103:0/340850052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194cac0 0x55d481956310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f821e000640 1 -- 172.21.15.103:0/340850052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d481902bc0 msgr2=0x55d481902070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:06.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f821e000640 1 --2- 172.21.15.103:0/340850052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d481902bc0 0x55d481902070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f821e000640 1 -- 172.21.15.103:0/340850052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4817aa660 con 0x55d48194c1a0 2024-09-10T22:44:06.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8226a00640 1 --2- 172.21.15.103:0/340850052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d481902bc0 0x55d481902070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:06.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f821e000640 1 --2- 172.21.15.103:0/340850052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d48194c1a0 0x55d4819025b0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f821001cc70 tx=0x7f82100091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb0b5eb182e32c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:06.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8216a00640 1 -- 172.21.15.103:0/340850052 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82100c7040 con 0x55d48194c1a0 2024-09-10T22:44:06.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8216a00640 1 -- 172.21.15.103:0/340850052 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8210003bd0 con 0x55d48194c1a0 2024-09-10T22:44:06.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8216a00640 1 -- 172.21.15.103:0/340850052 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82100b2040 con 0x55d48194c1a0 2024-09-10T22:44:06.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 -- 172.21.15.103:0/340850052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d48194c1a0 msgr2=0x55d4819025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:06.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 --2- 172.21.15.103:0/340850052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d48194c1a0 0x55d4819025b0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f821001cc70 tx=0x7f82100091e0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 -- 172.21.15.103:0/340850052 shutdown_connections 2024-09-10T22:44:06.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 --2- 172.21.15.103:0/340850052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194cac0 0x55d481956310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 --2- 172.21.15.103:0/340850052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d48194c1a0 0x55d4819025b0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 --2- 172.21.15.103:0/340850052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d481902bc0 0x55d481902070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 -- 172.21.15.103:0/340850052 >> 172.21.15.103:0/340850052 conn(0x55d481908d20 msgr2=0x55d481901960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:06.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 -- 172.21.15.103:0/340850052 shutdown_connections 2024-09-10T22:44:06.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 -- 172.21.15.103:0/340850052 wait complete. 2024-09-10T22:44:06.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 -- start start 2024-09-10T22:44:06.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 Processor -- start 2024-09-10T22:44:06.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d481902bc0 0x55d481958fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48194c1a0 0x55d481959500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.742+0000 7f8230d98000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194cac0 0x55d48197e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8230d98000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d48190bd40 con 0x55d481902bc0 2024-09-10T22:44:06.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8230d98000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d481909100 con 0x55d48194c1a0 2024-09-10T22:44:06.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8230d98000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55d481747ec0 con 0x55d48194cac0 2024-09-10T22:44:06.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8230d98000 10 client.0 _ll_register_callbacks cb 0x7f821805d910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:06.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8226a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d481902bc0 0x55d481958fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8226a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d481902bc0 0x55d481958fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51996/0 (socket says 172.21.15.103:51996) 2024-09-10T22:44:06.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8226a00640 1 -- 172.21.15.103:0/3925647132 learned_addr learned my addr 172.21.15.103:0/3925647132 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:06.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f821e000640 1 --2- 172.21.15.103:0/3925647132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48194c1a0 0x55d481959500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8227400640 1 --2- 172.21.15.103:0/3925647132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194cac0 0x55d48197e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8226a00640 1 -- 172.21.15.103:0/3925647132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194cac0 msgr2=0x55d48197e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:06.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8226a00640 1 --2- 172.21.15.103:0/3925647132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194cac0 0x55d48197e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8226a00640 1 -- 172.21.15.103:0/3925647132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48194c1a0 msgr2=0x55d481959500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:06.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8226a00640 1 --2- 172.21.15.103:0/3925647132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48194c1a0 0x55d481959500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8226a00640 1 -- 172.21.15.103:0/3925647132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d481717090 con 0x55d481902bc0 2024-09-10T22:44:06.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f821e000640 1 --2- 172.21.15.103:0/3925647132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48194c1a0 0x55d481959500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:44:06.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8226a00640 1 --2- 172.21.15.103:0/3925647132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d481902bc0 0x55d481958fc0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f821805d780 tx=0x7f8218059b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfb7712c4a08971 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:06.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f820be00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:06.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f820be00640 1 -- 172.21.15.103:0/3925647132 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821808a2f0 con 0x55d481902bc0 2024-09-10T22:44:06.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f820be00640 1 -- 172.21.15.103:0/3925647132 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f8218059c30 con 0x55d481902bc0 2024-09-10T22:44:06.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8230d98000 1 -- 172.21.15.103:0/3925647132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8210003bd0 con 0x55d481902bc0 2024-09-10T22:44:06.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f820be00640 1 -- 172.21.15.103:0/3925647132 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f8218067410 con 0x55d481902bc0 2024-09-10T22:44:06.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8230d98000 10 client.7143 fetch_fsmap learned FSMap version 79 2024-09-10T22:44:06.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8230d98000 1 -- 172.21.15.103:0/3925647132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x55d4816e35f0 con 0x55d481902bc0 2024-09-10T22:44:06.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f820be00640 1 -- 172.21.15.103:0/3925647132 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8210003bd0 con 0x55d481902bc0 2024-09-10T22:44:06.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f820be00640 1 -- 172.21.15.103:0/3925647132 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 79) ==== 3554+0+0 (secure 0 0 0) 0x7f8218077ce0 con 0x55d481902bc0 2024-09-10T22:44:06.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8230d98000 10 client.7143 fetch_fsmap finished waiting for FSMap version 79 2024-09-10T22:44:06.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8230d98000 10 client.7143 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-10T22:44:06.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8230d98000 20 client.7143 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:06.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8230d98000 1 --2- 172.21.15.103:0/3925647132 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x55d48197ec00 0x55d4819c1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8230d98000 4 client.7143 mds_command: new command op to 6873 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:44:06.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f8230d98000 1 -- 172.21.15.103:0/3925647132 --> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d48175b590 con 0x55d48197ec00 2024-09-10T22:44:06.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f821e000640 1 --2- 172.21.15.103:0/3925647132 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x55d48197ec00 0x55d4819c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f821e000640 1 --2- 172.21.15.103:0/3925647132 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x55d48197ec00 0x55d4819c1640 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a94de7cbce45f2e server_cookie=49a02758bc6efb33 in_seq=0 out_seq=0 2024-09-10T22:44:06.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.746+0000 7f820be00640 10 client.7143 ms_handle_connect on v2:172.21.15.103:6833/249667943 2024-09-10T22:44:06.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.762+0000 7f820be00640 1 -- 172.21.15.103:0/3925647132 <== mds.0 v2:172.21.15.103:6833/249667943 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d48175b590 con 0x55d48197ec00 2024-09-10T22:44:06.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.762+0000 7f820be00640 10 client.7143 handle_command_reply: tid=0 2024-09-10T22:44:06.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.762+0000 7f8230d98000 1 client.7143 shutdown 2024-09-10T22:44:06.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.762+0000 7f8230d98000 1 -- 172.21.15.103:0/3925647132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d481902bc0 msgr2=0x55d481958fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:06.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.762+0000 7f8230d98000 1 --2- 172.21.15.103:0/3925647132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d481902bc0 0x55d481958fc0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f821805d780 tx=0x7f8218059b40 comp rx=0 tx=0).stop 2024-09-10T22:44:06.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.762+0000 7f8230d98000 1 -- 172.21.15.103:0/3925647132 shutdown_connections 2024-09-10T22:44:06.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.762+0000 7f8230d98000 1 --2- 172.21.15.103:0/3925647132 >> [v2:172.21.15.103:6833/249667943,v1:172.21.15.103:6835/249667943] conn(0x55d48197ec00 0x55d4819c1640 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.762+0000 7f8230d98000 1 --2- 172.21.15.103:0/3925647132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d48194cac0 0x55d48197e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.762+0000 7f8230d98000 1 --2- 172.21.15.103:0/3925647132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48194c1a0 0x55d481959500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.762+0000 7f8230d98000 1 --2- 172.21.15.103:0/3925647132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d481902bc0 0x55d481958fc0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.762+0000 7f820be00640 0 client.7143 ms_handle_reset on v2:172.21.15.103:6833/249667943 2024-09-10T22:44:06.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.762+0000 7f8230d98000 1 -- 172.21.15.103:0/3925647132 >> 172.21.15.103:0/3925647132 conn(0x55d481908d20 msgr2=0x55d481902180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:06.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.762+0000 7f8230d98000 1 -- 172.21.15.103:0/3925647132 shutdown_connections 2024-09-10T22:44:06.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.762+0000 7f8230d98000 1 -- 172.21.15.103:0/3925647132 wait complete. 2024-09-10T22:44:06.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.762+0000 7f8230d98000 20 client.7143 trim_cache size 0 max 16384 2024-09-10T22:44:06.769 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:44:06.769 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:44:06.769 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:44:06.769 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:44:06.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.766+0000 7f8227e00640 1 -- 172.21.15.103:0/754582388 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f82040725e0 msgr2=0x7f8204074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:06.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.766+0000 7f8227e00640 1 --2- 172.21.15.103:0/754582388 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f82040725e0 0x7f8204074aa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f82100af000 tx=0x7f821001afd0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.766+0000 7f8227e00640 1 -- 172.21.15.103:0/754582388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82280714d0 msgr2=0x7f822814af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:06.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.766+0000 7f8227e00640 1 --2- 172.21.15.103:0/754582388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82280714d0 0x7f822814af10 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f821800c430 tx=0x7f821800c8f0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.766+0000 7f8227e00640 1 -- 172.21.15.103:0/754582388 shutdown_connections 2024-09-10T22:44:06.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.766+0000 7f8227e00640 1 --2- 172.21.15.103:0/754582388 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f82040725e0 0x7f8204074aa0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.766+0000 7f8227e00640 1 --2- 172.21.15.103:0/754582388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f822815f0e0 0x7f8228154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.766+0000 7f8227e00640 1 --2- 172.21.15.103:0/754582388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82280b0510 0x7f8228154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.766+0000 7f8227e00640 1 --2- 172.21.15.103:0/754582388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82280714d0 0x7f822814af10 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.766+0000 7f8227e00640 1 -- 172.21.15.103:0/754582388 >> 172.21.15.103:0/754582388 conn(0x7f82280d18f0 msgr2=0x7f822815d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:06.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.766+0000 7f8227e00640 1 -- 172.21.15.103:0/754582388 shutdown_connections 2024-09-10T22:44:06.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.766+0000 7f8227e00640 1 -- 172.21.15.103:0/754582388 wait complete. 2024-09-10T22:44:06.787 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:1 flush journal 2024-09-10T22:44:06.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.926+0000 7fed99400640 1 -- 172.21.15.103:0/240744256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed9415be30 msgr2=0x7fed940ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:06.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.926+0000 7fed99400640 1 --2- 172.21.15.103:0/240744256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed9415be30 0x7fed940ce0c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fed84009840 tx=0x7fed8401c790 comp rx=0 tx=0).stop 2024-09-10T22:44:06.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.926+0000 7fed99400640 1 -- 172.21.15.103:0/240744256 shutdown_connections 2024-09-10T22:44:06.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.926+0000 7fed99400640 1 --2- 172.21.15.103:0/240744256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed9415be30 0x7fed940ce0c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.926+0000 7fed99400640 1 -- 172.21.15.103:0/240744256 >> 172.21.15.103:0/240744256 conn(0x7fed940d1ac0 msgr2=0x7fed940d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:06.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.926+0000 7fed99400640 1 -- 172.21.15.103:0/240744256 shutdown_connections 2024-09-10T22:44:06.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.926+0000 7fed99400640 1 -- 172.21.15.103:0/240744256 wait complete. 2024-09-10T22:44:06.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed99400640 1 Processor -- start 2024-09-10T22:44:06.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed99400640 1 -- start start 2024-09-10T22:44:06.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed99400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed940ae9c0 0x7fed940c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed99400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed940b09c0 0x7fed940c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed99400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed9415be30 0x7fed9414e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed99400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fed94169e50 con 0x7fed9415be30 2024-09-10T22:44:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed99400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fed94169cd0 con 0x7fed940ae9c0 2024-09-10T22:44:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed99400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fed94169fd0 con 0x7fed940b09c0 2024-09-10T22:44:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed93200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed9415be30 0x7fed9414e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed93200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed9415be30 0x7fed9414e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52010/0 (socket says 172.21.15.103:52010) 2024-09-10T22:44:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed93200640 1 -- 172.21.15.103:0/3313586706 learned_addr learned my addr 172.21.15.103:0/3313586706 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed92800640 1 --2- 172.21.15.103:0/3313586706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed940ae9c0 0x7fed940c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed91e00640 1 --2- 172.21.15.103:0/3313586706 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed940b09c0 0x7fed940c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed93200640 1 -- 172.21.15.103:0/3313586706 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed940b09c0 msgr2=0x7fed940c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed93200640 1 --2- 172.21.15.103:0/3313586706 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed940b09c0 0x7fed940c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed93200640 1 -- 172.21.15.103:0/3313586706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed940ae9c0 msgr2=0x7fed940c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed93200640 1 --2- 172.21.15.103:0/3313586706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed940ae9c0 0x7fed940c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed93200640 1 -- 172.21.15.103:0/3313586706 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed940cb9e0 con 0x7fed9415be30 2024-09-10T22:44:06.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed93200640 1 --2- 172.21.15.103:0/3313586706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed9415be30 0x7fed9414e460 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00cbc0 tx=0x7fed8c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:06.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed8aa00640 1 -- 172.21.15.103:0/3313586706 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c016020 con 0x7fed9415be30 2024-09-10T22:44:06.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed8aa00640 1 -- 172.21.15.103:0/3313586706 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed8c00ab00 con 0x7fed9415be30 2024-09-10T22:44:06.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed8aa00640 1 -- 172.21.15.103:0/3313586706 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c012420 con 0x7fed9415be30 2024-09-10T22:44:06.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed99400640 1 -- 172.21.15.103:0/3313586706 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed940c63a0 con 0x7fed9415be30 2024-09-10T22:44:06.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.930+0000 7fed99400640 1 -- 172.21.15.103:0/3313586706 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed941f8e90 con 0x7fed9415be30 2024-09-10T22:44:06.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed8aa00640 1 -- 172.21.15.103:0/3313586706 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fed8c0125c0 con 0x7fed9415be30 2024-09-10T22:44:06.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed8aa00640 1 --2- 172.21.15.103:0/3313586706 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fed740725e0 0x7fed74074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed9c867000 1 Processor -- start 2024-09-10T22:44:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed8aa00640 1 -- 172.21.15.103:0/3313586706 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fed8c0938b0 con 0x7fed9415be30 2024-09-10T22:44:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed9c867000 1 -- start start 2024-09-10T22:44:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed92800640 1 --2- 172.21.15.103:0/3313586706 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fed740725e0 0x7fed74074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed9c867000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c70d600 0x56394c70d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed9c867000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c70df20 0x56394c6c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed9c867000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c6c3fd0 0x56394c6c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed9c867000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56394c5a7cb0 con 0x56394c6c3fd0 2024-09-10T22:44:06.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed9c867000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56394c4bd310 con 0x56394c70df20 2024-09-10T22:44:06.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed9c867000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56394c51ab90 con 0x56394c70d600 2024-09-10T22:44:06.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed92800640 1 --2- 172.21.15.103:0/3313586706 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fed740725e0 0x7fed74074aa0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fed840af000 tx=0x7fed8401afd0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:06.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed92800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c70d600 0x56394c70d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed93200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c6c3fd0 0x56394c6c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed91e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c70df20 0x56394c6c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed92800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c70d600 0x56394c70d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:53272/0 (socket says 172.21.15.103:53272) 2024-09-10T22:44:06.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed92800640 1 -- 172.21.15.103:0/2855416042 learned_addr learned my addr 172.21.15.103:0/2855416042 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:06.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.934+0000 7fed93200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c6c3fd0 0x56394c6c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52022/0 (socket says 172.21.15.103:52022) 2024-09-10T22:44:06.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed91e00640 1 -- 172.21.15.103:0/2855416042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c70d600 msgr2=0x56394c70d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:06.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed91e00640 1 --2- 172.21.15.103:0/2855416042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c70d600 0x56394c70d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed91e00640 1 -- 172.21.15.103:0/2855416042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c6c3fd0 msgr2=0x56394c6c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:06.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed91e00640 1 --2- 172.21.15.103:0/2855416042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c6c3fd0 0x56394c6c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed91e00640 1 -- 172.21.15.103:0/2855416042 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56394c4bec60 con 0x56394c70df20 2024-09-10T22:44:06.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed93200640 1 --2- 172.21.15.103:0/2855416042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c6c3fd0 0x56394c6c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:44:06.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed91e00640 1 --2- 172.21.15.103:0/2855416042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c70df20 0x56394c6c3a90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fed94151740 tx=0x7fed80007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db540cec68ec3354 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:06.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed7f400640 1 -- 172.21.15.103:0/2855416042 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed800052e0 con 0x56394c70df20 2024-09-10T22:44:06.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed7f400640 1 -- 172.21.15.103:0/2855416042 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed80018070 con 0x56394c70df20 2024-09-10T22:44:06.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed7f400640 1 -- 172.21.15.103:0/2855416042 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8000f980 con 0x56394c70df20 2024-09-10T22:44:06.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed9c867000 1 -- 172.21.15.103:0/2855416042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c70df20 msgr2=0x56394c6c3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:06.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed9c867000 1 --2- 172.21.15.103:0/2855416042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c70df20 0x56394c6c3a90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fed94151740 tx=0x7fed80007e00 comp rx=0 tx=0).stop 2024-09-10T22:44:06.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed9c867000 1 -- 172.21.15.103:0/2855416042 shutdown_connections 2024-09-10T22:44:06.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed9c867000 1 --2- 172.21.15.103:0/2855416042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c6c3fd0 0x56394c6c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed9c867000 1 --2- 172.21.15.103:0/2855416042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c70df20 0x56394c6c3a90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed9c867000 1 --2- 172.21.15.103:0/2855416042 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c70d600 0x56394c70d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed9c867000 1 -- 172.21.15.103:0/2855416042 >> 172.21.15.103:0/2855416042 conn(0x56394c6c5d20 msgr2=0x56394c6bdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:06.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed9c867000 1 -- 172.21.15.103:0/2855416042 shutdown_connections 2024-09-10T22:44:06.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed9c867000 1 -- 172.21.15.103:0/2855416042 wait complete. 2024-09-10T22:44:06.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed9c867000 1 -- start start 2024-09-10T22:44:06.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed9c867000 1 Processor -- start 2024-09-10T22:44:06.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed9c867000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c6c3fd0 0x56394c6f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed9c867000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70d600 0x56394c6f7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed9c867000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c70df20 0x56394c6f84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed9c867000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56394c50ddd0 con 0x56394c70d600 2024-09-10T22:44:06.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed9c867000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56394c509fc0 con 0x56394c70df20 2024-09-10T22:44:06.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed9c867000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56394c4af4b0 con 0x56394c6c3fd0 2024-09-10T22:44:06.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed9c867000 10 client.0 _ll_register_callbacks cb 0x56394c48d7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:06.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed91e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70d600 0x56394c6f7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed91e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70d600 0x56394c6f7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52038/0 (socket says 172.21.15.103:52038) 2024-09-10T22:44:06.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.938+0000 7fed91e00640 1 -- 172.21.15.103:0/1943614197 learned_addr learned my addr 172.21.15.103:0/1943614197 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:06.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed92800640 1 --2- 172.21.15.103:0/1943614197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c6c3fd0 0x56394c6f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed93200640 1 --2- 172.21.15.103:0/1943614197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c70df20 0x56394c6f84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed91e00640 1 -- 172.21.15.103:0/1943614197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c6c3fd0 msgr2=0x56394c6f7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:06.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed91e00640 1 --2- 172.21.15.103:0/1943614197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c6c3fd0 0x56394c6f7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed91e00640 1 -- 172.21.15.103:0/1943614197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c70df20 msgr2=0x56394c6f84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:06.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed91e00640 1 --2- 172.21.15.103:0/1943614197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c70df20 0x56394c6f84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed91e00640 1 -- 172.21.15.103:0/1943614197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56394c4a81f0 con 0x56394c70d600 2024-09-10T22:44:06.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed92800640 1 --2- 172.21.15.103:0/1943614197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c6c3fd0 0x56394c6f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:06.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed91e00640 1 --2- 172.21.15.103:0/1943614197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70d600 0x56394c6f7f60 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fed80000c10 tx=0x7fed8000fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145ee552f2c8198a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:06.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed73e00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:06.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed73e00640 1 -- 172.21.15.103:0/1943614197 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed800069e0 con 0x56394c70d600 2024-09-10T22:44:06.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed73e00640 1 -- 172.21.15.103:0/1943614197 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fed80006b80 con 0x56394c70d600 2024-09-10T22:44:06.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 1 -- 172.21.15.103:0/1943614197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56394c4a2330 con 0x56394c70d600 2024-09-10T22:44:06.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed73e00640 1 -- 172.21.15.103:0/1943614197 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fed8002a050 con 0x56394c70d600 2024-09-10T22:44:06.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 10 client.7155 fetch_fsmap learned FSMap version 79 2024-09-10T22:44:06.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 1 -- 172.21.15.103:0/1943614197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x56394c48efa0 con 0x56394c70d600 2024-09-10T22:44:06.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed73e00640 1 -- 172.21.15.103:0/1943614197 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56394c4a2330 con 0x56394c70d600 2024-09-10T22:44:06.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed73e00640 1 -- 172.21.15.103:0/1943614197 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 79) ==== 3554+0+0 (secure 0 0 0) 0x7fed8002d020 con 0x56394c70d600 2024-09-10T22:44:06.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 10 client.7155 fetch_fsmap finished waiting for FSMap version 79 2024-09-10T22:44:06.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 10 client.7155 resolve_mds: resolved 5:1 to role '5:1' aka daemon mds.d 2024-09-10T22:44:06.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 20 client.7155 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:06.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 1 --2- 172.21.15.103:0/1943614197 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x56394c6f8eb0 0x56394c71e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 4 client.7155 mds_command: new command op to 6592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:06.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 1 -- 172.21.15.103:0/1943614197 --> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56394c51cae0 con 0x56394c6f8eb0 2024-09-10T22:44:06.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed92800640 1 --2- 172.21.15.103:0/1943614197 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x56394c6f8eb0 0x56394c71e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed92800640 1 --2- 172.21.15.103:0/1943614197 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x56394c6f8eb0 0x56394c71e8b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dd678f057e229baf server_cookie=3b693a6d8551ac64 in_seq=0 out_seq=0 2024-09-10T22:44:06.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed73e00640 10 client.7155 ms_handle_connect on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:06.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed73e00640 1 -- 172.21.15.103:0/1943614197 <== mds.1 v2:172.21.15.131:6834/134240629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56394c51cae0 con 0x56394c6f8eb0 2024-09-10T22:44:06.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed73e00640 10 client.7155 handle_command_reply: tid=0 2024-09-10T22:44:06.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 1 client.7155 shutdown 2024-09-10T22:44:06.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 1 -- 172.21.15.103:0/1943614197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70d600 msgr2=0x56394c6f7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:06.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 1 --2- 172.21.15.103:0/1943614197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70d600 0x56394c6f7f60 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fed80000c10 tx=0x7fed8000fdf0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 1 -- 172.21.15.103:0/1943614197 shutdown_connections 2024-09-10T22:44:06.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 1 --2- 172.21.15.103:0/1943614197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c70df20 0x56394c6f84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 1 --2- 172.21.15.103:0/1943614197 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x56394c6f8eb0 0x56394c71e8b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 1 --2- 172.21.15.103:0/1943614197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70d600 0x56394c6f7f60 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 1 --2- 172.21.15.103:0/1943614197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c6c3fd0 0x56394c6f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed73e00640 0 client.7155 ms_handle_reset on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:06.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 1 -- 172.21.15.103:0/1943614197 >> 172.21.15.103:0/1943614197 conn(0x56394c6c5d20 msgr2=0x56394c6c52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:06.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 1 -- 172.21.15.103:0/1943614197 shutdown_connections 2024-09-10T22:44:06.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.942+0000 7fed9c867000 1 -- 172.21.15.103:0/1943614197 wait complete. 2024-09-10T22:44:06.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.946+0000 7fed9c867000 20 client.7155 trim_cache size 0 max 16384 2024-09-10T22:44:06.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.958+0000 7fed9c867000 1 Processor -- start 2024-09-10T22:44:06.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.958+0000 7fed9c867000 1 -- start start 2024-09-10T22:44:06.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.958+0000 7fed9c867000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c6c3fd0 0x56394c77f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.958+0000 7fed9c867000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70d600 0x56394c77fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c70df20 0x56394c780280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fed942000e0 con 0x56394c70d600 2024-09-10T22:44:06.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fed9406f8d0 con 0x56394c6c3fd0 2024-09-10T22:44:06.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fed940ca6f0 con 0x56394c70df20 2024-09-10T22:44:06.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed91e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70d600 0x56394c77fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed91e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70d600 0x56394c77fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52046/0 (socket says 172.21.15.103:52046) 2024-09-10T22:44:06.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed91e00640 1 -- 172.21.15.103:0/1603263806 learned_addr learned my addr 172.21.15.103:0/1603263806 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:06.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed93200640 1 --2- 172.21.15.103:0/1603263806 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c70df20 0x56394c780280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed92800640 1 --2- 172.21.15.103:0/1603263806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c6c3fd0 0x56394c77f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed91e00640 1 -- 172.21.15.103:0/1603263806 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c70df20 msgr2=0x56394c780280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:06.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed91e00640 1 --2- 172.21.15.103:0/1603263806 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c70df20 0x56394c780280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed91e00640 1 -- 172.21.15.103:0/1603263806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c6c3fd0 msgr2=0x56394c77f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:06.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed91e00640 1 --2- 172.21.15.103:0/1603263806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c6c3fd0 0x56394c77f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed91e00640 1 -- 172.21.15.103:0/1603263806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56394c70dd50 con 0x56394c70d600 2024-09-10T22:44:06.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed91e00640 1 --2- 172.21.15.103:0/1603263806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70d600 0x56394c77fd40 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fed80001060 tx=0x7fed80007b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd71da8885cd2a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:06.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed7ea00640 1 -- 172.21.15.103:0/1603263806 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed800069e0 con 0x56394c70d600 2024-09-10T22:44:06.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed7ea00640 1 -- 172.21.15.103:0/1603263806 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed80021030 con 0x56394c70d600 2024-09-10T22:44:06.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed7ea00640 1 -- 172.21.15.103:0/1603263806 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed80007370 con 0x56394c70d600 2024-09-10T22:44:06.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 -- 172.21.15.103:0/1603263806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70d600 msgr2=0x56394c77fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:06.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 --2- 172.21.15.103:0/1603263806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70d600 0x56394c77fd40 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fed80001060 tx=0x7fed80007b40 comp rx=0 tx=0).stop 2024-09-10T22:44:06.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 -- 172.21.15.103:0/1603263806 shutdown_connections 2024-09-10T22:44:06.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 --2- 172.21.15.103:0/1603263806 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c70df20 0x56394c780280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 --2- 172.21.15.103:0/1603263806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70d600 0x56394c77fd40 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 --2- 172.21.15.103:0/1603263806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c6c3fd0 0x56394c77f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 -- 172.21.15.103:0/1603263806 >> 172.21.15.103:0/1603263806 conn(0x56394c6c5d20 msgr2=0x56394c6bd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:06.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 -- 172.21.15.103:0/1603263806 shutdown_connections 2024-09-10T22:44:06.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 -- 172.21.15.103:0/1603263806 wait complete. 2024-09-10T22:44:06.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 -- start start 2024-09-10T22:44:06.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 Processor -- start 2024-09-10T22:44:06.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c6c3fd0 0x56394c783570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c70d600 0x56394c783ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70df20 0x56394c783ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56394c512400 con 0x56394c70df20 2024-09-10T22:44:06.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56394c4bd310 con 0x56394c6c3fd0 2024-09-10T22:44:06.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56394c509fc0 con 0x56394c70d600 2024-09-10T22:44:06.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed9c867000 10 client.0 _ll_register_callbacks cb 0x7fed8c00cf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:06.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed93200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70df20 0x56394c783ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed93200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70df20 0x56394c783ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52048/0 (socket says 172.21.15.103:52048) 2024-09-10T22:44:06.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.962+0000 7fed93200640 1 -- 172.21.15.103:0/940313609 learned_addr learned my addr 172.21.15.103:0/940313609 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:06.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed91e00640 1 --2- 172.21.15.103:0/940313609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c70d600 0x56394c783ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed92800640 1 --2- 172.21.15.103:0/940313609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c6c3fd0 0x56394c783570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed93200640 1 -- 172.21.15.103:0/940313609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c70d600 msgr2=0x56394c783ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:06.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed93200640 1 --2- 172.21.15.103:0/940313609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c70d600 0x56394c783ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed93200640 1 -- 172.21.15.103:0/940313609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c6c3fd0 msgr2=0x56394c783570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed93200640 1 --2- 172.21.15.103:0/940313609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c6c3fd0 0x56394c783570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed93200640 1 -- 172.21.15.103:0/940313609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56394c567660 con 0x56394c70df20 2024-09-10T22:44:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed93200640 1 --2- 172.21.15.103:0/940313609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70df20 0x56394c783ff0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fed8c05e6a0 tx=0x7fed8c01eff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d209203fe2277a6f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed73e00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed73e00640 1 -- 172.21.15.103:0/940313609 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c090060 con 0x56394c70df20 2024-09-10T22:44:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed73e00640 1 -- 172.21.15.103:0/940313609 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fed8c05db70 con 0x56394c70df20 2024-09-10T22:44:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed9c867000 1 -- 172.21.15.103:0/940313609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed80021030 con 0x56394c70df20 2024-09-10T22:44:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed73e00640 1 -- 172.21.15.103:0/940313609 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fed8c088050 con 0x56394c70df20 2024-09-10T22:44:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed9c867000 10 client.7161 fetch_fsmap learned FSMap version 79 2024-09-10T22:44:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed9c867000 1 -- 172.21.15.103:0/940313609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x56394c4d4090 con 0x56394c70df20 2024-09-10T22:44:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed73e00640 1 -- 172.21.15.103:0/940313609 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed80021030 con 0x56394c70df20 2024-09-10T22:44:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed73e00640 1 -- 172.21.15.103:0/940313609 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 79) ==== 3554+0+0 (secure 0 0 0) 0x7fed8c078070 con 0x56394c70df20 2024-09-10T22:44:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed9c867000 10 client.7161 fetch_fsmap finished waiting for FSMap version 79 2024-09-10T22:44:06.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed9c867000 10 client.7161 resolve_mds: resolved 5:1 to role '5:1' aka daemon mds.d 2024-09-10T22:44:06.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed9c867000 20 client.7161 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:06.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed9c867000 1 --2- 172.21.15.103:0/940313609 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x56394c73f220 0x56394c73f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:06.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed9c867000 4 client.7161 mds_command: new command op to 6592 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:44:06.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed9c867000 1 -- 172.21.15.103:0/940313609 --> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56394c518590 con 0x56394c73f220 2024-09-10T22:44:06.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed92800640 1 --2- 172.21.15.103:0/940313609 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x56394c73f220 0x56394c73f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:06.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed73e00640 10 client.7161 ms_handle_connect on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:06.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.966+0000 7fed92800640 1 --2- 172.21.15.103:0/940313609 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x56394c73f220 0x56394c73f630 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=62798b92a98ffd1a server_cookie=71567225ff682d7c in_seq=0 out_seq=0 2024-09-10T22:44:06.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed73e00640 1 -- 172.21.15.103:0/940313609 <== mds.1 v2:172.21.15.131:6834/134240629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56394c518590 con 0x56394c73f220 2024-09-10T22:44:06.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed73e00640 10 client.7161 handle_command_reply: tid=0 2024-09-10T22:44:06.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed9c867000 1 client.7161 shutdown 2024-09-10T22:44:06.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed9c867000 1 -- 172.21.15.103:0/940313609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70df20 msgr2=0x56394c783ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:06.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed9c867000 1 --2- 172.21.15.103:0/940313609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70df20 0x56394c783ff0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fed8c05e6a0 tx=0x7fed8c01eff0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed9c867000 1 -- 172.21.15.103:0/940313609 shutdown_connections 2024-09-10T22:44:06.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed9c867000 1 --2- 172.21.15.103:0/940313609 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x56394c73f220 0x56394c73f630 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed9c867000 1 --2- 172.21.15.103:0/940313609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394c70df20 0x56394c783ff0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed9c867000 1 --2- 172.21.15.103:0/940313609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56394c70d600 0x56394c783ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed9c867000 1 --2- 172.21.15.103:0/940313609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394c6c3fd0 0x56394c783570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed73e00640 0 client.7161 ms_handle_reset on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:06.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed9c867000 1 -- 172.21.15.103:0/940313609 >> 172.21.15.103:0/940313609 conn(0x56394c6c5d20 msgr2=0x56394c6bd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:06.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed9c867000 1 -- 172.21.15.103:0/940313609 shutdown_connections 2024-09-10T22:44:06.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed9c867000 1 -- 172.21.15.103:0/940313609 wait complete. 2024-09-10T22:44:06.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed9c867000 20 client.7161 trim_cache size 0 max 16384 2024-09-10T22:44:06.984 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:44:06.984 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:44:06.984 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:44:06.984 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:44:06.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed99400640 1 -- 172.21.15.103:0/3313586706 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fed740725e0 msgr2=0x7fed74074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:06.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed99400640 1 --2- 172.21.15.103:0/3313586706 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fed740725e0 0x7fed74074aa0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fed840af000 tx=0x7fed8401afd0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed99400640 1 -- 172.21.15.103:0/3313586706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed9415be30 msgr2=0x7fed9414e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:06.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed99400640 1 --2- 172.21.15.103:0/3313586706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed9415be30 0x7fed9414e460 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00cbc0 tx=0x7fed8c00ccb0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed99400640 1 -- 172.21.15.103:0/3313586706 shutdown_connections 2024-09-10T22:44:06.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed99400640 1 --2- 172.21.15.103:0/3313586706 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fed740725e0 0x7fed74074aa0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed99400640 1 --2- 172.21.15.103:0/3313586706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed9415be30 0x7fed9414e460 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed99400640 1 --2- 172.21.15.103:0/3313586706 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed940b09c0 0x7fed940c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed99400640 1 --2- 172.21.15.103:0/3313586706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed940ae9c0 0x7fed940c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:06.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed99400640 1 -- 172.21.15.103:0/3313586706 >> 172.21.15.103:0/3313586706 conn(0x7fed940d1ac0 msgr2=0x7fed940b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:06.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed99400640 1 -- 172.21.15.103:0/3313586706 shutdown_connections 2024-09-10T22:44:06.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:06.978+0000 7fed99400640 1 -- 172.21.15.103:0/3313586706 wait complete. 2024-09-10T22:44:07.002 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:2 flush journal 2024-09-10T22:44:07.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.142+0000 7f2173200640 1 -- 172.21.15.103:0/800039155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f216c0cfdd0 msgr2=0x7f216c073b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.142+0000 7f2173200640 1 --2- 172.21.15.103:0/800039155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f216c0cfdd0 0x7f216c073b50 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f216c06eae0 tx=0x7f216401cd80 comp rx=0 tx=0).stop 2024-09-10T22:44:07.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.142+0000 7f2173200640 1 -- 172.21.15.103:0/800039155 shutdown_connections 2024-09-10T22:44:07.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.142+0000 7f2173200640 1 --2- 172.21.15.103:0/800039155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f216c0cfdd0 0x7f216c073b50 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.142+0000 7f2173200640 1 --2- 172.21.15.103:0/800039155 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216c06f0c0 0x7f216c073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.142+0000 7f2173200640 1 --2- 172.21.15.103:0/800039155 >> v2:172.21.15.131:3300/0 conn(0x7f216c0cf9f0 0x7f216c06eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.142+0000 7f2173200640 1 -- 172.21.15.103:0/800039155 >> 172.21.15.103:0/800039155 conn(0x7f216c06cc00 msgr2=0x7f216c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:07.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.142+0000 7f2173200640 1 -- 172.21.15.103:0/800039155 shutdown_connections 2024-09-10T22:44:07.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.142+0000 7f2173200640 1 -- 172.21.15.103:0/800039155 wait complete. 2024-09-10T22:44:07.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f2173200640 1 Processor -- start 2024-09-10T22:44:07.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f2173200640 1 -- start start 2024-09-10T22:44:07.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f2173200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f216c06f0c0 0x7f216c1fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f2173200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f216c0cf9f0 0x7f216c1f7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f2173200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216c0cfdd0 0x7f216c0b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f2173200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f216c0cc930 con 0x7f216c0cf9f0 2024-09-10T22:44:07.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f2173200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f216c15fbd0 con 0x7f216c06f0c0 2024-09-10T22:44:07.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f2173200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f216c0ccab0 con 0x7f216c0cfdd0 2024-09-10T22:44:07.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f216b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f216c0cf9f0 0x7f216c1f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f216be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f216c06f0c0 0x7f216c1fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f216b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f216c0cf9f0 0x7f216c1f7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52066/0 (socket says 172.21.15.103:52066) 2024-09-10T22:44:07.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f216b400640 1 -- 172.21.15.103:0/2610483630 learned_addr learned my addr 172.21.15.103:0/2610483630 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:07.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f2171200640 1 --2- 172.21.15.103:0/2610483630 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216c0cfdd0 0x7f216c0b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f216b400640 1 -- 172.21.15.103:0/2610483630 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216c0cfdd0 msgr2=0x7f216c0b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f216b400640 1 --2- 172.21.15.103:0/2610483630 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216c0cfdd0 0x7f216c0b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f216b400640 1 -- 172.21.15.103:0/2610483630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f216c06f0c0 msgr2=0x7f216c1fb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f216b400640 1 --2- 172.21.15.103:0/2610483630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f216c06f0c0 0x7f216c1fb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f216b400640 1 -- 172.21.15.103:0/2610483630 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216c0b1500 con 0x7f216c0cf9f0 2024-09-10T22:44:07.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f216b400640 1 --2- 172.21.15.103:0/2610483630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f216c0cf9f0 0x7f216c1f7590 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f215800e9f0 tx=0x7f215800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f2163e00640 1 -- 172.21.15.103:0/2610483630 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215800cd80 con 0x7f216c0cf9f0 2024-09-10T22:44:07.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f2163e00640 1 -- 172.21.15.103:0/2610483630 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2158010430 con 0x7f216c0cf9f0 2024-09-10T22:44:07.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f2173200640 1 -- 172.21.15.103:0/2610483630 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f216c1fb8b0 con 0x7f216c0cf9f0 2024-09-10T22:44:07.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f2163e00640 1 -- 172.21.15.103:0/2610483630 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2158010860 con 0x7f216c0cf9f0 2024-09-10T22:44:07.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.146+0000 7f2173200640 1 -- 172.21.15.103:0/2610483630 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f216c1fbe70 con 0x7f216c0cf9f0 2024-09-10T22:44:07.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f2163e00640 1 -- 172.21.15.103:0/2610483630 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2158010a00 con 0x7f216c0cf9f0 2024-09-10T22:44:07.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f2163e00640 1 --2- 172.21.15.103:0/2610483630 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f214c0725e0 0x7f214c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f2176692000 1 Processor -- start 2024-09-10T22:44:07.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f2163e00640 1 -- 172.21.15.103:0/2610483630 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f2158093f10 con 0x7f216c0cf9f0 2024-09-10T22:44:07.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f2176692000 1 -- start start 2024-09-10T22:44:07.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f216be00640 1 --2- 172.21.15.103:0/2610483630 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f214c0725e0 0x7f214c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f2176692000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee34c61a0 0x55cee34c6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f2176692000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c6ac0 0x55cee347c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f2176692000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cee347cbc0 0x55cee347cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f2176692000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cee3364cb0 con 0x55cee34c61a0 2024-09-10T22:44:07.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f2176692000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cee327a310 con 0x55cee34c6ac0 2024-09-10T22:44:07.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f2176692000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55cee32d7b90 con 0x55cee347cbc0 2024-09-10T22:44:07.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f216be00640 1 --2- 172.21.15.103:0/2610483630 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f214c0725e0 0x7f214c074aa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f216c14b340 tx=0x7f215c0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f216be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee34c61a0 0x55cee34c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f216be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee34c61a0 0x55cee34c6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52070/0 (socket says 172.21.15.103:52070) 2024-09-10T22:44:07.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f216be00640 1 -- 172.21.15.103:0/1903164674 learned_addr learned my addr 172.21.15.103:0/1903164674 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:07.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f2171200640 1 --2- 172.21.15.103:0/1903164674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cee347cbc0 0x55cee347cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f216b400640 1 --2- 172.21.15.103:0/1903164674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c6ac0 0x55cee347c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f216be00640 1 -- 172.21.15.103:0/1903164674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cee347cbc0 msgr2=0x55cee347cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f216be00640 1 --2- 172.21.15.103:0/1903164674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cee347cbc0 0x55cee347cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f216be00640 1 -- 172.21.15.103:0/1903164674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c6ac0 msgr2=0x55cee347c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f216be00640 1 --2- 172.21.15.103:0/1903164674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c6ac0 0x55cee347c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f216be00640 1 -- 172.21.15.103:0/1903164674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cee327bc60 con 0x55cee34c61a0 2024-09-10T22:44:07.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f216b400640 1 --2- 172.21.15.103:0/1903164674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c6ac0 0x55cee347c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:44:07.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f216be00640 1 --2- 172.21.15.103:0/1903164674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee34c61a0 0x55cee34c6580 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f215c011ee0 tx=0x7f215c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fda04bb2574b67 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.150+0000 7f2160c00640 1 -- 172.21.15.103:0/1903164674 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c003d80 con 0x55cee34c61a0 2024-09-10T22:44:07.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2160c00640 1 -- 172.21.15.103:0/1903164674 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f215c0044d0 con 0x55cee34c61a0 2024-09-10T22:44:07.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2160c00640 1 -- 172.21.15.103:0/1903164674 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c01e680 con 0x55cee34c61a0 2024-09-10T22:44:07.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 1 -- 172.21.15.103:0/1903164674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee34c61a0 msgr2=0x55cee34c6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 1 --2- 172.21.15.103:0/1903164674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee34c61a0 0x55cee34c6580 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f215c011ee0 tx=0x7f215c014000 comp rx=0 tx=0).stop 2024-09-10T22:44:07.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 1 -- 172.21.15.103:0/1903164674 shutdown_connections 2024-09-10T22:44:07.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 1 --2- 172.21.15.103:0/1903164674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cee347cbc0 0x55cee347cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 1 --2- 172.21.15.103:0/1903164674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c6ac0 0x55cee347c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 1 --2- 172.21.15.103:0/1903164674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee34c61a0 0x55cee34c6580 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 1 -- 172.21.15.103:0/1903164674 >> 172.21.15.103:0/1903164674 conn(0x55cee3482d20 msgr2=0x55cee347af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:07.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 1 -- 172.21.15.103:0/1903164674 shutdown_connections 2024-09-10T22:44:07.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 1 -- 172.21.15.103:0/1903164674 wait complete. 2024-09-10T22:44:07.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 1 -- start start 2024-09-10T22:44:07.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 1 Processor -- start 2024-09-10T22:44:07.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cee347cbc0 0x55cee34cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee34c61a0 0x55cee34cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c6ac0 0x55cee34cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cee32cadd0 con 0x55cee34c61a0 2024-09-10T22:44:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cee32c6fc0 con 0x55cee34c6ac0 2024-09-10T22:44:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55cee326c4b0 con 0x55cee347cbc0 2024-09-10T22:44:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 10 client.0 _ll_register_callbacks cb 0x55cee324a7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f216b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee34c61a0 0x55cee34cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f216b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee34c61a0 0x55cee34cda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52076/0 (socket says 172.21.15.103:52076) 2024-09-10T22:44:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f216b400640 1 -- 172.21.15.103:0/534015443 learned_addr learned my addr 172.21.15.103:0/534015443 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f216b400640 1 -- 172.21.15.103:0/534015443 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cee347cbc0 msgr2=0x55cee34cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f216b400640 1 --2- 172.21.15.103:0/534015443 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cee347cbc0 0x55cee34cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f216b400640 1 -- 172.21.15.103:0/534015443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c6ac0 msgr2=0x55cee34cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f216b400640 1 --2- 172.21.15.103:0/534015443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c6ac0 0x55cee34cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f216b400640 1 -- 172.21.15.103:0/534015443 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cee32651f0 con 0x55cee34c61a0 2024-09-10T22:44:07.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f216b400640 1 --2- 172.21.15.103:0/534015443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee34c61a0 0x55cee34cda70 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f21580922a0 tx=0x7f215805ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe2764a7a01b6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2155600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:07.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2155600640 1 -- 172.21.15.103:0/534015443 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215805e120 con 0x55cee34c61a0 2024-09-10T22:44:07.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2155600640 1 -- 172.21.15.103:0/534015443 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f215805e2c0 con 0x55cee34c61a0 2024-09-10T22:44:07.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.154+0000 7f2176692000 1 -- 172.21.15.103:0/534015443 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cee325f330 con 0x55cee34c61a0 2024-09-10T22:44:07.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2155600640 1 -- 172.21.15.103:0/534015443 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f215808a050 con 0x55cee34c61a0 2024-09-10T22:44:07.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 10 client.7173 fetch_fsmap learned FSMap version 79 2024-09-10T22:44:07.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 1 -- 172.21.15.103:0/534015443 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x55cee324bfa0 con 0x55cee34c61a0 2024-09-10T22:44:07.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2155600640 1 -- 172.21.15.103:0/534015443 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55cee325f330 con 0x55cee34c61a0 2024-09-10T22:44:07.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2155600640 1 -- 172.21.15.103:0/534015443 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 79) ==== 3554+0+0 (secure 0 0 0) 0x7f215805a810 con 0x55cee34c61a0 2024-09-10T22:44:07.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 10 client.7173 fetch_fsmap finished waiting for FSMap version 79 2024-09-10T22:44:07.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 10 client.7173 resolve_mds: resolved 5:2 to role '5:2' aka daemon mds.b 2024-09-10T22:44:07.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 20 client.7173 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:07.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 1 --2- 172.21.15.103:0/534015443 >> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] conn(0x55cee34d5900 0x55cee34d7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 4 client.7173 mds_command: new command op to 6053 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:07.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 1 -- 172.21.15.103:0/534015443 --> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cee32d9ae0 con 0x55cee34d5900 2024-09-10T22:44:07.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f216be00640 1 --2- 172.21.15.103:0/534015443 >> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] conn(0x55cee34d5900 0x55cee34d7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f216be00640 1 --2- 172.21.15.103:0/534015443 >> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] conn(0x55cee34d5900 0x55cee34d7cf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=15fb1132d46069f1 server_cookie=6f73cb6d789390b8 in_seq=0 out_seq=0 2024-09-10T22:44:07.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2155600640 10 client.7173 ms_handle_connect on v2:172.21.15.131:6835/4254729752 2024-09-10T22:44:07.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2155600640 1 -- 172.21.15.103:0/534015443 <== mds.2 v2:172.21.15.131:6835/4254729752 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cee32d9ae0 con 0x55cee34d5900 2024-09-10T22:44:07.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2155600640 10 client.7173 handle_command_reply: tid=0 2024-09-10T22:44:07.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 1 client.7173 shutdown 2024-09-10T22:44:07.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 1 -- 172.21.15.103:0/534015443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee34c61a0 msgr2=0x55cee34cda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 1 --2- 172.21.15.103:0/534015443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee34c61a0 0x55cee34cda70 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f21580922a0 tx=0x7f215805ef80 comp rx=0 tx=0).stop 2024-09-10T22:44:07.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 1 -- 172.21.15.103:0/534015443 shutdown_connections 2024-09-10T22:44:07.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 1 --2- 172.21.15.103:0/534015443 >> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] conn(0x55cee34d5900 0x55cee34d7cf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 1 --2- 172.21.15.103:0/534015443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c6ac0 0x55cee34cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 1 --2- 172.21.15.103:0/534015443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee34c61a0 0x55cee34cda70 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2155600640 0 client.7173 ms_handle_reset on v2:172.21.15.131:6835/4254729752 2024-09-10T22:44:07.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 1 --2- 172.21.15.103:0/534015443 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cee347cbc0 0x55cee34cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 1 -- 172.21.15.103:0/534015443 >> 172.21.15.103:0/534015443 conn(0x55cee3482d20 msgr2=0x55cee347af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:07.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 1 -- 172.21.15.103:0/534015443 shutdown_connections 2024-09-10T22:44:07.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 1 -- 172.21.15.103:0/534015443 wait complete. 2024-09-10T22:44:07.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.158+0000 7f2176692000 20 client.7173 trim_cache size 0 max 16384 2024-09-10T22:44:07.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f2176692000 1 Processor -- start 2024-09-10T22:44:07.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f2176692000 1 -- start start 2024-09-10T22:44:07.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f2176692000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee347cbc0 0x55cee3537a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f2176692000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c61a0 0x55cee3537f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f2176692000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cee34c6ac0 0x55cee35384a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f2176692000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f216c2047e0 con 0x55cee347cbc0 2024-09-10T22:44:07.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f2176692000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f216c2039d0 con 0x55cee34c61a0 2024-09-10T22:44:07.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f2176692000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f216c2040b0 con 0x55cee34c6ac0 2024-09-10T22:44:07.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f216be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee347cbc0 0x55cee3537a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f216be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee347cbc0 0x55cee3537a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52090/0 (socket says 172.21.15.103:52090) 2024-09-10T22:44:07.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f216be00640 1 -- 172.21.15.103:0/138921795 learned_addr learned my addr 172.21.15.103:0/138921795 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:07.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f216be00640 1 -- 172.21.15.103:0/138921795 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cee34c6ac0 msgr2=0x55cee35384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f216be00640 1 --2- 172.21.15.103:0/138921795 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cee34c6ac0 0x55cee35384a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f216be00640 1 -- 172.21.15.103:0/138921795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c61a0 msgr2=0x55cee3537f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f216b400640 1 --2- 172.21.15.103:0/138921795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c61a0 0x55cee3537f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f216be00640 1 --2- 172.21.15.103:0/138921795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c61a0 0x55cee3537f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f216be00640 1 -- 172.21.15.103:0/138921795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cee3324660 con 0x55cee347cbc0 2024-09-10T22:44:07.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f216b400640 1 --2- 172.21.15.103:0/138921795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c61a0 0x55cee3537f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:07.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f216be00640 1 --2- 172.21.15.103:0/138921795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee347cbc0 0x55cee3537a20 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f215c022000 tx=0x7f215c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d0644f9b9509e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f2157e00640 1 -- 172.21.15.103:0/138921795 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c005270 con 0x55cee347cbc0 2024-09-10T22:44:07.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f2157e00640 1 -- 172.21.15.103:0/138921795 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f215c003e90 con 0x55cee347cbc0 2024-09-10T22:44:07.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.174+0000 7f2157e00640 1 -- 172.21.15.103:0/138921795 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c004740 con 0x55cee347cbc0 2024-09-10T22:44:07.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 -- 172.21.15.103:0/138921795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee347cbc0 msgr2=0x55cee3537a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 --2- 172.21.15.103:0/138921795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee347cbc0 0x55cee3537a20 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f215c022000 tx=0x7f215c0046d0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 -- 172.21.15.103:0/138921795 shutdown_connections 2024-09-10T22:44:07.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 --2- 172.21.15.103:0/138921795 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cee34c6ac0 0x55cee35384a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 --2- 172.21.15.103:0/138921795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c61a0 0x55cee3537f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 --2- 172.21.15.103:0/138921795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee347cbc0 0x55cee3537a20 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 -- 172.21.15.103:0/138921795 >> 172.21.15.103:0/138921795 conn(0x55cee3482d20 msgr2=0x55cee347e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:07.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 -- 172.21.15.103:0/138921795 shutdown_connections 2024-09-10T22:44:07.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 -- 172.21.15.103:0/138921795 wait complete. 2024-09-10T22:44:07.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 -- start start 2024-09-10T22:44:07.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 Processor -- start 2024-09-10T22:44:07.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee347cbc0 0x55cee34dc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cee34c61a0 0x55cee34dcba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c6ac0 0x55cee34f8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cee3485d40 con 0x55cee347cbc0 2024-09-10T22:44:07.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cee3483100 con 0x55cee34c6ac0 2024-09-10T22:44:07.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55cee32c1ec0 con 0x55cee34c61a0 2024-09-10T22:44:07.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 10 client.0 _ll_register_callbacks cb 0x7f215800cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:07.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f216be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee347cbc0 0x55cee34dc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f216be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee347cbc0 0x55cee34dc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52102/0 (socket says 172.21.15.103:52102) 2024-09-10T22:44:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f216be00640 1 -- 172.21.15.103:0/4113036863 learned_addr learned my addr 172.21.15.103:0/4113036863 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f216b400640 1 --2- 172.21.15.103:0/4113036863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cee34c61a0 0x55cee34dcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2171200640 1 --2- 172.21.15.103:0/4113036863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c6ac0 0x55cee34f8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f216be00640 1 -- 172.21.15.103:0/4113036863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cee34c61a0 msgr2=0x55cee34dcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f216be00640 1 --2- 172.21.15.103:0/4113036863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cee34c61a0 0x55cee34dcba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f216be00640 1 -- 172.21.15.103:0/4113036863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c6ac0 msgr2=0x55cee34f8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f216be00640 1 --2- 172.21.15.103:0/4113036863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c6ac0 0x55cee34f8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f216be00640 1 -- 172.21.15.103:0/4113036863 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cee3291090 con 0x55cee347cbc0 2024-09-10T22:44:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f216be00640 1 --2- 172.21.15.103:0/4113036863 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee347cbc0 0x55cee34dc660 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x55cee32d25e0 tx=0x7f215c003aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd8c815e30ee3be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2155600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2155600640 1 -- 172.21.15.103:0/4113036863 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c030450 con 0x55cee347cbc0 2024-09-10T22:44:07.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2155600640 1 -- 172.21.15.103:0/4113036863 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f215c0305f0 con 0x55cee347cbc0 2024-09-10T22:44:07.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 -- 172.21.15.103:0/4113036863 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f215c003e90 con 0x55cee347cbc0 2024-09-10T22:44:07.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2155600640 1 -- 172.21.15.103:0/4113036863 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f215c042050 con 0x55cee347cbc0 2024-09-10T22:44:07.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 10 client.7179 fetch_fsmap learned FSMap version 79 2024-09-10T22:44:07.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 -- 172.21.15.103:0/4113036863 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x55cee325d5f0 con 0x55cee347cbc0 2024-09-10T22:44:07.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2155600640 1 -- 172.21.15.103:0/4113036863 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f215c003e90 con 0x55cee347cbc0 2024-09-10T22:44:07.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2155600640 1 -- 172.21.15.103:0/4113036863 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 79) ==== 3554+0+0 (secure 0 0 0) 0x7f215c045020 con 0x55cee347cbc0 2024-09-10T22:44:07.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 10 client.7179 fetch_fsmap finished waiting for FSMap version 79 2024-09-10T22:44:07.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 10 client.7179 resolve_mds: resolved 5:2 to role '5:2' aka daemon mds.b 2024-09-10T22:44:07.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 20 client.7179 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:07.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 --2- 172.21.15.103:0/4113036863 >> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] conn(0x55cee34f8c00 0x55cee3543680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 4 client.7179 mds_command: new command op to 6053 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:44:07.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.178+0000 7f2176692000 1 -- 172.21.15.103:0/4113036863 --> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cee32d5590 con 0x55cee34f8c00 2024-09-10T22:44:07.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.182+0000 7f216b400640 1 --2- 172.21.15.103:0/4113036863 >> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] conn(0x55cee34f8c00 0x55cee3543680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.182+0000 7f216b400640 1 --2- 172.21.15.103:0/4113036863 >> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] conn(0x55cee34f8c00 0x55cee3543680 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=31e5c5a8809112b0 server_cookie=71d7891a3379782 in_seq=0 out_seq=0 2024-09-10T22:44:07.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.182+0000 7f2155600640 10 client.7179 ms_handle_connect on v2:172.21.15.131:6835/4254729752 2024-09-10T22:44:07.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2155600640 1 -- 172.21.15.103:0/4113036863 <== mds.2 v2:172.21.15.131:6835/4254729752 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cee32d5590 con 0x55cee34f8c00 2024-09-10T22:44:07.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2155600640 10 client.7179 handle_command_reply: tid=0 2024-09-10T22:44:07.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2176692000 1 client.7179 shutdown 2024-09-10T22:44:07.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2176692000 1 -- 172.21.15.103:0/4113036863 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee347cbc0 msgr2=0x55cee34dc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2176692000 1 --2- 172.21.15.103:0/4113036863 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee347cbc0 0x55cee34dc660 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x55cee32d25e0 tx=0x7f215c003aa0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2176692000 1 -- 172.21.15.103:0/4113036863 shutdown_connections 2024-09-10T22:44:07.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2176692000 1 --2- 172.21.15.103:0/4113036863 >> [v2:172.21.15.131:6835/4254729752,v1:172.21.15.131:6837/4254729752] conn(0x55cee34f8c00 0x55cee3543680 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2176692000 1 --2- 172.21.15.103:0/4113036863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cee34c6ac0 0x55cee34f8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2176692000 1 --2- 172.21.15.103:0/4113036863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cee34c61a0 0x55cee34dcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2155600640 0 client.7179 ms_handle_reset on v2:172.21.15.131:6835/4254729752 2024-09-10T22:44:07.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2176692000 1 --2- 172.21.15.103:0/4113036863 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cee347cbc0 0x55cee34dc660 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2176692000 1 -- 172.21.15.103:0/4113036863 >> 172.21.15.103:0/4113036863 conn(0x55cee3482d20 msgr2=0x55cee34d7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:07.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2176692000 1 -- 172.21.15.103:0/4113036863 shutdown_connections 2024-09-10T22:44:07.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2176692000 1 -- 172.21.15.103:0/4113036863 wait complete. 2024-09-10T22:44:07.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2176692000 20 client.7179 trim_cache size 0 max 16384 2024-09-10T22:44:07.195 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:44:07.196 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:44:07.196 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:44:07.196 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:44:07.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2173200640 1 -- 172.21.15.103:0/2610483630 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f214c0725e0 msgr2=0x7f214c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2173200640 1 --2- 172.21.15.103:0/2610483630 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f214c0725e0 0x7f214c074aa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f216c14b340 tx=0x7f215c0091e0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2173200640 1 -- 172.21.15.103:0/2610483630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f216c0cf9f0 msgr2=0x7f216c1f7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2173200640 1 --2- 172.21.15.103:0/2610483630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f216c0cf9f0 0x7f216c1f7590 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f215800e9f0 tx=0x7f215800eeb0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2173200640 1 -- 172.21.15.103:0/2610483630 shutdown_connections 2024-09-10T22:44:07.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2173200640 1 --2- 172.21.15.103:0/2610483630 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f214c0725e0 0x7f214c074aa0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2173200640 1 --2- 172.21.15.103:0/2610483630 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216c0cfdd0 0x7f216c0b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2173200640 1 --2- 172.21.15.103:0/2610483630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f216c0cf9f0 0x7f216c1f7590 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2173200640 1 --2- 172.21.15.103:0/2610483630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f216c06f0c0 0x7f216c1fb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2173200640 1 -- 172.21.15.103:0/2610483630 >> 172.21.15.103:0/2610483630 conn(0x7f216c06cc00 msgr2=0x7f216c0ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:07.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2173200640 1 -- 172.21.15.103:0/2610483630 shutdown_connections 2024-09-10T22:44:07.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.190+0000 7f2173200640 1 -- 172.21.15.103:0/2610483630 wait complete. 2024-09-10T22:44:07.214 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:44:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.350+0000 7ff3c8a00640 1 -- 172.21.15.103:0/4097404540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3c40ceb40 msgr2=0x7ff3c40cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.350+0000 7ff3c8a00640 1 --2- 172.21.15.103:0/4097404540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3c40ceb40 0x7ff3c40cf9c0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4073840 tx=0x7ff3bc01ccf0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.350+0000 7ff3c8a00640 1 -- 172.21.15.103:0/4097404540 shutdown_connections 2024-09-10T22:44:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.350+0000 7ff3c8a00640 1 --2- 172.21.15.103:0/4097404540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3c40ceb40 0x7ff3c40cf9c0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.350+0000 7ff3c8a00640 1 --2- 172.21.15.103:0/4097404540 >> v2:172.21.15.131:3300/0 conn(0x7ff3c40b09c0 0x7ff3c40ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.350+0000 7ff3c8a00640 1 --2- 172.21.15.103:0/4097404540 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3c415be30 0x7ff3c40ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.350+0000 7ff3c8a00640 1 -- 172.21.15.103:0/4097404540 >> 172.21.15.103:0/4097404540 conn(0x7ff3c40d1ac0 msgr2=0x7ff3c40d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.350+0000 7ff3c8a00640 1 -- 172.21.15.103:0/4097404540 shutdown_connections 2024-09-10T22:44:07.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.350+0000 7ff3c8a00640 1 -- 172.21.15.103:0/4097404540 wait complete. 2024-09-10T22:44:07.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c8a00640 1 Processor -- start 2024-09-10T22:44:07.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c8a00640 1 -- start start 2024-09-10T22:44:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c8a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3c40b09c0 0x7ff3c41549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c8a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3c40ceb40 0x7ff3c40c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c8a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3c415be30 0x7ff3c4154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c8a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c40aed50 con 0x7ff3c40b09c0 2024-09-10T22:44:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c8a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c40aebd0 con 0x7ff3c415be30 2024-09-10T22:44:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c8a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c40aeed0 con 0x7ff3c40ceb40 2024-09-10T22:44:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3c40b09c0 0x7ff3c41549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3c40b09c0 0x7ff3c41549c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52112/0 (socket says 172.21.15.103:52112) 2024-09-10T22:44:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c1e00640 1 -- 172.21.15.103:0/3313198009 learned_addr learned my addr 172.21.15.103:0/3313198009 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c1400640 1 --2- 172.21.15.103:0/3313198009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3c40ceb40 0x7ff3c40c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c2800640 1 --2- 172.21.15.103:0/3313198009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3c415be30 0x7ff3c4154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c1e00640 1 -- 172.21.15.103:0/3313198009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3c40ceb40 msgr2=0x7ff3c40c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c1e00640 1 --2- 172.21.15.103:0/3313198009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3c40ceb40 0x7ff3c40c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c1e00640 1 -- 172.21.15.103:0/3313198009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3c415be30 msgr2=0x7ff3c4154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c1e00640 1 --2- 172.21.15.103:0/3313198009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3c415be30 0x7ff3c4154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c1e00640 1 -- 172.21.15.103:0/3313198009 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c40c5040 con 0x7ff3c40b09c0 2024-09-10T22:44:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c1e00640 1 --2- 172.21.15.103:0/3313198009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3c40b09c0 0x7ff3c41549c0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400d750 tx=0x7ff3b400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3ba000640 1 -- 172.21.15.103:0/3313198009 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4017070 con 0x7ff3c40b09c0 2024-09-10T22:44:07.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3ba000640 1 -- 172.21.15.103:0/3313198009 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3b4009d20 con 0x7ff3c40b09c0 2024-09-10T22:44:07.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3ba000640 1 -- 172.21.15.103:0/3313198009 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4005280 con 0x7ff3c40b09c0 2024-09-10T22:44:07.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c8a00640 1 -- 172.21.15.103:0/3313198009 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c40cbbe0 con 0x7ff3c40b09c0 2024-09-10T22:44:07.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c8a00640 1 -- 172.21.15.103:0/3313198009 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c40ca550 con 0x7ff3c40b09c0 2024-09-10T22:44:07.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.354+0000 7ff3c8a00640 1 -- 172.21.15.103:0/3313198009 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c40ca060 con 0x7ff3c40b09c0 2024-09-10T22:44:07.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.358+0000 7ff3ba000640 1 -- 172.21.15.103:0/3313198009 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff3b4005420 con 0x7ff3c40b09c0 2024-09-10T22:44:07.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.358+0000 7ff3ba000640 1 --2- 172.21.15.103:0/3313198009 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff3a40725e0 0x7ff3a4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.358+0000 7ff3ba000640 1 -- 172.21.15.103:0/3313198009 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7ff3b40935b0 con 0x7ff3c40b09c0 2024-09-10T22:44:07.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.358+0000 7ff3c1400640 1 --2- 172.21.15.103:0/3313198009 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff3a40725e0 0x7ff3a4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.358+0000 7ff3c1400640 1 --2- 172.21.15.103:0/3313198009 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff3a40725e0 0x7ff3a4074aa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0005fd0 tx=0x7ff3b0005e60 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.362+0000 7ff3ba000640 1 -- 172.21.15.103:0/3313198009 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff3b400de60 con 0x7ff3c40b09c0 2024-09-10T22:44:07.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.562+0000 7ff3c8a00640 1 -- 172.21.15.103:0/3313198009 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3c40cf9c0 con 0x7ff3c40b09c0 2024-09-10T22:44:07.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.562+0000 7ff3ba000640 1 -- 172.21.15.103:0/3313198009 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+5273 (secure 0 0 0) 0x7ff3b405ea60 con 0x7ff3c40b09c0 2024-09-10T22:44:07.566 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:07.566 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":79,"btime":"2024-09-10T22:44:05:060646+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6047,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/2402286786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2402286786},{"type":"v1","addr":"172.21.15.103:6834","nonce":2402286786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:43:33.337095+0000","modified":"2024-09-10T22:44:04.465247+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6873,"mds_1":6592,"mds_2":6053},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6053":{"gid":6053,"name":"b","rank":2,"incarnation":76,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6837/4254729752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":4254729752},{"type":"v1","addr":"172.21.15.131:6837","nonce":4254729752}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6592":{"gid":6592,"name":"d","rank":1,"incarnation":74,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6836/134240629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":134240629},{"type":"v1","addr":"172.21.15.131:6836","nonce":134240629}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6873":{"gid":6873,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/249667943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":249667943},{"type":"v1","addr":"172.21.15.103:6835","nonce":249667943}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6873,"qdb_cluster":[6053,6592,6873]},"id":5}]} 2024-09-10T22:44:07.566 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 79 2024-09-10T22:44:07.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.562+0000 7ff3c8a00640 1 -- 172.21.15.103:0/3313198009 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff3a40725e0 msgr2=0x7ff3a4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.562+0000 7ff3c8a00640 1 --2- 172.21.15.103:0/3313198009 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff3a40725e0 0x7ff3a4074aa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0005fd0 tx=0x7ff3b0005e60 comp rx=0 tx=0).stop 2024-09-10T22:44:07.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.562+0000 7ff3c8a00640 1 -- 172.21.15.103:0/3313198009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3c40b09c0 msgr2=0x7ff3c41549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.562+0000 7ff3c8a00640 1 --2- 172.21.15.103:0/3313198009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3c40b09c0 0x7ff3c41549c0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400d750 tx=0x7ff3b400dc10 comp rx=0 tx=0).stop 2024-09-10T22:44:07.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.562+0000 7ff3c8a00640 1 -- 172.21.15.103:0/3313198009 shutdown_connections 2024-09-10T22:44:07.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.562+0000 7ff3c8a00640 1 --2- 172.21.15.103:0/3313198009 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff3a40725e0 0x7ff3a4074aa0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.562+0000 7ff3c8a00640 1 --2- 172.21.15.103:0/3313198009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3c415be30 0x7ff3c4154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.562+0000 7ff3c8a00640 1 --2- 172.21.15.103:0/3313198009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3c40ceb40 0x7ff3c40c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.562+0000 7ff3c8a00640 1 --2- 172.21.15.103:0/3313198009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3c40b09c0 0x7ff3c41549c0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.562+0000 7ff3c8a00640 1 -- 172.21.15.103:0/3313198009 >> 172.21.15.103:0/3313198009 conn(0x7ff3c40d1ac0 msgr2=0x7ff3c41558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:07.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.566+0000 7ff3c8a00640 1 -- 172.21.15.103:0/3313198009 shutdown_connections 2024-09-10T22:44:07.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.566+0000 7ff3c8a00640 1 -- 172.21.15.103:0/3313198009 wait complete. 2024-09-10T22:44:07.587 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d scrub start /d1/d2/d3 2024-09-10T22:44:07.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50fb200640 1 -- 172.21.15.103:0/482452771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50f40cdd00 msgr2=0x7f50f40ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50fb200640 1 --2- 172.21.15.103:0/482452771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50f40cdd00 0x7f50f40ae7f0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f50f40736c0 tx=0x7f50e001c800 comp rx=0 tx=0).stop 2024-09-10T22:44:07.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50fb200640 1 -- 172.21.15.103:0/482452771 shutdown_connections 2024-09-10T22:44:07.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50fb200640 1 --2- 172.21.15.103:0/482452771 >> v2:172.21.15.131:3300/0 conn(0x7f50f40cd500 0x7f50f415f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50fb200640 1 --2- 172.21.15.103:0/482452771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50f40cdd00 0x7f50f40ae7f0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50fb200640 1 -- 172.21.15.103:0/482452771 >> 172.21.15.103:0/482452771 conn(0x7f50f40d1a20 msgr2=0x7f50f40d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:07.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50fb200640 1 -- 172.21.15.103:0/482452771 shutdown_connections 2024-09-10T22:44:07.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50fb200640 1 -- 172.21.15.103:0/482452771 wait complete. 2024-09-10T22:44:07.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50fb200640 1 Processor -- start 2024-09-10T22:44:07.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50fb200640 1 -- start start 2024-09-10T22:44:07.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50fb200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50f40cd500 0x7f50f4151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50fb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50f40cdd00 0x7f50f4166380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50fb200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50f415f1a0 0x7f50f41f8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50fb200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f50f4168f60 con 0x7f50f40cdd00 2024-09-10T22:44:07.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50fb200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f50f4168de0 con 0x7f50f415f1a0 2024-09-10T22:44:07.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50fb200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f50f41690e0 con 0x7f50f40cd500 2024-09-10T22:44:07.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50f3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50f40cdd00 0x7f50f4166380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50f3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50f40cdd00 0x7f50f4166380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52132/0 (socket says 172.21.15.103:52132) 2024-09-10T22:44:07.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50f3400640 1 -- 172.21.15.103:0/3693105512 learned_addr learned my addr 172.21.15.103:0/3693105512 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:07.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50f9200640 1 --2- 172.21.15.103:0/3693105512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50f415f1a0 0x7f50f41f8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50f3e00640 1 --2- 172.21.15.103:0/3693105512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50f40cd500 0x7f50f4151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50f3400640 1 -- 172.21.15.103:0/3693105512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50f40cd500 msgr2=0x7f50f4151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50f3400640 1 --2- 172.21.15.103:0/3693105512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50f40cd500 0x7f50f4151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50f3400640 1 -- 172.21.15.103:0/3693105512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50f415f1a0 msgr2=0x7f50f41f8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50f3400640 1 --2- 172.21.15.103:0/3693105512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50f415f1a0 0x7f50f41f8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50f3400640 1 -- 172.21.15.103:0/3693105512 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f40c8560 con 0x7f50f40cdd00 2024-09-10T22:44:07.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50f9200640 1 --2- 172.21.15.103:0/3693105512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50f415f1a0 0x7f50f41f8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:07.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.730+0000 7f50f3400640 1 --2- 172.21.15.103:0/3693105512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50f40cdd00 0x7f50f4166380 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f50e0000c10 tx=0x7f50e00a6690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.734+0000 7f50ebe00640 1 -- 172.21.15.103:0/3693105512 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0004380 con 0x7f50f40cdd00 2024-09-10T22:44:07.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.734+0000 7f50ebe00640 1 -- 172.21.15.103:0/3693105512 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50e00be070 con 0x7f50f40cdd00 2024-09-10T22:44:07.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.734+0000 7f50ebe00640 1 -- 172.21.15.103:0/3693105512 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0005230 con 0x7f50f40cdd00 2024-09-10T22:44:07.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.734+0000 7f50fb200640 1 -- 172.21.15.103:0/3693105512 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50f40c7fa0 con 0x7f50f40cdd00 2024-09-10T22:44:07.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.734+0000 7f50fb200640 1 -- 172.21.15.103:0/3693105512 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50f41f7b00 con 0x7f50f40cdd00 2024-09-10T22:44:07.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.734+0000 7f50ebe00640 1 -- 172.21.15.103:0/3693105512 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f50e00053d0 con 0x7f50f40cdd00 2024-09-10T22:44:07.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.734+0000 7f50ebe00640 1 --2- 172.21.15.103:0/3693105512 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f50d4072610 0x7f50d4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.734+0000 7f50fe70b000 1 Processor -- start 2024-09-10T22:44:07.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.734+0000 7f50ebe00640 1 -- 172.21.15.103:0/3693105512 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f50e012e0e0 con 0x7f50f40cdd00 2024-09-10T22:44:07.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.734+0000 7f50fe70b000 1 -- start start 2024-09-10T22:44:07.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.734+0000 7f50f3e00640 1 --2- 172.21.15.103:0/3693105512 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f50d4072610 0x7f50d4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50f3e00640 1 --2- 172.21.15.103:0/3693105512 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f50d4072610 0x7f50d4074ad0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f50e40012f0 tx=0x7f50e4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50fe70b000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f29bc100 0x5569f29bc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50fe70b000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f29bca20 0x5569f296fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50fe70b000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f2970380 0x5569f2970760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50fe70b000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5569f285a810 con 0x5569f29bc100 2024-09-10T22:44:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50fe70b000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5569f27cd980 con 0x5569f29bca20 2024-09-10T22:44:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50fe70b000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5569f27bcdb0 con 0x5569f2970380 2024-09-10T22:44:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50f3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f29bc100 0x5569f29bc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50f3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f29bc100 0x5569f29bc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52148/0 (socket says 172.21.15.103:52148) 2024-09-10T22:44:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50f3e00640 1 -- 172.21.15.103:0/3357927121 learned_addr learned my addr 172.21.15.103:0/3357927121 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50f3400640 1 --2- 172.21.15.103:0/3357927121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f29bca20 0x5569f296fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50f9200640 1 --2- 172.21.15.103:0/3357927121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f2970380 0x5569f2970760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50f3e00640 1 -- 172.21.15.103:0/3357927121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f2970380 msgr2=0x5569f2970760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50f3e00640 1 --2- 172.21.15.103:0/3357927121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f2970380 0x5569f2970760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50f3e00640 1 -- 172.21.15.103:0/3357927121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f29bca20 msgr2=0x5569f296fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50f3e00640 1 --2- 172.21.15.103:0/3357927121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f29bca20 0x5569f296fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50f3e00640 1 -- 172.21.15.103:0/3357927121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569f278aaf0 con 0x5569f29bc100 2024-09-10T22:44:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50f3e00640 1 --2- 172.21.15.103:0/3357927121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f29bc100 0x5569f29bc4e0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f50e4003b40 tx=0x7f50e4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed577e0660cb86f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50e8c00640 1 -- 172.21.15.103:0/3357927121 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e40052e0 con 0x5569f29bc100 2024-09-10T22:44:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50e8c00640 1 -- 172.21.15.103:0/3357927121 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50e4005570 con 0x5569f29bc100 2024-09-10T22:44:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50e8c00640 1 -- 172.21.15.103:0/3357927121 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e4021450 con 0x5569f29bc100 2024-09-10T22:44:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50fe70b000 1 -- 172.21.15.103:0/3357927121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f29bc100 msgr2=0x5569f29bc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50fe70b000 1 --2- 172.21.15.103:0/3357927121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f29bc100 0x5569f29bc4e0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f50e4003b40 tx=0x7f50e4011000 comp rx=0 tx=0).stop 2024-09-10T22:44:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50fe70b000 1 -- 172.21.15.103:0/3357927121 shutdown_connections 2024-09-10T22:44:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50fe70b000 1 --2- 172.21.15.103:0/3357927121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f2970380 0x5569f2970760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50fe70b000 1 --2- 172.21.15.103:0/3357927121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f29bca20 0x5569f296fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50fe70b000 1 --2- 172.21.15.103:0/3357927121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f29bc100 0x5569f29bc4e0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50fe70b000 1 -- 172.21.15.103:0/3357927121 >> 172.21.15.103:0/3357927121 conn(0x5569f299d1c0 msgr2=0x5569f299f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50fe70b000 1 -- 172.21.15.103:0/3357927121 shutdown_connections 2024-09-10T22:44:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50fe70b000 1 -- 172.21.15.103:0/3357927121 wait complete. 2024-09-10T22:44:07.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50fe70b000 1 -- start start 2024-09-10T22:44:07.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.738+0000 7f50fe70b000 1 Processor -- start 2024-09-10T22:44:07.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50fe70b000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f2970380 0x5569f29c3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50fe70b000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f29bc100 0x5569f29c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50fe70b000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f29bca20 0x5569f29c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50fe70b000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5569f2762140 con 0x5569f29bca20 2024-09-10T22:44:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50fe70b000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5569f27c0bc0 con 0x5569f2970380 2024-09-10T22:44:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50fe70b000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5569f2763320 con 0x5569f29bc100 2024-09-10T22:44:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50fe70b000 10 client.0 _ll_register_callbacks cb 0x5569f295db50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50f3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f2970380 0x5569f29c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50f9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f29bca20 0x5569f29c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50f3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f2970380 0x5569f29c3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:42098/0 (socket says 172.21.15.103:42098) 2024-09-10T22:44:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50f3e00640 1 -- 172.21.15.103:0/1367975844 learned_addr learned my addr 172.21.15.103:0/1367975844 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50f3400640 1 --2- 172.21.15.103:0/1367975844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f29bc100 0x5569f29c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50f9200640 1 -- 172.21.15.103:0/1367975844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f29bc100 msgr2=0x5569f29c37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50f9200640 1 --2- 172.21.15.103:0/1367975844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f29bc100 0x5569f29c37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50f9200640 1 -- 172.21.15.103:0/1367975844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f2970380 msgr2=0x5569f29c3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50f9200640 1 --2- 172.21.15.103:0/1367975844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f2970380 0x5569f29c3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50f9200640 1 -- 172.21.15.103:0/1367975844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569f2765ba0 con 0x5569f29bca20 2024-09-10T22:44:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50f3e00640 1 --2- 172.21.15.103:0/1367975844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f2970380 0x5569f29c3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:44:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50f9200640 1 --2- 172.21.15.103:0/1367975844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f29bca20 0x5569f29c3d00 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f50ec012700 tx=0x7f50ec012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2318d497d9f7a197 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50dd600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50dd600640 1 -- 172.21.15.103:0/1367975844 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec011bb0 con 0x5569f29bca20 2024-09-10T22:44:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50dd600640 1 -- 172.21.15.103:0/1367975844 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f50ec011d50 con 0x5569f29bca20 2024-09-10T22:44:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50fe70b000 1 -- 172.21.15.103:0/1367975844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5569f2754e20 con 0x5569f29bca20 2024-09-10T22:44:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50dd600640 1 -- 172.21.15.103:0/1367975844 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f50ec024050 con 0x5569f29bca20 2024-09-10T22:44:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50fe70b000 10 client.7200 fetch_fsmap learned FSMap version 79 2024-09-10T22:44:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50fe70b000 1 -- 172.21.15.103:0/1367975844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x5569f275af90 con 0x5569f29bca20 2024-09-10T22:44:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50dd600640 1 -- 172.21.15.103:0/1367975844 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5569f2754e20 con 0x5569f29bca20 2024-09-10T22:44:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50dd600640 1 -- 172.21.15.103:0/1367975844 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 79) ==== 3554+0+0 (secure 0 0 0) 0x7f50ec005020 con 0x5569f29bca20 2024-09-10T22:44:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50fe70b000 10 client.7200 fetch_fsmap finished waiting for FSMap version 79 2024-09-10T22:44:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50fe70b000 10 client.7200 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T22:44:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50fe70b000 20 client.7200 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50fe70b000 1 --2- 172.21.15.103:0/1367975844 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x5569f29cb650 0x5569f29cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50fe70b000 4 client.7200 mds_command: new command op to 6592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50fe70b000 1 -- 172.21.15.103:0/1367975844 --> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569f27cf8d0 con 0x5569f29cb650 2024-09-10T22:44:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50f3e00640 1 --2- 172.21.15.103:0/1367975844 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x5569f29cb650 0x5569f29cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50f3e00640 1 --2- 172.21.15.103:0/1367975844 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x5569f29cb650 0x5569f29cda40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7a18f5a490ebf489 server_cookie=4790f294dc096c6e in_seq=0 out_seq=0 2024-09-10T22:44:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50dd600640 10 client.7200 ms_handle_connect on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:07.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50dd600640 1 -- 172.21.15.103:0/1367975844 <== mds.1 v2:172.21.15.131:6834/134240629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5569f27cf8d0 con 0x5569f29cb650 2024-09-10T22:44:07.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.742+0000 7f50dd600640 10 client.7200 handle_command_reply: tid=0 2024-09-10T22:44:07.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.746+0000 7f50fe70b000 1 client.7200 shutdown 2024-09-10T22:44:07.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.746+0000 7f50fe70b000 1 -- 172.21.15.103:0/1367975844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f29bca20 msgr2=0x5569f29c3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.746+0000 7f50fe70b000 1 --2- 172.21.15.103:0/1367975844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f29bca20 0x5569f29c3d00 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f50ec012700 tx=0x7f50ec012bc0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.746+0000 7f50fe70b000 1 -- 172.21.15.103:0/1367975844 shutdown_connections 2024-09-10T22:44:07.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.746+0000 7f50fe70b000 1 --2- 172.21.15.103:0/1367975844 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x5569f29cb650 0x5569f29cda40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.746+0000 7f50fe70b000 1 --2- 172.21.15.103:0/1367975844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f29bca20 0x5569f29c3d00 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.746+0000 7f50fe70b000 1 --2- 172.21.15.103:0/1367975844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f29bc100 0x5569f29c37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.746+0000 7f50dd600640 0 client.7200 ms_handle_reset on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:07.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.746+0000 7f50fe70b000 1 --2- 172.21.15.103:0/1367975844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f2970380 0x5569f29c3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.746+0000 7f50fe70b000 1 -- 172.21.15.103:0/1367975844 >> 172.21.15.103:0/1367975844 conn(0x5569f299d1c0 msgr2=0x5569f296f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:07.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.746+0000 7f50fe70b000 1 -- 172.21.15.103:0/1367975844 shutdown_connections 2024-09-10T22:44:07.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.746+0000 7f50fe70b000 1 -- 172.21.15.103:0/1367975844 wait complete. 2024-09-10T22:44:07.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.746+0000 7f50fe70b000 20 client.7200 trim_cache size 0 max 16384 2024-09-10T22:44:07.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.762+0000 7f50fe70b000 1 Processor -- start 2024-09-10T22:44:07.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.762+0000 7f50fe70b000 1 -- start start 2024-09-10T22:44:07.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.762+0000 7f50fe70b000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f2970380 0x5569f29c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.762+0000 7f50fe70b000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f29bc100 0x5569f29c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.762+0000 7f50fe70b000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f29bca20 0x5569f2973990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.762+0000 7f50fe70b000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f50f4203dd0 con 0x5569f2970380 2024-09-10T22:44:07.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.762+0000 7f50fe70b000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f50f41fb410 con 0x5569f29bca20 2024-09-10T22:44:07.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.762+0000 7f50fe70b000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5569f27415a0 con 0x5569f29bc100 2024-09-10T22:44:07.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.762+0000 7f50f3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f2970380 0x5569f29c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.762+0000 7f50f3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f2970380 0x5569f29c96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52164/0 (socket says 172.21.15.103:52164) 2024-09-10T22:44:07.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.762+0000 7f50f3e00640 1 -- 172.21.15.103:0/2553199352 learned_addr learned my addr 172.21.15.103:0/2553199352 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:07.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.762+0000 7f50f3400640 1 --2- 172.21.15.103:0/2553199352 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f29bc100 0x5569f29c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.762+0000 7f50f9200640 1 --2- 172.21.15.103:0/2553199352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f29bca20 0x5569f2973990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.762+0000 7f50f3e00640 1 -- 172.21.15.103:0/2553199352 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f29bc100 msgr2=0x5569f29c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.762+0000 7f50f3e00640 1 --2- 172.21.15.103:0/2553199352 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f29bc100 0x5569f29c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.762+0000 7f50f3e00640 1 -- 172.21.15.103:0/2553199352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f29bca20 msgr2=0x5569f2973990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.762+0000 7f50f3e00640 1 --2- 172.21.15.103:0/2553199352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f29bca20 0x5569f2973990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.762+0000 7f50f3e00640 1 -- 172.21.15.103:0/2553199352 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569f2786970 con 0x5569f2970380 2024-09-10T22:44:07.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50f3e00640 1 --2- 172.21.15.103:0/2553199352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f2970380 0x5569f29c96f0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f50e4001740 tx=0x7f50e4001410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70acd9eb057bfac0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50dfe00640 1 -- 172.21.15.103:0/2553199352 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e4005570 con 0x5569f2970380 2024-09-10T22:44:07.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50dfe00640 1 -- 172.21.15.103:0/2553199352 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50e4021450 con 0x5569f2970380 2024-09-10T22:44:07.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50dfe00640 1 -- 172.21.15.103:0/2553199352 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e4021860 con 0x5569f2970380 2024-09-10T22:44:07.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50fe70b000 1 -- 172.21.15.103:0/2553199352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f2970380 msgr2=0x5569f29c96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50fe70b000 1 --2- 172.21.15.103:0/2553199352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f2970380 0x5569f29c96f0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f50e4001740 tx=0x7f50e4001410 comp rx=0 tx=0).stop 2024-09-10T22:44:07.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50fe70b000 1 -- 172.21.15.103:0/2553199352 shutdown_connections 2024-09-10T22:44:07.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50fe70b000 1 --2- 172.21.15.103:0/2553199352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f29bca20 0x5569f2973990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50fe70b000 1 --2- 172.21.15.103:0/2553199352 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f29bc100 0x5569f29c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50fe70b000 1 --2- 172.21.15.103:0/2553199352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f2970380 0x5569f29c96f0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50fe70b000 1 -- 172.21.15.103:0/2553199352 >> 172.21.15.103:0/2553199352 conn(0x5569f299d1c0 msgr2=0x5569f2970760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:07.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50fe70b000 1 -- 172.21.15.103:0/2553199352 shutdown_connections 2024-09-10T22:44:07.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50fe70b000 1 -- 172.21.15.103:0/2553199352 wait complete. 2024-09-10T22:44:07.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50fe70b000 1 -- start start 2024-09-10T22:44:07.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50fe70b000 1 Processor -- start 2024-09-10T22:44:07.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50fe70b000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f2970380 0x5569f29c7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50fe70b000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f29bc100 0x5569f29c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50fe70b000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f29bca20 0x5569f29c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50fe70b000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5569f27bfed0 con 0x5569f2970380 2024-09-10T22:44:07.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50fe70b000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5569f27cc750 con 0x5569f29bc100 2024-09-10T22:44:07.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50fe70b000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5569f287d710 con 0x5569f29bca20 2024-09-10T22:44:07.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50fe70b000 10 client.0 _ll_register_callbacks cb 0x7f50ec009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:07.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50f3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f2970380 0x5569f29c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50f3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f2970380 0x5569f29c7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52178/0 (socket says 172.21.15.103:52178) 2024-09-10T22:44:07.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50f3e00640 1 -- 172.21.15.103:0/1421699074 learned_addr learned my addr 172.21.15.103:0/1421699074 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:07.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50f3400640 1 --2- 172.21.15.103:0/1421699074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f29bc100 0x5569f29c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50f9200640 1 --2- 172.21.15.103:0/1421699074 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f29bca20 0x5569f29c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50f3e00640 1 -- 172.21.15.103:0/1421699074 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f29bca20 msgr2=0x5569f29c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50f3e00640 1 --2- 172.21.15.103:0/1421699074 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f29bca20 0x5569f29c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50f3e00640 1 -- 172.21.15.103:0/1421699074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f29bc100 msgr2=0x5569f29c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50f3e00640 1 --2- 172.21.15.103:0/1421699074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f29bc100 0x5569f29c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50f3e00640 1 -- 172.21.15.103:0/1421699074 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569f2741f50 con 0x5569f2970380 2024-09-10T22:44:07.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50f3e00640 1 --2- 172.21.15.103:0/1421699074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f2970380 0x5569f29c7750 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x5569f2877790 tx=0x7f50e40015c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66db58e579e6d497 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50dd600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:07.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.766+0000 7f50dd600640 1 -- 172.21.15.103:0/1421699074 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e4005570 con 0x5569f2970380 2024-09-10T22:44:07.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 1 -- 172.21.15.103:0/1421699074 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50e4021450 con 0x5569f2970380 2024-09-10T22:44:07.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50dd600640 1 -- 172.21.15.103:0/1421699074 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f50e4021810 con 0x5569f2970380 2024-09-10T22:44:07.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50dd600640 1 -- 172.21.15.103:0/1421699074 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f50e4044050 con 0x5569f2970380 2024-09-10T22:44:07.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 10 client.7206 fetch_fsmap learned FSMap version 79 2024-09-10T22:44:07.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 1 -- 172.21.15.103:0/1421699074 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x5569f277fa60 con 0x5569f2970380 2024-09-10T22:44:07.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50dd600640 1 -- 172.21.15.103:0/1421699074 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50e4021450 con 0x5569f2970380 2024-09-10T22:44:07.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50dd600640 1 -- 172.21.15.103:0/1421699074 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 79) ==== 3554+0+0 (secure 0 0 0) 0x7f50e4047020 con 0x5569f2970380 2024-09-10T22:44:07.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 10 client.7206 fetch_fsmap finished waiting for FSMap version 79 2024-09-10T22:44:07.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 10 client.7206 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T22:44:07.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 20 client.7206 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:07.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 1 --2- 172.21.15.103:0/1421699074 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x5569f29c8b00 0x5569f2a3a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 4 client.7206 mds_command: new command op to 6592 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/d1/d2/d3"}] 2024-09-10T22:44:07.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 1 -- 172.21.15.103:0/1421699074 --> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3"}) -- 0x5569f27cb380 con 0x5569f29c8b00 2024-09-10T22:44:07.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50f3400640 1 --2- 172.21.15.103:0/1421699074 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x5569f29c8b00 0x5569f2a3a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50f3400640 1 --2- 172.21.15.103:0/1421699074 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x5569f29c8b00 0x5569f2a3a3d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=67b10d6a130cd13f server_cookie=dc83a75b9cb5e747 in_seq=0 out_seq=0 2024-09-10T22:44:07.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50dd600640 10 client.7206 ms_handle_connect on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:07.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50dd600640 1 -- 172.21.15.103:0/1421699074 <== mds.1 v2:172.21.15.131:6834/134240629 1 ==== command_reply(tid 0: -18 Not rank 0) ==== 18+0+0 (crc 0 0 0) 0x5569f27cb380 con 0x5569f29c8b00 2024-09-10T22:44:07.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50dd600640 10 client.7206 handle_command_reply: tid=0 2024-09-10T22:44:07.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 1 client.7206 shutdown 2024-09-10T22:44:07.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 1 -- 172.21.15.103:0/1421699074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f2970380 msgr2=0x5569f29c7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 1 --2- 172.21.15.103:0/1421699074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f2970380 0x5569f29c7750 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x5569f2877790 tx=0x7f50e40015c0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 1 -- 172.21.15.103:0/1421699074 shutdown_connections 2024-09-10T22:44:07.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 1 --2- 172.21.15.103:0/1421699074 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5569f29bca20 0x5569f29c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 1 --2- 172.21.15.103:0/1421699074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5569f29bc100 0x5569f29c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 1 --2- 172.21.15.103:0/1421699074 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x5569f29c8b00 0x5569f2a3a3d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 1 --2- 172.21.15.103:0/1421699074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569f2970380 0x5569f29c7750 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50dd600640 0 client.7206 ms_handle_reset on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:07.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 1 -- 172.21.15.103:0/1421699074 >> 172.21.15.103:0/1421699074 conn(0x5569f299d1c0 msgr2=0x5569f2970f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:07.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 1 -- 172.21.15.103:0/1421699074 shutdown_connections 2024-09-10T22:44:07.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 1 -- 172.21.15.103:0/1421699074 wait complete. 2024-09-10T22:44:07.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.770+0000 7f50fe70b000 20 client.7206 trim_cache size 0 max 16384 2024-09-10T22:44:07.779 INFO:teuthology.orchestra.run.smithi103.stderr:Error EXDEV: Not rank 0 2024-09-10T22:44:07.780 DEBUG:teuthology.orchestra.run:got remote process result: 18 2024-09-10T22:44:07.781 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d scrub abort 2024-09-10T22:44:07.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.922+0000 7fc9e1400640 1 -- 172.21.15.103:0/4156327255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9dc0d25f0 msgr2=0x7fc9dc15f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.922+0000 7fc9e1400640 1 --2- 172.21.15.103:0/4156327255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9dc0d25f0 0x7fc9dc15f1e0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0705f0 tx=0x7fc9c801c770 comp rx=0 tx=0).stop 2024-09-10T22:44:07.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.922+0000 7fc9e1400640 1 -- 172.21.15.103:0/4156327255 shutdown_connections 2024-09-10T22:44:07.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.922+0000 7fc9e1400640 1 --2- 172.21.15.103:0/4156327255 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9dc0717a0 0x7fc9dc070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.922+0000 7fc9e1400640 1 --2- 172.21.15.103:0/4156327255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9dc0d25f0 0x7fc9dc15f1e0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.922+0000 7fc9e1400640 1 --2- 172.21.15.103:0/4156327255 >> v2:172.21.15.131:3300/0 conn(0x7fc9dc0cfda0 0x7fc9dc15eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.922+0000 7fc9e1400640 1 -- 172.21.15.103:0/4156327255 >> 172.21.15.103:0/4156327255 conn(0x7fc9dc0d1ad0 msgr2=0x7fc9dc0d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:07.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.922+0000 7fc9e1400640 1 -- 172.21.15.103:0/4156327255 shutdown_connections 2024-09-10T22:44:07.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.922+0000 7fc9e1400640 1 -- 172.21.15.103:0/4156327255 wait complete. 2024-09-10T22:44:07.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.922+0000 7fc9e1400640 1 Processor -- start 2024-09-10T22:44:07.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.922+0000 7fc9e1400640 1 -- start start 2024-09-10T22:44:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9e1400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9dc0717a0 0x7fc9dc06dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9e1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9dc0cfda0 0x7fc9dc0b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9e1400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9dc0d25f0 0x7fc9dc14adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9e1400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc0afef0 con 0x7fc9dc0cfda0 2024-09-10T22:44:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9e1400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc0afd70 con 0x7fc9dc0717a0 2024-09-10T22:44:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9e1400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc9dc0b0070 con 0x7fc9dc0d25f0 2024-09-10T22:44:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9d9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9dc0cfda0 0x7fc9dc0b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9da800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9dc0717a0 0x7fc9dc06dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9d9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9dc0cfda0 0x7fc9dc0b5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52188/0 (socket says 172.21.15.103:52188) 2024-09-10T22:44:07.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9d9e00640 1 -- 172.21.15.103:0/1325921797 learned_addr learned my addr 172.21.15.103:0/1325921797 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:07.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9db200640 1 --2- 172.21.15.103:0/1325921797 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9dc0d25f0 0x7fc9dc14adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9d9e00640 1 -- 172.21.15.103:0/1325921797 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9dc0d25f0 msgr2=0x7fc9dc14adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9d9e00640 1 --2- 172.21.15.103:0/1325921797 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9dc0d25f0 0x7fc9dc14adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9d9e00640 1 -- 172.21.15.103:0/1325921797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9dc0717a0 msgr2=0x7fc9dc06dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9d9e00640 1 --2- 172.21.15.103:0/1325921797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9dc0717a0 0x7fc9dc06dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9d9e00640 1 -- 172.21.15.103:0/1325921797 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc06e250 con 0x7fc9dc0cfda0 2024-09-10T22:44:07.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9d9e00640 1 --2- 172.21.15.103:0/1325921797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9dc0cfda0 0x7fc9dc0b5860 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80b0040 tx=0x7fc9c80a5750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9d2a00640 1 -- 172.21.15.103:0/1325921797 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c80b2040 con 0x7fc9dc0cfda0 2024-09-10T22:44:07.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9d2a00640 1 -- 172.21.15.103:0/1325921797 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9c80044b0 con 0x7fc9dc0cfda0 2024-09-10T22:44:07.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9e1400640 1 -- 172.21.15.103:0/1325921797 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9dc0c9bf0 con 0x7fc9dc0cfda0 2024-09-10T22:44:07.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9d2a00640 1 -- 172.21.15.103:0/1325921797 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8003860 con 0x7fc9dc0cfda0 2024-09-10T22:44:07.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9e1400640 1 -- 172.21.15.103:0/1325921797 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9dc0c8880 con 0x7fc9dc0cfda0 2024-09-10T22:44:07.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.926+0000 7fc9d2a00640 1 -- 172.21.15.103:0/1325921797 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc9c8003a00 con 0x7fc9dc0cfda0 2024-09-10T22:44:07.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9d2a00640 1 --2- 172.21.15.103:0/1325921797 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9bc0725e0 0x7fc9bc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9d2a00640 1 -- 172.21.15.103:0/1325921797 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fc9c812cb40 con 0x7fc9dc0cfda0 2024-09-10T22:44:07.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9e48aa000 1 Processor -- start 2024-09-10T22:44:07.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9e48aa000 1 -- start start 2024-09-10T22:44:07.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9da800640 1 --2- 172.21.15.103:0/1325921797 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9bc0725e0 0x7fc9bc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9da800640 1 --2- 172.21.15.103:0/1325921797 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9bc0725e0 0x7fc9bc074aa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00ac60 tx=0x7fc9cc00a2d0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9e48aa000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f75234e350 0x55f75234e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9e48aa000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f75234ec70 0x55f752307270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9e48aa000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7523077b0 0x55f752307b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9e48aa000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f75215fa90 con 0x55f7523077b0 2024-09-10T22:44:07.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9e48aa000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f75214eec0 con 0x55f75234e350 2024-09-10T22:44:07.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9e48aa000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55f752152cd0 con 0x55f75234ec70 2024-09-10T22:44:07.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9db200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7523077b0 0x55f752307b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9db200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7523077b0 0x55f752307b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52200/0 (socket says 172.21.15.103:52200) 2024-09-10T22:44:07.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9db200640 1 -- 172.21.15.103:0/1633390374 learned_addr learned my addr 172.21.15.103:0/1633390374 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:07.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9da800640 1 --2- 172.21.15.103:0/1633390374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f75234e350 0x55f75234e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9d9e00640 1 --2- 172.21.15.103:0/1633390374 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f75234ec70 0x55f752307270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9db200640 1 -- 172.21.15.103:0/1633390374 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f75234ec70 msgr2=0x55f752307270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9db200640 1 --2- 172.21.15.103:0/1633390374 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f75234ec70 0x55f752307270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9db200640 1 -- 172.21.15.103:0/1633390374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f75234e350 msgr2=0x55f75234e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9db200640 1 --2- 172.21.15.103:0/1633390374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f75234e350 0x55f75234e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9db200640 1 -- 172.21.15.103:0/1633390374 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7520f3220 con 0x55f7523077b0 2024-09-10T22:44:07.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9db200640 1 --2- 172.21.15.103:0/1633390374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7523077b0 0x55f752307b90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400aec0 tx=0x7fc9d400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8520699e11a147c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9c7400640 1 -- 172.21.15.103:0/1633390374 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4004d30 con 0x55f7523077b0 2024-09-10T22:44:07.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9c7400640 1 -- 172.21.15.103:0/1633390374 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9d4010640 con 0x55f7523077b0 2024-09-10T22:44:07.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9c7400640 1 -- 172.21.15.103:0/1633390374 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d40109f0 con 0x55f7523077b0 2024-09-10T22:44:07.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9e48aa000 1 -- 172.21.15.103:0/1633390374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7523077b0 msgr2=0x55f752307b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/1633390374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7523077b0 0x55f752307b90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400aec0 tx=0x7fc9d400f790 comp rx=0 tx=0).stop 2024-09-10T22:44:07.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9e48aa000 1 -- 172.21.15.103:0/1633390374 shutdown_connections 2024-09-10T22:44:07.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/1633390374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7523077b0 0x55f752307b90 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/1633390374 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f75234ec70 0x55f752307270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/1633390374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f75234e350 0x55f75234e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9e48aa000 1 -- 172.21.15.103:0/1633390374 >> 172.21.15.103:0/1633390374 conn(0x55f7522fe610 msgr2=0x55f752305b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:07.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9e48aa000 1 -- 172.21.15.103:0/1633390374 shutdown_connections 2024-09-10T22:44:07.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.930+0000 7fc9e48aa000 1 -- 172.21.15.103:0/1633390374 wait complete. 2024-09-10T22:44:07.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9e48aa000 1 -- start start 2024-09-10T22:44:07.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9e48aa000 1 Processor -- start 2024-09-10T22:44:07.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9e48aa000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f7523077b0 0x55f7523550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9e48aa000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f75234e350 0x55f7523555f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9e48aa000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f75234ec70 0x55f752355b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9e48aa000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f7520f8a20 con 0x55f75234ec70 2024-09-10T22:44:07.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9e48aa000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f7520f9ff0 con 0x55f75234e350 2024-09-10T22:44:07.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9e48aa000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55f752106c00 con 0x55f7523077b0 2024-09-10T22:44:07.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9e48aa000 10 client.0 _ll_register_callbacks cb 0x55f752206fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:07.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9db200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f75234ec70 0x55f752355b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9db200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f75234ec70 0x55f752355b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52216/0 (socket says 172.21.15.103:52216) 2024-09-10T22:44:07.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9db200640 1 -- 172.21.15.103:0/2093810412 learned_addr learned my addr 172.21.15.103:0/2093810412 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:07.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9da800640 1 --2- 172.21.15.103:0/2093810412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f7523077b0 0x55f7523550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9d9e00640 1 --2- 172.21.15.103:0/2093810412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f75234e350 0x55f7523555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9db200640 1 -- 172.21.15.103:0/2093810412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f7523077b0 msgr2=0x55f7523550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9db200640 1 --2- 172.21.15.103:0/2093810412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f7523077b0 0x55f7523550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9db200640 1 -- 172.21.15.103:0/2093810412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f75234e350 msgr2=0x55f7523555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9db200640 1 --2- 172.21.15.103:0/2093810412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f75234e350 0x55f7523555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9db200640 1 -- 172.21.15.103:0/2093810412 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7520ed170 con 0x55f75234ec70 2024-09-10T22:44:07.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9db200640 1 --2- 172.21.15.103:0/2093810412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f75234ec70 0x55f752355b30 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4000f90 tx=0x7fc9d4005b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d6b792e8045f2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:07.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9bbe00640 1 -- 172.21.15.103:0/2093810412 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4027020 con 0x55f75234ec70 2024-09-10T22:44:07.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9bbe00640 1 -- 172.21.15.103:0/2093810412 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fc9d40042d0 con 0x55f75234ec70 2024-09-10T22:44:07.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9e48aa000 1 -- 172.21.15.103:0/2093810412 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f7520e70f0 con 0x55f75234ec70 2024-09-10T22:44:07.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9bbe00640 1 -- 172.21.15.103:0/2093810412 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fc9d4031050 con 0x55f75234ec70 2024-09-10T22:44:07.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9e48aa000 10 client.7218 fetch_fsmap learned FSMap version 79 2024-09-10T22:44:07.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9e48aa000 1 -- 172.21.15.103:0/2093810412 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x55f7521d5430 con 0x55f75234ec70 2024-09-10T22:44:07.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9bbe00640 1 -- 172.21.15.103:0/2093810412 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f7520e70f0 con 0x55f75234ec70 2024-09-10T22:44:07.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9bbe00640 1 -- 172.21.15.103:0/2093810412 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 79) ==== 3554+0+0 (secure 0 0 0) 0x7fc9d4034020 con 0x55f75234ec70 2024-09-10T22:44:07.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9e48aa000 10 client.7218 fetch_fsmap finished waiting for FSMap version 79 2024-09-10T22:44:07.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9e48aa000 10 client.7218 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T22:44:07.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9e48aa000 20 client.7218 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:07.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/2093810412 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x55f75235d480 0x55f75235f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9e48aa000 4 client.7218 mds_command: new command op to 6592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:07.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9e48aa000 1 -- 172.21.15.103:0/2093810412 --> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7521619e0 con 0x55f75235d480 2024-09-10T22:44:07.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.934+0000 7fc9da800640 1 --2- 172.21.15.103:0/2093810412 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x55f75235d480 0x55f75235f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.938+0000 7fc9da800640 1 --2- 172.21.15.103:0/2093810412 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x55f75235d480 0x55f75235f870 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8f7e1a5f01f76d6 server_cookie=d0438c26c443eba in_seq=0 out_seq=0 2024-09-10T22:44:07.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.938+0000 7fc9bbe00640 10 client.7218 ms_handle_connect on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:07.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.938+0000 7fc9bbe00640 1 -- 172.21.15.103:0/2093810412 <== mds.1 v2:172.21.15.131:6834/134240629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f7521619e0 con 0x55f75235d480 2024-09-10T22:44:07.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.938+0000 7fc9bbe00640 10 client.7218 handle_command_reply: tid=0 2024-09-10T22:44:07.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.938+0000 7fc9e48aa000 1 client.7218 shutdown 2024-09-10T22:44:07.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.938+0000 7fc9e48aa000 1 -- 172.21.15.103:0/2093810412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f75234ec70 msgr2=0x55f752355b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.938+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/2093810412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f75234ec70 0x55f752355b30 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4000f90 tx=0x7fc9d4005b60 comp rx=0 tx=0).stop 2024-09-10T22:44:07.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.938+0000 7fc9e48aa000 1 -- 172.21.15.103:0/2093810412 shutdown_connections 2024-09-10T22:44:07.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.938+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/2093810412 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x55f75235d480 0x55f75235f870 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.938+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/2093810412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f75234ec70 0x55f752355b30 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.938+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/2093810412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f75234e350 0x55f7523555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.938+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/2093810412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f7523077b0 0x55f7523550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.938+0000 7fc9e48aa000 1 -- 172.21.15.103:0/2093810412 >> 172.21.15.103:0/2093810412 conn(0x55f7522fe610 msgr2=0x55f752306260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:07.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.938+0000 7fc9bbe00640 0 client.7218 ms_handle_reset on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:07.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.938+0000 7fc9e48aa000 1 -- 172.21.15.103:0/2093810412 shutdown_connections 2024-09-10T22:44:07.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.938+0000 7fc9e48aa000 1 -- 172.21.15.103:0/2093810412 wait complete. 2024-09-10T22:44:07.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.938+0000 7fc9e48aa000 20 client.7218 trim_cache size 0 max 16384 2024-09-10T22:44:07.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.954+0000 7fc9e48aa000 1 Processor -- start 2024-09-10T22:44:07.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.954+0000 7fc9e48aa000 1 -- start start 2024-09-10T22:44:07.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7523077b0 0x55f7523c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f75234e350 0x55f7523c0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f75234ec70 0x55f7523c1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc2039d0 con 0x55f7523077b0 2024-09-10T22:44:07.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc2040d0 con 0x55f75234ec70 2024-09-10T22:44:07.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc9dc1fb7f0 con 0x55f75234e350 2024-09-10T22:44:07.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9da800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7523077b0 0x55f7523c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9da800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7523077b0 0x55f7523c05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52222/0 (socket says 172.21.15.103:52222) 2024-09-10T22:44:07.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9da800640 1 -- 172.21.15.103:0/1519901522 learned_addr learned my addr 172.21.15.103:0/1519901522 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:07.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9db200640 1 --2- 172.21.15.103:0/1519901522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f75234ec70 0x55f7523c1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9d9e00640 1 --2- 172.21.15.103:0/1519901522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f75234e350 0x55f7523c0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9da800640 1 -- 172.21.15.103:0/1519901522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f75234e350 msgr2=0x55f7523c0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9da800640 1 --2- 172.21.15.103:0/1519901522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f75234e350 0x55f7523c0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9da800640 1 -- 172.21.15.103:0/1519901522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f75234ec70 msgr2=0x55f7523c1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9da800640 1 --2- 172.21.15.103:0/1519901522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f75234ec70 0x55f7523c1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9da800640 1 -- 172.21.15.103:0/1519901522 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7520f7c00 con 0x55f7523077b0 2024-09-10T22:44:07.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9da800640 1 --2- 172.21.15.103:0/1519901522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7523077b0 0x55f7523c05b0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00fc20 tx=0x7fc9cc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9adc75c59436603 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9c6a00640 1 -- 172.21.15.103:0/1519901522 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc034070 con 0x55f7523077b0 2024-09-10T22:44:07.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9c6a00640 1 -- 172.21.15.103:0/1519901522 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9cc02f430 con 0x55f7523077b0 2024-09-10T22:44:07.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9c6a00640 1 -- 172.21.15.103:0/1519901522 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc016070 con 0x55f7523077b0 2024-09-10T22:44:07.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 -- 172.21.15.103:0/1519901522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7523077b0 msgr2=0x55f7523c05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/1519901522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7523077b0 0x55f7523c05b0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00fc20 tx=0x7fc9cc012000 comp rx=0 tx=0).stop 2024-09-10T22:44:07.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 -- 172.21.15.103:0/1519901522 shutdown_connections 2024-09-10T22:44:07.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/1519901522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f75234ec70 0x55f7523c1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/1519901522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f75234e350 0x55f7523c0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/1519901522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7523077b0 0x55f7523c05b0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 -- 172.21.15.103:0/1519901522 >> 172.21.15.103:0/1519901522 conn(0x55f7522fe610 msgr2=0x55f75234d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:07.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 -- 172.21.15.103:0/1519901522 shutdown_connections 2024-09-10T22:44:07.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 -- 172.21.15.103:0/1519901522 wait complete. 2024-09-10T22:44:07.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 -- start start 2024-09-10T22:44:07.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 Processor -- start 2024-09-10T22:44:07.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7523077b0 0x55f7523c1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f75234e350 0x55f75235b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f75234ec70 0x55f75235b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f752157300 con 0x55f75234ec70 2024-09-10T22:44:07.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f752151fe0 con 0x55f7523077b0 2024-09-10T22:44:07.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55f752162600 con 0x55f75234e350 2024-09-10T22:44:07.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.958+0000 7fc9e48aa000 10 client.0 _ll_register_callbacks cb 0x7fc9cc00a970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:07.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9db200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f75234ec70 0x55f75235b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9db200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f75234ec70 0x55f75235b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52224/0 (socket says 172.21.15.103:52224) 2024-09-10T22:44:07.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9da800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7523077b0 0x55f7523c1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9db200640 1 -- 172.21.15.103:0/3178117030 learned_addr learned my addr 172.21.15.103:0/3178117030 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:07.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9d9e00640 1 --2- 172.21.15.103:0/3178117030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f75234e350 0x55f75235b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9db200640 1 -- 172.21.15.103:0/3178117030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f75234e350 msgr2=0x55f75235b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9db200640 1 --2- 172.21.15.103:0/3178117030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f75234e350 0x55f75235b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9db200640 1 -- 172.21.15.103:0/3178117030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7523077b0 msgr2=0x55f7523c1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:07.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9db200640 1 --2- 172.21.15.103:0/3178117030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7523077b0 0x55f7523c1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9db200640 1 -- 172.21.15.103:0/3178117030 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7520d8990 con 0x55f75234ec70 2024-09-10T22:44:07.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9db200640 1 --2- 172.21.15.103:0/3178117030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f75234ec70 0x55f75235b990 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4010010 tx=0x7fc9d4010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55a60320b5d21d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:07.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:07.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9bbe00640 1 -- 172.21.15.103:0/3178117030 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4027070 con 0x55f75234ec70 2024-09-10T22:44:07.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9bbe00640 1 -- 172.21.15.103:0/3178117030 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fc9d4004850 con 0x55f75234ec70 2024-09-10T22:44:07.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 1 -- 172.21.15.103:0/3178117030 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9cc02f430 con 0x55f75234ec70 2024-09-10T22:44:07.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9bbe00640 1 -- 172.21.15.103:0/3178117030 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fc9d4045050 con 0x55f75234ec70 2024-09-10T22:44:07.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 10 client.7224 fetch_fsmap learned FSMap version 79 2024-09-10T22:44:07.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 1 -- 172.21.15.103:0/3178117030 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x55f7520f4140 con 0x55f75234ec70 2024-09-10T22:44:07.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9bbe00640 1 -- 172.21.15.103:0/3178117030 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9cc02f430 con 0x55f75234ec70 2024-09-10T22:44:07.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9bbe00640 1 -- 172.21.15.103:0/3178117030 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 79) ==== 3554+0+0 (secure 0 0 0) 0x7fc9d4048020 con 0x55f75234ec70 2024-09-10T22:44:07.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 10 client.7224 fetch_fsmap finished waiting for FSMap version 79 2024-09-10T22:44:07.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 10 client.7224 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T22:44:07.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 20 client.7224 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:07.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/3178117030 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x55f752380210 0x55f7523805f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:07.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 4 client.7224 mds_command: new command op to 6592 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-10T22:44:07.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 1 -- 172.21.15.103:0/3178117030 --> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55f75215d490 con 0x55f752380210 2024-09-10T22:44:07.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9da800640 1 --2- 172.21.15.103:0/3178117030 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x55f752380210 0x55f7523805f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:07.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9bbe00640 10 client.7224 ms_handle_connect on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:07.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9da800640 1 --2- 172.21.15.103:0/3178117030 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x55f752380210 0x55f7523805f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=117f76fe48bcf4ab server_cookie=9bf1f975669ba7f8 in_seq=0 out_seq=0 2024-09-10T22:44:07.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9bbe00640 1 -- 172.21.15.103:0/3178117030 <== mds.1 v2:172.21.15.131:6834/134240629 1 ==== command_reply(tid 0: -18 Not rank 0) ==== 18+0+0 (crc 0 0 0) 0x55f75215d490 con 0x55f752380210 2024-09-10T22:44:07.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9bbe00640 10 client.7224 handle_command_reply: tid=0 2024-09-10T22:44:07.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 1 client.7224 shutdown 2024-09-10T22:44:07.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 1 -- 172.21.15.103:0/3178117030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f75234ec70 msgr2=0x55f75235b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:07.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/3178117030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f75234ec70 0x55f75235b990 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4010010 tx=0x7fc9d4010d90 comp rx=0 tx=0).stop 2024-09-10T22:44:07.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 1 -- 172.21.15.103:0/3178117030 shutdown_connections 2024-09-10T22:44:07.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/3178117030 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x55f752380210 0x55f7523805f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/3178117030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f75234ec70 0x55f75235b990 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/3178117030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f75234e350 0x55f75235b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9bbe00640 0 client.7224 ms_handle_reset on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:07.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 1 --2- 172.21.15.103:0/3178117030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7523077b0 0x55f7523c1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:07.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 1 -- 172.21.15.103:0/3178117030 >> 172.21.15.103:0/3178117030 conn(0x55f7522fe610 msgr2=0x55f752303320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:07.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 1 -- 172.21.15.103:0/3178117030 shutdown_connections 2024-09-10T22:44:07.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 1 -- 172.21.15.103:0/3178117030 wait complete. 2024-09-10T22:44:07.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:07.962+0000 7fc9e48aa000 20 client.7224 trim_cache size 0 max 16384 2024-09-10T22:44:07.974 INFO:teuthology.orchestra.run.smithi103.stderr:Error EXDEV: Not rank 0 2024-09-10T22:44:07.974 DEBUG:teuthology.orchestra.run:got remote process result: 18 2024-09-10T22:44:07.975 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d scrub pause 2024-09-10T22:44:08.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f4401400640 1 -- 172.21.15.103:0/2165326837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43fc0cfda0 msgr2=0x7f43fc15eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f4401400640 1 --2- 172.21.15.103:0/2165326837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43fc0cfda0 0x7f43fc15eca0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0b0ec0 tx=0x7f43ec01c770 comp rx=0 tx=0).stop 2024-09-10T22:44:08.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f4401400640 1 -- 172.21.15.103:0/2165326837 shutdown_connections 2024-09-10T22:44:08.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f4401400640 1 --2- 172.21.15.103:0/2165326837 >> v2:172.21.15.131:3300/0 conn(0x7f43fc0717a0 0x7f43fc15f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f4401400640 1 --2- 172.21.15.103:0/2165326837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43fc0cfda0 0x7f43fc15eca0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f4401400640 1 -- 172.21.15.103:0/2165326837 >> 172.21.15.103:0/2165326837 conn(0x7f43fc0d1ad0 msgr2=0x7f43fc0d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:08.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f4401400640 1 -- 172.21.15.103:0/2165326837 shutdown_connections 2024-09-10T22:44:08.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f4401400640 1 -- 172.21.15.103:0/2165326837 wait complete. 2024-09-10T22:44:08.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f4401400640 1 Processor -- start 2024-09-10T22:44:08.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f4401400640 1 -- start start 2024-09-10T22:44:08.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f4401400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43fc0717a0 0x7f43fc15bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f4401400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43fc0cfda0 0x7f43fc06f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f4401400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43fc0d25f0 0x7f43fc06dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f4401400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc168f90 con 0x7f43fc0d25f0 2024-09-10T22:44:08.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f4401400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc168e10 con 0x7f43fc0cfda0 2024-09-10T22:44:08.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f4401400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f43fc169110 con 0x7f43fc0717a0 2024-09-10T22:44:08.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f43fb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43fc0d25f0 0x7f43fc06dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f43fb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43fc0d25f0 0x7f43fc06dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52238/0 (socket says 172.21.15.103:52238) 2024-09-10T22:44:08.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f43fb200640 1 -- 172.21.15.103:0/2280887984 learned_addr learned my addr 172.21.15.103:0/2280887984 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:08.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f43f9e00640 1 --2- 172.21.15.103:0/2280887984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43fc0cfda0 0x7f43fc06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.118+0000 7f43fa800640 1 --2- 172.21.15.103:0/2280887984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43fc0717a0 0x7f43fc15bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.122+0000 7f43fb200640 1 -- 172.21.15.103:0/2280887984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43fc0717a0 msgr2=0x7f43fc15bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.122+0000 7f43fb200640 1 --2- 172.21.15.103:0/2280887984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43fc0717a0 0x7f43fc15bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.122+0000 7f43fb200640 1 -- 172.21.15.103:0/2280887984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43fc0cfda0 msgr2=0x7f43fc06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.122+0000 7f43fb200640 1 --2- 172.21.15.103:0/2280887984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43fc0cfda0 0x7f43fc06f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.122+0000 7f43fb200640 1 -- 172.21.15.103:0/2280887984 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc06f980 con 0x7f43fc0d25f0 2024-09-10T22:44:08.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.122+0000 7f43fb200640 1 --2- 172.21.15.103:0/2280887984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43fc0d25f0 0x7f43fc06dd10 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f43f400ea50 tx=0x7f43f400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:08.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.122+0000 7f43f2a00640 1 -- 172.21.15.103:0/2280887984 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f400cdc0 con 0x7f43fc0d25f0 2024-09-10T22:44:08.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.122+0000 7f43f2a00640 1 -- 172.21.15.103:0/2280887984 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43f4004c40 con 0x7f43fc0d25f0 2024-09-10T22:44:08.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.122+0000 7f43f2a00640 1 -- 172.21.15.103:0/2280887984 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f4005280 con 0x7f43fc0d25f0 2024-09-10T22:44:08.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.122+0000 7f4401400640 1 -- 172.21.15.103:0/2280887984 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43fc0cb680 con 0x7f43fc0d25f0 2024-09-10T22:44:08.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.122+0000 7f4401400640 1 -- 172.21.15.103:0/2280887984 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43fc159840 con 0x7f43fc0d25f0 2024-09-10T22:44:08.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.122+0000 7f43f2a00640 1 -- 172.21.15.103:0/2280887984 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f43f400f040 con 0x7f43fc0d25f0 2024-09-10T22:44:08.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f4404742000 1 Processor -- start 2024-09-10T22:44:08.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f43f2a00640 1 --2- 172.21.15.103:0/2280887984 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f43dc0725e0 0x7f43dc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f43f2a00640 1 -- 172.21.15.103:0/2280887984 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f43f4093a60 con 0x7f43fc0d25f0 2024-09-10T22:44:08.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f4404742000 1 -- start start 2024-09-10T22:44:08.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f43fa800640 1 --2- 172.21.15.103:0/2280887984 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f43dc0725e0 0x7f43dc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f43fa800640 1 --2- 172.21.15.103:0/2280887984 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f43dc0725e0 0x7f43dc074aa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0af000 tx=0x7f43ec01afb0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:08.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f4404742000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dcc350 0x557ab1dcc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f4404742000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1dccc70 0x557ab1d85270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f4404742000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1d857b0 0x557ab1d85b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f4404742000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x557ab1bdda90 con 0x557ab1dcc350 2024-09-10T22:44:08.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f4404742000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557ab1bccec0 con 0x557ab1d857b0 2024-09-10T22:44:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f4404742000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x557ab1bd0cd0 con 0x557ab1dccc70 2024-09-10T22:44:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f43fa800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dcc350 0x557ab1dcc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f43fa800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dcc350 0x557ab1dcc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52250/0 (socket says 172.21.15.103:52250) 2024-09-10T22:44:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f43fa800640 1 -- 172.21.15.103:0/966199349 learned_addr learned my addr 172.21.15.103:0/966199349 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f43fb200640 1 --2- 172.21.15.103:0/966199349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1d857b0 0x557ab1d85b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f43f9e00640 1 --2- 172.21.15.103:0/966199349 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1dccc70 0x557ab1d85270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f43fa800640 1 -- 172.21.15.103:0/966199349 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1dccc70 msgr2=0x557ab1d85270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f43fa800640 1 --2- 172.21.15.103:0/966199349 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1dccc70 0x557ab1d85270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f43fa800640 1 -- 172.21.15.103:0/966199349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1d857b0 msgr2=0x557ab1d85b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f43fa800640 1 --2- 172.21.15.103:0/966199349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1d857b0 0x557ab1d85b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f43fa800640 1 -- 172.21.15.103:0/966199349 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ab1b71220 con 0x557ab1dcc350 2024-09-10T22:44:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f43fa800640 1 --2- 172.21.15.103:0/966199349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dcc350 0x557ab1dcc730 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f43ec019380 tx=0x7f43ec0b5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797198793bde0470 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:08.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f43e7400640 1 -- 172.21.15.103:0/966199349 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0c6070 con 0x557ab1dcc350 2024-09-10T22:44:08.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f43e7400640 1 -- 172.21.15.103:0/966199349 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43ec0b3040 con 0x557ab1dcc350 2024-09-10T22:44:08.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f43e7400640 1 -- 172.21.15.103:0/966199349 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0bd040 con 0x557ab1dcc350 2024-09-10T22:44:08.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f4404742000 1 -- 172.21.15.103:0/966199349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dcc350 msgr2=0x557ab1dcc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f4404742000 1 --2- 172.21.15.103:0/966199349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dcc350 0x557ab1dcc730 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f43ec019380 tx=0x7f43ec0b5000 comp rx=0 tx=0).stop 2024-09-10T22:44:08.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f4404742000 1 -- 172.21.15.103:0/966199349 shutdown_connections 2024-09-10T22:44:08.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f4404742000 1 --2- 172.21.15.103:0/966199349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1d857b0 0x557ab1d85b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f4404742000 1 --2- 172.21.15.103:0/966199349 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1dccc70 0x557ab1d85270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f4404742000 1 --2- 172.21.15.103:0/966199349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dcc350 0x557ab1dcc730 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f4404742000 1 -- 172.21.15.103:0/966199349 >> 172.21.15.103:0/966199349 conn(0x557ab1d7c610 msgr2=0x557ab1d83b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:08.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f4404742000 1 -- 172.21.15.103:0/966199349 shutdown_connections 2024-09-10T22:44:08.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.126+0000 7f4404742000 1 -- 172.21.15.103:0/966199349 wait complete. 2024-09-10T22:44:08.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f4404742000 1 -- start start 2024-09-10T22:44:08.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f4404742000 1 Processor -- start 2024-09-10T22:44:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f4404742000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1d857b0 0x557ab1dd30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f4404742000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dcc350 0x557ab1dd35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f4404742000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1dccc70 0x557ab1dd3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f4404742000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x557ab1b76a20 con 0x557ab1dcc350 2024-09-10T22:44:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f4404742000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557ab1b77ff0 con 0x557ab1dccc70 2024-09-10T22:44:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f4404742000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x557ab1b84c00 con 0x557ab1d857b0 2024-09-10T22:44:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f4404742000 10 client.0 _ll_register_callbacks cb 0x557ab1c84fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f43f9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dcc350 0x557ab1dd35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f43f9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dcc350 0x557ab1dd35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52266/0 (socket says 172.21.15.103:52266) 2024-09-10T22:44:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f43f9e00640 1 -- 172.21.15.103:0/1251783618 learned_addr learned my addr 172.21.15.103:0/1251783618 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f43fa800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1d857b0 0x557ab1dd30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f43fb200640 1 --2- 172.21.15.103:0/1251783618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1dccc70 0x557ab1dd3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f43f9e00640 1 -- 172.21.15.103:0/1251783618 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1d857b0 msgr2=0x557ab1dd30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f43f9e00640 1 --2- 172.21.15.103:0/1251783618 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1d857b0 0x557ab1dd30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f43f9e00640 1 -- 172.21.15.103:0/1251783618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1dccc70 msgr2=0x557ab1dd3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:08.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f43f9e00640 1 --2- 172.21.15.103:0/1251783618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1dccc70 0x557ab1dd3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f43f9e00640 1 -- 172.21.15.103:0/1251783618 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ab1b6b170 con 0x557ab1dcc350 2024-09-10T22:44:08.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f43f9e00640 1 --2- 172.21.15.103:0/1251783618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dcc350 0x557ab1dd35f0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f43e8007fd0 tx=0x7f43e80015a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfc1a6ec2688b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:08.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f43dbe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:08.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f43dbe00640 1 -- 172.21.15.103:0/1251783618 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e80067e0 con 0x557ab1dcc350 2024-09-10T22:44:08.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f43dbe00640 1 -- 172.21.15.103:0/1251783618 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f43e8010040 con 0x557ab1dcc350 2024-09-10T22:44:08.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f4404742000 1 -- 172.21.15.103:0/1251783618 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557ab1b650f0 con 0x557ab1dcc350 2024-09-10T22:44:08.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f43dbe00640 1 -- 172.21.15.103:0/1251783618 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f43e8006980 con 0x557ab1dcc350 2024-09-10T22:44:08.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f4404742000 10 client.7239 fetch_fsmap learned FSMap version 79 2024-09-10T22:44:08.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f4404742000 1 -- 172.21.15.103:0/1251783618 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x557ab1c53430 con 0x557ab1dcc350 2024-09-10T22:44:08.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f43dbe00640 1 -- 172.21.15.103:0/1251783618 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x557ab1b650f0 con 0x557ab1dcc350 2024-09-10T22:44:08.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f43dbe00640 1 -- 172.21.15.103:0/1251783618 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 79) ==== 3554+0+0 (secure 0 0 0) 0x7f43e8006b20 con 0x557ab1dcc350 2024-09-10T22:44:08.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f4404742000 10 client.7239 fetch_fsmap finished waiting for FSMap version 79 2024-09-10T22:44:08.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f4404742000 10 client.7239 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T22:44:08.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f4404742000 20 client.7239 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:08.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f4404742000 1 --2- 172.21.15.103:0/1251783618 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x557ab1ddb480 0x557ab1ddd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f4404742000 4 client.7239 mds_command: new command op to 6592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:08.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f4404742000 1 -- 172.21.15.103:0/1251783618 --> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ab1bdf9e0 con 0x557ab1ddb480 2024-09-10T22:44:08.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.130+0000 7f43fa800640 1 --2- 172.21.15.103:0/1251783618 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x557ab1ddb480 0x557ab1ddd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.134+0000 7f43fa800640 1 --2- 172.21.15.103:0/1251783618 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x557ab1ddb480 0x557ab1ddd870 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1a181320dcbfc6f5 server_cookie=6f0e053146b78ef8 in_seq=0 out_seq=0 2024-09-10T22:44:08.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.134+0000 7f43dbe00640 10 client.7239 ms_handle_connect on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:08.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.134+0000 7f43dbe00640 1 -- 172.21.15.103:0/1251783618 <== mds.1 v2:172.21.15.131:6834/134240629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557ab1bdf9e0 con 0x557ab1ddb480 2024-09-10T22:44:08.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.134+0000 7f43dbe00640 10 client.7239 handle_command_reply: tid=0 2024-09-10T22:44:08.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.134+0000 7f4404742000 1 client.7239 shutdown 2024-09-10T22:44:08.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.134+0000 7f4404742000 1 -- 172.21.15.103:0/1251783618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dcc350 msgr2=0x557ab1dd35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.134+0000 7f4404742000 1 --2- 172.21.15.103:0/1251783618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dcc350 0x557ab1dd35f0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f43e8007fd0 tx=0x7f43e80015a0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.134+0000 7f4404742000 1 -- 172.21.15.103:0/1251783618 shutdown_connections 2024-09-10T22:44:08.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.134+0000 7f4404742000 1 --2- 172.21.15.103:0/1251783618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1dccc70 0x557ab1dd3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.134+0000 7f4404742000 1 --2- 172.21.15.103:0/1251783618 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x557ab1ddb480 0x557ab1ddd870 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.134+0000 7f4404742000 1 --2- 172.21.15.103:0/1251783618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dcc350 0x557ab1dd35f0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.134+0000 7f4404742000 1 --2- 172.21.15.103:0/1251783618 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1d857b0 0x557ab1dd30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.134+0000 7f4404742000 1 -- 172.21.15.103:0/1251783618 >> 172.21.15.103:0/1251783618 conn(0x557ab1d7c610 msgr2=0x557ab1d84260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:08.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.134+0000 7f43dbe00640 0 client.7239 ms_handle_reset on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:08.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.134+0000 7f4404742000 1 -- 172.21.15.103:0/1251783618 shutdown_connections 2024-09-10T22:44:08.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.134+0000 7f4404742000 1 -- 172.21.15.103:0/1251783618 wait complete. 2024-09-10T22:44:08.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.134+0000 7f4404742000 20 client.7239 trim_cache size 0 max 16384 2024-09-10T22:44:08.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.150+0000 7f4404742000 1 Processor -- start 2024-09-10T22:44:08.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.150+0000 7f4404742000 1 -- start start 2024-09-10T22:44:08.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1d857b0 0x557ab1e3d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1dcc350 0x557ab1e3df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1dccc70 0x557ab1e3e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc203d00 con 0x557ab1d857b0 2024-09-10T22:44:08.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc204400 con 0x557ab1dcc350 2024-09-10T22:44:08.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f43fc15abf0 con 0x557ab1dccc70 2024-09-10T22:44:08.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f43fa800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1d857b0 0x557ab1e3d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f43fa800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1d857b0 0x557ab1e3d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52276/0 (socket says 172.21.15.103:52276) 2024-09-10T22:44:08.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f43fa800640 1 -- 172.21.15.103:0/947687066 learned_addr learned my addr 172.21.15.103:0/947687066 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:08.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f43f9e00640 1 --2- 172.21.15.103:0/947687066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1dcc350 0x557ab1e3df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f43fb200640 1 --2- 172.21.15.103:0/947687066 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1dccc70 0x557ab1e3e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f43fa800640 1 -- 172.21.15.103:0/947687066 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1dccc70 msgr2=0x557ab1e3e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:08.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f43fa800640 1 --2- 172.21.15.103:0/947687066 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1dccc70 0x557ab1e3e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f43fa800640 1 -- 172.21.15.103:0/947687066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1dcc350 msgr2=0x557ab1e3df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:08.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f43fa800640 1 --2- 172.21.15.103:0/947687066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1dcc350 0x557ab1e3df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f43fa800640 1 -- 172.21.15.103:0/947687066 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ab1b75c00 con 0x557ab1d857b0 2024-09-10T22:44:08.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f43f9e00640 1 --2- 172.21.15.103:0/947687066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1dcc350 0x557ab1e3df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:08.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f43fa800640 1 --2- 172.21.15.103:0/947687066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1d857b0 0x557ab1e3d9c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f43ec01c5a0 tx=0x7f43ec0b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459923137b386c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:08.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f43e6a00640 1 -- 172.21.15.103:0/947687066 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0c6070 con 0x557ab1d857b0 2024-09-10T22:44:08.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f43e6a00640 1 -- 172.21.15.103:0/947687066 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43ec0c7040 con 0x557ab1d857b0 2024-09-10T22:44:08.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f43e6a00640 1 -- 172.21.15.103:0/947687066 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0cbf90 con 0x557ab1d857b0 2024-09-10T22:44:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 -- 172.21.15.103:0/947687066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1d857b0 msgr2=0x557ab1e3d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 --2- 172.21.15.103:0/947687066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1d857b0 0x557ab1e3d9c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f43ec01c5a0 tx=0x7f43ec0b9040 comp rx=0 tx=0).stop 2024-09-10T22:44:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 -- 172.21.15.103:0/947687066 shutdown_connections 2024-09-10T22:44:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 --2- 172.21.15.103:0/947687066 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1dccc70 0x557ab1e3e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 --2- 172.21.15.103:0/947687066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1dcc350 0x557ab1e3df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 --2- 172.21.15.103:0/947687066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1d857b0 0x557ab1e3d9c0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 -- 172.21.15.103:0/947687066 >> 172.21.15.103:0/947687066 conn(0x557ab1d7c610 msgr2=0x557ab1d89df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 -- 172.21.15.103:0/947687066 shutdown_connections 2024-09-10T22:44:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 -- 172.21.15.103:0/947687066 wait complete. 2024-09-10T22:44:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 -- start start 2024-09-10T22:44:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 Processor -- start 2024-09-10T22:44:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1d857b0 0x557ab1de0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1dcc350 0x557ab1de12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dccc70 0x557ab1dfdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x557ab1bd5300 con 0x557ab1dccc70 2024-09-10T22:44:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557ab1bcffe0 con 0x557ab1d857b0 2024-09-10T22:44:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.154+0000 7f4404742000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x557ab1be0600 con 0x557ab1dcc350 2024-09-10T22:44:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 10 client.0 _ll_register_callbacks cb 0x7f43e8005050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43fb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dccc70 0x557ab1dfdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43fb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dccc70 0x557ab1dfdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52278/0 (socket says 172.21.15.103:52278) 2024-09-10T22:44:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43fb200640 1 -- 172.21.15.103:0/572349938 learned_addr learned my addr 172.21.15.103:0/572349938 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43fa800640 1 --2- 172.21.15.103:0/572349938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1d857b0 0x557ab1de0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43f9e00640 1 --2- 172.21.15.103:0/572349938 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1dcc350 0x557ab1de12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43fb200640 1 -- 172.21.15.103:0/572349938 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1dcc350 msgr2=0x557ab1de12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43fb200640 1 --2- 172.21.15.103:0/572349938 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1dcc350 0x557ab1de12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43fb200640 1 -- 172.21.15.103:0/572349938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1d857b0 msgr2=0x557ab1de0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43fb200640 1 --2- 172.21.15.103:0/572349938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1d857b0 0x557ab1de0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43fb200640 1 -- 172.21.15.103:0/572349938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ab1b56990 con 0x557ab1dccc70 2024-09-10T22:44:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43fb200640 1 --2- 172.21.15.103:0/572349938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dccc70 0x557ab1dfdd90 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f43f400c700 tx=0x7f43f405ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46360d61747a114d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43dbe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43dbe00640 1 -- 172.21.15.103:0/572349938 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f401f040 con 0x557ab1dccc70 2024-09-10T22:44:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43dbe00640 1 -- 172.21.15.103:0/572349938 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f43f405a210 con 0x557ab1dccc70 2024-09-10T22:44:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 1 -- 172.21.15.103:0/572349938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43ec0c7040 con 0x557ab1dccc70 2024-09-10T22:44:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43dbe00640 1 -- 172.21.15.103:0/572349938 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f43f405e8c0 con 0x557ab1dccc70 2024-09-10T22:44:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 10 client.7245 fetch_fsmap learned FSMap version 79 2024-09-10T22:44:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 1 -- 172.21.15.103:0/572349938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x557ab1b72140 con 0x557ab1dccc70 2024-09-10T22:44:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43dbe00640 1 -- 172.21.15.103:0/572349938 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43ec0c7040 con 0x557ab1dccc70 2024-09-10T22:44:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43dbe00640 1 -- 172.21.15.103:0/572349938 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 79) ==== 3554+0+0 (secure 0 0 0) 0x7f43f405a410 con 0x557ab1dccc70 2024-09-10T22:44:08.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 10 client.7245 fetch_fsmap finished waiting for FSMap version 79 2024-09-10T22:44:08.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 10 client.7245 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T22:44:08.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 20 client.7245 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:08.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 1 --2- 172.21.15.103:0/572349938 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x557ab1e415e0 0x557ab1e419c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 4 client.7245 mds_command: new command op to 6592 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-10T22:44:08.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 1 -- 172.21.15.103:0/572349938 --> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x557ab1bdb490 con 0x557ab1e415e0 2024-09-10T22:44:08.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43fa800640 1 --2- 172.21.15.103:0/572349938 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x557ab1e415e0 0x557ab1e419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43fa800640 1 --2- 172.21.15.103:0/572349938 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x557ab1e415e0 0x557ab1e419c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8341f197afb2ae79 server_cookie=9a7738f928a08e9c in_seq=0 out_seq=0 2024-09-10T22:44:08.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43dbe00640 10 client.7245 ms_handle_connect on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:08.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43dbe00640 1 -- 172.21.15.103:0/572349938 <== mds.1 v2:172.21.15.131:6834/134240629 1 ==== command_reply(tid 0: -18 Not rank 0) ==== 18+0+0 (crc 0 0 0) 0x557ab1bdb490 con 0x557ab1e415e0 2024-09-10T22:44:08.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43dbe00640 10 client.7245 handle_command_reply: tid=0 2024-09-10T22:44:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 1 client.7245 shutdown 2024-09-10T22:44:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 1 -- 172.21.15.103:0/572349938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dccc70 msgr2=0x557ab1dfdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 1 --2- 172.21.15.103:0/572349938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dccc70 0x557ab1dfdd90 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f43f400c700 tx=0x7f43f405ee60 comp rx=0 tx=0).stop 2024-09-10T22:44:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 1 -- 172.21.15.103:0/572349938 shutdown_connections 2024-09-10T22:44:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 1 --2- 172.21.15.103:0/572349938 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x557ab1e415e0 0x557ab1e419c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 1 --2- 172.21.15.103:0/572349938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ab1dccc70 0x557ab1dfdd90 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 1 --2- 172.21.15.103:0/572349938 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ab1dcc350 0x557ab1de12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f43dbe00640 0 client.7245 ms_handle_reset on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 1 --2- 172.21.15.103:0/572349938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ab1d857b0 0x557ab1de0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 1 -- 172.21.15.103:0/572349938 >> 172.21.15.103:0/572349938 conn(0x557ab1d7c610 msgr2=0x557ab1d8a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 1 -- 172.21.15.103:0/572349938 shutdown_connections 2024-09-10T22:44:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 1 -- 172.21.15.103:0/572349938 wait complete. 2024-09-10T22:44:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.158+0000 7f4404742000 20 client.7245 trim_cache size 0 max 16384 2024-09-10T22:44:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:Error EXDEV: Not rank 0 2024-09-10T22:44:08.169 DEBUG:teuthology.orchestra.run:got remote process result: 18 2024-09-10T22:44:08.170 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d scrub resume 2024-09-10T22:44:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.310+0000 7ff9dd000640 1 -- 172.21.15.103:0/3803488441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9d80cc120 msgr2=0x7ff9d80aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.310+0000 7ff9dd000640 1 --2- 172.21.15.103:0/3803488441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9d80cc120 0x7ff9d80aeb40 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80b4ee0 tx=0x7ff9c801ccd0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.310+0000 7ff9dd000640 1 -- 172.21.15.103:0/3803488441 shutdown_connections 2024-09-10T22:44:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.310+0000 7ff9dd000640 1 --2- 172.21.15.103:0/3803488441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9d80cf790 0x7ff9d80cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.310+0000 7ff9dd000640 1 --2- 172.21.15.103:0/3803488441 >> v2:172.21.15.131:3300/0 conn(0x7ff9d815c970 0x7ff9d8072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.310+0000 7ff9dd000640 1 --2- 172.21.15.103:0/3803488441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9d80cc120 0x7ff9d80aeb40 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.310+0000 7ff9dd000640 1 -- 172.21.15.103:0/3803488441 >> 172.21.15.103:0/3803488441 conn(0x7ff9d806cc00 msgr2=0x7ff9d806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.310+0000 7ff9dd000640 1 -- 172.21.15.103:0/3803488441 shutdown_connections 2024-09-10T22:44:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.310+0000 7ff9dd000640 1 -- 172.21.15.103:0/3803488441 wait complete. 2024-09-10T22:44:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.310+0000 7ff9dd000640 1 Processor -- start 2024-09-10T22:44:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.310+0000 7ff9dd000640 1 -- start start 2024-09-10T22:44:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9dd000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9d80cc120 0x7ff9d81501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9dd000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9d80cf790 0x7ff9d81573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9dd000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9d815c970 0x7ff9d8157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9dd000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d815f8a0 con 0x7ff9d815c970 2024-09-10T22:44:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9dd000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d815f720 con 0x7ff9d80cf790 2024-09-10T22:44:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9dd000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff9d815fa20 con 0x7ff9d80cc120 2024-09-10T22:44:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9d6800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9d815c970 0x7ff9d8157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9d6800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9d815c970 0x7ff9d8157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52284/0 (socket says 172.21.15.103:52284) 2024-09-10T22:44:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9d6800640 1 -- 172.21.15.103:0/3564981050 learned_addr learned my addr 172.21.15.103:0/3564981050 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9d5e00640 1 --2- 172.21.15.103:0/3564981050 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9d80cc120 0x7ff9d81501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9d5400640 1 --2- 172.21.15.103:0/3564981050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9d80cf790 0x7ff9d81573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9d6800640 1 -- 172.21.15.103:0/3564981050 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9d80cc120 msgr2=0x7ff9d81501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9d6800640 1 --2- 172.21.15.103:0/3564981050 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9d80cc120 0x7ff9d81501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9d6800640 1 -- 172.21.15.103:0/3564981050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9d80cf790 msgr2=0x7ff9d81573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9d6800640 1 --2- 172.21.15.103:0/3564981050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9d80cf790 0x7ff9d81573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9d6800640 1 -- 172.21.15.103:0/3564981050 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d8152cc0 con 0x7ff9d815c970 2024-09-10T22:44:08.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9d6800640 1 --2- 172.21.15.103:0/3564981050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9d815c970 0x7ff9d8157900 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000d6d0 tx=0x7ff9d000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:08.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9ce000640 1 -- 172.21.15.103:0/3564981050 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0017070 con 0x7ff9d815c970 2024-09-10T22:44:08.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9ce000640 1 -- 172.21.15.103:0/3564981050 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9d0005310 con 0x7ff9d815c970 2024-09-10T22:44:08.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9dd000640 1 -- 172.21.15.103:0/3564981050 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d8152fa0 con 0x7ff9d815c970 2024-09-10T22:44:08.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9ce000640 1 -- 172.21.15.103:0/3564981050 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0009820 con 0x7ff9d815c970 2024-09-10T22:44:08.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9dd000640 1 -- 172.21.15.103:0/3564981050 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d8151070 con 0x7ff9d815c970 2024-09-10T22:44:08.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.314+0000 7ff9ce000640 1 -- 172.21.15.103:0/3564981050 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff9d00099c0 con 0x7ff9d815c970 2024-09-10T22:44:08.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9e045c000 1 Processor -- start 2024-09-10T22:44:08.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9ce000640 1 --2- 172.21.15.103:0/3564981050 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff9b80725e0 0x7ff9b8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9e045c000 1 -- start start 2024-09-10T22:44:08.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9ce000640 1 -- 172.21.15.103:0/3564981050 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7ff9d0093430 con 0x7ff9d815c970 2024-09-10T22:44:08.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9d5e00640 1 --2- 172.21.15.103:0/3564981050 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff9b80725e0 0x7ff9b8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9e045c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e8324d1d0 0x558e833b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9e045c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e833b3830 0x558e833b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9e045c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833699b0 0x558e83369d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9e045c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558e831632c0 con 0x558e8324d1d0 2024-09-10T22:44:08.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9e045c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x558e831c0b90 con 0x558e833699b0 2024-09-10T22:44:08.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9e045c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x558e831affc0 con 0x558e833b3830 2024-09-10T22:44:08.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9d5e00640 1 --2- 172.21.15.103:0/3564981050 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff9b80725e0 0x7ff9b8074aa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80af000 tx=0x7ff9c801b510 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:08.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9d5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e8324d1d0 0x558e833b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9d6800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833699b0 0x558e83369d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9d5400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e833b3830 0x558e833b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9d6800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833699b0 0x558e83369d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:42268/0 (socket says 172.21.15.103:42268) 2024-09-10T22:44:08.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9d5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e8324d1d0 0x558e833b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52292/0 (socket says 172.21.15.103:52292) 2024-09-10T22:44:08.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9d6800640 1 -- 172.21.15.103:0/606101533 learned_addr learned my addr 172.21.15.103:0/606101533 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:08.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9d6800640 1 -- 172.21.15.103:0/606101533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e833b3830 msgr2=0x558e833b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:08.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9d6800640 1 --2- 172.21.15.103:0/606101533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e833b3830 0x558e833b3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9d6800640 1 -- 172.21.15.103:0/606101533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e8324d1d0 msgr2=0x558e833b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:08.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9d6800640 1 --2- 172.21.15.103:0/606101533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e8324d1d0 0x558e833b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9d6800640 1 -- 172.21.15.103:0/606101533 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e8314e1a0 con 0x558e833699b0 2024-09-10T22:44:08.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9d6800640 1 --2- 172.21.15.103:0/606101533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833699b0 0x558e83369d90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff9d005e2b0 tx=0x7ff9d005dda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=567e3ce119a61b5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:08.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9c2a00640 1 -- 172.21.15.103:0/606101533 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0020070 con 0x558e833699b0 2024-09-10T22:44:08.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9c2a00640 1 -- 172.21.15.103:0/606101533 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9d005e320 con 0x558e833699b0 2024-09-10T22:44:08.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.318+0000 7ff9c2a00640 1 -- 172.21.15.103:0/606101533 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0062d50 con 0x558e833699b0 2024-09-10T22:44:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 -- 172.21.15.103:0/606101533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833699b0 msgr2=0x558e83369d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 --2- 172.21.15.103:0/606101533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833699b0 0x558e83369d90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff9d005e2b0 tx=0x7ff9d005dda0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 -- 172.21.15.103:0/606101533 shutdown_connections 2024-09-10T22:44:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 --2- 172.21.15.103:0/606101533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833699b0 0x558e83369d90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 --2- 172.21.15.103:0/606101533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e833b3830 0x558e833b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 --2- 172.21.15.103:0/606101533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e8324d1d0 0x558e833b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 -- 172.21.15.103:0/606101533 >> 172.21.15.103:0/606101533 conn(0x558e82e6e880 msgr2=0x558e83363e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 -- 172.21.15.103:0/606101533 shutdown_connections 2024-09-10T22:44:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 -- 172.21.15.103:0/606101533 wait complete. 2024-09-10T22:44:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 -- start start 2024-09-10T22:44:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 Processor -- start 2024-09-10T22:44:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e8324d1d0 0x558e833a1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e833699b0 0x558e833a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833b3830 0x558e833a22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558e831554d0 con 0x558e833699b0 2024-09-10T22:44:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x558e831b3dd0 con 0x558e833b3830 2024-09-10T22:44:08.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x558e82e75620 con 0x558e8324d1d0 2024-09-10T22:44:08.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 10 client.0 _ll_register_callbacks cb 0x558e83186cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:08.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9d5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e833699b0 0x558e833a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9d5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e833699b0 0x558e833a1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52300/0 (socket says 172.21.15.103:52300) 2024-09-10T22:44:08.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9d5400640 1 -- 172.21.15.103:0/1935036470 learned_addr learned my addr 172.21.15.103:0/1935036470 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:08.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9d5e00640 1 --2- 172.21.15.103:0/1935036470 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e8324d1d0 0x558e833a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9d6800640 1 --2- 172.21.15.103:0/1935036470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833b3830 0x558e833a22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9d5400640 1 -- 172.21.15.103:0/1935036470 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e8324d1d0 msgr2=0x558e833a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:08.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9d5400640 1 --2- 172.21.15.103:0/1935036470 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e8324d1d0 0x558e833a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9d5400640 1 -- 172.21.15.103:0/1935036470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833b3830 msgr2=0x558e833a22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:08.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9d5400640 1 --2- 172.21.15.103:0/1935036470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833b3830 0x558e833a22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9d5400640 1 -- 172.21.15.103:0/1935036470 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e8327f720 con 0x558e833699b0 2024-09-10T22:44:08.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9d5400640 1 --2- 172.21.15.103:0/1935036470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e833699b0 0x558e833a1da0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400ba40 tx=0x7ff9c400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b082dcd9fcda2743 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9b7400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9b7400640 1 -- 172.21.15.103:0/1935036470 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4003e30 con 0x558e833699b0 2024-09-10T22:44:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9b7400640 1 -- 172.21.15.103:0/1935036470 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7ff9c4005020 con 0x558e833699b0 2024-09-10T22:44:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 -- 172.21.15.103:0/1935036470 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558e831482e0 con 0x558e833699b0 2024-09-10T22:44:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9b7400640 1 -- 172.21.15.103:0/1935036470 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7ff9c4005220 con 0x558e833699b0 2024-09-10T22:44:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 10 client.7257 fetch_fsmap learned FSMap version 79 2024-09-10T22:44:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.322+0000 7ff9e045c000 1 -- 172.21.15.103:0/1935036470 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x558e83235420 con 0x558e833699b0 2024-09-10T22:44:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9b7400640 1 -- 172.21.15.103:0/1935036470 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x558e831482e0 con 0x558e833699b0 2024-09-10T22:44:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9b7400640 1 -- 172.21.15.103:0/1935036470 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 79) ==== 3554+0+0 (secure 0 0 0) 0x7ff9c40053c0 con 0x558e833699b0 2024-09-10T22:44:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9e045c000 10 client.7257 fetch_fsmap finished waiting for FSMap version 79 2024-09-10T22:44:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9e045c000 10 client.7257 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T22:44:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9e045c000 20 client.7257 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9e045c000 1 --2- 172.21.15.103:0/1935036470 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x558e833a2cf0 0x558e833c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9e045c000 4 client.7257 mds_command: new command op to 6592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9e045c000 1 -- 172.21.15.103:0/1935036470 --> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e831c2ae0 con 0x558e833a2cf0 2024-09-10T22:44:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9d5e00640 1 --2- 172.21.15.103:0/1935036470 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x558e833a2cf0 0x558e833c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9d5e00640 1 --2- 172.21.15.103:0/1935036470 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x558e833a2cf0 0x558e833c4fc0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a0065eb9845447c server_cookie=590020d54ad8201b in_seq=0 out_seq=0 2024-09-10T22:44:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9b7400640 10 client.7257 ms_handle_connect on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9b7400640 1 -- 172.21.15.103:0/1935036470 <== mds.1 v2:172.21.15.131:6834/134240629 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558e831c2ae0 con 0x558e833a2cf0 2024-09-10T22:44:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9b7400640 10 client.7257 handle_command_reply: tid=0 2024-09-10T22:44:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9e045c000 1 client.7257 shutdown 2024-09-10T22:44:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9e045c000 1 -- 172.21.15.103:0/1935036470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e833699b0 msgr2=0x558e833a1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9e045c000 1 --2- 172.21.15.103:0/1935036470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e833699b0 0x558e833a1da0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400ba40 tx=0x7ff9c400bf00 comp rx=0 tx=0).stop 2024-09-10T22:44:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9e045c000 1 -- 172.21.15.103:0/1935036470 shutdown_connections 2024-09-10T22:44:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9e045c000 1 --2- 172.21.15.103:0/1935036470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833b3830 0x558e833a22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9e045c000 1 --2- 172.21.15.103:0/1935036470 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x558e833a2cf0 0x558e833c4fc0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9e045c000 1 --2- 172.21.15.103:0/1935036470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e833699b0 0x558e833a1da0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9e045c000 1 --2- 172.21.15.103:0/1935036470 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e8324d1d0 0x558e833a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9b7400640 0 client.7257 ms_handle_reset on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:08.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9e045c000 1 -- 172.21.15.103:0/1935036470 >> 172.21.15.103:0/1935036470 conn(0x558e82e6e880 msgr2=0x558e8336acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:08.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9e045c000 1 -- 172.21.15.103:0/1935036470 shutdown_connections 2024-09-10T22:44:08.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9e045c000 1 -- 172.21.15.103:0/1935036470 wait complete. 2024-09-10T22:44:08.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.326+0000 7ff9e045c000 20 client.7257 trim_cache size 0 max 16384 2024-09-10T22:44:08.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9e045c000 1 Processor -- start 2024-09-10T22:44:08.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9e045c000 1 -- start start 2024-09-10T22:44:08.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9e045c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e8324d1d0 0x558e83363d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9e045c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e833699b0 0x558e833642b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9e045c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833b3830 0x558e833c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9e045c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81569c0 con 0x558e833699b0 2024-09-10T22:44:08.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9e045c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x558e83147290 con 0x558e833b3830 2024-09-10T22:44:08.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9e045c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x558e8315b020 con 0x558e8324d1d0 2024-09-10T22:44:08.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9d5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e833699b0 0x558e833642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9d5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e833699b0 0x558e833642b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52304/0 (socket says 172.21.15.103:52304) 2024-09-10T22:44:08.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9d5e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e8324d1d0 0x558e83363d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9d5400640 1 -- 172.21.15.103:0/2332217690 learned_addr learned my addr 172.21.15.103:0/2332217690 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:08.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9d6800640 1 --2- 172.21.15.103:0/2332217690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833b3830 0x558e833c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9d5400640 1 -- 172.21.15.103:0/2332217690 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e8324d1d0 msgr2=0x558e83363d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:08.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9d5400640 1 --2- 172.21.15.103:0/2332217690 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e8324d1d0 0x558e83363d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9d5400640 1 -- 172.21.15.103:0/2332217690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833b3830 msgr2=0x558e833c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:08.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9d5400640 1 --2- 172.21.15.103:0/2332217690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833b3830 0x558e833c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9d5400640 1 -- 172.21.15.103:0/2332217690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e8320cae0 con 0x558e833699b0 2024-09-10T22:44:08.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9d5400640 1 --2- 172.21.15.103:0/2332217690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e833699b0 0x558e833642b0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4004340 tx=0x7ff9c4004460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322bad945a73e130 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:08.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9c2000640 1 -- 172.21.15.103:0/2332217690 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c402b020 con 0x558e833699b0 2024-09-10T22:44:08.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9c2000640 1 -- 172.21.15.103:0/2332217690 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9c4000e50 con 0x558e833699b0 2024-09-10T22:44:08.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9c2000640 1 -- 172.21.15.103:0/2332217690 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40053c0 con 0x558e833699b0 2024-09-10T22:44:08.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9e045c000 1 -- 172.21.15.103:0/2332217690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e833699b0 msgr2=0x558e833642b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9e045c000 1 --2- 172.21.15.103:0/2332217690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e833699b0 0x558e833642b0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4004340 tx=0x7ff9c4004460 comp rx=0 tx=0).stop 2024-09-10T22:44:08.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9e045c000 1 -- 172.21.15.103:0/2332217690 shutdown_connections 2024-09-10T22:44:08.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9e045c000 1 --2- 172.21.15.103:0/2332217690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833b3830 0x558e833c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9e045c000 1 --2- 172.21.15.103:0/2332217690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e833699b0 0x558e833642b0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9e045c000 1 --2- 172.21.15.103:0/2332217690 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e8324d1d0 0x558e83363d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9e045c000 1 -- 172.21.15.103:0/2332217690 >> 172.21.15.103:0/2332217690 conn(0x558e82e6e880 msgr2=0x558e83363660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:08.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9e045c000 1 -- 172.21.15.103:0/2332217690 shutdown_connections 2024-09-10T22:44:08.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9e045c000 1 -- 172.21.15.103:0/2332217690 wait complete. 2024-09-10T22:44:08.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.346+0000 7ff9e045c000 1 -- start start 2024-09-10T22:44:08.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 1 Processor -- start 2024-09-10T22:44:08.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e8324d1d0 0x558e83429350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833699b0 0x558e83429890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e833b3830 0x558e83429dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558e831b30e0 con 0x558e8324d1d0 2024-09-10T22:44:08.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x558e8317bc50 con 0x558e833699b0 2024-09-10T22:44:08.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x558e831b8400 con 0x558e833b3830 2024-09-10T22:44:08.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 10 client.0 _ll_register_callbacks cb 0x7ff9c4004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:08.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9d5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e8324d1d0 0x558e83429350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9d5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e8324d1d0 0x558e83429350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52314/0 (socket says 172.21.15.103:52314) 2024-09-10T22:44:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9d5e00640 1 -- 172.21.15.103:0/1176336124 learned_addr learned my addr 172.21.15.103:0/1176336124 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9d5400640 1 --2- 172.21.15.103:0/1176336124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833699b0 0x558e83429890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9d6800640 1 --2- 172.21.15.103:0/1176336124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e833b3830 0x558e83429dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9d5e00640 1 -- 172.21.15.103:0/1176336124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e833b3830 msgr2=0x558e83429dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9d5e00640 1 --2- 172.21.15.103:0/1176336124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e833b3830 0x558e83429dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9d5e00640 1 -- 172.21.15.103:0/1176336124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833699b0 msgr2=0x558e83429890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9d5e00640 1 --2- 172.21.15.103:0/1176336124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833699b0 0x558e83429890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9d5e00640 1 -- 172.21.15.103:0/1176336124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e8317a040 con 0x558e8324d1d0 2024-09-10T22:44:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9d5e00640 1 --2- 172.21.15.103:0/1176336124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e8324d1d0 0x558e83429350 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7ff9c801c740 tx=0x7ff9c80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46b960f34e6153d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9b7400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9b7400640 1 -- 172.21.15.103:0/1176336124 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c80d2070 con 0x558e8324d1d0 2024-09-10T22:44:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9b7400640 1 -- 172.21.15.103:0/1176336124 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7ff9c80043c0 con 0x558e8324d1d0 2024-09-10T22:44:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 1 -- 172.21.15.103:0/1176336124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9c4000e50 con 0x558e8324d1d0 2024-09-10T22:44:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9b7400640 1 -- 172.21.15.103:0/1176336124 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7ff9c80dd050 con 0x558e8324d1d0 2024-09-10T22:44:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 10 client.7263 fetch_fsmap learned FSMap version 79 2024-09-10T22:44:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 1 -- 172.21.15.103:0/1176336124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x558e83146620 con 0x558e8324d1d0 2024-09-10T22:44:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9b7400640 1 -- 172.21.15.103:0/1176336124 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9c4000e50 con 0x558e8324d1d0 2024-09-10T22:44:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9b7400640 1 -- 172.21.15.103:0/1176336124 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 79) ==== 3554+0+0 (secure 0 0 0) 0x7ff9c80e0020 con 0x558e8324d1d0 2024-09-10T22:44:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 10 client.7263 fetch_fsmap finished waiting for FSMap version 79 2024-09-10T22:44:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 10 client.7263 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T22:44:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 20 client.7263 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 1 --2- 172.21.15.103:0/1176336124 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x558e833c6460 0x558e833c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 4 client.7263 mds_command: new command op to 6592 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-10T22:44:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 1 -- 172.21.15.103:0/1176336124 --> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x558e831be590 con 0x558e833c6460 2024-09-10T22:44:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9d5400640 1 --2- 172.21.15.103:0/1176336124 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x558e833c6460 0x558e833c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9b7400640 10 client.7263 ms_handle_connect on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:08.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9d5400640 1 --2- 172.21.15.103:0/1176336124 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x558e833c6460 0x558e833c6840 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=270470fd8d1b0d19 server_cookie=1478efaacd9a1f15 in_seq=0 out_seq=0 2024-09-10T22:44:08.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9b7400640 1 -- 172.21.15.103:0/1176336124 <== mds.1 v2:172.21.15.131:6834/134240629 1 ==== command_reply(tid 0: -18 Not rank 0) ==== 18+0+0 (crc 0 0 0) 0x558e831be590 con 0x558e833c6460 2024-09-10T22:44:08.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9b7400640 10 client.7263 handle_command_reply: tid=0 2024-09-10T22:44:08.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 1 client.7263 shutdown 2024-09-10T22:44:08.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 1 -- 172.21.15.103:0/1176336124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e8324d1d0 msgr2=0x558e83429350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.350+0000 7ff9e045c000 1 --2- 172.21.15.103:0/1176336124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e8324d1d0 0x558e83429350 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7ff9c801c740 tx=0x7ff9c80095c0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.354+0000 7ff9e045c000 1 -- 172.21.15.103:0/1176336124 shutdown_connections 2024-09-10T22:44:08.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.354+0000 7ff9e045c000 1 --2- 172.21.15.103:0/1176336124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558e833b3830 0x558e83429dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.354+0000 7ff9e045c000 1 --2- 172.21.15.103:0/1176336124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e833699b0 0x558e83429890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.354+0000 7ff9e045c000 1 --2- 172.21.15.103:0/1176336124 >> [v2:172.21.15.131:6834/134240629,v1:172.21.15.131:6836/134240629] conn(0x558e833c6460 0x558e833c6840 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.354+0000 7ff9e045c000 1 --2- 172.21.15.103:0/1176336124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558e8324d1d0 0x558e83429350 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.354+0000 7ff9e045c000 1 -- 172.21.15.103:0/1176336124 >> 172.21.15.103:0/1176336124 conn(0x558e82e6e880 msgr2=0x558e83363e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:08.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.354+0000 7ff9b7400640 0 client.7263 ms_handle_reset on v2:172.21.15.131:6834/134240629 2024-09-10T22:44:08.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.354+0000 7ff9e045c000 1 -- 172.21.15.103:0/1176336124 shutdown_connections 2024-09-10T22:44:08.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.354+0000 7ff9e045c000 1 -- 172.21.15.103:0/1176336124 wait complete. 2024-09-10T22:44:08.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.354+0000 7ff9e045c000 20 client.7263 trim_cache size 0 max 16384 2024-09-10T22:44:08.361 INFO:teuthology.orchestra.run.smithi103.stderr:Error EXDEV: Not rank 0 2024-09-10T22:44:08.362 DEBUG:teuthology.orchestra.run:got remote process result: 18 2024-09-10T22:44:08.363 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T22:44:08.363 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:44:08.446 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:44:08.535 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T22:44:08.536 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:44:08.536 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:44:08.536 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:44:08.545 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:44:08.545 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:44:08.595 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T22:44:08.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.774+0000 7f0a6ba00640 1 -- 172.21.15.103:0/2957680616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a48004810 msgr2=0x7f0a48004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.774+0000 7f0a6ba00640 1 --2- 172.21.15.103:0/2957680616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a48004810 0x7f0a48004c90 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00c260 tx=0x7f0a4c01f680 comp rx=0 tx=0).stop 2024-09-10T22:44:08.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.774+0000 7f0a6ba00640 1 -- 172.21.15.103:0/2957680616 shutdown_connections 2024-09-10T22:44:08.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.774+0000 7f0a6ba00640 1 --2- 172.21.15.103:0/2957680616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a48004810 0x7f0a48004c90 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.774+0000 7f0a6ba00640 1 -- 172.21.15.103:0/2957680616 >> 172.21.15.103:0/2957680616 conn(0x7f0a6406cc00 msgr2=0x7f0a6406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:08.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.774+0000 7f0a6ba00640 1 -- 172.21.15.103:0/2957680616 shutdown_connections 2024-09-10T22:44:08.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.774+0000 7f0a6ba00640 1 -- 172.21.15.103:0/2957680616 wait complete. 2024-09-10T22:44:08.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a6ba00640 1 Processor -- start 2024-09-10T22:44:08.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a6ba00640 1 -- start start 2024-09-10T22:44:08.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a6ba00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a48004810 0x7f0a64151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a6ba00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a641e15b0 0x7f0a640b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a6ba00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a641e1a30 0x7f0a640b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a6ba00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6406ef60 con 0x7f0a641e15b0 2024-09-10T22:44:08.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a6ba00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6406ede0 con 0x7f0a641e1a30 2024-09-10T22:44:08.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a6ba00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0a6406f0e0 con 0x7f0a48004810 2024-09-10T22:44:08.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a5be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a641e15b0 0x7f0a640b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a5be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a641e15b0 0x7f0a640b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52318/0 (socket says 172.21.15.103:52318) 2024-09-10T22:44:08.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a5be00640 1 -- 172.21.15.103:0/3201953532 learned_addr learned my addr 172.21.15.103:0/3201953532 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:08.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a69000640 1 --2- 172.21.15.103:0/3201953532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a48004810 0x7f0a64151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a69a00640 1 --2- 172.21.15.103:0/3201953532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a641e1a30 0x7f0a640b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a5be00640 1 -- 172.21.15.103:0/3201953532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a48004810 msgr2=0x7f0a64151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a5be00640 1 --2- 172.21.15.103:0/3201953532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a48004810 0x7f0a64151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a5be00640 1 -- 172.21.15.103:0/3201953532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a641e1a30 msgr2=0x7f0a640b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a5be00640 1 --2- 172.21.15.103:0/3201953532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a641e1a30 0x7f0a640b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a5be00640 1 -- 172.21.15.103:0/3201953532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a64151c80 con 0x7f0a641e15b0 2024-09-10T22:44:08.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a5be00640 1 --2- 172.21.15.103:0/3201953532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a641e15b0 0x7f0a640b0450 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c026390 tx=0x7f0a4c006ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:08.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a61600640 1 -- 172.21.15.103:0/3201953532 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c0be070 con 0x7f0a641e15b0 2024-09-10T22:44:08.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a61600640 1 -- 172.21.15.103:0/3201953532 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a4c0b4040 con 0x7f0a641e15b0 2024-09-10T22:44:08.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a6ba00640 1 -- 172.21.15.103:0/3201953532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a6415a400 con 0x7f0a641e15b0 2024-09-10T22:44:08.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a61600640 1 -- 172.21.15.103:0/3201953532 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c0b3070 con 0x7f0a641e15b0 2024-09-10T22:44:08.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.778+0000 7f0a6ba00640 1 -- 172.21.15.103:0/3201953532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a641f59b0 con 0x7f0a641e15b0 2024-09-10T22:44:08.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.782+0000 7f0a6ba00640 1 -- 172.21.15.103:0/3201953532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a640736f0 con 0x7f0a641e15b0 2024-09-10T22:44:08.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.782+0000 7f0a61600640 1 -- 172.21.15.103:0/3201953532 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0a4c0ad030 con 0x7f0a641e15b0 2024-09-10T22:44:08.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.782+0000 7f0a61600640 1 --2- 172.21.15.103:0/3201953532 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0a40072610 0x7f0a40074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:08.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.782+0000 7f0a61600640 1 -- 172.21.15.103:0/3201953532 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f0a4c130210 con 0x7f0a641e15b0 2024-09-10T22:44:08.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.782+0000 7f0a69000640 1 --2- 172.21.15.103:0/3201953532 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0a40072610 0x7f0a40074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:08.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.782+0000 7f0a69000640 1 --2- 172.21.15.103:0/3201953532 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0a40072610 0x7f0a40074ad0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0a54000c10 tx=0x7f0a54006cb0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:08.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.786+0000 7f0a61600640 1 -- 172.21.15.103:0/3201953532 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0a4c0ab070 con 0x7f0a641e15b0 2024-09-10T22:44:08.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.962+0000 7f0a6ba00640 1 -- 172.21.15.103:0/3201953532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0a640afc90 con 0x7f0a641e15b0 2024-09-10T22:44:08.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.966+0000 7f0a61600640 1 -- 172.21.15.103:0/3201953532 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v81) ==== 80+0+0 (secure 0 0 0) 0x7f0a4c019430 con 0x7f0a641e15b0 2024-09-10T22:44:08.968 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T22:44:08.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.966+0000 7f0a6ba00640 1 -- 172.21.15.103:0/3201953532 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0a40072610 msgr2=0x7f0a40074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.966+0000 7f0a6ba00640 1 --2- 172.21.15.103:0/3201953532 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0a40072610 0x7f0a40074ad0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0a54000c10 tx=0x7f0a54006cb0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.966+0000 7f0a6ba00640 1 -- 172.21.15.103:0/3201953532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a641e15b0 msgr2=0x7f0a640b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:08.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.966+0000 7f0a6ba00640 1 --2- 172.21.15.103:0/3201953532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a641e15b0 0x7f0a640b0450 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c026390 tx=0x7f0a4c006ca0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.966+0000 7f0a6ba00640 1 -- 172.21.15.103:0/3201953532 shutdown_connections 2024-09-10T22:44:08.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.966+0000 7f0a6ba00640 1 --2- 172.21.15.103:0/3201953532 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0a40072610 0x7f0a40074ad0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.966+0000 7f0a6ba00640 1 --2- 172.21.15.103:0/3201953532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a641e1a30 0x7f0a640b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.966+0000 7f0a6ba00640 1 --2- 172.21.15.103:0/3201953532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a641e15b0 0x7f0a640b0450 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.966+0000 7f0a6ba00640 1 --2- 172.21.15.103:0/3201953532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a48004810 0x7f0a64151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:08.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.966+0000 7f0a6ba00640 1 -- 172.21.15.103:0/3201953532 >> 172.21.15.103:0/3201953532 conn(0x7f0a6406cc00 msgr2=0x7f0a6414e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:08.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.966+0000 7f0a6ba00640 1 -- 172.21.15.103:0/3201953532 shutdown_connections 2024-09-10T22:44:08.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:08.966+0000 7f0a6ba00640 1 -- 172.21.15.103:0/3201953532 wait complete. 2024-09-10T22:44:08.988 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-09-10T22:44:08.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:08.988 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T22:44:09.005 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[44639]: fuse finished with error 0 and tester_r 0 2024-09-10T22:44:09.008 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:44:09.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:09.009 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T22:44:09.169 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:44:09.169 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:44:09.169 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:44:09.179 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:44:09.179 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:44:09.179 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:44:09.180 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:44:09.220 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350248k,nr_inodes=4087562,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3542 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T22:44:09.220 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:44:09.220 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:44:09.220 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:44:09.229 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:44:09.229 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:44:09.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.398+0000 7f6024e00640 1 -- 172.21.15.103:0/1686067702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60200717a0 msgr2=0x7f60200afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:09.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.398+0000 7f6024e00640 1 --2- 172.21.15.103:0/1686067702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60200717a0 0x7f60200afc60 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f60200b14a0 tx=0x7f601801cc50 comp rx=0 tx=0).stop 2024-09-10T22:44:09.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f6024e00640 1 -- 172.21.15.103:0/1686067702 shutdown_connections 2024-09-10T22:44:09.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f6024e00640 1 --2- 172.21.15.103:0/1686067702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60200717a0 0x7f60200afc60 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:09.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f6024e00640 1 --2- 172.21.15.103:0/1686067702 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60200d25f0 0x7f60200af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:09.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f6024e00640 1 -- 172.21.15.103:0/1686067702 >> 172.21.15.103:0/1686067702 conn(0x7f60200d1ad0 msgr2=0x7f60200d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:09.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f6024e00640 1 -- 172.21.15.103:0/1686067702 shutdown_connections 2024-09-10T22:44:09.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f6024e00640 1 -- 172.21.15.103:0/1686067702 wait complete. 2024-09-10T22:44:09.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f6024e00640 1 Processor -- start 2024-09-10T22:44:09.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f6024e00640 1 -- start start 2024-09-10T22:44:09.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f6024e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60200717a0 0x7f602014af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:09.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f6024e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60200cfda0 0x7f6020158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:09.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f6024e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60200d25f0 0x7f60200c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:09.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f6024e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f60201690b0 con 0x7f60200d25f0 2024-09-10T22:44:09.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f6024e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6020168f30 con 0x7f60200717a0 2024-09-10T22:44:09.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f6024e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6020169230 con 0x7f60200cfda0 2024-09-10T22:44:09.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f601e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60200d25f0 0x7f60200c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:09.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f601e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60200d25f0 0x7f60200c9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52330/0 (socket says 172.21.15.103:52330) 2024-09-10T22:44:09.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f601e800640 1 -- 172.21.15.103:0/3508719336 learned_addr learned my addr 172.21.15.103:0/3508719336 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:09.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f6015400640 1 --2- 172.21.15.103:0/3508719336 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60200cfda0 0x7f6020158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:09.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f601de00640 1 --2- 172.21.15.103:0/3508719336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60200717a0 0x7f602014af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:09.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f601e800640 1 -- 172.21.15.103:0/3508719336 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60200cfda0 msgr2=0x7f6020158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:09.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f601e800640 1 --2- 172.21.15.103:0/3508719336 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60200cfda0 0x7f6020158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:09.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f601e800640 1 -- 172.21.15.103:0/3508719336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60200717a0 msgr2=0x7f602014af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:09.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f601e800640 1 --2- 172.21.15.103:0/3508719336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60200717a0 0x7f602014af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:09.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f601e800640 1 -- 172.21.15.103:0/3508719336 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60200c8d40 con 0x7f60200d25f0 2024-09-10T22:44:09.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.402+0000 7f601e800640 1 --2- 172.21.15.103:0/3508719336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60200d25f0 0x7f60200c9b00 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f601801d130 tx=0x7f6018005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:09.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.406+0000 7f6016a00640 1 -- 172.21.15.103:0/3508719336 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60180b2040 con 0x7f60200d25f0 2024-09-10T22:44:09.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.406+0000 7f6016a00640 1 -- 172.21.15.103:0/3508719336 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60180bb070 con 0x7f60200d25f0 2024-09-10T22:44:09.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.406+0000 7f6016a00640 1 -- 172.21.15.103:0/3508719336 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018004350 con 0x7f60200d25f0 2024-09-10T22:44:09.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.406+0000 7f6024e00640 1 -- 172.21.15.103:0/3508719336 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60200c9020 con 0x7f60200d25f0 2024-09-10T22:44:09.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.406+0000 7f6024e00640 1 -- 172.21.15.103:0/3508719336 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f602015a870 con 0x7f60200d25f0 2024-09-10T22:44:09.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.406+0000 7f6024e00640 1 -- 172.21.15.103:0/3508719336 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f602015eca0 con 0x7f60200d25f0 2024-09-10T22:44:09.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.406+0000 7f6016a00640 1 -- 172.21.15.103:0/3508719336 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f60180b5070 con 0x7f60200d25f0 2024-09-10T22:44:09.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.406+0000 7f6016a00640 1 --2- 172.21.15.103:0/3508719336 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5ffc0725e0 0x7f5ffc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:09.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.406+0000 7f6016a00640 1 -- 172.21.15.103:0/3508719336 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f601812db00 con 0x7f60200d25f0 2024-09-10T22:44:09.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.406+0000 7f601de00640 1 --2- 172.21.15.103:0/3508719336 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5ffc0725e0 0x7f5ffc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:09.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.410+0000 7f601de00640 1 --2- 172.21.15.103:0/3508719336 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5ffc0725e0 0x7f5ffc074aa0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6010000f70 tx=0x7f6010009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:09.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.410+0000 7f6016a00640 1 -- 172.21.15.103:0/3508719336 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6018016990 con 0x7f60200d25f0 2024-09-10T22:44:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.610+0000 7f6024e00640 1 -- 172.21.15.103:0/3508719336 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60200b7020 con 0x7f60200d25f0 2024-09-10T22:44:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.610+0000 7f6016a00640 1 -- 172.21.15.103:0/3508719336 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+5273 (secure 0 0 0) 0x7f601812de20 con 0x7f60200d25f0 2024-09-10T22:44:09.616 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:09.616 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":79,"btime":"2024-09-10T22:44:05:060646+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6047,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/2402286786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2402286786},{"type":"v1","addr":"172.21.15.103:6834","nonce":2402286786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:43:33.337095+0000","modified":"2024-09-10T22:44:04.465247+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6873,"mds_1":6592,"mds_2":6053},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6053":{"gid":6053,"name":"b","rank":2,"incarnation":76,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6837/4254729752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":4254729752},{"type":"v1","addr":"172.21.15.131:6837","nonce":4254729752}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6592":{"gid":6592,"name":"d","rank":1,"incarnation":74,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6836/134240629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":134240629},{"type":"v1","addr":"172.21.15.131:6836","nonce":134240629}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6873":{"gid":6873,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/249667943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":249667943},{"type":"v1","addr":"172.21.15.103:6835","nonce":249667943}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6873,"qdb_cluster":[6053,6592,6873]},"id":5}]} 2024-09-10T22:44:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 79 2024-09-10T22:44:09.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.614+0000 7f6024e00640 1 -- 172.21.15.103:0/3508719336 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5ffc0725e0 msgr2=0x7f5ffc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:09.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.614+0000 7f6024e00640 1 --2- 172.21.15.103:0/3508719336 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5ffc0725e0 0x7f5ffc074aa0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6010000f70 tx=0x7f6010009040 comp rx=0 tx=0).stop 2024-09-10T22:44:09.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.614+0000 7f6024e00640 1 -- 172.21.15.103:0/3508719336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60200d25f0 msgr2=0x7f60200c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:09.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.614+0000 7f6024e00640 1 --2- 172.21.15.103:0/3508719336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60200d25f0 0x7f60200c9b00 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f601801d130 tx=0x7f6018005ae0 comp rx=0 tx=0).stop 2024-09-10T22:44:09.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.614+0000 7f6024e00640 1 -- 172.21.15.103:0/3508719336 shutdown_connections 2024-09-10T22:44:09.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.614+0000 7f6024e00640 1 --2- 172.21.15.103:0/3508719336 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5ffc0725e0 0x7f5ffc074aa0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:09.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.614+0000 7f6024e00640 1 --2- 172.21.15.103:0/3508719336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60200d25f0 0x7f60200c9b00 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:09.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.614+0000 7f6024e00640 1 --2- 172.21.15.103:0/3508719336 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60200cfda0 0x7f6020158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:09.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.614+0000 7f6024e00640 1 --2- 172.21.15.103:0/3508719336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60200717a0 0x7f602014af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:09.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.614+0000 7f6024e00640 1 -- 172.21.15.103:0/3508719336 >> 172.21.15.103:0/3508719336 conn(0x7f60200d1ad0 msgr2=0x7f60200cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:09.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.614+0000 7f6024e00640 1 -- 172.21.15.103:0/3508719336 shutdown_connections 2024-09-10T22:44:09.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.614+0000 7f6024e00640 1 -- 172.21.15.103:0/3508719336 wait complete. 2024-09-10T22:44:09.637 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:44:09.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.774+0000 7f7543000640 1 -- 172.21.15.103:0/2059875244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f753c06e820 msgr2=0x7f753c0d20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:09.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.774+0000 7f7543000640 1 --2- 172.21.15.103:0/2059875244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f753c06e820 0x7f753c0d20a0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f7528009900 tx=0x7f752801c850 comp rx=0 tx=0).stop 2024-09-10T22:44:09.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.774+0000 7f7543000640 1 -- 172.21.15.103:0/2059875244 shutdown_connections 2024-09-10T22:44:09.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.774+0000 7f7543000640 1 --2- 172.21.15.103:0/2059875244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f753c06e820 0x7f753c0d20a0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:09.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.774+0000 7f7543000640 1 -- 172.21.15.103:0/2059875244 >> 172.21.15.103:0/2059875244 conn(0x7f753c0d3ac0 msgr2=0x7f753c0d3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:09.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.774+0000 7f7543000640 1 -- 172.21.15.103:0/2059875244 shutdown_connections 2024-09-10T22:44:09.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.774+0000 7f7543000640 1 -- 172.21.15.103:0/2059875244 wait complete. 2024-09-10T22:44:09.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.774+0000 7f7543000640 1 Processor -- start 2024-09-10T22:44:09.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.774+0000 7f7543000640 1 -- start start 2024-09-10T22:44:09.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7543000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f753c06e200 0x7f753c0c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:09.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7543000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f753c06e820 0x7f753c158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:09.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7543000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f753c1611b0 0x7f753c14c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:09.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7543000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f753c16c580 con 0x7f753c06e200 2024-09-10T22:44:09.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7543000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f753c16c400 con 0x7f753c06e820 2024-09-10T22:44:09.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7543000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f753c16c700 con 0x7f753c1611b0 2024-09-10T22:44:09.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7541c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f753c06e200 0x7f753c0c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:09.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7541c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f753c06e200 0x7f753c0c6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52338/0 (socket says 172.21.15.103:52338) 2024-09-10T22:44:09.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7541c00640 1 -- 172.21.15.103:0/2389148880 learned_addr learned my addr 172.21.15.103:0/2389148880 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:09.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7541200640 1 --2- 172.21.15.103:0/2389148880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f753c06e820 0x7f753c158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:09.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7542600640 1 --2- 172.21.15.103:0/2389148880 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f753c1611b0 0x7f753c14c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:09.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7541c00640 1 -- 172.21.15.103:0/2389148880 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f753c1611b0 msgr2=0x7f753c14c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:09.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7541c00640 1 --2- 172.21.15.103:0/2389148880 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f753c1611b0 0x7f753c14c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:09.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7541c00640 1 -- 172.21.15.103:0/2389148880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f753c06e820 msgr2=0x7f753c158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:09.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7541c00640 1 --2- 172.21.15.103:0/2389148880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f753c06e820 0x7f753c158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:09.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7541c00640 1 -- 172.21.15.103:0/2389148880 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753c149200 con 0x7f753c06e200 2024-09-10T22:44:09.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7541c00640 1 --2- 172.21.15.103:0/2389148880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f753c06e200 0x7f753c0c6d60 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f7530001ec0 tx=0x7f753000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:09.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7539600640 1 -- 172.21.15.103:0/2389148880 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530017070 con 0x7f753c06e200 2024-09-10T22:44:09.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7539600640 1 -- 172.21.15.103:0/2389148880 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7530003600 con 0x7f753c06e200 2024-09-10T22:44:09.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7543000640 1 -- 172.21.15.103:0/2389148880 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753c149470 con 0x7f753c06e200 2024-09-10T22:44:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7539600640 1 -- 172.21.15.103:0/2389148880 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530003a50 con 0x7f753c06e200 2024-09-10T22:44:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7543000640 1 -- 172.21.15.103:0/2389148880 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f753c14ce30 con 0x7f753c06e200 2024-09-10T22:44:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7543000640 1 -- 172.21.15.103:0/2389148880 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f753c0b8680 con 0x7f753c06e200 2024-09-10T22:44:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.778+0000 7f7539600640 1 -- 172.21.15.103:0/2389148880 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7530003bf0 con 0x7f753c06e200 2024-09-10T22:44:09.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.782+0000 7f7539600640 1 --2- 172.21.15.103:0/2389148880 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f751c072610 0x7f751c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:09.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.782+0000 7f7539600640 1 -- 172.21.15.103:0/2389148880 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f75300928e0 con 0x7f753c06e200 2024-09-10T22:44:09.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.782+0000 7f7541200640 1 --2- 172.21.15.103:0/2389148880 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f751c072610 0x7f751c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:09.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.782+0000 7f7541200640 1 --2- 172.21.15.103:0/2389148880 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f751c072610 0x7f751c074ad0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f75280af000 tx=0x7f752801b090 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:09.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.786+0000 7f7539600640 1 -- 172.21.15.103:0/2389148880 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f753005d7d0 con 0x7f753c06e200 2024-09-10T22:44:09.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.986+0000 7f7543000640 1 -- 172.21.15.103:0/2389148880 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f753c0b83a0 con 0x7f753c06e200 2024-09-10T22:44:09.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.986+0000 7f7539600640 1 -- 172.21.15.103:0/2389148880 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+5273 (secure 0 0 0) 0x7f7530062200 con 0x7f753c06e200 2024-09-10T22:44:09.990 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:09.990 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":79,"btime":"2024-09-10T22:44:05:060646+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6047,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/2402286786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2402286786},{"type":"v1","addr":"172.21.15.103:6834","nonce":2402286786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:43:33.337095+0000","modified":"2024-09-10T22:44:04.465247+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6873,"mds_1":6592,"mds_2":6053},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6053":{"gid":6053,"name":"b","rank":2,"incarnation":76,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6837/4254729752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":4254729752},{"type":"v1","addr":"172.21.15.131:6837","nonce":4254729752}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6592":{"gid":6592,"name":"d","rank":1,"incarnation":74,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6836/134240629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":134240629},{"type":"v1","addr":"172.21.15.131:6836","nonce":134240629}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6873":{"gid":6873,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/249667943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":249667943},{"type":"v1","addr":"172.21.15.103:6835","nonce":249667943}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6873,"qdb_cluster":[6053,6592,6873]},"id":5}]} 2024-09-10T22:44:09.991 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 79 2024-09-10T22:44:09.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.990+0000 7f7543000640 1 -- 172.21.15.103:0/2389148880 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f751c072610 msgr2=0x7f751c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:09.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.990+0000 7f7543000640 1 --2- 172.21.15.103:0/2389148880 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f751c072610 0x7f751c074ad0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f75280af000 tx=0x7f752801b090 comp rx=0 tx=0).stop 2024-09-10T22:44:09.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.990+0000 7f7543000640 1 -- 172.21.15.103:0/2389148880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f753c06e200 msgr2=0x7f753c0c6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:09.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.990+0000 7f7543000640 1 --2- 172.21.15.103:0/2389148880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f753c06e200 0x7f753c0c6d60 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f7530001ec0 tx=0x7f753000c890 comp rx=0 tx=0).stop 2024-09-10T22:44:09.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.990+0000 7f7543000640 1 -- 172.21.15.103:0/2389148880 shutdown_connections 2024-09-10T22:44:09.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.990+0000 7f7543000640 1 --2- 172.21.15.103:0/2389148880 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f751c072610 0x7f751c074ad0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:09.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.990+0000 7f7543000640 1 --2- 172.21.15.103:0/2389148880 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f753c1611b0 0x7f753c14c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:09.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.990+0000 7f7543000640 1 --2- 172.21.15.103:0/2389148880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f753c06e820 0x7f753c158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:09.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.990+0000 7f7543000640 1 --2- 172.21.15.103:0/2389148880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f753c06e200 0x7f753c0c6d60 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:09.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.990+0000 7f7543000640 1 -- 172.21.15.103:0/2389148880 >> 172.21.15.103:0/2389148880 conn(0x7f753c0d3ac0 msgr2=0x7f753c0b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:09.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.990+0000 7f7543000640 1 -- 172.21.15.103:0/2389148880 shutdown_connections 2024-09-10T22:44:09.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:09.990+0000 7f7543000640 1 -- 172.21.15.103:0/2389148880 wait complete. 2024-09-10T22:44:10.011 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:44:10.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.150+0000 7f6e89600640 1 -- 172.21.15.103:0/176502696 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e8415ece0 msgr2=0x7f6e8406f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:10.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.150+0000 7f6e89600640 1 --2- 172.21.15.103:0/176502696 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e8415ece0 0x7f6e8406f450 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f6e840730c0 tx=0x7f6e7401c8c0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.150+0000 7f6e89600640 1 -- 172.21.15.103:0/176502696 shutdown_connections 2024-09-10T22:44:10.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.150+0000 7f6e89600640 1 --2- 172.21.15.103:0/176502696 >> v2:172.21.15.131:3300/0 conn(0x7f6e840afcb0 0x7f6e840cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.150+0000 7f6e89600640 1 --2- 172.21.15.103:0/176502696 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e8415ece0 0x7f6e8406f450 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.150+0000 7f6e89600640 1 -- 172.21.15.103:0/176502696 >> 172.21.15.103:0/176502696 conn(0x7f6e840d0780 msgr2=0x7f6e840d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:10.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.150+0000 7f6e89600640 1 -- 172.21.15.103:0/176502696 shutdown_connections 2024-09-10T22:44:10.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.150+0000 7f6e89600640 1 -- 172.21.15.103:0/176502696 wait complete. 2024-09-10T22:44:10.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.150+0000 7f6e89600640 1 Processor -- start 2024-09-10T22:44:10.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.150+0000 7f6e89600640 1 -- start start 2024-09-10T22:44:10.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e89600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e840afcb0 0x7f6e84157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:10.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e89600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e840ccc10 0x7f6e8414af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:10.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e89600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e8415ece0 0x7f6e84157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:10.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e89600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6e841687d0 con 0x7f6e840ccc10 2024-09-10T22:44:10.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e89600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6e84168650 con 0x7f6e8415ece0 2024-09-10T22:44:10.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e89600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6e84168950 con 0x7f6e840afcb0 2024-09-10T22:44:10.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e7b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e840ccc10 0x7f6e8414af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:10.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e7b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e840ccc10 0x7f6e8414af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52354/0 (socket says 172.21.15.103:52354) 2024-09-10T22:44:10.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e7b400640 1 -- 172.21.15.103:0/4178444996 learned_addr learned my addr 172.21.15.103:0/4178444996 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:10.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e83e00640 1 --2- 172.21.15.103:0/4178444996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e840afcb0 0x7f6e84157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:10.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e88c00640 1 --2- 172.21.15.103:0/4178444996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e8415ece0 0x7f6e84157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:10.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e7b400640 1 -- 172.21.15.103:0/4178444996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e840afcb0 msgr2=0x7f6e84157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:10.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e7b400640 1 --2- 172.21.15.103:0/4178444996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e840afcb0 0x7f6e84157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e7b400640 1 -- 172.21.15.103:0/4178444996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e8415ece0 msgr2=0x7f6e84157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:10.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e7b400640 1 --2- 172.21.15.103:0/4178444996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e8415ece0 0x7f6e84157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e7b400640 1 -- 172.21.15.103:0/4178444996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e84158980 con 0x7f6e840ccc10 2024-09-10T22:44:10.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e88c00640 1 --2- 172.21.15.103:0/4178444996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e8415ece0 0x7f6e84157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:10.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e7b400640 1 --2- 172.21.15.103:0/4178444996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e840ccc10 0x7f6e8414af80 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00d950 tx=0x7f6e6c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:10.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e80c00640 1 -- 172.21.15.103:0/4178444996 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c017070 con 0x7f6e840ccc10 2024-09-10T22:44:10.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e80c00640 1 -- 172.21.15.103:0/4178444996 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e6c009d20 con 0x7f6e840ccc10 2024-09-10T22:44:10.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e80c00640 1 -- 172.21.15.103:0/4178444996 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c0106c0 con 0x7f6e840ccc10 2024-09-10T22:44:10.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e89600640 1 -- 172.21.15.103:0/4178444996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e84156e30 con 0x7f6e840ccc10 2024-09-10T22:44:10.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e89600640 1 -- 172.21.15.103:0/4178444996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e84158c60 con 0x7f6e840ccc10 2024-09-10T22:44:10.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.154+0000 7f6e89600640 1 -- 172.21.15.103:0/4178444996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e840cc6d0 con 0x7f6e840ccc10 2024-09-10T22:44:10.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.158+0000 7f6e80c00640 1 -- 172.21.15.103:0/4178444996 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6e6c010860 con 0x7f6e840ccc10 2024-09-10T22:44:10.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.158+0000 7f6e80c00640 1 --2- 172.21.15.103:0/4178444996 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6e600725e0 0x7f6e60074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:10.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.158+0000 7f6e80c00640 1 -- 172.21.15.103:0/4178444996 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f6e6c0937b0 con 0x7f6e840ccc10 2024-09-10T22:44:10.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.158+0000 7f6e83e00640 1 --2- 172.21.15.103:0/4178444996 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6e600725e0 0x7f6e60074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:10.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.158+0000 7f6e83e00640 1 --2- 172.21.15.103:0/4178444996 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6e600725e0 0x7f6e60074aa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6e740af000 tx=0x7f6e740a7040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:10.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.162+0000 7f6e80c00640 1 -- 172.21.15.103:0/4178444996 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6e6c05e610 con 0x7f6e840ccc10 2024-09-10T22:44:10.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.326+0000 7f6e89600640 1 -- 172.21.15.103:0/4178444996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e84155f20 con 0x7f6e840ccc10 2024-09-10T22:44:10.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.326+0000 7f6e80c00640 1 -- 172.21.15.103:0/4178444996 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+17065 (secure 0 0 0) 0x7f6e6c063040 con 0x7f6e840ccc10 2024-09-10T22:44:10.331 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:10.332 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":81,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:43:34.948634+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:43:31.019531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-10T22:43:32.295197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:44:10.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.330+0000 7f6e89600640 1 -- 172.21.15.103:0/4178444996 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6e600725e0 msgr2=0x7f6e60074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:10.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.330+0000 7f6e89600640 1 --2- 172.21.15.103:0/4178444996 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6e600725e0 0x7f6e60074aa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6e740af000 tx=0x7f6e740a7040 comp rx=0 tx=0).stop 2024-09-10T22:44:10.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.330+0000 7f6e89600640 1 -- 172.21.15.103:0/4178444996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e840ccc10 msgr2=0x7f6e8414af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:10.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.330+0000 7f6e89600640 1 --2- 172.21.15.103:0/4178444996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e840ccc10 0x7f6e8414af80 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00d950 tx=0x7f6e6c00de10 comp rx=0 tx=0).stop 2024-09-10T22:44:10.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.330+0000 7f6e89600640 1 -- 172.21.15.103:0/4178444996 shutdown_connections 2024-09-10T22:44:10.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.330+0000 7f6e89600640 1 --2- 172.21.15.103:0/4178444996 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6e600725e0 0x7f6e60074aa0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.330+0000 7f6e89600640 1 --2- 172.21.15.103:0/4178444996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e8415ece0 0x7f6e84157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.330+0000 7f6e89600640 1 --2- 172.21.15.103:0/4178444996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e840ccc10 0x7f6e8414af80 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.330+0000 7f6e89600640 1 --2- 172.21.15.103:0/4178444996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e840afcb0 0x7f6e84157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.330+0000 7f6e89600640 1 -- 172.21.15.103:0/4178444996 >> 172.21.15.103:0/4178444996 conn(0x7f6e840d0780 msgr2=0x7f6e8415de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:10.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.330+0000 7f6e89600640 1 -- 172.21.15.103:0/4178444996 shutdown_connections 2024-09-10T22:44:10.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.330+0000 7f6e89600640 1 -- 172.21.15.103:0/4178444996 wait complete. 2024-09-10T22:44:10.356 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T22:44:10.357 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:44:10.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.494+0000 7f705c400640 1 -- 172.21.15.103:0/3922913293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703c003ab0 msgr2=0x7f703c003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:10.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.494+0000 7f705c400640 1 --2- 172.21.15.103:0/3922913293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703c003ab0 0x7f703c003ed0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f70480016c0 tx=0x7f704801c750 comp rx=0 tx=0).stop 2024-09-10T22:44:10.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.494+0000 7f705c400640 1 -- 172.21.15.103:0/3922913293 shutdown_connections 2024-09-10T22:44:10.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.494+0000 7f705c400640 1 --2- 172.21.15.103:0/3922913293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703c003ab0 0x7f703c003ed0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.494+0000 7f705c400640 1 -- 172.21.15.103:0/3922913293 >> 172.21.15.103:0/3922913293 conn(0x7f70540d1ac0 msgr2=0x7f70540d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:10.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.494+0000 7f705c400640 1 -- 172.21.15.103:0/3922913293 shutdown_connections 2024-09-10T22:44:10.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.494+0000 7f705c400640 1 -- 172.21.15.103:0/3922913293 wait complete. 2024-09-10T22:44:10.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f705c400640 1 Processor -- start 2024-09-10T22:44:10.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f705c400640 1 -- start start 2024-09-10T22:44:10.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f705c400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f703c003ab0 0x7f7054155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:10.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f705c400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70540ccae0 0x7f70540cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:10.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f705c400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70540ce420 0x7f705415f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:10.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f705c400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f70540aec60 con 0x7f70540ccae0 2024-09-10T22:44:10.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f705c400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f70540aeae0 con 0x7f70540ce420 2024-09-10T22:44:10.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f705c400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f70540aede0 con 0x7f703c003ab0 2024-09-10T22:44:10.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f7059000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70540ccae0 0x7f70540cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:10.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f7059000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70540ccae0 0x7f70540cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52370/0 (socket says 172.21.15.103:52370) 2024-09-10T22:44:10.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f7059000640 1 -- 172.21.15.103:0/786760607 learned_addr learned my addr 172.21.15.103:0/786760607 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:10.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f705a400640 1 --2- 172.21.15.103:0/786760607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70540ce420 0x7f705415f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:10.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f7059a00640 1 --2- 172.21.15.103:0/786760607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f703c003ab0 0x7f7054155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:10.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f7059000640 1 -- 172.21.15.103:0/786760607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f703c003ab0 msgr2=0x7f7054155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:10.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f7059000640 1 --2- 172.21.15.103:0/786760607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f703c003ab0 0x7f7054155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f7059000640 1 -- 172.21.15.103:0/786760607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70540ce420 msgr2=0x7f705415f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:10.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f7059000640 1 --2- 172.21.15.103:0/786760607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70540ce420 0x7f705415f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f7059000640 1 -- 172.21.15.103:0/786760607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70540cd8b0 con 0x7f70540ccae0 2024-09-10T22:44:10.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f7059000640 1 --2- 172.21.15.103:0/786760607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70540ccae0 0x7f70540cdee0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f7040006fb0 tx=0x7f70400039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:10.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f7051600640 1 -- 172.21.15.103:0/786760607 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7040015070 con 0x7f70540ccae0 2024-09-10T22:44:10.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f7051600640 1 -- 172.21.15.103:0/786760607 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70400119e0 con 0x7f70540ccae0 2024-09-10T22:44:10.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f7051600640 1 -- 172.21.15.103:0/786760607 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7040011e30 con 0x7f70540ccae0 2024-09-10T22:44:10.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f705c400640 1 -- 172.21.15.103:0/786760607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70540cd010 con 0x7f70540ccae0 2024-09-10T22:44:10.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.498+0000 7f705c400640 1 -- 172.21.15.103:0/786760607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70540cd5d0 con 0x7f70540ccae0 2024-09-10T22:44:10.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.502+0000 7f705c400640 1 -- 172.21.15.103:0/786760607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70540cfd40 con 0x7f70540ccae0 2024-09-10T22:44:10.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.502+0000 7f7051600640 1 -- 172.21.15.103:0/786760607 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7040010420 con 0x7f70540ccae0 2024-09-10T22:44:10.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.502+0000 7f7051600640 1 --2- 172.21.15.103:0/786760607 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f70340725e0 0x7f7034074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:10.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.502+0000 7f7051600640 1 -- 172.21.15.103:0/786760607 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f70400940e0 con 0x7f70540ccae0 2024-09-10T22:44:10.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.502+0000 7f7059a00640 1 --2- 172.21.15.103:0/786760607 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f70340725e0 0x7f7034074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:10.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.502+0000 7f7059a00640 1 --2- 172.21.15.103:0/786760607 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f70340725e0 0x7f7034074aa0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f703c004790 tx=0x7f70480b0040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:10.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.506+0000 7f7051600640 1 -- 172.21.15.103:0/786760607 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f704005ef40 con 0x7f70540ccae0 2024-09-10T22:44:10.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.710+0000 7f705c400640 1 -- 172.21.15.103:0/786760607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f705415f3b0 con 0x7f70540ccae0 2024-09-10T22:44:10.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.710+0000 7f7051600640 1 -- 172.21.15.103:0/786760607 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5275 (secure 0 0 0) 0x7f7040063970 con 0x7f70540ccae0 2024-09-10T22:44:10.713 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:10.713 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":80,"btime":"2024-09-10T22:44:10:085703+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6047,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/2402286786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2402286786},{"type":"v1","addr":"172.21.15.103:6834","nonce":2402286786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:43:33.337095+0000","modified":"2024-09-10T22:44:09.464879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6873,"mds_1":6592,"mds_2":6053},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6053":{"gid":6053,"name":"b","rank":2,"incarnation":76,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6837/4254729752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":4254729752},{"type":"v1","addr":"172.21.15.131:6837","nonce":4254729752}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6592":{"gid":6592,"name":"d","rank":1,"incarnation":74,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6836/134240629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":134240629},{"type":"v1","addr":"172.21.15.131:6836","nonce":134240629}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6873":{"gid":6873,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/249667943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":249667943},{"type":"v1","addr":"172.21.15.103:6835","nonce":249667943}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6873,"qdb_cluster":[6873,6592,6053]},"id":5}]} 2024-09-10T22:44:10.714 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 80 2024-09-10T22:44:10.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.710+0000 7f705c400640 1 -- 172.21.15.103:0/786760607 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f70340725e0 msgr2=0x7f7034074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:10.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.710+0000 7f705c400640 1 --2- 172.21.15.103:0/786760607 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f70340725e0 0x7f7034074aa0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f703c004790 tx=0x7f70480b0040 comp rx=0 tx=0).stop 2024-09-10T22:44:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.710+0000 7f705c400640 1 -- 172.21.15.103:0/786760607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70540ccae0 msgr2=0x7f70540cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.710+0000 7f705c400640 1 --2- 172.21.15.103:0/786760607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70540ccae0 0x7f70540cdee0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f7040006fb0 tx=0x7f70400039d0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.710+0000 7f705c400640 1 -- 172.21.15.103:0/786760607 shutdown_connections 2024-09-10T22:44:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.710+0000 7f705c400640 1 --2- 172.21.15.103:0/786760607 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f70340725e0 0x7f7034074aa0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.710+0000 7f705c400640 1 --2- 172.21.15.103:0/786760607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70540ce420 0x7f705415f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.710+0000 7f705c400640 1 --2- 172.21.15.103:0/786760607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70540ccae0 0x7f70540cdee0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.710+0000 7f705c400640 1 --2- 172.21.15.103:0/786760607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f703c003ab0 0x7f7054155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.710+0000 7f705c400640 1 -- 172.21.15.103:0/786760607 >> 172.21.15.103:0/786760607 conn(0x7f70540d1ac0 msgr2=0x7f7054070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.710+0000 7f705c400640 1 -- 172.21.15.103:0/786760607 shutdown_connections 2024-09-10T22:44:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.710+0000 7f705c400640 1 -- 172.21.15.103:0/786760607 wait complete. 2024-09-10T22:44:10.735 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:44:10.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f9742800640 1 -- 172.21.15.103:0/2534643785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f973c072a40 msgr2=0x7f973c157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f9742800640 1 --2- 172.21.15.103:0/2534643785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f973c072a40 0x7f973c157090 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f973c0d0340 tx=0x7f973401dc70 comp rx=0 tx=0).stop 2024-09-10T22:44:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f9742800640 1 -- 172.21.15.103:0/2534643785 shutdown_connections 2024-09-10T22:44:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f9742800640 1 --2- 172.21.15.103:0/2534643785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f973c072a40 0x7f973c157090 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f9742800640 1 --2- 172.21.15.103:0/2534643785 >> v2:172.21.15.131:3300/0 conn(0x7f973c0b3150 0x7f973c072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f9742800640 1 --2- 172.21.15.103:0/2534643785 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f973c0cf260 0x7f973c0b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f9742800640 1 -- 172.21.15.103:0/2534643785 >> 172.21.15.103:0/2534643785 conn(0x7f973c06cc00 msgr2=0x7f973c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f9742800640 1 -- 172.21.15.103:0/2534643785 shutdown_connections 2024-09-10T22:44:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f9742800640 1 -- 172.21.15.103:0/2534643785 wait complete. 2024-09-10T22:44:10.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f9742800640 1 Processor -- start 2024-09-10T22:44:10.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f9742800640 1 -- start start 2024-09-10T22:44:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f9742800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f973c072a40 0x7f973c14aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f9742800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f973c0b3150 0x7f973c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f9742800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f973c0cf260 0x7f973c0b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f9742800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f973c157e70 con 0x7f973c072a40 2024-09-10T22:44:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f9742800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f973c157cf0 con 0x7f973c0b3150 2024-09-10T22:44:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f9742800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f973c15dab0 con 0x7f973c0cf260 2024-09-10T22:44:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f973b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f973c072a40 0x7f973c14aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f973b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f973c072a40 0x7f973c14aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52378/0 (socket says 172.21.15.103:52378) 2024-09-10T22:44:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f973b400640 1 -- 172.21.15.103:0/651445368 learned_addr learned my addr 172.21.15.103:0/651445368 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f9733e00640 1 --2- 172.21.15.103:0/651445368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f973c0b3150 0x7f973c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f973be00640 1 --2- 172.21.15.103:0/651445368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f973c0cf260 0x7f973c0b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f973b400640 1 -- 172.21.15.103:0/651445368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f973c0cf260 msgr2=0x7f973c0b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f973b400640 1 --2- 172.21.15.103:0/651445368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f973c0cf260 0x7f973c0b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f973b400640 1 -- 172.21.15.103:0/651445368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f973c0b3150 msgr2=0x7f973c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f973b400640 1 --2- 172.21.15.103:0/651445368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f973c0b3150 0x7f973c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.874+0000 7f973b400640 1 -- 172.21.15.103:0/651445368 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973c0b0030 con 0x7f973c072a40 2024-09-10T22:44:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.878+0000 7f973b400640 1 --2- 172.21.15.103:0/651445368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f973c072a40 0x7f973c14aeb0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f972c00d750 tx=0x7f972c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.878+0000 7f9733400640 1 -- 172.21.15.103:0/651445368 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c017070 con 0x7f973c072a40 2024-09-10T22:44:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.878+0000 7f9733400640 1 -- 172.21.15.103:0/651445368 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f972c009d20 con 0x7f973c072a40 2024-09-10T22:44:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.878+0000 7f9742800640 1 -- 172.21.15.103:0/651445368 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f973c0b0310 con 0x7f973c072a40 2024-09-10T22:44:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.878+0000 7f9733400640 1 -- 172.21.15.103:0/651445368 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c00de60 con 0x7f973c072a40 2024-09-10T22:44:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.878+0000 7f9742800640 1 -- 172.21.15.103:0/651445368 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f973c0b08d0 con 0x7f973c072a40 2024-09-10T22:44:10.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.878+0000 7f9742800640 1 -- 172.21.15.103:0/651445368 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f973c072500 con 0x7f973c072a40 2024-09-10T22:44:10.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.878+0000 7f9733400640 1 -- 172.21.15.103:0/651445368 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f972c004280 con 0x7f973c072a40 2024-09-10T22:44:10.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.878+0000 7f9733400640 1 --2- 172.21.15.103:0/651445368 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f97180725e0 0x7f9718074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:10.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.878+0000 7f9733400640 1 -- 172.21.15.103:0/651445368 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f972c0938c0 con 0x7f973c072a40 2024-09-10T22:44:10.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.878+0000 7f9733e00640 1 --2- 172.21.15.103:0/651445368 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f97180725e0 0x7f9718074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:10.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.882+0000 7f9733e00640 1 --2- 172.21.15.103:0/651445368 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f97180725e0 0x7f9718074aa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f973c1f82f0 tx=0x7f97240091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:10.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:10.882+0000 7f9733400640 1 -- 172.21.15.103:0/651445368 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f972c020020 con 0x7f973c072a40 2024-09-10T22:44:11.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.082+0000 7f9742800640 1 -- 172.21.15.103:0/651445368 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f973c1580f0 con 0x7f973c072a40 2024-09-10T22:44:11.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.082+0000 7f9733400640 1 -- 172.21.15.103:0/651445368 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5275 (secure 0 0 0) 0x7f972c05ed70 con 0x7f973c072a40 2024-09-10T22:44:11.087 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:11.088 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":80,"btime":"2024-09-10T22:44:10:085703+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6047,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/2402286786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2402286786},{"type":"v1","addr":"172.21.15.103:6834","nonce":2402286786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:43:33.337095+0000","modified":"2024-09-10T22:44:09.464879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6873,"mds_1":6592,"mds_2":6053},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6053":{"gid":6053,"name":"b","rank":2,"incarnation":76,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6837/4254729752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":4254729752},{"type":"v1","addr":"172.21.15.131:6837","nonce":4254729752}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6592":{"gid":6592,"name":"d","rank":1,"incarnation":74,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6836/134240629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":134240629},{"type":"v1","addr":"172.21.15.131:6836","nonce":134240629}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6873":{"gid":6873,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/249667943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":249667943},{"type":"v1","addr":"172.21.15.103:6835","nonce":249667943}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6873,"qdb_cluster":[6873,6592,6053]},"id":5}]} 2024-09-10T22:44:11.088 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 80 2024-09-10T22:44:11.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.086+0000 7f9742800640 1 -- 172.21.15.103:0/651445368 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f97180725e0 msgr2=0x7f9718074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:11.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.086+0000 7f9742800640 1 --2- 172.21.15.103:0/651445368 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f97180725e0 0x7f9718074aa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f973c1f82f0 tx=0x7f97240091e0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.086+0000 7f9742800640 1 -- 172.21.15.103:0/651445368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f973c072a40 msgr2=0x7f973c14aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:11.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.086+0000 7f9742800640 1 --2- 172.21.15.103:0/651445368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f973c072a40 0x7f973c14aeb0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f972c00d750 tx=0x7f972c00dc10 comp rx=0 tx=0).stop 2024-09-10T22:44:11.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.086+0000 7f9742800640 1 -- 172.21.15.103:0/651445368 shutdown_connections 2024-09-10T22:44:11.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.086+0000 7f9742800640 1 --2- 172.21.15.103:0/651445368 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f97180725e0 0x7f9718074aa0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.086+0000 7f9742800640 1 --2- 172.21.15.103:0/651445368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f973c0cf260 0x7f973c0b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.086+0000 7f9742800640 1 --2- 172.21.15.103:0/651445368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f973c0b3150 0x7f973c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.086+0000 7f9742800640 1 --2- 172.21.15.103:0/651445368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f973c072a40 0x7f973c14aeb0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.086+0000 7f9742800640 1 -- 172.21.15.103:0/651445368 >> 172.21.15.103:0/651445368 conn(0x7f973c06cc00 msgr2=0x7f973c14f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:11.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.086+0000 7f9742800640 1 -- 172.21.15.103:0/651445368 shutdown_connections 2024-09-10T22:44:11.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.086+0000 7f9742800640 1 -- 172.21.15.103:0/651445368 wait complete. 2024-09-10T22:44:11.108 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:44:11.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.246+0000 7f7f6e000640 1 -- 172.21.15.103:0/883466813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680cf790 msgr2=0x7f7f680cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:11.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.246+0000 7f7f6e000640 1 --2- 172.21.15.103:0/883466813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680cf790 0x7f7f680cfc20 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f7f60009900 tx=0x7f7f6001c850 comp rx=0 tx=0).stop 2024-09-10T22:44:11.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.246+0000 7f7f6e000640 1 -- 172.21.15.103:0/883466813 shutdown_connections 2024-09-10T22:44:11.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.246+0000 7f7f6e000640 1 --2- 172.21.15.103:0/883466813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680cf790 0x7f7f680cfc20 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.246+0000 7f7f6e000640 1 -- 172.21.15.103:0/883466813 >> 172.21.15.103:0/883466813 conn(0x7f7f6806cc00 msgr2=0x7f7f6806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:11.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.246+0000 7f7f6e000640 1 -- 172.21.15.103:0/883466813 shutdown_connections 2024-09-10T22:44:11.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.246+0000 7f7f6e000640 1 -- 172.21.15.103:0/883466813 wait complete. 2024-09-10T22:44:11.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.246+0000 7f7f6e000640 1 Processor -- start 2024-09-10T22:44:11.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.246+0000 7f7f6e000640 1 -- start start 2024-09-10T22:44:11.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.246+0000 7f7f6e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680aeb40 0x7f7f680af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:11.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.246+0000 7f7f6e000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f680cc120 0x7f7f6814ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:11.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.246+0000 7f7f6e000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f680cf790 0x7f7f6806ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:11.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.246+0000 7f7f6e000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7f68169e60 con 0x7f7f680aeb40 2024-09-10T22:44:11.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.246+0000 7f7f6e000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7f68169ce0 con 0x7f7f680cc120 2024-09-10T22:44:11.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.246+0000 7f7f6e000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7f68169fe0 con 0x7f7f680cf790 2024-09-10T22:44:11.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f67400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680aeb40 0x7f7f680af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:11.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f67400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680aeb40 0x7f7f680af370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52396/0 (socket says 172.21.15.103:52396) 2024-09-10T22:44:11.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f67400640 1 -- 172.21.15.103:0/3331615454 learned_addr learned my addr 172.21.15.103:0/3331615454 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:11.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f5ea00640 1 --2- 172.21.15.103:0/3331615454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f680cc120 0x7f7f6814ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:11.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f67e00640 1 --2- 172.21.15.103:0/3331615454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f680cf790 0x7f7f6806ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:11.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f67400640 1 -- 172.21.15.103:0/3331615454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f680cf790 msgr2=0x7f7f6806ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:11.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f67400640 1 --2- 172.21.15.103:0/3331615454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f680cf790 0x7f7f6806ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f67400640 1 -- 172.21.15.103:0/3331615454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f680cc120 msgr2=0x7f7f6814ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:11.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f67400640 1 --2- 172.21.15.103:0/3331615454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f680cc120 0x7f7f6814ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f67400640 1 -- 172.21.15.103:0/3331615454 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f681f79c0 con 0x7f7f680aeb40 2024-09-10T22:44:11.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f5ea00640 1 --2- 172.21.15.103:0/3331615454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f680cc120 0x7f7f6814ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:11.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f67400640 1 --2- 172.21.15.103:0/3331615454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680aeb40 0x7f7f680af370 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800c820 tx=0x7f7f5800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:11.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f5fe00640 1 -- 172.21.15.103:0/3331615454 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58017070 con 0x7f7f680aeb40 2024-09-10T22:44:11.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f5fe00640 1 -- 172.21.15.103:0/3331615454 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f58005070 con 0x7f7f680aeb40 2024-09-10T22:44:11.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f5fe00640 1 -- 172.21.15.103:0/3331615454 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f580054c0 con 0x7f7f680aeb40 2024-09-10T22:44:11.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f6e000640 1 -- 172.21.15.103:0/3331615454 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f681f7c60 con 0x7f7f680aeb40 2024-09-10T22:44:11.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f6e000640 1 -- 172.21.15.103:0/3331615454 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f681f8220 con 0x7f7f680aeb40 2024-09-10T22:44:11.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f6e000640 1 -- 172.21.15.103:0/3331615454 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f680cfc20 con 0x7f7f680aeb40 2024-09-10T22:44:11.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.250+0000 7f7f5fe00640 1 -- 172.21.15.103:0/3331615454 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7f58005660 con 0x7f7f680aeb40 2024-09-10T22:44:11.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.254+0000 7f7f5fe00640 1 --2- 172.21.15.103:0/3331615454 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7f440725e0 0x7f7f44074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:11.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.254+0000 7f7f5fe00640 1 -- 172.21.15.103:0/3331615454 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f7f58093240 con 0x7f7f680aeb40 2024-09-10T22:44:11.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.254+0000 7f7f5ea00640 1 --2- 172.21.15.103:0/3331615454 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7f440725e0 0x7f7f44074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:11.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.254+0000 7f7f5ea00640 1 --2- 172.21.15.103:0/3331615454 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7f440725e0 0x7f7f44074aa0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7f680adce0 tx=0x7f7f50009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:11.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.254+0000 7f7f5fe00640 1 -- 172.21.15.103:0/3331615454 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7f58021020 con 0x7f7f680aeb40 2024-09-10T22:44:11.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.422+0000 7f7f6e000640 1 -- 172.21.15.103:0/3331615454 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f6815eda0 con 0x7f7f680aeb40 2024-09-10T22:44:11.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.422+0000 7f7f5fe00640 1 -- 172.21.15.103:0/3331615454 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+17065 (secure 0 0 0) 0x7f7f5805e770 con 0x7f7f680aeb40 2024-09-10T22:44:11.427 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:11.427 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":81,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:43:34.948634+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:43:31.019531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-10T22:43:32.295197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:44:11.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.426+0000 7f7f6e000640 1 -- 172.21.15.103:0/3331615454 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7f440725e0 msgr2=0x7f7f44074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:11.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.426+0000 7f7f6e000640 1 --2- 172.21.15.103:0/3331615454 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7f440725e0 0x7f7f44074aa0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7f680adce0 tx=0x7f7f50009040 comp rx=0 tx=0).stop 2024-09-10T22:44:11.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.426+0000 7f7f6e000640 1 -- 172.21.15.103:0/3331615454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680aeb40 msgr2=0x7f7f680af370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:11.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.426+0000 7f7f6e000640 1 --2- 172.21.15.103:0/3331615454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680aeb40 0x7f7f680af370 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800c820 tx=0x7f7f5800cce0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.426+0000 7f7f6e000640 1 -- 172.21.15.103:0/3331615454 shutdown_connections 2024-09-10T22:44:11.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.426+0000 7f7f6e000640 1 --2- 172.21.15.103:0/3331615454 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7f440725e0 0x7f7f44074aa0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.426+0000 7f7f6e000640 1 --2- 172.21.15.103:0/3331615454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f680cf790 0x7f7f6806ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.426+0000 7f7f6e000640 1 --2- 172.21.15.103:0/3331615454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f680cc120 0x7f7f6814ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.426+0000 7f7f6e000640 1 --2- 172.21.15.103:0/3331615454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f680aeb40 0x7f7f680af370 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.426+0000 7f7f6e000640 1 -- 172.21.15.103:0/3331615454 >> 172.21.15.103:0/3331615454 conn(0x7f7f6806cc00 msgr2=0x7f7f6806cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:11.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.426+0000 7f7f6e000640 1 -- 172.21.15.103:0/3331615454 shutdown_connections 2024-09-10T22:44:11.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.426+0000 7f7f6e000640 1 -- 172.21.15.103:0/3331615454 wait complete. 2024-09-10T22:44:11.449 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T22:44:11.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.586+0000 7f1d13000640 1 -- 172.21.15.103:0/2510219806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0c0cf300 msgr2=0x7f1d0c15a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:11.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.586+0000 7f1d13000640 1 --2- 172.21.15.103:0/2510219806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0c0cf300 0x7f1d0c15a980 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009840 tx=0x7f1cf401c7f0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.586+0000 7f1d13000640 1 -- 172.21.15.103:0/2510219806 shutdown_connections 2024-09-10T22:44:11.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.586+0000 7f1d13000640 1 --2- 172.21.15.103:0/2510219806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0c0cf300 0x7f1d0c15a980 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.586+0000 7f1d13000640 1 -- 172.21.15.103:0/2510219806 >> 172.21.15.103:0/2510219806 conn(0x7f1d0c0cc7e0 msgr2=0x7f1d0c0ccbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:11.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.586+0000 7f1d13000640 1 -- 172.21.15.103:0/2510219806 shutdown_connections 2024-09-10T22:44:11.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.586+0000 7f1d13000640 1 -- 172.21.15.103:0/2510219806 wait complete. 2024-09-10T22:44:11.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d13000640 1 Processor -- start 2024-09-10T22:44:11.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d13000640 1 -- start start 2024-09-10T22:44:11.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d13000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d0c070590 0x7f1d0c155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:11.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d13000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d0c0cf300 0x7f1d0c1f7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:11.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d13000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0c15a5a0 0x7f1d0c15fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:11.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d13000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c1690c0 con 0x7f1d0c15a5a0 2024-09-10T22:44:11.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d13000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c168f40 con 0x7f1d0c070590 2024-09-10T22:44:11.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d13000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1d0c169240 con 0x7f1d0c0cf300 2024-09-10T22:44:11.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d11000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0c15a5a0 0x7f1d0c15fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:11.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d11000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0c15a5a0 0x7f1d0c15fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52410/0 (socket says 172.21.15.103:52410) 2024-09-10T22:44:11.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d11000640 1 -- 172.21.15.103:0/4206714254 learned_addr learned my addr 172.21.15.103:0/4206714254 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:11.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d03400640 1 --2- 172.21.15.103:0/4206714254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d0c0cf300 0x7f1d0c1f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:11.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d0be00640 1 --2- 172.21.15.103:0/4206714254 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d0c070590 0x7f1d0c155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:11.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d11000640 1 -- 172.21.15.103:0/4206714254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d0c0cf300 msgr2=0x7f1d0c1f7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:11.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d11000640 1 --2- 172.21.15.103:0/4206714254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d0c0cf300 0x7f1d0c1f7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d11000640 1 -- 172.21.15.103:0/4206714254 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d0c070590 msgr2=0x7f1d0c155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:11.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d11000640 1 --2- 172.21.15.103:0/4206714254 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d0c070590 0x7f1d0c155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d11000640 1 -- 172.21.15.103:0/4206714254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0c1f84f0 con 0x7f1d0c15a5a0 2024-09-10T22:44:11.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d03400640 1 --2- 172.21.15.103:0/4206714254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d0c0cf300 0x7f1d0c1f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:11.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d11000640 1 --2- 172.21.15.103:0/4206714254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0c15a5a0 0x7f1d0c15fdd0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f1d0400c700 tx=0x7f1d0400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:11.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d08c00640 1 -- 172.21.15.103:0/4206714254 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d04003db0 con 0x7f1d0c15a5a0 2024-09-10T22:44:11.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d08c00640 1 -- 172.21.15.103:0/4206714254 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d0400ce10 con 0x7f1d0c15a5a0 2024-09-10T22:44:11.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d13000640 1 -- 172.21.15.103:0/4206714254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d0c1f87d0 con 0x7f1d0c15a5a0 2024-09-10T22:44:11.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d08c00640 1 -- 172.21.15.103:0/4206714254 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d04005290 con 0x7f1d0c15a5a0 2024-09-10T22:44:11.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.590+0000 7f1d13000640 1 -- 172.21.15.103:0/4206714254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d0c1f8ab0 con 0x7f1d0c15a5a0 2024-09-10T22:44:11.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.594+0000 7f1d13000640 1 -- 172.21.15.103:0/4206714254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d0c15a980 con 0x7f1d0c15a5a0 2024-09-10T22:44:11.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.594+0000 7f1d08c00640 1 -- 172.21.15.103:0/4206714254 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1d04005430 con 0x7f1d0c15a5a0 2024-09-10T22:44:11.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.594+0000 7f1d08c00640 1 --2- 172.21.15.103:0/4206714254 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1ce8072610 0x7f1ce8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:11.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.594+0000 7f1d08c00640 1 -- 172.21.15.103:0/4206714254 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f1d04093190 con 0x7f1d0c15a5a0 2024-09-10T22:44:11.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.594+0000 7f1d0be00640 1 --2- 172.21.15.103:0/4206714254 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1ce8072610 0x7f1ce8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:11.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.594+0000 7f1d0be00640 1 --2- 172.21.15.103:0/4206714254 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1ce8072610 0x7f1ce8074ad0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc000f70 tx=0x7f1cfc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:11.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.598+0000 7f1d08c00640 1 -- 172.21.15.103:0/4206714254 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1d0405e6d0 con 0x7f1d0c15a5a0 2024-09-10T22:44:11.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.794+0000 7f1d13000640 1 -- 172.21.15.103:0/4206714254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1d0c070ba0 con 0x7f1d0c15a5a0 2024-09-10T22:44:11.800 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-10T22:44:11.798+0000 7fb5aba00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:44:11.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.798+0000 7f1d08c00640 1 -- 172.21.15.103:0/4206714254 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v81) ==== 161+0+0 (secure 0 0 0) 0x7f1d0405dfd0 con 0x7f1d0c15a5a0 2024-09-10T22:44:11.802 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T22:44:11.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.802+0000 7f1d13000640 1 -- 172.21.15.103:0/4206714254 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1ce8072610 msgr2=0x7f1ce8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:11.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.802+0000 7f1d13000640 1 --2- 172.21.15.103:0/4206714254 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1ce8072610 0x7f1ce8074ad0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc000f70 tx=0x7f1cfc009040 comp rx=0 tx=0).stop 2024-09-10T22:44:11.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.802+0000 7f1d13000640 1 -- 172.21.15.103:0/4206714254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0c15a5a0 msgr2=0x7f1d0c15fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:11.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.802+0000 7f1d13000640 1 --2- 172.21.15.103:0/4206714254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0c15a5a0 0x7f1d0c15fdd0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f1d0400c700 tx=0x7f1d0400cbc0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.802+0000 7f1d13000640 1 -- 172.21.15.103:0/4206714254 shutdown_connections 2024-09-10T22:44:11.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.802+0000 7f1d13000640 1 --2- 172.21.15.103:0/4206714254 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1ce8072610 0x7f1ce8074ad0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.802+0000 7f1d13000640 1 --2- 172.21.15.103:0/4206714254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0c15a5a0 0x7f1d0c15fdd0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.802+0000 7f1d13000640 1 --2- 172.21.15.103:0/4206714254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d0c0cf300 0x7f1d0c1f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.802+0000 7f1d13000640 1 --2- 172.21.15.103:0/4206714254 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d0c070590 0x7f1d0c155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.802+0000 7f1d13000640 1 -- 172.21.15.103:0/4206714254 >> 172.21.15.103:0/4206714254 conn(0x7f1d0c0cc7e0 msgr2=0x7f1d0c1593a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:11.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.802+0000 7f1d13000640 1 -- 172.21.15.103:0/4206714254 shutdown_connections 2024-09-10T22:44:11.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.802+0000 7f1d13000640 1 -- 172.21.15.103:0/4206714254 wait complete. 2024-09-10T22:44:11.816 INFO:tasks.ceph.mds.c.smithi103.stderr: -9130> 2024-09-10T22:43:34.918+0000 7f084f800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T22:44:11.828 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T22:44:11.857 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2024-09-10T22:44:11.858 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2024-09-10T22:44:11.867 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-09-10T22:44:11.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.970+0000 7fd45b200640 1 -- 172.21.15.103:0/812772411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4540d25f0 msgr2=0x7fd45415f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:11.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.970+0000 7fd45b200640 1 --2- 172.21.15.103:0/812772411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4540d25f0 0x7fd45415f1e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009840 tx=0x7fd43c01c6d0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.970+0000 7fd45b200640 1 -- 172.21.15.103:0/812772411 shutdown_connections 2024-09-10T22:44:11.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.970+0000 7fd45b200640 1 --2- 172.21.15.103:0/812772411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4540d25f0 0x7fd45415f1e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.970+0000 7fd45b200640 1 --2- 172.21.15.103:0/812772411 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4540cfda0 0x7fd45415eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.970+0000 7fd45b200640 1 -- 172.21.15.103:0/812772411 >> 172.21.15.103:0/812772411 conn(0x7fd4540d1ad0 msgr2=0x7fd4540d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:11.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.970+0000 7fd45b200640 1 -- 172.21.15.103:0/812772411 shutdown_connections 2024-09-10T22:44:11.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.970+0000 7fd45b200640 1 -- 172.21.15.103:0/812772411 wait complete. 2024-09-10T22:44:11.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd45b200640 1 Processor -- start 2024-09-10T22:44:11.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd45b200640 1 -- start start 2024-09-10T22:44:11.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd45b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4540717a0 0x7fd454156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:11.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd45b200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4540cfda0 0x7fd4540b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:11.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd45b200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4540d25f0 0x7fd4540b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:11.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd45b200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd454168ff0 con 0x7fd4540717a0 2024-09-10T22:44:11.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd45b200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd454168e70 con 0x7fd4540cfda0 2024-09-10T22:44:11.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd45b200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd454169170 con 0x7fd4540d25f0 2024-09-10T22:44:11.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd453e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4540717a0 0x7fd454156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:11.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd453e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4540717a0 0x7fd454156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52422/0 (socket says 172.21.15.103:52422) 2024-09-10T22:44:11.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd453e00640 1 -- 172.21.15.103:0/1566124718 learned_addr learned my addr 172.21.15.103:0/1566124718 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:11.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd44b400640 1 --2- 172.21.15.103:0/1566124718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4540cfda0 0x7fd4540b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:11.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd459200640 1 --2- 172.21.15.103:0/1566124718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4540d25f0 0x7fd4540b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:11.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd453e00640 1 -- 172.21.15.103:0/1566124718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4540d25f0 msgr2=0x7fd4540b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:11.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd453e00640 1 --2- 172.21.15.103:0/1566124718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4540d25f0 0x7fd4540b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd453e00640 1 -- 172.21.15.103:0/1566124718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4540cfda0 msgr2=0x7fd4540b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:11.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd453e00640 1 --2- 172.21.15.103:0/1566124718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4540cfda0 0x7fd4540b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:11.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd453e00640 1 -- 172.21.15.103:0/1566124718 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4540b34b0 con 0x7fd4540717a0 2024-09-10T22:44:11.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd44b400640 1 --2- 172.21.15.103:0/1566124718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4540cfda0 0x7fd4540b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:11.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd453e00640 1 --2- 172.21.15.103:0/1566124718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4540717a0 0x7fd454156910 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fd44400ea10 tx=0x7fd44400eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:11.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd450c00640 1 -- 172.21.15.103:0/1566124718 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44400cde0 con 0x7fd4540717a0 2024-09-10T22:44:11.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd450c00640 1 -- 172.21.15.103:0/1566124718 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd444004020 con 0x7fd4540717a0 2024-09-10T22:44:11.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd450c00640 1 -- 172.21.15.103:0/1566124718 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd444004470 con 0x7fd4540717a0 2024-09-10T22:44:11.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd45b200640 1 -- 172.21.15.103:0/1566124718 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4540b3790 con 0x7fd4540717a0 2024-09-10T22:44:11.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd45b200640 1 -- 172.21.15.103:0/1566124718 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4540b2180 con 0x7fd4540717a0 2024-09-10T22:44:11.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.974+0000 7fd45b200640 1 -- 172.21.15.103:0/1566124718 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4540b3c40 con 0x7fd4540717a0 2024-09-10T22:44:11.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.978+0000 7fd450c00640 1 -- 172.21.15.103:0/1566124718 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd444003600 con 0x7fd4540717a0 2024-09-10T22:44:11.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.978+0000 7fd450c00640 1 --2- 172.21.15.103:0/1566124718 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4300725e0 0x7fd430074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:11.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.978+0000 7fd450c00640 1 -- 172.21.15.103:0/1566124718 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6359+0+0 (secure 0 0 0) 0x7fd444093f20 con 0x7fd4540717a0 2024-09-10T22:44:11.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.978+0000 7fd44b400640 1 --2- 172.21.15.103:0/1566124718 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4300725e0 0x7fd430074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:11.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.978+0000 7fd44b400640 1 --2- 172.21.15.103:0/1566124718 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4300725e0 0x7fd430074aa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0af000 tx=0x7fd43c01af10 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:11.982+0000 7fd450c00640 1 -- 172.21.15.103:0/1566124718 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd44405f360 con 0x7fd4540717a0 2024-09-10T22:44:12.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:12.182+0000 7fd45b200640 1 -- 172.21.15.103:0/1566124718 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd454070700 con 0x7fd4540717a0 2024-09-10T22:44:12.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:12.802+0000 7fd450c00640 1 -- 172.21.15.103:0/1566124718 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v82) ==== 104+0+0 (secure 0 0 0) 0x7fd44405ec60 con 0x7fd4540717a0 2024-09-10T22:44:12.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:12.802+0000 7fd45b200640 1 -- 172.21.15.103:0/1566124718 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4300725e0 msgr2=0x7fd430074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:12.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:12.802+0000 7fd45b200640 1 --2- 172.21.15.103:0/1566124718 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4300725e0 0x7fd430074aa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0af000 tx=0x7fd43c01af10 comp rx=0 tx=0).stop 2024-09-10T22:44:12.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:12.802+0000 7fd45b200640 1 -- 172.21.15.103:0/1566124718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4540717a0 msgr2=0x7fd454156910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:12.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:12.802+0000 7fd45b200640 1 --2- 172.21.15.103:0/1566124718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4540717a0 0x7fd454156910 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fd44400ea10 tx=0x7fd44400eed0 comp rx=0 tx=0).stop 2024-09-10T22:44:12.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:12.802+0000 7fd45b200640 1 -- 172.21.15.103:0/1566124718 shutdown_connections 2024-09-10T22:44:12.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:12.802+0000 7fd45b200640 1 --2- 172.21.15.103:0/1566124718 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4300725e0 0x7fd430074aa0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:12.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:12.802+0000 7fd45b200640 1 --2- 172.21.15.103:0/1566124718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4540d25f0 0x7fd4540b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:12.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:12.802+0000 7fd45b200640 1 --2- 172.21.15.103:0/1566124718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4540cfda0 0x7fd4540b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:12.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:12.802+0000 7fd45b200640 1 --2- 172.21.15.103:0/1566124718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4540717a0 0x7fd454156910 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:12.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:12.802+0000 7fd45b200640 1 -- 172.21.15.103:0/1566124718 >> 172.21.15.103:0/1566124718 conn(0x7fd4540d1ad0 msgr2=0x7fd4540cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:12.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:12.802+0000 7fd45b200640 1 -- 172.21.15.103:0/1566124718 shutdown_connections 2024-09-10T22:44:12.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:12.802+0000 7fd45b200640 1 -- 172.21.15.103:0/1566124718 wait complete. 2024-09-10T22:44:12.831 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T22:44:13.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.026+0000 7fb797000640 1 -- 172.21.15.103:0/2764722594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7900af9d0 msgr2=0x7fb790166a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:13.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.026+0000 7fb797000640 1 --2- 172.21.15.103:0/2764722594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7900af9d0 0x7fb790166a50 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fb788009840 tx=0x7fb78801c790 comp rx=0 tx=0).stop 2024-09-10T22:44:13.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.026+0000 7fb797000640 1 -- 172.21.15.103:0/2764722594 shutdown_connections 2024-09-10T22:44:13.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.026+0000 7fb797000640 1 --2- 172.21.15.103:0/2764722594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7900af9d0 0x7fb790166a50 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:13.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.026+0000 7fb797000640 1 -- 172.21.15.103:0/2764722594 >> 172.21.15.103:0/2764722594 conn(0x7fb7900d1ac0 msgr2=0x7fb7900d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:13.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.026+0000 7fb797000640 1 -- 172.21.15.103:0/2764722594 shutdown_connections 2024-09-10T22:44:13.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.026+0000 7fb797000640 1 -- 172.21.15.103:0/2764722594 wait complete. 2024-09-10T22:44:13.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb797000640 1 Processor -- start 2024-09-10T22:44:13.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb797000640 1 -- start start 2024-09-10T22:44:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb797000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7900af9d0 0x7fb790151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb797000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7900b09c0 0x7fb7900b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb797000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb79015be30 0x7fb7901fa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb797000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb790169ca0 con 0x7fb7900af9d0 2024-09-10T22:44:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb797000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb790169b20 con 0x7fb7900b09c0 2024-09-10T22:44:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb797000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb790169e20 con 0x7fb79015be30 2024-09-10T22:44:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb78fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7900af9d0 0x7fb790151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb78fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7900af9d0 0x7fb790151040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52436/0 (socket says 172.21.15.103:52436) 2024-09-10T22:44:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb78fe00640 1 -- 172.21.15.103:0/707752377 learned_addr learned my addr 172.21.15.103:0/707752377 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb795000640 1 --2- 172.21.15.103:0/707752377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb79015be30 0x7fb7901fa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb787400640 1 --2- 172.21.15.103:0/707752377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7900b09c0 0x7fb7900b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb78fe00640 1 -- 172.21.15.103:0/707752377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb79015be30 msgr2=0x7fb7901fa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb78fe00640 1 --2- 172.21.15.103:0/707752377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb79015be30 0x7fb7901fa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb78fe00640 1 -- 172.21.15.103:0/707752377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7900b09c0 msgr2=0x7fb7900b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb78fe00640 1 --2- 172.21.15.103:0/707752377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7900b09c0 0x7fb7900b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb78fe00640 1 -- 172.21.15.103:0/707752377 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7901518d0 con 0x7fb7900af9d0 2024-09-10T22:44:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb78fe00640 1 --2- 172.21.15.103:0/707752377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7900af9d0 0x7fb790151040 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fb78000c790 tx=0x7fb78000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb78cc00640 1 -- 172.21.15.103:0/707752377 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780003b80 con 0x7fb7900af9d0 2024-09-10T22:44:13.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb78cc00640 1 -- 172.21.15.103:0/707752377 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb780003d20 con 0x7fb7900af9d0 2024-09-10T22:44:13.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb78cc00640 1 -- 172.21.15.103:0/707752377 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78000aa90 con 0x7fb7900af9d0 2024-09-10T22:44:13.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb797000640 1 -- 172.21.15.103:0/707752377 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb790151580 con 0x7fb7900af9d0 2024-09-10T22:44:13.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.030+0000 7fb797000640 1 -- 172.21.15.103:0/707752377 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb79006fa40 con 0x7fb7900af9d0 2024-09-10T22:44:13.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.034+0000 7fb797000640 1 -- 172.21.15.103:0/707752377 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7900ce0c0 con 0x7fb7900af9d0 2024-09-10T22:44:13.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.034+0000 7fb78cc00640 1 -- 172.21.15.103:0/707752377 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb78000ac30 con 0x7fb7900af9d0 2024-09-10T22:44:13.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.034+0000 7fb78cc00640 1 --2- 172.21.15.103:0/707752377 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb76c0725e0 0x7fb76c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:13.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.034+0000 7fb78cc00640 1 -- 172.21.15.103:0/707752377 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6359+0+0 (secure 0 0 0) 0x7fb780093230 con 0x7fb7900af9d0 2024-09-10T22:44:13.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.034+0000 7fb787400640 1 --2- 172.21.15.103:0/707752377 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb76c0725e0 0x7fb76c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:13.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.038+0000 7fb787400640 1 --2- 172.21.15.103:0/707752377 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb76c0725e0 0x7fb76c074aa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb7900b0840 tx=0x7fb778009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.038+0000 7fb78cc00640 1 -- 172.21.15.103:0/707752377 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb78005e060 con 0x7fb7900af9d0 2024-09-10T22:44:13.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:13.206+0000 7fb797000640 1 -- 172.21.15.103:0/707752377 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb790075d40 con 0x7fb7900af9d0 2024-09-10T22:44:14.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.106+0000 7fb78cc00640 1 -- 172.21.15.103:0/707752377 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) ==== 181+0+0 (secure 0 0 0) 0x7fb780062a90 con 0x7fb7900af9d0 2024-09-10T22:44:14.111 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2024-09-10T22:44:14.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.110+0000 7fb797000640 1 -- 172.21.15.103:0/707752377 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb76c0725e0 msgr2=0x7fb76c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:14.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.110+0000 7fb797000640 1 --2- 172.21.15.103:0/707752377 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb76c0725e0 0x7fb76c074aa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb7900b0840 tx=0x7fb778009040 comp rx=0 tx=0).stop 2024-09-10T22:44:14.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.110+0000 7fb797000640 1 -- 172.21.15.103:0/707752377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7900af9d0 msgr2=0x7fb790151040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:14.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.110+0000 7fb797000640 1 --2- 172.21.15.103:0/707752377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7900af9d0 0x7fb790151040 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fb78000c790 tx=0x7fb78000cc50 comp rx=0 tx=0).stop 2024-09-10T22:44:14.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.110+0000 7fb797000640 1 -- 172.21.15.103:0/707752377 shutdown_connections 2024-09-10T22:44:14.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.110+0000 7fb797000640 1 --2- 172.21.15.103:0/707752377 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb76c0725e0 0x7fb76c074aa0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:14.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.110+0000 7fb797000640 1 --2- 172.21.15.103:0/707752377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb79015be30 0x7fb7901fa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:14.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.110+0000 7fb797000640 1 --2- 172.21.15.103:0/707752377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7900b09c0 0x7fb7900b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:14.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.110+0000 7fb797000640 1 --2- 172.21.15.103:0/707752377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7900af9d0 0x7fb790151040 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:14.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.110+0000 7fb797000640 1 -- 172.21.15.103:0/707752377 >> 172.21.15.103:0/707752377 conn(0x7fb7900d1ac0 msgr2=0x7fb7900b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:14.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.114+0000 7fb797000640 1 -- 172.21.15.103:0/707752377 shutdown_connections 2024-09-10T22:44:14.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.114+0000 7fb797000640 1 -- 172.21.15.103:0/707752377 wait complete. 2024-09-10T22:44:14.142 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T22:44:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.286+0000 7f68c0000640 1 -- 172.21.15.103:0/2111631617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68b80cdd00 msgr2=0x7f68b80ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.286+0000 7f68c0000640 1 --2- 172.21.15.103:0/2111631617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68b80cdd00 0x7f68b80ccdf0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f68a4009900 tx=0x7f68a401c8e0 comp rx=0 tx=0).stop 2024-09-10T22:44:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.286+0000 7f68c0000640 1 -- 172.21.15.103:0/2111631617 shutdown_connections 2024-09-10T22:44:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.286+0000 7f68c0000640 1 --2- 172.21.15.103:0/2111631617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68b80cdd00 0x7f68b80ccdf0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.286+0000 7f68c0000640 1 --2- 172.21.15.103:0/2111631617 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f68b815f1a0 0x7f68b80ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.286+0000 7f68c0000640 1 -- 172.21.15.103:0/2111631617 >> 172.21.15.103:0/2111631617 conn(0x7f68b80d1a20 msgr2=0x7f68b80d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.286+0000 7f68c0000640 1 -- 172.21.15.103:0/2111631617 shutdown_connections 2024-09-10T22:44:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.286+0000 7f68c0000640 1 -- 172.21.15.103:0/2111631617 wait complete. 2024-09-10T22:44:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68c0000640 1 Processor -- start 2024-09-10T22:44:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68c0000640 1 -- start start 2024-09-10T22:44:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68c0000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f68b80cd330 0x7f68b815c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68c0000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68b80cdd00 0x7f68b80b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68c0000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68b815f1a0 0x7f68b806ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68c0000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f68b8169010 con 0x7f68b80cdd00 2024-09-10T22:44:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68c0000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f68b8168e90 con 0x7f68b815f1a0 2024-09-10T22:44:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68c0000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f68b8169190 con 0x7f68b80cd330 2024-09-10T22:44:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68bcc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68b80cdd00 0x7f68b80b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68bcc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68b80cdd00 0x7f68b80b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52448/0 (socket says 172.21.15.103:52448) 2024-09-10T22:44:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68bcc00640 1 -- 172.21.15.103:0/3789129210 learned_addr learned my addr 172.21.15.103:0/3789129210 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68bd600640 1 --2- 172.21.15.103:0/3789129210 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f68b80cd330 0x7f68b815c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68be000640 1 --2- 172.21.15.103:0/3789129210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68b815f1a0 0x7f68b806ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68bcc00640 1 -- 172.21.15.103:0/3789129210 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f68b80cd330 msgr2=0x7f68b815c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68bcc00640 1 --2- 172.21.15.103:0/3789129210 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f68b80cd330 0x7f68b815c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68bcc00640 1 -- 172.21.15.103:0/3789129210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68b815f1a0 msgr2=0x7f68b806ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68bcc00640 1 --2- 172.21.15.103:0/3789129210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68b815f1a0 0x7f68b806ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68bcc00640 1 -- 172.21.15.103:0/3789129210 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b806e210 con 0x7f68b80cdd00 2024-09-10T22:44:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68be000640 1 --2- 172.21.15.103:0/3789129210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68b815f1a0 0x7f68b806ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68bcc00640 1 --2- 172.21.15.103:0/3789129210 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68b80cdd00 0x7f68b80b1c20 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f68a4009850 tx=0x7f68a40a55a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68b5600640 1 -- 172.21.15.103:0/3789129210 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a40bb070 con 0x7f68b80cdd00 2024-09-10T22:44:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68b5600640 1 -- 172.21.15.103:0/3789129210 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68a40a6d90 con 0x7f68b80cdd00 2024-09-10T22:44:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68c0000640 1 -- 172.21.15.103:0/3789129210 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b806e4f0 con 0x7f68b80cdd00 2024-09-10T22:44:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68b5600640 1 -- 172.21.15.103:0/3789129210 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a40b2040 con 0x7f68b80cdd00 2024-09-10T22:44:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68c0000640 1 -- 172.21.15.103:0/3789129210 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b806eab0 con 0x7f68b80cdd00 2024-09-10T22:44:14.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.290+0000 7f68c0000640 1 -- 172.21.15.103:0/3789129210 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68b80ccdf0 con 0x7f68b80cdd00 2024-09-10T22:44:14.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.294+0000 7f68b5600640 1 -- 172.21.15.103:0/3789129210 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f68a4005290 con 0x7f68b80cdd00 2024-09-10T22:44:14.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.294+0000 7f68b5600640 1 --2- 172.21.15.103:0/3789129210 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f68980725e0 0x7f6898074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:14.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.294+0000 7f68b5600640 1 -- 172.21.15.103:0/3789129210 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5921+0+0 (secure 0 0 0) 0x7f68a412ce20 con 0x7f68b80cdd00 2024-09-10T22:44:14.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.294+0000 7f68bd600640 1 --2- 172.21.15.103:0/3789129210 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f68980725e0 0x7f6898074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:14.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.294+0000 7f68bd600640 1 --2- 172.21.15.103:0/3789129210 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f68980725e0 0x7f6898074aa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009e60 tx=0x7f68ac0095b0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:14.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.298+0000 7f68b5600640 1 -- 172.21.15.103:0/3789129210 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f68a40164d0 con 0x7f68b80cdd00 2024-09-10T22:44:14.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:14.462+0000 7f68c0000640 1 -- 172.21.15.103:0/3789129210 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f68b80b0c60 con 0x7f68b80cdd00 2024-09-10T22:44:15.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.110+0000 7f68b5600640 1 -- 172.21.15.103:0/3789129210 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) ==== 169+0+0 (secure 0 0 0) 0x7f68a40f7dc0 con 0x7f68b80cdd00 2024-09-10T22:44:15.113 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2024-09-10T22:44:15.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.110+0000 7f68c0000640 1 -- 172.21.15.103:0/3789129210 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f68980725e0 msgr2=0x7f6898074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:15.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.110+0000 7f68c0000640 1 --2- 172.21.15.103:0/3789129210 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f68980725e0 0x7f6898074aa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009e60 tx=0x7f68ac0095b0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.110+0000 7f68c0000640 1 -- 172.21.15.103:0/3789129210 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68b80cdd00 msgr2=0x7f68b80b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:15.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.110+0000 7f68c0000640 1 --2- 172.21.15.103:0/3789129210 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68b80cdd00 0x7f68b80b1c20 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f68a4009850 tx=0x7f68a40a55a0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.110+0000 7f68c0000640 1 -- 172.21.15.103:0/3789129210 shutdown_connections 2024-09-10T22:44:15.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.110+0000 7f68c0000640 1 --2- 172.21.15.103:0/3789129210 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f68980725e0 0x7f6898074aa0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.110+0000 7f68c0000640 1 --2- 172.21.15.103:0/3789129210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68b815f1a0 0x7f68b806ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.110+0000 7f68c0000640 1 --2- 172.21.15.103:0/3789129210 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68b80cdd00 0x7f68b80b1c20 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.110+0000 7f68c0000640 1 --2- 172.21.15.103:0/3789129210 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f68b80cd330 0x7f68b815c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.110+0000 7f68c0000640 1 -- 172.21.15.103:0/3789129210 >> 172.21.15.103:0/3789129210 conn(0x7f68b80d1a20 msgr2=0x7f68b80af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:15.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.114+0000 7f68c0000640 1 -- 172.21.15.103:0/3789129210 shutdown_connections 2024-09-10T22:44:15.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.114+0000 7f68c0000640 1 -- 172.21.15.103:0/3789129210 wait complete. 2024-09-10T22:44:15.146 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T22:44:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.286+0000 7f7046600640 1 -- 172.21.15.103:0/295051235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f704015f2e0 msgr2=0x7f704015f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.286+0000 7f7046600640 1 --2- 172.21.15.103:0/295051235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f704015f2e0 0x7f704015f710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7038009c80 tx=0x7f703801cda0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.286+0000 7f7046600640 1 -- 172.21.15.103:0/295051235 shutdown_connections 2024-09-10T22:44:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.286+0000 7f7046600640 1 --2- 172.21.15.103:0/295051235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f704015f2e0 0x7f704015f710 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.286+0000 7f7046600640 1 --2- 172.21.15.103:0/295051235 >> v2:172.21.15.131:3300/0 conn(0x7f70400cfdd0 0x7f704015eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.286+0000 7f7046600640 1 -- 172.21.15.103:0/295051235 >> 172.21.15.103:0/295051235 conn(0x7f704006cc00 msgr2=0x7f704006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.286+0000 7f7046600640 1 -- 172.21.15.103:0/295051235 shutdown_connections 2024-09-10T22:44:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.286+0000 7f7046600640 1 -- 172.21.15.103:0/295051235 wait complete. 2024-09-10T22:44:15.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7046600640 1 Processor -- start 2024-09-10T22:44:15.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7046600640 1 -- start start 2024-09-10T22:44:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7046600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70400cf9f0 0x7f70401412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7046600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70400cfdd0 0x7f704015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7046600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f704015f2e0 0x7f70400ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7046600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f70400cd720 con 0x7f70400cfdd0 2024-09-10T22:44:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7046600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f70400cd5a0 con 0x7f70400cf9f0 2024-09-10T22:44:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7046600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f70400cd8a0 con 0x7f704015f2e0 2024-09-10T22:44:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7037e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70400cfdd0 0x7f704015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7037e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70400cfdd0 0x7f704015bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52454/0 (socket says 172.21.15.103:52454) 2024-09-10T22:44:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7037e00640 1 -- 172.21.15.103:0/944945738 learned_addr learned my addr 172.21.15.103:0/944945738 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:15.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f703f400640 1 --2- 172.21.15.103:0/944945738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70400cf9f0 0x7f70401412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:15.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f703fe00640 1 --2- 172.21.15.103:0/944945738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f704015f2e0 0x7f70400ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:15.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7037e00640 1 -- 172.21.15.103:0/944945738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f704015f2e0 msgr2=0x7f70400ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:15.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7037e00640 1 --2- 172.21.15.103:0/944945738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f704015f2e0 0x7f70400ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7037e00640 1 -- 172.21.15.103:0/944945738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70400cf9f0 msgr2=0x7f70401412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:15.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7037e00640 1 --2- 172.21.15.103:0/944945738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70400cf9f0 0x7f70401412c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7037e00640 1 -- 172.21.15.103:0/944945738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70400b1fe0 con 0x7f70400cfdd0 2024-09-10T22:44:15.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7037e00640 1 --2- 172.21.15.103:0/944945738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70400cfdd0 0x7f704015bd80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f702800ea10 tx=0x7f702800eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:15.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7037400640 1 -- 172.21.15.103:0/944945738 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702800cde0 con 0x7f70400cfdd0 2024-09-10T22:44:15.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7037400640 1 -- 172.21.15.103:0/944945738 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7028004020 con 0x7f70400cfdd0 2024-09-10T22:44:15.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7046600640 1 -- 172.21.15.103:0/944945738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70400b22c0 con 0x7f70400cfdd0 2024-09-10T22:44:15.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7037400640 1 -- 172.21.15.103:0/944945738 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028004470 con 0x7f70400cfdd0 2024-09-10T22:44:15.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7046600640 1 -- 172.21.15.103:0/944945738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70400af840 con 0x7f70400cfdd0 2024-09-10T22:44:15.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.290+0000 7f7046600640 1 -- 172.21.15.103:0/944945738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f704015eda0 con 0x7f70400cfdd0 2024-09-10T22:44:15.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.294+0000 7f7037400640 1 -- 172.21.15.103:0/944945738 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7028003600 con 0x7f70400cfdd0 2024-09-10T22:44:15.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.294+0000 7f7037400640 1 --2- 172.21.15.103:0/944945738 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f701c0725e0 0x7f701c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:15.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.294+0000 7f7037400640 1 -- 172.21.15.103:0/944945738 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5507+0+0 (secure 0 0 0) 0x7f7028093a60 con 0x7f70400cfdd0 2024-09-10T22:44:15.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.294+0000 7f703f400640 1 --2- 172.21.15.103:0/944945738 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f701c0725e0 0x7f701c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:15.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.294+0000 7f703f400640 1 --2- 172.21.15.103:0/944945738 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f701c0725e0 0x7f701c074aa0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f70400b37b0 tx=0x7f7030009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:15.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.298+0000 7f7037400640 1 -- 172.21.15.103:0/944945738 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f702805eba0 con 0x7f70400cfdd0 2024-09-10T22:44:15.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.466+0000 7f7046600640 1 -- 172.21.15.103:0/944945738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f70400b37e0 con 0x7f70400cfdd0 2024-09-10T22:44:15.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.470+0000 7f7037400640 1 -- 172.21.15.103:0/944945738 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v35) ==== 71+0+0 (secure 0 0 0) 0x7f70280635d0 con 0x7f70400cfdd0 2024-09-10T22:44:15.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.470+0000 7f7046600640 1 -- 172.21.15.103:0/944945738 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f701c0725e0 msgr2=0x7f701c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:15.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.470+0000 7f7046600640 1 --2- 172.21.15.103:0/944945738 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f701c0725e0 0x7f701c074aa0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f70400b37b0 tx=0x7f7030009040 comp rx=0 tx=0).stop 2024-09-10T22:44:15.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.470+0000 7f7046600640 1 -- 172.21.15.103:0/944945738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70400cfdd0 msgr2=0x7f704015bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:15.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.470+0000 7f7046600640 1 --2- 172.21.15.103:0/944945738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70400cfdd0 0x7f704015bd80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f702800ea10 tx=0x7f702800eed0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.470+0000 7f7046600640 1 -- 172.21.15.103:0/944945738 shutdown_connections 2024-09-10T22:44:15.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.470+0000 7f7046600640 1 --2- 172.21.15.103:0/944945738 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f701c0725e0 0x7f701c074aa0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.470+0000 7f7046600640 1 --2- 172.21.15.103:0/944945738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f704015f2e0 0x7f70400ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.470+0000 7f7046600640 1 --2- 172.21.15.103:0/944945738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70400cfdd0 0x7f704015bd80 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.470+0000 7f7046600640 1 --2- 172.21.15.103:0/944945738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70400cf9f0 0x7f70401412c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.470+0000 7f7046600640 1 -- 172.21.15.103:0/944945738 >> 172.21.15.103:0/944945738 conn(0x7f704006cc00 msgr2=0x7f7040158e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:15.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.470+0000 7f7046600640 1 -- 172.21.15.103:0/944945738 shutdown_connections 2024-09-10T22:44:15.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.470+0000 7f7046600640 1 -- 172.21.15.103:0/944945738 wait complete. 2024-09-10T22:44:15.495 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0' 2024-09-10T22:44:15.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08efe00640 1 -- 172.21.15.103:0/4189660855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08e815f1a0 msgr2=0x7f08e80ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:15.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08efe00640 1 --2- 172.21.15.103:0/4189660855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08e815f1a0 0x7f08e80ae7f0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009840 tx=0x7f08dc01c820 comp rx=0 tx=0).stop 2024-09-10T22:44:15.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08efe00640 1 -- 172.21.15.103:0/4189660855 shutdown_connections 2024-09-10T22:44:15.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08efe00640 1 --2- 172.21.15.103:0/4189660855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08e815f1a0 0x7f08e80ae7f0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08efe00640 1 -- 172.21.15.103:0/4189660855 >> 172.21.15.103:0/4189660855 conn(0x7f08e80d1a20 msgr2=0x7f08e80d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:15.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08efe00640 1 -- 172.21.15.103:0/4189660855 shutdown_connections 2024-09-10T22:44:15.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08efe00640 1 -- 172.21.15.103:0/4189660855 wait complete. 2024-09-10T22:44:15.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08efe00640 1 Processor -- start 2024-09-10T22:44:15.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08efe00640 1 -- start start 2024-09-10T22:44:15.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08efe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08e80cd500 0x7f08e8151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:15.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08efe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08e80cdd00 0x7f08e80d1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:15.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08efe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08e815f1a0 0x7f08e80d2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08efe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f08e8169f70 con 0x7f08e80cd500 2024-09-10T22:44:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08efe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f08e8169df0 con 0x7f08e80cdd00 2024-09-10T22:44:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08efe00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f08e816a0f0 con 0x7f08e815f1a0 2024-09-10T22:44:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08ed400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08e80cd500 0x7f08e8151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08ed400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08e80cd500 0x7f08e8151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52472/0 (socket says 172.21.15.103:52472) 2024-09-10T22:44:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08ed400640 1 -- 172.21.15.103:0/2593670839 learned_addr learned my addr 172.21.15.103:0/2593670839 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08eca00640 1 --2- 172.21.15.103:0/2593670839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08e80cdd00 0x7f08e80d1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08ede00640 1 --2- 172.21.15.103:0/2593670839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08e815f1a0 0x7f08e80d2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08ed400640 1 -- 172.21.15.103:0/2593670839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08e815f1a0 msgr2=0x7f08e80d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08ed400640 1 --2- 172.21.15.103:0/2593670839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08e815f1a0 0x7f08e80d2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08ed400640 1 -- 172.21.15.103:0/2593670839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08e80cdd00 msgr2=0x7f08e80d1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08ed400640 1 --2- 172.21.15.103:0/2593670839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08e80cdd00 0x7f08e80d1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08ed400640 1 -- 172.21.15.103:0/2593670839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e80b5c90 con 0x7f08e80cd500 2024-09-10T22:44:15.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.634+0000 7f08ede00640 1 --2- 172.21.15.103:0/2593670839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08e815f1a0 0x7f08e80d2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:15.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.638+0000 7f08ed400640 1 --2- 172.21.15.103:0/2593670839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08e80cd500 0x7f08e8151b80 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0b0040 tx=0x7f08dc005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:15.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.638+0000 7f08e5600640 1 -- 172.21.15.103:0/2593670839 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc0a6990 con 0x7f08e80cd500 2024-09-10T22:44:15.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.638+0000 7f08e5600640 1 -- 172.21.15.103:0/2593670839 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08dc0a6c20 con 0x7f08e80cd500 2024-09-10T22:44:15.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.638+0000 7f08e5600640 1 -- 172.21.15.103:0/2593670839 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc0a6e50 con 0x7f08e80cd500 2024-09-10T22:44:15.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.638+0000 7f08efe00640 1 -- 172.21.15.103:0/2593670839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e80b5f70 con 0x7f08e80cd500 2024-09-10T22:44:15.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.638+0000 7f08efe00640 1 -- 172.21.15.103:0/2593670839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e80b6530 con 0x7f08e80cd500 2024-09-10T22:44:15.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.638+0000 7f08efe00640 1 -- 172.21.15.103:0/2593670839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08e80ae7f0 con 0x7f08e80cd500 2024-09-10T22:44:15.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.638+0000 7f08e5600640 1 -- 172.21.15.103:0/2593670839 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f08dc0a65f0 con 0x7f08e80cd500 2024-09-10T22:44:15.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.638+0000 7f08e5600640 1 --2- 172.21.15.103:0/2593670839 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f08c80727b0 0x7f08c8074c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:15.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.638+0000 7f08e5600640 1 -- 172.21.15.103:0/2593670839 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5507+0+0 (secure 0 0 0) 0x7f08dc12dab0 con 0x7f08e80cd500 2024-09-10T22:44:15.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.638+0000 7f08eca00640 1 --2- 172.21.15.103:0/2593670839 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f08c80727b0 0x7f08c8074c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:15.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.642+0000 7f08eca00640 1 --2- 172.21.15.103:0/2593670839 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f08c80727b0 0x7f08c8074c70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f08e8154b00 tx=0x7f08d4007d50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:15.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.642+0000 7f08e5600640 1 -- 172.21.15.103:0/2593670839 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f08dc0c8060 con 0x7f08e80cd500 2024-09-10T22:44:15.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:15.870+0000 7f08efe00640 1 -- 172.21.15.103:0/2593670839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]} v 0) -- 0x7f08e81679b0 con 0x7f08e80cd500 2024-09-10T22:44:16.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.122+0000 7f08e5600640 1 -- 172.21.15.103:0/2593670839 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]}]=0 v282) ==== 141+0+0 (secure 0 0 0) 0x7f08dc016410 con 0x7f08e80cd500 2024-09-10T22:44:16.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.126+0000 7f08efe00640 1 -- 172.21.15.103:0/2593670839 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f08c80727b0 msgr2=0x7f08c8074c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:16.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.126+0000 7f08efe00640 1 --2- 172.21.15.103:0/2593670839 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f08c80727b0 0x7f08c8074c70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f08e8154b00 tx=0x7f08d4007d50 comp rx=0 tx=0).stop 2024-09-10T22:44:16.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.126+0000 7f08efe00640 1 -- 172.21.15.103:0/2593670839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08e80cd500 msgr2=0x7f08e8151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:16.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.126+0000 7f08efe00640 1 --2- 172.21.15.103:0/2593670839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08e80cd500 0x7f08e8151b80 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0b0040 tx=0x7f08dc005d20 comp rx=0 tx=0).stop 2024-09-10T22:44:16.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.126+0000 7f08efe00640 1 -- 172.21.15.103:0/2593670839 shutdown_connections 2024-09-10T22:44:16.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.126+0000 7f08efe00640 1 --2- 172.21.15.103:0/2593670839 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f08c80727b0 0x7f08c8074c70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.126+0000 7f08efe00640 1 --2- 172.21.15.103:0/2593670839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08e815f1a0 0x7f08e80d2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.126+0000 7f08efe00640 1 --2- 172.21.15.103:0/2593670839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08e80cdd00 0x7f08e80d1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.126+0000 7f08efe00640 1 --2- 172.21.15.103:0/2593670839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08e80cd500 0x7f08e8151b80 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.126+0000 7f08efe00640 1 -- 172.21.15.103:0/2593670839 >> 172.21.15.103:0/2593670839 conn(0x7f08e80d1a20 msgr2=0x7f08e8157920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:16.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.126+0000 7f08efe00640 1 -- 172.21.15.103:0/2593670839 shutdown_connections 2024-09-10T22:44:16.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.126+0000 7f08efe00640 1 -- 172.21.15.103:0/2593670839 wait complete. 2024-09-10T22:44:16.150 INFO:tasks.cephfs_test_runner:test_scrub_non_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2024-09-10T22:44:16.150 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2024-09-10T22:44:16.151 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:44:16.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.290+0000 7faef2a00640 1 -- 172.21.15.103:0/1623241212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeec0cdd00 msgr2=0x7faeec0ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:16.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.290+0000 7faef2a00640 1 --2- 172.21.15.103:0/1623241212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeec0cdd00 0x7faeec0ccdf0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7faeec0d2b20 tx=0x7faed401c8c0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.290+0000 7faef2a00640 1 -- 172.21.15.103:0/1623241212 shutdown_connections 2024-09-10T22:44:16.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.290+0000 7faef2a00640 1 --2- 172.21.15.103:0/1623241212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeec0cdd00 0x7faeec0ccdf0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.290+0000 7faef2a00640 1 --2- 172.21.15.103:0/1623241212 >> v2:172.21.15.131:3300/0 conn(0x7faeec15f1a0 0x7faeec0ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.290+0000 7faef2a00640 1 -- 172.21.15.103:0/1623241212 >> 172.21.15.103:0/1623241212 conn(0x7faeec0d1a20 msgr2=0x7faeec0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:16.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.290+0000 7faef2a00640 1 -- 172.21.15.103:0/1623241212 shutdown_connections 2024-09-10T22:44:16.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.290+0000 7faef2a00640 1 -- 172.21.15.103:0/1623241212 wait complete. 2024-09-10T22:44:16.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.290+0000 7faef2a00640 1 Processor -- start 2024-09-10T22:44:16.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.290+0000 7faef2a00640 1 -- start start 2024-09-10T22:44:16.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.290+0000 7faef2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeec0cd330 0x7faeec0b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:16.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faef2a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faeec0cdd00 0x7faeec070d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:16.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faef2a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faeec15f1a0 0x7faeec0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:16.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faef2a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faeec169070 con 0x7faeec0cd330 2024-09-10T22:44:16.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faef2a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faeec168ef0 con 0x7faeec15f1a0 2024-09-10T22:44:16.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faef2a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7faeec1691f0 con 0x7faeec0cdd00 2024-09-10T22:44:16.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faeebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeec0cd330 0x7faeec0b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:16.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faeebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeec0cd330 0x7faeec0b4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52486/0 (socket says 172.21.15.103:52486) 2024-09-10T22:44:16.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faeebe00640 1 -- 172.21.15.103:0/1035743376 learned_addr learned my addr 172.21.15.103:0/1035743376 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:16.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faef0a00640 1 --2- 172.21.15.103:0/1035743376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faeec15f1a0 0x7faeec0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:16.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faee3400640 1 --2- 172.21.15.103:0/1035743376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faeec0cdd00 0x7faeec070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:16.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faeebe00640 1 -- 172.21.15.103:0/1035743376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faeec0cdd00 msgr2=0x7faeec070d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:16.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faeebe00640 1 --2- 172.21.15.103:0/1035743376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faeec0cdd00 0x7faeec070d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faeebe00640 1 -- 172.21.15.103:0/1035743376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faeec15f1a0 msgr2=0x7faeec0712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:16.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faeebe00640 1 --2- 172.21.15.103:0/1035743376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faeec15f1a0 0x7faeec0712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faeebe00640 1 -- 172.21.15.103:0/1035743376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeec0b6ee0 con 0x7faeec0cd330 2024-09-10T22:44:16.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faeebe00640 1 --2- 172.21.15.103:0/1035743376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeec0cd330 0x7faeec0b4870 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7faedc00ccb0 tx=0x7faedc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:16.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faee8c00640 1 -- 172.21.15.103:0/1035743376 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc00f450 con 0x7faeec0cd330 2024-09-10T22:44:16.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faee8c00640 1 -- 172.21.15.103:0/1035743376 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faedc00f6e0 con 0x7faeec0cd330 2024-09-10T22:44:16.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faee8c00640 1 -- 172.21.15.103:0/1035743376 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc00fb30 con 0x7faeec0cd330 2024-09-10T22:44:16.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faef2a00640 1 -- 172.21.15.103:0/1035743376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeec0b71c0 con 0x7faeec0cd330 2024-09-10T22:44:16.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faef2a00640 1 -- 172.21.15.103:0/1035743376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeec0c9ca0 con 0x7faeec0cd330 2024-09-10T22:44:16.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faef2a00640 1 -- 172.21.15.103:0/1035743376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeec0b76e0 con 0x7faeec0cd330 2024-09-10T22:44:16.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.294+0000 7faee8c00640 1 -- 172.21.15.103:0/1035743376 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7faedc020030 con 0x7faeec0cd330 2024-09-10T22:44:16.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.298+0000 7faee8c00640 1 --2- 172.21.15.103:0/1035743376 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faec8072610 0x7faec8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:16.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.298+0000 7faee8c00640 1 -- 172.21.15.103:0/1035743376 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5507+0+0 (secure 0 0 0) 0x7faedc0939c0 con 0x7faeec0cd330 2024-09-10T22:44:16.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.298+0000 7faee3400640 1 --2- 172.21.15.103:0/1035743376 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faec8072610 0x7faec8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:16.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.298+0000 7faee3400640 1 --2- 172.21.15.103:0/1035743376 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faec8072610 0x7faec8074ad0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7faed40af000 tx=0x7faed401b100 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:16.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.302+0000 7faee8c00640 1 -- 172.21.15.103:0/1035743376 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7faedc014030 con 0x7faeec0cd330 2024-09-10T22:44:16.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.470+0000 7faef2a00640 1 -- 172.21.15.103:0/1035743376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faeec0ccdf0 con 0x7faeec0cd330 2024-09-10T22:44:16.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.470+0000 7faee8c00640 1 -- 172.21.15.103:0/1035743376 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+13628 (secure 0 0 0) 0x7faedc05f0c0 con 0x7faeec0cd330 2024-09-10T22:44:16.475 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:16.476 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":84,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:44:15.111409+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.131:6836/134240629":"2024-09-11T22:44:11.800691+0000","172.21.15.131:6834/134240629":"2024-09-11T22:44:11.800691+0000","172.21.15.103:6835/249667943":"2024-09-11T22:44:11.800696+0000","172.21.15.103:6833/249667943":"2024-09-11T22:44:11.800696+0000","172.21.15.131:6837/4254729752":"2024-09-11T22:44:11.800680+0000","172.21.15.131:6835/4254729752":"2024-09-11T22:44:11.800680+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:44:16.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.474+0000 7faef2a00640 1 -- 172.21.15.103:0/1035743376 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faec8072610 msgr2=0x7faec8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:16.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.474+0000 7faef2a00640 1 --2- 172.21.15.103:0/1035743376 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faec8072610 0x7faec8074ad0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7faed40af000 tx=0x7faed401b100 comp rx=0 tx=0).stop 2024-09-10T22:44:16.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.474+0000 7faef2a00640 1 -- 172.21.15.103:0/1035743376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeec0cd330 msgr2=0x7faeec0b4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:16.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.474+0000 7faef2a00640 1 --2- 172.21.15.103:0/1035743376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeec0cd330 0x7faeec0b4870 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7faedc00ccb0 tx=0x7faedc00a620 comp rx=0 tx=0).stop 2024-09-10T22:44:16.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.474+0000 7faef2a00640 1 -- 172.21.15.103:0/1035743376 shutdown_connections 2024-09-10T22:44:16.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.474+0000 7faef2a00640 1 --2- 172.21.15.103:0/1035743376 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faec8072610 0x7faec8074ad0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.474+0000 7faef2a00640 1 --2- 172.21.15.103:0/1035743376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faeec15f1a0 0x7faeec0712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.474+0000 7faef2a00640 1 --2- 172.21.15.103:0/1035743376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faeec0cdd00 0x7faeec070d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.474+0000 7faef2a00640 1 --2- 172.21.15.103:0/1035743376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeec0cd330 0x7faeec0b4870 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.474+0000 7faef2a00640 1 -- 172.21.15.103:0/1035743376 >> 172.21.15.103:0/1035743376 conn(0x7faeec0d1a20 msgr2=0x7faeec15e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:16.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.474+0000 7faef2a00640 1 -- 172.21.15.103:0/1035743376 shutdown_connections 2024-09-10T22:44:16.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.474+0000 7faef2a00640 1 -- 172.21.15.103:0/1035743376 wait complete. 2024-09-10T22:44:16.496 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T22:38:39.639064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T22:44:16.497 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T22:44:16.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.638+0000 7f50acc00640 1 -- 172.21.15.103:0/1775700736 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50a80b09c0 msgr2=0x7f50a80ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:16.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.638+0000 7f50acc00640 1 --2- 172.21.15.103:0/1775700736 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50a80b09c0 0x7f50a80ce600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5094009900 tx=0x7f509401c850 comp rx=0 tx=0).stop 2024-09-10T22:44:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.638+0000 7f50acc00640 1 -- 172.21.15.103:0/1775700736 shutdown_connections 2024-09-10T22:44:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.638+0000 7f50acc00640 1 --2- 172.21.15.103:0/1775700736 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50a80b09c0 0x7f50a80ce600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.638+0000 7f50acc00640 1 --2- 172.21.15.103:0/1775700736 >> v2:172.21.15.131:3300/0 conn(0x7f50a815be30 0x7f50a80ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.638+0000 7f50acc00640 1 -- 172.21.15.103:0/1775700736 >> 172.21.15.103:0/1775700736 conn(0x7f50a80d1ac0 msgr2=0x7f50a80d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.638+0000 7f50acc00640 1 -- 172.21.15.103:0/1775700736 shutdown_connections 2024-09-10T22:44:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.638+0000 7f50acc00640 1 -- 172.21.15.103:0/1775700736 wait complete. 2024-09-10T22:44:16.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.638+0000 7f50acc00640 1 Processor -- start 2024-09-10T22:44:16.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50acc00640 1 -- start start 2024-09-10T22:44:16.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50acc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a80b09c0 0x7f50a81561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:16.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50acc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50a80ceb40 0x7f50a8166260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:16.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50acc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50a815be30 0x7f50a81fba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50acc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f50a8169110 con 0x7f50a80b09c0 2024-09-10T22:44:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50acc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f50a8168f90 con 0x7f50a815be30 2024-09-10T22:44:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50acc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f50a8169290 con 0x7f50a80ceb40 2024-09-10T22:44:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50a5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a80b09c0 0x7f50a81561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50a5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a80b09c0 0x7f50a81561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44138/0 (socket says 172.21.15.103:44138) 2024-09-10T22:44:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50a5e00640 1 -- 172.21.15.103:0/3131031987 learned_addr learned my addr 172.21.15.103:0/3131031987 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50a5400640 1 --2- 172.21.15.103:0/3131031987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50a80ceb40 0x7f50a8166260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50a6800640 1 --2- 172.21.15.103:0/3131031987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50a815be30 0x7f50a81fba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50a5e00640 1 -- 172.21.15.103:0/3131031987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50a80ceb40 msgr2=0x7f50a8166260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50a5e00640 1 --2- 172.21.15.103:0/3131031987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50a80ceb40 0x7f50a8166260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50a5e00640 1 -- 172.21.15.103:0/3131031987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50a815be30 msgr2=0x7f50a81fba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50a5e00640 1 --2- 172.21.15.103:0/3131031987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50a815be30 0x7f50a81fba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50a5e00640 1 -- 172.21.15.103:0/3131031987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a8152830 con 0x7f50a80b09c0 2024-09-10T22:44:16.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50a5400640 1 --2- 172.21.15.103:0/3131031987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50a80ceb40 0x7f50a8166260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:44:16.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50a6800640 1 --2- 172.21.15.103:0/3131031987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50a815be30 0x7f50a81fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:44:16.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50a5e00640 1 --2- 172.21.15.103:0/3131031987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a80b09c0 0x7f50a81561a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f509800e970 tx=0x7f509800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:16.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f509e000640 1 -- 172.21.15.103:0/3131031987 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509800cd80 con 0x7f50a80b09c0 2024-09-10T22:44:16.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f509e000640 1 -- 172.21.15.103:0/3131031987 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5098004020 con 0x7f50a80b09c0 2024-09-10T22:44:16.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f509e000640 1 -- 172.21.15.103:0/3131031987 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5098004470 con 0x7f50a80b09c0 2024-09-10T22:44:16.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50acc00640 1 -- 172.21.15.103:0/3131031987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50a8152ad0 con 0x7f50a80b09c0 2024-09-10T22:44:16.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50acc00640 1 -- 172.21.15.103:0/3131031987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50a8151070 con 0x7f50a80b09c0 2024-09-10T22:44:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.642+0000 7f50acc00640 1 -- 172.21.15.103:0/3131031987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50a80cf9c0 con 0x7f50a80b09c0 2024-09-10T22:44:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.646+0000 7f509e000640 1 -- 172.21.15.103:0/3131031987 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5098003600 con 0x7f50a80b09c0 2024-09-10T22:44:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.646+0000 7f509e000640 1 --2- 172.21.15.103:0/3131031987 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5088072610 0x7f5088074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.646+0000 7f509e000640 1 -- 172.21.15.103:0/3131031987 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5507+0+0 (secure 0 0 0) 0x7f5098093a50 con 0x7f50a80b09c0 2024-09-10T22:44:16.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.646+0000 7f50a5400640 1 --2- 172.21.15.103:0/3131031987 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5088072610 0x7f5088074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:16.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.646+0000 7f50a5400640 1 --2- 172.21.15.103:0/3131031987 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5088072610 0x7f5088074ad0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f50940af000 tx=0x7f509401b090 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.650+0000 7f509e000640 1 -- 172.21.15.103:0/3131031987 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f509805eb00 con 0x7f50a80b09c0 2024-09-10T22:44:16.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.814+0000 7f50acc00640 1 -- 172.21.15.103:0/3131031987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f50a8152ff0 con 0x7f50a80b09c0 2024-09-10T22:44:16.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.814+0000 7f509e000640 1 -- 172.21.15.103:0/3131031987 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f5098063530 con 0x7f50a80b09c0 2024-09-10T22:44:16.819 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-09-10T22:44:16.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.818+0000 7f50acc00640 1 -- 172.21.15.103:0/3131031987 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5088072610 msgr2=0x7f5088074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:16.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.818+0000 7f50acc00640 1 --2- 172.21.15.103:0/3131031987 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5088072610 0x7f5088074ad0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f50940af000 tx=0x7f509401b090 comp rx=0 tx=0).stop 2024-09-10T22:44:16.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.818+0000 7f50acc00640 1 -- 172.21.15.103:0/3131031987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a80b09c0 msgr2=0x7f50a81561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:16.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.818+0000 7f50acc00640 1 --2- 172.21.15.103:0/3131031987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a80b09c0 0x7f50a81561a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f509800e970 tx=0x7f509800ee30 comp rx=0 tx=0).stop 2024-09-10T22:44:16.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.818+0000 7f50acc00640 1 -- 172.21.15.103:0/3131031987 shutdown_connections 2024-09-10T22:44:16.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.818+0000 7f50acc00640 1 --2- 172.21.15.103:0/3131031987 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5088072610 0x7f5088074ad0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.818+0000 7f50acc00640 1 --2- 172.21.15.103:0/3131031987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50a815be30 0x7f50a81fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.818+0000 7f50acc00640 1 --2- 172.21.15.103:0/3131031987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50a80ceb40 0x7f50a8166260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.818+0000 7f50acc00640 1 --2- 172.21.15.103:0/3131031987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a80b09c0 0x7f50a81561a0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.818+0000 7f50acc00640 1 -- 172.21.15.103:0/3131031987 >> 172.21.15.103:0/3131031987 conn(0x7f50a80d1ac0 msgr2=0x7f50a80b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:16.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.818+0000 7f50acc00640 1 -- 172.21.15.103:0/3131031987 shutdown_connections 2024-09-10T22:44:16.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.818+0000 7f50acc00640 1 -- 172.21.15.103:0/3131031987 wait complete. 2024-09-10T22:44:16.840 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0' 2024-09-10T22:44:16.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.978+0000 7f4615400640 1 -- 172.21.15.103:0/3973203232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46100cc120 msgr2=0x7f46100aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:16.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.978+0000 7f4615400640 1 --2- 172.21.15.103:0/3973203232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46100cc120 0x7f46100aeb40 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f46100b4ee0 tx=0x7f460001c810 comp rx=0 tx=0).stop 2024-09-10T22:44:16.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.978+0000 7f4615400640 1 -- 172.21.15.103:0/3973203232 shutdown_connections 2024-09-10T22:44:16.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.978+0000 7f4615400640 1 --2- 172.21.15.103:0/3973203232 >> v2:172.21.15.131:3300/0 conn(0x7f46100cf790 0x7f46100cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.978+0000 7f4615400640 1 --2- 172.21.15.103:0/3973203232 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f461015c970 0x7f4610072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.978+0000 7f4615400640 1 --2- 172.21.15.103:0/3973203232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46100cc120 0x7f46100aeb40 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.978+0000 7f4615400640 1 -- 172.21.15.103:0/3973203232 >> 172.21.15.103:0/3973203232 conn(0x7f461006cc00 msgr2=0x7f461006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:16.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.978+0000 7f4615400640 1 -- 172.21.15.103:0/3973203232 shutdown_connections 2024-09-10T22:44:16.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.978+0000 7f4615400640 1 -- 172.21.15.103:0/3973203232 wait complete. 2024-09-10T22:44:16.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.978+0000 7f4615400640 1 Processor -- start 2024-09-10T22:44:16.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.978+0000 7f4615400640 1 -- start start 2024-09-10T22:44:16.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f4615400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46100cc120 0x7f46101f6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:16.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f4615400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46100cf790 0x7f46100af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:16.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f4615400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f461015c970 0x7f461006e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:16.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f4615400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f461015f8a0 con 0x7f461015c970 2024-09-10T22:44:16.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f4615400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f461015f720 con 0x7f46100cc120 2024-09-10T22:44:16.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f4615400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f461015fa20 con 0x7f46100cf790 2024-09-10T22:44:16.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f460f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f461015c970 0x7f461006e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:16.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f460f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f461015c970 0x7f461006e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44162/0 (socket says 172.21.15.103:44162) 2024-09-10T22:44:16.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f460f200640 1 -- 172.21.15.103:0/3132476672 learned_addr learned my addr 172.21.15.103:0/3132476672 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:16.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f4605e00640 1 --2- 172.21.15.103:0/3132476672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46100cf790 0x7f46100af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:16.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f460e800640 1 --2- 172.21.15.103:0/3132476672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46100cc120 0x7f46101f6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:16.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f460f200640 1 -- 172.21.15.103:0/3132476672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46100cf790 msgr2=0x7f46100af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:16.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f460f200640 1 --2- 172.21.15.103:0/3132476672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46100cf790 0x7f46100af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f460f200640 1 -- 172.21.15.103:0/3132476672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46100cc120 msgr2=0x7f46101f6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:16.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f460f200640 1 --2- 172.21.15.103:0/3132476672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46100cc120 0x7f46101f6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:16.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f460f200640 1 -- 172.21.15.103:0/3132476672 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461013ef40 con 0x7f461015c970 2024-09-10T22:44:16.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f460f200640 1 --2- 172.21.15.103:0/3132476672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f461015c970 0x7f461006e7b0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f460800e990 tx=0x7f460800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:16.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f4607400640 1 -- 172.21.15.103:0/3132476672 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608004d30 con 0x7f461015c970 2024-09-10T22:44:16.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f4607400640 1 -- 172.21.15.103:0/3132476672 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f460800ca40 con 0x7f461015c970 2024-09-10T22:44:16.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f4615400640 1 -- 172.21.15.103:0/3132476672 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461013f1e0 con 0x7f461015c970 2024-09-10T22:44:16.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f4607400640 1 -- 172.21.15.103:0/3132476672 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608005020 con 0x7f461015c970 2024-09-10T22:44:16.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f4615400640 1 -- 172.21.15.103:0/3132476672 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f461013f7a0 con 0x7f461015c970 2024-09-10T22:44:16.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f4615400640 1 -- 172.21.15.103:0/3132476672 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46100cfc20 con 0x7f461015c970 2024-09-10T22:44:16.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.982+0000 7f4607400640 1 -- 172.21.15.103:0/3132476672 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f460800f040 con 0x7f461015c970 2024-09-10T22:44:16.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.986+0000 7f4607400640 1 --2- 172.21.15.103:0/3132476672 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f45ec072610 0x7f45ec074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:16.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.986+0000 7f4607400640 1 -- 172.21.15.103:0/3132476672 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5507+0+0 (secure 0 0 0) 0x7f4608093690 con 0x7f461015c970 2024-09-10T22:44:16.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.986+0000 7f460e800640 1 --2- 172.21.15.103:0/3132476672 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f45ec072610 0x7f45ec074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:16.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.986+0000 7f460e800640 1 --2- 172.21.15.103:0/3132476672 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f45ec072610 0x7f45ec074ad0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f46000af000 tx=0x7f460001b050 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:16.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:16.990+0000 7f4607400640 1 -- 172.21.15.103:0/3132476672 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4608016030 con 0x7f461015c970 2024-09-10T22:44:17.190 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:44:17.193 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:44:17.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:17.218+0000 7f4615400640 1 -- 172.21.15.103:0/3132476672 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]} v 0) -- 0x7f4610075df0 con 0x7f461015c970 2024-09-10T22:44:18.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.130+0000 7f4607400640 1 -- 172.21.15.103:0/3132476672 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]}]=0 v284) ==== 157+0+0 (secure 0 0 0) 0x7f460805e740 con 0x7f461015c970 2024-09-10T22:44:18.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.134+0000 7f4615400640 1 -- 172.21.15.103:0/3132476672 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f45ec072610 msgr2=0x7f45ec074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:18.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.134+0000 7f4615400640 1 --2- 172.21.15.103:0/3132476672 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f45ec072610 0x7f45ec074ad0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f46000af000 tx=0x7f460001b050 comp rx=0 tx=0).stop 2024-09-10T22:44:18.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.134+0000 7f4615400640 1 -- 172.21.15.103:0/3132476672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f461015c970 msgr2=0x7f461006e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:18.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.134+0000 7f4615400640 1 --2- 172.21.15.103:0/3132476672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f461015c970 0x7f461006e7b0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f460800e990 tx=0x7f460800ee50 comp rx=0 tx=0).stop 2024-09-10T22:44:18.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.134+0000 7f4615400640 1 -- 172.21.15.103:0/3132476672 shutdown_connections 2024-09-10T22:44:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.134+0000 7f4615400640 1 --2- 172.21.15.103:0/3132476672 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f45ec072610 0x7f45ec074ad0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.134+0000 7f4615400640 1 --2- 172.21.15.103:0/3132476672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f461015c970 0x7f461006e7b0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.134+0000 7f4615400640 1 --2- 172.21.15.103:0/3132476672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46100cf790 0x7f46100af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.134+0000 7f4615400640 1 --2- 172.21.15.103:0/3132476672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46100cc120 0x7f46101f6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.134+0000 7f4615400640 1 -- 172.21.15.103:0/3132476672 >> 172.21.15.103:0/3132476672 conn(0x7f461006cc00 msgr2=0x7f46100ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.134+0000 7f4615400640 1 -- 172.21.15.103:0/3132476672 shutdown_connections 2024-09-10T22:44:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.134+0000 7f4615400640 1 -- 172.21.15.103:0/3132476672 wait complete. 2024-09-10T22:44:18.159 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T22:44:18.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.302+0000 7fc062000640 1 -- 172.21.15.103:0/1909697524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0b2c10 msgr2=0x7fc05c0b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:18.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.302+0000 7fc062000640 1 --2- 172.21.15.103:0/1909697524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0b2c10 0x7fc05c0b3030 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fc05c074960 tx=0x7fc04401cd80 comp rx=0 tx=0).stop 2024-09-10T22:44:18.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.302+0000 7fc062000640 1 -- 172.21.15.103:0/1909697524 shutdown_connections 2024-09-10T22:44:18.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.302+0000 7fc062000640 1 --2- 172.21.15.103:0/1909697524 >> v2:172.21.15.131:3300/0 conn(0x7fc05c072500 0x7fc05c072970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.302+0000 7fc062000640 1 --2- 172.21.15.103:0/1909697524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0b2c10 0x7fc05c0b3030 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.302+0000 7fc062000640 1 -- 172.21.15.103:0/1909697524 >> 172.21.15.103:0/1909697524 conn(0x7fc05c06cc00 msgr2=0x7fc05c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:18.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.302+0000 7fc062000640 1 -- 172.21.15.103:0/1909697524 shutdown_connections 2024-09-10T22:44:18.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.302+0000 7fc062000640 1 -- 172.21.15.103:0/1909697524 wait complete. 2024-09-10T22:44:18.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.302+0000 7fc062000640 1 Processor -- start 2024-09-10T22:44:18.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.302+0000 7fc062000640 1 -- start start 2024-09-10T22:44:18.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc062000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc05c072500 0x7fc05c136a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:18.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc062000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc05c0b2c10 0x7fc05c139cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:18.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc062000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0cf260 0x7fc05c0ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:18.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc062000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c157c30 con 0x7fc05c0cf260 2024-09-10T22:44:18.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc062000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c157ab0 con 0x7fc05c0b2c10 2024-09-10T22:44:18.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc062000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc05c157db0 con 0x7fc05c072500 2024-09-10T22:44:18.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc05be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0cf260 0x7fc05c0ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:18.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc05be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0cf260 0x7fc05c0ae530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44184/0 (socket says 172.21.15.103:44184) 2024-09-10T22:44:18.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc05be00640 1 -- 172.21.15.103:0/3495759666 learned_addr learned my addr 172.21.15.103:0/3495759666 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc052a00640 1 --2- 172.21.15.103:0/3495759666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc05c0b2c10 0x7fc05c139cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc05b400640 1 --2- 172.21.15.103:0/3495759666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc05c072500 0x7fc05c136a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc05be00640 1 -- 172.21.15.103:0/3495759666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc05c072500 msgr2=0x7fc05c136a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc05be00640 1 --2- 172.21.15.103:0/3495759666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc05c072500 0x7fc05c136a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc05be00640 1 -- 172.21.15.103:0/3495759666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc05c0b2c10 msgr2=0x7fc05c139cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc05be00640 1 --2- 172.21.15.103:0/3495759666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc05c0b2c10 0x7fc05c139cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc05be00640 1 -- 172.21.15.103:0/3495759666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05c13a1f0 con 0x7fc05c0cf260 2024-09-10T22:44:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc05b400640 1 --2- 172.21.15.103:0/3495759666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc05c072500 0x7fc05c136a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc05be00640 1 --2- 172.21.15.103:0/3495759666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0cf260 0x7fc05c0ae530 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fc05400d780 tx=0x7fc05400dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc053e00640 1 -- 172.21.15.103:0/3495759666 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054017070 con 0x7fc05c0cf260 2024-09-10T22:44:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc053e00640 1 -- 172.21.15.103:0/3495759666 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc05400de90 con 0x7fc05c0cf260 2024-09-10T22:44:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc053e00640 1 -- 172.21.15.103:0/3495759666 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054005020 con 0x7fc05c0cf260 2024-09-10T22:44:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc062000640 1 -- 172.21.15.103:0/3495759666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc05c1f8b60 con 0x7fc05c0cf260 2024-09-10T22:44:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc062000640 1 -- 172.21.15.103:0/3495759666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc05c1f9120 con 0x7fc05c0cf260 2024-09-10T22:44:18.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc062000640 1 -- 172.21.15.103:0/3495759666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc05c072970 con 0x7fc05c0cf260 2024-09-10T22:44:18.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.306+0000 7fc053e00640 1 -- 172.21.15.103:0/3495759666 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc0540051c0 con 0x7fc05c0cf260 2024-09-10T22:44:18.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.310+0000 7fc053e00640 1 --2- 172.21.15.103:0/3495759666 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc0380725e0 0x7fc038074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:18.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.310+0000 7fc053e00640 1 -- 172.21.15.103:0/3495759666 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5507+0+0 (secure 0 0 0) 0x7fc054093280 con 0x7fc05c0cf260 2024-09-10T22:44:18.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.310+0000 7fc05b400640 1 --2- 172.21.15.103:0/3495759666 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc0380725e0 0x7fc038074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:18.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.310+0000 7fc05b400640 1 --2- 172.21.15.103:0/3495759666 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc0380725e0 0x7fc038074aa0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0016b0 tx=0x7fc04c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:18.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.314+0000 7fc053e00640 1 -- 172.21.15.103:0/3495759666 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc05405e330 con 0x7fc05c0cf260 2024-09-10T22:44:18.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.478+0000 7fc062000640 1 -- 172.21.15.103:0/3495759666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fc05c152560 con 0x7fc05c0cf260 2024-09-10T22:44:18.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.482+0000 7fc053e00640 1 -- 172.21.15.103:0/3495759666 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v35) ==== 59+0+1998 (secure 0 0 0) 0x7fc0540670a0 con 0x7fc05c0cf260 2024-09-10T22:44:18.484 INFO:teuthology.orchestra.run.smithi103.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T22:44:18.484 INFO:teuthology.orchestra.run.smithi103.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T22:44:18.484 INFO:teuthology.orchestra.run.smithi103.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T22:44:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T22:44:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4853.781452 2024-09-10T22:44:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 8222.655229 2024-09-10T22:44:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4587.934032 2024-09-10T22:44:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4814.972817 2024-09-10T22:44:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3485.951614 2024-09-10T22:44:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3821.456289 2024-09-10T22:44:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3533.610209 2024-09-10T22:44:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3752.830807 2024-09-10T22:44:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced debug_mds 20/20 2024-09-10T22:44:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T22:44:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced debug_ms 2/2 2024-09-10T22:44:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:mds dev mds_debug_frag true 2024-09-10T22:44:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:mds dev mds_debug_scatterstat true 2024-09-10T22:44:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T22:44:18.486 INFO:teuthology.orchestra.run.smithi103.stdout:mds dev mds_verify_scatter true 2024-09-10T22:44:18.486 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T22:44:18.486 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T22:44:18.486 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T22:44:18.486 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced client_mount_timeout 600 2024-09-10T22:44:18.486 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced debug_client 20/20 2024-09-10T22:44:18.486 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced debug_ms 1/1 2024-09-10T22:44:18.486 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T22:44:18.486 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T22:44:18.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.482+0000 7fc062000640 1 -- 172.21.15.103:0/3495759666 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc0380725e0 msgr2=0x7fc038074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:18.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.482+0000 7fc062000640 1 --2- 172.21.15.103:0/3495759666 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc0380725e0 0x7fc038074aa0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0016b0 tx=0x7fc04c009040 comp rx=0 tx=0).stop 2024-09-10T22:44:18.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.482+0000 7fc062000640 1 -- 172.21.15.103:0/3495759666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0cf260 msgr2=0x7fc05c0ae530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:18.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.482+0000 7fc062000640 1 --2- 172.21.15.103:0/3495759666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0cf260 0x7fc05c0ae530 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fc05400d780 tx=0x7fc05400dc40 comp rx=0 tx=0).stop 2024-09-10T22:44:18.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.482+0000 7fc062000640 1 -- 172.21.15.103:0/3495759666 shutdown_connections 2024-09-10T22:44:18.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.482+0000 7fc062000640 1 --2- 172.21.15.103:0/3495759666 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc0380725e0 0x7fc038074aa0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.482+0000 7fc062000640 1 --2- 172.21.15.103:0/3495759666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc05c0cf260 0x7fc05c0ae530 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.482+0000 7fc062000640 1 --2- 172.21.15.103:0/3495759666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc05c0b2c10 0x7fc05c139cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.482+0000 7fc062000640 1 --2- 172.21.15.103:0/3495759666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc05c072500 0x7fc05c136a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.482+0000 7fc062000640 1 -- 172.21.15.103:0/3495759666 >> 172.21.15.103:0/3495759666 conn(0x7fc05c06cc00 msgr2=0x7fc05c158ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:18.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.482+0000 7fc062000640 1 -- 172.21.15.103:0/3495759666 shutdown_connections 2024-09-10T22:44:18.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.482+0000 7fc062000640 1 -- 172.21.15.103:0/3495759666 wait complete. 2024-09-10T22:44:18.505 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T22:44:18.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.646+0000 7fb631c00640 1 -- 172.21.15.103:0/2997822451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb62c15be30 msgr2=0x7fb62c0ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:18.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.646+0000 7fb631c00640 1 --2- 172.21.15.103:0/2997822451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb62c15be30 0x7fb62c0ce0c0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009bc0 tx=0x7fb61c01cb10 comp rx=0 tx=0).stop 2024-09-10T22:44:18.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.646+0000 7fb631c00640 1 -- 172.21.15.103:0/2997822451 shutdown_connections 2024-09-10T22:44:18.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.646+0000 7fb631c00640 1 --2- 172.21.15.103:0/2997822451 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb62c0ae9c0 0x7fb62c0aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.646+0000 7fb631c00640 1 --2- 172.21.15.103:0/2997822451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb62c15be30 0x7fb62c0ce0c0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.646+0000 7fb631c00640 1 -- 172.21.15.103:0/2997822451 >> 172.21.15.103:0/2997822451 conn(0x7fb62c0d1ac0 msgr2=0x7fb62c0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:18.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.646+0000 7fb631c00640 1 -- 172.21.15.103:0/2997822451 shutdown_connections 2024-09-10T22:44:18.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.646+0000 7fb631c00640 1 -- 172.21.15.103:0/2997822451 wait complete. 2024-09-10T22:44:18.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.646+0000 7fb631c00640 1 Processor -- start 2024-09-10T22:44:18.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.646+0000 7fb631c00640 1 -- start start 2024-09-10T22:44:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb631c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb62c0ae9c0 0x7fb62c14d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb631c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb62c0b09c0 0x7fb62c1578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb631c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb62c15be30 0x7fb62c14dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb631c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb62c168df0 con 0x7fb62c0ae9c0 2024-09-10T22:44:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb631c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb62c168c70 con 0x7fb62c0b09c0 2024-09-10T22:44:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb631c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb62c168f70 con 0x7fb62c15be30 2024-09-10T22:44:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb62aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb62c0ae9c0 0x7fb62c14d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:18.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb62aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb62c0ae9c0 0x7fb62c14d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44192/0 (socket says 172.21.15.103:44192) 2024-09-10T22:44:18.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb62aa00640 1 -- 172.21.15.103:0/3564180047 learned_addr learned my addr 172.21.15.103:0/3564180047 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:18.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb62b400640 1 --2- 172.21.15.103:0/3564180047 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb62c15be30 0x7fb62c14dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:18.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb622000640 1 --2- 172.21.15.103:0/3564180047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb62c0b09c0 0x7fb62c1578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:18.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb62aa00640 1 -- 172.21.15.103:0/3564180047 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb62c15be30 msgr2=0x7fb62c14dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:18.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb62aa00640 1 --2- 172.21.15.103:0/3564180047 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb62c15be30 0x7fb62c14dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb62aa00640 1 -- 172.21.15.103:0/3564180047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb62c0b09c0 msgr2=0x7fb62c1578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:18.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb62aa00640 1 --2- 172.21.15.103:0/3564180047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb62c0b09c0 0x7fb62c1578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb62aa00640 1 -- 172.21.15.103:0/3564180047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62c157e30 con 0x7fb62c0ae9c0 2024-09-10T22:44:18.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb622000640 1 --2- 172.21.15.103:0/3564180047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb62c0b09c0 0x7fb62c1578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:18.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb62aa00640 1 --2- 172.21.15.103:0/3564180047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb62c0ae9c0 0x7fb62c14d0b0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009b10 tx=0x7fb61c0a57e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:18.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb623400640 1 -- 172.21.15.103:0/3564180047 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0bb070 con 0x7fb62c0ae9c0 2024-09-10T22:44:18.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb623400640 1 -- 172.21.15.103:0/3564180047 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb61c004d40 con 0x7fb62c0ae9c0 2024-09-10T22:44:18.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb623400640 1 -- 172.21.15.103:0/3564180047 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0b2040 con 0x7fb62c0ae9c0 2024-09-10T22:44:18.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb631c00640 1 -- 172.21.15.103:0/3564180047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb62c1580b0 con 0x7fb62c0ae9c0 2024-09-10T22:44:18.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb631c00640 1 -- 172.21.15.103:0/3564180047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb62c158670 con 0x7fb62c0ae9c0 2024-09-10T22:44:18.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb631c00640 1 -- 172.21.15.103:0/3564180047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb62c0aee50 con 0x7fb62c0ae9c0 2024-09-10T22:44:18.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.650+0000 7fb623400640 1 -- 172.21.15.103:0/3564180047 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb61c0b5030 con 0x7fb62c0ae9c0 2024-09-10T22:44:18.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.654+0000 7fb623400640 1 --2- 172.21.15.103:0/3564180047 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb608072610 0x7fb608074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:18.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.654+0000 7fb623400640 1 -- 172.21.15.103:0/3564180047 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5507+0+0 (secure 0 0 0) 0x7fb61c12cff0 con 0x7fb62c0ae9c0 2024-09-10T22:44:18.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.654+0000 7fb622000640 1 --2- 172.21.15.103:0/3564180047 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb608072610 0x7fb608074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:18.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.654+0000 7fb622000640 1 --2- 172.21.15.103:0/3564180047 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb608072610 0x7fb608074ad0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb62c1594c0 tx=0x7fb614009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:18.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.658+0000 7fb623400640 1 -- 172.21.15.103:0/3564180047 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb62c157e30 con 0x7fb62c0ae9c0 2024-09-10T22:44:18.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.822+0000 7fb631c00640 1 -- 172.21.15.103:0/3564180047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb62c14d5f0 con 0x7fb62c0ae9c0 2024-09-10T22:44:18.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.826+0000 7fb623400640 1 -- 172.21.15.103:0/3564180047 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7fb61c016790 con 0x7fb62c0ae9c0 2024-09-10T22:44:18.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.830+0000 7fb631c00640 1 -- 172.21.15.103:0/3564180047 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb608072610 msgr2=0x7fb608074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:18.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.830+0000 7fb631c00640 1 --2- 172.21.15.103:0/3564180047 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb608072610 0x7fb608074ad0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb62c1594c0 tx=0x7fb614009040 comp rx=0 tx=0).stop 2024-09-10T22:44:18.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.830+0000 7fb631c00640 1 -- 172.21.15.103:0/3564180047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb62c0ae9c0 msgr2=0x7fb62c14d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:18.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.830+0000 7fb631c00640 1 --2- 172.21.15.103:0/3564180047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb62c0ae9c0 0x7fb62c14d0b0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009b10 tx=0x7fb61c0a57e0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.830+0000 7fb631c00640 1 -- 172.21.15.103:0/3564180047 shutdown_connections 2024-09-10T22:44:18.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.830+0000 7fb631c00640 1 --2- 172.21.15.103:0/3564180047 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb608072610 0x7fb608074ad0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.830+0000 7fb631c00640 1 --2- 172.21.15.103:0/3564180047 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb62c15be30 0x7fb62c14dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.830+0000 7fb631c00640 1 --2- 172.21.15.103:0/3564180047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb62c0b09c0 0x7fb62c1578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.830+0000 7fb631c00640 1 --2- 172.21.15.103:0/3564180047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb62c0ae9c0 0x7fb62c14d0b0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:18.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.830+0000 7fb631c00640 1 -- 172.21.15.103:0/3564180047 >> 172.21.15.103:0/3564180047 conn(0x7fb62c0d1ac0 msgr2=0x7fb62c14e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:18.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.830+0000 7fb631c00640 1 -- 172.21.15.103:0/3564180047 shutdown_connections 2024-09-10T22:44:18.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:18.830+0000 7fb631c00640 1 -- 172.21.15.103:0/3564180047 wait complete. 2024-09-10T22:44:18.853 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T22:44:18.853 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:44:18.926 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:44:19.027 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T22:44:19.028 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:44:19.028 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:44:19.036 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350248k,nr_inodes=4087562,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3542 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T22:44:19.036 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:44:19.036 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:44:19.046 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:44:19.046 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:44:19.046 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:44:19.087 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350248k,nr_inodes=4087562,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3542 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T22:44:19.087 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:44:19.087 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:44:19.097 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:44:19.097 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T22:44:19.098 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:44:19.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.270+0000 7fe17de00640 1 -- 172.21.15.103:0/351443460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe17815f1a0 msgr2=0x7fe1780ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:19.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.270+0000 7fe17de00640 1 --2- 172.21.15.103:0/351443460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe17815f1a0 0x7fe1780ae7f0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fe1780736c0 tx=0x7fe16801cd80 comp rx=0 tx=0).stop 2024-09-10T22:44:19.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.270+0000 7fe17de00640 1 -- 172.21.15.103:0/351443460 shutdown_connections 2024-09-10T22:44:19.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.270+0000 7fe17de00640 1 --2- 172.21.15.103:0/351443460 >> v2:172.21.15.131:3300/0 conn(0x7fe1780cd500 0x7fe17815f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:19.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.270+0000 7fe17de00640 1 --2- 172.21.15.103:0/351443460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe17815f1a0 0x7fe1780ae7f0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:19.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.270+0000 7fe17de00640 1 -- 172.21.15.103:0/351443460 >> 172.21.15.103:0/351443460 conn(0x7fe1780d1a20 msgr2=0x7fe1780d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:19.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.270+0000 7fe17de00640 1 -- 172.21.15.103:0/351443460 shutdown_connections 2024-09-10T22:44:19.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.270+0000 7fe17de00640 1 -- 172.21.15.103:0/351443460 wait complete. 2024-09-10T22:44:19.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.270+0000 7fe17de00640 1 Processor -- start 2024-09-10T22:44:19.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.270+0000 7fe17de00640 1 -- start start 2024-09-10T22:44:19.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.270+0000 7fe17de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1780cd500 0x7fe1781f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:19.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.270+0000 7fe17de00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1780cdd00 0x7fe1781fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:19.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe17de00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe17815f1a0 0x7fe1780b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:19.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe17de00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe178168de0 con 0x7fe1780cd500 2024-09-10T22:44:19.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe17de00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe1780cdb60 con 0x7fe1780cdd00 2024-09-10T22:44:19.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe17de00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe178168f60 con 0x7fe17815f1a0 2024-09-10T22:44:19.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe176a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1780cd500 0x7fe1781f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:19.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe176a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1780cd500 0x7fe1781f75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44204/0 (socket says 172.21.15.103:44204) 2024-09-10T22:44:19.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe176a00640 1 -- 172.21.15.103:0/2680409122 learned_addr learned my addr 172.21.15.103:0/2680409122 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:19.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe16e000640 1 --2- 172.21.15.103:0/2680409122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1780cdd00 0x7fe1781fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:19.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe177400640 1 --2- 172.21.15.103:0/2680409122 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe17815f1a0 0x7fe1780b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:19.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe176a00640 1 -- 172.21.15.103:0/2680409122 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe17815f1a0 msgr2=0x7fe1780b4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:19.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe176a00640 1 --2- 172.21.15.103:0/2680409122 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe17815f1a0 0x7fe1780b4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:19.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe176a00640 1 -- 172.21.15.103:0/2680409122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1780cdd00 msgr2=0x7fe1781fb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:19.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe176a00640 1 --2- 172.21.15.103:0/2680409122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1780cdd00 0x7fe1781fb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:19.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe176a00640 1 -- 172.21.15.103:0/2680409122 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1781f7c50 con 0x7fe1780cd500 2024-09-10T22:44:19.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe176a00640 1 --2- 172.21.15.103:0/2680409122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1780cd500 0x7fe1781f75b0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fe16801b430 tx=0x7fe1680093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:19.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe16fe00640 1 -- 172.21.15.103:0/2680409122 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1680bb070 con 0x7fe1780cd500 2024-09-10T22:44:19.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe16fe00640 1 -- 172.21.15.103:0/2680409122 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe168004e00 con 0x7fe1780cd500 2024-09-10T22:44:19.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe16fe00640 1 -- 172.21.15.103:0/2680409122 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1680b2040 con 0x7fe1780cd500 2024-09-10T22:44:19.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe17de00640 1 -- 172.21.15.103:0/2680409122 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1781f7f30 con 0x7fe1780cd500 2024-09-10T22:44:19.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe17de00640 1 -- 172.21.15.103:0/2680409122 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1781fbaa0 con 0x7fe1780cd500 2024-09-10T22:44:19.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe17de00640 1 -- 172.21.15.103:0/2680409122 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe17815f890 con 0x7fe1780cd500 2024-09-10T22:44:19.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.274+0000 7fe16fe00640 1 -- 172.21.15.103:0/2680409122 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe1680b5030 con 0x7fe1780cd500 2024-09-10T22:44:19.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.278+0000 7fe16fe00640 1 --2- 172.21.15.103:0/2680409122 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe1540725e0 0x7fe154074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:19.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.278+0000 7fe16fe00640 1 -- 172.21.15.103:0/2680409122 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5507+0+0 (secure 0 0 0) 0x7fe16812cfc0 con 0x7fe1780cd500 2024-09-10T22:44:19.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.278+0000 7fe16e000640 1 --2- 172.21.15.103:0/2680409122 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe1540725e0 0x7fe154074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:19.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.278+0000 7fe16e000640 1 --2- 172.21.15.103:0/2680409122 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe1540725e0 0x7fe154074aa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe17806af10 tx=0x7fe160009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:19.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.282+0000 7fe16fe00640 1 -- 172.21.15.103:0/2680409122 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe168016970 con 0x7fe1780cd500 2024-09-10T22:44:19.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.478+0000 7fe17de00640 1 -- 172.21.15.103:0/2680409122 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe178075d40 con 0x7fe1780cd500 2024-09-10T22:44:19.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.482+0000 7fe16fe00640 1 -- 172.21.15.103:0/2680409122 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+3923 (secure 0 0 0) 0x7fe1680f86c0 con 0x7fe1780cd500 2024-09-10T22:44:19.484 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:19.484 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":82,"btime":"2024-09-10T22:44:12:803082+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6047,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/2402286786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2402286786},{"type":"v1","addr":"172.21.15.103:6834","nonce":2402286786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68},{"gid":6961,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/2187212011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2187212011},{"type":"v1","addr":"172.21.15.131:6836","nonce":2187212011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":6964,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/1867535563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1867535563},{"type":"v1","addr":"172.21.15.131:6837","nonce":1867535563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":7341,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/2462377658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":2462377658},{"type":"v1","addr":"172.21.15.103:6835","nonce":2462377658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82}],"filesystems":[]} 2024-09-10T22:44:19.485 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 82 2024-09-10T22:44:19.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.482+0000 7fe17de00640 1 -- 172.21.15.103:0/2680409122 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe1540725e0 msgr2=0x7fe154074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:19.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.482+0000 7fe17de00640 1 --2- 172.21.15.103:0/2680409122 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe1540725e0 0x7fe154074aa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe17806af10 tx=0x7fe160009040 comp rx=0 tx=0).stop 2024-09-10T22:44:19.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.482+0000 7fe17de00640 1 -- 172.21.15.103:0/2680409122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1780cd500 msgr2=0x7fe1781f75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:19.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.482+0000 7fe17de00640 1 --2- 172.21.15.103:0/2680409122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1780cd500 0x7fe1781f75b0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fe16801b430 tx=0x7fe1680093f0 comp rx=0 tx=0).stop 2024-09-10T22:44:19.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.482+0000 7fe17de00640 1 -- 172.21.15.103:0/2680409122 shutdown_connections 2024-09-10T22:44:19.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.482+0000 7fe17de00640 1 --2- 172.21.15.103:0/2680409122 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe1540725e0 0x7fe154074aa0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:19.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.482+0000 7fe17de00640 1 --2- 172.21.15.103:0/2680409122 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe17815f1a0 0x7fe1780b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:19.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.482+0000 7fe17de00640 1 --2- 172.21.15.103:0/2680409122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1780cdd00 0x7fe1781fb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:19.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.482+0000 7fe17de00640 1 --2- 172.21.15.103:0/2680409122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1780cd500 0x7fe1781f75b0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:19.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.482+0000 7fe17de00640 1 -- 172.21.15.103:0/2680409122 >> 172.21.15.103:0/2680409122 conn(0x7fe1780d1a20 msgr2=0x7fe178072050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:19.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.482+0000 7fe17de00640 1 -- 172.21.15.103:0/2680409122 shutdown_connections 2024-09-10T22:44:19.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.482+0000 7fe17de00640 1 -- 172.21.15.103:0/2680409122 wait complete. 2024-09-10T22:44:19.507 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T22:44:19.507 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T22:44:19.507 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T22:44:19.507 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:44:19.507 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T22:44:19.507 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T22:44:19.507 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T22:44:19.508 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:44:19.508 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T22:44:19.508 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T22:44:19.508 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T22:44:19.508 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:44:19.508 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T22:44:19.508 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T22:44:19.509 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T22:44:19.509 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:44:19.520 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T22:44:19.520 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T22:44:19.521 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T22:44:19.521 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T22:44:19.522 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T22:44:19.523 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T22:44:19.523 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T22:44:19.523 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T22:44:19.567 INFO:tasks.ceph.mds.d:Started 2024-09-10T22:44:19.568 DEBUG:teuthology.parallel:result is None 2024-09-10T22:44:19.569 INFO:tasks.ceph.mds.b:Started 2024-09-10T22:44:19.569 DEBUG:teuthology.parallel:result is None 2024-09-10T22:44:19.570 INFO:tasks.ceph.mds.a:Started 2024-09-10T22:44:19.570 DEBUG:teuthology.parallel:result is None 2024-09-10T22:44:19.572 INFO:tasks.ceph.mds.c:Started 2024-09-10T22:44:19.572 DEBUG:teuthology.parallel:result is None 2024-09-10T22:44:19.572 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T22:44:19.657 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-09-10T22:44:19.658 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2024-09-10T22:44:19.658 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-09-10T22:44:19.658 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2024-09-10T22:44:19.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f8200640 1 -- 172.21.15.103:0/872338156 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2f015be30 msgr2=0x7fb2f00ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:19.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f8200640 1 --2- 172.21.15.103:0/872338156 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2f015be30 0x7fb2f00ce0c0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fb2f015f970 tx=0x7fb2e401c830 comp rx=0 tx=0).stop 2024-09-10T22:44:19.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f8200640 1 -- 172.21.15.103:0/872338156 shutdown_connections 2024-09-10T22:44:19.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f8200640 1 --2- 172.21.15.103:0/872338156 >> v2:172.21.15.131:3300/0 conn(0x7fb2f00ceb40 0x7fb2f00cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:19.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f8200640 1 --2- 172.21.15.103:0/872338156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2f00b09c0 0x7fb2f00ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:19.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f8200640 1 --2- 172.21.15.103:0/872338156 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2f015be30 0x7fb2f00ce0c0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:19.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f8200640 1 -- 172.21.15.103:0/872338156 >> 172.21.15.103:0/872338156 conn(0x7fb2f00d1ac0 msgr2=0x7fb2f00d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:19.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f8200640 1 -- 172.21.15.103:0/872338156 shutdown_connections 2024-09-10T22:44:19.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f8200640 1 -- 172.21.15.103:0/872338156 wait complete. 2024-09-10T22:44:19.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f8200640 1 Processor -- start 2024-09-10T22:44:19.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f8200640 1 -- start start 2024-09-10T22:44:19.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f8200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2f00b09c0 0x7fb2f00c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:19.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f8200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2f00ceb40 0x7fb2f00c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:19.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f8200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2f015be30 0x7fb2f00cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:19.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f8200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f00aed50 con 0x7fb2f00b09c0 2024-09-10T22:44:19.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f8200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f00aebd0 con 0x7fb2f00ceb40 2024-09-10T22:44:19.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f8200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb2f00aeed0 con 0x7fb2f015be30 2024-09-10T22:44:19.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f5800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2f00b09c0 0x7fb2f00c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:19.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f5800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2f00b09c0 0x7fb2f00c7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44292/0 (socket says 172.21.15.103:44292) 2024-09-10T22:44:19.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f5800640 1 -- 172.21.15.103:0/3493855519 learned_addr learned my addr 172.21.15.103:0/3493855519 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:19.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f4e00640 1 --2- 172.21.15.103:0/3493855519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2f00ceb40 0x7fb2f00c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:19.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f6200640 1 --2- 172.21.15.103:0/3493855519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2f015be30 0x7fb2f00cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:19.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f5800640 1 -- 172.21.15.103:0/3493855519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2f015be30 msgr2=0x7fb2f00cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:19.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f5800640 1 --2- 172.21.15.103:0/3493855519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2f015be30 0x7fb2f00cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:19.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f5800640 1 -- 172.21.15.103:0/3493855519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2f00ceb40 msgr2=0x7fb2f00c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:19.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f5800640 1 --2- 172.21.15.103:0/3493855519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2f00ceb40 0x7fb2f00c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:19.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.718+0000 7fb2f5800640 1 -- 172.21.15.103:0/3493855519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f01faef0 con 0x7fb2f00b09c0 2024-09-10T22:44:19.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.722+0000 7fb2f5800640 1 --2- 172.21.15.103:0/3493855519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2f00b09c0 0x7fb2f00c7870 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40b0040 tx=0x7fb2e40a6540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:19.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.722+0000 7fb2ed600640 1 -- 172.21.15.103:0/3493855519 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4004240 con 0x7fb2f00b09c0 2024-09-10T22:44:19.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.722+0000 7fb2ed600640 1 -- 172.21.15.103:0/3493855519 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2e4005020 con 0x7fb2f00b09c0 2024-09-10T22:44:19.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.722+0000 7fb2ed600640 1 -- 172.21.15.103:0/3493855519 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e40044f0 con 0x7fb2f00b09c0 2024-09-10T22:44:19.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.722+0000 7fb2f8200640 1 -- 172.21.15.103:0/3493855519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f01fb1d0 con 0x7fb2f00b09c0 2024-09-10T22:44:19.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.722+0000 7fb2f8200640 1 -- 172.21.15.103:0/3493855519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f01fb790 con 0x7fb2f00b09c0 2024-09-10T22:44:19.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.722+0000 7fb2f8200640 1 -- 172.21.15.103:0/3493855519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2f01fb960 con 0x7fb2f00b09c0 2024-09-10T22:44:19.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.722+0000 7fb2ed600640 1 -- 172.21.15.103:0/3493855519 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb2e4005470 con 0x7fb2f00b09c0 2024-09-10T22:44:19.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.722+0000 7fb2ed600640 1 --2- 172.21.15.103:0/3493855519 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb2d00725e0 0x7fb2d0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:19.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.722+0000 7fb2ed600640 1 -- 172.21.15.103:0/3493855519 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5507+0+0 (secure 0 0 0) 0x7fb2e412d280 con 0x7fb2f00b09c0 2024-09-10T22:44:19.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.722+0000 7fb2f4e00640 1 --2- 172.21.15.103:0/3493855519 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb2d00725e0 0x7fb2d0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:19.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.726+0000 7fb2f4e00640 1 --2- 172.21.15.103:0/3493855519 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb2d00725e0 0x7fb2d0074aa0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb2f00b40b0 tx=0x7fb2dc0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:19.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.726+0000 7fb2ed600640 1 -- 172.21.15.103:0/3493855519 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb2e40164b0 con 0x7fb2f00b09c0 2024-09-10T22:44:19.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:19.902+0000 7fb2f8200640 1 -- 172.21.15.103:0/3493855519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb2f00cf9c0 con 0x7fb2f00b09c0 2024-09-10T22:44:20.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.142+0000 7fb2ed600640 1 -- 172.21.15.103:0/3493855519 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v86) ==== 97+0+0 (secure 0 0 0) 0x7fb2e40f8900 con 0x7fb2f00b09c0 2024-09-10T22:44:20.146 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blocklist entries 2024-09-10T22:44:20.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.146+0000 7fb2f8200640 1 -- 172.21.15.103:0/3493855519 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb2d00725e0 msgr2=0x7fb2d0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:20.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.146+0000 7fb2f8200640 1 --2- 172.21.15.103:0/3493855519 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb2d00725e0 0x7fb2d0074aa0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb2f00b40b0 tx=0x7fb2dc0091e0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.146+0000 7fb2f8200640 1 -- 172.21.15.103:0/3493855519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2f00b09c0 msgr2=0x7fb2f00c7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:20.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.146+0000 7fb2f8200640 1 --2- 172.21.15.103:0/3493855519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2f00b09c0 0x7fb2f00c7870 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40b0040 tx=0x7fb2e40a6540 comp rx=0 tx=0).stop 2024-09-10T22:44:20.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.146+0000 7fb2f8200640 1 -- 172.21.15.103:0/3493855519 shutdown_connections 2024-09-10T22:44:20.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.146+0000 7fb2f8200640 1 --2- 172.21.15.103:0/3493855519 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb2d00725e0 0x7fb2d0074aa0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.146+0000 7fb2f8200640 1 --2- 172.21.15.103:0/3493855519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2f015be30 0x7fb2f00cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.146+0000 7fb2f8200640 1 --2- 172.21.15.103:0/3493855519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2f00ceb40 0x7fb2f00c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.146+0000 7fb2f8200640 1 --2- 172.21.15.103:0/3493855519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2f00b09c0 0x7fb2f00c7870 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.146+0000 7fb2f8200640 1 -- 172.21.15.103:0/3493855519 >> 172.21.15.103:0/3493855519 conn(0x7fb2f00d1ac0 msgr2=0x7fb2f006e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:20.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.146+0000 7fb2f8200640 1 -- 172.21.15.103:0/3493855519 shutdown_connections 2024-09-10T22:44:20.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.146+0000 7fb2f8200640 1 -- 172.21.15.103:0/3493855519 wait complete. 2024-09-10T22:44:20.171 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T22:44:20.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.310+0000 7fe54fe00640 1 -- 172.21.15.103:0/2358332586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe530004da0 msgr2=0x7fe530005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:20.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.310+0000 7fe54fe00640 1 --2- 172.21.15.103:0/2358332586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe530004da0 0x7fe530005220 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fe54000c640 tx=0x7fe54001f960 comp rx=0 tx=0).stop 2024-09-10T22:44:20.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.310+0000 7fe54de00640 1 -- 172.21.15.103:0/2358332586 reap_dead start 2024-09-10T22:44:20.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.310+0000 7fe54fe00640 1 -- 172.21.15.103:0/2358332586 shutdown_connections 2024-09-10T22:44:20.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.310+0000 7fe54fe00640 1 -- 172.21.15.103:0/2358332586 >> 172.21.15.103:0/2358332586 conn(0x7fe54806cc00 msgr2=0x7fe54806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:20.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.310+0000 7fe54fe00640 1 -- 172.21.15.103:0/2358332586 shutdown_connections 2024-09-10T22:44:20.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.310+0000 7fe54fe00640 1 -- 172.21.15.103:0/2358332586 wait complete. 2024-09-10T22:44:20.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54fe00640 1 Processor -- start 2024-09-10T22:44:20.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54fe00640 1 -- start start 2024-09-10T22:44:20.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54fe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe530004da0 0x7fe5481e4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:20.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5481e7360 0x7fe5481f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:20.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5481501f0 0x7fe548158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:20.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54fe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe5480b2d90 con 0x7fe5481501f0 2024-09-10T22:44:20.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54fe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe5480b2c10 con 0x7fe5481e7360 2024-09-10T22:44:20.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54fe00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe5480b2f10 con 0x7fe530004da0 2024-09-10T22:44:20.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5481501f0 0x7fe548158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:20.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5481501f0 0x7fe548158060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44304/0 (socket says 172.21.15.103:44304) 2024-09-10T22:44:20.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54de00640 1 -- 172.21.15.103:0/890442537 learned_addr learned my addr 172.21.15.103:0/890442537 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:20.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54d400640 1 --2- 172.21.15.103:0/890442537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe530004da0 0x7fe5481e4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:20.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54ca00640 1 --2- 172.21.15.103:0/890442537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5481e7360 0x7fe5481f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:20.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54de00640 1 -- 172.21.15.103:0/890442537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe530004da0 msgr2=0x7fe5481e4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:20.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54de00640 1 --2- 172.21.15.103:0/890442537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe530004da0 0x7fe5481e4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54de00640 1 -- 172.21.15.103:0/890442537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5481e7360 msgr2=0x7fe5481f5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:20.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54de00640 1 --2- 172.21.15.103:0/890442537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5481e7360 0x7fe5481f5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54de00640 1 -- 172.21.15.103:0/890442537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5481563d0 con 0x7fe5481501f0 2024-09-10T22:44:20.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54ca00640 1 --2- 172.21.15.103:0/890442537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5481e7360 0x7fe5481f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:44:20.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54de00640 1 --2- 172.21.15.103:0/890442537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5481501f0 0x7fe548158060 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fe54009c250 tx=0x7fe540004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:20.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe545600640 1 -- 172.21.15.103:0/890442537 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5400011d0 con 0x7fe5481501f0 2024-09-10T22:44:20.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe545600640 1 -- 172.21.15.103:0/890442537 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5400060d0 con 0x7fe5481501f0 2024-09-10T22:44:20.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe545600640 1 -- 172.21.15.103:0/890442537 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe540001a80 con 0x7fe5481501f0 2024-09-10T22:44:20.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54fe00640 1 -- 172.21.15.103:0/890442537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5481e69d0 con 0x7fe5481501f0 2024-09-10T22:44:20.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54fe00640 1 -- 172.21.15.103:0/890442537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5481e7820 con 0x7fe5481501f0 2024-09-10T22:44:20.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.314+0000 7fe54fe00640 1 -- 172.21.15.103:0/890442537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe548156a30 con 0x7fe5481501f0 2024-09-10T22:44:20.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.318+0000 7fe545600640 1 -- 172.21.15.103:0/890442537 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe5400c5060 con 0x7fe5481501f0 2024-09-10T22:44:20.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.318+0000 7fe545600640 1 --2- 172.21.15.103:0/890442537 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe528072610 0x7fe528074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:20.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.318+0000 7fe545600640 1 -- 172.21.15.103:0/890442537 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5249+0+0 (secure 0 0 0) 0x7fe5400b8030 con 0x7fe5481501f0 2024-09-10T22:44:20.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.318+0000 7fe54d400640 1 --2- 172.21.15.103:0/890442537 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe528072610 0x7fe528074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:20.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.318+0000 7fe54d400640 1 --2- 172.21.15.103:0/890442537 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe528072610 0x7fe528074ad0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00acd0 tx=0x7fe53c00a2f0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:20.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.322+0000 7fe545600640 1 -- 172.21.15.103:0/890442537 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe540019710 con 0x7fe5481501f0 2024-09-10T22:44:20.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.546+0000 7fe54fe00640 1 -- 172.21.15.103:0/890442537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe548073190 con 0x7fe5481501f0 2024-09-10T22:44:20.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.546+0000 7fe545600640 1 -- 172.21.15.103:0/890442537 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7fe5400fb060 con 0x7fe5481501f0 2024-09-10T22:44:20.551 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:20.551 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:44:20.551 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2024-09-10T22:44:20.551 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.551 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2024-09-10T22:44:20.551 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmh8HQHBAAZlp4CnHLegqhgWrgXoyltw==", 2024-09-10T22:44:20.552 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.552 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:44:20.552 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:44:20.552 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:44:20.552 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:44:20.552 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.552 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:20.552 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.552 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2024-09-10T22:44:20.552 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmpYUNKRAAstv0pZDy3081UKcsSWnWIg==", 2024-09-10T22:44:20.552 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.552 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:44:20.552 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:44:20.553 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:44:20.553 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:44:20.553 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:20.553 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.553 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.c", 2024-09-10T22:44:20.553 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBm8I0TJBAAmW480qKYYrolVm7+SlJ97w==", 2024-09-10T22:44:20.553 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.553 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:44:20.553 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:44:20.553 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:44:20.553 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:44:20.553 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:20.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.554 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.d", 2024-09-10T22:44:20.554 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmB55uMBAA1VqVuUEAk1i2LFBoZXiRmA==", 2024-09-10T22:44:20.554 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.554 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:44:20.554 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:44:20.554 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:44:20.554 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:44:20.554 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:20.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.554 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2024-09-10T22:44:20.554 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA/yuBm+fNzNRAAwt8IZXd3mcEh5UbXc924UQ==", 2024-09-10T22:44:20.554 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.555 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:44:20.555 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:44:20.555 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:44:20.555 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:20.555 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.555 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2024-09-10T22:44:20.555 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBDyuBmNBfvDhAAcBNATtrJNZ4RFzYXqWt2pg==", 2024-09-10T22:44:20.555 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.555 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:44:20.555 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:44:20.555 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:44:20.555 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:20.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.556 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2024-09-10T22:44:20.556 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBGyuBmJD9HJBAAgq8tqoeDT8WNr7pMxQCCJw==", 2024-09-10T22:44:20.556 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.556 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:44:20.556 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:44:20.556 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:44:20.556 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:20.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.556 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2024-09-10T22:44:20.556 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBJyuBmzxWIOhAA4yOLmTZAY0MRLj+w3mhCeQ==", 2024-09-10T22:44:20.556 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.556 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:44:20.557 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:44:20.557 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:44:20.557 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:20.557 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.557 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2024-09-10T22:44:20.557 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBQyuBm3pi6ABAAnwu13uYkLRJuU5y+DE2Isw==", 2024-09-10T22:44:20.557 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.557 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:44:20.557 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:44:20.557 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:44:20.557 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:20.557 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.558 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2024-09-10T22:44:20.558 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBTyuBmkaPVFhAALlwgsnQ/dUJVLTK2iAh6Ww==", 2024-09-10T22:44:20.558 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.558 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:44:20.558 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:44:20.558 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:44:20.558 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.558 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:20.558 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.558 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2024-09-10T22:44:20.558 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBWyuBmL2kKKxAAbxeyAuzd994tvNfKKs+WIA==", 2024-09-10T22:44:20.558 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.559 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:44:20.559 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:44:20.559 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:44:20.559 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.559 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:20.559 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.559 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2024-09-10T22:44:20.559 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBayuBmUmSwBBAAWTFVgtYXlyEI+rJzGIM+Aw==", 2024-09-10T22:44:20.559 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.559 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:44:20.559 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:44:20.559 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:44:20.559 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.559 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:20.559 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.560 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2024-09-10T22:44:20.560 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmtOhZNBAAeszxWpV60NIn/zOInT5Zzw==", 2024-09-10T22:44:20.560 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.560 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:44:20.560 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2024-09-10T22:44:20.560 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T22:44:20.560 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.560 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:20.560 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.560 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2024-09-10T22:44:20.561 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9yuBmu20iAhAASacT/hh3sxW1XU/XD6uDjA==", 2024-09-10T22:44:20.561 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.561 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:44:20.561 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:44:20.561 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:44:20.561 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:44:20.561 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.561 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:20.561 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.561 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2024-09-10T22:44:20.561 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmd1E5OhAAfidEn8dwfGna8gwefsYtUg==", 2024-09-10T22:44:20.561 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.561 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:44:20.562 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:44:20.562 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:44:20.562 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:44:20.562 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.562 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:20.562 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.562 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2024-09-10T22:44:20.562 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9yuBmGGhVCBAAAs3y0cfqMN0t0/PTNsVEQw==", 2024-09-10T22:44:20.562 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.562 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:44:20.562 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:44:20.562 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:44:20.562 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:44:20.562 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.563 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:20.563 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.563 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2024-09-10T22:44:20.563 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmsY75ABAAYeEF+hTiVUtmqzwU0IIpjA==", 2024-09-10T22:44:20.563 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.563 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-09-10T22:44:20.563 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:44:20.563 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:44:20.563 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:44:20.563 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.563 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:20.563 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.563 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2024-09-10T22:44:20.563 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmghJQGBAAXvlC58nhT9H/c71/ToGCSw==", 2024-09-10T22:44:20.563 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.564 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-09-10T22:44:20.564 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2024-09-10T22:44:20.564 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:44:20.564 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:20.564 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.564 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2024-09-10T22:44:20.564 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBma9x+FBAAQrKkw3eGcKnLxSqVz/DHJQ==", 2024-09-10T22:44:20.564 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:44:20.564 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-09-10T22:44:20.564 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2024-09-10T22:44:20.564 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:44:20.564 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.564 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.565 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T22:44:20.565 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:44:20.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.550+0000 7fe54fe00640 1 -- 172.21.15.103:0/890442537 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe528072610 msgr2=0x7fe528074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:20.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.550+0000 7fe54fe00640 1 --2- 172.21.15.103:0/890442537 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe528072610 0x7fe528074ad0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00acd0 tx=0x7fe53c00a2f0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.550+0000 7fe54fe00640 1 -- 172.21.15.103:0/890442537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5481501f0 msgr2=0x7fe548158060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:20.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.550+0000 7fe54fe00640 1 --2- 172.21.15.103:0/890442537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5481501f0 0x7fe548158060 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fe54009c250 tx=0x7fe540004e50 comp rx=0 tx=0).stop 2024-09-10T22:44:20.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.550+0000 7fe54fe00640 1 -- 172.21.15.103:0/890442537 shutdown_connections 2024-09-10T22:44:20.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.550+0000 7fe54fe00640 1 --2- 172.21.15.103:0/890442537 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe528072610 0x7fe528074ad0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.550+0000 7fe54fe00640 1 --2- 172.21.15.103:0/890442537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5481501f0 0x7fe548158060 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.550+0000 7fe54fe00640 1 --2- 172.21.15.103:0/890442537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5481e7360 0x7fe5481f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.550+0000 7fe54fe00640 1 --2- 172.21.15.103:0/890442537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe530004da0 0x7fe5481e4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.550+0000 7fe54fe00640 1 -- 172.21.15.103:0/890442537 >> 172.21.15.103:0/890442537 conn(0x7fe54806cc00 msgr2=0x7fe5480a9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:20.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.550+0000 7fe54fe00640 1 -- 172.21.15.103:0/890442537 shutdown_connections 2024-09-10T22:44:20.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.550+0000 7fe54fe00640 1 -- 172.21.15.103:0/890442537 wait complete. 2024-09-10T22:44:20.573 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T22:44:20.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.710+0000 7f0eb2200640 1 -- 172.21.15.103:0/2526885545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0eac0af9d0 msgr2=0x7f0eac166a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:20.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.710+0000 7f0eb2200640 1 --2- 172.21.15.103:0/2526885545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0eac0af9d0 0x7f0eac166a50 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009840 tx=0x7f0ea401c790 comp rx=0 tx=0).stop 2024-09-10T22:44:20.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.710+0000 7f0eb2200640 1 -- 172.21.15.103:0/2526885545 shutdown_connections 2024-09-10T22:44:20.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.710+0000 7f0eb2200640 1 --2- 172.21.15.103:0/2526885545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0eac0af9d0 0x7f0eac166a50 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.710+0000 7f0eb2200640 1 -- 172.21.15.103:0/2526885545 >> 172.21.15.103:0/2526885545 conn(0x7f0eac0d1ac0 msgr2=0x7f0eac0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:20.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.710+0000 7f0eb2200640 1 -- 172.21.15.103:0/2526885545 shutdown_connections 2024-09-10T22:44:20.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.710+0000 7f0eb2200640 1 -- 172.21.15.103:0/2526885545 wait complete. 2024-09-10T22:44:20.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eb2200640 1 Processor -- start 2024-09-10T22:44:20.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eb2200640 1 -- start start 2024-09-10T22:44:20.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eb2200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0eac0af9d0 0x7f0eac1569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:20.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eb2200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0eac0b09c0 0x7f0eac1457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:20.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eb2200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0eac15be30 0x7f0eac0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:20.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eb2200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0eac169bf0 con 0x7f0eac0af9d0 2024-09-10T22:44:20.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eb2200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0eac169a70 con 0x7f0eac0b09c0 2024-09-10T22:44:20.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eb2200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0eac169d70 con 0x7f0eac15be30 2024-09-10T22:44:20.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eab400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0eac0af9d0 0x7f0eac1569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:20.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eab400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0eac0af9d0 0x7f0eac1569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44326/0 (socket says 172.21.15.103:44326) 2024-09-10T22:44:20.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eab400640 1 -- 172.21.15.103:0/2245446062 learned_addr learned my addr 172.21.15.103:0/2245446062 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:20.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eaaa00640 1 --2- 172.21.15.103:0/2245446062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0eac0b09c0 0x7f0eac1457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:20.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eabe00640 1 --2- 172.21.15.103:0/2245446062 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0eac15be30 0x7f0eac0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:20.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eab400640 1 -- 172.21.15.103:0/2245446062 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0eac15be30 msgr2=0x7f0eac0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:20.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eab400640 1 --2- 172.21.15.103:0/2245446062 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0eac15be30 0x7f0eac0cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eab400640 1 -- 172.21.15.103:0/2245446062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0eac0b09c0 msgr2=0x7f0eac1457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:20.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eab400640 1 --2- 172.21.15.103:0/2245446062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0eac0b09c0 0x7f0eac1457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eab400640 1 -- 172.21.15.103:0/2245446062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eac0c9db0 con 0x7f0eac0af9d0 2024-09-10T22:44:20.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eaaa00640 1 --2- 172.21.15.103:0/2245446062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0eac0b09c0 0x7f0eac1457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:20.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eabe00640 1 --2- 172.21.15.103:0/2245446062 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0eac15be30 0x7f0eac0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:20.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eab400640 1 --2- 172.21.15.103:0/2245446062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0eac0af9d0 0x7f0eac1569d0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00c790 tx=0x7f0e9c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:20.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0ea3400640 1 -- 172.21.15.103:0/2245446062 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c003b80 con 0x7f0eac0af9d0 2024-09-10T22:44:20.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0ea3400640 1 -- 172.21.15.103:0/2245446062 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e9c003d20 con 0x7f0eac0af9d0 2024-09-10T22:44:20.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0ea3400640 1 -- 172.21.15.103:0/2245446062 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c00aa90 con 0x7f0eac0af9d0 2024-09-10T22:44:20.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eb2200640 1 -- 172.21.15.103:0/2245446062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eac0ca090 con 0x7f0eac0af9d0 2024-09-10T22:44:20.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eb2200640 1 -- 172.21.15.103:0/2245446062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eac0ca650 con 0x7f0eac0af9d0 2024-09-10T22:44:20.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.714+0000 7f0eb2200640 1 -- 172.21.15.103:0/2245446062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eac0ce0c0 con 0x7f0eac0af9d0 2024-09-10T22:44:20.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.718+0000 7f0ea3400640 1 -- 172.21.15.103:0/2245446062 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0e9c00ac30 con 0x7f0eac0af9d0 2024-09-10T22:44:20.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.718+0000 7f0ea3400640 1 --2- 172.21.15.103:0/2245446062 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0e8c0725e0 0x7f0e8c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:20.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.718+0000 7f0ea3400640 1 -- 172.21.15.103:0/2245446062 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5249+0+0 (secure 0 0 0) 0x7f0e9c092f60 con 0x7f0eac0af9d0 2024-09-10T22:44:20.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.718+0000 7f0eaaa00640 1 --2- 172.21.15.103:0/2245446062 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0e8c0725e0 0x7f0e8c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:20.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.718+0000 7f0eaaa00640 1 --2- 172.21.15.103:0/2245446062 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0e8c0725e0 0x7f0e8c074aa0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0eac166f30 tx=0x7f0e98009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:20.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.722+0000 7f0ea3400640 1 -- 172.21.15.103:0/2245446062 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0e9c05e7f0 con 0x7f0eac0af9d0 2024-09-10T22:44:20.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.886+0000 7f0eb2200640 1 -- 172.21.15.103:0/2245446062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0eac0708e0 con 0x7f0eac0af9d0 2024-09-10T22:44:20.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.886+0000 7f0ea3400640 1 -- 172.21.15.103:0/2245446062 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v88) ==== 84+0+65 (secure 0 0 0) 0x7f0e9c05e0f0 con 0x7f0eac0af9d0 2024-09-10T22:44:20.891 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:20.891 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-09-10T22:44:20.891 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:44:20.891 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2024-09-10T22:44:20.891 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": ".mgr" 2024-09-10T22:44:20.891 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:20.891 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-09-10T22:44:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.890+0000 7f0eb2200640 1 -- 172.21.15.103:0/2245446062 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0e8c0725e0 msgr2=0x7f0e8c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.890+0000 7f0eb2200640 1 --2- 172.21.15.103:0/2245446062 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0e8c0725e0 0x7f0e8c074aa0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0eac166f30 tx=0x7f0e98009040 comp rx=0 tx=0).stop 2024-09-10T22:44:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.890+0000 7f0eb2200640 1 -- 172.21.15.103:0/2245446062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0eac0af9d0 msgr2=0x7f0eac1569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.890+0000 7f0eb2200640 1 --2- 172.21.15.103:0/2245446062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0eac0af9d0 0x7f0eac1569d0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00c790 tx=0x7f0e9c00cc50 comp rx=0 tx=0).stop 2024-09-10T22:44:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.890+0000 7f0eb2200640 1 -- 172.21.15.103:0/2245446062 shutdown_connections 2024-09-10T22:44:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.890+0000 7f0eb2200640 1 --2- 172.21.15.103:0/2245446062 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0e8c0725e0 0x7f0e8c074aa0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.890+0000 7f0eb2200640 1 --2- 172.21.15.103:0/2245446062 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0eac15be30 0x7f0eac0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.890+0000 7f0eb2200640 1 --2- 172.21.15.103:0/2245446062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0eac0b09c0 0x7f0eac1457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.890+0000 7f0eb2200640 1 --2- 172.21.15.103:0/2245446062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0eac0af9d0 0x7f0eac1569d0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.890+0000 7f0eb2200640 1 -- 172.21.15.103:0/2245446062 >> 172.21.15.103:0/2245446062 conn(0x7f0eac0d1ac0 msgr2=0x7f0eac06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.890+0000 7f0eb2200640 1 -- 172.21.15.103:0/2245446062 shutdown_connections 2024-09-10T22:44:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:20.890+0000 7f0eb2200640 1 -- 172.21.15.103:0/2245446062 wait complete. 2024-09-10T22:44:20.912 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T22:44:20.912 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T22:44:21.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.054+0000 7fbe0da00640 1 -- 172.21.15.103:0/2648166273 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe08070b40 msgr2=0x7fbe080d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:21.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.054+0000 7fbe0da00640 1 --2- 172.21.15.103:0/2648166273 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe08070b40 0x7fbe080d1280 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009840 tx=0x7fbdf401c790 comp rx=0 tx=0).stop 2024-09-10T22:44:21.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.054+0000 7fbe0da00640 1 -- 172.21.15.103:0/2648166273 shutdown_connections 2024-09-10T22:44:21.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.054+0000 7fbe0da00640 1 --2- 172.21.15.103:0/2648166273 >> v2:172.21.15.131:3300/0 conn(0x7fbe080d23f0 0x7fbe080cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:21.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.054+0000 7fbe0da00640 1 --2- 172.21.15.103:0/2648166273 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe08070b40 0x7fbe080d1280 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:21.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.054+0000 7fbe0da00640 1 -- 172.21.15.103:0/2648166273 >> 172.21.15.103:0/2648166273 conn(0x7fbe080d18d0 msgr2=0x7fbe080d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:21.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.054+0000 7fbe0da00640 1 -- 172.21.15.103:0/2648166273 shutdown_connections 2024-09-10T22:44:21.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.054+0000 7fbe0da00640 1 -- 172.21.15.103:0/2648166273 wait complete. 2024-09-10T22:44:21.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe0da00640 1 Processor -- start 2024-09-10T22:44:21.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe0da00640 1 -- start start 2024-09-10T22:44:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe0da00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe08070b40 0x7fbe08157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe0da00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe080d23f0 0x7fbe0815ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe0da00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe0815f0e0 0x7fbe0815b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe0da00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbe081688a0 con 0x7fbe08070b40 2024-09-10T22:44:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe0da00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbe080cec90 con 0x7fbe080d23f0 2024-09-10T22:44:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe0da00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fbe08168a20 con 0x7fbe0815f0e0 2024-09-10T22:44:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe07e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe08070b40 0x7fbe08157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe07e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe08070b40 0x7fbe08157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44334/0 (socket says 172.21.15.103:44334) 2024-09-10T22:44:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe07e00640 1 -- 172.21.15.103:0/768178128 learned_addr learned my addr 172.21.15.103:0/768178128 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe07400640 1 --2- 172.21.15.103:0/768178128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe080d23f0 0x7fbe0815ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe0d000640 1 --2- 172.21.15.103:0/768178128 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe0815f0e0 0x7fbe0815b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe07e00640 1 -- 172.21.15.103:0/768178128 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe0815f0e0 msgr2=0x7fbe0815b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe07e00640 1 --2- 172.21.15.103:0/768178128 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe0815f0e0 0x7fbe0815b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe07e00640 1 -- 172.21.15.103:0/768178128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe080d23f0 msgr2=0x7fbe0815ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe07e00640 1 --2- 172.21.15.103:0/768178128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe080d23f0 0x7fbe0815ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe07e00640 1 -- 172.21.15.103:0/768178128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe080b4720 con 0x7fbe08070b40 2024-09-10T22:44:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe07e00640 1 --2- 172.21.15.103:0/768178128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe08070b40 0x7fbe08157600 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800c400 tx=0x7fbdf800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbdffe00640 1 -- 172.21.15.103:0/768178128 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8011790 con 0x7fbe08070b40 2024-09-10T22:44:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbdffe00640 1 -- 172.21.15.103:0/768178128 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdf8017070 con 0x7fbe08070b40 2024-09-10T22:44:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe0da00640 1 -- 172.21.15.103:0/768178128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe080b4a00 con 0x7fbe08070b40 2024-09-10T22:44:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbdffe00640 1 -- 172.21.15.103:0/768178128 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8011cc0 con 0x7fbe08070b40 2024-09-10T22:44:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe0da00640 1 -- 172.21.15.103:0/768178128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe080b52a0 con 0x7fbe08070b40 2024-09-10T22:44:21.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.058+0000 7fbe0da00640 1 -- 172.21.15.103:0/768178128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe080b4df0 con 0x7fbe08070b40 2024-09-10T22:44:21.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.062+0000 7fbdffe00640 1 -- 172.21.15.103:0/768178128 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbdf801c460 con 0x7fbe08070b40 2024-09-10T22:44:21.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.062+0000 7fbdffe00640 1 --2- 172.21.15.103:0/768178128 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbde80725e0 0x7fbde8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:21.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.062+0000 7fbdffe00640 1 -- 172.21.15.103:0/768178128 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5249+0+0 (secure 0 0 0) 0x7fbdf8092d70 con 0x7fbe08070b40 2024-09-10T22:44:21.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.062+0000 7fbe07400640 1 --2- 172.21.15.103:0/768178128 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbde80725e0 0x7fbde8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:21.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.062+0000 7fbe07400640 1 --2- 172.21.15.103:0/768178128 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbde80725e0 0x7fbde8074aa0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40af000 tx=0x7fbdf401afd0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:21.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.066+0000 7fbdffe00640 1 -- 172.21.15.103:0/768178128 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbdf805e570 con 0x7fbe08070b40 2024-09-10T22:44:21.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:21.234+0000 7fbe0da00640 1 -- 172.21.15.103:0/768178128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbe080d1280 con 0x7fbe08070b40 2024-09-10T22:44:22.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.154+0000 7fbdffe00640 1 -- 172.21.15.103:0/768178128 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v89) ==== 138+0+0 (secure 0 0 0) 0x7fbdf805de70 con 0x7fbe08070b40 2024-09-10T22:44:22.159 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2024-09-10T22:44:22.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.158+0000 7fbe0da00640 1 -- 172.21.15.103:0/768178128 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbde80725e0 msgr2=0x7fbde8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:22.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.158+0000 7fbe0da00640 1 --2- 172.21.15.103:0/768178128 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbde80725e0 0x7fbde8074aa0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40af000 tx=0x7fbdf401afd0 comp rx=0 tx=0).stop 2024-09-10T22:44:22.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.158+0000 7fbe0da00640 1 -- 172.21.15.103:0/768178128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe08070b40 msgr2=0x7fbe08157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:22.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.158+0000 7fbe0da00640 1 --2- 172.21.15.103:0/768178128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe08070b40 0x7fbe08157600 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800c400 tx=0x7fbdf800c800 comp rx=0 tx=0).stop 2024-09-10T22:44:22.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.158+0000 7fbe0da00640 1 -- 172.21.15.103:0/768178128 shutdown_connections 2024-09-10T22:44:22.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.158+0000 7fbe0da00640 1 --2- 172.21.15.103:0/768178128 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbde80725e0 0x7fbde8074aa0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:22.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.158+0000 7fbe0da00640 1 --2- 172.21.15.103:0/768178128 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe0815f0e0 0x7fbe0815b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:22.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.158+0000 7fbe0da00640 1 --2- 172.21.15.103:0/768178128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe080d23f0 0x7fbe0815ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:22.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.158+0000 7fbe0da00640 1 --2- 172.21.15.103:0/768178128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe08070b40 0x7fbe08157600 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:22.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.158+0000 7fbe0da00640 1 -- 172.21.15.103:0/768178128 >> 172.21.15.103:0/768178128 conn(0x7fbe080d18d0 msgr2=0x7fbe0806eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:22.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.158+0000 7fbe0da00640 1 -- 172.21.15.103:0/768178128 shutdown_connections 2024-09-10T22:44:22.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.158+0000 7fbe0da00640 1 -- 172.21.15.103:0/768178128 wait complete. 2024-09-10T22:44:22.188 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T22:44:22.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.334+0000 7f5d33600640 1 -- 172.21.15.103:0/4033915179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d2c06e490 msgr2=0x7f5d2c072470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:22.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.334+0000 7f5d33600640 1 --2- 172.21.15.103:0/4033915179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d2c06e490 0x7f5d2c072470 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f5d1800b3f0 tx=0x7f5d1801d150 comp rx=0 tx=0).stop 2024-09-10T22:44:22.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.334+0000 7f5d33600640 1 -- 172.21.15.103:0/4033915179 shutdown_connections 2024-09-10T22:44:22.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.334+0000 7f5d33600640 1 --2- 172.21.15.103:0/4033915179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d2c06e490 0x7f5d2c072470 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:22.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.334+0000 7f5d33600640 1 -- 172.21.15.103:0/4033915179 >> 172.21.15.103:0/4033915179 conn(0x7f5d2c0cf7f0 msgr2=0x7f5d2c0cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:22.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.334+0000 7f5d33600640 1 -- 172.21.15.103:0/4033915179 shutdown_connections 2024-09-10T22:44:22.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.334+0000 7f5d33600640 1 -- 172.21.15.103:0/4033915179 wait complete. 2024-09-10T22:44:22.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.334+0000 7f5d33600640 1 Processor -- start 2024-09-10T22:44:22.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.334+0000 7f5d33600640 1 -- start start 2024-09-10T22:44:22.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d33600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d2c06e490 0x7f5d2c146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:22.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d33600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d2c0d0310 0x7f5d2c156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:22.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d33600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d2c159b80 0x7f5d2c156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:22.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d33600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c168020 con 0x7f5d2c159b80 2024-09-10T22:44:22.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d33600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c167ea0 con 0x7f5d2c0d0310 2024-09-10T22:44:22.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d33600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5d2c1681a0 con 0x7f5d2c06e490 2024-09-10T22:44:22.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d31600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d2c159b80 0x7f5d2c156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:22.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d31600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d2c159b80 0x7f5d2c156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44362/0 (socket says 172.21.15.103:44362) 2024-09-10T22:44:22.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d31600640 1 -- 172.21.15.103:0/1006023658 learned_addr learned my addr 172.21.15.103:0/1006023658 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:22.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d2be00640 1 --2- 172.21.15.103:0/1006023658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d2c0d0310 0x7f5d2c156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:22.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d30c00640 1 --2- 172.21.15.103:0/1006023658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d2c06e490 0x7f5d2c146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:22.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d31600640 1 -- 172.21.15.103:0/1006023658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d2c06e490 msgr2=0x7f5d2c146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:22.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d31600640 1 --2- 172.21.15.103:0/1006023658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d2c06e490 0x7f5d2c146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:22.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d31600640 1 -- 172.21.15.103:0/1006023658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d2c0d0310 msgr2=0x7f5d2c156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:22.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d31600640 1 --2- 172.21.15.103:0/1006023658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d2c0d0310 0x7f5d2c156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:22.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d31600640 1 -- 172.21.15.103:0/1006023658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2c159400 con 0x7f5d2c159b80 2024-09-10T22:44:22.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d30c00640 1 --2- 172.21.15.103:0/1006023658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d2c06e490 0x7f5d2c146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:22.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d31600640 1 --2- 172.21.15.103:0/1006023658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d2c159b80 0x7f5d2c156aa0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400c730 tx=0x7f5d2400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:22.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d28c00640 1 -- 172.21.15.103:0/1006023658 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24003db0 con 0x7f5d2c159b80 2024-09-10T22:44:22.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d28c00640 1 -- 172.21.15.103:0/1006023658 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d2400ce40 con 0x7f5d2c159b80 2024-09-10T22:44:22.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d28c00640 1 -- 172.21.15.103:0/1006023658 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d240052d0 con 0x7f5d2c159b80 2024-09-10T22:44:22.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d33600640 1 -- 172.21.15.103:0/1006023658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d2c1f87e0 con 0x7f5d2c159b80 2024-09-10T22:44:22.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d33600640 1 -- 172.21.15.103:0/1006023658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d2c1f8000 con 0x7f5d2c159b80 2024-09-10T22:44:22.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.338+0000 7f5d33600640 1 -- 172.21.15.103:0/1006023658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d2c1f7b50 con 0x7f5d2c159b80 2024-09-10T22:44:22.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.342+0000 7f5d28c00640 1 -- 172.21.15.103:0/1006023658 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5d24005470 con 0x7f5d2c159b80 2024-09-10T22:44:22.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.342+0000 7f5d28c00640 1 --2- 172.21.15.103:0/1006023658 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5d0c0725e0 0x7f5d0c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:22.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.342+0000 7f5d28c00640 1 -- 172.21.15.103:0/1006023658 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5619+0+0 (secure 0 0 0) 0x7f5d24092fe0 con 0x7f5d2c159b80 2024-09-10T22:44:22.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.342+0000 7f5d30c00640 1 --2- 172.21.15.103:0/1006023658 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5d0c0725e0 0x7f5d0c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:22.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.342+0000 7f5d30c00640 1 --2- 172.21.15.103:0/1006023658 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5d0c0725e0 0x7f5d0c074aa0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5d200016b0 tx=0x7f5d20009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:22.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.346+0000 7f5d28c00640 1 -- 172.21.15.103:0/1006023658 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5d2405e760 con 0x7f5d2c159b80 2024-09-10T22:44:22.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:22.510+0000 7f5d33600640 1 -- 172.21.15.103:0/1006023658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f5d2c072470 con 0x7f5d2c159b80 2024-09-10T22:44:23.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.158+0000 7f5d28c00640 1 -- 172.21.15.103:0/1006023658 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v90) ==== 170+0+0 (secure 0 0 0) 0x7f5d2405e060 con 0x7f5d2c159b80 2024-09-10T22:44:23.163 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2024-09-10T22:44:23.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.162+0000 7f5d33600640 1 -- 172.21.15.103:0/1006023658 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5d0c0725e0 msgr2=0x7f5d0c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:23.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.162+0000 7f5d33600640 1 --2- 172.21.15.103:0/1006023658 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5d0c0725e0 0x7f5d0c074aa0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5d200016b0 tx=0x7f5d20009040 comp rx=0 tx=0).stop 2024-09-10T22:44:23.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.162+0000 7f5d33600640 1 -- 172.21.15.103:0/1006023658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d2c159b80 msgr2=0x7f5d2c156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:23.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.162+0000 7f5d33600640 1 --2- 172.21.15.103:0/1006023658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d2c159b80 0x7f5d2c156aa0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400c730 tx=0x7f5d2400cbf0 comp rx=0 tx=0).stop 2024-09-10T22:44:23.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.162+0000 7f5d33600640 1 -- 172.21.15.103:0/1006023658 shutdown_connections 2024-09-10T22:44:23.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.162+0000 7f5d33600640 1 --2- 172.21.15.103:0/1006023658 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5d0c0725e0 0x7f5d0c074aa0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:23.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.162+0000 7f5d33600640 1 --2- 172.21.15.103:0/1006023658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d2c159b80 0x7f5d2c156aa0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:23.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.162+0000 7f5d33600640 1 --2- 172.21.15.103:0/1006023658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d2c0d0310 0x7f5d2c156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:23.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.162+0000 7f5d33600640 1 --2- 172.21.15.103:0/1006023658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d2c06e490 0x7f5d2c146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:23.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.162+0000 7f5d33600640 1 -- 172.21.15.103:0/1006023658 >> 172.21.15.103:0/1006023658 conn(0x7f5d2c0cf7f0 msgr2=0x7f5d2c154990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:23.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.162+0000 7f5d33600640 1 -- 172.21.15.103:0/1006023658 shutdown_connections 2024-09-10T22:44:23.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.162+0000 7f5d33600640 1 -- 172.21.15.103:0/1006023658 wait complete. 2024-09-10T22:44:23.203 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T22:44:23.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.346+0000 7f8cb3e00640 1 -- 172.21.15.103:0/2457421062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cb40b0510 msgr2=0x7f8cb4070430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:23.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.346+0000 7f8cb3e00640 1 --2- 172.21.15.103:0/2457421062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cb40b0510 0x7f8cb4070430 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009c80 tx=0x7f8cac01cd10 comp rx=0 tx=0).stop 2024-09-10T22:44:23.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.346+0000 7f8cb3e00640 1 -- 172.21.15.103:0/2457421062 shutdown_connections 2024-09-10T22:44:23.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.346+0000 7f8cb3e00640 1 --2- 172.21.15.103:0/2457421062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cb40b0510 0x7f8cb4070430 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:23.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.346+0000 7f8cb3e00640 1 --2- 172.21.15.103:0/2457421062 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cb40714d0 0x7f8cb40affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:23.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.346+0000 7f8cb3e00640 1 -- 172.21.15.103:0/2457421062 >> 172.21.15.103:0/2457421062 conn(0x7f8cb40d18f0 msgr2=0x7f8cb40d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:23.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.346+0000 7f8cb3e00640 1 -- 172.21.15.103:0/2457421062 shutdown_connections 2024-09-10T22:44:23.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.346+0000 7f8cb3e00640 1 -- 172.21.15.103:0/2457421062 wait complete. 2024-09-10T22:44:23.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.346+0000 7f8cb3e00640 1 Processor -- start 2024-09-10T22:44:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.346+0000 7f8cb3e00640 1 -- start start 2024-09-10T22:44:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.346+0000 7f8cb3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cb40714d0 0x7f8cb414eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cb40b0510 0x7f8cb40ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb3e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cb415f0e0 0x7f8cb40cd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb3e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb4168d40 con 0x7f8cb40b0510 2024-09-10T22:44:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb3e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb4168bc0 con 0x7f8cb40714d0 2024-09-10T22:44:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb3e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb4168ec0 con 0x7f8cb415f0e0 2024-09-10T22:44:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cb40b0510 0x7f8cb40ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cb40b0510 0x7f8cb40ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44380/0 (socket says 172.21.15.103:44380) 2024-09-10T22:44:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb2000640 1 -- 172.21.15.103:0/3839139827 learned_addr learned my addr 172.21.15.103:0/3839139827 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb2a00640 1 --2- 172.21.15.103:0/3839139827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cb40714d0 0x7f8cb414eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb3400640 1 --2- 172.21.15.103:0/3839139827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cb415f0e0 0x7f8cb40cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb2000640 1 -- 172.21.15.103:0/3839139827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cb415f0e0 msgr2=0x7f8cb40cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb2000640 1 --2- 172.21.15.103:0/3839139827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cb415f0e0 0x7f8cb40cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb2000640 1 -- 172.21.15.103:0/3839139827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cb40714d0 msgr2=0x7f8cb414eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:23.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb2000640 1 --2- 172.21.15.103:0/3839139827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cb40714d0 0x7f8cb414eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:23.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb2000640 1 -- 172.21.15.103:0/3839139827 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb4155860 con 0x7f8cb40b0510 2024-09-10T22:44:23.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb2000640 1 --2- 172.21.15.103:0/3839139827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cb40b0510 0x7f8cb40ccb20 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000d9b0 tx=0x7f8ca000de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:23.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cab400640 1 -- 172.21.15.103:0/3839139827 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0017070 con 0x7f8cb40b0510 2024-09-10T22:44:23.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cab400640 1 -- 172.21.15.103:0/3839139827 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ca0009cc0 con 0x7f8cb40b0510 2024-09-10T22:44:23.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb3e00640 1 -- 172.21.15.103:0/3839139827 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb415bde0 con 0x7f8cb40b0510 2024-09-10T22:44:23.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cab400640 1 -- 172.21.15.103:0/3839139827 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0005280 con 0x7f8cb40b0510 2024-09-10T22:44:23.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb3e00640 1 -- 172.21.15.103:0/3839139827 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb4155510 con 0x7f8cb40b0510 2024-09-10T22:44:23.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cb3e00640 1 -- 172.21.15.103:0/3839139827 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb40affd0 con 0x7f8cb40b0510 2024-09-10T22:44:23.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.350+0000 7f8cab400640 1 -- 172.21.15.103:0/3839139827 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8ca0005420 con 0x7f8cb40b0510 2024-09-10T22:44:23.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.354+0000 7f8cab400640 1 --2- 172.21.15.103:0/3839139827 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8c940725e0 0x7f8c94074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:23.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.354+0000 7f8cab400640 1 -- 172.21.15.103:0/3839139827 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6001+0+0 (secure 0 0 0) 0x7f8ca0093940 con 0x7f8cb40b0510 2024-09-10T22:44:23.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.354+0000 7f8cb2a00640 1 --2- 172.21.15.103:0/3839139827 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8c940725e0 0x7f8c94074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:23.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.354+0000 7f8cb2a00640 1 --2- 172.21.15.103:0/3839139827 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8c940725e0 0x7f8c94074aa0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4007fd0 tx=0x7f8ca4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:23.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.358+0000 7f8cab400640 1 -- 172.21.15.103:0/3839139827 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8ca005e910 con 0x7f8cb40b0510 2024-09-10T22:44:23.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:23.554+0000 7f8cb3e00640 1 -- 172.21.15.103:0/3839139827 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8cb4159eb0 con 0x7f8cb40b0510 2024-09-10T22:44:24.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.190+0000 7f8cab400640 1 -- 172.21.15.103:0/3839139827 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v85) ==== 174+0+0 (secure 0 0 0) 0x7f8ca0063340 con 0x7f8cb40b0510 2024-09-10T22:44:24.197 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 13 and data pool 14 2024-09-10T22:44:24.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.202+0000 7f8cb3e00640 1 -- 172.21.15.103:0/3839139827 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8c940725e0 msgr2=0x7f8c94074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:24.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.202+0000 7f8cb3e00640 1 --2- 172.21.15.103:0/3839139827 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8c940725e0 0x7f8c94074aa0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4007fd0 tx=0x7f8ca4009040 comp rx=0 tx=0).stop 2024-09-10T22:44:24.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.202+0000 7f8cb3e00640 1 -- 172.21.15.103:0/3839139827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cb40b0510 msgr2=0x7f8cb40ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:24.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.202+0000 7f8cb3e00640 1 --2- 172.21.15.103:0/3839139827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cb40b0510 0x7f8cb40ccb20 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000d9b0 tx=0x7f8ca000de70 comp rx=0 tx=0).stop 2024-09-10T22:44:24.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.206+0000 7f8cb3e00640 1 -- 172.21.15.103:0/3839139827 shutdown_connections 2024-09-10T22:44:24.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.206+0000 7f8cb3e00640 1 --2- 172.21.15.103:0/3839139827 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8c940725e0 0x7f8c94074aa0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.206+0000 7f8cb3e00640 1 --2- 172.21.15.103:0/3839139827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cb415f0e0 0x7f8cb40cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.206+0000 7f8cb3e00640 1 --2- 172.21.15.103:0/3839139827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cb40b0510 0x7f8cb40ccb20 secure :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000d9b0 tx=0x7f8ca000de70 comp rx=0 tx=0).stop 2024-09-10T22:44:24.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.206+0000 7f8cb3e00640 1 --2- 172.21.15.103:0/3839139827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cb40714d0 0x7f8cb414eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.206+0000 7f8cb3e00640 1 -- 172.21.15.103:0/3839139827 >> 172.21.15.103:0/3839139827 conn(0x7f8cb40d18f0 msgr2=0x7f8cb40d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:24.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.206+0000 7f8cb3e00640 1 -- 172.21.15.103:0/3839139827 shutdown_connections 2024-09-10T22:44:24.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.206+0000 7f8cb3e00640 1 -- 172.21.15.103:0/3839139827 wait complete. 2024-09-10T22:44:24.239 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:44:24.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.378+0000 7f5dd8000640 1 -- 172.21.15.103:0/3885653176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd0073c30 msgr2=0x7f5dd00740e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:24.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.378+0000 7f5dd8000640 1 --2- 172.21.15.103:0/3885653176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd0073c30 0x7f5dd00740e0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00d03c0 tx=0x7f5dc801dc70 comp rx=0 tx=0).stop 2024-09-10T22:44:24.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.378+0000 7f5dd8000640 1 -- 172.21.15.103:0/3885653176 shutdown_connections 2024-09-10T22:44:24.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.378+0000 7f5dd8000640 1 --2- 172.21.15.103:0/3885653176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd0073c30 0x7f5dd00740e0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.378+0000 7f5dd8000640 1 --2- 172.21.15.103:0/3885653176 >> v2:172.21.15.131:3300/0 conn(0x7f5dd0150a50 0x7f5dd015aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.378+0000 7f5dd8000640 1 -- 172.21.15.103:0/3885653176 >> 172.21.15.103:0/3885653176 conn(0x7f5dd006cc00 msgr2=0x7f5dd006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:24.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.378+0000 7f5dd8000640 1 -- 172.21.15.103:0/3885653176 shutdown_connections 2024-09-10T22:44:24.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.378+0000 7f5dd8000640 1 -- 172.21.15.103:0/3885653176 wait complete. 2024-09-10T22:44:24.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.378+0000 7f5dd8000640 1 Processor -- start 2024-09-10T22:44:24.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.378+0000 7f5dd8000640 1 -- start start 2024-09-10T22:44:24.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.378+0000 7f5dd8000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5dd0073c30 0x7f5dd014e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:24.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.378+0000 7f5dd8000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd00b4b20 0x7f5dd0141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:24.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.378+0000 7f5dd8000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dd0150a50 0x7f5dd0159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:24.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.378+0000 7f5dd8000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd0166a40 con 0x7f5dd00b4b20 2024-09-10T22:44:24.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.378+0000 7f5dd8000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd00732f0 con 0x7f5dd0150a50 2024-09-10T22:44:24.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.378+0000 7f5dd8000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd0166bc0 con 0x7f5dd0073c30 2024-09-10T22:44:24.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.378+0000 7f5dd4c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd00b4b20 0x7f5dd0141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:24.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.378+0000 7f5dd4c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd00b4b20 0x7f5dd0141160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44402/0 (socket says 172.21.15.103:44402) 2024-09-10T22:44:24.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.382+0000 7f5dd4c00640 1 -- 172.21.15.103:0/3654694771 learned_addr learned my addr 172.21.15.103:0/3654694771 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:24.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.382+0000 7f5dd5600640 1 --2- 172.21.15.103:0/3654694771 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5dd0073c30 0x7f5dd014e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:24.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.382+0000 7f5dd6000640 1 --2- 172.21.15.103:0/3654694771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dd0150a50 0x7f5dd0159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:24.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.382+0000 7f5dd4c00640 1 -- 172.21.15.103:0/3654694771 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5dd0073c30 msgr2=0x7f5dd014e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:24.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.382+0000 7f5dd4c00640 1 --2- 172.21.15.103:0/3654694771 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5dd0073c30 0x7f5dd014e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.382+0000 7f5dd4c00640 1 -- 172.21.15.103:0/3654694771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dd0150a50 msgr2=0x7f5dd0159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:24.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.382+0000 7f5dd4c00640 1 --2- 172.21.15.103:0/3654694771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dd0150a50 0x7f5dd0159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.382+0000 7f5dd4c00640 1 -- 172.21.15.103:0/3654694771 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd01416a0 con 0x7f5dd00b4b20 2024-09-10T22:44:24.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.382+0000 7f5dd5600640 1 --2- 172.21.15.103:0/3654694771 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5dd0073c30 0x7f5dd014e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:24.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.382+0000 7f5dd4c00640 1 --2- 172.21.15.103:0/3654694771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd00b4b20 0x7f5dd0141160 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00c410 tx=0x7f5dbc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:24.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.382+0000 7f5dcd600640 1 -- 172.21.15.103:0/3654694771 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc011790 con 0x7f5dd00b4b20 2024-09-10T22:44:24.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.382+0000 7f5dcd600640 1 -- 172.21.15.103:0/3654694771 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5dbc017070 con 0x7f5dd00b4b20 2024-09-10T22:44:24.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.382+0000 7f5dcd600640 1 -- 172.21.15.103:0/3654694771 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc011d00 con 0x7f5dd00b4b20 2024-09-10T22:44:24.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.382+0000 7f5dd8000640 1 -- 172.21.15.103:0/3654694771 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd00a9950 con 0x7f5dd00b4b20 2024-09-10T22:44:24.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.382+0000 7f5dd8000640 1 -- 172.21.15.103:0/3654694771 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd00aa1f0 con 0x7f5dd00b4b20 2024-09-10T22:44:24.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.382+0000 7f5dd8000640 1 -- 172.21.15.103:0/3654694771 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd00a9d40 con 0x7f5dd00b4b20 2024-09-10T22:44:24.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.382+0000 7f5dcd600640 1 -- 172.21.15.103:0/3654694771 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5dbc01c460 con 0x7f5dd00b4b20 2024-09-10T22:44:24.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.386+0000 7f5dcd600640 1 --2- 172.21.15.103:0/3654694771 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5db0072610 0x7f5db0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:24.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.386+0000 7f5dcd600640 1 -- 172.21.15.103:0/3654694771 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6101+0+0 (secure 0 0 0) 0x7f5dbc092f90 con 0x7f5dd00b4b20 2024-09-10T22:44:24.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.386+0000 7f5dd5600640 1 --2- 172.21.15.103:0/3654694771 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5db0072610 0x7f5db0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:24.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.386+0000 7f5dd5600640 1 --2- 172.21.15.103:0/3654694771 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5db0072610 0x7f5db0074ad0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4006fd0 tx=0x7f5dc4008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:24.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.390+0000 7f5dcd600640 1 -- 172.21.15.103:0/3654694771 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5dbc021020 con 0x7f5dd00b4b20 2024-09-10T22:44:24.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.554+0000 7f5dd8000640 1 -- 172.21.15.103:0/3654694771 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5dd006d400 con 0x7f5dd00b4b20 2024-09-10T22:44:24.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.554+0000 7f5dcd600640 1 -- 172.21.15.103:0/3654694771 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+17018 (secure 0 0 0) 0x7f5dd01416a0 con 0x7f5dd00b4b20 2024-09-10T22:44:24.558 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:24.558 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":91,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:44:23.558571+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:44:21.248484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-10T22:44:22.526092+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:44:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.558+0000 7f5dd8000640 1 -- 172.21.15.103:0/3654694771 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5db0072610 msgr2=0x7f5db0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.558+0000 7f5dd8000640 1 --2- 172.21.15.103:0/3654694771 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5db0072610 0x7f5db0074ad0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4006fd0 tx=0x7f5dc4008040 comp rx=0 tx=0).stop 2024-09-10T22:44:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.558+0000 7f5dd8000640 1 -- 172.21.15.103:0/3654694771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd00b4b20 msgr2=0x7f5dd0141160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.558+0000 7f5dd8000640 1 --2- 172.21.15.103:0/3654694771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd00b4b20 0x7f5dd0141160 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00c410 tx=0x7f5dbc00c8d0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.558+0000 7f5dd8000640 1 -- 172.21.15.103:0/3654694771 shutdown_connections 2024-09-10T22:44:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.558+0000 7f5dd8000640 1 --2- 172.21.15.103:0/3654694771 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5db0072610 0x7f5db0074ad0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.558+0000 7f5dd8000640 1 --2- 172.21.15.103:0/3654694771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dd0150a50 0x7f5dd0159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.558+0000 7f5dd8000640 1 --2- 172.21.15.103:0/3654694771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd00b4b20 0x7f5dd0141160 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.558+0000 7f5dd8000640 1 --2- 172.21.15.103:0/3654694771 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5dd0073c30 0x7f5dd014e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.558+0000 7f5dd8000640 1 -- 172.21.15.103:0/3654694771 >> 172.21.15.103:0/3654694771 conn(0x7f5dd006cc00 msgr2=0x7f5dd00af4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.558+0000 7f5dd8000640 1 -- 172.21.15.103:0/3654694771 shutdown_connections 2024-09-10T22:44:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.558+0000 7f5dd8000640 1 -- 172.21.15.103:0/3654694771 wait complete. 2024-09-10T22:44:24.580 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:44:24.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.718+0000 7f3858400640 1 -- 172.21.15.103:0/1200460578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3838004810 msgr2=0x7f3838004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:24.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.718+0000 7f3858400640 1 --2- 172.21.15.103:0/1200460578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3838004810 0x7f3838004c90 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f383c006fc0 tx=0x7f383c01cec0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.718+0000 7f3856400640 1 -- 172.21.15.103:0/1200460578 reap_dead start 2024-09-10T22:44:24.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.718+0000 7f3858400640 1 -- 172.21.15.103:0/1200460578 shutdown_connections 2024-09-10T22:44:24.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.718+0000 7f3858400640 1 -- 172.21.15.103:0/1200460578 >> 172.21.15.103:0/1200460578 conn(0x7f38500d1a20 msgr2=0x7f38500d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:24.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.718+0000 7f3858400640 1 -- 172.21.15.103:0/1200460578 shutdown_connections 2024-09-10T22:44:24.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.718+0000 7f3858400640 1 -- 172.21.15.103:0/1200460578 wait complete. 2024-09-10T22:44:24.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3858400640 1 Processor -- start 2024-09-10T22:44:24.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3858400640 1 -- start start 2024-09-10T22:44:24.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3858400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3838004810 0x7f38500ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:24.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3858400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38500cb460 0x7f38500b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:24.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3858400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38500b6e40 0x7f385009e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:24.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3858400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f38500cf980 con 0x7f38500cb460 2024-09-10T22:44:24.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3858400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f38500cf800 con 0x7f38500b6e40 2024-09-10T22:44:24.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3858400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f38500b1ba0 con 0x7f3838004810 2024-09-10T22:44:24.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3855000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38500cb460 0x7f38500b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:24.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3855000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38500cb460 0x7f38500b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44422/0 (socket says 172.21.15.103:44422) 2024-09-10T22:44:24.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3855000640 1 -- 172.21.15.103:0/46552973 learned_addr learned my addr 172.21.15.103:0/46552973 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:24.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3856400640 1 --2- 172.21.15.103:0/46552973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38500b6e40 0x7f385009e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:24.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3855a00640 1 --2- 172.21.15.103:0/46552973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3838004810 0x7f38500ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:24.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3855000640 1 -- 172.21.15.103:0/46552973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3838004810 msgr2=0x7f38500ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:24.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3855000640 1 --2- 172.21.15.103:0/46552973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3838004810 0x7f38500ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3855000640 1 -- 172.21.15.103:0/46552973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38500b6e40 msgr2=0x7f385009e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:24.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3855000640 1 --2- 172.21.15.103:0/46552973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38500b6e40 0x7f385009e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3855000640 1 -- 172.21.15.103:0/46552973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38500c9880 con 0x7f38500cb460 2024-09-10T22:44:24.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3855a00640 1 --2- 172.21.15.103:0/46552973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3838004810 0x7f38500ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:24.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3855000640 1 --2- 172.21.15.103:0/46552973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38500cb460 0x7f38500b5280 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f383c098a90 tx=0x7f383c0011b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:24.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f384d600640 1 -- 172.21.15.103:0/46552973 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c006090 con 0x7f38500cb460 2024-09-10T22:44:24.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f384d600640 1 -- 172.21.15.103:0/46552973 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f383c006230 con 0x7f38500cb460 2024-09-10T22:44:24.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f384d600640 1 -- 172.21.15.103:0/46552973 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c003600 con 0x7f38500cb460 2024-09-10T22:44:24.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3858400640 1 -- 172.21.15.103:0/46552973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38500c9b60 con 0x7f38500cb460 2024-09-10T22:44:24.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3858400640 1 -- 172.21.15.103:0/46552973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38500ca120 con 0x7f38500cb460 2024-09-10T22:44:24.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.722+0000 7f3858400640 1 -- 172.21.15.103:0/46552973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38500b1490 con 0x7f38500cb460 2024-09-10T22:44:24.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.726+0000 7f384d600640 1 -- 172.21.15.103:0/46552973 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f383c0037a0 con 0x7f38500cb460 2024-09-10T22:44:24.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.726+0000 7f384d600640 1 --2- 172.21.15.103:0/46552973 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3830072610 0x7f3830074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:24.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.726+0000 7f384d600640 1 -- 172.21.15.103:0/46552973 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6101+0+0 (secure 0 0 0) 0x7f383c12cf20 con 0x7f38500cb460 2024-09-10T22:44:24.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.726+0000 7f3855a00640 1 --2- 172.21.15.103:0/46552973 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3830072610 0x7f3830074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:24.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.726+0000 7f3855a00640 1 --2- 172.21.15.103:0/46552973 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3830072610 0x7f3830074ad0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3844009b80 tx=0x7f38440091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:24.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.730+0000 7f384d600640 1 -- 172.21.15.103:0/46552973 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f383c0bf030 con 0x7f38500cb460 2024-09-10T22:44:24.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.894+0000 7f3858400640 1 -- 172.21.15.103:0/46552973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38500ce680 con 0x7f38500cb460 2024-09-10T22:44:24.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.898+0000 7f384d600640 1 -- 172.21.15.103:0/46552973 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+17018 (secure 0 0 0) 0x7f383c016c70 con 0x7f38500cb460 2024-09-10T22:44:24.900 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:24.900 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":91,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:44:23.558571+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:44:21.248484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-10T22:44:22.526092+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:44:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.898+0000 7f3858400640 1 -- 172.21.15.103:0/46552973 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3830072610 msgr2=0x7f3830074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.898+0000 7f3858400640 1 --2- 172.21.15.103:0/46552973 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3830072610 0x7f3830074ad0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3844009b80 tx=0x7f38440091e0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.898+0000 7f3858400640 1 -- 172.21.15.103:0/46552973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38500cb460 msgr2=0x7f38500b5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.898+0000 7f3858400640 1 --2- 172.21.15.103:0/46552973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38500cb460 0x7f38500b5280 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f383c098a90 tx=0x7f383c0011b0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.898+0000 7f3858400640 1 -- 172.21.15.103:0/46552973 shutdown_connections 2024-09-10T22:44:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.898+0000 7f3858400640 1 --2- 172.21.15.103:0/46552973 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3830072610 0x7f3830074ad0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.898+0000 7f3858400640 1 --2- 172.21.15.103:0/46552973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38500b6e40 0x7f385009e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.898+0000 7f3858400640 1 --2- 172.21.15.103:0/46552973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38500cb460 0x7f38500b5280 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.898+0000 7f3858400640 1 --2- 172.21.15.103:0/46552973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3838004810 0x7f38500ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:24.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.898+0000 7f3858400640 1 -- 172.21.15.103:0/46552973 >> 172.21.15.103:0/46552973 conn(0x7f38500d1a20 msgr2=0x7f38500d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:24.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.898+0000 7f3858400640 1 -- 172.21.15.103:0/46552973 shutdown_connections 2024-09-10T22:44:24.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:24.898+0000 7f3858400640 1 -- 172.21.15.103:0/46552973 wait complete. 2024-09-10T22:44:24.922 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T22:44:25.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.062+0000 7f1d2ac00640 1 -- 172.21.15.103:0/2043909527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d2415f2e0 msgr2=0x7f1d2415f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:25.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.062+0000 7f1d2ac00640 1 --2- 172.21.15.103:0/2043909527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d2415f2e0 0x7f1d2415f6f0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f1d24072490 tx=0x7f1d1c01cd80 comp rx=0 tx=0).stop 2024-09-10T22:44:25.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.062+0000 7f1d2ac00640 1 -- 172.21.15.103:0/2043909527 shutdown_connections 2024-09-10T22:44:25.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.062+0000 7f1d2ac00640 1 --2- 172.21.15.103:0/2043909527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d2415f2e0 0x7f1d2415f6f0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:25.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.062+0000 7f1d2ac00640 1 --2- 172.21.15.103:0/2043909527 >> v2:172.21.15.131:3300/0 conn(0x7f1d240cfdd0 0x7f1d2415eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:25.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.062+0000 7f1d2ac00640 1 -- 172.21.15.103:0/2043909527 >> 172.21.15.103:0/2043909527 conn(0x7f1d2406cc00 msgr2=0x7f1d2406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:25.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.062+0000 7f1d2ac00640 1 -- 172.21.15.103:0/2043909527 shutdown_connections 2024-09-10T22:44:25.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.062+0000 7f1d2ac00640 1 -- 172.21.15.103:0/2043909527 wait complete. 2024-09-10T22:44:25.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.062+0000 7f1d2ac00640 1 Processor -- start 2024-09-10T22:44:25.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.062+0000 7f1d2ac00640 1 -- start start 2024-09-10T22:44:25.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d2ac00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d240cf9f0 0x7f1d24152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:25.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d2ac00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d240cfdd0 0x7f1d2415b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:25.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d2ac00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d2415f2e0 0x7f1d24150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:25.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d2ac00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1d240cd660 con 0x7f1d240cfdd0 2024-09-10T22:44:25.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d2ac00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1d240cd4e0 con 0x7f1d240cf9f0 2024-09-10T22:44:25.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d2ac00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1d240cd7e0 con 0x7f1d2415f2e0 2024-09-10T22:44:25.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d23400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d240cfdd0 0x7f1d2415b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:25.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d23400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d240cfdd0 0x7f1d2415b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44434/0 (socket says 172.21.15.103:44434) 2024-09-10T22:44:25.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d23400640 1 -- 172.21.15.103:0/376072334 learned_addr learned my addr 172.21.15.103:0/376072334 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:25.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d23400640 1 -- 172.21.15.103:0/376072334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d2415f2e0 msgr2=0x7f1d24150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:25.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d23400640 1 --2- 172.21.15.103:0/376072334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d2415f2e0 0x7f1d24150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:25.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d23400640 1 -- 172.21.15.103:0/376072334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d240cf9f0 msgr2=0x7f1d24152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:25.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d23400640 1 --2- 172.21.15.103:0/376072334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d240cf9f0 0x7f1d24152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:25.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d23400640 1 -- 172.21.15.103:0/376072334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2415be30 con 0x7f1d240cfdd0 2024-09-10T22:44:25.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d23400640 1 --2- 172.21.15.103:0/376072334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d240cfdd0 0x7f1d2415b770 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000d9b0 tx=0x7f1d1000de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:25.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d1be00640 1 -- 172.21.15.103:0/376072334 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10017070 con 0x7f1d240cfdd0 2024-09-10T22:44:25.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d1be00640 1 -- 172.21.15.103:0/376072334 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d10009cc0 con 0x7f1d240cfdd0 2024-09-10T22:44:25.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d2ac00640 1 -- 172.21.15.103:0/376072334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d2415c110 con 0x7f1d240cfdd0 2024-09-10T22:44:25.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d1be00640 1 -- 172.21.15.103:0/376072334 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10005280 con 0x7f1d240cfdd0 2024-09-10T22:44:25.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d2ac00640 1 -- 172.21.15.103:0/376072334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d2415c6d0 con 0x7f1d240cfdd0 2024-09-10T22:44:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d2ac00640 1 -- 172.21.15.103:0/376072334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d2415eda0 con 0x7f1d240cfdd0 2024-09-10T22:44:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.066+0000 7f1d1be00640 1 -- 172.21.15.103:0/376072334 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1d10005420 con 0x7f1d240cfdd0 2024-09-10T22:44:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.070+0000 7f1d1be00640 1 --2- 172.21.15.103:0/376072334 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1d040725e0 0x7f1d04074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.070+0000 7f1d1be00640 1 -- 172.21.15.103:0/376072334 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6101+0+0 (secure 0 0 0) 0x7f1d100936a0 con 0x7f1d240cfdd0 2024-09-10T22:44:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.070+0000 7f1d23e00640 1 --2- 172.21.15.103:0/376072334 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1d040725e0 0x7f1d04074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.070+0000 7f1d23e00640 1 --2- 172.21.15.103:0/376072334 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1d040725e0 0x7f1d04074aa0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1d14003cf0 tx=0x7f1d140079c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:25.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.074+0000 7f1d1be00640 1 -- 172.21.15.103:0/376072334 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1d1005ebe0 con 0x7f1d240cfdd0 2024-09-10T22:44:25.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:25.274+0000 7f1d2ac00640 1 -- 172.21.15.103:0/376072334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1d240b2f00 con 0x7f1d240cfdd0 2024-09-10T22:44:26.159 INFO:tasks.ceph.mds.c.smithi103.stderr:2024-09-10T22:44:26.153+0000 7f11ae800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T22:44:26.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.197+0000 7f1d1be00640 1 -- 172.21.15.103:0/376072334 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v88) ==== 118+0+0 (secure 0 0 0) 0x7f1d10067300 con 0x7f1d240cfdd0 2024-09-10T22:44:26.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.197+0000 7f1d2ac00640 1 -- 172.21.15.103:0/376072334 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1d040725e0 msgr2=0x7f1d04074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:26.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.197+0000 7f1d2ac00640 1 --2- 172.21.15.103:0/376072334 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1d040725e0 0x7f1d04074aa0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1d14003cf0 tx=0x7f1d140079c0 comp rx=0 tx=0).stop 2024-09-10T22:44:26.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.197+0000 7f1d2ac00640 1 -- 172.21.15.103:0/376072334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d240cfdd0 msgr2=0x7f1d2415b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:26.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.197+0000 7f1d2ac00640 1 --2- 172.21.15.103:0/376072334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d240cfdd0 0x7f1d2415b770 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000d9b0 tx=0x7f1d1000de70 comp rx=0 tx=0).stop 2024-09-10T22:44:26.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.197+0000 7f1d2ac00640 1 -- 172.21.15.103:0/376072334 shutdown_connections 2024-09-10T22:44:26.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.197+0000 7f1d2ac00640 1 --2- 172.21.15.103:0/376072334 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1d040725e0 0x7f1d04074aa0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:26.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.197+0000 7f1d2ac00640 1 --2- 172.21.15.103:0/376072334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d2415f2e0 0x7f1d24150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:26.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.197+0000 7f1d2ac00640 1 --2- 172.21.15.103:0/376072334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d240cfdd0 0x7f1d2415b770 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:26.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.197+0000 7f1d2ac00640 1 --2- 172.21.15.103:0/376072334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d240cf9f0 0x7f1d24152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:26.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.197+0000 7f1d2ac00640 1 -- 172.21.15.103:0/376072334 >> 172.21.15.103:0/376072334 conn(0x7f1d2406cc00 msgr2=0x7f1d241511f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:26.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.197+0000 7f1d2ac00640 1 -- 172.21.15.103:0/376072334 shutdown_connections 2024-09-10T22:44:26.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.197+0000 7f1d2ac00640 1 -- 172.21.15.103:0/376072334 wait complete. 2024-09-10T22:44:26.222 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T22:44:26.223 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T22:44:26.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.361+0000 7f6dcf800640 1 -- 172.21.15.103:0/1694370213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6dc8070a80 msgr2=0x7f6dc8070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:26.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.361+0000 7f6dcf800640 1 --2- 172.21.15.103:0/1694370213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6dc8070a80 0x7f6dc8070e60 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009840 tx=0x7f6db801f010 comp rx=0 tx=0).stop 2024-09-10T22:44:26.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.361+0000 7f6dcf800640 1 -- 172.21.15.103:0/1694370213 shutdown_connections 2024-09-10T22:44:26.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.361+0000 7f6dcf800640 1 --2- 172.21.15.103:0/1694370213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6dc8070a80 0x7f6dc8070e60 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:26.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.361+0000 7f6dcf800640 1 -- 172.21.15.103:0/1694370213 >> 172.21.15.103:0/1694370213 conn(0x7f6dc80d0920 msgr2=0x7f6dc80d0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:26.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.361+0000 7f6dcf800640 1 -- 172.21.15.103:0/1694370213 shutdown_connections 2024-09-10T22:44:26.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.361+0000 7f6dcf800640 1 -- 172.21.15.103:0/1694370213 wait complete. 2024-09-10T22:44:26.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcf800640 1 Processor -- start 2024-09-10T22:44:26.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcf800640 1 -- start start 2024-09-10T22:44:26.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcf800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6dc8070080 0x7f6dc8151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:26.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcf800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dc8070a80 0x7f6dc814c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:26.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcf800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc815c540 0x7f6dc8158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:26.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcf800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc8074020 con 0x7f6dc8070080 2024-09-10T22:44:26.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcf800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc8073ea0 con 0x7f6dc8070a80 2024-09-10T22:44:26.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcf800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc8167470 con 0x7f6dc815c540 2024-09-10T22:44:26.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6dc8070080 0x7f6dc8151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:26.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6dc8070080 0x7f6dc8151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44446/0 (socket says 172.21.15.103:44446) 2024-09-10T22:44:26.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcce00640 1 -- 172.21.15.103:0/810572527 learned_addr learned my addr 172.21.15.103:0/810572527 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:26.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dc7e00640 1 --2- 172.21.15.103:0/810572527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dc8070a80 0x7f6dc814c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:26.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcd800640 1 --2- 172.21.15.103:0/810572527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc815c540 0x7f6dc8158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:26.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcce00640 1 -- 172.21.15.103:0/810572527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc815c540 msgr2=0x7f6dc8158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:26.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcce00640 1 --2- 172.21.15.103:0/810572527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc815c540 0x7f6dc8158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:26.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcce00640 1 -- 172.21.15.103:0/810572527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dc8070a80 msgr2=0x7f6dc814c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:26.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcce00640 1 --2- 172.21.15.103:0/810572527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dc8070a80 0x7f6dc814c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:26.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcce00640 1 -- 172.21.15.103:0/810572527 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc80b3c20 con 0x7f6dc8070080 2024-09-10T22:44:26.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcd800640 1 --2- 172.21.15.103:0/810572527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc815c540 0x7f6dc8158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:26.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcce00640 1 --2- 172.21.15.103:0/810572527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6dc8070080 0x7f6dc8151e90 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009790 tx=0x7f6db80a8d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:26.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dc4c00640 1 -- 172.21.15.103:0/810572527 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db80bf070 con 0x7f6dc8070080 2024-09-10T22:44:26.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dc4c00640 1 -- 172.21.15.103:0/810572527 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6db80052f0 con 0x7f6dc8070080 2024-09-10T22:44:26.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dc4c00640 1 -- 172.21.15.103:0/810572527 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db80b5040 con 0x7f6dc8070080 2024-09-10T22:44:26.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcf800640 1 -- 172.21.15.103:0/810572527 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc8158cc0 con 0x7f6dc8070080 2024-09-10T22:44:26.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcf800640 1 -- 172.21.15.103:0/810572527 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc80b3ee0 con 0x7f6dc8070080 2024-09-10T22:44:26.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.365+0000 7f6dcf800640 1 -- 172.21.15.103:0/810572527 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc8070e60 con 0x7f6dc8070080 2024-09-10T22:44:26.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.369+0000 7f6dc4c00640 1 -- 172.21.15.103:0/810572527 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6db80b8070 con 0x7f6dc8070080 2024-09-10T22:44:26.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.369+0000 7f6dc4c00640 1 --2- 172.21.15.103:0/810572527 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6da80725e0 0x7f6da8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:26.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.369+0000 7f6dc4c00640 1 -- 172.21.15.103:0/810572527 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6101+0+0 (secure 0 0 0) 0x7f6db81301c0 con 0x7f6dc8070080 2024-09-10T22:44:26.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.369+0000 7f6dc7e00640 1 --2- 172.21.15.103:0/810572527 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6da80725e0 0x7f6da8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:26.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.369+0000 7f6dc7e00640 1 --2- 172.21.15.103:0/810572527 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6da80725e0 0x7f6da8074aa0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8153be0 tx=0x7f6db4007d50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:26.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.373+0000 7f6dc4c00640 1 -- 172.21.15.103:0/810572527 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6db8018b70 con 0x7f6dc8070080 2024-09-10T22:44:26.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:26.573+0000 7f6dcf800640 1 -- 172.21.15.103:0/810572527 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6dc80b6570 con 0x7f6dc8070080 2024-09-10T22:44:27.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.197+0000 7f6dc4c00640 1 -- 172.21.15.103:0/810572527 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v89) ==== 122+0+0 (secure 0 0 0) 0x7f6db80fb0b0 con 0x7f6dc8070080 2024-09-10T22:44:27.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.201+0000 7f6dcf800640 1 -- 172.21.15.103:0/810572527 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6da80725e0 msgr2=0x7f6da8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:27.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.201+0000 7f6dcf800640 1 --2- 172.21.15.103:0/810572527 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6da80725e0 0x7f6da8074aa0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8153be0 tx=0x7f6db4007d50 comp rx=0 tx=0).stop 2024-09-10T22:44:27.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.201+0000 7f6dcf800640 1 -- 172.21.15.103:0/810572527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6dc8070080 msgr2=0x7f6dc8151e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:27.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.201+0000 7f6dcf800640 1 --2- 172.21.15.103:0/810572527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6dc8070080 0x7f6dc8151e90 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009790 tx=0x7f6db80a8d80 comp rx=0 tx=0).stop 2024-09-10T22:44:27.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.201+0000 7f6dcf800640 1 -- 172.21.15.103:0/810572527 shutdown_connections 2024-09-10T22:44:27.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.201+0000 7f6dcf800640 1 --2- 172.21.15.103:0/810572527 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6da80725e0 0x7f6da8074aa0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.201+0000 7f6dcf800640 1 --2- 172.21.15.103:0/810572527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc815c540 0x7f6dc8158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.201+0000 7f6dcf800640 1 --2- 172.21.15.103:0/810572527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dc8070a80 0x7f6dc814c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.201+0000 7f6dcf800640 1 --2- 172.21.15.103:0/810572527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6dc8070080 0x7f6dc8151e90 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.201+0000 7f6dcf800640 1 -- 172.21.15.103:0/810572527 >> 172.21.15.103:0/810572527 conn(0x7f6dc80d0920 msgr2=0x7f6dc815ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:27.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.201+0000 7f6dcf800640 1 -- 172.21.15.103:0/810572527 shutdown_connections 2024-09-10T22:44:27.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.201+0000 7f6dcf800640 1 -- 172.21.15.103:0/810572527 wait complete. 2024-09-10T22:44:27.227 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T22:44:27.227 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:44:27.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.365+0000 7f3414600640 1 -- 172.21.15.103:0/4024893897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f340c0ae9c0 msgr2=0x7f340c0aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:27.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.365+0000 7f3414600640 1 --2- 172.21.15.103:0/4024893897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f340c0ae9c0 0x7f340c0aee10 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f340c0cbf40 tx=0x7f340401caf0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.365+0000 7f3414600640 1 -- 172.21.15.103:0/4024893897 shutdown_connections 2024-09-10T22:44:27.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.365+0000 7f3414600640 1 --2- 172.21.15.103:0/4024893897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f340c0ae9c0 0x7f340c0aee10 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.365+0000 7f3414600640 1 --2- 172.21.15.103:0/4024893897 >> v2:172.21.15.131:3300/0 conn(0x7f340c0b09c0 0x7f340c0ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.365+0000 7f3414600640 1 -- 172.21.15.103:0/4024893897 >> 172.21.15.103:0/4024893897 conn(0x7f340c0d1ac0 msgr2=0x7f340c0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:27.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.365+0000 7f3414600640 1 -- 172.21.15.103:0/4024893897 shutdown_connections 2024-09-10T22:44:27.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.365+0000 7f3414600640 1 -- 172.21.15.103:0/4024893897 wait complete. 2024-09-10T22:44:27.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3414600640 1 Processor -- start 2024-09-10T22:44:27.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3414600640 1 -- start start 2024-09-10T22:44:27.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3414600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f340c0ae9c0 0x7f340c09b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:27.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3414600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f340c0b09c0 0x7f340c155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:27.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3414600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f340c15be30 0x7f340c0ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:27.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3414600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f340c168df0 con 0x7f340c15be30 2024-09-10T22:44:27.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3414600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f340c168c70 con 0x7f340c0ae9c0 2024-09-10T22:44:27.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3414600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f340c168f70 con 0x7f340c0b09c0 2024-09-10T22:44:27.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3412600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f340c15be30 0x7f340c0ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:27.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3412600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f340c15be30 0x7f340c0ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47964/0 (socket says 172.21.15.103:47964) 2024-09-10T22:44:27.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3412600640 1 -- 172.21.15.103:0/3862604327 learned_addr learned my addr 172.21.15.103:0/3862604327 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:27.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3412600640 1 -- 172.21.15.103:0/3862604327 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f340c0b09c0 msgr2=0x7f340c155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:27.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3412600640 1 --2- 172.21.15.103:0/3862604327 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f340c0b09c0 0x7f340c155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3412600640 1 -- 172.21.15.103:0/3862604327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f340c0ae9c0 msgr2=0x7f340c09b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:27.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3411c00640 1 --2- 172.21.15.103:0/3862604327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f340c0ae9c0 0x7f340c09b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:27.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3412600640 1 --2- 172.21.15.103:0/3862604327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f340c0ae9c0 0x7f340c09b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3412600640 1 -- 172.21.15.103:0/3862604327 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340c0c6880 con 0x7f340c15be30 2024-09-10T22:44:27.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3411c00640 1 --2- 172.21.15.103:0/3862604327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f340c0ae9c0 0x7f340c09b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:27.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3412600640 1 --2- 172.21.15.103:0/3862604327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f340c15be30 0x7f340c0ca040 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f3404009b10 tx=0x7f34040a58b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:27.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3409600640 1 -- 172.21.15.103:0/3862604327 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34040bb070 con 0x7f340c15be30 2024-09-10T22:44:27.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3409600640 1 -- 172.21.15.103:0/3862604327 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3404004e00 con 0x7f340c15be30 2024-09-10T22:44:27.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3409600640 1 -- 172.21.15.103:0/3862604327 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34040b2040 con 0x7f340c15be30 2024-09-10T22:44:27.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3414600640 1 -- 172.21.15.103:0/3862604327 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f340c0b5b10 con 0x7f340c15be30 2024-09-10T22:44:27.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.369+0000 7f3414600640 1 -- 172.21.15.103:0/3862604327 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f340c0b60d0 con 0x7f340c15be30 2024-09-10T22:44:27.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.373+0000 7f3414600640 1 -- 172.21.15.103:0/3862604327 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f340c0aedf0 con 0x7f340c15be30 2024-09-10T22:44:27.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.373+0000 7f3409600640 1 -- 172.21.15.103:0/3862604327 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f34040b5030 con 0x7f340c15be30 2024-09-10T22:44:27.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.373+0000 7f3409600640 1 --2- 172.21.15.103:0/3862604327 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33ec0725e0 0x7f33ec074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:27.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.373+0000 7f3409600640 1 -- 172.21.15.103:0/3862604327 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6101+0+0 (secure 0 0 0) 0x7f340412d4f0 con 0x7f340c15be30 2024-09-10T22:44:27.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.373+0000 7f3411c00640 1 --2- 172.21.15.103:0/3862604327 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33ec0725e0 0x7f33ec074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:27.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.373+0000 7f3411c00640 1 --2- 172.21.15.103:0/3862604327 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33ec0725e0 0x7f33ec074aa0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3400000f70 tx=0x7f3400009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:27.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.377+0000 7f3409600640 1 -- 172.21.15.103:0/3862604327 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3404016770 con 0x7f340c15be30 2024-09-10T22:44:27.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.577+0000 7f3414600640 1 -- 172.21.15.103:0/3862604327 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f340c09be60 con 0x7f340c15be30 2024-09-10T22:44:27.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.577+0000 7f3409600640 1 -- 172.21.15.103:0/3862604327 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5234 (secure 0 0 0) 0x7f34040f8a30 con 0x7f340c15be30 2024-09-10T22:44:27.583 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:27.583 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"btime":"2024-09-10T22:44:27:201245+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2586411857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2586411857},{"type":"v1","addr":"172.21.15.131:6837","nonce":2586411857}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84},{"gid":7048,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/1622106563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1622106563},{"type":"v1","addr":"172.21.15.131:6836","nonce":1622106563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84},{"gid":7428,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/3251348074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3251348074},{"type":"v1","addr":"172.21.15.103:6834","nonce":3251348074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:44:23.558537+0000","modified":"2024-09-10T22:44:26.577936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7434":{"gid":7434,"name":"c","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/187627880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":187627880},{"type":"v1","addr":"172.21.15.103:6835","nonce":187627880}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7434,"qdb_cluster":[7434]},"id":6}]} 2024-09-10T22:44:27.583 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 89 2024-09-10T22:44:27.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.581+0000 7f3414600640 1 -- 172.21.15.103:0/3862604327 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33ec0725e0 msgr2=0x7f33ec074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:27.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.581+0000 7f3414600640 1 --2- 172.21.15.103:0/3862604327 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33ec0725e0 0x7f33ec074aa0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3400000f70 tx=0x7f3400009040 comp rx=0 tx=0).stop 2024-09-10T22:44:27.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.581+0000 7f3414600640 1 -- 172.21.15.103:0/3862604327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f340c15be30 msgr2=0x7f340c0ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:27.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.581+0000 7f3414600640 1 --2- 172.21.15.103:0/3862604327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f340c15be30 0x7f340c0ca040 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f3404009b10 tx=0x7f34040a58b0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.581+0000 7f3414600640 1 -- 172.21.15.103:0/3862604327 shutdown_connections 2024-09-10T22:44:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.581+0000 7f3414600640 1 --2- 172.21.15.103:0/3862604327 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f33ec0725e0 0x7f33ec074aa0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.581+0000 7f3414600640 1 --2- 172.21.15.103:0/3862604327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f340c15be30 0x7f340c0ca040 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.581+0000 7f3414600640 1 --2- 172.21.15.103:0/3862604327 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f340c0b09c0 0x7f340c155bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.581+0000 7f3414600640 1 --2- 172.21.15.103:0/3862604327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f340c0ae9c0 0x7f340c09b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.581+0000 7f3414600640 1 -- 172.21.15.103:0/3862604327 >> 172.21.15.103:0/3862604327 conn(0x7f340c0d1ac0 msgr2=0x7f340c070600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.581+0000 7f3414600640 1 -- 172.21.15.103:0/3862604327 shutdown_connections 2024-09-10T22:44:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.581+0000 7f3414600640 1 -- 172.21.15.103:0/3862604327 wait complete. 2024-09-10T22:44:27.604 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:44:27.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.741+0000 7f088be00640 1 -- 172.21.15.103:0/1831479738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08840cc120 msgr2=0x7f08840aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:27.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.741+0000 7f088be00640 1 --2- 172.21.15.103:0/1831479738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08840cc120 0x7f08840aeb40 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f08840d0870 tx=0x7f087801caf0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.741+0000 7f088be00640 1 -- 172.21.15.103:0/1831479738 shutdown_connections 2024-09-10T22:44:27.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.741+0000 7f088be00640 1 --2- 172.21.15.103:0/1831479738 >> v2:172.21.15.131:3300/0 conn(0x7f08840cf790 0x7f08840cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.741+0000 7f088be00640 1 --2- 172.21.15.103:0/1831479738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08840cc120 0x7f08840aeb40 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.741+0000 7f088be00640 1 -- 172.21.15.103:0/1831479738 >> 172.21.15.103:0/1831479738 conn(0x7f088406cc00 msgr2=0x7f088406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:27.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.741+0000 7f088be00640 1 -- 172.21.15.103:0/1831479738 shutdown_connections 2024-09-10T22:44:27.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.741+0000 7f088be00640 1 -- 172.21.15.103:0/1831479738 wait complete. 2024-09-10T22:44:27.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f088be00640 1 Processor -- start 2024-09-10T22:44:27.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f088be00640 1 -- start start 2024-09-10T22:44:27.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f088be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08840cc120 0x7f08841f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:27.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f088be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08840cf790 0x7f0884154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:27.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f088be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f088415c970 0x7f088415d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:27.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f088be00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0884168b40 con 0x7f088415c970 2024-09-10T22:44:27.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f088be00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f08841689c0 con 0x7f08840cc120 2024-09-10T22:44:27.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f088be00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0884168cc0 con 0x7f08840cf790 2024-09-10T22:44:27.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f0889e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f088415c970 0x7f088415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:27.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f0889e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f088415c970 0x7f088415d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47984/0 (socket says 172.21.15.103:47984) 2024-09-10T22:44:27.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f0889e00640 1 -- 172.21.15.103:0/2129301139 learned_addr learned my addr 172.21.15.103:0/2129301139 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:27.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f0889e00640 1 -- 172.21.15.103:0/2129301139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08840cf790 msgr2=0x7f0884154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:27.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f0889e00640 1 --2- 172.21.15.103:0/2129301139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08840cf790 0x7f0884154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f0889e00640 1 -- 172.21.15.103:0/2129301139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08840cc120 msgr2=0x7f08841f7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:27.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f0889e00640 1 --2- 172.21.15.103:0/2129301139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08840cc120 0x7f08841f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f0889e00640 1 -- 172.21.15.103:0/2129301139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08841600a0 con 0x7f088415c970 2024-09-10T22:44:27.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f0889e00640 1 --2- 172.21.15.103:0/2129301139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f088415c970 0x7f088415d090 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f087c00d750 tx=0x7f087c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:27.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f0881600640 1 -- 172.21.15.103:0/2129301139 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c017070 con 0x7f088415c970 2024-09-10T22:44:27.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f0881600640 1 -- 172.21.15.103:0/2129301139 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f087c009d20 con 0x7f088415c970 2024-09-10T22:44:27.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f0881600640 1 -- 172.21.15.103:0/2129301139 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c00de60 con 0x7f088415c970 2024-09-10T22:44:27.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f088be00640 1 -- 172.21.15.103:0/2129301139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08841f7b50 con 0x7f088415c970 2024-09-10T22:44:27.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f088be00640 1 -- 172.21.15.103:0/2129301139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08841f8110 con 0x7f088415c970 2024-09-10T22:44:27.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.745+0000 7f088be00640 1 -- 172.21.15.103:0/2129301139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08841f8350 con 0x7f088415c970 2024-09-10T22:44:27.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.749+0000 7f0881600640 1 -- 172.21.15.103:0/2129301139 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f087c005280 con 0x7f088415c970 2024-09-10T22:44:27.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.749+0000 7f0881600640 1 --2- 172.21.15.103:0/2129301139 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0864072640 0x7f0864074b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:27.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.749+0000 7f0881600640 1 -- 172.21.15.103:0/2129301139 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6101+0+0 (secure 0 0 0) 0x7f087c093580 con 0x7f088415c970 2024-09-10T22:44:27.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.749+0000 7f0889400640 1 --2- 172.21.15.103:0/2129301139 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0864072640 0x7f0864074b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:27.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.749+0000 7f0889400640 1 --2- 172.21.15.103:0/2129301139 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0864072640 0x7f0864074b00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f08780af000 tx=0x7f0878019890 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:27.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.753+0000 7f0881600640 1 -- 172.21.15.103:0/2129301139 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f08841f8350 con 0x7f088415c970 2024-09-10T22:44:27.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.917+0000 7f088be00640 1 -- 172.21.15.103:0/2129301139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08840b11e0 con 0x7f088415c970 2024-09-10T22:44:27.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.921+0000 7f0881600640 1 -- 172.21.15.103:0/2129301139 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+17005 (secure 0 0 0) 0x7f087c05ea30 con 0x7f088415c970 2024-09-10T22:44:27.924 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:27.924 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":92,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:44:25.189139+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:44:21.248484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-10T22:44:22.526092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:44:27.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.921+0000 7f088be00640 1 -- 172.21.15.103:0/2129301139 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0864072640 msgr2=0x7f0864074b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:27.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.921+0000 7f088be00640 1 --2- 172.21.15.103:0/2129301139 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0864072640 0x7f0864074b00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f08780af000 tx=0x7f0878019890 comp rx=0 tx=0).stop 2024-09-10T22:44:27.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.921+0000 7f088be00640 1 -- 172.21.15.103:0/2129301139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f088415c970 msgr2=0x7f088415d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:27.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.921+0000 7f088be00640 1 --2- 172.21.15.103:0/2129301139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f088415c970 0x7f088415d090 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f087c00d750 tx=0x7f087c00dc10 comp rx=0 tx=0).stop 2024-09-10T22:44:27.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.921+0000 7f088be00640 1 -- 172.21.15.103:0/2129301139 shutdown_connections 2024-09-10T22:44:27.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.921+0000 7f088be00640 1 --2- 172.21.15.103:0/2129301139 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0864072640 0x7f0864074b00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.921+0000 7f088be00640 1 --2- 172.21.15.103:0/2129301139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f088415c970 0x7f088415d090 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.921+0000 7f088be00640 1 --2- 172.21.15.103:0/2129301139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08840cf790 0x7f0884154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.921+0000 7f088be00640 1 --2- 172.21.15.103:0/2129301139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08840cc120 0x7f08841f7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:27.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.921+0000 7f088be00640 1 -- 172.21.15.103:0/2129301139 >> 172.21.15.103:0/2129301139 conn(0x7f088406cc00 msgr2=0x7f088415a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:27.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.921+0000 7f088be00640 1 -- 172.21.15.103:0/2129301139 shutdown_connections 2024-09-10T22:44:27.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:27.921+0000 7f088be00640 1 -- 172.21.15.103:0/2129301139 wait complete. 2024-09-10T22:44:27.946 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T22:44:27.946 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:44:28.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.081+0000 7f85fde00640 1 -- 172.21.15.103:0/1528123281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85f815f0e0 msgr2=0x7f85f80d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:28.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.081+0000 7f85fde00640 1 --2- 172.21.15.103:0/1528123281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85f815f0e0 0x7f85f80d1280 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009900 tx=0x7f85e801c850 comp rx=0 tx=0).stop 2024-09-10T22:44:28.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85fde00640 1 -- 172.21.15.103:0/1528123281 shutdown_connections 2024-09-10T22:44:28.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85fde00640 1 --2- 172.21.15.103:0/1528123281 >> v2:172.21.15.131:3300/0 conn(0x7f85f8070b40 0x7f85f80cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85fde00640 1 --2- 172.21.15.103:0/1528123281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85f815f0e0 0x7f85f80d1280 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85fde00640 1 -- 172.21.15.103:0/1528123281 >> 172.21.15.103:0/1528123281 conn(0x7f85f80d18d0 msgr2=0x7f85f80d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:28.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85fde00640 1 -- 172.21.15.103:0/1528123281 shutdown_connections 2024-09-10T22:44:28.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85fde00640 1 -- 172.21.15.103:0/1528123281 wait complete. 2024-09-10T22:44:28.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85fde00640 1 Processor -- start 2024-09-10T22:44:28.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85fde00640 1 -- start start 2024-09-10T22:44:28.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85fde00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85f8070b40 0x7f85f80b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:28.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85fde00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85f80d23f0 0x7f85f80b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:28.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85fde00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85f815f0e0 0x7f85f813d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:28.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85fde00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f85f8168a20 con 0x7f85f80d23f0 2024-09-10T22:44:28.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85fde00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f85f81688a0 con 0x7f85f8070b40 2024-09-10T22:44:28.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85fde00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f85f8168ba0 con 0x7f85f815f0e0 2024-09-10T22:44:28.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85efe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85f80d23f0 0x7f85f80b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:28.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85efe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85f80d23f0 0x7f85f80b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47992/0 (socket says 172.21.15.103:47992) 2024-09-10T22:44:28.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85efe00640 1 -- 172.21.15.103:0/1106516267 learned_addr learned my addr 172.21.15.103:0/1106516267 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:28.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85fca00640 1 --2- 172.21.15.103:0/1106516267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85f8070b40 0x7f85f80b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:28.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85fd400640 1 --2- 172.21.15.103:0/1106516267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85f815f0e0 0x7f85f813d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:28.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85efe00640 1 -- 172.21.15.103:0/1106516267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85f815f0e0 msgr2=0x7f85f813d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:28.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85efe00640 1 --2- 172.21.15.103:0/1106516267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85f815f0e0 0x7f85f813d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85efe00640 1 -- 172.21.15.103:0/1106516267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85f8070b40 msgr2=0x7f85f80b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:28.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85efe00640 1 --2- 172.21.15.103:0/1106516267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85f8070b40 0x7f85f80b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85efe00640 1 -- 172.21.15.103:0/1106516267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f815d720 con 0x7f85f80d23f0 2024-09-10T22:44:28.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85efe00640 1 --2- 172.21.15.103:0/1106516267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85f80d23f0 0x7f85f80b4720 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f85e000c500 tx=0x7f85e000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:28.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.085+0000 7f85f5600640 1 -- 172.21.15.103:0/1106516267 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e00052d0 con 0x7f85f80d23f0 2024-09-10T22:44:28.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.089+0000 7f85f5600640 1 -- 172.21.15.103:0/1106516267 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85e0005490 con 0x7f85f80d23f0 2024-09-10T22:44:28.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.089+0000 7f85fde00640 1 -- 172.21.15.103:0/1106516267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f81505c0 con 0x7f85f80d23f0 2024-09-10T22:44:28.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.089+0000 7f85f5600640 1 -- 172.21.15.103:0/1106516267 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0012870 con 0x7f85f80d23f0 2024-09-10T22:44:28.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.089+0000 7f85fde00640 1 -- 172.21.15.103:0/1106516267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f8150b80 con 0x7f85f80d23f0 2024-09-10T22:44:28.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.089+0000 7f85fde00640 1 -- 172.21.15.103:0/1106516267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f80cdc40 con 0x7f85f80d23f0 2024-09-10T22:44:28.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.089+0000 7f85f5600640 1 -- 172.21.15.103:0/1106516267 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f85e0012a50 con 0x7f85f80d23f0 2024-09-10T22:44:28.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.089+0000 7f85f5600640 1 --2- 172.21.15.103:0/1106516267 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f85d40725e0 0x7f85d4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:28.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.089+0000 7f85f5600640 1 -- 172.21.15.103:0/1106516267 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6101+0+0 (secure 0 0 0) 0x7f85e0092f20 con 0x7f85f80d23f0 2024-09-10T22:44:28.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.089+0000 7f85fca00640 1 --2- 172.21.15.103:0/1106516267 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f85d40725e0 0x7f85d4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:28.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.093+0000 7f85fca00640 1 --2- 172.21.15.103:0/1106516267 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f85d40725e0 0x7f85d4074aa0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f85e80af000 tx=0x7f85e801b090 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:28.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.093+0000 7f85f5600640 1 -- 172.21.15.103:0/1106516267 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f85e005ded0 con 0x7f85f80d23f0 2024-09-10T22:44:28.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.257+0000 7f85fde00640 1 -- 172.21.15.103:0/1106516267 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f85f8150370 con 0x7f85d40725e0 2024-09-10T22:44:28.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.265+0000 7f85f5600640 1 -- 172.21.15.103:0/1106516267 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247612 (secure 0 0 0) 0x7f85f8150370 con 0x7f85d40725e0 2024-09-10T22:44:28.271 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:28.272 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:44:28.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.269+0000 7f85fde00640 1 -- 172.21.15.103:0/1106516267 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f85d40725e0 msgr2=0x7f85d4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:28.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.269+0000 7f85fde00640 1 --2- 172.21.15.103:0/1106516267 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f85d40725e0 0x7f85d4074aa0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f85e80af000 tx=0x7f85e801b090 comp rx=0 tx=0).stop 2024-09-10T22:44:28.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.269+0000 7f85fde00640 1 -- 172.21.15.103:0/1106516267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85f80d23f0 msgr2=0x7f85f80b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:28.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.269+0000 7f85fde00640 1 --2- 172.21.15.103:0/1106516267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85f80d23f0 0x7f85f80b4720 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f85e000c500 tx=0x7f85e000c9c0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.269+0000 7f85fde00640 1 -- 172.21.15.103:0/1106516267 shutdown_connections 2024-09-10T22:44:28.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.269+0000 7f85fde00640 1 --2- 172.21.15.103:0/1106516267 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f85d40725e0 0x7f85d4074aa0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.269+0000 7f85fde00640 1 --2- 172.21.15.103:0/1106516267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85f815f0e0 0x7f85f813d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.269+0000 7f85fde00640 1 --2- 172.21.15.103:0/1106516267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85f80d23f0 0x7f85f80b4720 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.269+0000 7f85fde00640 1 --2- 172.21.15.103:0/1106516267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85f8070b40 0x7f85f80b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.269+0000 7f85fde00640 1 -- 172.21.15.103:0/1106516267 >> 172.21.15.103:0/1106516267 conn(0x7f85f80d18d0 msgr2=0x7f85f815da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:28.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.269+0000 7f85fde00640 1 -- 172.21.15.103:0/1106516267 shutdown_connections 2024-09-10T22:44:28.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.269+0000 7f85fde00640 1 -- 172.21.15.103:0/1106516267 wait complete. 2024-09-10T22:44:28.290 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2024-09-10T22:44:27.705623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259304,"kb_used_data":9772,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715416,"statfs":{"total":773094113280,"available":772828585984,"internally_reserved":0,"allocated":10006528,"data_stored":5228890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.541139"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.168772+0000","last_change":"2024-09-10T22:44:23.168772+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.168772+0000","last_undegraded":"2024-09-10T22:44:23.168772+0000","last_fullsized":"2024-09-10T22:44:23.168772+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.173894+0000","last_change":"2024-09-10T22:44:23.173894+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.173894+0000","last_undegraded":"2024-09-10T22:44:23.173894+0000","last_fullsized":"2024-09-10T22:44:23.173894+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.168798+0000","last_change":"2024-09-10T22:44:23.168798+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.168798+0000","last_undegraded":"2024-09-10T22:44:23.168798+0000","last_fullsized":"2024-09-10T22:44:23.168798+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198423+0000","last_change":"2024-09-10T22:44:24.194558+0000","last_active":"2024-09-10T22:44:25.198423+0000","last_peered":"2024-09-10T22:44:25.198423+0000","last_clean":"2024-09-10T22:44:25.198423+0000","last_became_active":"2024-09-10T22:44:24.194119+0000","last_became_peered":"2024-09-10T22:44:24.194119+0000","last_unstale":"2024-09-10T22:44:25.198423+0000","last_undegraded":"2024-09-10T22:44:25.198423+0000","last_fullsized":"2024-09-10T22:44:25.198423+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:04.688517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.169523+0000","last_change":"2024-09-10T22:44:23.169523+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.169523+0000","last_undegraded":"2024-09-10T22:44:23.169523+0000","last_fullsized":"2024-09-10T22:44:23.169523+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.180941+0000","last_change":"2024-09-10T22:44:23.180941+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.180941+0000","last_undegraded":"2024-09-10T22:44:23.180941+0000","last_fullsized":"2024-09-10T22:44:23.180941+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.177044+0000","last_change":"2024-09-10T22:44:23.177044+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.177044+0000","last_undegraded":"2024-09-10T22:44:23.177044+0000","last_fullsized":"2024-09-10T22:44:23.177044+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197490+0000","last_change":"2024-09-10T22:44:24.202919+0000","last_active":"2024-09-10T22:44:25.197490+0000","last_peered":"2024-09-10T22:44:25.197490+0000","last_clean":"2024-09-10T22:44:25.197490+0000","last_became_active":"2024-09-10T22:44:24.202633+0000","last_became_peered":"2024-09-10T22:44:24.202633+0000","last_unstale":"2024-09-10T22:44:25.197490+0000","last_undegraded":"2024-09-10T22:44:25.197490+0000","last_fullsized":"2024-09-10T22:44:25.197490+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:24.832375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.169870+0000","last_change":"2024-09-10T22:44:23.169870+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.169870+0000","last_undegraded":"2024-09-10T22:44:23.169870+0000","last_fullsized":"2024-09-10T22:44:23.169870+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.180090+0000","last_change":"2024-09-10T22:44:23.180090+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.180090+0000","last_undegraded":"2024-09-10T22:44:23.180090+0000","last_fullsized":"2024-09-10T22:44:23.180090+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.171297+0000","last_change":"2024-09-10T22:44:23.171297+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.171297+0000","last_undegraded":"2024-09-10T22:44:23.171297+0000","last_fullsized":"2024-09-10T22:44:23.171297+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.179040+0000","last_change":"2024-09-10T22:44:23.179040+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.179040+0000","last_undegraded":"2024-09-10T22:44:23.179040+0000","last_fullsized":"2024-09-10T22:44:23.179040+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198071+0000","last_change":"2024-09-10T22:44:24.203861+0000","last_active":"2024-09-10T22:44:25.198071+0000","last_peered":"2024-09-10T22:44:25.198071+0000","last_clean":"2024-09-10T22:44:25.198071+0000","last_became_active":"2024-09-10T22:44:24.203535+0000","last_became_peered":"2024-09-10T22:44:24.203535+0000","last_unstale":"2024-09-10T22:44:25.198071+0000","last_undegraded":"2024-09-10T22:44:25.198071+0000","last_fullsized":"2024-09-10T22:44:25.198071+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:22.211727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.171199+0000","last_change":"2024-09-10T22:44:23.171199+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.171199+0000","last_undegraded":"2024-09-10T22:44:23.171199+0000","last_fullsized":"2024-09-10T22:44:23.171199+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197749+0000","last_change":"2024-09-10T22:44:24.197228+0000","last_active":"2024-09-10T22:44:25.197749+0000","last_peered":"2024-09-10T22:44:25.197749+0000","last_clean":"2024-09-10T22:44:25.197749+0000","last_became_active":"2024-09-10T22:44:24.196964+0000","last_became_peered":"2024-09-10T22:44:24.196964+0000","last_unstale":"2024-09-10T22:44:25.197749+0000","last_undegraded":"2024-09-10T22:44:25.197749+0000","last_fullsized":"2024-09-10T22:44:25.197749+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:09.707330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.182766+0000","last_change":"2024-09-10T22:44:23.182766+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.182766+0000","last_undegraded":"2024-09-10T22:44:23.182766+0000","last_fullsized":"2024-09-10T22:44:23.182766+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.179559+0000","last_change":"2024-09-10T22:44:23.179559+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.179559+0000","last_undegraded":"2024-09-10T22:44:23.179559+0000","last_fullsized":"2024-09-10T22:44:23.179559+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.169080+0000","last_change":"2024-09-10T22:44:23.169080+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.169080+0000","last_undegraded":"2024-09-10T22:44:23.169080+0000","last_fullsized":"2024-09-10T22:44:23.169080+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.170752+0000","last_change":"2024-09-10T22:44:23.170752+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.170752+0000","last_undegraded":"2024-09-10T22:44:23.170752+0000","last_fullsized":"2024-09-10T22:44:23.170752+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198606+0000","last_change":"2024-09-10T22:44:24.198928+0000","last_active":"2024-09-10T22:44:25.198606+0000","last_peered":"2024-09-10T22:44:25.198606+0000","last_clean":"2024-09-10T22:44:25.198606+0000","last_became_active":"2024-09-10T22:44:24.198508+0000","last_became_peered":"2024-09-10T22:44:24.198508+0000","last_unstale":"2024-09-10T22:44:25.198606+0000","last_undegraded":"2024-09-10T22:44:25.198606+0000","last_fullsized":"2024-09-10T22:44:25.198606+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:09.617474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.171741+0000","last_change":"2024-09-10T22:44:23.171741+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.171741+0000","last_undegraded":"2024-09-10T22:44:23.171741+0000","last_fullsized":"2024-09-10T22:44:23.171741+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.170475+0000","last_change":"2024-09-10T22:44:23.170475+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.170475+0000","last_undegraded":"2024-09-10T22:44:23.170475+0000","last_fullsized":"2024-09-10T22:44:23.170475+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.180546+0000","last_change":"2024-09-10T22:44:23.180546+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.180546+0000","last_undegraded":"2024-09-10T22:44:23.180546+0000","last_fullsized":"2024-09-10T22:44:23.180546+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.168256+0000","last_change":"2024-09-10T22:44:23.168256+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.168256+0000","last_undegraded":"2024-09-10T22:44:23.168256+0000","last_fullsized":"2024-09-10T22:44:23.168256+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.173683+0000","last_change":"2024-09-10T22:44:23.173683+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.173683+0000","last_undegraded":"2024-09-10T22:44:23.173683+0000","last_fullsized":"2024-09-10T22:44:23.173683+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.171614+0000","last_change":"2024-09-10T22:44:23.171614+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.171614+0000","last_undegraded":"2024-09-10T22:44:23.171614+0000","last_fullsized":"2024-09-10T22:44:23.171614+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.179586+0000","last_change":"2024-09-10T22:44:23.179586+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.179586+0000","last_undegraded":"2024-09-10T22:44:23.179586+0000","last_fullsized":"2024-09-10T22:44:23.179586+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198801+0000","last_change":"2024-09-10T22:44:24.208790+0000","last_active":"2024-09-10T22:44:25.198801+0000","last_peered":"2024-09-10T22:44:25.198801+0000","last_clean":"2024-09-10T22:44:25.198801+0000","last_became_active":"2024-09-10T22:44:24.208540+0000","last_became_peered":"2024-09-10T22:44:24.208540+0000","last_unstale":"2024-09-10T22:44:25.198801+0000","last_undegraded":"2024-09-10T22:44:25.198801+0000","last_fullsized":"2024-09-10T22:44:25.198801+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:50.921887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.176432+0000","last_change":"2024-09-10T22:44:23.176432+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.176432+0000","last_undegraded":"2024-09-10T22:44:23.176432+0000","last_fullsized":"2024-09-10T22:44:23.176432+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.169167+0000","last_change":"2024-09-10T22:44:23.169167+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.169167+0000","last_undegraded":"2024-09-10T22:44:23.169167+0000","last_fullsized":"2024-09-10T22:44:23.169167+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.176425+0000","last_change":"2024-09-10T22:44:23.176425+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.176425+0000","last_undegraded":"2024-09-10T22:44:23.176425+0000","last_fullsized":"2024-09-10T22:44:23.176425+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.179565+0000","last_change":"2024-09-10T22:44:23.179565+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.179565+0000","last_undegraded":"2024-09-10T22:44:23.179565+0000","last_fullsized":"2024-09-10T22:44:23.179565+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.179050+0000","last_change":"2024-09-10T22:44:23.179050+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.179050+0000","last_undegraded":"2024-09-10T22:44:23.179050+0000","last_fullsized":"2024-09-10T22:44:23.179050+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.195915+0000","last_change":"2024-09-10T22:44:23.194098+0000","last_active":"2024-09-10T22:44:23.195915+0000","last_peered":"2024-09-10T22:44:23.195915+0000","last_clean":"2024-09-10T22:44:23.195915+0000","last_became_active":"2024-09-10T22:44:23.193814+0000","last_became_peered":"2024-09-10T22:44:23.193814+0000","last_unstale":"2024-09-10T22:44:23.195915+0000","last_undegraded":"2024-09-10T22:44:23.195915+0000","last_fullsized":"2024-09-10T22:44:23.195915+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:07.866030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.178351+0000","last_change":"2024-09-10T22:44:23.178351+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.178351+0000","last_undegraded":"2024-09-10T22:44:23.178351+0000","last_fullsized":"2024-09-10T22:44:23.178351+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.189946+0000","last_change":"2024-09-10T22:44:23.186842+0000","last_active":"2024-09-10T22:44:23.189946+0000","last_peered":"2024-09-10T22:44:23.189946+0000","last_clean":"2024-09-10T22:44:23.189946+0000","last_became_active":"2024-09-10T22:44:23.186437+0000","last_became_peered":"2024-09-10T22:44:23.186437+0000","last_unstale":"2024-09-10T22:44:23.189946+0000","last_undegraded":"2024-09-10T22:44:23.189946+0000","last_fullsized":"2024-09-10T22:44:23.189946+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:08.665780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.177699+0000","last_change":"2024-09-10T22:44:23.177699+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.177699+0000","last_undegraded":"2024-09-10T22:44:23.177699+0000","last_fullsized":"2024-09-10T22:44:23.177699+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.193050+0000","last_change":"2024-09-10T22:44:23.188760+0000","last_active":"2024-09-10T22:44:23.193050+0000","last_peered":"2024-09-10T22:44:23.193050+0000","last_clean":"2024-09-10T22:44:23.193050+0000","last_became_active":"2024-09-10T22:44:23.188504+0000","last_became_peered":"2024-09-10T22:44:23.188504+0000","last_unstale":"2024-09-10T22:44:23.193050+0000","last_undegraded":"2024-09-10T22:44:23.193050+0000","last_fullsized":"2024-09-10T22:44:23.193050+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:53.656054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.178054+0000","last_change":"2024-09-10T22:44:23.178054+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.178054+0000","last_undegraded":"2024-09-10T22:44:23.178054+0000","last_fullsized":"2024-09-10T22:44:23.178054+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.198411+0000","last_change":"2024-09-10T22:44:23.197426+0000","last_active":"2024-09-10T22:44:23.198411+0000","last_peered":"2024-09-10T22:44:23.198411+0000","last_clean":"2024-09-10T22:44:23.198411+0000","last_became_active":"2024-09-10T22:44:23.197108+0000","last_became_peered":"2024-09-10T22:44:23.197108+0000","last_unstale":"2024-09-10T22:44:23.198411+0000","last_undegraded":"2024-09-10T22:44:23.198411+0000","last_fullsized":"2024-09-10T22:44:23.198411+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:39.429544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197557+0000","last_change":"2024-09-10T22:44:24.202442+0000","last_active":"2024-09-10T22:44:25.197557+0000","last_peered":"2024-09-10T22:44:25.197557+0000","last_clean":"2024-09-10T22:44:25.197557+0000","last_became_active":"2024-09-10T22:44:24.197691+0000","last_became_peered":"2024-09-10T22:44:24.197691+0000","last_unstale":"2024-09-10T22:44:25.197557+0000","last_undegraded":"2024-09-10T22:44:25.197557+0000","last_fullsized":"2024-09-10T22:44:25.197557+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:43.068682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.190378+0000","last_change":"2024-09-10T22:44:23.188330+0000","last_active":"2024-09-10T22:44:23.190378+0000","last_peered":"2024-09-10T22:44:23.190378+0000","last_clean":"2024-09-10T22:44:23.190378+0000","last_became_active":"2024-09-10T22:44:23.188074+0000","last_became_peered":"2024-09-10T22:44:23.188074+0000","last_unstale":"2024-09-10T22:44:23.190378+0000","last_undegraded":"2024-09-10T22:44:23.190378+0000","last_fullsized":"2024-09-10T22:44:23.190378+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:53.660937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.177551+0000","last_change":"2024-09-10T22:44:23.177551+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.177551+0000","last_undegraded":"2024-09-10T22:44:23.177551+0000","last_fullsized":"2024-09-10T22:44:23.177551+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198372+0000","last_change":"2024-09-10T22:44:23.195943+0000","last_active":"2024-09-10T22:44:25.198372+0000","last_peered":"2024-09-10T22:44:25.198372+0000","last_clean":"2024-09-10T22:44:25.198372+0000","last_became_active":"2024-09-10T22:44:23.195678+0000","last_became_peered":"2024-09-10T22:44:23.195678+0000","last_unstale":"2024-09-10T22:44:25.198372+0000","last_undegraded":"2024-09-10T22:44:25.198372+0000","last_fullsized":"2024-09-10T22:44:25.198372+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:30.932095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.177301+0000","last_change":"2024-09-10T22:44:23.177301+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.177301+0000","last_undegraded":"2024-09-10T22:44:23.177301+0000","last_fullsized":"2024-09-10T22:44:23.177301+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.192541+0000","last_change":"2024-09-10T22:44:23.184732+0000","last_active":"2024-09-10T22:44:23.192541+0000","last_peered":"2024-09-10T22:44:23.192541+0000","last_clean":"2024-09-10T22:44:23.192541+0000","last_became_active":"2024-09-10T22:44:23.184397+0000","last_became_peered":"2024-09-10T22:44:23.184397+0000","last_unstale":"2024-09-10T22:44:23.192541+0000","last_undegraded":"2024-09-10T22:44:23.192541+0000","last_fullsized":"2024-09-10T22:44:23.192541+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:19:14.203129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199476+0000","last_change":"2024-09-10T22:44:24.202421+0000","last_active":"2024-09-10T22:44:25.199476+0000","last_peered":"2024-09-10T22:44:25.199476+0000","last_clean":"2024-09-10T22:44:25.199476+0000","last_became_active":"2024-09-10T22:44:24.202090+0000","last_became_peered":"2024-09-10T22:44:24.202090+0000","last_unstale":"2024-09-10T22:44:25.199476+0000","last_undegraded":"2024-09-10T22:44:25.199476+0000","last_fullsized":"2024-09-10T22:44:25.199476+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:34.501203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.194769+0000","last_change":"2024-09-10T22:44:23.193342+0000","last_active":"2024-09-10T22:44:23.194769+0000","last_peered":"2024-09-10T22:44:23.194769+0000","last_clean":"2024-09-10T22:44:23.194769+0000","last_became_active":"2024-09-10T22:44:23.193097+0000","last_became_peered":"2024-09-10T22:44:23.193097+0000","last_unstale":"2024-09-10T22:44:23.194769+0000","last_undegraded":"2024-09-10T22:44:23.194769+0000","last_fullsized":"2024-09-10T22:44:23.194769+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:59.916869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.169206+0000","last_change":"2024-09-10T22:44:23.169206+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.169206+0000","last_undegraded":"2024-09-10T22:44:23.169206+0000","last_fullsized":"2024-09-10T22:44:23.169206+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.190530+0000","last_change":"2024-09-10T22:44:23.188266+0000","last_active":"2024-09-10T22:44:23.190530+0000","last_peered":"2024-09-10T22:44:23.190530+0000","last_clean":"2024-09-10T22:44:23.190530+0000","last_became_active":"2024-09-10T22:44:23.187992+0000","last_became_peered":"2024-09-10T22:44:23.187992+0000","last_unstale":"2024-09-10T22:44:23.190530+0000","last_undegraded":"2024-09-10T22:44:23.190530+0000","last_fullsized":"2024-09-10T22:44:23.190530+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:06.476793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.176730+0000","last_change":"2024-09-10T22:44:23.176730+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.176730+0000","last_undegraded":"2024-09-10T22:44:23.176730+0000","last_fullsized":"2024-09-10T22:44:23.176730+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.190455+0000","last_change":"2024-09-10T22:44:23.185327+0000","last_active":"2024-09-10T22:44:23.190455+0000","last_peered":"2024-09-10T22:44:23.190455+0000","last_clean":"2024-09-10T22:44:23.190455+0000","last_became_active":"2024-09-10T22:44:23.185040+0000","last_became_peered":"2024-09-10T22:44:23.185040+0000","last_unstale":"2024-09-10T22:44:23.190455+0000","last_undegraded":"2024-09-10T22:44:23.190455+0000","last_fullsized":"2024-09-10T22:44:23.190455+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:32.513332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.168364+0000","last_change":"2024-09-10T22:44:23.168364+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.168364+0000","last_undegraded":"2024-09-10T22:44:23.168364+0000","last_fullsized":"2024-09-10T22:44:23.168364+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.186155+0000","last_change":"2024-09-10T22:44:23.184019+0000","last_active":"2024-09-10T22:44:23.186155+0000","last_peered":"2024-09-10T22:44:23.186155+0000","last_clean":"2024-09-10T22:44:23.186155+0000","last_became_active":"2024-09-10T22:44:23.183735+0000","last_became_peered":"2024-09-10T22:44:23.183735+0000","last_unstale":"2024-09-10T22:44:23.186155+0000","last_undegraded":"2024-09-10T22:44:23.186155+0000","last_fullsized":"2024-09-10T22:44:23.186155+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:05.572031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198775+0000","last_change":"2024-09-10T22:44:24.197746+0000","last_active":"2024-09-10T22:44:25.198775+0000","last_peered":"2024-09-10T22:44:25.198775+0000","last_clean":"2024-09-10T22:44:25.198775+0000","last_became_active":"2024-09-10T22:44:24.197467+0000","last_became_peered":"2024-09-10T22:44:24.197467+0000","last_unstale":"2024-09-10T22:44:25.198775+0000","last_undegraded":"2024-09-10T22:44:25.198775+0000","last_fullsized":"2024-09-10T22:44:25.198775+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:21.613577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.191864+0000","last_change":"2024-09-10T22:44:23.188843+0000","last_active":"2024-09-10T22:44:23.191864+0000","last_peered":"2024-09-10T22:44:23.191864+0000","last_clean":"2024-09-10T22:44:23.191864+0000","last_became_active":"2024-09-10T22:44:23.188570+0000","last_became_peered":"2024-09-10T22:44:23.188570+0000","last_unstale":"2024-09-10T22:44:23.191864+0000","last_undegraded":"2024-09-10T22:44:23.191864+0000","last_fullsized":"2024-09-10T22:44:23.191864+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:10.992205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197666+0000","last_change":"2024-09-10T22:44:24.201026+0000","last_active":"2024-09-10T22:44:25.197666+0000","last_peered":"2024-09-10T22:44:25.197666+0000","last_clean":"2024-09-10T22:44:25.197666+0000","last_became_active":"2024-09-10T22:44:24.197325+0000","last_became_peered":"2024-09-10T22:44:24.197325+0000","last_unstale":"2024-09-10T22:44:25.197666+0000","last_undegraded":"2024-09-10T22:44:25.197666+0000","last_fullsized":"2024-09-10T22:44:25.197666+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:48.952777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.195632+0000","last_change":"2024-09-10T22:44:23.193543+0000","last_active":"2024-09-10T22:44:23.195632+0000","last_peered":"2024-09-10T22:44:23.195632+0000","last_clean":"2024-09-10T22:44:23.195632+0000","last_became_active":"2024-09-10T22:44:23.193253+0000","last_became_peered":"2024-09-10T22:44:23.193253+0000","last_unstale":"2024-09-10T22:44:23.195632+0000","last_undegraded":"2024-09-10T22:44:23.195632+0000","last_fullsized":"2024-09-10T22:44:23.195632+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:49.790547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.169953+0000","last_change":"2024-09-10T22:44:23.169953+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.169953+0000","last_undegraded":"2024-09-10T22:44:23.169953+0000","last_fullsized":"2024-09-10T22:44:23.169953+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.186939+0000","last_change":"2024-09-10T22:44:23.179309+0000","last_active":"2024-09-10T22:44:23.186939+0000","last_peered":"2024-09-10T22:44:23.186939+0000","last_clean":"2024-09-10T22:44:23.186939+0000","last_became_active":"2024-09-10T22:44:23.177131+0000","last_became_peered":"2024-09-10T22:44:23.177131+0000","last_unstale":"2024-09-10T22:44:23.186939+0000","last_undegraded":"2024-09-10T22:44:23.186939+0000","last_fullsized":"2024-09-10T22:44:23.186939+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:24.201009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.175931+0000","last_change":"2024-09-10T22:44:23.175931+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.175931+0000","last_undegraded":"2024-09-10T22:44:23.175931+0000","last_fullsized":"2024-09-10T22:44:23.175931+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197761+0000","last_change":"2024-09-10T22:44:23.195006+0000","last_active":"2024-09-10T22:44:25.197761+0000","last_peered":"2024-09-10T22:44:25.197761+0000","last_clean":"2024-09-10T22:44:25.197761+0000","last_became_active":"2024-09-10T22:44:23.194737+0000","last_became_peered":"2024-09-10T22:44:23.194737+0000","last_unstale":"2024-09-10T22:44:25.197761+0000","last_undegraded":"2024-09-10T22:44:25.197761+0000","last_fullsized":"2024-09-10T22:44:25.197761+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:50.822823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.177660+0000","last_change":"2024-09-10T22:44:23.177660+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.177660+0000","last_undegraded":"2024-09-10T22:44:23.177660+0000","last_fullsized":"2024-09-10T22:44:23.177660+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"91'8","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197737+0000","last_change":"2024-09-10T22:44:23.195915+0000","last_active":"2024-09-10T22:44:25.197737+0000","last_peered":"2024-09-10T22:44:25.197737+0000","last_clean":"2024-09-10T22:44:25.197737+0000","last_became_active":"2024-09-10T22:44:23.195654+0000","last_became_peered":"2024-09-10T22:44:23.195654+0000","last_unstale":"2024-09-10T22:44:25.197737+0000","last_undegraded":"2024-09-10T22:44:25.197737+0000","last_fullsized":"2024-09-10T22:44:25.197737+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:01.303549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.176647+0000","last_change":"2024-09-10T22:44:23.176647+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.176647+0000","last_undegraded":"2024-09-10T22:44:23.176647+0000","last_fullsized":"2024-09-10T22:44:23.176647+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.191634+0000","last_change":"2024-09-10T22:44:23.189443+0000","last_active":"2024-09-10T22:44:23.191634+0000","last_peered":"2024-09-10T22:44:23.191634+0000","last_clean":"2024-09-10T22:44:23.191634+0000","last_became_active":"2024-09-10T22:44:23.188194+0000","last_became_peered":"2024-09-10T22:44:23.188194+0000","last_unstale":"2024-09-10T22:44:23.191634+0000","last_undegraded":"2024-09-10T22:44:23.191634+0000","last_fullsized":"2024-09-10T22:44:23.191634+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:56.779138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.178111+0000","last_change":"2024-09-10T22:44:23.178111+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.178111+0000","last_undegraded":"2024-09-10T22:44:23.178111+0000","last_fullsized":"2024-09-10T22:44:23.178111+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.192463+0000","last_change":"2024-09-10T22:44:23.187756+0000","last_active":"2024-09-10T22:44:23.192463+0000","last_peered":"2024-09-10T22:44:23.192463+0000","last_clean":"2024-09-10T22:44:23.192463+0000","last_became_active":"2024-09-10T22:44:23.187474+0000","last_became_peered":"2024-09-10T22:44:23.187474+0000","last_unstale":"2024-09-10T22:44:23.192463+0000","last_undegraded":"2024-09-10T22:44:23.192463+0000","last_fullsized":"2024-09-10T22:44:23.192463+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:53:19.805095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.171023+0000","last_change":"2024-09-10T22:44:23.171023+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.171023+0000","last_undegraded":"2024-09-10T22:44:23.171023+0000","last_fullsized":"2024-09-10T22:44:23.171023+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.193417+0000","last_change":"2024-09-10T22:44:23.192579+0000","last_active":"2024-09-10T22:44:23.193417+0000","last_peered":"2024-09-10T22:44:23.193417+0000","last_clean":"2024-09-10T22:44:23.193417+0000","last_became_active":"2024-09-10T22:44:23.191640+0000","last_became_peered":"2024-09-10T22:44:23.191640+0000","last_unstale":"2024-09-10T22:44:23.193417+0000","last_undegraded":"2024-09-10T22:44:23.193417+0000","last_fullsized":"2024-09-10T22:44:23.193417+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:44.121930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.175572+0000","last_change":"2024-09-10T22:44:23.175572+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.175572+0000","last_undegraded":"2024-09-10T22:44:23.175572+0000","last_fullsized":"2024-09-10T22:44:23.175572+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.184370+0000","last_change":"2024-09-10T22:44:23.180037+0000","last_active":"2024-09-10T22:44:23.184370+0000","last_peered":"2024-09-10T22:44:23.184370+0000","last_clean":"2024-09-10T22:44:23.184370+0000","last_became_active":"2024-09-10T22:44:23.179760+0000","last_became_peered":"2024-09-10T22:44:23.179760+0000","last_unstale":"2024-09-10T22:44:23.184370+0000","last_undegraded":"2024-09-10T22:44:23.184370+0000","last_fullsized":"2024-09-10T22:44:23.184370+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:50.593281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.172730+0000","last_change":"2024-09-10T22:44:23.172730+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.172730+0000","last_undegraded":"2024-09-10T22:44:23.172730+0000","last_fullsized":"2024-09-10T22:44:23.172730+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.199910+0000","last_change":"2024-09-10T22:44:23.196730+0000","last_active":"2024-09-10T22:44:23.199910+0000","last_peered":"2024-09-10T22:44:23.199910+0000","last_clean":"2024-09-10T22:44:23.199910+0000","last_became_active":"2024-09-10T22:44:23.195841+0000","last_became_peered":"2024-09-10T22:44:23.195841+0000","last_unstale":"2024-09-10T22:44:23.199910+0000","last_undegraded":"2024-09-10T22:44:23.199910+0000","last_fullsized":"2024-09-10T22:44:23.199910+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:58.089373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.172639+0000","last_change":"2024-09-10T22:44:23.172639+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.172639+0000","last_undegraded":"2024-09-10T22:44:23.172639+0000","last_fullsized":"2024-09-10T22:44:23.172639+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.185264+0000","last_change":"2024-09-10T22:44:23.182444+0000","last_active":"2024-09-10T22:44:23.185264+0000","last_peered":"2024-09-10T22:44:23.185264+0000","last_clean":"2024-09-10T22:44:23.185264+0000","last_became_active":"2024-09-10T22:44:23.182160+0000","last_became_peered":"2024-09-10T22:44:23.182160+0000","last_unstale":"2024-09-10T22:44:23.185264+0000","last_undegraded":"2024-09-10T22:44:23.185264+0000","last_fullsized":"2024-09-10T22:44:23.185264+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:42.122855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.176156+0000","last_change":"2024-09-10T22:44:23.176156+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.176156+0000","last_undegraded":"2024-09-10T22:44:23.176156+0000","last_fullsized":"2024-09-10T22:44:23.176156+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.195217+0000","last_change":"2024-09-10T22:44:23.190506+0000","last_active":"2024-09-10T22:44:23.195217+0000","last_peered":"2024-09-10T22:44:23.195217+0000","last_clean":"2024-09-10T22:44:23.195217+0000","last_became_active":"2024-09-10T22:44:23.187895+0000","last_became_peered":"2024-09-10T22:44:23.187895+0000","last_unstale":"2024-09-10T22:44:23.195217+0000","last_undegraded":"2024-09-10T22:44:23.195217+0000","last_fullsized":"2024-09-10T22:44:23.195217+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:12.293801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.179941+0000","last_change":"2024-09-10T22:44:23.179941+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.179941+0000","last_undegraded":"2024-09-10T22:44:23.179941+0000","last_fullsized":"2024-09-10T22:44:23.179941+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.194102+0000","last_change":"2024-09-10T22:44:23.190502+0000","last_active":"2024-09-10T22:44:23.194102+0000","last_peered":"2024-09-10T22:44:23.194102+0000","last_clean":"2024-09-10T22:44:23.194102+0000","last_became_active":"2024-09-10T22:44:23.190243+0000","last_became_peered":"2024-09-10T22:44:23.190243+0000","last_unstale":"2024-09-10T22:44:23.194102+0000","last_undegraded":"2024-09-10T22:44:23.194102+0000","last_fullsized":"2024-09-10T22:44:23.194102+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:38.009879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.175160+0000","last_change":"2024-09-10T22:44:23.175160+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.175160+0000","last_undegraded":"2024-09-10T22:44:23.175160+0000","last_fullsized":"2024-09-10T22:44:23.175160+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.181636+0000","last_change":"2024-09-10T22:44:23.177566+0000","last_active":"2024-09-10T22:44:23.181636+0000","last_peered":"2024-09-10T22:44:23.181636+0000","last_clean":"2024-09-10T22:44:23.181636+0000","last_became_active":"2024-09-10T22:44:23.177258+0000","last_became_peered":"2024-09-10T22:44:23.177258+0000","last_unstale":"2024-09-10T22:44:23.181636+0000","last_undegraded":"2024-09-10T22:44:23.181636+0000","last_fullsized":"2024-09-10T22:44:23.181636+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:47.275849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.174732+0000","last_change":"2024-09-10T22:44:23.174732+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.174732+0000","last_undegraded":"2024-09-10T22:44:23.174732+0000","last_fullsized":"2024-09-10T22:44:23.174732+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.184213+0000","last_change":"2024-09-10T22:44:23.181449+0000","last_active":"2024-09-10T22:44:23.184213+0000","last_peered":"2024-09-10T22:44:23.184213+0000","last_clean":"2024-09-10T22:44:23.184213+0000","last_became_active":"2024-09-10T22:44:23.181079+0000","last_became_peered":"2024-09-10T22:44:23.181079+0000","last_unstale":"2024-09-10T22:44:23.184213+0000","last_undegraded":"2024-09-10T22:44:23.184213+0000","last_fullsized":"2024-09-10T22:44:23.184213+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:47.138408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.173227+0000","last_change":"2024-09-10T22:44:23.173227+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.173227+0000","last_undegraded":"2024-09-10T22:44:23.173227+0000","last_fullsized":"2024-09-10T22:44:23.173227+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.194760+0000","last_change":"2024-09-10T22:44:23.191673+0000","last_active":"2024-09-10T22:44:23.194760+0000","last_peered":"2024-09-10T22:44:23.194760+0000","last_clean":"2024-09-10T22:44:23.194760+0000","last_became_active":"2024-09-10T22:44:23.191370+0000","last_became_peered":"2024-09-10T22:44:23.191370+0000","last_unstale":"2024-09-10T22:44:23.194760+0000","last_undegraded":"2024-09-10T22:44:23.194760+0000","last_fullsized":"2024-09-10T22:44:23.194760+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:40.051769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.175487+0000","last_change":"2024-09-10T22:44:23.175487+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.175487+0000","last_undegraded":"2024-09-10T22:44:23.175487+0000","last_fullsized":"2024-09-10T22:44:23.175487+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.188178+0000","last_change":"2024-09-10T22:44:23.181424+0000","last_active":"2024-09-10T22:44:23.188178+0000","last_peered":"2024-09-10T22:44:23.188178+0000","last_clean":"2024-09-10T22:44:23.188178+0000","last_became_active":"2024-09-10T22:44:23.179930+0000","last_became_peered":"2024-09-10T22:44:23.179930+0000","last_unstale":"2024-09-10T22:44:23.188178+0000","last_undegraded":"2024-09-10T22:44:23.188178+0000","last_fullsized":"2024-09-10T22:44:23.188178+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:05.430072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.168325+0000","last_change":"2024-09-10T22:44:23.168325+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.168325+0000","last_undegraded":"2024-09-10T22:44:23.168325+0000","last_fullsized":"2024-09-10T22:44:23.168325+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.184482+0000","last_change":"2024-09-10T22:44:23.180560+0000","last_active":"2024-09-10T22:44:23.184482+0000","last_peered":"2024-09-10T22:44:23.184482+0000","last_clean":"2024-09-10T22:44:23.184482+0000","last_became_active":"2024-09-10T22:44:23.180274+0000","last_became_peered":"2024-09-10T22:44:23.180274+0000","last_unstale":"2024-09-10T22:44:23.184482+0000","last_undegraded":"2024-09-10T22:44:23.184482+0000","last_fullsized":"2024-09-10T22:44:23.184482+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:46.530536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.180431+0000","last_change":"2024-09-10T22:44:23.180431+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.180431+0000","last_undegraded":"2024-09-10T22:44:23.180431+0000","last_fullsized":"2024-09-10T22:44:23.180431+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.194334+0000","last_change":"2024-09-10T22:44:23.188939+0000","last_active":"2024-09-10T22:44:23.194334+0000","last_peered":"2024-09-10T22:44:23.194334+0000","last_clean":"2024-09-10T22:44:23.194334+0000","last_became_active":"2024-09-10T22:44:23.188521+0000","last_became_peered":"2024-09-10T22:44:23.188521+0000","last_unstale":"2024-09-10T22:44:23.194334+0000","last_undegraded":"2024-09-10T22:44:23.194334+0000","last_fullsized":"2024-09-10T22:44:23.194334+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:09.115754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.174630+0000","last_change":"2024-09-10T22:44:23.174630+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.174630+0000","last_undegraded":"2024-09-10T22:44:23.174630+0000","last_fullsized":"2024-09-10T22:44:23.174630+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.194708+0000","last_change":"2024-09-10T22:44:23.192580+0000","last_active":"2024-09-10T22:44:23.194708+0000","last_peered":"2024-09-10T22:44:23.194708+0000","last_clean":"2024-09-10T22:44:23.194708+0000","last_became_active":"2024-09-10T22:44:23.192249+0000","last_became_peered":"2024-09-10T22:44:23.192249+0000","last_unstale":"2024-09-10T22:44:23.194708+0000","last_undegraded":"2024-09-10T22:44:23.194708+0000","last_fullsized":"2024-09-10T22:44:23.194708+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:57.776232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.177315+0000","last_change":"2024-09-10T22:44:23.177315+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.177315+0000","last_undegraded":"2024-09-10T22:44:23.177315+0000","last_fullsized":"2024-09-10T22:44:23.177315+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198891+0000","last_change":"2024-09-10T22:44:23.194384+0000","last_active":"2024-09-10T22:44:25.198891+0000","last_peered":"2024-09-10T22:44:25.198891+0000","last_clean":"2024-09-10T22:44:25.198891+0000","last_became_active":"2024-09-10T22:44:23.194107+0000","last_became_peered":"2024-09-10T22:44:23.194107+0000","last_unstale":"2024-09-10T22:44:25.198891+0000","last_undegraded":"2024-09-10T22:44:25.198891+0000","last_fullsized":"2024-09-10T22:44:25.198891+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:56.664956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":238,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.179423+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:44:23.179423+0000","last_peered":"2024-09-10T22:44:23.179423+0000","last_clean":"2024-09-10T22:44:23.179423+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:44:23.179423+0000","last_undegraded":"2024-09-10T22:44:23.179423+0000","last_fullsized":"2024-09-10T22:44:23.179423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509512,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32848,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338992,"statfs":{"total":96636764160,"available":96603127808,"internally_reserved":0,"allocated":1695744,"data_stored":1096316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509512,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1089536,"data_stored":499281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509513,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1101824,"data_stored":505948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509512,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1101824,"data_stored":505948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509512,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1101824,"data_stored":505948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509512,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1101824,"data_stored":505948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509512,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32852,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338988,"statfs":{"total":96636764160,"available":96603123712,"internally_reserved":0,"allocated":1695744,"data_stored":1096316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1118208,"data_stored":513185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:44:28.295 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:44:28.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.473+0000 7f90a9400640 1 -- 172.21.15.103:0/1053528560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90a40ccaa0 msgr2=0x7f90a40ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:28.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.473+0000 7f90a9400640 1 --2- 172.21.15.103:0/1053528560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90a40ccaa0 0x7f90a40ccf30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f909c009bc0 tx=0x7f909c01d570 comp rx=0 tx=0).stop 2024-09-10T22:44:28.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.473+0000 7f90a9400640 1 -- 172.21.15.103:0/1053528560 shutdown_connections 2024-09-10T22:44:28.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.473+0000 7f90a9400640 1 --2- 172.21.15.103:0/1053528560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90a40ccaa0 0x7f90a40ccf30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.473+0000 7f90a9400640 1 --2- 172.21.15.103:0/1053528560 >> v2:172.21.15.131:3300/0 conn(0x7f90a40b2840 0x7f90a40d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.473+0000 7f90a9400640 1 -- 172.21.15.103:0/1053528560 >> 172.21.15.103:0/1053528560 conn(0x7f90a40d1ab0 msgr2=0x7f90a40d1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:28.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.473+0000 7f90a9400640 1 -- 172.21.15.103:0/1053528560 shutdown_connections 2024-09-10T22:44:28.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.473+0000 7f90a9400640 1 -- 172.21.15.103:0/1053528560 wait complete. 2024-09-10T22:44:28.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.473+0000 7f90a9400640 1 Processor -- start 2024-09-10T22:44:28.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.473+0000 7f90a9400640 1 -- start start 2024-09-10T22:44:28.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a9400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a40b2840 0x7f90a40b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:28.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a9400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90a40ccaa0 0x7f90a40b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:28.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a9400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90a415f330 0x7f90a4071700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:28.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a9400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f90a4168da0 con 0x7f90a40b2840 2024-09-10T22:44:28.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a9400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f90a4168c20 con 0x7f90a415f330 2024-09-10T22:44:28.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a9400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f90a4168f20 con 0x7f90a40ccaa0 2024-09-10T22:44:28.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a40b2840 0x7f90a40b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:28.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a40b2840 0x7f90a40b5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48002/0 (socket says 172.21.15.103:48002) 2024-09-10T22:44:28.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a2800640 1 -- 172.21.15.103:0/1045475494 learned_addr learned my addr 172.21.15.103:0/1045475494 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:28.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a1e00640 1 --2- 172.21.15.103:0/1045475494 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90a40ccaa0 0x7f90a40b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:28.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a3200640 1 --2- 172.21.15.103:0/1045475494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90a415f330 0x7f90a4071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:28.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a2800640 1 -- 172.21.15.103:0/1045475494 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90a40ccaa0 msgr2=0x7f90a40b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:28.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a2800640 1 --2- 172.21.15.103:0/1045475494 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90a40ccaa0 0x7f90a40b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a2800640 1 -- 172.21.15.103:0/1045475494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90a415f330 msgr2=0x7f90a4071700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:28.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a2800640 1 --2- 172.21.15.103:0/1045475494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90a415f330 0x7f90a4071700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a2800640 1 -- 172.21.15.103:0/1045475494 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a40b6210 con 0x7f90a40b2840 2024-09-10T22:44:28.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a2800640 1 --2- 172.21.15.103:0/1045475494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a40b2840 0x7f90a40b5640 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f909400c430 tx=0x7f909400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:28.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f909aa00640 1 -- 172.21.15.103:0/1045475494 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9094011790 con 0x7f90a40b2840 2024-09-10T22:44:28.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f909aa00640 1 -- 172.21.15.103:0/1045475494 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9094017070 con 0x7f90a40b2840 2024-09-10T22:44:28.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a9400640 1 -- 172.21.15.103:0/1045475494 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a40b64f0 con 0x7f90a40b2840 2024-09-10T22:44:28.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f909aa00640 1 -- 172.21.15.103:0/1045475494 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9094011cc0 con 0x7f90a40b2840 2024-09-10T22:44:28.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a9400640 1 -- 172.21.15.103:0/1045475494 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a4159d40 con 0x7f90a40b2840 2024-09-10T22:44:28.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f90a9400640 1 -- 172.21.15.103:0/1045475494 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90a40b6730 con 0x7f90a40b2840 2024-09-10T22:44:28.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.477+0000 7f909aa00640 1 -- 172.21.15.103:0/1045475494 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f909401c460 con 0x7f90a40b2840 2024-09-10T22:44:28.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.481+0000 7f909aa00640 1 --2- 172.21.15.103:0/1045475494 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f90840725e0 0x7f9084074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:28.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.481+0000 7f909aa00640 1 -- 172.21.15.103:0/1045475494 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6101+0+0 (secure 0 0 0) 0x7f9094092ff0 con 0x7f90a40b2840 2024-09-10T22:44:28.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.481+0000 7f90a1e00640 1 --2- 172.21.15.103:0/1045475494 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f90840725e0 0x7f9084074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:28.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.481+0000 7f90a1e00640 1 --2- 172.21.15.103:0/1045475494 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f90840725e0 0x7f9084074aa0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f90a40b7900 tx=0x7f90900091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:28.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.485+0000 7f909aa00640 1 -- 172.21.15.103:0/1045475494 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f909405df20 con 0x7f90a40b2840 2024-09-10T22:44:28.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.645+0000 7f90a9400640 1 -- 172.21.15.103:0/1045475494 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f90a40ccf30 con 0x7f90840725e0 2024-09-10T22:44:28.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.653+0000 7f909aa00640 1 -- 172.21.15.103:0/1045475494 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247612 (secure 0 0 0) 0x7f90a40ccf30 con 0x7f90840725e0 2024-09-10T22:44:28.659 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:28.660 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:44:28.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.657+0000 7f90a9400640 1 -- 172.21.15.103:0/1045475494 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f90840725e0 msgr2=0x7f9084074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:28.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.657+0000 7f90a9400640 1 --2- 172.21.15.103:0/1045475494 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f90840725e0 0x7f9084074aa0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f90a40b7900 tx=0x7f90900091e0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.657+0000 7f90a9400640 1 -- 172.21.15.103:0/1045475494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a40b2840 msgr2=0x7f90a40b5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:28.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.657+0000 7f90a9400640 1 --2- 172.21.15.103:0/1045475494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a40b2840 0x7f90a40b5640 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f909400c430 tx=0x7f909400c8f0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.657+0000 7f90a9400640 1 -- 172.21.15.103:0/1045475494 shutdown_connections 2024-09-10T22:44:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.657+0000 7f90a9400640 1 --2- 172.21.15.103:0/1045475494 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f90840725e0 0x7f9084074aa0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.657+0000 7f90a9400640 1 --2- 172.21.15.103:0/1045475494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90a415f330 0x7f90a4071700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.657+0000 7f90a9400640 1 --2- 172.21.15.103:0/1045475494 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90a40ccaa0 0x7f90a40b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.657+0000 7f90a9400640 1 --2- 172.21.15.103:0/1045475494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a40b2840 0x7f90a40b5640 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.657+0000 7f90a9400640 1 -- 172.21.15.103:0/1045475494 >> 172.21.15.103:0/1045475494 conn(0x7f90a40d1ab0 msgr2=0x7f90a415e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.657+0000 7f90a9400640 1 -- 172.21.15.103:0/1045475494 shutdown_connections 2024-09-10T22:44:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.657+0000 7f90a9400640 1 -- 172.21.15.103:0/1045475494 wait complete. 2024-09-10T22:44:28.679 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2024-09-10T22:44:27.705623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259304,"kb_used_data":9772,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715416,"statfs":{"total":773094113280,"available":772828585984,"internally_reserved":0,"allocated":10006528,"data_stored":5228890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.541139"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.168772+0000","last_change":"2024-09-10T22:44:23.168772+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.168772+0000","last_undegraded":"2024-09-10T22:44:23.168772+0000","last_fullsized":"2024-09-10T22:44:23.168772+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.173894+0000","last_change":"2024-09-10T22:44:23.173894+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.173894+0000","last_undegraded":"2024-09-10T22:44:23.173894+0000","last_fullsized":"2024-09-10T22:44:23.173894+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.168798+0000","last_change":"2024-09-10T22:44:23.168798+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.168798+0000","last_undegraded":"2024-09-10T22:44:23.168798+0000","last_fullsized":"2024-09-10T22:44:23.168798+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198423+0000","last_change":"2024-09-10T22:44:24.194558+0000","last_active":"2024-09-10T22:44:25.198423+0000","last_peered":"2024-09-10T22:44:25.198423+0000","last_clean":"2024-09-10T22:44:25.198423+0000","last_became_active":"2024-09-10T22:44:24.194119+0000","last_became_peered":"2024-09-10T22:44:24.194119+0000","last_unstale":"2024-09-10T22:44:25.198423+0000","last_undegraded":"2024-09-10T22:44:25.198423+0000","last_fullsized":"2024-09-10T22:44:25.198423+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:04.688517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.169523+0000","last_change":"2024-09-10T22:44:23.169523+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.169523+0000","last_undegraded":"2024-09-10T22:44:23.169523+0000","last_fullsized":"2024-09-10T22:44:23.169523+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.180941+0000","last_change":"2024-09-10T22:44:23.180941+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.180941+0000","last_undegraded":"2024-09-10T22:44:23.180941+0000","last_fullsized":"2024-09-10T22:44:23.180941+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.177044+0000","last_change":"2024-09-10T22:44:23.177044+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.177044+0000","last_undegraded":"2024-09-10T22:44:23.177044+0000","last_fullsized":"2024-09-10T22:44:23.177044+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197490+0000","last_change":"2024-09-10T22:44:24.202919+0000","last_active":"2024-09-10T22:44:25.197490+0000","last_peered":"2024-09-10T22:44:25.197490+0000","last_clean":"2024-09-10T22:44:25.197490+0000","last_became_active":"2024-09-10T22:44:24.202633+0000","last_became_peered":"2024-09-10T22:44:24.202633+0000","last_unstale":"2024-09-10T22:44:25.197490+0000","last_undegraded":"2024-09-10T22:44:25.197490+0000","last_fullsized":"2024-09-10T22:44:25.197490+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:24.832375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.169870+0000","last_change":"2024-09-10T22:44:23.169870+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.169870+0000","last_undegraded":"2024-09-10T22:44:23.169870+0000","last_fullsized":"2024-09-10T22:44:23.169870+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.180090+0000","last_change":"2024-09-10T22:44:23.180090+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.180090+0000","last_undegraded":"2024-09-10T22:44:23.180090+0000","last_fullsized":"2024-09-10T22:44:23.180090+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.171297+0000","last_change":"2024-09-10T22:44:23.171297+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.171297+0000","last_undegraded":"2024-09-10T22:44:23.171297+0000","last_fullsized":"2024-09-10T22:44:23.171297+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.179040+0000","last_change":"2024-09-10T22:44:23.179040+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.179040+0000","last_undegraded":"2024-09-10T22:44:23.179040+0000","last_fullsized":"2024-09-10T22:44:23.179040+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198071+0000","last_change":"2024-09-10T22:44:24.203861+0000","last_active":"2024-09-10T22:44:25.198071+0000","last_peered":"2024-09-10T22:44:25.198071+0000","last_clean":"2024-09-10T22:44:25.198071+0000","last_became_active":"2024-09-10T22:44:24.203535+0000","last_became_peered":"2024-09-10T22:44:24.203535+0000","last_unstale":"2024-09-10T22:44:25.198071+0000","last_undegraded":"2024-09-10T22:44:25.198071+0000","last_fullsized":"2024-09-10T22:44:25.198071+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:22.211727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.171199+0000","last_change":"2024-09-10T22:44:23.171199+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.171199+0000","last_undegraded":"2024-09-10T22:44:23.171199+0000","last_fullsized":"2024-09-10T22:44:23.171199+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197749+0000","last_change":"2024-09-10T22:44:24.197228+0000","last_active":"2024-09-10T22:44:25.197749+0000","last_peered":"2024-09-10T22:44:25.197749+0000","last_clean":"2024-09-10T22:44:25.197749+0000","last_became_active":"2024-09-10T22:44:24.196964+0000","last_became_peered":"2024-09-10T22:44:24.196964+0000","last_unstale":"2024-09-10T22:44:25.197749+0000","last_undegraded":"2024-09-10T22:44:25.197749+0000","last_fullsized":"2024-09-10T22:44:25.197749+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:09.707330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.182766+0000","last_change":"2024-09-10T22:44:23.182766+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.182766+0000","last_undegraded":"2024-09-10T22:44:23.182766+0000","last_fullsized":"2024-09-10T22:44:23.182766+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.179559+0000","last_change":"2024-09-10T22:44:23.179559+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.179559+0000","last_undegraded":"2024-09-10T22:44:23.179559+0000","last_fullsized":"2024-09-10T22:44:23.179559+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.169080+0000","last_change":"2024-09-10T22:44:23.169080+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.169080+0000","last_undegraded":"2024-09-10T22:44:23.169080+0000","last_fullsized":"2024-09-10T22:44:23.169080+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.170752+0000","last_change":"2024-09-10T22:44:23.170752+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.170752+0000","last_undegraded":"2024-09-10T22:44:23.170752+0000","last_fullsized":"2024-09-10T22:44:23.170752+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198606+0000","last_change":"2024-09-10T22:44:24.198928+0000","last_active":"2024-09-10T22:44:25.198606+0000","last_peered":"2024-09-10T22:44:25.198606+0000","last_clean":"2024-09-10T22:44:25.198606+0000","last_became_active":"2024-09-10T22:44:24.198508+0000","last_became_peered":"2024-09-10T22:44:24.198508+0000","last_unstale":"2024-09-10T22:44:25.198606+0000","last_undegraded":"2024-09-10T22:44:25.198606+0000","last_fullsized":"2024-09-10T22:44:25.198606+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:09.617474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.171741+0000","last_change":"2024-09-10T22:44:23.171741+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.171741+0000","last_undegraded":"2024-09-10T22:44:23.171741+0000","last_fullsized":"2024-09-10T22:44:23.171741+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.170475+0000","last_change":"2024-09-10T22:44:23.170475+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.170475+0000","last_undegraded":"2024-09-10T22:44:23.170475+0000","last_fullsized":"2024-09-10T22:44:23.170475+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.180546+0000","last_change":"2024-09-10T22:44:23.180546+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.180546+0000","last_undegraded":"2024-09-10T22:44:23.180546+0000","last_fullsized":"2024-09-10T22:44:23.180546+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.168256+0000","last_change":"2024-09-10T22:44:23.168256+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.168256+0000","last_undegraded":"2024-09-10T22:44:23.168256+0000","last_fullsized":"2024-09-10T22:44:23.168256+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.173683+0000","last_change":"2024-09-10T22:44:23.173683+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.173683+0000","last_undegraded":"2024-09-10T22:44:23.173683+0000","last_fullsized":"2024-09-10T22:44:23.173683+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.171614+0000","last_change":"2024-09-10T22:44:23.171614+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.171614+0000","last_undegraded":"2024-09-10T22:44:23.171614+0000","last_fullsized":"2024-09-10T22:44:23.171614+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.179586+0000","last_change":"2024-09-10T22:44:23.179586+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.179586+0000","last_undegraded":"2024-09-10T22:44:23.179586+0000","last_fullsized":"2024-09-10T22:44:23.179586+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198801+0000","last_change":"2024-09-10T22:44:24.208790+0000","last_active":"2024-09-10T22:44:25.198801+0000","last_peered":"2024-09-10T22:44:25.198801+0000","last_clean":"2024-09-10T22:44:25.198801+0000","last_became_active":"2024-09-10T22:44:24.208540+0000","last_became_peered":"2024-09-10T22:44:24.208540+0000","last_unstale":"2024-09-10T22:44:25.198801+0000","last_undegraded":"2024-09-10T22:44:25.198801+0000","last_fullsized":"2024-09-10T22:44:25.198801+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:50.921887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.176432+0000","last_change":"2024-09-10T22:44:23.176432+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.176432+0000","last_undegraded":"2024-09-10T22:44:23.176432+0000","last_fullsized":"2024-09-10T22:44:23.176432+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.169167+0000","last_change":"2024-09-10T22:44:23.169167+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.169167+0000","last_undegraded":"2024-09-10T22:44:23.169167+0000","last_fullsized":"2024-09-10T22:44:23.169167+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.176425+0000","last_change":"2024-09-10T22:44:23.176425+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.176425+0000","last_undegraded":"2024-09-10T22:44:23.176425+0000","last_fullsized":"2024-09-10T22:44:23.176425+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.179565+0000","last_change":"2024-09-10T22:44:23.179565+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.179565+0000","last_undegraded":"2024-09-10T22:44:23.179565+0000","last_fullsized":"2024-09-10T22:44:23.179565+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.179050+0000","last_change":"2024-09-10T22:44:23.179050+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.179050+0000","last_undegraded":"2024-09-10T22:44:23.179050+0000","last_fullsized":"2024-09-10T22:44:23.179050+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.195915+0000","last_change":"2024-09-10T22:44:23.194098+0000","last_active":"2024-09-10T22:44:23.195915+0000","last_peered":"2024-09-10T22:44:23.195915+0000","last_clean":"2024-09-10T22:44:23.195915+0000","last_became_active":"2024-09-10T22:44:23.193814+0000","last_became_peered":"2024-09-10T22:44:23.193814+0000","last_unstale":"2024-09-10T22:44:23.195915+0000","last_undegraded":"2024-09-10T22:44:23.195915+0000","last_fullsized":"2024-09-10T22:44:23.195915+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:07.866030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.178351+0000","last_change":"2024-09-10T22:44:23.178351+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.178351+0000","last_undegraded":"2024-09-10T22:44:23.178351+0000","last_fullsized":"2024-09-10T22:44:23.178351+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.189946+0000","last_change":"2024-09-10T22:44:23.186842+0000","last_active":"2024-09-10T22:44:23.189946+0000","last_peered":"2024-09-10T22:44:23.189946+0000","last_clean":"2024-09-10T22:44:23.189946+0000","last_became_active":"2024-09-10T22:44:23.186437+0000","last_became_peered":"2024-09-10T22:44:23.186437+0000","last_unstale":"2024-09-10T22:44:23.189946+0000","last_undegraded":"2024-09-10T22:44:23.189946+0000","last_fullsized":"2024-09-10T22:44:23.189946+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:08.665780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.177699+0000","last_change":"2024-09-10T22:44:23.177699+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.177699+0000","last_undegraded":"2024-09-10T22:44:23.177699+0000","last_fullsized":"2024-09-10T22:44:23.177699+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.193050+0000","last_change":"2024-09-10T22:44:23.188760+0000","last_active":"2024-09-10T22:44:23.193050+0000","last_peered":"2024-09-10T22:44:23.193050+0000","last_clean":"2024-09-10T22:44:23.193050+0000","last_became_active":"2024-09-10T22:44:23.188504+0000","last_became_peered":"2024-09-10T22:44:23.188504+0000","last_unstale":"2024-09-10T22:44:23.193050+0000","last_undegraded":"2024-09-10T22:44:23.193050+0000","last_fullsized":"2024-09-10T22:44:23.193050+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:53.656054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.178054+0000","last_change":"2024-09-10T22:44:23.178054+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.178054+0000","last_undegraded":"2024-09-10T22:44:23.178054+0000","last_fullsized":"2024-09-10T22:44:23.178054+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.198411+0000","last_change":"2024-09-10T22:44:23.197426+0000","last_active":"2024-09-10T22:44:23.198411+0000","last_peered":"2024-09-10T22:44:23.198411+0000","last_clean":"2024-09-10T22:44:23.198411+0000","last_became_active":"2024-09-10T22:44:23.197108+0000","last_became_peered":"2024-09-10T22:44:23.197108+0000","last_unstale":"2024-09-10T22:44:23.198411+0000","last_undegraded":"2024-09-10T22:44:23.198411+0000","last_fullsized":"2024-09-10T22:44:23.198411+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:39.429544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197557+0000","last_change":"2024-09-10T22:44:24.202442+0000","last_active":"2024-09-10T22:44:25.197557+0000","last_peered":"2024-09-10T22:44:25.197557+0000","last_clean":"2024-09-10T22:44:25.197557+0000","last_became_active":"2024-09-10T22:44:24.197691+0000","last_became_peered":"2024-09-10T22:44:24.197691+0000","last_unstale":"2024-09-10T22:44:25.197557+0000","last_undegraded":"2024-09-10T22:44:25.197557+0000","last_fullsized":"2024-09-10T22:44:25.197557+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:43.068682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.190378+0000","last_change":"2024-09-10T22:44:23.188330+0000","last_active":"2024-09-10T22:44:23.190378+0000","last_peered":"2024-09-10T22:44:23.190378+0000","last_clean":"2024-09-10T22:44:23.190378+0000","last_became_active":"2024-09-10T22:44:23.188074+0000","last_became_peered":"2024-09-10T22:44:23.188074+0000","last_unstale":"2024-09-10T22:44:23.190378+0000","last_undegraded":"2024-09-10T22:44:23.190378+0000","last_fullsized":"2024-09-10T22:44:23.190378+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:53.660937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.177551+0000","last_change":"2024-09-10T22:44:23.177551+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.177551+0000","last_undegraded":"2024-09-10T22:44:23.177551+0000","last_fullsized":"2024-09-10T22:44:23.177551+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198372+0000","last_change":"2024-09-10T22:44:23.195943+0000","last_active":"2024-09-10T22:44:25.198372+0000","last_peered":"2024-09-10T22:44:25.198372+0000","last_clean":"2024-09-10T22:44:25.198372+0000","last_became_active":"2024-09-10T22:44:23.195678+0000","last_became_peered":"2024-09-10T22:44:23.195678+0000","last_unstale":"2024-09-10T22:44:25.198372+0000","last_undegraded":"2024-09-10T22:44:25.198372+0000","last_fullsized":"2024-09-10T22:44:25.198372+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:30.932095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.177301+0000","last_change":"2024-09-10T22:44:23.177301+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.177301+0000","last_undegraded":"2024-09-10T22:44:23.177301+0000","last_fullsized":"2024-09-10T22:44:23.177301+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.192541+0000","last_change":"2024-09-10T22:44:23.184732+0000","last_active":"2024-09-10T22:44:23.192541+0000","last_peered":"2024-09-10T22:44:23.192541+0000","last_clean":"2024-09-10T22:44:23.192541+0000","last_became_active":"2024-09-10T22:44:23.184397+0000","last_became_peered":"2024-09-10T22:44:23.184397+0000","last_unstale":"2024-09-10T22:44:23.192541+0000","last_undegraded":"2024-09-10T22:44:23.192541+0000","last_fullsized":"2024-09-10T22:44:23.192541+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:19:14.203129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199476+0000","last_change":"2024-09-10T22:44:24.202421+0000","last_active":"2024-09-10T22:44:25.199476+0000","last_peered":"2024-09-10T22:44:25.199476+0000","last_clean":"2024-09-10T22:44:25.199476+0000","last_became_active":"2024-09-10T22:44:24.202090+0000","last_became_peered":"2024-09-10T22:44:24.202090+0000","last_unstale":"2024-09-10T22:44:25.199476+0000","last_undegraded":"2024-09-10T22:44:25.199476+0000","last_fullsized":"2024-09-10T22:44:25.199476+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:34.501203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.194769+0000","last_change":"2024-09-10T22:44:23.193342+0000","last_active":"2024-09-10T22:44:23.194769+0000","last_peered":"2024-09-10T22:44:23.194769+0000","last_clean":"2024-09-10T22:44:23.194769+0000","last_became_active":"2024-09-10T22:44:23.193097+0000","last_became_peered":"2024-09-10T22:44:23.193097+0000","last_unstale":"2024-09-10T22:44:23.194769+0000","last_undegraded":"2024-09-10T22:44:23.194769+0000","last_fullsized":"2024-09-10T22:44:23.194769+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:59.916869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.169206+0000","last_change":"2024-09-10T22:44:23.169206+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.169206+0000","last_undegraded":"2024-09-10T22:44:23.169206+0000","last_fullsized":"2024-09-10T22:44:23.169206+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.190530+0000","last_change":"2024-09-10T22:44:23.188266+0000","last_active":"2024-09-10T22:44:23.190530+0000","last_peered":"2024-09-10T22:44:23.190530+0000","last_clean":"2024-09-10T22:44:23.190530+0000","last_became_active":"2024-09-10T22:44:23.187992+0000","last_became_peered":"2024-09-10T22:44:23.187992+0000","last_unstale":"2024-09-10T22:44:23.190530+0000","last_undegraded":"2024-09-10T22:44:23.190530+0000","last_fullsized":"2024-09-10T22:44:23.190530+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:06.476793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.176730+0000","last_change":"2024-09-10T22:44:23.176730+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.176730+0000","last_undegraded":"2024-09-10T22:44:23.176730+0000","last_fullsized":"2024-09-10T22:44:23.176730+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.190455+0000","last_change":"2024-09-10T22:44:23.185327+0000","last_active":"2024-09-10T22:44:23.190455+0000","last_peered":"2024-09-10T22:44:23.190455+0000","last_clean":"2024-09-10T22:44:23.190455+0000","last_became_active":"2024-09-10T22:44:23.185040+0000","last_became_peered":"2024-09-10T22:44:23.185040+0000","last_unstale":"2024-09-10T22:44:23.190455+0000","last_undegraded":"2024-09-10T22:44:23.190455+0000","last_fullsized":"2024-09-10T22:44:23.190455+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:32.513332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.168364+0000","last_change":"2024-09-10T22:44:23.168364+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.168364+0000","last_undegraded":"2024-09-10T22:44:23.168364+0000","last_fullsized":"2024-09-10T22:44:23.168364+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.186155+0000","last_change":"2024-09-10T22:44:23.184019+0000","last_active":"2024-09-10T22:44:23.186155+0000","last_peered":"2024-09-10T22:44:23.186155+0000","last_clean":"2024-09-10T22:44:23.186155+0000","last_became_active":"2024-09-10T22:44:23.183735+0000","last_became_peered":"2024-09-10T22:44:23.183735+0000","last_unstale":"2024-09-10T22:44:23.186155+0000","last_undegraded":"2024-09-10T22:44:23.186155+0000","last_fullsized":"2024-09-10T22:44:23.186155+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:05.572031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198775+0000","last_change":"2024-09-10T22:44:24.197746+0000","last_active":"2024-09-10T22:44:25.198775+0000","last_peered":"2024-09-10T22:44:25.198775+0000","last_clean":"2024-09-10T22:44:25.198775+0000","last_became_active":"2024-09-10T22:44:24.197467+0000","last_became_peered":"2024-09-10T22:44:24.197467+0000","last_unstale":"2024-09-10T22:44:25.198775+0000","last_undegraded":"2024-09-10T22:44:25.198775+0000","last_fullsized":"2024-09-10T22:44:25.198775+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:21.613577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.191864+0000","last_change":"2024-09-10T22:44:23.188843+0000","last_active":"2024-09-10T22:44:23.191864+0000","last_peered":"2024-09-10T22:44:23.191864+0000","last_clean":"2024-09-10T22:44:23.191864+0000","last_became_active":"2024-09-10T22:44:23.188570+0000","last_became_peered":"2024-09-10T22:44:23.188570+0000","last_unstale":"2024-09-10T22:44:23.191864+0000","last_undegraded":"2024-09-10T22:44:23.191864+0000","last_fullsized":"2024-09-10T22:44:23.191864+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:10.992205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197666+0000","last_change":"2024-09-10T22:44:24.201026+0000","last_active":"2024-09-10T22:44:25.197666+0000","last_peered":"2024-09-10T22:44:25.197666+0000","last_clean":"2024-09-10T22:44:25.197666+0000","last_became_active":"2024-09-10T22:44:24.197325+0000","last_became_peered":"2024-09-10T22:44:24.197325+0000","last_unstale":"2024-09-10T22:44:25.197666+0000","last_undegraded":"2024-09-10T22:44:25.197666+0000","last_fullsized":"2024-09-10T22:44:25.197666+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:48.952777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.195632+0000","last_change":"2024-09-10T22:44:23.193543+0000","last_active":"2024-09-10T22:44:23.195632+0000","last_peered":"2024-09-10T22:44:23.195632+0000","last_clean":"2024-09-10T22:44:23.195632+0000","last_became_active":"2024-09-10T22:44:23.193253+0000","last_became_peered":"2024-09-10T22:44:23.193253+0000","last_unstale":"2024-09-10T22:44:23.195632+0000","last_undegraded":"2024-09-10T22:44:23.195632+0000","last_fullsized":"2024-09-10T22:44:23.195632+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:49.790547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.169953+0000","last_change":"2024-09-10T22:44:23.169953+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.169953+0000","last_undegraded":"2024-09-10T22:44:23.169953+0000","last_fullsized":"2024-09-10T22:44:23.169953+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.186939+0000","last_change":"2024-09-10T22:44:23.179309+0000","last_active":"2024-09-10T22:44:23.186939+0000","last_peered":"2024-09-10T22:44:23.186939+0000","last_clean":"2024-09-10T22:44:23.186939+0000","last_became_active":"2024-09-10T22:44:23.177131+0000","last_became_peered":"2024-09-10T22:44:23.177131+0000","last_unstale":"2024-09-10T22:44:23.186939+0000","last_undegraded":"2024-09-10T22:44:23.186939+0000","last_fullsized":"2024-09-10T22:44:23.186939+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:24.201009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.175931+0000","last_change":"2024-09-10T22:44:23.175931+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.175931+0000","last_undegraded":"2024-09-10T22:44:23.175931+0000","last_fullsized":"2024-09-10T22:44:23.175931+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197761+0000","last_change":"2024-09-10T22:44:23.195006+0000","last_active":"2024-09-10T22:44:25.197761+0000","last_peered":"2024-09-10T22:44:25.197761+0000","last_clean":"2024-09-10T22:44:25.197761+0000","last_became_active":"2024-09-10T22:44:23.194737+0000","last_became_peered":"2024-09-10T22:44:23.194737+0000","last_unstale":"2024-09-10T22:44:25.197761+0000","last_undegraded":"2024-09-10T22:44:25.197761+0000","last_fullsized":"2024-09-10T22:44:25.197761+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:50.822823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.177660+0000","last_change":"2024-09-10T22:44:23.177660+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.177660+0000","last_undegraded":"2024-09-10T22:44:23.177660+0000","last_fullsized":"2024-09-10T22:44:23.177660+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"91'8","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197737+0000","last_change":"2024-09-10T22:44:23.195915+0000","last_active":"2024-09-10T22:44:25.197737+0000","last_peered":"2024-09-10T22:44:25.197737+0000","last_clean":"2024-09-10T22:44:25.197737+0000","last_became_active":"2024-09-10T22:44:23.195654+0000","last_became_peered":"2024-09-10T22:44:23.195654+0000","last_unstale":"2024-09-10T22:44:25.197737+0000","last_undegraded":"2024-09-10T22:44:25.197737+0000","last_fullsized":"2024-09-10T22:44:25.197737+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:01.303549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.176647+0000","last_change":"2024-09-10T22:44:23.176647+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.176647+0000","last_undegraded":"2024-09-10T22:44:23.176647+0000","last_fullsized":"2024-09-10T22:44:23.176647+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.191634+0000","last_change":"2024-09-10T22:44:23.189443+0000","last_active":"2024-09-10T22:44:23.191634+0000","last_peered":"2024-09-10T22:44:23.191634+0000","last_clean":"2024-09-10T22:44:23.191634+0000","last_became_active":"2024-09-10T22:44:23.188194+0000","last_became_peered":"2024-09-10T22:44:23.188194+0000","last_unstale":"2024-09-10T22:44:23.191634+0000","last_undegraded":"2024-09-10T22:44:23.191634+0000","last_fullsized":"2024-09-10T22:44:23.191634+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:56.779138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.178111+0000","last_change":"2024-09-10T22:44:23.178111+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.178111+0000","last_undegraded":"2024-09-10T22:44:23.178111+0000","last_fullsized":"2024-09-10T22:44:23.178111+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.192463+0000","last_change":"2024-09-10T22:44:23.187756+0000","last_active":"2024-09-10T22:44:23.192463+0000","last_peered":"2024-09-10T22:44:23.192463+0000","last_clean":"2024-09-10T22:44:23.192463+0000","last_became_active":"2024-09-10T22:44:23.187474+0000","last_became_peered":"2024-09-10T22:44:23.187474+0000","last_unstale":"2024-09-10T22:44:23.192463+0000","last_undegraded":"2024-09-10T22:44:23.192463+0000","last_fullsized":"2024-09-10T22:44:23.192463+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:53:19.805095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.171023+0000","last_change":"2024-09-10T22:44:23.171023+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.171023+0000","last_undegraded":"2024-09-10T22:44:23.171023+0000","last_fullsized":"2024-09-10T22:44:23.171023+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.193417+0000","last_change":"2024-09-10T22:44:23.192579+0000","last_active":"2024-09-10T22:44:23.193417+0000","last_peered":"2024-09-10T22:44:23.193417+0000","last_clean":"2024-09-10T22:44:23.193417+0000","last_became_active":"2024-09-10T22:44:23.191640+0000","last_became_peered":"2024-09-10T22:44:23.191640+0000","last_unstale":"2024-09-10T22:44:23.193417+0000","last_undegraded":"2024-09-10T22:44:23.193417+0000","last_fullsized":"2024-09-10T22:44:23.193417+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:44.121930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.175572+0000","last_change":"2024-09-10T22:44:23.175572+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.175572+0000","last_undegraded":"2024-09-10T22:44:23.175572+0000","last_fullsized":"2024-09-10T22:44:23.175572+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.184370+0000","last_change":"2024-09-10T22:44:23.180037+0000","last_active":"2024-09-10T22:44:23.184370+0000","last_peered":"2024-09-10T22:44:23.184370+0000","last_clean":"2024-09-10T22:44:23.184370+0000","last_became_active":"2024-09-10T22:44:23.179760+0000","last_became_peered":"2024-09-10T22:44:23.179760+0000","last_unstale":"2024-09-10T22:44:23.184370+0000","last_undegraded":"2024-09-10T22:44:23.184370+0000","last_fullsized":"2024-09-10T22:44:23.184370+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:50.593281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.172730+0000","last_change":"2024-09-10T22:44:23.172730+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.172730+0000","last_undegraded":"2024-09-10T22:44:23.172730+0000","last_fullsized":"2024-09-10T22:44:23.172730+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.199910+0000","last_change":"2024-09-10T22:44:23.196730+0000","last_active":"2024-09-10T22:44:23.199910+0000","last_peered":"2024-09-10T22:44:23.199910+0000","last_clean":"2024-09-10T22:44:23.199910+0000","last_became_active":"2024-09-10T22:44:23.195841+0000","last_became_peered":"2024-09-10T22:44:23.195841+0000","last_unstale":"2024-09-10T22:44:23.199910+0000","last_undegraded":"2024-09-10T22:44:23.199910+0000","last_fullsized":"2024-09-10T22:44:23.199910+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:58.089373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.172639+0000","last_change":"2024-09-10T22:44:23.172639+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.172639+0000","last_undegraded":"2024-09-10T22:44:23.172639+0000","last_fullsized":"2024-09-10T22:44:23.172639+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.185264+0000","last_change":"2024-09-10T22:44:23.182444+0000","last_active":"2024-09-10T22:44:23.185264+0000","last_peered":"2024-09-10T22:44:23.185264+0000","last_clean":"2024-09-10T22:44:23.185264+0000","last_became_active":"2024-09-10T22:44:23.182160+0000","last_became_peered":"2024-09-10T22:44:23.182160+0000","last_unstale":"2024-09-10T22:44:23.185264+0000","last_undegraded":"2024-09-10T22:44:23.185264+0000","last_fullsized":"2024-09-10T22:44:23.185264+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:42.122855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.176156+0000","last_change":"2024-09-10T22:44:23.176156+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.176156+0000","last_undegraded":"2024-09-10T22:44:23.176156+0000","last_fullsized":"2024-09-10T22:44:23.176156+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.195217+0000","last_change":"2024-09-10T22:44:23.190506+0000","last_active":"2024-09-10T22:44:23.195217+0000","last_peered":"2024-09-10T22:44:23.195217+0000","last_clean":"2024-09-10T22:44:23.195217+0000","last_became_active":"2024-09-10T22:44:23.187895+0000","last_became_peered":"2024-09-10T22:44:23.187895+0000","last_unstale":"2024-09-10T22:44:23.195217+0000","last_undegraded":"2024-09-10T22:44:23.195217+0000","last_fullsized":"2024-09-10T22:44:23.195217+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:12.293801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.179941+0000","last_change":"2024-09-10T22:44:23.179941+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.179941+0000","last_undegraded":"2024-09-10T22:44:23.179941+0000","last_fullsized":"2024-09-10T22:44:23.179941+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.194102+0000","last_change":"2024-09-10T22:44:23.190502+0000","last_active":"2024-09-10T22:44:23.194102+0000","last_peered":"2024-09-10T22:44:23.194102+0000","last_clean":"2024-09-10T22:44:23.194102+0000","last_became_active":"2024-09-10T22:44:23.190243+0000","last_became_peered":"2024-09-10T22:44:23.190243+0000","last_unstale":"2024-09-10T22:44:23.194102+0000","last_undegraded":"2024-09-10T22:44:23.194102+0000","last_fullsized":"2024-09-10T22:44:23.194102+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:38.009879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.175160+0000","last_change":"2024-09-10T22:44:23.175160+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.175160+0000","last_undegraded":"2024-09-10T22:44:23.175160+0000","last_fullsized":"2024-09-10T22:44:23.175160+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.181636+0000","last_change":"2024-09-10T22:44:23.177566+0000","last_active":"2024-09-10T22:44:23.181636+0000","last_peered":"2024-09-10T22:44:23.181636+0000","last_clean":"2024-09-10T22:44:23.181636+0000","last_became_active":"2024-09-10T22:44:23.177258+0000","last_became_peered":"2024-09-10T22:44:23.177258+0000","last_unstale":"2024-09-10T22:44:23.181636+0000","last_undegraded":"2024-09-10T22:44:23.181636+0000","last_fullsized":"2024-09-10T22:44:23.181636+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:47.275849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.174732+0000","last_change":"2024-09-10T22:44:23.174732+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.174732+0000","last_undegraded":"2024-09-10T22:44:23.174732+0000","last_fullsized":"2024-09-10T22:44:23.174732+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.184213+0000","last_change":"2024-09-10T22:44:23.181449+0000","last_active":"2024-09-10T22:44:23.184213+0000","last_peered":"2024-09-10T22:44:23.184213+0000","last_clean":"2024-09-10T22:44:23.184213+0000","last_became_active":"2024-09-10T22:44:23.181079+0000","last_became_peered":"2024-09-10T22:44:23.181079+0000","last_unstale":"2024-09-10T22:44:23.184213+0000","last_undegraded":"2024-09-10T22:44:23.184213+0000","last_fullsized":"2024-09-10T22:44:23.184213+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:47.138408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.173227+0000","last_change":"2024-09-10T22:44:23.173227+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.173227+0000","last_undegraded":"2024-09-10T22:44:23.173227+0000","last_fullsized":"2024-09-10T22:44:23.173227+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.194760+0000","last_change":"2024-09-10T22:44:23.191673+0000","last_active":"2024-09-10T22:44:23.194760+0000","last_peered":"2024-09-10T22:44:23.194760+0000","last_clean":"2024-09-10T22:44:23.194760+0000","last_became_active":"2024-09-10T22:44:23.191370+0000","last_became_peered":"2024-09-10T22:44:23.191370+0000","last_unstale":"2024-09-10T22:44:23.194760+0000","last_undegraded":"2024-09-10T22:44:23.194760+0000","last_fullsized":"2024-09-10T22:44:23.194760+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:40.051769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.175487+0000","last_change":"2024-09-10T22:44:23.175487+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.175487+0000","last_undegraded":"2024-09-10T22:44:23.175487+0000","last_fullsized":"2024-09-10T22:44:23.175487+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.188178+0000","last_change":"2024-09-10T22:44:23.181424+0000","last_active":"2024-09-10T22:44:23.188178+0000","last_peered":"2024-09-10T22:44:23.188178+0000","last_clean":"2024-09-10T22:44:23.188178+0000","last_became_active":"2024-09-10T22:44:23.179930+0000","last_became_peered":"2024-09-10T22:44:23.179930+0000","last_unstale":"2024-09-10T22:44:23.188178+0000","last_undegraded":"2024-09-10T22:44:23.188178+0000","last_fullsized":"2024-09-10T22:44:23.188178+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:05.430072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.168325+0000","last_change":"2024-09-10T22:44:23.168325+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.168325+0000","last_undegraded":"2024-09-10T22:44:23.168325+0000","last_fullsized":"2024-09-10T22:44:23.168325+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.184482+0000","last_change":"2024-09-10T22:44:23.180560+0000","last_active":"2024-09-10T22:44:23.184482+0000","last_peered":"2024-09-10T22:44:23.184482+0000","last_clean":"2024-09-10T22:44:23.184482+0000","last_became_active":"2024-09-10T22:44:23.180274+0000","last_became_peered":"2024-09-10T22:44:23.180274+0000","last_unstale":"2024-09-10T22:44:23.184482+0000","last_undegraded":"2024-09-10T22:44:23.184482+0000","last_fullsized":"2024-09-10T22:44:23.184482+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:46.530536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.180431+0000","last_change":"2024-09-10T22:44:23.180431+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.180431+0000","last_undegraded":"2024-09-10T22:44:23.180431+0000","last_fullsized":"2024-09-10T22:44:23.180431+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.194334+0000","last_change":"2024-09-10T22:44:23.188939+0000","last_active":"2024-09-10T22:44:23.194334+0000","last_peered":"2024-09-10T22:44:23.194334+0000","last_clean":"2024-09-10T22:44:23.194334+0000","last_became_active":"2024-09-10T22:44:23.188521+0000","last_became_peered":"2024-09-10T22:44:23.188521+0000","last_unstale":"2024-09-10T22:44:23.194334+0000","last_undegraded":"2024-09-10T22:44:23.194334+0000","last_fullsized":"2024-09-10T22:44:23.194334+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:09.115754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.174630+0000","last_change":"2024-09-10T22:44:23.174630+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.174630+0000","last_undegraded":"2024-09-10T22:44:23.174630+0000","last_fullsized":"2024-09-10T22:44:23.174630+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.194708+0000","last_change":"2024-09-10T22:44:23.192580+0000","last_active":"2024-09-10T22:44:23.194708+0000","last_peered":"2024-09-10T22:44:23.194708+0000","last_clean":"2024-09-10T22:44:23.194708+0000","last_became_active":"2024-09-10T22:44:23.192249+0000","last_became_peered":"2024-09-10T22:44:23.192249+0000","last_unstale":"2024-09-10T22:44:23.194708+0000","last_undegraded":"2024-09-10T22:44:23.194708+0000","last_fullsized":"2024-09-10T22:44:23.194708+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:57.776232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.177315+0000","last_change":"2024-09-10T22:44:23.177315+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.177315+0000","last_undegraded":"2024-09-10T22:44:23.177315+0000","last_fullsized":"2024-09-10T22:44:23.177315+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198891+0000","last_change":"2024-09-10T22:44:23.194384+0000","last_active":"2024-09-10T22:44:25.198891+0000","last_peered":"2024-09-10T22:44:25.198891+0000","last_clean":"2024-09-10T22:44:25.198891+0000","last_became_active":"2024-09-10T22:44:23.194107+0000","last_became_peered":"2024-09-10T22:44:23.194107+0000","last_unstale":"2024-09-10T22:44:25.198891+0000","last_undegraded":"2024-09-10T22:44:25.198891+0000","last_fullsized":"2024-09-10T22:44:25.198891+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:56.664956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":238,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.179423+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:44:23.179423+0000","last_peered":"2024-09-10T22:44:23.179423+0000","last_clean":"2024-09-10T22:44:23.179423+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:44:23.179423+0000","last_undegraded":"2024-09-10T22:44:23.179423+0000","last_fullsized":"2024-09-10T22:44:23.179423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509512,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32848,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338992,"statfs":{"total":96636764160,"available":96603127808,"internally_reserved":0,"allocated":1695744,"data_stored":1096316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509512,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1089536,"data_stored":499281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509513,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1101824,"data_stored":505948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509512,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1101824,"data_stored":505948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509512,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1101824,"data_stored":505948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509512,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1101824,"data_stored":505948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509512,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32852,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338988,"statfs":{"total":96636764160,"available":96603123712,"internally_reserved":0,"allocated":1695744,"data_stored":1096316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1118208,"data_stored":513185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:44:28.683 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:44:28.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.853+0000 7f67ecc00640 1 -- 172.21.15.103:0/888533901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f67e80cc120 msgr2=0x7f67e80aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:28.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.853+0000 7f67ecc00640 1 --2- 172.21.15.103:0/888533901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f67e80cc120 0x7f67e80aeb40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009840 tx=0x7f67d801c760 comp rx=0 tx=0).stop 2024-09-10T22:44:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.853+0000 7f67ecc00640 1 -- 172.21.15.103:0/888533901 shutdown_connections 2024-09-10T22:44:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.853+0000 7f67ecc00640 1 --2- 172.21.15.103:0/888533901 >> v2:172.21.15.131:3300/0 conn(0x7f67e815c970 0x7f67e8072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.853+0000 7f67ecc00640 1 --2- 172.21.15.103:0/888533901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f67e80cc120 0x7f67e80aeb40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.853+0000 7f67ecc00640 1 -- 172.21.15.103:0/888533901 >> 172.21.15.103:0/888533901 conn(0x7f67e806cc00 msgr2=0x7f67e806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.853+0000 7f67ecc00640 1 -- 172.21.15.103:0/888533901 shutdown_connections 2024-09-10T22:44:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.853+0000 7f67ecc00640 1 -- 172.21.15.103:0/888533901 wait complete. 2024-09-10T22:44:28.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67ecc00640 1 Processor -- start 2024-09-10T22:44:28.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67ecc00640 1 -- start start 2024-09-10T22:44:28.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67ecc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67e80cc120 0x7f67e80a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:28.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67ecc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67e80cf790 0x7f67e814a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:28.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67ecc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f67e815c970 0x7f67e806fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:28.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67ecc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8169030 con 0x7f67e80cc120 2024-09-10T22:44:28.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67ecc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8168eb0 con 0x7f67e80cf790 2024-09-10T22:44:28.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67ecc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f67e81691b0 con 0x7f67e815c970 2024-09-10T22:44:28.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67e5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67e80cc120 0x7f67e80a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:28.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67e5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67e80cc120 0x7f67e80a9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48006/0 (socket says 172.21.15.103:48006) 2024-09-10T22:44:28.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67e5e00640 1 -- 172.21.15.103:0/2126570454 learned_addr learned my addr 172.21.15.103:0/2126570454 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:28.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67e5e00640 1 -- 172.21.15.103:0/2126570454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f67e815c970 msgr2=0x7f67e806fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67e5e00640 1 --2- 172.21.15.103:0/2126570454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f67e815c970 0x7f67e806fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67e5e00640 1 -- 172.21.15.103:0/2126570454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67e80cf790 msgr2=0x7f67e814a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67e5e00640 1 --2- 172.21.15.103:0/2126570454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67e80cf790 0x7f67e814a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67e5e00640 1 -- 172.21.15.103:0/2126570454 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e80aa360 con 0x7f67e80cc120 2024-09-10T22:44:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67e5e00640 1 --2- 172.21.15.103:0/2126570454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67e80cc120 0x7f67e80a9d60 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009790 tx=0x7f67d80a5750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67dea00640 1 -- 172.21.15.103:0/2126570454 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d80b2040 con 0x7f67e80cc120 2024-09-10T22:44:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67dea00640 1 -- 172.21.15.103:0/2126570454 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67d8004430 con 0x7f67e80cc120 2024-09-10T22:44:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67dea00640 1 -- 172.21.15.103:0/2126570454 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d8005280 con 0x7f67e80cc120 2024-09-10T22:44:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67ecc00640 1 -- 172.21.15.103:0/2126570454 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e80aa640 con 0x7f67e80cc120 2024-09-10T22:44:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.857+0000 7f67ecc00640 1 -- 172.21.15.103:0/2126570454 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e806f810 con 0x7f67e80cc120 2024-09-10T22:44:28.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.861+0000 7f67ecc00640 1 -- 172.21.15.103:0/2126570454 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e8072e30 con 0x7f67e80cc120 2024-09-10T22:44:28.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.861+0000 7f67dea00640 1 -- 172.21.15.103:0/2126570454 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f67d80b5070 con 0x7f67e80cc120 2024-09-10T22:44:28.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.861+0000 7f67dea00640 1 --2- 172.21.15.103:0/2126570454 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f67c4072610 0x7f67c4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:28.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.861+0000 7f67dea00640 1 -- 172.21.15.103:0/2126570454 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6101+0+0 (secure 0 0 0) 0x7f67d812cc80 con 0x7f67e80cc120 2024-09-10T22:44:28.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.861+0000 7f67dd400640 1 --2- 172.21.15.103:0/2126570454 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f67c4072610 0x7f67c4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:28.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.861+0000 7f67dd400640 1 --2- 172.21.15.103:0/2126570454 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f67c4072610 0x7f67c4074ad0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f67e80af8d0 tx=0x7f67d00095a0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:28.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:28.865+0000 7f67dea00640 1 -- 172.21.15.103:0/2126570454 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f67d8016410 con 0x7f67e80cc120 2024-09-10T22:44:29.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.029+0000 7f67ecc00640 1 -- 172.21.15.103:0/2126570454 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f67e806f9e0 con 0x7f67c4072610 2024-09-10T22:44:29.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.033+0000 7f67dea00640 1 -- 172.21.15.103:0/2126570454 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247612 (secure 0 0 0) 0x7f67e806f9e0 con 0x7f67c4072610 2024-09-10T22:44:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:29.042 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:44:29.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.037+0000 7f67ecc00640 1 -- 172.21.15.103:0/2126570454 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f67c4072610 msgr2=0x7f67c4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:29.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.037+0000 7f67ecc00640 1 --2- 172.21.15.103:0/2126570454 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f67c4072610 0x7f67c4074ad0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f67e80af8d0 tx=0x7f67d00095a0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.037+0000 7f67ecc00640 1 -- 172.21.15.103:0/2126570454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67e80cc120 msgr2=0x7f67e80a9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:29.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.037+0000 7f67ecc00640 1 --2- 172.21.15.103:0/2126570454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67e80cc120 0x7f67e80a9d60 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009790 tx=0x7f67d80a5750 comp rx=0 tx=0).stop 2024-09-10T22:44:29.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.037+0000 7f67ecc00640 1 -- 172.21.15.103:0/2126570454 shutdown_connections 2024-09-10T22:44:29.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.037+0000 7f67ecc00640 1 --2- 172.21.15.103:0/2126570454 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f67c4072610 0x7f67c4074ad0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.037+0000 7f67ecc00640 1 --2- 172.21.15.103:0/2126570454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f67e815c970 0x7f67e806fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.037+0000 7f67ecc00640 1 --2- 172.21.15.103:0/2126570454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67e80cf790 0x7f67e814a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.037+0000 7f67ecc00640 1 --2- 172.21.15.103:0/2126570454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67e80cc120 0x7f67e80a9d60 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.037+0000 7f67ecc00640 1 -- 172.21.15.103:0/2126570454 >> 172.21.15.103:0/2126570454 conn(0x7f67e806cc00 msgr2=0x7f67e80b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:29.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.037+0000 7f67ecc00640 1 -- 172.21.15.103:0/2126570454 shutdown_connections 2024-09-10T22:44:29.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.037+0000 7f67ecc00640 1 -- 172.21.15.103:0/2126570454 wait complete. 2024-09-10T22:44:29.062 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2024-09-10T22:44:27.705623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259304,"kb_used_data":9772,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715416,"statfs":{"total":773094113280,"available":772828585984,"internally_reserved":0,"allocated":10006528,"data_stored":5228890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.541139"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.168772+0000","last_change":"2024-09-10T22:44:23.168772+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.168772+0000","last_undegraded":"2024-09-10T22:44:23.168772+0000","last_fullsized":"2024-09-10T22:44:23.168772+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.173894+0000","last_change":"2024-09-10T22:44:23.173894+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.173894+0000","last_undegraded":"2024-09-10T22:44:23.173894+0000","last_fullsized":"2024-09-10T22:44:23.173894+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.168798+0000","last_change":"2024-09-10T22:44:23.168798+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.168798+0000","last_undegraded":"2024-09-10T22:44:23.168798+0000","last_fullsized":"2024-09-10T22:44:23.168798+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198423+0000","last_change":"2024-09-10T22:44:24.194558+0000","last_active":"2024-09-10T22:44:25.198423+0000","last_peered":"2024-09-10T22:44:25.198423+0000","last_clean":"2024-09-10T22:44:25.198423+0000","last_became_active":"2024-09-10T22:44:24.194119+0000","last_became_peered":"2024-09-10T22:44:24.194119+0000","last_unstale":"2024-09-10T22:44:25.198423+0000","last_undegraded":"2024-09-10T22:44:25.198423+0000","last_fullsized":"2024-09-10T22:44:25.198423+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:04.688517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.169523+0000","last_change":"2024-09-10T22:44:23.169523+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.169523+0000","last_undegraded":"2024-09-10T22:44:23.169523+0000","last_fullsized":"2024-09-10T22:44:23.169523+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.180941+0000","last_change":"2024-09-10T22:44:23.180941+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.180941+0000","last_undegraded":"2024-09-10T22:44:23.180941+0000","last_fullsized":"2024-09-10T22:44:23.180941+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.177044+0000","last_change":"2024-09-10T22:44:23.177044+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.177044+0000","last_undegraded":"2024-09-10T22:44:23.177044+0000","last_fullsized":"2024-09-10T22:44:23.177044+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197490+0000","last_change":"2024-09-10T22:44:24.202919+0000","last_active":"2024-09-10T22:44:25.197490+0000","last_peered":"2024-09-10T22:44:25.197490+0000","last_clean":"2024-09-10T22:44:25.197490+0000","last_became_active":"2024-09-10T22:44:24.202633+0000","last_became_peered":"2024-09-10T22:44:24.202633+0000","last_unstale":"2024-09-10T22:44:25.197490+0000","last_undegraded":"2024-09-10T22:44:25.197490+0000","last_fullsized":"2024-09-10T22:44:25.197490+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:24.832375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.169870+0000","last_change":"2024-09-10T22:44:23.169870+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.169870+0000","last_undegraded":"2024-09-10T22:44:23.169870+0000","last_fullsized":"2024-09-10T22:44:23.169870+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.180090+0000","last_change":"2024-09-10T22:44:23.180090+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.180090+0000","last_undegraded":"2024-09-10T22:44:23.180090+0000","last_fullsized":"2024-09-10T22:44:23.180090+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.171297+0000","last_change":"2024-09-10T22:44:23.171297+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.171297+0000","last_undegraded":"2024-09-10T22:44:23.171297+0000","last_fullsized":"2024-09-10T22:44:23.171297+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.179040+0000","last_change":"2024-09-10T22:44:23.179040+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.179040+0000","last_undegraded":"2024-09-10T22:44:23.179040+0000","last_fullsized":"2024-09-10T22:44:23.179040+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198071+0000","last_change":"2024-09-10T22:44:24.203861+0000","last_active":"2024-09-10T22:44:25.198071+0000","last_peered":"2024-09-10T22:44:25.198071+0000","last_clean":"2024-09-10T22:44:25.198071+0000","last_became_active":"2024-09-10T22:44:24.203535+0000","last_became_peered":"2024-09-10T22:44:24.203535+0000","last_unstale":"2024-09-10T22:44:25.198071+0000","last_undegraded":"2024-09-10T22:44:25.198071+0000","last_fullsized":"2024-09-10T22:44:25.198071+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:22.211727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.171199+0000","last_change":"2024-09-10T22:44:23.171199+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.171199+0000","last_undegraded":"2024-09-10T22:44:23.171199+0000","last_fullsized":"2024-09-10T22:44:23.171199+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197749+0000","last_change":"2024-09-10T22:44:24.197228+0000","last_active":"2024-09-10T22:44:25.197749+0000","last_peered":"2024-09-10T22:44:25.197749+0000","last_clean":"2024-09-10T22:44:25.197749+0000","last_became_active":"2024-09-10T22:44:24.196964+0000","last_became_peered":"2024-09-10T22:44:24.196964+0000","last_unstale":"2024-09-10T22:44:25.197749+0000","last_undegraded":"2024-09-10T22:44:25.197749+0000","last_fullsized":"2024-09-10T22:44:25.197749+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:09.707330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.182766+0000","last_change":"2024-09-10T22:44:23.182766+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.182766+0000","last_undegraded":"2024-09-10T22:44:23.182766+0000","last_fullsized":"2024-09-10T22:44:23.182766+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.179559+0000","last_change":"2024-09-10T22:44:23.179559+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.179559+0000","last_undegraded":"2024-09-10T22:44:23.179559+0000","last_fullsized":"2024-09-10T22:44:23.179559+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.169080+0000","last_change":"2024-09-10T22:44:23.169080+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.169080+0000","last_undegraded":"2024-09-10T22:44:23.169080+0000","last_fullsized":"2024-09-10T22:44:23.169080+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.170752+0000","last_change":"2024-09-10T22:44:23.170752+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.170752+0000","last_undegraded":"2024-09-10T22:44:23.170752+0000","last_fullsized":"2024-09-10T22:44:23.170752+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198606+0000","last_change":"2024-09-10T22:44:24.198928+0000","last_active":"2024-09-10T22:44:25.198606+0000","last_peered":"2024-09-10T22:44:25.198606+0000","last_clean":"2024-09-10T22:44:25.198606+0000","last_became_active":"2024-09-10T22:44:24.198508+0000","last_became_peered":"2024-09-10T22:44:24.198508+0000","last_unstale":"2024-09-10T22:44:25.198606+0000","last_undegraded":"2024-09-10T22:44:25.198606+0000","last_fullsized":"2024-09-10T22:44:25.198606+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:09.617474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.171741+0000","last_change":"2024-09-10T22:44:23.171741+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.171741+0000","last_undegraded":"2024-09-10T22:44:23.171741+0000","last_fullsized":"2024-09-10T22:44:23.171741+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.170475+0000","last_change":"2024-09-10T22:44:23.170475+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.170475+0000","last_undegraded":"2024-09-10T22:44:23.170475+0000","last_fullsized":"2024-09-10T22:44:23.170475+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.180546+0000","last_change":"2024-09-10T22:44:23.180546+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.180546+0000","last_undegraded":"2024-09-10T22:44:23.180546+0000","last_fullsized":"2024-09-10T22:44:23.180546+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.168256+0000","last_change":"2024-09-10T22:44:23.168256+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.168256+0000","last_undegraded":"2024-09-10T22:44:23.168256+0000","last_fullsized":"2024-09-10T22:44:23.168256+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.173683+0000","last_change":"2024-09-10T22:44:23.173683+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.173683+0000","last_undegraded":"2024-09-10T22:44:23.173683+0000","last_fullsized":"2024-09-10T22:44:23.173683+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.171614+0000","last_change":"2024-09-10T22:44:23.171614+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.171614+0000","last_undegraded":"2024-09-10T22:44:23.171614+0000","last_fullsized":"2024-09-10T22:44:23.171614+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.179586+0000","last_change":"2024-09-10T22:44:23.179586+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.179586+0000","last_undegraded":"2024-09-10T22:44:23.179586+0000","last_fullsized":"2024-09-10T22:44:23.179586+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198801+0000","last_change":"2024-09-10T22:44:24.208790+0000","last_active":"2024-09-10T22:44:25.198801+0000","last_peered":"2024-09-10T22:44:25.198801+0000","last_clean":"2024-09-10T22:44:25.198801+0000","last_became_active":"2024-09-10T22:44:24.208540+0000","last_became_peered":"2024-09-10T22:44:24.208540+0000","last_unstale":"2024-09-10T22:44:25.198801+0000","last_undegraded":"2024-09-10T22:44:25.198801+0000","last_fullsized":"2024-09-10T22:44:25.198801+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:50.921887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.176432+0000","last_change":"2024-09-10T22:44:23.176432+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.176432+0000","last_undegraded":"2024-09-10T22:44:23.176432+0000","last_fullsized":"2024-09-10T22:44:23.176432+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.169167+0000","last_change":"2024-09-10T22:44:23.169167+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.169167+0000","last_undegraded":"2024-09-10T22:44:23.169167+0000","last_fullsized":"2024-09-10T22:44:23.169167+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.176425+0000","last_change":"2024-09-10T22:44:23.176425+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.176425+0000","last_undegraded":"2024-09-10T22:44:23.176425+0000","last_fullsized":"2024-09-10T22:44:23.176425+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.179565+0000","last_change":"2024-09-10T22:44:23.179565+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.179565+0000","last_undegraded":"2024-09-10T22:44:23.179565+0000","last_fullsized":"2024-09-10T22:44:23.179565+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.179050+0000","last_change":"2024-09-10T22:44:23.179050+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.179050+0000","last_undegraded":"2024-09-10T22:44:23.179050+0000","last_fullsized":"2024-09-10T22:44:23.179050+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.195915+0000","last_change":"2024-09-10T22:44:23.194098+0000","last_active":"2024-09-10T22:44:23.195915+0000","last_peered":"2024-09-10T22:44:23.195915+0000","last_clean":"2024-09-10T22:44:23.195915+0000","last_became_active":"2024-09-10T22:44:23.193814+0000","last_became_peered":"2024-09-10T22:44:23.193814+0000","last_unstale":"2024-09-10T22:44:23.195915+0000","last_undegraded":"2024-09-10T22:44:23.195915+0000","last_fullsized":"2024-09-10T22:44:23.195915+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:07.866030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.178351+0000","last_change":"2024-09-10T22:44:23.178351+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.178351+0000","last_undegraded":"2024-09-10T22:44:23.178351+0000","last_fullsized":"2024-09-10T22:44:23.178351+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.189946+0000","last_change":"2024-09-10T22:44:23.186842+0000","last_active":"2024-09-10T22:44:23.189946+0000","last_peered":"2024-09-10T22:44:23.189946+0000","last_clean":"2024-09-10T22:44:23.189946+0000","last_became_active":"2024-09-10T22:44:23.186437+0000","last_became_peered":"2024-09-10T22:44:23.186437+0000","last_unstale":"2024-09-10T22:44:23.189946+0000","last_undegraded":"2024-09-10T22:44:23.189946+0000","last_fullsized":"2024-09-10T22:44:23.189946+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:08.665780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.177699+0000","last_change":"2024-09-10T22:44:23.177699+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.177699+0000","last_undegraded":"2024-09-10T22:44:23.177699+0000","last_fullsized":"2024-09-10T22:44:23.177699+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.193050+0000","last_change":"2024-09-10T22:44:23.188760+0000","last_active":"2024-09-10T22:44:23.193050+0000","last_peered":"2024-09-10T22:44:23.193050+0000","last_clean":"2024-09-10T22:44:23.193050+0000","last_became_active":"2024-09-10T22:44:23.188504+0000","last_became_peered":"2024-09-10T22:44:23.188504+0000","last_unstale":"2024-09-10T22:44:23.193050+0000","last_undegraded":"2024-09-10T22:44:23.193050+0000","last_fullsized":"2024-09-10T22:44:23.193050+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:53.656054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.178054+0000","last_change":"2024-09-10T22:44:23.178054+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.178054+0000","last_undegraded":"2024-09-10T22:44:23.178054+0000","last_fullsized":"2024-09-10T22:44:23.178054+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.198411+0000","last_change":"2024-09-10T22:44:23.197426+0000","last_active":"2024-09-10T22:44:23.198411+0000","last_peered":"2024-09-10T22:44:23.198411+0000","last_clean":"2024-09-10T22:44:23.198411+0000","last_became_active":"2024-09-10T22:44:23.197108+0000","last_became_peered":"2024-09-10T22:44:23.197108+0000","last_unstale":"2024-09-10T22:44:23.198411+0000","last_undegraded":"2024-09-10T22:44:23.198411+0000","last_fullsized":"2024-09-10T22:44:23.198411+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:39.429544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197557+0000","last_change":"2024-09-10T22:44:24.202442+0000","last_active":"2024-09-10T22:44:25.197557+0000","last_peered":"2024-09-10T22:44:25.197557+0000","last_clean":"2024-09-10T22:44:25.197557+0000","last_became_active":"2024-09-10T22:44:24.197691+0000","last_became_peered":"2024-09-10T22:44:24.197691+0000","last_unstale":"2024-09-10T22:44:25.197557+0000","last_undegraded":"2024-09-10T22:44:25.197557+0000","last_fullsized":"2024-09-10T22:44:25.197557+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:43.068682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.190378+0000","last_change":"2024-09-10T22:44:23.188330+0000","last_active":"2024-09-10T22:44:23.190378+0000","last_peered":"2024-09-10T22:44:23.190378+0000","last_clean":"2024-09-10T22:44:23.190378+0000","last_became_active":"2024-09-10T22:44:23.188074+0000","last_became_peered":"2024-09-10T22:44:23.188074+0000","last_unstale":"2024-09-10T22:44:23.190378+0000","last_undegraded":"2024-09-10T22:44:23.190378+0000","last_fullsized":"2024-09-10T22:44:23.190378+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:53.660937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.177551+0000","last_change":"2024-09-10T22:44:23.177551+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.177551+0000","last_undegraded":"2024-09-10T22:44:23.177551+0000","last_fullsized":"2024-09-10T22:44:23.177551+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198372+0000","last_change":"2024-09-10T22:44:23.195943+0000","last_active":"2024-09-10T22:44:25.198372+0000","last_peered":"2024-09-10T22:44:25.198372+0000","last_clean":"2024-09-10T22:44:25.198372+0000","last_became_active":"2024-09-10T22:44:23.195678+0000","last_became_peered":"2024-09-10T22:44:23.195678+0000","last_unstale":"2024-09-10T22:44:25.198372+0000","last_undegraded":"2024-09-10T22:44:25.198372+0000","last_fullsized":"2024-09-10T22:44:25.198372+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:30.932095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.177301+0000","last_change":"2024-09-10T22:44:23.177301+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.177301+0000","last_undegraded":"2024-09-10T22:44:23.177301+0000","last_fullsized":"2024-09-10T22:44:23.177301+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.192541+0000","last_change":"2024-09-10T22:44:23.184732+0000","last_active":"2024-09-10T22:44:23.192541+0000","last_peered":"2024-09-10T22:44:23.192541+0000","last_clean":"2024-09-10T22:44:23.192541+0000","last_became_active":"2024-09-10T22:44:23.184397+0000","last_became_peered":"2024-09-10T22:44:23.184397+0000","last_unstale":"2024-09-10T22:44:23.192541+0000","last_undegraded":"2024-09-10T22:44:23.192541+0000","last_fullsized":"2024-09-10T22:44:23.192541+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:19:14.203129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199476+0000","last_change":"2024-09-10T22:44:24.202421+0000","last_active":"2024-09-10T22:44:25.199476+0000","last_peered":"2024-09-10T22:44:25.199476+0000","last_clean":"2024-09-10T22:44:25.199476+0000","last_became_active":"2024-09-10T22:44:24.202090+0000","last_became_peered":"2024-09-10T22:44:24.202090+0000","last_unstale":"2024-09-10T22:44:25.199476+0000","last_undegraded":"2024-09-10T22:44:25.199476+0000","last_fullsized":"2024-09-10T22:44:25.199476+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:34.501203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.194769+0000","last_change":"2024-09-10T22:44:23.193342+0000","last_active":"2024-09-10T22:44:23.194769+0000","last_peered":"2024-09-10T22:44:23.194769+0000","last_clean":"2024-09-10T22:44:23.194769+0000","last_became_active":"2024-09-10T22:44:23.193097+0000","last_became_peered":"2024-09-10T22:44:23.193097+0000","last_unstale":"2024-09-10T22:44:23.194769+0000","last_undegraded":"2024-09-10T22:44:23.194769+0000","last_fullsized":"2024-09-10T22:44:23.194769+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:59.916869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.169206+0000","last_change":"2024-09-10T22:44:23.169206+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.169206+0000","last_undegraded":"2024-09-10T22:44:23.169206+0000","last_fullsized":"2024-09-10T22:44:23.169206+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.190530+0000","last_change":"2024-09-10T22:44:23.188266+0000","last_active":"2024-09-10T22:44:23.190530+0000","last_peered":"2024-09-10T22:44:23.190530+0000","last_clean":"2024-09-10T22:44:23.190530+0000","last_became_active":"2024-09-10T22:44:23.187992+0000","last_became_peered":"2024-09-10T22:44:23.187992+0000","last_unstale":"2024-09-10T22:44:23.190530+0000","last_undegraded":"2024-09-10T22:44:23.190530+0000","last_fullsized":"2024-09-10T22:44:23.190530+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:06.476793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.176730+0000","last_change":"2024-09-10T22:44:23.176730+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.176730+0000","last_undegraded":"2024-09-10T22:44:23.176730+0000","last_fullsized":"2024-09-10T22:44:23.176730+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.190455+0000","last_change":"2024-09-10T22:44:23.185327+0000","last_active":"2024-09-10T22:44:23.190455+0000","last_peered":"2024-09-10T22:44:23.190455+0000","last_clean":"2024-09-10T22:44:23.190455+0000","last_became_active":"2024-09-10T22:44:23.185040+0000","last_became_peered":"2024-09-10T22:44:23.185040+0000","last_unstale":"2024-09-10T22:44:23.190455+0000","last_undegraded":"2024-09-10T22:44:23.190455+0000","last_fullsized":"2024-09-10T22:44:23.190455+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:32.513332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.168364+0000","last_change":"2024-09-10T22:44:23.168364+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.168364+0000","last_undegraded":"2024-09-10T22:44:23.168364+0000","last_fullsized":"2024-09-10T22:44:23.168364+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.186155+0000","last_change":"2024-09-10T22:44:23.184019+0000","last_active":"2024-09-10T22:44:23.186155+0000","last_peered":"2024-09-10T22:44:23.186155+0000","last_clean":"2024-09-10T22:44:23.186155+0000","last_became_active":"2024-09-10T22:44:23.183735+0000","last_became_peered":"2024-09-10T22:44:23.183735+0000","last_unstale":"2024-09-10T22:44:23.186155+0000","last_undegraded":"2024-09-10T22:44:23.186155+0000","last_fullsized":"2024-09-10T22:44:23.186155+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:05.572031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198775+0000","last_change":"2024-09-10T22:44:24.197746+0000","last_active":"2024-09-10T22:44:25.198775+0000","last_peered":"2024-09-10T22:44:25.198775+0000","last_clean":"2024-09-10T22:44:25.198775+0000","last_became_active":"2024-09-10T22:44:24.197467+0000","last_became_peered":"2024-09-10T22:44:24.197467+0000","last_unstale":"2024-09-10T22:44:25.198775+0000","last_undegraded":"2024-09-10T22:44:25.198775+0000","last_fullsized":"2024-09-10T22:44:25.198775+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:21.613577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.191864+0000","last_change":"2024-09-10T22:44:23.188843+0000","last_active":"2024-09-10T22:44:23.191864+0000","last_peered":"2024-09-10T22:44:23.191864+0000","last_clean":"2024-09-10T22:44:23.191864+0000","last_became_active":"2024-09-10T22:44:23.188570+0000","last_became_peered":"2024-09-10T22:44:23.188570+0000","last_unstale":"2024-09-10T22:44:23.191864+0000","last_undegraded":"2024-09-10T22:44:23.191864+0000","last_fullsized":"2024-09-10T22:44:23.191864+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:10.992205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197666+0000","last_change":"2024-09-10T22:44:24.201026+0000","last_active":"2024-09-10T22:44:25.197666+0000","last_peered":"2024-09-10T22:44:25.197666+0000","last_clean":"2024-09-10T22:44:25.197666+0000","last_became_active":"2024-09-10T22:44:24.197325+0000","last_became_peered":"2024-09-10T22:44:24.197325+0000","last_unstale":"2024-09-10T22:44:25.197666+0000","last_undegraded":"2024-09-10T22:44:25.197666+0000","last_fullsized":"2024-09-10T22:44:25.197666+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:48.952777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.195632+0000","last_change":"2024-09-10T22:44:23.193543+0000","last_active":"2024-09-10T22:44:23.195632+0000","last_peered":"2024-09-10T22:44:23.195632+0000","last_clean":"2024-09-10T22:44:23.195632+0000","last_became_active":"2024-09-10T22:44:23.193253+0000","last_became_peered":"2024-09-10T22:44:23.193253+0000","last_unstale":"2024-09-10T22:44:23.195632+0000","last_undegraded":"2024-09-10T22:44:23.195632+0000","last_fullsized":"2024-09-10T22:44:23.195632+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:49.790547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.169953+0000","last_change":"2024-09-10T22:44:23.169953+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.169953+0000","last_undegraded":"2024-09-10T22:44:23.169953+0000","last_fullsized":"2024-09-10T22:44:23.169953+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.186939+0000","last_change":"2024-09-10T22:44:23.179309+0000","last_active":"2024-09-10T22:44:23.186939+0000","last_peered":"2024-09-10T22:44:23.186939+0000","last_clean":"2024-09-10T22:44:23.186939+0000","last_became_active":"2024-09-10T22:44:23.177131+0000","last_became_peered":"2024-09-10T22:44:23.177131+0000","last_unstale":"2024-09-10T22:44:23.186939+0000","last_undegraded":"2024-09-10T22:44:23.186939+0000","last_fullsized":"2024-09-10T22:44:23.186939+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:24.201009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.175931+0000","last_change":"2024-09-10T22:44:23.175931+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.175931+0000","last_undegraded":"2024-09-10T22:44:23.175931+0000","last_fullsized":"2024-09-10T22:44:23.175931+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197761+0000","last_change":"2024-09-10T22:44:23.195006+0000","last_active":"2024-09-10T22:44:25.197761+0000","last_peered":"2024-09-10T22:44:25.197761+0000","last_clean":"2024-09-10T22:44:25.197761+0000","last_became_active":"2024-09-10T22:44:23.194737+0000","last_became_peered":"2024-09-10T22:44:23.194737+0000","last_unstale":"2024-09-10T22:44:25.197761+0000","last_undegraded":"2024-09-10T22:44:25.197761+0000","last_fullsized":"2024-09-10T22:44:25.197761+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:50.822823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.177660+0000","last_change":"2024-09-10T22:44:23.177660+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.177660+0000","last_undegraded":"2024-09-10T22:44:23.177660+0000","last_fullsized":"2024-09-10T22:44:23.177660+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"91'8","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197737+0000","last_change":"2024-09-10T22:44:23.195915+0000","last_active":"2024-09-10T22:44:25.197737+0000","last_peered":"2024-09-10T22:44:25.197737+0000","last_clean":"2024-09-10T22:44:25.197737+0000","last_became_active":"2024-09-10T22:44:23.195654+0000","last_became_peered":"2024-09-10T22:44:23.195654+0000","last_unstale":"2024-09-10T22:44:25.197737+0000","last_undegraded":"2024-09-10T22:44:25.197737+0000","last_fullsized":"2024-09-10T22:44:25.197737+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:01.303549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.176647+0000","last_change":"2024-09-10T22:44:23.176647+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.176647+0000","last_undegraded":"2024-09-10T22:44:23.176647+0000","last_fullsized":"2024-09-10T22:44:23.176647+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.191634+0000","last_change":"2024-09-10T22:44:23.189443+0000","last_active":"2024-09-10T22:44:23.191634+0000","last_peered":"2024-09-10T22:44:23.191634+0000","last_clean":"2024-09-10T22:44:23.191634+0000","last_became_active":"2024-09-10T22:44:23.188194+0000","last_became_peered":"2024-09-10T22:44:23.188194+0000","last_unstale":"2024-09-10T22:44:23.191634+0000","last_undegraded":"2024-09-10T22:44:23.191634+0000","last_fullsized":"2024-09-10T22:44:23.191634+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:56.779138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.178111+0000","last_change":"2024-09-10T22:44:23.178111+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.178111+0000","last_undegraded":"2024-09-10T22:44:23.178111+0000","last_fullsized":"2024-09-10T22:44:23.178111+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.192463+0000","last_change":"2024-09-10T22:44:23.187756+0000","last_active":"2024-09-10T22:44:23.192463+0000","last_peered":"2024-09-10T22:44:23.192463+0000","last_clean":"2024-09-10T22:44:23.192463+0000","last_became_active":"2024-09-10T22:44:23.187474+0000","last_became_peered":"2024-09-10T22:44:23.187474+0000","last_unstale":"2024-09-10T22:44:23.192463+0000","last_undegraded":"2024-09-10T22:44:23.192463+0000","last_fullsized":"2024-09-10T22:44:23.192463+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:53:19.805095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.171023+0000","last_change":"2024-09-10T22:44:23.171023+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.171023+0000","last_undegraded":"2024-09-10T22:44:23.171023+0000","last_fullsized":"2024-09-10T22:44:23.171023+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.193417+0000","last_change":"2024-09-10T22:44:23.192579+0000","last_active":"2024-09-10T22:44:23.193417+0000","last_peered":"2024-09-10T22:44:23.193417+0000","last_clean":"2024-09-10T22:44:23.193417+0000","last_became_active":"2024-09-10T22:44:23.191640+0000","last_became_peered":"2024-09-10T22:44:23.191640+0000","last_unstale":"2024-09-10T22:44:23.193417+0000","last_undegraded":"2024-09-10T22:44:23.193417+0000","last_fullsized":"2024-09-10T22:44:23.193417+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:44.121930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.175572+0000","last_change":"2024-09-10T22:44:23.175572+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.175572+0000","last_undegraded":"2024-09-10T22:44:23.175572+0000","last_fullsized":"2024-09-10T22:44:23.175572+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.184370+0000","last_change":"2024-09-10T22:44:23.180037+0000","last_active":"2024-09-10T22:44:23.184370+0000","last_peered":"2024-09-10T22:44:23.184370+0000","last_clean":"2024-09-10T22:44:23.184370+0000","last_became_active":"2024-09-10T22:44:23.179760+0000","last_became_peered":"2024-09-10T22:44:23.179760+0000","last_unstale":"2024-09-10T22:44:23.184370+0000","last_undegraded":"2024-09-10T22:44:23.184370+0000","last_fullsized":"2024-09-10T22:44:23.184370+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:50.593281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.172730+0000","last_change":"2024-09-10T22:44:23.172730+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.172730+0000","last_undegraded":"2024-09-10T22:44:23.172730+0000","last_fullsized":"2024-09-10T22:44:23.172730+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.199910+0000","last_change":"2024-09-10T22:44:23.196730+0000","last_active":"2024-09-10T22:44:23.199910+0000","last_peered":"2024-09-10T22:44:23.199910+0000","last_clean":"2024-09-10T22:44:23.199910+0000","last_became_active":"2024-09-10T22:44:23.195841+0000","last_became_peered":"2024-09-10T22:44:23.195841+0000","last_unstale":"2024-09-10T22:44:23.199910+0000","last_undegraded":"2024-09-10T22:44:23.199910+0000","last_fullsized":"2024-09-10T22:44:23.199910+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:58.089373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.172639+0000","last_change":"2024-09-10T22:44:23.172639+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.172639+0000","last_undegraded":"2024-09-10T22:44:23.172639+0000","last_fullsized":"2024-09-10T22:44:23.172639+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.185264+0000","last_change":"2024-09-10T22:44:23.182444+0000","last_active":"2024-09-10T22:44:23.185264+0000","last_peered":"2024-09-10T22:44:23.185264+0000","last_clean":"2024-09-10T22:44:23.185264+0000","last_became_active":"2024-09-10T22:44:23.182160+0000","last_became_peered":"2024-09-10T22:44:23.182160+0000","last_unstale":"2024-09-10T22:44:23.185264+0000","last_undegraded":"2024-09-10T22:44:23.185264+0000","last_fullsized":"2024-09-10T22:44:23.185264+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:42.122855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.176156+0000","last_change":"2024-09-10T22:44:23.176156+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.176156+0000","last_undegraded":"2024-09-10T22:44:23.176156+0000","last_fullsized":"2024-09-10T22:44:23.176156+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.195217+0000","last_change":"2024-09-10T22:44:23.190506+0000","last_active":"2024-09-10T22:44:23.195217+0000","last_peered":"2024-09-10T22:44:23.195217+0000","last_clean":"2024-09-10T22:44:23.195217+0000","last_became_active":"2024-09-10T22:44:23.187895+0000","last_became_peered":"2024-09-10T22:44:23.187895+0000","last_unstale":"2024-09-10T22:44:23.195217+0000","last_undegraded":"2024-09-10T22:44:23.195217+0000","last_fullsized":"2024-09-10T22:44:23.195217+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:12.293801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.179941+0000","last_change":"2024-09-10T22:44:23.179941+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.179941+0000","last_undegraded":"2024-09-10T22:44:23.179941+0000","last_fullsized":"2024-09-10T22:44:23.179941+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.194102+0000","last_change":"2024-09-10T22:44:23.190502+0000","last_active":"2024-09-10T22:44:23.194102+0000","last_peered":"2024-09-10T22:44:23.194102+0000","last_clean":"2024-09-10T22:44:23.194102+0000","last_became_active":"2024-09-10T22:44:23.190243+0000","last_became_peered":"2024-09-10T22:44:23.190243+0000","last_unstale":"2024-09-10T22:44:23.194102+0000","last_undegraded":"2024-09-10T22:44:23.194102+0000","last_fullsized":"2024-09-10T22:44:23.194102+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:38.009879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.175160+0000","last_change":"2024-09-10T22:44:23.175160+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.175160+0000","last_undegraded":"2024-09-10T22:44:23.175160+0000","last_fullsized":"2024-09-10T22:44:23.175160+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.181636+0000","last_change":"2024-09-10T22:44:23.177566+0000","last_active":"2024-09-10T22:44:23.181636+0000","last_peered":"2024-09-10T22:44:23.181636+0000","last_clean":"2024-09-10T22:44:23.181636+0000","last_became_active":"2024-09-10T22:44:23.177258+0000","last_became_peered":"2024-09-10T22:44:23.177258+0000","last_unstale":"2024-09-10T22:44:23.181636+0000","last_undegraded":"2024-09-10T22:44:23.181636+0000","last_fullsized":"2024-09-10T22:44:23.181636+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:47.275849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.174732+0000","last_change":"2024-09-10T22:44:23.174732+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.174732+0000","last_undegraded":"2024-09-10T22:44:23.174732+0000","last_fullsized":"2024-09-10T22:44:23.174732+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.184213+0000","last_change":"2024-09-10T22:44:23.181449+0000","last_active":"2024-09-10T22:44:23.184213+0000","last_peered":"2024-09-10T22:44:23.184213+0000","last_clean":"2024-09-10T22:44:23.184213+0000","last_became_active":"2024-09-10T22:44:23.181079+0000","last_became_peered":"2024-09-10T22:44:23.181079+0000","last_unstale":"2024-09-10T22:44:23.184213+0000","last_undegraded":"2024-09-10T22:44:23.184213+0000","last_fullsized":"2024-09-10T22:44:23.184213+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:47.138408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.173227+0000","last_change":"2024-09-10T22:44:23.173227+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.173227+0000","last_undegraded":"2024-09-10T22:44:23.173227+0000","last_fullsized":"2024-09-10T22:44:23.173227+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.194760+0000","last_change":"2024-09-10T22:44:23.191673+0000","last_active":"2024-09-10T22:44:23.194760+0000","last_peered":"2024-09-10T22:44:23.194760+0000","last_clean":"2024-09-10T22:44:23.194760+0000","last_became_active":"2024-09-10T22:44:23.191370+0000","last_became_peered":"2024-09-10T22:44:23.191370+0000","last_unstale":"2024-09-10T22:44:23.194760+0000","last_undegraded":"2024-09-10T22:44:23.194760+0000","last_fullsized":"2024-09-10T22:44:23.194760+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:40.051769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.175487+0000","last_change":"2024-09-10T22:44:23.175487+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.175487+0000","last_undegraded":"2024-09-10T22:44:23.175487+0000","last_fullsized":"2024-09-10T22:44:23.175487+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.188178+0000","last_change":"2024-09-10T22:44:23.181424+0000","last_active":"2024-09-10T22:44:23.188178+0000","last_peered":"2024-09-10T22:44:23.188178+0000","last_clean":"2024-09-10T22:44:23.188178+0000","last_became_active":"2024-09-10T22:44:23.179930+0000","last_became_peered":"2024-09-10T22:44:23.179930+0000","last_unstale":"2024-09-10T22:44:23.188178+0000","last_undegraded":"2024-09-10T22:44:23.188178+0000","last_fullsized":"2024-09-10T22:44:23.188178+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:05.430072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.168325+0000","last_change":"2024-09-10T22:44:23.168325+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.168325+0000","last_undegraded":"2024-09-10T22:44:23.168325+0000","last_fullsized":"2024-09-10T22:44:23.168325+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.184482+0000","last_change":"2024-09-10T22:44:23.180560+0000","last_active":"2024-09-10T22:44:23.184482+0000","last_peered":"2024-09-10T22:44:23.184482+0000","last_clean":"2024-09-10T22:44:23.184482+0000","last_became_active":"2024-09-10T22:44:23.180274+0000","last_became_peered":"2024-09-10T22:44:23.180274+0000","last_unstale":"2024-09-10T22:44:23.184482+0000","last_undegraded":"2024-09-10T22:44:23.184482+0000","last_fullsized":"2024-09-10T22:44:23.184482+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:46.530536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.180431+0000","last_change":"2024-09-10T22:44:23.180431+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.180431+0000","last_undegraded":"2024-09-10T22:44:23.180431+0000","last_fullsized":"2024-09-10T22:44:23.180431+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.194334+0000","last_change":"2024-09-10T22:44:23.188939+0000","last_active":"2024-09-10T22:44:23.194334+0000","last_peered":"2024-09-10T22:44:23.194334+0000","last_clean":"2024-09-10T22:44:23.194334+0000","last_became_active":"2024-09-10T22:44:23.188521+0000","last_became_peered":"2024-09-10T22:44:23.188521+0000","last_unstale":"2024-09-10T22:44:23.194334+0000","last_undegraded":"2024-09-10T22:44:23.194334+0000","last_fullsized":"2024-09-10T22:44:23.194334+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:09.115754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.174630+0000","last_change":"2024-09-10T22:44:23.174630+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.174630+0000","last_undegraded":"2024-09-10T22:44:23.174630+0000","last_fullsized":"2024-09-10T22:44:23.174630+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.194708+0000","last_change":"2024-09-10T22:44:23.192580+0000","last_active":"2024-09-10T22:44:23.194708+0000","last_peered":"2024-09-10T22:44:23.194708+0000","last_clean":"2024-09-10T22:44:23.194708+0000","last_became_active":"2024-09-10T22:44:23.192249+0000","last_became_peered":"2024-09-10T22:44:23.192249+0000","last_unstale":"2024-09-10T22:44:23.194708+0000","last_undegraded":"2024-09-10T22:44:23.194708+0000","last_fullsized":"2024-09-10T22:44:23.194708+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:57.776232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":90,"state":"creating+peering","last_fresh":"2024-09-10T22:44:23.177315+0000","last_change":"2024-09-10T22:44:23.177315+0000","last_active":"2024-09-10T22:44:23.160320+0000","last_peered":"2024-09-10T22:44:23.160320+0000","last_clean":"2024-09-10T22:44:23.160320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T22:44:23.177315+0000","last_undegraded":"2024-09-10T22:44:23.177315+0000","last_fullsized":"2024-09-10T22:44:23.177315+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198891+0000","last_change":"2024-09-10T22:44:23.194384+0000","last_active":"2024-09-10T22:44:25.198891+0000","last_peered":"2024-09-10T22:44:25.198891+0000","last_clean":"2024-09-10T22:44:25.198891+0000","last_became_active":"2024-09-10T22:44:23.194107+0000","last_became_peered":"2024-09-10T22:44:23.194107+0000","last_unstale":"2024-09-10T22:44:25.198891+0000","last_undegraded":"2024-09-10T22:44:25.198891+0000","last_fullsized":"2024-09-10T22:44:25.198891+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:56.664956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":238,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-10T22:44:23.179423+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:44:23.179423+0000","last_peered":"2024-09-10T22:44:23.179423+0000","last_clean":"2024-09-10T22:44:23.179423+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:44:23.179423+0000","last_undegraded":"2024-09-10T22:44:23.179423+0000","last_fullsized":"2024-09-10T22:44:23.179423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509512,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32848,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338992,"statfs":{"total":96636764160,"available":96603127808,"internally_reserved":0,"allocated":1695744,"data_stored":1096316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509512,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1089536,"data_stored":499281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509513,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1101824,"data_stored":505948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509512,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1101824,"data_stored":505948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509512,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1101824,"data_stored":505948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509512,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1101824,"data_stored":505948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509512,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32852,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338988,"statfs":{"total":96636764160,"available":96603123712,"internally_reserved":0,"allocated":1695744,"data_stored":1096316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1118208,"data_stored":513185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:44:29.066 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3f is not active+clean 2024-09-10T22:44:29.066 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.168772+0000', 'last_change': '2024-09-10T22:44:23.168772+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.168772+0000', 'last_undegraded': '2024-09-10T22:44:23.168772+0000', 'last_fullsized': '2024-09-10T22:44:23.168772+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T22:44:29.066 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3e is not active+clean 2024-09-10T22:44:29.066 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.173894+0000', 'last_change': '2024-09-10T22:44:23.173894+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.173894+0000', 'last_undegraded': '2024-09-10T22:44:23.173894+0000', 'last_fullsized': '2024-09-10T22:44:23.173894+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T22:44:29.067 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3d is not active+clean 2024-09-10T22:44:29.067 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.168798+0000', 'last_change': '2024-09-10T22:44:23.168798+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.168798+0000', 'last_undegraded': '2024-09-10T22:44:23.168798+0000', 'last_fullsized': '2024-09-10T22:44:23.168798+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T22:44:29.067 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3b is not active+clean 2024-09-10T22:44:29.067 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.169523+0000', 'last_change': '2024-09-10T22:44:23.169523+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.169523+0000', 'last_undegraded': '2024-09-10T22:44:23.169523+0000', 'last_fullsized': '2024-09-10T22:44:23.169523+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:44:29.067 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3a is not active+clean 2024-09-10T22:44:29.067 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.180941+0000', 'last_change': '2024-09-10T22:44:23.180941+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.180941+0000', 'last_undegraded': '2024-09-10T22:44:23.180941+0000', 'last_fullsized': '2024-09-10T22:44:23.180941+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:44:29.067 INFO:tasks.ceph.ceph_manager.ceph:PG 14.39 is not active+clean 2024-09-10T22:44:29.067 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.177044+0000', 'last_change': '2024-09-10T22:44:23.177044+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.177044+0000', 'last_undegraded': '2024-09-10T22:44:23.177044+0000', 'last_fullsized': '2024-09-10T22:44:23.177044+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T22:44:29.067 INFO:tasks.ceph.ceph_manager.ceph:PG 14.37 is not active+clean 2024-09-10T22:44:29.067 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.169870+0000', 'last_change': '2024-09-10T22:44:23.169870+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.169870+0000', 'last_undegraded': '2024-09-10T22:44:23.169870+0000', 'last_fullsized': '2024-09-10T22:44:23.169870+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:44:29.068 INFO:tasks.ceph.ceph_manager.ceph:PG 14.36 is not active+clean 2024-09-10T22:44:29.068 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.180090+0000', 'last_change': '2024-09-10T22:44:23.180090+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.180090+0000', 'last_undegraded': '2024-09-10T22:44:23.180090+0000', 'last_fullsized': '2024-09-10T22:44:23.180090+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T22:44:29.068 INFO:tasks.ceph.ceph_manager.ceph:PG 14.35 is not active+clean 2024-09-10T22:44:29.068 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.171297+0000', 'last_change': '2024-09-10T22:44:23.171297+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.171297+0000', 'last_undegraded': '2024-09-10T22:44:23.171297+0000', 'last_fullsized': '2024-09-10T22:44:23.171297+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:44:29.068 INFO:tasks.ceph.ceph_manager.ceph:PG 14.34 is not active+clean 2024-09-10T22:44:29.068 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.179040+0000', 'last_change': '2024-09-10T22:44:23.179040+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.179040+0000', 'last_undegraded': '2024-09-10T22:44:23.179040+0000', 'last_fullsized': '2024-09-10T22:44:23.179040+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T22:44:29.068 INFO:tasks.ceph.ceph_manager.ceph:PG 14.32 is not active+clean 2024-09-10T22:44:29.068 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.171199+0000', 'last_change': '2024-09-10T22:44:23.171199+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.171199+0000', 'last_undegraded': '2024-09-10T22:44:23.171199+0000', 'last_fullsized': '2024-09-10T22:44:23.171199+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:44:29.068 INFO:tasks.ceph.ceph_manager.ceph:PG 14.30 is not active+clean 2024-09-10T22:44:29.068 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.182766+0000', 'last_change': '2024-09-10T22:44:23.182766+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.182766+0000', 'last_undegraded': '2024-09-10T22:44:23.182766+0000', 'last_fullsized': '2024-09-10T22:44:23.182766+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:44:29.068 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2f is not active+clean 2024-09-10T22:44:29.068 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.179559+0000', 'last_change': '2024-09-10T22:44:23.179559+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.179559+0000', 'last_undegraded': '2024-09-10T22:44:23.179559+0000', 'last_fullsized': '2024-09-10T22:44:23.179559+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:44:29.069 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2e is not active+clean 2024-09-10T22:44:29.069 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.169080+0000', 'last_change': '2024-09-10T22:44:23.169080+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.169080+0000', 'last_undegraded': '2024-09-10T22:44:23.169080+0000', 'last_fullsized': '2024-09-10T22:44:23.169080+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T22:44:29.069 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2d is not active+clean 2024-09-10T22:44:29.069 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.170752+0000', 'last_change': '2024-09-10T22:44:23.170752+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.170752+0000', 'last_undegraded': '2024-09-10T22:44:23.170752+0000', 'last_fullsized': '2024-09-10T22:44:23.170752+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:44:29.069 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2b is not active+clean 2024-09-10T22:44:29.069 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.171741+0000', 'last_change': '2024-09-10T22:44:23.171741+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.171741+0000', 'last_undegraded': '2024-09-10T22:44:23.171741+0000', 'last_fullsized': '2024-09-10T22:44:23.171741+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:44:29.069 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2a is not active+clean 2024-09-10T22:44:29.069 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.170475+0000', 'last_change': '2024-09-10T22:44:23.170475+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.170475+0000', 'last_undegraded': '2024-09-10T22:44:23.170475+0000', 'last_fullsized': '2024-09-10T22:44:23.170475+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:44:29.069 INFO:tasks.ceph.ceph_manager.ceph:PG 14.29 is not active+clean 2024-09-10T22:44:29.069 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.180546+0000', 'last_change': '2024-09-10T22:44:23.180546+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.180546+0000', 'last_undegraded': '2024-09-10T22:44:23.180546+0000', 'last_fullsized': '2024-09-10T22:44:23.180546+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T22:44:29.070 INFO:tasks.ceph.ceph_manager.ceph:PG 14.28 is not active+clean 2024-09-10T22:44:29.070 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.168256+0000', 'last_change': '2024-09-10T22:44:23.168256+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.168256+0000', 'last_undegraded': '2024-09-10T22:44:23.168256+0000', 'last_fullsized': '2024-09-10T22:44:23.168256+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T22:44:29.070 INFO:tasks.ceph.ceph_manager.ceph:PG 14.27 is not active+clean 2024-09-10T22:44:29.070 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.173683+0000', 'last_change': '2024-09-10T22:44:23.173683+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.173683+0000', 'last_undegraded': '2024-09-10T22:44:23.173683+0000', 'last_fullsized': '2024-09-10T22:44:23.173683+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T22:44:29.070 INFO:tasks.ceph.ceph_manager.ceph:PG 14.26 is not active+clean 2024-09-10T22:44:29.070 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.171614+0000', 'last_change': '2024-09-10T22:44:23.171614+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.171614+0000', 'last_undegraded': '2024-09-10T22:44:23.171614+0000', 'last_fullsized': '2024-09-10T22:44:23.171614+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:44:29.070 INFO:tasks.ceph.ceph_manager.ceph:PG 14.25 is not active+clean 2024-09-10T22:44:29.070 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.179586+0000', 'last_change': '2024-09-10T22:44:23.179586+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.179586+0000', 'last_undegraded': '2024-09-10T22:44:23.179586+0000', 'last_fullsized': '2024-09-10T22:44:23.179586+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T22:44:29.070 INFO:tasks.ceph.ceph_manager.ceph:PG 14.23 is not active+clean 2024-09-10T22:44:29.070 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.176432+0000', 'last_change': '2024-09-10T22:44:23.176432+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.176432+0000', 'last_undegraded': '2024-09-10T22:44:23.176432+0000', 'last_fullsized': '2024-09-10T22:44:23.176432+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T22:44:29.070 INFO:tasks.ceph.ceph_manager.ceph:PG 14.22 is not active+clean 2024-09-10T22:44:29.071 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.169167+0000', 'last_change': '2024-09-10T22:44:23.169167+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.169167+0000', 'last_undegraded': '2024-09-10T22:44:23.169167+0000', 'last_fullsized': '2024-09-10T22:44:23.169167+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:44:29.071 INFO:tasks.ceph.ceph_manager.ceph:PG 14.21 is not active+clean 2024-09-10T22:44:29.071 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.176425+0000', 'last_change': '2024-09-10T22:44:23.176425+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.176425+0000', 'last_undegraded': '2024-09-10T22:44:23.176425+0000', 'last_fullsized': '2024-09-10T22:44:23.176425+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T22:44:29.071 INFO:tasks.ceph.ceph_manager.ceph:PG 14.20 is not active+clean 2024-09-10T22:44:29.071 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.179565+0000', 'last_change': '2024-09-10T22:44:23.179565+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.179565+0000', 'last_undegraded': '2024-09-10T22:44:23.179565+0000', 'last_fullsized': '2024-09-10T22:44:23.179565+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:44:29.071 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1c is not active+clean 2024-09-10T22:44:29.071 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.179050+0000', 'last_change': '2024-09-10T22:44:23.179050+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.179050+0000', 'last_undegraded': '2024-09-10T22:44:23.179050+0000', 'last_fullsized': '2024-09-10T22:44:23.179050+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:44:29.071 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1d is not active+clean 2024-09-10T22:44:29.071 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.178351+0000', 'last_change': '2024-09-10T22:44:23.178351+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.178351+0000', 'last_undegraded': '2024-09-10T22:44:23.178351+0000', 'last_fullsized': '2024-09-10T22:44:23.178351+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:44:29.071 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1e is not active+clean 2024-09-10T22:44:29.071 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.177699+0000', 'last_change': '2024-09-10T22:44:23.177699+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.177699+0000', 'last_undegraded': '2024-09-10T22:44:23.177699+0000', 'last_fullsized': '2024-09-10T22:44:23.177699+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T22:44:29.072 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1f is not active+clean 2024-09-10T22:44:29.072 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.178054+0000', 'last_change': '2024-09-10T22:44:23.178054+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.178054+0000', 'last_undegraded': '2024-09-10T22:44:23.178054+0000', 'last_fullsized': '2024-09-10T22:44:23.178054+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:44:29.072 INFO:tasks.ceph.ceph_manager.ceph:PG 14.19 is not active+clean 2024-09-10T22:44:29.072 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.177551+0000', 'last_change': '2024-09-10T22:44:23.177551+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.177551+0000', 'last_undegraded': '2024-09-10T22:44:23.177551+0000', 'last_fullsized': '2024-09-10T22:44:23.177551+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T22:44:29.072 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1a is not active+clean 2024-09-10T22:44:29.072 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.177301+0000', 'last_change': '2024-09-10T22:44:23.177301+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.177301+0000', 'last_undegraded': '2024-09-10T22:44:23.177301+0000', 'last_fullsized': '2024-09-10T22:44:23.177301+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:44:29.072 INFO:tasks.ceph.ceph_manager.ceph:PG 14.14 is not active+clean 2024-09-10T22:44:29.072 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.169206+0000', 'last_change': '2024-09-10T22:44:23.169206+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.169206+0000', 'last_undegraded': '2024-09-10T22:44:23.169206+0000', 'last_fullsized': '2024-09-10T22:44:23.169206+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:44:29.072 INFO:tasks.ceph.ceph_manager.ceph:PG 14.15 is not active+clean 2024-09-10T22:44:29.072 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.176730+0000', 'last_change': '2024-09-10T22:44:23.176730+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.176730+0000', 'last_undegraded': '2024-09-10T22:44:23.176730+0000', 'last_fullsized': '2024-09-10T22:44:23.176730+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T22:44:29.072 INFO:tasks.ceph.ceph_manager.ceph:PG 14.16 is not active+clean 2024-09-10T22:44:29.073 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.168364+0000', 'last_change': '2024-09-10T22:44:23.168364+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.168364+0000', 'last_undegraded': '2024-09-10T22:44:23.168364+0000', 'last_fullsized': '2024-09-10T22:44:23.168364+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T22:44:29.073 INFO:tasks.ceph.ceph_manager.ceph:PG 14.11 is not active+clean 2024-09-10T22:44:29.073 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.169953+0000', 'last_change': '2024-09-10T22:44:23.169953+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.169953+0000', 'last_undegraded': '2024-09-10T22:44:23.169953+0000', 'last_fullsized': '2024-09-10T22:44:23.169953+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:44:29.073 INFO:tasks.ceph.ceph_manager.ceph:PG 14.12 is not active+clean 2024-09-10T22:44:29.073 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.175931+0000', 'last_change': '2024-09-10T22:44:23.175931+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.175931+0000', 'last_undegraded': '2024-09-10T22:44:23.175931+0000', 'last_fullsized': '2024-09-10T22:44:23.175931+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T22:44:29.073 INFO:tasks.ceph.ceph_manager.ceph:PG 14.13 is not active+clean 2024-09-10T22:44:29.073 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.177660+0000', 'last_change': '2024-09-10T22:44:23.177660+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.177660+0000', 'last_undegraded': '2024-09-10T22:44:23.177660+0000', 'last_fullsized': '2024-09-10T22:44:23.177660+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T22:44:29.073 INFO:tasks.ceph.ceph_manager.ceph:PG 14.c is not active+clean 2024-09-10T22:44:29.073 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.176647+0000', 'last_change': '2024-09-10T22:44:23.176647+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.176647+0000', 'last_undegraded': '2024-09-10T22:44:23.176647+0000', 'last_fullsized': '2024-09-10T22:44:23.176647+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:44:29.073 INFO:tasks.ceph.ceph_manager.ceph:PG 14.d is not active+clean 2024-09-10T22:44:29.073 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.178111+0000', 'last_change': '2024-09-10T22:44:23.178111+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.178111+0000', 'last_undegraded': '2024-09-10T22:44:23.178111+0000', 'last_fullsized': '2024-09-10T22:44:23.178111+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T22:44:29.074 INFO:tasks.ceph.ceph_manager.ceph:PG 14.e is not active+clean 2024-09-10T22:44:29.074 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.171023+0000', 'last_change': '2024-09-10T22:44:23.171023+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.171023+0000', 'last_undegraded': '2024-09-10T22:44:23.171023+0000', 'last_fullsized': '2024-09-10T22:44:23.171023+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T22:44:29.074 INFO:tasks.ceph.ceph_manager.ceph:PG 14.8 is not active+clean 2024-09-10T22:44:29.074 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.175572+0000', 'last_change': '2024-09-10T22:44:23.175572+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.175572+0000', 'last_undegraded': '2024-09-10T22:44:23.175572+0000', 'last_fullsized': '2024-09-10T22:44:23.175572+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:44:29.074 INFO:tasks.ceph.ceph_manager.ceph:PG 14.9 is not active+clean 2024-09-10T22:44:29.074 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.172730+0000', 'last_change': '2024-09-10T22:44:23.172730+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.172730+0000', 'last_undegraded': '2024-09-10T22:44:23.172730+0000', 'last_fullsized': '2024-09-10T22:44:23.172730+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T22:44:29.074 INFO:tasks.ceph.ceph_manager.ceph:PG 14.a is not active+clean 2024-09-10T22:44:29.074 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.172639+0000', 'last_change': '2024-09-10T22:44:23.172639+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.172639+0000', 'last_undegraded': '2024-09-10T22:44:23.172639+0000', 'last_fullsized': '2024-09-10T22:44:23.172639+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T22:44:29.074 INFO:tasks.ceph.ceph_manager.ceph:PG 14.b is not active+clean 2024-09-10T22:44:29.074 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.176156+0000', 'last_change': '2024-09-10T22:44:23.176156+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.176156+0000', 'last_undegraded': '2024-09-10T22:44:23.176156+0000', 'last_fullsized': '2024-09-10T22:44:23.176156+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:44:29.075 INFO:tasks.ceph.ceph_manager.ceph:PG 14.4 is not active+clean 2024-09-10T22:44:29.075 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.179941+0000', 'last_change': '2024-09-10T22:44:23.179941+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.179941+0000', 'last_undegraded': '2024-09-10T22:44:23.179941+0000', 'last_fullsized': '2024-09-10T22:44:23.179941+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T22:44:29.075 INFO:tasks.ceph.ceph_manager.ceph:PG 14.5 is not active+clean 2024-09-10T22:44:29.075 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.175160+0000', 'last_change': '2024-09-10T22:44:23.175160+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.175160+0000', 'last_undegraded': '2024-09-10T22:44:23.175160+0000', 'last_fullsized': '2024-09-10T22:44:23.175160+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:44:29.075 INFO:tasks.ceph.ceph_manager.ceph:PG 14.6 is not active+clean 2024-09-10T22:44:29.075 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.174732+0000', 'last_change': '2024-09-10T22:44:23.174732+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.174732+0000', 'last_undegraded': '2024-09-10T22:44:23.174732+0000', 'last_fullsized': '2024-09-10T22:44:23.174732+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:44:29.075 INFO:tasks.ceph.ceph_manager.ceph:PG 14.7 is not active+clean 2024-09-10T22:44:29.075 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.173227+0000', 'last_change': '2024-09-10T22:44:23.173227+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.173227+0000', 'last_undegraded': '2024-09-10T22:44:23.173227+0000', 'last_fullsized': '2024-09-10T22:44:23.173227+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T22:44:29.075 INFO:tasks.ceph.ceph_manager.ceph:PG 14.0 is not active+clean 2024-09-10T22:44:29.075 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.175487+0000', 'last_change': '2024-09-10T22:44:23.175487+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.175487+0000', 'last_undegraded': '2024-09-10T22:44:23.175487+0000', 'last_fullsized': '2024-09-10T22:44:23.175487+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T22:44:29.076 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1 is not active+clean 2024-09-10T22:44:29.076 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.168325+0000', 'last_change': '2024-09-10T22:44:23.168325+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.168325+0000', 'last_undegraded': '2024-09-10T22:44:23.168325+0000', 'last_fullsized': '2024-09-10T22:44:23.168325+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T22:44:29.076 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2 is not active+clean 2024-09-10T22:44:29.076 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.180431+0000', 'last_change': '2024-09-10T22:44:23.180431+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.180431+0000', 'last_undegraded': '2024-09-10T22:44:23.180431+0000', 'last_fullsized': '2024-09-10T22:44:23.180431+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T22:44:29.076 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3 is not active+clean 2024-09-10T22:44:29.076 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.174630+0000', 'last_change': '2024-09-10T22:44:23.174630+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.174630+0000', 'last_undegraded': '2024-09-10T22:44:23.174630+0000', 'last_fullsized': '2024-09-10T22:44:23.174630+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T22:44:29.076 INFO:tasks.ceph.ceph_manager.ceph:PG 14.f is not active+clean 2024-09-10T22:44:29.076 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 90, 'state': 'creating+peering', 'last_fresh': '2024-09-10T22:44:23.177315+0000', 'last_change': '2024-09-10T22:44:23.177315+0000', 'last_active': '2024-09-10T22:44:23.160320+0000', 'last_peered': '2024-09-10T22:44:23.160320+0000', 'last_clean': '2024-09-10T22:44:23.160320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T22:44:23.177315+0000', 'last_undegraded': '2024-09-10T22:44:23.177315+0000', 'last_fullsized': '2024-09-10T22:44:23.177315+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 90, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'last_clean_scrub_stamp': '2024-09-10T22:44:23.160320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T22:44:29.077 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:44:29.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.237+0000 7f6e4ea00640 1 -- 172.21.15.103:0/1310748114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e480d25f0 msgr2=0x7f6e480af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:29.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.237+0000 7f6e4ea00640 1 --2- 172.21.15.103:0/1310748114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e480d25f0 0x7f6e480af720 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f6e480b0ec0 tx=0x7f6e3401c6b0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ea00640 1 -- 172.21.15.103:0/1310748114 shutdown_connections 2024-09-10T22:44:29.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ea00640 1 --2- 172.21.15.103:0/1310748114 >> v2:172.21.15.131:3300/0 conn(0x7f6e480717a0 0x7f6e480afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ea00640 1 --2- 172.21.15.103:0/1310748114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e480d25f0 0x7f6e480af720 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ea00640 1 -- 172.21.15.103:0/1310748114 >> 172.21.15.103:0/1310748114 conn(0x7f6e480d1ad0 msgr2=0x7f6e480d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:29.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ea00640 1 -- 172.21.15.103:0/1310748114 shutdown_connections 2024-09-10T22:44:29.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ea00640 1 -- 172.21.15.103:0/1310748114 wait complete. 2024-09-10T22:44:29.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ea00640 1 Processor -- start 2024-09-10T22:44:29.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ea00640 1 -- start start 2024-09-10T22:44:29.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ea00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e480717a0 0x7f6e481644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:29.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e480cfda0 0x7f6e48166350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:29.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e480d25f0 0x7f6e48164e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:29.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ea00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6e48169050 con 0x7f6e480d25f0 2024-09-10T22:44:29.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ea00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6e48168ed0 con 0x7f6e480cfda0 2024-09-10T22:44:29.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ea00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6e481691d0 con 0x7f6e480717a0 2024-09-10T22:44:29.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e480d25f0 0x7f6e48164e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:29.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e480d25f0 0x7f6e48164e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48014/0 (socket says 172.21.15.103:48014) 2024-09-10T22:44:29.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ca00640 1 -- 172.21.15.103:0/1564841662 learned_addr learned my addr 172.21.15.103:0/1564841662 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:29.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e47e00640 1 --2- 172.21.15.103:0/1564841662 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e480717a0 0x7f6e481644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:29.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e47400640 1 --2- 172.21.15.103:0/1564841662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e480cfda0 0x7f6e48166350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:29.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ca00640 1 -- 172.21.15.103:0/1564841662 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e480717a0 msgr2=0x7f6e481644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:29.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ca00640 1 --2- 172.21.15.103:0/1564841662 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e480717a0 0x7f6e481644b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ca00640 1 -- 172.21.15.103:0/1564841662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e480cfda0 msgr2=0x7f6e48166350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:29.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ca00640 1 --2- 172.21.15.103:0/1564841662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e480cfda0 0x7f6e48166350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ca00640 1 -- 172.21.15.103:0/1564841662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e480ceeb0 con 0x7f6e480d25f0 2024-09-10T22:44:29.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.241+0000 7f6e4ca00640 1 --2- 172.21.15.103:0/1564841662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e480d25f0 0x7f6e48164e10 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000ea50 tx=0x7f6e4000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:29.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.245+0000 7f6e3fe00640 1 -- 172.21.15.103:0/1564841662 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4000cdc0 con 0x7f6e480d25f0 2024-09-10T22:44:29.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.245+0000 7f6e3fe00640 1 -- 172.21.15.103:0/1564841662 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e40004c40 con 0x7f6e480d25f0 2024-09-10T22:44:29.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.245+0000 7f6e3fe00640 1 -- 172.21.15.103:0/1564841662 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e40005280 con 0x7f6e480d25f0 2024-09-10T22:44:29.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.245+0000 7f6e4ea00640 1 -- 172.21.15.103:0/1564841662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e48164ae0 con 0x7f6e480d25f0 2024-09-10T22:44:29.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.245+0000 7f6e4ea00640 1 -- 172.21.15.103:0/1564841662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e481fb610 con 0x7f6e480d25f0 2024-09-10T22:44:29.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.245+0000 7f6e4ea00640 1 -- 172.21.15.103:0/1564841662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e4815eca0 con 0x7f6e480d25f0 2024-09-10T22:44:29.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.245+0000 7f6e3fe00640 1 -- 172.21.15.103:0/1564841662 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6e4000f040 con 0x7f6e480d25f0 2024-09-10T22:44:29.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.245+0000 7f6e3fe00640 1 --2- 172.21.15.103:0/1564841662 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6e280725e0 0x7f6e28074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:29.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.245+0000 7f6e3fe00640 1 -- 172.21.15.103:0/1564841662 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6101+0+0 (secure 0 0 0) 0x7f6e40093a70 con 0x7f6e480d25f0 2024-09-10T22:44:29.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.245+0000 7f6e47e00640 1 --2- 172.21.15.103:0/1564841662 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6e280725e0 0x7f6e28074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:29.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.249+0000 7f6e47e00640 1 --2- 172.21.15.103:0/1564841662 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6e280725e0 0x7f6e28074aa0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6e38001910 tx=0x7f6e38001420 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:29.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.249+0000 7f6e3fe00640 1 -- 172.21.15.103:0/1564841662 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6e40016030 con 0x7f6e480d25f0 2024-09-10T22:44:29.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.473+0000 7f6e4ea00640 1 -- 172.21.15.103:0/1564841662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6e480b7780 con 0x7f6e480d25f0 2024-09-10T22:44:29.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.473+0000 7f6e3fe00640 1 -- 172.21.15.103:0/1564841662 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1138 (secure 0 0 0) 0x7f6e4005e8d0 con 0x7f6e480d25f0 2024-09-10T22:44:29.479 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:29.480 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":365,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":92,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":54},{"state_name":"active+clean","count":43}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":590368,"bytes_used":265527296,"bytes_avail":772828585984,"bytes_total":773094113280,"inactive_pgs_ratio":0.55670100450515747,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":89,"btime":"2024-09-10T22:44:27:201245+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7434}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-10T22:43:21.688460+0000","services":{}},"progress_events":{}} 2024-09-10T22:44:29.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.477+0000 7f6e4ea00640 1 -- 172.21.15.103:0/1564841662 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6e280725e0 msgr2=0x7f6e28074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:29.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.477+0000 7f6e4ea00640 1 --2- 172.21.15.103:0/1564841662 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6e280725e0 0x7f6e28074aa0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6e38001910 tx=0x7f6e38001420 comp rx=0 tx=0).stop 2024-09-10T22:44:29.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.477+0000 7f6e4ea00640 1 -- 172.21.15.103:0/1564841662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e480d25f0 msgr2=0x7f6e48164e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:29.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.477+0000 7f6e4ea00640 1 --2- 172.21.15.103:0/1564841662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e480d25f0 0x7f6e48164e10 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000ea50 tx=0x7f6e4000ef10 comp rx=0 tx=0).stop 2024-09-10T22:44:29.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.477+0000 7f6e4ea00640 1 -- 172.21.15.103:0/1564841662 shutdown_connections 2024-09-10T22:44:29.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.477+0000 7f6e4ea00640 1 --2- 172.21.15.103:0/1564841662 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6e280725e0 0x7f6e28074aa0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.477+0000 7f6e4ea00640 1 --2- 172.21.15.103:0/1564841662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e480d25f0 0x7f6e48164e10 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.477+0000 7f6e4ea00640 1 --2- 172.21.15.103:0/1564841662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e480cfda0 0x7f6e48166350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.477+0000 7f6e4ea00640 1 --2- 172.21.15.103:0/1564841662 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e480717a0 0x7f6e481644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.477+0000 7f6e4ea00640 1 -- 172.21.15.103:0/1564841662 >> 172.21.15.103:0/1564841662 conn(0x7f6e480d1ad0 msgr2=0x7f6e48157970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:29.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.477+0000 7f6e4ea00640 1 -- 172.21.15.103:0/1564841662 shutdown_connections 2024-09-10T22:44:29.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.477+0000 7f6e4ea00640 1 -- 172.21.15.103:0/1564841662 wait complete. 2024-09-10T22:44:29.500 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T22:44:29.500 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:44:29.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.637+0000 7f31de600640 1 -- 172.21.15.103:0/2669928981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31d80b09c0 msgr2=0x7f31d80ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:29.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.637+0000 7f31de600640 1 --2- 172.21.15.103:0/2669928981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31d80b09c0 0x7f31d80ce7d0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009840 tx=0x7f31c401c790 comp rx=0 tx=0).stop 2024-09-10T22:44:29.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.637+0000 7f31de600640 1 -- 172.21.15.103:0/2669928981 shutdown_connections 2024-09-10T22:44:29.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.637+0000 7f31de600640 1 --2- 172.21.15.103:0/2669928981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31d80b09c0 0x7f31d80ce7d0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.637+0000 7f31de600640 1 -- 172.21.15.103:0/2669928981 >> 172.21.15.103:0/2669928981 conn(0x7f31d80d1ac0 msgr2=0x7f31d80d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:29.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.637+0000 7f31de600640 1 -- 172.21.15.103:0/2669928981 shutdown_connections 2024-09-10T22:44:29.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.637+0000 7f31de600640 1 -- 172.21.15.103:0/2669928981 wait complete. 2024-09-10T22:44:29.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.637+0000 7f31de600640 1 Processor -- start 2024-09-10T22:44:29.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.637+0000 7f31de600640 1 -- start start 2024-09-10T22:44:29.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.637+0000 7f31de600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31d80ae9c0 0x7f31d8155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:29.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.637+0000 7f31de600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31d80b09c0 0x7f31d813d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:29.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.637+0000 7f31de600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31d815be30 0x7f31d81f7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:29.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.637+0000 7f31de600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f31d8169e00 con 0x7f31d80b09c0 2024-09-10T22:44:29.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.637+0000 7f31de600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f31d8169c80 con 0x7f31d815be30 2024-09-10T22:44:29.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.637+0000 7f31de600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f31d8169f80 con 0x7f31d80ae9c0 2024-09-10T22:44:29.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.641+0000 7f31d6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31d80b09c0 0x7f31d813d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:29.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.641+0000 7f31d6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31d80b09c0 0x7f31d813d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48040/0 (socket says 172.21.15.103:48040) 2024-09-10T22:44:29.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.641+0000 7f31d6a00640 1 -- 172.21.15.103:0/3515698087 learned_addr learned my addr 172.21.15.103:0/3515698087 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:29.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.641+0000 7f31d7400640 1 --2- 172.21.15.103:0/3515698087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31d80ae9c0 0x7f31d8155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:29.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.641+0000 7f31d7e00640 1 --2- 172.21.15.103:0/3515698087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31d815be30 0x7f31d81f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:29.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.641+0000 7f31d6a00640 1 -- 172.21.15.103:0/3515698087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31d80ae9c0 msgr2=0x7f31d8155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:29.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.641+0000 7f31d6a00640 1 --2- 172.21.15.103:0/3515698087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31d80ae9c0 0x7f31d8155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.641+0000 7f31d6a00640 1 -- 172.21.15.103:0/3515698087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31d815be30 msgr2=0x7f31d81f7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:29.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.641+0000 7f31d6a00640 1 --2- 172.21.15.103:0/3515698087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31d815be30 0x7f31d81f7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.641+0000 7f31d6a00640 1 -- 172.21.15.103:0/3515698087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d81fb760 con 0x7f31d80b09c0 2024-09-10T22:44:29.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.641+0000 7f31d6a00640 1 --2- 172.21.15.103:0/3515698087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31d80b09c0 0x7f31d813d9d0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009790 tx=0x7f31c4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:29.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.641+0000 7f31cf400640 1 -- 172.21.15.103:0/3515698087 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c40bb070 con 0x7f31d80b09c0 2024-09-10T22:44:29.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.641+0000 7f31cf400640 1 -- 172.21.15.103:0/3515698087 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31c4005030 con 0x7f31d80b09c0 2024-09-10T22:44:29.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.641+0000 7f31de600640 1 -- 172.21.15.103:0/3515698087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d80b4a40 con 0x7f31d80b09c0 2024-09-10T22:44:29.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.641+0000 7f31cf400640 1 -- 172.21.15.103:0/3515698087 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c40b2040 con 0x7f31d80b09c0 2024-09-10T22:44:29.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.641+0000 7f31de600640 1 -- 172.21.15.103:0/3515698087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d80b4fc0 con 0x7f31d80b09c0 2024-09-10T22:44:29.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.641+0000 7f31de600640 1 -- 172.21.15.103:0/3515698087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d80aee10 con 0x7f31d80b09c0 2024-09-10T22:44:29.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.641+0000 7f31cf400640 1 -- 172.21.15.103:0/3515698087 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f31c40b5030 con 0x7f31d80b09c0 2024-09-10T22:44:29.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.645+0000 7f31cf400640 1 --2- 172.21.15.103:0/3515698087 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31b80725e0 0x7f31b8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:29.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.645+0000 7f31cf400640 1 -- 172.21.15.103:0/3515698087 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6101+0+0 (secure 0 0 0) 0x7f31c412ce80 con 0x7f31d80b09c0 2024-09-10T22:44:29.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.645+0000 7f31d7400640 1 --2- 172.21.15.103:0/3515698087 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31b80725e0 0x7f31b8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:29.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.645+0000 7f31d7400640 1 --2- 172.21.15.103:0/3515698087 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31b80725e0 0x7f31b8074aa0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f31c8001cf0 tx=0x7f31c8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:29.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.649+0000 7f31cf400640 1 -- 172.21.15.103:0/3515698087 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f31c4016410 con 0x7f31d80b09c0 2024-09-10T22:44:29.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.813+0000 7f31de600640 1 -- 172.21.15.103:0/3515698087 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f31d815a430 con 0x7f31b80725e0 2024-09-10T22:44:29.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.817+0000 7f31cf400640 1 -- 172.21.15.103:0/3515698087 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252065 (secure 0 0 0) 0x7f31d815a430 con 0x7f31b80725e0 2024-09-10T22:44:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:29.826 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:44:29.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.821+0000 7f31de600640 1 -- 172.21.15.103:0/3515698087 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31b80725e0 msgr2=0x7f31b8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:29.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.821+0000 7f31de600640 1 --2- 172.21.15.103:0/3515698087 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31b80725e0 0x7f31b8074aa0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f31c8001cf0 tx=0x7f31c8009040 comp rx=0 tx=0).stop 2024-09-10T22:44:29.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.821+0000 7f31de600640 1 -- 172.21.15.103:0/3515698087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31d80b09c0 msgr2=0x7f31d813d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:29.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.821+0000 7f31de600640 1 --2- 172.21.15.103:0/3515698087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31d80b09c0 0x7f31d813d9d0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009790 tx=0x7f31c4004040 comp rx=0 tx=0).stop 2024-09-10T22:44:29.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.821+0000 7f31de600640 1 -- 172.21.15.103:0/3515698087 shutdown_connections 2024-09-10T22:44:29.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.821+0000 7f31de600640 1 --2- 172.21.15.103:0/3515698087 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31b80725e0 0x7f31b8074aa0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.821+0000 7f31de600640 1 --2- 172.21.15.103:0/3515698087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31d815be30 0x7f31d81f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.821+0000 7f31de600640 1 --2- 172.21.15.103:0/3515698087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31d80b09c0 0x7f31d813d9d0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.821+0000 7f31de600640 1 --2- 172.21.15.103:0/3515698087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31d80ae9c0 0x7f31d8155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:29.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.821+0000 7f31de600640 1 -- 172.21.15.103:0/3515698087 >> 172.21.15.103:0/3515698087 conn(0x7f31d80d1ac0 msgr2=0x7f31d806e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:29.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.821+0000 7f31de600640 1 -- 172.21.15.103:0/3515698087 shutdown_connections 2024-09-10T22:44:29.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:29.821+0000 7f31de600640 1 -- 172.21.15.103:0/3515698087 wait complete. 2024-09-10T22:44:29.846 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-09-10T22:44:29.706165+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259556,"kb_used_data":10012,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715164,"statfs":{"total":773094113280,"available":772828327936,"internally_reserved":0,"allocated":10252288,"data_stored":5337320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.538535"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199470+0000","last_change":"2024-09-10T22:44:24.215311+0000","last_active":"2024-09-10T22:44:25.199470+0000","last_peered":"2024-09-10T22:44:25.199470+0000","last_clean":"2024-09-10T22:44:25.199470+0000","last_became_active":"2024-09-10T22:44:24.215003+0000","last_became_peered":"2024-09-10T22:44:24.215003+0000","last_unstale":"2024-09-10T22:44:25.199470+0000","last_undegraded":"2024-09-10T22:44:25.199470+0000","last_fullsized":"2024-09-10T22:44:25.199470+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:33.303882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207854+0000","last_change":"2024-09-10T22:44:24.198124+0000","last_active":"2024-09-10T22:44:25.207854+0000","last_peered":"2024-09-10T22:44:25.207854+0000","last_clean":"2024-09-10T22:44:25.207854+0000","last_became_active":"2024-09-10T22:44:24.197850+0000","last_became_peered":"2024-09-10T22:44:24.197850+0000","last_unstale":"2024-09-10T22:44:25.207854+0000","last_undegraded":"2024-09-10T22:44:25.207854+0000","last_fullsized":"2024-09-10T22:44:25.207854+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:03.746731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198665+0000","last_change":"2024-09-10T22:44:24.207322+0000","last_active":"2024-09-10T22:44:25.198665+0000","last_peered":"2024-09-10T22:44:25.198665+0000","last_clean":"2024-09-10T22:44:25.198665+0000","last_became_active":"2024-09-10T22:44:24.207045+0000","last_became_peered":"2024-09-10T22:44:24.207045+0000","last_unstale":"2024-09-10T22:44:25.198665+0000","last_undegraded":"2024-09-10T22:44:25.198665+0000","last_fullsized":"2024-09-10T22:44:25.198665+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:09.749318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198423+0000","last_change":"2024-09-10T22:44:24.194558+0000","last_active":"2024-09-10T22:44:25.198423+0000","last_peered":"2024-09-10T22:44:25.198423+0000","last_clean":"2024-09-10T22:44:25.198423+0000","last_became_active":"2024-09-10T22:44:24.194119+0000","last_became_peered":"2024-09-10T22:44:24.194119+0000","last_unstale":"2024-09-10T22:44:25.198423+0000","last_undegraded":"2024-09-10T22:44:25.198423+0000","last_fullsized":"2024-09-10T22:44:25.198423+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:04.688517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204715+0000","last_change":"2024-09-10T22:44:24.202127+0000","last_active":"2024-09-10T22:44:25.204715+0000","last_peered":"2024-09-10T22:44:25.204715+0000","last_clean":"2024-09-10T22:44:25.204715+0000","last_became_active":"2024-09-10T22:44:24.201739+0000","last_became_peered":"2024-09-10T22:44:24.201739+0000","last_unstale":"2024-09-10T22:44:25.204715+0000","last_undegraded":"2024-09-10T22:44:25.204715+0000","last_fullsized":"2024-09-10T22:44:25.204715+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:15.423701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470548+0000","last_change":"2024-09-10T22:44:24.212306+0000","last_active":"2024-09-10T22:44:25.470548+0000","last_peered":"2024-09-10T22:44:25.470548+0000","last_clean":"2024-09-10T22:44:25.470548+0000","last_became_active":"2024-09-10T22:44:24.212053+0000","last_became_peered":"2024-09-10T22:44:24.212053+0000","last_unstale":"2024-09-10T22:44:25.470548+0000","last_undegraded":"2024-09-10T22:44:25.470548+0000","last_fullsized":"2024-09-10T22:44:25.470548+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:02.588393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199809+0000","last_change":"2024-09-10T22:44:24.208791+0000","last_active":"2024-09-10T22:44:25.199809+0000","last_peered":"2024-09-10T22:44:25.199809+0000","last_clean":"2024-09-10T22:44:25.199809+0000","last_became_active":"2024-09-10T22:44:24.208465+0000","last_became_peered":"2024-09-10T22:44:24.208465+0000","last_unstale":"2024-09-10T22:44:25.199809+0000","last_undegraded":"2024-09-10T22:44:25.199809+0000","last_fullsized":"2024-09-10T22:44:25.199809+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:36.730451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197490+0000","last_change":"2024-09-10T22:44:24.202919+0000","last_active":"2024-09-10T22:44:25.197490+0000","last_peered":"2024-09-10T22:44:25.197490+0000","last_clean":"2024-09-10T22:44:25.197490+0000","last_became_active":"2024-09-10T22:44:24.202633+0000","last_became_peered":"2024-09-10T22:44:24.202633+0000","last_unstale":"2024-09-10T22:44:25.197490+0000","last_undegraded":"2024-09-10T22:44:25.197490+0000","last_fullsized":"2024-09-10T22:44:25.197490+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:24.832375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.205075+0000","last_change":"2024-09-10T22:44:24.202407+0000","last_active":"2024-09-10T22:44:25.205075+0000","last_peered":"2024-09-10T22:44:25.205075+0000","last_clean":"2024-09-10T22:44:25.205075+0000","last_became_active":"2024-09-10T22:44:24.200840+0000","last_became_peered":"2024-09-10T22:44:24.200840+0000","last_unstale":"2024-09-10T22:44:25.205075+0000","last_undegraded":"2024-09-10T22:44:25.205075+0000","last_fullsized":"2024-09-10T22:44:25.205075+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:14.597536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470827+0000","last_change":"2024-09-10T22:44:24.191830+0000","last_active":"2024-09-10T22:44:25.470827+0000","last_peered":"2024-09-10T22:44:25.470827+0000","last_clean":"2024-09-10T22:44:25.470827+0000","last_became_active":"2024-09-10T22:44:24.191546+0000","last_became_peered":"2024-09-10T22:44:24.191546+0000","last_unstale":"2024-09-10T22:44:25.470827+0000","last_undegraded":"2024-09-10T22:44:25.470827+0000","last_fullsized":"2024-09-10T22:44:25.470827+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:48.140782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204571+0000","last_change":"2024-09-10T22:44:24.213262+0000","last_active":"2024-09-10T22:44:25.204571+0000","last_peered":"2024-09-10T22:44:25.204571+0000","last_clean":"2024-09-10T22:44:25.204571+0000","last_became_active":"2024-09-10T22:44:24.213013+0000","last_became_peered":"2024-09-10T22:44:24.213013+0000","last_unstale":"2024-09-10T22:44:25.204571+0000","last_undegraded":"2024-09-10T22:44:25.204571+0000","last_fullsized":"2024-09-10T22:44:25.204571+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:33.521343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470573+0000","last_change":"2024-09-10T22:44:24.186427+0000","last_active":"2024-09-10T22:44:25.470573+0000","last_peered":"2024-09-10T22:44:25.470573+0000","last_clean":"2024-09-10T22:44:25.470573+0000","last_became_active":"2024-09-10T22:44:24.186120+0000","last_became_peered":"2024-09-10T22:44:24.186120+0000","last_unstale":"2024-09-10T22:44:25.470573+0000","last_undegraded":"2024-09-10T22:44:25.470573+0000","last_fullsized":"2024-09-10T22:44:25.470573+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:26.022789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198071+0000","last_change":"2024-09-10T22:44:24.203861+0000","last_active":"2024-09-10T22:44:25.198071+0000","last_peered":"2024-09-10T22:44:25.198071+0000","last_clean":"2024-09-10T22:44:25.198071+0000","last_became_active":"2024-09-10T22:44:24.203535+0000","last_became_peered":"2024-09-10T22:44:24.203535+0000","last_unstale":"2024-09-10T22:44:25.198071+0000","last_undegraded":"2024-09-10T22:44:25.198071+0000","last_fullsized":"2024-09-10T22:44:25.198071+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:22.211727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204281+0000","last_change":"2024-09-10T22:44:24.204250+0000","last_active":"2024-09-10T22:44:25.204281+0000","last_peered":"2024-09-10T22:44:25.204281+0000","last_clean":"2024-09-10T22:44:25.204281+0000","last_became_active":"2024-09-10T22:44:24.202378+0000","last_became_peered":"2024-09-10T22:44:24.202378+0000","last_unstale":"2024-09-10T22:44:25.204281+0000","last_undegraded":"2024-09-10T22:44:25.204281+0000","last_fullsized":"2024-09-10T22:44:25.204281+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:39.017889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197749+0000","last_change":"2024-09-10T22:44:24.197228+0000","last_active":"2024-09-10T22:44:25.197749+0000","last_peered":"2024-09-10T22:44:25.197749+0000","last_clean":"2024-09-10T22:44:25.197749+0000","last_became_active":"2024-09-10T22:44:24.196964+0000","last_became_peered":"2024-09-10T22:44:24.196964+0000","last_unstale":"2024-09-10T22:44:25.197749+0000","last_undegraded":"2024-09-10T22:44:25.197749+0000","last_fullsized":"2024-09-10T22:44:25.197749+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:09.707330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470176+0000","last_change":"2024-09-10T22:44:24.204371+0000","last_active":"2024-09-10T22:44:25.470176+0000","last_peered":"2024-09-10T22:44:25.470176+0000","last_clean":"2024-09-10T22:44:25.470176+0000","last_became_active":"2024-09-10T22:44:24.203921+0000","last_became_peered":"2024-09-10T22:44:24.203921+0000","last_unstale":"2024-09-10T22:44:25.470176+0000","last_undegraded":"2024-09-10T22:44:25.470176+0000","last_fullsized":"2024-09-10T22:44:25.470176+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:03.288275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471310+0000","last_change":"2024-09-10T22:44:24.211924+0000","last_active":"2024-09-10T22:44:25.471310+0000","last_peered":"2024-09-10T22:44:25.471310+0000","last_clean":"2024-09-10T22:44:25.471310+0000","last_became_active":"2024-09-10T22:44:24.211638+0000","last_became_peered":"2024-09-10T22:44:24.211638+0000","last_unstale":"2024-09-10T22:44:25.471310+0000","last_undegraded":"2024-09-10T22:44:25.471310+0000","last_fullsized":"2024-09-10T22:44:25.471310+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:44.001885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199072+0000","last_change":"2024-09-10T22:44:24.193330+0000","last_active":"2024-09-10T22:44:25.199072+0000","last_peered":"2024-09-10T22:44:25.199072+0000","last_clean":"2024-09-10T22:44:25.199072+0000","last_became_active":"2024-09-10T22:44:24.193093+0000","last_became_peered":"2024-09-10T22:44:24.193093+0000","last_unstale":"2024-09-10T22:44:25.199072+0000","last_undegraded":"2024-09-10T22:44:25.199072+0000","last_fullsized":"2024-09-10T22:44:25.199072+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:47.668822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204714+0000","last_change":"2024-09-10T22:44:24.216917+0000","last_active":"2024-09-10T22:44:25.204714+0000","last_peered":"2024-09-10T22:44:25.204714+0000","last_clean":"2024-09-10T22:44:25.204714+0000","last_became_active":"2024-09-10T22:44:24.216336+0000","last_became_peered":"2024-09-10T22:44:24.216336+0000","last_unstale":"2024-09-10T22:44:25.204714+0000","last_undegraded":"2024-09-10T22:44:25.204714+0000","last_fullsized":"2024-09-10T22:44:25.204714+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:53.203981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198606+0000","last_change":"2024-09-10T22:44:24.198928+0000","last_active":"2024-09-10T22:44:25.198606+0000","last_peered":"2024-09-10T22:44:25.198606+0000","last_clean":"2024-09-10T22:44:25.198606+0000","last_became_active":"2024-09-10T22:44:24.198508+0000","last_became_peered":"2024-09-10T22:44:24.198508+0000","last_unstale":"2024-09-10T22:44:25.198606+0000","last_undegraded":"2024-09-10T22:44:25.198606+0000","last_fullsized":"2024-09-10T22:44:25.198606+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:09.617474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204309+0000","last_change":"2024-09-10T22:44:24.203762+0000","last_active":"2024-09-10T22:44:25.204309+0000","last_peered":"2024-09-10T22:44:25.204309+0000","last_clean":"2024-09-10T22:44:25.204309+0000","last_became_active":"2024-09-10T22:44:24.203140+0000","last_became_peered":"2024-09-10T22:44:24.203140+0000","last_unstale":"2024-09-10T22:44:25.204309+0000","last_undegraded":"2024-09-10T22:44:25.204309+0000","last_fullsized":"2024-09-10T22:44:25.204309+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:04.391080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204258+0000","last_change":"2024-09-10T22:44:24.202325+0000","last_active":"2024-09-10T22:44:25.204258+0000","last_peered":"2024-09-10T22:44:25.204258+0000","last_clean":"2024-09-10T22:44:25.204258+0000","last_became_active":"2024-09-10T22:44:24.202038+0000","last_became_peered":"2024-09-10T22:44:24.202038+0000","last_unstale":"2024-09-10T22:44:25.204258+0000","last_undegraded":"2024-09-10T22:44:25.204258+0000","last_fullsized":"2024-09-10T22:44:25.204258+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:53:20.813105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471664+0000","last_change":"2024-09-10T22:44:24.199627+0000","last_active":"2024-09-10T22:44:25.471664+0000","last_peered":"2024-09-10T22:44:25.471664+0000","last_clean":"2024-09-10T22:44:25.471664+0000","last_became_active":"2024-09-10T22:44:24.198780+0000","last_became_peered":"2024-09-10T22:44:24.198780+0000","last_unstale":"2024-09-10T22:44:25.471664+0000","last_undegraded":"2024-09-10T22:44:25.471664+0000","last_fullsized":"2024-09-10T22:44:25.471664+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:33.521343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197959+0000","last_change":"2024-09-10T22:44:24.207260+0000","last_active":"2024-09-10T22:44:25.197959+0000","last_peered":"2024-09-10T22:44:25.197959+0000","last_clean":"2024-09-10T22:44:25.197959+0000","last_became_active":"2024-09-10T22:44:24.206937+0000","last_became_peered":"2024-09-10T22:44:24.206937+0000","last_unstale":"2024-09-10T22:44:25.197959+0000","last_undegraded":"2024-09-10T22:44:25.197959+0000","last_fullsized":"2024-09-10T22:44:25.197959+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:03.746731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207672+0000","last_change":"2024-09-10T22:44:24.197377+0000","last_active":"2024-09-10T22:44:25.207672+0000","last_peered":"2024-09-10T22:44:25.207672+0000","last_clean":"2024-09-10T22:44:25.207672+0000","last_became_active":"2024-09-10T22:44:24.197145+0000","last_became_peered":"2024-09-10T22:44:24.197145+0000","last_unstale":"2024-09-10T22:44:25.207672+0000","last_undegraded":"2024-09-10T22:44:25.207672+0000","last_fullsized":"2024-09-10T22:44:25.207672+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:51.296991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204580+0000","last_change":"2024-09-10T22:44:24.213923+0000","last_active":"2024-09-10T22:44:25.204580+0000","last_peered":"2024-09-10T22:44:25.204580+0000","last_clean":"2024-09-10T22:44:25.204580+0000","last_became_active":"2024-09-10T22:44:24.213570+0000","last_became_peered":"2024-09-10T22:44:24.213570+0000","last_unstale":"2024-09-10T22:44:25.204580+0000","last_undegraded":"2024-09-10T22:44:25.204580+0000","last_fullsized":"2024-09-10T22:44:25.204580+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:58.784242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470752+0000","last_change":"2024-09-10T22:44:24.189211+0000","last_active":"2024-09-10T22:44:25.470752+0000","last_peered":"2024-09-10T22:44:25.470752+0000","last_clean":"2024-09-10T22:44:25.470752+0000","last_became_active":"2024-09-10T22:44:24.188729+0000","last_became_peered":"2024-09-10T22:44:24.188729+0000","last_unstale":"2024-09-10T22:44:25.470752+0000","last_undegraded":"2024-09-10T22:44:25.470752+0000","last_fullsized":"2024-09-10T22:44:25.470752+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:26.057456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198801+0000","last_change":"2024-09-10T22:44:24.208790+0000","last_active":"2024-09-10T22:44:25.198801+0000","last_peered":"2024-09-10T22:44:25.198801+0000","last_clean":"2024-09-10T22:44:25.198801+0000","last_became_active":"2024-09-10T22:44:24.208540+0000","last_became_peered":"2024-09-10T22:44:24.208540+0000","last_unstale":"2024-09-10T22:44:25.198801+0000","last_undegraded":"2024-09-10T22:44:25.198801+0000","last_fullsized":"2024-09-10T22:44:25.198801+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:50.921887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199597+0000","last_change":"2024-09-10T22:44:24.199868+0000","last_active":"2024-09-10T22:44:25.199597+0000","last_peered":"2024-09-10T22:44:25.199597+0000","last_clean":"2024-09-10T22:44:25.199597+0000","last_became_active":"2024-09-10T22:44:24.198890+0000","last_became_peered":"2024-09-10T22:44:24.198890+0000","last_unstale":"2024-09-10T22:44:25.199597+0000","last_undegraded":"2024-09-10T22:44:25.199597+0000","last_fullsized":"2024-09-10T22:44:25.199597+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:33.303882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204989+0000","last_change":"2024-09-10T22:44:24.200965+0000","last_active":"2024-09-10T22:44:25.204989+0000","last_peered":"2024-09-10T22:44:25.204989+0000","last_clean":"2024-09-10T22:44:25.204989+0000","last_became_active":"2024-09-10T22:44:24.200687+0000","last_became_peered":"2024-09-10T22:44:24.200687+0000","last_unstale":"2024-09-10T22:44:25.204989+0000","last_undegraded":"2024-09-10T22:44:25.204989+0000","last_fullsized":"2024-09-10T22:44:25.204989+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:25.792154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207454+0000","last_change":"2024-09-10T22:44:24.198687+0000","last_active":"2024-09-10T22:44:25.207454+0000","last_peered":"2024-09-10T22:44:25.207454+0000","last_clean":"2024-09-10T22:44:25.207454+0000","last_became_active":"2024-09-10T22:44:24.198160+0000","last_became_peered":"2024-09-10T22:44:24.198160+0000","last_unstale":"2024-09-10T22:44:25.207454+0000","last_undegraded":"2024-09-10T22:44:25.207454+0000","last_fullsized":"2024-09-10T22:44:25.207454+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:39.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470254+0000","last_change":"2024-09-10T22:44:24.212874+0000","last_active":"2024-09-10T22:44:25.470254+0000","last_peered":"2024-09-10T22:44:25.470254+0000","last_clean":"2024-09-10T22:44:25.470254+0000","last_became_active":"2024-09-10T22:44:24.212552+0000","last_became_peered":"2024-09-10T22:44:24.212552+0000","last_unstale":"2024-09-10T22:44:25.470254+0000","last_undegraded":"2024-09-10T22:44:25.470254+0000","last_fullsized":"2024-09-10T22:44:25.470254+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:23.290144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470874+0000","last_change":"2024-09-10T22:44:24.207309+0000","last_active":"2024-09-10T22:44:25.470874+0000","last_peered":"2024-09-10T22:44:25.470874+0000","last_clean":"2024-09-10T22:44:25.470874+0000","last_became_active":"2024-09-10T22:44:24.206781+0000","last_became_peered":"2024-09-10T22:44:24.206781+0000","last_unstale":"2024-09-10T22:44:25.470874+0000","last_undegraded":"2024-09-10T22:44:25.470874+0000","last_fullsized":"2024-09-10T22:44:25.470874+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:30.064406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"91'4","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471682+0000","last_change":"2024-09-10T22:44:23.194098+0000","last_active":"2024-09-10T22:44:25.471682+0000","last_peered":"2024-09-10T22:44:25.471682+0000","last_clean":"2024-09-10T22:44:25.471682+0000","last_became_active":"2024-09-10T22:44:23.193814+0000","last_became_peered":"2024-09-10T22:44:23.193814+0000","last_unstale":"2024-09-10T22:44:25.471682+0000","last_undegraded":"2024-09-10T22:44:25.471682+0000","last_fullsized":"2024-09-10T22:44:25.471682+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:46.530536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471163+0000","last_change":"2024-09-10T22:44:24.210514+0000","last_active":"2024-09-10T22:44:25.471163+0000","last_peered":"2024-09-10T22:44:25.471163+0000","last_clean":"2024-09-10T22:44:25.471163+0000","last_became_active":"2024-09-10T22:44:24.210212+0000","last_became_peered":"2024-09-10T22:44:24.210212+0000","last_unstale":"2024-09-10T22:44:25.471163+0000","last_undegraded":"2024-09-10T22:44:25.471163+0000","last_fullsized":"2024-09-10T22:44:25.471163+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:45.551599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204801+0000","last_change":"2024-09-10T22:44:23.186842+0000","last_active":"2024-09-10T22:44:25.204801+0000","last_peered":"2024-09-10T22:44:25.204801+0000","last_clean":"2024-09-10T22:44:25.204801+0000","last_became_active":"2024-09-10T22:44:23.186437+0000","last_became_peered":"2024-09-10T22:44:23.186437+0000","last_unstale":"2024-09-10T22:44:25.204801+0000","last_undegraded":"2024-09-10T22:44:25.204801+0000","last_fullsized":"2024-09-10T22:44:25.204801+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:41.002798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199361+0000","last_change":"2024-09-10T22:44:24.213940+0000","last_active":"2024-09-10T22:44:25.199361+0000","last_peered":"2024-09-10T22:44:25.199361+0000","last_clean":"2024-09-10T22:44:25.199361+0000","last_became_active":"2024-09-10T22:44:24.213674+0000","last_became_peered":"2024-09-10T22:44:24.213674+0000","last_unstale":"2024-09-10T22:44:25.199361+0000","last_undegraded":"2024-09-10T22:44:25.199361+0000","last_fullsized":"2024-09-10T22:44:25.199361+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:29.724657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199629+0000","last_change":"2024-09-10T22:44:23.188760+0000","last_active":"2024-09-10T22:44:25.199629+0000","last_peered":"2024-09-10T22:44:25.199629+0000","last_clean":"2024-09-10T22:44:25.199629+0000","last_became_active":"2024-09-10T22:44:23.188504+0000","last_became_peered":"2024-09-10T22:44:23.188504+0000","last_unstale":"2024-09-10T22:44:25.199629+0000","last_undegraded":"2024-09-10T22:44:25.199629+0000","last_fullsized":"2024-09-10T22:44:25.199629+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:13.589526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471375+0000","last_change":"2024-09-10T22:44:24.206195+0000","last_active":"2024-09-10T22:44:25.471375+0000","last_peered":"2024-09-10T22:44:25.471375+0000","last_clean":"2024-09-10T22:44:25.471375+0000","last_became_active":"2024-09-10T22:44:24.205945+0000","last_became_peered":"2024-09-10T22:44:24.205945+0000","last_unstale":"2024-09-10T22:44:25.471375+0000","last_undegraded":"2024-09-10T22:44:25.471375+0000","last_fullsized":"2024-09-10T22:44:25.471375+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:11.330230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471704+0000","last_change":"2024-09-10T22:44:23.197426+0000","last_active":"2024-09-10T22:44:25.471704+0000","last_peered":"2024-09-10T22:44:25.471704+0000","last_clean":"2024-09-10T22:44:25.471704+0000","last_became_active":"2024-09-10T22:44:23.197108+0000","last_became_peered":"2024-09-10T22:44:23.197108+0000","last_unstale":"2024-09-10T22:44:25.471704+0000","last_undegraded":"2024-09-10T22:44:25.471704+0000","last_fullsized":"2024-09-10T22:44:25.471704+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:32.857745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197557+0000","last_change":"2024-09-10T22:44:24.202442+0000","last_active":"2024-09-10T22:44:25.197557+0000","last_peered":"2024-09-10T22:44:25.197557+0000","last_clean":"2024-09-10T22:44:25.197557+0000","last_became_active":"2024-09-10T22:44:24.197691+0000","last_became_peered":"2024-09-10T22:44:24.197691+0000","last_unstale":"2024-09-10T22:44:25.197557+0000","last_undegraded":"2024-09-10T22:44:25.197557+0000","last_fullsized":"2024-09-10T22:44:25.197557+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:43.068682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204558+0000","last_change":"2024-09-10T22:44:23.188330+0000","last_active":"2024-09-10T22:44:25.204558+0000","last_peered":"2024-09-10T22:44:25.204558+0000","last_clean":"2024-09-10T22:44:25.204558+0000","last_became_active":"2024-09-10T22:44:23.188074+0000","last_became_peered":"2024-09-10T22:44:23.188074+0000","last_unstale":"2024-09-10T22:44:25.204558+0000","last_undegraded":"2024-09-10T22:44:25.204558+0000","last_fullsized":"2024-09-10T22:44:25.204558+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:40.971955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471484+0000","last_change":"2024-09-10T22:44:24.202396+0000","last_active":"2024-09-10T22:44:25.471484+0000","last_peered":"2024-09-10T22:44:25.471484+0000","last_clean":"2024-09-10T22:44:25.471484+0000","last_became_active":"2024-09-10T22:44:24.201498+0000","last_became_peered":"2024-09-10T22:44:24.201498+0000","last_unstale":"2024-09-10T22:44:25.471484+0000","last_undegraded":"2024-09-10T22:44:25.471484+0000","last_fullsized":"2024-09-10T22:44:25.471484+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:40.884782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198372+0000","last_change":"2024-09-10T22:44:23.195943+0000","last_active":"2024-09-10T22:44:25.198372+0000","last_peered":"2024-09-10T22:44:25.198372+0000","last_clean":"2024-09-10T22:44:25.198372+0000","last_became_active":"2024-09-10T22:44:23.195678+0000","last_became_peered":"2024-09-10T22:44:23.195678+0000","last_unstale":"2024-09-10T22:44:25.198372+0000","last_undegraded":"2024-09-10T22:44:25.198372+0000","last_fullsized":"2024-09-10T22:44:25.198372+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:30.932095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470931+0000","last_change":"2024-09-10T22:44:24.211243+0000","last_active":"2024-09-10T22:44:25.470931+0000","last_peered":"2024-09-10T22:44:25.470931+0000","last_clean":"2024-09-10T22:44:25.470931+0000","last_became_active":"2024-09-10T22:44:24.210992+0000","last_became_peered":"2024-09-10T22:44:24.210992+0000","last_unstale":"2024-09-10T22:44:25.470931+0000","last_undegraded":"2024-09-10T22:44:25.470931+0000","last_fullsized":"2024-09-10T22:44:25.470931+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:00.810040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198179+0000","last_change":"2024-09-10T22:44:23.184732+0000","last_active":"2024-09-10T22:44:25.198179+0000","last_peered":"2024-09-10T22:44:25.198179+0000","last_clean":"2024-09-10T22:44:25.198179+0000","last_became_active":"2024-09-10T22:44:23.184397+0000","last_became_peered":"2024-09-10T22:44:23.184397+0000","last_unstale":"2024-09-10T22:44:25.198179+0000","last_undegraded":"2024-09-10T22:44:25.198179+0000","last_fullsized":"2024-09-10T22:44:25.198179+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:45.636226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199476+0000","last_change":"2024-09-10T22:44:24.202421+0000","last_active":"2024-09-10T22:44:25.199476+0000","last_peered":"2024-09-10T22:44:25.199476+0000","last_clean":"2024-09-10T22:44:25.199476+0000","last_became_active":"2024-09-10T22:44:24.202090+0000","last_became_peered":"2024-09-10T22:44:24.202090+0000","last_unstale":"2024-09-10T22:44:25.199476+0000","last_undegraded":"2024-09-10T22:44:25.199476+0000","last_fullsized":"2024-09-10T22:44:25.199476+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:34.501203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199257+0000","last_change":"2024-09-10T22:44:23.193342+0000","last_active":"2024-09-10T22:44:25.199257+0000","last_peered":"2024-09-10T22:44:25.199257+0000","last_clean":"2024-09-10T22:44:25.199257+0000","last_became_active":"2024-09-10T22:44:23.193097+0000","last_became_peered":"2024-09-10T22:44:23.193097+0000","last_unstale":"2024-09-10T22:44:25.199257+0000","last_undegraded":"2024-09-10T22:44:25.199257+0000","last_fullsized":"2024-09-10T22:44:25.199257+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:56.341661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204625+0000","last_change":"2024-09-10T22:44:24.211211+0000","last_active":"2024-09-10T22:44:25.204625+0000","last_peered":"2024-09-10T22:44:25.204625+0000","last_clean":"2024-09-10T22:44:25.204625+0000","last_became_active":"2024-09-10T22:44:24.210758+0000","last_became_peered":"2024-09-10T22:44:24.210758+0000","last_unstale":"2024-09-10T22:44:25.204625+0000","last_undegraded":"2024-09-10T22:44:25.204625+0000","last_fullsized":"2024-09-10T22:44:25.204625+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:50.798557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207853+0000","last_change":"2024-09-10T22:44:23.188266+0000","last_active":"2024-09-10T22:44:25.207853+0000","last_peered":"2024-09-10T22:44:25.207853+0000","last_clean":"2024-09-10T22:44:25.207853+0000","last_became_active":"2024-09-10T22:44:23.187992+0000","last_became_peered":"2024-09-10T22:44:23.187992+0000","last_unstale":"2024-09-10T22:44:25.207853+0000","last_undegraded":"2024-09-10T22:44:25.207853+0000","last_fullsized":"2024-09-10T22:44:25.207853+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:53.656054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199617+0000","last_change":"2024-09-10T22:44:24.207405+0000","last_active":"2024-09-10T22:44:25.199617+0000","last_peered":"2024-09-10T22:44:25.199617+0000","last_clean":"2024-09-10T22:44:25.199617+0000","last_became_active":"2024-09-10T22:44:24.206912+0000","last_became_peered":"2024-09-10T22:44:24.206912+0000","last_unstale":"2024-09-10T22:44:25.199617+0000","last_undegraded":"2024-09-10T22:44:25.199617+0000","last_fullsized":"2024-09-10T22:44:25.199617+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:05.348559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199192+0000","last_change":"2024-09-10T22:44:23.185327+0000","last_active":"2024-09-10T22:44:25.199192+0000","last_peered":"2024-09-10T22:44:25.199192+0000","last_clean":"2024-09-10T22:44:25.199192+0000","last_became_active":"2024-09-10T22:44:23.185040+0000","last_became_peered":"2024-09-10T22:44:23.185040+0000","last_unstale":"2024-09-10T22:44:25.199192+0000","last_undegraded":"2024-09-10T22:44:25.199192+0000","last_fullsized":"2024-09-10T22:44:25.199192+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:53.534182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199080+0000","last_change":"2024-09-10T22:44:24.214251+0000","last_active":"2024-09-10T22:44:25.199080+0000","last_peered":"2024-09-10T22:44:25.199080+0000","last_clean":"2024-09-10T22:44:25.199080+0000","last_became_active":"2024-09-10T22:44:24.213999+0000","last_became_peered":"2024-09-10T22:44:24.213999+0000","last_unstale":"2024-09-10T22:44:25.199080+0000","last_undegraded":"2024-09-10T22:44:25.199080+0000","last_fullsized":"2024-09-10T22:44:25.199080+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:41.253063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"91'3","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204929+0000","last_change":"2024-09-10T22:44:23.184019+0000","last_active":"2024-09-10T22:44:25.204929+0000","last_peered":"2024-09-10T22:44:25.204929+0000","last_clean":"2024-09-10T22:44:25.204929+0000","last_became_active":"2024-09-10T22:44:23.183735+0000","last_became_peered":"2024-09-10T22:44:23.183735+0000","last_unstale":"2024-09-10T22:44:25.204929+0000","last_undegraded":"2024-09-10T22:44:25.204929+0000","last_fullsized":"2024-09-10T22:44:25.204929+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:00.691719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198775+0000","last_change":"2024-09-10T22:44:24.197746+0000","last_active":"2024-09-10T22:44:25.198775+0000","last_peered":"2024-09-10T22:44:25.198775+0000","last_clean":"2024-09-10T22:44:25.198775+0000","last_became_active":"2024-09-10T22:44:24.197467+0000","last_became_peered":"2024-09-10T22:44:24.197467+0000","last_unstale":"2024-09-10T22:44:25.198775+0000","last_undegraded":"2024-09-10T22:44:25.198775+0000","last_fullsized":"2024-09-10T22:44:25.198775+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:21.613577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"91'6","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471046+0000","last_change":"2024-09-10T22:44:23.188843+0000","last_active":"2024-09-10T22:44:25.471046+0000","last_peered":"2024-09-10T22:44:25.471046+0000","last_clean":"2024-09-10T22:44:25.471046+0000","last_became_active":"2024-09-10T22:44:23.188570+0000","last_became_peered":"2024-09-10T22:44:23.188570+0000","last_unstale":"2024-09-10T22:44:25.471046+0000","last_undegraded":"2024-09-10T22:44:25.471046+0000","last_fullsized":"2024-09-10T22:44:25.471046+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:40.245052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197666+0000","last_change":"2024-09-10T22:44:24.201026+0000","last_active":"2024-09-10T22:44:25.197666+0000","last_peered":"2024-09-10T22:44:25.197666+0000","last_clean":"2024-09-10T22:44:25.197666+0000","last_became_active":"2024-09-10T22:44:24.197325+0000","last_became_peered":"2024-09-10T22:44:24.197325+0000","last_unstale":"2024-09-10T22:44:25.197666+0000","last_undegraded":"2024-09-10T22:44:25.197666+0000","last_fullsized":"2024-09-10T22:44:25.197666+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:48.952777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199804+0000","last_change":"2024-09-10T22:44:23.193543+0000","last_active":"2024-09-10T22:44:25.199804+0000","last_peered":"2024-09-10T22:44:25.199804+0000","last_clean":"2024-09-10T22:44:25.199804+0000","last_became_active":"2024-09-10T22:44:23.193253+0000","last_became_peered":"2024-09-10T22:44:23.193253+0000","last_unstale":"2024-09-10T22:44:25.199804+0000","last_undegraded":"2024-09-10T22:44:25.199804+0000","last_fullsized":"2024-09-10T22:44:25.199804+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:38.021136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204248+0000","last_change":"2024-09-10T22:44:24.201841+0000","last_active":"2024-09-10T22:44:25.204248+0000","last_peered":"2024-09-10T22:44:25.204248+0000","last_clean":"2024-09-10T22:44:25.204248+0000","last_became_active":"2024-09-10T22:44:24.201344+0000","last_became_peered":"2024-09-10T22:44:24.201344+0000","last_unstale":"2024-09-10T22:44:25.204248+0000","last_undegraded":"2024-09-10T22:44:25.204248+0000","last_fullsized":"2024-09-10T22:44:25.204248+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:25.851692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470924+0000","last_change":"2024-09-10T22:44:23.179309+0000","last_active":"2024-09-10T22:44:25.470924+0000","last_peered":"2024-09-10T22:44:25.470924+0000","last_clean":"2024-09-10T22:44:25.470924+0000","last_became_active":"2024-09-10T22:44:23.177131+0000","last_became_peered":"2024-09-10T22:44:23.177131+0000","last_unstale":"2024-09-10T22:44:25.470924+0000","last_undegraded":"2024-09-10T22:44:25.470924+0000","last_fullsized":"2024-09-10T22:44:25.470924+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:04.340549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470764+0000","last_change":"2024-09-10T22:44:24.191707+0000","last_active":"2024-09-10T22:44:25.470764+0000","last_peered":"2024-09-10T22:44:25.470764+0000","last_clean":"2024-09-10T22:44:25.470764+0000","last_became_active":"2024-09-10T22:44:24.191416+0000","last_became_peered":"2024-09-10T22:44:24.191416+0000","last_unstale":"2024-09-10T22:44:25.470764+0000","last_undegraded":"2024-09-10T22:44:25.470764+0000","last_fullsized":"2024-09-10T22:44:25.470764+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:57.999311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197761+0000","last_change":"2024-09-10T22:44:23.195006+0000","last_active":"2024-09-10T22:44:25.197761+0000","last_peered":"2024-09-10T22:44:25.197761+0000","last_clean":"2024-09-10T22:44:25.197761+0000","last_became_active":"2024-09-10T22:44:23.194737+0000","last_became_peered":"2024-09-10T22:44:23.194737+0000","last_unstale":"2024-09-10T22:44:25.197761+0000","last_undegraded":"2024-09-10T22:44:25.197761+0000","last_fullsized":"2024-09-10T22:44:25.197761+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:50.822823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470485+0000","last_change":"2024-09-10T22:44:24.207762+0000","last_active":"2024-09-10T22:44:25.470485+0000","last_peered":"2024-09-10T22:44:25.470485+0000","last_clean":"2024-09-10T22:44:25.470485+0000","last_became_active":"2024-09-10T22:44:24.207437+0000","last_became_peered":"2024-09-10T22:44:24.207437+0000","last_unstale":"2024-09-10T22:44:25.470485+0000","last_undegraded":"2024-09-10T22:44:25.470485+0000","last_fullsized":"2024-09-10T22:44:25.470485+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:14.743355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"91'8","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197737+0000","last_change":"2024-09-10T22:44:23.195915+0000","last_active":"2024-09-10T22:44:25.197737+0000","last_peered":"2024-09-10T22:44:25.197737+0000","last_clean":"2024-09-10T22:44:25.197737+0000","last_became_active":"2024-09-10T22:44:23.195654+0000","last_became_peered":"2024-09-10T22:44:23.195654+0000","last_unstale":"2024-09-10T22:44:25.197737+0000","last_undegraded":"2024-09-10T22:44:25.197737+0000","last_fullsized":"2024-09-10T22:44:25.197737+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:01.303549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471002+0000","last_change":"2024-09-10T22:44:24.207022+0000","last_active":"2024-09-10T22:44:25.471002+0000","last_peered":"2024-09-10T22:44:25.471002+0000","last_clean":"2024-09-10T22:44:25.471002+0000","last_became_active":"2024-09-10T22:44:24.206462+0000","last_became_peered":"2024-09-10T22:44:24.206462+0000","last_unstale":"2024-09-10T22:44:25.471002+0000","last_undegraded":"2024-09-10T22:44:25.471002+0000","last_fullsized":"2024-09-10T22:44:25.471002+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:52.489694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471924+0000","last_change":"2024-09-10T22:44:23.189443+0000","last_active":"2024-09-10T22:44:25.471924+0000","last_peered":"2024-09-10T22:44:25.471924+0000","last_clean":"2024-09-10T22:44:25.471924+0000","last_became_active":"2024-09-10T22:44:23.188194+0000","last_became_peered":"2024-09-10T22:44:23.188194+0000","last_unstale":"2024-09-10T22:44:25.471924+0000","last_undegraded":"2024-09-10T22:44:25.471924+0000","last_fullsized":"2024-09-10T22:44:25.471924+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:50.593281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471644+0000","last_change":"2024-09-10T22:44:24.194967+0000","last_active":"2024-09-10T22:44:25.471644+0000","last_peered":"2024-09-10T22:44:25.471644+0000","last_clean":"2024-09-10T22:44:25.471644+0000","last_became_active":"2024-09-10T22:44:24.194632+0000","last_became_peered":"2024-09-10T22:44:24.194632+0000","last_unstale":"2024-09-10T22:44:25.471644+0000","last_undegraded":"2024-09-10T22:44:25.471644+0000","last_fullsized":"2024-09-10T22:44:25.471644+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:58.784242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199813+0000","last_change":"2024-09-10T22:44:23.187756+0000","last_active":"2024-09-10T22:44:25.199813+0000","last_peered":"2024-09-10T22:44:25.199813+0000","last_clean":"2024-09-10T22:44:25.199813+0000","last_became_active":"2024-09-10T22:44:23.187474+0000","last_became_peered":"2024-09-10T22:44:23.187474+0000","last_unstale":"2024-09-10T22:44:25.199813+0000","last_undegraded":"2024-09-10T22:44:25.199813+0000","last_fullsized":"2024-09-10T22:44:25.199813+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:24.784144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204739+0000","last_change":"2024-09-10T22:44:24.205267+0000","last_active":"2024-09-10T22:44:25.204739+0000","last_peered":"2024-09-10T22:44:25.204739+0000","last_clean":"2024-09-10T22:44:25.204739+0000","last_became_active":"2024-09-10T22:44:24.204952+0000","last_became_peered":"2024-09-10T22:44:24.204952+0000","last_unstale":"2024-09-10T22:44:25.204739+0000","last_undegraded":"2024-09-10T22:44:25.204739+0000","last_fullsized":"2024-09-10T22:44:25.204739+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:57.351203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204953+0000","last_change":"2024-09-10T22:44:23.192579+0000","last_active":"2024-09-10T22:44:25.204953+0000","last_peered":"2024-09-10T22:44:25.204953+0000","last_clean":"2024-09-10T22:44:25.204953+0000","last_became_active":"2024-09-10T22:44:23.191640+0000","last_became_peered":"2024-09-10T22:44:23.191640+0000","last_unstale":"2024-09-10T22:44:25.204953+0000","last_undegraded":"2024-09-10T22:44:25.204953+0000","last_fullsized":"2024-09-10T22:44:25.204953+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:17.105045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470388+0000","last_change":"2024-09-10T22:44:24.210092+0000","last_active":"2024-09-10T22:44:25.470388+0000","last_peered":"2024-09-10T22:44:25.470388+0000","last_clean":"2024-09-10T22:44:25.470388+0000","last_became_active":"2024-09-10T22:44:24.209736+0000","last_became_peered":"2024-09-10T22:44:24.209736+0000","last_unstale":"2024-09-10T22:44:25.470388+0000","last_undegraded":"2024-09-10T22:44:25.470388+0000","last_fullsized":"2024-09-10T22:44:25.470388+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:16.138386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207371+0000","last_change":"2024-09-10T22:44:23.180037+0000","last_active":"2024-09-10T22:44:25.207371+0000","last_peered":"2024-09-10T22:44:25.207371+0000","last_clean":"2024-09-10T22:44:25.207371+0000","last_became_active":"2024-09-10T22:44:23.179760+0000","last_became_peered":"2024-09-10T22:44:23.179760+0000","last_unstale":"2024-09-10T22:44:25.207371+0000","last_undegraded":"2024-09-10T22:44:25.207371+0000","last_fullsized":"2024-09-10T22:44:25.207371+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:11.739895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207454+0000","last_change":"2024-09-10T22:44:24.198411+0000","last_active":"2024-09-10T22:44:25.207454+0000","last_peered":"2024-09-10T22:44:25.207454+0000","last_clean":"2024-09-10T22:44:25.207454+0000","last_became_active":"2024-09-10T22:44:24.197767+0000","last_became_peered":"2024-09-10T22:44:24.197767+0000","last_unstale":"2024-09-10T22:44:25.207454+0000","last_undegraded":"2024-09-10T22:44:25.207454+0000","last_fullsized":"2024-09-10T22:44:25.207454+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:25.792154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470420+0000","last_change":"2024-09-10T22:44:23.196730+0000","last_active":"2024-09-10T22:44:25.470420+0000","last_peered":"2024-09-10T22:44:25.470420+0000","last_clean":"2024-09-10T22:44:25.470420+0000","last_became_active":"2024-09-10T22:44:23.195841+0000","last_became_peered":"2024-09-10T22:44:23.195841+0000","last_unstale":"2024-09-10T22:44:25.470420+0000","last_undegraded":"2024-09-10T22:44:25.470420+0000","last_fullsized":"2024-09-10T22:44:25.470420+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:07.235209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207658+0000","last_change":"2024-09-10T22:44:24.204553+0000","last_active":"2024-09-10T22:44:25.207658+0000","last_peered":"2024-09-10T22:44:25.207658+0000","last_clean":"2024-09-10T22:44:25.207658+0000","last_became_active":"2024-09-10T22:44:24.203074+0000","last_became_peered":"2024-09-10T22:44:24.203074+0000","last_unstale":"2024-09-10T22:44:25.207658+0000","last_undegraded":"2024-09-10T22:44:25.207658+0000","last_fullsized":"2024-09-10T22:44:25.207658+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:14.597536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207691+0000","last_change":"2024-09-10T22:44:23.182444+0000","last_active":"2024-09-10T22:44:25.207691+0000","last_peered":"2024-09-10T22:44:25.207691+0000","last_clean":"2024-09-10T22:44:25.207691+0000","last_became_active":"2024-09-10T22:44:23.182160+0000","last_became_peered":"2024-09-10T22:44:23.182160+0000","last_unstale":"2024-09-10T22:44:25.207691+0000","last_undegraded":"2024-09-10T22:44:25.207691+0000","last_fullsized":"2024-09-10T22:44:25.207691+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:24.843682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470939+0000","last_change":"2024-09-10T22:44:24.201689+0000","last_active":"2024-09-10T22:44:25.470939+0000","last_peered":"2024-09-10T22:44:25.470939+0000","last_clean":"2024-09-10T22:44:25.470939+0000","last_became_active":"2024-09-10T22:44:24.201421+0000","last_became_peered":"2024-09-10T22:44:24.201421+0000","last_unstale":"2024-09-10T22:44:25.470939+0000","last_undegraded":"2024-09-10T22:44:25.470939+0000","last_fullsized":"2024-09-10T22:44:25.470939+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:01.996232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470554+0000","last_change":"2024-09-10T22:44:23.190506+0000","last_active":"2024-09-10T22:44:25.470554+0000","last_peered":"2024-09-10T22:44:25.470554+0000","last_clean":"2024-09-10T22:44:25.470554+0000","last_became_active":"2024-09-10T22:44:23.187895+0000","last_became_peered":"2024-09-10T22:44:23.187895+0000","last_unstale":"2024-09-10T22:44:25.470554+0000","last_undegraded":"2024-09-10T22:44:25.470554+0000","last_fullsized":"2024-09-10T22:44:25.470554+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:52.616877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471584+0000","last_change":"2024-09-10T22:44:24.204379+0000","last_active":"2024-09-10T22:44:25.471584+0000","last_peered":"2024-09-10T22:44:25.471584+0000","last_clean":"2024-09-10T22:44:25.471584+0000","last_became_active":"2024-09-10T22:44:24.203293+0000","last_became_peered":"2024-09-10T22:44:24.203293+0000","last_unstale":"2024-09-10T22:44:25.471584+0000","last_undegraded":"2024-09-10T22:44:25.471584+0000","last_fullsized":"2024-09-10T22:44:25.471584+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:19:15.211139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.200037+0000","last_change":"2024-09-10T22:44:23.190502+0000","last_active":"2024-09-10T22:44:25.200037+0000","last_peered":"2024-09-10T22:44:25.200037+0000","last_clean":"2024-09-10T22:44:25.200037+0000","last_became_active":"2024-09-10T22:44:23.190243+0000","last_became_peered":"2024-09-10T22:44:23.190243+0000","last_unstale":"2024-09-10T22:44:25.200037+0000","last_undegraded":"2024-09-10T22:44:25.200037+0000","last_fullsized":"2024-09-10T22:44:25.200037+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:55.992567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471220+0000","last_change":"2024-09-10T22:44:24.211164+0000","last_active":"2024-09-10T22:44:25.471220+0000","last_peered":"2024-09-10T22:44:25.471220+0000","last_clean":"2024-09-10T22:44:25.471220+0000","last_became_active":"2024-09-10T22:44:24.210908+0000","last_became_peered":"2024-09-10T22:44:24.210908+0000","last_unstale":"2024-09-10T22:44:25.471220+0000","last_undegraded":"2024-09-10T22:44:25.471220+0000","last_fullsized":"2024-09-10T22:44:25.471220+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:21:55.105875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"92'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204942+0000","last_change":"2024-09-10T22:44:23.177566+0000","last_active":"2024-09-10T22:44:25.204942+0000","last_peered":"2024-09-10T22:44:25.204942+0000","last_clean":"2024-09-10T22:44:25.204942+0000","last_became_active":"2024-09-10T22:44:23.177258+0000","last_became_peered":"2024-09-10T22:44:23.177258+0000","last_unstale":"2024-09-10T22:44:25.204942+0000","last_undegraded":"2024-09-10T22:44:25.204942+0000","last_fullsized":"2024-09-10T22:44:25.204942+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:09.898402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471390+0000","last_change":"2024-09-10T22:44:24.214646+0000","last_active":"2024-09-10T22:44:25.471390+0000","last_peered":"2024-09-10T22:44:25.471390+0000","last_clean":"2024-09-10T22:44:25.471390+0000","last_became_active":"2024-09-10T22:44:24.214338+0000","last_became_peered":"2024-09-10T22:44:24.214338+0000","last_unstale":"2024-09-10T22:44:25.471390+0000","last_undegraded":"2024-09-10T22:44:25.471390+0000","last_fullsized":"2024-09-10T22:44:25.471390+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:47.576757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.205051+0000","last_change":"2024-09-10T22:44:23.181449+0000","last_active":"2024-09-10T22:44:25.205051+0000","last_peered":"2024-09-10T22:44:25.205051+0000","last_clean":"2024-09-10T22:44:25.205051+0000","last_became_active":"2024-09-10T22:44:23.181079+0000","last_became_peered":"2024-09-10T22:44:23.181079+0000","last_unstale":"2024-09-10T22:44:25.205051+0000","last_undegraded":"2024-09-10T22:44:25.205051+0000","last_fullsized":"2024-09-10T22:44:25.205051+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:29:42.223967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207777+0000","last_change":"2024-09-10T22:44:24.205034+0000","last_active":"2024-09-10T22:44:25.207777+0000","last_peered":"2024-09-10T22:44:25.207777+0000","last_clean":"2024-09-10T22:44:25.207777+0000","last_became_active":"2024-09-10T22:44:24.204638+0000","last_became_peered":"2024-09-10T22:44:24.204638+0000","last_unstale":"2024-09-10T22:44:25.207777+0000","last_undegraded":"2024-09-10T22:44:25.207777+0000","last_fullsized":"2024-09-10T22:44:25.207777+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:35.621454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471797+0000","last_change":"2024-09-10T22:44:23.191673+0000","last_active":"2024-09-10T22:44:25.471797+0000","last_peered":"2024-09-10T22:44:25.471797+0000","last_clean":"2024-09-10T22:44:25.471797+0000","last_became_active":"2024-09-10T22:44:23.191370+0000","last_became_peered":"2024-09-10T22:44:23.191370+0000","last_unstale":"2024-09-10T22:44:25.471797+0000","last_undegraded":"2024-09-10T22:44:25.471797+0000","last_fullsized":"2024-09-10T22:44:25.471797+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:07.977455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470445+0000","last_change":"2024-09-10T22:44:24.203036+0000","last_active":"2024-09-10T22:44:25.470445+0000","last_peered":"2024-09-10T22:44:25.470445+0000","last_clean":"2024-09-10T22:44:25.470445+0000","last_became_active":"2024-09-10T22:44:24.202753+0000","last_became_peered":"2024-09-10T22:44:24.202753+0000","last_unstale":"2024-09-10T22:44:25.470445+0000","last_undegraded":"2024-09-10T22:44:25.470445+0000","last_fullsized":"2024-09-10T22:44:25.470445+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:39.399881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471083+0000","last_change":"2024-09-10T22:44:23.181424+0000","last_active":"2024-09-10T22:44:25.471083+0000","last_peered":"2024-09-10T22:44:25.471083+0000","last_clean":"2024-09-10T22:44:25.471083+0000","last_became_active":"2024-09-10T22:44:23.179930+0000","last_became_peered":"2024-09-10T22:44:23.179930+0000","last_unstale":"2024-09-10T22:44:25.471083+0000","last_undegraded":"2024-09-10T22:44:25.471083+0000","last_fullsized":"2024-09-10T22:44:25.471083+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:02.518381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198040+0000","last_change":"2024-09-10T22:44:24.197878+0000","last_active":"2024-09-10T22:44:25.198040+0000","last_peered":"2024-09-10T22:44:25.198040+0000","last_clean":"2024-09-10T22:44:25.198040+0000","last_became_active":"2024-09-10T22:44:24.197514+0000","last_became_peered":"2024-09-10T22:44:24.197514+0000","last_unstale":"2024-09-10T22:44:25.198040+0000","last_undegraded":"2024-09-10T22:44:25.198040+0000","last_fullsized":"2024-09-10T22:44:25.198040+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:14.347409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207801+0000","last_change":"2024-09-10T22:44:23.180560+0000","last_active":"2024-09-10T22:44:25.207801+0000","last_peered":"2024-09-10T22:44:25.207801+0000","last_clean":"2024-09-10T22:44:25.207801+0000","last_became_active":"2024-09-10T22:44:23.180274+0000","last_became_peered":"2024-09-10T22:44:23.180274+0000","last_unstale":"2024-09-10T22:44:25.207801+0000","last_undegraded":"2024-09-10T22:44:25.207801+0000","last_fullsized":"2024-09-10T22:44:25.207801+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:53:19.805095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471417+0000","last_change":"2024-09-10T22:44:24.193744+0000","last_active":"2024-09-10T22:44:25.471417+0000","last_peered":"2024-09-10T22:44:25.471417+0000","last_clean":"2024-09-10T22:44:25.471417+0000","last_became_active":"2024-09-10T22:44:24.192297+0000","last_became_peered":"2024-09-10T22:44:24.192297+0000","last_unstale":"2024-09-10T22:44:25.471417+0000","last_undegraded":"2024-09-10T22:44:25.471417+0000","last_fullsized":"2024-09-10T22:44:25.471417+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:04.391080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471846+0000","last_change":"2024-09-10T22:44:23.188939+0000","last_active":"2024-09-10T22:44:25.471846+0000","last_peered":"2024-09-10T22:44:25.471846+0000","last_clean":"2024-09-10T22:44:25.471846+0000","last_became_active":"2024-09-10T22:44:23.188521+0000","last_became_peered":"2024-09-10T22:44:23.188521+0000","last_unstale":"2024-09-10T22:44:25.471846+0000","last_undegraded":"2024-09-10T22:44:25.471846+0000","last_fullsized":"2024-09-10T22:44:25.471846+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:43.033819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471031+0000","last_change":"2024-09-10T22:44:24.211980+0000","last_active":"2024-09-10T22:44:25.471031+0000","last_peered":"2024-09-10T22:44:25.471031+0000","last_clean":"2024-09-10T22:44:25.471031+0000","last_became_active":"2024-09-10T22:44:24.211615+0000","last_became_peered":"2024-09-10T22:44:24.211615+0000","last_unstale":"2024-09-10T22:44:25.471031+0000","last_undegraded":"2024-09-10T22:44:25.471031+0000","last_fullsized":"2024-09-10T22:44:25.471031+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:55.445260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199408+0000","last_change":"2024-09-10T22:44:23.192580+0000","last_active":"2024-09-10T22:44:25.199408+0000","last_peered":"2024-09-10T22:44:25.199408+0000","last_clean":"2024-09-10T22:44:25.199408+0000","last_became_active":"2024-09-10T22:44:23.192249+0000","last_became_peered":"2024-09-10T22:44:23.192249+0000","last_unstale":"2024-09-10T22:44:25.199408+0000","last_undegraded":"2024-09-10T22:44:25.199408+0000","last_fullsized":"2024-09-10T22:44:25.199408+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:14.415691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.200030+0000","last_change":"2024-09-10T22:44:24.211635+0000","last_active":"2024-09-10T22:44:25.200030+0000","last_peered":"2024-09-10T22:44:25.200030+0000","last_clean":"2024-09-10T22:44:25.200030+0000","last_became_active":"2024-09-10T22:44:24.211338+0000","last_became_peered":"2024-09-10T22:44:24.211338+0000","last_unstale":"2024-09-10T22:44:25.200030+0000","last_undegraded":"2024-09-10T22:44:25.200030+0000","last_fullsized":"2024-09-10T22:44:25.200030+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:34.552337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198891+0000","last_change":"2024-09-10T22:44:23.194384+0000","last_active":"2024-09-10T22:44:25.198891+0000","last_peered":"2024-09-10T22:44:25.198891+0000","last_clean":"2024-09-10T22:44:25.198891+0000","last_became_active":"2024-09-10T22:44:23.194107+0000","last_became_peered":"2024-09-10T22:44:23.194107+0000","last_unstale":"2024-09-10T22:44:25.198891+0000","last_undegraded":"2024-09-10T22:44:25.198891+0000","last_fullsized":"2024-09-10T22:44:25.198891+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:56.664956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":242,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199419+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:44:25.199419+0000","last_peered":"2024-09-10T22:44:25.199419+0000","last_clean":"2024-09-10T22:44:25.199419+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:44:25.199419+0000","last_undegraded":"2024-09-10T22:44:25.199419+0000","last_fullsized":"2024-09-10T22:44:25.199419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509513,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1728512,"data_stored":1110231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509513,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1146880,"data_stored":522023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509514,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1126400,"data_stored":519807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509513,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1134592,"data_stored":519967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509513,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1126400,"data_stored":519807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509513,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1126400,"data_stored":519807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509513,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1744896,"data_stored":1112493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1118208,"data_stored":513185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:44:32.851 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:44:33.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:32.997+0000 7f05fdc00640 1 -- 172.21.15.103:0/296386190 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05f815ece0 msgr2=0x7f05f806f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:33.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:32.997+0000 7f05fdc00640 1 --2- 172.21.15.103:0/296386190 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05f815ece0 0x7f05f806f450 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009900 tx=0x7f05e801c8e0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:32.997+0000 7f05fdc00640 1 -- 172.21.15.103:0/296386190 shutdown_connections 2024-09-10T22:44:33.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:32.997+0000 7f05fdc00640 1 --2- 172.21.15.103:0/296386190 >> v2:172.21.15.131:3300/0 conn(0x7f05f80afcb0 0x7f05f80cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:32.997+0000 7f05fdc00640 1 --2- 172.21.15.103:0/296386190 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05f815ece0 0x7f05f806f450 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:32.997+0000 7f05fdc00640 1 -- 172.21.15.103:0/296386190 >> 172.21.15.103:0/296386190 conn(0x7f05f80d0780 msgr2=0x7f05f80d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:33.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:32.997+0000 7f05fdc00640 1 -- 172.21.15.103:0/296386190 shutdown_connections 2024-09-10T22:44:33.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:32.997+0000 7f05fdc00640 1 -- 172.21.15.103:0/296386190 wait complete. 2024-09-10T22:44:33.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fdc00640 1 Processor -- start 2024-09-10T22:44:33.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fdc00640 1 -- start start 2024-09-10T22:44:33.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fdc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05f80afcb0 0x7f05f814b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:33.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fdc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05f80ccc10 0x7f05f80b5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:33.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fdc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05f815ece0 0x7f05f8156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:33.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fdc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f05f8168830 con 0x7f05f815ece0 2024-09-10T22:44:33.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fdc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f05f81686b0 con 0x7f05f80afcb0 2024-09-10T22:44:33.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fdc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f05f81689b0 con 0x7f05f80ccc10 2024-09-10T22:44:33.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fd200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05f815ece0 0x7f05f8156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:33.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fd200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05f815ece0 0x7f05f8156f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48050/0 (socket says 172.21.15.103:48050) 2024-09-10T22:44:33.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fd200640 1 -- 172.21.15.103:0/699534043 learned_addr learned my addr 172.21.15.103:0/699534043 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:33.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05f7400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05f80ccc10 0x7f05f80b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:33.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05f7e00640 1 --2- 172.21.15.103:0/699534043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05f80afcb0 0x7f05f814b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:33.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fd200640 1 -- 172.21.15.103:0/699534043 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05f80ccc10 msgr2=0x7f05f80b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:33.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fd200640 1 --2- 172.21.15.103:0/699534043 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05f80ccc10 0x7f05f80b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fd200640 1 -- 172.21.15.103:0/699534043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05f80afcb0 msgr2=0x7f05f814b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:33.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fd200640 1 --2- 172.21.15.103:0/699534043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05f80afcb0 0x7f05f814b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fd200640 1 -- 172.21.15.103:0/699534043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f81fb730 con 0x7f05f815ece0 2024-09-10T22:44:33.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05f7400640 1 --2- 172.21.15.103:0/699534043 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05f80ccc10 0x7f05f80b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:44:33.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05f7e00640 1 --2- 172.21.15.103:0/699534043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05f80afcb0 0x7f05f814b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:44:33.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fd200640 1 --2- 172.21.15.103:0/699534043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05f815ece0 0x7f05f8156f10 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f05f000c760 tx=0x7f05f000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05efe00640 1 -- 172.21.15.103:0/699534043 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0003b80 con 0x7f05f815ece0 2024-09-10T22:44:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05efe00640 1 -- 172.21.15.103:0/699534043 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05f0003d40 con 0x7f05f815ece0 2024-09-10T22:44:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fdc00640 1 -- 172.21.15.103:0/699534043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f81fba10 con 0x7f05f815ece0 2024-09-10T22:44:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05efe00640 1 -- 172.21.15.103:0/699534043 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f000aab0 con 0x7f05f815ece0 2024-09-10T22:44:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fdc00640 1 -- 172.21.15.103:0/699534043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f81fbfd0 con 0x7f05f815ece0 2024-09-10T22:44:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.001+0000 7f05fdc00640 1 -- 172.21.15.103:0/699534043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f80cc6d0 con 0x7f05f815ece0 2024-09-10T22:44:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.005+0000 7f05efe00640 1 -- 172.21.15.103:0/699534043 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f05f000ac50 con 0x7f05f815ece0 2024-09-10T22:44:33.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.005+0000 7f05efe00640 1 --2- 172.21.15.103:0/699534043 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05d80725e0 0x7f05d8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.005+0000 7f05efe00640 1 -- 172.21.15.103:0/699534043 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6217+0+0 (secure 0 0 0) 0x7f05f0093070 con 0x7f05f815ece0 2024-09-10T22:44:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.005+0000 7f05f7e00640 1 --2- 172.21.15.103:0/699534043 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05d80725e0 0x7f05d8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.005+0000 7f05f7e00640 1 --2- 172.21.15.103:0/699534043 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05d80725e0 0x7f05d8074aa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f05e80af000 tx=0x7f05e801b120 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:33.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.009+0000 7f05efe00640 1 -- 172.21.15.103:0/699534043 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f05f005def0 con 0x7f05f815ece0 2024-09-10T22:44:33.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.169+0000 7f05fdc00640 1 -- 172.21.15.103:0/699534043 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f05f81568f0 con 0x7f05d80725e0 2024-09-10T22:44:33.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.177+0000 7f05efe00640 1 -- 172.21.15.103:0/699534043 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252053 (secure 0 0 0) 0x7f05f81568f0 con 0x7f05d80725e0 2024-09-10T22:44:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:33.184 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:44:33.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.181+0000 7f05fdc00640 1 -- 172.21.15.103:0/699534043 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05d80725e0 msgr2=0x7f05d8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:33.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.181+0000 7f05fdc00640 1 --2- 172.21.15.103:0/699534043 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05d80725e0 0x7f05d8074aa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f05e80af000 tx=0x7f05e801b120 comp rx=0 tx=0).stop 2024-09-10T22:44:33.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.181+0000 7f05fdc00640 1 -- 172.21.15.103:0/699534043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05f815ece0 msgr2=0x7f05f8156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:33.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.181+0000 7f05fdc00640 1 --2- 172.21.15.103:0/699534043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05f815ece0 0x7f05f8156f10 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f05f000c760 tx=0x7f05f000cc20 comp rx=0 tx=0).stop 2024-09-10T22:44:33.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.181+0000 7f05fdc00640 1 -- 172.21.15.103:0/699534043 shutdown_connections 2024-09-10T22:44:33.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.181+0000 7f05fdc00640 1 --2- 172.21.15.103:0/699534043 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f05d80725e0 0x7f05d8074aa0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.181+0000 7f05fdc00640 1 --2- 172.21.15.103:0/699534043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05f815ece0 0x7f05f8156f10 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.181+0000 7f05fdc00640 1 --2- 172.21.15.103:0/699534043 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05f80ccc10 0x7f05f80b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.181+0000 7f05fdc00640 1 --2- 172.21.15.103:0/699534043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05f80afcb0 0x7f05f814b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.181+0000 7f05fdc00640 1 -- 172.21.15.103:0/699534043 >> 172.21.15.103:0/699534043 conn(0x7f05f80d0780 msgr2=0x7f05f80b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:33.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.181+0000 7f05fdc00640 1 -- 172.21.15.103:0/699534043 shutdown_connections 2024-09-10T22:44:33.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.181+0000 7f05fdc00640 1 -- 172.21.15.103:0/699534043 wait complete. 2024-09-10T22:44:33.203 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-09-10T22:44:32.229292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259560,"kb_used_data":10024,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715160,"statfs":{"total":773094113280,"available":772828323840,"internally_reserved":0,"allocated":10264576,"data_stored":5344012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.048714"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199470+0000","last_change":"2024-09-10T22:44:24.215311+0000","last_active":"2024-09-10T22:44:25.199470+0000","last_peered":"2024-09-10T22:44:25.199470+0000","last_clean":"2024-09-10T22:44:25.199470+0000","last_became_active":"2024-09-10T22:44:24.215003+0000","last_became_peered":"2024-09-10T22:44:24.215003+0000","last_unstale":"2024-09-10T22:44:25.199470+0000","last_undegraded":"2024-09-10T22:44:25.199470+0000","last_fullsized":"2024-09-10T22:44:25.199470+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:33.303882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207854+0000","last_change":"2024-09-10T22:44:24.198124+0000","last_active":"2024-09-10T22:44:25.207854+0000","last_peered":"2024-09-10T22:44:25.207854+0000","last_clean":"2024-09-10T22:44:25.207854+0000","last_became_active":"2024-09-10T22:44:24.197850+0000","last_became_peered":"2024-09-10T22:44:24.197850+0000","last_unstale":"2024-09-10T22:44:25.207854+0000","last_undegraded":"2024-09-10T22:44:25.207854+0000","last_fullsized":"2024-09-10T22:44:25.207854+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:03.746731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198665+0000","last_change":"2024-09-10T22:44:24.207322+0000","last_active":"2024-09-10T22:44:25.198665+0000","last_peered":"2024-09-10T22:44:25.198665+0000","last_clean":"2024-09-10T22:44:25.198665+0000","last_became_active":"2024-09-10T22:44:24.207045+0000","last_became_peered":"2024-09-10T22:44:24.207045+0000","last_unstale":"2024-09-10T22:44:25.198665+0000","last_undegraded":"2024-09-10T22:44:25.198665+0000","last_fullsized":"2024-09-10T22:44:25.198665+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:09.749318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198423+0000","last_change":"2024-09-10T22:44:24.194558+0000","last_active":"2024-09-10T22:44:25.198423+0000","last_peered":"2024-09-10T22:44:25.198423+0000","last_clean":"2024-09-10T22:44:25.198423+0000","last_became_active":"2024-09-10T22:44:24.194119+0000","last_became_peered":"2024-09-10T22:44:24.194119+0000","last_unstale":"2024-09-10T22:44:25.198423+0000","last_undegraded":"2024-09-10T22:44:25.198423+0000","last_fullsized":"2024-09-10T22:44:25.198423+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:04.688517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204715+0000","last_change":"2024-09-10T22:44:24.202127+0000","last_active":"2024-09-10T22:44:25.204715+0000","last_peered":"2024-09-10T22:44:25.204715+0000","last_clean":"2024-09-10T22:44:25.204715+0000","last_became_active":"2024-09-10T22:44:24.201739+0000","last_became_peered":"2024-09-10T22:44:24.201739+0000","last_unstale":"2024-09-10T22:44:25.204715+0000","last_undegraded":"2024-09-10T22:44:25.204715+0000","last_fullsized":"2024-09-10T22:44:25.204715+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:15.423701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470548+0000","last_change":"2024-09-10T22:44:24.212306+0000","last_active":"2024-09-10T22:44:25.470548+0000","last_peered":"2024-09-10T22:44:25.470548+0000","last_clean":"2024-09-10T22:44:25.470548+0000","last_became_active":"2024-09-10T22:44:24.212053+0000","last_became_peered":"2024-09-10T22:44:24.212053+0000","last_unstale":"2024-09-10T22:44:25.470548+0000","last_undegraded":"2024-09-10T22:44:25.470548+0000","last_fullsized":"2024-09-10T22:44:25.470548+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:02.588393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199809+0000","last_change":"2024-09-10T22:44:24.208791+0000","last_active":"2024-09-10T22:44:25.199809+0000","last_peered":"2024-09-10T22:44:25.199809+0000","last_clean":"2024-09-10T22:44:25.199809+0000","last_became_active":"2024-09-10T22:44:24.208465+0000","last_became_peered":"2024-09-10T22:44:24.208465+0000","last_unstale":"2024-09-10T22:44:25.199809+0000","last_undegraded":"2024-09-10T22:44:25.199809+0000","last_fullsized":"2024-09-10T22:44:25.199809+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:36.730451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197490+0000","last_change":"2024-09-10T22:44:24.202919+0000","last_active":"2024-09-10T22:44:25.197490+0000","last_peered":"2024-09-10T22:44:25.197490+0000","last_clean":"2024-09-10T22:44:25.197490+0000","last_became_active":"2024-09-10T22:44:24.202633+0000","last_became_peered":"2024-09-10T22:44:24.202633+0000","last_unstale":"2024-09-10T22:44:25.197490+0000","last_undegraded":"2024-09-10T22:44:25.197490+0000","last_fullsized":"2024-09-10T22:44:25.197490+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:24.832375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.205075+0000","last_change":"2024-09-10T22:44:24.202407+0000","last_active":"2024-09-10T22:44:25.205075+0000","last_peered":"2024-09-10T22:44:25.205075+0000","last_clean":"2024-09-10T22:44:25.205075+0000","last_became_active":"2024-09-10T22:44:24.200840+0000","last_became_peered":"2024-09-10T22:44:24.200840+0000","last_unstale":"2024-09-10T22:44:25.205075+0000","last_undegraded":"2024-09-10T22:44:25.205075+0000","last_fullsized":"2024-09-10T22:44:25.205075+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:14.597536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470827+0000","last_change":"2024-09-10T22:44:24.191830+0000","last_active":"2024-09-10T22:44:25.470827+0000","last_peered":"2024-09-10T22:44:25.470827+0000","last_clean":"2024-09-10T22:44:25.470827+0000","last_became_active":"2024-09-10T22:44:24.191546+0000","last_became_peered":"2024-09-10T22:44:24.191546+0000","last_unstale":"2024-09-10T22:44:25.470827+0000","last_undegraded":"2024-09-10T22:44:25.470827+0000","last_fullsized":"2024-09-10T22:44:25.470827+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:48.140782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204571+0000","last_change":"2024-09-10T22:44:24.213262+0000","last_active":"2024-09-10T22:44:25.204571+0000","last_peered":"2024-09-10T22:44:25.204571+0000","last_clean":"2024-09-10T22:44:25.204571+0000","last_became_active":"2024-09-10T22:44:24.213013+0000","last_became_peered":"2024-09-10T22:44:24.213013+0000","last_unstale":"2024-09-10T22:44:25.204571+0000","last_undegraded":"2024-09-10T22:44:25.204571+0000","last_fullsized":"2024-09-10T22:44:25.204571+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:33.521343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470573+0000","last_change":"2024-09-10T22:44:24.186427+0000","last_active":"2024-09-10T22:44:25.470573+0000","last_peered":"2024-09-10T22:44:25.470573+0000","last_clean":"2024-09-10T22:44:25.470573+0000","last_became_active":"2024-09-10T22:44:24.186120+0000","last_became_peered":"2024-09-10T22:44:24.186120+0000","last_unstale":"2024-09-10T22:44:25.470573+0000","last_undegraded":"2024-09-10T22:44:25.470573+0000","last_fullsized":"2024-09-10T22:44:25.470573+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:26.022789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198071+0000","last_change":"2024-09-10T22:44:24.203861+0000","last_active":"2024-09-10T22:44:25.198071+0000","last_peered":"2024-09-10T22:44:25.198071+0000","last_clean":"2024-09-10T22:44:25.198071+0000","last_became_active":"2024-09-10T22:44:24.203535+0000","last_became_peered":"2024-09-10T22:44:24.203535+0000","last_unstale":"2024-09-10T22:44:25.198071+0000","last_undegraded":"2024-09-10T22:44:25.198071+0000","last_fullsized":"2024-09-10T22:44:25.198071+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:22.211727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204281+0000","last_change":"2024-09-10T22:44:24.204250+0000","last_active":"2024-09-10T22:44:25.204281+0000","last_peered":"2024-09-10T22:44:25.204281+0000","last_clean":"2024-09-10T22:44:25.204281+0000","last_became_active":"2024-09-10T22:44:24.202378+0000","last_became_peered":"2024-09-10T22:44:24.202378+0000","last_unstale":"2024-09-10T22:44:25.204281+0000","last_undegraded":"2024-09-10T22:44:25.204281+0000","last_fullsized":"2024-09-10T22:44:25.204281+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:39.017889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197749+0000","last_change":"2024-09-10T22:44:24.197228+0000","last_active":"2024-09-10T22:44:25.197749+0000","last_peered":"2024-09-10T22:44:25.197749+0000","last_clean":"2024-09-10T22:44:25.197749+0000","last_became_active":"2024-09-10T22:44:24.196964+0000","last_became_peered":"2024-09-10T22:44:24.196964+0000","last_unstale":"2024-09-10T22:44:25.197749+0000","last_undegraded":"2024-09-10T22:44:25.197749+0000","last_fullsized":"2024-09-10T22:44:25.197749+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:09.707330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470176+0000","last_change":"2024-09-10T22:44:24.204371+0000","last_active":"2024-09-10T22:44:25.470176+0000","last_peered":"2024-09-10T22:44:25.470176+0000","last_clean":"2024-09-10T22:44:25.470176+0000","last_became_active":"2024-09-10T22:44:24.203921+0000","last_became_peered":"2024-09-10T22:44:24.203921+0000","last_unstale":"2024-09-10T22:44:25.470176+0000","last_undegraded":"2024-09-10T22:44:25.470176+0000","last_fullsized":"2024-09-10T22:44:25.470176+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:03.288275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471310+0000","last_change":"2024-09-10T22:44:24.211924+0000","last_active":"2024-09-10T22:44:25.471310+0000","last_peered":"2024-09-10T22:44:25.471310+0000","last_clean":"2024-09-10T22:44:25.471310+0000","last_became_active":"2024-09-10T22:44:24.211638+0000","last_became_peered":"2024-09-10T22:44:24.211638+0000","last_unstale":"2024-09-10T22:44:25.471310+0000","last_undegraded":"2024-09-10T22:44:25.471310+0000","last_fullsized":"2024-09-10T22:44:25.471310+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:44.001885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199072+0000","last_change":"2024-09-10T22:44:24.193330+0000","last_active":"2024-09-10T22:44:25.199072+0000","last_peered":"2024-09-10T22:44:25.199072+0000","last_clean":"2024-09-10T22:44:25.199072+0000","last_became_active":"2024-09-10T22:44:24.193093+0000","last_became_peered":"2024-09-10T22:44:24.193093+0000","last_unstale":"2024-09-10T22:44:25.199072+0000","last_undegraded":"2024-09-10T22:44:25.199072+0000","last_fullsized":"2024-09-10T22:44:25.199072+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:47.668822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204714+0000","last_change":"2024-09-10T22:44:24.216917+0000","last_active":"2024-09-10T22:44:25.204714+0000","last_peered":"2024-09-10T22:44:25.204714+0000","last_clean":"2024-09-10T22:44:25.204714+0000","last_became_active":"2024-09-10T22:44:24.216336+0000","last_became_peered":"2024-09-10T22:44:24.216336+0000","last_unstale":"2024-09-10T22:44:25.204714+0000","last_undegraded":"2024-09-10T22:44:25.204714+0000","last_fullsized":"2024-09-10T22:44:25.204714+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:53.203981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198606+0000","last_change":"2024-09-10T22:44:24.198928+0000","last_active":"2024-09-10T22:44:25.198606+0000","last_peered":"2024-09-10T22:44:25.198606+0000","last_clean":"2024-09-10T22:44:25.198606+0000","last_became_active":"2024-09-10T22:44:24.198508+0000","last_became_peered":"2024-09-10T22:44:24.198508+0000","last_unstale":"2024-09-10T22:44:25.198606+0000","last_undegraded":"2024-09-10T22:44:25.198606+0000","last_fullsized":"2024-09-10T22:44:25.198606+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:09.617474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204309+0000","last_change":"2024-09-10T22:44:24.203762+0000","last_active":"2024-09-10T22:44:25.204309+0000","last_peered":"2024-09-10T22:44:25.204309+0000","last_clean":"2024-09-10T22:44:25.204309+0000","last_became_active":"2024-09-10T22:44:24.203140+0000","last_became_peered":"2024-09-10T22:44:24.203140+0000","last_unstale":"2024-09-10T22:44:25.204309+0000","last_undegraded":"2024-09-10T22:44:25.204309+0000","last_fullsized":"2024-09-10T22:44:25.204309+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:04.391080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204258+0000","last_change":"2024-09-10T22:44:24.202325+0000","last_active":"2024-09-10T22:44:25.204258+0000","last_peered":"2024-09-10T22:44:25.204258+0000","last_clean":"2024-09-10T22:44:25.204258+0000","last_became_active":"2024-09-10T22:44:24.202038+0000","last_became_peered":"2024-09-10T22:44:24.202038+0000","last_unstale":"2024-09-10T22:44:25.204258+0000","last_undegraded":"2024-09-10T22:44:25.204258+0000","last_fullsized":"2024-09-10T22:44:25.204258+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:53:20.813105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471664+0000","last_change":"2024-09-10T22:44:24.199627+0000","last_active":"2024-09-10T22:44:25.471664+0000","last_peered":"2024-09-10T22:44:25.471664+0000","last_clean":"2024-09-10T22:44:25.471664+0000","last_became_active":"2024-09-10T22:44:24.198780+0000","last_became_peered":"2024-09-10T22:44:24.198780+0000","last_unstale":"2024-09-10T22:44:25.471664+0000","last_undegraded":"2024-09-10T22:44:25.471664+0000","last_fullsized":"2024-09-10T22:44:25.471664+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:33.521343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197959+0000","last_change":"2024-09-10T22:44:24.207260+0000","last_active":"2024-09-10T22:44:25.197959+0000","last_peered":"2024-09-10T22:44:25.197959+0000","last_clean":"2024-09-10T22:44:25.197959+0000","last_became_active":"2024-09-10T22:44:24.206937+0000","last_became_peered":"2024-09-10T22:44:24.206937+0000","last_unstale":"2024-09-10T22:44:25.197959+0000","last_undegraded":"2024-09-10T22:44:25.197959+0000","last_fullsized":"2024-09-10T22:44:25.197959+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:03.746731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207672+0000","last_change":"2024-09-10T22:44:24.197377+0000","last_active":"2024-09-10T22:44:25.207672+0000","last_peered":"2024-09-10T22:44:25.207672+0000","last_clean":"2024-09-10T22:44:25.207672+0000","last_became_active":"2024-09-10T22:44:24.197145+0000","last_became_peered":"2024-09-10T22:44:24.197145+0000","last_unstale":"2024-09-10T22:44:25.207672+0000","last_undegraded":"2024-09-10T22:44:25.207672+0000","last_fullsized":"2024-09-10T22:44:25.207672+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:51.296991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204580+0000","last_change":"2024-09-10T22:44:24.213923+0000","last_active":"2024-09-10T22:44:25.204580+0000","last_peered":"2024-09-10T22:44:25.204580+0000","last_clean":"2024-09-10T22:44:25.204580+0000","last_became_active":"2024-09-10T22:44:24.213570+0000","last_became_peered":"2024-09-10T22:44:24.213570+0000","last_unstale":"2024-09-10T22:44:25.204580+0000","last_undegraded":"2024-09-10T22:44:25.204580+0000","last_fullsized":"2024-09-10T22:44:25.204580+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:58.784242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470752+0000","last_change":"2024-09-10T22:44:24.189211+0000","last_active":"2024-09-10T22:44:25.470752+0000","last_peered":"2024-09-10T22:44:25.470752+0000","last_clean":"2024-09-10T22:44:25.470752+0000","last_became_active":"2024-09-10T22:44:24.188729+0000","last_became_peered":"2024-09-10T22:44:24.188729+0000","last_unstale":"2024-09-10T22:44:25.470752+0000","last_undegraded":"2024-09-10T22:44:25.470752+0000","last_fullsized":"2024-09-10T22:44:25.470752+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:26.057456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198801+0000","last_change":"2024-09-10T22:44:24.208790+0000","last_active":"2024-09-10T22:44:25.198801+0000","last_peered":"2024-09-10T22:44:25.198801+0000","last_clean":"2024-09-10T22:44:25.198801+0000","last_became_active":"2024-09-10T22:44:24.208540+0000","last_became_peered":"2024-09-10T22:44:24.208540+0000","last_unstale":"2024-09-10T22:44:25.198801+0000","last_undegraded":"2024-09-10T22:44:25.198801+0000","last_fullsized":"2024-09-10T22:44:25.198801+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:50.921887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199597+0000","last_change":"2024-09-10T22:44:24.199868+0000","last_active":"2024-09-10T22:44:25.199597+0000","last_peered":"2024-09-10T22:44:25.199597+0000","last_clean":"2024-09-10T22:44:25.199597+0000","last_became_active":"2024-09-10T22:44:24.198890+0000","last_became_peered":"2024-09-10T22:44:24.198890+0000","last_unstale":"2024-09-10T22:44:25.199597+0000","last_undegraded":"2024-09-10T22:44:25.199597+0000","last_fullsized":"2024-09-10T22:44:25.199597+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:33.303882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204989+0000","last_change":"2024-09-10T22:44:24.200965+0000","last_active":"2024-09-10T22:44:25.204989+0000","last_peered":"2024-09-10T22:44:25.204989+0000","last_clean":"2024-09-10T22:44:25.204989+0000","last_became_active":"2024-09-10T22:44:24.200687+0000","last_became_peered":"2024-09-10T22:44:24.200687+0000","last_unstale":"2024-09-10T22:44:25.204989+0000","last_undegraded":"2024-09-10T22:44:25.204989+0000","last_fullsized":"2024-09-10T22:44:25.204989+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:25.792154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207454+0000","last_change":"2024-09-10T22:44:24.198687+0000","last_active":"2024-09-10T22:44:25.207454+0000","last_peered":"2024-09-10T22:44:25.207454+0000","last_clean":"2024-09-10T22:44:25.207454+0000","last_became_active":"2024-09-10T22:44:24.198160+0000","last_became_peered":"2024-09-10T22:44:24.198160+0000","last_unstale":"2024-09-10T22:44:25.207454+0000","last_undegraded":"2024-09-10T22:44:25.207454+0000","last_fullsized":"2024-09-10T22:44:25.207454+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:39.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470254+0000","last_change":"2024-09-10T22:44:24.212874+0000","last_active":"2024-09-10T22:44:25.470254+0000","last_peered":"2024-09-10T22:44:25.470254+0000","last_clean":"2024-09-10T22:44:25.470254+0000","last_became_active":"2024-09-10T22:44:24.212552+0000","last_became_peered":"2024-09-10T22:44:24.212552+0000","last_unstale":"2024-09-10T22:44:25.470254+0000","last_undegraded":"2024-09-10T22:44:25.470254+0000","last_fullsized":"2024-09-10T22:44:25.470254+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:23.290144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470874+0000","last_change":"2024-09-10T22:44:24.207309+0000","last_active":"2024-09-10T22:44:25.470874+0000","last_peered":"2024-09-10T22:44:25.470874+0000","last_clean":"2024-09-10T22:44:25.470874+0000","last_became_active":"2024-09-10T22:44:24.206781+0000","last_became_peered":"2024-09-10T22:44:24.206781+0000","last_unstale":"2024-09-10T22:44:25.470874+0000","last_undegraded":"2024-09-10T22:44:25.470874+0000","last_fullsized":"2024-09-10T22:44:25.470874+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:30.064406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"91'4","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471682+0000","last_change":"2024-09-10T22:44:23.194098+0000","last_active":"2024-09-10T22:44:25.471682+0000","last_peered":"2024-09-10T22:44:25.471682+0000","last_clean":"2024-09-10T22:44:25.471682+0000","last_became_active":"2024-09-10T22:44:23.193814+0000","last_became_peered":"2024-09-10T22:44:23.193814+0000","last_unstale":"2024-09-10T22:44:25.471682+0000","last_undegraded":"2024-09-10T22:44:25.471682+0000","last_fullsized":"2024-09-10T22:44:25.471682+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:46.530536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471163+0000","last_change":"2024-09-10T22:44:24.210514+0000","last_active":"2024-09-10T22:44:25.471163+0000","last_peered":"2024-09-10T22:44:25.471163+0000","last_clean":"2024-09-10T22:44:25.471163+0000","last_became_active":"2024-09-10T22:44:24.210212+0000","last_became_peered":"2024-09-10T22:44:24.210212+0000","last_unstale":"2024-09-10T22:44:25.471163+0000","last_undegraded":"2024-09-10T22:44:25.471163+0000","last_fullsized":"2024-09-10T22:44:25.471163+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:45.551599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204801+0000","last_change":"2024-09-10T22:44:23.186842+0000","last_active":"2024-09-10T22:44:25.204801+0000","last_peered":"2024-09-10T22:44:25.204801+0000","last_clean":"2024-09-10T22:44:25.204801+0000","last_became_active":"2024-09-10T22:44:23.186437+0000","last_became_peered":"2024-09-10T22:44:23.186437+0000","last_unstale":"2024-09-10T22:44:25.204801+0000","last_undegraded":"2024-09-10T22:44:25.204801+0000","last_fullsized":"2024-09-10T22:44:25.204801+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:41.002798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199361+0000","last_change":"2024-09-10T22:44:24.213940+0000","last_active":"2024-09-10T22:44:25.199361+0000","last_peered":"2024-09-10T22:44:25.199361+0000","last_clean":"2024-09-10T22:44:25.199361+0000","last_became_active":"2024-09-10T22:44:24.213674+0000","last_became_peered":"2024-09-10T22:44:24.213674+0000","last_unstale":"2024-09-10T22:44:25.199361+0000","last_undegraded":"2024-09-10T22:44:25.199361+0000","last_fullsized":"2024-09-10T22:44:25.199361+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:29.724657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199629+0000","last_change":"2024-09-10T22:44:23.188760+0000","last_active":"2024-09-10T22:44:25.199629+0000","last_peered":"2024-09-10T22:44:25.199629+0000","last_clean":"2024-09-10T22:44:25.199629+0000","last_became_active":"2024-09-10T22:44:23.188504+0000","last_became_peered":"2024-09-10T22:44:23.188504+0000","last_unstale":"2024-09-10T22:44:25.199629+0000","last_undegraded":"2024-09-10T22:44:25.199629+0000","last_fullsized":"2024-09-10T22:44:25.199629+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:13.589526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471375+0000","last_change":"2024-09-10T22:44:24.206195+0000","last_active":"2024-09-10T22:44:25.471375+0000","last_peered":"2024-09-10T22:44:25.471375+0000","last_clean":"2024-09-10T22:44:25.471375+0000","last_became_active":"2024-09-10T22:44:24.205945+0000","last_became_peered":"2024-09-10T22:44:24.205945+0000","last_unstale":"2024-09-10T22:44:25.471375+0000","last_undegraded":"2024-09-10T22:44:25.471375+0000","last_fullsized":"2024-09-10T22:44:25.471375+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:11.330230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471704+0000","last_change":"2024-09-10T22:44:23.197426+0000","last_active":"2024-09-10T22:44:25.471704+0000","last_peered":"2024-09-10T22:44:25.471704+0000","last_clean":"2024-09-10T22:44:25.471704+0000","last_became_active":"2024-09-10T22:44:23.197108+0000","last_became_peered":"2024-09-10T22:44:23.197108+0000","last_unstale":"2024-09-10T22:44:25.471704+0000","last_undegraded":"2024-09-10T22:44:25.471704+0000","last_fullsized":"2024-09-10T22:44:25.471704+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:32.857745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197557+0000","last_change":"2024-09-10T22:44:24.202442+0000","last_active":"2024-09-10T22:44:25.197557+0000","last_peered":"2024-09-10T22:44:25.197557+0000","last_clean":"2024-09-10T22:44:25.197557+0000","last_became_active":"2024-09-10T22:44:24.197691+0000","last_became_peered":"2024-09-10T22:44:24.197691+0000","last_unstale":"2024-09-10T22:44:25.197557+0000","last_undegraded":"2024-09-10T22:44:25.197557+0000","last_fullsized":"2024-09-10T22:44:25.197557+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:43.068682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204558+0000","last_change":"2024-09-10T22:44:23.188330+0000","last_active":"2024-09-10T22:44:25.204558+0000","last_peered":"2024-09-10T22:44:25.204558+0000","last_clean":"2024-09-10T22:44:25.204558+0000","last_became_active":"2024-09-10T22:44:23.188074+0000","last_became_peered":"2024-09-10T22:44:23.188074+0000","last_unstale":"2024-09-10T22:44:25.204558+0000","last_undegraded":"2024-09-10T22:44:25.204558+0000","last_fullsized":"2024-09-10T22:44:25.204558+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:40.971955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471484+0000","last_change":"2024-09-10T22:44:24.202396+0000","last_active":"2024-09-10T22:44:25.471484+0000","last_peered":"2024-09-10T22:44:25.471484+0000","last_clean":"2024-09-10T22:44:25.471484+0000","last_became_active":"2024-09-10T22:44:24.201498+0000","last_became_peered":"2024-09-10T22:44:24.201498+0000","last_unstale":"2024-09-10T22:44:25.471484+0000","last_undegraded":"2024-09-10T22:44:25.471484+0000","last_fullsized":"2024-09-10T22:44:25.471484+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:40.884782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198372+0000","last_change":"2024-09-10T22:44:23.195943+0000","last_active":"2024-09-10T22:44:25.198372+0000","last_peered":"2024-09-10T22:44:25.198372+0000","last_clean":"2024-09-10T22:44:25.198372+0000","last_became_active":"2024-09-10T22:44:23.195678+0000","last_became_peered":"2024-09-10T22:44:23.195678+0000","last_unstale":"2024-09-10T22:44:25.198372+0000","last_undegraded":"2024-09-10T22:44:25.198372+0000","last_fullsized":"2024-09-10T22:44:25.198372+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:30.932095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470931+0000","last_change":"2024-09-10T22:44:24.211243+0000","last_active":"2024-09-10T22:44:25.470931+0000","last_peered":"2024-09-10T22:44:25.470931+0000","last_clean":"2024-09-10T22:44:25.470931+0000","last_became_active":"2024-09-10T22:44:24.210992+0000","last_became_peered":"2024-09-10T22:44:24.210992+0000","last_unstale":"2024-09-10T22:44:25.470931+0000","last_undegraded":"2024-09-10T22:44:25.470931+0000","last_fullsized":"2024-09-10T22:44:25.470931+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:00.810040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198179+0000","last_change":"2024-09-10T22:44:23.184732+0000","last_active":"2024-09-10T22:44:25.198179+0000","last_peered":"2024-09-10T22:44:25.198179+0000","last_clean":"2024-09-10T22:44:25.198179+0000","last_became_active":"2024-09-10T22:44:23.184397+0000","last_became_peered":"2024-09-10T22:44:23.184397+0000","last_unstale":"2024-09-10T22:44:25.198179+0000","last_undegraded":"2024-09-10T22:44:25.198179+0000","last_fullsized":"2024-09-10T22:44:25.198179+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:45.636226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199476+0000","last_change":"2024-09-10T22:44:24.202421+0000","last_active":"2024-09-10T22:44:25.199476+0000","last_peered":"2024-09-10T22:44:25.199476+0000","last_clean":"2024-09-10T22:44:25.199476+0000","last_became_active":"2024-09-10T22:44:24.202090+0000","last_became_peered":"2024-09-10T22:44:24.202090+0000","last_unstale":"2024-09-10T22:44:25.199476+0000","last_undegraded":"2024-09-10T22:44:25.199476+0000","last_fullsized":"2024-09-10T22:44:25.199476+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:34.501203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199257+0000","last_change":"2024-09-10T22:44:23.193342+0000","last_active":"2024-09-10T22:44:25.199257+0000","last_peered":"2024-09-10T22:44:25.199257+0000","last_clean":"2024-09-10T22:44:25.199257+0000","last_became_active":"2024-09-10T22:44:23.193097+0000","last_became_peered":"2024-09-10T22:44:23.193097+0000","last_unstale":"2024-09-10T22:44:25.199257+0000","last_undegraded":"2024-09-10T22:44:25.199257+0000","last_fullsized":"2024-09-10T22:44:25.199257+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:56.341661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204625+0000","last_change":"2024-09-10T22:44:24.211211+0000","last_active":"2024-09-10T22:44:25.204625+0000","last_peered":"2024-09-10T22:44:25.204625+0000","last_clean":"2024-09-10T22:44:25.204625+0000","last_became_active":"2024-09-10T22:44:24.210758+0000","last_became_peered":"2024-09-10T22:44:24.210758+0000","last_unstale":"2024-09-10T22:44:25.204625+0000","last_undegraded":"2024-09-10T22:44:25.204625+0000","last_fullsized":"2024-09-10T22:44:25.204625+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:50.798557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207853+0000","last_change":"2024-09-10T22:44:23.188266+0000","last_active":"2024-09-10T22:44:25.207853+0000","last_peered":"2024-09-10T22:44:25.207853+0000","last_clean":"2024-09-10T22:44:25.207853+0000","last_became_active":"2024-09-10T22:44:23.187992+0000","last_became_peered":"2024-09-10T22:44:23.187992+0000","last_unstale":"2024-09-10T22:44:25.207853+0000","last_undegraded":"2024-09-10T22:44:25.207853+0000","last_fullsized":"2024-09-10T22:44:25.207853+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:53.656054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199617+0000","last_change":"2024-09-10T22:44:24.207405+0000","last_active":"2024-09-10T22:44:25.199617+0000","last_peered":"2024-09-10T22:44:25.199617+0000","last_clean":"2024-09-10T22:44:25.199617+0000","last_became_active":"2024-09-10T22:44:24.206912+0000","last_became_peered":"2024-09-10T22:44:24.206912+0000","last_unstale":"2024-09-10T22:44:25.199617+0000","last_undegraded":"2024-09-10T22:44:25.199617+0000","last_fullsized":"2024-09-10T22:44:25.199617+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:05.348559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199192+0000","last_change":"2024-09-10T22:44:23.185327+0000","last_active":"2024-09-10T22:44:25.199192+0000","last_peered":"2024-09-10T22:44:25.199192+0000","last_clean":"2024-09-10T22:44:25.199192+0000","last_became_active":"2024-09-10T22:44:23.185040+0000","last_became_peered":"2024-09-10T22:44:23.185040+0000","last_unstale":"2024-09-10T22:44:25.199192+0000","last_undegraded":"2024-09-10T22:44:25.199192+0000","last_fullsized":"2024-09-10T22:44:25.199192+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:53.534182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199080+0000","last_change":"2024-09-10T22:44:24.214251+0000","last_active":"2024-09-10T22:44:25.199080+0000","last_peered":"2024-09-10T22:44:25.199080+0000","last_clean":"2024-09-10T22:44:25.199080+0000","last_became_active":"2024-09-10T22:44:24.213999+0000","last_became_peered":"2024-09-10T22:44:24.213999+0000","last_unstale":"2024-09-10T22:44:25.199080+0000","last_undegraded":"2024-09-10T22:44:25.199080+0000","last_fullsized":"2024-09-10T22:44:25.199080+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:41.253063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"91'3","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204929+0000","last_change":"2024-09-10T22:44:23.184019+0000","last_active":"2024-09-10T22:44:25.204929+0000","last_peered":"2024-09-10T22:44:25.204929+0000","last_clean":"2024-09-10T22:44:25.204929+0000","last_became_active":"2024-09-10T22:44:23.183735+0000","last_became_peered":"2024-09-10T22:44:23.183735+0000","last_unstale":"2024-09-10T22:44:25.204929+0000","last_undegraded":"2024-09-10T22:44:25.204929+0000","last_fullsized":"2024-09-10T22:44:25.204929+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:00.691719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198775+0000","last_change":"2024-09-10T22:44:24.197746+0000","last_active":"2024-09-10T22:44:25.198775+0000","last_peered":"2024-09-10T22:44:25.198775+0000","last_clean":"2024-09-10T22:44:25.198775+0000","last_became_active":"2024-09-10T22:44:24.197467+0000","last_became_peered":"2024-09-10T22:44:24.197467+0000","last_unstale":"2024-09-10T22:44:25.198775+0000","last_undegraded":"2024-09-10T22:44:25.198775+0000","last_fullsized":"2024-09-10T22:44:25.198775+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:21.613577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"91'6","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471046+0000","last_change":"2024-09-10T22:44:23.188843+0000","last_active":"2024-09-10T22:44:25.471046+0000","last_peered":"2024-09-10T22:44:25.471046+0000","last_clean":"2024-09-10T22:44:25.471046+0000","last_became_active":"2024-09-10T22:44:23.188570+0000","last_became_peered":"2024-09-10T22:44:23.188570+0000","last_unstale":"2024-09-10T22:44:25.471046+0000","last_undegraded":"2024-09-10T22:44:25.471046+0000","last_fullsized":"2024-09-10T22:44:25.471046+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:40.245052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197666+0000","last_change":"2024-09-10T22:44:24.201026+0000","last_active":"2024-09-10T22:44:25.197666+0000","last_peered":"2024-09-10T22:44:25.197666+0000","last_clean":"2024-09-10T22:44:25.197666+0000","last_became_active":"2024-09-10T22:44:24.197325+0000","last_became_peered":"2024-09-10T22:44:24.197325+0000","last_unstale":"2024-09-10T22:44:25.197666+0000","last_undegraded":"2024-09-10T22:44:25.197666+0000","last_fullsized":"2024-09-10T22:44:25.197666+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:48.952777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199804+0000","last_change":"2024-09-10T22:44:23.193543+0000","last_active":"2024-09-10T22:44:25.199804+0000","last_peered":"2024-09-10T22:44:25.199804+0000","last_clean":"2024-09-10T22:44:25.199804+0000","last_became_active":"2024-09-10T22:44:23.193253+0000","last_became_peered":"2024-09-10T22:44:23.193253+0000","last_unstale":"2024-09-10T22:44:25.199804+0000","last_undegraded":"2024-09-10T22:44:25.199804+0000","last_fullsized":"2024-09-10T22:44:25.199804+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:38.021136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204248+0000","last_change":"2024-09-10T22:44:24.201841+0000","last_active":"2024-09-10T22:44:25.204248+0000","last_peered":"2024-09-10T22:44:25.204248+0000","last_clean":"2024-09-10T22:44:25.204248+0000","last_became_active":"2024-09-10T22:44:24.201344+0000","last_became_peered":"2024-09-10T22:44:24.201344+0000","last_unstale":"2024-09-10T22:44:25.204248+0000","last_undegraded":"2024-09-10T22:44:25.204248+0000","last_fullsized":"2024-09-10T22:44:25.204248+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:25.851692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470924+0000","last_change":"2024-09-10T22:44:23.179309+0000","last_active":"2024-09-10T22:44:25.470924+0000","last_peered":"2024-09-10T22:44:25.470924+0000","last_clean":"2024-09-10T22:44:25.470924+0000","last_became_active":"2024-09-10T22:44:23.177131+0000","last_became_peered":"2024-09-10T22:44:23.177131+0000","last_unstale":"2024-09-10T22:44:25.470924+0000","last_undegraded":"2024-09-10T22:44:25.470924+0000","last_fullsized":"2024-09-10T22:44:25.470924+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:04.340549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470764+0000","last_change":"2024-09-10T22:44:24.191707+0000","last_active":"2024-09-10T22:44:25.470764+0000","last_peered":"2024-09-10T22:44:25.470764+0000","last_clean":"2024-09-10T22:44:25.470764+0000","last_became_active":"2024-09-10T22:44:24.191416+0000","last_became_peered":"2024-09-10T22:44:24.191416+0000","last_unstale":"2024-09-10T22:44:25.470764+0000","last_undegraded":"2024-09-10T22:44:25.470764+0000","last_fullsized":"2024-09-10T22:44:25.470764+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:57.999311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197761+0000","last_change":"2024-09-10T22:44:23.195006+0000","last_active":"2024-09-10T22:44:25.197761+0000","last_peered":"2024-09-10T22:44:25.197761+0000","last_clean":"2024-09-10T22:44:25.197761+0000","last_became_active":"2024-09-10T22:44:23.194737+0000","last_became_peered":"2024-09-10T22:44:23.194737+0000","last_unstale":"2024-09-10T22:44:25.197761+0000","last_undegraded":"2024-09-10T22:44:25.197761+0000","last_fullsized":"2024-09-10T22:44:25.197761+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:50.822823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470485+0000","last_change":"2024-09-10T22:44:24.207762+0000","last_active":"2024-09-10T22:44:25.470485+0000","last_peered":"2024-09-10T22:44:25.470485+0000","last_clean":"2024-09-10T22:44:25.470485+0000","last_became_active":"2024-09-10T22:44:24.207437+0000","last_became_peered":"2024-09-10T22:44:24.207437+0000","last_unstale":"2024-09-10T22:44:25.470485+0000","last_undegraded":"2024-09-10T22:44:25.470485+0000","last_fullsized":"2024-09-10T22:44:25.470485+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:14.743355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"91'8","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.197737+0000","last_change":"2024-09-10T22:44:23.195915+0000","last_active":"2024-09-10T22:44:25.197737+0000","last_peered":"2024-09-10T22:44:25.197737+0000","last_clean":"2024-09-10T22:44:25.197737+0000","last_became_active":"2024-09-10T22:44:23.195654+0000","last_became_peered":"2024-09-10T22:44:23.195654+0000","last_unstale":"2024-09-10T22:44:25.197737+0000","last_undegraded":"2024-09-10T22:44:25.197737+0000","last_fullsized":"2024-09-10T22:44:25.197737+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:01.303549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471002+0000","last_change":"2024-09-10T22:44:24.207022+0000","last_active":"2024-09-10T22:44:25.471002+0000","last_peered":"2024-09-10T22:44:25.471002+0000","last_clean":"2024-09-10T22:44:25.471002+0000","last_became_active":"2024-09-10T22:44:24.206462+0000","last_became_peered":"2024-09-10T22:44:24.206462+0000","last_unstale":"2024-09-10T22:44:25.471002+0000","last_undegraded":"2024-09-10T22:44:25.471002+0000","last_fullsized":"2024-09-10T22:44:25.471002+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:52.489694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471924+0000","last_change":"2024-09-10T22:44:23.189443+0000","last_active":"2024-09-10T22:44:25.471924+0000","last_peered":"2024-09-10T22:44:25.471924+0000","last_clean":"2024-09-10T22:44:25.471924+0000","last_became_active":"2024-09-10T22:44:23.188194+0000","last_became_peered":"2024-09-10T22:44:23.188194+0000","last_unstale":"2024-09-10T22:44:25.471924+0000","last_undegraded":"2024-09-10T22:44:25.471924+0000","last_fullsized":"2024-09-10T22:44:25.471924+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:50.593281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471644+0000","last_change":"2024-09-10T22:44:24.194967+0000","last_active":"2024-09-10T22:44:25.471644+0000","last_peered":"2024-09-10T22:44:25.471644+0000","last_clean":"2024-09-10T22:44:25.471644+0000","last_became_active":"2024-09-10T22:44:24.194632+0000","last_became_peered":"2024-09-10T22:44:24.194632+0000","last_unstale":"2024-09-10T22:44:25.471644+0000","last_undegraded":"2024-09-10T22:44:25.471644+0000","last_fullsized":"2024-09-10T22:44:25.471644+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:58.784242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199813+0000","last_change":"2024-09-10T22:44:23.187756+0000","last_active":"2024-09-10T22:44:25.199813+0000","last_peered":"2024-09-10T22:44:25.199813+0000","last_clean":"2024-09-10T22:44:25.199813+0000","last_became_active":"2024-09-10T22:44:23.187474+0000","last_became_peered":"2024-09-10T22:44:23.187474+0000","last_unstale":"2024-09-10T22:44:25.199813+0000","last_undegraded":"2024-09-10T22:44:25.199813+0000","last_fullsized":"2024-09-10T22:44:25.199813+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:24.784144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204739+0000","last_change":"2024-09-10T22:44:24.205267+0000","last_active":"2024-09-10T22:44:25.204739+0000","last_peered":"2024-09-10T22:44:25.204739+0000","last_clean":"2024-09-10T22:44:25.204739+0000","last_became_active":"2024-09-10T22:44:24.204952+0000","last_became_peered":"2024-09-10T22:44:24.204952+0000","last_unstale":"2024-09-10T22:44:25.204739+0000","last_undegraded":"2024-09-10T22:44:25.204739+0000","last_fullsized":"2024-09-10T22:44:25.204739+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:57.351203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"91'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204953+0000","last_change":"2024-09-10T22:44:23.192579+0000","last_active":"2024-09-10T22:44:25.204953+0000","last_peered":"2024-09-10T22:44:25.204953+0000","last_clean":"2024-09-10T22:44:25.204953+0000","last_became_active":"2024-09-10T22:44:23.191640+0000","last_became_peered":"2024-09-10T22:44:23.191640+0000","last_unstale":"2024-09-10T22:44:25.204953+0000","last_undegraded":"2024-09-10T22:44:25.204953+0000","last_fullsized":"2024-09-10T22:44:25.204953+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:17.105045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470388+0000","last_change":"2024-09-10T22:44:24.210092+0000","last_active":"2024-09-10T22:44:25.470388+0000","last_peered":"2024-09-10T22:44:25.470388+0000","last_clean":"2024-09-10T22:44:25.470388+0000","last_became_active":"2024-09-10T22:44:24.209736+0000","last_became_peered":"2024-09-10T22:44:24.209736+0000","last_unstale":"2024-09-10T22:44:25.470388+0000","last_undegraded":"2024-09-10T22:44:25.470388+0000","last_fullsized":"2024-09-10T22:44:25.470388+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:16.138386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207371+0000","last_change":"2024-09-10T22:44:23.180037+0000","last_active":"2024-09-10T22:44:25.207371+0000","last_peered":"2024-09-10T22:44:25.207371+0000","last_clean":"2024-09-10T22:44:25.207371+0000","last_became_active":"2024-09-10T22:44:23.179760+0000","last_became_peered":"2024-09-10T22:44:23.179760+0000","last_unstale":"2024-09-10T22:44:25.207371+0000","last_undegraded":"2024-09-10T22:44:25.207371+0000","last_fullsized":"2024-09-10T22:44:25.207371+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:11.739895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207454+0000","last_change":"2024-09-10T22:44:24.198411+0000","last_active":"2024-09-10T22:44:25.207454+0000","last_peered":"2024-09-10T22:44:25.207454+0000","last_clean":"2024-09-10T22:44:25.207454+0000","last_became_active":"2024-09-10T22:44:24.197767+0000","last_became_peered":"2024-09-10T22:44:24.197767+0000","last_unstale":"2024-09-10T22:44:25.207454+0000","last_undegraded":"2024-09-10T22:44:25.207454+0000","last_fullsized":"2024-09-10T22:44:25.207454+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:25.792154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470420+0000","last_change":"2024-09-10T22:44:23.196730+0000","last_active":"2024-09-10T22:44:25.470420+0000","last_peered":"2024-09-10T22:44:25.470420+0000","last_clean":"2024-09-10T22:44:25.470420+0000","last_became_active":"2024-09-10T22:44:23.195841+0000","last_became_peered":"2024-09-10T22:44:23.195841+0000","last_unstale":"2024-09-10T22:44:25.470420+0000","last_undegraded":"2024-09-10T22:44:25.470420+0000","last_fullsized":"2024-09-10T22:44:25.470420+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:07.235209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207658+0000","last_change":"2024-09-10T22:44:24.204553+0000","last_active":"2024-09-10T22:44:25.207658+0000","last_peered":"2024-09-10T22:44:25.207658+0000","last_clean":"2024-09-10T22:44:25.207658+0000","last_became_active":"2024-09-10T22:44:24.203074+0000","last_became_peered":"2024-09-10T22:44:24.203074+0000","last_unstale":"2024-09-10T22:44:25.207658+0000","last_undegraded":"2024-09-10T22:44:25.207658+0000","last_fullsized":"2024-09-10T22:44:25.207658+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:14.597536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207691+0000","last_change":"2024-09-10T22:44:23.182444+0000","last_active":"2024-09-10T22:44:25.207691+0000","last_peered":"2024-09-10T22:44:25.207691+0000","last_clean":"2024-09-10T22:44:25.207691+0000","last_became_active":"2024-09-10T22:44:23.182160+0000","last_became_peered":"2024-09-10T22:44:23.182160+0000","last_unstale":"2024-09-10T22:44:25.207691+0000","last_undegraded":"2024-09-10T22:44:25.207691+0000","last_fullsized":"2024-09-10T22:44:25.207691+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:24.843682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470939+0000","last_change":"2024-09-10T22:44:24.201689+0000","last_active":"2024-09-10T22:44:25.470939+0000","last_peered":"2024-09-10T22:44:25.470939+0000","last_clean":"2024-09-10T22:44:25.470939+0000","last_became_active":"2024-09-10T22:44:24.201421+0000","last_became_peered":"2024-09-10T22:44:24.201421+0000","last_unstale":"2024-09-10T22:44:25.470939+0000","last_undegraded":"2024-09-10T22:44:25.470939+0000","last_fullsized":"2024-09-10T22:44:25.470939+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:01.996232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470554+0000","last_change":"2024-09-10T22:44:23.190506+0000","last_active":"2024-09-10T22:44:25.470554+0000","last_peered":"2024-09-10T22:44:25.470554+0000","last_clean":"2024-09-10T22:44:25.470554+0000","last_became_active":"2024-09-10T22:44:23.187895+0000","last_became_peered":"2024-09-10T22:44:23.187895+0000","last_unstale":"2024-09-10T22:44:25.470554+0000","last_undegraded":"2024-09-10T22:44:25.470554+0000","last_fullsized":"2024-09-10T22:44:25.470554+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:52.616877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471584+0000","last_change":"2024-09-10T22:44:24.204379+0000","last_active":"2024-09-10T22:44:25.471584+0000","last_peered":"2024-09-10T22:44:25.471584+0000","last_clean":"2024-09-10T22:44:25.471584+0000","last_became_active":"2024-09-10T22:44:24.203293+0000","last_became_peered":"2024-09-10T22:44:24.203293+0000","last_unstale":"2024-09-10T22:44:25.471584+0000","last_undegraded":"2024-09-10T22:44:25.471584+0000","last_fullsized":"2024-09-10T22:44:25.471584+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:19:15.211139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"91'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.200037+0000","last_change":"2024-09-10T22:44:23.190502+0000","last_active":"2024-09-10T22:44:25.200037+0000","last_peered":"2024-09-10T22:44:25.200037+0000","last_clean":"2024-09-10T22:44:25.200037+0000","last_became_active":"2024-09-10T22:44:23.190243+0000","last_became_peered":"2024-09-10T22:44:23.190243+0000","last_unstale":"2024-09-10T22:44:25.200037+0000","last_undegraded":"2024-09-10T22:44:25.200037+0000","last_fullsized":"2024-09-10T22:44:25.200037+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:55.992567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471220+0000","last_change":"2024-09-10T22:44:24.211164+0000","last_active":"2024-09-10T22:44:25.471220+0000","last_peered":"2024-09-10T22:44:25.471220+0000","last_clean":"2024-09-10T22:44:25.471220+0000","last_became_active":"2024-09-10T22:44:24.210908+0000","last_became_peered":"2024-09-10T22:44:24.210908+0000","last_unstale":"2024-09-10T22:44:25.471220+0000","last_undegraded":"2024-09-10T22:44:25.471220+0000","last_fullsized":"2024-09-10T22:44:25.471220+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:21:55.105875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"92'1","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.204942+0000","last_change":"2024-09-10T22:44:23.177566+0000","last_active":"2024-09-10T22:44:25.204942+0000","last_peered":"2024-09-10T22:44:25.204942+0000","last_clean":"2024-09-10T22:44:25.204942+0000","last_became_active":"2024-09-10T22:44:23.177258+0000","last_became_peered":"2024-09-10T22:44:23.177258+0000","last_unstale":"2024-09-10T22:44:25.204942+0000","last_undegraded":"2024-09-10T22:44:25.204942+0000","last_fullsized":"2024-09-10T22:44:25.204942+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:09.898402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471390+0000","last_change":"2024-09-10T22:44:24.214646+0000","last_active":"2024-09-10T22:44:25.471390+0000","last_peered":"2024-09-10T22:44:25.471390+0000","last_clean":"2024-09-10T22:44:25.471390+0000","last_became_active":"2024-09-10T22:44:24.214338+0000","last_became_peered":"2024-09-10T22:44:24.214338+0000","last_unstale":"2024-09-10T22:44:25.471390+0000","last_undegraded":"2024-09-10T22:44:25.471390+0000","last_fullsized":"2024-09-10T22:44:25.471390+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:47.576757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.205051+0000","last_change":"2024-09-10T22:44:23.181449+0000","last_active":"2024-09-10T22:44:25.205051+0000","last_peered":"2024-09-10T22:44:25.205051+0000","last_clean":"2024-09-10T22:44:25.205051+0000","last_became_active":"2024-09-10T22:44:23.181079+0000","last_became_peered":"2024-09-10T22:44:23.181079+0000","last_unstale":"2024-09-10T22:44:25.205051+0000","last_undegraded":"2024-09-10T22:44:25.205051+0000","last_fullsized":"2024-09-10T22:44:25.205051+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:29:42.223967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207777+0000","last_change":"2024-09-10T22:44:24.205034+0000","last_active":"2024-09-10T22:44:25.207777+0000","last_peered":"2024-09-10T22:44:25.207777+0000","last_clean":"2024-09-10T22:44:25.207777+0000","last_became_active":"2024-09-10T22:44:24.204638+0000","last_became_peered":"2024-09-10T22:44:24.204638+0000","last_unstale":"2024-09-10T22:44:25.207777+0000","last_undegraded":"2024-09-10T22:44:25.207777+0000","last_fullsized":"2024-09-10T22:44:25.207777+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:35.621454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471797+0000","last_change":"2024-09-10T22:44:23.191673+0000","last_active":"2024-09-10T22:44:25.471797+0000","last_peered":"2024-09-10T22:44:25.471797+0000","last_clean":"2024-09-10T22:44:25.471797+0000","last_became_active":"2024-09-10T22:44:23.191370+0000","last_became_peered":"2024-09-10T22:44:23.191370+0000","last_unstale":"2024-09-10T22:44:25.471797+0000","last_undegraded":"2024-09-10T22:44:25.471797+0000","last_fullsized":"2024-09-10T22:44:25.471797+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:07.977455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.470445+0000","last_change":"2024-09-10T22:44:24.203036+0000","last_active":"2024-09-10T22:44:25.470445+0000","last_peered":"2024-09-10T22:44:25.470445+0000","last_clean":"2024-09-10T22:44:25.470445+0000","last_became_active":"2024-09-10T22:44:24.202753+0000","last_became_peered":"2024-09-10T22:44:24.202753+0000","last_unstale":"2024-09-10T22:44:25.470445+0000","last_undegraded":"2024-09-10T22:44:25.470445+0000","last_fullsized":"2024-09-10T22:44:25.470445+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:39.399881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471083+0000","last_change":"2024-09-10T22:44:23.181424+0000","last_active":"2024-09-10T22:44:25.471083+0000","last_peered":"2024-09-10T22:44:25.471083+0000","last_clean":"2024-09-10T22:44:25.471083+0000","last_became_active":"2024-09-10T22:44:23.179930+0000","last_became_peered":"2024-09-10T22:44:23.179930+0000","last_unstale":"2024-09-10T22:44:25.471083+0000","last_undegraded":"2024-09-10T22:44:25.471083+0000","last_fullsized":"2024-09-10T22:44:25.471083+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:02.518381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198040+0000","last_change":"2024-09-10T22:44:24.197878+0000","last_active":"2024-09-10T22:44:25.198040+0000","last_peered":"2024-09-10T22:44:25.198040+0000","last_clean":"2024-09-10T22:44:25.198040+0000","last_became_active":"2024-09-10T22:44:24.197514+0000","last_became_peered":"2024-09-10T22:44:24.197514+0000","last_unstale":"2024-09-10T22:44:25.198040+0000","last_undegraded":"2024-09-10T22:44:25.198040+0000","last_fullsized":"2024-09-10T22:44:25.198040+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:14.347409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.207801+0000","last_change":"2024-09-10T22:44:23.180560+0000","last_active":"2024-09-10T22:44:25.207801+0000","last_peered":"2024-09-10T22:44:25.207801+0000","last_clean":"2024-09-10T22:44:25.207801+0000","last_became_active":"2024-09-10T22:44:23.180274+0000","last_became_peered":"2024-09-10T22:44:23.180274+0000","last_unstale":"2024-09-10T22:44:25.207801+0000","last_undegraded":"2024-09-10T22:44:25.207801+0000","last_fullsized":"2024-09-10T22:44:25.207801+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:53:19.805095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471417+0000","last_change":"2024-09-10T22:44:24.193744+0000","last_active":"2024-09-10T22:44:25.471417+0000","last_peered":"2024-09-10T22:44:25.471417+0000","last_clean":"2024-09-10T22:44:25.471417+0000","last_became_active":"2024-09-10T22:44:24.192297+0000","last_became_peered":"2024-09-10T22:44:24.192297+0000","last_unstale":"2024-09-10T22:44:25.471417+0000","last_undegraded":"2024-09-10T22:44:25.471417+0000","last_fullsized":"2024-09-10T22:44:25.471417+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:04.391080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471846+0000","last_change":"2024-09-10T22:44:23.188939+0000","last_active":"2024-09-10T22:44:25.471846+0000","last_peered":"2024-09-10T22:44:25.471846+0000","last_clean":"2024-09-10T22:44:25.471846+0000","last_became_active":"2024-09-10T22:44:23.188521+0000","last_became_peered":"2024-09-10T22:44:23.188521+0000","last_unstale":"2024-09-10T22:44:25.471846+0000","last_undegraded":"2024-09-10T22:44:25.471846+0000","last_fullsized":"2024-09-10T22:44:25.471846+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:43.033819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.471031+0000","last_change":"2024-09-10T22:44:24.211980+0000","last_active":"2024-09-10T22:44:25.471031+0000","last_peered":"2024-09-10T22:44:25.471031+0000","last_clean":"2024-09-10T22:44:25.471031+0000","last_became_active":"2024-09-10T22:44:24.211615+0000","last_became_peered":"2024-09-10T22:44:24.211615+0000","last_unstale":"2024-09-10T22:44:25.471031+0000","last_undegraded":"2024-09-10T22:44:25.471031+0000","last_fullsized":"2024-09-10T22:44:25.471031+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:55.445260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199408+0000","last_change":"2024-09-10T22:44:23.192580+0000","last_active":"2024-09-10T22:44:25.199408+0000","last_peered":"2024-09-10T22:44:25.199408+0000","last_clean":"2024-09-10T22:44:25.199408+0000","last_became_active":"2024-09-10T22:44:23.192249+0000","last_became_peered":"2024-09-10T22:44:23.192249+0000","last_unstale":"2024-09-10T22:44:25.199408+0000","last_undegraded":"2024-09-10T22:44:25.199408+0000","last_fullsized":"2024-09-10T22:44:25.199408+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:14.415691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.200030+0000","last_change":"2024-09-10T22:44:24.211635+0000","last_active":"2024-09-10T22:44:25.200030+0000","last_peered":"2024-09-10T22:44:25.200030+0000","last_clean":"2024-09-10T22:44:25.200030+0000","last_became_active":"2024-09-10T22:44:24.211338+0000","last_became_peered":"2024-09-10T22:44:24.211338+0000","last_unstale":"2024-09-10T22:44:25.200030+0000","last_undegraded":"2024-09-10T22:44:25.200030+0000","last_fullsized":"2024-09-10T22:44:25.200030+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:23.160320+0000","last_clean_scrub_stamp":"2024-09-10T22:44:23.160320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:34.552337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.198891+0000","last_change":"2024-09-10T22:44:23.194384+0000","last_active":"2024-09-10T22:44:25.198891+0000","last_peered":"2024-09-10T22:44:25.198891+0000","last_clean":"2024-09-10T22:44:25.198891+0000","last_became_active":"2024-09-10T22:44:23.194107+0000","last_became_peered":"2024-09-10T22:44:23.194107+0000","last_unstale":"2024-09-10T22:44:25.198891+0000","last_undegraded":"2024-09-10T22:44:25.198891+0000","last_fullsized":"2024-09-10T22:44:25.198891+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:44:22.152310+0000","last_clean_scrub_stamp":"2024-09-10T22:44:22.152310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:56.664956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":242,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T22:44:25.199419+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:44:25.199419+0000","last_peered":"2024-09-10T22:44:25.199419+0000","last_clean":"2024-09-10T22:44:25.199419+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:44:25.199419+0000","last_undegraded":"2024-09-10T22:44:25.199419+0000","last_fullsized":"2024-09-10T22:44:25.199419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509513,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1728512,"data_stored":1110231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509513,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1146880,"data_stored":522023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509514,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1126400,"data_stored":519807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509513,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1134592,"data_stored":519967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509513,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1126400,"data_stored":519807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509513,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1126400,"data_stored":519807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509513,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1744896,"data_stored":1112493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1130496,"data_stored":519877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:44:33.207 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T22:44:33.208 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T22:44:33.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.397+0000 7fc668000640 1 -- 172.21.15.103:0/3520393111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc66015add0 msgr2=0x7fc66015b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:33.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.397+0000 7fc668000640 1 --2- 172.21.15.103:0/3520393111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc66015add0 0x7fc66015b1b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc654009840 tx=0x7fc65401c820 comp rx=0 tx=0).stop 2024-09-10T22:44:33.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.397+0000 7fc668000640 1 -- 172.21.15.103:0/3520393111 shutdown_connections 2024-09-10T22:44:33.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.397+0000 7fc668000640 1 --2- 172.21.15.103:0/3520393111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6600b2800 0x7fc6600ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.397+0000 7fc668000640 1 --2- 172.21.15.103:0/3520393111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc66015add0 0x7fc66015b1b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.397+0000 7fc668000640 1 -- 172.21.15.103:0/3520393111 >> 172.21.15.103:0/3520393111 conn(0x7fc6600cf7f0 msgr2=0x7fc6600cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:33.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.397+0000 7fc668000640 1 -- 172.21.15.103:0/3520393111 shutdown_connections 2024-09-10T22:44:33.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.397+0000 7fc668000640 1 -- 172.21.15.103:0/3520393111 wait complete. 2024-09-10T22:44:33.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc668000640 1 Processor -- start 2024-09-10T22:44:33.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc668000640 1 -- start start 2024-09-10T22:44:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc668000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6600b2800 0x7fc66014a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc668000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc66015add0 0x7fc6601f98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc668000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc66015b6f0 0x7fc6600b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc668000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc660167e90 con 0x7fc6600b2800 2024-09-10T22:44:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc668000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc660167d10 con 0x7fc66015add0 2024-09-10T22:44:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc668000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc660168010 con 0x7fc66015b6f0 2024-09-10T22:44:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc665600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6600b2800 0x7fc66014a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc665600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6600b2800 0x7fc66014a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48060/0 (socket says 172.21.15.103:48060) 2024-09-10T22:44:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc665600640 1 -- 172.21.15.103:0/1338986989 learned_addr learned my addr 172.21.15.103:0/1338986989 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc664c00640 1 --2- 172.21.15.103:0/1338986989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc66015add0 0x7fc6601f98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc666000640 1 --2- 172.21.15.103:0/1338986989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc66015b6f0 0x7fc6600b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc665600640 1 -- 172.21.15.103:0/1338986989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc66015b6f0 msgr2=0x7fc6600b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc665600640 1 --2- 172.21.15.103:0/1338986989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc66015b6f0 0x7fc6600b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc665600640 1 -- 172.21.15.103:0/1338986989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc66015add0 msgr2=0x7fc6601f98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:33.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc665600640 1 --2- 172.21.15.103:0/1338986989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc66015add0 0x7fc6601f98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc665600640 1 -- 172.21.15.103:0/1338986989 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6601f9e30 con 0x7fc6600b2800 2024-09-10T22:44:33.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc665600640 1 --2- 172.21.15.103:0/1338986989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6600b2800 0x7fc66014a400 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fc65401d0c0 tx=0x7fc6540a66b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:33.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc65d600640 1 -- 172.21.15.103:0/1338986989 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6540bf070 con 0x7fc6600b2800 2024-09-10T22:44:33.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc65d600640 1 -- 172.21.15.103:0/1338986989 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc654004040 con 0x7fc6600b2800 2024-09-10T22:44:33.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc668000640 1 -- 172.21.15.103:0/1338986989 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6601f5c90 con 0x7fc6600b2800 2024-09-10T22:44:33.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc65d600640 1 -- 172.21.15.103:0/1338986989 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc654004450 con 0x7fc6600b2800 2024-09-10T22:44:33.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc668000640 1 -- 172.21.15.103:0/1338986989 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6601f6250 con 0x7fc6600b2800 2024-09-10T22:44:33.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.401+0000 7fc668000640 1 -- 172.21.15.103:0/1338986989 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6600ae7c0 con 0x7fc6600b2800 2024-09-10T22:44:33.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.405+0000 7fc65d600640 1 -- 172.21.15.103:0/1338986989 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc654005030 con 0x7fc6600b2800 2024-09-10T22:44:33.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.405+0000 7fc65d600640 1 --2- 172.21.15.103:0/1338986989 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc6400725e0 0x7fc640074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:33.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.405+0000 7fc65d600640 1 -- 172.21.15.103:0/1338986989 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fc65412d510 con 0x7fc6600b2800 2024-09-10T22:44:33.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.405+0000 7fc664c00640 1 --2- 172.21.15.103:0/1338986989 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc6400725e0 0x7fc640074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:33.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.405+0000 7fc664c00640 1 --2- 172.21.15.103:0/1338986989 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc6400725e0 0x7fc640074aa0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009600 tx=0x7fc64c0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.409+0000 7fc65d600640 1 -- 172.21.15.103:0/1338986989 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc6601f9e30 con 0x7fc6600b2800 2024-09-10T22:44:33.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.633+0000 7fc668000640 1 -- 172.21.15.103:0/1338986989 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc660151b20 con 0x7fc6600b2800 2024-09-10T22:44:33.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.637+0000 7fc65d600640 1 -- 172.21.15.103:0/1338986989 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7fc654016410 con 0x7fc6600b2800 2024-09-10T22:44:33.640 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-09-10T22:44:33.640 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA8yuBmtOhZNBAAeszxWpV60NIn/zOInT5Zzw== 2024-09-10T22:44:33.640 INFO:teuthology.orchestra.run.smithi103.stdout: caps mds = "allow" 2024-09-10T22:44:33.640 INFO:teuthology.orchestra.run.smithi103.stdout: caps mon = "allow r" 2024-09-10T22:44:33.640 INFO:teuthology.orchestra.run.smithi103.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T22:44:33.641 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2024-09-10T22:44:33.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.637+0000 7fc668000640 1 -- 172.21.15.103:0/1338986989 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc6400725e0 msgr2=0x7fc640074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:33.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.637+0000 7fc668000640 1 --2- 172.21.15.103:0/1338986989 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc6400725e0 0x7fc640074aa0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009600 tx=0x7fc64c0091e0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.637+0000 7fc668000640 1 -- 172.21.15.103:0/1338986989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6600b2800 msgr2=0x7fc66014a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:33.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.637+0000 7fc668000640 1 --2- 172.21.15.103:0/1338986989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6600b2800 0x7fc66014a400 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fc65401d0c0 tx=0x7fc6540a66b0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.637+0000 7fc668000640 1 -- 172.21.15.103:0/1338986989 shutdown_connections 2024-09-10T22:44:33.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.637+0000 7fc668000640 1 --2- 172.21.15.103:0/1338986989 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc6400725e0 0x7fc640074aa0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.637+0000 7fc668000640 1 --2- 172.21.15.103:0/1338986989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc66015b6f0 0x7fc6600b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.637+0000 7fc668000640 1 --2- 172.21.15.103:0/1338986989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc66015add0 0x7fc6601f98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.637+0000 7fc668000640 1 --2- 172.21.15.103:0/1338986989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6600b2800 0x7fc66014a400 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.637+0000 7fc668000640 1 -- 172.21.15.103:0/1338986989 >> 172.21.15.103:0/1338986989 conn(0x7fc6600cf7f0 msgr2=0x7fc66015caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:33.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.637+0000 7fc668000640 1 -- 172.21.15.103:0/1338986989 shutdown_connections 2024-09-10T22:44:33.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.637+0000 7fc668000640 1 -- 172.21.15.103:0/1338986989 wait complete. 2024-09-10T22:44:33.662 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:44:33.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b91200640 1 -- 172.21.15.103:0/3195966930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b8c06f0c0 msgr2=0x7f2b8c073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:33.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b91200640 1 --2- 172.21.15.103:0/3195966930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b8c06f0c0 0x7f2b8c073610 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009840 tx=0x7f2b7401c820 comp rx=0 tx=0).stop 2024-09-10T22:44:33.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b91200640 1 -- 172.21.15.103:0/3195966930 shutdown_connections 2024-09-10T22:44:33.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b91200640 1 --2- 172.21.15.103:0/3195966930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b8c06f0c0 0x7f2b8c073610 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b91200640 1 --2- 172.21.15.103:0/3195966930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2b8c0cf9f0 0x7f2b8c06eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b91200640 1 -- 172.21.15.103:0/3195966930 >> 172.21.15.103:0/3195966930 conn(0x7f2b8c06cc00 msgr2=0x7f2b8c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:33.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b91200640 1 -- 172.21.15.103:0/3195966930 shutdown_connections 2024-09-10T22:44:33.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b91200640 1 -- 172.21.15.103:0/3195966930 wait complete. 2024-09-10T22:44:33.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b91200640 1 Processor -- start 2024-09-10T22:44:33.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b91200640 1 -- start start 2024-09-10T22:44:33.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b91200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b8c06f0c0 0x7f2b8c149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:33.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b91200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b8c0cf9f0 0x7f2b8c1f7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:33.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b91200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2b8c0cfdd0 0x7f2b8c1f8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:33.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b91200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8c0cd690 con 0x7f2b8c06f0c0 2024-09-10T22:44:33.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b91200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8c0cd510 con 0x7f2b8c0cf9f0 2024-09-10T22:44:33.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b91200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2b8c0cd810 con 0x7f2b8c0cfdd0 2024-09-10T22:44:33.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b89e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b8c06f0c0 0x7f2b8c149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:33.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b89e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b8c06f0c0 0x7f2b8c149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48070/0 (socket says 172.21.15.103:48070) 2024-09-10T22:44:33.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b89e00640 1 -- 172.21.15.103:0/3961892407 learned_addr learned my addr 172.21.15.103:0/3961892407 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b89e00640 1 -- 172.21.15.103:0/3961892407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2b8c0cfdd0 msgr2=0x7f2b8c1f8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b89e00640 1 --2- 172.21.15.103:0/3961892407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2b8c0cfdd0 0x7f2b8c1f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b89e00640 1 -- 172.21.15.103:0/3961892407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b8c0cf9f0 msgr2=0x7f2b8c1f7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b89e00640 1 --2- 172.21.15.103:0/3961892407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b8c0cf9f0 0x7f2b8c1f7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b89e00640 1 -- 172.21.15.103:0/3961892407 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8c151ca0 con 0x7f2b8c06f0c0 2024-09-10T22:44:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.801+0000 7f2b89e00640 1 --2- 172.21.15.103:0/3961892407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b8c06f0c0 0x7f2b8c149180 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00d950 tx=0x7f2b7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.805+0000 7f2b82a00640 1 -- 172.21.15.103:0/3961892407 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c017070 con 0x7f2b8c06f0c0 2024-09-10T22:44:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.805+0000 7f2b82a00640 1 -- 172.21.15.103:0/3961892407 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b7c009cc0 con 0x7f2b8c06f0c0 2024-09-10T22:44:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.805+0000 7f2b91200640 1 -- 172.21.15.103:0/3961892407 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8c151f80 con 0x7f2b8c06f0c0 2024-09-10T22:44:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.805+0000 7f2b82a00640 1 -- 172.21.15.103:0/3961892407 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c0106c0 con 0x7f2b8c06f0c0 2024-09-10T22:44:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.805+0000 7f2b91200640 1 -- 172.21.15.103:0/3961892407 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b8c1f79a0 con 0x7f2b8c06f0c0 2024-09-10T22:44:33.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.805+0000 7f2b91200640 1 -- 172.21.15.103:0/3961892407 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b8c06eb80 con 0x7f2b8c06f0c0 2024-09-10T22:44:33.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.805+0000 7f2b82a00640 1 -- 172.21.15.103:0/3961892407 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2b7c010860 con 0x7f2b8c06f0c0 2024-09-10T22:44:33.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.805+0000 7f2b82a00640 1 --2- 172.21.15.103:0/3961892407 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2b680725e0 0x7f2b68074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:33.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.805+0000 7f2b82a00640 1 -- 172.21.15.103:0/3961892407 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f2b7c093880 con 0x7f2b8c06f0c0 2024-09-10T22:44:33.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.805+0000 7f2b81400640 1 --2- 172.21.15.103:0/3961892407 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2b680725e0 0x7f2b68074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:33.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.809+0000 7f2b81400640 1 --2- 172.21.15.103:0/3961892407 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2b680725e0 0x7f2b68074aa0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2b740af000 tx=0x7f2b740195c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:33.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:33.809+0000 7f2b82a00640 1 -- 172.21.15.103:0/3961892407 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2b7c05ecd0 con 0x7f2b8c06f0c0 2024-09-10T22:44:34.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.009+0000 7f2b91200640 1 -- 172.21.15.103:0/3961892407 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b8c15a220 con 0x7f2b8c06f0c0 2024-09-10T22:44:34.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.013+0000 7f2b82a00640 1 -- 172.21.15.103:0/3961892407 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5234 (secure 0 0 0) 0x7f2b7c05e5d0 con 0x7f2b8c06f0c0 2024-09-10T22:44:34.016 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:34.016 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"btime":"2024-09-10T22:44:27:201245+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2586411857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2586411857},{"type":"v1","addr":"172.21.15.131:6837","nonce":2586411857}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84},{"gid":7048,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/1622106563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1622106563},{"type":"v1","addr":"172.21.15.131:6836","nonce":1622106563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84},{"gid":7428,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6834/3251348074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3251348074},{"type":"v1","addr":"172.21.15.103:6834","nonce":3251348074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:44:23.558537+0000","modified":"2024-09-10T22:44:26.577936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7434":{"gid":7434,"name":"c","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/187627880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":187627880},{"type":"v1","addr":"172.21.15.103:6835","nonce":187627880}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7434,"qdb_cluster":[7434]},"id":6}]} 2024-09-10T22:44:34.017 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 89 2024-09-10T22:44:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.013+0000 7f2b91200640 1 -- 172.21.15.103:0/3961892407 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2b680725e0 msgr2=0x7f2b68074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.013+0000 7f2b91200640 1 --2- 172.21.15.103:0/3961892407 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2b680725e0 0x7f2b68074aa0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2b740af000 tx=0x7f2b740195c0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.013+0000 7f2b91200640 1 -- 172.21.15.103:0/3961892407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b8c06f0c0 msgr2=0x7f2b8c149180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.013+0000 7f2b91200640 1 --2- 172.21.15.103:0/3961892407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b8c06f0c0 0x7f2b8c149180 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00d950 tx=0x7f2b7c00de10 comp rx=0 tx=0).stop 2024-09-10T22:44:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.013+0000 7f2b91200640 1 -- 172.21.15.103:0/3961892407 shutdown_connections 2024-09-10T22:44:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.013+0000 7f2b91200640 1 --2- 172.21.15.103:0/3961892407 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2b680725e0 0x7f2b68074aa0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.013+0000 7f2b91200640 1 --2- 172.21.15.103:0/3961892407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2b8c0cfdd0 0x7f2b8c1f8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.013+0000 7f2b91200640 1 --2- 172.21.15.103:0/3961892407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b8c0cf9f0 0x7f2b8c1f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.013+0000 7f2b91200640 1 --2- 172.21.15.103:0/3961892407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b8c06f0c0 0x7f2b8c149180 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.013+0000 7f2b91200640 1 -- 172.21.15.103:0/3961892407 >> 172.21.15.103:0/3961892407 conn(0x7f2b8c06cc00 msgr2=0x7f2b8c157ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.013+0000 7f2b91200640 1 -- 172.21.15.103:0/3961892407 shutdown_connections 2024-09-10T22:44:34.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.013+0000 7f2b91200640 1 -- 172.21.15.103:0/3961892407 wait complete. 2024-09-10T22:44:34.441 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 89, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:44:23.558537+0000', 'modified': '2024-09-10T22:44:26.577936+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7434}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7434': {'gid': 7434, 'name': 'c', 'rank': 0, 'incarnation': 85, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/187627880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6833', 'nonce': 187627880}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 187627880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7434, 'qdb_cluster': [7434]} 2024-09-10T22:44:34.441 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T22:44:34.441 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T22:44:34.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb9800640 1 -- 172.21.15.103:0/1266444612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb40cf9f0 msgr2=0x7feeb406eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:34.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb9800640 1 --2- 172.21.15.103:0/1266444612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb40cf9f0 0x7feeb406eb80 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7feea4009c80 tx=0x7feea401cda0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb9800640 1 -- 172.21.15.103:0/1266444612 shutdown_connections 2024-09-10T22:44:34.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb9800640 1 --2- 172.21.15.103:0/1266444612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feeb406f0c0 0x7feeb4073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb9800640 1 --2- 172.21.15.103:0/1266444612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb40cf9f0 0x7feeb406eb80 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb9800640 1 -- 172.21.15.103:0/1266444612 >> 172.21.15.103:0/1266444612 conn(0x7feeb406cc00 msgr2=0x7feeb406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb9800640 1 -- 172.21.15.103:0/1266444612 shutdown_connections 2024-09-10T22:44:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb9800640 1 -- 172.21.15.103:0/1266444612 wait complete. 2024-09-10T22:44:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb9800640 1 Processor -- start 2024-09-10T22:44:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb9800640 1 -- start start 2024-09-10T22:44:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb9800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb406f0c0 0x7feeb413bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb9800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feeb40cf9f0 0x7feeb41f8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb9800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feeb40cfdd0 0x7feeb41f4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb9800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feeb40cd690 con 0x7feeb406f0c0 2024-09-10T22:44:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb9800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feeb40cd510 con 0x7feeb40cf9f0 2024-09-10T22:44:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb9800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7feeb40cd810 con 0x7feeb40cfdd0 2024-09-10T22:44:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb406f0c0 0x7feeb413bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb406f0c0 0x7feeb413bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48088/0 (socket says 172.21.15.103:48088) 2024-09-10T22:44:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb2a00640 1 -- 172.21.15.103:0/1151847152 learned_addr learned my addr 172.21.15.103:0/1151847152 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb3400640 1 --2- 172.21.15.103:0/1151847152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feeb40cfdd0 0x7feeb41f4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.581+0000 7feeb2000640 1 --2- 172.21.15.103:0/1151847152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feeb40cf9f0 0x7feeb41f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.585+0000 7feeb2a00640 1 -- 172.21.15.103:0/1151847152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feeb40cfdd0 msgr2=0x7feeb41f4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.585+0000 7feeb2a00640 1 --2- 172.21.15.103:0/1151847152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feeb40cfdd0 0x7feeb41f4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.585+0000 7feeb2a00640 1 -- 172.21.15.103:0/1151847152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feeb40cf9f0 msgr2=0x7feeb41f8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.585+0000 7feeb2a00640 1 --2- 172.21.15.103:0/1151847152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feeb40cf9f0 0x7feeb41f8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.585+0000 7feeb2a00640 1 -- 172.21.15.103:0/1151847152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb4158290 con 0x7feeb406f0c0 2024-09-10T22:44:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.585+0000 7feeb2a00640 1 --2- 172.21.15.103:0/1151847152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb406f0c0 0x7feeb413bd50 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7feea4000f90 tx=0x7feea40a5ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.585+0000 7feeaaa00640 1 -- 172.21.15.103:0/1151847152 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea40b2040 con 0x7feeb406f0c0 2024-09-10T22:44:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.585+0000 7feeaaa00640 1 -- 172.21.15.103:0/1151847152 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feea40042c0 con 0x7feeb406f0c0 2024-09-10T22:44:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.585+0000 7feeb9800640 1 -- 172.21.15.103:0/1151847152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb41f8bd0 con 0x7feeb406f0c0 2024-09-10T22:44:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.585+0000 7feeaaa00640 1 -- 172.21.15.103:0/1151847152 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea40046f0 con 0x7feeb406f0c0 2024-09-10T22:44:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.585+0000 7feeb9800640 1 -- 172.21.15.103:0/1151847152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb413e420 con 0x7feeb406f0c0 2024-09-10T22:44:34.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.585+0000 7feeaaa00640 1 -- 172.21.15.103:0/1151847152 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7feea40b5070 con 0x7feeb406f0c0 2024-09-10T22:44:34.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.585+0000 7feeaaa00640 1 --2- 172.21.15.103:0/1151847152 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fee940725e0 0x7fee94074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feeaaa00640 1 -- 172.21.15.103:0/1151847152 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7feea412d950 con 0x7feeb406f0c0 2024-09-10T22:44:34.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 Processor -- start 2024-09-10T22:44:34.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 -- start start 2024-09-10T22:44:34.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feeb2000640 1 --2- 172.21.15.103:0/1151847152 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fee940725e0 0x7fee94074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 0x55f397daddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397dae2f0 0x55f397d618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397d61e10 0x55f397d621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f397c823f0 con 0x55f397d61e10 2024-09-10T22:44:34.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f397bbfb20 con 0x55f397dad9d0 2024-09-10T22:44:34.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55f397baef50 con 0x55f397dae2f0 2024-09-10T22:44:34.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feeb2000640 1 --2- 172.21.15.103:0/1151847152 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fee940725e0 0x7fee94074aa0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7feeb40aea00 tx=0x7feea0009110 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:34.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feeb3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397d61e10 0x55f397d621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feeb3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397d61e10 0x55f397d621f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48094/0 (socket says 172.21.15.103:48094) 2024-09-10T22:44:34.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feeb3400640 1 -- 172.21.15.103:0/600980197 learned_addr learned my addr 172.21.15.103:0/600980197 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:34.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feeb2a00640 1 --2- 172.21.15.103:0/600980197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 0x55f397daddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feeb2000640 1 --2- 172.21.15.103:0/600980197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397dae2f0 0x55f397d618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feeb3400640 1 -- 172.21.15.103:0/600980197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397dae2f0 msgr2=0x55f397d618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:34.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feeb3400640 1 --2- 172.21.15.103:0/600980197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397dae2f0 0x55f397d618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feeb3400640 1 -- 172.21.15.103:0/600980197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 msgr2=0x55f397daddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:34.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feeb3400640 1 --2- 172.21.15.103:0/600980197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 0x55f397daddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feeb3400640 1 -- 172.21.15.103:0/600980197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f397b76590 con 0x55f397d61e10 2024-09-10T22:44:34.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feeb2000640 1 --2- 172.21.15.103:0/600980197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397dae2f0 0x55f397d618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:34.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feeb3400640 1 --2- 172.21.15.103:0/600980197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397d61e10 0x55f397d621f0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7feeac009940 tx=0x7feeac009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc2790cbe2c2921 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:34.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7fee9f400640 1 -- 172.21.15.103:0/600980197 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac017070 con 0x55f397d61e10 2024-09-10T22:44:34.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7fee9f400640 1 -- 172.21.15.103:0/600980197 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feeac00ea80 con 0x55f397d61e10 2024-09-10T22:44:34.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7fee9f400640 1 -- 172.21.15.103:0/600980197 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac004020 con 0x55f397d61e10 2024-09-10T22:44:34.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 -- 172.21.15.103:0/600980197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397d61e10 msgr2=0x55f397d621f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:34.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 --2- 172.21.15.103:0/600980197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397d61e10 0x55f397d621f0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7feeac009940 tx=0x7feeac009e00 comp rx=0 tx=0).stop 2024-09-10T22:44:34.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 -- 172.21.15.103:0/600980197 shutdown_connections 2024-09-10T22:44:34.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 --2- 172.21.15.103:0/600980197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397d61e10 0x55f397d621f0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 --2- 172.21.15.103:0/600980197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397dae2f0 0x55f397d618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 --2- 172.21.15.103:0/600980197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 0x55f397daddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 -- 172.21.15.103:0/600980197 >> 172.21.15.103:0/600980197 conn(0x55f397c4b130 msgr2=0x55f397d90e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:34.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 -- 172.21.15.103:0/600980197 shutdown_connections 2024-09-10T22:44:34.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 -- 172.21.15.103:0/600980197 wait complete. 2024-09-10T22:44:34.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 -- start start 2024-09-10T22:44:34.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.589+0000 7feebcc3e000 1 Processor -- start 2024-09-10T22:44:34.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feebcc3e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397d61e10 0x55f397d8e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feebcc3e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 0x55f397d8ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feebcc3e000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 0x55f397d8f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feebcc3e000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f397b495d0 con 0x55f397dae2f0 2024-09-10T22:44:34.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feebcc3e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f397bb2d60 con 0x55f397dad9d0 2024-09-10T22:44:34.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feebcc3e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55f397b55500 con 0x55f397d61e10 2024-09-10T22:44:34.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feebcc3e000 10 client.0 _ll_register_callbacks cb 0x55f397b59810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:34.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feeb3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 0x55f397d8f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feeb3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 0x55f397d8f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48096/0 (socket says 172.21.15.103:48096) 2024-09-10T22:44:34.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feeb3400640 1 -- 172.21.15.103:0/792715987 learned_addr learned my addr 172.21.15.103:0/792715987 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:34.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feeb2a00640 1 --2- 172.21.15.103:0/792715987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397d61e10 0x55f397d8e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feeb2000640 1 --2- 172.21.15.103:0/792715987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 0x55f397d8ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feeb3400640 1 -- 172.21.15.103:0/792715987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397d61e10 msgr2=0x55f397d8e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:34.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feeb3400640 1 --2- 172.21.15.103:0/792715987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397d61e10 0x55f397d8e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feeb3400640 1 -- 172.21.15.103:0/792715987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 msgr2=0x55f397d8ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:34.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feeb3400640 1 --2- 172.21.15.103:0/792715987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 0x55f397d8ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feeb3400640 1 -- 172.21.15.103:0/792715987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f397b4d170 con 0x55f397dae2f0 2024-09-10T22:44:34.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feeb3400640 1 --2- 172.21.15.103:0/792715987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 0x55f397d8f3b0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x55f397b60130 tx=0x7feeac0044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b7dbadb0914d58 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:34.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7fee93e00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:34.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7fee93e00640 1 -- 172.21.15.103:0/792715987 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac017070 con 0x55f397dae2f0 2024-09-10T22:44:34.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7fee93e00640 1 -- 172.21.15.103:0/792715987 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7feeac003a10 con 0x55f397dae2f0 2024-09-10T22:44:34.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feebcc3e000 1 -- 172.21.15.103:0/792715987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f397b470f0 con 0x55f397dae2f0 2024-09-10T22:44:34.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7fee93e00640 1 -- 172.21.15.103:0/792715987 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7feeac02b050 con 0x55f397dae2f0 2024-09-10T22:44:34.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feebcc3e000 10 client.7575 fetch_fsmap learned FSMap version 89 2024-09-10T22:44:34.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feebcc3e000 1 -- 172.21.15.103:0/792715987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55f397c33ef0 con 0x55f397dae2f0 2024-09-10T22:44:34.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7fee93e00640 1 -- 172.21.15.103:0/792715987 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f397b470f0 con 0x55f397dae2f0 2024-09-10T22:44:34.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7fee93e00640 1 -- 172.21.15.103:0/792715987 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7feeac02e020 con 0x55f397dae2f0 2024-09-10T22:44:34.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feebcc3e000 10 client.7575 fetch_fsmap finished waiting for FSMap version 89 2024-09-10T22:44:34.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feebcc3e000 10 client.7575 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:44:34.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feebcc3e000 20 client.7575 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:34.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feebcc3e000 1 --2- 172.21.15.103:0/792715987 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55f397d900f0 0x55f397dbfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feebcc3e000 4 client.7575 mds_command: new command op to 7434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:34.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feebcc3e000 1 -- 172.21.15.103:0/792715987 --> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f397bc1a70 con 0x55f397d900f0 2024-09-10T22:44:34.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feeb2a00640 1 --2- 172.21.15.103:0/792715987 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55f397d900f0 0x55f397dbfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7feeb2a00640 1 --2- 172.21.15.103:0/792715987 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55f397d900f0 0x55f397dbfc90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c546a7b7ae42bc63 server_cookie=51016ae4a41d2d3d in_seq=0 out_seq=0 2024-09-10T22:44:34.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7fee93e00640 10 client.7575 ms_handle_connect on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:34.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7fee93e00640 1 -- 172.21.15.103:0/792715987 <== mds.0 v2:172.21.15.103:6833/187627880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f397bc1a70 con 0x55f397d900f0 2024-09-10T22:44:34.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.593+0000 7fee93e00640 10 client.7575 handle_command_reply: tid=0 2024-09-10T22:44:34.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.597+0000 7feebcc3e000 1 client.7575 shutdown 2024-09-10T22:44:34.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.597+0000 7feebcc3e000 1 -- 172.21.15.103:0/792715987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 msgr2=0x55f397d8f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:34.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.597+0000 7feebcc3e000 1 --2- 172.21.15.103:0/792715987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 0x55f397d8f3b0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x55f397b60130 tx=0x7feeac0044b0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.597+0000 7feebcc3e000 1 -- 172.21.15.103:0/792715987 shutdown_connections 2024-09-10T22:44:34.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.597+0000 7feebcc3e000 1 --2- 172.21.15.103:0/792715987 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55f397d900f0 0x55f397dbfc90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.597+0000 7feebcc3e000 1 --2- 172.21.15.103:0/792715987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 0x55f397d8f3b0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.597+0000 7fee93e00640 0 client.7575 ms_handle_reset on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.597+0000 7feebcc3e000 1 --2- 172.21.15.103:0/792715987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 0x55f397d8ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.597+0000 7feebcc3e000 1 --2- 172.21.15.103:0/792715987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397d61e10 0x55f397d8e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.597+0000 7feebcc3e000 1 -- 172.21.15.103:0/792715987 >> 172.21.15.103:0/792715987 conn(0x55f397c4b130 msgr2=0x55f397d60fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.597+0000 7feebcc3e000 1 -- 172.21.15.103:0/792715987 shutdown_connections 2024-09-10T22:44:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.597+0000 7feebcc3e000 1 -- 172.21.15.103:0/792715987 wait complete. 2024-09-10T22:44:34.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.597+0000 7feebcc3e000 20 client.7575 trim_cache size 0 max 16384 2024-09-10T22:44:34.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.613+0000 7feebcc3e000 1 Processor -- start 2024-09-10T22:44:34.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.613+0000 7feebcc3e000 1 -- start start 2024-09-10T22:44:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397d61e10 0x55f397e1f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 0x55f397e1fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 0x55f397e20430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feeb42045a0 con 0x55f397dae2f0 2024-09-10T22:44:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feeb41fb200 con 0x55f397dad9d0 2024-09-10T22:44:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7feeb40cb4a0 con 0x55f397d61e10 2024-09-10T22:44:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feeb3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 0x55f397e20430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feeb3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 0x55f397e20430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48104/0 (socket says 172.21.15.103:48104) 2024-09-10T22:44:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feeb3400640 1 -- 172.21.15.103:0/976310980 learned_addr learned my addr 172.21.15.103:0/976310980 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feeb2a00640 1 --2- 172.21.15.103:0/976310980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397d61e10 0x55f397e1f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feeb2000640 1 --2- 172.21.15.103:0/976310980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 0x55f397e1fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feeb3400640 1 -- 172.21.15.103:0/976310980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397d61e10 msgr2=0x55f397e1f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:34.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feeb3400640 1 --2- 172.21.15.103:0/976310980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397d61e10 0x55f397e1f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feeb3400640 1 -- 172.21.15.103:0/976310980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 msgr2=0x55f397e1fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:34.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feeb3400640 1 --2- 172.21.15.103:0/976310980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 0x55f397e1fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feeb3400640 1 -- 172.21.15.103:0/976310980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f397c0ad90 con 0x55f397dae2f0 2024-09-10T22:44:34.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feeb2000640 1 --2- 172.21.15.103:0/976310980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 0x55f397e1fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:34.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feeb2a00640 1 --2- 172.21.15.103:0/976310980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397d61e10 0x55f397e1f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:34.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feeb3400640 1 --2- 172.21.15.103:0/976310980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 0x55f397e20430 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7feeac006dd0 tx=0x7feeac003aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e711902a47dce94b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:34.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7fee9ea00640 1 -- 172.21.15.103:0/976310980 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac017070 con 0x55f397dae2f0 2024-09-10T22:44:34.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7fee9ea00640 1 -- 172.21.15.103:0/976310980 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feeac013670 con 0x55f397dae2f0 2024-09-10T22:44:34.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7fee9ea00640 1 -- 172.21.15.103:0/976310980 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac013ac0 con 0x55f397dae2f0 2024-09-10T22:44:34.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 -- 172.21.15.103:0/976310980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 msgr2=0x55f397e20430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:34.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 --2- 172.21.15.103:0/976310980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 0x55f397e20430 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7feeac006dd0 tx=0x7feeac003aa0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 -- 172.21.15.103:0/976310980 shutdown_connections 2024-09-10T22:44:34.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 --2- 172.21.15.103:0/976310980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 0x55f397e20430 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 --2- 172.21.15.103:0/976310980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 0x55f397e1fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 --2- 172.21.15.103:0/976310980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397d61e10 0x55f397e1f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 -- 172.21.15.103:0/976310980 >> 172.21.15.103:0/976310980 conn(0x55f397c4b130 msgr2=0x55f397dbafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:34.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 -- 172.21.15.103:0/976310980 shutdown_connections 2024-09-10T22:44:34.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 -- 172.21.15.103:0/976310980 wait complete. 2024-09-10T22:44:34.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 -- start start 2024-09-10T22:44:34.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 Processor -- start 2024-09-10T22:44:34.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397d61e10 0x55f397e235d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 0x55f397e23b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 0x55f397e24050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f397d5bd80 con 0x55f397dae2f0 2024-09-10T22:44:34.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f397bb7390 con 0x55f397dad9d0 2024-09-10T22:44:34.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55f397bb2070 con 0x55f397d61e10 2024-09-10T22:44:34.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feebcc3e000 10 client.0 _ll_register_callbacks cb 0x7feea4009540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:34.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.617+0000 7feeb3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 0x55f397e24050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 0x55f397e24050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48106/0 (socket says 172.21.15.103:48106) 2024-09-10T22:44:34.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb3400640 1 -- 172.21.15.103:0/202374559 learned_addr learned my addr 172.21.15.103:0/202374559 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:34.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb2a00640 1 --2- 172.21.15.103:0/202374559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397d61e10 0x55f397e235d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb2000640 1 --2- 172.21.15.103:0/202374559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 0x55f397e23b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb3400640 1 -- 172.21.15.103:0/202374559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397d61e10 msgr2=0x55f397e235d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:34.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb3400640 1 --2- 172.21.15.103:0/202374559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397d61e10 0x55f397e235d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb3400640 1 -- 172.21.15.103:0/202374559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 msgr2=0x55f397e23b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:34.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb3400640 1 --2- 172.21.15.103:0/202374559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 0x55f397e23b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb3400640 1 -- 172.21.15.103:0/202374559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f397b75a90 con 0x55f397dae2f0 2024-09-10T22:44:34.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb2000640 1 --2- 172.21.15.103:0/202374559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 0x55f397e23b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:34.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb3400640 1 --2- 172.21.15.103:0/202374559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 0x55f397e24050 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7feeac00e5a0 tx=0x7feeac023b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40364f6a5a577b1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:34.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7fee93e00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:34.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7fee93e00640 1 -- 172.21.15.103:0/202374559 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac017040 con 0x55f397dae2f0 2024-09-10T22:44:34.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7fee93e00640 1 -- 172.21.15.103:0/202374559 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7feeac023cc0 con 0x55f397dae2f0 2024-09-10T22:44:34.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 1 -- 172.21.15.103:0/202374559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feeac013670 con 0x55f397dae2f0 2024-09-10T22:44:34.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7fee93e00640 1 -- 172.21.15.103:0/202374559 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7feeac005920 con 0x55f397dae2f0 2024-09-10T22:44:34.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 10 client.7581 fetch_fsmap learned FSMap version 89 2024-09-10T22:44:34.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 1 -- 172.21.15.103:0/202374559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55f397b54050 con 0x55f397dae2f0 2024-09-10T22:44:34.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7fee93e00640 1 -- 172.21.15.103:0/202374559 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feeac013670 con 0x55f397dae2f0 2024-09-10T22:44:34.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7fee93e00640 1 -- 172.21.15.103:0/202374559 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7feeac02e040 con 0x55f397dae2f0 2024-09-10T22:44:34.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 10 client.7581 fetch_fsmap finished waiting for FSMap version 89 2024-09-10T22:44:34.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 10 client.7581 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:44:34.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 20 client.7581 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:34.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 1 --2- 172.21.15.103:0/202374559 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55f397dc1be0 0x55f397dc1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 4 client.7581 mds_command: new command op to 7434 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:44:34.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 1 -- 172.21.15.103:0/202374559 --> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] -- command(tid 0: {"prefix": "status"}) -- 0x55f397bbd520 con 0x55f397dc1be0 2024-09-10T22:44:34.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb2a00640 1 --2- 172.21.15.103:0/202374559 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55f397dc1be0 0x55f397dc1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb2a00640 1 --2- 172.21.15.103:0/202374559 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55f397dc1be0 0x55f397dc1fc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a69575b8a297cf server_cookie=b60148f444b6fc0f in_seq=0 out_seq=0 2024-09-10T22:44:34.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7fee93e00640 10 client.7581 ms_handle_connect on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:34.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7fee93e00640 1 -- 172.21.15.103:0/202374559 <== mds.0 v2:172.21.15.103:6833/187627880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55f397bbd520 con 0x55f397dc1be0 2024-09-10T22:44:34.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7fee93e00640 10 client.7581 handle_command_reply: tid=0 2024-09-10T22:44:34.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 1 client.7581 shutdown 2024-09-10T22:44:34.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 1 -- 172.21.15.103:0/202374559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 msgr2=0x55f397e24050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:34.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 1 --2- 172.21.15.103:0/202374559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 0x55f397e24050 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7feeac00e5a0 tx=0x7feeac023b50 comp rx=0 tx=0).stop 2024-09-10T22:44:34.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 1 -- 172.21.15.103:0/202374559 shutdown_connections 2024-09-10T22:44:34.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 1 --2- 172.21.15.103:0/202374559 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55f397dc1be0 0x55f397dc1fc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 1 --2- 172.21.15.103:0/202374559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f397dae2f0 0x55f397e24050 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 1 --2- 172.21.15.103:0/202374559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f397dad9d0 0x55f397e23b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7fee93e00640 0 client.7581 ms_handle_reset on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:34.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 1 --2- 172.21.15.103:0/202374559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f397d61e10 0x55f397e235d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 1 -- 172.21.15.103:0/202374559 >> 172.21.15.103:0/202374559 conn(0x55f397c4b130 msgr2=0x55f397d69ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:34.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 1 -- 172.21.15.103:0/202374559 shutdown_connections 2024-09-10T22:44:34.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 1 -- 172.21.15.103:0/202374559 wait complete. 2024-09-10T22:44:34.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feebcc3e000 20 client.7581 trim_cache size 0 max 16384 2024-09-10T22:44:34.632 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:44:34.632 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:44:34.632 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-10T22:44:34.632 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7434, 2024-09-10T22:44:34.632 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:44:34.632 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:44:34.632 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:44:34.633 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 10.436052585000001, 2024-09-10T22:44:34.633 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 89, 2024-09-10T22:44:34.633 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 94, 2024-09-10T22:44:34.633 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 92, 2024-09-10T22:44:34.633 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 14.964604411 2024-09-10T22:44:34.633 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:44:34.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb9800640 1 -- 172.21.15.103:0/1151847152 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fee940725e0 msgr2=0x7fee94074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:34.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb9800640 1 --2- 172.21.15.103:0/1151847152 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fee940725e0 0x7fee94074aa0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7feeb40aea00 tx=0x7feea0009110 comp rx=0 tx=0).stop 2024-09-10T22:44:34.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb9800640 1 -- 172.21.15.103:0/1151847152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb406f0c0 msgr2=0x7feeb413bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:34.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb9800640 1 --2- 172.21.15.103:0/1151847152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb406f0c0 0x7feeb413bd50 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7feea4000f90 tx=0x7feea40a5ae0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb9800640 1 -- 172.21.15.103:0/1151847152 shutdown_connections 2024-09-10T22:44:34.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb9800640 1 --2- 172.21.15.103:0/1151847152 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fee940725e0 0x7fee94074aa0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb9800640 1 --2- 172.21.15.103:0/1151847152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feeb40cfdd0 0x7feeb41f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb9800640 1 --2- 172.21.15.103:0/1151847152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feeb40cf9f0 0x7feeb41f8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb9800640 1 --2- 172.21.15.103:0/1151847152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feeb406f0c0 0x7feeb413bd50 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb9800640 1 -- 172.21.15.103:0/1151847152 >> 172.21.15.103:0/1151847152 conn(0x7feeb406cc00 msgr2=0x7feeb4159710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:34.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb9800640 1 -- 172.21.15.103:0/1151847152 shutdown_connections 2024-09-10T22:44:34.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.621+0000 7feeb9800640 1 -- 172.21.15.103:0/1151847152 wait complete. 2024-09-10T22:44:34.645 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T22:44:34.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.785+0000 7fda5d000640 1 -- 172.21.15.103:0/3365534878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda3c003a60 msgr2=0x7fda3c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:34.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.785+0000 7fda5d000640 1 --2- 172.21.15.103:0/3365534878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda3c003a60 0x7fda3c003e80 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fda48001dc0 tx=0x7fda4801cad0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.785+0000 7fda5d000640 1 -- 172.21.15.103:0/3365534878 shutdown_connections 2024-09-10T22:44:34.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.785+0000 7fda5d000640 1 --2- 172.21.15.103:0/3365534878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda3c003a60 0x7fda3c003e80 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.785+0000 7fda5d000640 1 -- 172.21.15.103:0/3365534878 >> 172.21.15.103:0/3365534878 conn(0x7fda5806cc00 msgr2=0x7fda5806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:34.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.785+0000 7fda5d000640 1 -- 172.21.15.103:0/3365534878 shutdown_connections 2024-09-10T22:44:34.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.785+0000 7fda5d000640 1 -- 172.21.15.103:0/3365534878 wait complete. 2024-09-10T22:44:34.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.785+0000 7fda5d000640 1 Processor -- start 2024-09-10T22:44:34.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.785+0000 7fda5d000640 1 -- start start 2024-09-10T22:44:34.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.785+0000 7fda5d000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda3c003a60 0x7fda5815adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.785+0000 7fda5d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda5815cb10 0x7fda5815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.785+0000 7fda5d000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda581f6170 0x7fda581f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.785+0000 7fda5d000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fda580739a0 con 0x7fda5815cb10 2024-09-10T22:44:34.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.785+0000 7fda5d000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fda58073820 con 0x7fda581f6170 2024-09-10T22:44:34.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.785+0000 7fda5d000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fda58073b20 con 0x7fda3c003a60 2024-09-10T22:44:34.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda55400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda5815cb10 0x7fda5815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda55400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda5815cb10 0x7fda5815cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48116/0 (socket says 172.21.15.103:48116) 2024-09-10T22:44:34.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda55400640 1 -- 172.21.15.103:0/727140553 learned_addr learned my addr 172.21.15.103:0/727140553 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:34.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda55e00640 1 --2- 172.21.15.103:0/727140553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda3c003a60 0x7fda5815adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda56800640 1 --2- 172.21.15.103:0/727140553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda581f6170 0x7fda581f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda55400640 1 -- 172.21.15.103:0/727140553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda3c003a60 msgr2=0x7fda5815adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:34.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda55400640 1 --2- 172.21.15.103:0/727140553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda3c003a60 0x7fda5815adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda55400640 1 -- 172.21.15.103:0/727140553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda581f6170 msgr2=0x7fda581f6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:34.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda55400640 1 --2- 172.21.15.103:0/727140553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda581f6170 0x7fda581f6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:34.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda55400640 1 -- 172.21.15.103:0/727140553 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5815d680 con 0x7fda5815cb10 2024-09-10T22:44:34.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda55e00640 1 --2- 172.21.15.103:0/727140553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda3c003a60 0x7fda5815adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:34.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda55400640 1 --2- 172.21.15.103:0/727140553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda5815cb10 0x7fda5815cf70 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fda44011ae0 tx=0x7fda44009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:34.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda4e000640 1 -- 172.21.15.103:0/727140553 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4400fcd0 con 0x7fda5815cb10 2024-09-10T22:44:34.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda4e000640 1 -- 172.21.15.103:0/727140553 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda4400fe70 con 0x7fda5815cb10 2024-09-10T22:44:34.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda5d000640 1 -- 172.21.15.103:0/727140553 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda5815d960 con 0x7fda5815cb10 2024-09-10T22:44:34.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda4e000640 1 -- 172.21.15.103:0/727140553 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda44004260 con 0x7fda5815cb10 2024-09-10T22:44:34.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda5d000640 1 -- 172.21.15.103:0/727140553 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda5815df20 con 0x7fda5815cb10 2024-09-10T22:44:34.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda5d000640 1 -- 172.21.15.103:0/727140553 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda58074080 con 0x7fda5815cb10 2024-09-10T22:44:34.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.789+0000 7fda4e000640 1 -- 172.21.15.103:0/727140553 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fda44003600 con 0x7fda5815cb10 2024-09-10T22:44:34.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.793+0000 7fda4e000640 1 --2- 172.21.15.103:0/727140553 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda380725e0 0x7fda38074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:34.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.793+0000 7fda4e000640 1 -- 172.21.15.103:0/727140553 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fda44093f50 con 0x7fda5815cb10 2024-09-10T22:44:34.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.793+0000 7fda55e00640 1 --2- 172.21.15.103:0/727140553 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda380725e0 0x7fda38074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:34.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.793+0000 7fda55e00640 1 --2- 172.21.15.103:0/727140553 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda380725e0 0x7fda38074aa0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fda480aa000 tx=0x7fda480198c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:34.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.797+0000 7fda4e000640 1 -- 172.21.15.103:0/727140553 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fda4405ecb0 con 0x7fda5815cb10 2024-09-10T22:44:35.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.997+0000 7fda5d000640 1 -- 172.21.15.103:0/727140553 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fda5814f3f0 con 0x7fda5815cb10 2024-09-10T22:44:35.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:34.997+0000 7fda4e000640 1 -- 172.21.15.103:0/727140553 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v89) ==== 53+0+73 (secure 0 0 0) 0x7fda440636e0 con 0x7fda5815cb10 2024-09-10T22:44:35.002 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T22:44:35.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:35.001+0000 7fda5d000640 1 -- 172.21.15.103:0/727140553 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda380725e0 msgr2=0x7fda38074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:35.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:35.001+0000 7fda5d000640 1 --2- 172.21.15.103:0/727140553 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda380725e0 0x7fda38074aa0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fda480aa000 tx=0x7fda480198c0 comp rx=0 tx=0).stop 2024-09-10T22:44:35.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:35.001+0000 7fda5d000640 1 -- 172.21.15.103:0/727140553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda5815cb10 msgr2=0x7fda5815cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:35.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:35.001+0000 7fda5d000640 1 --2- 172.21.15.103:0/727140553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda5815cb10 0x7fda5815cf70 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fda44011ae0 tx=0x7fda44009f20 comp rx=0 tx=0).stop 2024-09-10T22:44:35.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:35.001+0000 7fda5d000640 1 -- 172.21.15.103:0/727140553 shutdown_connections 2024-09-10T22:44:35.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:35.001+0000 7fda5d000640 1 --2- 172.21.15.103:0/727140553 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fda380725e0 0x7fda38074aa0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:35.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:35.001+0000 7fda5d000640 1 --2- 172.21.15.103:0/727140553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda581f6170 0x7fda581f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:35.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:35.001+0000 7fda5d000640 1 --2- 172.21.15.103:0/727140553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda5815cb10 0x7fda5815cf70 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:35.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:35.001+0000 7fda5d000640 1 --2- 172.21.15.103:0/727140553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda3c003a60 0x7fda5815adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:35.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:35.001+0000 7fda5d000640 1 -- 172.21.15.103:0/727140553 >> 172.21.15.103:0/727140553 conn(0x7fda5806cc00 msgr2=0x7fda580b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:35.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:35.001+0000 7fda5d000640 1 -- 172.21.15.103:0/727140553 shutdown_connections 2024-09-10T22:44:35.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:35.001+0000 7fda5d000640 1 -- 172.21.15.103:0/727140553 wait complete. 2024-09-10T22:44:35.023 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T22:44:35.024 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T22:44:35.024 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-10T22:44:35.024 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T22:44:35.024 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T22:44:35.024 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T22:44:35.024 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T22:44:35.024 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T22:44:35.024 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:44:35.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:35.024 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-10T22:44:35.034 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T22:44:35.034 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T22:44:35.034 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T22:44:35.034 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:44:35.034 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-10T22:44:35.034 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:44:35.034 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:44:35.034 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:44:35.034 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-10T22:44:35.034 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:44:35.034 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:44:35.035 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-10T22:44:35.035 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:44:35.035 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-10T22:44:35.035 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T22:44:35.035 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-10T22:44:35.035 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-10T22:44:35.035 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42107sec preferred_lft 42107sec 2024-09-10T22:44:35.035 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2024-09-10T22:44:35.035 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:44:35.035 INFO:teuthology.orchestra.run.smithi103.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T22:44:35.035 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 02:42:c3:dd:ba:ba brd ff:ff:ff:ff:ff:ff 2024-09-10T22:44:35.035 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T22:44:35.035 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:44:35.036 INFO:teuthology.orchestra.run.smithi103.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T22:44:35.036 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T22:44:35.036 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T22:44:35.036 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:44:35.036 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T22:44:35.036 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:44:35.036 INFO:teuthology.orchestra.run.smithi103.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T22:44:35.036 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:44:35.036 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T22:44:35.036 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:44:35.036 INFO:teuthology.orchestra.run.smithi103.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T22:44:35.036 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:44:35.036 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T22:44:35.037 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:44:35.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:35.037 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T22:44:35.096 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-10T22:44:35.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:35.098 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-10T22:44:35.151 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-10T22:44:35.151 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T22:44:35.151 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-10T22:44:35.151 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T22:44:35.151 INFO:teuthology.orchestra.run.smithi103.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-10T22:44:35.151 INFO:teuthology.orchestra.run.smithi103.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T22:44:35.151 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T22:44:35.151 INFO:teuthology.orchestra.run.smithi103.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:44:35.151 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:44:35.151 INFO:teuthology.orchestra.run.smithi103.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:44:35.152 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T22:44:35.152 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:44:35.152 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:44:35.152 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T22:44:35.152 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T22:44:35.152 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T22:44:35.152 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:44:35.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:44:35.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:44:35.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:35.284 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-10T22:44:35.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T22:44:35.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T22:44:35.294 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:44:35.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:35.294 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-10T22:44:35.358 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T22:44:35.358 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:44:35.359 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T22:44:35.407 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:44:35.407 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:44:35.407 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T22:44:35.454 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:44:35.519 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:44:35.576 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:44:35.577 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:44:35.577 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:44:35.577 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:44:35.577 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:44:35.577 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:44:35.577 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:44:35.577 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:44:35.577 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:44:35.577 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:44:35.577 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:44:35.577 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:44:35.577 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:44:35.578 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:44:35.578 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:44:35.578 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:44:35.578 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:44:35.578 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:44:35.578 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:44:35.578 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:44:35.578 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:44:35.578 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:44:35.578 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:44:35.578 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:44:35.578 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:44:35.578 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:44:35.578 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:44:35.579 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:44:35.579 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:44:35.579 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:44:35.579 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:44:35.579 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:44:35.579 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:44:35.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:35.580 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:44:35.635 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T22:44:35.635 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T22:44:35.687 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:44:35.708 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:44:35.760 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:44:35.761 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:44:35.761 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:44:35.761 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:44:35.761 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:44:35.761 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:44:35.761 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:44:35.761 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:44:35.761 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:44:35.761 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:44:35.761 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:44:35.761 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:44:35.762 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:44:35.762 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:44:35.762 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:44:35.762 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:44:35.762 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:44:35.762 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:44:35.762 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:44:35.762 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:44:35.762 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:44:35.762 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:44:35.762 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:44:35.762 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:44:35.762 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:44:35.762 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:44:35.763 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:44:35.763 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:44:35.763 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:44:35.763 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:44:35.763 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:44:35.763 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:44:35.763 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:44:35.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:35.764 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:44:35.779 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2024-09-10T22:44:35.773+0000 7f9672aba580 -1 init, newargv = 0x55c9e512cbb0 newargc=15 2024-09-10T22:44:35.779 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[46577]: starting ceph client 2024-09-10T22:44:35.786 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[46577]: starting fuse 2024-09-10T22:44:35.788 INFO:teuthology.orchestra.run.smithi103.stdout:44 2024-09-10T22:44:35.788 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T22:44:35.788 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-09-10T22:44:35.788 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-09-10T22:44:35.788 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-09-10T22:44:35.789 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:44:35.789 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-09-10T22:44:35.789 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:44:35.789 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-09-10T22:44:35.789 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T22:44:35.789 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-09-10T22:44:35.789 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T22:44:35.789 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:44:35.789 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-09-10T22:44:35.789 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-09-10T22:44:35.789 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-09-10T22:44:35.789 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-09-10T22:44:35.789 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:44:35.789 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-09-10T22:44:35.790 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T22:44:35.790 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T22:44:35.790 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T22:44:35.790 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-09-10T22:44:35.790 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-09-10T22:44:35.790 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-09-10T22:44:35.790 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T22:44:35.790 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:44:35.790 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.0")) 2024-09-10T22:44:35.790 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:44:35.911 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.46577.asok 2024-09-10T22:44:35.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:44:35.923 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46577.asok 2024-09-10T22:44:35.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:35.923 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46577.asok status 2024-09-10T22:44:36.090 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:44:36.090 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-09-10T22:44:36.090 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T22:44:36.090 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:44:36.090 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2024-09-10T22:44:36.090 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-09-10T22:44:36.090 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T22:44:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "46577", 2024-09-10T22:44:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-09-10T22:44:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-09-10T22:44:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-09-10T22:44:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7596, 2024-09-10T22:44:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-09-10T22:44:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-09-10T22:44:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-09-10T22:44:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7596 2024-09-10T22:44:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T22:44:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T22:44:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-10T22:44:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 4086028661 2024-09-10T22:44:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T22:44:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T22:44:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-10T22:44:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 4086028661 2024-09-10T22:44:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.7596 192.168.0.1:0/4086028661", 2024-09-10T22:44:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/4086028661", 2024-09-10T22:44:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-09-10T22:44:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 89, 2024-09-10T22:44:36.093 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 94, 2024-09-10T22:44:36.093 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-09-10T22:44:36.093 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-09-10T22:44:36.093 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-09-10T22:44:36.093 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:44:36.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:36.105 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-09-10T22:44:36.105 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T22:44:36.114 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-09-10T22:44:36.114 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T22:44:36.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:36.115 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T22:44:36.175 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-10T22:44:36.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bd6000640 1 -- 172.21.15.103:0/1665970022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb4003a10 msgr2=0x7f3bb4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:36.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bd6000640 1 --2- 172.21.15.103:0/1665970022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb4003a10 0x7f3bb4003e30 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000c2e0 tx=0x7f3bc001cfc0 comp rx=0 tx=0).stop 2024-09-10T22:44:36.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bcfe00640 1 -- 172.21.15.103:0/1665970022 reap_dead start 2024-09-10T22:44:36.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bd6000640 1 -- 172.21.15.103:0/1665970022 shutdown_connections 2024-09-10T22:44:36.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bd6000640 1 -- 172.21.15.103:0/1665970022 >> 172.21.15.103:0/1665970022 conn(0x7f3bd00d0940 msgr2=0x7f3bd00d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:36.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bd6000640 1 -- 172.21.15.103:0/1665970022 shutdown_connections 2024-09-10T22:44:36.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bd6000640 1 -- 172.21.15.103:0/1665970022 wait complete. 2024-09-10T22:44:36.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bd6000640 1 Processor -- start 2024-09-10T22:44:36.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bd6000640 1 -- start start 2024-09-10T22:44:36.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bd6000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb4003a10 0x7f3bd01552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:36.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bd6000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bd01620d0 0x7f3bd0159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:36.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bd6000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd015f3f0 0x7f3bd0159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:36.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bd6000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd00b4380 con 0x7f3bd015f3f0 2024-09-10T22:44:36.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bd6000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd00b4200 con 0x7f3bd01620d0 2024-09-10T22:44:36.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bd6000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd00b4500 con 0x7f3bb4003a10 2024-09-10T22:44:36.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bcfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd015f3f0 0x7f3bd0159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:36.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bcf400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb4003a10 0x7f3bd01552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:36.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bcfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd015f3f0 0x7f3bd0159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48136/0 (socket says 172.21.15.103:48136) 2024-09-10T22:44:36.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bcfe00640 1 -- 172.21.15.103:0/4238618674 learned_addr learned my addr 172.21.15.103:0/4238618674 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:36.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.361+0000 7f3bc6a00640 1 --2- 172.21.15.103:0/4238618674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bd01620d0 0x7f3bd0159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:36.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.365+0000 7f3bcfe00640 1 -- 172.21.15.103:0/4238618674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb4003a10 msgr2=0x7f3bd01552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:36.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.365+0000 7f3bcfe00640 1 --2- 172.21.15.103:0/4238618674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb4003a10 0x7f3bd01552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:36.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.365+0000 7f3bcfe00640 1 -- 172.21.15.103:0/4238618674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bd01620d0 msgr2=0x7f3bd0159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:36.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.365+0000 7f3bcfe00640 1 --2- 172.21.15.103:0/4238618674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bd01620d0 0x7f3bd0159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:36.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.365+0000 7f3bcfe00640 1 -- 172.21.15.103:0/4238618674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd00cde00 con 0x7f3bd015f3f0 2024-09-10T22:44:36.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.365+0000 7f3bcfe00640 1 --2- 172.21.15.103:0/4238618674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd015f3f0 0x7f3bd0159ed0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8011b20 tx=0x7f3bc8011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:36.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.365+0000 7f3bc7e00640 1 -- 172.21.15.103:0/4238618674 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8003e50 con 0x7f3bd015f3f0 2024-09-10T22:44:36.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.365+0000 7f3bc7e00640 1 -- 172.21.15.103:0/4238618674 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bc8004b30 con 0x7f3bd015f3f0 2024-09-10T22:44:36.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.365+0000 7f3bd6000640 1 -- 172.21.15.103:0/4238618674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd0155820 con 0x7f3bd015f3f0 2024-09-10T22:44:36.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.365+0000 7f3bc7e00640 1 -- 172.21.15.103:0/4238618674 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc800f9c0 con 0x7f3bd015f3f0 2024-09-10T22:44:36.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.365+0000 7f3bd6000640 1 -- 172.21.15.103:0/4238618674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd00ce0a0 con 0x7f3bd015f3f0 2024-09-10T22:44:36.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.365+0000 7f3bd6000640 1 -- 172.21.15.103:0/4238618674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd00b4a90 con 0x7f3bd015f3f0 2024-09-10T22:44:36.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.365+0000 7f3bc7e00640 1 -- 172.21.15.103:0/4238618674 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3bc8018070 con 0x7f3bd015f3f0 2024-09-10T22:44:36.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.365+0000 7f3bc7e00640 1 --2- 172.21.15.103:0/4238618674 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3bac0727b0 0x7f3bac074c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:36.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.365+0000 7f3bc7e00640 1 -- 172.21.15.103:0/4238618674 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f3bc8093b20 con 0x7f3bd015f3f0 2024-09-10T22:44:36.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.369+0000 7f3bcf400640 1 --2- 172.21.15.103:0/4238618674 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3bac0727b0 0x7f3bac074c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:36.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.369+0000 7f3bcf400640 1 --2- 172.21.15.103:0/4238618674 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3bac0727b0 0x7f3bac074c70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00ac000 tx=0x7f3bc0019e00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:36.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.369+0000 7f3bc7e00640 1 -- 172.21.15.103:0/4238618674 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3bc801f060 con 0x7f3bd015f3f0 2024-09-10T22:44:36.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:36.569+0000 7f3bd6000640 1 -- 172.21.15.103:0/4238618674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f3bd0157100 con 0x7f3bd015f3f0 2024-09-10T22:44:37.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.237+0000 7f3bc7e00640 1 -- 172.21.15.103:0/4238618674 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v90) ==== 105+0+0 (secure 0 0 0) 0x7f3bc805ef60 con 0x7f3bd015f3f0 2024-09-10T22:44:37.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.237+0000 7f3bd6000640 1 -- 172.21.15.103:0/4238618674 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3bac0727b0 msgr2=0x7f3bac074c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:37.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.237+0000 7f3bd6000640 1 --2- 172.21.15.103:0/4238618674 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3bac0727b0 0x7f3bac074c70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00ac000 tx=0x7f3bc0019e00 comp rx=0 tx=0).stop 2024-09-10T22:44:37.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.237+0000 7f3bd6000640 1 -- 172.21.15.103:0/4238618674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd015f3f0 msgr2=0x7f3bd0159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:37.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.237+0000 7f3bd6000640 1 --2- 172.21.15.103:0/4238618674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd015f3f0 0x7f3bd0159ed0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8011b20 tx=0x7f3bc8011f20 comp rx=0 tx=0).stop 2024-09-10T22:44:37.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.237+0000 7f3bd6000640 1 -- 172.21.15.103:0/4238618674 shutdown_connections 2024-09-10T22:44:37.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.237+0000 7f3bd6000640 1 --2- 172.21.15.103:0/4238618674 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3bac0727b0 0x7f3bac074c70 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:37.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.237+0000 7f3bd6000640 1 --2- 172.21.15.103:0/4238618674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd015f3f0 0x7f3bd0159ed0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:37.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.237+0000 7f3bd6000640 1 --2- 172.21.15.103:0/4238618674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bd01620d0 0x7f3bd0159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:37.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.237+0000 7f3bd6000640 1 --2- 172.21.15.103:0/4238618674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb4003a10 0x7f3bd01552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:37.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.237+0000 7f3bd6000640 1 -- 172.21.15.103:0/4238618674 >> 172.21.15.103:0/4238618674 conn(0x7f3bd00d0940 msgr2=0x7f3bd00aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:37.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.237+0000 7f3bd6000640 1 -- 172.21.15.103:0/4238618674 shutdown_connections 2024-09-10T22:44:37.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.237+0000 7f3bd6000640 1 -- 172.21.15.103:0/4238618674 wait complete. 2024-09-10T22:44:37.272 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:44:37.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.409+0000 7f3fc5000640 1 -- 172.21.15.103:0/2166896811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc00ae9c0 msgr2=0x7f3fc00aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:37.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.409+0000 7f3fc5000640 1 --2- 172.21.15.103:0/2166896811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc00ae9c0 0x7f3fc00aee50 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8009c80 tx=0x7f3fb801cd10 comp rx=0 tx=0).stop 2024-09-10T22:44:37.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.409+0000 7f3fc5000640 1 -- 172.21.15.103:0/2166896811 shutdown_connections 2024-09-10T22:44:37.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.409+0000 7f3fc5000640 1 --2- 172.21.15.103:0/2166896811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc00ae9c0 0x7f3fc00aee50 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:37.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.409+0000 7f3fc5000640 1 --2- 172.21.15.103:0/2166896811 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fc00b09c0 0x7f3fc00ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:37.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.409+0000 7f3fc5000640 1 -- 172.21.15.103:0/2166896811 >> 172.21.15.103:0/2166896811 conn(0x7f3fc00d1ac0 msgr2=0x7f3fc00d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:37.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.409+0000 7f3fc5000640 1 -- 172.21.15.103:0/2166896811 shutdown_connections 2024-09-10T22:44:37.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.409+0000 7f3fc5000640 1 -- 172.21.15.103:0/2166896811 wait complete. 2024-09-10T22:44:37.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fc5000640 1 Processor -- start 2024-09-10T22:44:37.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fc5000640 1 -- start start 2024-09-10T22:44:37.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fc5000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fc00ae9c0 0x7f3fc00ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:37.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fc5000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc00b09c0 0x7f3fc0149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:37.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fc5000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fc015be30 0x7f3fc006f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:37.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fc5000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc0168df0 con 0x7f3fc00b09c0 2024-09-10T22:44:37.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fc5000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc0168c70 con 0x7f3fc015be30 2024-09-10T22:44:37.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fc5000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc0168f70 con 0x7f3fc00ae9c0 2024-09-10T22:44:37.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fb5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc00b09c0 0x7f3fc0149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:37.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fb5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc00b09c0 0x7f3fc0149e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51504/0 (socket says 172.21.15.103:51504) 2024-09-10T22:44:37.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fb5400640 1 -- 172.21.15.103:0/1513901224 learned_addr learned my addr 172.21.15.103:0/1513901224 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:37.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fbe800640 1 --2- 172.21.15.103:0/1513901224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fc015be30 0x7f3fc006f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:37.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fb5400640 1 -- 172.21.15.103:0/1513901224 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fc00ae9c0 msgr2=0x7f3fc00ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:37.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fbde00640 1 --2- 172.21.15.103:0/1513901224 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fc00ae9c0 0x7f3fc00ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:37.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fb5400640 1 --2- 172.21.15.103:0/1513901224 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fc00ae9c0 0x7f3fc00ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:37.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fb5400640 1 -- 172.21.15.103:0/1513901224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fc015be30 msgr2=0x7f3fc006f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:37.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fb5400640 1 --2- 172.21.15.103:0/1513901224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fc015be30 0x7f3fc006f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:37.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fb5400640 1 -- 172.21.15.103:0/1513901224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc00b4ab0 con 0x7f3fc00b09c0 2024-09-10T22:44:37.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fbe800640 1 --2- 172.21.15.103:0/1513901224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fc015be30 0x7f3fc006f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:37.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fbde00640 1 --2- 172.21.15.103:0/1513901224 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fc00ae9c0 0x7f3fc00ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:37.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fb5400640 1 --2- 172.21.15.103:0/1513901224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc00b09c0 0x7f3fc0149e60 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800d980 tx=0x7f3fa800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:37.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fb6a00640 1 -- 172.21.15.103:0/1513901224 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa8017070 con 0x7f3fc00b09c0 2024-09-10T22:44:37.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fb6a00640 1 -- 172.21.15.103:0/1513901224 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fa8009d60 con 0x7f3fc00b09c0 2024-09-10T22:44:37.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fc5000640 1 -- 172.21.15.103:0/1513901224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc00b4d90 con 0x7f3fc00b09c0 2024-09-10T22:44:37.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fb6a00640 1 -- 172.21.15.103:0/1513901224 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa8005280 con 0x7f3fc00b09c0 2024-09-10T22:44:37.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fc5000640 1 -- 172.21.15.103:0/1513901224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc0157170 con 0x7f3fc00b09c0 2024-09-10T22:44:37.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.413+0000 7f3fc5000640 1 -- 172.21.15.103:0/1513901224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fc00aee50 con 0x7f3fc00b09c0 2024-09-10T22:44:37.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.417+0000 7f3fb6a00640 1 -- 172.21.15.103:0/1513901224 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3fa8005420 con 0x7f3fc00b09c0 2024-09-10T22:44:37.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.417+0000 7f3fb6a00640 1 --2- 172.21.15.103:0/1513901224 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3f9c0725e0 0x7f3f9c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:37.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.417+0000 7f3fb6a00640 1 -- 172.21.15.103:0/1513901224 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f3fa80936c0 con 0x7f3fc00b09c0 2024-09-10T22:44:37.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.417+0000 7f3fbde00640 1 --2- 172.21.15.103:0/1513901224 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3f9c0725e0 0x7f3f9c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:37.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.417+0000 7f3fbde00640 1 --2- 172.21.15.103:0/1513901224 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3f9c0725e0 0x7f3f9c074aa0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00ccf70 tx=0x7f3fb0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:37.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.421+0000 7f3fb6a00640 1 -- 172.21.15.103:0/1513901224 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3fa805eb00 con 0x7f3fc00b09c0 2024-09-10T22:44:37.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.617+0000 7f3fc5000640 1 -- 172.21.15.103:0/1513901224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fc015b030 con 0x7f3fc00b09c0 2024-09-10T22:44:37.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.621+0000 7f3fb6a00640 1 -- 172.21.15.103:0/1513901224 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5250 (secure 0 0 0) 0x7f3fa8067220 con 0x7f3fc00b09c0 2024-09-10T22:44:37.624 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:37.624 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":91,"btime":"2024-09-10T22:44:37:243775+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2586411857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2586411857},{"type":"v1","addr":"172.21.15.131:6837","nonce":2586411857}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84},{"gid":7048,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/1622106563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1622106563},{"type":"v1","addr":"172.21.15.131:6836","nonce":1622106563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:44:23.558537+0000","modified":"2024-09-10T22:44:37.243751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":7434,"mds_1":7428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7428":{"gid":7428,"name":"a","rank":1,"incarnation":91,"state":"up:creating","state_seq":1,"addr":"172.21.15.103:6834/3251348074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3251348074},{"type":"v1","addr":"172.21.15.103:6834","nonce":3251348074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7434":{"gid":7434,"name":"c","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/187627880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":187627880},{"type":"v1","addr":"172.21.15.103:6835","nonce":187627880}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7434,"qdb_cluster":[7434]},"id":6}]} 2024-09-10T22:44:37.624 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 91 2024-09-10T22:44:37.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.621+0000 7f3fc5000640 1 -- 172.21.15.103:0/1513901224 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3f9c0725e0 msgr2=0x7f3f9c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:37.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.621+0000 7f3fc5000640 1 --2- 172.21.15.103:0/1513901224 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3f9c0725e0 0x7f3f9c074aa0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00ccf70 tx=0x7f3fb0009040 comp rx=0 tx=0).stop 2024-09-10T22:44:37.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.621+0000 7f3fc5000640 1 -- 172.21.15.103:0/1513901224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc00b09c0 msgr2=0x7f3fc0149e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:37.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.621+0000 7f3fc5000640 1 --2- 172.21.15.103:0/1513901224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc00b09c0 0x7f3fc0149e60 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800d980 tx=0x7f3fa800de40 comp rx=0 tx=0).stop 2024-09-10T22:44:37.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.621+0000 7f3fc5000640 1 -- 172.21.15.103:0/1513901224 shutdown_connections 2024-09-10T22:44:37.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.621+0000 7f3fc5000640 1 --2- 172.21.15.103:0/1513901224 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3f9c0725e0 0x7f3f9c074aa0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:37.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.621+0000 7f3fc5000640 1 --2- 172.21.15.103:0/1513901224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fc015be30 0x7f3fc006f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:37.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.621+0000 7f3fc5000640 1 --2- 172.21.15.103:0/1513901224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc00b09c0 0x7f3fc0149e60 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:37.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.621+0000 7f3fc5000640 1 --2- 172.21.15.103:0/1513901224 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fc00ae9c0 0x7f3fc00ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:37.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.621+0000 7f3fc5000640 1 -- 172.21.15.103:0/1513901224 >> 172.21.15.103:0/1513901224 conn(0x7f3fc00d1ac0 msgr2=0x7f3fc006dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:37.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.621+0000 7f3fc5000640 1 -- 172.21.15.103:0/1513901224 shutdown_connections 2024-09-10T22:44:37.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:37.621+0000 7f3fc5000640 1 -- 172.21.15.103:0/1513901224 wait complete. 2024-09-10T22:44:38.048 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 91, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:44:23.558537+0000', 'modified': '2024-09-10T22:44:37.243751+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 7434, 'mds_1': 7428}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7428': {'gid': 7428, 'name': 'a', 'rank': 1, 'incarnation': 91, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.103:6834/3251348074', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6832', 'nonce': 3251348074}, {'type': 'v1', 'addr': '172.21.15.103:6834', 'nonce': 3251348074}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_7434': {'gid': 7434, 'name': 'c', 'rank': 0, 'incarnation': 85, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/187627880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6833', 'nonce': 187627880}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 187627880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7434, 'qdb_cluster': [7434]} 2024-09-10T22:44:38.048 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7428:up:creating 2024-09-10T22:44:39.050 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:44:39.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.197+0000 7f7c64200640 1 -- 172.21.15.103:0/2729764207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c15b2b0 msgr2=0x7f7c5c0afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:39.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.197+0000 7f7c64200640 1 --2- 172.21.15.103:0/2729764207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c15b2b0 0x7f7c5c0afac0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0cfe30 tx=0x7f7c5001c8c0 comp rx=0 tx=0).stop 2024-09-10T22:44:39.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.197+0000 7f7c64200640 1 -- 172.21.15.103:0/2729764207 shutdown_connections 2024-09-10T22:44:39.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.197+0000 7f7c64200640 1 --2- 172.21.15.103:0/2729764207 >> v2:172.21.15.131:3300/0 conn(0x7f7c5c0b0030 0x7f7c5c15b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:39.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c64200640 1 --2- 172.21.15.103:0/2729764207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c15b2b0 0x7f7c5c0afac0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:39.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c64200640 1 -- 172.21.15.103:0/2729764207 >> 172.21.15.103:0/2729764207 conn(0x7f7c5c0cd3c0 msgr2=0x7f7c5c0cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:39.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c64200640 1 -- 172.21.15.103:0/2729764207 shutdown_connections 2024-09-10T22:44:39.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c64200640 1 -- 172.21.15.103:0/2729764207 wait complete. 2024-09-10T22:44:39.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c64200640 1 Processor -- start 2024-09-10T22:44:39.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c64200640 1 -- start start 2024-09-10T22:44:39.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c64200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c5c0b0030 0x7f7c5c070c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:39.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c64200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0cf1d0 0x7f7c5c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:39.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c64200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c5c15b2b0 0x7f7c5c1501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:39.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c64200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c167820 con 0x7f7c5c0cf1d0 2024-09-10T22:44:39.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c64200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c1676a0 con 0x7f7c5c15b2b0 2024-09-10T22:44:39.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c64200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7c5c1679a0 con 0x7f7c5c0b0030 2024-09-10T22:44:39.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c60e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0cf1d0 0x7f7c5c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:39.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c60e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0cf1d0 0x7f7c5c06fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51510/0 (socket says 172.21.15.103:51510) 2024-09-10T22:44:39.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c60e00640 1 -- 172.21.15.103:0/1889545982 learned_addr learned my addr 172.21.15.103:0/1889545982 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:39.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c61800640 1 --2- 172.21.15.103:0/1889545982 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c5c0b0030 0x7f7c5c070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:39.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c62200640 1 --2- 172.21.15.103:0/1889545982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c5c15b2b0 0x7f7c5c1501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:39.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c60e00640 1 -- 172.21.15.103:0/1889545982 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c5c0b0030 msgr2=0x7f7c5c070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:39.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c60e00640 1 --2- 172.21.15.103:0/1889545982 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c5c0b0030 0x7f7c5c070c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:39.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c60e00640 1 -- 172.21.15.103:0/1889545982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c5c15b2b0 msgr2=0x7f7c5c1501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:39.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c60e00640 1 --2- 172.21.15.103:0/1889545982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c5c15b2b0 0x7f7c5c1501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:39.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c60e00640 1 -- 172.21.15.103:0/1889545982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5c1fab80 con 0x7f7c5c0cf1d0 2024-09-10T22:44:39.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c60e00640 1 --2- 172.21.15.103:0/1889545982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0cf1d0 0x7f7c5c06fca0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800d750 tx=0x7f7c4800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:39.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.201+0000 7f7c59600640 1 -- 172.21.15.103:0/1889545982 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48017070 con 0x7f7c5c0cf1d0 2024-09-10T22:44:39.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.205+0000 7f7c59600640 1 -- 172.21.15.103:0/1889545982 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c48009d20 con 0x7f7c5c0cf1d0 2024-09-10T22:44:39.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.205+0000 7f7c64200640 1 -- 172.21.15.103:0/1889545982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c5c1fae20 con 0x7f7c5c0cf1d0 2024-09-10T22:44:39.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.205+0000 7f7c59600640 1 -- 172.21.15.103:0/1889545982 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4800de60 con 0x7f7c5c0cf1d0 2024-09-10T22:44:39.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.205+0000 7f7c64200640 1 -- 172.21.15.103:0/1889545982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c5c1fb3e0 con 0x7f7c5c0cf1d0 2024-09-10T22:44:39.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.205+0000 7f7c64200640 1 -- 172.21.15.103:0/1889545982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c5c15b690 con 0x7f7c5c0cf1d0 2024-09-10T22:44:39.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.205+0000 7f7c59600640 1 -- 172.21.15.103:0/1889545982 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7c48004280 con 0x7f7c5c0cf1d0 2024-09-10T22:44:39.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.205+0000 7f7c59600640 1 --2- 172.21.15.103:0/1889545982 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7c3c072610 0x7f7c3c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:39.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.205+0000 7f7c59600640 1 -- 172.21.15.103:0/1889545982 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f7c480936e0 con 0x7f7c5c0cf1d0 2024-09-10T22:44:39.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.209+0000 7f7c61800640 1 --2- 172.21.15.103:0/1889545982 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7c3c072610 0x7f7c3c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:39.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.209+0000 7f7c61800640 1 --2- 172.21.15.103:0/1889545982 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7c3c072610 0x7f7c3c074ad0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7c500af000 tx=0x7f7c500b2040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:39.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.209+0000 7f7c59600640 1 -- 172.21.15.103:0/1889545982 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7c48020020 con 0x7f7c5c0cf1d0 2024-09-10T22:44:39.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.413+0000 7f7c64200640 1 -- 172.21.15.103:0/1889545982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c5c0cce70 con 0x7f7c5c0cf1d0 2024-09-10T22:44:39.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.413+0000 7f7c59600640 1 -- 172.21.15.103:0/1889545982 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5272 (secure 0 0 0) 0x7f7c480672d0 con 0x7f7c5c0cf1d0 2024-09-10T22:44:39.418 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:39.419 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":94,"btime":"2024-09-10T22:44:39:256252+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2586411857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2586411857},{"type":"v1","addr":"172.21.15.131:6837","nonce":2586411857}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:44:23.558537+0000","modified":"2024-09-10T22:44:39.256244+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7434,"mds_1":7428,"mds_2":7048},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7048":{"gid":7048,"name":"d","rank":2,"incarnation":93,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6836/1622106563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1622106563},{"type":"v1","addr":"172.21.15.131:6836","nonce":1622106563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":1,"incarnation":91,"state":"up:active","state_seq":6,"addr":"172.21.15.103:6834/3251348074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3251348074},{"type":"v1","addr":"172.21.15.103:6834","nonce":3251348074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7434":{"gid":7434,"name":"c","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/187627880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":187627880},{"type":"v1","addr":"172.21.15.103:6835","nonce":187627880}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7434,"qdb_cluster":[7048,7428,7434]},"id":6}]} 2024-09-10T22:44:39.419 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 94 2024-09-10T22:44:39.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.417+0000 7f7c64200640 1 -- 172.21.15.103:0/1889545982 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7c3c072610 msgr2=0x7f7c3c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:39.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.417+0000 7f7c64200640 1 --2- 172.21.15.103:0/1889545982 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7c3c072610 0x7f7c3c074ad0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7c500af000 tx=0x7f7c500b2040 comp rx=0 tx=0).stop 2024-09-10T22:44:39.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.417+0000 7f7c64200640 1 -- 172.21.15.103:0/1889545982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0cf1d0 msgr2=0x7f7c5c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:39.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.417+0000 7f7c64200640 1 --2- 172.21.15.103:0/1889545982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0cf1d0 0x7f7c5c06fca0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800d750 tx=0x7f7c4800dc10 comp rx=0 tx=0).stop 2024-09-10T22:44:39.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.417+0000 7f7c64200640 1 -- 172.21.15.103:0/1889545982 shutdown_connections 2024-09-10T22:44:39.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.417+0000 7f7c64200640 1 --2- 172.21.15.103:0/1889545982 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7c3c072610 0x7f7c3c074ad0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:39.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.417+0000 7f7c64200640 1 --2- 172.21.15.103:0/1889545982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c5c15b2b0 0x7f7c5c1501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:39.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.417+0000 7f7c64200640 1 --2- 172.21.15.103:0/1889545982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0cf1d0 0x7f7c5c06fca0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:39.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.417+0000 7f7c64200640 1 --2- 172.21.15.103:0/1889545982 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c5c0b0030 0x7f7c5c070c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:39.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.417+0000 7f7c64200640 1 -- 172.21.15.103:0/1889545982 >> 172.21.15.103:0/1889545982 conn(0x7f7c5c0cd3c0 msgr2=0x7f7c5c15d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:39.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.417+0000 7f7c64200640 1 -- 172.21.15.103:0/1889545982 shutdown_connections 2024-09-10T22:44:39.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.417+0000 7f7c64200640 1 -- 172.21.15.103:0/1889545982 wait complete. 2024-09-10T22:44:39.842 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 94, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:44:23.558537+0000', 'modified': '2024-09-10T22:44:39.256244+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 7434, 'mds_1': 7428, 'mds_2': 7048}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7048': {'gid': 7048, 'name': 'd', 'rank': 2, 'incarnation': 93, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.131:6836/1622106563', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6834', 'nonce': 1622106563}, {'type': 'v1', 'addr': '172.21.15.131:6836', 'nonce': 1622106563}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_7428': {'gid': 7428, 'name': 'a', 'rank': 1, 'incarnation': 91, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.103:6834/3251348074', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6832', 'nonce': 3251348074}, {'type': 'v1', 'addr': '172.21.15.103:6834', 'nonce': 3251348074}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_7434': {'gid': 7434, 'name': 'c', 'rank': 0, 'incarnation': 85, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/187627880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6833', 'nonce': 187627880}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 187627880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7434, 'qdb_cluster': [7048, 7428, 7434]} 2024-09-10T22:44:39.843 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T22:44:39.843 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T22:44:39.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.985+0000 7f0e95200640 1 -- 172.21.15.103:0/3212590843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e900aeb40 msgr2=0x7f0e90072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:39.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.985+0000 7f0e95200640 1 --2- 172.21.15.103:0/3212590843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e900aeb40 0x7f0e90072e30 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f0e900d0870 tx=0x7f0e7c01c830 comp rx=0 tx=0).stop 2024-09-10T22:44:39.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.985+0000 7f0e95200640 1 -- 172.21.15.103:0/3212590843 shutdown_connections 2024-09-10T22:44:39.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.985+0000 7f0e95200640 1 --2- 172.21.15.103:0/3212590843 >> v2:172.21.15.131:3300/0 conn(0x7f0e900cf790 0x7f0e900cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:39.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.985+0000 7f0e95200640 1 --2- 172.21.15.103:0/3212590843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e900aeb40 0x7f0e90072e30 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:39.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.985+0000 7f0e95200640 1 -- 172.21.15.103:0/3212590843 >> 172.21.15.103:0/3212590843 conn(0x7f0e9006cc00 msgr2=0x7f0e9006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:39.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.985+0000 7f0e95200640 1 -- 172.21.15.103:0/3212590843 shutdown_connections 2024-09-10T22:44:39.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.985+0000 7f0e95200640 1 -- 172.21.15.103:0/3212590843 wait complete. 2024-09-10T22:44:39.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.985+0000 7f0e95200640 1 Processor -- start 2024-09-10T22:44:39.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.985+0000 7f0e95200640 1 -- start start 2024-09-10T22:44:39.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e95200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e900aeb40 0x7f0e90070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:39.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e95200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e900cc120 0x7f0e900a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:39.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e95200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e900cf790 0x7f0e9014a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:39.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e95200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0e90168bf0 con 0x7f0e900cf790 2024-09-10T22:44:39.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e95200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0e90168a70 con 0x7f0e900cc120 2024-09-10T22:44:39.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e95200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0e90168d70 con 0x7f0e900aeb40 2024-09-10T22:44:39.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e8e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e900cf790 0x7f0e9014a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:39.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e8e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e900cf790 0x7f0e9014a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51536/0 (socket says 172.21.15.103:51536) 2024-09-10T22:44:39.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e8e800640 1 -- 172.21.15.103:0/4114886303 learned_addr learned my addr 172.21.15.103:0/4114886303 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:39.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e8d400640 1 --2- 172.21.15.103:0/4114886303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e900cc120 0x7f0e900a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:39.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e8e800640 1 -- 172.21.15.103:0/4114886303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e900aeb40 msgr2=0x7f0e90070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:39.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e8e800640 1 --2- 172.21.15.103:0/4114886303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e900aeb40 0x7f0e90070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:39.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e8e800640 1 -- 172.21.15.103:0/4114886303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e900cc120 msgr2=0x7f0e900a9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:39.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e8e800640 1 --2- 172.21.15.103:0/4114886303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e900cc120 0x7f0e900a9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:39.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e8e800640 1 -- 172.21.15.103:0/4114886303 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e900aa470 con 0x7f0e900cf790 2024-09-10T22:44:39.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e8d400640 1 --2- 172.21.15.103:0/4114886303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e900cc120 0x7f0e900a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:39.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e8e800640 1 --2- 172.21.15.103:0/4114886303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e900cf790 0x7f0e9014a090 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800e970 tx=0x7f0e8800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:39.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e86000640 1 -- 172.21.15.103:0/4114886303 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88004d30 con 0x7f0e900cf790 2024-09-10T22:44:39.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e86000640 1 -- 172.21.15.103:0/4114886303 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e8800cb20 con 0x7f0e900cf790 2024-09-10T22:44:39.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e95200640 1 -- 172.21.15.103:0/4114886303 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e900aa750 con 0x7f0e900cf790 2024-09-10T22:44:39.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e86000640 1 -- 172.21.15.103:0/4114886303 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88005020 con 0x7f0e900cf790 2024-09-10T22:44:39.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.989+0000 7f0e95200640 1 -- 172.21.15.103:0/4114886303 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e900aa180 con 0x7f0e900cf790 2024-09-10T22:44:39.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e86000640 1 -- 172.21.15.103:0/4114886303 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0e8800f040 con 0x7f0e900cf790 2024-09-10T22:44:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e98700000 1 Processor -- start 2024-09-10T22:44:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e86000640 1 --2- 172.21.15.103:0/4114886303 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0e700725e0 0x7f0e70074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e86000640 1 -- 172.21.15.103:0/4114886303 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f0e88093ac0 con 0x7f0e900cf790 2024-09-10T22:44:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e98700000 1 -- start start 2024-09-10T22:44:40.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e8d400640 1 --2- 172.21.15.103:0/4114886303 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0e700725e0 0x7f0e70074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e8d400640 1 --2- 172.21.15.103:0/4114886303 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0e700725e0 0x7f0e70074aa0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0af000 tx=0x7f0e7c01b070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e98700000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 0x5630f8139db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e98700000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f813a2f0 0x5630f80ed8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e98700000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f80ede10 0x5630f80ee1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e98700000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5630f800e3f0 con 0x5630f81399d0 2024-09-10T22:44:40.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e98700000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5630f7f4bb20 con 0x5630f813a2f0 2024-09-10T22:44:40.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e98700000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5630f7f3af50 con 0x5630f80ede10 2024-09-10T22:44:40.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e8de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 0x5630f8139db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e8de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 0x5630f8139db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51538/0 (socket says 172.21.15.103:51538) 2024-09-10T22:44:40.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e8de00640 1 -- 172.21.15.103:0/3355389080 learned_addr learned my addr 172.21.15.103:0/3355389080 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:40.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e8d400640 1 --2- 172.21.15.103:0/3355389080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f813a2f0 0x5630f80ed8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e8e800640 1 --2- 172.21.15.103:0/3355389080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f80ede10 0x5630f80ee1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e8de00640 1 -- 172.21.15.103:0/3355389080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f80ede10 msgr2=0x5630f80ee1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e8de00640 1 --2- 172.21.15.103:0/3355389080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f80ede10 0x5630f80ee1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e8de00640 1 -- 172.21.15.103:0/3355389080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f813a2f0 msgr2=0x5630f80ed8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e8de00640 1 --2- 172.21.15.103:0/3355389080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f813a2f0 0x5630f80ed8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.993+0000 7f0e8de00640 1 -- 172.21.15.103:0/3355389080 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630f7f02590 con 0x5630f81399d0 2024-09-10T22:44:40.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e8de00640 1 --2- 172.21.15.103:0/3355389080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 0x5630f8139db0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f0e800016b0 tx=0x7f0e80001b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b398df1924762f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e7aa00640 1 -- 172.21.15.103:0/3355389080 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e80017070 con 0x5630f81399d0 2024-09-10T22:44:40.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e7aa00640 1 -- 172.21.15.103:0/3355389080 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e800053e0 con 0x5630f81399d0 2024-09-10T22:44:40.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e7aa00640 1 -- 172.21.15.103:0/3355389080 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8000cb30 con 0x5630f81399d0 2024-09-10T22:44:40.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e98700000 1 -- 172.21.15.103:0/3355389080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 msgr2=0x5630f8139db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e98700000 1 --2- 172.21.15.103:0/3355389080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 0x5630f8139db0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f0e800016b0 tx=0x7f0e80001b70 comp rx=0 tx=0).stop 2024-09-10T22:44:40.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e98700000 1 -- 172.21.15.103:0/3355389080 shutdown_connections 2024-09-10T22:44:40.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e98700000 1 --2- 172.21.15.103:0/3355389080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f80ede10 0x5630f80ee1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e98700000 1 --2- 172.21.15.103:0/3355389080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f813a2f0 0x5630f80ed8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e98700000 1 --2- 172.21.15.103:0/3355389080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 0x5630f8139db0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e98700000 1 -- 172.21.15.103:0/3355389080 >> 172.21.15.103:0/3355389080 conn(0x5630f7fd7130 msgr2=0x5630f811ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e98700000 1 -- 172.21.15.103:0/3355389080 shutdown_connections 2024-09-10T22:44:40.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e98700000 1 -- 172.21.15.103:0/3355389080 wait complete. 2024-09-10T22:44:40.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e98700000 1 -- start start 2024-09-10T22:44:40.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e98700000 1 Processor -- start 2024-09-10T22:44:40.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e98700000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f80ede10 0x5630f80ef240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e98700000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 0x5630f80ef780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e98700000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f813a2f0 0x5630f80efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e98700000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5630f7ed55d0 con 0x5630f81399d0 2024-09-10T22:44:40.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e98700000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5630f7f3ed60 con 0x5630f80ede10 2024-09-10T22:44:40.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e98700000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5630f7ee1500 con 0x5630f813a2f0 2024-09-10T22:44:40.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e98700000 10 client.0 _ll_register_callbacks cb 0x5630f7ee5810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:40.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e8d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 0x5630f80ef780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e8d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 0x5630f80ef780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51552/0 (socket says 172.21.15.103:51552) 2024-09-10T22:44:40.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e8d400640 1 -- 172.21.15.103:0/1703837080 learned_addr learned my addr 172.21.15.103:0/1703837080 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:40.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e8de00640 1 --2- 172.21.15.103:0/1703837080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f80ede10 0x5630f80ef240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e8e800640 1 --2- 172.21.15.103:0/1703837080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f813a2f0 0x5630f80efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e8d400640 1 -- 172.21.15.103:0/1703837080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f813a2f0 msgr2=0x5630f80efcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e8d400640 1 --2- 172.21.15.103:0/1703837080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f813a2f0 0x5630f80efcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e8d400640 1 -- 172.21.15.103:0/1703837080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f80ede10 msgr2=0x5630f80ef240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e8d400640 1 --2- 172.21.15.103:0/1703837080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f80ede10 0x5630f80ef240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:39.997+0000 7f0e8d400640 1 -- 172.21.15.103:0/1703837080 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630f7ed9170 con 0x5630f81399d0 2024-09-10T22:44:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e8d400640 1 --2- 172.21.15.103:0/1703837080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 0x5630f80ef780 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c01a460 tx=0x7f0e7c01c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b43e3159ed54a93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e6f400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e6f400640 1 -- 172.21.15.103:0/1703837080 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c0b2040 con 0x5630f81399d0 2024-09-10T22:44:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 1 -- 172.21.15.103:0/1703837080 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5630f7ed30f0 con 0x5630f81399d0 2024-09-10T22:44:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e6f400640 1 -- 172.21.15.103:0/1703837080 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f0e7c0048d0 con 0x5630f81399d0 2024-09-10T22:44:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e6f400640 1 -- 172.21.15.103:0/1703837080 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f0e7c0d1050 con 0x5630f81399d0 2024-09-10T22:44:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 10 client.7629 fetch_fsmap learned FSMap version 94 2024-09-10T22:44:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 1 -- 172.21.15.103:0/1703837080 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x5630f7fbfef0 con 0x5630f81399d0 2024-09-10T22:44:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e6f400640 1 -- 172.21.15.103:0/1703837080 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5630f7ed30f0 con 0x5630f81399d0 2024-09-10T22:44:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e6f400640 1 -- 172.21.15.103:0/1703837080 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 94) ==== 3542+0+0 (secure 0 0 0) 0x7f0e7c0d4020 con 0x5630f81399d0 2024-09-10T22:44:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 10 client.7629 fetch_fsmap finished waiting for FSMap version 94 2024-09-10T22:44:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 10 client.7629 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T22:44:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 20 client.7629 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 1 --2- 172.21.15.103:0/1703837080 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5630f8148c70 0x5630f814b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 4 client.7629 mds_command: new command op to 7048 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 1 -- 172.21.15.103:0/1703837080 --> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630f7f4da70 con 0x5630f8148c70 2024-09-10T22:44:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e8de00640 1 --2- 172.21.15.103:0/1703837080 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5630f8148c70 0x5630f814b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e6f400640 10 client.7629 ms_handle_connect on v2:172.21.15.131:6834/1622106563 2024-09-10T22:44:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e8de00640 1 --2- 172.21.15.103:0/1703837080 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5630f8148c70 0x5630f814b060 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d003960876d31dd1 server_cookie=b226b1c7cc2b7fbe in_seq=0 out_seq=0 2024-09-10T22:44:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e6f400640 1 -- 172.21.15.103:0/1703837080 <== mds.2 v2:172.21.15.131:6834/1622106563 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5630f7f4da70 con 0x5630f8148c70 2024-09-10T22:44:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e6f400640 10 client.7629 handle_command_reply: tid=0 2024-09-10T22:44:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 1 client.7629 shutdown 2024-09-10T22:44:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 1 -- 172.21.15.103:0/1703837080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 msgr2=0x5630f80ef780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 1 --2- 172.21.15.103:0/1703837080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 0x5630f80ef780 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c01a460 tx=0x7f0e7c01c830 comp rx=0 tx=0).stop 2024-09-10T22:44:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 1 -- 172.21.15.103:0/1703837080 shutdown_connections 2024-09-10T22:44:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 1 --2- 172.21.15.103:0/1703837080 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5630f8148c70 0x5630f814b060 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 1 --2- 172.21.15.103:0/1703837080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f813a2f0 0x5630f80efcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 1 --2- 172.21.15.103:0/1703837080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 0x5630f80ef780 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 1 --2- 172.21.15.103:0/1703837080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f80ede10 0x5630f80ef240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e6f400640 0 client.7629 ms_handle_reset on v2:172.21.15.131:6834/1622106563 2024-09-10T22:44:40.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 1 -- 172.21.15.103:0/1703837080 >> 172.21.15.103:0/1703837080 conn(0x5630f7fd7130 msgr2=0x5630f80ecfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 1 -- 172.21.15.103:0/1703837080 shutdown_connections 2024-09-10T22:44:40.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 1 -- 172.21.15.103:0/1703837080 wait complete. 2024-09-10T22:44:40.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.001+0000 7f0e98700000 20 client.7629 trim_cache size 0 max 16384 2024-09-10T22:44:40.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e98700000 1 Processor -- start 2024-09-10T22:44:40.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e98700000 1 -- start start 2024-09-10T22:44:40.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e98700000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f80ede10 0x5630f81ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e98700000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 0x5630f81abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e98700000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f813a2f0 0x5630f81ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e98700000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0e90204230 con 0x5630f81399d0 2024-09-10T22:44:40.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e98700000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0e90202bd0 con 0x5630f813a2f0 2024-09-10T22:44:40.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e98700000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5630f7f43390 con 0x5630f80ede10 2024-09-10T22:44:40.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e8d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 0x5630f81abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e8d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 0x5630f81abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51560/0 (socket says 172.21.15.103:51560) 2024-09-10T22:44:40.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e8d400640 1 -- 172.21.15.103:0/511837703 learned_addr learned my addr 172.21.15.103:0/511837703 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:40.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e8d400640 1 -- 172.21.15.103:0/511837703 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f80ede10 msgr2=0x5630f81ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e8d400640 1 --2- 172.21.15.103:0/511837703 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f80ede10 0x5630f81ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e8d400640 1 -- 172.21.15.103:0/511837703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f813a2f0 msgr2=0x5630f81ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e8d400640 1 --2- 172.21.15.103:0/511837703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f813a2f0 0x5630f81ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e8d400640 1 -- 172.21.15.103:0/511837703 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630f7f96d90 con 0x5630f81399d0 2024-09-10T22:44:40.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e8d400640 1 --2- 172.21.15.103:0/511837703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 0x5630f81abb10 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c01d0d0 tx=0x7f0e7c0056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f797934e25c470 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e7a000640 1 -- 172.21.15.103:0/511837703 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c0da070 con 0x5630f81399d0 2024-09-10T22:44:40.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e7a000640 1 -- 172.21.15.103:0/511837703 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e7c0c9070 con 0x5630f81399d0 2024-09-10T22:44:40.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.021+0000 7f0e7a000640 1 -- 172.21.15.103:0/511837703 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c0b2070 con 0x5630f81399d0 2024-09-10T22:44:40.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 -- 172.21.15.103:0/511837703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 msgr2=0x5630f81abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 --2- 172.21.15.103:0/511837703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 0x5630f81abb10 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c01d0d0 tx=0x7f0e7c0056a0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 -- 172.21.15.103:0/511837703 shutdown_connections 2024-09-10T22:44:40.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 --2- 172.21.15.103:0/511837703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f813a2f0 0x5630f81ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 --2- 172.21.15.103:0/511837703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f81399d0 0x5630f81abb10 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 --2- 172.21.15.103:0/511837703 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f80ede10 0x5630f81ab5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 -- 172.21.15.103:0/511837703 >> 172.21.15.103:0/511837703 conn(0x5630f7fd7130 msgr2=0x5630f80ed470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 -- 172.21.15.103:0/511837703 shutdown_connections 2024-09-10T22:44:40.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 -- 172.21.15.103:0/511837703 wait complete. 2024-09-10T22:44:40.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 -- start start 2024-09-10T22:44:40.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 Processor -- start 2024-09-10T22:44:40.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f80ede10 0x5630f814fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f81399d0 0x5630f816b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f813a2f0 0x5630f816bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5630f7f3e070 con 0x5630f813a2f0 2024-09-10T22:44:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5630f7fbfa60 con 0x5630f81399d0 2024-09-10T22:44:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5630f7f4a8f0 con 0x5630f80ede10 2024-09-10T22:44:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 10 client.0 _ll_register_callbacks cb 0x7f0e7c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e8e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f813a2f0 0x5630f816bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e8e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f813a2f0 0x5630f816bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51574/0 (socket says 172.21.15.103:51574) 2024-09-10T22:44:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e8e800640 1 -- 172.21.15.103:0/4098271144 learned_addr learned my addr 172.21.15.103:0/4098271144 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e8d400640 1 --2- 172.21.15.103:0/4098271144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f81399d0 0x5630f816b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e8de00640 1 --2- 172.21.15.103:0/4098271144 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f80ede10 0x5630f814fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e8e800640 1 -- 172.21.15.103:0/4098271144 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f80ede10 msgr2=0x5630f814fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e8e800640 1 --2- 172.21.15.103:0/4098271144 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f80ede10 0x5630f814fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e8e800640 1 -- 172.21.15.103:0/4098271144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f81399d0 msgr2=0x5630f816b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e8e800640 1 --2- 172.21.15.103:0/4098271144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f81399d0 0x5630f816b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e8e800640 1 -- 172.21.15.103:0/4098271144 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630f7f01a90 con 0x5630f813a2f0 2024-09-10T22:44:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e8e800640 1 --2- 172.21.15.103:0/4098271144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f813a2f0 0x5630f816bac0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f0e88091de0 tx=0x7f0e8805f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2c9a6c77ec949a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e6f400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e6f400640 1 -- 172.21.15.103:0/4098271144 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8801f040 con 0x5630f813a2f0 2024-09-10T22:44:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e6f400640 1 -- 172.21.15.103:0/4098271144 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f0e8805fdc0 con 0x5630f813a2f0 2024-09-10T22:44:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 -- 172.21.15.103:0/4098271144 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e7c0c9070 con 0x5630f813a2f0 2024-09-10T22:44:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e6f400640 1 -- 172.21.15.103:0/4098271144 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f0e8805a260 con 0x5630f813a2f0 2024-09-10T22:44:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 10 client.7635 fetch_fsmap learned FSMap version 94 2024-09-10T22:44:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.025+0000 7f0e98700000 1 -- 172.21.15.103:0/4098271144 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x5630f7ee0050 con 0x5630f813a2f0 2024-09-10T22:44:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e6f400640 1 -- 172.21.15.103:0/4098271144 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e7c0c9070 con 0x5630f813a2f0 2024-09-10T22:44:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e6f400640 1 -- 172.21.15.103:0/4098271144 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 94) ==== 3542+0+0 (secure 0 0 0) 0x7f0e8805a400 con 0x5630f813a2f0 2024-09-10T22:44:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e98700000 10 client.7635 fetch_fsmap finished waiting for FSMap version 94 2024-09-10T22:44:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e98700000 10 client.7635 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T22:44:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e98700000 20 client.7635 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e98700000 1 --2- 172.21.15.103:0/4098271144 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5630f816c000 0x5630f81af820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e98700000 4 client.7635 mds_command: new command op to 7048 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:44:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e98700000 1 -- 172.21.15.103:0/4098271144 --> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] -- command(tid 0: {"prefix": "status"}) -- 0x5630f7f49520 con 0x5630f816c000 2024-09-10T22:44:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e8de00640 1 --2- 172.21.15.103:0/4098271144 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5630f816c000 0x5630f81af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e8de00640 1 --2- 172.21.15.103:0/4098271144 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5630f816c000 0x5630f81af820 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fc71a60da0d6ff21 server_cookie=e1b26f230c76c2c3 in_seq=0 out_seq=0 2024-09-10T22:44:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e6f400640 10 client.7635 ms_handle_connect on v2:172.21.15.131:6834/1622106563 2024-09-10T22:44:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e6f400640 1 -- 172.21.15.103:0/4098271144 <== mds.2 v2:172.21.15.131:6834/1622106563 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5630f7f49520 con 0x5630f816c000 2024-09-10T22:44:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e6f400640 10 client.7635 handle_command_reply: tid=0 2024-09-10T22:44:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e98700000 1 client.7635 shutdown 2024-09-10T22:44:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e98700000 1 -- 172.21.15.103:0/4098271144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f813a2f0 msgr2=0x5630f816bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e98700000 1 --2- 172.21.15.103:0/4098271144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f813a2f0 0x5630f816bac0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f0e88091de0 tx=0x7f0e8805f0f0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e98700000 1 -- 172.21.15.103:0/4098271144 shutdown_connections 2024-09-10T22:44:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e98700000 1 --2- 172.21.15.103:0/4098271144 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5630f816c000 0x5630f81af820 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e98700000 1 --2- 172.21.15.103:0/4098271144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5630f813a2f0 0x5630f816bac0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e98700000 1 --2- 172.21.15.103:0/4098271144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5630f81399d0 0x5630f816b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e6f400640 0 client.7635 ms_handle_reset on v2:172.21.15.131:6834/1622106563 2024-09-10T22:44:40.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e98700000 1 --2- 172.21.15.103:0/4098271144 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5630f80ede10 0x5630f814fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e98700000 1 -- 172.21.15.103:0/4098271144 >> 172.21.15.103:0/4098271144 conn(0x5630f7fd7130 msgr2=0x5630f814b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e98700000 1 -- 172.21.15.103:0/4098271144 shutdown_connections 2024-09-10T22:44:40.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e98700000 1 -- 172.21.15.103:0/4098271144 wait complete. 2024-09-10T22:44:40.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e98700000 20 client.7635 trim_cache size 0 max 16384 2024-09-10T22:44:40.037 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:44:40.037 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:44:40.037 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 2, 2024-09-10T22:44:40.038 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7048, 2024-09-10T22:44:40.038 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:44:40.038 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:44:40.038 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:44:40.038 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 1.776501264, 2024-09-10T22:44:40.038 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 94, 2024-09-10T22:44:40.038 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 94, 2024-09-10T22:44:40.038 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 94, 2024-09-10T22:44:40.038 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 20.371913335999999 2024-09-10T22:44:40.038 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:44:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e95200640 1 -- 172.21.15.103:0/4114886303 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0e700725e0 msgr2=0x7f0e70074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e95200640 1 --2- 172.21.15.103:0/4114886303 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0e700725e0 0x7f0e70074aa0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0af000 tx=0x7f0e7c01b070 comp rx=0 tx=0).stop 2024-09-10T22:44:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e95200640 1 -- 172.21.15.103:0/4114886303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e900cf790 msgr2=0x7f0e9014a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e95200640 1 --2- 172.21.15.103:0/4114886303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e900cf790 0x7f0e9014a090 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800e970 tx=0x7f0e8800ee30 comp rx=0 tx=0).stop 2024-09-10T22:44:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e95200640 1 -- 172.21.15.103:0/4114886303 shutdown_connections 2024-09-10T22:44:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e95200640 1 --2- 172.21.15.103:0/4114886303 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0e700725e0 0x7f0e70074aa0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e95200640 1 --2- 172.21.15.103:0/4114886303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e900cf790 0x7f0e9014a090 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e95200640 1 --2- 172.21.15.103:0/4114886303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e900cc120 0x7f0e900a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e95200640 1 --2- 172.21.15.103:0/4114886303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e900aeb40 0x7f0e90070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e95200640 1 -- 172.21.15.103:0/4114886303 >> 172.21.15.103:0/4114886303 conn(0x7f0e9006cc00 msgr2=0x7f0e9015c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e95200640 1 -- 172.21.15.103:0/4114886303 shutdown_connections 2024-09-10T22:44:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.029+0000 7f0e95200640 1 -- 172.21.15.103:0/4114886303 wait complete. 2024-09-10T22:44:40.053 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T22:44:40.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.193+0000 7efe5ce00640 1 -- 172.21.15.103:0/3293818804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe580b0510 msgr2=0x7efe58070430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.193+0000 7efe5ce00640 1 --2- 172.21.15.103:0/3293818804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe580b0510 0x7efe58070430 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7efe50009c80 tx=0x7efe5001cd10 comp rx=0 tx=0).stop 2024-09-10T22:44:40.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.193+0000 7efe5ce00640 1 -- 172.21.15.103:0/3293818804 shutdown_connections 2024-09-10T22:44:40.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.193+0000 7efe5ce00640 1 --2- 172.21.15.103:0/3293818804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe580b0510 0x7efe58070430 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.193+0000 7efe5ce00640 1 --2- 172.21.15.103:0/3293818804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe580714d0 0x7efe580affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.193+0000 7efe5ce00640 1 -- 172.21.15.103:0/3293818804 >> 172.21.15.103:0/3293818804 conn(0x7efe580d18f0 msgr2=0x7efe580d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.193+0000 7efe5ce00640 1 -- 172.21.15.103:0/3293818804 shutdown_connections 2024-09-10T22:44:40.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.193+0000 7efe5ce00640 1 -- 172.21.15.103:0/3293818804 wait complete. 2024-09-10T22:44:40.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.193+0000 7efe5ce00640 1 Processor -- start 2024-09-10T22:44:40.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.193+0000 7efe5ce00640 1 -- start start 2024-09-10T22:44:40.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe5ce00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe580714d0 0x7efe58152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe5ce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe580b0510 0x7efe58151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe5ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe5815f0e0 0x7efe580cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe5ce00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efe58168d40 con 0x7efe5815f0e0 2024-09-10T22:44:40.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe5ce00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7efe58168bc0 con 0x7efe580b0510 2024-09-10T22:44:40.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe5ce00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7efe58168ec0 con 0x7efe580714d0 2024-09-10T22:44:40.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe57e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe5815f0e0 0x7efe580cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe57e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe5815f0e0 0x7efe580cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51598/0 (socket says 172.21.15.103:51598) 2024-09-10T22:44:40.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe57e00640 1 -- 172.21.15.103:0/1248149998 learned_addr learned my addr 172.21.15.103:0/1248149998 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:40.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe57400640 1 --2- 172.21.15.103:0/1248149998 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe580714d0 0x7efe58152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe56a00640 1 --2- 172.21.15.103:0/1248149998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe580b0510 0x7efe58151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe57e00640 1 -- 172.21.15.103:0/1248149998 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe580714d0 msgr2=0x7efe58152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe57e00640 1 --2- 172.21.15.103:0/1248149998 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe580714d0 0x7efe58152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe57e00640 1 -- 172.21.15.103:0/1248149998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe580b0510 msgr2=0x7efe58151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe57e00640 1 --2- 172.21.15.103:0/1248149998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe580b0510 0x7efe58151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe57e00640 1 -- 172.21.15.103:0/1248149998 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe58152c70 con 0x7efe5815f0e0 2024-09-10T22:44:40.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe57e00640 1 --2- 172.21.15.103:0/1248149998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe5815f0e0 0x7efe580cad60 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7efe50009bd0 tx=0x7efe50009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe4f400640 1 -- 172.21.15.103:0/1248149998 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe500bb070 con 0x7efe5815f0e0 2024-09-10T22:44:40.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe4f400640 1 -- 172.21.15.103:0/1248149998 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe50004e00 con 0x7efe5815f0e0 2024-09-10T22:44:40.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe4f400640 1 -- 172.21.15.103:0/1248149998 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe500b2040 con 0x7efe5815f0e0 2024-09-10T22:44:40.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe5ce00640 1 -- 172.21.15.103:0/1248149998 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe58152f50 con 0x7efe5815f0e0 2024-09-10T22:44:40.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.197+0000 7efe5ce00640 1 -- 172.21.15.103:0/1248149998 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe5815a4f0 con 0x7efe5815f0e0 2024-09-10T22:44:40.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.201+0000 7efe4f400640 1 -- 172.21.15.103:0/1248149998 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7efe500b5030 con 0x7efe5815f0e0 2024-09-10T22:44:40.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.201+0000 7efe61873000 1 Processor -- start 2024-09-10T22:44:40.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.201+0000 7efe4f400640 1 --2- 172.21.15.103:0/1248149998 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efe380725e0 0x7efe38074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.201+0000 7efe61873000 1 -- start start 2024-09-10T22:44:40.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.201+0000 7efe4f400640 1 -- 172.21.15.103:0/1248149998 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7efe5012d060 con 0x7efe5815f0e0 2024-09-10T22:44:40.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.201+0000 7efe56a00640 1 --2- 172.21.15.103:0/1248149998 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efe380725e0 0x7efe38074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.201+0000 7efe61873000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 0x560d3c8e22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.201+0000 7efe61873000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c8e2820 0x560d3c897cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.201+0000 7efe61873000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c898230 0x560d3c898610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.201+0000 7efe61873000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560d3c7b23f0 con 0x560d3c8e1f00 2024-09-10T22:44:40.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.201+0000 7efe61873000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560d3c6efb20 con 0x560d3c8e2820 2024-09-10T22:44:40.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.201+0000 7efe61873000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560d3c6def50 con 0x560d3c898230 2024-09-10T22:44:40.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.201+0000 7efe56a00640 1 --2- 172.21.15.103:0/1248149998 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efe380725e0 0x7efe38074aa0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efe581f8b60 tx=0x7efe4400b390 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.201+0000 7efe57400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 0x560d3c8e22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe56a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c8e2820 0x560d3c897cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe57e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c898230 0x560d3c898610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe57400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 0x560d3c8e22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51610/0 (socket says 172.21.15.103:51610) 2024-09-10T22:44:40.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe57400640 1 -- 172.21.15.103:0/3409803196 learned_addr learned my addr 172.21.15.103:0/3409803196 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:40.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe56a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c8e2820 0x560d3c897cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:35488/0 (socket says 172.21.15.103:35488) 2024-09-10T22:44:40.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe57400640 1 -- 172.21.15.103:0/3409803196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c898230 msgr2=0x560d3c898610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe57400640 1 --2- 172.21.15.103:0/3409803196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c898230 0x560d3c898610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe57400640 1 -- 172.21.15.103:0/3409803196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c8e2820 msgr2=0x560d3c897cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe57400640 1 --2- 172.21.15.103:0/3409803196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c8e2820 0x560d3c897cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe57400640 1 -- 172.21.15.103:0/3409803196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d3c6a6590 con 0x560d3c8e1f00 2024-09-10T22:44:40.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe57400640 1 --2- 172.21.15.103:0/3409803196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 0x560d3c8e22e0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7efe48001810 tx=0x7efe48007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd65868af366b55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe43e00640 1 -- 172.21.15.103:0/3409803196 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe480052e0 con 0x560d3c8e1f00 2024-09-10T22:44:40.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe43e00640 1 -- 172.21.15.103:0/3409803196 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe48018070 con 0x560d3c8e1f00 2024-09-10T22:44:40.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe43e00640 1 -- 172.21.15.103:0/3409803196 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4800fa10 con 0x560d3c8e1f00 2024-09-10T22:44:40.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe61873000 1 -- 172.21.15.103:0/3409803196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 msgr2=0x560d3c8e22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe61873000 1 --2- 172.21.15.103:0/3409803196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 0x560d3c8e22e0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7efe48001810 tx=0x7efe48007e40 comp rx=0 tx=0).stop 2024-09-10T22:44:40.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe61873000 1 -- 172.21.15.103:0/3409803196 shutdown_connections 2024-09-10T22:44:40.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe61873000 1 --2- 172.21.15.103:0/3409803196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c898230 0x560d3c898610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe61873000 1 --2- 172.21.15.103:0/3409803196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c8e2820 0x560d3c897cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe61873000 1 --2- 172.21.15.103:0/3409803196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 0x560d3c8e22e0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe61873000 1 -- 172.21.15.103:0/3409803196 >> 172.21.15.103:0/3409803196 conn(0x560d3c77b130 msgr2=0x560d3c899e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe61873000 1 -- 172.21.15.103:0/3409803196 shutdown_connections 2024-09-10T22:44:40.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe61873000 1 -- 172.21.15.103:0/3409803196 wait complete. 2024-09-10T22:44:40.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe61873000 1 -- start start 2024-09-10T22:44:40.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.205+0000 7efe61873000 1 Processor -- start 2024-09-10T22:44:40.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe61873000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c898230 0x560d3c8cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe61873000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c8e1f00 0x560d3c8ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe61873000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c8e2820 0x560d3c8cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe61873000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560d3c6795d0 con 0x560d3c898230 2024-09-10T22:44:40.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe61873000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560d3c6e2d60 con 0x560d3c8e1f00 2024-09-10T22:44:40.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe61873000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560d3c685500 con 0x560d3c8e2820 2024-09-10T22:44:40.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe61873000 10 client.0 _ll_register_callbacks cb 0x560d3c689810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:40.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe57e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c8e2820 0x560d3c8cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe56a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c8e1f00 0x560d3c8ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe57e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c8e2820 0x560d3c8cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:42046/0 (socket says 172.21.15.103:42046) 2024-09-10T22:44:40.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe56a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c8e1f00 0x560d3c8ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:35502/0 (socket says 172.21.15.103:35502) 2024-09-10T22:44:40.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe57e00640 1 -- 172.21.15.103:0/4202109080 learned_addr learned my addr 172.21.15.103:0/4202109080 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:40.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe57400640 1 --2- 172.21.15.103:0/4202109080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c898230 0x560d3c8cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe57e00640 1 -- 172.21.15.103:0/4202109080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c8e1f00 msgr2=0x560d3c8ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe57e00640 1 --2- 172.21.15.103:0/4202109080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c8e1f00 0x560d3c8ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe57e00640 1 -- 172.21.15.103:0/4202109080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c898230 msgr2=0x560d3c8cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe57e00640 1 --2- 172.21.15.103:0/4202109080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c898230 0x560d3c8cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe57e00640 1 -- 172.21.15.103:0/4202109080 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x560d3c67d170 con 0x560d3c8e2820 2024-09-10T22:44:40.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe57400640 1 --2- 172.21.15.103:0/4202109080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c898230 0x560d3c8cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:44:40.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe56a00640 1 --2- 172.21.15.103:0/4202109080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c8e1f00 0x560d3c8ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:44:40.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe57e00640 1 --2- 172.21.15.103:0/4202109080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c8e2820 0x560d3c8cd2a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efe5001b3c0 tx=0x7efe500f78e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72112de5c375b3bc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe40c00640 10 client.0 ms_handle_connect on v2:172.21.15.131:3301/0 2024-09-10T22:44:40.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe40c00640 1 -- 172.21.15.103:0/4202109080 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe500fc900 con 0x560d3c8e2820 2024-09-10T22:44:40.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe61873000 1 -- 172.21.15.103:0/4202109080 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x560d3c6770f0 con 0x560d3c8e2820 2024-09-10T22:44:40.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe40c00640 1 -- 172.21.15.103:0/4202109080 <== mon.2 v2:172.21.15.131:3301/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7efe50125dc0 con 0x560d3c8e2820 2024-09-10T22:44:40.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe40c00640 1 -- 172.21.15.103:0/4202109080 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7efe50101320 con 0x560d3c8e2820 2024-09-10T22:44:40.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe61873000 10 client.6578 fetch_fsmap learned FSMap version 94 2024-09-10T22:44:40.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe61873000 1 -- 172.21.15.103:0/4202109080 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x560d3c763ef0 con 0x560d3c8e2820 2024-09-10T22:44:40.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe40c00640 1 -- 172.21.15.103:0/4202109080 <== mon.2 v2:172.21.15.131:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560d3c6770f0 con 0x560d3c8e2820 2024-09-10T22:44:40.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe40c00640 1 -- 172.21.15.103:0/4202109080 <== mon.2 v2:172.21.15.131:3301/0 5 ==== fsmap(e 94) ==== 3542+0+0 (secure 0 0 0) 0x7efe501240d0 con 0x560d3c8e2820 2024-09-10T22:44:40.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe61873000 10 client.6578 fetch_fsmap finished waiting for FSMap version 94 2024-09-10T22:44:40.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe61873000 10 client.6578 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T22:44:40.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe61873000 20 client.6578 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:40.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe61873000 1 --2- 172.21.15.103:0/4202109080 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x560d3c8cdcb0 0x560d3c8ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe61873000 4 client.6578 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:40.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe61873000 1 -- 172.21.15.103:0/4202109080 --> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d3c6f1a70 con 0x560d3c8cdcb0 2024-09-10T22:44:40.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe57400640 1 --2- 172.21.15.103:0/4202109080 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x560d3c8cdcb0 0x560d3c8ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe57400640 1 --2- 172.21.15.103:0/4202109080 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x560d3c8cdcb0 0x560d3c8ce090 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f2776b143253faa0 server_cookie=67a6b14dc2eb9b77 in_seq=0 out_seq=0 2024-09-10T22:44:40.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.209+0000 7efe40c00640 10 client.6578 ms_handle_connect on v2:172.21.15.103:6832/3251348074 2024-09-10T22:44:40.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.213+0000 7efe40c00640 1 -- 172.21.15.103:0/4202109080 <== mds.1 v2:172.21.15.103:6832/3251348074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d3c6f1a70 con 0x560d3c8cdcb0 2024-09-10T22:44:40.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.213+0000 7efe40c00640 10 client.6578 handle_command_reply: tid=0 2024-09-10T22:44:40.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.213+0000 7efe61873000 1 client.6578 shutdown 2024-09-10T22:44:40.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.213+0000 7efe61873000 1 -- 172.21.15.103:0/4202109080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c8e2820 msgr2=0x560d3c8cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.213+0000 7efe61873000 1 --2- 172.21.15.103:0/4202109080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c8e2820 0x560d3c8cd2a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efe5001b3c0 tx=0x7efe500f78e0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.213+0000 7efe61873000 1 -- 172.21.15.103:0/4202109080 shutdown_connections 2024-09-10T22:44:40.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.213+0000 7efe61873000 1 --2- 172.21.15.103:0/4202109080 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x560d3c8cdcb0 0x560d3c8ce090 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.213+0000 7efe61873000 1 --2- 172.21.15.103:0/4202109080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c8e2820 0x560d3c8cd2a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.213+0000 7efe61873000 1 --2- 172.21.15.103:0/4202109080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c8e1f00 0x560d3c8ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.213+0000 7efe40c00640 0 client.6578 ms_handle_reset on v2:172.21.15.103:6832/3251348074 2024-09-10T22:44:40.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.213+0000 7efe61873000 1 --2- 172.21.15.103:0/4202109080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c898230 0x560d3c8cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.213+0000 7efe61873000 1 -- 172.21.15.103:0/4202109080 >> 172.21.15.103:0/4202109080 conn(0x560d3c77b130 msgr2=0x560d3c898610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.213+0000 7efe61873000 1 -- 172.21.15.103:0/4202109080 shutdown_connections 2024-09-10T22:44:40.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.213+0000 7efe61873000 1 -- 172.21.15.103:0/4202109080 wait complete. 2024-09-10T22:44:40.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.213+0000 7efe61873000 20 client.6578 trim_cache size 0 max 16384 2024-09-10T22:44:40.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.229+0000 7efe61873000 1 Processor -- start 2024-09-10T22:44:40.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.229+0000 7efe61873000 1 -- start start 2024-09-10T22:44:40.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c898230 0x560d3c8e0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 0x560d3c8e0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c8e2820 0x560d3c8e0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efe5806f910 con 0x560d3c8e1f00 2024-09-10T22:44:40.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7efe581ffd10 con 0x560d3c898230 2024-09-10T22:44:40.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7efe580b3040 con 0x560d3c8e2820 2024-09-10T22:44:40.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe56a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 0x560d3c8e0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe56a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 0x560d3c8e0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51628/0 (socket says 172.21.15.103:51628) 2024-09-10T22:44:40.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe56a00640 1 -- 172.21.15.103:0/2726559844 learned_addr learned my addr 172.21.15.103:0/2726559844 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:40.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe57400640 1 --2- 172.21.15.103:0/2726559844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c898230 0x560d3c8e0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe57e00640 1 --2- 172.21.15.103:0/2726559844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c8e2820 0x560d3c8e0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe56a00640 1 -- 172.21.15.103:0/2726559844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c8e2820 msgr2=0x560d3c8e0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe56a00640 1 --2- 172.21.15.103:0/2726559844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c8e2820 0x560d3c8e0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe56a00640 1 -- 172.21.15.103:0/2726559844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c898230 msgr2=0x560d3c8e0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe56a00640 1 --2- 172.21.15.103:0/2726559844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c898230 0x560d3c8e0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe56a00640 1 -- 172.21.15.103:0/2726559844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d3c73ad90 con 0x560d3c8e1f00 2024-09-10T22:44:40.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe57400640 1 --2- 172.21.15.103:0/2726559844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c898230 0x560d3c8e0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:40.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe57e00640 1 --2- 172.21.15.103:0/2726559844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c8e2820 0x560d3c8e0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:40.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe56a00640 1 --2- 172.21.15.103:0/2726559844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 0x560d3c8e0660 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7efe580b0390 tx=0x7efe44013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd4170e1d1bd763 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe43400640 1 -- 172.21.15.103:0/2726559844 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4401f520 con 0x560d3c8e1f00 2024-09-10T22:44:40.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe43400640 1 -- 172.21.15.103:0/2726559844 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe4401f6c0 con 0x560d3c8e1f00 2024-09-10T22:44:40.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe43400640 1 -- 172.21.15.103:0/2726559844 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4401fab0 con 0x560d3c8e1f00 2024-09-10T22:44:40.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 -- 172.21.15.103:0/2726559844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 msgr2=0x560d3c8e0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 --2- 172.21.15.103:0/2726559844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 0x560d3c8e0660 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7efe580b0390 tx=0x7efe44013000 comp rx=0 tx=0).stop 2024-09-10T22:44:40.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 -- 172.21.15.103:0/2726559844 shutdown_connections 2024-09-10T22:44:40.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 --2- 172.21.15.103:0/2726559844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c8e2820 0x560d3c8e0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 --2- 172.21.15.103:0/2726559844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 0x560d3c8e0660 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 --2- 172.21.15.103:0/2726559844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c898230 0x560d3c8e0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 -- 172.21.15.103:0/2726559844 >> 172.21.15.103:0/2726559844 conn(0x560d3c77b130 msgr2=0x560d3c8ef690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 -- 172.21.15.103:0/2726559844 shutdown_connections 2024-09-10T22:44:40.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 -- 172.21.15.103:0/2726559844 wait complete. 2024-09-10T22:44:40.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 -- start start 2024-09-10T22:44:40.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 Processor -- start 2024-09-10T22:44:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c898230 0x560d3c9589e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 0x560d3c958f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c8e2820 0x560d3c959460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560d3c685500 con 0x560d3c8e1f00 2024-09-10T22:44:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560d3c6aaec0 con 0x560d3c898230 2024-09-10T22:44:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560d3c6795d0 con 0x560d3c8e2820 2024-09-10T22:44:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.233+0000 7efe61873000 10 client.0 _ll_register_callbacks cb 0x7efe500f7ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe56a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 0x560d3c958f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe56a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 0x560d3c958f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51636/0 (socket says 172.21.15.103:51636) 2024-09-10T22:44:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe56a00640 1 -- 172.21.15.103:0/2454237877 learned_addr learned my addr 172.21.15.103:0/2454237877 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe57e00640 1 --2- 172.21.15.103:0/2454237877 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c8e2820 0x560d3c959460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe57400640 1 --2- 172.21.15.103:0/2454237877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c898230 0x560d3c9589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe56a00640 1 -- 172.21.15.103:0/2454237877 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c8e2820 msgr2=0x560d3c959460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe56a00640 1 --2- 172.21.15.103:0/2454237877 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c8e2820 0x560d3c959460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe56a00640 1 -- 172.21.15.103:0/2454237877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c898230 msgr2=0x560d3c9589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe56a00640 1 --2- 172.21.15.103:0/2454237877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c898230 0x560d3c9589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe56a00640 1 -- 172.21.15.103:0/2454237877 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d3c6a5a90 con 0x560d3c8e1f00 2024-09-10T22:44:40.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe56a00640 1 --2- 172.21.15.103:0/2454237877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 0x560d3c958f20 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x560d3c3fe8d0 tx=0x7efe44010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb03de0969c0ce73 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe40c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:40.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe40c00640 1 -- 172.21.15.103:0/2454237877 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe44029630 con 0x560d3c8e1f00 2024-09-10T22:44:40.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe40c00640 1 -- 172.21.15.103:0/2454237877 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7efe44034cf0 con 0x560d3c8e1f00 2024-09-10T22:44:40.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 1 -- 172.21.15.103:0/2454237877 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe4401f6c0 con 0x560d3c8e1f00 2024-09-10T22:44:40.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe40c00640 1 -- 172.21.15.103:0/2454237877 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7efe4403b050 con 0x560d3c8e1f00 2024-09-10T22:44:40.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 10 client.7656 fetch_fsmap learned FSMap version 94 2024-09-10T22:44:40.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 1 -- 172.21.15.103:0/2454237877 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x560d3c684050 con 0x560d3c8e1f00 2024-09-10T22:44:40.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe40c00640 1 -- 172.21.15.103:0/2454237877 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe4401f6c0 con 0x560d3c8e1f00 2024-09-10T22:44:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe40c00640 1 -- 172.21.15.103:0/2454237877 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 94) ==== 3542+0+0 (secure 0 0 0) 0x7efe4403e020 con 0x560d3c8e1f00 2024-09-10T22:44:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 10 client.7656 fetch_fsmap finished waiting for FSMap version 94 2024-09-10T22:44:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 10 client.7656 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T22:44:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 20 client.7656 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 1 --2- 172.21.15.103:0/2454237877 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x560d3c8f7b40 0x560d3c8f6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 4 client.7656 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:44:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 1 -- 172.21.15.103:0/2454237877 --> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] -- command(tid 0: {"prefix": "status"}) -- 0x560d3c6ed520 con 0x560d3c8f7b40 2024-09-10T22:44:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe57400640 1 --2- 172.21.15.103:0/2454237877 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x560d3c8f7b40 0x560d3c8f6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe57400640 1 --2- 172.21.15.103:0/2454237877 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x560d3c8f7b40 0x560d3c8f6cd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=202f7e601b664c10 server_cookie=a9efce10d5c6bdc5 in_seq=0 out_seq=0 2024-09-10T22:44:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe40c00640 10 client.7656 ms_handle_connect on v2:172.21.15.103:6832/3251348074 2024-09-10T22:44:40.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe40c00640 1 -- 172.21.15.103:0/2454237877 <== mds.1 v2:172.21.15.103:6832/3251348074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x560d3c6ed520 con 0x560d3c8f7b40 2024-09-10T22:44:40.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe40c00640 10 client.7656 handle_command_reply: tid=0 2024-09-10T22:44:40.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 1 client.7656 shutdown 2024-09-10T22:44:40.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 1 -- 172.21.15.103:0/2454237877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 msgr2=0x560d3c958f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 1 --2- 172.21.15.103:0/2454237877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 0x560d3c958f20 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x560d3c3fe8d0 tx=0x7efe44010cb0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 1 -- 172.21.15.103:0/2454237877 shutdown_connections 2024-09-10T22:44:40.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 1 --2- 172.21.15.103:0/2454237877 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x560d3c8f7b40 0x560d3c8f6cd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 1 --2- 172.21.15.103:0/2454237877 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560d3c8e2820 0x560d3c959460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 1 --2- 172.21.15.103:0/2454237877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d3c8e1f00 0x560d3c958f20 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 1 --2- 172.21.15.103:0/2454237877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560d3c898230 0x560d3c9589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe40c00640 0 client.7656 ms_handle_reset on v2:172.21.15.103:6832/3251348074 2024-09-10T22:44:40.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 1 -- 172.21.15.103:0/2454237877 >> 172.21.15.103:0/2454237877 conn(0x560d3c77b130 msgr2=0x560d3c896ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 1 -- 172.21.15.103:0/2454237877 shutdown_connections 2024-09-10T22:44:40.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 1 -- 172.21.15.103:0/2454237877 wait complete. 2024-09-10T22:44:40.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe61873000 20 client.7656 trim_cache size 0 max 16384 2024-09-10T22:44:40.247 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:44:40.247 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:44:40.247 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 1, 2024-09-10T22:44:40.247 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7428, 2024-09-10T22:44:40.247 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:44:40.247 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:44:40.247 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:44:40.247 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 2.9972386389999999, 2024-09-10T22:44:40.247 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 94, 2024-09-10T22:44:40.247 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 94, 2024-09-10T22:44:40.247 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 94, 2024-09-10T22:44:40.247 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 20.581715827 2024-09-10T22:44:40.248 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:44:40.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.237+0000 7efe5ce00640 1 -- 172.21.15.103:0/1248149998 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efe380725e0 msgr2=0x7efe38074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.241+0000 7efe5ce00640 1 --2- 172.21.15.103:0/1248149998 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efe380725e0 0x7efe38074aa0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efe581f8b60 tx=0x7efe4400b390 comp rx=0 tx=0).stop 2024-09-10T22:44:40.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.241+0000 7efe5ce00640 1 -- 172.21.15.103:0/1248149998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe5815f0e0 msgr2=0x7efe580cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.241+0000 7efe5ce00640 1 --2- 172.21.15.103:0/1248149998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe5815f0e0 0x7efe580cad60 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7efe50009bd0 tx=0x7efe50009390 comp rx=0 tx=0).stop 2024-09-10T22:44:40.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.241+0000 7efe5ce00640 1 -- 172.21.15.103:0/1248149998 shutdown_connections 2024-09-10T22:44:40.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.241+0000 7efe5ce00640 1 --2- 172.21.15.103:0/1248149998 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efe380725e0 0x7efe38074aa0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.241+0000 7efe5ce00640 1 --2- 172.21.15.103:0/1248149998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe5815f0e0 0x7efe580cad60 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.241+0000 7efe5ce00640 1 --2- 172.21.15.103:0/1248149998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe580b0510 0x7efe58151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.241+0000 7efe5ce00640 1 --2- 172.21.15.103:0/1248149998 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe580714d0 0x7efe58152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.241+0000 7efe5ce00640 1 -- 172.21.15.103:0/1248149998 >> 172.21.15.103:0/1248149998 conn(0x7efe580d18f0 msgr2=0x7efe580d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.241+0000 7efe5ce00640 1 -- 172.21.15.103:0/1248149998 shutdown_connections 2024-09-10T22:44:40.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.241+0000 7efe5ce00640 1 -- 172.21.15.103:0/1248149998 wait complete. 2024-09-10T22:44:40.263 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T22:44:40.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.401+0000 7f59dfc00640 1 -- 172.21.15.103:0/3188435225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59c0006330 msgr2=0x7f59c000cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.401+0000 7f59dfc00640 1 --2- 172.21.15.103:0/3188435225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59c0006330 0x7f59c000cae0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f59d000c560 tx=0x7f59d001f9c0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.401+0000 7f59dfc00640 1 -- 172.21.15.103:0/3188435225 shutdown_connections 2024-09-10T22:44:40.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.401+0000 7f59dfc00640 1 --2- 172.21.15.103:0/3188435225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59c0006330 0x7f59c000cae0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.401+0000 7f59dfc00640 1 -- 172.21.15.103:0/3188435225 >> 172.21.15.103:0/3188435225 conn(0x7f59d806cc00 msgr2=0x7f59d806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.401+0000 7f59dfc00640 1 -- 172.21.15.103:0/3188435225 shutdown_connections 2024-09-10T22:44:40.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.401+0000 7f59dfc00640 1 -- 172.21.15.103:0/3188435225 wait complete. 2024-09-10T22:44:40.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59dfc00640 1 Processor -- start 2024-09-10T22:44:40.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59dfc00640 1 -- start start 2024-09-10T22:44:40.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59dfc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59c0006330 0x7f59d8158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59dfc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59d80c47e0 0x7f59d80c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59dfc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59d80affd0 0x7f59d80b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59dfc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f59d8072890 con 0x7f59d80c47e0 2024-09-10T22:44:40.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59dfc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f59d8072710 con 0x7f59d80affd0 2024-09-10T22:44:40.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59dfc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f59d80b2c10 con 0x7f59c0006330 2024-09-10T22:44:40.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59d7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59d80c47e0 0x7f59d80c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59d7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59d80c47e0 0x7f59d80c4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51654/0 (socket says 172.21.15.103:51654) 2024-09-10T22:44:40.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59d7e00640 1 -- 172.21.15.103:0/1993004507 learned_addr learned my addr 172.21.15.103:0/1993004507 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:40.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59d7e00640 1 -- 172.21.15.103:0/1993004507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59c0006330 msgr2=0x7f59d8158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59dd200640 1 --2- 172.21.15.103:0/1993004507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59c0006330 0x7f59d8158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59ddc00640 1 --2- 172.21.15.103:0/1993004507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59d80affd0 0x7f59d80b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59d7e00640 1 --2- 172.21.15.103:0/1993004507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59c0006330 0x7f59d8158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59d7e00640 1 -- 172.21.15.103:0/1993004507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59d80affd0 msgr2=0x7f59d80b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59d7e00640 1 --2- 172.21.15.103:0/1993004507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59d80affd0 0x7f59d80b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59d7e00640 1 -- 172.21.15.103:0/1993004507 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d81590c0 con 0x7f59d80c47e0 2024-09-10T22:44:40.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59dd200640 1 --2- 172.21.15.103:0/1993004507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59c0006330 0x7f59d8158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:40.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59ddc00640 1 --2- 172.21.15.103:0/1993004507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59d80affd0 0x7f59d80b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:40.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59d7e00640 1 --2- 172.21.15.103:0/1993004507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59d80c47e0 0x7f59d80c4c60 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f59c4011ae0 tx=0x7f59c400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59d4c00640 1 -- 172.21.15.103:0/1993004507 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c401e070 con 0x7f59d80c47e0 2024-09-10T22:44:40.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59d4c00640 1 -- 172.21.15.103:0/1993004507 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59c400fd40 con 0x7f59d80c47e0 2024-09-10T22:44:40.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59d4c00640 1 -- 172.21.15.103:0/1993004507 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c4019670 con 0x7f59d80c47e0 2024-09-10T22:44:40.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59dfc00640 1 -- 172.21.15.103:0/1993004507 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d81f7420 con 0x7f59d80c47e0 2024-09-10T22:44:40.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.405+0000 7f59dfc00640 1 -- 172.21.15.103:0/1993004507 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d81f79e0 con 0x7f59d80c47e0 2024-09-10T22:44:40.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.409+0000 7f59d4c00640 1 -- 172.21.15.103:0/1993004507 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f59c4019810 con 0x7f59d80c47e0 2024-09-10T22:44:40.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.409+0000 7f59d4c00640 1 --2- 172.21.15.103:0/1993004507 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f59b80725e0 0x7f59b8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.409+0000 7f59d4c00640 1 -- 172.21.15.103:0/1993004507 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f59c40940d0 con 0x7f59d80c47e0 2024-09-10T22:44:40.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.409+0000 7f59e3016000 1 Processor -- start 2024-09-10T22:44:40.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.409+0000 7f59dd200640 1 --2- 172.21.15.103:0/1993004507 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f59b80725e0 0x7f59b8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.409+0000 7f59e3016000 1 -- start start 2024-09-10T22:44:40.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.409+0000 7f59dd200640 1 --2- 172.21.15.103:0/1993004507 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f59b80725e0 0x7f59b8074aa0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f59cc006fd0 tx=0x7f59cc006b20 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.409+0000 7f59e3016000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 0x563f5aa7bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.409+0000 7f59e3016000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa7c2f0 0x563f5aa2f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.409+0000 7f59e3016000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa2fe10 0x563f5aa301f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.409+0000 7f59e3016000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563f5a9503f0 con 0x563f5aa7b9d0 2024-09-10T22:44:40.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.409+0000 7f59e3016000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563f5a88db20 con 0x563f5aa2fe10 2024-09-10T22:44:40.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.409+0000 7f59e3016000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563f5a87cf50 con 0x563f5aa7c2f0 2024-09-10T22:44:40.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.409+0000 7f59dd200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 0x563f5aa7bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59dd200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 0x563f5aa7bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51664/0 (socket says 172.21.15.103:51664) 2024-09-10T22:44:40.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59dd200640 1 -- 172.21.15.103:0/3581442385 learned_addr learned my addr 172.21.15.103:0/3581442385 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:40.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59ddc00640 1 --2- 172.21.15.103:0/3581442385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa2fe10 0x563f5aa301f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59d7e00640 1 --2- 172.21.15.103:0/3581442385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa7c2f0 0x563f5aa2f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59dd200640 1 -- 172.21.15.103:0/3581442385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa7c2f0 msgr2=0x563f5aa2f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59dd200640 1 --2- 172.21.15.103:0/3581442385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa7c2f0 0x563f5aa2f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59dd200640 1 -- 172.21.15.103:0/3581442385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa2fe10 msgr2=0x563f5aa301f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59dd200640 1 --2- 172.21.15.103:0/3581442385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa2fe10 0x563f5aa301f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59dd200640 1 -- 172.21.15.103:0/3581442385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f5a844590 con 0x563f5aa7b9d0 2024-09-10T22:44:40.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59dd200640 1 --2- 172.21.15.103:0/3581442385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 0x563f5aa7bdb0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f59cc001820 tx=0x7f59cc003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a45a48a9b7f4d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59c9600640 1 -- 172.21.15.103:0/3581442385 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59cc022070 con 0x563f5aa7b9d0 2024-09-10T22:44:40.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59c9600640 1 -- 172.21.15.103:0/3581442385 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59cc012bc0 con 0x563f5aa7b9d0 2024-09-10T22:44:40.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59c9600640 1 -- 172.21.15.103:0/3581442385 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59cc016070 con 0x563f5aa7b9d0 2024-09-10T22:44:40.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59e3016000 1 -- 172.21.15.103:0/3581442385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 msgr2=0x563f5aa7bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59e3016000 1 --2- 172.21.15.103:0/3581442385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 0x563f5aa7bdb0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f59cc001820 tx=0x7f59cc003f90 comp rx=0 tx=0).stop 2024-09-10T22:44:40.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59e3016000 1 -- 172.21.15.103:0/3581442385 shutdown_connections 2024-09-10T22:44:40.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59e3016000 1 --2- 172.21.15.103:0/3581442385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa2fe10 0x563f5aa301f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59e3016000 1 --2- 172.21.15.103:0/3581442385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa7c2f0 0x563f5aa2f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59e3016000 1 --2- 172.21.15.103:0/3581442385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 0x563f5aa7bdb0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59e3016000 1 -- 172.21.15.103:0/3581442385 >> 172.21.15.103:0/3581442385 conn(0x563f5a919130 msgr2=0x563f5aa5ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59e3016000 1 -- 172.21.15.103:0/3581442385 shutdown_connections 2024-09-10T22:44:40.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59e3016000 1 -- 172.21.15.103:0/3581442385 wait complete. 2024-09-10T22:44:40.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59e3016000 1 -- start start 2024-09-10T22:44:40.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59e3016000 1 Processor -- start 2024-09-10T22:44:40.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59e3016000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa2fe10 0x563f5aa31240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59e3016000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa7b9d0 0x563f5aa31780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59e3016000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa7c2f0 0x563f5aa31cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59e3016000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563f5a8175d0 con 0x563f5aa2fe10 2024-09-10T22:44:40.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59e3016000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563f5a880d60 con 0x563f5aa7b9d0 2024-09-10T22:44:40.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59e3016000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563f5a823500 con 0x563f5aa7c2f0 2024-09-10T22:44:40.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59e3016000 10 client.0 _ll_register_callbacks cb 0x563f5a827810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:40.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59dd200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa2fe10 0x563f5aa31240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59dd200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa2fe10 0x563f5aa31240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51670/0 (socket says 172.21.15.103:51670) 2024-09-10T22:44:40.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59dd200640 1 -- 172.21.15.103:0/324673937 learned_addr learned my addr 172.21.15.103:0/324673937 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:40.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59ddc00640 1 --2- 172.21.15.103:0/324673937 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa7c2f0 0x563f5aa31cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.413+0000 7f59d7e00640 1 --2- 172.21.15.103:0/324673937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa7b9d0 0x563f5aa31780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59dd200640 1 -- 172.21.15.103:0/324673937 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa7c2f0 msgr2=0x563f5aa31cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59dd200640 1 --2- 172.21.15.103:0/324673937 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa7c2f0 0x563f5aa31cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59dd200640 1 -- 172.21.15.103:0/324673937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa7b9d0 msgr2=0x563f5aa31780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59dd200640 1 --2- 172.21.15.103:0/324673937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa7b9d0 0x563f5aa31780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59dd200640 1 -- 172.21.15.103:0/324673937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f5a81b170 con 0x563f5aa2fe10 2024-09-10T22:44:40.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59dd200640 1 --2- 172.21.15.103:0/324673937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa2fe10 0x563f5aa31240 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f59cc001ec0 tx=0x7f59cc013c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c41a1e38109621 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59be000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:40.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59be000640 1 -- 172.21.15.103:0/324673937 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59cc016070 con 0x563f5aa2fe10 2024-09-10T22:44:40.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59be000640 1 -- 172.21.15.103:0/324673937 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f59cc006c30 con 0x563f5aa2fe10 2024-09-10T22:44:40.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 1 -- 172.21.15.103:0/324673937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563f5a8150f0 con 0x563f5aa2fe10 2024-09-10T22:44:40.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59be000640 1 -- 172.21.15.103:0/324673937 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f59cc038050 con 0x563f5aa2fe10 2024-09-10T22:44:40.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 10 client.7668 fetch_fsmap learned FSMap version 94 2024-09-10T22:44:40.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 1 -- 172.21.15.103:0/324673937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x563f5a901ef0 con 0x563f5aa2fe10 2024-09-10T22:44:40.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59be000640 1 -- 172.21.15.103:0/324673937 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563f5a8150f0 con 0x563f5aa2fe10 2024-09-10T22:44:40.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59be000640 1 -- 172.21.15.103:0/324673937 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 94) ==== 3542+0+0 (secure 0 0 0) 0x7f59cc03b020 con 0x563f5aa2fe10 2024-09-10T22:44:40.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 10 client.7668 fetch_fsmap finished waiting for FSMap version 94 2024-09-10T22:44:40.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 10 client.7668 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:44:40.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 20 client.7668 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:40.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 1 --2- 172.21.15.103:0/324673937 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x563f5aa8ac70 0x563f5aa8d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 4 client.7668 mds_command: new command op to 7434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:40.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 1 -- 172.21.15.103:0/324673937 --> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f5a88fa70 con 0x563f5aa8ac70 2024-09-10T22:44:40.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59d7e00640 1 --2- 172.21.15.103:0/324673937 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x563f5aa8ac70 0x563f5aa8d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59d7e00640 1 --2- 172.21.15.103:0/324673937 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x563f5aa8ac70 0x563f5aa8d060 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac9be21ea9c7b68f server_cookie=d4d1a639ccad258e in_seq=0 out_seq=0 2024-09-10T22:44:40.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59be000640 10 client.7668 ms_handle_connect on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:40.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59be000640 1 -- 172.21.15.103:0/324673937 <== mds.0 v2:172.21.15.103:6833/187627880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563f5a88fa70 con 0x563f5aa8ac70 2024-09-10T22:44:40.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59be000640 10 client.7668 handle_command_reply: tid=0 2024-09-10T22:44:40.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 1 client.7668 shutdown 2024-09-10T22:44:40.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 1 -- 172.21.15.103:0/324673937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa2fe10 msgr2=0x563f5aa31240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 1 --2- 172.21.15.103:0/324673937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa2fe10 0x563f5aa31240 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f59cc001ec0 tx=0x7f59cc013c00 comp rx=0 tx=0).stop 2024-09-10T22:44:40.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 1 -- 172.21.15.103:0/324673937 shutdown_connections 2024-09-10T22:44:40.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 1 --2- 172.21.15.103:0/324673937 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x563f5aa8ac70 0x563f5aa8d060 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 1 --2- 172.21.15.103:0/324673937 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa7c2f0 0x563f5aa31cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 1 --2- 172.21.15.103:0/324673937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa7b9d0 0x563f5aa31780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59be000640 0 client.7668 ms_handle_reset on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:40.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 1 --2- 172.21.15.103:0/324673937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa2fe10 0x563f5aa31240 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 1 -- 172.21.15.103:0/324673937 >> 172.21.15.103:0/324673937 conn(0x563f5a919130 msgr2=0x563f5aa2efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 1 -- 172.21.15.103:0/324673937 shutdown_connections 2024-09-10T22:44:40.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 1 -- 172.21.15.103:0/324673937 wait complete. 2024-09-10T22:44:40.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.417+0000 7f59e3016000 20 client.7668 trim_cache size 0 max 16384 2024-09-10T22:44:40.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59e3016000 1 Processor -- start 2024-09-10T22:44:40.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59e3016000 1 -- start start 2024-09-10T22:44:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59e3016000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa2fe10 0x563f5aaed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59e3016000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 0x563f5aaed900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59e3016000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa7c2f0 0x563f5aaede40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59e3016000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f59d8201c40 con 0x563f5aa7b9d0 2024-09-10T22:44:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59e3016000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f59d8200ea0 con 0x563f5aa7c2f0 2024-09-10T22:44:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59e3016000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f59d8201570 con 0x563f5aa2fe10 2024-09-10T22:44:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59d7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 0x563f5aaed900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59d7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 0x563f5aaed900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51686/0 (socket says 172.21.15.103:51686) 2024-09-10T22:44:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59d7e00640 1 -- 172.21.15.103:0/4288929236 learned_addr learned my addr 172.21.15.103:0/4288929236 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59dd200640 1 --2- 172.21.15.103:0/4288929236 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa2fe10 0x563f5aaed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59ddc00640 1 --2- 172.21.15.103:0/4288929236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa7c2f0 0x563f5aaede40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59d7e00640 1 -- 172.21.15.103:0/4288929236 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa2fe10 msgr2=0x563f5aaed3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59d7e00640 1 --2- 172.21.15.103:0/4288929236 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa2fe10 0x563f5aaed3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59d7e00640 1 -- 172.21.15.103:0/4288929236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa7c2f0 msgr2=0x563f5aaede40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59d7e00640 1 --2- 172.21.15.103:0/4288929236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa7c2f0 0x563f5aaede40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59d7e00640 1 -- 172.21.15.103:0/4288929236 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f5a8d8d90 con 0x563f5aa7b9d0 2024-09-10T22:44:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59d7e00640 1 --2- 172.21.15.103:0/4288929236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 0x563f5aaed900 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f59c4019000 tx=0x7f59c40638f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f463bcf5b0ebdd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59c8c00640 1 -- 172.21.15.103:0/4288929236 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c4092530 con 0x563f5aa7b9d0 2024-09-10T22:44:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59c8c00640 1 -- 172.21.15.103:0/4288929236 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59c404c030 con 0x563f5aa7b9d0 2024-09-10T22:44:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.437+0000 7f59c8c00640 1 -- 172.21.15.103:0/4288929236 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c405b130 con 0x563f5aa7b9d0 2024-09-10T22:44:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 -- 172.21.15.103:0/4288929236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 msgr2=0x563f5aaed900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 --2- 172.21.15.103:0/4288929236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 0x563f5aaed900 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f59c4019000 tx=0x7f59c40638f0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 -- 172.21.15.103:0/4288929236 shutdown_connections 2024-09-10T22:44:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 --2- 172.21.15.103:0/4288929236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa7c2f0 0x563f5aaede40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 --2- 172.21.15.103:0/4288929236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 0x563f5aaed900 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 --2- 172.21.15.103:0/4288929236 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa2fe10 0x563f5aaed3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 -- 172.21.15.103:0/4288929236 >> 172.21.15.103:0/4288929236 conn(0x563f5a919130 msgr2=0x563f5aa2f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 -- 172.21.15.103:0/4288929236 shutdown_connections 2024-09-10T22:44:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 -- 172.21.15.103:0/4288929236 wait complete. 2024-09-10T22:44:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 -- start start 2024-09-10T22:44:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 Processor -- start 2024-09-10T22:44:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa2fe10 0x563f5aa91a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 0x563f5aa91fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa7c2f0 0x563f5aaad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563f5a885390 con 0x563f5aa7b9d0 2024-09-10T22:44:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f59d8200080 con 0x563f5aa7c2f0 2024-09-10T22:44:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563f5a88c8f0 con 0x563f5aa2fe10 2024-09-10T22:44:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 10 client.0 _ll_register_callbacks cb 0x7f59c0004810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:40.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59d7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 0x563f5aa91fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59d7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 0x563f5aa91fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51700/0 (socket says 172.21.15.103:51700) 2024-09-10T22:44:40.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59d7e00640 1 -- 172.21.15.103:0/4236258826 learned_addr learned my addr 172.21.15.103:0/4236258826 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:40.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59d7e00640 1 -- 172.21.15.103:0/4236258826 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa2fe10 msgr2=0x563f5aa91a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59d7e00640 1 --2- 172.21.15.103:0/4236258826 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa2fe10 0x563f5aa91a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59d7e00640 1 -- 172.21.15.103:0/4236258826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa7c2f0 msgr2=0x563f5aaad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:40.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59d7e00640 1 --2- 172.21.15.103:0/4236258826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa7c2f0 0x563f5aaad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59d7e00640 1 -- 172.21.15.103:0/4236258826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f5a843a90 con 0x563f5aa7b9d0 2024-09-10T22:44:40.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59d7e00640 1 --2- 172.21.15.103:0/4236258826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 0x563f5aa91fb0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f59c405c130 tx=0x7f59c405b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6020146ab3ba1121 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59be000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:40.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59be000640 1 -- 172.21.15.103:0/4236258826 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c4068090 con 0x563f5aa7b9d0 2024-09-10T22:44:40.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59be000640 1 -- 172.21.15.103:0/4236258826 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f59c405e120 con 0x563f5aa7b9d0 2024-09-10T22:44:40.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 -- 172.21.15.103:0/4236258826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59c404c030 con 0x563f5aa7b9d0 2024-09-10T22:44:40.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59be000640 1 -- 172.21.15.103:0/4236258826 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f59c405e320 con 0x563f5aa7b9d0 2024-09-10T22:44:40.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 10 client.7674 fetch_fsmap learned FSMap version 94 2024-09-10T22:44:40.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 -- 172.21.15.103:0/4236258826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x563f5a822050 con 0x563f5aa7b9d0 2024-09-10T22:44:40.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59be000640 1 -- 172.21.15.103:0/4236258826 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59c404c030 con 0x563f5aa7b9d0 2024-09-10T22:44:40.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59be000640 1 -- 172.21.15.103:0/4236258826 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 94) ==== 3542+0+0 (secure 0 0 0) 0x7f59c408b020 con 0x563f5aa7b9d0 2024-09-10T22:44:40.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 10 client.7674 fetch_fsmap finished waiting for FSMap version 94 2024-09-10T22:44:40.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 10 client.7674 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:44:40.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 20 client.7674 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:40.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 --2- 172.21.15.103:0/4236258826 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x563f5aaadf40 0x563f5aaf9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 4 client.7674 mds_command: new command op to 7434 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:44:40.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.441+0000 7f59e3016000 1 -- 172.21.15.103:0/4236258826 --> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] -- command(tid 0: {"prefix": "status"}) -- 0x563f5a88b520 con 0x563f5aaadf40 2024-09-10T22:44:40.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59dd200640 1 --2- 172.21.15.103:0/4236258826 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x563f5aaadf40 0x563f5aaf9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59be000640 10 client.7674 ms_handle_connect on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:40.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59dd200640 1 --2- 172.21.15.103:0/4236258826 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x563f5aaadf40 0x563f5aaf9440 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=220422d17303a99a server_cookie=993fdf30fbaeffe7 in_seq=0 out_seq=0 2024-09-10T22:44:40.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59be000640 1 -- 172.21.15.103:0/4236258826 <== mds.0 v2:172.21.15.103:6833/187627880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x563f5a88b520 con 0x563f5aaadf40 2024-09-10T22:44:40.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59be000640 10 client.7674 handle_command_reply: tid=0 2024-09-10T22:44:40.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59e3016000 1 client.7674 shutdown 2024-09-10T22:44:40.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59e3016000 1 -- 172.21.15.103:0/4236258826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 msgr2=0x563f5aa91fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59e3016000 1 --2- 172.21.15.103:0/4236258826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 0x563f5aa91fb0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f59c405c130 tx=0x7f59c405b3e0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59e3016000 1 -- 172.21.15.103:0/4236258826 shutdown_connections 2024-09-10T22:44:40.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59e3016000 1 --2- 172.21.15.103:0/4236258826 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x563f5aaadf40 0x563f5aaf9440 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59e3016000 1 --2- 172.21.15.103:0/4236258826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563f5aa7c2f0 0x563f5aaad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59e3016000 1 --2- 172.21.15.103:0/4236258826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563f5aa7b9d0 0x563f5aa91fb0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59e3016000 1 --2- 172.21.15.103:0/4236258826 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563f5aa2fe10 0x563f5aa91a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59be000640 0 client.7674 ms_handle_reset on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:40.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59e3016000 1 -- 172.21.15.103:0/4236258826 >> 172.21.15.103:0/4236258826 conn(0x563f5a919130 msgr2=0x563f5aa8d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59e3016000 1 -- 172.21.15.103:0/4236258826 shutdown_connections 2024-09-10T22:44:40.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59e3016000 1 -- 172.21.15.103:0/4236258826 wait complete. 2024-09-10T22:44:40.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59e3016000 20 client.7674 trim_cache size 0 max 16384 2024-09-10T22:44:40.453 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:44:40.453 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:44:40.453 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-10T22:44:40.453 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7434, 2024-09-10T22:44:40.453 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:44:40.453 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:44:40.453 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:44:40.454 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 16.258544981, 2024-09-10T22:44:40.454 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 94, 2024-09-10T22:44:40.454 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 94, 2024-09-10T22:44:40.454 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 94, 2024-09-10T22:44:40.454 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 20.787096871999999 2024-09-10T22:44:40.454 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:44:40.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59dfc00640 1 -- 172.21.15.103:0/1993004507 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f59b80725e0 msgr2=0x7f59b8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59dfc00640 1 --2- 172.21.15.103:0/1993004507 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f59b80725e0 0x7f59b8074aa0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f59cc006fd0 tx=0x7f59cc006b20 comp rx=0 tx=0).stop 2024-09-10T22:44:40.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59dfc00640 1 -- 172.21.15.103:0/1993004507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59d80c47e0 msgr2=0x7f59d80c4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59dfc00640 1 --2- 172.21.15.103:0/1993004507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59d80c47e0 0x7f59d80c4c60 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f59c4011ae0 tx=0x7f59c400f3c0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59dfc00640 1 -- 172.21.15.103:0/1993004507 shutdown_connections 2024-09-10T22:44:40.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59dfc00640 1 --2- 172.21.15.103:0/1993004507 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f59b80725e0 0x7f59b8074aa0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59dfc00640 1 --2- 172.21.15.103:0/1993004507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59d80affd0 0x7f59d80b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59dfc00640 1 --2- 172.21.15.103:0/1993004507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59d80c47e0 0x7f59d80c4c60 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59dfc00640 1 --2- 172.21.15.103:0/1993004507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59c0006330 0x7f59d8158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59dfc00640 1 -- 172.21.15.103:0/1993004507 >> 172.21.15.103:0/1993004507 conn(0x7f59d806cc00 msgr2=0x7f59d8159940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59dfc00640 1 -- 172.21.15.103:0/1993004507 shutdown_connections 2024-09-10T22:44:40.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.445+0000 7f59dfc00640 1 -- 172.21.15.103:0/1993004507 wait complete. 2024-09-10T22:44:40.468 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:44:40.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.605+0000 7f61ba800640 1 -- 172.21.15.103:0/2337956097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61b40cf790 msgr2=0x7f61b40cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.605+0000 7f61ba800640 1 --2- 172.21.15.103:0/2337956097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61b40cf790 0x7f61b40cfc20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009c80 tx=0x7f61ac01cd10 comp rx=0 tx=0).stop 2024-09-10T22:44:40.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.605+0000 7f61ba800640 1 -- 172.21.15.103:0/2337956097 shutdown_connections 2024-09-10T22:44:40.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.605+0000 7f61ba800640 1 --2- 172.21.15.103:0/2337956097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61b40cf790 0x7f61b40cfc20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.605+0000 7f61ba800640 1 --2- 172.21.15.103:0/2337956097 >> v2:172.21.15.131:3300/0 conn(0x7f61b40cc120 0x7f61b40aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.605+0000 7f61ba800640 1 -- 172.21.15.103:0/2337956097 >> 172.21.15.103:0/2337956097 conn(0x7f61b406cc00 msgr2=0x7f61b406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.605+0000 7f61ba800640 1 -- 172.21.15.103:0/2337956097 shutdown_connections 2024-09-10T22:44:40.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.605+0000 7f61ba800640 1 -- 172.21.15.103:0/2337956097 wait complete. 2024-09-10T22:44:40.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61ba800640 1 Processor -- start 2024-09-10T22:44:40.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61ba800640 1 -- start start 2024-09-10T22:44:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61ba800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61b40cc120 0x7f61b4147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61ba800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61b40cf790 0x7f61b4163ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61ba800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61b415c970 0x7f61b41fa980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61ba800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f61b4168ba0 con 0x7f61b40cf790 2024-09-10T22:44:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61ba800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f61b4168a20 con 0x7f61b415c970 2024-09-10T22:44:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61ba800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f61b4168d20 con 0x7f61b40cc120 2024-09-10T22:44:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61b2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61b40cf790 0x7f61b4163ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61b2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61b40cf790 0x7f61b4163ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51704/0 (socket says 172.21.15.103:51704) 2024-09-10T22:44:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61b2a00640 1 -- 172.21.15.103:0/1995240102 learned_addr learned my addr 172.21.15.103:0/1995240102 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61b3e00640 1 --2- 172.21.15.103:0/1995240102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61b415c970 0x7f61b41fa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61b3400640 1 --2- 172.21.15.103:0/1995240102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61b40cc120 0x7f61b4147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61b2a00640 1 -- 172.21.15.103:0/1995240102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61b40cc120 msgr2=0x7f61b4147cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61b2a00640 1 --2- 172.21.15.103:0/1995240102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61b40cc120 0x7f61b4147cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61b2a00640 1 -- 172.21.15.103:0/1995240102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61b415c970 msgr2=0x7f61b41fa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61b2a00640 1 --2- 172.21.15.103:0/1995240102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61b415c970 0x7f61b41fa980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61b2a00640 1 -- 172.21.15.103:0/1995240102 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b4164020 con 0x7f61b40cf790 2024-09-10T22:44:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61b2a00640 1 --2- 172.21.15.103:0/1995240102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61b40cf790 0x7f61b4163ae0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f61a000c3c0 tx=0x7f61a000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61ab400640 1 -- 172.21.15.103:0/1995240102 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a00052d0 con 0x7f61b40cf790 2024-09-10T22:44:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61ab400640 1 -- 172.21.15.103:0/1995240102 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61a0007020 con 0x7f61b40cf790 2024-09-10T22:44:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61ab400640 1 -- 172.21.15.103:0/1995240102 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a0007470 con 0x7f61b40cf790 2024-09-10T22:44:40.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61ba800640 1 -- 172.21.15.103:0/1995240102 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b41faec0 con 0x7f61b40cf790 2024-09-10T22:44:40.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61ba800640 1 -- 172.21.15.103:0/1995240102 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b41fb470 con 0x7f61b40cf790 2024-09-10T22:44:40.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.609+0000 7f61ba800640 1 -- 172.21.15.103:0/1995240102 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b40cfc20 con 0x7f61b40cf790 2024-09-10T22:44:40.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.613+0000 7f61ab400640 1 -- 172.21.15.103:0/1995240102 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f61a00067e0 con 0x7f61b40cf790 2024-09-10T22:44:40.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.613+0000 7f61ab400640 1 --2- 172.21.15.103:0/1995240102 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f61940725e0 0x7f6194074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:40.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.613+0000 7f61ab400640 1 -- 172.21.15.103:0/1995240102 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f61a00929d0 con 0x7f61b40cf790 2024-09-10T22:44:40.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.613+0000 7f61b3400640 1 --2- 172.21.15.103:0/1995240102 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f61940725e0 0x7f6194074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:40.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.613+0000 7f61b3400640 1 --2- 172.21.15.103:0/1995240102 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f61940725e0 0x7f6194074aa0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009b70 tx=0x7f61a40091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:40.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.617+0000 7f61ab400640 1 -- 172.21.15.103:0/1995240102 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f61a005de10 con 0x7f61b40cf790 2024-09-10T22:44:40.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.813+0000 7f61ba800640 1 -- 172.21.15.103:0/1995240102 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61b4075df0 con 0x7f61b40cf790 2024-09-10T22:44:40.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.813+0000 7f61ab400640 1 -- 172.21.15.103:0/1995240102 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5272 (secure 0 0 0) 0x7f61a0001090 con 0x7f61b40cf790 2024-09-10T22:44:40.818 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:44:40.818 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":94,"btime":"2024-09-10T22:44:39:256252+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2586411857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2586411857},{"type":"v1","addr":"172.21.15.131:6837","nonce":2586411857}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:44:23.558537+0000","modified":"2024-09-10T22:44:39.256244+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7434,"mds_1":7428,"mds_2":7048},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7048":{"gid":7048,"name":"d","rank":2,"incarnation":93,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6836/1622106563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1622106563},{"type":"v1","addr":"172.21.15.131:6836","nonce":1622106563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":1,"incarnation":91,"state":"up:active","state_seq":6,"addr":"172.21.15.103:6834/3251348074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3251348074},{"type":"v1","addr":"172.21.15.103:6834","nonce":3251348074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7434":{"gid":7434,"name":"c","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/187627880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":187627880},{"type":"v1","addr":"172.21.15.103:6835","nonce":187627880}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7434,"qdb_cluster":[7048,7428,7434]},"id":6}]} 2024-09-10T22:44:40.818 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 94 2024-09-10T22:44:40.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.817+0000 7f61ba800640 1 -- 172.21.15.103:0/1995240102 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f61940725e0 msgr2=0x7f6194074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.817+0000 7f61ba800640 1 --2- 172.21.15.103:0/1995240102 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f61940725e0 0x7f6194074aa0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009b70 tx=0x7f61a40091e0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.817+0000 7f61ba800640 1 -- 172.21.15.103:0/1995240102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61b40cf790 msgr2=0x7f61b4163ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.817+0000 7f61ba800640 1 --2- 172.21.15.103:0/1995240102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61b40cf790 0x7f61b4163ae0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f61a000c3c0 tx=0x7f61a000c880 comp rx=0 tx=0).stop 2024-09-10T22:44:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.817+0000 7f61ba800640 1 -- 172.21.15.103:0/1995240102 shutdown_connections 2024-09-10T22:44:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.817+0000 7f61ba800640 1 --2- 172.21.15.103:0/1995240102 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f61940725e0 0x7f6194074aa0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.817+0000 7f61ba800640 1 --2- 172.21.15.103:0/1995240102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61b415c970 0x7f61b41fa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.817+0000 7f61ba800640 1 --2- 172.21.15.103:0/1995240102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61b40cf790 0x7f61b4163ae0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.817+0000 7f61ba800640 1 --2- 172.21.15.103:0/1995240102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61b40cc120 0x7f61b4147cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.817+0000 7f61ba800640 1 -- 172.21.15.103:0/1995240102 >> 172.21.15.103:0/1995240102 conn(0x7f61b406cc00 msgr2=0x7f61b40ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.817+0000 7f61ba800640 1 -- 172.21.15.103:0/1995240102 shutdown_connections 2024-09-10T22:44:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:40.817+0000 7f61ba800640 1 -- 172.21.15.103:0/1995240102 wait complete. 2024-09-10T22:44:40.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:40.840 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-10T22:44:40.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:40.869 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-10T22:44:40.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:40.927 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2024-09-10T22:44:40.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:40.982 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2024-09-10T22:44:41.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:41.038 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2024-09-10T22:44:41.090 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:44:41.288 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:44:41.289 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:44:41.289 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:44:43.290 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:44:43.456 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:44:43.456 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:44:43.456 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:44:45.457 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:44:45.624 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:44:45.624 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:44:45.625 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:44:47.249 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:44:47.253 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:44:47.626 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:44:47.793 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:44:47.794 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:44:47.794 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:44:49.795 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:44:49.959 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:44:49.960 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:44:49.960 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:44:51.962 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:44:52.127 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:44:52.127 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:44:52.127 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:44:52.128 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:44:52.283 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-10T22:44:52.284 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:44:52.284 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:44:54.286 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:44:54.453 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-10T22:44:54.454 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:44:54.454 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:44:56.455 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:44:56.621 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2024-09-10T22:44:56.622 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-10T22:44:56.622 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:44:56.622 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-10T22:44:56.790 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:44:56.790 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:44:56.791 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:44:56.791 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2024-09-10T22:44:56.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.929+0000 7fa847c00640 1 -- 172.21.15.103:0/2784897044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa840072c10 msgr2=0x7fa840157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:56.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.929+0000 7fa847c00640 1 --2- 172.21.15.103:0/2784897044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa840072c10 0x7fa840157090 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa83800acd0 tx=0x7fa83801def0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.929+0000 7fa847c00640 1 -- 172.21.15.103:0/2784897044 shutdown_connections 2024-09-10T22:44:56.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.929+0000 7fa847c00640 1 --2- 172.21.15.103:0/2784897044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa840072c10 0x7fa840157090 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.929+0000 7fa847c00640 1 --2- 172.21.15.103:0/2784897044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8400cf260 0x7fa8400b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.929+0000 7fa847c00640 1 -- 172.21.15.103:0/2784897044 >> 172.21.15.103:0/2784897044 conn(0x7fa84006cc00 msgr2=0x7fa84006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:56.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.929+0000 7fa847c00640 1 -- 172.21.15.103:0/2784897044 shutdown_connections 2024-09-10T22:44:56.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.929+0000 7fa847c00640 1 -- 172.21.15.103:0/2784897044 wait complete. 2024-09-10T22:44:56.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa847c00640 1 Processor -- start 2024-09-10T22:44:56.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa847c00640 1 -- start start 2024-09-10T22:44:56.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa847c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa840072c10 0x7fa8400addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:56.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa847c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8400b3150 0x7fa840152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:56.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa847c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8400cf260 0x7fa84014e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:56.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa847c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa84006e960 con 0x7fa8400cf260 2024-09-10T22:44:56.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa847c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa84006e7e0 con 0x7fa8400b3150 2024-09-10T22:44:56.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa847c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa84006eae0 con 0x7fa840072c10 2024-09-10T22:44:56.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa845c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8400cf260 0x7fa84014e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:56.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa845c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8400cf260 0x7fa84014e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40226/0 (socket says 172.21.15.103:40226) 2024-09-10T22:44:56.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa845c00640 1 -- 172.21.15.103:0/1359660194 learned_addr learned my addr 172.21.15.103:0/1359660194 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:56.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa845200640 1 --2- 172.21.15.103:0/1359660194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa840072c10 0x7fa8400addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:56.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa837e00640 1 --2- 172.21.15.103:0/1359660194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8400b3150 0x7fa840152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:56.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa845c00640 1 -- 172.21.15.103:0/1359660194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa840072c10 msgr2=0x7fa8400addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:56.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa845c00640 1 --2- 172.21.15.103:0/1359660194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa840072c10 0x7fa8400addc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa845c00640 1 -- 172.21.15.103:0/1359660194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8400b3150 msgr2=0x7fa840152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:56.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa845c00640 1 --2- 172.21.15.103:0/1359660194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8400b3150 0x7fa840152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa845c00640 1 -- 172.21.15.103:0/1359660194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8401fa5b0 con 0x7fa8400cf260 2024-09-10T22:44:56.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa845c00640 1 --2- 172.21.15.103:0/1359660194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8400cf260 0x7fa84014e3c0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fa83801bb20 tx=0x7fa838003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:56.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa83d600640 1 -- 172.21.15.103:0/1359660194 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8380b3040 con 0x7fa8400cf260 2024-09-10T22:44:56.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa83d600640 1 -- 172.21.15.103:0/1359660194 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa838004d40 con 0x7fa8400cf260 2024-09-10T22:44:56.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa83d600640 1 -- 172.21.15.103:0/1359660194 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8380ae830 con 0x7fa8400cf260 2024-09-10T22:44:56.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa847c00640 1 -- 172.21.15.103:0/1359660194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8401fa890 con 0x7fa8400cf260 2024-09-10T22:44:56.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.933+0000 7fa847c00640 1 -- 172.21.15.103:0/1359660194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8401fae50 con 0x7fa8400cf260 2024-09-10T22:44:56.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.937+0000 7fa83d600640 1 -- 172.21.15.103:0/1359660194 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa83800b040 con 0x7fa8400cf260 2024-09-10T22:44:56.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.937+0000 7fa83d600640 1 --2- 172.21.15.103:0/1359660194 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa81c0725e0 0x7fa81c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:56.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.937+0000 7fa84af8b000 1 Processor -- start 2024-09-10T22:44:56.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.937+0000 7fa83d600640 1 -- 172.21.15.103:0/1359660194 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fa8380be070 con 0x7fa8400cf260 2024-09-10T22:44:56.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.937+0000 7fa84af8b000 1 -- start start 2024-09-10T22:44:56.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.937+0000 7fa845200640 1 --2- 172.21.15.103:0/1359660194 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa81c0725e0 0x7fa81c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:56.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.937+0000 7fa84af8b000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53a1a0 0x55caed53a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:56.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.937+0000 7fa84af8b000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed53aac0 0x55caed4f0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:56.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.937+0000 7fa84af8b000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed4f0bc0 0x55caed4f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:56.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.937+0000 7fa84af8b000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55caed3d8cb0 con 0x55caed4f0bc0 2024-09-10T22:44:56.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.937+0000 7fa84af8b000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55caed2ee310 con 0x55caed53aac0 2024-09-10T22:44:56.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.937+0000 7fa84af8b000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55caed34bb90 con 0x55caed53a1a0 2024-09-10T22:44:56.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.937+0000 7fa845200640 1 --2- 172.21.15.103:0/1359660194 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa81c0725e0 0x7fa81c074aa0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa830009b40 tx=0x7fa8300091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:56.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa845c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed4f0bc0 0x55caed4f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:56.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa845200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53a1a0 0x55caed53a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:56.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa837e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed53aac0 0x55caed4f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:56.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa845200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53a1a0 0x55caed53a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:54846/0 (socket says 172.21.15.103:54846) 2024-09-10T22:44:56.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa845c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed4f0bc0 0x55caed4f0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40236/0 (socket says 172.21.15.103:40236) 2024-09-10T22:44:56.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa845200640 1 -- 172.21.15.103:0/183739189 learned_addr learned my addr 172.21.15.103:0/183739189 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:56.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa845c00640 1 -- 172.21.15.103:0/183739189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53a1a0 msgr2=0x55caed53a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:56.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa845c00640 1 --2- 172.21.15.103:0/183739189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53a1a0 0x55caed53a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa845c00640 1 -- 172.21.15.103:0/183739189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed53aac0 msgr2=0x55caed4f0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:56.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa845c00640 1 --2- 172.21.15.103:0/183739189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed53aac0 0x55caed4f0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa845c00640 1 -- 172.21.15.103:0/183739189 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55caed2efc60 con 0x55caed4f0bc0 2024-09-10T22:44:56.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa845200640 1 --2- 172.21.15.103:0/183739189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53a1a0 0x55caed53a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:44:56.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa845c00640 1 --2- 172.21.15.103:0/183739189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed4f0bc0 0x55caed4f0fa0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fa83812b870 tx=0x7fa8380f42c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f88135aff3ef45d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:56.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa835600640 1 -- 172.21.15.103:0/183739189 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8380bd070 con 0x55caed4f0bc0 2024-09-10T22:44:56.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa835600640 1 -- 172.21.15.103:0/183739189 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8380ae440 con 0x55caed4f0bc0 2024-09-10T22:44:56.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa835600640 1 -- 172.21.15.103:0/183739189 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8380f7af0 con 0x55caed4f0bc0 2024-09-10T22:44:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa84af8b000 1 -- 172.21.15.103:0/183739189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed4f0bc0 msgr2=0x55caed4f0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa84af8b000 1 --2- 172.21.15.103:0/183739189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed4f0bc0 0x55caed4f0fa0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fa83812b870 tx=0x7fa8380f42c0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa84af8b000 1 -- 172.21.15.103:0/183739189 shutdown_connections 2024-09-10T22:44:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa84af8b000 1 --2- 172.21.15.103:0/183739189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed4f0bc0 0x55caed4f0fa0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa84af8b000 1 --2- 172.21.15.103:0/183739189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed53aac0 0x55caed4f0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa84af8b000 1 --2- 172.21.15.103:0/183739189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53a1a0 0x55caed53a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa84af8b000 1 -- 172.21.15.103:0/183739189 >> 172.21.15.103:0/183739189 conn(0x55caed4f6d20 msgr2=0x55caed4eef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa84af8b000 1 -- 172.21.15.103:0/183739189 shutdown_connections 2024-09-10T22:44:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa84af8b000 1 -- 172.21.15.103:0/183739189 wait complete. 2024-09-10T22:44:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa84af8b000 1 -- start start 2024-09-10T22:44:56.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa84af8b000 1 Processor -- start 2024-09-10T22:44:56.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa84af8b000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed4f0bc0 0x55caed541530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:56.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa84af8b000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53a1a0 0x55caed541a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:56.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa84af8b000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed53aac0 0x55caed541fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:56.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa84af8b000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55caed33edd0 con 0x55caed53aac0 2024-09-10T22:44:56.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa84af8b000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55caed33afc0 con 0x55caed4f0bc0 2024-09-10T22:44:56.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa84af8b000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55caed2e04b0 con 0x55caed53a1a0 2024-09-10T22:44:56.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa84af8b000 10 client.0 _ll_register_callbacks cb 0x55caed2be7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:56.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa837e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53a1a0 0x55caed541a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:56.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.941+0000 7fa845c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed53aac0 0x55caed541fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:56.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa845200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed4f0bc0 0x55caed541530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:56.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa845c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed53aac0 0x55caed541fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40238/0 (socket says 172.21.15.103:40238) 2024-09-10T22:44:56.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa845c00640 1 -- 172.21.15.103:0/3324617978 learned_addr learned my addr 172.21.15.103:0/3324617978 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:56.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa845c00640 1 -- 172.21.15.103:0/3324617978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53a1a0 msgr2=0x55caed541a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:56.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa845c00640 1 --2- 172.21.15.103:0/3324617978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53a1a0 0x55caed541a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa845c00640 1 -- 172.21.15.103:0/3324617978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed4f0bc0 msgr2=0x55caed541530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:56.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa845c00640 1 --2- 172.21.15.103:0/3324617978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed4f0bc0 0x55caed541530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa845c00640 1 -- 172.21.15.103:0/3324617978 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55caed2d91f0 con 0x55caed53aac0 2024-09-10T22:44:56.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa845200640 1 --2- 172.21.15.103:0/3324617978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed4f0bc0 0x55caed541530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:44:56.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa845c00640 1 --2- 172.21.15.103:0/3324617978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed53aac0 0x55caed541fb0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fa8380f8310 tx=0x7fa838005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e8a0a8eb78661e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:56.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa82e000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:56.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa82e000640 1 -- 172.21.15.103:0/3324617978 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83811d030 con 0x55caed53aac0 2024-09-10T22:44:56.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 1 -- 172.21.15.103:0/3324617978 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55caed2d3330 con 0x55caed53aac0 2024-09-10T22:44:56.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa82e000640 1 -- 172.21.15.103:0/3324617978 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fa83812d0c0 con 0x55caed53aac0 2024-09-10T22:44:56.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa82e000640 1 -- 172.21.15.103:0/3324617978 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7fa83812b050 con 0x55caed53aac0 2024-09-10T22:44:56.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 10 client.7689 fetch_fsmap learned FSMap version 96 2024-09-10T22:44:56.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 1 -- 172.21.15.103:0/3324617978 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x55caed2bffa0 con 0x55caed53aac0 2024-09-10T22:44:56.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa82e000640 1 -- 172.21.15.103:0/3324617978 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55caed2d3330 con 0x55caed53aac0 2024-09-10T22:44:56.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa82e000640 1 -- 172.21.15.103:0/3324617978 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 96) ==== 3554+0+0 (secure 0 0 0) 0x7fa838101340 con 0x55caed53aac0 2024-09-10T22:44:56.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 10 client.7689 fetch_fsmap finished waiting for FSMap version 96 2024-09-10T22:44:56.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 10 client.7689 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-10T22:44:56.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 20 client.7689 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:56.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 1 --2- 172.21.15.103:0/3324617978 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55caed549900 0x55caed54bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:56.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 4 client.7689 mds_command: new command op to 7434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:56.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 1 -- 172.21.15.103:0/3324617978 --> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55caed34dae0 con 0x55caed549900 2024-09-10T22:44:56.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa845200640 1 --2- 172.21.15.103:0/3324617978 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55caed549900 0x55caed54bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:56.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa845200640 1 --2- 172.21.15.103:0/3324617978 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55caed549900 0x55caed54bcf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff68cd5ff56755df server_cookie=c36ec9252ef76ca6 in_seq=0 out_seq=0 2024-09-10T22:44:56.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa82e000640 10 client.7689 ms_handle_connect on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:56.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa82e000640 1 -- 172.21.15.103:0/3324617978 <== mds.0 v2:172.21.15.103:6833/187627880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55caed34dae0 con 0x55caed549900 2024-09-10T22:44:56.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa82e000640 10 client.7689 handle_command_reply: tid=0 2024-09-10T22:44:56.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 1 client.7689 shutdown 2024-09-10T22:44:56.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 1 -- 172.21.15.103:0/3324617978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed53aac0 msgr2=0x55caed541fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:56.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 1 --2- 172.21.15.103:0/3324617978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed53aac0 0x55caed541fb0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fa8380f8310 tx=0x7fa838005e20 comp rx=0 tx=0).stop 2024-09-10T22:44:56.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 1 -- 172.21.15.103:0/3324617978 shutdown_connections 2024-09-10T22:44:56.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 1 --2- 172.21.15.103:0/3324617978 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55caed549900 0x55caed54bcf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 1 --2- 172.21.15.103:0/3324617978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed53aac0 0x55caed541fb0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 1 --2- 172.21.15.103:0/3324617978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53a1a0 0x55caed541a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 1 --2- 172.21.15.103:0/3324617978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed4f0bc0 0x55caed541530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 1 -- 172.21.15.103:0/3324617978 >> 172.21.15.103:0/3324617978 conn(0x55caed4f6d20 msgr2=0x55caed4eef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:56.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa82e000640 0 client.7689 ms_handle_reset on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:56.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 1 -- 172.21.15.103:0/3324617978 shutdown_connections 2024-09-10T22:44:56.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 1 -- 172.21.15.103:0/3324617978 wait complete. 2024-09-10T22:44:56.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.945+0000 7fa84af8b000 20 client.7689 trim_cache size 0 max 16384 2024-09-10T22:44:56.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.961+0000 7fa84af8b000 1 Processor -- start 2024-09-10T22:44:56.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.961+0000 7fa84af8b000 1 -- start start 2024-09-10T22:44:56.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.961+0000 7fa84af8b000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed4f0bc0 0x55caed5aba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:56.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.961+0000 7fa84af8b000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53a1a0 0x55caed5abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:56.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.961+0000 7fa84af8b000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed53aac0 0x55caed5ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:56.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.961+0000 7fa84af8b000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa8402042b0 con 0x55caed4f0bc0 2024-09-10T22:44:56.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.961+0000 7fa84af8b000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa840203480 con 0x55caed53aac0 2024-09-10T22:44:56.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.961+0000 7fa84af8b000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa840203b80 con 0x55caed53a1a0 2024-09-10T22:44:56.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.961+0000 7fa845200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed4f0bc0 0x55caed5aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:56.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.961+0000 7fa845200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed4f0bc0 0x55caed5aba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40246/0 (socket says 172.21.15.103:40246) 2024-09-10T22:44:56.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.961+0000 7fa845200640 1 -- 172.21.15.103:0/1566487058 learned_addr learned my addr 172.21.15.103:0/1566487058 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.961+0000 7fa845200640 1 -- 172.21.15.103:0/1566487058 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53a1a0 msgr2=0x55caed5abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.961+0000 7fa845200640 1 --2- 172.21.15.103:0/1566487058 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53a1a0 0x55caed5abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.961+0000 7fa845200640 1 -- 172.21.15.103:0/1566487058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed53aac0 msgr2=0x55caed5ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.961+0000 7fa845200640 1 --2- 172.21.15.103:0/1566487058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed53aac0 0x55caed5ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.961+0000 7fa845200640 1 -- 172.21.15.103:0/1566487058 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55caed398660 con 0x55caed4f0bc0 2024-09-10T22:44:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa845200640 1 --2- 172.21.15.103:0/1566487058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed4f0bc0 0x55caed5aba20 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fa830003900 tx=0x7fa830014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1680aa785c3410 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa834c00640 1 -- 172.21.15.103:0/1566487058 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa830030620 con 0x55caed4f0bc0 2024-09-10T22:44:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa834c00640 1 -- 172.21.15.103:0/1566487058 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8300307c0 con 0x55caed4f0bc0 2024-09-10T22:44:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa834c00640 1 -- 172.21.15.103:0/1566487058 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa830030bb0 con 0x55caed4f0bc0 2024-09-10T22:44:56.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa84af8b000 1 -- 172.21.15.103:0/1566487058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed4f0bc0 msgr2=0x55caed5aba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:56.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa84af8b000 1 --2- 172.21.15.103:0/1566487058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed4f0bc0 0x55caed5aba20 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fa830003900 tx=0x7fa830014000 comp rx=0 tx=0).stop 2024-09-10T22:44:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa84af8b000 1 -- 172.21.15.103:0/1566487058 shutdown_connections 2024-09-10T22:44:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa84af8b000 1 --2- 172.21.15.103:0/1566487058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed53aac0 0x55caed5ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa84af8b000 1 --2- 172.21.15.103:0/1566487058 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53a1a0 0x55caed5abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa84af8b000 1 --2- 172.21.15.103:0/1566487058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed4f0bc0 0x55caed5aba20 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa84af8b000 1 -- 172.21.15.103:0/1566487058 >> 172.21.15.103:0/1566487058 conn(0x55caed4f6d20 msgr2=0x55caed4f1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa84af8b000 1 -- 172.21.15.103:0/1566487058 shutdown_connections 2024-09-10T22:44:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa84af8b000 1 -- 172.21.15.103:0/1566487058 wait complete. 2024-09-10T22:44:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa84af8b000 1 -- start start 2024-09-10T22:44:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa84af8b000 1 Processor -- start 2024-09-10T22:44:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa84af8b000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed4f0bc0 0x55caed550500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa84af8b000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed53a1a0 0x55caed550a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa84af8b000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53aac0 0x55caed550f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa84af8b000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55caed33afc0 con 0x55caed53a1a0 2024-09-10T22:44:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa84af8b000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55caed4f9d40 con 0x55caed4f0bc0 2024-09-10T22:44:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa84af8b000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55caed4f7100 con 0x55caed53aac0 2024-09-10T22:44:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa84af8b000 10 client.0 _ll_register_callbacks cb 0x7fa828001320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa845200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed4f0bc0 0x55caed550500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa837e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed53a1a0 0x55caed550a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa845200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed4f0bc0 0x55caed550500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:54634/0 (socket says 172.21.15.103:54634) 2024-09-10T22:44:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa845200640 1 -- 172.21.15.103:0/4000292083 learned_addr learned my addr 172.21.15.103:0/4000292083 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa845c00640 1 --2- 172.21.15.103:0/4000292083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53aac0 0x55caed550f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa845200640 1 -- 172.21.15.103:0/4000292083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53aac0 msgr2=0x55caed550f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa845200640 1 --2- 172.21.15.103:0/4000292083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53aac0 0x55caed550f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa845200640 1 -- 172.21.15.103:0/4000292083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed53a1a0 msgr2=0x55caed550a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa845200640 1 --2- 172.21.15.103:0/4000292083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed53a1a0 0x55caed550a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa845200640 1 -- 172.21.15.103:0/4000292083 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55caed305090 con 0x55caed4f0bc0 2024-09-10T22:44:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa837e00640 1 --2- 172.21.15.103:0/4000292083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed53a1a0 0x55caed550a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:44:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa845200640 1 --2- 172.21.15.103:0/4000292083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed4f0bc0 0x55caed550500 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa830032040 tx=0x7fa830003600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ac3ec83deab3d72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.965+0000 7fa82e000640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-10T22:44:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.969+0000 7fa82e000640 1 -- 172.21.15.103:0/4000292083 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa830030b70 con 0x55caed4f0bc0 2024-09-10T22:44:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.969+0000 7fa82e000640 1 -- 172.21.15.103:0/4000292083 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fa830030d10 con 0x55caed4f0bc0 2024-09-10T22:44:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.969+0000 7fa84af8b000 1 -- 172.21.15.103:0/4000292083 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8300307c0 con 0x55caed4f0bc0 2024-09-10T22:44:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.969+0000 7fa82e000640 1 -- 172.21.15.103:0/4000292083 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7fa830043050 con 0x55caed4f0bc0 2024-09-10T22:44:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.969+0000 7fa84af8b000 10 client.7264 fetch_fsmap learned FSMap version 96 2024-09-10T22:44:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.969+0000 7fa84af8b000 1 -- 172.21.15.103:0/4000292083 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x55caed2d15f0 con 0x55caed4f0bc0 2024-09-10T22:44:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.969+0000 7fa82e000640 1 -- 172.21.15.103:0/4000292083 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8300307c0 con 0x55caed4f0bc0 2024-09-10T22:44:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.969+0000 7fa82e000640 1 -- 172.21.15.103:0/4000292083 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 96) ==== 3554+0+0 (secure 0 0 0) 0x7fa830046020 con 0x55caed4f0bc0 2024-09-10T22:44:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.969+0000 7fa84af8b000 10 client.7264 fetch_fsmap finished waiting for FSMap version 96 2024-09-10T22:44:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.969+0000 7fa84af8b000 10 client.7264 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-10T22:44:56.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.969+0000 7fa84af8b000 20 client.7264 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:56.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.969+0000 7fa84af8b000 1 --2- 172.21.15.103:0/4000292083 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55caed5514c0 0x55caed5518d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:56.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.969+0000 7fa84af8b000 4 client.7264 mds_command: new command op to 7434 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:44:56.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.969+0000 7fa84af8b000 1 -- 172.21.15.103:0/4000292083 --> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55caed349590 con 0x55caed5514c0 2024-09-10T22:44:56.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.969+0000 7fa837e00640 1 --2- 172.21.15.103:0/4000292083 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55caed5514c0 0x55caed5518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:56.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.969+0000 7fa837e00640 1 --2- 172.21.15.103:0/4000292083 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55caed5514c0 0x55caed5518d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9168a1ed931db7d9 server_cookie=8137f0c6fa637cf7 in_seq=0 out_seq=0 2024-09-10T22:44:56.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.969+0000 7fa82e000640 10 client.7264 ms_handle_connect on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:56.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa82e000640 1 -- 172.21.15.103:0/4000292083 <== mds.0 v2:172.21.15.103:6833/187627880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55caed349590 con 0x55caed5514c0 2024-09-10T22:44:56.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa82e000640 10 client.7264 handle_command_reply: tid=0 2024-09-10T22:44:56.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa84af8b000 1 client.7264 shutdown 2024-09-10T22:44:56.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa84af8b000 1 -- 172.21.15.103:0/4000292083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed4f0bc0 msgr2=0x55caed550500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:56.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa84af8b000 1 --2- 172.21.15.103:0/4000292083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed4f0bc0 0x55caed550500 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa830032040 tx=0x7fa830003600 comp rx=0 tx=0).stop 2024-09-10T22:44:56.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa84af8b000 1 -- 172.21.15.103:0/4000292083 shutdown_connections 2024-09-10T22:44:56.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa84af8b000 1 --2- 172.21.15.103:0/4000292083 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55caed5514c0 0x55caed5518d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa84af8b000 1 --2- 172.21.15.103:0/4000292083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55caed53aac0 0x55caed550f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa84af8b000 1 --2- 172.21.15.103:0/4000292083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55caed53a1a0 0x55caed550a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa82e000640 0 client.7264 ms_handle_reset on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:56.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa84af8b000 1 --2- 172.21.15.103:0/4000292083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55caed4f0bc0 0x55caed550500 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa84af8b000 1 -- 172.21.15.103:0/4000292083 >> 172.21.15.103:0/4000292083 conn(0x55caed4f6d20 msgr2=0x55caed4f2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:56.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa84af8b000 1 -- 172.21.15.103:0/4000292083 shutdown_connections 2024-09-10T22:44:56.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa84af8b000 1 -- 172.21.15.103:0/4000292083 wait complete. 2024-09-10T22:44:56.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa84af8b000 20 client.7264 trim_cache size 0 max 16384 2024-09-10T22:44:56.988 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:44:56.988 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:44:56.988 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:44:56.988 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:44:56.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa847c00640 1 -- 172.21.15.103:0/1359660194 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa81c0725e0 msgr2=0x7fa81c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:56.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa847c00640 1 --2- 172.21.15.103:0/1359660194 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa81c0725e0 0x7fa81c074aa0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa830009b40 tx=0x7fa8300091e0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa847c00640 1 -- 172.21.15.103:0/1359660194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8400cf260 msgr2=0x7fa84014e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:56.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa847c00640 1 --2- 172.21.15.103:0/1359660194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8400cf260 0x7fa84014e3c0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fa83801bb20 tx=0x7fa838003f60 comp rx=0 tx=0).stop 2024-09-10T22:44:56.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa847c00640 1 -- 172.21.15.103:0/1359660194 shutdown_connections 2024-09-10T22:44:56.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa847c00640 1 --2- 172.21.15.103:0/1359660194 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa81c0725e0 0x7fa81c074aa0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa847c00640 1 --2- 172.21.15.103:0/1359660194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8400cf260 0x7fa84014e3c0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa847c00640 1 --2- 172.21.15.103:0/1359660194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8400b3150 0x7fa840152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa847c00640 1 --2- 172.21.15.103:0/1359660194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa840072c10 0x7fa8400addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:56.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa847c00640 1 -- 172.21.15.103:0/1359660194 >> 172.21.15.103:0/1359660194 conn(0x7fa84006cc00 msgr2=0x7fa840158750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:56.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.981+0000 7fa847c00640 1 -- 172.21.15.103:0/1359660194 shutdown_connections 2024-09-10T22:44:56.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:56.985+0000 7fa847c00640 1 -- 172.21.15.103:0/1359660194 wait complete. 2024-09-10T22:44:57.006 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:1 flush journal 2024-09-10T22:44:57.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b30600640 1 -- 172.21.15.103:0/4214775041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b280cf790 msgr2=0x7f8b280cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:57.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b30600640 1 --2- 172.21.15.103:0/4214775041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b280cf790 0x7f8b280cfc20 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f8b280744a0 tx=0x7f8b2001ccf0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b30600640 1 -- 172.21.15.103:0/4214775041 shutdown_connections 2024-09-10T22:44:57.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b30600640 1 --2- 172.21.15.103:0/4214775041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b280cf790 0x7f8b280cfc20 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b30600640 1 --2- 172.21.15.103:0/4214775041 >> v2:172.21.15.131:3300/0 conn(0x7f8b280aeb40 0x7f8b28072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b30600640 1 -- 172.21.15.103:0/4214775041 >> 172.21.15.103:0/4214775041 conn(0x7f8b2806cc00 msgr2=0x7f8b2806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:57.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b30600640 1 -- 172.21.15.103:0/4214775041 shutdown_connections 2024-09-10T22:44:57.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b30600640 1 -- 172.21.15.103:0/4214775041 wait complete. 2024-09-10T22:44:57.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b30600640 1 Processor -- start 2024-09-10T22:44:57.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b30600640 1 -- start start 2024-09-10T22:44:57.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b30600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b280aeb40 0x7f8b2813a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b30600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b280cc120 0x7f8b28152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b30600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b280cf790 0x7f8b2815f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b30600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8b28168c40 con 0x7f8b280cc120 2024-09-10T22:44:57.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b30600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8b28168ac0 con 0x7f8b280cf790 2024-09-10T22:44:57.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b30600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8b28168dc0 con 0x7f8b280aeb40 2024-09-10T22:44:57.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b2d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b280cc120 0x7f8b28152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b2d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b280cc120 0x7f8b28152a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40274/0 (socket says 172.21.15.103:40274) 2024-09-10T22:44:57.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.145+0000 7f8b2d200640 1 -- 172.21.15.103:0/1695538862 learned_addr learned my addr 172.21.15.103:0/1695538862 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:57.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.149+0000 7f8b2e600640 1 --2- 172.21.15.103:0/1695538862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b280cf790 0x7f8b2815f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.149+0000 7f8b2dc00640 1 --2- 172.21.15.103:0/1695538862 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b280aeb40 0x7f8b2813a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.149+0000 7f8b2d200640 1 -- 172.21.15.103:0/1695538862 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b280aeb40 msgr2=0x7f8b2813a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:57.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.149+0000 7f8b2d200640 1 --2- 172.21.15.103:0/1695538862 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b280aeb40 0x7f8b2813a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.149+0000 7f8b2d200640 1 -- 172.21.15.103:0/1695538862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b280cf790 msgr2=0x7f8b2815f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:57.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.149+0000 7f8b2d200640 1 --2- 172.21.15.103:0/1695538862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b280cf790 0x7f8b2815f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.149+0000 7f8b2d200640 1 -- 172.21.15.103:0/1695538862 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b281f90b0 con 0x7f8b280cc120 2024-09-10T22:44:57.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.149+0000 7f8b2d200640 1 --2- 172.21.15.103:0/1695538862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b280cc120 0x7f8b28152a50 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400ea20 tx=0x7f8b1400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:57.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.149+0000 7f8b25600640 1 -- 172.21.15.103:0/1695538862 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1400cd80 con 0x7f8b280cc120 2024-09-10T22:44:57.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.149+0000 7f8b25600640 1 -- 172.21.15.103:0/1695538862 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b14010430 con 0x7f8b280cc120 2024-09-10T22:44:57.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.149+0000 7f8b30600640 1 -- 172.21.15.103:0/1695538862 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b281510d0 con 0x7f8b280cc120 2024-09-10T22:44:57.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.149+0000 7f8b25600640 1 -- 172.21.15.103:0/1695538862 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14010860 con 0x7f8b280cc120 2024-09-10T22:44:57.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.149+0000 7f8b30600640 1 -- 172.21.15.103:0/1695538862 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b280af840 con 0x7f8b280cc120 2024-09-10T22:44:57.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.149+0000 7f8b25600640 1 -- 172.21.15.103:0/1695538862 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8b14010a00 con 0x7f8b280cc120 2024-09-10T22:44:57.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b25600640 1 --2- 172.21.15.103:0/1695538862 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8b080725e0 0x7f8b08074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b25600640 1 -- 172.21.15.103:0/1695538862 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f8b14093ff0 con 0x7f8b280cc120 2024-09-10T22:44:57.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b33a80000 1 Processor -- start 2024-09-10T22:44:57.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b2dc00640 1 --2- 172.21.15.103:0/1695538862 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8b080725e0 0x7f8b08074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b33a80000 1 -- start start 2024-09-10T22:44:57.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b2dc00640 1 --2- 172.21.15.103:0/1695538862 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8b080725e0 0x7f8b08074aa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c007fd0 tx=0x7f8b1c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:57.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b33a80000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c3281a0 0x55d94c328580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b33a80000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c328ac0 0x55d94c2de680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b33a80000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c2debc0 0x55d94c2defa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b33a80000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d94c1c6cb0 con 0x55d94c3281a0 2024-09-10T22:44:57.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b33a80000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d94c0dc310 con 0x55d94c328ac0 2024-09-10T22:44:57.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b33a80000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55d94c139b90 con 0x55d94c2debc0 2024-09-10T22:44:57.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b2dc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c3281a0 0x55d94c328580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b2dc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c3281a0 0x55d94c328580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40280/0 (socket says 172.21.15.103:40280) 2024-09-10T22:44:57.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b2d200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c328ac0 0x55d94c2de680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b2dc00640 1 -- 172.21.15.103:0/411129603 learned_addr learned my addr 172.21.15.103:0/411129603 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:57.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b2e600640 1 --2- 172.21.15.103:0/411129603 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c2debc0 0x55d94c2defa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b2d200640 1 -- 172.21.15.103:0/411129603 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c2debc0 msgr2=0x55d94c2defa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:57.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b2d200640 1 --2- 172.21.15.103:0/411129603 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c2debc0 0x55d94c2defa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b2d200640 1 -- 172.21.15.103:0/411129603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c3281a0 msgr2=0x55d94c328580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:57.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b2d200640 1 --2- 172.21.15.103:0/411129603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c3281a0 0x55d94c328580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b2d200640 1 -- 172.21.15.103:0/411129603 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d94c0ddc60 con 0x55d94c328ac0 2024-09-10T22:44:57.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b2d200640 1 --2- 172.21.15.103:0/411129603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c328ac0 0x55d94c2de680 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400e9f0 tx=0x7f8b1405e8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21801f7abf256e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:57.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b1a000640 1 -- 172.21.15.103:0/411129603 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14063810 con 0x55d94c328ac0 2024-09-10T22:44:57.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b1a000640 1 -- 172.21.15.103:0/411129603 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b1405b050 con 0x55d94c328ac0 2024-09-10T22:44:57.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b1a000640 1 -- 172.21.15.103:0/411129603 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1405e2a0 con 0x55d94c328ac0 2024-09-10T22:44:57.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b33a80000 1 -- 172.21.15.103:0/411129603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c328ac0 msgr2=0x55d94c2de680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:57.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b33a80000 1 --2- 172.21.15.103:0/411129603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c328ac0 0x55d94c2de680 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400e9f0 tx=0x7f8b1405e8f0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b33a80000 1 -- 172.21.15.103:0/411129603 shutdown_connections 2024-09-10T22:44:57.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b33a80000 1 --2- 172.21.15.103:0/411129603 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c2debc0 0x55d94c2defa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b33a80000 1 --2- 172.21.15.103:0/411129603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c328ac0 0x55d94c2de680 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b33a80000 1 --2- 172.21.15.103:0/411129603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c3281a0 0x55d94c328580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b33a80000 1 -- 172.21.15.103:0/411129603 >> 172.21.15.103:0/411129603 conn(0x55d94c2e4d20 msgr2=0x55d94c2dcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:57.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b33a80000 1 -- 172.21.15.103:0/411129603 shutdown_connections 2024-09-10T22:44:57.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.153+0000 7f8b33a80000 1 -- 172.21.15.103:0/411129603 wait complete. 2024-09-10T22:44:57.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b33a80000 1 -- start start 2024-09-10T22:44:57.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b33a80000 1 Processor -- start 2024-09-10T22:44:57.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b33a80000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c2debc0 0x55d94c327ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b33a80000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c3281a0 0x55d94c2ed990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b33a80000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c328ac0 0x55d94c2eded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b33a80000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d94c12cdd0 con 0x55d94c328ac0 2024-09-10T22:44:57.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b33a80000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d94c128fc0 con 0x55d94c2debc0 2024-09-10T22:44:57.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b33a80000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55d94c0ce4b0 con 0x55d94c3281a0 2024-09-10T22:44:57.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b33a80000 10 client.0 _ll_register_callbacks cb 0x55d94c0ac7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:57.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b2e600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c328ac0 0x55d94c2eded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b2e600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c328ac0 0x55d94c2eded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40288/0 (socket says 172.21.15.103:40288) 2024-09-10T22:44:57.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b2e600640 1 -- 172.21.15.103:0/2873941292 learned_addr learned my addr 172.21.15.103:0/2873941292 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:57.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b2dc00640 1 --2- 172.21.15.103:0/2873941292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c2debc0 0x55d94c327ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b2d200640 1 --2- 172.21.15.103:0/2873941292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c3281a0 0x55d94c2ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b2e600640 1 -- 172.21.15.103:0/2873941292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c3281a0 msgr2=0x55d94c2ed990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:57.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b2e600640 1 --2- 172.21.15.103:0/2873941292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c3281a0 0x55d94c2ed990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b2e600640 1 -- 172.21.15.103:0/2873941292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c2debc0 msgr2=0x55d94c327ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:57.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b2e600640 1 --2- 172.21.15.103:0/2873941292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c2debc0 0x55d94c327ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b2e600640 1 -- 172.21.15.103:0/2873941292 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d94c0c71f0 con 0x55d94c328ac0 2024-09-10T22:44:57.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b2dc00640 1 --2- 172.21.15.103:0/2873941292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c2debc0 0x55d94c327ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:57.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b2e600640 1 --2- 172.21.15.103:0/2873941292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c328ac0 0x55d94c2eded0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f8b200b0040 tx=0x7f8b200092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8358294817891b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:57.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b0ea00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:57.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b0ea00640 1 -- 172.21.15.103:0/2873941292 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b200b2040 con 0x55d94c328ac0 2024-09-10T22:44:57.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b33a80000 1 -- 172.21.15.103:0/2873941292 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d94c0c1330 con 0x55d94c328ac0 2024-09-10T22:44:57.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b0ea00640 1 -- 172.21.15.103:0/2873941292 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f8b20004c50 con 0x55d94c328ac0 2024-09-10T22:44:57.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b0ea00640 1 -- 172.21.15.103:0/2873941292 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f8b200c5050 con 0x55d94c328ac0 2024-09-10T22:44:57.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b33a80000 10 client.7710 fetch_fsmap learned FSMap version 96 2024-09-10T22:44:57.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b33a80000 1 -- 172.21.15.103:0/2873941292 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x55d94c0adfa0 con 0x55d94c328ac0 2024-09-10T22:44:57.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b0ea00640 1 -- 172.21.15.103:0/2873941292 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55d94c0c1330 con 0x55d94c328ac0 2024-09-10T22:44:57.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b0ea00640 1 -- 172.21.15.103:0/2873941292 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 96) ==== 3554+0+0 (secure 0 0 0) 0x7f8b200c8020 con 0x55d94c328ac0 2024-09-10T22:44:57.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b33a80000 10 client.7710 fetch_fsmap finished waiting for FSMap version 96 2024-09-10T22:44:57.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b33a80000 10 client.7710 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.a 2024-09-10T22:44:57.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b33a80000 20 client.7710 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:57.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b33a80000 1 --2- 172.21.15.103:0/2873941292 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x55d94c2eec10 0x55d94c33e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b33a80000 4 client.7710 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:57.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b33a80000 1 -- 172.21.15.103:0/2873941292 --> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d94c13bae0 con 0x55d94c2eec10 2024-09-10T22:44:57.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.157+0000 7f8b2dc00640 1 --2- 172.21.15.103:0/2873941292 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x55d94c2eec10 0x55d94c33e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.161+0000 7f8b0ea00640 10 client.7710 ms_handle_connect on v2:172.21.15.103:6832/3251348074 2024-09-10T22:44:57.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.161+0000 7f8b2dc00640 1 --2- 172.21.15.103:0/2873941292 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x55d94c2eec10 0x55d94c33e4a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=89c3c1f4fed8c8ad server_cookie=f8e0e3910578cc56 in_seq=0 out_seq=0 2024-09-10T22:44:57.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.161+0000 7f8b0ea00640 1 -- 172.21.15.103:0/2873941292 <== mds.1 v2:172.21.15.103:6832/3251348074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d94c13bae0 con 0x55d94c2eec10 2024-09-10T22:44:57.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.161+0000 7f8b0ea00640 10 client.7710 handle_command_reply: tid=0 2024-09-10T22:44:57.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.161+0000 7f8b33a80000 1 client.7710 shutdown 2024-09-10T22:44:57.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.161+0000 7f8b33a80000 1 -- 172.21.15.103:0/2873941292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c328ac0 msgr2=0x55d94c2eded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:57.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.161+0000 7f8b33a80000 1 --2- 172.21.15.103:0/2873941292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c328ac0 0x55d94c2eded0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f8b200b0040 tx=0x7f8b200092c0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.161+0000 7f8b33a80000 1 -- 172.21.15.103:0/2873941292 shutdown_connections 2024-09-10T22:44:57.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.161+0000 7f8b33a80000 1 --2- 172.21.15.103:0/2873941292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c328ac0 0x55d94c2eded0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.161+0000 7f8b33a80000 1 --2- 172.21.15.103:0/2873941292 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x55d94c2eec10 0x55d94c33e4a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.161+0000 7f8b33a80000 1 --2- 172.21.15.103:0/2873941292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c3281a0 0x55d94c2ed990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.161+0000 7f8b33a80000 1 --2- 172.21.15.103:0/2873941292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c2debc0 0x55d94c327ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.161+0000 7f8b0ea00640 0 client.7710 ms_handle_reset on v2:172.21.15.103:6832/3251348074 2024-09-10T22:44:57.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.161+0000 7f8b33a80000 1 -- 172.21.15.103:0/2873941292 >> 172.21.15.103:0/2873941292 conn(0x55d94c2e4d20 msgr2=0x55d94c2dcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:57.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.161+0000 7f8b33a80000 1 -- 172.21.15.103:0/2873941292 shutdown_connections 2024-09-10T22:44:57.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.161+0000 7f8b33a80000 1 -- 172.21.15.103:0/2873941292 wait complete. 2024-09-10T22:44:57.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.161+0000 7f8b33a80000 20 client.7710 trim_cache size 0 max 16384 2024-09-10T22:44:57.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.173+0000 7f8b33a80000 1 Processor -- start 2024-09-10T22:44:57.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b33a80000 1 -- start start 2024-09-10T22:44:57.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b33a80000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c2debc0 0x55d94c39e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b33a80000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c3281a0 0x55d94c39e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b33a80000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c328ac0 0x55d94c39ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b33a80000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8b282005b0 con 0x55d94c2debc0 2024-09-10T22:44:57.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b33a80000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8b281ff780 con 0x55d94c3281a0 2024-09-10T22:44:57.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b33a80000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8b281ffe80 con 0x55d94c328ac0 2024-09-10T22:44:57.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b2dc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c2debc0 0x55d94c39e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b2dc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c2debc0 0x55d94c39e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40298/0 (socket says 172.21.15.103:40298) 2024-09-10T22:44:57.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b2dc00640 1 -- 172.21.15.103:0/2958455383 learned_addr learned my addr 172.21.15.103:0/2958455383 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:57.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b2e600640 1 --2- 172.21.15.103:0/2958455383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c328ac0 0x55d94c39ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b2d200640 1 --2- 172.21.15.103:0/2958455383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c3281a0 0x55d94c39e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b2dc00640 1 -- 172.21.15.103:0/2958455383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c328ac0 msgr2=0x55d94c39ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:57.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b2dc00640 1 --2- 172.21.15.103:0/2958455383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c328ac0 0x55d94c39ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b2dc00640 1 -- 172.21.15.103:0/2958455383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c3281a0 msgr2=0x55d94c39e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:57.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b2dc00640 1 --2- 172.21.15.103:0/2958455383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c3281a0 0x55d94c39e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b2dc00640 1 -- 172.21.15.103:0/2958455383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d94c186660 con 0x55d94c2debc0 2024-09-10T22:44:57.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b2d200640 1 --2- 172.21.15.103:0/2958455383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c3281a0 0x55d94c39e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:57.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b2dc00640 1 --2- 172.21.15.103:0/2958455383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c2debc0 0x55d94c39e3e0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c001220 tx=0x7f8b1c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1a5a353bc8e973 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:57.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b19600640 1 -- 172.21.15.103:0/2958455383 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c02f070 con 0x55d94c2debc0 2024-09-10T22:44:57.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b19600640 1 -- 172.21.15.103:0/2958455383 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b1c01b040 con 0x55d94c2debc0 2024-09-10T22:44:57.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b19600640 1 -- 172.21.15.103:0/2958455383 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c0160d0 con 0x55d94c2debc0 2024-09-10T22:44:57.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b33a80000 1 -- 172.21.15.103:0/2958455383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c2debc0 msgr2=0x55d94c39e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:57.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b33a80000 1 --2- 172.21.15.103:0/2958455383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c2debc0 0x55d94c39e3e0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c001220 tx=0x7f8b1c012000 comp rx=0 tx=0).stop 2024-09-10T22:44:57.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b33a80000 1 -- 172.21.15.103:0/2958455383 shutdown_connections 2024-09-10T22:44:57.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b33a80000 1 --2- 172.21.15.103:0/2958455383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c328ac0 0x55d94c39ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b33a80000 1 --2- 172.21.15.103:0/2958455383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c3281a0 0x55d94c39e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b33a80000 1 --2- 172.21.15.103:0/2958455383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c2debc0 0x55d94c39e3e0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b33a80000 1 -- 172.21.15.103:0/2958455383 >> 172.21.15.103:0/2958455383 conn(0x55d94c2e4d20 msgr2=0x55d94c339130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:57.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b33a80000 1 -- 172.21.15.103:0/2958455383 shutdown_connections 2024-09-10T22:44:57.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b33a80000 1 -- 172.21.15.103:0/2958455383 wait complete. 2024-09-10T22:44:57.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b33a80000 1 -- start start 2024-09-10T22:44:57.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.177+0000 7f8b33a80000 1 Processor -- start 2024-09-10T22:44:57.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b33a80000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c2debc0 0x55d94c340ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b33a80000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c3281a0 0x55d94c3411e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b33a80000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c328ac0 0x55d94c35e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b33a80000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d94c12cdd0 con 0x55d94c2debc0 2024-09-10T22:44:57.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b33a80000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d94c2e7d40 con 0x55d94c328ac0 2024-09-10T22:44:57.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b33a80000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55d94c2e5100 con 0x55d94c3281a0 2024-09-10T22:44:57.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b33a80000 10 client.0 _ll_register_callbacks cb 0x7f8b20009b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:57.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b2dc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c2debc0 0x55d94c340ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b2dc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c2debc0 0x55d94c340ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40302/0 (socket says 172.21.15.103:40302) 2024-09-10T22:44:57.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b2dc00640 1 -- 172.21.15.103:0/805835339 learned_addr learned my addr 172.21.15.103:0/805835339 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:57.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b2d200640 1 --2- 172.21.15.103:0/805835339 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c3281a0 0x55d94c3411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b2e600640 1 --2- 172.21.15.103:0/805835339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c328ac0 0x55d94c35e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b2dc00640 1 -- 172.21.15.103:0/805835339 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c3281a0 msgr2=0x55d94c3411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:57.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b2dc00640 1 --2- 172.21.15.103:0/805835339 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c3281a0 0x55d94c3411e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b2dc00640 1 -- 172.21.15.103:0/805835339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c328ac0 msgr2=0x55d94c35e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:57.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b2dc00640 1 --2- 172.21.15.103:0/805835339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c328ac0 0x55d94c35e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b2dc00640 1 -- 172.21.15.103:0/805835339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d94c0f3090 con 0x55d94c2debc0 2024-09-10T22:44:57.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b2e600640 1 --2- 172.21.15.103:0/805835339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c328ac0 0x55d94c35e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:57.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b2dc00640 1 --2- 172.21.15.103:0/805835339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c2debc0 0x55d94c340ca0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00f5a0 tx=0x7f8b1c016380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15a1abe1fbe5c27 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:57.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b0ea00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:57.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b0ea00640 1 -- 172.21.15.103:0/805835339 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c02f030 con 0x55d94c2debc0 2024-09-10T22:44:57.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b0ea00640 1 -- 172.21.15.103:0/805835339 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f8b1c029040 con 0x55d94c2debc0 2024-09-10T22:44:57.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b33a80000 1 -- 172.21.15.103:0/805835339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b1c01b040 con 0x55d94c2debc0 2024-09-10T22:44:57.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b0ea00640 1 -- 172.21.15.103:0/805835339 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f8b1c016c80 con 0x55d94c2debc0 2024-09-10T22:44:57.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b33a80000 10 client.7716 fetch_fsmap learned FSMap version 96 2024-09-10T22:44:57.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b33a80000 1 -- 172.21.15.103:0/805835339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x55d94c0bf5f0 con 0x55d94c2debc0 2024-09-10T22:44:57.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b0ea00640 1 -- 172.21.15.103:0/805835339 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b1c01b040 con 0x55d94c2debc0 2024-09-10T22:44:57.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b0ea00640 1 -- 172.21.15.103:0/805835339 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 96) ==== 3554+0+0 (secure 0 0 0) 0x7f8b1c020050 con 0x55d94c2debc0 2024-09-10T22:44:57.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b33a80000 10 client.7716 fetch_fsmap finished waiting for FSMap version 96 2024-09-10T22:44:57.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b33a80000 10 client.7716 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.a 2024-09-10T22:44:57.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b33a80000 20 client.7716 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:57.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b33a80000 1 --2- 172.21.15.103:0/805835339 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x55d94c35f380 0x55d94c3a2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b33a80000 4 client.7716 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:44:57.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b33a80000 1 -- 172.21.15.103:0/805835339 --> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d94c137590 con 0x55d94c35f380 2024-09-10T22:44:57.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b2d200640 1 --2- 172.21.15.103:0/805835339 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x55d94c35f380 0x55d94c3a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b2d200640 1 --2- 172.21.15.103:0/805835339 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x55d94c35f380 0x55d94c3a2000 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d2295a27e91b799 server_cookie=2c2d54dcf7884f7f in_seq=0 out_seq=0 2024-09-10T22:44:57.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.181+0000 7f8b0ea00640 10 client.7716 ms_handle_connect on v2:172.21.15.103:6832/3251348074 2024-09-10T22:44:57.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.189+0000 7f8b0ea00640 1 -- 172.21.15.103:0/805835339 <== mds.1 v2:172.21.15.103:6832/3251348074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d94c137590 con 0x55d94c35f380 2024-09-10T22:44:57.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.189+0000 7f8b0ea00640 10 client.7716 handle_command_reply: tid=0 2024-09-10T22:44:57.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.189+0000 7f8b33a80000 1 client.7716 shutdown 2024-09-10T22:44:57.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.189+0000 7f8b33a80000 1 -- 172.21.15.103:0/805835339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c2debc0 msgr2=0x55d94c340ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:57.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.189+0000 7f8b33a80000 1 --2- 172.21.15.103:0/805835339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c2debc0 0x55d94c340ca0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00f5a0 tx=0x7f8b1c016380 comp rx=0 tx=0).stop 2024-09-10T22:44:57.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.189+0000 7f8b33a80000 1 -- 172.21.15.103:0/805835339 shutdown_connections 2024-09-10T22:44:57.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.189+0000 7f8b33a80000 1 --2- 172.21.15.103:0/805835339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d94c328ac0 0x55d94c35e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.189+0000 7f8b33a80000 1 --2- 172.21.15.103:0/805835339 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x55d94c35f380 0x55d94c3a2000 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.189+0000 7f8b33a80000 1 --2- 172.21.15.103:0/805835339 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d94c3281a0 0x55d94c3411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.189+0000 7f8b33a80000 1 --2- 172.21.15.103:0/805835339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d94c2debc0 0x55d94c340ca0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.189+0000 7f8b0ea00640 0 client.7716 ms_handle_reset on v2:172.21.15.103:6832/3251348074 2024-09-10T22:44:57.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.189+0000 7f8b33a80000 1 -- 172.21.15.103:0/805835339 >> 172.21.15.103:0/805835339 conn(0x55d94c2e4d20 msgr2=0x55d94c339950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:57.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.193+0000 7f8b33a80000 1 -- 172.21.15.103:0/805835339 shutdown_connections 2024-09-10T22:44:57.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.193+0000 7f8b33a80000 1 -- 172.21.15.103:0/805835339 wait complete. 2024-09-10T22:44:57.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.193+0000 7f8b33a80000 20 client.7716 trim_cache size 0 max 16384 2024-09-10T22:44:57.197 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:44:57.197 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:44:57.197 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:44:57.197 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:44:57.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.193+0000 7f8b30600640 1 -- 172.21.15.103:0/1695538862 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8b080725e0 msgr2=0x7f8b08074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:57.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.193+0000 7f8b30600640 1 --2- 172.21.15.103:0/1695538862 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8b080725e0 0x7f8b08074aa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c007fd0 tx=0x7f8b1c009040 comp rx=0 tx=0).stop 2024-09-10T22:44:57.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.193+0000 7f8b30600640 1 -- 172.21.15.103:0/1695538862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b280cc120 msgr2=0x7f8b28152a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:57.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.193+0000 7f8b30600640 1 --2- 172.21.15.103:0/1695538862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b280cc120 0x7f8b28152a50 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400ea20 tx=0x7f8b1400eee0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.193+0000 7f8b30600640 1 -- 172.21.15.103:0/1695538862 shutdown_connections 2024-09-10T22:44:57.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.193+0000 7f8b30600640 1 --2- 172.21.15.103:0/1695538862 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8b080725e0 0x7f8b08074aa0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.193+0000 7f8b30600640 1 --2- 172.21.15.103:0/1695538862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b280cf790 0x7f8b2815f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.193+0000 7f8b30600640 1 --2- 172.21.15.103:0/1695538862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b280cc120 0x7f8b28152a50 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.193+0000 7f8b30600640 1 --2- 172.21.15.103:0/1695538862 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b280aeb40 0x7f8b2813a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.193+0000 7f8b30600640 1 -- 172.21.15.103:0/1695538862 >> 172.21.15.103:0/1695538862 conn(0x7f8b2806cc00 msgr2=0x7f8b2815afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:57.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.193+0000 7f8b30600640 1 -- 172.21.15.103:0/1695538862 shutdown_connections 2024-09-10T22:44:57.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.193+0000 7f8b30600640 1 -- 172.21.15.103:0/1695538862 wait complete. 2024-09-10T22:44:57.215 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:2 flush journal 2024-09-10T22:44:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f35a2600640 1 -- 172.21.15.103:0/1223916193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f359c0cfdd0 msgr2=0x7f359c073b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f35a2600640 1 --2- 172.21.15.103:0/1223916193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f359c0cfdd0 0x7f359c073b50 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f359c06eae0 tx=0x7f359401cd80 comp rx=0 tx=0).stop 2024-09-10T22:44:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f35a2600640 1 -- 172.21.15.103:0/1223916193 shutdown_connections 2024-09-10T22:44:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f35a2600640 1 --2- 172.21.15.103:0/1223916193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f359c0cfdd0 0x7f359c073b50 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f35a2600640 1 --2- 172.21.15.103:0/1223916193 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f359c06f0c0 0x7f359c073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f35a2600640 1 --2- 172.21.15.103:0/1223916193 >> v2:172.21.15.131:3300/0 conn(0x7f359c0cf9f0 0x7f359c06eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f35a2600640 1 -- 172.21.15.103:0/1223916193 >> 172.21.15.103:0/1223916193 conn(0x7f359c06cc00 msgr2=0x7f359c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f35a2600640 1 -- 172.21.15.103:0/1223916193 shutdown_connections 2024-09-10T22:44:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f35a2600640 1 -- 172.21.15.103:0/1223916193 wait complete. 2024-09-10T22:44:57.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f35a2600640 1 Processor -- start 2024-09-10T22:44:57.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f35a2600640 1 -- start start 2024-09-10T22:44:57.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f35a2600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f359c06f0c0 0x7f359c0afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f35a2600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f359c0cf9f0 0x7f359c0adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f35a2600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f359c0cfdd0 0x7f359c14a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f35a2600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f359c0ccab0 con 0x7f359c06f0c0 2024-09-10T22:44:57.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f35a2600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f359c0cc930 con 0x7f359c0cf9f0 2024-09-10T22:44:57.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f35a2600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f359c0ccc30 con 0x7f359c0cfdd0 2024-09-10T22:44:57.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f359b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f359c06f0c0 0x7f359c0afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f359b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f359c06f0c0 0x7f359c0afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40320/0 (socket says 172.21.15.103:40320) 2024-09-10T22:44:57.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.357+0000 7f359b400640 1 -- 172.21.15.103:0/3805396649 learned_addr learned my addr 172.21.15.103:0/3805396649 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:57.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.361+0000 7f359be00640 1 --2- 172.21.15.103:0/3805396649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f359c0cfdd0 0x7f359c14a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.361+0000 7f3593e00640 1 --2- 172.21.15.103:0/3805396649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f359c0cf9f0 0x7f359c0adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.361+0000 7f359b400640 1 -- 172.21.15.103:0/3805396649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f359c0cfdd0 msgr2=0x7f359c14a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:57.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.361+0000 7f359b400640 1 --2- 172.21.15.103:0/3805396649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f359c0cfdd0 0x7f359c14a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.361+0000 7f359b400640 1 -- 172.21.15.103:0/3805396649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f359c0cf9f0 msgr2=0x7f359c0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:57.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.361+0000 7f359b400640 1 --2- 172.21.15.103:0/3805396649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f359c0cf9f0 0x7f359c0adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.361+0000 7f359b400640 1 -- 172.21.15.103:0/3805396649 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359c0affc0 con 0x7f359c06f0c0 2024-09-10T22:44:57.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.361+0000 7f359b400640 1 --2- 172.21.15.103:0/3805396649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f359c06f0c0 0x7f359c0afa80 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f358c00d980 tx=0x7f358c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:57.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.361+0000 7f3593400640 1 -- 172.21.15.103:0/3805396649 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c017030 con 0x7f359c06f0c0 2024-09-10T22:44:57.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.361+0000 7f3593400640 1 -- 172.21.15.103:0/3805396649 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f358c009b20 con 0x7f359c06f0c0 2024-09-10T22:44:57.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.361+0000 7f3593400640 1 -- 172.21.15.103:0/3805396649 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c004020 con 0x7f359c06f0c0 2024-09-10T22:44:57.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.361+0000 7f35a2600640 1 -- 172.21.15.103:0/3805396649 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f359c1fbcf0 con 0x7f359c06f0c0 2024-09-10T22:44:57.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.361+0000 7f35a2600640 1 -- 172.21.15.103:0/3805396649 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f359c1fb210 con 0x7f359c06f0c0 2024-09-10T22:44:57.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.361+0000 7f3593400640 1 -- 172.21.15.103:0/3805396649 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f358c024060 con 0x7f359c06f0c0 2024-09-10T22:44:57.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f3593400640 1 --2- 172.21.15.103:0/3805396649 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35780725e0 0x7f3578074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f35a5966000 1 Processor -- start 2024-09-10T22:44:57.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f3593400640 1 -- 172.21.15.103:0/3805396649 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f358c093740 con 0x7f359c06f0c0 2024-09-10T22:44:57.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f35a5966000 1 -- start start 2024-09-10T22:44:57.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f3593e00640 1 --2- 172.21.15.103:0/3805396649 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35780725e0 0x7f3578074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f35a5966000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 0x556ba6c95580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f35a5966000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c95ac0 0x556ba6c4b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f35a5966000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c4bbc0 0x556ba6c4bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f35a5966000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556ba6b33cb0 con 0x556ba6c95ac0 2024-09-10T22:44:57.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f35a5966000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x556ba6a49310 con 0x556ba6c4bbc0 2024-09-10T22:44:57.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f35a5966000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x556ba6aa6b90 con 0x556ba6c951a0 2024-09-10T22:44:57.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f3593e00640 1 --2- 172.21.15.103:0/3805396649 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35780725e0 0x7f3578074aa0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3584005fd0 tx=0x7f3584005e60 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:57.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f3593e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c95ac0 0x556ba6c4b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f3593e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c95ac0 0x556ba6c4b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40332/0 (socket says 172.21.15.103:40332) 2024-09-10T22:44:57.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f3593e00640 1 -- 172.21.15.103:0/1850381861 learned_addr learned my addr 172.21.15.103:0/1850381861 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:57.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f359b400640 1 --2- 172.21.15.103:0/1850381861 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 0x556ba6c95580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f359be00640 1 --2- 172.21.15.103:0/1850381861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c4bbc0 0x556ba6c4bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f3593e00640 1 -- 172.21.15.103:0/1850381861 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 msgr2=0x556ba6c95580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:57.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f3593e00640 1 --2- 172.21.15.103:0/1850381861 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 0x556ba6c95580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f3593e00640 1 -- 172.21.15.103:0/1850381861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c4bbc0 msgr2=0x556ba6c4bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:57.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f3593e00640 1 --2- 172.21.15.103:0/1850381861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c4bbc0 0x556ba6c4bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f3593e00640 1 -- 172.21.15.103:0/1850381861 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ba6a4ac60 con 0x556ba6c95ac0 2024-09-10T22:44:57.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f3593e00640 1 --2- 172.21.15.103:0/1850381861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c95ac0 0x556ba6c4b680 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f358400fe20 tx=0x7f3584012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc7b4c04d3b2e88 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:57.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f358be00640 1 -- 172.21.15.103:0/1850381861 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3584022070 con 0x556ba6c95ac0 2024-09-10T22:44:57.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f358be00640 1 -- 172.21.15.103:0/1850381861 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f358401e740 con 0x556ba6c95ac0 2024-09-10T22:44:57.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f358be00640 1 -- 172.21.15.103:0/1850381861 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358401eb10 con 0x556ba6c95ac0 2024-09-10T22:44:57.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f35a5966000 1 -- 172.21.15.103:0/1850381861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c95ac0 msgr2=0x556ba6c4b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:57.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f35a5966000 1 --2- 172.21.15.103:0/1850381861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c95ac0 0x556ba6c4b680 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f358400fe20 tx=0x7f3584012000 comp rx=0 tx=0).stop 2024-09-10T22:44:57.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f35a5966000 1 -- 172.21.15.103:0/1850381861 shutdown_connections 2024-09-10T22:44:57.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f35a5966000 1 --2- 172.21.15.103:0/1850381861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c4bbc0 0x556ba6c4bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f35a5966000 1 --2- 172.21.15.103:0/1850381861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c95ac0 0x556ba6c4b680 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f35a5966000 1 --2- 172.21.15.103:0/1850381861 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 0x556ba6c95580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f35a5966000 1 -- 172.21.15.103:0/1850381861 >> 172.21.15.103:0/1850381861 conn(0x556ba6c51d20 msgr2=0x556ba6c49f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:57.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f35a5966000 1 -- 172.21.15.103:0/1850381861 shutdown_connections 2024-09-10T22:44:57.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.365+0000 7f35a5966000 1 -- 172.21.15.103:0/1850381861 wait complete. 2024-09-10T22:44:57.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f35a5966000 1 -- start start 2024-09-10T22:44:57.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f35a5966000 1 Processor -- start 2024-09-10T22:44:57.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f35a5966000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c4bbc0 0x556ba6c9c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f35a5966000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 0x556ba6c9ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f35a5966000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c95ac0 0x556ba6c9cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f35a5966000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556ba6a99dd0 con 0x556ba6c95ac0 2024-09-10T22:44:57.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f35a5966000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x556ba6a95fc0 con 0x556ba6c4bbc0 2024-09-10T22:44:57.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f35a5966000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x556ba6a3b4b0 con 0x556ba6c951a0 2024-09-10T22:44:57.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f35a5966000 10 client.0 _ll_register_callbacks cb 0x556ba6a197d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:57.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f359be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c95ac0 0x556ba6c9cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f359b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c4bbc0 0x556ba6c9c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f359be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c95ac0 0x556ba6c9cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40344/0 (socket says 172.21.15.103:40344) 2024-09-10T22:44:57.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f359be00640 1 -- 172.21.15.103:0/4146083018 learned_addr learned my addr 172.21.15.103:0/4146083018 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:57.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f3593e00640 1 --2- 172.21.15.103:0/4146083018 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 0x556ba6c9ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f359b400640 1 -- 172.21.15.103:0/4146083018 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 msgr2=0x556ba6c9ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:57.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f359b400640 1 --2- 172.21.15.103:0/4146083018 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 0x556ba6c9ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f359b400640 1 -- 172.21.15.103:0/4146083018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c95ac0 msgr2=0x556ba6c9cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:57.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f359b400640 1 --2- 172.21.15.103:0/4146083018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c95ac0 0x556ba6c9cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f359b400640 1 -- 172.21.15.103:0/4146083018 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ba6a341f0 con 0x556ba6c4bbc0 2024-09-10T22:44:57.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f359b400640 1 --2- 172.21.15.103:0/4146083018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c4bbc0 0x556ba6c9c530 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f358c05b780 tx=0x7f358c0673c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bad5d777ef157d86 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:57.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f3588c00640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-10T22:44:57.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f3588c00640 1 -- 172.21.15.103:0/4146083018 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c083070 con 0x556ba6c4bbc0 2024-09-10T22:44:57.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f35a5966000 1 -- 172.21.15.103:0/4146083018 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556ba6a2e330 con 0x556ba6c4bbc0 2024-09-10T22:44:57.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f3588c00640 1 -- 172.21.15.103:0/4146083018 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f358c0041c0 con 0x556ba6c4bbc0 2024-09-10T22:44:57.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f3588c00640 1 -- 172.21.15.103:0/4146083018 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f358c05e510 con 0x556ba6c4bbc0 2024-09-10T22:44:57.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f35a5966000 10 client.7291 fetch_fsmap learned FSMap version 96 2024-09-10T22:44:57.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f35a5966000 1 -- 172.21.15.103:0/4146083018 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x556ba6a1afa0 con 0x556ba6c4bbc0 2024-09-10T22:44:57.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f3588c00640 1 -- 172.21.15.103:0/4146083018 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x556ba6a2e330 con 0x556ba6c4bbc0 2024-09-10T22:44:57.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f3588c00640 1 -- 172.21.15.103:0/4146083018 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 96) ==== 3554+0+0 (secure 0 0 0) 0x7f358c05d770 con 0x556ba6c4bbc0 2024-09-10T22:44:57.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f35a5966000 10 client.7291 fetch_fsmap finished waiting for FSMap version 96 2024-09-10T22:44:57.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f35a5966000 10 client.7291 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2024-09-10T22:44:57.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f35a5966000 20 client.7291 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:57.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f35a5966000 1 --2- 172.21.15.103:0/4146083018 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x556ba6ca4900 0x556ba6ca6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f35a5966000 4 client.7291 mds_command: new command op to 7048 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:57.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.369+0000 7f35a5966000 1 -- 172.21.15.103:0/4146083018 --> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ba6aa8ae0 con 0x556ba6ca4900 2024-09-10T22:44:57.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.373+0000 7f3593e00640 1 --2- 172.21.15.103:0/4146083018 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x556ba6ca4900 0x556ba6ca6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.373+0000 7f3593e00640 1 --2- 172.21.15.103:0/4146083018 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x556ba6ca4900 0x556ba6ca6cf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=50ee462d52caeb44 server_cookie=5864f435b6279ae1 in_seq=0 out_seq=0 2024-09-10T22:44:57.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.373+0000 7f3588c00640 10 client.7291 ms_handle_connect on v2:172.21.15.131:6834/1622106563 2024-09-10T22:44:57.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.373+0000 7f3588c00640 1 -- 172.21.15.103:0/4146083018 <== mds.2 v2:172.21.15.131:6834/1622106563 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ba6aa8ae0 con 0x556ba6ca4900 2024-09-10T22:44:57.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.373+0000 7f3588c00640 10 client.7291 handle_command_reply: tid=0 2024-09-10T22:44:57.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.373+0000 7f35a5966000 1 client.7291 shutdown 2024-09-10T22:44:57.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.373+0000 7f35a5966000 1 -- 172.21.15.103:0/4146083018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c4bbc0 msgr2=0x556ba6c9c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:57.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.373+0000 7f35a5966000 1 --2- 172.21.15.103:0/4146083018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c4bbc0 0x556ba6c9c530 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f358c05b780 tx=0x7f358c0673c0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.373+0000 7f35a5966000 1 -- 172.21.15.103:0/4146083018 shutdown_connections 2024-09-10T22:44:57.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.373+0000 7f35a5966000 1 --2- 172.21.15.103:0/4146083018 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x556ba6ca4900 0x556ba6ca6cf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.373+0000 7f35a5966000 1 --2- 172.21.15.103:0/4146083018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c95ac0 0x556ba6c9cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.373+0000 7f35a5966000 1 --2- 172.21.15.103:0/4146083018 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 0x556ba6c9ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.373+0000 7f35a5966000 1 --2- 172.21.15.103:0/4146083018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c4bbc0 0x556ba6c9c530 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.373+0000 7f3588c00640 0 client.7291 ms_handle_reset on v2:172.21.15.131:6834/1622106563 2024-09-10T22:44:57.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.373+0000 7f35a5966000 1 -- 172.21.15.103:0/4146083018 >> 172.21.15.103:0/4146083018 conn(0x556ba6c51d20 msgr2=0x556ba6c49f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:57.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.373+0000 7f35a5966000 1 -- 172.21.15.103:0/4146083018 shutdown_connections 2024-09-10T22:44:57.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.373+0000 7f35a5966000 1 -- 172.21.15.103:0/4146083018 wait complete. 2024-09-10T22:44:57.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.373+0000 7f35a5966000 20 client.7291 trim_cache size 0 max 16384 2024-09-10T22:44:57.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f35a5966000 1 Processor -- start 2024-09-10T22:44:57.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f35a5966000 1 -- start start 2024-09-10T22:44:57.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f35a5966000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c4bbc0 0x556ba6c4cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f35a5966000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 0x556ba6c4d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f35a5966000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c95ac0 0x556ba6c9f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f35a5966000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f359c204a80 con 0x556ba6c4bbc0 2024-09-10T22:44:57.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f35a5966000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f359c203c50 con 0x556ba6c95ac0 2024-09-10T22:44:57.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f35a5966000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f359c204350 con 0x556ba6c951a0 2024-09-10T22:44:57.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f359b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c4bbc0 0x556ba6c4cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f359b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c4bbc0 0x556ba6c4cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40352/0 (socket says 172.21.15.103:40352) 2024-09-10T22:44:57.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f359b400640 1 -- 172.21.15.103:0/2998810133 learned_addr learned my addr 172.21.15.103:0/2998810133 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:57.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f3593e00640 1 --2- 172.21.15.103:0/2998810133 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 0x556ba6c4d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f359be00640 1 --2- 172.21.15.103:0/2998810133 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c95ac0 0x556ba6c9f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f359b400640 1 -- 172.21.15.103:0/2998810133 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 msgr2=0x556ba6c4d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:57.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f359b400640 1 --2- 172.21.15.103:0/2998810133 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 0x556ba6c4d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f359b400640 1 -- 172.21.15.103:0/2998810133 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c95ac0 msgr2=0x556ba6c9f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:57.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f359b400640 1 --2- 172.21.15.103:0/2998810133 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c95ac0 0x556ba6c9f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f359b400640 1 -- 172.21.15.103:0/2998810133 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ba6af3660 con 0x556ba6c4bbc0 2024-09-10T22:44:57.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f3593e00640 1 --2- 172.21.15.103:0/2998810133 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 0x556ba6c4d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:57.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f359b400640 1 --2- 172.21.15.103:0/2998810133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c4bbc0 0x556ba6c4cfb0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f358c000c10 tx=0x7f358c009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5660b95ef6d291a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:57.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f358b400640 1 -- 172.21.15.103:0/2998810133 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c083050 con 0x556ba6c4bbc0 2024-09-10T22:44:57.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f358b400640 1 -- 172.21.15.103:0/2998810133 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f358c065050 con 0x556ba6c4bbc0 2024-09-10T22:44:57.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.389+0000 7f358b400640 1 -- 172.21.15.103:0/2998810133 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c067a10 con 0x556ba6c4bbc0 2024-09-10T22:44:57.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 -- 172.21.15.103:0/2998810133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c4bbc0 msgr2=0x556ba6c4cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:57.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 --2- 172.21.15.103:0/2998810133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c4bbc0 0x556ba6c4cfb0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f358c000c10 tx=0x7f358c009f70 comp rx=0 tx=0).stop 2024-09-10T22:44:57.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 -- 172.21.15.103:0/2998810133 shutdown_connections 2024-09-10T22:44:57.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 --2- 172.21.15.103:0/2998810133 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c95ac0 0x556ba6c9f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 --2- 172.21.15.103:0/2998810133 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 0x556ba6c4d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 --2- 172.21.15.103:0/2998810133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c4bbc0 0x556ba6c4cfb0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 -- 172.21.15.103:0/2998810133 >> 172.21.15.103:0/2998810133 conn(0x556ba6c51d20 msgr2=0x556ba6c4b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:57.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 -- 172.21.15.103:0/2998810133 shutdown_connections 2024-09-10T22:44:57.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 -- 172.21.15.103:0/2998810133 wait complete. 2024-09-10T22:44:57.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 -- start start 2024-09-10T22:44:57.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 Processor -- start 2024-09-10T22:44:57.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c4bbc0 0x556ba6ca2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 0x556ba6ca2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c95ac0 0x556ba6cc7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556ba6c54d40 con 0x556ba6c4bbc0 2024-09-10T22:44:57.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x556ba6c52100 con 0x556ba6c95ac0 2024-09-10T22:44:57.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x556ba6a90ec0 con 0x556ba6c951a0 2024-09-10T22:44:57.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 10 client.0 _ll_register_callbacks cb 0x7f358c00d8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:57.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f359b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c4bbc0 0x556ba6ca2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f3593e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 0x556ba6ca2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f359b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c4bbc0 0x556ba6ca2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40358/0 (socket says 172.21.15.103:40358) 2024-09-10T22:44:57.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f359b400640 1 -- 172.21.15.103:0/3034642678 learned_addr learned my addr 172.21.15.103:0/3034642678 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:57.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f359be00640 1 --2- 172.21.15.103:0/3034642678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c95ac0 0x556ba6cc7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f359b400640 1 -- 172.21.15.103:0/3034642678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 msgr2=0x556ba6ca2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f359b400640 1 --2- 172.21.15.103:0/3034642678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 0x556ba6ca2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f359b400640 1 -- 172.21.15.103:0/3034642678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c95ac0 msgr2=0x556ba6cc7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f359b400640 1 --2- 172.21.15.103:0/3034642678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c95ac0 0x556ba6cc7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f359b400640 1 -- 172.21.15.103:0/3034642678 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ba6a60090 con 0x556ba6c4bbc0 2024-09-10T22:44:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f359be00640 1 --2- 172.21.15.103:0/3034642678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c95ac0 0x556ba6cc7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f359b400640 1 --2- 172.21.15.103:0/3034642678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c4bbc0 0x556ba6ca2100 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f358c05b780 tx=0x7f358c067350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09d367ae0562771 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f3588c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f3588c00640 1 -- 172.21.15.103:0/3034642678 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c083050 con 0x556ba6c4bbc0 2024-09-10T22:44:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f3588c00640 1 -- 172.21.15.103:0/3034642678 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f358c0043c0 con 0x556ba6c4bbc0 2024-09-10T22:44:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 -- 172.21.15.103:0/3034642678 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f358c065050 con 0x556ba6c4bbc0 2024-09-10T22:44:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f3588c00640 1 -- 172.21.15.103:0/3034642678 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f358c067a10 con 0x556ba6c4bbc0 2024-09-10T22:44:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 10 client.7734 fetch_fsmap learned FSMap version 96 2024-09-10T22:44:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.393+0000 7f35a5966000 1 -- 172.21.15.103:0/3034642678 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x556ba6a2c5f0 con 0x556ba6c4bbc0 2024-09-10T22:44:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.397+0000 7f3588c00640 1 -- 172.21.15.103:0/3034642678 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f358c065050 con 0x556ba6c4bbc0 2024-09-10T22:44:57.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.397+0000 7f3588c00640 1 -- 172.21.15.103:0/3034642678 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 96) ==== 3554+0+0 (secure 0 0 0) 0x7f358c065200 con 0x556ba6c4bbc0 2024-09-10T22:44:57.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.397+0000 7f35a5966000 10 client.7734 fetch_fsmap finished waiting for FSMap version 96 2024-09-10T22:44:57.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.397+0000 7f35a5966000 10 client.7734 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2024-09-10T22:44:57.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.397+0000 7f35a5966000 20 client.7734 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:57.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.397+0000 7f35a5966000 1 --2- 172.21.15.103:0/3034642678 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x556ba6cc7c00 0x556ba6d0aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:57.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.397+0000 7f35a5966000 4 client.7734 mds_command: new command op to 7048 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:44:57.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.397+0000 7f35a5966000 1 -- 172.21.15.103:0/3034642678 --> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556ba6aa4590 con 0x556ba6cc7c00 2024-09-10T22:44:57.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.397+0000 7f3593e00640 1 --2- 172.21.15.103:0/3034642678 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x556ba6cc7c00 0x556ba6d0aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:57.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.397+0000 7f3593e00640 1 --2- 172.21.15.103:0/3034642678 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x556ba6cc7c00 0x556ba6d0aa60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ac0bcf1bc688c2d server_cookie=187b32541e5e24b1 in_seq=0 out_seq=0 2024-09-10T22:44:57.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.397+0000 7f3588c00640 10 client.7734 ms_handle_connect on v2:172.21.15.131:6834/1622106563 2024-09-10T22:44:57.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f3588c00640 1 -- 172.21.15.103:0/3034642678 <== mds.2 v2:172.21.15.131:6834/1622106563 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556ba6aa4590 con 0x556ba6cc7c00 2024-09-10T22:44:57.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f3588c00640 10 client.7734 handle_command_reply: tid=0 2024-09-10T22:44:57.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a5966000 1 client.7734 shutdown 2024-09-10T22:44:57.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a5966000 1 -- 172.21.15.103:0/3034642678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c4bbc0 msgr2=0x556ba6ca2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:57.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a5966000 1 --2- 172.21.15.103:0/3034642678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c4bbc0 0x556ba6ca2100 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f358c05b780 tx=0x7f358c067350 comp rx=0 tx=0).stop 2024-09-10T22:44:57.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a5966000 1 -- 172.21.15.103:0/3034642678 shutdown_connections 2024-09-10T22:44:57.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a5966000 1 --2- 172.21.15.103:0/3034642678 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x556ba6cc7c00 0x556ba6d0aa60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a5966000 1 --2- 172.21.15.103:0/3034642678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ba6c95ac0 0x556ba6cc7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a5966000 1 --2- 172.21.15.103:0/3034642678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556ba6c951a0 0x556ba6ca2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f3588c00640 0 client.7734 ms_handle_reset on v2:172.21.15.131:6834/1622106563 2024-09-10T22:44:57.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a5966000 1 --2- 172.21.15.103:0/3034642678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556ba6c4bbc0 0x556ba6ca2100 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a5966000 1 -- 172.21.15.103:0/3034642678 >> 172.21.15.103:0/3034642678 conn(0x556ba6c51d20 msgr2=0x556ba6c4bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:57.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a5966000 1 -- 172.21.15.103:0/3034642678 shutdown_connections 2024-09-10T22:44:57.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a5966000 1 -- 172.21.15.103:0/3034642678 wait complete. 2024-09-10T22:44:57.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a5966000 20 client.7734 trim_cache size 0 max 16384 2024-09-10T22:44:57.410 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:44:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:44:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:44:57.410 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:44:57.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a2600640 1 -- 172.21.15.103:0/3805396649 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35780725e0 msgr2=0x7f3578074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:57.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a2600640 1 --2- 172.21.15.103:0/3805396649 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35780725e0 0x7f3578074aa0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3584005fd0 tx=0x7f3584005e60 comp rx=0 tx=0).stop 2024-09-10T22:44:57.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a2600640 1 -- 172.21.15.103:0/3805396649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f359c06f0c0 msgr2=0x7f359c0afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:57.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a2600640 1 --2- 172.21.15.103:0/3805396649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f359c06f0c0 0x7f359c0afa80 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f358c00d980 tx=0x7f358c00de40 comp rx=0 tx=0).stop 2024-09-10T22:44:57.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a2600640 1 -- 172.21.15.103:0/3805396649 shutdown_connections 2024-09-10T22:44:57.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a2600640 1 --2- 172.21.15.103:0/3805396649 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35780725e0 0x7f3578074aa0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a2600640 1 --2- 172.21.15.103:0/3805396649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f359c0cfdd0 0x7f359c14a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a2600640 1 --2- 172.21.15.103:0/3805396649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f359c0cf9f0 0x7f359c0adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a2600640 1 --2- 172.21.15.103:0/3805396649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f359c06f0c0 0x7f359c0afa80 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:57.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a2600640 1 -- 172.21.15.103:0/3805396649 >> 172.21.15.103:0/3805396649 conn(0x7f359c06cc00 msgr2=0x7f359c159de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:57.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a2600640 1 -- 172.21.15.103:0/3805396649 shutdown_connections 2024-09-10T22:44:57.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57.405+0000 7f35a2600640 1 -- 172.21.15.103:0/3805396649 wait complete. 2024-09-10T22:44:57.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:57.429 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2024-09-10T22:44:57.466 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/ 2024-09-10T22:44:57.466 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4 2024-09-10T22:44:57.466 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5 2024-09-10T22:44:57.466 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5/d6 2024-09-10T22:44:57.466 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5/d6/d7 2024-09-10T22:44:57.466 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2024-09-10T22:44:57.467 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:44:57.467 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:44:57.467 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:44:57.467 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:44:57.468 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2024-09-10T22:44:57.468 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:44:57.575 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627778 2024-09-10T22:44:57.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:44:57.584 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:44:57.584 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:44:57.584 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:44:57.584 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:44:57.584 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2024-09-10T22:44:57.585 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:44:57.691 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627779 2024-09-10T22:44:57.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:44:57.700 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:44:57.700 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:44:57.700 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:44:57.700 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:44:57.700 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2024-09-10T22:44:57.700 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:44:57.807 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627780 2024-09-10T22:44:57.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:44:57.816 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:44:57.816 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:44:57.817 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:44:57.817 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:44:57.817 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2024-09-10T22:44:57.817 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:44:57.923 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627781 2024-09-10T22:44:57.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:44:57.933 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:44:57.933 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:44:57.933 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:44:57.933 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:44:57.933 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2024-09-10T22:44:57.933 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:44:58.043 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627782 2024-09-10T22:44:58.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:44:58.053 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:44:58.053 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:44:58.053 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:44:58.053 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:44:58.053 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2024-09-10T22:44:58.053 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:44:58.159 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627783 2024-09-10T22:44:58.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:44:58.169 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2024-09-10T22:44:58.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb2322a080 1 Processor -- start 2024-09-10T22:44:58.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb2322a080 1 -- start start 2024-09-10T22:44:58.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb2322a080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560cfd2ef7a0 0x560cfd3c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb2322a080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560cfd3a8be0 0x560cfd3c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb2322a080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560cfd3c3ce0 0x560cfd3a9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb2322a080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560cfd23da00 con 0x560cfd3c3ce0 2024-09-10T22:44:58.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb2322a080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560cfd29bf40 con 0x560cfd2ef7a0 2024-09-10T22:44:58.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb2322a080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560cfd3aa9c0 con 0x560cfd3a8be0 2024-09-10T22:44:58.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb20e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560cfd3c3ce0 0x560cfd3a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb20e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560cfd3c3ce0 0x560cfd3a9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40388/0 (socket says 172.21.15.103:40388) 2024-09-10T22:44:58.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb20e00640 1 -- 172.21.15.103:0/270247449 learned_addr learned my addr 172.21.15.103:0/270247449 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:58.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb20400640 1 --2- 172.21.15.103:0/270247449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560cfd2ef7a0 0x560cfd3c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb1fa00640 1 --2- 172.21.15.103:0/270247449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560cfd3a8be0 0x560cfd3c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb20e00640 1 -- 172.21.15.103:0/270247449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560cfd3a8be0 msgr2=0x560cfd3c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb20e00640 1 --2- 172.21.15.103:0/270247449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560cfd3a8be0 0x560cfd3c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb20e00640 1 -- 172.21.15.103:0/270247449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560cfd2ef7a0 msgr2=0x560cfd3c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb20e00640 1 --2- 172.21.15.103:0/270247449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560cfd2ef7a0 0x560cfd3c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb20e00640 1 -- 172.21.15.103:0/270247449 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cfd216c10 con 0x560cfd3c3ce0 2024-09-10T22:44:58.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.253+0000 7fbb20e00640 1 --2- 172.21.15.103:0/270247449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560cfd3c3ce0 0x560cfd3a9310 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800c750 tx=0x7fbb1800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5580fdd4392e7b3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb1e600640 1 -- 172.21.15.103:0/270247449 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18004220 con 0x560cfd3c3ce0 2024-09-10T22:44:58.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb1e600640 1 -- 172.21.15.103:0/270247449 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb1800a840 con 0x560cfd3c3ce0 2024-09-10T22:44:58.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb1e600640 1 -- 172.21.15.103:0/270247449 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1800ac70 con 0x560cfd3c3ce0 2024-09-10T22:44:58.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb2322a080 1 -- 172.21.15.103:0/270247449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560cfd3c3ce0 msgr2=0x560cfd3a9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb2322a080 1 --2- 172.21.15.103:0/270247449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560cfd3c3ce0 0x560cfd3a9310 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800c750 tx=0x7fbb1800cc10 comp rx=0 tx=0).stop 2024-09-10T22:44:58.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb2322a080 1 -- 172.21.15.103:0/270247449 shutdown_connections 2024-09-10T22:44:58.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb2322a080 1 --2- 172.21.15.103:0/270247449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560cfd3c3ce0 0x560cfd3a9310 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb2322a080 1 --2- 172.21.15.103:0/270247449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560cfd3a8be0 0x560cfd3c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb2322a080 1 --2- 172.21.15.103:0/270247449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560cfd2ef7a0 0x560cfd3c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb2322a080 1 -- 172.21.15.103:0/270247449 >> 172.21.15.103:0/270247449 conn(0x560cfd2eec80 msgr2=0x560cfd31ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:58.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb2322a080 1 -- 172.21.15.103:0/270247449 shutdown_connections 2024-09-10T22:44:58.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb2322a080 1 -- 172.21.15.103:0/270247449 wait complete. 2024-09-10T22:44:58.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb2322a080 1 Processor -- start 2024-09-10T22:44:58.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb2322a080 1 -- start start 2024-09-10T22:44:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb2322a080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560cfd2ef7a0 0x560cfd3378a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb2322a080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560cfd3a8be0 0x560cfd3308b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb2322a080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560cfd3c3ce0 0x560cfd3c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb2322a080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560cfd3c51a0 con 0x560cfd3c3ce0 2024-09-10T22:44:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb2322a080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560cfd3c4f40 con 0x560cfd3a8be0 2024-09-10T22:44:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb2322a080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560cfd3c5440 con 0x560cfd2ef7a0 2024-09-10T22:44:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb20e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560cfd3c3ce0 0x560cfd3c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb20e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560cfd3c3ce0 0x560cfd3c6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40396/0 (socket says 172.21.15.103:40396) 2024-09-10T22:44:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb20e00640 1 -- 172.21.15.103:0/39568448 learned_addr learned my addr 172.21.15.103:0/39568448 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb1fa00640 1 --2- 172.21.15.103:0/39568448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560cfd3a8be0 0x560cfd3308b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb20400640 1 --2- 172.21.15.103:0/39568448 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560cfd2ef7a0 0x560cfd3378a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb20e00640 1 -- 172.21.15.103:0/39568448 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560cfd2ef7a0 msgr2=0x560cfd3378a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb20e00640 1 --2- 172.21.15.103:0/39568448 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560cfd2ef7a0 0x560cfd3378a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb20e00640 1 -- 172.21.15.103:0/39568448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560cfd3a8be0 msgr2=0x560cfd3308b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb20e00640 1 --2- 172.21.15.103:0/39568448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560cfd3a8be0 0x560cfd3308b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb20e00640 1 -- 172.21.15.103:0/39568448 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cfd3b0870 con 0x560cfd3c3ce0 2024-09-10T22:44:58.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb20e00640 1 --2- 172.21.15.103:0/39568448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560cfd3c3ce0 0x560cfd3c6c30 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800a630 tx=0x7fbb1800afb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb1d200640 1 -- 172.21.15.103:0/39568448 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1800a840 con 0x560cfd3c3ce0 2024-09-10T22:44:58.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb1d200640 1 -- 172.21.15.103:0/39568448 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb1800ce60 con 0x560cfd3c3ce0 2024-09-10T22:44:58.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb1d200640 1 -- 172.21.15.103:0/39568448 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1800f8d0 con 0x560cfd3c3ce0 2024-09-10T22:44:58.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.257+0000 7fbb2322a080 1 -- 172.21.15.103:0/39568448 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560cfd3b0b10 con 0x560cfd3c3ce0 2024-09-10T22:44:58.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.261+0000 7fbb2322a080 1 -- 172.21.15.103:0/39568448 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cfd3b1050 con 0x560cfd3c3ce0 2024-09-10T22:44:58.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.261+0000 7fbb1d200640 1 -- 172.21.15.103:0/39568448 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbb1800fa70 con 0x560cfd3c3ce0 2024-09-10T22:44:58.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.261+0000 7fbb1d200640 1 --2- 172.21.15.103:0/39568448 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbb00071190 0x7fbb00073650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.261+0000 7fbb1d200640 1 -- 172.21.15.103:0/39568448 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fbb18093c90 con 0x560cfd3c3ce0 2024-09-10T22:44:58.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.261+0000 7fbb20400640 1 --2- 172.21.15.103:0/39568448 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbb00071190 0x7fbb00073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.261+0000 7fbb2322a080 1 --2- 172.21.15.103:0/39568448 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x560cfd3b03f0 0x560cfd3b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.261+0000 7fbb2322a080 1 -- 172.21.15.103:0/39568448 --> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] -- osd_op(unknown.0.0:1 13.12 13:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x560cfd330df0 con 0x560cfd3b03f0 2024-09-10T22:44:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.261+0000 7fbb1fa00640 1 --2- 172.21.15.103:0/39568448 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x560cfd3b03f0 0x560cfd3b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.261+0000 7fbb20400640 1 --2- 172.21.15.103:0/39568448 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbb00071190 0x7fbb00073650 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbb10011570 tx=0x7fbb100017e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.265+0000 7fbb1fa00640 1 --2- 172.21.15.103:0/39568448 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x560cfd3b03f0 0x560cfd3b55d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.265+0000 7fbb1fa00640 1 -- 172.21.15.103:0/39568448 <== osd.0 v2:172.21.15.103:6808/2662233365 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v94'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fbb0c0b3040 con 0x560cfd3b03f0 2024-09-10T22:44:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.265+0000 7fbb2322a080 1 -- 172.21.15.103:0/39568448 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x560cfd3b03f0 msgr2=0x560cfd3b55d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.265+0000 7fbb2322a080 1 --2- 172.21.15.103:0/39568448 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x560cfd3b03f0 0x560cfd3b55d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.265+0000 7fbb2322a080 1 -- 172.21.15.103:0/39568448 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbb00071190 msgr2=0x7fbb00073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.265+0000 7fbb2322a080 1 --2- 172.21.15.103:0/39568448 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbb00071190 0x7fbb00073650 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbb10011570 tx=0x7fbb100017e0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.265+0000 7fbb2322a080 1 -- 172.21.15.103:0/39568448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560cfd3c3ce0 msgr2=0x560cfd3c6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.265+0000 7fbb2322a080 1 --2- 172.21.15.103:0/39568448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560cfd3c3ce0 0x560cfd3c6c30 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800a630 tx=0x7fbb1800afb0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.265+0000 7fbb20e00640 1 -- 172.21.15.103:0/39568448 reap_dead start 2024-09-10T22:44:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.265+0000 7fbb2322a080 1 -- 172.21.15.103:0/39568448 shutdown_connections 2024-09-10T22:44:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.265+0000 7fbb2322a080 1 -- 172.21.15.103:0/39568448 >> 172.21.15.103:0/39568448 conn(0x560cfd2eec80 msgr2=0x560cfd3c8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.265+0000 7fbb2322a080 1 -- 172.21.15.103:0/39568448 shutdown_connections 2024-09-10T22:44:58.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.265+0000 7fbb2322a080 1 -- 172.21.15.103:0/39568448 wait complete. 2024-09-10T22:44:58.274 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2024-09-10T22:44:58.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1dc453080 1 Processor -- start 2024-09-10T22:44:58.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1dc453080 1 -- start start 2024-09-10T22:44:58.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1dc453080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ecec040700 0x55ecec025600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1dc453080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecec0cd5c0 0x55ecec0c3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1dc453080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ecec0cd9a0 0x55ecec03c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1dc453080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ecebfa3f40 con 0x55ecec0cd9a0 2024-09-10T22:44:58.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1dc453080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ecebfb0d00 con 0x55ecec040700 2024-09-10T22:44:58.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1dc453080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ecebf45a00 con 0x55ecec0cd5c0 2024-09-10T22:44:58.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1da000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ecec0cd9a0 0x55ecec03c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1da000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ecec0cd9a0 0x55ecec03c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40428/0 (socket says 172.21.15.103:40428) 2024-09-10T22:44:58.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1da000640 1 -- 172.21.15.103:0/301879423 learned_addr learned my addr 172.21.15.103:0/301879423 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:58.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1d8c00640 1 --2- 172.21.15.103:0/301879423 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecec0cd5c0 0x55ecec0c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1d9600640 1 --2- 172.21.15.103:0/301879423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ecec040700 0x55ecec025600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1da000640 1 -- 172.21.15.103:0/301879423 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecec0cd5c0 msgr2=0x55ecec0c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1da000640 1 --2- 172.21.15.103:0/301879423 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecec0cd5c0 0x55ecec0c3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1da000640 1 -- 172.21.15.103:0/301879423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ecec040700 msgr2=0x55ecec025600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1da000640 1 --2- 172.21.15.103:0/301879423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ecec040700 0x55ecec025600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1da000640 1 -- 172.21.15.103:0/301879423 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecec027060 con 0x55ecec0cd9a0 2024-09-10T22:44:58.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1d8c00640 1 --2- 172.21.15.103:0/301879423 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecec0cd5c0 0x55ecec0c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:58.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1da000640 1 --2- 172.21.15.103:0/301879423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ecec0cd9a0 0x55ecec03c440 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40016f0 tx=0x7ff1d4001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b16362e5225e2ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1d3400640 1 -- 172.21.15.103:0/301879423 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4016070 con 0x55ecec0cd9a0 2024-09-10T22:44:58.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1d3400640 1 -- 172.21.15.103:0/301879423 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1d4010880 con 0x55ecec0cd9a0 2024-09-10T22:44:58.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1d3400640 1 -- 172.21.15.103:0/301879423 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4010cd0 con 0x55ecec0cd9a0 2024-09-10T22:44:58.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1dc453080 1 -- 172.21.15.103:0/301879423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ecec0cd9a0 msgr2=0x55ecec03c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1dc453080 1 --2- 172.21.15.103:0/301879423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ecec0cd9a0 0x55ecec03c440 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40016f0 tx=0x7ff1d4001bb0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1dc453080 1 -- 172.21.15.103:0/301879423 shutdown_connections 2024-09-10T22:44:58.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1dc453080 1 --2- 172.21.15.103:0/301879423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ecec0cd9a0 0x55ecec03c440 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1dc453080 1 --2- 172.21.15.103:0/301879423 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecec0cd5c0 0x55ecec0c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1dc453080 1 --2- 172.21.15.103:0/301879423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ecec040700 0x55ecec025600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1dc453080 1 -- 172.21.15.103:0/301879423 >> 172.21.15.103:0/301879423 conn(0x55ecebff8f30 msgr2=0x55ecec03d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:58.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1dc453080 1 -- 172.21.15.103:0/301879423 shutdown_connections 2024-09-10T22:44:58.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.317+0000 7ff1dc453080 1 -- 172.21.15.103:0/301879423 wait complete. 2024-09-10T22:44:58.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1dc453080 1 Processor -- start 2024-09-10T22:44:58.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1dc453080 1 -- start start 2024-09-10T22:44:58.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1dc453080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ecec040700 0x55ecec0c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1dc453080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ecec0cd5c0 0x55ecec166dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1dc453080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecec0cd9a0 0x55ecec0c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1dc453080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ecec0275a0 con 0x55ecec040700 2024-09-10T22:44:58.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1dc453080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ecec027300 con 0x55ecec0cd5c0 2024-09-10T22:44:58.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1dc453080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ecec027840 con 0x55ecec0cd9a0 2024-09-10T22:44:58.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1d9600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ecec040700 0x55ecec0c02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1d9600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ecec040700 0x55ecec0c02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40440/0 (socket says 172.21.15.103:40440) 2024-09-10T22:44:58.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1d9600640 1 -- 172.21.15.103:0/919948754 learned_addr learned my addr 172.21.15.103:0/919948754 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:58.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1d8c00640 1 --2- 172.21.15.103:0/919948754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ecec0cd5c0 0x55ecec166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1da000640 1 --2- 172.21.15.103:0/919948754 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecec0cd9a0 0x55ecec0c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1d9600640 1 -- 172.21.15.103:0/919948754 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecec0cd9a0 msgr2=0x55ecec0c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1d9600640 1 --2- 172.21.15.103:0/919948754 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecec0cd9a0 0x55ecec0c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1d9600640 1 -- 172.21.15.103:0/919948754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ecec0cd5c0 msgr2=0x55ecec166dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1d9600640 1 --2- 172.21.15.103:0/919948754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ecec0cd5c0 0x55ecec166dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1d9600640 1 -- 172.21.15.103:0/919948754 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecec0cc000 con 0x55ecec040700 2024-09-10T22:44:58.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1d9600640 1 --2- 172.21.15.103:0/919948754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ecec040700 0x55ecec0c02c0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00a460 tx=0x7ff1cc0aca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1d2000640 1 -- 172.21.15.103:0/919948754 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc0bc070 con 0x55ecec040700 2024-09-10T22:44:58.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1d2000640 1 -- 172.21.15.103:0/919948754 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1cc0acdb0 con 0x55ecec040700 2024-09-10T22:44:58.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1dc453080 1 -- 172.21.15.103:0/919948754 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecec0cc2a0 con 0x55ecec040700 2024-09-10T22:44:58.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1d2000640 1 -- 172.21.15.103:0/919948754 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc0b86d0 con 0x55ecec040700 2024-09-10T22:44:58.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.321+0000 7ff1dc453080 1 -- 172.21.15.103:0/919948754 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecec0cc7e0 con 0x55ecec040700 2024-09-10T22:44:58.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.325+0000 7ff1d2000640 1 -- 172.21.15.103:0/919948754 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff1cc0b6040 con 0x55ecec040700 2024-09-10T22:44:58.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.325+0000 7ff1d2000640 1 --2- 172.21.15.103:0/919948754 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff1bc070fc0 0x7ff1bc073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.325+0000 7ff1d2000640 1 -- 172.21.15.103:0/919948754 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7ff1cc12d740 con 0x55ecec040700 2024-09-10T22:44:58.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.325+0000 7ff1dc453080 1 --2- 172.21.15.103:0/919948754 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55ecec167310 0x55ecec161be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.325+0000 7ff1dc453080 1 -- 172.21.15.103:0/919948754 --> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] -- osd_op(unknown.0.0:1 13.12 13:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55ecec0c2a30 con 0x55ecec167310 2024-09-10T22:44:58.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.325+0000 7ff1d8c00640 1 --2- 172.21.15.103:0/919948754 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff1bc070fc0 0x7ff1bc073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.325+0000 7ff1da000640 1 --2- 172.21.15.103:0/919948754 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55ecec167310 0x55ecec161be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.325+0000 7ff1da000640 1 --2- 172.21.15.103:0/919948754 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55ecec167310 0x55ecec161be0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.325+0000 7ff1d8c00640 1 --2- 172.21.15.103:0/919948754 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff1bc070fc0 0x7ff1bc073480 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8000c10 tx=0x7ff1c80038e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.329+0000 7ff1da000640 1 -- 172.21.15.103:0/919948754 <== osd.0 v2:172.21.15.103:6808/2662233365 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v94'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff1d4019040 con 0x55ecec167310 2024-09-10T22:44:58.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.329+0000 7ff1dc453080 1 -- 172.21.15.103:0/919948754 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55ecec167310 msgr2=0x55ecec161be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.329+0000 7ff1dc453080 1 --2- 172.21.15.103:0/919948754 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x55ecec167310 0x55ecec161be0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.329+0000 7ff1dc453080 1 -- 172.21.15.103:0/919948754 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff1bc070fc0 msgr2=0x7ff1bc073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.329+0000 7ff1dc453080 1 --2- 172.21.15.103:0/919948754 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff1bc070fc0 0x7ff1bc073480 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8000c10 tx=0x7ff1c80038e0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.329+0000 7ff1dc453080 1 -- 172.21.15.103:0/919948754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ecec040700 msgr2=0x55ecec0c02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.329+0000 7ff1dc453080 1 --2- 172.21.15.103:0/919948754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ecec040700 0x55ecec0c02c0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00a460 tx=0x7ff1cc0aca10 comp rx=0 tx=0).stop 2024-09-10T22:44:58.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.329+0000 7ff1da000640 1 -- 172.21.15.103:0/919948754 reap_dead start 2024-09-10T22:44:58.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.329+0000 7ff1dc453080 1 -- 172.21.15.103:0/919948754 shutdown_connections 2024-09-10T22:44:58.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.329+0000 7ff1dc453080 1 -- 172.21.15.103:0/919948754 >> 172.21.15.103:0/919948754 conn(0x55ecebff8f30 msgr2=0x55ecec03d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:58.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.329+0000 7ff1dc453080 1 -- 172.21.15.103:0/919948754 shutdown_connections 2024-09-10T22:44:58.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.329+0000 7ff1dc453080 1 -- 172.21.15.103:0/919948754 wait complete. 2024-09-10T22:44:58.337 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2024-09-10T22:44:58.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.425+0000 7fa224bd9080 1 Processor -- start 2024-09-10T22:44:58.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.425+0000 7fa224bd9080 1 -- start start 2024-09-10T22:44:58.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.425+0000 7fa224bd9080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d800038b0 0x564d7ffd0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.425+0000 7fa224bd9080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d8001d8e0 0x564d800a6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.425+0000 7fa224bd9080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564d800a7570 0x564d800a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.425+0000 7fa224bd9080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564d7ff1fa00 con 0x564d8001d8e0 2024-09-10T22:44:58.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.425+0000 7fa224bd9080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x564d7ff7df40 con 0x564d800038b0 2024-09-10T22:44:58.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.425+0000 7fa224bd9080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x564d8008cbf0 con 0x564d800a7570 2024-09-10T22:44:58.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.425+0000 7fa221400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d8001d8e0 0x564d800a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.425+0000 7fa221400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d8001d8e0 0x564d800a6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40454/0 (socket says 172.21.15.103:40454) 2024-09-10T22:44:58.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.425+0000 7fa221400640 1 -- 172.21.15.103:0/397179253 learned_addr learned my addr 172.21.15.103:0/397179253 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:58.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.425+0000 7fa222800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564d800a7570 0x564d800a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.425+0000 7fa221e00640 1 --2- 172.21.15.103:0/397179253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d800038b0 0x564d7ffd0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.425+0000 7fa221400640 1 -- 172.21.15.103:0/397179253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564d800a7570 msgr2=0x564d800a9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.425+0000 7fa221400640 1 --2- 172.21.15.103:0/397179253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564d800a7570 0x564d800a9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.425+0000 7fa221400640 1 -- 172.21.15.103:0/397179253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d800038b0 msgr2=0x564d7ffd0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.425+0000 7fa221400640 1 --2- 172.21.15.103:0/397179253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d800038b0 0x564d7ffd0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.425+0000 7fa221400640 1 -- 172.21.15.103:0/397179253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d7fef8c10 con 0x564d8001d8e0 2024-09-10T22:44:58.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa221400640 1 --2- 172.21.15.103:0/397179253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d8001d8e0 0x564d800a6240 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fa21000b220 tx=0x7fa21000b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2acf0d1657983a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa21be00640 1 -- 172.21.15.103:0/397179253 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21000a040 con 0x564d8001d8e0 2024-09-10T22:44:58.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa21be00640 1 -- 172.21.15.103:0/397179253 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa21000f620 con 0x564d8001d8e0 2024-09-10T22:44:58.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa21be00640 1 -- 172.21.15.103:0/397179253 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21000fa70 con 0x564d8001d8e0 2024-09-10T22:44:58.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa224bd9080 1 -- 172.21.15.103:0/397179253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d8001d8e0 msgr2=0x564d800a6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa224bd9080 1 --2- 172.21.15.103:0/397179253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d8001d8e0 0x564d800a6240 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fa21000b220 tx=0x7fa21000b6e0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa224bd9080 1 -- 172.21.15.103:0/397179253 shutdown_connections 2024-09-10T22:44:58.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa224bd9080 1 --2- 172.21.15.103:0/397179253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564d800a7570 0x564d800a9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa224bd9080 1 --2- 172.21.15.103:0/397179253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d8001d8e0 0x564d800a6240 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa224bd9080 1 --2- 172.21.15.103:0/397179253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d800038b0 0x564d7ffd0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa224bd9080 1 -- 172.21.15.103:0/397179253 >> 172.21.15.103:0/397179253 conn(0x564d7ffcedb0 msgr2=0x564d7ffcfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:58.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa224bd9080 1 -- 172.21.15.103:0/397179253 shutdown_connections 2024-09-10T22:44:58.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa224bd9080 1 -- 172.21.15.103:0/397179253 wait complete. 2024-09-10T22:44:58.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa224bd9080 1 Processor -- start 2024-09-10T22:44:58.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa224bd9080 1 -- start start 2024-09-10T22:44:58.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa224bd9080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d800038b0 0x564d7ffd2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa224bd9080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564d8001d8e0 0x564d80089260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa224bd9080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d800a7570 0x564d7ffd4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa224bd9080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564d8008a570 con 0x564d800a7570 2024-09-10T22:44:58.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa224bd9080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x564d8008a2d0 con 0x564d800038b0 2024-09-10T22:44:58.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa224bd9080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x564d8008a810 con 0x564d8001d8e0 2024-09-10T22:44:58.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa222800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d800a7570 0x564d7ffd4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa222800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d800a7570 0x564d7ffd4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40456/0 (socket says 172.21.15.103:40456) 2024-09-10T22:44:58.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa222800640 1 -- 172.21.15.103:0/1977911845 learned_addr learned my addr 172.21.15.103:0/1977911845 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:58.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa221400640 1 --2- 172.21.15.103:0/1977911845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564d8001d8e0 0x564d80089260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa221e00640 1 --2- 172.21.15.103:0/1977911845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d800038b0 0x564d7ffd2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa222800640 1 -- 172.21.15.103:0/1977911845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564d8001d8e0 msgr2=0x564d80089260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa222800640 1 --2- 172.21.15.103:0/1977911845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564d8001d8e0 0x564d80089260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa222800640 1 -- 172.21.15.103:0/1977911845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d800038b0 msgr2=0x564d7ffd2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa222800640 1 --2- 172.21.15.103:0/1977911845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d800038b0 0x564d7ffd2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa222800640 1 -- 172.21.15.103:0/1977911845 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d8008f3a0 con 0x564d800a7570 2024-09-10T22:44:58.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa221e00640 1 --2- 172.21.15.103:0/1977911845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d800038b0 0x564d7ffd2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:58.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa221400640 1 --2- 172.21.15.103:0/1977911845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564d8001d8e0 0x564d80089260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:58.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.429+0000 7fa222800640 1 --2- 172.21.15.103:0/1977911845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d800a7570 0x564d7ffd4520 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00a600 tx=0x7fa21c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.433+0000 7fa21aa00640 1 -- 172.21.15.103:0/1977911845 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c0bb030 con 0x564d800a7570 2024-09-10T22:44:58.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.433+0000 7fa21aa00640 1 -- 172.21.15.103:0/1977911845 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa21c0b0040 con 0x564d800a7570 2024-09-10T22:44:58.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.433+0000 7fa21aa00640 1 -- 172.21.15.103:0/1977911845 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c0af070 con 0x564d800a7570 2024-09-10T22:44:58.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.433+0000 7fa224bd9080 1 -- 172.21.15.103:0/1977911845 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d8008f640 con 0x564d800a7570 2024-09-10T22:44:58.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.433+0000 7fa224bd9080 1 -- 172.21.15.103:0/1977911845 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d8008fb80 con 0x564d800a7570 2024-09-10T22:44:58.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.433+0000 7fa21aa00640 1 -- 172.21.15.103:0/1977911845 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa21c0b5040 con 0x564d800a7570 2024-09-10T22:44:58.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.433+0000 7fa21aa00640 1 --2- 172.21.15.103:0/1977911845 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa204070fc0 0x7fa204073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.433+0000 7fa21aa00640 1 -- 172.21.15.103:0/1977911845 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fa21c12d660 con 0x564d800a7570 2024-09-10T22:44:58.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.433+0000 7fa221e00640 1 --2- 172.21.15.103:0/1977911845 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa204070fc0 0x7fa204073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.433+0000 7fa224bd9080 1 --2- 172.21.15.103:0/1977911845 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x564d800a5030 0x564d80090020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.433+0000 7fa224bd9080 1 -- 172.21.15.103:0/1977911845 --> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] -- osd_op(unknown.0.0:1 13.5 13:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x564d80090560 con 0x564d800a5030 2024-09-10T22:44:58.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.437+0000 7fa221400640 1 --2- 172.21.15.103:0/1977911845 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x564d800a5030 0x564d80090020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.437+0000 7fa221e00640 1 --2- 172.21.15.103:0/1977911845 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa204070fc0 0x7fa204073480 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa21400c860 tx=0x7fa21400f040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.437+0000 7fa221400640 1 --2- 172.21.15.103:0/1977911845 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x564d800a5030 0x564d80090020 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.437+0000 7fa221400640 1 -- 172.21.15.103:0/1977911845 <== osd.4 v2:172.21.15.131:6810/2178799193 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v94'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa21000d040 con 0x564d800a5030 2024-09-10T22:44:58.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.437+0000 7fa224bd9080 1 -- 172.21.15.103:0/1977911845 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x564d800a5030 msgr2=0x564d80090020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.437+0000 7fa224bd9080 1 --2- 172.21.15.103:0/1977911845 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x564d800a5030 0x564d80090020 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.437+0000 7fa224bd9080 1 -- 172.21.15.103:0/1977911845 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa204070fc0 msgr2=0x7fa204073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.437+0000 7fa224bd9080 1 --2- 172.21.15.103:0/1977911845 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa204070fc0 0x7fa204073480 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa21400c860 tx=0x7fa21400f040 comp rx=0 tx=0).stop 2024-09-10T22:44:58.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.437+0000 7fa224bd9080 1 -- 172.21.15.103:0/1977911845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d800a7570 msgr2=0x564d7ffd4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.437+0000 7fa224bd9080 1 --2- 172.21.15.103:0/1977911845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d800a7570 0x564d7ffd4520 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00a600 tx=0x7fa21c004ab0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.437+0000 7fa222800640 1 -- 172.21.15.103:0/1977911845 reap_dead start 2024-09-10T22:44:58.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.437+0000 7fa224bd9080 1 -- 172.21.15.103:0/1977911845 shutdown_connections 2024-09-10T22:44:58.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.437+0000 7fa224bd9080 1 -- 172.21.15.103:0/1977911845 >> 172.21.15.103:0/1977911845 conn(0x564d7ffcedb0 msgr2=0x564d800a60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:58.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.437+0000 7fa224bd9080 1 -- 172.21.15.103:0/1977911845 shutdown_connections 2024-09-10T22:44:58.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.437+0000 7fa224bd9080 1 -- 172.21.15.103:0/1977911845 wait complete. 2024-09-10T22:44:58.447 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2024-09-10T22:44:58.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bdfa47080 1 Processor -- start 2024-09-10T22:44:58.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bdfa47080 1 -- start start 2024-09-10T22:44:58.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bdfa47080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5612018987a0 0x56120196e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bdfa47080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561201951be0 0x561201a04590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bdfa47080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56120196c210 0x561201a04ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bdfa47080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5612017e6a00 con 0x561201951be0 2024-09-10T22:44:58.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bdfa47080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x561201844f40 con 0x56120196c210 2024-09-10T22:44:58.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bdfa47080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5612019783c0 con 0x5612018987a0 2024-09-10T22:44:58.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bd7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561201951be0 0x561201a04590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bd7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561201951be0 0x561201a04590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40464/0 (socket says 172.21.15.103:40464) 2024-09-10T22:44:58.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bd7e00640 1 -- 172.21.15.103:0/4125803439 learned_addr learned my addr 172.21.15.103:0/4125803439 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:58.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bdcc00640 1 --2- 172.21.15.103:0/4125803439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5612018987a0 0x56120196e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bdd600640 1 --2- 172.21.15.103:0/4125803439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56120196c210 0x561201a04ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bd7e00640 1 -- 172.21.15.103:0/4125803439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5612018987a0 msgr2=0x56120196e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bd7e00640 1 --2- 172.21.15.103:0/4125803439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5612018987a0 0x56120196e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bd7e00640 1 -- 172.21.15.103:0/4125803439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56120196c210 msgr2=0x561201a04ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bd7e00640 1 --2- 172.21.15.103:0/4125803439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56120196c210 0x561201a04ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bd7e00640 1 -- 172.21.15.103:0/4125803439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612017bfc10 con 0x561201951be0 2024-09-10T22:44:58.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bd7e00640 1 --2- 172.21.15.103:0/4125803439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561201951be0 0x561201a04590 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800b7d0 tx=0x7f4bc800bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2352483b50bfb995 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bd6a00640 1 -- 172.21.15.103:0/4125803439 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc800abb0 con 0x561201951be0 2024-09-10T22:44:58.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bd6a00640 1 -- 172.21.15.103:0/4125803439 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bc800ad50 con 0x561201951be0 2024-09-10T22:44:58.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.489+0000 7f4bd6a00640 1 -- 172.21.15.103:0/4125803439 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc80086c0 con 0x561201951be0 2024-09-10T22:44:58.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 -- 172.21.15.103:0/4125803439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561201951be0 msgr2=0x561201a04590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 --2- 172.21.15.103:0/4125803439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561201951be0 0x561201a04590 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800b7d0 tx=0x7f4bc800bc90 comp rx=0 tx=0).stop 2024-09-10T22:44:58.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 -- 172.21.15.103:0/4125803439 shutdown_connections 2024-09-10T22:44:58.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 --2- 172.21.15.103:0/4125803439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56120196c210 0x561201a04ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 --2- 172.21.15.103:0/4125803439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561201951be0 0x561201a04590 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 --2- 172.21.15.103:0/4125803439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5612018987a0 0x56120196e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 -- 172.21.15.103:0/4125803439 >> 172.21.15.103:0/4125803439 conn(0x561201897c80 msgr2=0x561201898060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:58.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 -- 172.21.15.103:0/4125803439 shutdown_connections 2024-09-10T22:44:58.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 -- 172.21.15.103:0/4125803439 wait complete. 2024-09-10T22:44:58.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 Processor -- start 2024-09-10T22:44:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 -- start start 2024-09-10T22:44:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612018987a0 0x561201974500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561201951be0 0x561201940fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56120196c210 0x561201a0bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56120196b3b0 con 0x56120196c210 2024-09-10T22:44:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56120196b110 con 0x5612018987a0 2024-09-10T22:44:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56120196b650 con 0x561201951be0 2024-09-10T22:44:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdd600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56120196c210 0x561201a0bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdd600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56120196c210 0x561201a0bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40476/0 (socket says 172.21.15.103:40476) 2024-09-10T22:44:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdd600640 1 -- 172.21.15.103:0/1132395129 learned_addr learned my addr 172.21.15.103:0/1132395129 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bd7e00640 1 --2- 172.21.15.103:0/1132395129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561201951be0 0x561201940fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdcc00640 1 --2- 172.21.15.103:0/1132395129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612018987a0 0x561201974500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdd600640 1 -- 172.21.15.103:0/1132395129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561201951be0 msgr2=0x561201940fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdd600640 1 --2- 172.21.15.103:0/1132395129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561201951be0 0x561201940fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdd600640 1 -- 172.21.15.103:0/1132395129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612018987a0 msgr2=0x561201974500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdd600640 1 --2- 172.21.15.103:0/1132395129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612018987a0 0x561201974500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdd600640 1 -- 172.21.15.103:0/1132395129 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561201974ba0 con 0x56120196c210 2024-09-10T22:44:58.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdcc00640 1 --2- 172.21.15.103:0/1132395129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612018987a0 0x561201974500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:58.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdd600640 1 --2- 172.21.15.103:0/1132395129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56120196c210 0x561201a0bd30 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800d4a0 tx=0x7f4bd800d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bd5600640 1 -- 172.21.15.103:0/1132395129 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd80125f0 con 0x56120196c210 2024-09-10T22:44:58.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bd5600640 1 -- 172.21.15.103:0/1132395129 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bd8018070 con 0x56120196c210 2024-09-10T22:44:58.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bd5600640 1 -- 172.21.15.103:0/1132395129 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8012b40 con 0x56120196c210 2024-09-10T22:44:58.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 -- 172.21.15.103:0/1132395129 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561201974e40 con 0x56120196c210 2024-09-10T22:44:58.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.493+0000 7f4bdfa47080 1 -- 172.21.15.103:0/1132395129 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561201975380 con 0x56120196c210 2024-09-10T22:44:58.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.497+0000 7f4bd5600640 1 -- 172.21.15.103:0/1132395129 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4bd8012ce0 con 0x56120196c210 2024-09-10T22:44:58.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.497+0000 7f4bd5600640 1 --2- 172.21.15.103:0/1132395129 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4bbc070ff0 0x7f4bbc0734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.497+0000 7f4bd5600640 1 -- 172.21.15.103:0/1132395129 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f4bd8092330 con 0x56120196c210 2024-09-10T22:44:58.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.497+0000 7f4bdcc00640 1 --2- 172.21.15.103:0/1132395129 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4bbc070ff0 0x7f4bbc0734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.497+0000 7f4bdfa47080 1 --2- 172.21.15.103:0/1132395129 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x56120193e630 0x56120193ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.497+0000 7f4bdfa47080 1 -- 172.21.15.103:0/1132395129 --> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] -- osd_op(unknown.0.0:1 13.9 13:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x56120193ef50 con 0x56120193e630 2024-09-10T22:44:58.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.497+0000 7f4bd7e00640 1 --2- 172.21.15.103:0/1132395129 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x56120193e630 0x56120193ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.497+0000 7f4bdcc00640 1 --2- 172.21.15.103:0/1132395129 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4bbc070ff0 0x7f4bbc0734b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00ab000 tx=0x7f4bd00198d0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.497+0000 7f4bd7e00640 1 --2- 172.21.15.103:0/1132395129 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x56120193e630 0x56120193ea10 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.501+0000 7f4bd7e00640 1 -- 172.21.15.103:0/1132395129 <== osd.5 v2:172.21.15.131:6800/175724775 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v94'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4bc8008460 con 0x56120193e630 2024-09-10T22:44:58.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.501+0000 7f4bdfa47080 1 -- 172.21.15.103:0/1132395129 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x56120193e630 msgr2=0x56120193ea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.501+0000 7f4bdfa47080 1 --2- 172.21.15.103:0/1132395129 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x56120193e630 0x56120193ea10 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.501+0000 7f4bdfa47080 1 -- 172.21.15.103:0/1132395129 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4bbc070ff0 msgr2=0x7f4bbc0734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.501+0000 7f4bdfa47080 1 --2- 172.21.15.103:0/1132395129 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4bbc070ff0 0x7f4bbc0734b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00ab000 tx=0x7f4bd00198d0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.501+0000 7f4bdfa47080 1 -- 172.21.15.103:0/1132395129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56120196c210 msgr2=0x561201a0bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.501+0000 7f4bdfa47080 1 --2- 172.21.15.103:0/1132395129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56120196c210 0x561201a0bd30 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800d4a0 tx=0x7f4bd800d960 comp rx=0 tx=0).stop 2024-09-10T22:44:58.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.501+0000 7f4bdd600640 1 -- 172.21.15.103:0/1132395129 reap_dead start 2024-09-10T22:44:58.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.501+0000 7f4bdfa47080 1 -- 172.21.15.103:0/1132395129 shutdown_connections 2024-09-10T22:44:58.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.501+0000 7f4bdfa47080 1 -- 172.21.15.103:0/1132395129 >> 172.21.15.103:0/1132395129 conn(0x561201897c80 msgr2=0x561201950ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:58.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.501+0000 7f4bdfa47080 1 -- 172.21.15.103:0/1132395129 shutdown_connections 2024-09-10T22:44:58.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.501+0000 7f4bdfa47080 1 -- 172.21.15.103:0/1132395129 wait complete. 2024-09-10T22:44:58.510 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2024-09-10T22:44:58.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.549+0000 7fed9022b080 1 Processor -- start 2024-09-10T22:44:58.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.549+0000 7fed9022b080 1 -- start start 2024-09-10T22:44:58.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed9022b080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563d5fbd3db0 0x563d5fc1c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed9022b080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563d5fc154d0 0x563d5fca90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed9022b080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d5fcaa510 0x563d5fca9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed9022b080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563d5fb24a00 con 0x563d5fcaa510 2024-09-10T22:44:58.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed9022b080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563d5fb82f40 con 0x563d5fc154d0 2024-09-10T22:44:58.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed9022b080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563d5fcab310 con 0x563d5fbd3db0 2024-09-10T22:44:58.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed8d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d5fcaa510 0x563d5fca9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed8d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d5fcaa510 0x563d5fca9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40506/0 (socket says 172.21.15.103:40506) 2024-09-10T22:44:58.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed8d000640 1 -- 172.21.15.103:0/1336646590 learned_addr learned my addr 172.21.15.103:0/1336646590 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:58.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed8c600640 1 --2- 172.21.15.103:0/1336646590 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563d5fbd3db0 0x563d5fc1c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed8bc00640 1 --2- 172.21.15.103:0/1336646590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563d5fc154d0 0x563d5fca90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed8d000640 1 -- 172.21.15.103:0/1336646590 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563d5fbd3db0 msgr2=0x563d5fc1c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed8d000640 1 --2- 172.21.15.103:0/1336646590 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563d5fbd3db0 0x563d5fc1c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed8d000640 1 -- 172.21.15.103:0/1336646590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563d5fc154d0 msgr2=0x563d5fca90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed8d000640 1 --2- 172.21.15.103:0/1336646590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563d5fc154d0 0x563d5fca90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed8d000640 1 -- 172.21.15.103:0/1336646590 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d5fafdc10 con 0x563d5fcaa510 2024-09-10T22:44:58.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed8d000640 1 --2- 172.21.15.103:0/1336646590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d5fcaa510 0x563d5fca9620 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fed840026f0 tx=0x7fed84002bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f706d48766be9531 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed8a800640 1 -- 172.21.15.103:0/1336646590 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed84017070 con 0x563d5fcaa510 2024-09-10T22:44:58.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed8a800640 1 -- 172.21.15.103:0/1336646590 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed8400f7e0 con 0x563d5fcaa510 2024-09-10T22:44:58.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed8a800640 1 -- 172.21.15.103:0/1336646590 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8400fc10 con 0x563d5fcaa510 2024-09-10T22:44:58.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed9022b080 1 -- 172.21.15.103:0/1336646590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d5fcaa510 msgr2=0x563d5fca9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed9022b080 1 --2- 172.21.15.103:0/1336646590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d5fcaa510 0x563d5fca9620 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fed840026f0 tx=0x7fed84002bb0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed9022b080 1 -- 172.21.15.103:0/1336646590 shutdown_connections 2024-09-10T22:44:58.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed9022b080 1 --2- 172.21.15.103:0/1336646590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d5fcaa510 0x563d5fca9620 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed9022b080 1 --2- 172.21.15.103:0/1336646590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563d5fc154d0 0x563d5fca90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed9022b080 1 --2- 172.21.15.103:0/1336646590 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563d5fbd3db0 0x563d5fc1c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed9022b080 1 -- 172.21.15.103:0/1336646590 >> 172.21.15.103:0/1336646590 conn(0x563d5fbd5c80 msgr2=0x563d5fc18930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:58.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed9022b080 1 -- 172.21.15.103:0/1336646590 shutdown_connections 2024-09-10T22:44:58.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed9022b080 1 -- 172.21.15.103:0/1336646590 wait complete. 2024-09-10T22:44:58.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed9022b080 1 Processor -- start 2024-09-10T22:44:58.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.553+0000 7fed9022b080 1 -- start start 2024-09-10T22:44:58.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed9022b080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563d5fbd3db0 0x563d5fc927d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed9022b080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d5fc154d0 0x563d5fcb4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed9022b080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563d5fcaa510 0x563d5fc94070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed9022b080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563d5fc1ee50 con 0x563d5fc154d0 2024-09-10T22:44:58.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed9022b080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563d5fc1e1d0 con 0x563d5fbd3db0 2024-09-10T22:44:58.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed9022b080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563d5fc1e470 con 0x563d5fcaa510 2024-09-10T22:44:58.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed8bc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d5fc154d0 0x563d5fcb4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed8bc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d5fc154d0 0x563d5fcb4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40514/0 (socket says 172.21.15.103:40514) 2024-09-10T22:44:58.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed8bc00640 1 -- 172.21.15.103:0/2117813874 learned_addr learned my addr 172.21.15.103:0/2117813874 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:58.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed8c600640 1 --2- 172.21.15.103:0/2117813874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563d5fbd3db0 0x563d5fc927d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed8bc00640 1 -- 172.21.15.103:0/2117813874 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563d5fcaa510 msgr2=0x563d5fc94070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed8bc00640 1 --2- 172.21.15.103:0/2117813874 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563d5fcaa510 0x563d5fc94070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed8bc00640 1 -- 172.21.15.103:0/2117813874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563d5fbd3db0 msgr2=0x563d5fc927d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed8bc00640 1 --2- 172.21.15.103:0/2117813874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563d5fbd3db0 0x563d5fc927d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed8bc00640 1 -- 172.21.15.103:0/2117813874 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d5fc93150 con 0x563d5fc154d0 2024-09-10T22:44:58.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed8bc00640 1 --2- 172.21.15.103:0/2117813874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d5fc154d0 0x563d5fcb4450 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fed78008780 tx=0x7fed78008c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed89400640 1 -- 172.21.15.103:0/2117813874 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7800ad70 con 0x563d5fc154d0 2024-09-10T22:44:58.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed89400640 1 -- 172.21.15.103:0/2117813874 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed78015420 con 0x563d5fc154d0 2024-09-10T22:44:58.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed89400640 1 -- 172.21.15.103:0/2117813874 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed78015850 con 0x563d5fc154d0 2024-09-10T22:44:58.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed9022b080 1 -- 172.21.15.103:0/2117813874 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d5fc933f0 con 0x563d5fc154d0 2024-09-10T22:44:58.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed9022b080 1 -- 172.21.15.103:0/2117813874 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d5fc93930 con 0x563d5fc154d0 2024-09-10T22:44:58.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.557+0000 7fed89400640 1 -- 172.21.15.103:0/2117813874 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fed780159f0 con 0x563d5fc154d0 2024-09-10T22:44:58.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed89400640 1 --2- 172.21.15.103:0/2117813874 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fed6c070ff0 0x7fed6c0734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed89400640 1 -- 172.21.15.103:0/2117813874 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fed78092720 con 0x563d5fc154d0 2024-09-10T22:44:58.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed9022b080 1 --2- 172.21.15.103:0/2117813874 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x563d5fc945b0 0x563d5fd45a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed9022b080 1 -- 172.21.15.103:0/2117813874 --> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] -- osd_op(unknown.0.0:1 13.5 13:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x563d5fc92d10 con 0x563d5fc945b0 2024-09-10T22:44:58.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed8c600640 1 --2- 172.21.15.103:0/2117813874 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fed6c070ff0 0x7fed6c0734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed8d000640 1 --2- 172.21.15.103:0/2117813874 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x563d5fc945b0 0x563d5fd45a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed8c600640 1 --2- 172.21.15.103:0/2117813874 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fed6c070ff0 0x7fed6c0734b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0ab000 tx=0x7fed7c0199c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed8d000640 1 --2- 172.21.15.103:0/2117813874 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x563d5fc945b0 0x563d5fd45a10 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed8d000640 1 -- 172.21.15.103:0/2117813874 <== osd.4 v2:172.21.15.131:6810/2178799193 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v94'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fed8401a040 con 0x563d5fc945b0 2024-09-10T22:44:58.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed9022b080 1 -- 172.21.15.103:0/2117813874 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x563d5fc945b0 msgr2=0x563d5fd45a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed9022b080 1 --2- 172.21.15.103:0/2117813874 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x563d5fc945b0 0x563d5fd45a10 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed9022b080 1 -- 172.21.15.103:0/2117813874 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fed6c070ff0 msgr2=0x7fed6c0734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed9022b080 1 --2- 172.21.15.103:0/2117813874 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fed6c070ff0 0x7fed6c0734b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0ab000 tx=0x7fed7c0199c0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed9022b080 1 -- 172.21.15.103:0/2117813874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d5fc154d0 msgr2=0x563d5fcb4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed9022b080 1 --2- 172.21.15.103:0/2117813874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563d5fc154d0 0x563d5fcb4450 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fed78008780 tx=0x7fed78008c40 comp rx=0 tx=0).stop 2024-09-10T22:44:58.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed8d000640 1 -- 172.21.15.103:0/2117813874 reap_dead start 2024-09-10T22:44:58.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed9022b080 1 -- 172.21.15.103:0/2117813874 shutdown_connections 2024-09-10T22:44:58.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed9022b080 1 -- 172.21.15.103:0/2117813874 >> 172.21.15.103:0/2117813874 conn(0x563d5fbd5c80 msgr2=0x563d5fca90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:58.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed9022b080 1 -- 172.21.15.103:0/2117813874 shutdown_connections 2024-09-10T22:44:58.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.561+0000 7fed9022b080 1 -- 172.21.15.103:0/2117813874 wait complete. 2024-09-10T22:44:58.571 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2024-09-10T22:44:58.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafcd52d080 1 Processor -- start 2024-09-10T22:44:58.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafcd52d080 1 -- start start 2024-09-10T22:44:58.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafcd52d080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627862ff380 0x5627862b7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafcd52d080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562786374e00 0x562786300c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafcd52d080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5627862fb440 0x5627862e6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafcd52d080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562786205a00 con 0x5627862fb440 2024-09-10T22:44:58.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafcd52d080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562786263f40 con 0x5627862ff380 2024-09-10T22:44:58.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafcd52d080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56278638d2a0 con 0x562786374e00 2024-09-10T22:44:58.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafcb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5627862fb440 0x5627862e6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafcb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5627862fb440 0x5627862e6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40532/0 (socket says 172.21.15.103:40532) 2024-09-10T22:44:58.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafcb200640 1 -- 172.21.15.103:0/127345990 learned_addr learned my addr 172.21.15.103:0/127345990 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:58.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafc9e00640 1 --2- 172.21.15.103:0/127345990 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562786374e00 0x562786300c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafca800640 1 --2- 172.21.15.103:0/127345990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627862ff380 0x5627862b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafcb200640 1 -- 172.21.15.103:0/127345990 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562786374e00 msgr2=0x562786300c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafcb200640 1 --2- 172.21.15.103:0/127345990 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562786374e00 0x562786300c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafcb200640 1 -- 172.21.15.103:0/127345990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627862ff380 msgr2=0x5627862b7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafcb200640 1 --2- 172.21.15.103:0/127345990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627862ff380 0x5627862b7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafcb200640 1 -- 172.21.15.103:0/127345990 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627861dec10 con 0x5627862fb440 2024-09-10T22:44:58.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafc9e00640 1 --2- 172.21.15.103:0/127345990 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562786374e00 0x562786300c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:58.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafca800640 1 --2- 172.21.15.103:0/127345990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627862ff380 0x5627862b7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:58.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafcb200640 1 --2- 172.21.15.103:0/127345990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5627862fb440 0x5627862e6ec0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fafc4019af0 tx=0x7fafc40181e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2c753d18dada7b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafc8a00640 1 -- 172.21.15.103:0/127345990 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc40ba020 con 0x5627862fb440 2024-09-10T22:44:58.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafc8a00640 1 -- 172.21.15.103:0/127345990 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafc40b0040 con 0x5627862fb440 2024-09-10T22:44:58.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.657+0000 7fafc8a00640 1 -- 172.21.15.103:0/127345990 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc40af070 con 0x5627862fb440 2024-09-10T22:44:58.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 -- 172.21.15.103:0/127345990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5627862fb440 msgr2=0x5627862e6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 --2- 172.21.15.103:0/127345990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5627862fb440 0x5627862e6ec0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fafc4019af0 tx=0x7fafc40181e0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 -- 172.21.15.103:0/127345990 shutdown_connections 2024-09-10T22:44:58.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 --2- 172.21.15.103:0/127345990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5627862fb440 0x5627862e6ec0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 --2- 172.21.15.103:0/127345990 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562786374e00 0x562786300c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 --2- 172.21.15.103:0/127345990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627862ff380 0x5627862b7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 -- 172.21.15.103:0/127345990 >> 172.21.15.103:0/127345990 conn(0x5627862b8f30 msgr2=0x5627862fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:58.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 -- 172.21.15.103:0/127345990 shutdown_connections 2024-09-10T22:44:58.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 -- 172.21.15.103:0/127345990 wait complete. 2024-09-10T22:44:58.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 Processor -- start 2024-09-10T22:44:58.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 -- start start 2024-09-10T22:44:58.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5627862fb440 0x5627862b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5627862ff380 0x56278638afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562786374e00 0x562786370400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5627862fdcd0 con 0x5627862ff380 2024-09-10T22:44:58.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5627862fdf70 con 0x562786374e00 2024-09-10T22:44:58.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5627862b7460 con 0x5627862fb440 2024-09-10T22:44:58.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafc9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5627862ff380 0x56278638afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafc9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5627862ff380 0x56278638afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40548/0 (socket says 172.21.15.103:40548) 2024-09-10T22:44:58.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafc9e00640 1 -- 172.21.15.103:0/2251830229 learned_addr learned my addr 172.21.15.103:0/2251830229 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:58.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafca800640 1 --2- 172.21.15.103:0/2251830229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5627862fb440 0x5627862b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcb200640 1 --2- 172.21.15.103:0/2251830229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562786374e00 0x562786370400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafc9e00640 1 -- 172.21.15.103:0/2251830229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5627862fb440 msgr2=0x5627862b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafc9e00640 1 --2- 172.21.15.103:0/2251830229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5627862fb440 0x5627862b69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafc9e00640 1 -- 172.21.15.103:0/2251830229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562786374e00 msgr2=0x562786370400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafc9e00640 1 --2- 172.21.15.103:0/2251830229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562786374e00 0x562786370400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafc9e00640 1 -- 172.21.15.103:0/2251830229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562786374320 con 0x5627862ff380 2024-09-10T22:44:58.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafc9e00640 1 --2- 172.21.15.103:0/2251830229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5627862ff380 0x56278638afc0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fafb800cfd0 tx=0x7fafb800a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafc3400640 1 -- 172.21.15.103:0/2251830229 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8010680 con 0x5627862ff380 2024-09-10T22:44:58.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafc3400640 1 -- 172.21.15.103:0/2251830229 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafb8010820 con 0x5627862ff380 2024-09-10T22:44:58.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafc3400640 1 -- 172.21.15.103:0/2251830229 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8010c50 con 0x5627862ff380 2024-09-10T22:44:58.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 -- 172.21.15.103:0/2251830229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627863745c0 con 0x5627862ff380 2024-09-10T22:44:58.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.661+0000 7fafcd52d080 1 -- 172.21.15.103:0/2251830229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562786374860 con 0x5627862ff380 2024-09-10T22:44:58.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.665+0000 7fafc3400640 1 -- 172.21.15.103:0/2251830229 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fafb801b470 con 0x5627862ff380 2024-09-10T22:44:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.665+0000 7fafc3400640 1 --2- 172.21.15.103:0/2251830229 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafac070fc0 0x7fafac073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.665+0000 7fafc3400640 1 -- 172.21.15.103:0/2251830229 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fafb8092180 con 0x5627862ff380 2024-09-10T22:44:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.665+0000 7fafcd52d080 1 --2- 172.21.15.103:0/2251830229 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x562786301d40 0x5627864276d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.665+0000 7fafcd52d080 1 -- 172.21.15.103:0/2251830229 --> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] -- osd_op(unknown.0.0:1 13.1d 13:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x562786427c10 con 0x562786301d40 2024-09-10T22:44:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.665+0000 7fafca800640 1 --2- 172.21.15.103:0/2251830229 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafac070fc0 0x7fafac073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.665+0000 7fafcb200640 1 --2- 172.21.15.103:0/2251830229 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x562786301d40 0x5627864276d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.665+0000 7fafca800640 1 --2- 172.21.15.103:0/2251830229 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafac070fc0 0x7fafac073480 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fafbc005fd0 tx=0x7fafbc005a30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.665+0000 7fafcb200640 1 --2- 172.21.15.103:0/2251830229 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x562786301d40 0x5627864276d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.669+0000 7fafcb200640 1 -- 172.21.15.103:0/2251830229 <== osd.7 v2:172.21.15.131:6826/1279722082 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v94'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fafc4002050 con 0x562786301d40 2024-09-10T22:44:58.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.669+0000 7fafcd52d080 1 -- 172.21.15.103:0/2251830229 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x562786301d40 msgr2=0x5627864276d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.669+0000 7fafcd52d080 1 --2- 172.21.15.103:0/2251830229 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x562786301d40 0x5627864276d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.669+0000 7fafcd52d080 1 -- 172.21.15.103:0/2251830229 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafac070fc0 msgr2=0x7fafac073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.669+0000 7fafcd52d080 1 --2- 172.21.15.103:0/2251830229 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fafac070fc0 0x7fafac073480 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fafbc005fd0 tx=0x7fafbc005a30 comp rx=0 tx=0).stop 2024-09-10T22:44:58.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.669+0000 7fafcd52d080 1 -- 172.21.15.103:0/2251830229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5627862ff380 msgr2=0x56278638afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.669+0000 7fafcd52d080 1 --2- 172.21.15.103:0/2251830229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5627862ff380 0x56278638afc0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fafb800cfd0 tx=0x7fafb800a5b0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.669+0000 7fafcb200640 1 -- 172.21.15.103:0/2251830229 reap_dead start 2024-09-10T22:44:58.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.669+0000 7fafcd52d080 1 -- 172.21.15.103:0/2251830229 shutdown_connections 2024-09-10T22:44:58.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.669+0000 7fafcd52d080 1 -- 172.21.15.103:0/2251830229 >> 172.21.15.103:0/2251830229 conn(0x5627862b8f30 msgr2=0x5627862e6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:58.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.669+0000 7fafcd52d080 1 -- 172.21.15.103:0/2251830229 shutdown_connections 2024-09-10T22:44:58.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.669+0000 7fafcd52d080 1 -- 172.21.15.103:0/2251830229 wait complete. 2024-09-10T22:44:58.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:58.677 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /d1/d2/d3 recursive,force 2024-09-10T22:44:58.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.861+0000 7f4e23400640 1 -- 172.21.15.103:0/2367951920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e00003a60 msgr2=0x7f4e00003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.861+0000 7f4e23400640 1 --2- 172.21.15.103:0/2367951920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e00003a60 0x7f4e00003e80 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c009b30 tx=0x7f4e0c01d1e0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.861+0000 7f4e21400640 1 -- 172.21.15.103:0/2367951920 reap_dead start 2024-09-10T22:44:58.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.861+0000 7f4e23400640 1 -- 172.21.15.103:0/2367951920 shutdown_connections 2024-09-10T22:44:58.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.861+0000 7f4e23400640 1 -- 172.21.15.103:0/2367951920 >> 172.21.15.103:0/2367951920 conn(0x7f4e1c06cc00 msgr2=0x7f4e1c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:58.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.861+0000 7f4e23400640 1 -- 172.21.15.103:0/2367951920 shutdown_connections 2024-09-10T22:44:58.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.861+0000 7f4e23400640 1 -- 172.21.15.103:0/2367951920 wait complete. 2024-09-10T22:44:58.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.861+0000 7f4e23400640 1 Processor -- start 2024-09-10T22:44:58.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.861+0000 7f4e23400640 1 -- start start 2024-09-10T22:44:58.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.861+0000 7f4e23400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e00003a60 0x7f4e1c1461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.861+0000 7f4e23400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e1c06fbb0 0x7f4e1c070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.861+0000 7f4e23400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e1c1635f0 0x7f4e1c163a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.861+0000 7f4e23400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c0cff50 con 0x7f4e1c1635f0 2024-09-10T22:44:58.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.861+0000 7f4e23400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c0cfdd0 con 0x7f4e00003a60 2024-09-10T22:44:58.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.861+0000 7f4e23400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4e1c0d00d0 con 0x7f4e1c06fbb0 2024-09-10T22:44:58.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.865+0000 7f4e21400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e1c1635f0 0x7f4e1c163a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.865+0000 7f4e21400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e1c1635f0 0x7f4e1c163a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40578/0 (socket says 172.21.15.103:40578) 2024-09-10T22:44:58.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.865+0000 7f4e21400640 1 -- 172.21.15.103:0/4027547679 learned_addr learned my addr 172.21.15.103:0/4027547679 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:58.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.865+0000 7f4e20a00640 1 --2- 172.21.15.103:0/4027547679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e00003a60 0x7f4e1c1461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.865+0000 7f4e13e00640 1 --2- 172.21.15.103:0/4027547679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e1c06fbb0 0x7f4e1c070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.865+0000 7f4e21400640 1 -- 172.21.15.103:0/4027547679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e1c06fbb0 msgr2=0x7f4e1c070030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.865+0000 7f4e21400640 1 --2- 172.21.15.103:0/4027547679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e1c06fbb0 0x7f4e1c070030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.865+0000 7f4e21400640 1 -- 172.21.15.103:0/4027547679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e00003a60 msgr2=0x7f4e1c1461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.865+0000 7f4e21400640 1 --2- 172.21.15.103:0/4027547679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e00003a60 0x7f4e1c1461f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.865+0000 7f4e21400640 1 -- 172.21.15.103:0/4027547679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e1c163fb0 con 0x7f4e1c1635f0 2024-09-10T22:44:58.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.865+0000 7f4e21400640 1 --2- 172.21.15.103:0/4027547679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e1c1635f0 0x7f4e1c163a70 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c0744a0 tx=0x7f4e140064e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.865+0000 7f4e19600640 1 -- 172.21.15.103:0/4027547679 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e14010890 con 0x7f4e1c1635f0 2024-09-10T22:44:58.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.865+0000 7f4e19600640 1 -- 172.21.15.103:0/4027547679 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e14018070 con 0x7f4e1c1635f0 2024-09-10T22:44:58.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.865+0000 7f4e19600640 1 -- 172.21.15.103:0/4027547679 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e14010de0 con 0x7f4e1c1635f0 2024-09-10T22:44:58.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.865+0000 7f4e23400640 1 -- 172.21.15.103:0/4027547679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e1c1fb360 con 0x7f4e1c1635f0 2024-09-10T22:44:58.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.865+0000 7f4e23400640 1 -- 172.21.15.103:0/4027547679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e1c1fb920 con 0x7f4e1c1635f0 2024-09-10T22:44:58.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e19600640 1 -- 172.21.15.103:0/4027547679 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4e1401d460 con 0x7f4e1c1635f0 2024-09-10T22:44:58.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e267f7000 1 Processor -- start 2024-09-10T22:44:58.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e19600640 1 --2- 172.21.15.103:0/4027547679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4df8072610 0x7f4df8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e267f7000 1 -- start start 2024-09-10T22:44:58.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e19600640 1 -- 172.21.15.103:0/4027547679 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f4e14093a00 con 0x7f4e1c1635f0 2024-09-10T22:44:58.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e13e00640 1 --2- 172.21.15.103:0/4027547679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4df8072610 0x7f4df8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e267f7000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556974695470 0x556974695850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e267f7000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 0x55697464bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e267f7000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 0x55697464c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e267f7000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5569744a7bb0 con 0x55697464c0b0 2024-09-10T22:44:58.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e267f7000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x556974496fe0 con 0x556974695470 2024-09-10T22:44:58.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e267f7000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55697449adf0 con 0x556974695d90 2024-09-10T22:44:58.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e13e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 0x55697464bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e20a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556974695470 0x556974695850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e21400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 0x55697464c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e13e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 0x55697464bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:55142/0 (socket says 172.21.15.103:55142) 2024-09-10T22:44:58.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e13e00640 1 -- 172.21.15.103:0/726448654 learned_addr learned my addr 172.21.15.103:0/726448654 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:58.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e13e00640 1 --2- 172.21.15.103:0/4027547679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4df8072610 0x7f4df8074ad0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c070700 tx=0x7f4e040091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e21400640 1 -- 172.21.15.103:0/726448654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 msgr2=0x55697464bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e21400640 1 --2- 172.21.15.103:0/726448654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 0x55697464bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e21400640 1 -- 172.21.15.103:0/726448654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556974695470 msgr2=0x556974695850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e21400640 1 --2- 172.21.15.103:0/726448654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556974695470 0x556974695850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e21400640 1 -- 172.21.15.103:0/726448654 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569744724a0 con 0x55697464c0b0 2024-09-10T22:44:58.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e21400640 1 --2- 172.21.15.103:0/726448654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 0x55697464c490 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f4e14091d80 tx=0x7f4e1405e3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3c7ac94652b584 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e11600640 1 -- 172.21.15.103:0/726448654 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e140632c0 con 0x55697464c0b0 2024-09-10T22:44:58.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e11600640 1 -- 172.21.15.103:0/726448654 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e14067ce0 con 0x55697464c0b0 2024-09-10T22:44:58.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.869+0000 7f4e11600640 1 -- 172.21.15.103:0/726448654 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1405dd50 con 0x55697464c0b0 2024-09-10T22:44:58.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 -- 172.21.15.103:0/726448654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 msgr2=0x55697464c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 --2- 172.21.15.103:0/726448654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 0x55697464c490 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f4e14091d80 tx=0x7f4e1405e3a0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 -- 172.21.15.103:0/726448654 shutdown_connections 2024-09-10T22:44:58.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 --2- 172.21.15.103:0/726448654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 0x55697464c490 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 --2- 172.21.15.103:0/726448654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 0x55697464bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 --2- 172.21.15.103:0/726448654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556974695470 0x556974695850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 -- 172.21.15.103:0/726448654 >> 172.21.15.103:0/726448654 conn(0x556974648060 msgr2=0x55697464a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:58.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 -- 172.21.15.103:0/726448654 shutdown_connections 2024-09-10T22:44:58.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 -- 172.21.15.103:0/726448654 wait complete. 2024-09-10T22:44:58.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 -- start start 2024-09-10T22:44:58.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 Processor -- start 2024-09-10T22:44:58.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 0x55697469c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556974695470 0x55697469c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 0x55697469ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556974552a10 con 0x55697464c0b0 2024-09-10T22:44:58.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x556974440b30 con 0x556974695470 2024-09-10T22:44:58.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55697443d990 con 0x556974695d90 2024-09-10T22:44:58.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 10 client.0 _ll_register_callbacks cb 0x55697454dc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:58.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e20a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 0x55697469c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e20a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 0x55697469c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40598/0 (socket says 172.21.15.103:40598) 2024-09-10T22:44:58.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e20a00640 1 -- 172.21.15.103:0/1683623126 learned_addr learned my addr 172.21.15.103:0/1683623126 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:58.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e21400640 1 --2- 172.21.15.103:0/1683623126 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 0x55697469ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e13e00640 1 --2- 172.21.15.103:0/1683623126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556974695470 0x55697469c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e20a00640 1 -- 172.21.15.103:0/1683623126 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 msgr2=0x55697469ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e20a00640 1 --2- 172.21.15.103:0/1683623126 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 0x55697469ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e20a00640 1 -- 172.21.15.103:0/1683623126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556974695470 msgr2=0x55697469c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e20a00640 1 --2- 172.21.15.103:0/1683623126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556974695470 0x55697469c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e20a00640 1 -- 172.21.15.103:0/1683623126 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569744e0600 con 0x55697464c0b0 2024-09-10T22:44:58.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e13e00640 1 --2- 172.21.15.103:0/1683623126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556974695470 0x55697469c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:58.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e20a00640 1 --2- 172.21.15.103:0/1683623126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 0x55697469c3e0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0af040 tx=0x7f4e0c005860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47eaaec5e16e223 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e0a000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:58.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e0a000640 1 -- 172.21.15.103:0/1683623126 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0bd070 con 0x55697464c0b0 2024-09-10T22:44:58.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e0a000640 1 -- 172.21.15.103:0/1683623126 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f4e0c005230 con 0x55697464c0b0 2024-09-10T22:44:58.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 -- 172.21.15.103:0/1683623126 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55697442f240 con 0x55697464c0b0 2024-09-10T22:44:58.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e0a000640 1 -- 172.21.15.103:0/1683623126 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f4e0c0b1040 con 0x55697464c0b0 2024-09-10T22:44:58.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 10 client.7803 fetch_fsmap learned FSMap version 96 2024-09-10T22:44:58.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e267f7000 1 -- 172.21.15.103:0/1683623126 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x55697444a350 con 0x55697464c0b0 2024-09-10T22:44:58.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.873+0000 7f4e0a000640 1 -- 172.21.15.103:0/1683623126 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55697442f240 con 0x55697464c0b0 2024-09-10T22:44:58.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e0a000640 1 -- 172.21.15.103:0/1683623126 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 96) ==== 3554+0+0 (secure 0 0 0) 0x7f4e0c0046d0 con 0x55697464c0b0 2024-09-10T22:44:58.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e267f7000 10 client.7803 fetch_fsmap finished waiting for FSMap version 96 2024-09-10T22:44:58.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e267f7000 10 client.7803 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-10T22:44:58.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e267f7000 20 client.7803 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:58.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e267f7000 1 --2- 172.21.15.103:0/1683623126 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x5569746a47b0 0x5569746a6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e267f7000 4 client.7803 mds_command: new command op to 7434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:58.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e267f7000 1 -- 172.21.15.103:0/1683623126 --> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569744a9b00 con 0x5569746a47b0 2024-09-10T22:44:58.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e13e00640 1 --2- 172.21.15.103:0/1683623126 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x5569746a47b0 0x5569746a6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e13e00640 1 --2- 172.21.15.103:0/1683623126 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x5569746a47b0 0x5569746a6ba0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7659ff4e43aab9d6 server_cookie=203c3449a0295e1c in_seq=0 out_seq=0 2024-09-10T22:44:58.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e0a000640 10 client.7803 ms_handle_connect on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:58.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e0a000640 1 -- 172.21.15.103:0/1683623126 <== mds.0 v2:172.21.15.103:6833/187627880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5569744a9b00 con 0x5569746a47b0 2024-09-10T22:44:58.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e0a000640 10 client.7803 handle_command_reply: tid=0 2024-09-10T22:44:58.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e267f7000 1 client.7803 shutdown 2024-09-10T22:44:58.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e267f7000 1 -- 172.21.15.103:0/1683623126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 msgr2=0x55697469c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e267f7000 1 --2- 172.21.15.103:0/1683623126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 0x55697469c3e0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0af040 tx=0x7f4e0c005860 comp rx=0 tx=0).stop 2024-09-10T22:44:58.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e267f7000 1 -- 172.21.15.103:0/1683623126 shutdown_connections 2024-09-10T22:44:58.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e267f7000 1 --2- 172.21.15.103:0/1683623126 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x5569746a47b0 0x5569746a6ba0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e267f7000 1 --2- 172.21.15.103:0/1683623126 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 0x55697469ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e267f7000 1 --2- 172.21.15.103:0/1683623126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556974695470 0x55697469c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e0a000640 0 client.7803 ms_handle_reset on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:58.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e267f7000 1 --2- 172.21.15.103:0/1683623126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 0x55697469c3e0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e267f7000 1 -- 172.21.15.103:0/1683623126 >> 172.21.15.103:0/1683623126 conn(0x556974648060 msgr2=0x55697464ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:58.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e267f7000 1 -- 172.21.15.103:0/1683623126 shutdown_connections 2024-09-10T22:44:58.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e267f7000 1 -- 172.21.15.103:0/1683623126 wait complete. 2024-09-10T22:44:58.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.877+0000 7f4e267f7000 20 client.7803 trim_cache size 0 max 16384 2024-09-10T22:44:58.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.893+0000 7f4e267f7000 1 Processor -- start 2024-09-10T22:44:58.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.893+0000 7f4e267f7000 1 -- start start 2024-09-10T22:44:58.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e267f7000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55697464c0b0 0x556974707310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e267f7000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556974695470 0x556974707850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e267f7000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 0x556974707d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e267f7000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c204410 con 0x556974695470 2024-09-10T22:44:58.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e267f7000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c204b10 con 0x55697464c0b0 2024-09-10T22:44:58.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e267f7000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4e1c2034e0 con 0x556974695d90 2024-09-10T22:44:58.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e13e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556974695470 0x556974707850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e13e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556974695470 0x556974707850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40606/0 (socket says 172.21.15.103:40606) 2024-09-10T22:44:58.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e13e00640 1 -- 172.21.15.103:0/139647394 learned_addr learned my addr 172.21.15.103:0/139647394 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:58.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e20a00640 1 --2- 172.21.15.103:0/139647394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55697464c0b0 0x556974707310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e21400640 1 --2- 172.21.15.103:0/139647394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 0x556974707d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e13e00640 1 -- 172.21.15.103:0/139647394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 msgr2=0x556974707d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e13e00640 1 --2- 172.21.15.103:0/139647394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 0x556974707d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e13e00640 1 -- 172.21.15.103:0/139647394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55697464c0b0 msgr2=0x556974707310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e13e00640 1 --2- 172.21.15.103:0/139647394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55697464c0b0 0x556974707310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e13e00640 1 -- 172.21.15.103:0/139647394 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556974695bc0 con 0x556974695470 2024-09-10T22:44:58.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e13e00640 1 --2- 172.21.15.103:0/139647394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556974695470 0x556974707850 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f4e04012e90 tx=0x7f4e04009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8a77a1b13f8d44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e10c00640 1 -- 172.21.15.103:0/139647394 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04004050 con 0x556974695470 2024-09-10T22:44:58.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e10c00640 1 -- 172.21.15.103:0/139647394 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e040041f0 con 0x556974695470 2024-09-10T22:44:58.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e10c00640 1 -- 172.21.15.103:0/139647394 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04003600 con 0x556974695470 2024-09-10T22:44:58.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e267f7000 1 -- 172.21.15.103:0/139647394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556974695470 msgr2=0x556974707850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e267f7000 1 --2- 172.21.15.103:0/139647394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556974695470 0x556974707850 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f4e04012e90 tx=0x7f4e04009f90 comp rx=0 tx=0).stop 2024-09-10T22:44:58.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e267f7000 1 -- 172.21.15.103:0/139647394 shutdown_connections 2024-09-10T22:44:58.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e267f7000 1 --2- 172.21.15.103:0/139647394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 0x556974707d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e267f7000 1 --2- 172.21.15.103:0/139647394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556974695470 0x556974707850 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e267f7000 1 --2- 172.21.15.103:0/139647394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55697464c0b0 0x556974707310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e267f7000 1 -- 172.21.15.103:0/139647394 >> 172.21.15.103:0/139647394 conn(0x556974648060 msgr2=0x55697464a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:58.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e267f7000 1 -- 172.21.15.103:0/139647394 shutdown_connections 2024-09-10T22:44:58.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e267f7000 1 -- 172.21.15.103:0/139647394 wait complete. 2024-09-10T22:44:58.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e267f7000 1 -- start start 2024-09-10T22:44:58.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.897+0000 7f4e267f7000 1 Processor -- start 2024-09-10T22:44:58.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 0x5569747074b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556974695470 0x5569747079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 0x5569746a9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55697449a100 con 0x55697464c0b0 2024-09-10T22:44:58.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x556974464a90 con 0x556974695470 2024-09-10T22:44:58.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55697449f420 con 0x556974695d90 2024-09-10T22:44:58.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 10 client.0 _ll_register_callbacks cb 0x7f4e0c005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:58.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e20a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 0x5569747074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e20a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 0x5569747074b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40620/0 (socket says 172.21.15.103:40620) 2024-09-10T22:44:58.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e20a00640 1 -- 172.21.15.103:0/2822217776 learned_addr learned my addr 172.21.15.103:0/2822217776 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:58.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e13e00640 1 --2- 172.21.15.103:0/2822217776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556974695470 0x5569747079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e21400640 1 --2- 172.21.15.103:0/2822217776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 0x5569746a9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e20a00640 1 -- 172.21.15.103:0/2822217776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 msgr2=0x5569746a9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e20a00640 1 --2- 172.21.15.103:0/2822217776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 0x5569746a9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e20a00640 1 -- 172.21.15.103:0/2822217776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556974695470 msgr2=0x5569747079f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:58.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e20a00640 1 --2- 172.21.15.103:0/2822217776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556974695470 0x5569747079f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e20a00640 1 -- 172.21.15.103:0/2822217776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556974435100 con 0x55697464c0b0 2024-09-10T22:44:58.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e13e00640 1 --2- 172.21.15.103:0/2822217776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556974695470 0x5569747079f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:58.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e20a00640 1 --2- 172.21.15.103:0/2822217776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 0x5569747074b0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c004c20 tx=0x7f4e0c0097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0166cda4031b66a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:58.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e0a000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:58.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e0a000640 1 -- 172.21.15.103:0/2822217776 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0d2060 con 0x55697464c0b0 2024-09-10T22:44:58.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e0a000640 1 -- 172.21.15.103:0/2822217776 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f4e0c0051c0 con 0x55697464c0b0 2024-09-10T22:44:58.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 1 -- 172.21.15.103:0/2822217776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e040041f0 con 0x55697464c0b0 2024-09-10T22:44:58.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e0a000640 1 -- 172.21.15.103:0/2822217776 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f4e0c0d8050 con 0x55697464c0b0 2024-09-10T22:44:58.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 10 client.7809 fetch_fsmap learned FSMap version 96 2024-09-10T22:44:58.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 1 -- 172.21.15.103:0/2822217776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x55697451c290 con 0x55697464c0b0 2024-09-10T22:44:58.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e0a000640 1 -- 172.21.15.103:0/2822217776 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e040041f0 con 0x55697464c0b0 2024-09-10T22:44:58.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e0a000640 1 -- 172.21.15.103:0/2822217776 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 96) ==== 3554+0+0 (secure 0 0 0) 0x7f4e0c0db020 con 0x55697464c0b0 2024-09-10T22:44:58.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 10 client.7809 fetch_fsmap finished waiting for FSMap version 96 2024-09-10T22:44:58.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 10 client.7809 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-10T22:44:58.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 20 client.7809 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:58.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 1 --2- 172.21.15.103:0/2822217776 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x5569746a9880 0x5569746a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:58.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 4 client.7809 mds_command: new command op to 7434 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2024-09-10T22:44:58.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 1 -- 172.21.15.103:0/2822217776 --> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) -- 0x5569744a55b0 con 0x5569746a9880 2024-09-10T22:44:58.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e13e00640 1 --2- 172.21.15.103:0/2822217776 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x5569746a9880 0x5569746a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:58.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e13e00640 1 --2- 172.21.15.103:0/2822217776 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x5569746a9880 0x5569746a9c90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fb6034ace4cb6dc server_cookie=afc749f34a75bc62 in_seq=0 out_seq=0 2024-09-10T22:44:58.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e0a000640 10 client.7809 ms_handle_connect on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:58.910 INFO:tasks.ceph.mds.d.smithi131.stderr:2024-09-10T22:44:58.910+0000 7fdcf9c00640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-10T22:44:40.868264+0000 1=0+1) n(v0 rc2024-09-10T22:44:40.868264+0000 2=0+2) (inest lock) (ifile excl) caps={7596=pAsLsXsFsx/-@6},l=7596 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5622792ac580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:44:40.868264+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:44:40.868264+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-10T22:44:40.868264+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-10T22:44:40.868264+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-10T22:44:58.910 INFO:tasks.ceph.mds.d.smithi131.stderr:2024-09-10T22:44:58.910+0000 7fdcf9c00640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) caps={7596=pAsLsXsFs/-@3},l=7596 | request=0 lock=0 importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5622792acb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-10T22:44:58.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e0a000640 1 -- 172.21.15.103:0/2822217776 <== mds.0 v2:172.21.15.103:6833/187627880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5569744a55b0 con 0x5569746a9880 2024-09-10T22:44:58.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e0a000640 10 client.7809 handle_command_reply: tid=0 2024-09-10T22:44:58.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 1 client.7809 shutdown 2024-09-10T22:44:58.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 1 -- 172.21.15.103:0/2822217776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 msgr2=0x5569747074b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f4e267f7000 1 --2- 172.21.15.103:0/2822217776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 0x5569747074b0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c004c20 tx=0x7f4e0c0097c0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.911 INFO:tasks.ceph.mds.c.smithi103.stderr:2024-09-10T22:44:58.901+0000 7f11a9800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-10T22:44:40.861172+0000 1=0+1) n(v3 rc2024-09-10T22:44:41.089657+0000 6=0+6) (inest mix dirty) (ifile excl) caps={7596=pAsLsXsFsx/AsLsXsFsx@9},l=7596 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x560bb6269b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:44:40.861172+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:44:41.089657+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-10T22:44:40.861172+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-10T22:44:41.089657+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-10T22:44:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e267f7000 1 -- 172.21.15.103:0/2822217776 shutdown_connections 2024-09-10T22:44:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e267f7000 1 --2- 172.21.15.103:0/2822217776 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x5569746a9880 0x5569746a9c90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e267f7000 1 --2- 172.21.15.103:0/2822217776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556974695d90 0x5569746a9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e267f7000 1 --2- 172.21.15.103:0/2822217776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556974695470 0x5569747079f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e267f7000 1 --2- 172.21.15.103:0/2822217776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55697464c0b0 0x5569747074b0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e0a000640 0 client.7809 ms_handle_reset on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:58.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e267f7000 1 -- 172.21.15.103:0/2822217776 >> 172.21.15.103:0/2822217776 conn(0x556974648060 msgr2=0x55697464ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:58.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e267f7000 1 -- 172.21.15.103:0/2822217776 shutdown_connections 2024-09-10T22:44:58.912 INFO:tasks.ceph.mds.a.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f220a400640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-10T22:44:40.864709+0000 1=0+1) n(v2 rc2024-09-10T22:44:41.089657+0000 4=0+4) (inest lock) caps={7596=pAsLsXsFs/-@7},l=7596 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55a605c6a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:44:40.864709+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:44:41.089657+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-10T22:44:40.864709+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-10T22:44:41.089657+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-10T22:44:58.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e267f7000 1 -- 172.21.15.103:0/2822217776 wait complete. 2024-09-10T22:44:58.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e267f7000 20 client.7809 trim_cache size 0 max 16384 2024-09-10T22:44:58.913 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:44:58.913 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0, 2024-09-10T22:44:58.913 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_tag": "118e1155-7244-4d9c-9fab-dbfc720435a1", 2024-09-10T22:44:58.913 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": "asynchronous" 2024-09-10T22:44:58.913 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:44:58.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e23400640 1 -- 172.21.15.103:0/4027547679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4df8072610 msgr2=0x7f4df8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e23400640 1 --2- 172.21.15.103:0/4027547679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4df8072610 0x7f4df8074ad0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c070700 tx=0x7f4e040091e0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e23400640 1 -- 172.21.15.103:0/4027547679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e1c1635f0 msgr2=0x7f4e1c163a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:58.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e23400640 1 --2- 172.21.15.103:0/4027547679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e1c1635f0 0x7f4e1c163a70 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c0744a0 tx=0x7f4e140064e0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e23400640 1 -- 172.21.15.103:0/4027547679 shutdown_connections 2024-09-10T22:44:58.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e23400640 1 --2- 172.21.15.103:0/4027547679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4df8072610 0x7f4df8074ad0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e23400640 1 --2- 172.21.15.103:0/4027547679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e1c1635f0 0x7f4e1c163a70 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e23400640 1 --2- 172.21.15.103:0/4027547679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e1c06fbb0 0x7f4e1c070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e23400640 1 --2- 172.21.15.103:0/4027547679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e00003a60 0x7f4e1c1461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:58.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e23400640 1 -- 172.21.15.103:0/4027547679 >> 172.21.15.103:0/4027547679 conn(0x7f4e1c06cc00 msgr2=0x7f4e1c0b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:58.915 INFO:tasks.ceph.mds.c.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f11b1a00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-10T22:44:40.863008+0000 1=0+1) n(v4 rc2024-09-10T22:44:41.089657+0000 5=0+5) (inest sync->mix g=1,2) caps={7596=pAsLsXsFs/-@11} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x560bb626a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:44:40.863008+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:44:41.089657+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-10T22:44:40.863008+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-10T22:44:41.089657+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-10T22:44:58.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e23400640 1 -- 172.21.15.103:0/4027547679 shutdown_connections 2024-09-10T22:44:58.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f4e23400640 1 -- 172.21.15.103:0/4027547679 wait complete. 2024-09-10T22:44:58.915 INFO:tasks.ceph.mds.a.smithi103.stderr:2024-09-10T22:44:58.905+0000 7f2212600640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-10T22:44:40.866487+0000 1=0+1) n(v1 rc2024-09-10T22:44:41.089657+0000 3=0+3) (inest sync->mix g=0,2 scatter_wanted) caps={7596=pAsLsXsFs/-@7} | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55a605c6ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:44:40.866487+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:44:40.868264+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-10T22:44:40.866487+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-10T22:44:41.089657+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-10T22:44:58.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:44:58.928 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub pause 2024-09-10T22:44:59.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35b6c00640 1 -- 172.21.15.103:0/2053117319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35b00d02c0 msgr2=0x7f35b0166c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35b6c00640 1 --2- 172.21.15.103:0/2053117319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35b00d02c0 0x7f35b0166c10 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009bc0 tx=0x7f35a801cb10 comp rx=0 tx=0).stop 2024-09-10T22:44:59.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35b6c00640 1 -- 172.21.15.103:0/2053117319 shutdown_connections 2024-09-10T22:44:59.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35b6c00640 1 --2- 172.21.15.103:0/2053117319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35b00d02c0 0x7f35b0166c10 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35b6c00640 1 -- 172.21.15.103:0/2053117319 >> 172.21.15.103:0/2053117319 conn(0x7f35b00d0940 msgr2=0x7f35b00d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35b6c00640 1 -- 172.21.15.103:0/2053117319 shutdown_connections 2024-09-10T22:44:59.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35b6c00640 1 -- 172.21.15.103:0/2053117319 wait complete. 2024-09-10T22:44:59.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35b6c00640 1 Processor -- start 2024-09-10T22:44:59.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35b6c00640 1 -- start start 2024-09-10T22:44:59.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35b6c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35b006cc00 0x7f35b0143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35b6c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35b00d02c0 0x7f35b01f9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35b6c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35b00d1460 0x7f35b0153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35b6c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f35b0169e50 con 0x7f35b006cc00 2024-09-10T22:44:59.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35b6c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f35b0169cd0 con 0x7f35b00d1460 2024-09-10T22:44:59.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35b6c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f35b0169fd0 con 0x7f35b00d02c0 2024-09-10T22:44:59.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35afe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35b006cc00 0x7f35b0143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35afe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35b006cc00 0x7f35b0143af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40632/0 (socket says 172.21.15.103:40632) 2024-09-10T22:44:59.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35afe00640 1 -- 172.21.15.103:0/1752319107 learned_addr learned my addr 172.21.15.103:0/1752319107 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35b4c00640 1 --2- 172.21.15.103:0/1752319107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35b00d1460 0x7f35b0153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35a7400640 1 --2- 172.21.15.103:0/1752319107 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35b00d02c0 0x7f35b01f9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35afe00640 1 -- 172.21.15.103:0/1752319107 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35b00d02c0 msgr2=0x7f35b01f9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35afe00640 1 --2- 172.21.15.103:0/1752319107 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35b00d02c0 0x7f35b01f9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35afe00640 1 -- 172.21.15.103:0/1752319107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35b00d1460 msgr2=0x7f35b0153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35afe00640 1 --2- 172.21.15.103:0/1752319107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35b00d1460 0x7f35b0153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35afe00640 1 -- 172.21.15.103:0/1752319107 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b014c510 con 0x7f35b006cc00 2024-09-10T22:44:59.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.069+0000 7f35afe00640 1 --2- 172.21.15.103:0/1752319107 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35b006cc00 0x7f35b0143af0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f35a000c4b0 tx=0x7f35a000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.073+0000 7f35acc00640 1 -- 172.21.15.103:0/1752319107 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a00052d0 con 0x7f35b006cc00 2024-09-10T22:44:59.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.073+0000 7f35acc00640 1 -- 172.21.15.103:0/1752319107 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35a0005470 con 0x7f35b006cc00 2024-09-10T22:44:59.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.073+0000 7f35acc00640 1 -- 172.21.15.103:0/1752319107 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0012870 con 0x7f35b006cc00 2024-09-10T22:44:59.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.073+0000 7f35b6c00640 1 -- 172.21.15.103:0/1752319107 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35b0149ba0 con 0x7f35b006cc00 2024-09-10T22:44:59.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.073+0000 7f35b6c00640 1 -- 172.21.15.103:0/1752319107 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b014ca90 con 0x7f35b006cc00 2024-09-10T22:44:59.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.073+0000 7f35acc00640 1 -- 172.21.15.103:0/1752319107 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f35a0003600 con 0x7f35b006cc00 2024-09-10T22:44:59.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.073+0000 7f35acc00640 1 --2- 172.21.15.103:0/1752319107 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f358c072610 0x7f358c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.073+0000 7f35acc00640 1 -- 172.21.15.103:0/1752319107 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f35a0092eb0 con 0x7f35b006cc00 2024-09-10T22:44:59.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.073+0000 7f35ba046000 1 Processor -- start 2024-09-10T22:44:59.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35ba046000 1 -- start start 2024-09-10T22:44:59.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35a7400640 1 --2- 172.21.15.103:0/1752319107 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f358c072610 0x7f358c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35a7400640 1 --2- 172.21.15.103:0/1752319107 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f358c072610 0x7f358c074ad0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f35b01f89d0 tx=0x7f3598009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35ba046000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545c5d1d0 0x55a545dc32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35ba046000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545dc3830 0x55a545dc3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35ba046000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a545d799b0 0x55a545d79d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35ba046000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a545b732c0 con 0x55a545c5d1d0 2024-09-10T22:44:59.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35ba046000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a545bd0b90 con 0x55a545dc3830 2024-09-10T22:44:59.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35ba046000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a545bbffc0 con 0x55a545d799b0 2024-09-10T22:44:59.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35afe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545c5d1d0 0x55a545dc32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35afe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545c5d1d0 0x55a545dc32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40640/0 (socket says 172.21.15.103:40640) 2024-09-10T22:44:59.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35afe00640 1 -- 172.21.15.103:0/1799201582 learned_addr learned my addr 172.21.15.103:0/1799201582 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35a7400640 1 --2- 172.21.15.103:0/1799201582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545dc3830 0x55a545dc3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35b4c00640 1 --2- 172.21.15.103:0/1799201582 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a545d799b0 0x55a545d79d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35afe00640 1 -- 172.21.15.103:0/1799201582 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a545d799b0 msgr2=0x55a545d79d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35afe00640 1 --2- 172.21.15.103:0/1799201582 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a545d799b0 0x55a545d79d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35afe00640 1 -- 172.21.15.103:0/1799201582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545dc3830 msgr2=0x55a545dc3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35afe00640 1 --2- 172.21.15.103:0/1799201582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545dc3830 0x55a545dc3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35afe00640 1 -- 172.21.15.103:0/1799201582 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a545b5e1a0 con 0x55a545c5d1d0 2024-09-10T22:44:59.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35b4c00640 1 --2- 172.21.15.103:0/1799201582 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a545d799b0 0x55a545d79d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:59.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35a7400640 1 --2- 172.21.15.103:0/1799201582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545dc3830 0x55a545dc3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:59.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35afe00640 1 --2- 172.21.15.103:0/1799201582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545c5d1d0 0x55a545dc32f0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f35a005da40 tx=0x7f35a005d850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51bcea2f4c9daab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35a4c00640 1 -- 172.21.15.103:0/1799201582 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0062770 con 0x55a545c5d1d0 2024-09-10T22:44:59.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35a4c00640 1 -- 172.21.15.103:0/1799201582 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35a0062020 con 0x55a545c5d1d0 2024-09-10T22:44:59.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35a4c00640 1 -- 172.21.15.103:0/1799201582 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a005d1c0 con 0x55a545c5d1d0 2024-09-10T22:44:59.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35ba046000 1 -- 172.21.15.103:0/1799201582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545c5d1d0 msgr2=0x55a545dc32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35ba046000 1 --2- 172.21.15.103:0/1799201582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545c5d1d0 0x55a545dc32f0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f35a005da40 tx=0x7f35a005d850 comp rx=0 tx=0).stop 2024-09-10T22:44:59.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35ba046000 1 -- 172.21.15.103:0/1799201582 shutdown_connections 2024-09-10T22:44:59.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35ba046000 1 --2- 172.21.15.103:0/1799201582 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a545d799b0 0x55a545d79d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35ba046000 1 --2- 172.21.15.103:0/1799201582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545dc3830 0x55a545dc3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35ba046000 1 --2- 172.21.15.103:0/1799201582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545c5d1d0 0x55a545dc32f0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35ba046000 1 -- 172.21.15.103:0/1799201582 >> 172.21.15.103:0/1799201582 conn(0x55a54587e880 msgr2=0x55a545d73e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35ba046000 1 -- 172.21.15.103:0/1799201582 shutdown_connections 2024-09-10T22:44:59.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35ba046000 1 -- 172.21.15.103:0/1799201582 wait complete. 2024-09-10T22:44:59.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35ba046000 1 -- start start 2024-09-10T22:44:59.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.077+0000 7f35ba046000 1 Processor -- start 2024-09-10T22:44:59.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35ba046000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545c5d1d0 0x55a545db1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35ba046000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545d799b0 0x55a545db1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35ba046000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a545dc3830 0x55a545db22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35ba046000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a545b654d0 con 0x55a545d799b0 2024-09-10T22:44:59.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35ba046000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a545bc3dd0 con 0x55a545c5d1d0 2024-09-10T22:44:59.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35ba046000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a545885620 con 0x55a545dc3830 2024-09-10T22:44:59.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35ba046000 10 client.0 _ll_register_callbacks cb 0x55a545b96cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:59.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35a7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545d799b0 0x55a545db1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35a7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545d799b0 0x55a545db1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40650/0 (socket says 172.21.15.103:40650) 2024-09-10T22:44:59.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35a7400640 1 -- 172.21.15.103:0/4146797642 learned_addr learned my addr 172.21.15.103:0/4146797642 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35afe00640 1 --2- 172.21.15.103:0/4146797642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545c5d1d0 0x55a545db1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35b4c00640 1 --2- 172.21.15.103:0/4146797642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a545dc3830 0x55a545db22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35a7400640 1 -- 172.21.15.103:0/4146797642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a545dc3830 msgr2=0x55a545db22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35a7400640 1 --2- 172.21.15.103:0/4146797642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a545dc3830 0x55a545db22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35a7400640 1 -- 172.21.15.103:0/4146797642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545c5d1d0 msgr2=0x55a545db1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35a7400640 1 --2- 172.21.15.103:0/4146797642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545c5d1d0 0x55a545db1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35a7400640 1 -- 172.21.15.103:0/4146797642 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a545c8f720 con 0x55a545d799b0 2024-09-10T22:44:59.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35afe00640 1 --2- 172.21.15.103:0/4146797642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545c5d1d0 0x55a545db1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:59.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35b4c00640 1 --2- 172.21.15.103:0/4146797642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a545dc3830 0x55a545db22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:59.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35a7400640 1 --2- 172.21.15.103:0/4146797642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545d799b0 0x55a545db1da0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f3598014700 tx=0x7f3598000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e26047b2b6c425 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f359d600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:59.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f359d600640 1 -- 172.21.15.103:0/4146797642 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35980135c0 con 0x55a545d799b0 2024-09-10T22:44:59.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35ba046000 1 -- 172.21.15.103:0/4146797642 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a545b582e0 con 0x55a545d799b0 2024-09-10T22:44:59.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f359d600640 1 -- 172.21.15.103:0/4146797642 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f3598013760 con 0x55a545d799b0 2024-09-10T22:44:59.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f359d600640 1 -- 172.21.15.103:0/4146797642 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f359802d050 con 0x55a545d799b0 2024-09-10T22:44:59.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35ba046000 10 client.7824 fetch_fsmap learned FSMap version 96 2024-09-10T22:44:59.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35ba046000 1 -- 172.21.15.103:0/4146797642 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x55a545c45420 con 0x55a545d799b0 2024-09-10T22:44:59.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f359d600640 1 -- 172.21.15.103:0/4146797642 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a545b582e0 con 0x55a545d799b0 2024-09-10T22:44:59.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f359d600640 1 -- 172.21.15.103:0/4146797642 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 96) ==== 3554+0+0 (secure 0 0 0) 0x7f3598030020 con 0x55a545d799b0 2024-09-10T22:44:59.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35ba046000 10 client.7824 fetch_fsmap finished waiting for FSMap version 96 2024-09-10T22:44:59.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35ba046000 10 client.7824 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-10T22:44:59.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35ba046000 20 client.7824 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:59.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35ba046000 1 --2- 172.21.15.103:0/4146797642 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55a545db2cf0 0x55a545dd4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35ba046000 4 client.7824 mds_command: new command op to 7434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:59.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35ba046000 1 -- 172.21.15.103:0/4146797642 --> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a545bd2ae0 con 0x55a545db2cf0 2024-09-10T22:44:59.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35afe00640 1 --2- 172.21.15.103:0/4146797642 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55a545db2cf0 0x55a545dd4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f35afe00640 1 --2- 172.21.15.103:0/4146797642 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55a545db2cf0 0x55a545dd4fc0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=398d27425de51f0e server_cookie=1a5e308ed2139309 in_seq=0 out_seq=0 2024-09-10T22:44:59.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f359d600640 10 client.7824 ms_handle_connect on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:59.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f359d600640 1 -- 172.21.15.103:0/4146797642 <== mds.0 v2:172.21.15.103:6833/187627880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a545bd2ae0 con 0x55a545db2cf0 2024-09-10T22:44:59.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.081+0000 7f359d600640 10 client.7824 handle_command_reply: tid=0 2024-09-10T22:44:59.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.085+0000 7f35ba046000 1 client.7824 shutdown 2024-09-10T22:44:59.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.085+0000 7f35ba046000 1 -- 172.21.15.103:0/4146797642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545d799b0 msgr2=0x55a545db1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.085+0000 7f35ba046000 1 --2- 172.21.15.103:0/4146797642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545d799b0 0x55a545db1da0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f3598014700 tx=0x7f3598000ee0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.085+0000 7f35ba046000 1 -- 172.21.15.103:0/4146797642 shutdown_connections 2024-09-10T22:44:59.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.085+0000 7f35ba046000 1 --2- 172.21.15.103:0/4146797642 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55a545db2cf0 0x55a545dd4fc0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.085+0000 7f35ba046000 1 --2- 172.21.15.103:0/4146797642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a545dc3830 0x55a545db22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.085+0000 7f35ba046000 1 --2- 172.21.15.103:0/4146797642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545d799b0 0x55a545db1da0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.085+0000 7f359d600640 0 client.7824 ms_handle_reset on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:59.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.085+0000 7f35ba046000 1 --2- 172.21.15.103:0/4146797642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545c5d1d0 0x55a545db1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.085+0000 7f35ba046000 1 -- 172.21.15.103:0/4146797642 >> 172.21.15.103:0/4146797642 conn(0x55a54587e880 msgr2=0x55a545d7acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.085+0000 7f35ba046000 1 -- 172.21.15.103:0/4146797642 shutdown_connections 2024-09-10T22:44:59.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.085+0000 7f35ba046000 1 -- 172.21.15.103:0/4146797642 wait complete. 2024-09-10T22:44:59.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.085+0000 7f35ba046000 20 client.7824 trim_cache size 0 max 16384 2024-09-10T22:44:59.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35ba046000 1 Processor -- start 2024-09-10T22:44:59.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35ba046000 1 -- start start 2024-09-10T22:44:59.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35ba046000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a54587e880 0x55a545d79d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35ba046000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545c5d1d0 0x55a545d7a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35ba046000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a545d799b0 0x55a545d7a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35ba046000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f35b0200520 con 0x55a54587e880 2024-09-10T22:44:59.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35ba046000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f35b00b57e0 con 0x55a545c5d1d0 2024-09-10T22:44:59.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35ba046000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f35b01ffe10 con 0x55a545d799b0 2024-09-10T22:44:59.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35afe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a54587e880 0x55a545d79d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35afe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a54587e880 0x55a545d79d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40654/0 (socket says 172.21.15.103:40654) 2024-09-10T22:44:59.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35afe00640 1 -- 172.21.15.103:0/2253473800 learned_addr learned my addr 172.21.15.103:0/2253473800 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35afe00640 1 -- 172.21.15.103:0/2253473800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a545d799b0 msgr2=0x55a545d7a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35b4c00640 1 --2- 172.21.15.103:0/2253473800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a545d799b0 0x55a545d7a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35a7400640 1 --2- 172.21.15.103:0/2253473800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545c5d1d0 0x55a545d7a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35afe00640 1 --2- 172.21.15.103:0/2253473800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a545d799b0 0x55a545d7a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35afe00640 1 -- 172.21.15.103:0/2253473800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545c5d1d0 msgr2=0x55a545d7a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35afe00640 1 --2- 172.21.15.103:0/2253473800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545c5d1d0 0x55a545d7a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35afe00640 1 -- 172.21.15.103:0/2253473800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a545c1cae0 con 0x55a54587e880 2024-09-10T22:44:59.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35b4c00640 1 --2- 172.21.15.103:0/2253473800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a545d799b0 0x55a545d7a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:59.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.101+0000 7f35a7400640 1 --2- 172.21.15.103:0/2253473800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545c5d1d0 0x55a545d7a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:59.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35afe00640 1 --2- 172.21.15.103:0/2253473800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a54587e880 0x55a545d79d90 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f35a000ce70 tx=0x7f35a0001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419ad695b291d19b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f359fe00640 1 -- 172.21.15.103:0/2253473800 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0066af0 con 0x55a54587e880 2024-09-10T22:44:59.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f359fe00640 1 -- 172.21.15.103:0/2253473800 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35a0062040 con 0x55a54587e880 2024-09-10T22:44:59.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f359fe00640 1 -- 172.21.15.103:0/2253473800 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a005d1e0 con 0x55a54587e880 2024-09-10T22:44:59.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35ba046000 1 -- 172.21.15.103:0/2253473800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a54587e880 msgr2=0x55a545d79d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35ba046000 1 --2- 172.21.15.103:0/2253473800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a54587e880 0x55a545d79d90 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f35a000ce70 tx=0x7f35a0001130 comp rx=0 tx=0).stop 2024-09-10T22:44:59.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35ba046000 1 -- 172.21.15.103:0/2253473800 shutdown_connections 2024-09-10T22:44:59.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35ba046000 1 --2- 172.21.15.103:0/2253473800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a545d799b0 0x55a545d7a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35ba046000 1 --2- 172.21.15.103:0/2253473800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545c5d1d0 0x55a545d7a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35ba046000 1 --2- 172.21.15.103:0/2253473800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a54587e880 0x55a545d79d90 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35ba046000 1 -- 172.21.15.103:0/2253473800 >> 172.21.15.103:0/2253473800 conn(0x55a545db2080 msgr2=0x55a545daf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35ba046000 1 -- 172.21.15.103:0/2253473800 shutdown_connections 2024-09-10T22:44:59.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35ba046000 1 -- 172.21.15.103:0/2253473800 wait complete. 2024-09-10T22:44:59.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35ba046000 1 -- start start 2024-09-10T22:44:59.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35ba046000 1 Processor -- start 2024-09-10T22:44:59.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35ba046000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a54587e880 0x55a545e39f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35ba046000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545c5d1d0 0x55a545e3a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35ba046000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545d799b0 0x55a545e3a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35ba046000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a545885620 con 0x55a545c5d1d0 2024-09-10T22:44:59.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35ba046000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a545bc3dd0 con 0x55a545d799b0 2024-09-10T22:44:59.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35ba046000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a545b6b020 con 0x55a54587e880 2024-09-10T22:44:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35ba046000 10 client.0 _ll_register_callbacks cb 0x7f3598017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35a7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545c5d1d0 0x55a545e3a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35a7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545c5d1d0 0x55a545e3a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40656/0 (socket says 172.21.15.103:40656) 2024-09-10T22:44:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35a7400640 1 -- 172.21.15.103:0/324297197 learned_addr learned my addr 172.21.15.103:0/324297197 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35b4c00640 1 --2- 172.21.15.103:0/324297197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545d799b0 0x55a545e3a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35afe00640 1 --2- 172.21.15.103:0/324297197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a54587e880 0x55a545e39f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35a7400640 1 -- 172.21.15.103:0/324297197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a54587e880 msgr2=0x55a545e39f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35a7400640 1 --2- 172.21.15.103:0/324297197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a54587e880 0x55a545e39f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35a7400640 1 -- 172.21.15.103:0/324297197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545d799b0 msgr2=0x55a545e3a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35a7400640 1 --2- 172.21.15.103:0/324297197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545d799b0 0x55a545e3a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35a7400640 1 -- 172.21.15.103:0/324297197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a545b8a040 con 0x55a545c5d1d0 2024-09-10T22:44:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f35a7400640 1 --2- 172.21.15.103:0/324297197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545c5d1d0 0x55a545e3a480 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f3598007ad0 tx=0x7f3598000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76afffdd5ed01084 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.105+0000 7f359d600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f359d600640 1 -- 172.21.15.103:0/324297197 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3598035070 con 0x55a545c5d1d0 2024-09-10T22:44:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f359d600640 1 -- 172.21.15.103:0/324297197 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f3598020630 con 0x55a545c5d1d0 2024-09-10T22:44:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 1 -- 172.21.15.103:0/324297197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35a0062040 con 0x55a545c5d1d0 2024-09-10T22:44:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f359d600640 1 -- 172.21.15.103:0/324297197 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f3598040050 con 0x55a545c5d1d0 2024-09-10T22:44:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 10 client.7830 fetch_fsmap learned FSMap version 96 2024-09-10T22:44:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 1 -- 172.21.15.103:0/324297197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x55a545b56620 con 0x55a545c5d1d0 2024-09-10T22:44:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f359d600640 1 -- 172.21.15.103:0/324297197 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35a0062040 con 0x55a545c5d1d0 2024-09-10T22:44:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f359d600640 1 -- 172.21.15.103:0/324297197 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 96) ==== 3554+0+0 (secure 0 0 0) 0x7f3598043020 con 0x55a545c5d1d0 2024-09-10T22:44:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 10 client.7830 fetch_fsmap finished waiting for FSMap version 96 2024-09-10T22:44:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 10 client.7830 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-10T22:44:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 20 client.7830 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 1 --2- 172.21.15.103:0/324297197 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55a545dc3830 0x55a545dd7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 4 client.7830 mds_command: new command op to 7434 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-10T22:44:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 1 -- 172.21.15.103:0/324297197 --> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55a545bce590 con 0x55a545dc3830 2024-09-10T22:44:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35afe00640 1 --2- 172.21.15.103:0/324297197 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55a545dc3830 0x55a545dd7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f359d600640 10 client.7830 ms_handle_connect on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35afe00640 1 --2- 172.21.15.103:0/324297197 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55a545dc3830 0x55a545dd7ab0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89cceda5b2dabb3b server_cookie=b00f050213ea3a5c in_seq=0 out_seq=0 2024-09-10T22:44:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f359d600640 1 -- 172.21.15.103:0/324297197 <== mds.0 v2:172.21.15.103:6833/187627880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a545bce590 con 0x55a545dc3830 2024-09-10T22:44:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f359d600640 10 client.7830 handle_command_reply: tid=0 2024-09-10T22:44:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 1 client.7830 shutdown 2024-09-10T22:44:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 1 -- 172.21.15.103:0/324297197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545c5d1d0 msgr2=0x55a545e3a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 1 --2- 172.21.15.103:0/324297197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545c5d1d0 0x55a545e3a480 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f3598007ad0 tx=0x7f3598000f50 comp rx=0 tx=0).stop 2024-09-10T22:44:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 1 -- 172.21.15.103:0/324297197 shutdown_connections 2024-09-10T22:44:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 1 --2- 172.21.15.103:0/324297197 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x55a545dc3830 0x55a545dd7ab0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 1 --2- 172.21.15.103:0/324297197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a545d799b0 0x55a545e3a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 1 --2- 172.21.15.103:0/324297197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a545c5d1d0 0x55a545e3a480 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 1 --2- 172.21.15.103:0/324297197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a54587e880 0x55a545e39f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f359d600640 0 client.7830 ms_handle_reset on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:59.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 1 -- 172.21.15.103:0/324297197 >> 172.21.15.103:0/324297197 conn(0x55a545db2080 msgr2=0x55a545d743e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 1 -- 172.21.15.103:0/324297197 shutdown_connections 2024-09-10T22:44:59.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 1 -- 172.21.15.103:0/324297197 wait complete. 2024-09-10T22:44:59.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35ba046000 20 client.7830 trim_cache size 0 max 16384 2024-09-10T22:44:59.119 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:44:59.119 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:44:59.119 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:44:59.120 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:44:59.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35b6c00640 1 -- 172.21.15.103:0/1752319107 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f358c072610 msgr2=0x7f358c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35b6c00640 1 --2- 172.21.15.103:0/1752319107 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f358c072610 0x7f358c074ad0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f35b01f89d0 tx=0x7f3598009040 comp rx=0 tx=0).stop 2024-09-10T22:44:59.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35b6c00640 1 -- 172.21.15.103:0/1752319107 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35b006cc00 msgr2=0x7f35b0143af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35b6c00640 1 --2- 172.21.15.103:0/1752319107 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35b006cc00 0x7f35b0143af0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f35a000c4b0 tx=0x7f35a000c970 comp rx=0 tx=0).stop 2024-09-10T22:44:59.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35b6c00640 1 -- 172.21.15.103:0/1752319107 shutdown_connections 2024-09-10T22:44:59.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35b6c00640 1 --2- 172.21.15.103:0/1752319107 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f358c072610 0x7f358c074ad0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35b6c00640 1 --2- 172.21.15.103:0/1752319107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35b00d1460 0x7f35b0153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35b6c00640 1 --2- 172.21.15.103:0/1752319107 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35b00d02c0 0x7f35b01f9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35b6c00640 1 --2- 172.21.15.103:0/1752319107 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35b006cc00 0x7f35b0143af0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35b6c00640 1 -- 172.21.15.103:0/1752319107 >> 172.21.15.103:0/1752319107 conn(0x7f35b00d0940 msgr2=0x7f35b015d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35b6c00640 1 -- 172.21.15.103:0/1752319107 shutdown_connections 2024-09-10T22:44:59.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.109+0000 7f35b6c00640 1 -- 172.21.15.103:0/1752319107 wait complete. 2024-09-10T22:44:59.134 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:44:59.134 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.6:1 scrub status 2024-09-10T22:44:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.273+0000 7f66c7600640 1 -- 172.21.15.103:0/2610291792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66c00cc120 msgr2=0x7f66c00aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.273+0000 7f66c7600640 1 --2- 172.21.15.103:0/2610291792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66c00cc120 0x7f66c00aeb40 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f66c00744a0 tx=0x7f66b001c800 comp rx=0 tx=0).stop 2024-09-10T22:44:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.273+0000 7f66c7600640 1 -- 172.21.15.103:0/2610291792 shutdown_connections 2024-09-10T22:44:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.273+0000 7f66c7600640 1 --2- 172.21.15.103:0/2610291792 >> v2:172.21.15.131:3300/0 conn(0x7f66c015c970 0x7f66c0072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.273+0000 7f66c7600640 1 --2- 172.21.15.103:0/2610291792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66c00cc120 0x7f66c00aeb40 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.273+0000 7f66c7600640 1 -- 172.21.15.103:0/2610291792 >> 172.21.15.103:0/2610291792 conn(0x7f66c006cc00 msgr2=0x7f66c006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.273+0000 7f66c7600640 1 -- 172.21.15.103:0/2610291792 shutdown_connections 2024-09-10T22:44:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.273+0000 7f66c7600640 1 -- 172.21.15.103:0/2610291792 wait complete. 2024-09-10T22:44:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.273+0000 7f66c7600640 1 Processor -- start 2024-09-10T22:44:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.273+0000 7f66c7600640 1 -- start start 2024-09-10T22:44:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66c7600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66c00cc120 0x7f66c006eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66c7600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66c00cf790 0x7f66c0164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66c7600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66c015c970 0x7f66c006fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66c7600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f66c0169030 con 0x7f66c015c970 2024-09-10T22:44:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66c7600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f66c0168eb0 con 0x7f66c00cf790 2024-09-10T22:44:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66c7600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f66c01691b0 con 0x7f66c00cc120 2024-09-10T22:44:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66c5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66c015c970 0x7f66c006fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66c5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66c015c970 0x7f66c006fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40666/0 (socket says 172.21.15.103:40666) 2024-09-10T22:44:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66c5600640 1 -- 172.21.15.103:0/3579634514 learned_addr learned my addr 172.21.15.103:0/3579634514 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66c4c00640 1 --2- 172.21.15.103:0/3579634514 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66c00cc120 0x7f66c006eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66b7e00640 1 --2- 172.21.15.103:0/3579634514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66c00cf790 0x7f66c0164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66c5600640 1 -- 172.21.15.103:0/3579634514 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66c00cc120 msgr2=0x7f66c006eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66c5600640 1 --2- 172.21.15.103:0/3579634514 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66c00cc120 0x7f66c006eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66c5600640 1 -- 172.21.15.103:0/3579634514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66c00cf790 msgr2=0x7f66c0164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66c5600640 1 --2- 172.21.15.103:0/3579634514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66c00cf790 0x7f66c0164cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66c5600640 1 -- 172.21.15.103:0/3579634514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c01fae20 con 0x7f66c015c970 2024-09-10T22:44:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66c5600640 1 --2- 172.21.15.103:0/3579634514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66c015c970 0x7f66c006fae0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f66b800c7c0 tx=0x7f66b800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66bd600640 1 -- 172.21.15.103:0/3579634514 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b8003b80 con 0x7f66c015c970 2024-09-10T22:44:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66bd600640 1 -- 172.21.15.103:0/3579634514 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66b8003d20 con 0x7f66c015c970 2024-09-10T22:44:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66bd600640 1 -- 172.21.15.103:0/3579634514 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b800aab0 con 0x7f66c015c970 2024-09-10T22:44:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66c7600640 1 -- 172.21.15.103:0/3579634514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c01fb100 con 0x7f66c015c970 2024-09-10T22:44:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.277+0000 7f66c7600640 1 -- 172.21.15.103:0/3579634514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c01fb6c0 con 0x7f66c015c970 2024-09-10T22:44:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66bd600640 1 -- 172.21.15.103:0/3579634514 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f66b800ac50 con 0x7f66c015c970 2024-09-10T22:44:59.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66bd600640 1 --2- 172.21.15.103:0/3579634514 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f669c0725e0 0x7f669c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66caa56000 1 Processor -- start 2024-09-10T22:44:59.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66bd600640 1 -- 172.21.15.103:0/3579634514 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f66b8093190 con 0x7f66c015c970 2024-09-10T22:44:59.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66caa56000 1 -- start start 2024-09-10T22:44:59.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66c4c00640 1 --2- 172.21.15.103:0/3579634514 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f669c0725e0 0x7f669c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66c4c00640 1 --2- 172.21.15.103:0/3579634514 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f669c0725e0 0x7f669c074aa0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f66b00af000 tx=0x7f66b001b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66caa56000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844c181a0 0x559844c18580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66caa56000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c18ac0 0x559844bce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66caa56000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844bcebc0 0x559844bcefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66caa56000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559844ab6cb0 con 0x559844c18ac0 2024-09-10T22:44:59.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66caa56000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5598449cc310 con 0x559844bcebc0 2024-09-10T22:44:59.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66caa56000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x559844a29b90 con 0x559844c181a0 2024-09-10T22:44:59.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66b7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c18ac0 0x559844bce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66b7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c18ac0 0x559844bce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40680/0 (socket says 172.21.15.103:40680) 2024-09-10T22:44:59.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66b7e00640 1 -- 172.21.15.103:0/2508003606 learned_addr learned my addr 172.21.15.103:0/2508003606 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66c4c00640 1 --2- 172.21.15.103:0/2508003606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844c181a0 0x559844c18580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66c5600640 1 --2- 172.21.15.103:0/2508003606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844bcebc0 0x559844bcefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66b7e00640 1 -- 172.21.15.103:0/2508003606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844c181a0 msgr2=0x559844c18580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66b7e00640 1 --2- 172.21.15.103:0/2508003606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844c181a0 0x559844c18580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66b7e00640 1 -- 172.21.15.103:0/2508003606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844bcebc0 msgr2=0x559844bcefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66b7e00640 1 --2- 172.21.15.103:0/2508003606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844bcebc0 0x559844bcefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66b7e00640 1 -- 172.21.15.103:0/2508003606 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598449cdc60 con 0x559844c18ac0 2024-09-10T22:44:59.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66b7e00640 1 --2- 172.21.15.103:0/2508003606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c18ac0 0x559844bce680 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f66a80036b0 tx=0x7f66a8003b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2112ac041d6c6a61 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66b5600640 1 -- 172.21.15.103:0/2508003606 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a800bbc0 con 0x559844c18ac0 2024-09-10T22:44:59.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66b5600640 1 -- 172.21.15.103:0/2508003606 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66a8015070 con 0x559844c18ac0 2024-09-10T22:44:59.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.281+0000 7f66b5600640 1 -- 172.21.15.103:0/2508003606 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a8005280 con 0x559844c18ac0 2024-09-10T22:44:59.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 -- 172.21.15.103:0/2508003606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c18ac0 msgr2=0x559844bce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 --2- 172.21.15.103:0/2508003606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c18ac0 0x559844bce680 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f66a80036b0 tx=0x7f66a8003b70 comp rx=0 tx=0).stop 2024-09-10T22:44:59.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 -- 172.21.15.103:0/2508003606 shutdown_connections 2024-09-10T22:44:59.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 --2- 172.21.15.103:0/2508003606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844bcebc0 0x559844bcefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 --2- 172.21.15.103:0/2508003606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c18ac0 0x559844bce680 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 --2- 172.21.15.103:0/2508003606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844c181a0 0x559844c18580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 -- 172.21.15.103:0/2508003606 >> 172.21.15.103:0/2508003606 conn(0x559844bd4d20 msgr2=0x559844bccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 -- 172.21.15.103:0/2508003606 shutdown_connections 2024-09-10T22:44:59.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 -- 172.21.15.103:0/2508003606 wait complete. 2024-09-10T22:44:59.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 -- start start 2024-09-10T22:44:59.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 Processor -- start 2024-09-10T22:44:59.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844bcebc0 0x559844c1f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 0x559844c1fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844c18ac0 0x559844c1ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559844a1cdd0 con 0x559844c181a0 2024-09-10T22:44:59.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559844a18fc0 con 0x559844c18ac0 2024-09-10T22:44:59.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5598449be4b0 con 0x559844bcebc0 2024-09-10T22:44:59.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 10 client.0 _ll_register_callbacks cb 0x55984499c7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:59.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66b7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 0x559844c1fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66b7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 0x559844c1fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40692/0 (socket says 172.21.15.103:40692) 2024-09-10T22:44:59.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66b7e00640 1 -- 172.21.15.103:0/2707345820 learned_addr learned my addr 172.21.15.103:0/2707345820 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66c4c00640 1 --2- 172.21.15.103:0/2707345820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844bcebc0 0x559844c1f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66c5600640 1 --2- 172.21.15.103:0/2707345820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844c18ac0 0x559844c1ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66b7e00640 1 -- 172.21.15.103:0/2707345820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844bcebc0 msgr2=0x559844c1f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66b7e00640 1 --2- 172.21.15.103:0/2707345820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844bcebc0 0x559844c1f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66b7e00640 1 -- 172.21.15.103:0/2707345820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844c18ac0 msgr2=0x559844c1ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66b7e00640 1 --2- 172.21.15.103:0/2707345820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844c18ac0 0x559844c1ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66b7e00640 1 -- 172.21.15.103:0/2707345820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598449b71f0 con 0x559844c181a0 2024-09-10T22:44:59.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66b7e00640 1 --2- 172.21.15.103:0/2707345820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 0x559844c1fa70 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f66a800b9b0 tx=0x7f66a8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26b8e717cfdf51a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66ae000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:59.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66ae000640 1 -- 172.21.15.103:0/2707345820 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a8027060 con 0x559844c181a0 2024-09-10T22:44:59.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66ae000640 1 -- 172.21.15.103:0/2707345820 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f66a8011440 con 0x559844c181a0 2024-09-10T22:44:59.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 -- 172.21.15.103:0/2707345820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5598449b1330 con 0x559844c181a0 2024-09-10T22:44:59.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66ae000640 1 -- 172.21.15.103:0/2707345820 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f66a802d050 con 0x559844c181a0 2024-09-10T22:44:59.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 10 client.7842 fetch_fsmap learned FSMap version 96 2024-09-10T22:44:59.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66caa56000 1 -- 172.21.15.103:0/2707345820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x55984499dfa0 con 0x559844c181a0 2024-09-10T22:44:59.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.285+0000 7f66ae000640 1 -- 172.21.15.103:0/2707345820 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5598449b1330 con 0x559844c181a0 2024-09-10T22:44:59.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66ae000640 1 -- 172.21.15.103:0/2707345820 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 96) ==== 3554+0+0 (secure 0 0 0) 0x7f66a8030020 con 0x559844c181a0 2024-09-10T22:44:59.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66caa56000 10 client.7842 fetch_fsmap finished waiting for FSMap version 96 2024-09-10T22:44:59.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66caa56000 10 client.7842 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.a 2024-09-10T22:44:59.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66caa56000 20 client.7842 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:59.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66caa56000 1 --2- 172.21.15.103:0/2707345820 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x559844c27900 0x559844c29cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66caa56000 4 client.7842 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:59.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66caa56000 1 -- 172.21.15.103:0/2707345820 --> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559844a2bae0 con 0x559844c27900 2024-09-10T22:44:59.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66c4c00640 1 --2- 172.21.15.103:0/2707345820 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x559844c27900 0x559844c29cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66c4c00640 1 --2- 172.21.15.103:0/2707345820 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x559844c27900 0x559844c29cf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dfcefb449c6c6702 server_cookie=24b708814643213f in_seq=0 out_seq=0 2024-09-10T22:44:59.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66ae000640 10 client.7842 ms_handle_connect on v2:172.21.15.103:6832/3251348074 2024-09-10T22:44:59.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66ae000640 1 -- 172.21.15.103:0/2707345820 <== mds.1 v2:172.21.15.103:6832/3251348074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559844a2bae0 con 0x559844c27900 2024-09-10T22:44:59.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66ae000640 10 client.7842 handle_command_reply: tid=0 2024-09-10T22:44:59.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66caa56000 1 client.7842 shutdown 2024-09-10T22:44:59.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66caa56000 1 -- 172.21.15.103:0/2707345820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 msgr2=0x559844c1fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66caa56000 1 --2- 172.21.15.103:0/2707345820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 0x559844c1fa70 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f66a800b9b0 tx=0x7f66a8004040 comp rx=0 tx=0).stop 2024-09-10T22:44:59.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66caa56000 1 -- 172.21.15.103:0/2707345820 shutdown_connections 2024-09-10T22:44:59.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66caa56000 1 --2- 172.21.15.103:0/2707345820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844c18ac0 0x559844c1ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66caa56000 1 --2- 172.21.15.103:0/2707345820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 0x559844c1fa70 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66caa56000 1 --2- 172.21.15.103:0/2707345820 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x559844c27900 0x559844c29cf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66caa56000 1 --2- 172.21.15.103:0/2707345820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844bcebc0 0x559844c1f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66caa56000 1 -- 172.21.15.103:0/2707345820 >> 172.21.15.103:0/2707345820 conn(0x559844bd4d20 msgr2=0x559844bccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66ae000640 0 client.7842 ms_handle_reset on v2:172.21.15.103:6832/3251348074 2024-09-10T22:44:59.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66caa56000 1 -- 172.21.15.103:0/2707345820 shutdown_connections 2024-09-10T22:44:59.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66caa56000 1 -- 172.21.15.103:0/2707345820 wait complete. 2024-09-10T22:44:59.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.289+0000 7f66caa56000 20 client.7842 trim_cache size 0 max 16384 2024-09-10T22:44:59.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.305+0000 7f66caa56000 1 Processor -- start 2024-09-10T22:44:59.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.305+0000 7f66caa56000 1 -- start start 2024-09-10T22:44:59.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66caa56000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844bcebc0 0x559844c89c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66caa56000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 0x559844c8a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66caa56000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844c18ac0 0x559844c8a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66caa56000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559844bcea40 con 0x559844c181a0 2024-09-10T22:44:59.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66caa56000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f66c0204c50 con 0x559844bcebc0 2024-09-10T22:44:59.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66caa56000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f66c0203e20 con 0x559844c18ac0 2024-09-10T22:44:59.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66b7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 0x559844c8a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66b7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 0x559844c8a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40698/0 (socket says 172.21.15.103:40698) 2024-09-10T22:44:59.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66b7e00640 1 -- 172.21.15.103:0/221761593 learned_addr learned my addr 172.21.15.103:0/221761593 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66c5600640 1 --2- 172.21.15.103:0/221761593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844c18ac0 0x559844c8a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66c4c00640 1 --2- 172.21.15.103:0/221761593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844bcebc0 0x559844c89c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66b7e00640 1 -- 172.21.15.103:0/221761593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844c18ac0 msgr2=0x559844c8a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66b7e00640 1 --2- 172.21.15.103:0/221761593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844c18ac0 0x559844c8a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66b7e00640 1 -- 172.21.15.103:0/221761593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844bcebc0 msgr2=0x559844c89c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66b7e00640 1 --2- 172.21.15.103:0/221761593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844bcebc0 0x559844c89c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66b7e00640 1 -- 172.21.15.103:0/221761593 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559844a76660 con 0x559844c181a0 2024-09-10T22:44:59.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66c4c00640 1 --2- 172.21.15.103:0/221761593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844bcebc0 0x559844c89c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:59.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66b7e00640 1 --2- 172.21.15.103:0/221761593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 0x559844c8a170 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f66a8003e00 tx=0x7f66a80116d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa89496cac79e25 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66b4c00640 1 -- 172.21.15.103:0/221761593 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a8005020 con 0x559844c181a0 2024-09-10T22:44:59.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66b4c00640 1 -- 172.21.15.103:0/221761593 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66a801d070 con 0x559844c181a0 2024-09-10T22:44:59.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66b4c00640 1 -- 172.21.15.103:0/221761593 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a8005550 con 0x559844c181a0 2024-09-10T22:44:59.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66caa56000 1 -- 172.21.15.103:0/221761593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 msgr2=0x559844c8a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66caa56000 1 --2- 172.21.15.103:0/221761593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 0x559844c8a170 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f66a8003e00 tx=0x7f66a80116d0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66caa56000 1 -- 172.21.15.103:0/221761593 shutdown_connections 2024-09-10T22:44:59.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66caa56000 1 --2- 172.21.15.103:0/221761593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844c18ac0 0x559844c8a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66caa56000 1 --2- 172.21.15.103:0/221761593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 0x559844c8a170 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66caa56000 1 --2- 172.21.15.103:0/221761593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844bcebc0 0x559844c89c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66caa56000 1 -- 172.21.15.103:0/221761593 >> 172.21.15.103:0/221761593 conn(0x559844bd4d20 msgr2=0x559844bd02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66caa56000 1 -- 172.21.15.103:0/221761593 shutdown_connections 2024-09-10T22:44:59.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66caa56000 1 -- 172.21.15.103:0/221761593 wait complete. 2024-09-10T22:44:59.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66caa56000 1 -- start start 2024-09-10T22:44:59.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.309+0000 7f66caa56000 1 Processor -- start 2024-09-10T22:44:59.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844bcebc0 0x559844c2ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 0x559844c2f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844c18ac0 0x559844c4a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f66c0202fb0 con 0x559844c181a0 2024-09-10T22:44:59.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f66c0204520 con 0x559844c18ac0 2024-09-10T22:44:59.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5598446de680 con 0x559844bcebc0 2024-09-10T22:44:59.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 10 client.0 _ll_register_callbacks cb 0x7f66b800cf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:59.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66b7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 0x559844c2f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66b7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 0x559844c2f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40712/0 (socket says 172.21.15.103:40712) 2024-09-10T22:44:59.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66b7e00640 1 -- 172.21.15.103:0/897730163 learned_addr learned my addr 172.21.15.103:0/897730163 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66c5600640 1 --2- 172.21.15.103:0/897730163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844c18ac0 0x559844c4a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66c4c00640 1 --2- 172.21.15.103:0/897730163 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844bcebc0 0x559844c2ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66b7e00640 1 -- 172.21.15.103:0/897730163 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844bcebc0 msgr2=0x559844c2ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66b7e00640 1 --2- 172.21.15.103:0/897730163 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844bcebc0 0x559844c2ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66b7e00640 1 -- 172.21.15.103:0/897730163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844c18ac0 msgr2=0x559844c4a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66b7e00640 1 --2- 172.21.15.103:0/897730163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844c18ac0 0x559844c4a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66b7e00640 1 -- 172.21.15.103:0/897730163 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598449e3090 con 0x559844c181a0 2024-09-10T22:44:59.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66c5600640 1 --2- 172.21.15.103:0/897730163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844c18ac0 0x559844c4a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:59.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66b7e00640 1 --2- 172.21.15.103:0/897730163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 0x559844c2f150 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x559844a28d70 tx=0x7f66a80056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360f1389575e8f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66ae000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:59.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66ae000640 1 -- 172.21.15.103:0/897730163 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a8005860 con 0x559844c181a0 2024-09-10T22:44:59.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66ae000640 1 -- 172.21.15.103:0/897730163 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f66a80119f0 con 0x559844c181a0 2024-09-10T22:44:59.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 1 -- 172.21.15.103:0/897730163 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66a801d070 con 0x559844c181a0 2024-09-10T22:44:59.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66ae000640 1 -- 172.21.15.103:0/897730163 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f66a8042050 con 0x559844c181a0 2024-09-10T22:44:59.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 10 client.7848 fetch_fsmap learned FSMap version 96 2024-09-10T22:44:59.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 1 -- 172.21.15.103:0/897730163 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x5598449af5f0 con 0x559844c181a0 2024-09-10T22:44:59.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66ae000640 1 -- 172.21.15.103:0/897730163 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66a801d070 con 0x559844c181a0 2024-09-10T22:44:59.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66ae000640 1 -- 172.21.15.103:0/897730163 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 96) ==== 3554+0+0 (secure 0 0 0) 0x7f66a8045020 con 0x559844c181a0 2024-09-10T22:44:59.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 10 client.7848 fetch_fsmap finished waiting for FSMap version 96 2024-09-10T22:44:59.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 10 client.7848 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.a 2024-09-10T22:44:59.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 20 client.7848 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:59.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 1 --2- 172.21.15.103:0/897730163 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x559844c4ac00 0x559844c8d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 4 client.7848 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:44:59.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 1 -- 172.21.15.103:0/897730163 --> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559844a27590 con 0x559844c4ac00 2024-09-10T22:44:59.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66c4c00640 1 --2- 172.21.15.103:0/897730163 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x559844c4ac00 0x559844c8d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66c4c00640 1 --2- 172.21.15.103:0/897730163 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x559844c4ac00 0x559844c8d640 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=486e99040846980d server_cookie=98983d5a036a7a6 in_seq=0 out_seq=0 2024-09-10T22:44:59.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66ae000640 10 client.7848 ms_handle_connect on v2:172.21.15.103:6832/3251348074 2024-09-10T22:44:59.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66ae000640 1 -- 172.21.15.103:0/897730163 <== mds.1 v2:172.21.15.103:6832/3251348074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x559844a27590 con 0x559844c4ac00 2024-09-10T22:44:59.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66ae000640 10 client.7848 handle_command_reply: tid=0 2024-09-10T22:44:59.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 1 client.7848 shutdown 2024-09-10T22:44:59.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 1 -- 172.21.15.103:0/897730163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 msgr2=0x559844c2f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.313+0000 7f66caa56000 1 --2- 172.21.15.103:0/897730163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 0x559844c2f150 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x559844a28d70 tx=0x7f66a80056b0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66caa56000 1 -- 172.21.15.103:0/897730163 shutdown_connections 2024-09-10T22:44:59.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66caa56000 1 --2- 172.21.15.103:0/897730163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559844c18ac0 0x559844c4a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66caa56000 1 --2- 172.21.15.103:0/897730163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559844c181a0 0x559844c2f150 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66caa56000 1 --2- 172.21.15.103:0/897730163 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x559844c4ac00 0x559844c8d640 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66caa56000 1 --2- 172.21.15.103:0/897730163 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559844bcebc0 0x559844c2ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66caa56000 1 -- 172.21.15.103:0/897730163 >> 172.21.15.103:0/897730163 conn(0x559844bd4d20 msgr2=0x559844c29cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66ae000640 0 client.7848 ms_handle_reset on v2:172.21.15.103:6832/3251348074 2024-09-10T22:44:59.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66caa56000 1 -- 172.21.15.103:0/897730163 shutdown_connections 2024-09-10T22:44:59.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66caa56000 1 -- 172.21.15.103:0/897730163 wait complete. 2024-09-10T22:44:59.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66caa56000 20 client.7848 trim_cache size 0 max 16384 2024-09-10T22:44:59.325 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:44:59.325 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-10T22:44:59.325 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:44:59.325 INFO:teuthology.orchestra.run.smithi103.stdout: "118e1155-7244-4d9c-9fab-dbfc720435a1": { 2024-09-10T22:44:59.326 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:44:59.326 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "118e1155-7244-4d9c-9fab-dbfc720435a1", 2024-09-10T22:44:59.326 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:44:59.326 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:59.326 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:59.326 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:44:59.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66c7600640 1 -- 172.21.15.103:0/3579634514 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f669c0725e0 msgr2=0x7f669c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66c7600640 1 --2- 172.21.15.103:0/3579634514 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f669c0725e0 0x7f669c074aa0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f66b00af000 tx=0x7f66b001b040 comp rx=0 tx=0).stop 2024-09-10T22:44:59.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66c7600640 1 -- 172.21.15.103:0/3579634514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66c015c970 msgr2=0x7f66c006fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66c7600640 1 --2- 172.21.15.103:0/3579634514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66c015c970 0x7f66c006fae0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f66b800c7c0 tx=0x7f66b800cc80 comp rx=0 tx=0).stop 2024-09-10T22:44:59.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66c7600640 1 -- 172.21.15.103:0/3579634514 shutdown_connections 2024-09-10T22:44:59.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66c7600640 1 --2- 172.21.15.103:0/3579634514 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f669c0725e0 0x7f669c074aa0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66c7600640 1 --2- 172.21.15.103:0/3579634514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66c015c970 0x7f66c006fae0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66c7600640 1 --2- 172.21.15.103:0/3579634514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66c00cf790 0x7f66c0164cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66c7600640 1 --2- 172.21.15.103:0/3579634514 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66c00cc120 0x7f66c006eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66c7600640 1 -- 172.21.15.103:0/3579634514 >> 172.21.15.103:0/3579634514 conn(0x7f66c006cc00 msgr2=0x7f66c015bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66c7600640 1 -- 172.21.15.103:0/3579634514 shutdown_connections 2024-09-10T22:44:59.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.317+0000 7f66c7600640 1 -- 172.21.15.103:0/3579634514 wait complete. 2024-09-10T22:44:59.339 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:44:59.339 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:44:59.339 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.6:2 scrub status 2024-09-10T22:44:59.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.477+0000 7f1d07200640 1 -- 172.21.15.103:0/3371129890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0815f0e0 msgr2=0x7f1d080cff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.477+0000 7f1d07200640 1 --2- 172.21.15.103:0/3371129890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0815f0e0 0x7f1d080cff60 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009900 tx=0x7f1cf801c7c0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.477+0000 7f1d07200640 1 -- 172.21.15.103:0/3371129890 shutdown_connections 2024-09-10T22:44:59.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.477+0000 7f1d07200640 1 --2- 172.21.15.103:0/3371129890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0815f0e0 0x7f1d080cff60 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.477+0000 7f1d07200640 1 -- 172.21.15.103:0/3371129890 >> 172.21.15.103:0/3371129890 conn(0x7f1d080d18f0 msgr2=0x7f1d080d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.477+0000 7f1d07200640 1 -- 172.21.15.103:0/3371129890 shutdown_connections 2024-09-10T22:44:59.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.477+0000 7f1d07200640 1 -- 172.21.15.103:0/3371129890 wait complete. 2024-09-10T22:44:59.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d07200640 1 Processor -- start 2024-09-10T22:44:59.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d07200640 1 -- start start 2024-09-10T22:44:59.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d07200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d080b06e0 0x7f1d0814b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d07200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d080d04a0 0x7f1d080b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d07200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0815f0e0 0x7f1d08153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d07200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0816a050 con 0x7f1d0815f0e0 2024-09-10T22:44:59.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d07200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08169ed0 con 0x7f1d080d04a0 2024-09-10T22:44:59.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d07200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1d0816a1d0 con 0x7f1d080b06e0 2024-09-10T22:44:59.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d06800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0815f0e0 0x7f1d08153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d06800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0815f0e0 0x7f1d08153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40738/0 (socket says 172.21.15.103:40738) 2024-09-10T22:44:59.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d06800640 1 -- 172.21.15.103:0/870846862 learned_addr learned my addr 172.21.15.103:0/870846862 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d05e00640 1 --2- 172.21.15.103:0/870846862 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d080b06e0 0x7f1d0814b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d06800640 1 -- 172.21.15.103:0/870846862 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d080b06e0 msgr2=0x7f1d0814b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d06800640 1 --2- 172.21.15.103:0/870846862 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d080b06e0 0x7f1d0814b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1cfd400640 1 --2- 172.21.15.103:0/870846862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d080d04a0 0x7f1d080b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d06800640 1 -- 172.21.15.103:0/870846862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d080d04a0 msgr2=0x7f1d080b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d06800640 1 --2- 172.21.15.103:0/870846862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d080d04a0 0x7f1d080b6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d06800640 1 -- 172.21.15.103:0/870846862 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d080b53e0 con 0x7f1d0815f0e0 2024-09-10T22:44:59.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d05e00640 1 --2- 172.21.15.103:0/870846862 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d080b06e0 0x7f1d0814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:59.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1cfd400640 1 --2- 172.21.15.103:0/870846862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d080d04a0 0x7f1d080b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:59.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d06800640 1 --2- 172.21.15.103:0/870846862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0815f0e0 0x7f1d08153c20 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000c7c0 tx=0x7f1d0000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1cfea00640 1 -- 172.21.15.103:0/870846862 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00003b80 con 0x7f1d0815f0e0 2024-09-10T22:44:59.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1cfea00640 1 -- 172.21.15.103:0/870846862 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d00003d20 con 0x7f1d0815f0e0 2024-09-10T22:44:59.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1cfea00640 1 -- 172.21.15.103:0/870846862 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0000aab0 con 0x7f1d0815f0e0 2024-09-10T22:44:59.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d07200640 1 -- 172.21.15.103:0/870846862 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d080b63a0 con 0x7f1d0815f0e0 2024-09-10T22:44:59.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.481+0000 7f1d07200640 1 -- 172.21.15.103:0/870846862 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d080b56c0 con 0x7f1d0815f0e0 2024-09-10T22:44:59.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.485+0000 7f1cfea00640 1 -- 172.21.15.103:0/870846862 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1d0000ac50 con 0x7f1d0815f0e0 2024-09-10T22:44:59.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.485+0000 7f1cfea00640 1 --2- 172.21.15.103:0/870846862 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1ce40725e0 0x7f1ce4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.485+0000 7f1cfea00640 1 -- 172.21.15.103:0/870846862 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f1d000933b0 con 0x7f1d0815f0e0 2024-09-10T22:44:59.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.485+0000 7f1d10415000 1 Processor -- start 2024-09-10T22:44:59.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.485+0000 7f1d10415000 1 -- start start 2024-09-10T22:44:59.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.485+0000 7f1d05e00640 1 --2- 172.21.15.103:0/870846862 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1ce40725e0 0x7f1ce4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de9521a0 0x5621de952580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de952ac0 0x5621de908680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de908bc0 0x5621de908fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5621de7f0cb0 con 0x5621de952ac0 2024-09-10T22:44:59.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5621de706310 con 0x5621de908bc0 2024-09-10T22:44:59.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5621de763b90 con 0x5621de9521a0 2024-09-10T22:44:59.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d05e00640 1 --2- 172.21.15.103:0/870846862 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1ce40725e0 0x7f1ce4074aa0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80af000 tx=0x7f1cf801b000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1cfd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de952ac0 0x5621de908680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1cfd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de952ac0 0x5621de908680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40754/0 (socket says 172.21.15.103:40754) 2024-09-10T22:44:59.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1cfd400640 1 -- 172.21.15.103:0/1367984116 learned_addr learned my addr 172.21.15.103:0/1367984116 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d06800640 1 --2- 172.21.15.103:0/1367984116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de908bc0 0x5621de908fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d05e00640 1 --2- 172.21.15.103:0/1367984116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de9521a0 0x5621de952580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1cfd400640 1 -- 172.21.15.103:0/1367984116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de9521a0 msgr2=0x5621de952580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1cfd400640 1 --2- 172.21.15.103:0/1367984116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de9521a0 0x5621de952580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1cfd400640 1 -- 172.21.15.103:0/1367984116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de908bc0 msgr2=0x5621de908fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1cfd400640 1 --2- 172.21.15.103:0/1367984116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de908bc0 0x5621de908fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1cfd400640 1 -- 172.21.15.103:0/1367984116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621de707c60 con 0x5621de952ac0 2024-09-10T22:44:59.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1cfd400640 1 --2- 172.21.15.103:0/1367984116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de952ac0 0x5621de908680 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f1d080c8770 tx=0x7f1cf0001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37fc56da4f9d5a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1cf6a00640 1 -- 172.21.15.103:0/1367984116 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0018070 con 0x5621de952ac0 2024-09-10T22:44:59.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1cf6a00640 1 -- 172.21.15.103:0/1367984116 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cf0007030 con 0x5621de952ac0 2024-09-10T22:44:59.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1cf6a00640 1 -- 172.21.15.103:0/1367984116 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0007460 con 0x5621de952ac0 2024-09-10T22:44:59.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 -- 172.21.15.103:0/1367984116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de952ac0 msgr2=0x5621de908680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 --2- 172.21.15.103:0/1367984116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de952ac0 0x5621de908680 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f1d080c8770 tx=0x7f1cf0001ba0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 -- 172.21.15.103:0/1367984116 shutdown_connections 2024-09-10T22:44:59.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 --2- 172.21.15.103:0/1367984116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de908bc0 0x5621de908fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 --2- 172.21.15.103:0/1367984116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de952ac0 0x5621de908680 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 --2- 172.21.15.103:0/1367984116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de9521a0 0x5621de952580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 -- 172.21.15.103:0/1367984116 >> 172.21.15.103:0/1367984116 conn(0x5621de90ed20 msgr2=0x5621de906f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 -- 172.21.15.103:0/1367984116 shutdown_connections 2024-09-10T22:44:59.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 -- 172.21.15.103:0/1367984116 wait complete. 2024-09-10T22:44:59.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 -- start start 2024-09-10T22:44:59.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 Processor -- start 2024-09-10T22:44:59.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de908bc0 0x5621de959530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.489+0000 7f1d10415000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de9521a0 0x5621de959a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d10415000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de952ac0 0x5621de959fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d10415000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5621de756dd0 con 0x5621de908bc0 2024-09-10T22:44:59.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d10415000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5621de752fc0 con 0x5621de9521a0 2024-09-10T22:44:59.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d10415000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5621de6f84b0 con 0x5621de952ac0 2024-09-10T22:44:59.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d10415000 10 client.0 _ll_register_callbacks cb 0x5621de6d67d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:59.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d05e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de908bc0 0x5621de959530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d05e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de908bc0 0x5621de959530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40762/0 (socket says 172.21.15.103:40762) 2024-09-10T22:44:59.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d05e00640 1 -- 172.21.15.103:0/893802377 learned_addr learned my addr 172.21.15.103:0/893802377 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d06800640 1 --2- 172.21.15.103:0/893802377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de952ac0 0x5621de959fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1cfd400640 1 --2- 172.21.15.103:0/893802377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de9521a0 0x5621de959a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d05e00640 1 -- 172.21.15.103:0/893802377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de952ac0 msgr2=0x5621de959fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d05e00640 1 --2- 172.21.15.103:0/893802377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de952ac0 0x5621de959fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d05e00640 1 -- 172.21.15.103:0/893802377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de9521a0 msgr2=0x5621de959a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d05e00640 1 --2- 172.21.15.103:0/893802377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de9521a0 0x5621de959a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d05e00640 1 -- 172.21.15.103:0/893802377 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621de6f11f0 con 0x5621de908bc0 2024-09-10T22:44:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d06800640 1 --2- 172.21.15.103:0/893802377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de952ac0 0x5621de959fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1cfd400640 1 --2- 172.21.15.103:0/893802377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de9521a0 0x5621de959a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:44:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d05e00640 1 --2- 172.21.15.103:0/893802377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de908bc0 0x5621de959530 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8000c10 tx=0x7f1cf801c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83df0f80436b4dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1ceb400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1ceb400640 1 -- 172.21.15.103:0/893802377 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80b2040 con 0x5621de908bc0 2024-09-10T22:44:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1ceb400640 1 -- 172.21.15.103:0/893802377 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f1cf8005340 con 0x5621de908bc0 2024-09-10T22:44:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d10415000 1 -- 172.21.15.103:0/893802377 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5621de6eb330 con 0x5621de908bc0 2024-09-10T22:44:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1ceb400640 1 -- 172.21.15.103:0/893802377 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f1cf80d1050 con 0x5621de908bc0 2024-09-10T22:44:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d10415000 10 client.7863 fetch_fsmap learned FSMap version 96 2024-09-10T22:44:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d10415000 1 -- 172.21.15.103:0/893802377 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x5621de6d7fa0 con 0x5621de908bc0 2024-09-10T22:44:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1ceb400640 1 -- 172.21.15.103:0/893802377 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5621de6eb330 con 0x5621de908bc0 2024-09-10T22:44:59.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1ceb400640 1 -- 172.21.15.103:0/893802377 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 96) ==== 3554+0+0 (secure 0 0 0) 0x7f1cf80d4020 con 0x5621de908bc0 2024-09-10T22:44:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d10415000 10 client.7863 fetch_fsmap finished waiting for FSMap version 96 2024-09-10T22:44:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d10415000 10 client.7863 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2024-09-10T22:44:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d10415000 20 client.7863 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d10415000 1 --2- 172.21.15.103:0/893802377 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5621de961900 0x5621de963cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d10415000 4 client.7863 mds_command: new command op to 7048 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1d10415000 1 -- 172.21.15.103:0/893802377 --> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621de765ae0 con 0x5621de961900 2024-09-10T22:44:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1cfd400640 1 --2- 172.21.15.103:0/893802377 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5621de961900 0x5621de963cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1cfd400640 1 --2- 172.21.15.103:0/893802377 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5621de961900 0x5621de963cf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ad3eb7582bf5c655 server_cookie=b3814cf88dc62ea6 in_seq=0 out_seq=0 2024-09-10T22:44:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.493+0000 7f1ceb400640 10 client.7863 ms_handle_connect on v2:172.21.15.131:6834/1622106563 2024-09-10T22:44:59.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.497+0000 7f1ceb400640 1 -- 172.21.15.103:0/893802377 <== mds.2 v2:172.21.15.131:6834/1622106563 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5621de765ae0 con 0x5621de961900 2024-09-10T22:44:59.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.497+0000 7f1ceb400640 10 client.7863 handle_command_reply: tid=0 2024-09-10T22:44:59.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.497+0000 7f1d10415000 1 client.7863 shutdown 2024-09-10T22:44:59.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.497+0000 7f1d10415000 1 -- 172.21.15.103:0/893802377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de908bc0 msgr2=0x5621de959530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.497+0000 7f1d10415000 1 --2- 172.21.15.103:0/893802377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de908bc0 0x5621de959530 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8000c10 tx=0x7f1cf801c7c0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.497+0000 7f1d10415000 1 -- 172.21.15.103:0/893802377 shutdown_connections 2024-09-10T22:44:59.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.497+0000 7f1d10415000 1 --2- 172.21.15.103:0/893802377 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5621de961900 0x5621de963cf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.497+0000 7f1d10415000 1 --2- 172.21.15.103:0/893802377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de952ac0 0x5621de959fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.497+0000 7f1d10415000 1 --2- 172.21.15.103:0/893802377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de9521a0 0x5621de959a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.497+0000 7f1ceb400640 0 client.7863 ms_handle_reset on v2:172.21.15.131:6834/1622106563 2024-09-10T22:44:59.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.497+0000 7f1d10415000 1 --2- 172.21.15.103:0/893802377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de908bc0 0x5621de959530 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.497+0000 7f1d10415000 1 -- 172.21.15.103:0/893802377 >> 172.21.15.103:0/893802377 conn(0x5621de90ed20 msgr2=0x5621de906f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.497+0000 7f1d10415000 1 -- 172.21.15.103:0/893802377 shutdown_connections 2024-09-10T22:44:59.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.497+0000 7f1d10415000 1 -- 172.21.15.103:0/893802377 wait complete. 2024-09-10T22:44:59.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.497+0000 7f1d10415000 20 client.7863 trim_cache size 0 max 16384 2024-09-10T22:44:59.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.513+0000 7f1d10415000 1 Processor -- start 2024-09-10T22:44:59.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.513+0000 7f1d10415000 1 -- start start 2024-09-10T22:44:59.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.513+0000 7f1d10415000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de908bc0 0x5621de909fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.513+0000 7f1d10415000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de9521a0 0x5621de90a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.513+0000 7f1d10415000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de952ac0 0x5621de95c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.513+0000 7f1d10415000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08202980 con 0x5621de952ac0 2024-09-10T22:44:59.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.513+0000 7f1d10415000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08201b50 con 0x5621de908bc0 2024-09-10T22:44:59.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.513+0000 7f1d10415000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1d08202250 con 0x5621de9521a0 2024-09-10T22:44:59.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.513+0000 7f1d06800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de952ac0 0x5621de95c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.513+0000 7f1d06800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de952ac0 0x5621de95c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40766/0 (socket says 172.21.15.103:40766) 2024-09-10T22:44:59.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.513+0000 7f1d06800640 1 -- 172.21.15.103:0/1160845733 learned_addr learned my addr 172.21.15.103:0/1160845733 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.513+0000 7f1d06800640 1 -- 172.21.15.103:0/1160845733 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de9521a0 msgr2=0x5621de90a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1cfd400640 1 --2- 172.21.15.103:0/1160845733 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de9521a0 0x5621de90a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d05e00640 1 --2- 172.21.15.103:0/1160845733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de908bc0 0x5621de909fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d06800640 1 --2- 172.21.15.103:0/1160845733 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de9521a0 0x5621de90a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d06800640 1 -- 172.21.15.103:0/1160845733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de908bc0 msgr2=0x5621de909fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d06800640 1 --2- 172.21.15.103:0/1160845733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de908bc0 0x5621de909fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d06800640 1 -- 172.21.15.103:0/1160845733 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621de7b0660 con 0x5621de952ac0 2024-09-10T22:44:59.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1cfd400640 1 --2- 172.21.15.103:0/1160845733 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de9521a0 0x5621de90a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:59.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d05e00640 1 --2- 172.21.15.103:0/1160845733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de908bc0 0x5621de909fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:44:59.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d06800640 1 --2- 172.21.15.103:0/1160845733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de952ac0 0x5621de95c550 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000c790 tx=0x7f1d00065040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11aec3458aa9c11 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1cf6000640 1 -- 172.21.15.103:0/1160845733 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0005e0f0 con 0x5621de952ac0 2024-09-10T22:44:59.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1cf6000640 1 -- 172.21.15.103:0/1160845733 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d000675f0 con 0x5621de952ac0 2024-09-10T22:44:59.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1cf6000640 1 -- 172.21.15.103:0/1160845733 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00093030 con 0x5621de952ac0 2024-09-10T22:44:59.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d10415000 1 -- 172.21.15.103:0/1160845733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de952ac0 msgr2=0x5621de95c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d10415000 1 --2- 172.21.15.103:0/1160845733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de952ac0 0x5621de95c550 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000c790 tx=0x7f1d00065040 comp rx=0 tx=0).stop 2024-09-10T22:44:59.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d10415000 1 -- 172.21.15.103:0/1160845733 shutdown_connections 2024-09-10T22:44:59.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d10415000 1 --2- 172.21.15.103:0/1160845733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de952ac0 0x5621de95c550 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d10415000 1 --2- 172.21.15.103:0/1160845733 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de9521a0 0x5621de90a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d10415000 1 --2- 172.21.15.103:0/1160845733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de908bc0 0x5621de909fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d10415000 1 -- 172.21.15.103:0/1160845733 >> 172.21.15.103:0/1160845733 conn(0x5621de90ed20 msgr2=0x5621de908180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d10415000 1 -- 172.21.15.103:0/1160845733 shutdown_connections 2024-09-10T22:44:59.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d10415000 1 -- 172.21.15.103:0/1160845733 wait complete. 2024-09-10T22:44:59.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d10415000 1 -- start start 2024-09-10T22:44:59.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d10415000 1 Processor -- start 2024-09-10T22:44:59.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d10415000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de908bc0 0x5621de95f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d10415000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de9521a0 0x5621de95faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d10415000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de952ac0 0x5621de984210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d10415000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5621de756dd0 con 0x5621de9521a0 2024-09-10T22:44:59.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d10415000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5621de911d40 con 0x5621de908bc0 2024-09-10T22:44:59.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d10415000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5621de90f100 con 0x5621de952ac0 2024-09-10T22:44:59.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1d10415000 10 client.0 _ll_register_callbacks cb 0x7f1cf80b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:59.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1cfd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de9521a0 0x5621de95faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1cfd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de9521a0 0x5621de95faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40768/0 (socket says 172.21.15.103:40768) 2024-09-10T22:44:59.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1cfd400640 1 -- 172.21.15.103:0/1649513722 learned_addr learned my addr 172.21.15.103:0/1649513722 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1cfd400640 1 -- 172.21.15.103:0/1649513722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de952ac0 msgr2=0x5621de984210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1cfd400640 1 --2- 172.21.15.103:0/1649513722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de952ac0 0x5621de984210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1cfd400640 1 -- 172.21.15.103:0/1649513722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de908bc0 msgr2=0x5621de95f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1cfd400640 1 --2- 172.21.15.103:0/1649513722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de908bc0 0x5621de95f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1cfd400640 1 -- 172.21.15.103:0/1649513722 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621de71d090 con 0x5621de9521a0 2024-09-10T22:44:59.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1cfd400640 1 --2- 172.21.15.103:0/1649513722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de9521a0 0x5621de95faa0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000d520 tx=0x7f1cf0001240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3398e350a6849efe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.517+0000 7f1ceb400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:59.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1ceb400640 1 -- 172.21.15.103:0/1649513722 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf002c060 con 0x5621de9521a0 2024-09-10T22:44:59.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1ceb400640 1 -- 172.21.15.103:0/1649513722 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f1cf0007360 con 0x5621de9521a0 2024-09-10T22:44:59.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 1 -- 172.21.15.103:0/1649513722 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d000675f0 con 0x5621de9521a0 2024-09-10T22:44:59.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1ceb400640 1 -- 172.21.15.103:0/1649513722 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f1cf0018040 con 0x5621de9521a0 2024-09-10T22:44:59.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 10 client.7869 fetch_fsmap learned FSMap version 96 2024-09-10T22:44:59.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 1 -- 172.21.15.103:0/1649513722 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x5621de6e95f0 con 0x5621de9521a0 2024-09-10T22:44:59.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1ceb400640 1 -- 172.21.15.103:0/1649513722 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d000675f0 con 0x5621de9521a0 2024-09-10T22:44:59.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1ceb400640 1 -- 172.21.15.103:0/1649513722 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 96) ==== 3554+0+0 (secure 0 0 0) 0x7f1cf00067e0 con 0x5621de9521a0 2024-09-10T22:44:59.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 10 client.7869 fetch_fsmap finished waiting for FSMap version 96 2024-09-10T22:44:59.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 10 client.7869 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2024-09-10T22:44:59.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 20 client.7869 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:59.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 1 --2- 172.21.15.103:0/1649513722 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5621de984ba0 0x5621de9c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 4 client.7869 mds_command: new command op to 7048 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:44:59.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 1 -- 172.21.15.103:0/1649513722 --> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5621de761590 con 0x5621de984ba0 2024-09-10T22:44:59.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d05e00640 1 --2- 172.21.15.103:0/1649513722 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5621de984ba0 0x5621de9c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d05e00640 1 --2- 172.21.15.103:0/1649513722 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5621de984ba0 0x5621de9c7e80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f125870ee8f980d4 server_cookie=875f708cf830c49 in_seq=0 out_seq=0 2024-09-10T22:44:59.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1ceb400640 10 client.7869 ms_handle_connect on v2:172.21.15.131:6834/1622106563 2024-09-10T22:44:59.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1ceb400640 1 -- 172.21.15.103:0/1649513722 <== mds.2 v2:172.21.15.131:6834/1622106563 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x5621de761590 con 0x5621de984ba0 2024-09-10T22:44:59.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1ceb400640 10 client.7869 handle_command_reply: tid=0 2024-09-10T22:44:59.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 1 client.7869 shutdown 2024-09-10T22:44:59.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 1 -- 172.21.15.103:0/1649513722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de9521a0 msgr2=0x5621de95faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 1 --2- 172.21.15.103:0/1649513722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de9521a0 0x5621de95faa0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000d520 tx=0x7f1cf0001240 comp rx=0 tx=0).stop 2024-09-10T22:44:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 1 -- 172.21.15.103:0/1649513722 shutdown_connections 2024-09-10T22:44:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 1 --2- 172.21.15.103:0/1649513722 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5621de984ba0 0x5621de9c7e80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 1 --2- 172.21.15.103:0/1649513722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621de952ac0 0x5621de984210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 1 --2- 172.21.15.103:0/1649513722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5621de9521a0 0x5621de95faa0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1ceb400640 0 client.7869 ms_handle_reset on v2:172.21.15.131:6834/1622106563 2024-09-10T22:44:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 1 --2- 172.21.15.103:0/1649513722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621de908bc0 0x5621de95f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 1 -- 172.21.15.103:0/1649513722 >> 172.21.15.103:0/1649513722 conn(0x5621de90ed20 msgr2=0x5621de908fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 1 -- 172.21.15.103:0/1649513722 shutdown_connections 2024-09-10T22:44:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 1 -- 172.21.15.103:0/1649513722 wait complete. 2024-09-10T22:44:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d10415000 20 client.7869 trim_cache size 0 max 16384 2024-09-10T22:44:59.533 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:44:59.533 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-10T22:44:59.533 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:44:59.533 INFO:teuthology.orchestra.run.smithi103.stdout: "118e1155-7244-4d9c-9fab-dbfc720435a1": { 2024-09-10T22:44:59.533 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:44:59.533 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "118e1155-7244-4d9c-9fab-dbfc720435a1", 2024-09-10T22:44:59.533 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:44:59.534 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:59.534 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:59.534 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:44:59.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d07200640 1 -- 172.21.15.103:0/870846862 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1ce40725e0 msgr2=0x7f1ce4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d07200640 1 --2- 172.21.15.103:0/870846862 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1ce40725e0 0x7f1ce4074aa0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80af000 tx=0x7f1cf801b000 comp rx=0 tx=0).stop 2024-09-10T22:44:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d07200640 1 -- 172.21.15.103:0/870846862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0815f0e0 msgr2=0x7f1d08153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d07200640 1 --2- 172.21.15.103:0/870846862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0815f0e0 0x7f1d08153c20 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000c7c0 tx=0x7f1d0000cc80 comp rx=0 tx=0).stop 2024-09-10T22:44:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d07200640 1 -- 172.21.15.103:0/870846862 shutdown_connections 2024-09-10T22:44:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d07200640 1 --2- 172.21.15.103:0/870846862 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1ce40725e0 0x7f1ce4074aa0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d07200640 1 --2- 172.21.15.103:0/870846862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d0815f0e0 0x7f1d08153c20 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d07200640 1 --2- 172.21.15.103:0/870846862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d080d04a0 0x7f1d080b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d07200640 1 --2- 172.21.15.103:0/870846862 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d080b06e0 0x7f1d0814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d07200640 1 -- 172.21.15.103:0/870846862 >> 172.21.15.103:0/870846862 conn(0x7f1d080d18f0 msgr2=0x7f1d08158aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d07200640 1 -- 172.21.15.103:0/870846862 shutdown_connections 2024-09-10T22:44:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.521+0000 7f1d07200640 1 -- 172.21.15.103:0/870846862 wait complete. 2024-09-10T22:44:59.545 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:44:59.545 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:44:59.545 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.6:0 scrub status 2024-09-10T22:44:59.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.685+0000 7f0f07600640 1 -- 172.21.15.103:0/3706837536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f0006e150 msgr2=0x7f0f0006e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.685+0000 7f0f07600640 1 --2- 172.21.15.103:0/3706837536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f0006e150 0x7f0f0006e590 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009870 tx=0x7f0eec01c760 comp rx=0 tx=0).stop 2024-09-10T22:44:59.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.685+0000 7f0f07600640 1 -- 172.21.15.103:0/3706837536 shutdown_connections 2024-09-10T22:44:59.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.685+0000 7f0f07600640 1 --2- 172.21.15.103:0/3706837536 >> v2:172.21.15.131:3300/0 conn(0x7f0f0006ead0 0x7f0f00071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.685+0000 7f0f07600640 1 --2- 172.21.15.103:0/3706837536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f0006e150 0x7f0f0006e590 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.685+0000 7f0f07600640 1 -- 172.21.15.103:0/3706837536 >> 172.21.15.103:0/3706837536 conn(0x7f0f000d1ad0 msgr2=0x7f0f000d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.685+0000 7f0f07600640 1 -- 172.21.15.103:0/3706837536 shutdown_connections 2024-09-10T22:44:59.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.685+0000 7f0f07600640 1 -- 172.21.15.103:0/3706837536 wait complete. 2024-09-10T22:44:59.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f07600640 1 Processor -- start 2024-09-10T22:44:59.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f07600640 1 -- start start 2024-09-10T22:44:59.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f07600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f0006e150 0x7f0f001487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f07600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f0006ead0 0x7f0f0009bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f07600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f0015de80 0x7f0f0009e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f07600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0006f0b0 con 0x7f0f0006e150 2024-09-10T22:44:59.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f07600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0f000724c0 con 0x7f0f0015de80 2024-09-10T22:44:59.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f07600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0f0016aca0 con 0x7f0f0006ead0 2024-09-10T22:44:59.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f04c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f0006e150 0x7f0f001487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f04c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f0006e150 0x7f0f001487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40778/0 (socket says 172.21.15.103:40778) 2024-09-10T22:44:59.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f04c00640 1 -- 172.21.15.103:0/1436839439 learned_addr learned my addr 172.21.15.103:0/1436839439 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f05600640 1 --2- 172.21.15.103:0/1436839439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f0015de80 0x7f0f0009e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0effe00640 1 --2- 172.21.15.103:0/1436839439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f0006ead0 0x7f0f0009bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f04c00640 1 -- 172.21.15.103:0/1436839439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f0006ead0 msgr2=0x7f0f0009bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f04c00640 1 --2- 172.21.15.103:0/1436839439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f0006ead0 0x7f0f0009bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f04c00640 1 -- 172.21.15.103:0/1436839439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f0015de80 msgr2=0x7f0f0009e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f04c00640 1 --2- 172.21.15.103:0/1436839439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f0015de80 0x7f0f0009e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f04c00640 1 -- 172.21.15.103:0/1436839439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0009c0e0 con 0x7f0f0006e150 2024-09-10T22:44:59.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f04c00640 1 --2- 172.21.15.103:0/1436839439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f0006e150 0x7f0f001487d0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f0ef400c460 tx=0x7f0ef400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0efcc00640 1 -- 172.21.15.103:0/1436839439 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4016020 con 0x7f0f0006e150 2024-09-10T22:44:59.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0efcc00640 1 -- 172.21.15.103:0/1436839439 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ef4012940 con 0x7f0f0006e150 2024-09-10T22:44:59.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f07600640 1 -- 172.21.15.103:0/1436839439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f000c72b0 con 0x7f0f0006e150 2024-09-10T22:44:59.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0efcc00640 1 -- 172.21.15.103:0/1436839439 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4012d90 con 0x7f0f0006e150 2024-09-10T22:44:59.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.689+0000 7f0f07600640 1 -- 172.21.15.103:0/1436839439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f000c7870 con 0x7f0f0006e150 2024-09-10T22:44:59.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.693+0000 7f0efcc00640 1 -- 172.21.15.103:0/1436839439 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0ef401b400 con 0x7f0f0006e150 2024-09-10T22:44:59.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.693+0000 7f0f0aa41000 1 Processor -- start 2024-09-10T22:44:59.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.693+0000 7f0efcc00640 1 --2- 172.21.15.103:0/1436839439 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0ee00725e0 0x7f0ee0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.693+0000 7f0f0aa41000 1 -- start start 2024-09-10T22:44:59.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.693+0000 7f0efcc00640 1 -- 172.21.15.103:0/1436839439 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f0ef40935e0 con 0x7f0f0006e150 2024-09-10T22:44:59.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.693+0000 7f0f05600640 1 --2- 172.21.15.103:0/1436839439 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0ee00725e0 0x7f0ee0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.693+0000 7f0f0aa41000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e1491a0 0x56266e149580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.693+0000 7f0f0aa41000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e149ac0 0x56266e0ff680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.693+0000 7f0f0aa41000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e0ffbc0 0x56266e0fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.693+0000 7f0f0aa41000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56266dfe7cb0 con 0x56266e149ac0 2024-09-10T22:44:59.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.693+0000 7f0f0aa41000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56266defd310 con 0x56266e0ffbc0 2024-09-10T22:44:59.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.693+0000 7f0f0aa41000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56266df5ab90 con 0x56266e1491a0 2024-09-10T22:44:59.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.693+0000 7f0f05600640 1 --2- 172.21.15.103:0/1436839439 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0ee00725e0 0x7f0ee0074aa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009f60 tx=0x7f0ef8009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.693+0000 7f0effe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e149ac0 0x56266e0ff680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.693+0000 7f0f04c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e1491a0 0x56266e149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.693+0000 7f0f04c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e1491a0 0x56266e149580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:55354/0 (socket says 172.21.15.103:55354) 2024-09-10T22:44:59.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.693+0000 7f0effe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e149ac0 0x56266e0ff680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40784/0 (socket says 172.21.15.103:40784) 2024-09-10T22:44:59.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.693+0000 7f0f04c00640 1 -- 172.21.15.103:0/1266311584 learned_addr learned my addr 172.21.15.103:0/1266311584 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f05600640 1 --2- 172.21.15.103:0/1266311584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e0ffbc0 0x56266e0fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f04c00640 1 -- 172.21.15.103:0/1266311584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e0ffbc0 msgr2=0x56266e0fffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f04c00640 1 --2- 172.21.15.103:0/1266311584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e0ffbc0 0x56266e0fffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f04c00640 1 -- 172.21.15.103:0/1266311584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e149ac0 msgr2=0x56266e0ff680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f04c00640 1 --2- 172.21.15.103:0/1266311584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e149ac0 0x56266e0ff680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f04c00640 1 -- 172.21.15.103:0/1266311584 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56266defec60 con 0x56266e1491a0 2024-09-10T22:44:59.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0effe00640 1 --2- 172.21.15.103:0/1266311584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e149ac0 0x56266e0ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:44:59.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f04c00640 1 --2- 172.21.15.103:0/1266311584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e1491a0 0x56266e149580 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0ef405e440 tx=0x7f0ef405e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbc34a74758fd03 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0ef1600640 1 -- 172.21.15.103:0/1266311584 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4067900 con 0x56266e1491a0 2024-09-10T22:44:59.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0ef1600640 1 -- 172.21.15.103:0/1266311584 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ef405a720 con 0x56266e1491a0 2024-09-10T22:44:59.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0ef1600640 1 -- 172.21.15.103:0/1266311584 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4065310 con 0x56266e1491a0 2024-09-10T22:44:59.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f0aa41000 1 -- 172.21.15.103:0/1266311584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e1491a0 msgr2=0x56266e149580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/1266311584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e1491a0 0x56266e149580 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0ef405e440 tx=0x7f0ef405e4b0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f0aa41000 1 -- 172.21.15.103:0/1266311584 shutdown_connections 2024-09-10T22:44:59.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/1266311584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e0ffbc0 0x56266e0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/1266311584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e149ac0 0x56266e0ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/1266311584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e1491a0 0x56266e149580 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f0aa41000 1 -- 172.21.15.103:0/1266311584 >> 172.21.15.103:0/1266311584 conn(0x56266e105d20 msgr2=0x56266e0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f0aa41000 1 -- 172.21.15.103:0/1266311584 shutdown_connections 2024-09-10T22:44:59.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f0aa41000 1 -- 172.21.15.103:0/1266311584 wait complete. 2024-09-10T22:44:59.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f0aa41000 1 -- start start 2024-09-10T22:44:59.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f0aa41000 1 Processor -- start 2024-09-10T22:44:59.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f0aa41000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e0ffbc0 0x56266e150530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f0aa41000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e1491a0 0x56266e150a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f0aa41000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e149ac0 0x56266e150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f0aa41000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56266df4ddd0 con 0x56266e1491a0 2024-09-10T22:44:59.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f0aa41000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56266df49fc0 con 0x56266e149ac0 2024-09-10T22:44:59.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f0aa41000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56266deef4b0 con 0x56266e0ffbc0 2024-09-10T22:44:59.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f0aa41000 10 client.0 _ll_register_callbacks cb 0x56266decd7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:59.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0effe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e1491a0 0x56266e150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0effe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e1491a0 0x56266e150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40798/0 (socket says 172.21.15.103:40798) 2024-09-10T22:44:59.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0effe00640 1 -- 172.21.15.103:0/3542481021 learned_addr learned my addr 172.21.15.103:0/3542481021 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f04c00640 1 --2- 172.21.15.103:0/3542481021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e0ffbc0 0x56266e150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.697+0000 7f0f05600640 1 --2- 172.21.15.103:0/3542481021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e149ac0 0x56266e150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0effe00640 1 -- 172.21.15.103:0/3542481021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e0ffbc0 msgr2=0x56266e150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0effe00640 1 --2- 172.21.15.103:0/3542481021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e0ffbc0 0x56266e150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0effe00640 1 -- 172.21.15.103:0/3542481021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e149ac0 msgr2=0x56266e150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0effe00640 1 --2- 172.21.15.103:0/3542481021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e149ac0 0x56266e150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0effe00640 1 -- 172.21.15.103:0/3542481021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56266dee81f0 con 0x56266e1491a0 2024-09-10T22:44:59.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0effe00640 1 --2- 172.21.15.103:0/3542481021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e1491a0 0x56266e150a70 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0b0040 tx=0x7f0eec004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b9d2ec94a861f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0ee6000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:59.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0ee6000640 1 -- 172.21.15.103:0/3542481021 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec0b2040 con 0x56266e1491a0 2024-09-10T22:44:59.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0ee6000640 1 -- 172.21.15.103:0/3542481021 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f0eec005240 con 0x56266e1491a0 2024-09-10T22:44:59.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 1 -- 172.21.15.103:0/3542481021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56266dee2330 con 0x56266e1491a0 2024-09-10T22:44:59.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0ee6000640 1 -- 172.21.15.103:0/3542481021 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f0eec005440 con 0x56266e1491a0 2024-09-10T22:44:59.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 10 client.7878 fetch_fsmap learned FSMap version 96 2024-09-10T22:44:59.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 1 -- 172.21.15.103:0/3542481021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x56266decefa0 con 0x56266e1491a0 2024-09-10T22:44:59.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0ee6000640 1 -- 172.21.15.103:0/3542481021 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56266dee2330 con 0x56266e1491a0 2024-09-10T22:44:59.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0ee6000640 1 -- 172.21.15.103:0/3542481021 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 96) ==== 3554+0+0 (secure 0 0 0) 0x7f0eec0046d0 con 0x56266e1491a0 2024-09-10T22:44:59.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 10 client.7878 fetch_fsmap finished waiting for FSMap version 96 2024-09-10T22:44:59.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 10 client.7878 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-10T22:44:59.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 20 client.7878 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:59.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/3542481021 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x56266e158900 0x56266e15acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 4 client.7878 mds_command: new command op to 7434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:44:59.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 1 -- 172.21.15.103:0/3542481021 --> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56266df5cae0 con 0x56266e158900 2024-09-10T22:44:59.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f04c00640 1 --2- 172.21.15.103:0/3542481021 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x56266e158900 0x56266e15acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f04c00640 1 --2- 172.21.15.103:0/3542481021 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x56266e158900 0x56266e15acf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90ceada89e9dcc49 server_cookie=706d310fdfad1a31 in_seq=0 out_seq=0 2024-09-10T22:44:59.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0ee6000640 10 client.7878 ms_handle_connect on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:59.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0ee6000640 1 -- 172.21.15.103:0/3542481021 <== mds.0 v2:172.21.15.103:6833/187627880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56266df5cae0 con 0x56266e158900 2024-09-10T22:44:59.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0ee6000640 10 client.7878 handle_command_reply: tid=0 2024-09-10T22:44:59.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 1 client.7878 shutdown 2024-09-10T22:44:59.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 1 -- 172.21.15.103:0/3542481021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e1491a0 msgr2=0x56266e150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/3542481021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e1491a0 0x56266e150a70 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0b0040 tx=0x7f0eec004580 comp rx=0 tx=0).stop 2024-09-10T22:44:59.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 1 -- 172.21.15.103:0/3542481021 shutdown_connections 2024-09-10T22:44:59.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/3542481021 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x56266e158900 0x56266e15acf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/3542481021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e149ac0 0x56266e150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/3542481021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e1491a0 0x56266e150a70 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/3542481021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e0ffbc0 0x56266e150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 1 -- 172.21.15.103:0/3542481021 >> 172.21.15.103:0/3542481021 conn(0x56266e105d20 msgr2=0x56266e0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0ee6000640 0 client.7878 ms_handle_reset on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:59.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 1 -- 172.21.15.103:0/3542481021 shutdown_connections 2024-09-10T22:44:59.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 1 -- 172.21.15.103:0/3542481021 wait complete. 2024-09-10T22:44:59.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.701+0000 7f0f0aa41000 20 client.7878 trim_cache size 0 max 16384 2024-09-10T22:44:59.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f0aa41000 1 Processor -- start 2024-09-10T22:44:59.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f0aa41000 1 -- start start 2024-09-10T22:44:59.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f0aa41000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e0ffbc0 0x56266e0ff070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f0aa41000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e1491a0 0x56266e0ff5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f0aa41000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e149ac0 0x56266e153310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f0aa41000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0f00204160 con 0x56266e1491a0 2024-09-10T22:44:59.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f0aa41000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0f00203330 con 0x56266e0ffbc0 2024-09-10T22:44:59.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f0aa41000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0f00203a30 con 0x56266e149ac0 2024-09-10T22:44:59.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0effe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e1491a0 0x56266e0ff5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0effe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e1491a0 0x56266e0ff5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40810/0 (socket says 172.21.15.103:40810) 2024-09-10T22:44:59.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0effe00640 1 -- 172.21.15.103:0/2095255350 learned_addr learned my addr 172.21.15.103:0/2095255350 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f05600640 1 --2- 172.21.15.103:0/2095255350 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e149ac0 0x56266e153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f04c00640 1 --2- 172.21.15.103:0/2095255350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e0ffbc0 0x56266e0ff070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0effe00640 1 -- 172.21.15.103:0/2095255350 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e149ac0 msgr2=0x56266e153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0effe00640 1 --2- 172.21.15.103:0/2095255350 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e149ac0 0x56266e153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0effe00640 1 -- 172.21.15.103:0/2095255350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e0ffbc0 msgr2=0x56266e0ff070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0effe00640 1 --2- 172.21.15.103:0/2095255350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e0ffbc0 0x56266e0ff070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0effe00640 1 -- 172.21.15.103:0/2095255350 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56266dfa7660 con 0x56266e1491a0 2024-09-10T22:44:59.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0effe00640 1 --2- 172.21.15.103:0/2095255350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e1491a0 0x56266e0ff5b0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f0eec01a390 tx=0x7f0eec0096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc88f26fd6901 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0ef0c00640 1 -- 172.21.15.103:0/2095255350 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec0b2040 con 0x56266e1491a0 2024-09-10T22:44:59.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0ef0c00640 1 -- 172.21.15.103:0/2095255350 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0eec000e50 con 0x56266e1491a0 2024-09-10T22:44:59.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0ef0c00640 1 -- 172.21.15.103:0/2095255350 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec0046d0 con 0x56266e1491a0 2024-09-10T22:44:59.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f0aa41000 1 -- 172.21.15.103:0/2095255350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e1491a0 msgr2=0x56266e0ff5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/2095255350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e1491a0 0x56266e0ff5b0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f0eec01a390 tx=0x7f0eec0096c0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f0aa41000 1 -- 172.21.15.103:0/2095255350 shutdown_connections 2024-09-10T22:44:59.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/2095255350 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e149ac0 0x56266e153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/2095255350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e1491a0 0x56266e0ff5b0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/2095255350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e0ffbc0 0x56266e0ff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f0aa41000 1 -- 172.21.15.103:0/2095255350 >> 172.21.15.103:0/2095255350 conn(0x56266e105d20 msgr2=0x56266e0fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f0aa41000 1 -- 172.21.15.103:0/2095255350 shutdown_connections 2024-09-10T22:44:59.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.721+0000 7f0f0aa41000 1 -- 172.21.15.103:0/2095255350 wait complete. 2024-09-10T22:44:59.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f0aa41000 1 -- start start 2024-09-10T22:44:59.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f0aa41000 1 Processor -- start 2024-09-10T22:44:59.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f0aa41000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e0ffbc0 0x56266e155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f0aa41000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e1491a0 0x56266e156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f0aa41000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e149ac0 0x56266e183a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f0aa41000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56266e108d40 con 0x56266e149ac0 2024-09-10T22:44:59.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f0aa41000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56266e106100 con 0x56266e0ffbc0 2024-09-10T22:44:59.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f0aa41000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56266df44ec0 con 0x56266e1491a0 2024-09-10T22:44:59.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f0aa41000 10 client.0 _ll_register_callbacks cb 0x7f0ef80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:44:59.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f05600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e149ac0 0x56266e183a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f05600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e149ac0 0x56266e183a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40814/0 (socket says 172.21.15.103:40814) 2024-09-10T22:44:59.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f05600640 1 -- 172.21.15.103:0/2757337182 learned_addr learned my addr 172.21.15.103:0/2757337182 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f04c00640 1 --2- 172.21.15.103:0/2757337182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e0ffbc0 0x56266e155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0effe00640 1 --2- 172.21.15.103:0/2757337182 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e1491a0 0x56266e156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f05600640 1 -- 172.21.15.103:0/2757337182 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e1491a0 msgr2=0x56266e156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f05600640 1 --2- 172.21.15.103:0/2757337182 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e1491a0 0x56266e156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f05600640 1 -- 172.21.15.103:0/2757337182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e0ffbc0 msgr2=0x56266e155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:44:59.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f05600640 1 --2- 172.21.15.103:0/2757337182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e0ffbc0 0x56266e155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f05600640 1 -- 172.21.15.103:0/2757337182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56266df14090 con 0x56266e149ac0 2024-09-10T22:44:59.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f05600640 1 --2- 172.21.15.103:0/2757337182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e149ac0 0x56266e183a20 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f0ef801fc60 tx=0x7f0ef8004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad30ba0fff892f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0ee6000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:44:59.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0ee6000640 1 -- 172.21.15.103:0/2757337182 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef801fe10 con 0x56266e149ac0 2024-09-10T22:44:59.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0ee6000640 1 -- 172.21.15.103:0/2757337182 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f0ef8004b30 con 0x56266e149ac0 2024-09-10T22:44:59.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f0aa41000 1 -- 172.21.15.103:0/2757337182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0eec000e50 con 0x56266e149ac0 2024-09-10T22:44:59.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0ee6000640 1 -- 172.21.15.103:0/2757337182 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f0ef8033050 con 0x56266e149ac0 2024-09-10T22:44:59.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f0aa41000 10 client.7884 fetch_fsmap learned FSMap version 96 2024-09-10T22:44:59.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f0aa41000 1 -- 172.21.15.103:0/2757337182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x56266dee05f0 con 0x56266e149ac0 2024-09-10T22:44:59.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0ee6000640 1 -- 172.21.15.103:0/2757337182 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0eec000e50 con 0x56266e149ac0 2024-09-10T22:44:59.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0ee6000640 1 -- 172.21.15.103:0/2757337182 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 96) ==== 3554+0+0 (secure 0 0 0) 0x7f0ef8036020 con 0x56266e149ac0 2024-09-10T22:44:59.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f0aa41000 10 client.7884 fetch_fsmap finished waiting for FSMap version 96 2024-09-10T22:44:59.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f0aa41000 10 client.7884 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-10T22:44:59.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f0aa41000 20 client.7884 populate_metadata read hostname 'smithi103' 2024-09-10T22:44:59.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/2757337182 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x56266e1c7060 0x56266e1c7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f0aa41000 4 client.7884 mds_command: new command op to 7434 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:44:59.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f0aa41000 1 -- 172.21.15.103:0/2757337182 --> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56266df58590 con 0x56266e1c7060 2024-09-10T22:44:59.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.725+0000 7f0f04c00640 1 --2- 172.21.15.103:0/2757337182 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x56266e1c7060 0x56266e1c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f04c00640 1 --2- 172.21.15.103:0/2757337182 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x56266e1c7060 0x56266e1c7470 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef3f940e3127bd97 server_cookie=42b3bf6842e8d714 in_seq=0 out_seq=0 2024-09-10T22:44:59.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0ee6000640 10 client.7884 ms_handle_connect on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:59.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0ee6000640 1 -- 172.21.15.103:0/2757337182 <== mds.0 v2:172.21.15.103:6833/187627880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x56266df58590 con 0x56266e1c7060 2024-09-10T22:44:59.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0ee6000640 10 client.7884 handle_command_reply: tid=0 2024-09-10T22:44:59.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f0aa41000 1 client.7884 shutdown 2024-09-10T22:44:59.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f0aa41000 1 -- 172.21.15.103:0/2757337182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e149ac0 msgr2=0x56266e183a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/2757337182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e149ac0 0x56266e183a20 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f0ef801fc60 tx=0x7f0ef8004ac0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f0aa41000 1 -- 172.21.15.103:0/2757337182 shutdown_connections 2024-09-10T22:44:59.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/2757337182 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x56266e1c7060 0x56266e1c7470 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/2757337182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266e149ac0 0x56266e183a20 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/2757337182 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266e1491a0 0x56266e156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f0aa41000 1 --2- 172.21.15.103:0/2757337182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266e0ffbc0 0x56266e155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0ee6000640 0 client.7884 ms_handle_reset on v2:172.21.15.103:6833/187627880 2024-09-10T22:44:59.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f0aa41000 1 -- 172.21.15.103:0/2757337182 >> 172.21.15.103:0/2757337182 conn(0x56266e105d20 msgr2=0x56266e0ff180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f0aa41000 1 -- 172.21.15.103:0/2757337182 shutdown_connections 2024-09-10T22:44:59.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f0aa41000 1 -- 172.21.15.103:0/2757337182 wait complete. 2024-09-10T22:44:59.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f0aa41000 20 client.7884 trim_cache size 0 max 16384 2024-09-10T22:44:59.739 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:44:59.739 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-10T22:44:59.740 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:44:59.740 INFO:teuthology.orchestra.run.smithi103.stdout: "118e1155-7244-4d9c-9fab-dbfc720435a1": { 2024-09-10T22:44:59.740 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:44:59.740 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "118e1155-7244-4d9c-9fab-dbfc720435a1", 2024-09-10T22:44:59.740 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:44:59.740 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:59.740 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:44:59.740 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_stats": { 2024-09-10T22:44:59.740 INFO:teuthology.orchestra.run.smithi103.stdout: "118e1155-7244-4d9c-9fab-dbfc720435a1": { 2024-09-10T22:44:59.740 INFO:teuthology.orchestra.run.smithi103.stdout: "start_time": "2024-09-10T22:44:58.901676+0000", 2024-09-10T22:44:59.740 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:44:59.740 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_started": 0, 2024-09-10T22:44:59.741 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_passed": 0, 2024-09-10T22:44:59.741 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_failed": 0, 2024-09-10T22:44:59.741 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_skipped": 0 2024-09-10T22:44:59.741 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:59.741 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:44:59.741 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:44:59.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f07600640 1 -- 172.21.15.103:0/1436839439 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0ee00725e0 msgr2=0x7f0ee0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f07600640 1 --2- 172.21.15.103:0/1436839439 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0ee00725e0 0x7f0ee0074aa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009f60 tx=0x7f0ef8009500 comp rx=0 tx=0).stop 2024-09-10T22:44:59.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f07600640 1 -- 172.21.15.103:0/1436839439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f0006e150 msgr2=0x7f0f001487d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f07600640 1 --2- 172.21.15.103:0/1436839439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f0006e150 0x7f0f001487d0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f0ef400c460 tx=0x7f0ef400c920 comp rx=0 tx=0).stop 2024-09-10T22:44:59.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f07600640 1 -- 172.21.15.103:0/1436839439 shutdown_connections 2024-09-10T22:44:59.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f07600640 1 --2- 172.21.15.103:0/1436839439 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0ee00725e0 0x7f0ee0074aa0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f07600640 1 --2- 172.21.15.103:0/1436839439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f0015de80 0x7f0f0009e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f07600640 1 --2- 172.21.15.103:0/1436839439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f0006ead0 0x7f0f0009bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f07600640 1 --2- 172.21.15.103:0/1436839439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f0006e150 0x7f0f001487d0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f07600640 1 -- 172.21.15.103:0/1436839439 >> 172.21.15.103:0/1436839439 conn(0x7f0f000d1ad0 msgr2=0x7f0f000b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f07600640 1 -- 172.21.15.103:0/1436839439 shutdown_connections 2024-09-10T22:44:59.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.729+0000 7f0f07600640 1 -- 172.21.15.103:0/1436839439 wait complete. 2024-09-10T22:44:59.751 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:44:59.752 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:44:59.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.889+0000 7fb1a3e00640 1 -- 172.21.15.103:0/270513015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1a40d23f0 msgr2=0x7fb1a40cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.889+0000 7fb1a3e00640 1 --2- 172.21.15.103:0/270513015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1a40d23f0 0x7fb1a40cdc40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb19c009840 tx=0x7fb19c01c790 comp rx=0 tx=0).stop 2024-09-10T22:44:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.889+0000 7fb1a3e00640 1 -- 172.21.15.103:0/270513015 shutdown_connections 2024-09-10T22:44:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.889+0000 7fb1a3e00640 1 --2- 172.21.15.103:0/270513015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1a40d23f0 0x7fb1a40cdc40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.889+0000 7fb1a3e00640 1 --2- 172.21.15.103:0/270513015 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1a4070b40 0x7fb1a40d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.889+0000 7fb1a3e00640 1 -- 172.21.15.103:0/270513015 >> 172.21.15.103:0/270513015 conn(0x7fb1a40d18d0 msgr2=0x7fb1a40d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:44:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.889+0000 7fb1a3e00640 1 -- 172.21.15.103:0/270513015 shutdown_connections 2024-09-10T22:44:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.889+0000 7fb1a3e00640 1 -- 172.21.15.103:0/270513015 wait complete. 2024-09-10T22:44:59.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.889+0000 7fb1a3e00640 1 Processor -- start 2024-09-10T22:44:59.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.889+0000 7fb1a3e00640 1 -- start start 2024-09-10T22:44:59.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a3e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1a4070b40 0x7fb1a41fb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a40d23f0 0x7fb1a414f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1a415f0e0 0x7fb1a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a3e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a41688a0 con 0x7fb1a40d23f0 2024-09-10T22:44:59.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a3e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a40cec90 con 0x7fb1a415f0e0 2024-09-10T22:44:59.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a3e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb1a4168a20 con 0x7fb1a4070b40 2024-09-10T22:44:59.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a40d23f0 0x7fb1a414f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a40d23f0 0x7fb1a414f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40822/0 (socket says 172.21.15.103:40822) 2024-09-10T22:44:59.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a2000640 1 -- 172.21.15.103:0/2745665970 learned_addr learned my addr 172.21.15.103:0/2745665970 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:44:59.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a3400640 1 --2- 172.21.15.103:0/2745665970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1a415f0e0 0x7fb1a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a2a00640 1 --2- 172.21.15.103:0/2745665970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1a4070b40 0x7fb1a41fb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a2000640 1 -- 172.21.15.103:0/2745665970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1a4070b40 msgr2=0x7fb1a41fb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a2000640 1 --2- 172.21.15.103:0/2745665970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1a4070b40 0x7fb1a41fb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a2000640 1 -- 172.21.15.103:0/2745665970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1a415f0e0 msgr2=0x7fb1a406e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:44:59.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a2000640 1 --2- 172.21.15.103:0/2745665970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1a415f0e0 0x7fb1a406e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:44:59.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a2000640 1 -- 172.21.15.103:0/2745665970 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a406eec0 con 0x7fb1a40d23f0 2024-09-10T22:44:59.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a2000640 1 --2- 172.21.15.103:0/2745665970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a40d23f0 0x7fb1a414f6c0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fb19000e9f0 tx=0x7fb19000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb19b400640 1 -- 172.21.15.103:0/2745665970 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19000ccc0 con 0x7fb1a40d23f0 2024-09-10T22:44:59.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb19b400640 1 -- 172.21.15.103:0/2745665970 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb190010430 con 0x7fb1a40d23f0 2024-09-10T22:44:59.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb19b400640 1 -- 172.21.15.103:0/2745665970 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb190010860 con 0x7fb1a40d23f0 2024-09-10T22:44:59.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a3e00640 1 -- 172.21.15.103:0/2745665970 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a406f1a0 con 0x7fb1a40d23f0 2024-09-10T22:44:59.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a3e00640 1 -- 172.21.15.103:0/2745665970 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a406f760 con 0x7fb1a40d23f0 2024-09-10T22:44:59.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb1a3e00640 1 -- 172.21.15.103:0/2745665970 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a40d1280 con 0x7fb1a40d23f0 2024-09-10T22:44:59.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.893+0000 7fb19b400640 1 -- 172.21.15.103:0/2745665970 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb190010a00 con 0x7fb1a40d23f0 2024-09-10T22:44:59.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.897+0000 7fb19b400640 1 --2- 172.21.15.103:0/2745665970 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb1840725e0 0x7fb184074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:44:59.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.897+0000 7fb19b400640 1 -- 172.21.15.103:0/2745665970 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fb190094130 con 0x7fb1a40d23f0 2024-09-10T22:44:59.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.897+0000 7fb1a2a00640 1 --2- 172.21.15.103:0/2745665970 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb1840725e0 0x7fb184074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:44:59.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.897+0000 7fb1a2a00640 1 --2- 172.21.15.103:0/2745665970 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb1840725e0 0x7fb184074aa0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb194002100 tx=0x7fb194009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:44:59.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:44:59.901+0000 7fb19b400640 1 -- 172.21.15.103:0/2745665970 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb19005f560 con 0x7fb1a40d23f0 2024-09-10T22:45:00.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.097+0000 7fb1a3e00640 1 -- 172.21.15.103:0/2745665970 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1a40b0ed0 con 0x7fb1a40d23f0 2024-09-10T22:45:00.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.097+0000 7fb19b400640 1 -- 172.21.15.103:0/2745665970 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5276 (secure 0 0 0) 0x7fb19005ee60 con 0x7fb1a40d23f0 2024-09-10T22:45:00.103 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:00.103 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":96,"btime":"2024-09-10T22:44:55:296662+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2586411857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2586411857},{"type":"v1","addr":"172.21.15.131:6837","nonce":2586411857}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:44:23.558537+0000","modified":"2024-09-10T22:44:54.666173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7434,"mds_1":7428,"mds_2":7048},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7048":{"gid":7048,"name":"d","rank":2,"incarnation":93,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6836/1622106563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1622106563},{"type":"v1","addr":"172.21.15.131:6836","nonce":1622106563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":1,"incarnation":91,"state":"up:active","state_seq":6,"addr":"172.21.15.103:6834/3251348074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3251348074},{"type":"v1","addr":"172.21.15.103:6834","nonce":3251348074}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7434":{"gid":7434,"name":"c","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/187627880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":187627880},{"type":"v1","addr":"172.21.15.103:6835","nonce":187627880}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7434,"qdb_cluster":[7048,7428,7434]},"id":6}]} 2024-09-10T22:45:00.103 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 96 2024-09-10T22:45:00.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.101+0000 7fb1a3e00640 1 -- 172.21.15.103:0/2745665970 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb1840725e0 msgr2=0x7fb184074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:00.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.101+0000 7fb1a3e00640 1 --2- 172.21.15.103:0/2745665970 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb1840725e0 0x7fb184074aa0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb194002100 tx=0x7fb194009040 comp rx=0 tx=0).stop 2024-09-10T22:45:00.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.101+0000 7fb1a3e00640 1 -- 172.21.15.103:0/2745665970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a40d23f0 msgr2=0x7fb1a414f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:00.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.101+0000 7fb1a3e00640 1 --2- 172.21.15.103:0/2745665970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a40d23f0 0x7fb1a414f6c0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fb19000e9f0 tx=0x7fb19000eeb0 comp rx=0 tx=0).stop 2024-09-10T22:45:00.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.101+0000 7fb1a3e00640 1 -- 172.21.15.103:0/2745665970 shutdown_connections 2024-09-10T22:45:00.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.101+0000 7fb1a3e00640 1 --2- 172.21.15.103:0/2745665970 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb1840725e0 0x7fb184074aa0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:00.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.101+0000 7fb1a3e00640 1 --2- 172.21.15.103:0/2745665970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1a415f0e0 0x7fb1a406e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:00.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.101+0000 7fb1a3e00640 1 --2- 172.21.15.103:0/2745665970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a40d23f0 0x7fb1a414f6c0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:00.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.101+0000 7fb1a3e00640 1 --2- 172.21.15.103:0/2745665970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1a4070b40 0x7fb1a41fb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:00.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.101+0000 7fb1a3e00640 1 -- 172.21.15.103:0/2745665970 >> 172.21.15.103:0/2745665970 conn(0x7fb1a40d18d0 msgr2=0x7fb1a40af720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:00.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.101+0000 7fb1a3e00640 1 -- 172.21.15.103:0/2745665970 shutdown_connections 2024-09-10T22:45:00.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.101+0000 7fb1a3e00640 1 -- 172.21.15.103:0/2745665970 wait complete. 2024-09-10T22:45:00.123 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-10T22:45:00.124 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:45:00.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.261+0000 7f3b49000640 1 -- 172.21.15.103:0/959686278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b440d21a0 msgr2=0x7f3b440d4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:00.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.261+0000 7f3b49000640 1 --2- 172.21.15.103:0/959686278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b440d21a0 0x7f3b440d4750 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009840 tx=0x7f3b3401ef30 comp rx=0 tx=0).stop 2024-09-10T22:45:00.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.261+0000 7f3b49000640 1 -- 172.21.15.103:0/959686278 shutdown_connections 2024-09-10T22:45:00.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.261+0000 7f3b49000640 1 --2- 172.21.15.103:0/959686278 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b440d1830 0x7f3b440b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:00.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.261+0000 7f3b49000640 1 --2- 172.21.15.103:0/959686278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b440d21a0 0x7f3b440d4750 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:00.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.261+0000 7f3b49000640 1 -- 172.21.15.103:0/959686278 >> 172.21.15.103:0/959686278 conn(0x7f3b440d3c60 msgr2=0x7f3b440d4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:00.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.261+0000 7f3b49000640 1 -- 172.21.15.103:0/959686278 shutdown_connections 2024-09-10T22:45:00.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.261+0000 7f3b49000640 1 -- 172.21.15.103:0/959686278 wait complete. 2024-09-10T22:45:00.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.261+0000 7f3b49000640 1 Processor -- start 2024-09-10T22:45:00.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.261+0000 7f3b49000640 1 -- start start 2024-09-10T22:45:00.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b49000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b440d1830 0x7f3b440cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:00.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b49000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b440d21a0 0x7f3b4415b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:00.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b49000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b4415bbb0 0x7f3b441608e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:00.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b49000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3b440b3f10 con 0x7f3b440d1830 2024-09-10T22:45:00.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b49000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3b440b3d90 con 0x7f3b4415bbb0 2024-09-10T22:45:00.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b49000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3b440b4090 con 0x7f3b440d21a0 2024-09-10T22:45:00.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b41e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b440d1830 0x7f3b440cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:00.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b41e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b440d1830 0x7f3b440cd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40824/0 (socket says 172.21.15.103:40824) 2024-09-10T22:45:00.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b41e00640 1 -- 172.21.15.103:0/2829356738 learned_addr learned my addr 172.21.15.103:0/2829356738 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:00.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b42800640 1 --2- 172.21.15.103:0/2829356738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b4415bbb0 0x7f3b441608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:00.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b39400640 1 --2- 172.21.15.103:0/2829356738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b440d21a0 0x7f3b4415b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:00.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b41e00640 1 -- 172.21.15.103:0/2829356738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b440d21a0 msgr2=0x7f3b4415b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:00.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b41e00640 1 --2- 172.21.15.103:0/2829356738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b440d21a0 0x7f3b4415b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:00.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b41e00640 1 -- 172.21.15.103:0/2829356738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b4415bbb0 msgr2=0x7f3b441608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:00.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b41e00640 1 --2- 172.21.15.103:0/2829356738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b4415bbb0 0x7f3b441608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:00.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b41e00640 1 -- 172.21.15.103:0/2829356738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b441f4270 con 0x7f3b440d1830 2024-09-10T22:45:00.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b39400640 1 --2- 172.21.15.103:0/2829356738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b440d21a0 0x7f3b4415b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:00.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b41e00640 1 --2- 172.21.15.103:0/2829356738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b440d1830 0x7f3b440cd9e0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009930 tx=0x7f3b34004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:00.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b3aa00640 1 -- 172.21.15.103:0/2829356738 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b340bd020 con 0x7f3b440d1830 2024-09-10T22:45:00.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b3aa00640 1 -- 172.21.15.103:0/2829356738 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b34005310 con 0x7f3b440d1830 2024-09-10T22:45:00.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b49000640 1 -- 172.21.15.103:0/2829356738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b441f4550 con 0x7f3b440d1830 2024-09-10T22:45:00.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b3aa00640 1 -- 172.21.15.103:0/2829356738 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b340b5040 con 0x7f3b440d1830 2024-09-10T22:45:00.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b49000640 1 -- 172.21.15.103:0/2829356738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b441f4b10 con 0x7f3b440d1830 2024-09-10T22:45:00.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.265+0000 7f3b49000640 1 -- 172.21.15.103:0/2829356738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b440b4620 con 0x7f3b440d1830 2024-09-10T22:45:00.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.269+0000 7f3b3aa00640 1 -- 172.21.15.103:0/2829356738 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3b340b8070 con 0x7f3b440d1830 2024-09-10T22:45:00.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.269+0000 7f3b3aa00640 1 --2- 172.21.15.103:0/2829356738 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3b20072610 0x7f3b20074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:00.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.269+0000 7f3b3aa00640 1 -- 172.21.15.103:0/2829356738 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f3b3412ffd0 con 0x7f3b440d1830 2024-09-10T22:45:00.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.269+0000 7f3b39400640 1 --2- 172.21.15.103:0/2829356738 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3b20072610 0x7f3b20074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:00.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.269+0000 7f3b39400640 1 --2- 172.21.15.103:0/2829356738 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3b20072610 0x7f3b20074ad0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3b4415d4d0 tx=0x7f3b2c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:00.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.273+0000 7f3b3aa00640 1 -- 172.21.15.103:0/2829356738 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3b34018a90 con 0x7f3b440d1830 2024-09-10T22:45:00.315 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-10T22:45:00.309+0000 7fb5aec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-10T22:45:00.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.501+0000 7f3b49000640 1 -- 172.21.15.103:0/2829356738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3b44075d40 con 0x7f3b440d1830 2024-09-10T22:45:00.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.505+0000 7f3b3aa00640 1 -- 172.21.15.103:0/2829356738 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1337 (secure 0 0 0) 0x7f3b340fb410 con 0x7f3b440d1830 2024-09-10T22:45:00.508 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:00.508 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":396,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":69,"data_bytes":688866,"bytes_used":266211328,"bytes_avail":772827901952,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9469,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":97,"btime":"2024-09-10T22:45:00:316662+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":7048},{"filesystem_id":6,"rank":1,"name":"a","status":"up:active","gid":7428},{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7434}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-10T22:43:21.688460+0000","services":{}},"progress_events":{}} 2024-09-10T22:45:00.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.505+0000 7f3b49000640 1 -- 172.21.15.103:0/2829356738 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3b20072610 msgr2=0x7f3b20074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:00.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.505+0000 7f3b49000640 1 --2- 172.21.15.103:0/2829356738 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3b20072610 0x7f3b20074ad0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3b4415d4d0 tx=0x7f3b2c009040 comp rx=0 tx=0).stop 2024-09-10T22:45:00.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.505+0000 7f3b49000640 1 -- 172.21.15.103:0/2829356738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b440d1830 msgr2=0x7f3b440cd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:00.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.505+0000 7f3b49000640 1 --2- 172.21.15.103:0/2829356738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b440d1830 0x7f3b440cd9e0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009930 tx=0x7f3b34004620 comp rx=0 tx=0).stop 2024-09-10T22:45:00.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.505+0000 7f3b49000640 1 -- 172.21.15.103:0/2829356738 shutdown_connections 2024-09-10T22:45:00.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.505+0000 7f3b49000640 1 --2- 172.21.15.103:0/2829356738 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3b20072610 0x7f3b20074ad0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:00.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.505+0000 7f3b49000640 1 --2- 172.21.15.103:0/2829356738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b4415bbb0 0x7f3b441608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:00.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.505+0000 7f3b49000640 1 --2- 172.21.15.103:0/2829356738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b440d21a0 0x7f3b4415b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:00.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.505+0000 7f3b49000640 1 --2- 172.21.15.103:0/2829356738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b440d1830 0x7f3b440cd9e0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:00.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.505+0000 7f3b49000640 1 -- 172.21.15.103:0/2829356738 >> 172.21.15.103:0/2829356738 conn(0x7f3b440d3c60 msgr2=0x7f3b440d4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:00.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.505+0000 7f3b49000640 1 -- 172.21.15.103:0/2829356738 shutdown_connections 2024-09-10T22:45:00.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:00.505+0000 7f3b49000640 1 -- 172.21.15.103:0/2829356738 wait complete. 2024-09-10T22:45:01.530 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:45:01.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.677+0000 7f3b08000640 1 -- 172.21.15.103:0/3102934512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b000cc970 msgr2=0x7f3b000ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:01.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.677+0000 7f3b08000640 1 --2- 172.21.15.103:0/3102934512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b000cc970 0x7f3b000ccde0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009c80 tx=0x7f3af801cce0 comp rx=0 tx=0).stop 2024-09-10T22:45:01.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.677+0000 7f3b08000640 1 -- 172.21.15.103:0/3102934512 shutdown_connections 2024-09-10T22:45:01.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.677+0000 7f3b08000640 1 --2- 172.21.15.103:0/3102934512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b000cc970 0x7f3b000ccde0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:01.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.677+0000 7f3b08000640 1 --2- 172.21.15.103:0/3102934512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b0006e0c0 0x7f3b000ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:01.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.677+0000 7f3b08000640 1 -- 172.21.15.103:0/3102934512 >> 172.21.15.103:0/3102934512 conn(0x7f3b000b1c00 msgr2=0x7f3b000b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:01.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.677+0000 7f3b08000640 1 -- 172.21.15.103:0/3102934512 shutdown_connections 2024-09-10T22:45:01.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.677+0000 7f3b08000640 1 -- 172.21.15.103:0/3102934512 wait complete. 2024-09-10T22:45:01.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.677+0000 7f3b08000640 1 Processor -- start 2024-09-10T22:45:01.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.677+0000 7f3b08000640 1 -- start start 2024-09-10T22:45:01.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.677+0000 7f3b08000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b0006e0c0 0x7f3b000c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:01.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.677+0000 7f3b08000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b0006ff90 0x7f3b00167d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:01.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.677+0000 7f3b08000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b000cc970 0x7f3b0015b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:01.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.677+0000 7f3b08000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0016aba0 con 0x7f3b0006ff90 2024-09-10T22:45:01.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.677+0000 7f3b08000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0016aa20 con 0x7f3b0006e0c0 2024-09-10T22:45:01.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.677+0000 7f3b08000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3b0016ad20 con 0x7f3b000cc970 2024-09-10T22:45:01.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.681+0000 7f3b04c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b0006ff90 0x7f3b00167d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:01.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.681+0000 7f3b04c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b0006ff90 0x7f3b00167d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40850/0 (socket says 172.21.15.103:40850) 2024-09-10T22:45:01.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.681+0000 7f3b04c00640 1 -- 172.21.15.103:0/2386656828 learned_addr learned my addr 172.21.15.103:0/2386656828 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:01.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.681+0000 7f3b05600640 1 --2- 172.21.15.103:0/2386656828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b0006e0c0 0x7f3b000c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:01.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.681+0000 7f3b06000640 1 --2- 172.21.15.103:0/2386656828 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b000cc970 0x7f3b0015b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:01.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.681+0000 7f3b04c00640 1 -- 172.21.15.103:0/2386656828 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b000cc970 msgr2=0x7f3b0015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:01.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.681+0000 7f3b04c00640 1 --2- 172.21.15.103:0/2386656828 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b000cc970 0x7f3b0015b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:01.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.681+0000 7f3b04c00640 1 -- 172.21.15.103:0/2386656828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b0006e0c0 msgr2=0x7f3b000c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:01.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.681+0000 7f3b04c00640 1 --2- 172.21.15.103:0/2386656828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b0006e0c0 0x7f3b000c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:01.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.681+0000 7f3b04c00640 1 -- 172.21.15.103:0/2386656828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b000c8520 con 0x7f3b0006ff90 2024-09-10T22:45:01.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.681+0000 7f3b04c00640 1 --2- 172.21.15.103:0/2386656828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b0006ff90 0x7f3b00167d10 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00c3c0 tx=0x7f3aec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:01.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.681+0000 7f3afd600640 1 -- 172.21.15.103:0/2386656828 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aec017070 con 0x7f3b0006ff90 2024-09-10T22:45:01.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.681+0000 7f3afd600640 1 -- 172.21.15.103:0/2386656828 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3aec0053c0 con 0x7f3b0006ff90 2024-09-10T22:45:01.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.681+0000 7f3b08000640 1 -- 172.21.15.103:0/2386656828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b000c8800 con 0x7f3b0006ff90 2024-09-10T22:45:01.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.681+0000 7f3afd600640 1 -- 172.21.15.103:0/2386656828 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aec003860 con 0x7f3b0006ff90 2024-09-10T22:45:01.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.681+0000 7f3b08000640 1 -- 172.21.15.103:0/2386656828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b000c8110 con 0x7f3b0006ff90 2024-09-10T22:45:01.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.681+0000 7f3b08000640 1 -- 172.21.15.103:0/2386656828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b000cb940 con 0x7f3b0006ff90 2024-09-10T22:45:01.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.681+0000 7f3afd600640 1 -- 172.21.15.103:0/2386656828 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3aec003a00 con 0x7f3b0006ff90 2024-09-10T22:45:01.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.685+0000 7f3afd600640 1 --2- 172.21.15.103:0/2386656828 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3ae0072610 0x7f3ae0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:01.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.685+0000 7f3afd600640 1 -- 172.21.15.103:0/2386656828 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f3aec092a30 con 0x7f3b0006ff90 2024-09-10T22:45:01.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.685+0000 7f3b05600640 1 --2- 172.21.15.103:0/2386656828 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3ae0072610 0x7f3ae0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:01.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.685+0000 7f3b05600640 1 --2- 172.21.15.103:0/2386656828 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3ae0072610 0x7f3ae0074ad0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3af4004630 tx=0x7f3af400b390 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:01.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.689+0000 7f3afd600640 1 -- 172.21.15.103:0/2386656828 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3b00070830 con 0x7f3b0006ff90 2024-09-10T22:45:01.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.889+0000 7f3b08000640 1 -- 172.21.15.103:0/2386656828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b00074d20 con 0x7f3b0006ff90 2024-09-10T22:45:01.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.889+0000 7f3afd600640 1 -- 172.21.15.103:0/2386656828 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5280 (secure 0 0 0) 0x7f3aec05d820 con 0x7f3b0006ff90 2024-09-10T22:45:01.893 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:01.893 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":98,"btime":"2024-09-10T22:45:01:322585+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2586411857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2586411857},{"type":"v1","addr":"172.21.15.131:6837","nonce":2586411857}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:44:23.558537+0000","modified":"2024-09-10T22:45:01.262721+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7434,"mds_1":7428,"mds_2":7048},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7048":{"gid":7048,"name":"d","rank":2,"incarnation":93,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6836/1622106563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1622106563},{"type":"v1","addr":"172.21.15.131:6836","nonce":1622106563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":1,"incarnation":91,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3251348074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3251348074},{"type":"v1","addr":"172.21.15.103:6834","nonce":3251348074}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7434":{"gid":7434,"name":"c","rank":0,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/187627880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":187627880},{"type":"v1","addr":"172.21.15.103:6835","nonce":187627880}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7434,"qdb_cluster":[7048,7428,7434]},"id":6}]} 2024-09-10T22:45:01.894 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 98 2024-09-10T22:45:01.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.889+0000 7f3b08000640 1 -- 172.21.15.103:0/2386656828 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3ae0072610 msgr2=0x7f3ae0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:01.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.889+0000 7f3b08000640 1 --2- 172.21.15.103:0/2386656828 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3ae0072610 0x7f3ae0074ad0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3af4004630 tx=0x7f3af400b390 comp rx=0 tx=0).stop 2024-09-10T22:45:01.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.889+0000 7f3b08000640 1 -- 172.21.15.103:0/2386656828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b0006ff90 msgr2=0x7f3b00167d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:01.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.889+0000 7f3b08000640 1 --2- 172.21.15.103:0/2386656828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b0006ff90 0x7f3b00167d10 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00c3c0 tx=0x7f3aec00c880 comp rx=0 tx=0).stop 2024-09-10T22:45:01.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.889+0000 7f3b08000640 1 -- 172.21.15.103:0/2386656828 shutdown_connections 2024-09-10T22:45:01.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.889+0000 7f3b08000640 1 --2- 172.21.15.103:0/2386656828 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3ae0072610 0x7f3ae0074ad0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:01.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.889+0000 7f3b08000640 1 --2- 172.21.15.103:0/2386656828 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b000cc970 0x7f3b0015b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:01.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.889+0000 7f3b08000640 1 --2- 172.21.15.103:0/2386656828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b0006ff90 0x7f3b00167d10 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:01.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.889+0000 7f3b08000640 1 --2- 172.21.15.103:0/2386656828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b0006e0c0 0x7f3b000c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:01.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.889+0000 7f3b08000640 1 -- 172.21.15.103:0/2386656828 >> 172.21.15.103:0/2386656828 conn(0x7f3b000b1c00 msgr2=0x7f3b000b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:01.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.889+0000 7f3b08000640 1 -- 172.21.15.103:0/2386656828 shutdown_connections 2024-09-10T22:45:01.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:01.889+0000 7f3b08000640 1 -- 172.21.15.103:0/2386656828 wait complete. 2024-09-10T22:45:01.914 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-10T22:45:01.915 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:45:02.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.049+0000 7ff2db800640 1 -- 172.21.15.103:0/585216118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2d4072a40 msgr2=0x7ff2d4157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:02.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.049+0000 7ff2db800640 1 --2- 172.21.15.103:0/585216118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2d4072a40 0x7ff2d4157090 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40d0340 tx=0x7ff2cc01dbf0 comp rx=0 tx=0).stop 2024-09-10T22:45:02.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.049+0000 7ff2db800640 1 -- 172.21.15.103:0/585216118 shutdown_connections 2024-09-10T22:45:02.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.049+0000 7ff2db800640 1 --2- 172.21.15.103:0/585216118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2d4072a40 0x7ff2d4157090 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:02.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.049+0000 7ff2db800640 1 --2- 172.21.15.103:0/585216118 >> v2:172.21.15.131:3300/0 conn(0x7ff2d40b3150 0x7ff2d4072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:02.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.049+0000 7ff2db800640 1 --2- 172.21.15.103:0/585216118 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2d40cf260 0x7ff2d40b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:02.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.049+0000 7ff2db800640 1 -- 172.21.15.103:0/585216118 >> 172.21.15.103:0/585216118 conn(0x7ff2d406cc00 msgr2=0x7ff2d406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:02.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.049+0000 7ff2db800640 1 -- 172.21.15.103:0/585216118 shutdown_connections 2024-09-10T22:45:02.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.049+0000 7ff2db800640 1 -- 172.21.15.103:0/585216118 wait complete. 2024-09-10T22:45:02.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2db800640 1 Processor -- start 2024-09-10T22:45:02.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2db800640 1 -- start start 2024-09-10T22:45:02.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2db800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2d4072a40 0x7ff2d4147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:02.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2db800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2d40b3150 0x7ff2d40aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:02.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2db800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2d40cf260 0x7ff2d40af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:02.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2db800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d4157e70 con 0x7ff2d40cf260 2024-09-10T22:45:02.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2db800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d4157cf0 con 0x7ff2d4072a40 2024-09-10T22:45:02.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2db800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d415dab0 con 0x7ff2d40b3150 2024-09-10T22:45:02.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2d9800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2d40cf260 0x7ff2d40af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:02.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2d9800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2d40cf260 0x7ff2d40af420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40862/0 (socket says 172.21.15.103:40862) 2024-09-10T22:45:02.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2d9800640 1 -- 172.21.15.103:0/1898173554 learned_addr learned my addr 172.21.15.103:0/1898173554 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:02.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2d3e00640 1 --2- 172.21.15.103:0/1898173554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2d40b3150 0x7ff2d40aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:02.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2d8e00640 1 --2- 172.21.15.103:0/1898173554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2d4072a40 0x7ff2d4147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:02.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2d9800640 1 -- 172.21.15.103:0/1898173554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2d40b3150 msgr2=0x7ff2d40aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:02.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2d9800640 1 --2- 172.21.15.103:0/1898173554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2d40b3150 0x7ff2d40aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:02.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2d9800640 1 -- 172.21.15.103:0/1898173554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2d4072a40 msgr2=0x7ff2d4147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:02.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2d9800640 1 --2- 172.21.15.103:0/1898173554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2d4072a40 0x7ff2d4147ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:02.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2d9800640 1 -- 172.21.15.103:0/1898173554 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d41f8180 con 0x7ff2d40cf260 2024-09-10T22:45:02.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2d3e00640 1 --2- 172.21.15.103:0/1898173554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2d40b3150 0x7ff2d40aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:02.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2d8e00640 1 --2- 172.21.15.103:0/1898173554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2d4072a40 0x7ff2d4147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:02.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2d9800640 1 --2- 172.21.15.103:0/1898173554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2d40cf260 0x7ff2d40af420 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00a960 tx=0x7ff2cc004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:02.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2d0c00640 1 -- 172.21.15.103:0/1898173554 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc0bc070 con 0x7ff2d40cf260 2024-09-10T22:45:02.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2d0c00640 1 -- 172.21.15.103:0/1898173554 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2cc003b00 con 0x7ff2d40cf260 2024-09-10T22:45:02.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2db800640 1 -- 172.21.15.103:0/1898173554 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d41491e0 con 0x7ff2d40cf260 2024-09-10T22:45:02.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2d0c00640 1 -- 172.21.15.103:0/1898173554 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc0b3070 con 0x7ff2d40cf260 2024-09-10T22:45:02.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.053+0000 7ff2db800640 1 -- 172.21.15.103:0/1898173554 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d41497a0 con 0x7ff2d40cf260 2024-09-10T22:45:02.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.057+0000 7ff2db800640 1 -- 172.21.15.103:0/1898173554 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d4072500 con 0x7ff2d40cf260 2024-09-10T22:45:02.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.057+0000 7ff2d0c00640 1 -- 172.21.15.103:0/1898173554 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff2cc00b040 con 0x7ff2d40cf260 2024-09-10T22:45:02.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.057+0000 7ff2d0c00640 1 --2- 172.21.15.103:0/1898173554 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff2b40725e0 0x7ff2b4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:02.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.057+0000 7ff2d0c00640 1 -- 172.21.15.103:0/1898173554 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7ff2cc12d610 con 0x7ff2d40cf260 2024-09-10T22:45:02.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.057+0000 7ff2d8e00640 1 --2- 172.21.15.103:0/1898173554 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff2b40725e0 0x7ff2b4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:02.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.061+0000 7ff2d8e00640 1 --2- 172.21.15.103:0/1898173554 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff2b40725e0 0x7ff2b4074aa0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4165600 tx=0x7ff2c4009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:02.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.061+0000 7ff2d0c00640 1 -- 172.21.15.103:0/1898173554 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff2cc0177e0 con 0x7ff2d40cf260 2024-09-10T22:45:02.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.285+0000 7ff2db800640 1 -- 172.21.15.103:0/1898173554 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff2d4148420 con 0x7ff2d40cf260 2024-09-10T22:45:02.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.285+0000 7ff2d0c00640 1 -- 172.21.15.103:0/1898173554 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1337 (secure 0 0 0) 0x7ff2cc0f8a50 con 0x7ff2d40cf260 2024-09-10T22:45:02.291 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:02.291 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"2 MDSs report damaged metadata","count":2},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":398,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":69,"data_bytes":688866,"bytes_used":266211328,"bytes_avail":772827901952,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9469,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":98,"btime":"2024-09-10T22:45:01:322585+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":7048},{"filesystem_id":6,"rank":1,"name":"a","status":"up:active","gid":7428},{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7434}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-10T22:43:21.688460+0000","services":{}},"progress_events":{}} 2024-09-10T22:45:02.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.289+0000 7ff2db800640 1 -- 172.21.15.103:0/1898173554 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff2b40725e0 msgr2=0x7ff2b4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:02.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.289+0000 7ff2db800640 1 --2- 172.21.15.103:0/1898173554 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff2b40725e0 0x7ff2b4074aa0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4165600 tx=0x7ff2c4009500 comp rx=0 tx=0).stop 2024-09-10T22:45:02.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.289+0000 7ff2db800640 1 -- 172.21.15.103:0/1898173554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2d40cf260 msgr2=0x7ff2d40af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.289+0000 7ff2db800640 1 --2- 172.21.15.103:0/1898173554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2d40cf260 0x7ff2d40af420 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00a960 tx=0x7ff2cc004620 comp rx=0 tx=0).stop 2024-09-10T22:45:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.289+0000 7ff2db800640 1 -- 172.21.15.103:0/1898173554 shutdown_connections 2024-09-10T22:45:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.289+0000 7ff2db800640 1 --2- 172.21.15.103:0/1898173554 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff2b40725e0 0x7ff2b4074aa0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.289+0000 7ff2db800640 1 --2- 172.21.15.103:0/1898173554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2d40cf260 0x7ff2d40af420 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.289+0000 7ff2db800640 1 --2- 172.21.15.103:0/1898173554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2d40b3150 0x7ff2d40aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.289+0000 7ff2db800640 1 --2- 172.21.15.103:0/1898173554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2d4072a40 0x7ff2d4147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.289+0000 7ff2db800640 1 -- 172.21.15.103:0/1898173554 >> 172.21.15.103:0/1898173554 conn(0x7ff2d406cc00 msgr2=0x7ff2d41552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.289+0000 7ff2db800640 1 -- 172.21.15.103:0/1898173554 shutdown_connections 2024-09-10T22:45:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:02.289+0000 7ff2db800640 1 -- 172.21.15.103:0/1898173554 wait complete. 2024-09-10T22:45:03.313 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:45:03.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4177c00640 1 -- 172.21.15.103:0/2572874403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4154004810 msgr2=0x7f4154004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:03.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4177c00640 1 --2- 172.21.15.103:0/2572874403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4154004810 0x7f4154004c90 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f4158009b60 tx=0x7f415801d2b0 comp rx=0 tx=0).stop 2024-09-10T22:45:03.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4175c00640 1 -- 172.21.15.103:0/2572874403 reap_dead start 2024-09-10T22:45:03.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4177c00640 1 -- 172.21.15.103:0/2572874403 shutdown_connections 2024-09-10T22:45:03.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4177c00640 1 -- 172.21.15.103:0/2572874403 >> 172.21.15.103:0/2572874403 conn(0x7f417006cc00 msgr2=0x7f417006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:03.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4177c00640 1 -- 172.21.15.103:0/2572874403 shutdown_connections 2024-09-10T22:45:03.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4177c00640 1 -- 172.21.15.103:0/2572874403 wait complete. 2024-09-10T22:45:03.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4177c00640 1 Processor -- start 2024-09-10T22:45:03.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4177c00640 1 -- start start 2024-09-10T22:45:03.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4177c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4154004810 0x7f4170158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:03.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4177c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41701358a0 0x7f41701f5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:03.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4177c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4170135d20 0x7f41701f6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:03.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4177c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f417015f890 con 0x7f41701358a0 2024-09-10T22:45:03.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4177c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f417015f710 con 0x7f4154004810 2024-09-10T22:45:03.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4177c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f417015fa10 con 0x7f4170135d20 2024-09-10T22:45:03.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4167e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41701358a0 0x7f41701f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:03.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4167e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41701358a0 0x7f41701f5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40882/0 (socket says 172.21.15.103:40882) 2024-09-10T22:45:03.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4167e00640 1 -- 172.21.15.103:0/2103144120 learned_addr learned my addr 172.21.15.103:0/2103144120 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:03.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4175200640 1 --2- 172.21.15.103:0/2103144120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4154004810 0x7f4170158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:03.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4175c00640 1 --2- 172.21.15.103:0/2103144120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4170135d20 0x7f41701f6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:03.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4167e00640 1 -- 172.21.15.103:0/2103144120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4170135d20 msgr2=0x7f41701f6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:03.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4167e00640 1 --2- 172.21.15.103:0/2103144120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4170135d20 0x7f41701f6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:03.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4167e00640 1 -- 172.21.15.103:0/2103144120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4154004810 msgr2=0x7f4170158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:03.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4167e00640 1 --2- 172.21.15.103:0/2103144120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4154004810 0x7f4170158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:03.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4167e00640 1 -- 172.21.15.103:0/2103144120 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41701594a0 con 0x7f41701358a0 2024-09-10T22:45:03.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.465+0000 7f4175200640 1 --2- 172.21.15.103:0/2103144120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4154004810 0x7f4170158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:03.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.469+0000 7f4167e00640 1 --2- 172.21.15.103:0/2103144120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41701358a0 0x7f41701f5c50 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f415801d0e0 tx=0x7f4158005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:03.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.469+0000 7f416d600640 1 -- 172.21.15.103:0/2103144120 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41580b2070 con 0x7f41701358a0 2024-09-10T22:45:03.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.469+0000 7f416d600640 1 -- 172.21.15.103:0/2103144120 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41580b3040 con 0x7f41701358a0 2024-09-10T22:45:03.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.469+0000 7f416d600640 1 -- 172.21.15.103:0/2103144120 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4158004a40 con 0x7f41701358a0 2024-09-10T22:45:03.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.469+0000 7f4177c00640 1 -- 172.21.15.103:0/2103144120 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4170159780 con 0x7f41701358a0 2024-09-10T22:45:03.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.469+0000 7f4177c00640 1 -- 172.21.15.103:0/2103144120 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4170159d40 con 0x7f41701358a0 2024-09-10T22:45:03.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.469+0000 7f4177c00640 1 -- 172.21.15.103:0/2103144120 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f417015eda0 con 0x7f41701358a0 2024-09-10T22:45:03.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.469+0000 7f416d600640 1 -- 172.21.15.103:0/2103144120 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4158004be0 con 0x7f41701358a0 2024-09-10T22:45:03.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.469+0000 7f416d600640 1 --2- 172.21.15.103:0/2103144120 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f414c072610 0x7f414c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:03.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.469+0000 7f416d600640 1 -- 172.21.15.103:0/2103144120 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f415812dc90 con 0x7f41701358a0 2024-09-10T22:45:03.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.469+0000 7f4175200640 1 --2- 172.21.15.103:0/2103144120 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f414c072610 0x7f414c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:03.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.473+0000 7f4175200640 1 --2- 172.21.15.103:0/2103144120 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f414c072610 0x7f414c074ad0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4160001720 tx=0x7f41600067b0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:03.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.473+0000 7f416d600640 1 -- 172.21.15.103:0/2103144120 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f41580c5020 con 0x7f41701358a0 2024-09-10T22:45:03.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.673+0000 7f4177c00640 1 -- 172.21.15.103:0/2103144120 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41700b0ae0 con 0x7f41701358a0 2024-09-10T22:45:03.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.673+0000 7f416d600640 1 -- 172.21.15.103:0/2103144120 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) ==== 94+0+5281 (secure 0 0 0) 0x7f4158016fc0 con 0x7f41701358a0 2024-09-10T22:45:03.677 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:03.677 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":99,"btime":"2024-09-10T22:45:02:330664+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2586411857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2586411857},{"type":"v1","addr":"172.21.15.131:6837","nonce":2586411857}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:44:23.558537+0000","modified":"2024-09-10T22:45:02.272780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7434,"mds_1":7428,"mds_2":7048},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7048":{"gid":7048,"name":"d","rank":2,"incarnation":93,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6836/1622106563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1622106563},{"type":"v1","addr":"172.21.15.131:6836","nonce":1622106563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":1,"incarnation":91,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3251348074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3251348074},{"type":"v1","addr":"172.21.15.103:6834","nonce":3251348074}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7434":{"gid":7434,"name":"c","rank":0,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/187627880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":187627880},{"type":"v1","addr":"172.21.15.103:6835","nonce":187627880}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7434,"qdb_cluster":[7434,7428,7048]},"id":6}]} 2024-09-10T22:45:03.678 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 99 2024-09-10T22:45:03.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.673+0000 7f4177c00640 1 -- 172.21.15.103:0/2103144120 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f414c072610 msgr2=0x7f414c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:03.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.673+0000 7f4177c00640 1 --2- 172.21.15.103:0/2103144120 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f414c072610 0x7f414c074ad0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4160001720 tx=0x7f41600067b0 comp rx=0 tx=0).stop 2024-09-10T22:45:03.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.673+0000 7f4177c00640 1 -- 172.21.15.103:0/2103144120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41701358a0 msgr2=0x7f41701f5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:03.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.673+0000 7f4177c00640 1 --2- 172.21.15.103:0/2103144120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41701358a0 0x7f41701f5c50 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f415801d0e0 tx=0x7f4158005640 comp rx=0 tx=0).stop 2024-09-10T22:45:03.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.673+0000 7f4177c00640 1 -- 172.21.15.103:0/2103144120 shutdown_connections 2024-09-10T22:45:03.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.673+0000 7f4177c00640 1 --2- 172.21.15.103:0/2103144120 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f414c072610 0x7f414c074ad0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:03.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.673+0000 7f4177c00640 1 --2- 172.21.15.103:0/2103144120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4170135d20 0x7f41701f6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:03.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.673+0000 7f4177c00640 1 --2- 172.21.15.103:0/2103144120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41701358a0 0x7f41701f5c50 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:03.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.673+0000 7f4177c00640 1 --2- 172.21.15.103:0/2103144120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4154004810 0x7f4170158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:03.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.673+0000 7f4177c00640 1 -- 172.21.15.103:0/2103144120 >> 172.21.15.103:0/2103144120 conn(0x7f417006cc00 msgr2=0x7f417014c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:03.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.673+0000 7f4177c00640 1 -- 172.21.15.103:0/2103144120 shutdown_connections 2024-09-10T22:45:03.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.673+0000 7f4177c00640 1 -- 172.21.15.103:0/2103144120 wait complete. 2024-09-10T22:45:03.702 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-10T22:45:03.702 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:45:03.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82b9600640 1 -- 172.21.15.103:0/401286736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82b40d25f0 msgr2=0x7f82b40af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:03.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82b9600640 1 --2- 172.21.15.103:0/401286736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82b40d25f0 0x7f82b40af720 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f82b40b0ec0 tx=0x7f829c01c770 comp rx=0 tx=0).stop 2024-09-10T22:45:03.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82b9600640 1 -- 172.21.15.103:0/401286736 shutdown_connections 2024-09-10T22:45:03.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82b9600640 1 --2- 172.21.15.103:0/401286736 >> v2:172.21.15.131:3300/0 conn(0x7f82b40717a0 0x7f82b40afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:03.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82b9600640 1 --2- 172.21.15.103:0/401286736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82b40d25f0 0x7f82b40af720 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:03.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82b9600640 1 -- 172.21.15.103:0/401286736 >> 172.21.15.103:0/401286736 conn(0x7f82b40d1ad0 msgr2=0x7f82b40d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:03.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82b9600640 1 -- 172.21.15.103:0/401286736 shutdown_connections 2024-09-10T22:45:03.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82b9600640 1 -- 172.21.15.103:0/401286736 wait complete. 2024-09-10T22:45:03.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82b9600640 1 Processor -- start 2024-09-10T22:45:03.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82b9600640 1 -- start start 2024-09-10T22:45:03.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82b9600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82b40717a0 0x7f82b4146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:03.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82b9600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82b40cfda0 0x7f82b4149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:03.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82b9600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82b40d25f0 0x7f82b4149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:03.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82b9600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f82b4169050 con 0x7f82b40cfda0 2024-09-10T22:45:03.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82b9600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f82b4168ed0 con 0x7f82b40d25f0 2024-09-10T22:45:03.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82b9600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f82b41691d0 con 0x7f82b40717a0 2024-09-10T22:45:03.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82aa000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82b40cfda0 0x7f82b4149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:03.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82aa000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82b40cfda0 0x7f82b4149710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40910/0 (socket says 172.21.15.103:40910) 2024-09-10T22:45:03.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82aa000640 1 -- 172.21.15.103:0/1185975872 learned_addr learned my addr 172.21.15.103:0/1185975872 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:03.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82b2a00640 1 --2- 172.21.15.103:0/1185975872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82b40717a0 0x7f82b4146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:03.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82b3400640 1 --2- 172.21.15.103:0/1185975872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82b40d25f0 0x7f82b4149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:03.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82aa000640 1 -- 172.21.15.103:0/1185975872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82b40717a0 msgr2=0x7f82b4146d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:03.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82aa000640 1 --2- 172.21.15.103:0/1185975872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82b40717a0 0x7f82b4146d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:03.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82aa000640 1 -- 172.21.15.103:0/1185975872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82b40d25f0 msgr2=0x7f82b4149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:03.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82aa000640 1 --2- 172.21.15.103:0/1185975872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82b40d25f0 0x7f82b4149c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:03.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.841+0000 7f82aa000640 1 -- 172.21.15.103:0/1185975872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b40b22c0 con 0x7f82b40cfda0 2024-09-10T22:45:03.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.845+0000 7f82aa000640 1 --2- 172.21.15.103:0/1185975872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82b40cfda0 0x7f82b4149710 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f829c019380 tx=0x7f829c0a5540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:03.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.845+0000 7f82ab400640 1 -- 172.21.15.103:0/1185975872 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c0ba020 con 0x7f82b40cfda0 2024-09-10T22:45:03.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.845+0000 7f82ab400640 1 -- 172.21.15.103:0/1185975872 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f829c0043b0 con 0x7f82b40cfda0 2024-09-10T22:45:03.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.845+0000 7f82ab400640 1 -- 172.21.15.103:0/1185975872 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c0b2040 con 0x7f82b40cfda0 2024-09-10T22:45:03.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.845+0000 7f82b9600640 1 -- 172.21.15.103:0/1185975872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82b40b25a0 con 0x7f82b40cfda0 2024-09-10T22:45:03.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.845+0000 7f82b9600640 1 -- 172.21.15.103:0/1185975872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82b40b2b60 con 0x7f82b40cfda0 2024-09-10T22:45:03.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.845+0000 7f82b9600640 1 -- 172.21.15.103:0/1185975872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82b415eca0 con 0x7f82b40cfda0 2024-09-10T22:45:03.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.845+0000 7f82ab400640 1 -- 172.21.15.103:0/1185975872 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f829c005290 con 0x7f82b40cfda0 2024-09-10T22:45:03.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.845+0000 7f82ab400640 1 --2- 172.21.15.103:0/1185975872 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f82900725e0 0x7f8290074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:03.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.845+0000 7f82ab400640 1 -- 172.21.15.103:0/1185975872 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f829c12d160 con 0x7f82b40cfda0 2024-09-10T22:45:03.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.845+0000 7f82b2a00640 1 --2- 172.21.15.103:0/1185975872 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f82900725e0 0x7f8290074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:03.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.849+0000 7f82b2a00640 1 --2- 172.21.15.103:0/1185975872 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f82900725e0 0x7f8290074aa0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f82a4007fd0 tx=0x7f82a4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:03.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:03.849+0000 7f82ab400640 1 -- 172.21.15.103:0/1185975872 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f829c0c4060 con 0x7f82b40cfda0 2024-09-10T22:45:04.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.077+0000 7f82b9600640 1 -- 172.21.15.103:0/1185975872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f82b4075d40 con 0x7f82b40cfda0 2024-09-10T22:45:04.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.077+0000 7f82ab400640 1 -- 172.21.15.103:0/1185975872 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2008 (secure 0 0 0) 0x7f829c0164b0 con 0x7f82b40cfda0 2024-09-10T22:45:04.081 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:04.082 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":399,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":694889,"bytes_used":266215424,"bytes_avail":772827897856,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9639,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":99,"btime":"2024-09-10T22:45:02:330664+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":7048},{"filesystem_id":6,"rank":1,"name":"a","status":"up:active","gid":7428},{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7434}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-10T22:45:01.715869+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-10T22:45:04.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.081+0000 7f82b9600640 1 -- 172.21.15.103:0/1185975872 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f82900725e0 msgr2=0x7f8290074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.081+0000 7f82b9600640 1 --2- 172.21.15.103:0/1185975872 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f82900725e0 0x7f8290074aa0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f82a4007fd0 tx=0x7f82a4009040 comp rx=0 tx=0).stop 2024-09-10T22:45:04.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.081+0000 7f82b9600640 1 -- 172.21.15.103:0/1185975872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82b40cfda0 msgr2=0x7f82b4149710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.081+0000 7f82b9600640 1 --2- 172.21.15.103:0/1185975872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82b40cfda0 0x7f82b4149710 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f829c019380 tx=0x7f829c0a5540 comp rx=0 tx=0).stop 2024-09-10T22:45:04.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.081+0000 7f82b9600640 1 -- 172.21.15.103:0/1185975872 shutdown_connections 2024-09-10T22:45:04.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.081+0000 7f82b9600640 1 --2- 172.21.15.103:0/1185975872 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f82900725e0 0x7f8290074aa0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.081+0000 7f82b9600640 1 --2- 172.21.15.103:0/1185975872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82b40d25f0 0x7f82b4149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.081+0000 7f82b9600640 1 --2- 172.21.15.103:0/1185975872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82b40cfda0 0x7f82b4149710 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.081+0000 7f82b9600640 1 --2- 172.21.15.103:0/1185975872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82b40717a0 0x7f82b4146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.081+0000 7f82b9600640 1 -- 172.21.15.103:0/1185975872 >> 172.21.15.103:0/1185975872 conn(0x7f82b40d1ad0 msgr2=0x7f82b415de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.081+0000 7f82b9600640 1 -- 172.21.15.103:0/1185975872 shutdown_connections 2024-09-10T22:45:04.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.081+0000 7f82b9600640 1 -- 172.21.15.103:0/1185975872 wait complete. 2024-09-10T22:45:04.104 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-10T22:45:04.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:04.104 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub resume 2024-09-10T22:45:04.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4ea400640 1 -- 172.21.15.103:0/1307912768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4e40cdd00 msgr2=0x7fd4e40ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4ea400640 1 --2- 172.21.15.103:0/1307912768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4e40cdd00 0x7fd4e40ccdf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009900 tx=0x7fd4d001c8e0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4ea400640 1 -- 172.21.15.103:0/1307912768 shutdown_connections 2024-09-10T22:45:04.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4ea400640 1 --2- 172.21.15.103:0/1307912768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4e40cdd00 0x7fd4e40ccdf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4ea400640 1 --2- 172.21.15.103:0/1307912768 >> v2:172.21.15.131:3300/0 conn(0x7fd4e415f1a0 0x7fd4e40ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4ea400640 1 -- 172.21.15.103:0/1307912768 >> 172.21.15.103:0/1307912768 conn(0x7fd4e40d1a20 msgr2=0x7fd4e40d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4ea400640 1 -- 172.21.15.103:0/1307912768 shutdown_connections 2024-09-10T22:45:04.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4ea400640 1 -- 172.21.15.103:0/1307912768 wait complete. 2024-09-10T22:45:04.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4ea400640 1 Processor -- start 2024-09-10T22:45:04.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4ea400640 1 -- start start 2024-09-10T22:45:04.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4ea400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4e40cd330 0x7fd4e41598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4ea400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e40cdd00 0x7fd4e4166150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4ea400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4e415f1a0 0x7fd4e40c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4ea400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e41690c0 con 0x7fd4e40cdd00 2024-09-10T22:45:04.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4ea400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e4168f40 con 0x7fd4e40cd330 2024-09-10T22:45:04.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4ea400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e4169240 con 0x7fd4e415f1a0 2024-09-10T22:45:04.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4e2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e40cdd00 0x7fd4e4166150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4e2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e40cdd00 0x7fd4e4166150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40926/0 (socket says 172.21.15.103:40926) 2024-09-10T22:45:04.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4e2a00640 1 -- 172.21.15.103:0/2700437748 learned_addr learned my addr 172.21.15.103:0/2700437748 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.249+0000 7fd4e3400640 1 --2- 172.21.15.103:0/2700437748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4e40cd330 0x7fd4e41598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.253+0000 7fd4e3e00640 1 --2- 172.21.15.103:0/2700437748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4e415f1a0 0x7fd4e40c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.253+0000 7fd4e2a00640 1 -- 172.21.15.103:0/2700437748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4e415f1a0 msgr2=0x7fd4e40c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.253+0000 7fd4e2a00640 1 --2- 172.21.15.103:0/2700437748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4e415f1a0 0x7fd4e40c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.253+0000 7fd4e2a00640 1 -- 172.21.15.103:0/2700437748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4e40cd330 msgr2=0x7fd4e41598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.253+0000 7fd4e2a00640 1 --2- 172.21.15.103:0/2700437748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4e40cd330 0x7fd4e41598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.253+0000 7fd4e2a00640 1 -- 172.21.15.103:0/2700437748 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e4166690 con 0x7fd4e40cdd00 2024-09-10T22:45:04.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.253+0000 7fd4e2a00640 1 --2- 172.21.15.103:0/2700437748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e40cdd00 0x7fd4e4166150 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009850 tx=0x7fd4d0005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.253+0000 7fd4db400640 1 -- 172.21.15.103:0/2700437748 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d00b2040 con 0x7fd4e40cdd00 2024-09-10T22:45:04.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.253+0000 7fd4db400640 1 -- 172.21.15.103:0/2700437748 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4d00a5d00 con 0x7fd4e40cdd00 2024-09-10T22:45:04.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.253+0000 7fd4ea400640 1 -- 172.21.15.103:0/2700437748 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e41650b0 con 0x7fd4e40cdd00 2024-09-10T22:45:04.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.253+0000 7fd4db400640 1 -- 172.21.15.103:0/2700437748 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0005290 con 0x7fd4e40cdd00 2024-09-10T22:45:04.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.253+0000 7fd4ea400640 1 -- 172.21.15.103:0/2700437748 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e4165670 con 0x7fd4e40cdd00 2024-09-10T22:45:04.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.253+0000 7fd4db400640 1 -- 172.21.15.103:0/2700437748 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd4d0005430 con 0x7fd4e40cdd00 2024-09-10T22:45:04.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4db400640 1 --2- 172.21.15.103:0/2700437748 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4c40725e0 0x7fd4c4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4db400640 1 -- 172.21.15.103:0/2700437748 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fd4d012ce90 con 0x7fd4e40cdd00 2024-09-10T22:45:04.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4ed738000 1 Processor -- start 2024-09-10T22:45:04.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4e3400640 1 --2- 172.21.15.103:0/2700437748 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4c40725e0 0x7fd4c4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4ed738000 1 -- start start 2024-09-10T22:45:04.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4e3400640 1 --2- 172.21.15.103:0/2700437748 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4c40725e0 0x7fd4c4074aa0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd4e406e350 tx=0x7fd4d4009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4ed738000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5f1a0 0x5598eff5f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4ed738000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff5fac0 0x5598eff15680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4ed738000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff15bc0 0x5598eff15fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4ed738000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5598efdfdcb0 con 0x5598eff15bc0 2024-09-10T22:45:04.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4ed738000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5598efd13310 con 0x5598eff5fac0 2024-09-10T22:45:04.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4ed738000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5598efd70b90 con 0x5598eff5f1a0 2024-09-10T22:45:04.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4e3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff15bc0 0x5598eff15fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4e3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff15bc0 0x5598eff15fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40942/0 (socket says 172.21.15.103:40942) 2024-09-10T22:45:04.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4e3e00640 1 -- 172.21.15.103:0/4293788262 learned_addr learned my addr 172.21.15.103:0/4293788262 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4e2a00640 1 --2- 172.21.15.103:0/4293788262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff5fac0 0x5598eff15680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4e3400640 1 --2- 172.21.15.103:0/4293788262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5f1a0 0x5598eff5f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4e3e00640 1 -- 172.21.15.103:0/4293788262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5f1a0 msgr2=0x5598eff5f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4e3e00640 1 --2- 172.21.15.103:0/4293788262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5f1a0 0x5598eff5f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4e3e00640 1 -- 172.21.15.103:0/4293788262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff5fac0 msgr2=0x5598eff15680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4e3e00640 1 --2- 172.21.15.103:0/4293788262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff5fac0 0x5598eff15680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4e3e00640 1 -- 172.21.15.103:0/4293788262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598efd14c60 con 0x5598eff15bc0 2024-09-10T22:45:04.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4e3e00640 1 --2- 172.21.15.103:0/4293788262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff15bc0 0x5598eff15fa0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0015e0 tx=0x7fd4dc001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819313c537a3d666 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4cfe00640 1 -- 172.21.15.103:0/4293788262 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc019070 con 0x5598eff15bc0 2024-09-10T22:45:04.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4cfe00640 1 -- 172.21.15.103:0/4293788262 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4dc001cf0 con 0x5598eff15bc0 2024-09-10T22:45:04.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4cfe00640 1 -- 172.21.15.103:0/4293788262 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc00e740 con 0x5598eff15bc0 2024-09-10T22:45:04.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4ed738000 1 -- 172.21.15.103:0/4293788262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff15bc0 msgr2=0x5598eff15fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4ed738000 1 --2- 172.21.15.103:0/4293788262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff15bc0 0x5598eff15fa0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0015e0 tx=0x7fd4dc001aa0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4ed738000 1 -- 172.21.15.103:0/4293788262 shutdown_connections 2024-09-10T22:45:04.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4ed738000 1 --2- 172.21.15.103:0/4293788262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff15bc0 0x5598eff15fa0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4ed738000 1 --2- 172.21.15.103:0/4293788262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff5fac0 0x5598eff15680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4ed738000 1 --2- 172.21.15.103:0/4293788262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5f1a0 0x5598eff5f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4ed738000 1 -- 172.21.15.103:0/4293788262 >> 172.21.15.103:0/4293788262 conn(0x5598eff1bd20 msgr2=0x5598eff13f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4ed738000 1 -- 172.21.15.103:0/4293788262 shutdown_connections 2024-09-10T22:45:04.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.257+0000 7fd4ed738000 1 -- 172.21.15.103:0/4293788262 wait complete. 2024-09-10T22:45:04.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ed738000 1 -- start start 2024-09-10T22:45:04.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ed738000 1 Processor -- start 2024-09-10T22:45:04.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ed738000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff15bc0 0x5598eff66530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ed738000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5f1a0 0x5598eff66a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ed738000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5fac0 0x5598eff66fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ed738000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5598efd63dd0 con 0x5598eff5f1a0 2024-09-10T22:45:04.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ed738000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5598efd5ffc0 con 0x5598eff15bc0 2024-09-10T22:45:04.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ed738000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5598efd054b0 con 0x5598eff5fac0 2024-09-10T22:45:04.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ed738000 10 client.0 _ll_register_callbacks cb 0x5598efce37d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:04.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4e2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5f1a0 0x5598eff66a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4e2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5f1a0 0x5598eff66a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40950/0 (socket says 172.21.15.103:40950) 2024-09-10T22:45:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4e2a00640 1 -- 172.21.15.103:0/3982000896 learned_addr learned my addr 172.21.15.103:0/3982000896 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4e3400640 1 --2- 172.21.15.103:0/3982000896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff15bc0 0x5598eff66530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4e3e00640 1 --2- 172.21.15.103:0/3982000896 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5fac0 0x5598eff66fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4e2a00640 1 -- 172.21.15.103:0/3982000896 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5fac0 msgr2=0x5598eff66fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4e2a00640 1 --2- 172.21.15.103:0/3982000896 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5fac0 0x5598eff66fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4e2a00640 1 -- 172.21.15.103:0/3982000896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff15bc0 msgr2=0x5598eff66530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4e2a00640 1 --2- 172.21.15.103:0/3982000896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff15bc0 0x5598eff66530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4e2a00640 1 -- 172.21.15.103:0/3982000896 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598efcfe1f0 con 0x5598eff5f1a0 2024-09-10T22:45:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4e2a00640 1 --2- 172.21.15.103:0/3982000896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5f1a0 0x5598eff66a70 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fd4d001a510 tx=0x7fd4d00f7560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c62c6516009b8e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ccc00640 1 -- 172.21.15.103:0/3982000896 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d00f8250 con 0x5598eff5f1a0 2024-09-10T22:45:04.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ccc00640 1 -- 172.21.15.103:0/3982000896 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fd4d0100bc0 con 0x5598eff5f1a0 2024-09-10T22:45:04.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ed738000 1 -- 172.21.15.103:0/3982000896 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5598efcf8330 con 0x5598eff5f1a0 2024-09-10T22:45:04.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ccc00640 1 -- 172.21.15.103:0/3982000896 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7fd4d00f7b50 con 0x5598eff5f1a0 2024-09-10T22:45:04.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ed738000 10 client.7929 fetch_fsmap learned FSMap version 99 2024-09-10T22:45:04.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ed738000 1 -- 172.21.15.103:0/3982000896 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) -- 0x5598efce4fa0 con 0x5598eff5f1a0 2024-09-10T22:45:04.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ccc00640 1 -- 172.21.15.103:0/3982000896 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5598efcf8330 con 0x5598eff5f1a0 2024-09-10T22:45:04.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ccc00640 1 -- 172.21.15.103:0/3982000896 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 99) ==== 3558+0+0 (secure 0 0 0) 0x7fd4d01172f0 con 0x5598eff5f1a0 2024-09-10T22:45:04.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ed738000 10 client.7929 fetch_fsmap finished waiting for FSMap version 99 2024-09-10T22:45:04.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ed738000 10 client.7929 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-10T22:45:04.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ed738000 20 client.7929 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ed738000 1 --2- 172.21.15.103:0/3982000896 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x5598eff6e900 0x5598eff70cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ed738000 4 client.7929 mds_command: new command op to 7434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:45:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4ed738000 1 -- 172.21.15.103:0/3982000896 --> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598efd72ae0 con 0x5598eff6e900 2024-09-10T22:45:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.261+0000 7fd4e3400640 1 --2- 172.21.15.103:0/3982000896 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x5598eff6e900 0x5598eff70cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.265+0000 7fd4ccc00640 10 client.7929 ms_handle_connect on v2:172.21.15.103:6833/187627880 2024-09-10T22:45:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.265+0000 7fd4e3400640 1 --2- 172.21.15.103:0/3982000896 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x5598eff6e900 0x5598eff70cf0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51669b9109458502 server_cookie=d624ff71556c5775 in_seq=0 out_seq=0 2024-09-10T22:45:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.265+0000 7fd4ccc00640 1 -- 172.21.15.103:0/3982000896 <== mds.0 v2:172.21.15.103:6833/187627880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5598efd72ae0 con 0x5598eff6e900 2024-09-10T22:45:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.265+0000 7fd4ccc00640 10 client.7929 handle_command_reply: tid=0 2024-09-10T22:45:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.265+0000 7fd4ed738000 1 client.7929 shutdown 2024-09-10T22:45:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.265+0000 7fd4ed738000 1 -- 172.21.15.103:0/3982000896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5f1a0 msgr2=0x5598eff66a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.265+0000 7fd4ed738000 1 --2- 172.21.15.103:0/3982000896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5f1a0 0x5598eff66a70 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fd4d001a510 tx=0x7fd4d00f7560 comp rx=0 tx=0).stop 2024-09-10T22:45:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.265+0000 7fd4ed738000 1 -- 172.21.15.103:0/3982000896 shutdown_connections 2024-09-10T22:45:04.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.265+0000 7fd4ed738000 1 --2- 172.21.15.103:0/3982000896 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x5598eff6e900 0x5598eff70cf0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.265+0000 7fd4ed738000 1 --2- 172.21.15.103:0/3982000896 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5fac0 0x5598eff66fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.265+0000 7fd4ed738000 1 --2- 172.21.15.103:0/3982000896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5f1a0 0x5598eff66a70 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.265+0000 7fd4ccc00640 0 client.7929 ms_handle_reset on v2:172.21.15.103:6833/187627880 2024-09-10T22:45:04.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.265+0000 7fd4ed738000 1 --2- 172.21.15.103:0/3982000896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff15bc0 0x5598eff66530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.265+0000 7fd4ed738000 1 -- 172.21.15.103:0/3982000896 >> 172.21.15.103:0/3982000896 conn(0x5598eff1bd20 msgr2=0x5598eff13f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.265+0000 7fd4ed738000 1 -- 172.21.15.103:0/3982000896 shutdown_connections 2024-09-10T22:45:04.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.265+0000 7fd4ed738000 1 -- 172.21.15.103:0/3982000896 wait complete. 2024-09-10T22:45:04.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.265+0000 7fd4ed738000 20 client.7929 trim_cache size 0 max 16384 2024-09-10T22:45:04.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.281+0000 7fd4ed738000 1 Processor -- start 2024-09-10T22:45:04.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.281+0000 7fd4ed738000 1 -- start start 2024-09-10T22:45:04.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.281+0000 7fd4ed738000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff15bc0 0x5598effd0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.281+0000 7fd4ed738000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5f1a0 0x5598effd1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.281+0000 7fd4ed738000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5fac0 0x5598effd16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.281+0000 7fd4ed738000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5598eff15a40 con 0x5598eff5fac0 2024-09-10T22:45:04.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.281+0000 7fd4ed738000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e4204ab0 con 0x5598eff15bc0 2024-09-10T22:45:04.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.281+0000 7fd4ed738000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e4203c50 con 0x5598eff5f1a0 2024-09-10T22:45:04.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4e3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5fac0 0x5598effd16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4e3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5fac0 0x5598effd16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40964/0 (socket says 172.21.15.103:40964) 2024-09-10T22:45:04.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4e3e00640 1 -- 172.21.15.103:0/2599371675 learned_addr learned my addr 172.21.15.103:0/2599371675 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4e3400640 1 --2- 172.21.15.103:0/2599371675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff15bc0 0x5598effd0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4e2a00640 1 --2- 172.21.15.103:0/2599371675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5f1a0 0x5598effd1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4e3e00640 1 -- 172.21.15.103:0/2599371675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5f1a0 msgr2=0x5598effd1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4e3e00640 1 --2- 172.21.15.103:0/2599371675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5f1a0 0x5598effd1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4e3e00640 1 -- 172.21.15.103:0/2599371675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff15bc0 msgr2=0x5598effd0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4e3e00640 1 --2- 172.21.15.103:0/2599371675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff15bc0 0x5598effd0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4e3e00640 1 -- 172.21.15.103:0/2599371675 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598efdbd660 con 0x5598eff5fac0 2024-09-10T22:45:04.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4e3e00640 1 --2- 172.21.15.103:0/2599371675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5fac0 0x5598effd16b0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc013000 tx=0x7fd4dc001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4767b4f2b5bc7b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4cf400640 1 -- 172.21.15.103:0/2599371675 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc019040 con 0x5598eff5fac0 2024-09-10T22:45:04.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4cf400640 1 -- 172.21.15.103:0/2599371675 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4dc024070 con 0x5598eff5fac0 2024-09-10T22:45:04.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4cf400640 1 -- 172.21.15.103:0/2599371675 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc00e740 con 0x5598eff5fac0 2024-09-10T22:45:04.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4ed738000 1 -- 172.21.15.103:0/2599371675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5fac0 msgr2=0x5598effd16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4ed738000 1 --2- 172.21.15.103:0/2599371675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5fac0 0x5598effd16b0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc013000 tx=0x7fd4dc001130 comp rx=0 tx=0).stop 2024-09-10T22:45:04.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4ed738000 1 -- 172.21.15.103:0/2599371675 shutdown_connections 2024-09-10T22:45:04.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4ed738000 1 --2- 172.21.15.103:0/2599371675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5fac0 0x5598effd16b0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4ed738000 1 --2- 172.21.15.103:0/2599371675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5f1a0 0x5598effd1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4ed738000 1 --2- 172.21.15.103:0/2599371675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff15bc0 0x5598effd0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4ed738000 1 -- 172.21.15.103:0/2599371675 >> 172.21.15.103:0/2599371675 conn(0x5598eff1bd20 msgr2=0x5598eff172b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4ed738000 1 -- 172.21.15.103:0/2599371675 shutdown_connections 2024-09-10T22:45:04.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4ed738000 1 -- 172.21.15.103:0/2599371675 wait complete. 2024-09-10T22:45:04.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4ed738000 1 -- start start 2024-09-10T22:45:04.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4ed738000 1 Processor -- start 2024-09-10T22:45:04.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4ed738000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff15bc0 0x5598eff75c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4ed738000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5f1a0 0x5598eff76150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4ed738000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5fac0 0x5598eff91210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4ed738000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e41fb910 con 0x5598eff5fac0 2024-09-10T22:45:04.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4ed738000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e4204380 con 0x5598eff15bc0 2024-09-10T22:45:04.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4ed738000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5598efa25680 con 0x5598eff5f1a0 2024-09-10T22:45:04.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4ed738000 10 client.0 _ll_register_callbacks cb 0x7fd4d0005750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:04.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4e3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5fac0 0x5598eff91210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4e3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff15bc0 0x5598eff75c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4e3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5fac0 0x5598eff91210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40966/0 (socket says 172.21.15.103:40966) 2024-09-10T22:45:04.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4e3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff15bc0 0x5598eff75c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:55428/0 (socket says 172.21.15.103:55428) 2024-09-10T22:45:04.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.285+0000 7fd4e3e00640 1 -- 172.21.15.103:0/1419492056 learned_addr learned my addr 172.21.15.103:0/1419492056 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4e2a00640 1 --2- 172.21.15.103:0/1419492056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5f1a0 0x5598eff76150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4e3400640 1 -- 172.21.15.103:0/1419492056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5f1a0 msgr2=0x5598eff76150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4e3400640 1 --2- 172.21.15.103:0/1419492056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5f1a0 0x5598eff76150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4e3400640 1 -- 172.21.15.103:0/1419492056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5fac0 msgr2=0x5598eff91210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4e3400640 1 --2- 172.21.15.103:0/1419492056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5fac0 0x5598eff91210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4e3400640 1 -- 172.21.15.103:0/1419492056 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598efd2a090 con 0x5598eff15bc0 2024-09-10T22:45:04.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4e3400640 1 --2- 172.21.15.103:0/1419492056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff15bc0 0x5598eff75c10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4003b30 tx=0x7fd4d4004ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa3f4bd49a1c64bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-09-10T22:45:04.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ccc00640 1 -- 172.21.15.103:0/1419492056 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4034030 con 0x5598eff15bc0 2024-09-10T22:45:04.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ccc00640 1 -- 172.21.15.103:0/1419492056 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fd4d402d040 con 0x5598eff15bc0 2024-09-10T22:45:04.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 1 -- 172.21.15.103:0/1419492056 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4dc024070 con 0x5598eff15bc0 2024-09-10T22:45:04.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ccc00640 1 -- 172.21.15.103:0/1419492056 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7fd4d40046d0 con 0x5598eff15bc0 2024-09-10T22:45:04.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 10 client.7477 fetch_fsmap learned FSMap version 99 2024-09-10T22:45:04.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 1 -- 172.21.15.103:0/1419492056 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) -- 0x5598efcf65f0 con 0x5598eff15bc0 2024-09-10T22:45:04.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ccc00640 1 -- 172.21.15.103:0/1419492056 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4dc024070 con 0x5598eff15bc0 2024-09-10T22:45:04.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ccc00640 1 -- 172.21.15.103:0/1419492056 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 99) ==== 3558+0+0 (secure 0 0 0) 0x7fd4d401a040 con 0x5598eff15bc0 2024-09-10T22:45:04.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 10 client.7477 fetch_fsmap finished waiting for FSMap version 99 2024-09-10T22:45:04.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 10 client.7477 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-10T22:45:04.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 20 client.7477 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:04.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 1 --2- 172.21.15.103:0/1419492056 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x5598effd4850 0x5598effd4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 4 client.7477 mds_command: new command op to 7434 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-10T22:45:04.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 1 -- 172.21.15.103:0/1419492056 --> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x5598efd6e590 con 0x5598effd4850 2024-09-10T22:45:04.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4e2a00640 1 --2- 172.21.15.103:0/1419492056 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x5598effd4850 0x5598effd4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4e2a00640 1 --2- 172.21.15.103:0/1419492056 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x5598effd4850 0x5598effd4c60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51d0d48a8321aa0e server_cookie=1084b31e2e047344 in_seq=0 out_seq=0 2024-09-10T22:45:04.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ccc00640 10 client.7477 ms_handle_connect on v2:172.21.15.103:6833/187627880 2024-09-10T22:45:04.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ccc00640 1 -- 172.21.15.103:0/1419492056 <== mds.0 v2:172.21.15.103:6833/187627880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5598efd6e590 con 0x5598effd4850 2024-09-10T22:45:04.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ccc00640 10 client.7477 handle_command_reply: tid=0 2024-09-10T22:45:04.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 1 client.7477 shutdown 2024-09-10T22:45:04.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 1 -- 172.21.15.103:0/1419492056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff15bc0 msgr2=0x5598eff75c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 1 --2- 172.21.15.103:0/1419492056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff15bc0 0x5598eff75c10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4003b30 tx=0x7fd4d4004ac0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 1 -- 172.21.15.103:0/1419492056 shutdown_connections 2024-09-10T22:45:04.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 1 --2- 172.21.15.103:0/1419492056 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x5598effd4850 0x5598effd4c60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 1 --2- 172.21.15.103:0/1419492056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5598eff5fac0 0x5598eff91210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 1 --2- 172.21.15.103:0/1419492056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5598eff5f1a0 0x5598eff76150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 1 --2- 172.21.15.103:0/1419492056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598eff15bc0 0x5598eff75c10 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ccc00640 0 client.7477 ms_handle_reset on v2:172.21.15.103:6833/187627880 2024-09-10T22:45:04.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 1 -- 172.21.15.103:0/1419492056 >> 172.21.15.103:0/1419492056 conn(0x5598eff1bd20 msgr2=0x5598eff70cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 1 -- 172.21.15.103:0/1419492056 shutdown_connections 2024-09-10T22:45:04.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 1 -- 172.21.15.103:0/1419492056 wait complete. 2024-09-10T22:45:04.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ed738000 20 client.7477 trim_cache size 0 max 16384 2024-09-10T22:45:04.307 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:45:04.307 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:45:04.307 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:45:04.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ea400640 1 -- 172.21.15.103:0/2700437748 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4c40725e0 msgr2=0x7fd4c4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ea400640 1 --2- 172.21.15.103:0/2700437748 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4c40725e0 0x7fd4c4074aa0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd4e406e350 tx=0x7fd4d4009500 comp rx=0 tx=0).stop 2024-09-10T22:45:04.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ea400640 1 -- 172.21.15.103:0/2700437748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e40cdd00 msgr2=0x7fd4e4166150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ea400640 1 --2- 172.21.15.103:0/2700437748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e40cdd00 0x7fd4e4166150 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009850 tx=0x7fd4d0005e70 comp rx=0 tx=0).stop 2024-09-10T22:45:04.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ea400640 1 -- 172.21.15.103:0/2700437748 shutdown_connections 2024-09-10T22:45:04.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ea400640 1 --2- 172.21.15.103:0/2700437748 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4c40725e0 0x7fd4c4074aa0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ea400640 1 --2- 172.21.15.103:0/2700437748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4e415f1a0 0x7fd4e40c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ea400640 1 --2- 172.21.15.103:0/2700437748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e40cdd00 0x7fd4e4166150 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.289+0000 7fd4ea400640 1 --2- 172.21.15.103:0/2700437748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4e40cd330 0x7fd4e41598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.293+0000 7fd4ea400640 1 -- 172.21.15.103:0/2700437748 >> 172.21.15.103:0/2700437748 conn(0x7fd4e40d1a20 msgr2=0x7fd4e40b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.293+0000 7fd4ea400640 1 -- 172.21.15.103:0/2700437748 shutdown_connections 2024-09-10T22:45:04.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.293+0000 7fd4ea400640 1 -- 172.21.15.103:0/2700437748 wait complete. 2024-09-10T22:45:04.314 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:45:04.314 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.6:1 scrub status 2024-09-10T22:45:04.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.457+0000 7f327e400640 1 -- 172.21.15.103:0/1400105531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f325c004810 msgr2=0x7f325c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.457+0000 7f327e400640 1 --2- 172.21.15.103:0/1400105531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f325c004810 0x7f325c004c90 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f3260001dc0 tx=0x7f326001cad0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.457+0000 7f327e400640 1 -- 172.21.15.103:0/1400105531 shutdown_connections 2024-09-10T22:45:04.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.457+0000 7f327e400640 1 --2- 172.21.15.103:0/1400105531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f325c004810 0x7f325c004c90 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.457+0000 7f327e400640 1 -- 172.21.15.103:0/1400105531 >> 172.21.15.103:0/1400105531 conn(0x7f327806cc00 msgr2=0x7f327806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.457+0000 7f327e400640 1 -- 172.21.15.103:0/1400105531 shutdown_connections 2024-09-10T22:45:04.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.457+0000 7f327e400640 1 -- 172.21.15.103:0/1400105531 wait complete. 2024-09-10T22:45:04.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.457+0000 7f327e400640 1 Processor -- start 2024-09-10T22:45:04.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.457+0000 7f327e400640 1 -- start start 2024-09-10T22:45:04.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.457+0000 7f327e400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f325c004810 0x7f3278158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.457+0000 7f327e400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3278142d50 0x7f32780a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.457+0000 7f327e400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32780aca40 0x7f32780acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.457+0000 7f327e400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f32780b33c0 con 0x7f3278142d50 2024-09-10T22:45:04.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.457+0000 7f327e400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f32780b3240 con 0x7f325c004810 2024-09-10T22:45:04.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.457+0000 7f327e400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f32780b3540 con 0x7f32780aca40 2024-09-10T22:45:04.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.461+0000 7f326ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3278142d50 0x7f32780a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.461+0000 7f3277400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f325c004810 0x7f3278158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.461+0000 7f326ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3278142d50 0x7f32780a9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40974/0 (socket says 172.21.15.103:40974) 2024-09-10T22:45:04.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.461+0000 7f326ea00640 1 -- 172.21.15.103:0/1270208910 learned_addr learned my addr 172.21.15.103:0/1270208910 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.461+0000 7f3277e00640 1 --2- 172.21.15.103:0/1270208910 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32780aca40 0x7f32780acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.461+0000 7f326ea00640 1 -- 172.21.15.103:0/1270208910 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32780aca40 msgr2=0x7f32780acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.461+0000 7f326ea00640 1 --2- 172.21.15.103:0/1270208910 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32780aca40 0x7f32780acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.461+0000 7f326ea00640 1 -- 172.21.15.103:0/1270208910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f325c004810 msgr2=0x7f3278158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.461+0000 7f326ea00640 1 --2- 172.21.15.103:0/1270208910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f325c004810 0x7f3278158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.461+0000 7f326ea00640 1 -- 172.21.15.103:0/1270208910 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32780a9990 con 0x7f3278142d50 2024-09-10T22:45:04.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.461+0000 7f326ea00640 1 --2- 172.21.15.103:0/1270208910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3278142d50 0x7f32780a9450 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f3260006040 tx=0x7f3260003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.461+0000 7f326fe00640 1 -- 172.21.15.103:0/1270208910 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32600a5a30 con 0x7f3278142d50 2024-09-10T22:45:04.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.461+0000 7f326fe00640 1 -- 172.21.15.103:0/1270208910 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32600a5cc0 con 0x7f3278142d50 2024-09-10T22:45:04.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.461+0000 7f327e400640 1 -- 172.21.15.103:0/1270208910 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32780a9c30 con 0x7f3278142d50 2024-09-10T22:45:04.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.461+0000 7f326fe00640 1 -- 172.21.15.103:0/1270208910 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3260006330 con 0x7f3278142d50 2024-09-10T22:45:04.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.461+0000 7f327e400640 1 -- 172.21.15.103:0/1270208910 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32780aa1f0 con 0x7f3278142d50 2024-09-10T22:45:04.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.461+0000 7f326fe00640 1 -- 172.21.15.103:0/1270208910 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f32600c0030 con 0x7f3278142d50 2024-09-10T22:45:04.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f326fe00640 1 --2- 172.21.15.103:0/1270208910 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f32540725e0 0x7f3254074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f326fe00640 1 -- 172.21.15.103:0/1270208910 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f326012ce60 con 0x7f3278142d50 2024-09-10T22:45:04.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f32817d2000 1 Processor -- start 2024-09-10T22:45:04.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f32817d2000 1 -- start start 2024-09-10T22:45:04.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f3277400640 1 --2- 172.21.15.103:0/1270208910 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f32540725e0 0x7f3254074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f3277400640 1 --2- 172.21.15.103:0/1270208910 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f32540725e0 0x7f3254074aa0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3278052890 tx=0x7f326800b260 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f32817d2000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad41a0 0x562706ad4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f32817d2000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706ad4ac0 0x562706a8a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f32817d2000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706a8abc0 0x562706a8afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f32817d2000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562706972cb0 con 0x562706ad41a0 2024-09-10T22:45:04.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f32817d2000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562706888310 con 0x562706ad4ac0 2024-09-10T22:45:04.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f32817d2000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5627068e5b90 con 0x562706a8abc0 2024-09-10T22:45:04.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f3277400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad41a0 0x562706ad4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f3277400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad41a0 0x562706ad4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40976/0 (socket says 172.21.15.103:40976) 2024-09-10T22:45:04.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f3277400640 1 -- 172.21.15.103:0/1531242493 learned_addr learned my addr 172.21.15.103:0/1531242493 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f3277e00640 1 --2- 172.21.15.103:0/1531242493 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706a8abc0 0x562706a8afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f326ea00640 1 --2- 172.21.15.103:0/1531242493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706ad4ac0 0x562706a8a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f3277400640 1 -- 172.21.15.103:0/1531242493 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706a8abc0 msgr2=0x562706a8afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f3277400640 1 --2- 172.21.15.103:0/1531242493 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706a8abc0 0x562706a8afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f3277400640 1 -- 172.21.15.103:0/1531242493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706ad4ac0 msgr2=0x562706a8a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f3277400640 1 --2- 172.21.15.103:0/1531242493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706ad4ac0 0x562706a8a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f3277400640 1 -- 172.21.15.103:0/1531242493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562706889c60 con 0x562706ad41a0 2024-09-10T22:45:04.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f3277400640 1 --2- 172.21.15.103:0/1531242493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad41a0 0x562706ad4580 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f326800bb40 tx=0x7f3268016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c10cd6ff5fc7349 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f3267e00640 1 -- 172.21.15.103:0/1531242493 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326801f9f0 con 0x562706ad41a0 2024-09-10T22:45:04.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f3267e00640 1 -- 172.21.15.103:0/1531242493 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f326801fb90 con 0x562706ad41a0 2024-09-10T22:45:04.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f3267e00640 1 -- 172.21.15.103:0/1531242493 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326801fd80 con 0x562706ad41a0 2024-09-10T22:45:04.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f32817d2000 1 -- 172.21.15.103:0/1531242493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad41a0 msgr2=0x562706ad4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f32817d2000 1 --2- 172.21.15.103:0/1531242493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad41a0 0x562706ad4580 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f326800bb40 tx=0x7f3268016000 comp rx=0 tx=0).stop 2024-09-10T22:45:04.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f32817d2000 1 -- 172.21.15.103:0/1531242493 shutdown_connections 2024-09-10T22:45:04.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f32817d2000 1 --2- 172.21.15.103:0/1531242493 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706a8abc0 0x562706a8afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f32817d2000 1 --2- 172.21.15.103:0/1531242493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706ad4ac0 0x562706a8a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f32817d2000 1 --2- 172.21.15.103:0/1531242493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad41a0 0x562706ad4580 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f32817d2000 1 -- 172.21.15.103:0/1531242493 >> 172.21.15.103:0/1531242493 conn(0x562706a90d20 msgr2=0x562706a88f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f32817d2000 1 -- 172.21.15.103:0/1531242493 shutdown_connections 2024-09-10T22:45:04.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.465+0000 7f32817d2000 1 -- 172.21.15.103:0/1531242493 wait complete. 2024-09-10T22:45:04.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f32817d2000 1 -- start start 2024-09-10T22:45:04.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f32817d2000 1 Processor -- start 2024-09-10T22:45:04.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f32817d2000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706a8abc0 0x562706adb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f32817d2000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706ad41a0 0x562706adba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f32817d2000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad4ac0 0x562706adbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f32817d2000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5627068d8dd0 con 0x562706ad4ac0 2024-09-10T22:45:04.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f32817d2000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5627068d4fc0 con 0x562706a8abc0 2024-09-10T22:45:04.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f32817d2000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56270687a4b0 con 0x562706ad41a0 2024-09-10T22:45:04.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f32817d2000 10 client.0 _ll_register_callbacks cb 0x5627068587d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:04.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3277e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad4ac0 0x562706adbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3277e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad4ac0 0x562706adbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40988/0 (socket says 172.21.15.103:40988) 2024-09-10T22:45:04.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3277e00640 1 -- 172.21.15.103:0/3658273614 learned_addr learned my addr 172.21.15.103:0/3658273614 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3277400640 1 --2- 172.21.15.103:0/3658273614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706a8abc0 0x562706adb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f326ea00640 1 --2- 172.21.15.103:0/3658273614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706ad41a0 0x562706adba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3277e00640 1 -- 172.21.15.103:0/3658273614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706ad41a0 msgr2=0x562706adba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3277e00640 1 --2- 172.21.15.103:0/3658273614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706ad41a0 0x562706adba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3277e00640 1 -- 172.21.15.103:0/3658273614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706a8abc0 msgr2=0x562706adb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3277e00640 1 --2- 172.21.15.103:0/3658273614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706a8abc0 0x562706adb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3277e00640 1 -- 172.21.15.103:0/3658273614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627068731f0 con 0x562706ad4ac0 2024-09-10T22:45:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f326ea00640 1 --2- 172.21.15.103:0/3658273614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706ad41a0 0x562706adba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3277e00640 1 --2- 172.21.15.103:0/3658273614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad4ac0 0x562706adbfb0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f32780d0120 tx=0x7f3270013820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f6820dfdd1276a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3264c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3264c00640 1 -- 172.21.15.103:0/3658273614 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3270012860 con 0x562706ad4ac0 2024-09-10T22:45:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3264c00640 1 -- 172.21.15.103:0/3658273614 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f3270020cc0 con 0x562706ad4ac0 2024-09-10T22:45:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f32817d2000 1 -- 172.21.15.103:0/3658273614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56270686d330 con 0x562706ad4ac0 2024-09-10T22:45:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3264c00640 1 -- 172.21.15.103:0/3658273614 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f3270012a00 con 0x562706ad4ac0 2024-09-10T22:45:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f32817d2000 10 client.7947 fetch_fsmap learned FSMap version 99 2024-09-10T22:45:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f32817d2000 1 -- 172.21.15.103:0/3658273614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) -- 0x562706859fa0 con 0x562706ad4ac0 2024-09-10T22:45:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3264c00640 1 -- 172.21.15.103:0/3658273614 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56270686d330 con 0x562706ad4ac0 2024-09-10T22:45:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3264c00640 1 -- 172.21.15.103:0/3658273614 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 99) ==== 3558+0+0 (secure 0 0 0) 0x7f3270027050 con 0x562706ad4ac0 2024-09-10T22:45:04.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f32817d2000 10 client.7947 fetch_fsmap finished waiting for FSMap version 99 2024-09-10T22:45:04.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f32817d2000 10 client.7947 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.a 2024-09-10T22:45:04.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f32817d2000 20 client.7947 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:04.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f32817d2000 1 --2- 172.21.15.103:0/3658273614 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x562706ae3900 0x562706ae5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f32817d2000 4 client.7947 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:45:04.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f32817d2000 1 -- 172.21.15.103:0/3658273614 --> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627068e7ae0 con 0x562706ae3900 2024-09-10T22:45:04.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3277400640 1 --2- 172.21.15.103:0/3658273614 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x562706ae3900 0x562706ae5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3264c00640 10 client.7947 ms_handle_connect on v2:172.21.15.103:6832/3251348074 2024-09-10T22:45:04.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.469+0000 7f3277400640 1 --2- 172.21.15.103:0/3658273614 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x562706ae3900 0x562706ae5cf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d4c093df8b5987d3 server_cookie=6ac8ccbe9ed26058 in_seq=0 out_seq=0 2024-09-10T22:45:04.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.473+0000 7f3264c00640 1 -- 172.21.15.103:0/3658273614 <== mds.1 v2:172.21.15.103:6832/3251348074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5627068e7ae0 con 0x562706ae3900 2024-09-10T22:45:04.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.473+0000 7f3264c00640 10 client.7947 handle_command_reply: tid=0 2024-09-10T22:45:04.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.473+0000 7f32817d2000 1 client.7947 shutdown 2024-09-10T22:45:04.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.473+0000 7f32817d2000 1 -- 172.21.15.103:0/3658273614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad4ac0 msgr2=0x562706adbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.473+0000 7f32817d2000 1 --2- 172.21.15.103:0/3658273614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad4ac0 0x562706adbfb0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f32780d0120 tx=0x7f3270013820 comp rx=0 tx=0).stop 2024-09-10T22:45:04.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.473+0000 7f32817d2000 1 -- 172.21.15.103:0/3658273614 shutdown_connections 2024-09-10T22:45:04.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.473+0000 7f32817d2000 1 --2- 172.21.15.103:0/3658273614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad4ac0 0x562706adbfb0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.473+0000 7f32817d2000 1 --2- 172.21.15.103:0/3658273614 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x562706ae3900 0x562706ae5cf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.473+0000 7f32817d2000 1 --2- 172.21.15.103:0/3658273614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706ad41a0 0x562706adba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.473+0000 7f3264c00640 0 client.7947 ms_handle_reset on v2:172.21.15.103:6832/3251348074 2024-09-10T22:45:04.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.473+0000 7f32817d2000 1 --2- 172.21.15.103:0/3658273614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706a8abc0 0x562706adb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.473+0000 7f32817d2000 1 -- 172.21.15.103:0/3658273614 >> 172.21.15.103:0/3658273614 conn(0x562706a90d20 msgr2=0x562706a88f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.473+0000 7f32817d2000 1 -- 172.21.15.103:0/3658273614 shutdown_connections 2024-09-10T22:45:04.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.473+0000 7f32817d2000 1 -- 172.21.15.103:0/3658273614 wait complete. 2024-09-10T22:45:04.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.473+0000 7f32817d2000 20 client.7947 trim_cache size 0 max 16384 2024-09-10T22:45:04.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.489+0000 7f32817d2000 1 Processor -- start 2024-09-10T22:45:04.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.489+0000 7f32817d2000 1 -- start start 2024-09-10T22:45:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.489+0000 7f32817d2000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706a8abc0 0x562706a8bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.489+0000 7f32817d2000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706ad41a0 0x562706a8c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.489+0000 7f32817d2000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706ad4ac0 0x562706ade550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.489+0000 7f32817d2000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3278201f30 con 0x562706a8abc0 2024-09-10T22:45:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.489+0000 7f32817d2000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f32782010d0 con 0x562706ad41a0 2024-09-10T22:45:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.489+0000 7f32817d2000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3278201800 con 0x562706ad4ac0 2024-09-10T22:45:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f3277400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706a8abc0 0x562706a8bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f3277400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706a8abc0 0x562706a8bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41002/0 (socket says 172.21.15.103:41002) 2024-09-10T22:45:04.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f3277400640 1 -- 172.21.15.103:0/2068193899 learned_addr learned my addr 172.21.15.103:0/2068193899 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f3277400640 1 -- 172.21.15.103:0/2068193899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706ad4ac0 msgr2=0x562706ade550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f3277e00640 1 --2- 172.21.15.103:0/2068193899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706ad4ac0 0x562706ade550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f3277400640 1 --2- 172.21.15.103:0/2068193899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706ad4ac0 0x562706ade550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f326ea00640 1 --2- 172.21.15.103:0/2068193899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706ad41a0 0x562706a8c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f3277400640 1 -- 172.21.15.103:0/2068193899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706ad41a0 msgr2=0x562706a8c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f3277400640 1 --2- 172.21.15.103:0/2068193899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706ad41a0 0x562706a8c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f3277400640 1 -- 172.21.15.103:0/2068193899 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562706932660 con 0x562706a8abc0 2024-09-10T22:45:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f3277e00640 1 --2- 172.21.15.103:0/2068193899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706ad4ac0 0x562706ade550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f326ea00640 1 --2- 172.21.15.103:0/2068193899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706ad41a0 0x562706a8c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f3277400640 1 --2- 172.21.15.103:0/2068193899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706a8abc0 0x562706a8bfb0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f326801d000 tx=0x7f3268029040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9854a484d8aa053e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f3267400640 1 -- 172.21.15.103:0/2068193899 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3268027620 con 0x562706a8abc0 2024-09-10T22:45:04.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f3267400640 1 -- 172.21.15.103:0/2068193899 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3268033070 con 0x562706a8abc0 2024-09-10T22:45:04.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f3267400640 1 -- 172.21.15.103:0/2068193899 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3268027a40 con 0x562706a8abc0 2024-09-10T22:45:04.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f32817d2000 1 -- 172.21.15.103:0/2068193899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706a8abc0 msgr2=0x562706a8bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f32817d2000 1 --2- 172.21.15.103:0/2068193899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706a8abc0 0x562706a8bfb0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f326801d000 tx=0x7f3268029040 comp rx=0 tx=0).stop 2024-09-10T22:45:04.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f32817d2000 1 -- 172.21.15.103:0/2068193899 shutdown_connections 2024-09-10T22:45:04.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f32817d2000 1 --2- 172.21.15.103:0/2068193899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706ad4ac0 0x562706ade550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f32817d2000 1 --2- 172.21.15.103:0/2068193899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706ad41a0 0x562706a8c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f32817d2000 1 --2- 172.21.15.103:0/2068193899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706a8abc0 0x562706a8bfb0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f32817d2000 1 -- 172.21.15.103:0/2068193899 >> 172.21.15.103:0/2068193899 conn(0x562706a90d20 msgr2=0x562706a8a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f32817d2000 1 -- 172.21.15.103:0/2068193899 shutdown_connections 2024-09-10T22:45:04.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f32817d2000 1 -- 172.21.15.103:0/2068193899 wait complete. 2024-09-10T22:45:04.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f32817d2000 1 -- start start 2024-09-10T22:45:04.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f32817d2000 1 Processor -- start 2024-09-10T22:45:04.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f32817d2000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706a8abc0 0x562706ae1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f32817d2000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad41a0 0x562706ae1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f32817d2000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706ad4ac0 0x562706b06210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f32817d2000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562706a93d40 con 0x562706ad41a0 2024-09-10T22:45:04.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f32817d2000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562706a91100 con 0x562706ad4ac0 2024-09-10T22:45:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f32817d2000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5627068cfec0 con 0x562706a8abc0 2024-09-10T22:45:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f32817d2000 10 client.0 _ll_register_callbacks cb 0x7f32700015a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f326ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad41a0 0x562706ae1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f326ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad41a0 0x562706ae1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41010/0 (socket says 172.21.15.103:41010) 2024-09-10T22:45:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f326ea00640 1 -- 172.21.15.103:0/3945405281 learned_addr learned my addr 172.21.15.103:0/3945405281 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f3277400640 1 --2- 172.21.15.103:0/3945405281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706a8abc0 0x562706ae1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.493+0000 7f3277e00640 1 --2- 172.21.15.103:0/3945405281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706ad4ac0 0x562706b06210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f326ea00640 1 -- 172.21.15.103:0/3945405281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706a8abc0 msgr2=0x562706ae1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f326ea00640 1 --2- 172.21.15.103:0/3945405281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706a8abc0 0x562706ae1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f326ea00640 1 -- 172.21.15.103:0/3945405281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706ad4ac0 msgr2=0x562706b06210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f326ea00640 1 --2- 172.21.15.103:0/3945405281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706ad4ac0 0x562706b06210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f326ea00640 1 -- 172.21.15.103:0/3945405281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56270689f090 con 0x562706ad41a0 2024-09-10T22:45:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f326ea00640 1 --2- 172.21.15.103:0/3945405281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad41a0 0x562706ae1aa0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f32600f7ca0 tx=0x7f326001b360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df69c33f337f6483 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f3264c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f3264c00640 1 -- 172.21.15.103:0/3945405281 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32600f7480 con 0x562706ad41a0 2024-09-10T22:45:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f3264c00640 1 -- 172.21.15.103:0/3945405281 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f32600f3660 con 0x562706ad41a0 2024-09-10T22:45:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 1 -- 172.21.15.103:0/3945405281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3268033070 con 0x562706ad41a0 2024-09-10T22:45:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f3264c00640 1 -- 172.21.15.103:0/3945405281 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f3260121050 con 0x562706ad41a0 2024-09-10T22:45:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 10 client.7953 fetch_fsmap learned FSMap version 99 2024-09-10T22:45:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 1 -- 172.21.15.103:0/3945405281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) -- 0x56270686b5f0 con 0x562706ad41a0 2024-09-10T22:45:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f3264c00640 1 -- 172.21.15.103:0/3945405281 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3268033070 con 0x562706ad41a0 2024-09-10T22:45:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f3264c00640 1 -- 172.21.15.103:0/3945405281 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 99) ==== 3558+0+0 (secure 0 0 0) 0x7f32600b6020 con 0x562706ad41a0 2024-09-10T22:45:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 10 client.7953 fetch_fsmap finished waiting for FSMap version 99 2024-09-10T22:45:04.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 10 client.7953 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.a 2024-09-10T22:45:04.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 20 client.7953 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:04.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 1 --2- 172.21.15.103:0/3945405281 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x562706b06c00 0x562706b49c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 4 client.7953 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:45:04.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 1 -- 172.21.15.103:0/3945405281 --> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5627068e3590 con 0x562706b06c00 2024-09-10T22:45:04.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f3277400640 1 --2- 172.21.15.103:0/3945405281 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x562706b06c00 0x562706b49c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f3277400640 1 --2- 172.21.15.103:0/3945405281 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x562706b06c00 0x562706b49c70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4d5b81952fc40a04 server_cookie=7c6e106e4a3b1352 in_seq=0 out_seq=0 2024-09-10T22:45:04.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f3264c00640 10 client.7953 ms_handle_connect on v2:172.21.15.103:6832/3251348074 2024-09-10T22:45:04.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f3264c00640 1 -- 172.21.15.103:0/3945405281 <== mds.1 v2:172.21.15.103:6832/3251348074 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x5627068e3590 con 0x562706b06c00 2024-09-10T22:45:04.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f3264c00640 10 client.7953 handle_command_reply: tid=0 2024-09-10T22:45:04.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 1 client.7953 shutdown 2024-09-10T22:45:04.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 1 -- 172.21.15.103:0/3945405281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad41a0 msgr2=0x562706ae1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 1 --2- 172.21.15.103:0/3945405281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad41a0 0x562706ae1aa0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f32600f7ca0 tx=0x7f326001b360 comp rx=0 tx=0).stop 2024-09-10T22:45:04.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 1 -- 172.21.15.103:0/3945405281 shutdown_connections 2024-09-10T22:45:04.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 1 --2- 172.21.15.103:0/3945405281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562706ad4ac0 0x562706b06210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 1 --2- 172.21.15.103:0/3945405281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562706ad41a0 0x562706ae1aa0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 1 --2- 172.21.15.103:0/3945405281 >> [v2:172.21.15.103:6832/3251348074,v1:172.21.15.103:6834/3251348074] conn(0x562706b06c00 0x562706b49c70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 1 --2- 172.21.15.103:0/3945405281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562706a8abc0 0x562706ae1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 1 -- 172.21.15.103:0/3945405281 >> 172.21.15.103:0/3945405281 conn(0x562706a90d20 msgr2=0x562706a8afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f3264c00640 0 client.7953 ms_handle_reset on v2:172.21.15.103:6832/3251348074 2024-09-10T22:45:04.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 1 -- 172.21.15.103:0/3945405281 shutdown_connections 2024-09-10T22:45:04.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 1 -- 172.21.15.103:0/3945405281 wait complete. 2024-09-10T22:45:04.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f32817d2000 20 client.7953 trim_cache size 0 max 16384 2024-09-10T22:45:04.509 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:45:04.509 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:45:04.509 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:45:04.509 INFO:teuthology.orchestra.run.smithi103.stdout: "118e1155-7244-4d9c-9fab-dbfc720435a1": { 2024-09-10T22:45:04.509 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:45:04.509 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "118e1155-7244-4d9c-9fab-dbfc720435a1", 2024-09-10T22:45:04.509 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:45:04.510 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:04.510 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:04.510 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:45:04.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f327e400640 1 -- 172.21.15.103:0/1270208910 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f32540725e0 msgr2=0x7f3254074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f327e400640 1 --2- 172.21.15.103:0/1270208910 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f32540725e0 0x7f3254074aa0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3278052890 tx=0x7f326800b260 comp rx=0 tx=0).stop 2024-09-10T22:45:04.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f327e400640 1 -- 172.21.15.103:0/1270208910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3278142d50 msgr2=0x7f32780a9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f327e400640 1 --2- 172.21.15.103:0/1270208910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3278142d50 0x7f32780a9450 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f3260006040 tx=0x7f3260003f80 comp rx=0 tx=0).stop 2024-09-10T22:45:04.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f327e400640 1 -- 172.21.15.103:0/1270208910 shutdown_connections 2024-09-10T22:45:04.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f327e400640 1 --2- 172.21.15.103:0/1270208910 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f32540725e0 0x7f3254074aa0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f327e400640 1 --2- 172.21.15.103:0/1270208910 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32780aca40 0x7f32780acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f327e400640 1 --2- 172.21.15.103:0/1270208910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3278142d50 0x7f32780a9450 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f327e400640 1 --2- 172.21.15.103:0/1270208910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f325c004810 0x7f3278158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f327e400640 1 -- 172.21.15.103:0/1270208910 >> 172.21.15.103:0/1270208910 conn(0x7f327806cc00 msgr2=0x7f32781e83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f327e400640 1 -- 172.21.15.103:0/1270208910 shutdown_connections 2024-09-10T22:45:04.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.497+0000 7f327e400640 1 -- 172.21.15.103:0/1270208910 wait complete. 2024-09-10T22:45:04.521 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:45:04.521 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:45:04.521 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.6:2 scrub status 2024-09-10T22:45:04.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.661+0000 7fa6a6400640 1 -- 172.21.15.103:0/2068902786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a006cc00 msgr2=0x7fa6a006cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.661+0000 7fa6a6400640 1 --2- 172.21.15.103:0/2068902786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a006cc00 0x7fa6a006cfe0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0072f90 tx=0x7fa69001cc60 comp rx=0 tx=0).stop 2024-09-10T22:45:04.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.661+0000 7fa6a6400640 1 -- 172.21.15.103:0/2068902786 shutdown_connections 2024-09-10T22:45:04.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.661+0000 7fa6a6400640 1 --2- 172.21.15.103:0/2068902786 >> v2:172.21.15.131:3300/0 conn(0x7fa6a0071be0 0x7fa6a00cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.661+0000 7fa6a6400640 1 --2- 172.21.15.103:0/2068902786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6a00d1460 0x7fa6a00cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.661+0000 7fa6a6400640 1 --2- 172.21.15.103:0/2068902786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a006cc00 0x7fa6a006cfe0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.661+0000 7fa6a6400640 1 -- 172.21.15.103:0/2068902786 >> 172.21.15.103:0/2068902786 conn(0x7fa6a00d0940 msgr2=0x7fa6a00d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.661+0000 7fa6a6400640 1 -- 172.21.15.103:0/2068902786 shutdown_connections 2024-09-10T22:45:04.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.661+0000 7fa6a6400640 1 -- 172.21.15.103:0/2068902786 wait complete. 2024-09-10T22:45:04.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.661+0000 7fa6a6400640 1 Processor -- start 2024-09-10T22:45:04.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa6a6400640 1 -- start start 2024-09-10T22:45:04.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa6a6400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6a006cc00 0x7fa6a0141470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa6a6400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a0071be0 0x7fa6a01ff990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa6a6400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6a00d1460 0x7fa6a0070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa6a6400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a0167890 con 0x7fa6a0071be0 2024-09-10T22:45:04.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa6a6400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a0167710 con 0x7fa6a006cc00 2024-09-10T22:45:04.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa6a6400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a0167a10 con 0x7fa6a00d1460 2024-09-10T22:45:04.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa69ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a0071be0 0x7fa6a01ff990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa69ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a0071be0 0x7fa6a01ff990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41034/0 (socket says 172.21.15.103:41034) 2024-09-10T22:45:04.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa69ea00640 1 -- 172.21.15.103:0/1871858522 learned_addr learned my addr 172.21.15.103:0/1871858522 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa69f400640 1 --2- 172.21.15.103:0/1871858522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6a006cc00 0x7fa6a0141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa69fe00640 1 --2- 172.21.15.103:0/1871858522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6a00d1460 0x7fa6a0070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa69ea00640 1 -- 172.21.15.103:0/1871858522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6a00d1460 msgr2=0x7fa6a0070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa69ea00640 1 --2- 172.21.15.103:0/1871858522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6a00d1460 0x7fa6a0070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa69ea00640 1 -- 172.21.15.103:0/1871858522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6a006cc00 msgr2=0x7fa6a0141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa69ea00640 1 --2- 172.21.15.103:0/1871858522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6a006cc00 0x7fa6a0141470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa69ea00640 1 -- 172.21.15.103:0/1871858522 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a006f5d0 con 0x7fa6a0071be0 2024-09-10T22:45:04.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa69ea00640 1 --2- 172.21.15.103:0/1871858522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a0071be0 0x7fa6a01ff990 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00c970 tx=0x7fa68c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa697400640 1 -- 172.21.15.103:0/1871858522 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c014070 con 0x7fa6a0071be0 2024-09-10T22:45:04.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa697400640 1 -- 172.21.15.103:0/1871858522 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa68c0077a0 con 0x7fa6a0071be0 2024-09-10T22:45:04.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa6a6400640 1 -- 172.21.15.103:0/1871858522 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a00b5970 con 0x7fa6a0071be0 2024-09-10T22:45:04.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa697400640 1 -- 172.21.15.103:0/1871858522 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c007bf0 con 0x7fa6a0071be0 2024-09-10T22:45:04.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.665+0000 7fa6a6400640 1 -- 172.21.15.103:0/1871858522 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a01fc230 con 0x7fa6a0071be0 2024-09-10T22:45:04.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.669+0000 7fa697400640 1 -- 172.21.15.103:0/1871858522 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa68c003600 con 0x7fa6a0071be0 2024-09-10T22:45:04.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.669+0000 7fa697400640 1 --2- 172.21.15.103:0/1871858522 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6800725e0 0x7fa680074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.669+0000 7fa697400640 1 -- 172.21.15.103:0/1871858522 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fa68c0939e0 con 0x7fa6a0071be0 2024-09-10T22:45:04.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.669+0000 7fa6a9739000 1 Processor -- start 2024-09-10T22:45:04.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.669+0000 7fa6a9739000 1 -- start start 2024-09-10T22:45:04.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.669+0000 7fa69f400640 1 --2- 172.21.15.103:0/1871858522 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6800725e0 0x7fa680074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.669+0000 7fa69f400640 1 --2- 172.21.15.103:0/1871858522 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6800725e0 0x7fa680074aa0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa6900af000 tx=0x7fa69001b4a0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.669+0000 7fa6a9739000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bca131a0 0x5616bca13580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.669+0000 7fa6a9739000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bca13ac0 0x5616bc9c9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.669+0000 7fa6a9739000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bc9c9bc0 0x5616bc9c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.669+0000 7fa6a9739000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5616bc8b1cb0 con 0x5616bc9c9bc0 2024-09-10T22:45:04.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.669+0000 7fa6a9739000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5616bc7c7310 con 0x5616bca13ac0 2024-09-10T22:45:04.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.669+0000 7fa6a9739000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5616bc824b90 con 0x5616bca131a0 2024-09-10T22:45:04.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.669+0000 7fa69fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bc9c9bc0 0x5616bc9c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.669+0000 7fa69f400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bca131a0 0x5616bca13580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.669+0000 7fa69fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bc9c9bc0 0x5616bc9c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41050/0 (socket says 172.21.15.103:41050) 2024-09-10T22:45:04.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.669+0000 7fa69fe00640 1 -- 172.21.15.103:0/4208610068 learned_addr learned my addr 172.21.15.103:0/4208610068 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.669+0000 7fa69ea00640 1 --2- 172.21.15.103:0/4208610068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bca13ac0 0x5616bc9c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa69f400640 1 -- 172.21.15.103:0/4208610068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bca13ac0 msgr2=0x5616bc9c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa69f400640 1 --2- 172.21.15.103:0/4208610068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bca13ac0 0x5616bc9c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa69f400640 1 -- 172.21.15.103:0/4208610068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bc9c9bc0 msgr2=0x5616bc9c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa69f400640 1 --2- 172.21.15.103:0/4208610068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bc9c9bc0 0x5616bc9c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa69f400640 1 -- 172.21.15.103:0/4208610068 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616bc7c8c60 con 0x5616bca131a0 2024-09-10T22:45:04.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa69f400640 1 --2- 172.21.15.103:0/4208610068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bca131a0 0x5616bca13580 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa6900ac000 tx=0x7fa6900b6000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb27801fcfff3d02 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa68be00640 1 -- 172.21.15.103:0/4208610068 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6900b2040 con 0x5616bca131a0 2024-09-10T22:45:04.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa68be00640 1 -- 172.21.15.103:0/4208610068 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa690004040 con 0x5616bca131a0 2024-09-10T22:45:04.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa68be00640 1 -- 172.21.15.103:0/4208610068 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa690004450 con 0x5616bca131a0 2024-09-10T22:45:04.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa6a9739000 1 -- 172.21.15.103:0/4208610068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bca131a0 msgr2=0x5616bca13580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa6a9739000 1 --2- 172.21.15.103:0/4208610068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bca131a0 0x5616bca13580 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa6900ac000 tx=0x7fa6900b6000 comp rx=0 tx=0).stop 2024-09-10T22:45:04.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa6a9739000 1 -- 172.21.15.103:0/4208610068 shutdown_connections 2024-09-10T22:45:04.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa6a9739000 1 --2- 172.21.15.103:0/4208610068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bc9c9bc0 0x5616bc9c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa6a9739000 1 --2- 172.21.15.103:0/4208610068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bca13ac0 0x5616bc9c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa6a9739000 1 --2- 172.21.15.103:0/4208610068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bca131a0 0x5616bca13580 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa6a9739000 1 -- 172.21.15.103:0/4208610068 >> 172.21.15.103:0/4208610068 conn(0x5616bc9cfd20 msgr2=0x5616bc9c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa6a9739000 1 -- 172.21.15.103:0/4208610068 shutdown_connections 2024-09-10T22:45:04.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa6a9739000 1 -- 172.21.15.103:0/4208610068 wait complete. 2024-09-10T22:45:04.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa6a9739000 1 -- start start 2024-09-10T22:45:04.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa6a9739000 1 Processor -- start 2024-09-10T22:45:04.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa6a9739000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bc9c9bc0 0x5616bca1a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa6a9739000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bca131a0 0x5616bca1aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa6a9739000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bca13ac0 0x5616bca1afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa6a9739000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5616bc817dd0 con 0x5616bc9c9bc0 2024-09-10T22:45:04.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa6a9739000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5616bc813fc0 con 0x5616bca131a0 2024-09-10T22:45:04.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa6a9739000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5616bc7b94b0 con 0x5616bca13ac0 2024-09-10T22:45:04.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa6a9739000 10 client.0 _ll_register_callbacks cb 0x5616bc7977d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:04.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa69f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bc9c9bc0 0x5616bca1a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa69f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bc9c9bc0 0x5616bca1a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41056/0 (socket says 172.21.15.103:41056) 2024-09-10T22:45:04.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa69f400640 1 -- 172.21.15.103:0/2437744936 learned_addr learned my addr 172.21.15.103:0/2437744936 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa69ea00640 1 --2- 172.21.15.103:0/2437744936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bca131a0 0x5616bca1aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.673+0000 7fa69fe00640 1 --2- 172.21.15.103:0/2437744936 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bca13ac0 0x5616bca1afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa69f400640 1 -- 172.21.15.103:0/2437744936 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bca13ac0 msgr2=0x5616bca1afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa69f400640 1 --2- 172.21.15.103:0/2437744936 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bca13ac0 0x5616bca1afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa69f400640 1 -- 172.21.15.103:0/2437744936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bca131a0 msgr2=0x5616bca1aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa69f400640 1 --2- 172.21.15.103:0/2437744936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bca131a0 0x5616bca1aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa69f400640 1 -- 172.21.15.103:0/2437744936 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616bc7b21f0 con 0x5616bc9c9bc0 2024-09-10T22:45:04.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa69f400640 1 --2- 172.21.15.103:0/2437744936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bc9c9bc0 0x5616bca1a530 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fa690009bd0 tx=0x7fa690004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a28ad73e086e934 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa688c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:04.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa688c00640 1 -- 172.21.15.103:0/2437744936 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6900b2040 con 0x5616bc9c9bc0 2024-09-10T22:45:04.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa688c00640 1 -- 172.21.15.103:0/2437744936 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fa6900cecd0 con 0x5616bc9c9bc0 2024-09-10T22:45:04.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 1 -- 172.21.15.103:0/2437744936 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5616bc7ac330 con 0x5616bc9c9bc0 2024-09-10T22:45:04.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa688c00640 1 -- 172.21.15.103:0/2437744936 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7fa6900a5e30 con 0x5616bc9c9bc0 2024-09-10T22:45:04.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 10 client.7965 fetch_fsmap learned FSMap version 99 2024-09-10T22:45:04.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 1 -- 172.21.15.103:0/2437744936 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) -- 0x5616bc798fa0 con 0x5616bc9c9bc0 2024-09-10T22:45:04.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa688c00640 1 -- 172.21.15.103:0/2437744936 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5616bc7ac330 con 0x5616bc9c9bc0 2024-09-10T22:45:04.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa688c00640 1 -- 172.21.15.103:0/2437744936 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 99) ==== 3558+0+0 (secure 0 0 0) 0x7fa690004590 con 0x5616bc9c9bc0 2024-09-10T22:45:04.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 10 client.7965 fetch_fsmap finished waiting for FSMap version 99 2024-09-10T22:45:04.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 10 client.7965 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2024-09-10T22:45:04.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 20 client.7965 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:04.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 1 --2- 172.21.15.103:0/2437744936 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5616bca22900 0x5616bca24cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 4 client.7965 mds_command: new command op to 7048 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:45:04.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 1 -- 172.21.15.103:0/2437744936 --> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616bc826ae0 con 0x5616bca22900 2024-09-10T22:45:04.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa69ea00640 1 --2- 172.21.15.103:0/2437744936 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5616bca22900 0x5616bca24cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa69ea00640 1 --2- 172.21.15.103:0/2437744936 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5616bca22900 0x5616bca24cf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d0dbabc2c867d618 server_cookie=2bcc0ffa952a7e22 in_seq=0 out_seq=0 2024-09-10T22:45:04.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa688c00640 10 client.7965 ms_handle_connect on v2:172.21.15.131:6834/1622106563 2024-09-10T22:45:04.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa688c00640 1 -- 172.21.15.103:0/2437744936 <== mds.2 v2:172.21.15.131:6834/1622106563 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5616bc826ae0 con 0x5616bca22900 2024-09-10T22:45:04.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa688c00640 10 client.7965 handle_command_reply: tid=0 2024-09-10T22:45:04.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 1 client.7965 shutdown 2024-09-10T22:45:04.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 1 -- 172.21.15.103:0/2437744936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bc9c9bc0 msgr2=0x5616bca1a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 1 --2- 172.21.15.103:0/2437744936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bc9c9bc0 0x5616bca1a530 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fa690009bd0 tx=0x7fa690004420 comp rx=0 tx=0).stop 2024-09-10T22:45:04.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 1 -- 172.21.15.103:0/2437744936 shutdown_connections 2024-09-10T22:45:04.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 1 --2- 172.21.15.103:0/2437744936 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5616bca22900 0x5616bca24cf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 1 --2- 172.21.15.103:0/2437744936 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bca13ac0 0x5616bca1afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 1 --2- 172.21.15.103:0/2437744936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bca131a0 0x5616bca1aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa688c00640 0 client.7965 ms_handle_reset on v2:172.21.15.131:6834/1622106563 2024-09-10T22:45:04.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 1 --2- 172.21.15.103:0/2437744936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bc9c9bc0 0x5616bca1a530 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 1 -- 172.21.15.103:0/2437744936 >> 172.21.15.103:0/2437744936 conn(0x5616bc9cfd20 msgr2=0x5616bc9c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 1 -- 172.21.15.103:0/2437744936 shutdown_connections 2024-09-10T22:45:04.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 1 -- 172.21.15.103:0/2437744936 wait complete. 2024-09-10T22:45:04.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.677+0000 7fa6a9739000 20 client.7965 trim_cache size 0 max 16384 2024-09-10T22:45:04.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa6a9739000 1 Processor -- start 2024-09-10T22:45:04.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa6a9739000 1 -- start start 2024-09-10T22:45:04.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa6a9739000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bc9c9bc0 0x5616bca20bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa6a9739000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bca131a0 0x5616bc9c9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa6a9739000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bca13ac0 0x5616bc9c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa6a9739000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a02089b0 con 0x5616bca131a0 2024-09-10T22:45:04.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa6a9739000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a0207b50 con 0x5616bc9c9bc0 2024-09-10T22:45:04.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa6a9739000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a0208280 con 0x5616bca13ac0 2024-09-10T22:45:04.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa69ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bca131a0 0x5616bc9c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa69ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bca131a0 0x5616bc9c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41064/0 (socket says 172.21.15.103:41064) 2024-09-10T22:45:04.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa69ea00640 1 -- 172.21.15.103:0/1135535007 learned_addr learned my addr 172.21.15.103:0/1135535007 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa69f400640 1 --2- 172.21.15.103:0/1135535007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bc9c9bc0 0x5616bca20bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa69fe00640 1 --2- 172.21.15.103:0/1135535007 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bca13ac0 0x5616bc9c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa69ea00640 1 -- 172.21.15.103:0/1135535007 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bca13ac0 msgr2=0x5616bc9c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa69ea00640 1 --2- 172.21.15.103:0/1135535007 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bca13ac0 0x5616bc9c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa69ea00640 1 -- 172.21.15.103:0/1135535007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bc9c9bc0 msgr2=0x5616bca20bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa69ea00640 1 --2- 172.21.15.103:0/1135535007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bc9c9bc0 0x5616bca20bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa69ea00640 1 -- 172.21.15.103:0/1135535007 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616bc871660 con 0x5616bca131a0 2024-09-10T22:45:04.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa69ea00640 1 --2- 172.21.15.103:0/1135535007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bca131a0 0x5616bc9c9070 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fa68c05e600 tx=0x7fa68c062040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1051c11c0d73787c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa68b400640 1 -- 172.21.15.103:0/1135535007 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c01e040 con 0x5616bca131a0 2024-09-10T22:45:04.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa68b400640 1 -- 172.21.15.103:0/1135535007 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa68c05e900 con 0x5616bca131a0 2024-09-10T22:45:04.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa68b400640 1 -- 172.21.15.103:0/1135535007 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c067cc0 con 0x5616bca131a0 2024-09-10T22:45:04.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa6a9739000 1 -- 172.21.15.103:0/1135535007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bca131a0 msgr2=0x5616bc9c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.697+0000 7fa6a9739000 1 --2- 172.21.15.103:0/1135535007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bca131a0 0x5616bc9c9070 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fa68c05e600 tx=0x7fa68c062040 comp rx=0 tx=0).stop 2024-09-10T22:45:04.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 -- 172.21.15.103:0/1135535007 shutdown_connections 2024-09-10T22:45:04.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 --2- 172.21.15.103:0/1135535007 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bca13ac0 0x5616bc9c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 --2- 172.21.15.103:0/1135535007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bca131a0 0x5616bc9c9070 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 --2- 172.21.15.103:0/1135535007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bc9c9bc0 0x5616bca20bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 -- 172.21.15.103:0/1135535007 >> 172.21.15.103:0/1135535007 conn(0x5616bc9cfd20 msgr2=0x5616bc9c8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 -- 172.21.15.103:0/1135535007 shutdown_connections 2024-09-10T22:45:04.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 -- 172.21.15.103:0/1135535007 wait complete. 2024-09-10T22:45:04.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 -- start start 2024-09-10T22:45:04.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 Processor -- start 2024-09-10T22:45:04.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bc9c9bc0 0x5616bca1ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bca131a0 0x5616bca20500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bca13ac0 0x5616bca45210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5616bc813fc0 con 0x5616bca131a0 2024-09-10T22:45:04.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5616bc80eec0 con 0x5616bca13ac0 2024-09-10T22:45:04.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5616bc9d2d40 con 0x5616bc9c9bc0 2024-09-10T22:45:04.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 10 client.0 _ll_register_callbacks cb 0x7fa69800a600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:04.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa69ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bca131a0 0x5616bca20500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa69ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bca131a0 0x5616bca20500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41072/0 (socket says 172.21.15.103:41072) 2024-09-10T22:45:04.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa69ea00640 1 -- 172.21.15.103:0/10963174 learned_addr learned my addr 172.21.15.103:0/10963174 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa69fe00640 1 --2- 172.21.15.103:0/10963174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bca13ac0 0x5616bca45210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa69f400640 1 --2- 172.21.15.103:0/10963174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bc9c9bc0 0x5616bca1ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa69ea00640 1 -- 172.21.15.103:0/10963174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bc9c9bc0 msgr2=0x5616bca1ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa69ea00640 1 --2- 172.21.15.103:0/10963174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bc9c9bc0 0x5616bca1ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa69ea00640 1 -- 172.21.15.103:0/10963174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bca13ac0 msgr2=0x5616bca45210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa69ea00640 1 --2- 172.21.15.103:0/10963174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bca13ac0 0x5616bca45210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa69ea00640 1 -- 172.21.15.103:0/10963174 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616bc7de090 con 0x5616bca131a0 2024-09-10T22:45:04.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa69f400640 1 --2- 172.21.15.103:0/10963174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bc9c9bc0 0x5616bca1ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:04.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa69ea00640 1 --2- 172.21.15.103:0/10963174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bca131a0 0x5616bca20500 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fa68c091d60 tx=0x7fa68c00a4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ee53b849bfe14 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa688c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:04.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa688c00640 1 -- 172.21.15.103:0/10963174 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c01e040 con 0x5616bca131a0 2024-09-10T22:45:04.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 -- 172.21.15.103:0/10963174 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa68c05e900 con 0x5616bca131a0 2024-09-10T22:45:04.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa688c00640 1 -- 172.21.15.103:0/10963174 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fa68c05fd80 con 0x5616bca131a0 2024-09-10T22:45:04.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa688c00640 1 -- 172.21.15.103:0/10963174 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7fa68c007e50 con 0x5616bca131a0 2024-09-10T22:45:04.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 10 client.7971 fetch_fsmap learned FSMap version 99 2024-09-10T22:45:04.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 -- 172.21.15.103:0/10963174 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) -- 0x5616bc7aa5f0 con 0x5616bca131a0 2024-09-10T22:45:04.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa688c00640 1 -- 172.21.15.103:0/10963174 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa68c05e900 con 0x5616bca131a0 2024-09-10T22:45:04.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa688c00640 1 -- 172.21.15.103:0/10963174 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 99) ==== 3558+0+0 (secure 0 0 0) 0x7fa68c05db60 con 0x5616bca131a0 2024-09-10T22:45:04.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 10 client.7971 fetch_fsmap finished waiting for FSMap version 99 2024-09-10T22:45:04.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 10 client.7971 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2024-09-10T22:45:04.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 20 client.7971 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:04.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 --2- 172.21.15.103:0/10963174 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5616bca45ba0 0x5616bca90680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 4 client.7971 mds_command: new command op to 7048 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:45:04.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.701+0000 7fa6a9739000 1 -- 172.21.15.103:0/10963174 --> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5616bc822590 con 0x5616bca45ba0 2024-09-10T22:45:04.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa69f400640 1 --2- 172.21.15.103:0/10963174 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5616bca45ba0 0x5616bca90680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa69f400640 1 --2- 172.21.15.103:0/10963174 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5616bca45ba0 0x5616bca90680 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=85ef8cb5cc41e1e4 server_cookie=5896eb0cd5e8fa3a in_seq=0 out_seq=0 2024-09-10T22:45:04.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa688c00640 10 client.7971 ms_handle_connect on v2:172.21.15.131:6834/1622106563 2024-09-10T22:45:04.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa688c00640 1 -- 172.21.15.103:0/10963174 <== mds.2 v2:172.21.15.131:6834/1622106563 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x5616bc822590 con 0x5616bca45ba0 2024-09-10T22:45:04.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa688c00640 10 client.7971 handle_command_reply: tid=0 2024-09-10T22:45:04.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a9739000 1 client.7971 shutdown 2024-09-10T22:45:04.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a9739000 1 -- 172.21.15.103:0/10963174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bca131a0 msgr2=0x5616bca20500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a9739000 1 --2- 172.21.15.103:0/10963174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bca131a0 0x5616bca20500 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fa68c091d60 tx=0x7fa68c00a4b0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a9739000 1 -- 172.21.15.103:0/10963174 shutdown_connections 2024-09-10T22:45:04.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a9739000 1 --2- 172.21.15.103:0/10963174 >> [v2:172.21.15.131:6834/1622106563,v1:172.21.15.131:6836/1622106563] conn(0x5616bca45ba0 0x5616bca90680 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a9739000 1 --2- 172.21.15.103:0/10963174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bca13ac0 0x5616bca45210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a9739000 1 --2- 172.21.15.103:0/10963174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616bca131a0 0x5616bca20500 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa688c00640 0 client.7971 ms_handle_reset on v2:172.21.15.131:6834/1622106563 2024-09-10T22:45:04.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a9739000 1 --2- 172.21.15.103:0/10963174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616bc9c9bc0 0x5616bca1ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a9739000 1 -- 172.21.15.103:0/10963174 >> 172.21.15.103:0/10963174 conn(0x5616bc9cfd20 msgr2=0x5616bc9c9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a9739000 1 -- 172.21.15.103:0/10963174 shutdown_connections 2024-09-10T22:45:04.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a9739000 1 -- 172.21.15.103:0/10963174 wait complete. 2024-09-10T22:45:04.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a9739000 20 client.7971 trim_cache size 0 max 16384 2024-09-10T22:45:04.714 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:45:04.714 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:45:04.714 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:45:04.715 INFO:teuthology.orchestra.run.smithi103.stdout: "118e1155-7244-4d9c-9fab-dbfc720435a1": { 2024-09-10T22:45:04.715 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:45:04.715 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "118e1155-7244-4d9c-9fab-dbfc720435a1", 2024-09-10T22:45:04.715 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:45:04.715 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:04.715 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:04.715 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:45:04.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a6400640 1 -- 172.21.15.103:0/1871858522 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6800725e0 msgr2=0x7fa680074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a6400640 1 --2- 172.21.15.103:0/1871858522 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6800725e0 0x7fa680074aa0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa6900af000 tx=0x7fa69001b4a0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a6400640 1 -- 172.21.15.103:0/1871858522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a0071be0 msgr2=0x7fa6a01ff990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a6400640 1 --2- 172.21.15.103:0/1871858522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a0071be0 0x7fa6a01ff990 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00c970 tx=0x7fa68c00ce30 comp rx=0 tx=0).stop 2024-09-10T22:45:04.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a6400640 1 -- 172.21.15.103:0/1871858522 shutdown_connections 2024-09-10T22:45:04.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a6400640 1 --2- 172.21.15.103:0/1871858522 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa6800725e0 0x7fa680074aa0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a6400640 1 --2- 172.21.15.103:0/1871858522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6a00d1460 0x7fa6a0070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a6400640 1 --2- 172.21.15.103:0/1871858522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a0071be0 0x7fa6a01ff990 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a6400640 1 --2- 172.21.15.103:0/1871858522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6a006cc00 0x7fa6a0141470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a6400640 1 -- 172.21.15.103:0/1871858522 >> 172.21.15.103:0/1871858522 conn(0x7fa6a00d0940 msgr2=0x7fa6a00b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a6400640 1 -- 172.21.15.103:0/1871858522 shutdown_connections 2024-09-10T22:45:04.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.705+0000 7fa6a6400640 1 -- 172.21.15.103:0/1871858522 wait complete. 2024-09-10T22:45:04.727 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:45:04.728 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:45:04.728 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.6:0 scrub status 2024-09-10T22:45:04.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e83200640 1 -- 172.21.15.103:0/3993205604 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1e8406c5b0 msgr2=0x7f1e840ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e83200640 1 --2- 172.21.15.103:0/3993205604 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1e8406c5b0 0x7f1e840ce0b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009870 tx=0x7f1e6c01c860 comp rx=0 tx=0).stop 2024-09-10T22:45:04.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e83200640 1 -- 172.21.15.103:0/3993205604 shutdown_connections 2024-09-10T22:45:04.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e83200640 1 --2- 172.21.15.103:0/3993205604 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1e8406c5b0 0x7f1e840ce0b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e83200640 1 -- 172.21.15.103:0/3993205604 >> 172.21.15.103:0/3993205604 conn(0x7f1e840cfad0 msgr2=0x7f1e840cfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e83200640 1 -- 172.21.15.103:0/3993205604 shutdown_connections 2024-09-10T22:45:04.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e83200640 1 -- 172.21.15.103:0/3993205604 wait complete. 2024-09-10T22:45:04.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e83200640 1 Processor -- start 2024-09-10T22:45:04.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e83200640 1 -- start start 2024-09-10T22:45:04.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e83200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e8406c5b0 0x7f1e84151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e83200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e8406ff00 0x7f1e841520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e83200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1e840ca380 0x7f1e840c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e83200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1e84168e90 con 0x7f1e8406c5b0 2024-09-10T22:45:04.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e83200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1e84168d10 con 0x7f1e8406ff00 2024-09-10T22:45:04.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e83200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1e84169010 con 0x7f1e840ca380 2024-09-10T22:45:04.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e81e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e8406c5b0 0x7f1e84151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e81e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e8406c5b0 0x7f1e84151b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41074/0 (socket says 172.21.15.103:41074) 2024-09-10T22:45:04.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e81e00640 1 -- 172.21.15.103:0/3583432406 learned_addr learned my addr 172.21.15.103:0/3583432406 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e79400640 1 --2- 172.21.15.103:0/3583432406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e8406ff00 0x7f1e841520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e82800640 1 --2- 172.21.15.103:0/3583432406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1e840ca380 0x7f1e840c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e81e00640 1 -- 172.21.15.103:0/3583432406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1e840ca380 msgr2=0x7f1e840c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e81e00640 1 --2- 172.21.15.103:0/3583432406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1e840ca380 0x7f1e840c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e81e00640 1 -- 172.21.15.103:0/3583432406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e8406ff00 msgr2=0x7f1e841520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e81e00640 1 --2- 172.21.15.103:0/3583432406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e8406ff00 0x7f1e841520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.869+0000 7f1e81e00640 1 -- 172.21.15.103:0/3583432406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e840c7fd0 con 0x7f1e8406c5b0 2024-09-10T22:45:04.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.873+0000 7f1e81e00640 1 --2- 172.21.15.103:0/3583432406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e8406c5b0 0x7f1e84151b30 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400c400 tx=0x7f1e7400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.873+0000 7f1e7aa00640 1 -- 172.21.15.103:0/3583432406 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e74017070 con 0x7f1e8406c5b0 2024-09-10T22:45:04.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.873+0000 7f1e7aa00640 1 -- 172.21.15.103:0/3583432406 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e74005400 con 0x7f1e8406c5b0 2024-09-10T22:45:04.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.873+0000 7f1e7aa00640 1 -- 172.21.15.103:0/3583432406 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e74003860 con 0x7f1e8406c5b0 2024-09-10T22:45:04.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.873+0000 7f1e83200640 1 -- 172.21.15.103:0/3583432406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e840c82b0 con 0x7f1e8406c5b0 2024-09-10T22:45:04.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.873+0000 7f1e83200640 1 -- 172.21.15.103:0/3583432406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e840c6cd0 con 0x7f1e8406c5b0 2024-09-10T22:45:04.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.873+0000 7f1e7aa00640 1 -- 172.21.15.103:0/3583432406 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1e74003a00 con 0x7f1e8406c5b0 2024-09-10T22:45:04.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.873+0000 7f1e7aa00640 1 --2- 172.21.15.103:0/3583432406 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1e600725e0 0x7f1e60074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.873+0000 7f1e7aa00640 1 -- 172.21.15.103:0/3583432406 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f1e74092ac0 con 0x7f1e8406c5b0 2024-09-10T22:45:04.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.873+0000 7f1e79400640 1 --2- 172.21.15.103:0/3583432406 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1e600725e0 0x7f1e60074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.873+0000 7f1e8c14c000 1 Processor -- start 2024-09-10T22:45:04.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e8c14c000 1 -- start start 2024-09-10T22:45:04.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e79400640 1 --2- 172.21.15.103:0/3583432406 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1e600725e0 0x7f1e60074aa0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0af000 tx=0x7f1e6c01b0a0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e8c14c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e48143600 0x559e481439e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e8c14c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e48143f20 0x559e480f9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e8c14c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e480f9fd0 0x559e480fa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e8c14c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559e47fddcb0 con 0x559e480f9fd0 2024-09-10T22:45:04.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e8c14c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559e47ef3310 con 0x559e48143f20 2024-09-10T22:45:04.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e8c14c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x559e47f50b90 con 0x559e48143600 2024-09-10T22:45:04.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e82800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e480f9fd0 0x559e480fa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e82800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e480f9fd0 0x559e480fa3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41088/0 (socket says 172.21.15.103:41088) 2024-09-10T22:45:04.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e82800640 1 -- 172.21.15.103:0/231675459 learned_addr learned my addr 172.21.15.103:0/231675459 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e79400640 1 --2- 172.21.15.103:0/231675459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e48143f20 0x559e480f9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e81e00640 1 --2- 172.21.15.103:0/231675459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e48143600 0x559e481439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e82800640 1 -- 172.21.15.103:0/231675459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e48143600 msgr2=0x559e481439e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e82800640 1 --2- 172.21.15.103:0/231675459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e48143600 0x559e481439e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e82800640 1 -- 172.21.15.103:0/231675459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e48143f20 msgr2=0x559e480f9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e82800640 1 --2- 172.21.15.103:0/231675459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e48143f20 0x559e480f9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e82800640 1 -- 172.21.15.103:0/231675459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e47ef4c60 con 0x559e480f9fd0 2024-09-10T22:45:04.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e82800640 1 --2- 172.21.15.103:0/231675459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e480f9fd0 0x559e480fa3b0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c002020 tx=0x7f1e7c002110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d8b1cc119f241b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e72a00640 1 -- 172.21.15.103:0/231675459 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c004a50 con 0x559e480f9fd0 2024-09-10T22:45:04.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e72a00640 1 -- 172.21.15.103:0/231675459 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e7c004ce0 con 0x559e480f9fd0 2024-09-10T22:45:04.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e72a00640 1 -- 172.21.15.103:0/231675459 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c00ea40 con 0x559e480f9fd0 2024-09-10T22:45:04.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e8c14c000 1 -- 172.21.15.103:0/231675459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e480f9fd0 msgr2=0x559e480fa3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/231675459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e480f9fd0 0x559e480fa3b0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c002020 tx=0x7f1e7c002110 comp rx=0 tx=0).stop 2024-09-10T22:45:04.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e8c14c000 1 -- 172.21.15.103:0/231675459 shutdown_connections 2024-09-10T22:45:04.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/231675459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e480f9fd0 0x559e480fa3b0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/231675459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e48143f20 0x559e480f9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/231675459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e48143600 0x559e481439e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e8c14c000 1 -- 172.21.15.103:0/231675459 >> 172.21.15.103:0/231675459 conn(0x559e480fbd20 msgr2=0x559e480f3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e8c14c000 1 -- 172.21.15.103:0/231675459 shutdown_connections 2024-09-10T22:45:04.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e8c14c000 1 -- 172.21.15.103:0/231675459 wait complete. 2024-09-10T22:45:04.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e8c14c000 1 -- start start 2024-09-10T22:45:04.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.877+0000 7f1e8c14c000 1 Processor -- start 2024-09-10T22:45:04.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e8c14c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e480f9fd0 0x559e4812d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e8c14c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e48143600 0x559e4812df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e8c14c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e48143f20 0x559e4812e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e8c14c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559e47f43dd0 con 0x559e48143600 2024-09-10T22:45:04.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e8c14c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559e47f3ffc0 con 0x559e48143f20 2024-09-10T22:45:04.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e8c14c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x559e47ee54b0 con 0x559e480f9fd0 2024-09-10T22:45:04.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e8c14c000 10 client.0 _ll_register_callbacks cb 0x559e47ec37d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:04.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e79400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e48143600 0x559e4812df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e79400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e48143600 0x559e4812df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41094/0 (socket says 172.21.15.103:41094) 2024-09-10T22:45:04.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e79400640 1 -- 172.21.15.103:0/711174794 learned_addr learned my addr 172.21.15.103:0/711174794 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e81e00640 1 --2- 172.21.15.103:0/711174794 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e480f9fd0 0x559e4812d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e82800640 1 --2- 172.21.15.103:0/711174794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e48143f20 0x559e4812e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e79400640 1 -- 172.21.15.103:0/711174794 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e480f9fd0 msgr2=0x559e4812d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e79400640 1 --2- 172.21.15.103:0/711174794 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e480f9fd0 0x559e4812d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e79400640 1 -- 172.21.15.103:0/711174794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e48143f20 msgr2=0x559e4812e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e79400640 1 --2- 172.21.15.103:0/711174794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e48143f20 0x559e4812e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e79400640 1 -- 172.21.15.103:0/711174794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e47ede1f0 con 0x559e48143600 2024-09-10T22:45:04.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e79400640 1 --2- 172.21.15.103:0/711174794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e48143600 0x559e4812df00 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009870 tx=0x7f1e6c0091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3adec37d052eeb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e67400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:04.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e67400640 1 -- 172.21.15.103:0/711174794 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c0c9020 con 0x559e48143600 2024-09-10T22:45:04.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e8c14c000 1 -- 172.21.15.103:0/711174794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559e47ed8330 con 0x559e48143600 2024-09-10T22:45:04.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e67400640 1 -- 172.21.15.103:0/711174794 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f1e6c0048d0 con 0x559e48143600 2024-09-10T22:45:04.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e67400640 1 -- 172.21.15.103:0/711174794 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f1e6c0d3050 con 0x559e48143600 2024-09-10T22:45:04.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e8c14c000 10 client.7983 fetch_fsmap learned FSMap version 99 2024-09-10T22:45:04.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e8c14c000 1 -- 172.21.15.103:0/711174794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) -- 0x559e47ec4fa0 con 0x559e48143600 2024-09-10T22:45:04.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e67400640 1 -- 172.21.15.103:0/711174794 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x559e47ed8330 con 0x559e48143600 2024-09-10T22:45:04.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e67400640 1 -- 172.21.15.103:0/711174794 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 99) ==== 3558+0+0 (secure 0 0 0) 0x7f1e6c0d6020 con 0x559e48143600 2024-09-10T22:45:04.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e8c14c000 10 client.7983 fetch_fsmap finished waiting for FSMap version 99 2024-09-10T22:45:04.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e8c14c000 10 client.7983 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-10T22:45:04.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e8c14c000 20 client.7983 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:04.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/711174794 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x559e4812ee50 0x559e481548b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e8c14c000 4 client.7983 mds_command: new command op to 7434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:45:04.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e8c14c000 1 -- 172.21.15.103:0/711174794 --> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e47f52ae0 con 0x559e4812ee50 2024-09-10T22:45:04.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e81e00640 1 --2- 172.21.15.103:0/711174794 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x559e4812ee50 0x559e481548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e67400640 10 client.7983 ms_handle_connect on v2:172.21.15.103:6833/187627880 2024-09-10T22:45:04.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e81e00640 1 --2- 172.21.15.103:0/711174794 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x559e4812ee50 0x559e481548b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd1dc4bb864a3396 server_cookie=301d0d36462969e8 in_seq=0 out_seq=0 2024-09-10T22:45:04.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e67400640 1 -- 172.21.15.103:0/711174794 <== mds.0 v2:172.21.15.103:6833/187627880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559e47f52ae0 con 0x559e4812ee50 2024-09-10T22:45:04.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e67400640 10 client.7983 handle_command_reply: tid=0 2024-09-10T22:45:04.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.881+0000 7f1e8c14c000 1 client.7983 shutdown 2024-09-10T22:45:04.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.885+0000 7f1e8c14c000 1 -- 172.21.15.103:0/711174794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e48143600 msgr2=0x559e4812df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.885+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/711174794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e48143600 0x559e4812df00 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009870 tx=0x7f1e6c0091e0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.885+0000 7f1e8c14c000 1 -- 172.21.15.103:0/711174794 shutdown_connections 2024-09-10T22:45:04.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.885+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/711174794 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x559e4812ee50 0x559e481548b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.885+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/711174794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e48143f20 0x559e4812e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.885+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/711174794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e48143600 0x559e4812df00 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.885+0000 7f1e67400640 0 client.7983 ms_handle_reset on v2:172.21.15.103:6833/187627880 2024-09-10T22:45:04.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.885+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/711174794 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e480f9fd0 0x559e4812d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.885+0000 7f1e8c14c000 1 -- 172.21.15.103:0/711174794 >> 172.21.15.103:0/711174794 conn(0x559e480fbd20 msgr2=0x559e480fb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.885+0000 7f1e8c14c000 1 -- 172.21.15.103:0/711174794 shutdown_connections 2024-09-10T22:45:04.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.885+0000 7f1e8c14c000 1 -- 172.21.15.103:0/711174794 wait complete. 2024-09-10T22:45:04.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.885+0000 7f1e8c14c000 20 client.7983 trim_cache size 0 max 16384 2024-09-10T22:45:04.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.901+0000 7f1e8c14c000 1 Processor -- start 2024-09-10T22:45:04.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.901+0000 7f1e8c14c000 1 -- start start 2024-09-10T22:45:04.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.901+0000 7f1e8c14c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e480f9fd0 0x559e481b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.901+0000 7f1e8c14c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e48143600 0x559e481b6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.901+0000 7f1e8c14c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e48143f20 0x559e481b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.901+0000 7f1e8c14c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1e84200330 con 0x559e480f9fd0 2024-09-10T22:45:04.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.901+0000 7f1e8c14c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1e840b4440 con 0x559e48143f20 2024-09-10T22:45:04.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.901+0000 7f1e8c14c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1e841ffcb0 con 0x559e48143600 2024-09-10T22:45:04.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.901+0000 7f1e81e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e480f9fd0 0x559e481b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.901+0000 7f1e81e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e480f9fd0 0x559e481b5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41098/0 (socket says 172.21.15.103:41098) 2024-09-10T22:45:04.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.901+0000 7f1e81e00640 1 -- 172.21.15.103:0/1195951871 learned_addr learned my addr 172.21.15.103:0/1195951871 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.901+0000 7f1e82800640 1 --2- 172.21.15.103:0/1195951871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e48143f20 0x559e481b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.901+0000 7f1e79400640 1 --2- 172.21.15.103:0/1195951871 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e48143600 0x559e481b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.901+0000 7f1e81e00640 1 -- 172.21.15.103:0/1195951871 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e48143600 msgr2=0x559e481b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.901+0000 7f1e81e00640 1 --2- 172.21.15.103:0/1195951871 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e48143600 0x559e481b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.901+0000 7f1e81e00640 1 -- 172.21.15.103:0/1195951871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e48143f20 msgr2=0x559e481b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.901+0000 7f1e81e00640 1 --2- 172.21.15.103:0/1195951871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e48143f20 0x559e481b66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.901+0000 7f1e81e00640 1 -- 172.21.15.103:0/1195951871 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e48143d50 con 0x559e480f9fd0 2024-09-10T22:45:04.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e81e00640 1 --2- 172.21.15.103:0/1195951871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e480f9fd0 0x559e481b5c20 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f1e7405d640 tx=0x7f1e74061040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af91b1d5ce20ab24 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e72000640 1 -- 172.21.15.103:0/1195951871 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7408e070 con 0x559e480f9fd0 2024-09-10T22:45:04.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e72000640 1 -- 172.21.15.103:0/1195951871 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e74059bb0 con 0x559e480f9fd0 2024-09-10T22:45:04.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e72000640 1 -- 172.21.15.103:0/1195951871 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7405ee20 con 0x559e480f9fd0 2024-09-10T22:45:04.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e8c14c000 1 -- 172.21.15.103:0/1195951871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e480f9fd0 msgr2=0x559e481b5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/1195951871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e480f9fd0 0x559e481b5c20 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f1e7405d640 tx=0x7f1e74061040 comp rx=0 tx=0).stop 2024-09-10T22:45:04.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e8c14c000 1 -- 172.21.15.103:0/1195951871 shutdown_connections 2024-09-10T22:45:04.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/1195951871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e48143f20 0x559e481b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/1195951871 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e48143600 0x559e481b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/1195951871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e480f9fd0 0x559e481b5c20 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e8c14c000 1 -- 172.21.15.103:0/1195951871 >> 172.21.15.103:0/1195951871 conn(0x559e480fbd20 msgr2=0x559e480f3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e8c14c000 1 -- 172.21.15.103:0/1195951871 shutdown_connections 2024-09-10T22:45:04.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e8c14c000 1 -- 172.21.15.103:0/1195951871 wait complete. 2024-09-10T22:45:04.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e8c14c000 1 -- start start 2024-09-10T22:45:04.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e8c14c000 1 Processor -- start 2024-09-10T22:45:04.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e8c14c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e480f9fd0 0x559e48157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e8c14c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e48143600 0x559e48158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e8c14c000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e48143f20 0x559e48175e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e8c14c000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559e480fed40 con 0x559e48143f20 2024-09-10T22:45:04.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e8c14c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559e480fc100 con 0x559e480f9fd0 2024-09-10T22:45:04.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e8c14c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x559e47f430e0 con 0x559e48143600 2024-09-10T22:45:04.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e8c14c000 10 client.0 _ll_register_callbacks cb 0x7f1e68003890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:04.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e82800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e48143f20 0x559e48175e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e82800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e48143f20 0x559e48175e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41108/0 (socket says 172.21.15.103:41108) 2024-09-10T22:45:04.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e82800640 1 -- 172.21.15.103:0/2707235129 learned_addr learned my addr 172.21.15.103:0/2707235129 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:04.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e81e00640 1 --2- 172.21.15.103:0/2707235129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e480f9fd0 0x559e48157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e79400640 1 --2- 172.21.15.103:0/2707235129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e48143600 0x559e48158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e82800640 1 -- 172.21.15.103:0/2707235129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e48143600 msgr2=0x559e48158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e82800640 1 --2- 172.21.15.103:0/2707235129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e48143600 0x559e48158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e82800640 1 -- 172.21.15.103:0/2707235129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e480f9fd0 msgr2=0x559e48157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:04.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e82800640 1 --2- 172.21.15.103:0/2707235129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e480f9fd0 0x559e48157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e82800640 1 -- 172.21.15.103:0/2707235129 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e47f9d660 con 0x559e48143f20 2024-09-10T22:45:04.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e82800640 1 --2- 172.21.15.103:0/2707235129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e48143f20 0x559e48175e20 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c002240 tx=0x7f1e7c001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5259600689fa7072 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:04.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.905+0000 7f1e67400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:04.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e67400640 1 -- 172.21.15.103:0/2707235129 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c02b060 con 0x559e48143f20 2024-09-10T22:45:04.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e67400640 1 -- 172.21.15.103:0/2707235129 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f1e7c019040 con 0x559e48143f20 2024-09-10T22:45:04.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 1 -- 172.21.15.103:0/2707235129 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e74059bb0 con 0x559e48143f20 2024-09-10T22:45:04.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e67400640 1 -- 172.21.15.103:0/2707235129 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f1e7c031050 con 0x559e48143f20 2024-09-10T22:45:04.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 10 client.7989 fetch_fsmap learned FSMap version 99 2024-09-10T22:45:04.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 1 -- 172.21.15.103:0/2707235129 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) -- 0x559e47f0a090 con 0x559e48143f20 2024-09-10T22:45:04.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e67400640 1 -- 172.21.15.103:0/2707235129 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e74059bb0 con 0x559e48143f20 2024-09-10T22:45:04.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e67400640 1 -- 172.21.15.103:0/2707235129 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 99) ==== 3558+0+0 (secure 0 0 0) 0x7f1e7c034020 con 0x559e48143f20 2024-09-10T22:45:04.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 10 client.7989 fetch_fsmap finished waiting for FSMap version 99 2024-09-10T22:45:04.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 10 client.7989 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-10T22:45:04.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 20 client.7989 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:04.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/2707235129 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x559e481b9a90 0x559e481b9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:04.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 4 client.7989 mds_command: new command op to 7434 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:45:04.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 1 -- 172.21.15.103:0/2707235129 --> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559e47f4e590 con 0x559e481b9a90 2024-09-10T22:45:04.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e81e00640 1 --2- 172.21.15.103:0/2707235129 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x559e481b9a90 0x559e481b9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:04.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e81e00640 1 --2- 172.21.15.103:0/2707235129 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x559e481b9a90 0x559e481b9ea0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4d3dc1d8ee36f4a server_cookie=f488d26f333fafb3 in_seq=0 out_seq=0 2024-09-10T22:45:04.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e67400640 10 client.7989 ms_handle_connect on v2:172.21.15.103:6833/187627880 2024-09-10T22:45:04.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e67400640 1 -- 172.21.15.103:0/2707235129 <== mds.0 v2:172.21.15.103:6833/187627880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x559e47f4e590 con 0x559e481b9a90 2024-09-10T22:45:04.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e67400640 10 client.7989 handle_command_reply: tid=0 2024-09-10T22:45:04.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 1 client.7989 shutdown 2024-09-10T22:45:04.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 1 -- 172.21.15.103:0/2707235129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e48143f20 msgr2=0x559e48175e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/2707235129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e48143f20 0x559e48175e20 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c002240 tx=0x7f1e7c001da0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 1 -- 172.21.15.103:0/2707235129 shutdown_connections 2024-09-10T22:45:04.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/2707235129 >> [v2:172.21.15.103:6833/187627880,v1:172.21.15.103:6835/187627880] conn(0x559e481b9a90 0x559e481b9ea0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/2707235129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e48143f20 0x559e48175e20 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/2707235129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559e48143600 0x559e48158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 1 --2- 172.21.15.103:0/2707235129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e480f9fd0 0x559e48157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e67400640 0 client.7989 ms_handle_reset on v2:172.21.15.103:6833/187627880 2024-09-10T22:45:04.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 1 -- 172.21.15.103:0/2707235129 >> 172.21.15.103:0/2707235129 conn(0x559e480fbd20 msgr2=0x559e480f3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 1 -- 172.21.15.103:0/2707235129 shutdown_connections 2024-09-10T22:45:04.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 1 -- 172.21.15.103:0/2707235129 wait complete. 2024-09-10T22:45:04.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e8c14c000 20 client.7989 trim_cache size 0 max 16384 2024-09-10T22:45:04.918 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:45:04.919 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:45:04.919 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:45:04.919 INFO:teuthology.orchestra.run.smithi103.stdout: "118e1155-7244-4d9c-9fab-dbfc720435a1": { 2024-09-10T22:45:04.919 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:45:04.919 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "118e1155-7244-4d9c-9fab-dbfc720435a1", 2024-09-10T22:45:04.919 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:45:04.919 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:04.919 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:04.919 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_stats": { 2024-09-10T22:45:04.919 INFO:teuthology.orchestra.run.smithi103.stdout: "118e1155-7244-4d9c-9fab-dbfc720435a1": { 2024-09-10T22:45:04.919 INFO:teuthology.orchestra.run.smithi103.stdout: "start_time": "2024-09-10T22:44:58.901676+0000", 2024-09-10T22:45:04.919 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:45:04.919 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_started": 0, 2024-09-10T22:45:04.920 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_passed": 0, 2024-09-10T22:45:04.920 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_failed": 0, 2024-09-10T22:45:04.920 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_skipped": 0 2024-09-10T22:45:04.920 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:04.920 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:04.920 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:45:04.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e83200640 1 -- 172.21.15.103:0/3583432406 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1e600725e0 msgr2=0x7f1e60074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e83200640 1 --2- 172.21.15.103:0/3583432406 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1e600725e0 0x7f1e60074aa0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0af000 tx=0x7f1e6c01b0a0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e83200640 1 -- 172.21.15.103:0/3583432406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e8406c5b0 msgr2=0x7f1e84151b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:04.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e83200640 1 --2- 172.21.15.103:0/3583432406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e8406c5b0 0x7f1e84151b30 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400c400 tx=0x7f1e7400c8c0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e83200640 1 -- 172.21.15.103:0/3583432406 shutdown_connections 2024-09-10T22:45:04.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e83200640 1 --2- 172.21.15.103:0/3583432406 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1e600725e0 0x7f1e60074aa0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e83200640 1 --2- 172.21.15.103:0/3583432406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1e840ca380 0x7f1e840c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e83200640 1 --2- 172.21.15.103:0/3583432406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e8406ff00 0x7f1e841520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e83200640 1 --2- 172.21.15.103:0/3583432406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e8406c5b0 0x7f1e84151b30 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:04.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e83200640 1 -- 172.21.15.103:0/3583432406 >> 172.21.15.103:0/3583432406 conn(0x7f1e840cfad0 msgr2=0x7f1e840cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:04.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e83200640 1 -- 172.21.15.103:0/3583432406 shutdown_connections 2024-09-10T22:45:04.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:04.909+0000 7f1e83200640 1 -- 172.21.15.103:0/3583432406 wait complete. 2024-09-10T22:45:04.933 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:45:04.933 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:45:05.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.069+0000 7f0ae3e00640 1 -- 172.21.15.103:0/2262886489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0adc0d21a0 msgr2=0x7f0adc0d4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:05.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.069+0000 7f0ae3e00640 1 --2- 172.21.15.103:0/2262886489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0adc0d21a0 0x7f0adc0d4750 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009900 tx=0x7f0ad001f0d0 comp rx=0 tx=0).stop 2024-09-10T22:45:05.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.069+0000 7f0ae3e00640 1 -- 172.21.15.103:0/2262886489 shutdown_connections 2024-09-10T22:45:05.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.069+0000 7f0ae3e00640 1 --2- 172.21.15.103:0/2262886489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0adc0d21a0 0x7f0adc0d4750 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:05.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.069+0000 7f0ae3e00640 1 -- 172.21.15.103:0/2262886489 >> 172.21.15.103:0/2262886489 conn(0x7f0adc0d3c60 msgr2=0x7f0adc0d4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:05.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.069+0000 7f0ae3e00640 1 -- 172.21.15.103:0/2262886489 shutdown_connections 2024-09-10T22:45:05.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.069+0000 7f0ae3e00640 1 -- 172.21.15.103:0/2262886489 wait complete. 2024-09-10T22:45:05.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae3e00640 1 Processor -- start 2024-09-10T22:45:05.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae3e00640 1 -- start start 2024-09-10T22:45:05.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0adc0d1830 0x7f0adc153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:05.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0adc0d21a0 0x7f0adc1f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:05.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae3e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0adc1f7a90 0x7f0adc1f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:05.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae3e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0adc0b40e0 con 0x7f0adc0d1830 2024-09-10T22:45:05.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae3e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0adc0b3f60 con 0x7f0adc0d21a0 2024-09-10T22:45:05.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae3e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0adc0b4260 con 0x7f0adc1f7a90 2024-09-10T22:45:05.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0adc0d1830 0x7f0adc153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:05.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0adc0d1830 0x7f0adc153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41124/0 (socket says 172.21.15.103:41124) 2024-09-10T22:45:05.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae1400640 1 -- 172.21.15.103:0/3316506420 learned_addr learned my addr 172.21.15.103:0/3316506420 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:05.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae0a00640 1 --2- 172.21.15.103:0/3316506420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0adc0d21a0 0x7f0adc1f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:05.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae1e00640 1 --2- 172.21.15.103:0/3316506420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0adc1f7a90 0x7f0adc1f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:05.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae1400640 1 -- 172.21.15.103:0/3316506420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0adc1f7a90 msgr2=0x7f0adc1f7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:05.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae1400640 1 --2- 172.21.15.103:0/3316506420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0adc1f7a90 0x7f0adc1f7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:05.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae1400640 1 -- 172.21.15.103:0/3316506420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0adc0d21a0 msgr2=0x7f0adc1f3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:05.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae1400640 1 --2- 172.21.15.103:0/3316506420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0adc0d21a0 0x7f0adc1f3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:05.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae1400640 1 -- 172.21.15.103:0/3316506420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0adc0b8590 con 0x7f0adc0d1830 2024-09-10T22:45:05.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae1e00640 1 --2- 172.21.15.103:0/3316506420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0adc1f7a90 0x7f0adc1f7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:05.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae1400640 1 --2- 172.21.15.103:0/3316506420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0adc0d1830 0x7f0adc153b80 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009850 tx=0x7f0ad00a8d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:05.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ad9600640 1 -- 172.21.15.103:0/3316506420 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00b5040 con 0x7f0adc0d1830 2024-09-10T22:45:05.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ad9600640 1 -- 172.21.15.103:0/3316506420 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ad0003990 con 0x7f0adc0d1830 2024-09-10T22:45:05.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ad9600640 1 -- 172.21.15.103:0/3316506420 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0003de0 con 0x7f0adc0d1830 2024-09-10T22:45:05.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae3e00640 1 -- 172.21.15.103:0/3316506420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0adc0b8870 con 0x7f0adc0d1830 2024-09-10T22:45:05.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae3e00640 1 -- 172.21.15.103:0/3316506420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0adc0b8e30 con 0x7f0adc0d1830 2024-09-10T22:45:05.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.073+0000 7f0ae3e00640 1 -- 172.21.15.103:0/3316506420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0adc0b4820 con 0x7f0adc0d1830 2024-09-10T22:45:05.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.077+0000 7f0ad9600640 1 -- 172.21.15.103:0/3316506420 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0ad00b8070 con 0x7f0adc0d1830 2024-09-10T22:45:05.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.077+0000 7f0ad9600640 1 --2- 172.21.15.103:0/3316506420 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0abc0725e0 0x7f0abc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:05.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.077+0000 7f0ad9600640 1 -- 172.21.15.103:0/3316506420 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f0ad0130370 con 0x7f0adc0d1830 2024-09-10T22:45:05.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.077+0000 7f0ae0a00640 1 --2- 172.21.15.103:0/3316506420 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0abc0725e0 0x7f0abc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:05.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.077+0000 7f0ae0a00640 1 --2- 172.21.15.103:0/3316506420 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0abc0725e0 0x7f0abc074aa0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0adc06e9a0 tx=0x7f0ac8009060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:05.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.081+0000 7f0ad9600640 1 -- 172.21.15.103:0/3316506420 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0ad0018c30 con 0x7f0adc0d1830 2024-09-10T22:45:05.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.285+0000 7f0ae3e00640 1 -- 172.21.15.103:0/3316506420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0adc0ceda0 con 0x7f0adc0d1830 2024-09-10T22:45:05.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.285+0000 7f0ad9600640 1 -- 172.21.15.103:0/3316506420 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) ==== 94+0+5281 (secure 0 0 0) 0x7f0ad00fb7c0 con 0x7f0adc0d1830 2024-09-10T22:45:05.289 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:05.289 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":99,"btime":"2024-09-10T22:45:02:330664+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2586411857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2586411857},{"type":"v1","addr":"172.21.15.131:6837","nonce":2586411857}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:44:23.558537+0000","modified":"2024-09-10T22:45:02.272780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7434,"mds_1":7428,"mds_2":7048},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7048":{"gid":7048,"name":"d","rank":2,"incarnation":93,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6836/1622106563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1622106563},{"type":"v1","addr":"172.21.15.131:6836","nonce":1622106563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":1,"incarnation":91,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3251348074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3251348074},{"type":"v1","addr":"172.21.15.103:6834","nonce":3251348074}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7434":{"gid":7434,"name":"c","rank":0,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/187627880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":187627880},{"type":"v1","addr":"172.21.15.103:6835","nonce":187627880}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7434,"qdb_cluster":[7434,7428,7048]},"id":6}]} 2024-09-10T22:45:05.289 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 99 2024-09-10T22:45:05.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.285+0000 7f0ae3e00640 1 -- 172.21.15.103:0/3316506420 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0abc0725e0 msgr2=0x7f0abc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:05.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.285+0000 7f0ae3e00640 1 --2- 172.21.15.103:0/3316506420 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0abc0725e0 0x7f0abc074aa0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0adc06e9a0 tx=0x7f0ac8009060 comp rx=0 tx=0).stop 2024-09-10T22:45:05.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.285+0000 7f0ae3e00640 1 -- 172.21.15.103:0/3316506420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0adc0d1830 msgr2=0x7f0adc153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:05.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.285+0000 7f0ae3e00640 1 --2- 172.21.15.103:0/3316506420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0adc0d1830 0x7f0adc153b80 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009850 tx=0x7f0ad00a8d60 comp rx=0 tx=0).stop 2024-09-10T22:45:05.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.285+0000 7f0ae3e00640 1 -- 172.21.15.103:0/3316506420 shutdown_connections 2024-09-10T22:45:05.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.285+0000 7f0ae3e00640 1 --2- 172.21.15.103:0/3316506420 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0abc0725e0 0x7f0abc074aa0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:05.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.285+0000 7f0ae3e00640 1 --2- 172.21.15.103:0/3316506420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0adc1f7a90 0x7f0adc1f7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:05.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.285+0000 7f0ae3e00640 1 --2- 172.21.15.103:0/3316506420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0adc0d21a0 0x7f0adc1f3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:05.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.285+0000 7f0ae3e00640 1 --2- 172.21.15.103:0/3316506420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0adc0d1830 0x7f0adc153b80 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:05.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.285+0000 7f0ae3e00640 1 -- 172.21.15.103:0/3316506420 >> 172.21.15.103:0/3316506420 conn(0x7f0adc0d3c60 msgr2=0x7f0adc0ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:05.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.285+0000 7f0ae3e00640 1 -- 172.21.15.103:0/3316506420 shutdown_connections 2024-09-10T22:45:05.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.285+0000 7f0ae3e00640 1 -- 172.21.15.103:0/3316506420 wait complete. 2024-09-10T22:45:05.311 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-10T22:45:05.311 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:45:05.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.449+0000 7effb7600640 1 -- 172.21.15.103:0/3868453481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effb015eaf0 msgr2=0x7effb015ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:05.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.449+0000 7effb7600640 1 --2- 172.21.15.103:0/3868453481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effb015eaf0 0x7effb015ef40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7effa8009bc0 tx=0x7effa801cb10 comp rx=0 tx=0).stop 2024-09-10T22:45:05.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.449+0000 7effb7600640 1 -- 172.21.15.103:0/3868453481 shutdown_connections 2024-09-10T22:45:05.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.449+0000 7effb7600640 1 --2- 172.21.15.103:0/3868453481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effb015eaf0 0x7effb015ef40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:05.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.449+0000 7effb7600640 1 --2- 172.21.15.103:0/3868453481 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7effb0158220 0x7effb00b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:05.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.449+0000 7effb7600640 1 -- 172.21.15.103:0/3868453481 >> 172.21.15.103:0/3868453481 conn(0x7effb00b2660 msgr2=0x7effb00b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:05.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.449+0000 7effb7600640 1 -- 172.21.15.103:0/3868453481 shutdown_connections 2024-09-10T22:45:05.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.449+0000 7effb7600640 1 -- 172.21.15.103:0/3868453481 wait complete. 2024-09-10T22:45:05.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.449+0000 7effb7600640 1 Processor -- start 2024-09-10T22:45:05.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb7600640 1 -- start start 2024-09-10T22:45:05.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb7600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effb0158220 0x7effb014ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:05.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb7600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7effb0158600 0x7effb013d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:05.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb7600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effb015eaf0 0x7effb015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:05.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb7600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7effb00aec00 con 0x7effb015eaf0 2024-09-10T22:45:05.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb7600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7effb00aea80 con 0x7effb0158220 2024-09-10T22:45:05.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb7600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7effb00aed80 con 0x7effb0158600 2024-09-10T22:45:05.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effb015eaf0 0x7effb015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:05.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effb015eaf0 0x7effb015a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41132/0 (socket says 172.21.15.103:41132) 2024-09-10T22:45:05.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb5600640 1 -- 172.21.15.103:0/706582988 learned_addr learned my addr 172.21.15.103:0/706582988 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:05.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb4c00640 1 --2- 172.21.15.103:0/706582988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effb0158220 0x7effb014ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:05.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effafe00640 1 --2- 172.21.15.103:0/706582988 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7effb0158600 0x7effb013d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:05.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb5600640 1 -- 172.21.15.103:0/706582988 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7effb0158600 msgr2=0x7effb013d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:05.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb5600640 1 --2- 172.21.15.103:0/706582988 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7effb0158600 0x7effb013d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:05.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb5600640 1 -- 172.21.15.103:0/706582988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effb0158220 msgr2=0x7effb014ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:05.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb5600640 1 --2- 172.21.15.103:0/706582988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effb0158220 0x7effb014ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:05.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb5600640 1 -- 172.21.15.103:0/706582988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb013dcf0 con 0x7effb015eaf0 2024-09-10T22:45:05.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb4c00640 1 --2- 172.21.15.103:0/706582988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effb0158220 0x7effb014ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:05.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb5600640 1 --2- 172.21.15.103:0/706582988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effb015eaf0 0x7effb015a3e0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7effa801a740 tx=0x7effa8003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:05.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effacc00640 1 -- 172.21.15.103:0/706582988 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa80bb070 con 0x7effb015eaf0 2024-09-10T22:45:05.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effacc00640 1 -- 172.21.15.103:0/706582988 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effa8004d40 con 0x7effb015eaf0 2024-09-10T22:45:05.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effacc00640 1 -- 172.21.15.103:0/706582988 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa80b2040 con 0x7effb015eaf0 2024-09-10T22:45:05.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb7600640 1 -- 172.21.15.103:0/706582988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb015a920 con 0x7effb015eaf0 2024-09-10T22:45:05.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb7600640 1 -- 172.21.15.103:0/706582988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb014f750 con 0x7effb015eaf0 2024-09-10T22:45:05.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.453+0000 7effb7600640 1 -- 172.21.15.103:0/706582988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb00af260 con 0x7effb015eaf0 2024-09-10T22:45:05.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.457+0000 7effacc00640 1 -- 172.21.15.103:0/706582988 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7effa80b5030 con 0x7effb015eaf0 2024-09-10T22:45:05.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.457+0000 7effacc00640 1 --2- 172.21.15.103:0/706582988 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7eff900725e0 0x7eff90074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:05.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.457+0000 7effacc00640 1 -- 172.21.15.103:0/706582988 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7effa812cd80 con 0x7effb015eaf0 2024-09-10T22:45:05.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.457+0000 7effb4c00640 1 --2- 172.21.15.103:0/706582988 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7eff900725e0 0x7eff90074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:05.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.457+0000 7effb4c00640 1 --2- 172.21.15.103:0/706582988 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7eff900725e0 0x7eff90074aa0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7effa4009c30 tx=0x7effa40091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:05.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.461+0000 7effacc00640 1 -- 172.21.15.103:0/706582988 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7effa80f1de0 con 0x7effb015eaf0 2024-09-10T22:45:05.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.685+0000 7effb7600640 1 -- 172.21.15.103:0/706582988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7effb00736b0 con 0x7effb015eaf0 2024-09-10T22:45:05.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.685+0000 7effacc00640 1 -- 172.21.15.103:0/706582988 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2008 (secure 0 0 0) 0x7effa8016790 con 0x7effb015eaf0 2024-09-10T22:45:05.689 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:05.690 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":401,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":694889,"bytes_used":266215424,"bytes_avail":772827897856,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9639,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":99,"btime":"2024-09-10T22:45:02:330664+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":7048},{"filesystem_id":6,"rank":1,"name":"a","status":"up:active","gid":7428},{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7434}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-10T22:45:01.715869+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-10T22:45:05.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.689+0000 7effb7600640 1 -- 172.21.15.103:0/706582988 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7eff900725e0 msgr2=0x7eff90074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:05.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.689+0000 7effb7600640 1 --2- 172.21.15.103:0/706582988 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7eff900725e0 0x7eff90074aa0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7effa4009c30 tx=0x7effa40091e0 comp rx=0 tx=0).stop 2024-09-10T22:45:05.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.689+0000 7effb7600640 1 -- 172.21.15.103:0/706582988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effb015eaf0 msgr2=0x7effb015a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:05.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.689+0000 7effb7600640 1 --2- 172.21.15.103:0/706582988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effb015eaf0 0x7effb015a3e0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7effa801a740 tx=0x7effa8003f60 comp rx=0 tx=0).stop 2024-09-10T22:45:05.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.689+0000 7effb7600640 1 -- 172.21.15.103:0/706582988 shutdown_connections 2024-09-10T22:45:05.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.689+0000 7effb7600640 1 --2- 172.21.15.103:0/706582988 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7eff900725e0 0x7eff90074aa0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:05.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.689+0000 7effb7600640 1 --2- 172.21.15.103:0/706582988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effb015eaf0 0x7effb015a3e0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:05.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.689+0000 7effb7600640 1 --2- 172.21.15.103:0/706582988 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7effb0158600 0x7effb013d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:05.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.689+0000 7effb7600640 1 --2- 172.21.15.103:0/706582988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effb0158220 0x7effb014ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:05.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.689+0000 7effb7600640 1 -- 172.21.15.103:0/706582988 >> 172.21.15.103:0/706582988 conn(0x7effb00b2660 msgr2=0x7effb0150ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:05.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.689+0000 7effb7600640 1 -- 172.21.15.103:0/706582988 shutdown_connections 2024-09-10T22:45:05.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:05.689+0000 7effb7600640 1 -- 172.21.15.103:0/706582988 wait complete. 2024-09-10T22:45:05.710 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-10T22:45:06.711 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:45:06.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.853+0000 7fa496a00640 1 -- 172.21.15.103:0/3549829938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa490070b40 msgr2=0x7fa4900cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:06.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.853+0000 7fa496a00640 1 --2- 172.21.15.103:0/3549829938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa490070b40 0x7fa4900cdc40 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fa488009c80 tx=0x7fa48801ccb0 comp rx=0 tx=0).stop 2024-09-10T22:45:06.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.853+0000 7fa496a00640 1 -- 172.21.15.103:0/3549829938 shutdown_connections 2024-09-10T22:45:06.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.853+0000 7fa496a00640 1 --2- 172.21.15.103:0/3549829938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa490070b40 0x7fa4900cdc40 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:06.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.853+0000 7fa496a00640 1 --2- 172.21.15.103:0/3549829938 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa49015f0e0 0x7fa4900d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:06.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.853+0000 7fa496a00640 1 -- 172.21.15.103:0/3549829938 >> 172.21.15.103:0/3549829938 conn(0x7fa4900d18d0 msgr2=0x7fa4900d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:06.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.853+0000 7fa496a00640 1 -- 172.21.15.103:0/3549829938 shutdown_connections 2024-09-10T22:45:06.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.853+0000 7fa496a00640 1 -- 172.21.15.103:0/3549829938 wait complete. 2024-09-10T22:45:06.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.853+0000 7fa496a00640 1 Processor -- start 2024-09-10T22:45:06.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.853+0000 7fa496a00640 1 -- start start 2024-09-10T22:45:06.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa496a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa490070b40 0x7fa4901594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:06.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa496a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4900d23f0 0x7fa490164c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:06.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa496a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa49015f0e0 0x7fa490165180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:06.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa496a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa490168a20 con 0x7fa490070b40 2024-09-10T22:45:06.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa496a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa4901688a0 con 0x7fa49015f0e0 2024-09-10T22:45:06.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa496a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa490168ba0 con 0x7fa4900d23f0 2024-09-10T22:45:06.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa495600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa490070b40 0x7fa4901594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:06.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa495600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa490070b40 0x7fa4901594b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39468/0 (socket says 172.21.15.103:39468) 2024-09-10T22:45:06.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa495600640 1 -- 172.21.15.103:0/2185372855 learned_addr learned my addr 172.21.15.103:0/2185372855 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:06.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa496000640 1 --2- 172.21.15.103:0/2185372855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa49015f0e0 0x7fa490165180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:06.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa494c00640 1 --2- 172.21.15.103:0/2185372855 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4900d23f0 0x7fa490164c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:06.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa495600640 1 -- 172.21.15.103:0/2185372855 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4900d23f0 msgr2=0x7fa490164c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:06.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa495600640 1 --2- 172.21.15.103:0/2185372855 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4900d23f0 0x7fa490164c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:06.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa495600640 1 -- 172.21.15.103:0/2185372855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa49015f0e0 msgr2=0x7fa490165180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:06.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa495600640 1 --2- 172.21.15.103:0/2185372855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa49015f0e0 0x7fa490165180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:06.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa495600640 1 -- 172.21.15.103:0/2185372855 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4900b1530 con 0x7fa490070b40 2024-09-10T22:45:06.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa494c00640 1 --2- 172.21.15.103:0/2185372855 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4900d23f0 0x7fa490164c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:06.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa495600640 1 --2- 172.21.15.103:0/2185372855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa490070b40 0x7fa4901594b0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fa48400d720 tx=0x7fa48400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:06.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa48d600640 1 -- 172.21.15.103:0/2185372855 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484017070 con 0x7fa490070b40 2024-09-10T22:45:06.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa48d600640 1 -- 172.21.15.103:0/2185372855 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa484009d20 con 0x7fa490070b40 2024-09-10T22:45:06.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa48d600640 1 -- 172.21.15.103:0/2185372855 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484005280 con 0x7fa490070b40 2024-09-10T22:45:06.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa496a00640 1 -- 172.21.15.103:0/2185372855 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4900b1810 con 0x7fa490070b40 2024-09-10T22:45:06.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa496a00640 1 -- 172.21.15.103:0/2185372855 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4900b1dd0 con 0x7fa490070b40 2024-09-10T22:45:06.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.857+0000 7fa496a00640 1 -- 172.21.15.103:0/2185372855 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4900b12c0 con 0x7fa490070b40 2024-09-10T22:45:06.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.861+0000 7fa48d600640 1 -- 172.21.15.103:0/2185372855 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa484005420 con 0x7fa490070b40 2024-09-10T22:45:06.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.861+0000 7fa48d600640 1 --2- 172.21.15.103:0/2185372855 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa4700725e0 0x7fa470074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:06.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.861+0000 7fa48d600640 1 -- 172.21.15.103:0/2185372855 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fa484093540 con 0x7fa490070b40 2024-09-10T22:45:06.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.861+0000 7fa494c00640 1 --2- 172.21.15.103:0/2185372855 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa4700725e0 0x7fa470074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:06.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.861+0000 7fa494c00640 1 --2- 172.21.15.103:0/2185372855 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa4700725e0 0x7fa470074aa0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa4900b26c0 tx=0x7fa47c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:06.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:06.865+0000 7fa48d600640 1 -- 172.21.15.103:0/2185372855 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa48405e330 con 0x7fa490070b40 2024-09-10T22:45:07.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.061+0000 7fa496a00640 1 -- 172.21.15.103:0/2185372855 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4900cdc40 con 0x7fa490070b40 2024-09-10T22:45:07.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.061+0000 7fa48d600640 1 -- 172.21.15.103:0/2185372855 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) ==== 94+0+5281 (secure 0 0 0) 0x7fa4840670a0 con 0x7fa490070b40 2024-09-10T22:45:07.065 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:07.065 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":99,"btime":"2024-09-10T22:45:02:330664+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2586411857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2586411857},{"type":"v1","addr":"172.21.15.131:6837","nonce":2586411857}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:44:23.558537+0000","modified":"2024-09-10T22:45:02.272780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7434,"mds_1":7428,"mds_2":7048},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7048":{"gid":7048,"name":"d","rank":2,"incarnation":93,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6836/1622106563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1622106563},{"type":"v1","addr":"172.21.15.131:6836","nonce":1622106563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":1,"incarnation":91,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3251348074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3251348074},{"type":"v1","addr":"172.21.15.103:6834","nonce":3251348074}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7434":{"gid":7434,"name":"c","rank":0,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/187627880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":187627880},{"type":"v1","addr":"172.21.15.103:6835","nonce":187627880}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7434,"qdb_cluster":[7434,7428,7048]},"id":6}]} 2024-09-10T22:45:07.065 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 99 2024-09-10T22:45:07.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.061+0000 7fa496a00640 1 -- 172.21.15.103:0/2185372855 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa4700725e0 msgr2=0x7fa470074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:07.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.061+0000 7fa496a00640 1 --2- 172.21.15.103:0/2185372855 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa4700725e0 0x7fa470074aa0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa4900b26c0 tx=0x7fa47c009040 comp rx=0 tx=0).stop 2024-09-10T22:45:07.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.061+0000 7fa496a00640 1 -- 172.21.15.103:0/2185372855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa490070b40 msgr2=0x7fa4901594b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:07.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.061+0000 7fa496a00640 1 --2- 172.21.15.103:0/2185372855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa490070b40 0x7fa4901594b0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fa48400d720 tx=0x7fa48400dbe0 comp rx=0 tx=0).stop 2024-09-10T22:45:07.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.061+0000 7fa496a00640 1 -- 172.21.15.103:0/2185372855 shutdown_connections 2024-09-10T22:45:07.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.061+0000 7fa496a00640 1 --2- 172.21.15.103:0/2185372855 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa4700725e0 0x7fa470074aa0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:07.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.061+0000 7fa496a00640 1 --2- 172.21.15.103:0/2185372855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa49015f0e0 0x7fa490165180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:07.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.061+0000 7fa496a00640 1 --2- 172.21.15.103:0/2185372855 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4900d23f0 0x7fa490164c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:07.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.061+0000 7fa496a00640 1 --2- 172.21.15.103:0/2185372855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa490070b40 0x7fa4901594b0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:07.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.061+0000 7fa496a00640 1 -- 172.21.15.103:0/2185372855 >> 172.21.15.103:0/2185372855 conn(0x7fa4900d18d0 msgr2=0x7fa4900d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:07.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.061+0000 7fa496a00640 1 -- 172.21.15.103:0/2185372855 shutdown_connections 2024-09-10T22:45:07.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.061+0000 7fa496a00640 1 -- 172.21.15.103:0/2185372855 wait complete. 2024-09-10T22:45:07.086 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-10T22:45:07.086 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:45:07.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.221+0000 7fd870800640 1 -- 172.21.15.103:0/696315633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8680d02c0 msgr2=0x7fd868166c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:07.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.221+0000 7fd870800640 1 --2- 172.21.15.103:0/696315633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8680d02c0 0x7fd868166c10 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fd864009bc0 tx=0x7fd86401cb10 comp rx=0 tx=0).stop 2024-09-10T22:45:07.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.221+0000 7fd870800640 1 -- 172.21.15.103:0/696315633 shutdown_connections 2024-09-10T22:45:07.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.221+0000 7fd870800640 1 --2- 172.21.15.103:0/696315633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8680d02c0 0x7fd868166c10 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:07.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.221+0000 7fd870800640 1 -- 172.21.15.103:0/696315633 >> 172.21.15.103:0/696315633 conn(0x7fd8680d0940 msgr2=0x7fd8680d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:07.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd870800640 1 -- 172.21.15.103:0/696315633 shutdown_connections 2024-09-10T22:45:07.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd870800640 1 -- 172.21.15.103:0/696315633 wait complete. 2024-09-10T22:45:07.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd870800640 1 Processor -- start 2024-09-10T22:45:07.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd870800640 1 -- start start 2024-09-10T22:45:07.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd870800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd86806cc00 0x7fd868150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:07.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd870800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8680d02c0 0x7fd868150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:07.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd870800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8680d1460 0x7fd868150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:07.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd870800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd868169e10 con 0x7fd8680d02c0 2024-09-10T22:45:07.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd870800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd868169c90 con 0x7fd86806cc00 2024-09-10T22:45:07.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd870800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd868169f90 con 0x7fd8680d1460 2024-09-10T22:45:07.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd86d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8680d02c0 0x7fd868150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd86d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8680d02c0 0x7fd868150890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39482/0 (socket says 172.21.15.103:39482) 2024-09-10T22:45:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd86d400640 1 -- 172.21.15.103:0/954292139 learned_addr learned my addr 172.21.15.103:0/954292139 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd86e800640 1 --2- 172.21.15.103:0/954292139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8680d1460 0x7fd868150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd86de00640 1 --2- 172.21.15.103:0/954292139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd86806cc00 0x7fd868150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd86d400640 1 -- 172.21.15.103:0/954292139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8680d1460 msgr2=0x7fd868150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd86d400640 1 --2- 172.21.15.103:0/954292139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8680d1460 0x7fd868150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd86d400640 1 -- 172.21.15.103:0/954292139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd86806cc00 msgr2=0x7fd868150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd86d400640 1 --2- 172.21.15.103:0/954292139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd86806cc00 0x7fd868150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd86d400640 1 -- 172.21.15.103:0/954292139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd868135fa0 con 0x7fd8680d02c0 2024-09-10T22:45:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd86e800640 1 --2- 172.21.15.103:0/954292139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8680d1460 0x7fd868150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd86d400640 1 --2- 172.21.15.103:0/954292139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8680d02c0 0x7fd868150890 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fd85800c420 tx=0x7fd85800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd862000640 1 -- 172.21.15.103:0/954292139 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd858017070 con 0x7fd8680d02c0 2024-09-10T22:45:07.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd862000640 1 -- 172.21.15.103:0/954292139 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8580053c0 con 0x7fd8680d02c0 2024-09-10T22:45:07.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd870800640 1 -- 172.21.15.103:0/954292139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd86814fc30 con 0x7fd8680d02c0 2024-09-10T22:45:07.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd862000640 1 -- 172.21.15.103:0/954292139 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd858003860 con 0x7fd8680d02c0 2024-09-10T22:45:07.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.225+0000 7fd870800640 1 -- 172.21.15.103:0/954292139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd868158130 con 0x7fd8680d02c0 2024-09-10T22:45:07.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.229+0000 7fd870800640 1 -- 172.21.15.103:0/954292139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd86806cfe0 con 0x7fd8680d02c0 2024-09-10T22:45:07.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.229+0000 7fd862000640 1 -- 172.21.15.103:0/954292139 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd858003a00 con 0x7fd8680d02c0 2024-09-10T22:45:07.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.229+0000 7fd862000640 1 --2- 172.21.15.103:0/954292139 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd84c0725e0 0x7fd84c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:07.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.229+0000 7fd862000640 1 -- 172.21.15.103:0/954292139 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fd858092b80 con 0x7fd8680d02c0 2024-09-10T22:45:07.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.229+0000 7fd86de00640 1 --2- 172.21.15.103:0/954292139 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd84c0725e0 0x7fd84c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:07.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.233+0000 7fd86de00640 1 --2- 172.21.15.103:0/954292139 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd84c0725e0 0x7fd84c074aa0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0046c0 tx=0x7fd85c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:07.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.233+0000 7fd862000640 1 -- 172.21.15.103:0/954292139 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd868135fa0 con 0x7fd8680d02c0 2024-09-10T22:45:07.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.461+0000 7fd870800640 1 -- 172.21.15.103:0/954292139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd8680cd0c0 con 0x7fd8680d02c0 2024-09-10T22:45:07.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.461+0000 7fd862000640 1 -- 172.21.15.103:0/954292139 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2008 (secure 0 0 0) 0x7fd85805dfc0 con 0x7fd8680d02c0 2024-09-10T22:45:07.464 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:07.464 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":403,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":695463,"bytes_used":266215424,"bytes_avail":772827897856,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9725,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":99,"btime":"2024-09-10T22:45:02:330664+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":7048},{"filesystem_id":6,"rank":1,"name":"a","status":"up:active","gid":7428},{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7434}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-10T22:45:01.715869+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-10T22:45:07.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.461+0000 7fd870800640 1 -- 172.21.15.103:0/954292139 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd84c0725e0 msgr2=0x7fd84c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:07.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.461+0000 7fd870800640 1 --2- 172.21.15.103:0/954292139 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd84c0725e0 0x7fd84c074aa0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0046c0 tx=0x7fd85c009040 comp rx=0 tx=0).stop 2024-09-10T22:45:07.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.461+0000 7fd870800640 1 -- 172.21.15.103:0/954292139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8680d02c0 msgr2=0x7fd868150890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:07.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.461+0000 7fd870800640 1 --2- 172.21.15.103:0/954292139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8680d02c0 0x7fd868150890 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fd85800c420 tx=0x7fd85800c8e0 comp rx=0 tx=0).stop 2024-09-10T22:45:07.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.461+0000 7fd870800640 1 -- 172.21.15.103:0/954292139 shutdown_connections 2024-09-10T22:45:07.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.461+0000 7fd870800640 1 --2- 172.21.15.103:0/954292139 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd84c0725e0 0x7fd84c074aa0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:07.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.461+0000 7fd870800640 1 --2- 172.21.15.103:0/954292139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8680d1460 0x7fd868150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:07.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.461+0000 7fd870800640 1 --2- 172.21.15.103:0/954292139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8680d02c0 0x7fd868150890 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:07.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.461+0000 7fd870800640 1 --2- 172.21.15.103:0/954292139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd86806cc00 0x7fd868150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:07.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.461+0000 7fd870800640 1 -- 172.21.15.103:0/954292139 >> 172.21.15.103:0/954292139 conn(0x7fd8680d0940 msgr2=0x7fd86815e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:07.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.461+0000 7fd870800640 1 -- 172.21.15.103:0/954292139 shutdown_connections 2024-09-10T22:45:07.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:07.461+0000 7fd870800640 1 -- 172.21.15.103:0/954292139 wait complete. 2024-09-10T22:45:07.485 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-10T22:45:08.486 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:45:08.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.633+0000 7f457be00640 1 -- 172.21.15.103:0/2237505420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45740ad420 msgr2=0x7f45740b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:08.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.633+0000 7f457be00640 1 --2- 172.21.15.103:0/2237505420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45740ad420 0x7f45740b3550 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f456c009900 tx=0x7f456c01c8e0 comp rx=0 tx=0).stop 2024-09-10T22:45:08.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.633+0000 7f457be00640 1 -- 172.21.15.103:0/2237505420 shutdown_connections 2024-09-10T22:45:08.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.633+0000 7f457be00640 1 --2- 172.21.15.103:0/2237505420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45740ad420 0x7f45740b3550 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:08.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.633+0000 7f457be00640 1 --2- 172.21.15.103:0/2237505420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45740adba0 0x7f45740acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:08.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.633+0000 7f457be00640 1 -- 172.21.15.103:0/2237505420 >> 172.21.15.103:0/2237505420 conn(0x7f45740b1c00 msgr2=0x7f45740b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:08.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f457be00640 1 -- 172.21.15.103:0/2237505420 shutdown_connections 2024-09-10T22:45:08.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f457be00640 1 -- 172.21.15.103:0/2237505420 wait complete. 2024-09-10T22:45:08.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f457be00640 1 Processor -- start 2024-09-10T22:45:08.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f457be00640 1 -- start start 2024-09-10T22:45:08.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f457be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45740ad420 0x7f457409b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:08.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f457be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45740adba0 0x7f457409b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:08.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f457be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45740cc130 0x7f45741faab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:08.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f457be00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f45741658a0 con 0x7f45740ad420 2024-09-10T22:45:08.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f457be00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4574165720 con 0x7f45740adba0 2024-09-10T22:45:08.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f457be00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4574165a20 con 0x7f45740cc130 2024-09-10T22:45:08.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f4579400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45740ad420 0x7f457409b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:08.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f4579400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45740ad420 0x7f457409b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39490/0 (socket says 172.21.15.103:39490) 2024-09-10T22:45:08.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f4579400640 1 -- 172.21.15.103:0/507192523 learned_addr learned my addr 172.21.15.103:0/507192523 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:08.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f4578a00640 1 --2- 172.21.15.103:0/507192523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45740adba0 0x7f457409b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:08.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f4579e00640 1 --2- 172.21.15.103:0/507192523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45740cc130 0x7f45741faab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:08.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f4579400640 1 -- 172.21.15.103:0/507192523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45740cc130 msgr2=0x7f45741faab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:08.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f4579400640 1 --2- 172.21.15.103:0/507192523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45740cc130 0x7f45741faab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:08.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f4579400640 1 -- 172.21.15.103:0/507192523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45740adba0 msgr2=0x7f457409b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:08.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f4579400640 1 --2- 172.21.15.103:0/507192523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45740adba0 0x7f457409b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:08.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f4579400640 1 -- 172.21.15.103:0/507192523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f457409c220 con 0x7f45740ad420 2024-09-10T22:45:08.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f4579400640 1 --2- 172.21.15.103:0/507192523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45740ad420 0x7f457409b410 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f456800c730 tx=0x7f456800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:08.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f4571600640 1 -- 172.21.15.103:0/507192523 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4568003b80 con 0x7f45740ad420 2024-09-10T22:45:08.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f4571600640 1 -- 172.21.15.103:0/507192523 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4568003d40 con 0x7f45740ad420 2024-09-10T22:45:08.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.637+0000 7f4571600640 1 -- 172.21.15.103:0/507192523 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f456800aa50 con 0x7f45740ad420 2024-09-10T22:45:08.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.641+0000 7f457be00640 1 -- 172.21.15.103:0/507192523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4574167e90 con 0x7f45740ad420 2024-09-10T22:45:08.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.641+0000 7f457be00640 1 -- 172.21.15.103:0/507192523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f457415bcc0 con 0x7f45740ad420 2024-09-10T22:45:08.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.641+0000 7f457be00640 1 -- 172.21.15.103:0/507192523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45740b3550 con 0x7f45740ad420 2024-09-10T22:45:08.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.641+0000 7f4571600640 1 -- 172.21.15.103:0/507192523 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f456800abf0 con 0x7f45740ad420 2024-09-10T22:45:08.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.641+0000 7f4571600640 1 --2- 172.21.15.103:0/507192523 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f45540725e0 0x7f4554074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:08.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.641+0000 7f4571600640 1 -- 172.21.15.103:0/507192523 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f4568093150 con 0x7f45740ad420 2024-09-10T22:45:08.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.641+0000 7f4578a00640 1 --2- 172.21.15.103:0/507192523 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f45540725e0 0x7f4554074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:08.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.645+0000 7f4578a00640 1 --2- 172.21.15.103:0/507192523 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f45540725e0 0x7f4554074aa0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4574167d80 tx=0x7f456000b390 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:08.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.645+0000 7f4571600640 1 -- 172.21.15.103:0/507192523 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f456805dfd0 con 0x7f45740ad420 2024-09-10T22:45:08.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.841+0000 7f457be00640 1 -- 172.21.15.103:0/507192523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4574164630 con 0x7f45740ad420 2024-09-10T22:45:08.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.841+0000 7f4571600640 1 -- 172.21.15.103:0/507192523 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) ==== 94+0+5281 (secure 0 0 0) 0x7f4568062a00 con 0x7f45740ad420 2024-09-10T22:45:08.847 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:08.847 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":99,"btime":"2024-09-10T22:45:02:330664+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2586411857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2586411857},{"type":"v1","addr":"172.21.15.131:6837","nonce":2586411857}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:44:23.558537+0000","modified":"2024-09-10T22:45:02.272780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7434,"mds_1":7428,"mds_2":7048},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7048":{"gid":7048,"name":"d","rank":2,"incarnation":93,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6836/1622106563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1622106563},{"type":"v1","addr":"172.21.15.131:6836","nonce":1622106563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":1,"incarnation":91,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3251348074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3251348074},{"type":"v1","addr":"172.21.15.103:6834","nonce":3251348074}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7434":{"gid":7434,"name":"c","rank":0,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/187627880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":187627880},{"type":"v1","addr":"172.21.15.103:6835","nonce":187627880}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7434,"qdb_cluster":[7434,7428,7048]},"id":6}]} 2024-09-10T22:45:08.847 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 99 2024-09-10T22:45:08.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.845+0000 7f457be00640 1 -- 172.21.15.103:0/507192523 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f45540725e0 msgr2=0x7f4554074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:08.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.845+0000 7f457be00640 1 --2- 172.21.15.103:0/507192523 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f45540725e0 0x7f4554074aa0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4574167d80 tx=0x7f456000b390 comp rx=0 tx=0).stop 2024-09-10T22:45:08.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.845+0000 7f457be00640 1 -- 172.21.15.103:0/507192523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45740ad420 msgr2=0x7f457409b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:08.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.845+0000 7f457be00640 1 --2- 172.21.15.103:0/507192523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45740ad420 0x7f457409b410 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f456800c730 tx=0x7f456800cbf0 comp rx=0 tx=0).stop 2024-09-10T22:45:08.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.845+0000 7f457be00640 1 -- 172.21.15.103:0/507192523 shutdown_connections 2024-09-10T22:45:08.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.845+0000 7f457be00640 1 --2- 172.21.15.103:0/507192523 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f45540725e0 0x7f4554074aa0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:08.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.845+0000 7f457be00640 1 --2- 172.21.15.103:0/507192523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45740cc130 0x7f45741faab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:08.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.845+0000 7f457be00640 1 --2- 172.21.15.103:0/507192523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45740adba0 0x7f457409b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:08.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.845+0000 7f457be00640 1 --2- 172.21.15.103:0/507192523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45740ad420 0x7f457409b410 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:08.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.845+0000 7f457be00640 1 -- 172.21.15.103:0/507192523 >> 172.21.15.103:0/507192523 conn(0x7f45740b1c00 msgr2=0x7f457406d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:08.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.845+0000 7f457be00640 1 -- 172.21.15.103:0/507192523 shutdown_connections 2024-09-10T22:45:08.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:08.845+0000 7f457be00640 1 -- 172.21.15.103:0/507192523 wait complete. 2024-09-10T22:45:08.869 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-10T22:45:08.869 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:45:09.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.005+0000 7f7e3b200640 1 -- 172.21.15.103:0/488220268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e1c003a80 msgr2=0x7f7e1c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:09.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.005+0000 7f7e3b200640 1 --2- 172.21.15.103:0/488220268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e1c003a80 0x7f7e1c003ea0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f7e2800c2e0 tx=0x7f7e2801cf00 comp rx=0 tx=0).stop 2024-09-10T22:45:09.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.005+0000 7f7e3a800640 1 -- 172.21.15.103:0/488220268 reap_dead start 2024-09-10T22:45:09.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.005+0000 7f7e3b200640 1 -- 172.21.15.103:0/488220268 shutdown_connections 2024-09-10T22:45:09.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.005+0000 7f7e3b200640 1 -- 172.21.15.103:0/488220268 >> 172.21.15.103:0/488220268 conn(0x7f7e340d18d0 msgr2=0x7f7e340d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:09.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.005+0000 7f7e3b200640 1 -- 172.21.15.103:0/488220268 shutdown_connections 2024-09-10T22:45:09.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.005+0000 7f7e3b200640 1 -- 172.21.15.103:0/488220268 wait complete. 2024-09-10T22:45:09.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e3b200640 1 Processor -- start 2024-09-10T22:45:09.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e3b200640 1 -- start start 2024-09-10T22:45:09.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e3b200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e1c003a80 0x7f7e340cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:09.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e3b200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e34157cb0 0x7f7e3414ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:09.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e3b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e34159690 0x7f7e34159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:09.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e3b200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7e340ce7e0 con 0x7f7e34159690 2024-09-10T22:45:09.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e3b200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7e340ce660 con 0x7f7e34157cb0 2024-09-10T22:45:09.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e3b200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7e340ce960 con 0x7f7e1c003a80 2024-09-10T22:45:09.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e3a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e34159690 0x7f7e34159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:09.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e39e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e1c003a80 0x7f7e340cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:09.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e39e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e1c003a80 0x7f7e340cb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:45702/0 (socket says 172.21.15.103:45702) 2024-09-10T22:45:09.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e39e00640 1 -- 172.21.15.103:0/2466771844 learned_addr learned my addr 172.21.15.103:0/2466771844 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:09.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e39400640 1 --2- 172.21.15.103:0/2466771844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e34157cb0 0x7f7e3414ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:09.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e3a800640 1 -- 172.21.15.103:0/2466771844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e1c003a80 msgr2=0x7f7e340cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:09.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e3a800640 1 --2- 172.21.15.103:0/2466771844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e1c003a80 0x7f7e340cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:09.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e3a800640 1 -- 172.21.15.103:0/2466771844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e34157cb0 msgr2=0x7f7e3414ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:09.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e3a800640 1 --2- 172.21.15.103:0/2466771844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e34157cb0 0x7f7e3414ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:09.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e3a800640 1 -- 172.21.15.103:0/2466771844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e341f6280 con 0x7f7e34159690 2024-09-10T22:45:09.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e3a800640 1 --2- 172.21.15.103:0/2466771844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e34159690 0x7f7e34159ad0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f7e340d29d0 tx=0x7f7e30009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:09.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e2e000640 1 -- 172.21.15.103:0/2466771844 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e30016030 con 0x7f7e34159690 2024-09-10T22:45:09.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e2e000640 1 -- 172.21.15.103:0/2466771844 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e30011840 con 0x7f7e34159690 2024-09-10T22:45:09.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e2e000640 1 -- 172.21.15.103:0/2466771844 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e30011c90 con 0x7f7e34159690 2024-09-10T22:45:09.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e3b200640 1 -- 172.21.15.103:0/2466771844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e341f6540 con 0x7f7e34159690 2024-09-10T22:45:09.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.009+0000 7f7e3b200640 1 -- 172.21.15.103:0/2466771844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e341f6b00 con 0x7f7e34159690 2024-09-10T22:45:09.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.013+0000 7f7e3b200640 1 -- 172.21.15.103:0/2466771844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e340d1280 con 0x7f7e34159690 2024-09-10T22:45:09.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.013+0000 7f7e2e000640 1 -- 172.21.15.103:0/2466771844 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7e3000f440 con 0x7f7e34159690 2024-09-10T22:45:09.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.013+0000 7f7e2e000640 1 --2- 172.21.15.103:0/2466771844 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7e180725e0 0x7f7e18074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:09.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.013+0000 7f7e2e000640 1 -- 172.21.15.103:0/2466771844 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f7e30093ac0 con 0x7f7e34159690 2024-09-10T22:45:09.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.013+0000 7f7e39e00640 1 --2- 172.21.15.103:0/2466771844 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7e180725e0 0x7f7e18074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:09.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.013+0000 7f7e39e00640 1 --2- 172.21.15.103:0/2466771844 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7e180725e0 0x7f7e18074aa0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7e28000c10 tx=0x7f7e28019d40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:09.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.017+0000 7f7e2e000640 1 -- 172.21.15.103:0/2466771844 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7e3005e8b0 con 0x7f7e34159690 2024-09-10T22:45:09.121 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-10T22:45:09.113+0000 7fb5aec00640 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-10T22:45:09.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.241+0000 7f7e3b200640 1 -- 172.21.15.103:0/2466771844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f7e3415bfd0 con 0x7f7e34159690 2024-09-10T22:45:09.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.241+0000 7f7e2e000640 1 -- 172.21.15.103:0/2466771844 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2008 (secure 0 0 0) 0x7f7e300632e0 con 0x7f7e34159690 2024-09-10T22:45:09.247 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:09.247 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":404,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":695463,"bytes_used":266215424,"bytes_avail":772827897856,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":6568,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":99,"btime":"2024-09-10T22:45:02:330664+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":7048},{"filesystem_id":6,"rank":1,"name":"a","status":"up:active","gid":7428},{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7434}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-10T22:45:01.715869+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-10T22:45:09.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.245+0000 7f7e3b200640 1 -- 172.21.15.103:0/2466771844 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7e180725e0 msgr2=0x7f7e18074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:09.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.245+0000 7f7e3b200640 1 --2- 172.21.15.103:0/2466771844 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7e180725e0 0x7f7e18074aa0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7e28000c10 tx=0x7f7e28019d40 comp rx=0 tx=0).stop 2024-09-10T22:45:09.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.245+0000 7f7e3b200640 1 -- 172.21.15.103:0/2466771844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e34159690 msgr2=0x7f7e34159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:09.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.245+0000 7f7e3b200640 1 --2- 172.21.15.103:0/2466771844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e34159690 0x7f7e34159ad0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f7e340d29d0 tx=0x7f7e30009b00 comp rx=0 tx=0).stop 2024-09-10T22:45:09.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.245+0000 7f7e3b200640 1 -- 172.21.15.103:0/2466771844 shutdown_connections 2024-09-10T22:45:09.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.245+0000 7f7e3b200640 1 --2- 172.21.15.103:0/2466771844 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7e180725e0 0x7f7e18074aa0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:09.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.245+0000 7f7e3b200640 1 --2- 172.21.15.103:0/2466771844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e34159690 0x7f7e34159ad0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:09.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.245+0000 7f7e3b200640 1 --2- 172.21.15.103:0/2466771844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e34157cb0 0x7f7e3414ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:09.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.245+0000 7f7e3b200640 1 --2- 172.21.15.103:0/2466771844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e1c003a80 0x7f7e340cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:09.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.245+0000 7f7e3b200640 1 -- 172.21.15.103:0/2466771844 >> 172.21.15.103:0/2466771844 conn(0x7f7e340d18d0 msgr2=0x7f7e34070430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:09.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.245+0000 7f7e3b200640 1 -- 172.21.15.103:0/2466771844 shutdown_connections 2024-09-10T22:45:09.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:09.245+0000 7f7e3b200640 1 -- 172.21.15.103:0/2466771844 wait complete. 2024-09-10T22:45:09.268 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-10T22:45:10.269 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:45:10.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.417+0000 7f50cc800640 1 -- 172.21.15.103:0/1876935597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c406cc00 msgr2=0x7f50c406cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:10.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.417+0000 7f50cc800640 1 --2- 172.21.15.103:0/1876935597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c406cc00 0x7f50c406cfe0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009900 tx=0x7f50b801c850 comp rx=0 tx=0).stop 2024-09-10T22:45:10.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.417+0000 7f50cc800640 1 -- 172.21.15.103:0/1876935597 shutdown_connections 2024-09-10T22:45:10.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.417+0000 7f50cc800640 1 --2- 172.21.15.103:0/1876935597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c406cc00 0x7f50c406cfe0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:10.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.417+0000 7f50cc800640 1 -- 172.21.15.103:0/1876935597 >> 172.21.15.103:0/1876935597 conn(0x7f50c40d0940 msgr2=0x7f50c40d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:10.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.417+0000 7f50cc800640 1 -- 172.21.15.103:0/1876935597 shutdown_connections 2024-09-10T22:45:10.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.417+0000 7f50cc800640 1 -- 172.21.15.103:0/1876935597 wait complete. 2024-09-10T22:45:10.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50cc800640 1 Processor -- start 2024-09-10T22:45:10.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50cc800640 1 -- start start 2024-09-10T22:45:10.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50cc800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50c406cc00 0x7f50c413eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:10.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50cc800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50c4071be0 0x7f50c414c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:10.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50cc800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c40d1460 0x7f50c41445e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:10.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50cc800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f50c4169f40 con 0x7f50c40d1460 2024-09-10T22:45:10.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50cc800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f50c40cd8e0 con 0x7f50c406cc00 2024-09-10T22:45:10.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50cc800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f50c416a0c0 con 0x7f50c4071be0 2024-09-10T22:45:10.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50ca800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c40d1460 0x7f50c41445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:10.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50ca800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c40d1460 0x7f50c41445e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39512/0 (socket says 172.21.15.103:39512) 2024-09-10T22:45:10.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50ca800640 1 -- 172.21.15.103:0/2494404843 learned_addr learned my addr 172.21.15.103:0/2494404843 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:10.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50c9e00640 1 --2- 172.21.15.103:0/2494404843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50c406cc00 0x7f50c413eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:10.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50c9400640 1 --2- 172.21.15.103:0/2494404843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50c4071be0 0x7f50c414c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:10.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50ca800640 1 -- 172.21.15.103:0/2494404843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50c4071be0 msgr2=0x7f50c414c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:10.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50ca800640 1 --2- 172.21.15.103:0/2494404843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50c4071be0 0x7f50c414c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:10.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50ca800640 1 -- 172.21.15.103:0/2494404843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50c406cc00 msgr2=0x7f50c413eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:10.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50ca800640 1 --2- 172.21.15.103:0/2494404843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50c406cc00 0x7f50c413eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:10.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50ca800640 1 -- 172.21.15.103:0/2494404843 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c4154940 con 0x7f50c40d1460 2024-09-10T22:45:10.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50ca800640 1 --2- 172.21.15.103:0/2494404843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c40d1460 0x7f50c41445e0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f50c000c7c0 tx=0x7f50c000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:10.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50be000640 1 -- 172.21.15.103:0/2494404843 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c0003b80 con 0x7f50c40d1460 2024-09-10T22:45:10.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50be000640 1 -- 172.21.15.103:0/2494404843 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50c0003d20 con 0x7f50c40d1460 2024-09-10T22:45:10.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50cc800640 1 -- 172.21.15.103:0/2494404843 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c4154c10 con 0x7f50c40d1460 2024-09-10T22:45:10.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50be000640 1 -- 172.21.15.103:0/2494404843 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c000aab0 con 0x7f50c40d1460 2024-09-10T22:45:10.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.421+0000 7f50cc800640 1 -- 172.21.15.103:0/2494404843 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c41551d0 con 0x7f50c40d1460 2024-09-10T22:45:10.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.425+0000 7f50cc800640 1 -- 172.21.15.103:0/2494404843 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c406cfe0 con 0x7f50c40d1460 2024-09-10T22:45:10.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.425+0000 7f50be000640 1 -- 172.21.15.103:0/2494404843 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f50c000ac50 con 0x7f50c40d1460 2024-09-10T22:45:10.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.425+0000 7f50be000640 1 --2- 172.21.15.103:0/2494404843 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f50a80725e0 0x7f50a8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:10.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.425+0000 7f50be000640 1 -- 172.21.15.103:0/2494404843 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f50c0093300 con 0x7f50c40d1460 2024-09-10T22:45:10.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.425+0000 7f50c9e00640 1 --2- 172.21.15.103:0/2494404843 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f50a80725e0 0x7f50a8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:10.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.425+0000 7f50c9e00640 1 --2- 172.21.15.103:0/2494404843 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f50a80725e0 0x7f50a8074aa0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f50b80af000 tx=0x7f50b801b090 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:10.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.429+0000 7f50be000640 1 -- 172.21.15.103:0/2494404843 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f50c005e180 con 0x7f50c40d1460 2024-09-10T22:45:10.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.637+0000 7f50cc800640 1 -- 172.21.15.103:0/2494404843 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50c40cd0c0 con 0x7f50c40d1460 2024-09-10T22:45:10.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.637+0000 7f50be000640 1 -- 172.21.15.103:0/2494404843 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) ==== 94+0+5281 (secure 0 0 0) 0x7f50c0062bb0 con 0x7f50c40d1460 2024-09-10T22:45:10.642 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:10.642 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":99,"btime":"2024-09-10T22:45:02:330664+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2586411857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2586411857},{"type":"v1","addr":"172.21.15.131:6837","nonce":2586411857}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:44:23.558537+0000","modified":"2024-09-10T22:45:02.272780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7434,"mds_1":7428,"mds_2":7048},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7048":{"gid":7048,"name":"d","rank":2,"incarnation":93,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6836/1622106563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1622106563},{"type":"v1","addr":"172.21.15.131:6836","nonce":1622106563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":1,"incarnation":91,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3251348074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3251348074},{"type":"v1","addr":"172.21.15.103:6834","nonce":3251348074}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7434":{"gid":7434,"name":"c","rank":0,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/187627880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":187627880},{"type":"v1","addr":"172.21.15.103:6835","nonce":187627880}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7434,"qdb_cluster":[7434,7428,7048]},"id":6}]} 2024-09-10T22:45:10.642 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 99 2024-09-10T22:45:10.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.641+0000 7f50cc800640 1 -- 172.21.15.103:0/2494404843 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f50a80725e0 msgr2=0x7f50a8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:10.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.641+0000 7f50cc800640 1 --2- 172.21.15.103:0/2494404843 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f50a80725e0 0x7f50a8074aa0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f50b80af000 tx=0x7f50b801b090 comp rx=0 tx=0).stop 2024-09-10T22:45:10.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.641+0000 7f50cc800640 1 -- 172.21.15.103:0/2494404843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c40d1460 msgr2=0x7f50c41445e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:10.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.641+0000 7f50cc800640 1 --2- 172.21.15.103:0/2494404843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c40d1460 0x7f50c41445e0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f50c000c7c0 tx=0x7f50c000cc80 comp rx=0 tx=0).stop 2024-09-10T22:45:10.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.641+0000 7f50cc800640 1 -- 172.21.15.103:0/2494404843 shutdown_connections 2024-09-10T22:45:10.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.641+0000 7f50cc800640 1 --2- 172.21.15.103:0/2494404843 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f50a80725e0 0x7f50a8074aa0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:10.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.641+0000 7f50cc800640 1 --2- 172.21.15.103:0/2494404843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c40d1460 0x7f50c41445e0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:10.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.641+0000 7f50cc800640 1 --2- 172.21.15.103:0/2494404843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50c4071be0 0x7f50c414c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:10.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.641+0000 7f50cc800640 1 --2- 172.21.15.103:0/2494404843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50c406cc00 0x7f50c413eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:10.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.641+0000 7f50cc800640 1 -- 172.21.15.103:0/2494404843 >> 172.21.15.103:0/2494404843 conn(0x7f50c40d0940 msgr2=0x7f50c4159af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:10.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.641+0000 7f50cc800640 1 -- 172.21.15.103:0/2494404843 shutdown_connections 2024-09-10T22:45:10.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.641+0000 7f50cc800640 1 -- 172.21.15.103:0/2494404843 wait complete. 2024-09-10T22:45:10.663 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-10T22:45:10.663 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:45:10.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfe4e00640 1 -- 172.21.15.103:0/2706444076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfe00b2c10 msgr2=0x7fdfe00b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:10.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfe4e00640 1 --2- 172.21.15.103:0/2706444076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfe00b2c10 0x7fdfe00b3030 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009840 tx=0x7fdfc801c820 comp rx=0 tx=0).stop 2024-09-10T22:45:10.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfe4e00640 1 -- 172.21.15.103:0/2706444076 shutdown_connections 2024-09-10T22:45:10.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfe4e00640 1 --2- 172.21.15.103:0/2706444076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfe00b2c10 0x7fdfe00b3030 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:10.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfe4e00640 1 -- 172.21.15.103:0/2706444076 >> 172.21.15.103:0/2706444076 conn(0x7fdfe006cc00 msgr2=0x7fdfe006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:10.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfe4e00640 1 -- 172.21.15.103:0/2706444076 shutdown_connections 2024-09-10T22:45:10.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfe4e00640 1 -- 172.21.15.103:0/2706444076 wait complete. 2024-09-10T22:45:10.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfe4e00640 1 Processor -- start 2024-09-10T22:45:10.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfe4e00640 1 -- start start 2024-09-10T22:45:10.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfe4e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfe0072500 0x7fdfe00af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:10.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfe4e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfe00b2c10 0x7fdfe0149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:10.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfe4e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfe00cf260 0x7fdfe0149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:10.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfe4e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe0168c40 con 0x7fdfe0072500 2024-09-10T22:45:10.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfe4e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe0157d80 con 0x7fdfe00cf260 2024-09-10T22:45:10.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfe4e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdfe0168dc0 con 0x7fdfe00b2c10 2024-09-10T22:45:10.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfdde00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfe0072500 0x7fdfe00af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:10.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfdde00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfe0072500 0x7fdfe00af840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39528/0 (socket says 172.21.15.103:39528) 2024-09-10T22:45:10.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfdde00640 1 -- 172.21.15.103:0/684860588 learned_addr learned my addr 172.21.15.103:0/684860588 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:10.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfde800640 1 --2- 172.21.15.103:0/684860588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfe00cf260 0x7fdfe0149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:10.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.801+0000 7fdfd5400640 1 --2- 172.21.15.103:0/684860588 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfe00b2c10 0x7fdfe0149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:10.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.805+0000 7fdfdde00640 1 -- 172.21.15.103:0/684860588 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfe00b2c10 msgr2=0x7fdfe0149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:10.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.805+0000 7fdfdde00640 1 --2- 172.21.15.103:0/684860588 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfe00b2c10 0x7fdfe0149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:10.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.805+0000 7fdfdde00640 1 -- 172.21.15.103:0/684860588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfe00cf260 msgr2=0x7fdfe0149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:10.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.805+0000 7fdfdde00640 1 --2- 172.21.15.103:0/684860588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfe00cf260 0x7fdfe0149e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:10.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.805+0000 7fdfdde00640 1 -- 172.21.15.103:0/684860588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe01fb100 con 0x7fdfe0072500 2024-09-10T22:45:10.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.805+0000 7fdfde800640 1 --2- 172.21.15.103:0/684860588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfe00cf260 0x7fdfe0149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:10.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.805+0000 7fdfdde00640 1 --2- 172.21.15.103:0/684860588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfe0072500 0x7fdfe00af840 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fdfd000c750 tx=0x7fdfd000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:10.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.805+0000 7fdfd6a00640 1 -- 172.21.15.103:0/684860588 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0017070 con 0x7fdfe0072500 2024-09-10T22:45:10.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.805+0000 7fdfd6a00640 1 -- 172.21.15.103:0/684860588 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfd0005070 con 0x7fdfe0072500 2024-09-10T22:45:10.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.805+0000 7fdfe4e00640 1 -- 172.21.15.103:0/684860588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe01fb3e0 con 0x7fdfe0072500 2024-09-10T22:45:10.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.805+0000 7fdfd6a00640 1 -- 172.21.15.103:0/684860588 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd000ce60 con 0x7fdfe0072500 2024-09-10T22:45:10.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.805+0000 7fdfe4e00640 1 -- 172.21.15.103:0/684860588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe014e610 con 0x7fdfe0072500 2024-09-10T22:45:10.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.805+0000 7fdfe4e00640 1 -- 172.21.15.103:0/684860588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfe014e120 con 0x7fdfe0072500 2024-09-10T22:45:10.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.805+0000 7fdfd6a00640 1 -- 172.21.15.103:0/684860588 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdfd0005480 con 0x7fdfe0072500 2024-09-10T22:45:10.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.805+0000 7fdfd6a00640 1 --2- 172.21.15.103:0/684860588 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdfbc0725e0 0x7fdfbc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:10.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.805+0000 7fdfd6a00640 1 -- 172.21.15.103:0/684860588 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fdfd0092ce0 con 0x7fdfe0072500 2024-09-10T22:45:10.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.809+0000 7fdfd5400640 1 --2- 172.21.15.103:0/684860588 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdfbc0725e0 0x7fdfbc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:10.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.809+0000 7fdfd5400640 1 --2- 172.21.15.103:0/684860588 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdfbc0725e0 0x7fdfbc074aa0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdfc80af000 tx=0x7fdfc801b060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:10.809+0000 7fdfd6a00640 1 -- 172.21.15.103:0/684860588 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdfd005db60 con 0x7fdfe0072500 2024-09-10T22:45:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:11.037+0000 7fdfe4e00640 1 -- 172.21.15.103:0/684860588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fdfe0072970 con 0x7fdfe0072500 2024-09-10T22:45:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:11.037+0000 7fdfd6a00640 1 -- 172.21.15.103:0/684860588 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2008 (secure 0 0 0) 0x7fdfd0062590 con 0x7fdfe0072500 2024-09-10T22:45:11.041 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:11.041 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":406,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700795,"bytes_used":266223616,"bytes_avail":772827889664,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":6568,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":99,"btime":"2024-09-10T22:45:02:330664+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":7048},{"filesystem_id":6,"rank":1,"name":"a","status":"up:active","gid":7428},{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7434}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-10T22:45:01.715869+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-10T22:45:11.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:11.037+0000 7fdfe4e00640 1 -- 172.21.15.103:0/684860588 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdfbc0725e0 msgr2=0x7fdfbc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:11.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:11.037+0000 7fdfe4e00640 1 --2- 172.21.15.103:0/684860588 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdfbc0725e0 0x7fdfbc074aa0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdfc80af000 tx=0x7fdfc801b060 comp rx=0 tx=0).stop 2024-09-10T22:45:11.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:11.037+0000 7fdfe4e00640 1 -- 172.21.15.103:0/684860588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfe0072500 msgr2=0x7fdfe00af840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:11.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:11.037+0000 7fdfe4e00640 1 --2- 172.21.15.103:0/684860588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfe0072500 0x7fdfe00af840 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fdfd000c750 tx=0x7fdfd000cc10 comp rx=0 tx=0).stop 2024-09-10T22:45:11.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:11.037+0000 7fdfe4e00640 1 -- 172.21.15.103:0/684860588 shutdown_connections 2024-09-10T22:45:11.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:11.037+0000 7fdfe4e00640 1 --2- 172.21.15.103:0/684860588 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdfbc0725e0 0x7fdfbc074aa0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:11.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:11.037+0000 7fdfe4e00640 1 --2- 172.21.15.103:0/684860588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfe00cf260 0x7fdfe0149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:11.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:11.037+0000 7fdfe4e00640 1 --2- 172.21.15.103:0/684860588 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfe00b2c10 0x7fdfe0149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:11.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:11.037+0000 7fdfe4e00640 1 --2- 172.21.15.103:0/684860588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfe0072500 0x7fdfe00af840 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:11.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:11.037+0000 7fdfe4e00640 1 -- 172.21.15.103:0/684860588 >> 172.21.15.103:0/684860588 conn(0x7fdfe006cc00 msgr2=0x7fdfe006ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:11.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:11.037+0000 7fdfe4e00640 1 -- 172.21.15.103:0/684860588 shutdown_connections 2024-09-10T22:45:11.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:11.037+0000 7fdfe4e00640 1 -- 172.21.15.103:0/684860588 wait complete. 2024-09-10T22:45:11.061 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-10T22:45:12.063 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:45:12.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.201+0000 7f9d8e200640 1 -- 172.21.15.103:0/2089235848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880b09c0 msgr2=0x7f9d880ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:12.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.201+0000 7f9d8e200640 1 --2- 172.21.15.103:0/2089235848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880b09c0 0x7f9d880ce7d0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009900 tx=0x7f9d7401c6e0 comp rx=0 tx=0).stop 2024-09-10T22:45:12.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.201+0000 7f9d8e200640 1 -- 172.21.15.103:0/2089235848 shutdown_connections 2024-09-10T22:45:12.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.201+0000 7f9d8e200640 1 --2- 172.21.15.103:0/2089235848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880b09c0 0x7f9d880ce7d0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:12.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.201+0000 7f9d8e200640 1 -- 172.21.15.103:0/2089235848 >> 172.21.15.103:0/2089235848 conn(0x7f9d880d1ac0 msgr2=0x7f9d880d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:12.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.201+0000 7f9d8e200640 1 -- 172.21.15.103:0/2089235848 shutdown_connections 2024-09-10T22:45:12.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.201+0000 7f9d8e200640 1 -- 172.21.15.103:0/2089235848 wait complete. 2024-09-10T22:45:12.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d8e200640 1 Processor -- start 2024-09-10T22:45:12.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d8e200640 1 -- start start 2024-09-10T22:45:12.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d8e200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d880ae9c0 0x7f9d8806e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:12.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d8e200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880b09c0 0x7f9d881f4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:12.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d8e200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d8815be30 0x7f9d88071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:12.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d8e200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9d880cee90 con 0x7f9d880b09c0 2024-09-10T22:45:12.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d8e200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9d880ced10 con 0x7f9d880ae9c0 2024-09-10T22:45:12.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d8e200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9d880af520 con 0x7f9d8815be30 2024-09-10T22:45:12.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d86a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880b09c0 0x7f9d881f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:12.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d86a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880b09c0 0x7f9d881f4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39532/0 (socket says 172.21.15.103:39532) 2024-09-10T22:45:12.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d86a00640 1 -- 172.21.15.103:0/3822985207 learned_addr learned my addr 172.21.15.103:0/3822985207 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:12.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d87400640 1 --2- 172.21.15.103:0/3822985207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d880ae9c0 0x7f9d8806e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:12.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d87e00640 1 --2- 172.21.15.103:0/3822985207 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d8815be30 0x7f9d88071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:12.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d86a00640 1 -- 172.21.15.103:0/3822985207 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d8815be30 msgr2=0x7f9d88071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:12.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d86a00640 1 --2- 172.21.15.103:0/3822985207 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d8815be30 0x7f9d88071020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:12.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d86a00640 1 -- 172.21.15.103:0/3822985207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d880ae9c0 msgr2=0x7f9d8806e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:12.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d86a00640 1 --2- 172.21.15.103:0/3822985207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d880ae9c0 0x7f9d8806e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:12.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d86a00640 1 -- 172.21.15.103:0/3822985207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d881f51a0 con 0x7f9d880b09c0 2024-09-10T22:45:12.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d86a00640 1 --2- 172.21.15.103:0/3822985207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880b09c0 0x7f9d881f4c60 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009850 tx=0x7f9d740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:12.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d7f400640 1 -- 172.21.15.103:0/3822985207 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d740b2040 con 0x7f9d880b09c0 2024-09-10T22:45:12.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d7f400640 1 -- 172.21.15.103:0/3822985207 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d740044e0 con 0x7f9d880b09c0 2024-09-10T22:45:12.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d8e200640 1 -- 172.21.15.103:0/3822985207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d880c59b0 con 0x7f9d880b09c0 2024-09-10T22:45:12.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d7f400640 1 -- 172.21.15.103:0/3822985207 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74005590 con 0x7f9d880b09c0 2024-09-10T22:45:12.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.205+0000 7f9d8e200640 1 -- 172.21.15.103:0/3822985207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d8806dd10 con 0x7f9d880b09c0 2024-09-10T22:45:12.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.209+0000 7f9d8e200640 1 -- 172.21.15.103:0/3822985207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d880afab0 con 0x7f9d880b09c0 2024-09-10T22:45:12.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.209+0000 7f9d7f400640 1 -- 172.21.15.103:0/3822985207 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9d740046d0 con 0x7f9d880b09c0 2024-09-10T22:45:12.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.209+0000 7f9d7f400640 1 --2- 172.21.15.103:0/3822985207 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9d680727b0 0x7f9d68074c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:12.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.209+0000 7f9d7f400640 1 -- 172.21.15.103:0/3822985207 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f9d7412d700 con 0x7f9d880b09c0 2024-09-10T22:45:12.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.209+0000 7f9d87400640 1 --2- 172.21.15.103:0/3822985207 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9d680727b0 0x7f9d68074c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:12.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.209+0000 7f9d87400640 1 --2- 172.21.15.103:0/3822985207 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9d680727b0 0x7f9d68074c70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9d880b3550 tx=0x7f9d78009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:12.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.213+0000 7f9d7f400640 1 -- 172.21.15.103:0/3822985207 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9d740bd060 con 0x7f9d880b09c0 2024-09-10T22:45:12.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.413+0000 7f9d8e200640 1 -- 172.21.15.103:0/3822985207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d8815b660 con 0x7f9d880b09c0 2024-09-10T22:45:12.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.413+0000 7f9d7f400640 1 -- 172.21.15.103:0/3822985207 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) ==== 94+0+5281 (secure 0 0 0) 0x7f9d881f51a0 con 0x7f9d880b09c0 2024-09-10T22:45:12.419 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:12.420 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":99,"btime":"2024-09-10T22:45:02:330664+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2586411857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2586411857},{"type":"v1","addr":"172.21.15.131:6837","nonce":2586411857}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:44:23.558537+0000","modified":"2024-09-10T22:45:02.272780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7434,"mds_1":7428,"mds_2":7048},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7048":{"gid":7048,"name":"d","rank":2,"incarnation":93,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6836/1622106563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1622106563},{"type":"v1","addr":"172.21.15.131:6836","nonce":1622106563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":1,"incarnation":91,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3251348074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3251348074},{"type":"v1","addr":"172.21.15.103:6834","nonce":3251348074}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7434":{"gid":7434,"name":"c","rank":0,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/187627880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":187627880},{"type":"v1","addr":"172.21.15.103:6835","nonce":187627880}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7434,"qdb_cluster":[7434,7428,7048]},"id":6}]} 2024-09-10T22:45:12.420 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 99 2024-09-10T22:45:12.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.417+0000 7f9d8e200640 1 -- 172.21.15.103:0/3822985207 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9d680727b0 msgr2=0x7f9d68074c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:12.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.417+0000 7f9d8e200640 1 --2- 172.21.15.103:0/3822985207 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9d680727b0 0x7f9d68074c70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9d880b3550 tx=0x7f9d78009040 comp rx=0 tx=0).stop 2024-09-10T22:45:12.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.417+0000 7f9d8e200640 1 -- 172.21.15.103:0/3822985207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880b09c0 msgr2=0x7f9d881f4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:12.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.417+0000 7f9d8e200640 1 --2- 172.21.15.103:0/3822985207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880b09c0 0x7f9d881f4c60 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009850 tx=0x7f9d740042f0 comp rx=0 tx=0).stop 2024-09-10T22:45:12.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.417+0000 7f9d8e200640 1 -- 172.21.15.103:0/3822985207 shutdown_connections 2024-09-10T22:45:12.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.417+0000 7f9d8e200640 1 --2- 172.21.15.103:0/3822985207 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9d680727b0 0x7f9d68074c70 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:12.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.417+0000 7f9d8e200640 1 --2- 172.21.15.103:0/3822985207 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d8815be30 0x7f9d88071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:12.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.417+0000 7f9d8e200640 1 --2- 172.21.15.103:0/3822985207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d880b09c0 0x7f9d881f4c60 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:12.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.417+0000 7f9d8e200640 1 --2- 172.21.15.103:0/3822985207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d880ae9c0 0x7f9d8806e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:12.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.417+0000 7f9d8e200640 1 -- 172.21.15.103:0/3822985207 >> 172.21.15.103:0/3822985207 conn(0x7f9d880d1ac0 msgr2=0x7f9d880b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:12.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.417+0000 7f9d8e200640 1 -- 172.21.15.103:0/3822985207 shutdown_connections 2024-09-10T22:45:12.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.417+0000 7f9d8e200640 1 -- 172.21.15.103:0/3822985207 wait complete. 2024-09-10T22:45:12.441 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-10T22:45:12.441 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:45:12.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.577+0000 7fd8d1400640 1 -- 172.21.15.103:0/2868216066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8cc0aff40 msgr2=0x7fd8cc06cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:12.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.577+0000 7fd8d1400640 1 --2- 172.21.15.103:0/2868216066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8cc0aff40 0x7fd8cc06cc00 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0b69d0 tx=0x7fd8c401cd50 comp rx=0 tx=0).stop 2024-09-10T22:45:12.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.577+0000 7fd8d1400640 1 -- 172.21.15.103:0/2868216066 shutdown_connections 2024-09-10T22:45:12.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.577+0000 7fd8d1400640 1 --2- 172.21.15.103:0/2868216066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8cc0aff40 0x7fd8cc06cc00 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:12.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.577+0000 7fd8d1400640 1 --2- 172.21.15.103:0/2868216066 >> v2:172.21.15.131:3300/0 conn(0x7fd8cc073b00 0x7fd8cc0d12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:12.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.577+0000 7fd8d1400640 1 -- 172.21.15.103:0/2868216066 >> 172.21.15.103:0/2868216066 conn(0x7fd8cc0d0780 msgr2=0x7fd8cc0d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:12.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.577+0000 7fd8d1400640 1 -- 172.21.15.103:0/2868216066 shutdown_connections 2024-09-10T22:45:12.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.577+0000 7fd8d1400640 1 -- 172.21.15.103:0/2868216066 wait complete. 2024-09-10T22:45:12.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.577+0000 7fd8d1400640 1 Processor -- start 2024-09-10T22:45:12.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.577+0000 7fd8d1400640 1 -- start start 2024-09-10T22:45:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.577+0000 7fd8d1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8cc073b00 0x7fd8cc14d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.577+0000 7fd8d1400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8cc0afb60 0x7fd8cc14c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.577+0000 7fd8d1400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8cc0aff40 0x7fd8cc15e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.577+0000 7fd8d1400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc16aec0 con 0x7fd8cc073b00 2024-09-10T22:45:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.577+0000 7fd8d1400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc16ad40 con 0x7fd8cc0afb60 2024-09-10T22:45:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.577+0000 7fd8d1400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd8cc16b040 con 0x7fd8cc0aff40 2024-09-10T22:45:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.577+0000 7fd8cbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8cc073b00 0x7fd8cc14d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.581+0000 7fd8cbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8cc073b00 0x7fd8cc14d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39554/0 (socket says 172.21.15.103:39554) 2024-09-10T22:45:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.581+0000 7fd8cbe00640 1 -- 172.21.15.103:0/255222995 learned_addr learned my addr 172.21.15.103:0/255222995 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.581+0000 7fd8d0a00640 1 --2- 172.21.15.103:0/255222995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8cc0aff40 0x7fd8cc15e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:12.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.581+0000 7fd8c3400640 1 --2- 172.21.15.103:0/255222995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8cc0afb60 0x7fd8cc14c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:12.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.581+0000 7fd8cbe00640 1 -- 172.21.15.103:0/255222995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8cc0aff40 msgr2=0x7fd8cc15e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:12.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.581+0000 7fd8cbe00640 1 --2- 172.21.15.103:0/255222995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8cc0aff40 0x7fd8cc15e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:12.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.581+0000 7fd8cbe00640 1 -- 172.21.15.103:0/255222995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8cc0afb60 msgr2=0x7fd8cc14c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:12.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.581+0000 7fd8cbe00640 1 --2- 172.21.15.103:0/255222995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8cc0afb60 0x7fd8cc14c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:12.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.581+0000 7fd8cbe00640 1 -- 172.21.15.103:0/255222995 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8cc14de40 con 0x7fd8cc073b00 2024-09-10T22:45:12.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.581+0000 7fd8c3400640 1 --2- 172.21.15.103:0/255222995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8cc0afb60 0x7fd8cc14c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:12.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.581+0000 7fd8cbe00640 1 --2- 172.21.15.103:0/255222995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8cc073b00 0x7fd8cc14d900 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00c500 tx=0x7fd8bc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:12.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.581+0000 7fd8c8c00640 1 -- 172.21.15.103:0/255222995 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc017070 con 0x7fd8cc073b00 2024-09-10T22:45:12.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.581+0000 7fd8c8c00640 1 -- 172.21.15.103:0/255222995 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8bc003600 con 0x7fd8cc073b00 2024-09-10T22:45:12.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.581+0000 7fd8c8c00640 1 -- 172.21.15.103:0/255222995 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc003a90 con 0x7fd8cc073b00 2024-09-10T22:45:12.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.581+0000 7fd8d1400640 1 -- 172.21.15.103:0/255222995 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8cc160cd0 con 0x7fd8cc073b00 2024-09-10T22:45:12.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.581+0000 7fd8d1400640 1 -- 172.21.15.103:0/255222995 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8cc14d100 con 0x7fd8cc073b00 2024-09-10T22:45:12.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.581+0000 7fd8d1400640 1 -- 172.21.15.103:0/255222995 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8cc0cc690 con 0x7fd8cc073b00 2024-09-10T22:45:12.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.581+0000 7fd8c8c00640 1 -- 172.21.15.103:0/255222995 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd8bc003c30 con 0x7fd8cc073b00 2024-09-10T22:45:12.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.585+0000 7fd8c8c00640 1 --2- 172.21.15.103:0/255222995 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd8a80725e0 0x7fd8a8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:12.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.585+0000 7fd8c8c00640 1 -- 172.21.15.103:0/255222995 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fd8bc092c10 con 0x7fd8cc073b00 2024-09-10T22:45:12.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.585+0000 7fd8c3400640 1 --2- 172.21.15.103:0/255222995 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd8a80725e0 0x7fd8a8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:12.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.585+0000 7fd8c3400640 1 --2- 172.21.15.103:0/255222995 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd8a80725e0 0x7fd8a8074aa0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4005fd0 tx=0x7fd8b4005e60 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:12.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.585+0000 7fd8c8c00640 1 -- 172.21.15.103:0/255222995 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd8bc05e1a0 con 0x7fd8cc073b00 2024-09-10T22:45:12.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.809+0000 7fd8d1400640 1 -- 172.21.15.103:0/255222995 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd8cc0ca0f0 con 0x7fd8cc073b00 2024-09-10T22:45:12.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.809+0000 7fd8c8c00640 1 -- 172.21.15.103:0/255222995 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1913 (secure 0 0 0) 0x7fd8bc05daa0 con 0x7fd8cc073b00 2024-09-10T22:45:12.814 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:12.814 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":408,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700795,"bytes_used":266223616,"bytes_avail":772827889664,"bytes_total":773094113280,"write_bytes_sec":1450,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":99,"btime":"2024-09-10T22:45:02:330664+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":7048},{"filesystem_id":6,"rank":1,"name":"a","status":"up:active","gid":7428},{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7434}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-10T22:45:11.718639+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T22:45:12.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.813+0000 7fd8d1400640 1 -- 172.21.15.103:0/255222995 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd8a80725e0 msgr2=0x7fd8a8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:12.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.813+0000 7fd8d1400640 1 --2- 172.21.15.103:0/255222995 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd8a80725e0 0x7fd8a8074aa0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4005fd0 tx=0x7fd8b4005e60 comp rx=0 tx=0).stop 2024-09-10T22:45:12.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.813+0000 7fd8d1400640 1 -- 172.21.15.103:0/255222995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8cc073b00 msgr2=0x7fd8cc14d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:12.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.813+0000 7fd8d1400640 1 --2- 172.21.15.103:0/255222995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8cc073b00 0x7fd8cc14d900 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00c500 tx=0x7fd8bc00c9c0 comp rx=0 tx=0).stop 2024-09-10T22:45:12.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.813+0000 7fd8d1400640 1 -- 172.21.15.103:0/255222995 shutdown_connections 2024-09-10T22:45:12.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.813+0000 7fd8d1400640 1 --2- 172.21.15.103:0/255222995 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd8a80725e0 0x7fd8a8074aa0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:12.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.813+0000 7fd8d1400640 1 --2- 172.21.15.103:0/255222995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8cc0aff40 0x7fd8cc15e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:12.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.813+0000 7fd8d1400640 1 --2- 172.21.15.103:0/255222995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8cc0afb60 0x7fd8cc14c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:12.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.813+0000 7fd8d1400640 1 --2- 172.21.15.103:0/255222995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8cc073b00 0x7fd8cc14d900 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:12.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.813+0000 7fd8d1400640 1 -- 172.21.15.103:0/255222995 >> 172.21.15.103:0/255222995 conn(0x7fd8cc0d0780 msgr2=0x7fd8cc15ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:12.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.813+0000 7fd8d1400640 1 -- 172.21.15.103:0/255222995 shutdown_connections 2024-09-10T22:45:12.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:12.813+0000 7fd8d1400640 1 -- 172.21.15.103:0/255222995 wait complete. 2024-09-10T22:45:12.835 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/d1/d2/d3]'} 2024-09-10T22:45:12.835 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T22:45:12.836 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:45:12.917 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:45:13.015 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T22:45:13.015 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:45:13.015 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:45:13.015 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:45:13.024 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:45:13.024 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:45:13.075 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T22:45:13.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.253+0000 7f8673200640 1 -- 172.21.15.103:0/832505684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f866c0cd500 msgr2=0x7f866c15f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.253+0000 7f8673200640 1 --2- 172.21.15.103:0/832505684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f866c0cd500 0x7f866c15f890 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f8664009900 tx=0x7f866401c8e0 comp rx=0 tx=0).stop 2024-09-10T22:45:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8673200640 1 -- 172.21.15.103:0/832505684 shutdown_connections 2024-09-10T22:45:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8673200640 1 --2- 172.21.15.103:0/832505684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f866c0cd500 0x7f866c15f890 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8673200640 1 --2- 172.21.15.103:0/832505684 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f866c15f1a0 0x7f866c0ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8673200640 1 -- 172.21.15.103:0/832505684 >> 172.21.15.103:0/832505684 conn(0x7f866c0d1a20 msgr2=0x7f866c0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8673200640 1 -- 172.21.15.103:0/832505684 shutdown_connections 2024-09-10T22:45:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8673200640 1 -- 172.21.15.103:0/832505684 wait complete. 2024-09-10T22:45:13.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8673200640 1 Processor -- start 2024-09-10T22:45:13.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8673200640 1 -- start start 2024-09-10T22:45:13.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8673200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f866c0cd500 0x7f866c0b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:13.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8673200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f866c0cdd00 0x7f866c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:13.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8673200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f866c15f1a0 0x7f866c071610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:13.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8673200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f866c168f60 con 0x7f866c0cdd00 2024-09-10T22:45:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8673200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f866c168de0 con 0x7f866c0cd500 2024-09-10T22:45:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8673200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f866c1690e0 con 0x7f866c15f1a0 2024-09-10T22:45:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8663400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f866c0cdd00 0x7f866c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8663400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f866c0cdd00 0x7f866c158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39570/0 (socket says 172.21.15.103:39570) 2024-09-10T22:45:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8663400640 1 -- 172.21.15.103:0/2837256593 learned_addr learned my addr 172.21.15.103:0/2837256593 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f866be00640 1 --2- 172.21.15.103:0/2837256593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f866c0cd500 0x7f866c0b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8671200640 1 --2- 172.21.15.103:0/2837256593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f866c15f1a0 0x7f866c071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8663400640 1 -- 172.21.15.103:0/2837256593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f866c15f1a0 msgr2=0x7f866c071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8663400640 1 --2- 172.21.15.103:0/2837256593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f866c15f1a0 0x7f866c071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8663400640 1 -- 172.21.15.103:0/2837256593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f866c0cd500 msgr2=0x7f866c0b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8663400640 1 --2- 172.21.15.103:0/2837256593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f866c0cd500 0x7f866c0b6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8663400640 1 -- 172.21.15.103:0/2837256593 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f866c0afd90 con 0x7f866c0cdd00 2024-09-10T22:45:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8671200640 1 --2- 172.21.15.103:0/2837256593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f866c15f1a0 0x7f866c071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:13.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8663400640 1 --2- 172.21.15.103:0/2837256593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f866c0cdd00 0x7f866c158e90 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f865400c440 tx=0x7f865400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:13.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8668c00640 1 -- 172.21.15.103:0/2837256593 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654016020 con 0x7f866c0cdd00 2024-09-10T22:45:13.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8668c00640 1 -- 172.21.15.103:0/2837256593 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8654012920 con 0x7f866c0cdd00 2024-09-10T22:45:13.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8668c00640 1 -- 172.21.15.103:0/2837256593 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654012d70 con 0x7f866c0cdd00 2024-09-10T22:45:13.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.257+0000 7f8673200640 1 -- 172.21.15.103:0/2837256593 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f866c1fc250 con 0x7f866c0cdd00 2024-09-10T22:45:13.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.261+0000 7f8673200640 1 -- 172.21.15.103:0/2837256593 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f866c1f8160 con 0x7f866c0cdd00 2024-09-10T22:45:13.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.261+0000 7f8673200640 1 -- 172.21.15.103:0/2837256593 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f866c15f890 con 0x7f866c0cdd00 2024-09-10T22:45:13.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.261+0000 7f8668c00640 1 -- 172.21.15.103:0/2837256593 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8654024430 con 0x7f866c0cdd00 2024-09-10T22:45:13.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.261+0000 7f8668c00640 1 --2- 172.21.15.103:0/2837256593 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f86480725e0 0x7f8648074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:13.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.261+0000 7f8668c00640 1 -- 172.21.15.103:0/2837256593 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f8654093900 con 0x7f866c0cdd00 2024-09-10T22:45:13.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.261+0000 7f866be00640 1 --2- 172.21.15.103:0/2837256593 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f86480725e0 0x7f8648074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:13.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.265+0000 7f866be00640 1 --2- 172.21.15.103:0/2837256593 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f86480725e0 0x7f8648074aa0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f865c005c50 tx=0x7f865c005be0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:13.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.265+0000 7f8668c00640 1 -- 172.21.15.103:0/2837256593 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8654020030 con 0x7f866c0cdd00 2024-09-10T22:45:13.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.445+0000 7f8673200640 1 -- 172.21.15.103:0/2837256593 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f866c0af160 con 0x7f866c0cdd00 2024-09-10T22:45:13.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.445+0000 7f8668c00640 1 -- 172.21.15.103:0/2837256593 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v94) ==== 80+0+0 (secure 0 0 0) 0x7f865405ee50 con 0x7f866c0cdd00 2024-09-10T22:45:13.448 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T22:45:13.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.445+0000 7f8673200640 1 -- 172.21.15.103:0/2837256593 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f86480725e0 msgr2=0x7f8648074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:13.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.445+0000 7f8673200640 1 --2- 172.21.15.103:0/2837256593 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f86480725e0 0x7f8648074aa0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f865c005c50 tx=0x7f865c005be0 comp rx=0 tx=0).stop 2024-09-10T22:45:13.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.445+0000 7f8673200640 1 -- 172.21.15.103:0/2837256593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f866c0cdd00 msgr2=0x7f866c158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:13.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.445+0000 7f8673200640 1 --2- 172.21.15.103:0/2837256593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f866c0cdd00 0x7f866c158e90 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f865400c440 tx=0x7f865400c900 comp rx=0 tx=0).stop 2024-09-10T22:45:13.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.445+0000 7f8673200640 1 -- 172.21.15.103:0/2837256593 shutdown_connections 2024-09-10T22:45:13.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.445+0000 7f8673200640 1 --2- 172.21.15.103:0/2837256593 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f86480725e0 0x7f8648074aa0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:13.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.445+0000 7f8673200640 1 --2- 172.21.15.103:0/2837256593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f866c15f1a0 0x7f866c071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:13.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.445+0000 7f8673200640 1 --2- 172.21.15.103:0/2837256593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f866c0cdd00 0x7f866c158e90 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:13.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.445+0000 7f8673200640 1 --2- 172.21.15.103:0/2837256593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f866c0cd500 0x7f866c0b6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:13.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.445+0000 7f8673200640 1 -- 172.21.15.103:0/2837256593 >> 172.21.15.103:0/2837256593 conn(0x7f866c0d1a20 msgr2=0x7f866c0af680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:13.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.445+0000 7f8673200640 1 -- 172.21.15.103:0/2837256593 shutdown_connections 2024-09-10T22:45:13.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.445+0000 7f8673200640 1 -- 172.21.15.103:0/2837256593 wait complete. 2024-09-10T22:45:13.469 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-09-10T22:45:13.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:13.469 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T22:45:13.486 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[46577]: fuse finished with error 0 and tester_r 0 2024-09-10T22:45:13.490 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:45:13.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:13.490 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T22:45:13.611 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:45:13.611 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:45:13.611 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:45:13.621 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:45:13.621 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:45:13.621 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:45:13.621 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:45:13.630 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350248k,nr_inodes=4087562,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3542 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T22:45:13.630 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:45:13.630 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:45:13.631 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:45:13.672 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:45:13.673 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:45:13.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.809+0000 7f7262c00640 1 -- 172.21.15.103:0/3794563733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f725c0ceb40 msgr2=0x7f725c0cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:13.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.809+0000 7f7262c00640 1 --2- 172.21.15.103:0/3794563733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f725c0ceb40 0x7f725c0cf9c0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f725c073840 tx=0x7f725401c830 comp rx=0 tx=0).stop 2024-09-10T22:45:13.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.809+0000 7f7262c00640 1 -- 172.21.15.103:0/3794563733 shutdown_connections 2024-09-10T22:45:13.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.809+0000 7f7262c00640 1 --2- 172.21.15.103:0/3794563733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f725c0ceb40 0x7f725c0cf9c0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:13.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.809+0000 7f7262c00640 1 --2- 172.21.15.103:0/3794563733 >> v2:172.21.15.131:3300/0 conn(0x7f725c0b09c0 0x7f725c0ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:13.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.809+0000 7f7262c00640 1 --2- 172.21.15.103:0/3794563733 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f725c15be30 0x7f725c0ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:13.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.809+0000 7f7262c00640 1 -- 172.21.15.103:0/3794563733 >> 172.21.15.103:0/3794563733 conn(0x7f725c0d1ac0 msgr2=0x7f725c0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:13.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.809+0000 7f7262c00640 1 -- 172.21.15.103:0/3794563733 shutdown_connections 2024-09-10T22:45:13.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.809+0000 7f7262c00640 1 -- 172.21.15.103:0/3794563733 wait complete. 2024-09-10T22:45:13.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7262c00640 1 Processor -- start 2024-09-10T22:45:13.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7262c00640 1 -- start start 2024-09-10T22:45:13.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7262c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f725c0b09c0 0x7f725c0cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:13.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7262c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f725c0ceb40 0x7f725c0c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:13.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7262c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f725c15be30 0x7f725c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:13.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7262c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f725c0aed50 con 0x7f725c15be30 2024-09-10T22:45:13.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7262c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f725c0aebd0 con 0x7f725c0b09c0 2024-09-10T22:45:13.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7262c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f725c0aeed0 con 0x7f725c0ceb40 2024-09-10T22:45:13.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7260c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f725c15be30 0x7f725c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:13.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7260c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f725c15be30 0x7f725c15a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39592/0 (socket says 172.21.15.103:39592) 2024-09-10T22:45:13.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7260c00640 1 -- 172.21.15.103:0/3911880370 learned_addr learned my addr 172.21.15.103:0/3911880370 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:13.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f725be00640 1 --2- 172.21.15.103:0/3911880370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f725c0b09c0 0x7f725c0cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:13.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f725b400640 1 --2- 172.21.15.103:0/3911880370 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f725c0ceb40 0x7f725c0c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:13.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7260c00640 1 -- 172.21.15.103:0/3911880370 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f725c0ceb40 msgr2=0x7f725c0c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:13.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7260c00640 1 --2- 172.21.15.103:0/3911880370 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f725c0ceb40 0x7f725c0c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:13.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7260c00640 1 -- 172.21.15.103:0/3911880370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f725c0b09c0 msgr2=0x7f725c0cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:13.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7260c00640 1 --2- 172.21.15.103:0/3911880370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f725c0b09c0 0x7f725c0cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:13.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7260c00640 1 -- 172.21.15.103:0/3911880370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725c0c7e70 con 0x7f725c15be30 2024-09-10T22:45:13.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f725be00640 1 --2- 172.21.15.103:0/3911880370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f725c0b09c0 0x7f725c0cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:13.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7260c00640 1 --2- 172.21.15.103:0/3911880370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f725c15be30 0x7f725c15a5e0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f7254009850 tx=0x7f72540a66d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:13.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7253e00640 1 -- 172.21.15.103:0/3911880370 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72540040c0 con 0x7f725c15be30 2024-09-10T22:45:13.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7253e00640 1 -- 172.21.15.103:0/3911880370 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7254004350 con 0x7f725c15be30 2024-09-10T22:45:13.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7253e00640 1 -- 172.21.15.103:0/3911880370 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7254005270 con 0x7f725c15be30 2024-09-10T22:45:13.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7262c00640 1 -- 172.21.15.103:0/3911880370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f725c0c8140 con 0x7f725c15be30 2024-09-10T22:45:13.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7262c00640 1 -- 172.21.15.103:0/3911880370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f725c159de0 con 0x7f725c15be30 2024-09-10T22:45:13.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.813+0000 7f7262c00640 1 -- 172.21.15.103:0/3911880370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f725c0c8660 con 0x7f725c15be30 2024-09-10T22:45:13.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.817+0000 7f7253e00640 1 -- 172.21.15.103:0/3911880370 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7254005410 con 0x7f725c15be30 2024-09-10T22:45:13.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.817+0000 7f7253e00640 1 --2- 172.21.15.103:0/3911880370 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f723c0725e0 0x7f723c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:13.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.817+0000 7f7253e00640 1 -- 172.21.15.103:0/3911880370 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f725412df60 con 0x7f725c15be30 2024-09-10T22:45:13.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.817+0000 7f725be00640 1 --2- 172.21.15.103:0/3911880370 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f723c0725e0 0x7f723c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:13.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.817+0000 7f725be00640 1 --2- 172.21.15.103:0/3911880370 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f723c0725e0 0x7f723c074aa0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f724c009e70 tx=0x7f724c009850 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:13.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:13.821+0000 7f7253e00640 1 -- 172.21.15.103:0/3911880370 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f72540c6020 con 0x7f725c15be30 2024-09-10T22:45:14.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.017+0000 7f7262c00640 1 -- 172.21.15.103:0/3911880370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f725c0cf9c0 con 0x7f725c15be30 2024-09-10T22:45:14.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.017+0000 7f7253e00640 1 -- 172.21.15.103:0/3911880370 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) ==== 94+0+5281 (secure 0 0 0) 0x7f72540164b0 con 0x7f725c15be30 2024-09-10T22:45:14.023 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:14.023 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":99,"btime":"2024-09-10T22:45:02:330664+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2586411857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2586411857},{"type":"v1","addr":"172.21.15.131:6837","nonce":2586411857}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:44:23.558537+0000","modified":"2024-09-10T22:45:02.272780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7434,"mds_1":7428,"mds_2":7048},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7048":{"gid":7048,"name":"d","rank":2,"incarnation":93,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6836/1622106563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1622106563},{"type":"v1","addr":"172.21.15.131:6836","nonce":1622106563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":1,"incarnation":91,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3251348074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3251348074},{"type":"v1","addr":"172.21.15.103:6834","nonce":3251348074}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7434":{"gid":7434,"name":"c","rank":0,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/187627880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":187627880},{"type":"v1","addr":"172.21.15.103:6835","nonce":187627880}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7434,"qdb_cluster":[7434,7428,7048]},"id":6}]} 2024-09-10T22:45:14.024 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 99 2024-09-10T22:45:14.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.021+0000 7f7262c00640 1 -- 172.21.15.103:0/3911880370 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f723c0725e0 msgr2=0x7f723c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:14.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.021+0000 7f7262c00640 1 --2- 172.21.15.103:0/3911880370 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f723c0725e0 0x7f723c074aa0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f724c009e70 tx=0x7f724c009850 comp rx=0 tx=0).stop 2024-09-10T22:45:14.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.021+0000 7f7262c00640 1 -- 172.21.15.103:0/3911880370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f725c15be30 msgr2=0x7f725c15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:14.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.021+0000 7f7262c00640 1 --2- 172.21.15.103:0/3911880370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f725c15be30 0x7f725c15a5e0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f7254009850 tx=0x7f72540a66d0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.021+0000 7f7262c00640 1 -- 172.21.15.103:0/3911880370 shutdown_connections 2024-09-10T22:45:14.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.021+0000 7f7262c00640 1 --2- 172.21.15.103:0/3911880370 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f723c0725e0 0x7f723c074aa0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.021+0000 7f7262c00640 1 --2- 172.21.15.103:0/3911880370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f725c15be30 0x7f725c15a5e0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.021+0000 7f7262c00640 1 --2- 172.21.15.103:0/3911880370 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f725c0ceb40 0x7f725c0c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.021+0000 7f7262c00640 1 --2- 172.21.15.103:0/3911880370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f725c0b09c0 0x7f725c0cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.021+0000 7f7262c00640 1 -- 172.21.15.103:0/3911880370 >> 172.21.15.103:0/3911880370 conn(0x7f725c0d1ac0 msgr2=0x7f725c158170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:14.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.021+0000 7f7262c00640 1 -- 172.21.15.103:0/3911880370 shutdown_connections 2024-09-10T22:45:14.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.021+0000 7f7262c00640 1 -- 172.21.15.103:0/3911880370 wait complete. 2024-09-10T22:45:14.045 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:45:14.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.181+0000 7fc17b200640 1 -- 172.21.15.103:0/2741838099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1740b09c0 msgr2=0x7fc1740ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:14.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.181+0000 7fc17b200640 1 --2- 172.21.15.103:0/2741838099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1740b09c0 0x7fc1740ce600 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fc174073910 tx=0x7fc16001c830 comp rx=0 tx=0).stop 2024-09-10T22:45:14.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.181+0000 7fc17b200640 1 -- 172.21.15.103:0/2741838099 shutdown_connections 2024-09-10T22:45:14.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.181+0000 7fc17b200640 1 --2- 172.21.15.103:0/2741838099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1740ceb40 0x7fc1740cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.181+0000 7fc17b200640 1 --2- 172.21.15.103:0/2741838099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1740b09c0 0x7fc1740ce600 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.181+0000 7fc17b200640 1 --2- 172.21.15.103:0/2741838099 >> v2:172.21.15.131:3300/0 conn(0x7fc17415be30 0x7fc1740ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.181+0000 7fc17b200640 1 -- 172.21.15.103:0/2741838099 >> 172.21.15.103:0/2741838099 conn(0x7fc1740d1ac0 msgr2=0x7fc1740d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:14.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.181+0000 7fc17b200640 1 -- 172.21.15.103:0/2741838099 shutdown_connections 2024-09-10T22:45:14.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.181+0000 7fc17b200640 1 -- 172.21.15.103:0/2741838099 wait complete. 2024-09-10T22:45:14.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc17b200640 1 Processor -- start 2024-09-10T22:45:14.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc17b200640 1 -- start start 2024-09-10T22:45:14.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc17b200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1740b09c0 0x7fc174154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:14.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc17b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1740ceb40 0x7fc174153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:14.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc17b200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc17415be30 0x7fc174165b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:14.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc17b200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc1740aed50 con 0x7fc1740ceb40 2024-09-10T22:45:14.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc17b200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc1740aebd0 con 0x7fc17415be30 2024-09-10T22:45:14.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc17b200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc1740aeed0 con 0x7fc1740b09c0 2024-09-10T22:45:14.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc173400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1740ceb40 0x7fc174153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:14.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc173400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1740ceb40 0x7fc174153160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39620/0 (socket says 172.21.15.103:39620) 2024-09-10T22:45:14.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc173400640 1 -- 172.21.15.103:0/953815987 learned_addr learned my addr 172.21.15.103:0/953815987 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:14.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc173e00640 1 --2- 172.21.15.103:0/953815987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1740b09c0 0x7fc174154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:14.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc179200640 1 --2- 172.21.15.103:0/953815987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc17415be30 0x7fc174165b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:14.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc173400640 1 -- 172.21.15.103:0/953815987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1740b09c0 msgr2=0x7fc174154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:14.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc173400640 1 --2- 172.21.15.103:0/953815987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1740b09c0 0x7fc174154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc173400640 1 -- 172.21.15.103:0/953815987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc17415be30 msgr2=0x7fc174165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:14.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc173400640 1 --2- 172.21.15.103:0/953815987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc17415be30 0x7fc174165b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc173400640 1 -- 172.21.15.103:0/953815987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc174159de0 con 0x7fc1740ceb40 2024-09-10T22:45:14.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc173400640 1 --2- 172.21.15.103:0/953815987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1740ceb40 0x7fc174153160 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fc1600b0040 tx=0x7fc1600a6730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:14.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc16be00640 1 -- 172.21.15.103:0/953815987 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160004340 con 0x7fc1740ceb40 2024-09-10T22:45:14.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc16be00640 1 -- 172.21.15.103:0/953815987 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc160005030 con 0x7fc1740ceb40 2024-09-10T22:45:14.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc17b200640 1 -- 172.21.15.103:0/953815987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17415a0c0 con 0x7fc1740ceb40 2024-09-10T22:45:14.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc16be00640 1 -- 172.21.15.103:0/953815987 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160005480 con 0x7fc1740ceb40 2024-09-10T22:45:14.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc17b200640 1 -- 172.21.15.103:0/953815987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc17415a680 con 0x7fc1740ceb40 2024-09-10T22:45:14.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.185+0000 7fc17b200640 1 -- 172.21.15.103:0/953815987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1740cf9c0 con 0x7fc1740ceb40 2024-09-10T22:45:14.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.189+0000 7fc16be00640 1 -- 172.21.15.103:0/953815987 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc1600046d0 con 0x7fc1740ceb40 2024-09-10T22:45:14.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.189+0000 7fc16be00640 1 --2- 172.21.15.103:0/953815987 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc1540725e0 0x7fc154074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:14.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.189+0000 7fc16be00640 1 -- 172.21.15.103:0/953815987 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7fc16012d720 con 0x7fc1740ceb40 2024-09-10T22:45:14.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.189+0000 7fc173e00640 1 --2- 172.21.15.103:0/953815987 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc1540725e0 0x7fc154074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:14.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.189+0000 7fc173e00640 1 --2- 172.21.15.103:0/953815987 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc1540725e0 0x7fc154074aa0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc1741518f0 tx=0x7fc164009480 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:14.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.193+0000 7fc16be00640 1 -- 172.21.15.103:0/953815987 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc1600164b0 con 0x7fc1740ceb40 2024-09-10T22:45:14.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.393+0000 7fc17b200640 1 -- 172.21.15.103:0/953815987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc17415a850 con 0x7fc1740ceb40 2024-09-10T22:45:14.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.397+0000 7fc16be00640 1 -- 172.21.15.103:0/953815987 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) ==== 94+0+5281 (secure 0 0 0) 0x7fc1600f8b60 con 0x7fc1740ceb40 2024-09-10T22:45:14.399 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:14.400 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":99,"btime":"2024-09-10T22:45:02:330664+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2586411857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2586411857},{"type":"v1","addr":"172.21.15.131:6837","nonce":2586411857}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:44:23.558537+0000","modified":"2024-09-10T22:45:02.272780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7434,"mds_1":7428,"mds_2":7048},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7048":{"gid":7048,"name":"d","rank":2,"incarnation":93,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6836/1622106563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1622106563},{"type":"v1","addr":"172.21.15.131:6836","nonce":1622106563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":1,"incarnation":91,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3251348074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3251348074},{"type":"v1","addr":"172.21.15.103:6834","nonce":3251348074}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7434":{"gid":7434,"name":"c","rank":0,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/187627880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":187627880},{"type":"v1","addr":"172.21.15.103:6835","nonce":187627880}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7434,"qdb_cluster":[7434,7428,7048]},"id":6}]} 2024-09-10T22:45:14.400 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 99 2024-09-10T22:45:14.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.397+0000 7fc17b200640 1 -- 172.21.15.103:0/953815987 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc1540725e0 msgr2=0x7fc154074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:14.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.397+0000 7fc17b200640 1 --2- 172.21.15.103:0/953815987 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc1540725e0 0x7fc154074aa0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc1741518f0 tx=0x7fc164009480 comp rx=0 tx=0).stop 2024-09-10T22:45:14.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.397+0000 7fc17b200640 1 -- 172.21.15.103:0/953815987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1740ceb40 msgr2=0x7fc174153160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:14.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.397+0000 7fc17b200640 1 --2- 172.21.15.103:0/953815987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1740ceb40 0x7fc174153160 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fc1600b0040 tx=0x7fc1600a6730 comp rx=0 tx=0).stop 2024-09-10T22:45:14.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.397+0000 7fc17b200640 1 -- 172.21.15.103:0/953815987 shutdown_connections 2024-09-10T22:45:14.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.397+0000 7fc17b200640 1 --2- 172.21.15.103:0/953815987 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc1540725e0 0x7fc154074aa0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.397+0000 7fc17b200640 1 --2- 172.21.15.103:0/953815987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc17415be30 0x7fc174165b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.397+0000 7fc17b200640 1 --2- 172.21.15.103:0/953815987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1740ceb40 0x7fc174153160 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.397+0000 7fc17b200640 1 --2- 172.21.15.103:0/953815987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1740b09c0 0x7fc174154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.397+0000 7fc17b200640 1 -- 172.21.15.103:0/953815987 >> 172.21.15.103:0/953815987 conn(0x7fc1740d1ac0 msgr2=0x7fc1740b2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:14.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.397+0000 7fc17b200640 1 -- 172.21.15.103:0/953815987 shutdown_connections 2024-09-10T22:45:14.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.397+0000 7fc17b200640 1 -- 172.21.15.103:0/953815987 wait complete. 2024-09-10T22:45:14.421 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:45:14.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.557+0000 7f6ac7200640 1 -- 172.21.15.103:0/3632969617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac80d23f0 msgr2=0x7f6ac80cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:14.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.557+0000 7f6ac7200640 1 --2- 172.21.15.103:0/3632969617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac80d23f0 0x7f6ac80cdc40 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f6ac80cf2a0 tx=0x7f6ac001ccf0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.557+0000 7f6ac7200640 1 -- 172.21.15.103:0/3632969617 shutdown_connections 2024-09-10T22:45:14.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.557+0000 7f6ac7200640 1 --2- 172.21.15.103:0/3632969617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac80d23f0 0x7f6ac80cdc40 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.557+0000 7f6ac7200640 1 --2- 172.21.15.103:0/3632969617 >> v2:172.21.15.131:3300/0 conn(0x7f6ac8070b40 0x7f6ac80d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.557+0000 7f6ac7200640 1 -- 172.21.15.103:0/3632969617 >> 172.21.15.103:0/3632969617 conn(0x7f6ac80d18d0 msgr2=0x7f6ac80d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:14.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.557+0000 7f6ac7200640 1 -- 172.21.15.103:0/3632969617 shutdown_connections 2024-09-10T22:45:14.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.557+0000 7f6ac7200640 1 -- 172.21.15.103:0/3632969617 wait complete. 2024-09-10T22:45:14.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.557+0000 7f6ac7200640 1 Processor -- start 2024-09-10T22:45:14.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.557+0000 7f6ac7200640 1 -- start start 2024-09-10T22:45:14.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac7200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ac8070b40 0x7f6ac815b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:14.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac7200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac80d23f0 0x7f6ac80b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:14.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac7200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ac815f0e0 0x7f6ac814ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:14.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac7200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac81688a0 con 0x7f6ac80d23f0 2024-09-10T22:45:14.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac7200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac80cec30 con 0x7f6ac815f0e0 2024-09-10T22:45:14.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac7200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac8168a20 con 0x7f6ac8070b40 2024-09-10T22:45:14.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac80d23f0 0x7f6ac80b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:14.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac80d23f0 0x7f6ac80b6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39642/0 (socket says 172.21.15.103:39642) 2024-09-10T22:45:14.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac6800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ac815f0e0 0x7f6ac814ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:14.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac5400640 1 -- 172.21.15.103:0/1382918550 learned_addr learned my addr 172.21.15.103:0/1382918550 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:14.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac5e00640 1 --2- 172.21.15.103:0/1382918550 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ac8070b40 0x7f6ac815b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:14.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac5400640 1 -- 172.21.15.103:0/1382918550 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ac8070b40 msgr2=0x7f6ac815b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:14.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac5400640 1 --2- 172.21.15.103:0/1382918550 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ac8070b40 0x7f6ac815b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac5400640 1 -- 172.21.15.103:0/1382918550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ac815f0e0 msgr2=0x7f6ac814ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:14.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac5400640 1 --2- 172.21.15.103:0/1382918550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ac815f0e0 0x7f6ac814ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac5400640 1 -- 172.21.15.103:0/1382918550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac80b1500 con 0x7f6ac80d23f0 2024-09-10T22:45:14.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac6800640 1 --2- 172.21.15.103:0/1382918550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ac815f0e0 0x7f6ac814ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:45:14.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac5400640 1 --2- 172.21.15.103:0/1382918550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac80d23f0 0x7f6ac80b6c00 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400e9f0 tx=0x7f6ab400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:14.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6abe000640 1 -- 172.21.15.103:0/1382918550 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab400cd80 con 0x7f6ac80d23f0 2024-09-10T22:45:14.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6abe000640 1 -- 172.21.15.103:0/1382918550 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ab4010430 con 0x7f6ac80d23f0 2024-09-10T22:45:14.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6abe000640 1 -- 172.21.15.103:0/1382918550 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4010860 con 0x7f6ac80d23f0 2024-09-10T22:45:14.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac7200640 1 -- 172.21.15.103:0/1382918550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac80b17e0 con 0x7f6ac80d23f0 2024-09-10T22:45:14.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac7200640 1 -- 172.21.15.103:0/1382918550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac80b1da0 con 0x7f6ac80d23f0 2024-09-10T22:45:14.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.561+0000 7f6ac7200640 1 -- 172.21.15.103:0/1382918550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac80d1280 con 0x7f6ac80d23f0 2024-09-10T22:45:14.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.565+0000 7f6abe000640 1 -- 172.21.15.103:0/1382918550 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6ab4010a00 con 0x7f6ac80d23f0 2024-09-10T22:45:14.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.565+0000 7f6abe000640 1 --2- 172.21.15.103:0/1382918550 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6aa80725e0 0x7f6aa8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:14.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.565+0000 7f6abe000640 1 -- 172.21.15.103:0/1382918550 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f6ab4093fa0 con 0x7f6ac80d23f0 2024-09-10T22:45:14.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.565+0000 7f6ac5e00640 1 --2- 172.21.15.103:0/1382918550 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6aa80725e0 0x7f6aa8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:14.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.565+0000 7f6ac5e00640 1 --2- 172.21.15.103:0/1382918550 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6aa80725e0 0x7f6aa8074aa0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8007fd0 tx=0x7f6ab8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:14.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.569+0000 7f6abe000640 1 -- 172.21.15.103:0/1382918550 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6ab405eee0 con 0x7f6ac80d23f0 2024-09-10T22:45:14.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.737+0000 7f6ac7200640 1 -- 172.21.15.103:0/1382918550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ac80d1e50 con 0x7f6ac80d23f0 2024-09-10T22:45:14.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.737+0000 7f6abe000640 1 -- 172.21.15.103:0/1382918550 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+17199 (secure 0 0 0) 0x7f6ab4063910 con 0x7f6ac80d23f0 2024-09-10T22:45:14.741 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:14.741 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":94,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:44:33.227164+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:44:21.248484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-10T22:44:22.526092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.10","mappings":[{"from":1,"to":2}]},{"pgid":"14.29","mappings":[{"from":1,"to":7}]},{"pgid":"14.2c","mappings":[{"from":1,"to":7}]},{"pgid":"14.2d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:45:14.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.741+0000 7f6ac7200640 1 -- 172.21.15.103:0/1382918550 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6aa80725e0 msgr2=0x7f6aa8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:14.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.741+0000 7f6ac7200640 1 --2- 172.21.15.103:0/1382918550 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6aa80725e0 0x7f6aa8074aa0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8007fd0 tx=0x7f6ab8009040 comp rx=0 tx=0).stop 2024-09-10T22:45:14.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.741+0000 7f6ac7200640 1 -- 172.21.15.103:0/1382918550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac80d23f0 msgr2=0x7f6ac80b6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:14.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.741+0000 7f6ac7200640 1 --2- 172.21.15.103:0/1382918550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac80d23f0 0x7f6ac80b6c00 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400e9f0 tx=0x7f6ab400eeb0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.741+0000 7f6ac7200640 1 -- 172.21.15.103:0/1382918550 shutdown_connections 2024-09-10T22:45:14.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.741+0000 7f6ac7200640 1 --2- 172.21.15.103:0/1382918550 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6aa80725e0 0x7f6aa8074aa0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.741+0000 7f6ac7200640 1 --2- 172.21.15.103:0/1382918550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ac815f0e0 0x7f6ac814ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.741+0000 7f6ac7200640 1 --2- 172.21.15.103:0/1382918550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ac80d23f0 0x7f6ac80b6c00 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.741+0000 7f6ac7200640 1 --2- 172.21.15.103:0/1382918550 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ac8070b40 0x7f6ac815b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.741+0000 7f6ac7200640 1 -- 172.21.15.103:0/1382918550 >> 172.21.15.103:0/1382918550 conn(0x7f6ac80d18d0 msgr2=0x7f6ac815ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:14.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.741+0000 7f6ac7200640 1 -- 172.21.15.103:0/1382918550 shutdown_connections 2024-09-10T22:45:14.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.741+0000 7f6ac7200640 1 -- 172.21.15.103:0/1382918550 wait complete. 2024-09-10T22:45:14.764 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T22:45:14.764 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:45:14.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.901+0000 7f453b200640 1 -- 172.21.15.103:0/1694337675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453c0af5b0 msgr2=0x7f453c0af9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:14.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.901+0000 7f453b200640 1 --2- 172.21.15.103:0/1694337675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453c0af5b0 0x7f453c0af9e0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f453c0b3350 tx=0x7f453401ccf0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.901+0000 7f453b200640 1 -- 172.21.15.103:0/1694337675 shutdown_connections 2024-09-10T22:45:14.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.901+0000 7f453b200640 1 --2- 172.21.15.103:0/1694337675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453c0af5b0 0x7f453c0af9e0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.901+0000 7f453b200640 1 --2- 172.21.15.103:0/1694337675 >> v2:172.21.15.131:3300/0 conn(0x7f453c073700 0x7f453c073b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.901+0000 7f453b200640 1 --2- 172.21.15.103:0/1694337675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f453c15e250 0x7f453c15e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.901+0000 7f453b200640 1 -- 172.21.15.103:0/1694337675 >> 172.21.15.103:0/1694337675 conn(0x7f453c0d0780 msgr2=0x7f453c0d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:14.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.901+0000 7f453b200640 1 -- 172.21.15.103:0/1694337675 shutdown_connections 2024-09-10T22:45:14.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.901+0000 7f453b200640 1 -- 172.21.15.103:0/1694337675 wait complete. 2024-09-10T22:45:14.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.901+0000 7f453b200640 1 Processor -- start 2024-09-10T22:45:14.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.901+0000 7f453b200640 1 -- start start 2024-09-10T22:45:14.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f453b200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f453c073700 0x7f453c1f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:14.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f453b200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f453c0af5b0 0x7f453c1f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:14.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f453b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453c15e250 0x7f453c1380a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:14.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f453b200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f453c0717e0 con 0x7f453c15e250 2024-09-10T22:45:14.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f453b200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f453c071660 con 0x7f453c073700 2024-09-10T22:45:14.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f453b200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f453c071960 con 0x7f453c0af5b0 2024-09-10T22:45:14.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f453a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453c15e250 0x7f453c1380a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:14.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f453a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453c15e250 0x7f453c1380a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39656/0 (socket says 172.21.15.103:39656) 2024-09-10T22:45:14.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f453a800640 1 -- 172.21.15.103:0/2774391179 learned_addr learned my addr 172.21.15.103:0/2774391179 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:14.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f4539400640 1 --2- 172.21.15.103:0/2774391179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f453c0af5b0 0x7f453c1f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:14.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f4539e00640 1 --2- 172.21.15.103:0/2774391179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f453c073700 0x7f453c1f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:14.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f453a800640 1 -- 172.21.15.103:0/2774391179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f453c0af5b0 msgr2=0x7f453c1f92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:14.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f453a800640 1 --2- 172.21.15.103:0/2774391179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f453c0af5b0 0x7f453c1f92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f453a800640 1 -- 172.21.15.103:0/2774391179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f453c073700 msgr2=0x7f453c1f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:14.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f453a800640 1 --2- 172.21.15.103:0/2774391179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f453c073700 0x7f453c1f5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:14.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f453a800640 1 -- 172.21.15.103:0/2774391179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453c1f6210 con 0x7f453c15e250 2024-09-10T22:45:14.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f4539e00640 1 --2- 172.21.15.103:0/2774391179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f453c073700 0x7f453c1f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:14.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f453a800640 1 --2- 172.21.15.103:0/2774391179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453c15e250 0x7f453c1380a0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f453401b3a0 tx=0x7f45340092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:14.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f4532000640 1 -- 172.21.15.103:0/2774391179 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45340bb070 con 0x7f453c15e250 2024-09-10T22:45:14.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f4532000640 1 -- 172.21.15.103:0/2774391179 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4534004d40 con 0x7f453c15e250 2024-09-10T22:45:14.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f4532000640 1 -- 172.21.15.103:0/2774391179 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45340b2040 con 0x7f453c15e250 2024-09-10T22:45:14.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f453b200640 1 -- 172.21.15.103:0/2774391179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f453c1385e0 con 0x7f453c15e250 2024-09-10T22:45:14.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f453b200640 1 -- 172.21.15.103:0/2774391179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f453c1f5c50 con 0x7f453c15e250 2024-09-10T22:45:14.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.905+0000 7f453b200640 1 -- 172.21.15.103:0/2774391179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f453c0af9e0 con 0x7f453c15e250 2024-09-10T22:45:14.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.909+0000 7f4532000640 1 -- 172.21.15.103:0/2774391179 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f45340b5030 con 0x7f453c15e250 2024-09-10T22:45:14.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.909+0000 7f4532000640 1 --2- 172.21.15.103:0/2774391179 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f451c0725e0 0x7f451c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:14.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.909+0000 7f4532000640 1 -- 172.21.15.103:0/2774391179 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f453412cfe0 con 0x7f453c15e250 2024-09-10T22:45:14.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.909+0000 7f4539e00640 1 --2- 172.21.15.103:0/2774391179 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f451c0725e0 0x7f451c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:14.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.909+0000 7f4539e00640 1 --2- 172.21.15.103:0/2774391179 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f451c0725e0 0x7f451c074aa0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f452c005fd0 tx=0x7f452c00a540 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:14.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:14.913+0000 7f4532000640 1 -- 172.21.15.103:0/2774391179 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4534016970 con 0x7f453c15e250 2024-09-10T22:45:15.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.109+0000 7f453b200640 1 -- 172.21.15.103:0/2774391179 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f453c1531d0 con 0x7f453c15e250 2024-09-10T22:45:15.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.109+0000 7f4532000640 1 -- 172.21.15.103:0/2774391179 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) ==== 94+0+5281 (secure 0 0 0) 0x7f45340f7e10 con 0x7f453c15e250 2024-09-10T22:45:15.114 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:15.115 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":99,"btime":"2024-09-10T22:45:02:330664+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2586411857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2586411857},{"type":"v1","addr":"172.21.15.131:6837","nonce":2586411857}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:44:23.558537+0000","modified":"2024-09-10T22:45:02.272780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7434,"mds_1":7428,"mds_2":7048},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7048":{"gid":7048,"name":"d","rank":2,"incarnation":93,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6836/1622106563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1622106563},{"type":"v1","addr":"172.21.15.131:6836","nonce":1622106563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":1,"incarnation":91,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3251348074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3251348074},{"type":"v1","addr":"172.21.15.103:6834","nonce":3251348074}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7434":{"gid":7434,"name":"c","rank":0,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/187627880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":187627880},{"type":"v1","addr":"172.21.15.103:6835","nonce":187627880}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7434,"qdb_cluster":[7434,7428,7048]},"id":6}]} 2024-09-10T22:45:15.115 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 99 2024-09-10T22:45:15.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.113+0000 7f453b200640 1 -- 172.21.15.103:0/2774391179 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f451c0725e0 msgr2=0x7f451c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:15.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.113+0000 7f453b200640 1 --2- 172.21.15.103:0/2774391179 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f451c0725e0 0x7f451c074aa0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f452c005fd0 tx=0x7f452c00a540 comp rx=0 tx=0).stop 2024-09-10T22:45:15.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.113+0000 7f453b200640 1 -- 172.21.15.103:0/2774391179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453c15e250 msgr2=0x7f453c1380a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:15.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.113+0000 7f453b200640 1 --2- 172.21.15.103:0/2774391179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453c15e250 0x7f453c1380a0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f453401b3a0 tx=0x7f45340092c0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.113+0000 7f453b200640 1 -- 172.21.15.103:0/2774391179 shutdown_connections 2024-09-10T22:45:15.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.113+0000 7f453b200640 1 --2- 172.21.15.103:0/2774391179 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f451c0725e0 0x7f451c074aa0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.113+0000 7f453b200640 1 --2- 172.21.15.103:0/2774391179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453c15e250 0x7f453c1380a0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.113+0000 7f453b200640 1 --2- 172.21.15.103:0/2774391179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f453c0af5b0 0x7f453c1f92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.113+0000 7f453b200640 1 --2- 172.21.15.103:0/2774391179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f453c073700 0x7f453c1f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.113+0000 7f453b200640 1 -- 172.21.15.103:0/2774391179 >> 172.21.15.103:0/2774391179 conn(0x7f453c0d0780 msgr2=0x7f453c154300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:15.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.113+0000 7f453b200640 1 -- 172.21.15.103:0/2774391179 shutdown_connections 2024-09-10T22:45:15.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.113+0000 7f453b200640 1 -- 172.21.15.103:0/2774391179 wait complete. 2024-09-10T22:45:15.136 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:45:15.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.273+0000 7f70dd000640 1 -- 172.21.15.103:0/3198939424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d815be30 msgr2=0x7f70d80ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:15.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.273+0000 7f70dd000640 1 --2- 172.21.15.103:0/3198939424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d815be30 0x7f70d80ce0c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009bc0 tx=0x7f70c801cb10 comp rx=0 tx=0).stop 2024-09-10T22:45:15.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.273+0000 7f70dd000640 1 -- 172.21.15.103:0/3198939424 shutdown_connections 2024-09-10T22:45:15.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.273+0000 7f70dd000640 1 --2- 172.21.15.103:0/3198939424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d815be30 0x7f70d80ce0c0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.273+0000 7f70dd000640 1 -- 172.21.15.103:0/3198939424 >> 172.21.15.103:0/3198939424 conn(0x7f70d80d1ac0 msgr2=0x7f70d80d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:15.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.273+0000 7f70dd000640 1 -- 172.21.15.103:0/3198939424 shutdown_connections 2024-09-10T22:45:15.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.273+0000 7f70dd000640 1 -- 172.21.15.103:0/3198939424 wait complete. 2024-09-10T22:45:15.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70dd000640 1 Processor -- start 2024-09-10T22:45:15.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70dd000640 1 -- start start 2024-09-10T22:45:15.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70dd000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d80ae9c0 0x7f70d8156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:15.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70dd000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70d80b09c0 0x7f70d80cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:15.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70dd000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70d815be30 0x7f70d80b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:15.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70dd000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f70d8169e50 con 0x7f70d80ae9c0 2024-09-10T22:45:15.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70dd000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f70d8169cd0 con 0x7f70d815be30 2024-09-10T22:45:15.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70dd000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f70d8169fd0 con 0x7f70d80b09c0 2024-09-10T22:45:15.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70d5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d80ae9c0 0x7f70d8156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70d5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d80ae9c0 0x7f70d8156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39672/0 (socket says 172.21.15.103:39672) 2024-09-10T22:45:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70d5e00640 1 -- 172.21.15.103:0/4004362840 learned_addr learned my addr 172.21.15.103:0/4004362840 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70d6800640 1 --2- 172.21.15.103:0/4004362840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70d815be30 0x7f70d80b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70d5400640 1 --2- 172.21.15.103:0/4004362840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70d80b09c0 0x7f70d80cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70d5e00640 1 -- 172.21.15.103:0/4004362840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70d80b09c0 msgr2=0x7f70d80cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70d5e00640 1 --2- 172.21.15.103:0/4004362840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70d80b09c0 0x7f70d80cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70d5e00640 1 -- 172.21.15.103:0/4004362840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70d815be30 msgr2=0x7f70d80b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70d5e00640 1 --2- 172.21.15.103:0/4004362840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70d815be30 0x7f70d80b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70d5e00640 1 -- 172.21.15.103:0/4004362840 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d8156fd0 con 0x7f70d80ae9c0 2024-09-10T22:45:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70d6800640 1 --2- 172.21.15.103:0/4004362840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70d815be30 0x7f70d80b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70d5e00640 1 --2- 172.21.15.103:0/4004362840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d80ae9c0 0x7f70d8156a90 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009b10 tx=0x7f70c80092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70ce000640 1 -- 172.21.15.103:0/4004362840 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c80bb070 con 0x7f70d80ae9c0 2024-09-10T22:45:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70ce000640 1 -- 172.21.15.103:0/4004362840 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70c8004d40 con 0x7f70d80ae9c0 2024-09-10T22:45:15.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70ce000640 1 -- 172.21.15.103:0/4004362840 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c80b2040 con 0x7f70d80ae9c0 2024-09-10T22:45:15.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70dd000640 1 -- 172.21.15.103:0/4004362840 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d80c38b0 con 0x7f70d80ae9c0 2024-09-10T22:45:15.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70dd000640 1 -- 172.21.15.103:0/4004362840 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d80c3e70 con 0x7f70d80ae9c0 2024-09-10T22:45:15.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.277+0000 7f70dd000640 1 -- 172.21.15.103:0/4004362840 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70d80aee10 con 0x7f70d80ae9c0 2024-09-10T22:45:15.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.281+0000 7f70ce000640 1 -- 172.21.15.103:0/4004362840 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f70c80b5030 con 0x7f70d80ae9c0 2024-09-10T22:45:15.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.281+0000 7f70ce000640 1 --2- 172.21.15.103:0/4004362840 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f70b8072610 0x7f70b8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:15.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.281+0000 7f70ce000640 1 -- 172.21.15.103:0/4004362840 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f70c812cfe0 con 0x7f70d80ae9c0 2024-09-10T22:45:15.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.281+0000 7f70d5400640 1 --2- 172.21.15.103:0/4004362840 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f70b8072610 0x7f70b8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:15.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.281+0000 7f70d5400640 1 --2- 172.21.15.103:0/4004362840 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f70b8072610 0x7f70b8074ad0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f70d80c8840 tx=0x7f70c4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.285+0000 7f70ce000640 1 -- 172.21.15.103:0/4004362840 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f70c8016790 con 0x7f70d80ae9c0 2024-09-10T22:45:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.485+0000 7f70dd000640 1 -- 172.21.15.103:0/4004362840 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70d8154b00 con 0x7f70d80ae9c0 2024-09-10T22:45:15.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.485+0000 7f70ce000640 1 -- 172.21.15.103:0/4004362840 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) ==== 94+0+5281 (secure 0 0 0) 0x7f70c80f8470 con 0x7f70d80ae9c0 2024-09-10T22:45:15.491 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:15.491 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":99,"btime":"2024-09-10T22:45:02:330664+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2586411857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2586411857},{"type":"v1","addr":"172.21.15.131:6837","nonce":2586411857}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:44:23.558537+0000","modified":"2024-09-10T22:45:02.272780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7434,"mds_1":7428,"mds_2":7048},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7048":{"gid":7048,"name":"d","rank":2,"incarnation":93,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6836/1622106563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1622106563},{"type":"v1","addr":"172.21.15.131:6836","nonce":1622106563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":1,"incarnation":91,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6834/3251348074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3251348074},{"type":"v1","addr":"172.21.15.103:6834","nonce":3251348074}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7434":{"gid":7434,"name":"c","rank":0,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.103:6835/187627880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6833","nonce":187627880},{"type":"v1","addr":"172.21.15.103:6835","nonce":187627880}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7434,"qdb_cluster":[7434,7428,7048]},"id":6}]} 2024-09-10T22:45:15.491 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 99 2024-09-10T22:45:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.489+0000 7f70dd000640 1 -- 172.21.15.103:0/4004362840 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f70b8072610 msgr2=0x7f70b8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.489+0000 7f70dd000640 1 --2- 172.21.15.103:0/4004362840 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f70b8072610 0x7f70b8074ad0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f70d80c8840 tx=0x7f70c4009040 comp rx=0 tx=0).stop 2024-09-10T22:45:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.489+0000 7f70dd000640 1 -- 172.21.15.103:0/4004362840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d80ae9c0 msgr2=0x7f70d8156a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.489+0000 7f70dd000640 1 --2- 172.21.15.103:0/4004362840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d80ae9c0 0x7f70d8156a90 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009b10 tx=0x7f70c80092a0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.489+0000 7f70dd000640 1 -- 172.21.15.103:0/4004362840 shutdown_connections 2024-09-10T22:45:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.489+0000 7f70dd000640 1 --2- 172.21.15.103:0/4004362840 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f70b8072610 0x7f70b8074ad0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.489+0000 7f70dd000640 1 --2- 172.21.15.103:0/4004362840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70d815be30 0x7f70d80b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.489+0000 7f70dd000640 1 --2- 172.21.15.103:0/4004362840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70d80b09c0 0x7f70d80cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.489+0000 7f70dd000640 1 --2- 172.21.15.103:0/4004362840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d80ae9c0 0x7f70d8156a90 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.489+0000 7f70dd000640 1 -- 172.21.15.103:0/4004362840 >> 172.21.15.103:0/4004362840 conn(0x7f70d80d1ac0 msgr2=0x7f70d8157bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:15.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.489+0000 7f70dd000640 1 -- 172.21.15.103:0/4004362840 shutdown_connections 2024-09-10T22:45:15.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.489+0000 7f70dd000640 1 -- 172.21.15.103:0/4004362840 wait complete. 2024-09-10T22:45:15.512 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:45:15.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.649+0000 7f3028400640 1 -- 172.21.15.103:0/3185113892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f302015f230 msgr2=0x7f30200cf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:15.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.649+0000 7f3028400640 1 --2- 172.21.15.103:0/3185113892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f302015f230 0x7f30200cf9d0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f3014009840 tx=0x7f301401c700 comp rx=0 tx=0).stop 2024-09-10T22:45:15.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.649+0000 7f3028400640 1 -- 172.21.15.103:0/3185113892 shutdown_connections 2024-09-10T22:45:15.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.649+0000 7f3028400640 1 --2- 172.21.15.103:0/3185113892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f302015f230 0x7f30200cf9d0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.649+0000 7f3028400640 1 -- 172.21.15.103:0/3185113892 >> 172.21.15.103:0/3185113892 conn(0x7f30200d1ad0 msgr2=0x7f30200d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:15.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.649+0000 7f3028400640 1 -- 172.21.15.103:0/3185113892 shutdown_connections 2024-09-10T22:45:15.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.649+0000 7f3028400640 1 -- 172.21.15.103:0/3185113892 wait complete. 2024-09-10T22:45:15.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3028400640 1 Processor -- start 2024-09-10T22:45:15.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3028400640 1 -- start start 2024-09-10T22:45:15.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3028400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30200af1b0 0x7f30200c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:15.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3028400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30200b2a00 0x7f30200c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:15.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3028400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f302015f230 0x7f30200c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:15.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3028400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f302016a4f0 con 0x7f30200af1b0 2024-09-10T22:45:15.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3028400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f302016a370 con 0x7f30200b2a00 2024-09-10T22:45:15.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3028400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f302016a670 con 0x7f302015f230 2024-09-10T22:45:15.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3025a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30200af1b0 0x7f30200c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:15.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3025a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30200af1b0 0x7f30200c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39680/0 (socket says 172.21.15.103:39680) 2024-09-10T22:45:15.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3025a00640 1 -- 172.21.15.103:0/3275497538 learned_addr learned my addr 172.21.15.103:0/3275497538 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:15.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3025a00640 1 -- 172.21.15.103:0/3275497538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f302015f230 msgr2=0x7f30200c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:15.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3025a00640 1 --2- 172.21.15.103:0/3275497538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f302015f230 0x7f30200c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3025a00640 1 -- 172.21.15.103:0/3275497538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30200b2a00 msgr2=0x7f30200c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:15.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3025a00640 1 --2- 172.21.15.103:0/3275497538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30200b2a00 0x7f30200c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3025a00640 1 -- 172.21.15.103:0/3275497538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302015c2d0 con 0x7f30200af1b0 2024-09-10T22:45:15.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3025a00640 1 --2- 172.21.15.103:0/3275497538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30200af1b0 0x7f30200c5fc0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f3014009790 tx=0x7f3014004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:15.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f301d600640 1 -- 172.21.15.103:0/3275497538 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30140b2040 con 0x7f30200af1b0 2024-09-10T22:45:15.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f301d600640 1 -- 172.21.15.103:0/3275497538 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3014004430 con 0x7f30200af1b0 2024-09-10T22:45:15.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f301d600640 1 -- 172.21.15.103:0/3275497538 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3014005290 con 0x7f30200af1b0 2024-09-10T22:45:15.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3028400640 1 -- 172.21.15.103:0/3275497538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f302014d190 con 0x7f30200af1b0 2024-09-10T22:45:15.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3028400640 1 -- 172.21.15.103:0/3275497538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30200b5cb0 con 0x7f30200af1b0 2024-09-10T22:45:15.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.653+0000 7f3028400640 1 -- 172.21.15.103:0/3275497538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30200af640 con 0x7f30200af1b0 2024-09-10T22:45:15.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.657+0000 7f301d600640 1 -- 172.21.15.103:0/3275497538 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f30140b5070 con 0x7f30200af1b0 2024-09-10T22:45:15.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.657+0000 7f301d600640 1 --2- 172.21.15.103:0/3275497538 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3000072610 0x7f3000074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:15.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.657+0000 7f301d600640 1 -- 172.21.15.103:0/3275497538 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7f301412cff0 con 0x7f30200af1b0 2024-09-10T22:45:15.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.657+0000 7f3025000640 1 --2- 172.21.15.103:0/3275497538 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3000072610 0x7f3000074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:15.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.657+0000 7f3025000640 1 --2- 172.21.15.103:0/3275497538 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3000072610 0x7f3000074ad0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f30200d1f20 tx=0x7f300c0079c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:15.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.661+0000 7f301d600640 1 -- 172.21.15.103:0/3275497538 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3014016410 con 0x7f30200af1b0 2024-09-10T22:45:15.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.825+0000 7f3028400640 1 -- 172.21.15.103:0/3275497538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30200d1f50 con 0x7f30200af1b0 2024-09-10T22:45:15.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.829+0000 7f301d600640 1 -- 172.21.15.103:0/3275497538 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+17199 (secure 0 0 0) 0x7f30140f8640 con 0x7f30200af1b0 2024-09-10T22:45:15.834 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:15.834 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":94,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:44:33.227164+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:44:21.248484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-10T22:44:22.526092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.10","mappings":[{"from":1,"to":2}]},{"pgid":"14.29","mappings":[{"from":1,"to":7}]},{"pgid":"14.2c","mappings":[{"from":1,"to":7}]},{"pgid":"14.2d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:45:15.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.829+0000 7f3028400640 1 -- 172.21.15.103:0/3275497538 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3000072610 msgr2=0x7f3000074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:15.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.829+0000 7f3028400640 1 --2- 172.21.15.103:0/3275497538 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3000072610 0x7f3000074ad0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f30200d1f20 tx=0x7f300c0079c0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.829+0000 7f3028400640 1 -- 172.21.15.103:0/3275497538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30200af1b0 msgr2=0x7f30200c5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.829+0000 7f3028400640 1 --2- 172.21.15.103:0/3275497538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30200af1b0 0x7f30200c5fc0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f3014009790 tx=0x7f3014004040 comp rx=0 tx=0).stop 2024-09-10T22:45:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.829+0000 7f3028400640 1 -- 172.21.15.103:0/3275497538 shutdown_connections 2024-09-10T22:45:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.829+0000 7f3028400640 1 --2- 172.21.15.103:0/3275497538 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3000072610 0x7f3000074ad0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.829+0000 7f3028400640 1 --2- 172.21.15.103:0/3275497538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f302015f230 0x7f30200c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.829+0000 7f3028400640 1 --2- 172.21.15.103:0/3275497538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30200b2a00 0x7f30200c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.829+0000 7f3028400640 1 --2- 172.21.15.103:0/3275497538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30200af1b0 0x7f30200c5fc0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.829+0000 7f3028400640 1 -- 172.21.15.103:0/3275497538 >> 172.21.15.103:0/3275497538 conn(0x7f30200d1ad0 msgr2=0x7f3020071ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.829+0000 7f3028400640 1 -- 172.21.15.103:0/3275497538 shutdown_connections 2024-09-10T22:45:15.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.829+0000 7f3028400640 1 -- 172.21.15.103:0/3275497538 wait complete. 2024-09-10T22:45:15.854 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T22:45:15.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb57a00640 1 -- 172.21.15.103:0/3396143844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb50071be0 msgr2=0x7feb500cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:15.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb57a00640 1 --2- 172.21.15.103:0/3396143844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb50071be0 0x7feb500cf9c0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7feb48009bc0 tx=0x7feb4801ca80 comp rx=0 tx=0).stop 2024-09-10T22:45:15.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb57a00640 1 -- 172.21.15.103:0/3396143844 shutdown_connections 2024-09-10T22:45:15.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb57a00640 1 --2- 172.21.15.103:0/3396143844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb50071be0 0x7feb500cf9c0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb57a00640 1 --2- 172.21.15.103:0/3396143844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb5006cc00 0x7feb5006cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:15.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb57a00640 1 -- 172.21.15.103:0/3396143844 >> 172.21.15.103:0/3396143844 conn(0x7feb500d0940 msgr2=0x7feb500d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:15.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb57a00640 1 -- 172.21.15.103:0/3396143844 shutdown_connections 2024-09-10T22:45:15.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb57a00640 1 -- 172.21.15.103:0/3396143844 wait complete. 2024-09-10T22:45:15.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb57a00640 1 Processor -- start 2024-09-10T22:45:15.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb57a00640 1 -- start start 2024-09-10T22:45:15.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb57a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb5006cc00 0x7feb5014c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:15.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb57a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb50071be0 0x7feb50070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb57a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb500d1460 0x7feb50070b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb57a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feb50168900 con 0x7feb500d1460 2024-09-10T22:45:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb57a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feb50168780 con 0x7feb5006cc00 2024-09-10T22:45:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb57a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7feb50168a80 con 0x7feb50071be0 2024-09-10T22:45:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb55a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb500d1460 0x7feb50070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb55a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb500d1460 0x7feb50070b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39696/0 (socket says 172.21.15.103:39696) 2024-09-10T22:45:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb55a00640 1 -- 172.21.15.103:0/905070064 learned_addr learned my addr 172.21.15.103:0/905070064 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb4fe00640 1 --2- 172.21.15.103:0/905070064 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb50071be0 0x7feb50070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.993+0000 7feb55000640 1 --2- 172.21.15.103:0/905070064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb5006cc00 0x7feb5014c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.997+0000 7feb55a00640 1 -- 172.21.15.103:0/905070064 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb50071be0 msgr2=0x7feb50070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.997+0000 7feb55a00640 1 --2- 172.21.15.103:0/905070064 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb50071be0 0x7feb50070620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:16.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.997+0000 7feb55a00640 1 -- 172.21.15.103:0/905070064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb5006cc00 msgr2=0x7feb5014c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:16.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.997+0000 7feb55a00640 1 --2- 172.21.15.103:0/905070064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb5006cc00 0x7feb5014c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:16.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.997+0000 7feb55a00640 1 -- 172.21.15.103:0/905070064 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb50151f30 con 0x7feb500d1460 2024-09-10T22:45:16.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.997+0000 7feb55a00640 1 --2- 172.21.15.103:0/905070064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb500d1460 0x7feb50070b60 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7feb4801a6b0 tx=0x7feb480092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:16.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.997+0000 7feb4cc00640 1 -- 172.21.15.103:0/905070064 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb480bc070 con 0x7feb500d1460 2024-09-10T22:45:16.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.997+0000 7feb4cc00640 1 -- 172.21.15.103:0/905070064 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb480042f0 con 0x7feb500d1460 2024-09-10T22:45:16.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.997+0000 7feb57a00640 1 -- 172.21.15.103:0/905070064 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb50152210 con 0x7feb500d1460 2024-09-10T22:45:16.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.997+0000 7feb4cc00640 1 -- 172.21.15.103:0/905070064 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb480b2040 con 0x7feb500d1460 2024-09-10T22:45:16.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.997+0000 7feb57a00640 1 -- 172.21.15.103:0/905070064 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb501503f0 con 0x7feb500d1460 2024-09-10T22:45:16.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.997+0000 7feb57a00640 1 -- 172.21.15.103:0/905070064 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb5006cfe0 con 0x7feb500d1460 2024-09-10T22:45:16.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:15.997+0000 7feb4cc00640 1 -- 172.21.15.103:0/905070064 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7feb480b5070 con 0x7feb500d1460 2024-09-10T22:45:16.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.001+0000 7feb4cc00640 1 --2- 172.21.15.103:0/905070064 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feb300725e0 0x7feb30074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:16.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.001+0000 7feb4cc00640 1 -- 172.21.15.103:0/905070064 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6217+0+0 (secure 0 0 0) 0x7feb4812d060 con 0x7feb500d1460 2024-09-10T22:45:16.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.001+0000 7feb55000640 1 --2- 172.21.15.103:0/905070064 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feb300725e0 0x7feb30074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:16.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.001+0000 7feb55000640 1 --2- 172.21.15.103:0/905070064 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feb300725e0 0x7feb30074aa0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7feb4000bc00 tx=0x7feb4000b390 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:16.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.001+0000 7feb4cc00640 1 -- 172.21.15.103:0/905070064 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7feb48016790 con 0x7feb500d1460 2024-09-10T22:45:16.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.201+0000 7feb57a00640 1 -- 172.21.15.103:0/905070064 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7feb500b0c50 con 0x7feb500d1460 2024-09-10T22:45:16.204 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-10T22:45:16.201+0000 7fb5aba00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:45:16.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.201+0000 7feb4cc00640 1 -- 172.21.15.103:0/905070064 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v100) ==== 161+0+0 (secure 0 0 0) 0x7feb480f7e60 con 0x7feb500d1460 2024-09-10T22:45:16.206 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T22:45:16.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.205+0000 7feb57a00640 1 -- 172.21.15.103:0/905070064 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feb300725e0 msgr2=0x7feb30074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:16.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.205+0000 7feb57a00640 1 --2- 172.21.15.103:0/905070064 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feb300725e0 0x7feb30074aa0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7feb4000bc00 tx=0x7feb4000b390 comp rx=0 tx=0).stop 2024-09-10T22:45:16.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.205+0000 7feb57a00640 1 -- 172.21.15.103:0/905070064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb500d1460 msgr2=0x7feb50070b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:16.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.205+0000 7feb57a00640 1 --2- 172.21.15.103:0/905070064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb500d1460 0x7feb50070b60 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7feb4801a6b0 tx=0x7feb480092a0 comp rx=0 tx=0).stop 2024-09-10T22:45:16.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.205+0000 7feb57a00640 1 -- 172.21.15.103:0/905070064 shutdown_connections 2024-09-10T22:45:16.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.205+0000 7feb57a00640 1 --2- 172.21.15.103:0/905070064 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feb300725e0 0x7feb30074aa0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:16.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.205+0000 7feb57a00640 1 --2- 172.21.15.103:0/905070064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb500d1460 0x7feb50070b60 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:16.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.205+0000 7feb57a00640 1 --2- 172.21.15.103:0/905070064 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb50071be0 0x7feb50070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:16.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.205+0000 7feb57a00640 1 --2- 172.21.15.103:0/905070064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb5006cc00 0x7feb5014c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:16.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.205+0000 7feb57a00640 1 -- 172.21.15.103:0/905070064 >> 172.21.15.103:0/905070064 conn(0x7feb500d0940 msgr2=0x7feb500d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:16.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.205+0000 7feb57a00640 1 -- 172.21.15.103:0/905070064 shutdown_connections 2024-09-10T22:45:16.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.205+0000 7feb57a00640 1 -- 172.21.15.103:0/905070064 wait complete. 2024-09-10T22:45:16.223 INFO:tasks.ceph.mds.d.smithi131.stderr: -1019> 2024-09-10T22:44:58.910+0000 7fdcf9c00640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-10T22:44:40.868264+0000 1=0+1) n(v0 rc2024-09-10T22:44:40.868264+0000 2=0+2) (inest lock) (ifile excl) caps={7596=pAsLsXsFsx/-@6},l=7596 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5622792ac580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:44:40.868264+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:44:40.868264+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-10T22:44:40.868264+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-10T22:44:40.868264+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-10T22:45:16.223 INFO:tasks.ceph.mds.d.smithi131.stderr: -1005> 2024-09-10T22:44:58.910+0000 7fdcf9c00640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) caps={7596=pAsLsXsFs/-@3},l=7596 | request=0 lock=0 importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5622792acb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-10T22:45:16.225 INFO:tasks.ceph.mds.a.smithi103.stderr: -1145> 2024-09-10T22:44:58.905+0000 7f220a400640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-10T22:44:40.864709+0000 1=0+1) n(v2 rc2024-09-10T22:44:41.089657+0000 4=0+4) (inest lock) caps={7596=pAsLsXsFs/-@7},l=7596 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55a605c6a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:44:40.864709+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:44:41.089657+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-10T22:44:40.864709+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-10T22:44:41.089657+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-10T22:45:16.225 INFO:tasks.ceph.mds.a.smithi103.stderr: -995> 2024-09-10T22:44:58.905+0000 7f2212600640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-10T22:44:40.866487+0000 1=0+1) n(v1 rc2024-09-10T22:44:41.089657+0000 3=0+3) (inest sync->mix g=0,2 scatter_wanted) caps={7596=pAsLsXsFs/-@7} | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55a605c6ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:44:40.866487+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:44:40.868264+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-10T22:44:40.866487+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-10T22:44:41.089657+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-10T22:45:16.229 INFO:tasks.ceph.mds.c.smithi103.stderr: -2489> 2024-09-10T22:44:58.901+0000 7f11a9800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-10T22:44:40.861172+0000 1=0+1) n(v3 rc2024-09-10T22:44:41.089657+0000 6=0+6) (inest mix dirty) (ifile excl) caps={7596=pAsLsXsFsx/AsLsXsFsx@9},l=7596 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x560bb6269b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:44:40.861172+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:44:41.089657+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-10T22:44:40.861172+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-10T22:44:41.089657+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-10T22:45:16.229 INFO:tasks.ceph.mds.c.smithi103.stderr: -2356> 2024-09-10T22:44:58.905+0000 7f11b1a00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-10T22:44:40.863008+0000 1=0+1) n(v4 rc2024-09-10T22:44:41.089657+0000 5=0+5) (inest sync->mix g=1,2) caps={7596=pAsLsXsFs/-@11} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x560bb626a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:44:40.863008+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:44:41.089657+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-10T22:44:40.863008+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-10T22:44:41.089657+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-10T22:45:16.232 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T22:45:16.267 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2024-09-10T22:45:16.269 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-09-10T22:45:16.276 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-09-10T22:45:16.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.381+0000 7f9217e00640 1 -- 172.21.15.103:0/1405739237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9210072c10 msgr2=0x7f9210157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:16.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.381+0000 7f9217e00640 1 --2- 172.21.15.103:0/1405739237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9210072c10 0x7f9210157090 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f92100d0150 tx=0x7f920801cd80 comp rx=0 tx=0).stop 2024-09-10T22:45:16.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.381+0000 7f9217e00640 1 -- 172.21.15.103:0/1405739237 shutdown_connections 2024-09-10T22:45:16.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.381+0000 7f9217e00640 1 --2- 172.21.15.103:0/1405739237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9210072c10 0x7f9210157090 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:16.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.381+0000 7f9217e00640 1 --2- 172.21.15.103:0/1405739237 >> v2:172.21.15.131:3300/0 conn(0x7f92100cf260 0x7f92100b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:16.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.381+0000 7f9217e00640 1 -- 172.21.15.103:0/1405739237 >> 172.21.15.103:0/1405739237 conn(0x7f921006cc00 msgr2=0x7f921006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:16.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.381+0000 7f9217e00640 1 -- 172.21.15.103:0/1405739237 shutdown_connections 2024-09-10T22:45:16.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.381+0000 7f9217e00640 1 -- 172.21.15.103:0/1405739237 wait complete. 2024-09-10T22:45:16.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.381+0000 7f9217e00640 1 Processor -- start 2024-09-10T22:45:16.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.381+0000 7f9217e00640 1 -- start start 2024-09-10T22:45:16.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9217e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9210072c10 0x7f921014ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:16.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9217e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92100b3150 0x7f9210148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:16.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9217e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92100cf260 0x7f92101f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:16.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9217e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f921006e960 con 0x7f9210072c10 2024-09-10T22:45:16.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9217e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f921006e7e0 con 0x7f92100b3150 2024-09-10T22:45:16.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9217e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f921006eae0 con 0x7f92100cf260 2024-09-10T22:45:16.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9215400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9210072c10 0x7f921014ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:16.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9215400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9210072c10 0x7f921014ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39738/0 (socket says 172.21.15.103:39738) 2024-09-10T22:45:16.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9215400640 1 -- 172.21.15.103:0/3354269050 learned_addr learned my addr 172.21.15.103:0/3354269050 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:16.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9214a00640 1 --2- 172.21.15.103:0/3354269050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92100b3150 0x7f9210148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:16.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9215e00640 1 --2- 172.21.15.103:0/3354269050 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92100cf260 0x7f92101f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:16.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9215400640 1 -- 172.21.15.103:0/3354269050 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92100cf260 msgr2=0x7f92101f5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:16.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9215400640 1 --2- 172.21.15.103:0/3354269050 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92100cf260 0x7f92101f5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:16.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9215400640 1 -- 172.21.15.103:0/3354269050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92100b3150 msgr2=0x7f9210148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:16.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9215400640 1 --2- 172.21.15.103:0/3354269050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92100b3150 0x7f9210148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:16.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9215400640 1 -- 172.21.15.103:0/3354269050 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92101653a0 con 0x7f9210072c10 2024-09-10T22:45:16.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9215400640 1 --2- 172.21.15.103:0/3354269050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9210072c10 0x7f921014ef80 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f920400eac0 tx=0x7f920400ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:16.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f920d600640 1 -- 172.21.15.103:0/3354269050 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920401b070 con 0x7f9210072c10 2024-09-10T22:45:16.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f920d600640 1 -- 172.21.15.103:0/3354269050 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f920400ccb0 con 0x7f9210072c10 2024-09-10T22:45:16.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f920d600640 1 -- 172.21.15.103:0/3354269050 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204016670 con 0x7f9210072c10 2024-09-10T22:45:16.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9217e00640 1 -- 172.21.15.103:0/3354269050 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9210165680 con 0x7f9210072c10 2024-09-10T22:45:16.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9217e00640 1 -- 172.21.15.103:0/3354269050 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9210165960 con 0x7f9210072c10 2024-09-10T22:45:16.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f9217e00640 1 -- 172.21.15.103:0/3354269050 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f921014c7f0 con 0x7f9210072c10 2024-09-10T22:45:16.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.385+0000 7f920d600640 1 -- 172.21.15.103:0/3354269050 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f920400b040 con 0x7f9210072c10 2024-09-10T22:45:16.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.389+0000 7f920d600640 1 --2- 172.21.15.103:0/3354269050 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f91f00725e0 0x7f91f0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:16.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.389+0000 7f920d600640 1 -- 172.21.15.103:0/3354269050 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6475+0+0 (secure 0 0 0) 0x7f9204093780 con 0x7f9210072c10 2024-09-10T22:45:16.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.389+0000 7f9214a00640 1 --2- 172.21.15.103:0/3354269050 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f91f00725e0 0x7f91f0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:16.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.389+0000 7f9214a00640 1 --2- 172.21.15.103:0/3354269050 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f91f00725e0 0x7f91f0074aa0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f92101550b0 tx=0x7f91fc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:16.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.397+0000 7f920d600640 1 -- 172.21.15.103:0/3354269050 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f920405e470 con 0x7f9210072c10 2024-09-10T22:45:16.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:16.593+0000 7f9217e00640 1 -- 172.21.15.103:0/3354269050 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9210158af0 con 0x7f9210072c10 2024-09-10T22:45:17.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.205+0000 7f920d600640 1 -- 172.21.15.103:0/3354269050 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v101) ==== 104+0+0 (secure 0 0 0) 0x7f9204062ea0 con 0x7f9210072c10 2024-09-10T22:45:17.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.205+0000 7f9217e00640 1 -- 172.21.15.103:0/3354269050 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f91f00725e0 msgr2=0x7f91f0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:17.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.205+0000 7f9217e00640 1 --2- 172.21.15.103:0/3354269050 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f91f00725e0 0x7f91f0074aa0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f92101550b0 tx=0x7f91fc009040 comp rx=0 tx=0).stop 2024-09-10T22:45:17.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.205+0000 7f9217e00640 1 -- 172.21.15.103:0/3354269050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9210072c10 msgr2=0x7f921014ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:17.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.205+0000 7f9217e00640 1 --2- 172.21.15.103:0/3354269050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9210072c10 0x7f921014ef80 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f920400eac0 tx=0x7f920400ef80 comp rx=0 tx=0).stop 2024-09-10T22:45:17.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.205+0000 7f9217e00640 1 -- 172.21.15.103:0/3354269050 shutdown_connections 2024-09-10T22:45:17.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.205+0000 7f9217e00640 1 --2- 172.21.15.103:0/3354269050 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f91f00725e0 0x7f91f0074aa0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:17.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.205+0000 7f9217e00640 1 --2- 172.21.15.103:0/3354269050 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92100cf260 0x7f92101f5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:17.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.205+0000 7f9217e00640 1 --2- 172.21.15.103:0/3354269050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92100b3150 0x7f9210148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:17.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.205+0000 7f9217e00640 1 --2- 172.21.15.103:0/3354269050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9210072c10 0x7f921014ef80 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:17.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.205+0000 7f9217e00640 1 -- 172.21.15.103:0/3354269050 >> 172.21.15.103:0/3354269050 conn(0x7f921006cc00 msgr2=0x7f9210159740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:17.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.209+0000 7f9217e00640 1 -- 172.21.15.103:0/3354269050 shutdown_connections 2024-09-10T22:45:17.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.209+0000 7f9217e00640 1 -- 172.21.15.103:0/3354269050 wait complete. 2024-09-10T22:45:17.238 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T22:45:17.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.429+0000 7f3221a00640 1 -- 172.21.15.103:0/2012815354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3200004810 msgr2=0x7f3200004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:17.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.429+0000 7f3221a00640 1 --2- 172.21.15.103:0/2012815354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3200004810 0x7f3200004c90 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f321c0ce200 tx=0x7f320401cd80 comp rx=0 tx=0).stop 2024-09-10T22:45:17.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.429+0000 7f321b400640 1 -- 172.21.15.103:0/2012815354 reap_dead start 2024-09-10T22:45:17.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.429+0000 7f3221a00640 1 -- 172.21.15.103:0/2012815354 shutdown_connections 2024-09-10T22:45:17.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.429+0000 7f3221a00640 1 -- 172.21.15.103:0/2012815354 >> 172.21.15.103:0/2012815354 conn(0x7f321c0d1a20 msgr2=0x7f321c0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:17.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.429+0000 7f3221a00640 1 -- 172.21.15.103:0/2012815354 shutdown_connections 2024-09-10T22:45:17.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.429+0000 7f3221a00640 1 -- 172.21.15.103:0/2012815354 wait complete. 2024-09-10T22:45:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f3221a00640 1 Processor -- start 2024-09-10T22:45:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f3221a00640 1 -- start start 2024-09-10T22:45:17.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f3221a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3200004810 0x7f321c148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:17.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f3221a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f321c1f33d0 0x7f321c0cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:17.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f3221a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f321c0ca780 0x7f321c0cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:17.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f3221a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f321c0ae7f0 con 0x7f321c0ca780 2024-09-10T22:45:17.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f3221a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f321c15f660 con 0x7f321c1f33d0 2024-09-10T22:45:17.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f3221a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f321c0ae970 con 0x7f3200004810 2024-09-10T22:45:17.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f321b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f321c0ca780 0x7f321c0cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:17.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f321b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f321c0ca780 0x7f321c0cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51340/0 (socket says 172.21.15.103:51340) 2024-09-10T22:45:17.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f321b400640 1 -- 172.21.15.103:0/2670836287 learned_addr learned my addr 172.21.15.103:0/2670836287 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:17.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f321aa00640 1 --2- 172.21.15.103:0/2670836287 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3200004810 0x7f321c148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:17.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f3212000640 1 --2- 172.21.15.103:0/2670836287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f321c1f33d0 0x7f321c0cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:17.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f321b400640 1 -- 172.21.15.103:0/2670836287 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3200004810 msgr2=0x7f321c148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:17.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f321b400640 1 --2- 172.21.15.103:0/2670836287 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3200004810 0x7f321c148bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:17.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f321b400640 1 -- 172.21.15.103:0/2670836287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f321c1f33d0 msgr2=0x7f321c0cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:17.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f321b400640 1 --2- 172.21.15.103:0/2670836287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f321c1f33d0 0x7f321c0cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:17.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f321b400640 1 -- 172.21.15.103:0/2670836287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321c1f3850 con 0x7f321c0ca780 2024-09-10T22:45:17.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f321b400640 1 --2- 172.21.15.103:0/2670836287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f321c0ca780 0x7f321c0cac00 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f321c074100 tx=0x7f3214011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:17.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f3213400640 1 -- 172.21.15.103:0/2670836287 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32140137e0 con 0x7f321c0ca780 2024-09-10T22:45:17.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f3213400640 1 -- 172.21.15.103:0/2670836287 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3214018020 con 0x7f321c0ca780 2024-09-10T22:45:17.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f3213400640 1 -- 172.21.15.103:0/2670836287 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3214013cf0 con 0x7f321c0ca780 2024-09-10T22:45:17.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f3221a00640 1 -- 172.21.15.103:0/2670836287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f321c149240 con 0x7f321c0ca780 2024-09-10T22:45:17.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.433+0000 7f3221a00640 1 -- 172.21.15.103:0/2670836287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f321c149800 con 0x7f321c0ca780 2024-09-10T22:45:17.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.437+0000 7f3221a00640 1 -- 172.21.15.103:0/2670836287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f321c070970 con 0x7f321c0ca780 2024-09-10T22:45:17.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.437+0000 7f3213400640 1 -- 172.21.15.103:0/2670836287 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3214010040 con 0x7f321c0ca780 2024-09-10T22:45:17.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.437+0000 7f3213400640 1 --2- 172.21.15.103:0/2670836287 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31f80725e0 0x7f31f8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:17.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.437+0000 7f3213400640 1 -- 172.21.15.103:0/2670836287 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6475+0+0 (secure 0 0 0) 0x7f3214096d20 con 0x7f321c0ca780 2024-09-10T22:45:17.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.437+0000 7f321aa00640 1 --2- 172.21.15.103:0/2670836287 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31f80725e0 0x7f31f8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:17.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.441+0000 7f321aa00640 1 --2- 172.21.15.103:0/2670836287 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31f80725e0 0x7f31f8074aa0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f320c0069a0 tx=0x7f320c006930 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:17.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.441+0000 7f3213400640 1 -- 172.21.15.103:0/2670836287 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3214022030 con 0x7f321c0ca780 2024-09-10T22:45:17.498 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:45:17.501 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:45:17.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:17.609+0000 7f3221a00640 1 -- 172.21.15.103:0/2670836287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f321c15da30 con 0x7f321c0ca780 2024-09-10T22:45:18.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.401+0000 7f3213400640 1 -- 172.21.15.103:0/2670836287 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v96) ==== 181+0+0 (secure 0 0 0) 0x7f32140620f0 con 0x7f321c0ca780 2024-09-10T22:45:18.404 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2024-09-10T22:45:18.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.405+0000 7f3221a00640 1 -- 172.21.15.103:0/2670836287 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31f80725e0 msgr2=0x7f31f8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.405+0000 7f3221a00640 1 --2- 172.21.15.103:0/2670836287 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31f80725e0 0x7f31f8074aa0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f320c0069a0 tx=0x7f320c006930 comp rx=0 tx=0).stop 2024-09-10T22:45:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.405+0000 7f3221a00640 1 -- 172.21.15.103:0/2670836287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f321c0ca780 msgr2=0x7f321c0cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.405+0000 7f3221a00640 1 --2- 172.21.15.103:0/2670836287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f321c0ca780 0x7f321c0cac00 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f321c074100 tx=0x7f3214011a30 comp rx=0 tx=0).stop 2024-09-10T22:45:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.405+0000 7f3221a00640 1 -- 172.21.15.103:0/2670836287 shutdown_connections 2024-09-10T22:45:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.405+0000 7f3221a00640 1 --2- 172.21.15.103:0/2670836287 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f31f80725e0 0x7f31f8074aa0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.405+0000 7f3221a00640 1 --2- 172.21.15.103:0/2670836287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f321c0ca780 0x7f321c0cac00 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.405+0000 7f3221a00640 1 --2- 172.21.15.103:0/2670836287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f321c1f33d0 0x7f321c0cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.405+0000 7f3221a00640 1 --2- 172.21.15.103:0/2670836287 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3200004810 0x7f321c148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.405+0000 7f3221a00640 1 -- 172.21.15.103:0/2670836287 >> 172.21.15.103:0/2670836287 conn(0x7f321c0d1a20 msgr2=0x7f321c15cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:18.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.405+0000 7f3221a00640 1 -- 172.21.15.103:0/2670836287 shutdown_connections 2024-09-10T22:45:18.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.405+0000 7f3221a00640 1 -- 172.21.15.103:0/2670836287 wait complete. 2024-09-10T22:45:18.435 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T22:45:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88f1800640 1 -- 172.21.15.103:0/829359095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88ec06f0c0 msgr2=0x7f88ec073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88f1800640 1 --2- 172.21.15.103:0/829359095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88ec06f0c0 0x7f88ec073610 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009900 tx=0x7f88d801c8e0 comp rx=0 tx=0).stop 2024-09-10T22:45:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88f1800640 1 -- 172.21.15.103:0/829359095 shutdown_connections 2024-09-10T22:45:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88f1800640 1 --2- 172.21.15.103:0/829359095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88ec06f0c0 0x7f88ec073610 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88f1800640 1 --2- 172.21.15.103:0/829359095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88ec0cf9f0 0x7f88ec06eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88f1800640 1 -- 172.21.15.103:0/829359095 >> 172.21.15.103:0/829359095 conn(0x7f88ec06cc00 msgr2=0x7f88ec06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88f1800640 1 -- 172.21.15.103:0/829359095 shutdown_connections 2024-09-10T22:45:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88f1800640 1 -- 172.21.15.103:0/829359095 wait complete. 2024-09-10T22:45:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88f1800640 1 Processor -- start 2024-09-10T22:45:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88f1800640 1 -- start start 2024-09-10T22:45:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88f1800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88ec06f0c0 0x7f88ec157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88f1800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec0cf9f0 0x7f88ec1411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88f1800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88ec0cfdd0 0x7f88ec0ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88f1800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec0cd640 con 0x7f88ec06f0c0 2024-09-10T22:45:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88f1800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec0cd4c0 con 0x7f88ec0cf9f0 2024-09-10T22:45:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88f1800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f88ec0cd7c0 con 0x7f88ec0cfdd0 2024-09-10T22:45:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88eaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88ec06f0c0 0x7f88ec157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88eaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88ec06f0c0 0x7f88ec157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51370/0 (socket says 172.21.15.103:51370) 2024-09-10T22:45:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.581+0000 7f88eaa00640 1 -- 172.21.15.103:0/3466858230 learned_addr learned my addr 172.21.15.103:0/3466858230 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88ea000640 1 --2- 172.21.15.103:0/3466858230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec0cf9f0 0x7f88ec1411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88eaa00640 1 -- 172.21.15.103:0/3466858230 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88ec0cfdd0 msgr2=0x7f88ec0ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88eb400640 1 --2- 172.21.15.103:0/3466858230 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88ec0cfdd0 0x7f88ec0ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88eaa00640 1 --2- 172.21.15.103:0/3466858230 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88ec0cfdd0 0x7f88ec0ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88eaa00640 1 -- 172.21.15.103:0/3466858230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec0cf9f0 msgr2=0x7f88ec1411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88eaa00640 1 --2- 172.21.15.103:0/3466858230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec0cf9f0 0x7f88ec1411c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88eaa00640 1 -- 172.21.15.103:0/3466858230 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ec1526b0 con 0x7f88ec06f0c0 2024-09-10T22:45:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88ea000640 1 --2- 172.21.15.103:0/3466858230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec0cf9f0 0x7f88ec1411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88eb400640 1 --2- 172.21.15.103:0/3466858230 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88ec0cfdd0 0x7f88ec0ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88eaa00640 1 --2- 172.21.15.103:0/3466858230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88ec06f0c0 0x7f88ec157560 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00eb00 tx=0x7f88dc00c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88e2a00640 1 -- 172.21.15.103:0/3466858230 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc004b30 con 0x7f88ec06f0c0 2024-09-10T22:45:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88e2a00640 1 -- 172.21.15.103:0/3466858230 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88dc004de0 con 0x7f88ec06f0c0 2024-09-10T22:45:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88f1800640 1 -- 172.21.15.103:0/3466858230 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ec156a60 con 0x7f88ec06f0c0 2024-09-10T22:45:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88e2a00640 1 -- 172.21.15.103:0/3466858230 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc005280 con 0x7f88ec06f0c0 2024-09-10T22:45:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88f1800640 1 -- 172.21.15.103:0/3466858230 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ec156fc0 con 0x7f88ec06f0c0 2024-09-10T22:45:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88f1800640 1 -- 172.21.15.103:0/3466858230 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ec06eb80 con 0x7f88ec06f0c0 2024-09-10T22:45:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88e2a00640 1 -- 172.21.15.103:0/3466858230 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f88dc00f040 con 0x7f88ec06f0c0 2024-09-10T22:45:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88e2a00640 1 --2- 172.21.15.103:0/3466858230 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f88cc0725e0 0x7f88cc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.585+0000 7f88e2a00640 1 -- 172.21.15.103:0/3466858230 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6037+0+0 (secure 0 0 0) 0x7f88dc093b90 con 0x7f88ec06f0c0 2024-09-10T22:45:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.589+0000 7f88ea000640 1 --2- 172.21.15.103:0/3466858230 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f88cc0725e0 0x7f88cc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.589+0000 7f88ea000640 1 --2- 172.21.15.103:0/3466858230 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f88cc0725e0 0x7f88cc074aa0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f88d80af000 tx=0x7f88d801b120 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:18.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.589+0000 7f88e2a00640 1 -- 172.21.15.103:0/3466858230 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f88ec156a60 con 0x7f88ec06f0c0 2024-09-10T22:45:18.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:18.757+0000 7f88f1800640 1 -- 172.21.15.103:0/3466858230 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f88ec0b2020 con 0x7f88ec06f0c0 2024-09-10T22:45:19.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.405+0000 7f88e2a00640 1 -- 172.21.15.103:0/3466858230 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v97) ==== 169+0+0 (secure 0 0 0) 0x7f88dc016030 con 0x7f88ec06f0c0 2024-09-10T22:45:19.411 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2024-09-10T22:45:19.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.409+0000 7f88f1800640 1 -- 172.21.15.103:0/3466858230 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f88cc0725e0 msgr2=0x7f88cc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:19.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.409+0000 7f88f1800640 1 --2- 172.21.15.103:0/3466858230 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f88cc0725e0 0x7f88cc074aa0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f88d80af000 tx=0x7f88d801b120 comp rx=0 tx=0).stop 2024-09-10T22:45:19.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.409+0000 7f88f1800640 1 -- 172.21.15.103:0/3466858230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88ec06f0c0 msgr2=0x7f88ec157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:19.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.409+0000 7f88f1800640 1 --2- 172.21.15.103:0/3466858230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88ec06f0c0 0x7f88ec157560 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00eb00 tx=0x7f88dc00c270 comp rx=0 tx=0).stop 2024-09-10T22:45:19.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.409+0000 7f88f1800640 1 -- 172.21.15.103:0/3466858230 shutdown_connections 2024-09-10T22:45:19.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.409+0000 7f88f1800640 1 --2- 172.21.15.103:0/3466858230 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f88cc0725e0 0x7f88cc074aa0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:19.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.409+0000 7f88f1800640 1 --2- 172.21.15.103:0/3466858230 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88ec0cfdd0 0x7f88ec0ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:19.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.409+0000 7f88f1800640 1 --2- 172.21.15.103:0/3466858230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec0cf9f0 0x7f88ec1411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:19.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.409+0000 7f88f1800640 1 --2- 172.21.15.103:0/3466858230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88ec06f0c0 0x7f88ec157560 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:19.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.409+0000 7f88f1800640 1 -- 172.21.15.103:0/3466858230 >> 172.21.15.103:0/3466858230 conn(0x7f88ec06cc00 msgr2=0x7f88ec0cdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:19.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.409+0000 7f88f1800640 1 -- 172.21.15.103:0/3466858230 shutdown_connections 2024-09-10T22:45:19.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.409+0000 7f88f1800640 1 -- 172.21.15.103:0/3466858230 wait complete. 2024-09-10T22:45:19.444 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T22:45:19.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.585+0000 7fbe8dc00640 1 -- 172.21.15.103:0/116150613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe6c004810 msgr2=0x7fbe6c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:19.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.585+0000 7fbe8dc00640 1 --2- 172.21.15.103:0/116150613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe6c004810 0x7fbe6c004c90 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fbe700017f0 tx=0x7fbe7001c8b0 comp rx=0 tx=0).stop 2024-09-10T22:45:19.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.585+0000 7fbe87400640 1 -- 172.21.15.103:0/116150613 reap_dead start 2024-09-10T22:45:19.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.585+0000 7fbe8dc00640 1 -- 172.21.15.103:0/116150613 shutdown_connections 2024-09-10T22:45:19.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.585+0000 7fbe8dc00640 1 -- 172.21.15.103:0/116150613 >> 172.21.15.103:0/116150613 conn(0x7fbe880b1c00 msgr2=0x7fbe880b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:19.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.585+0000 7fbe8dc00640 1 -- 172.21.15.103:0/116150613 shutdown_connections 2024-09-10T22:45:19.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.585+0000 7fbe8dc00640 1 -- 172.21.15.103:0/116150613 wait complete. 2024-09-10T22:45:19.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.585+0000 7fbe8dc00640 1 Processor -- start 2024-09-10T22:45:19.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.585+0000 7fbe8dc00640 1 -- start start 2024-09-10T22:45:19.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe8dc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe6c004810 0x7fbe8815a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe8dc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe8815c320 0x7fbe8815c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe8dc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe880d04f0 0x7fbe880d0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe8dc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbe88169d60 con 0x7fbe6c004810 2024-09-10T22:45:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe8dc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbe88169be0 con 0x7fbe8815c320 2024-09-10T22:45:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe8dc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fbe88169ee0 con 0x7fbe880d04f0 2024-09-10T22:45:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe86a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe6c004810 0x7fbe8815a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe86a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe6c004810 0x7fbe8815a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51384/0 (socket says 172.21.15.103:51384) 2024-09-10T22:45:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe86a00640 1 -- 172.21.15.103:0/3919981610 learned_addr learned my addr 172.21.15.103:0/3919981610 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe87400640 1 --2- 172.21.15.103:0/3919981610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe880d04f0 0x7fbe880d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe7e000640 1 --2- 172.21.15.103:0/3919981610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe8815c320 0x7fbe8815c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe86a00640 1 -- 172.21.15.103:0/3919981610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe880d04f0 msgr2=0x7fbe880d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe86a00640 1 --2- 172.21.15.103:0/3919981610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe880d04f0 0x7fbe880d0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe86a00640 1 -- 172.21.15.103:0/3919981610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe8815c320 msgr2=0x7fbe8815c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe86a00640 1 --2- 172.21.15.103:0/3919981610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe8815c320 0x7fbe8815c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe86a00640 1 -- 172.21.15.103:0/3919981610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8815cce0 con 0x7fbe6c004810 2024-09-10T22:45:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe86a00640 1 --2- 172.21.15.103:0/3919981610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe6c004810 0x7fbe8815a840 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fbe78006450 tx=0x7fbe780039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe7f400640 1 -- 172.21.15.103:0/3919981610 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78015070 con 0x7fbe6c004810 2024-09-10T22:45:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe7f400640 1 -- 172.21.15.103:0/3919981610 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe78011840 con 0x7fbe6c004810 2024-09-10T22:45:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe7f400640 1 -- 172.21.15.103:0/3919981610 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78011c90 con 0x7fbe6c004810 2024-09-10T22:45:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe8dc00640 1 -- 172.21.15.103:0/3919981610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe881fb460 con 0x7fbe6c004810 2024-09-10T22:45:19.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe8dc00640 1 -- 172.21.15.103:0/3919981610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe881fba20 con 0x7fbe6c004810 2024-09-10T22:45:19.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.589+0000 7fbe8dc00640 1 -- 172.21.15.103:0/3919981610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe880cc970 con 0x7fbe6c004810 2024-09-10T22:45:19.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.593+0000 7fbe7f400640 1 -- 172.21.15.103:0/3919981610 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbe780103c0 con 0x7fbe6c004810 2024-09-10T22:45:19.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.593+0000 7fbe7f400640 1 --2- 172.21.15.103:0/3919981610 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbe64072610 0x7fbe64074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:19.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.593+0000 7fbe7f400640 1 -- 172.21.15.103:0/3919981610 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5507+0+0 (secure 0 0 0) 0x7fbe78094190 con 0x7fbe6c004810 2024-09-10T22:45:19.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.593+0000 7fbe7e000640 1 --2- 172.21.15.103:0/3919981610 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbe64072610 0x7fbe64074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:19.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.593+0000 7fbe7e000640 1 --2- 172.21.15.103:0/3919981610 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbe64072610 0x7fbe64074ad0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbe700017c0 tx=0x7fbe70019650 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:19.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.597+0000 7fbe7f400640 1 -- 172.21.15.103:0/3919981610 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbe88070830 con 0x7fbe6c004810 2024-09-10T22:45:19.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.761+0000 7fbe8dc00640 1 -- 172.21.15.103:0/3919981610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7fbe881fc1a0 con 0x7fbe6c004810 2024-09-10T22:45:19.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.765+0000 7fbe7f400640 1 -- 172.21.15.103:0/3919981610 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v37) ==== 71+0+0 (secure 0 0 0) 0x7fbe7805f1c0 con 0x7fbe6c004810 2024-09-10T22:45:19.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.769+0000 7fbe8dc00640 1 -- 172.21.15.103:0/3919981610 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbe64072610 msgr2=0x7fbe64074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:19.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.769+0000 7fbe8dc00640 1 --2- 172.21.15.103:0/3919981610 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbe64072610 0x7fbe64074ad0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbe700017c0 tx=0x7fbe70019650 comp rx=0 tx=0).stop 2024-09-10T22:45:19.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.769+0000 7fbe8dc00640 1 -- 172.21.15.103:0/3919981610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe6c004810 msgr2=0x7fbe8815a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:19.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.769+0000 7fbe8dc00640 1 --2- 172.21.15.103:0/3919981610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe6c004810 0x7fbe8815a840 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fbe78006450 tx=0x7fbe780039d0 comp rx=0 tx=0).stop 2024-09-10T22:45:19.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.769+0000 7fbe8dc00640 1 -- 172.21.15.103:0/3919981610 shutdown_connections 2024-09-10T22:45:19.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.769+0000 7fbe8dc00640 1 --2- 172.21.15.103:0/3919981610 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbe64072610 0x7fbe64074ad0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:19.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.769+0000 7fbe8dc00640 1 --2- 172.21.15.103:0/3919981610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe880d04f0 0x7fbe880d0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:19.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.769+0000 7fbe8dc00640 1 --2- 172.21.15.103:0/3919981610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe8815c320 0x7fbe8815c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:19.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.769+0000 7fbe8dc00640 1 --2- 172.21.15.103:0/3919981610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe6c004810 0x7fbe8815a840 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:19.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.769+0000 7fbe8dc00640 1 -- 172.21.15.103:0/3919981610 >> 172.21.15.103:0/3919981610 conn(0x7fbe880b1c00 msgr2=0x7fbe88074000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:19.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.769+0000 7fbe8dc00640 1 -- 172.21.15.103:0/3919981610 shutdown_connections 2024-09-10T22:45:19.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.769+0000 7fbe8dc00640 1 -- 172.21.15.103:0/3919981610 wait complete. 2024-09-10T22:45:19.791 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0' 2024-09-10T22:45:19.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.933+0000 7f0101a00640 1 -- 172.21.15.103:0/3820711679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00fc0cc120 msgr2=0x7f00fc0aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:19.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.933+0000 7f0101a00640 1 --2- 172.21.15.103:0/3820711679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00fc0cc120 0x7f00fc0aeb40 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009bc0 tx=0x7f00ec01cae0 comp rx=0 tx=0).stop 2024-09-10T22:45:19.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.933+0000 7f0101a00640 1 -- 172.21.15.103:0/3820711679 shutdown_connections 2024-09-10T22:45:19.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.933+0000 7f0101a00640 1 --2- 172.21.15.103:0/3820711679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00fc0cc120 0x7f00fc0aeb40 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:19.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.933+0000 7f0101a00640 1 -- 172.21.15.103:0/3820711679 >> 172.21.15.103:0/3820711679 conn(0x7f00fc06cc00 msgr2=0x7f00fc06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:19.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.933+0000 7f0101a00640 1 -- 172.21.15.103:0/3820711679 shutdown_connections 2024-09-10T22:45:19.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.933+0000 7f0101a00640 1 -- 172.21.15.103:0/3820711679 wait complete. 2024-09-10T22:45:19.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f0101a00640 1 Processor -- start 2024-09-10T22:45:19.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f0101a00640 1 -- start start 2024-09-10T22:45:19.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f0101a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00fc0cc120 0x7f00fc0b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:19.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f0101a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00fc0cf790 0x7f00fc06fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:19.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f0101a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00fc15c970 0x7f00fc143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:19.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f0101a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc16a250 con 0x7f00fc0cc120 2024-09-10T22:45:19.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f0101a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc16a0d0 con 0x7f00fc15c970 2024-09-10T22:45:19.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f0101a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f00fc16a3d0 con 0x7f00fc0cf790 2024-09-10T22:45:19.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f00faa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00fc0cc120 0x7f00fc0b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f00faa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00fc0cc120 0x7f00fc0b1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51396/0 (socket says 172.21.15.103:51396) 2024-09-10T22:45:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f00faa00640 1 -- 172.21.15.103:0/1913497130 learned_addr learned my addr 172.21.15.103:0/1913497130 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f00faa00640 1 -- 172.21.15.103:0/1913497130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00fc0cf790 msgr2=0x7f00fc06fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f00faa00640 1 --2- 172.21.15.103:0/1913497130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00fc0cf790 0x7f00fc06fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f00faa00640 1 -- 172.21.15.103:0/1913497130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00fc15c970 msgr2=0x7f00fc143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f00faa00640 1 --2- 172.21.15.103:0/1913497130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00fc15c970 0x7f00fc143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f00faa00640 1 -- 172.21.15.103:0/1913497130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00fc156450 con 0x7f00fc0cc120 2024-09-10T22:45:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f00faa00640 1 --2- 172.21.15.103:0/1913497130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00fc0cc120 0x7f00fc0b1c30 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0b0040 tx=0x7f00ec0a5b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:19.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f00f2a00640 1 -- 172.21.15.103:0/1913497130 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec0bc070 con 0x7f00fc0cc120 2024-09-10T22:45:19.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f00f2a00640 1 -- 172.21.15.103:0/1913497130 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00ec0a5e50 con 0x7f00fc0cc120 2024-09-10T22:45:19.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f00f2a00640 1 -- 172.21.15.103:0/1913497130 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec0b2040 con 0x7f00fc0cc120 2024-09-10T22:45:19.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f0101a00640 1 -- 172.21.15.103:0/1913497130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00fc156730 con 0x7f00fc0cc120 2024-09-10T22:45:19.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f0101a00640 1 -- 172.21.15.103:0/1913497130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00fc156cf0 con 0x7f00fc0cc120 2024-09-10T22:45:19.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.937+0000 7f0101a00640 1 -- 172.21.15.103:0/1913497130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00fc0aeb40 con 0x7f00fc0cc120 2024-09-10T22:45:19.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.941+0000 7f00f2a00640 1 -- 172.21.15.103:0/1913497130 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f00ec0b5070 con 0x7f00fc0cc120 2024-09-10T22:45:19.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.941+0000 7f00f2a00640 1 --2- 172.21.15.103:0/1913497130 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f00dc0725e0 0x7f00dc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:19.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.941+0000 7f00f2a00640 1 -- 172.21.15.103:0/1913497130 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5507+0+0 (secure 0 0 0) 0x7f00ec12ce50 con 0x7f00fc0cc120 2024-09-10T22:45:19.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.941+0000 7f00fa000640 1 --2- 172.21.15.103:0/1913497130 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f00dc0725e0 0x7f00dc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:19.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.941+0000 7f00fa000640 1 --2- 172.21.15.103:0/1913497130 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f00dc0725e0 0x7f00dc074aa0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f00e8007fd0 tx=0x7f00e8007940 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:19.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:19.945+0000 7f00f2a00640 1 -- 172.21.15.103:0/1913497130 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f00ec016790 con 0x7f00fc0cc120 2024-09-10T22:45:20.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.169+0000 7f0101a00640 1 -- 172.21.15.103:0/1913497130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]} v 0) -- 0x7f00fc0ae500 con 0x7f00fc0cc120 2024-09-10T22:45:20.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.413+0000 7f00f2a00640 1 -- 172.21.15.103:0/1913497130 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]}]=0 v336) ==== 154+0+0 (secure 0 0 0) 0x7f00ec0f8550 con 0x7f00fc0cc120 2024-09-10T22:45:20.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.417+0000 7f0101a00640 1 -- 172.21.15.103:0/1913497130 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f00dc0725e0 msgr2=0x7f00dc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:20.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.417+0000 7f0101a00640 1 --2- 172.21.15.103:0/1913497130 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f00dc0725e0 0x7f00dc074aa0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f00e8007fd0 tx=0x7f00e8007940 comp rx=0 tx=0).stop 2024-09-10T22:45:20.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.417+0000 7f0101a00640 1 -- 172.21.15.103:0/1913497130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00fc0cc120 msgr2=0x7f00fc0b1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:20.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.417+0000 7f0101a00640 1 --2- 172.21.15.103:0/1913497130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00fc0cc120 0x7f00fc0b1c30 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0b0040 tx=0x7f00ec0a5b10 comp rx=0 tx=0).stop 2024-09-10T22:45:20.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.417+0000 7f0101a00640 1 -- 172.21.15.103:0/1913497130 shutdown_connections 2024-09-10T22:45:20.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.417+0000 7f0101a00640 1 --2- 172.21.15.103:0/1913497130 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f00dc0725e0 0x7f00dc074aa0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:20.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.417+0000 7f0101a00640 1 --2- 172.21.15.103:0/1913497130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00fc15c970 0x7f00fc143e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:20.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.417+0000 7f0101a00640 1 --2- 172.21.15.103:0/1913497130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00fc0cf790 0x7f00fc06fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:20.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.417+0000 7f0101a00640 1 --2- 172.21.15.103:0/1913497130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00fc0cc120 0x7f00fc0b1c30 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:20.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.417+0000 7f0101a00640 1 -- 172.21.15.103:0/1913497130 >> 172.21.15.103:0/1913497130 conn(0x7f00fc06cc00 msgr2=0x7f00fc15c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:20.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.417+0000 7f0101a00640 1 -- 172.21.15.103:0/1913497130 shutdown_connections 2024-09-10T22:45:20.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.417+0000 7f0101a00640 1 -- 172.21.15.103:0/1913497130 wait complete. 2024-09-10T22:45:20.439 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2024-09-10T22:45:20.440 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2024-09-10T22:45:20.440 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:45:20.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.577+0000 7f96fba00640 1 -- 172.21.15.103:0/466672462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96f415f2e0 msgr2=0x7f96f415f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:20.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.577+0000 7f96fba00640 1 --2- 172.21.15.103:0/466672462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96f415f2e0 0x7f96f415f6f0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f96f4072490 tx=0x7f96ec01cb80 comp rx=0 tx=0).stop 2024-09-10T22:45:20.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.577+0000 7f96fba00640 1 -- 172.21.15.103:0/466672462 shutdown_connections 2024-09-10T22:45:20.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.577+0000 7f96fba00640 1 --2- 172.21.15.103:0/466672462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96f415f2e0 0x7f96f415f6f0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:20.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.577+0000 7f96fba00640 1 --2- 172.21.15.103:0/466672462 >> v2:172.21.15.131:3300/0 conn(0x7f96f40cfdd0 0x7f96f415eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:20.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.577+0000 7f96fba00640 1 -- 172.21.15.103:0/466672462 >> 172.21.15.103:0/466672462 conn(0x7f96f406cc00 msgr2=0x7f96f406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:20.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.577+0000 7f96fba00640 1 -- 172.21.15.103:0/466672462 shutdown_connections 2024-09-10T22:45:20.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.577+0000 7f96fba00640 1 -- 172.21.15.103:0/466672462 wait complete. 2024-09-10T22:45:20.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.577+0000 7f96fba00640 1 Processor -- start 2024-09-10T22:45:20.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.577+0000 7f96fba00640 1 -- start start 2024-09-10T22:45:20.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96fba00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96f40cf9f0 0x7f96f415ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:20.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96fba00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96f40cfdd0 0x7f96f414a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:20.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96fba00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96f415f2e0 0x7f96f414f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:20.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96fba00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f96f40cd660 con 0x7f96f40cf9f0 2024-09-10T22:45:20.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96fba00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f96f40cd4e0 con 0x7f96f40cfdd0 2024-09-10T22:45:20.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96fba00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f96f40cd7e0 con 0x7f96f415f2e0 2024-09-10T22:45:20.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96f9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96f40cf9f0 0x7f96f415ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:20.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96f9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96f40cf9f0 0x7f96f415ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51420/0 (socket says 172.21.15.103:51420) 2024-09-10T22:45:20.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96f9000640 1 -- 172.21.15.103:0/2595473440 learned_addr learned my addr 172.21.15.103:0/2595473440 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:20.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96ebe00640 1 --2- 172.21.15.103:0/2595473440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96f40cfdd0 0x7f96f414a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:20.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96f9a00640 1 --2- 172.21.15.103:0/2595473440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96f415f2e0 0x7f96f414f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:20.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96f9000640 1 -- 172.21.15.103:0/2595473440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96f415f2e0 msgr2=0x7f96f414f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:20.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96f9000640 1 --2- 172.21.15.103:0/2595473440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96f415f2e0 0x7f96f414f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:20.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96f9000640 1 -- 172.21.15.103:0/2595473440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96f40cfdd0 msgr2=0x7f96f414a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:20.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96f9000640 1 --2- 172.21.15.103:0/2595473440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96f40cfdd0 0x7f96f414a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:20.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96f9000640 1 -- 172.21.15.103:0/2595473440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f414e310 con 0x7f96f40cf9f0 2024-09-10T22:45:20.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96f9a00640 1 --2- 172.21.15.103:0/2595473440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96f415f2e0 0x7f96f414f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:20.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96f9000640 1 --2- 172.21.15.103:0/2595473440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96f40cf9f0 0x7f96f415ad60 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f96e400c500 tx=0x7f96e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:20.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96f1600640 1 -- 172.21.15.103:0/2595473440 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4017070 con 0x7f96f40cf9f0 2024-09-10T22:45:20.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96f1600640 1 -- 172.21.15.103:0/2595473440 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96e4003600 con 0x7f96f40cf9f0 2024-09-10T22:45:20.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96f1600640 1 -- 172.21.15.103:0/2595473440 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4003a90 con 0x7f96f40cf9f0 2024-09-10T22:45:20.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96fba00640 1 -- 172.21.15.103:0/2595473440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f414e5f0 con 0x7f96f40cf9f0 2024-09-10T22:45:20.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96fba00640 1 -- 172.21.15.103:0/2595473440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f414ebb0 con 0x7f96f40cf9f0 2024-09-10T22:45:20.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96fba00640 1 -- 172.21.15.103:0/2595473440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96f415eda0 con 0x7f96f40cf9f0 2024-09-10T22:45:20.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.581+0000 7f96f1600640 1 -- 172.21.15.103:0/2595473440 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f96e4003c30 con 0x7f96f40cf9f0 2024-09-10T22:45:20.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.585+0000 7f96f1600640 1 --2- 172.21.15.103:0/2595473440 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f96d00725e0 0x7f96d0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:20.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.585+0000 7f96f1600640 1 -- 172.21.15.103:0/2595473440 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5507+0+0 (secure 0 0 0) 0x7f96e4092900 con 0x7f96f40cf9f0 2024-09-10T22:45:20.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.585+0000 7f96ebe00640 1 --2- 172.21.15.103:0/2595473440 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f96d00725e0 0x7f96d0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:20.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.585+0000 7f96ebe00640 1 --2- 172.21.15.103:0/2595473440 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f96d00725e0 0x7f96d0074aa0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f96f41f8650 tx=0x7f96dc00b390 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:20.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.589+0000 7f96f1600640 1 -- 172.21.15.103:0/2595473440 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f96e405db00 con 0x7f96f40cf9f0 2024-09-10T22:45:20.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.753+0000 7f96fba00640 1 -- 172.21.15.103:0/2595473440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96f414ed80 con 0x7f96f40cf9f0 2024-09-10T22:45:20.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.753+0000 7f96f1600640 1 -- 172.21.15.103:0/2595473440 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+13630 (secure 0 0 0) 0x7f96e4062530 con 0x7f96f40cf9f0 2024-09-10T22:45:20.758 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:20.758 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":97,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:45:19.405368+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.131:6836/1622106563":"2024-09-11T22:45:16.205147+0000","172.21.15.131:6834/1622106563":"2024-09-11T22:45:16.205147+0000","172.21.15.103:6834/3251348074":"2024-09-11T22:45:16.205161+0000","172.21.15.103:6832/3251348074":"2024-09-11T22:45:16.205161+0000","172.21.15.103:6835/187627880":"2024-09-11T22:45:16.205166+0000","172.21.15.103:6833/187627880":"2024-09-11T22:45:16.205166+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:45:20.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.757+0000 7f96fba00640 1 -- 172.21.15.103:0/2595473440 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f96d00725e0 msgr2=0x7f96d0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:20.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.757+0000 7f96fba00640 1 --2- 172.21.15.103:0/2595473440 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f96d00725e0 0x7f96d0074aa0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f96f41f8650 tx=0x7f96dc00b390 comp rx=0 tx=0).stop 2024-09-10T22:45:20.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.757+0000 7f96fba00640 1 -- 172.21.15.103:0/2595473440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96f40cf9f0 msgr2=0x7f96f415ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:20.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.757+0000 7f96fba00640 1 --2- 172.21.15.103:0/2595473440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96f40cf9f0 0x7f96f415ad60 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f96e400c500 tx=0x7f96e400c9c0 comp rx=0 tx=0).stop 2024-09-10T22:45:20.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.757+0000 7f96fba00640 1 -- 172.21.15.103:0/2595473440 shutdown_connections 2024-09-10T22:45:20.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.757+0000 7f96fba00640 1 --2- 172.21.15.103:0/2595473440 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f96d00725e0 0x7f96d0074aa0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:20.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.757+0000 7f96fba00640 1 --2- 172.21.15.103:0/2595473440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96f415f2e0 0x7f96f414f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:20.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.757+0000 7f96fba00640 1 --2- 172.21.15.103:0/2595473440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96f40cfdd0 0x7f96f414a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:20.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.757+0000 7f96fba00640 1 --2- 172.21.15.103:0/2595473440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96f40cf9f0 0x7f96f415ad60 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:20.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.757+0000 7f96fba00640 1 -- 172.21.15.103:0/2595473440 >> 172.21.15.103:0/2595473440 conn(0x7f96f406cc00 msgr2=0x7f96f4158cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:20.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.757+0000 7f96fba00640 1 -- 172.21.15.103:0/2595473440 shutdown_connections 2024-09-10T22:45:20.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.757+0000 7f96fba00640 1 -- 172.21.15.103:0/2595473440 wait complete. 2024-09-10T22:45:20.780 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T22:38:39.639064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T22:45:20.780 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T22:45:20.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4eca00640 1 -- 172.21.15.103:0/1713464011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e80b0510 msgr2=0x7fd4e8070430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:20.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4eca00640 1 --2- 172.21.15.103:0/1713464011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e80b0510 0x7fd4e8070430 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0009900 tx=0x7fd4e001c850 comp rx=0 tx=0).stop 2024-09-10T22:45:20.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4eca00640 1 -- 172.21.15.103:0/1713464011 shutdown_connections 2024-09-10T22:45:20.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4eca00640 1 --2- 172.21.15.103:0/1713464011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e80b0510 0x7fd4e8070430 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:20.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4eca00640 1 --2- 172.21.15.103:0/1713464011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4e80714d0 0x7fd4e80affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:20.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4eca00640 1 -- 172.21.15.103:0/1713464011 >> 172.21.15.103:0/1713464011 conn(0x7fd4e80d18f0 msgr2=0x7fd4e80d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:20.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4eca00640 1 -- 172.21.15.103:0/1713464011 shutdown_connections 2024-09-10T22:45:20.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4eca00640 1 -- 172.21.15.103:0/1713464011 wait complete. 2024-09-10T22:45:20.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4eca00640 1 Processor -- start 2024-09-10T22:45:20.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4eca00640 1 -- start start 2024-09-10T22:45:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4eca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e80714d0 0x7fd4e80b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4eca00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4e80b0510 0x7fd4e80b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4eca00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4e815f0e0 0x7fd4e815b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4eca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e8168d40 con 0x7fd4e80714d0 2024-09-10T22:45:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4eca00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e8168bc0 con 0x7fd4e80b0510 2024-09-10T22:45:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4eca00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e8168ec0 con 0x7fd4e815f0e0 2024-09-10T22:45:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4e6800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e80714d0 0x7fd4e80b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4e6800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e80714d0 0x7fd4e80b7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51448/0 (socket says 172.21.15.103:51448) 2024-09-10T22:45:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.921+0000 7fd4e6800640 1 -- 172.21.15.103:0/3939414865 learned_addr learned my addr 172.21.15.103:0/3939414865 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:20.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.925+0000 7fd4dde00640 1 --2- 172.21.15.103:0/3939414865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4e80b0510 0x7fd4e80b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:20.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.925+0000 7fd4e7200640 1 --2- 172.21.15.103:0/3939414865 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4e815f0e0 0x7fd4e815b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:20.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.925+0000 7fd4e6800640 1 -- 172.21.15.103:0/3939414865 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4e815f0e0 msgr2=0x7fd4e815b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:20.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.925+0000 7fd4e6800640 1 --2- 172.21.15.103:0/3939414865 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4e815f0e0 0x7fd4e815b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:20.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.925+0000 7fd4e6800640 1 -- 172.21.15.103:0/3939414865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4e80b0510 msgr2=0x7fd4e80b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:20.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.925+0000 7fd4e6800640 1 --2- 172.21.15.103:0/3939414865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4e80b0510 0x7fd4e80b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:20.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.925+0000 7fd4e6800640 1 -- 172.21.15.103:0/3939414865 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e80b36b0 con 0x7fd4e80714d0 2024-09-10T22:45:20.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.925+0000 7fd4e6800640 1 --2- 172.21.15.103:0/3939414865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e80714d0 0x7fd4e80b7190 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800c730 tx=0x7fd4d800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:20.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.925+0000 7fd4df400640 1 -- 172.21.15.103:0/3939414865 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8003b80 con 0x7fd4e80714d0 2024-09-10T22:45:20.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.925+0000 7fd4df400640 1 -- 172.21.15.103:0/3939414865 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4d8003d40 con 0x7fd4e80714d0 2024-09-10T22:45:20.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.925+0000 7fd4eca00640 1 -- 172.21.15.103:0/3939414865 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e80b3990 con 0x7fd4e80714d0 2024-09-10T22:45:20.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.925+0000 7fd4df400640 1 -- 172.21.15.103:0/3939414865 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d800aab0 con 0x7fd4e80714d0 2024-09-10T22:45:20.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.925+0000 7fd4eca00640 1 -- 172.21.15.103:0/3939414865 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e80b3f50 con 0x7fd4e80714d0 2024-09-10T22:45:20.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.925+0000 7fd4eca00640 1 -- 172.21.15.103:0/3939414865 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e80affd0 con 0x7fd4e80714d0 2024-09-10T22:45:20.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.925+0000 7fd4df400640 1 -- 172.21.15.103:0/3939414865 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd4d800ac50 con 0x7fd4e80714d0 2024-09-10T22:45:20.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.925+0000 7fd4df400640 1 --2- 172.21.15.103:0/3939414865 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4c4072610 0x7fd4c4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:20.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.929+0000 7fd4df400640 1 -- 172.21.15.103:0/3939414865 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5507+0+0 (secure 0 0 0) 0x7fd4d8092fe0 con 0x7fd4e80714d0 2024-09-10T22:45:20.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.929+0000 7fd4dde00640 1 --2- 172.21.15.103:0/3939414865 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4c4072610 0x7fd4c4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:20.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.929+0000 7fd4dde00640 1 --2- 172.21.15.103:0/3939414865 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4c4072610 0x7fd4c4074ad0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0005fd0 tx=0x7fd4d0005db0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:20.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:20.929+0000 7fd4df400640 1 -- 172.21.15.103:0/3939414865 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd4d805e770 con 0x7fd4e80714d0 2024-09-10T22:45:21.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.093+0000 7fd4eca00640 1 -- 172.21.15.103:0/3939414865 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd4e815e720 con 0x7fd4e80714d0 2024-09-10T22:45:21.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.093+0000 7fd4df400640 1 -- 172.21.15.103:0/3939414865 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) ==== 93+0+10 (secure 0 0 0) 0x7fd4d805e070 con 0x7fd4e80714d0 2024-09-10T22:45:21.099 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-09-10T22:45:21.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.097+0000 7fd4eca00640 1 -- 172.21.15.103:0/3939414865 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4c4072610 msgr2=0x7fd4c4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:21.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.097+0000 7fd4eca00640 1 --2- 172.21.15.103:0/3939414865 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4c4072610 0x7fd4c4074ad0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0005fd0 tx=0x7fd4d0005db0 comp rx=0 tx=0).stop 2024-09-10T22:45:21.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.097+0000 7fd4eca00640 1 -- 172.21.15.103:0/3939414865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e80714d0 msgr2=0x7fd4e80b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:21.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.097+0000 7fd4eca00640 1 --2- 172.21.15.103:0/3939414865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e80714d0 0x7fd4e80b7190 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800c730 tx=0x7fd4d800cbf0 comp rx=0 tx=0).stop 2024-09-10T22:45:21.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.097+0000 7fd4eca00640 1 -- 172.21.15.103:0/3939414865 shutdown_connections 2024-09-10T22:45:21.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.097+0000 7fd4eca00640 1 --2- 172.21.15.103:0/3939414865 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd4c4072610 0x7fd4c4074ad0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:21.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.097+0000 7fd4eca00640 1 --2- 172.21.15.103:0/3939414865 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4e815f0e0 0x7fd4e815b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:21.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.097+0000 7fd4eca00640 1 --2- 172.21.15.103:0/3939414865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4e80b0510 0x7fd4e80b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:21.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.097+0000 7fd4eca00640 1 --2- 172.21.15.103:0/3939414865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4e80714d0 0x7fd4e80b7190 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:21.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.097+0000 7fd4eca00640 1 -- 172.21.15.103:0/3939414865 >> 172.21.15.103:0/3939414865 conn(0x7fd4e80d18f0 msgr2=0x7fd4e80cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:21.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.097+0000 7fd4eca00640 1 -- 172.21.15.103:0/3939414865 shutdown_connections 2024-09-10T22:45:21.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.097+0000 7fd4eca00640 1 -- 172.21.15.103:0/3939414865 wait complete. 2024-09-10T22:45:21.120 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0' 2024-09-10T22:45:21.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.261+0000 7f035e000640 1 -- 172.21.15.103:0/97117642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f033c004d50 msgr2=0x7f033c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:21.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.261+0000 7f035e000640 1 --2- 172.21.15.103:0/97117642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f033c004d50 0x7f033c0051d0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f035000c260 tx=0x7f035001cf40 comp rx=0 tx=0).stop 2024-09-10T22:45:21.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.261+0000 7f0357e00640 1 -- 172.21.15.103:0/97117642 reap_dead start 2024-09-10T22:45:21.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.261+0000 7f035e000640 1 -- 172.21.15.103:0/97117642 shutdown_connections 2024-09-10T22:45:21.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.261+0000 7f035e000640 1 -- 172.21.15.103:0/97117642 >> 172.21.15.103:0/97117642 conn(0x7f035806cc00 msgr2=0x7f035806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:21.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.261+0000 7f035e000640 1 -- 172.21.15.103:0/97117642 shutdown_connections 2024-09-10T22:45:21.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.261+0000 7f035e000640 1 -- 172.21.15.103:0/97117642 wait complete. 2024-09-10T22:45:21.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f035e000640 1 Processor -- start 2024-09-10T22:45:21.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f035e000640 1 -- start start 2024-09-10T22:45:21.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f035e000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f033c004d50 0x7f03581489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:21.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f035e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0358148f10 0x7f03580ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:21.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f035e000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03580adda0 0x7f03581f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:21.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f035e000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f035815ef20 con 0x7f0358148f10 2024-09-10T22:45:21.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f035e000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f035815eda0 con 0x7f03580adda0 2024-09-10T22:45:21.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f035e000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f035815f0a0 con 0x7f033c004d50 2024-09-10T22:45:21.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f034ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0358148f10 0x7f03580ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:21.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f034ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0358148f10 0x7f03580ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51460/0 (socket says 172.21.15.103:51460) 2024-09-10T22:45:21.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f034ea00640 1 -- 172.21.15.103:0/1279379235 learned_addr learned my addr 172.21.15.103:0/1279379235 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:21.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f0357e00640 1 --2- 172.21.15.103:0/1279379235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03580adda0 0x7f03581f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:21.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f034ea00640 1 -- 172.21.15.103:0/1279379235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f033c004d50 msgr2=0x7f03581489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:21.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f034ea00640 1 --2- 172.21.15.103:0/1279379235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f033c004d50 0x7f03581489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:21.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f034ea00640 1 -- 172.21.15.103:0/1279379235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03580adda0 msgr2=0x7f03581f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:21.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f034ea00640 1 --2- 172.21.15.103:0/1279379235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03580adda0 0x7f03581f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:21.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f034ea00640 1 -- 172.21.15.103:0/1279379235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03581f9220 con 0x7f0358148f10 2024-09-10T22:45:21.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f034ea00640 1 --2- 172.21.15.103:0/1279379235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0358148f10 0x7f03580ad860 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f0340011d10 tx=0x7f034000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:21.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f034fe00640 1 -- 172.21.15.103:0/1279379235 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0340003b90 con 0x7f0358148f10 2024-09-10T22:45:21.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f034fe00640 1 -- 172.21.15.103:0/1279379235 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0340003d30 con 0x7f0358148f10 2024-09-10T22:45:21.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f035e000640 1 -- 172.21.15.103:0/1279379235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03581f8480 con 0x7f0358148f10 2024-09-10T22:45:21.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f034fe00640 1 -- 172.21.15.103:0/1279379235 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0340004290 con 0x7f0358148f10 2024-09-10T22:45:21.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f035e000640 1 -- 172.21.15.103:0/1279379235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03581f8a40 con 0x7f0358148f10 2024-09-10T22:45:21.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.265+0000 7f035e000640 1 -- 172.21.15.103:0/1279379235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f035815fab0 con 0x7f0358148f10 2024-09-10T22:45:21.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.269+0000 7f034fe00640 1 -- 172.21.15.103:0/1279379235 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0340018070 con 0x7f0358148f10 2024-09-10T22:45:21.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.269+0000 7f034fe00640 1 --2- 172.21.15.103:0/1279379235 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f03340725e0 0x7f0334074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:21.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.269+0000 7f034fe00640 1 -- 172.21.15.103:0/1279379235 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5507+0+0 (secure 0 0 0) 0x7f03400943e0 con 0x7f0358148f10 2024-09-10T22:45:21.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.269+0000 7f0357400640 1 --2- 172.21.15.103:0/1279379235 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f03340725e0 0x7f0334074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:21.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.269+0000 7f0357400640 1 --2- 172.21.15.103:0/1279379235 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f03340725e0 0x7f0334074aa0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0348000c10 tx=0x7f03480061a0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:21.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.273+0000 7f034fe00640 1 -- 172.21.15.103:0/1279379235 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f034005fae0 con 0x7f0358148f10 2024-09-10T22:45:21.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:21.497+0000 7f035e000640 1 -- 172.21.15.103:0/1279379235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]} v 0) -- 0x7f03580b1c70 con 0x7f0358148f10 2024-09-10T22:45:22.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.421+0000 7f034fe00640 1 -- 172.21.15.103:0/1279379235 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]}]=0 v338) ==== 168+0+0 (secure 0 0 0) 0x7f0340068070 con 0x7f0358148f10 2024-09-10T22:45:22.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.425+0000 7f035e000640 1 -- 172.21.15.103:0/1279379235 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f03340725e0 msgr2=0x7f0334074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:22.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.425+0000 7f035e000640 1 --2- 172.21.15.103:0/1279379235 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f03340725e0 0x7f0334074aa0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0348000c10 tx=0x7f03480061a0 comp rx=0 tx=0).stop 2024-09-10T22:45:22.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.425+0000 7f035e000640 1 -- 172.21.15.103:0/1279379235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0358148f10 msgr2=0x7f03580ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:22.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.425+0000 7f035e000640 1 --2- 172.21.15.103:0/1279379235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0358148f10 0x7f03580ad860 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f0340011d10 tx=0x7f034000f790 comp rx=0 tx=0).stop 2024-09-10T22:45:22.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.425+0000 7f035e000640 1 -- 172.21.15.103:0/1279379235 shutdown_connections 2024-09-10T22:45:22.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.425+0000 7f035e000640 1 --2- 172.21.15.103:0/1279379235 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f03340725e0 0x7f0334074aa0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:22.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.425+0000 7f035e000640 1 --2- 172.21.15.103:0/1279379235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03580adda0 0x7f03581f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:22.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.425+0000 7f035e000640 1 --2- 172.21.15.103:0/1279379235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0358148f10 0x7f03580ad860 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:22.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.425+0000 7f035e000640 1 --2- 172.21.15.103:0/1279379235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f033c004d50 0x7f03581489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:22.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.425+0000 7f035e000640 1 -- 172.21.15.103:0/1279379235 >> 172.21.15.103:0/1279379235 conn(0x7f035806cc00 msgr2=0x7f03581e5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:22.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.425+0000 7f035e000640 1 -- 172.21.15.103:0/1279379235 shutdown_connections 2024-09-10T22:45:22.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.425+0000 7f035e000640 1 -- 172.21.15.103:0/1279379235 wait complete. 2024-09-10T22:45:22.451 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T22:45:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.593+0000 7f5241c00640 1 -- 172.21.15.103:0/1253466264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5220003cb0 msgr2=0x7f52200040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.593+0000 7f5241c00640 1 --2- 172.21.15.103:0/1253466264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5220003cb0 0x7f52200040b0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f522c009ee0 tx=0x7f522c01d5f0 comp rx=0 tx=0).stop 2024-09-10T22:45:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.593+0000 7f5241c00640 1 -- 172.21.15.103:0/1253466264 shutdown_connections 2024-09-10T22:45:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.593+0000 7f5241c00640 1 --2- 172.21.15.103:0/1253466264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5220003cb0 0x7f52200040b0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.593+0000 7f5241c00640 1 -- 172.21.15.103:0/1253466264 >> 172.21.15.103:0/1253466264 conn(0x7f523c0d18d0 msgr2=0x7f523c0d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.593+0000 7f5241c00640 1 -- 172.21.15.103:0/1253466264 shutdown_connections 2024-09-10T22:45:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.593+0000 7f5241c00640 1 -- 172.21.15.103:0/1253466264 wait complete. 2024-09-10T22:45:22.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.593+0000 7f5241c00640 1 Processor -- start 2024-09-10T22:45:22.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241c00640 1 -- start start 2024-09-10T22:45:22.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5220003cb0 0x7f523c0c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:22.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0caf70 0x7f523c1fb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f523c1527e0 0x7f523c152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f523c0d0160 con 0x7f523c1527e0 2024-09-10T22:45:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f523c0cffe0 con 0x7f523c0caf70 2024-09-10T22:45:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f523c0d02e0 con 0x7f5220003cb0 2024-09-10T22:45:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f523c1527e0 0x7f523c152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f523c1527e0 0x7f523c152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51482/0 (socket says 172.21.15.103:51482) 2024-09-10T22:45:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241200640 1 -- 172.21.15.103:0/3729519059 learned_addr learned my addr 172.21.15.103:0/3729519059 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f523be00640 1 --2- 172.21.15.103:0/3729519059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5220003cb0 0x7f523c0c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f523b400640 1 --2- 172.21.15.103:0/3729519059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0caf70 0x7f523c1fb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241200640 1 -- 172.21.15.103:0/3729519059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5220003cb0 msgr2=0x7f523c0c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241200640 1 --2- 172.21.15.103:0/3729519059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5220003cb0 0x7f523c0c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241200640 1 -- 172.21.15.103:0/3729519059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0caf70 msgr2=0x7f523c1fb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:22.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241200640 1 --2- 172.21.15.103:0/3729519059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0caf70 0x7f523c1fb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241200640 1 -- 172.21.15.103:0/3729519059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f523c06ddb0 con 0x7f523c1527e0 2024-09-10T22:45:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f523b400640 1 --2- 172.21.15.103:0/3729519059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0caf70 0x7f523c1fb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241200640 1 --2- 172.21.15.103:0/3729519059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f523c1527e0 0x7f523c152c70 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f523c0b12b0 tx=0x7f5234001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5233e00640 1 -- 172.21.15.103:0/3729519059 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234011660 con 0x7f523c1527e0 2024-09-10T22:45:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5233e00640 1 -- 172.21.15.103:0/3729519059 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5234017070 con 0x7f523c1527e0 2024-09-10T22:45:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5233e00640 1 -- 172.21.15.103:0/3729519059 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234011b50 con 0x7f523c1527e0 2024-09-10T22:45:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241c00640 1 -- 172.21.15.103:0/3729519059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f523c0cb430 con 0x7f523c1527e0 2024-09-10T22:45:22.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241c00640 1 -- 172.21.15.103:0/3729519059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f523c0cb9f0 con 0x7f523c1527e0 2024-09-10T22:45:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.597+0000 7f5241c00640 1 -- 172.21.15.103:0/3729519059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f523c0cdc40 con 0x7f523c1527e0 2024-09-10T22:45:22.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.601+0000 7f5233e00640 1 -- 172.21.15.103:0/3729519059 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f523401c460 con 0x7f523c1527e0 2024-09-10T22:45:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.601+0000 7f5233e00640 1 --2- 172.21.15.103:0/3729519059 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f521c072610 0x7f521c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.601+0000 7f5233e00640 1 -- 172.21.15.103:0/3729519059 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5507+0+0 (secure 0 0 0) 0x7f52340937e0 con 0x7f523c1527e0 2024-09-10T22:45:22.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.601+0000 7f523be00640 1 --2- 172.21.15.103:0/3729519059 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f521c072610 0x7f521c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:22.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.601+0000 7f523be00640 1 --2- 172.21.15.103:0/3729519059 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f521c072610 0x7f521c074ad0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f522c0b0000 tx=0x7f522c01a390 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:22.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.605+0000 7f5233e00640 1 -- 172.21.15.103:0/3729519059 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f523405eee0 con 0x7f523c1527e0 2024-09-10T22:45:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.769+0000 7f5241c00640 1 -- 172.21.15.103:0/3729519059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f523c0ae7c0 con 0x7f523c1527e0 2024-09-10T22:45:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.773+0000 7f5233e00640 1 -- 172.21.15.103:0/3729519059 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+1998 (secure 0 0 0) 0x7f523405e7e0 con 0x7f523c1527e0 2024-09-10T22:45:22.775 INFO:teuthology.orchestra.run.smithi103.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T22:45:22.776 INFO:teuthology.orchestra.run.smithi103.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T22:45:22.776 INFO:teuthology.orchestra.run.smithi103.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T22:45:22.776 INFO:teuthology.orchestra.run.smithi103.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T22:45:22.776 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4853.781452 2024-09-10T22:45:22.776 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 8222.655229 2024-09-10T22:45:22.776 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4587.934032 2024-09-10T22:45:22.776 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4814.972817 2024-09-10T22:45:22.776 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3485.951614 2024-09-10T22:45:22.776 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3821.456289 2024-09-10T22:45:22.776 INFO:teuthology.orchestra.run.smithi103.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3533.610209 2024-09-10T22:45:22.776 INFO:teuthology.orchestra.run.smithi103.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3752.830807 2024-09-10T22:45:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced debug_mds 20/20 2024-09-10T22:45:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T22:45:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced debug_ms 2/2 2024-09-10T22:45:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:mds dev mds_debug_frag true 2024-09-10T22:45:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:mds dev mds_debug_scatterstat true 2024-09-10T22:45:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T22:45:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:mds dev mds_verify_scatter true 2024-09-10T22:45:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T22:45:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T22:45:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T22:45:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced client_mount_timeout 600 2024-09-10T22:45:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced debug_client 20/20 2024-09-10T22:45:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced debug_ms 1/1 2024-09-10T22:45:22.778 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T22:45:22.778 INFO:teuthology.orchestra.run.smithi103.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T22:45:22.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.773+0000 7f5241c00640 1 -- 172.21.15.103:0/3729519059 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f521c072610 msgr2=0x7f521c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:22.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.773+0000 7f5241c00640 1 --2- 172.21.15.103:0/3729519059 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f521c072610 0x7f521c074ad0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f522c0b0000 tx=0x7f522c01a390 comp rx=0 tx=0).stop 2024-09-10T22:45:22.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.773+0000 7f5241c00640 1 -- 172.21.15.103:0/3729519059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f523c1527e0 msgr2=0x7f523c152c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:22.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.773+0000 7f5241c00640 1 --2- 172.21.15.103:0/3729519059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f523c1527e0 0x7f523c152c70 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f523c0b12b0 tx=0x7f5234001810 comp rx=0 tx=0).stop 2024-09-10T22:45:22.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.773+0000 7f5241c00640 1 -- 172.21.15.103:0/3729519059 shutdown_connections 2024-09-10T22:45:22.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.773+0000 7f5241c00640 1 --2- 172.21.15.103:0/3729519059 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f521c072610 0x7f521c074ad0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:22.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.773+0000 7f5241c00640 1 --2- 172.21.15.103:0/3729519059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f523c1527e0 0x7f523c152c70 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:22.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.773+0000 7f5241c00640 1 --2- 172.21.15.103:0/3729519059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0caf70 0x7f523c1fb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:22.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.773+0000 7f5241c00640 1 --2- 172.21.15.103:0/3729519059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5220003cb0 0x7f523c0c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:22.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.773+0000 7f5241c00640 1 -- 172.21.15.103:0/3729519059 >> 172.21.15.103:0/3729519059 conn(0x7f523c0d18d0 msgr2=0x7f523c0cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:22.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.773+0000 7f5241c00640 1 -- 172.21.15.103:0/3729519059 shutdown_connections 2024-09-10T22:45:22.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.773+0000 7f5241c00640 1 -- 172.21.15.103:0/3729519059 wait complete. 2024-09-10T22:45:22.797 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T22:45:22.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.937+0000 7f1226000640 1 -- 172.21.15.103:0/1606517335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12200d25f0 msgr2=0x7f12200af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:22.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.937+0000 7f1226000640 1 --2- 172.21.15.103:0/1606517335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12200d25f0 0x7f12200af720 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f12200b0ec0 tx=0x7f120801c770 comp rx=0 tx=0).stop 2024-09-10T22:45:22.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.937+0000 7f1226000640 1 -- 172.21.15.103:0/1606517335 shutdown_connections 2024-09-10T22:45:22.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.937+0000 7f1226000640 1 --2- 172.21.15.103:0/1606517335 >> v2:172.21.15.131:3300/0 conn(0x7f12200717a0 0x7f12200afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:22.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.937+0000 7f1226000640 1 --2- 172.21.15.103:0/1606517335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12200d25f0 0x7f12200af720 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:22.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.937+0000 7f1226000640 1 -- 172.21.15.103:0/1606517335 >> 172.21.15.103:0/1606517335 conn(0x7f12200d1ad0 msgr2=0x7f12200d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:22.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.937+0000 7f1226000640 1 -- 172.21.15.103:0/1606517335 shutdown_connections 2024-09-10T22:45:22.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.937+0000 7f1226000640 1 -- 172.21.15.103:0/1606517335 wait complete. 2024-09-10T22:45:22.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f1226000640 1 Processor -- start 2024-09-10T22:45:22.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f1226000640 1 -- start start 2024-09-10T22:45:22.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f1226000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12200717a0 0x7f12200c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:22.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f1226000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12200cfda0 0x7f12200b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:22.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f1226000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12200d25f0 0x7f12200b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:22.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f1226000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1220169050 con 0x7f12200d25f0 2024-09-10T22:45:22.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f1226000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1220168ed0 con 0x7f12200717a0 2024-09-10T22:45:22.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f1226000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f12201691d0 con 0x7f12200cfda0 2024-09-10T22:45:22.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f121fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12200d25f0 0x7f12200b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:22.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f121fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12200d25f0 0x7f12200b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51492/0 (socket says 172.21.15.103:51492) 2024-09-10T22:45:22.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f121fe00640 1 -- 172.21.15.103:0/2556582082 learned_addr learned my addr 172.21.15.103:0/2556582082 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:22.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f1216a00640 1 --2- 172.21.15.103:0/2556582082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12200cfda0 0x7f12200b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:22.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f121f400640 1 --2- 172.21.15.103:0/2556582082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12200717a0 0x7f12200c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:22.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f121fe00640 1 -- 172.21.15.103:0/2556582082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12200cfda0 msgr2=0x7f12200b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:22.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f121fe00640 1 --2- 172.21.15.103:0/2556582082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12200cfda0 0x7f12200b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:22.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f121fe00640 1 -- 172.21.15.103:0/2556582082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12200717a0 msgr2=0x7f12200c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:22.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f121fe00640 1 --2- 172.21.15.103:0/2556582082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12200717a0 0x7f12200c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:22.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f121fe00640 1 -- 172.21.15.103:0/2556582082 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1220145740 con 0x7f12200d25f0 2024-09-10T22:45:22.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f121fe00640 1 --2- 172.21.15.103:0/2556582082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12200d25f0 0x7f12200b3f80 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f121800ea20 tx=0x7f121800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:22.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f1217e00640 1 -- 172.21.15.103:0/2556582082 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121800cde0 con 0x7f12200d25f0 2024-09-10T22:45:22.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f1217e00640 1 -- 172.21.15.103:0/2556582082 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1218004c40 con 0x7f12200d25f0 2024-09-10T22:45:22.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f1217e00640 1 -- 172.21.15.103:0/2556582082 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218005280 con 0x7f12200d25f0 2024-09-10T22:45:22.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f1226000640 1 -- 172.21.15.103:0/2556582082 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12201fb660 con 0x7f12200d25f0 2024-09-10T22:45:22.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.941+0000 7f1226000640 1 -- 172.21.15.103:0/2556582082 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12201fbc20 con 0x7f12200d25f0 2024-09-10T22:45:22.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.945+0000 7f1226000640 1 -- 172.21.15.103:0/2556582082 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f122015eca0 con 0x7f12200d25f0 2024-09-10T22:45:22.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.945+0000 7f1217e00640 1 -- 172.21.15.103:0/2556582082 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f121800f040 con 0x7f12200d25f0 2024-09-10T22:45:22.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.945+0000 7f1217e00640 1 --2- 172.21.15.103:0/2556582082 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f11fc0725e0 0x7f11fc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:22.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.945+0000 7f1217e00640 1 -- 172.21.15.103:0/2556582082 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5507+0+0 (secure 0 0 0) 0x7f1218093860 con 0x7f12200d25f0 2024-09-10T22:45:22.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.945+0000 7f121f400640 1 --2- 172.21.15.103:0/2556582082 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f11fc0725e0 0x7f11fc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:22.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.945+0000 7f121f400640 1 --2- 172.21.15.103:0/2556582082 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f11fc0725e0 0x7f11fc074aa0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1210007fd0 tx=0x7f1210007e40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:22.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:22.949+0000 7f1217e00640 1 -- 172.21.15.103:0/2556582082 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1218016030 con 0x7f12200d25f0 2024-09-10T22:45:23.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.117+0000 7f1226000640 1 -- 172.21.15.103:0/2556582082 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f12200d2050 con 0x7f12200d25f0 2024-09-10T22:45:23.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.121+0000 7f1217e00640 1 -- 172.21.15.103:0/2556582082 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f121805e910 con 0x7f12200d25f0 2024-09-10T22:45:23.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.121+0000 7f1226000640 1 -- 172.21.15.103:0/2556582082 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f11fc0725e0 msgr2=0x7f11fc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:23.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.121+0000 7f1226000640 1 --2- 172.21.15.103:0/2556582082 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f11fc0725e0 0x7f11fc074aa0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1210007fd0 tx=0x7f1210007e40 comp rx=0 tx=0).stop 2024-09-10T22:45:23.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.121+0000 7f1226000640 1 -- 172.21.15.103:0/2556582082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12200d25f0 msgr2=0x7f12200b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:23.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.121+0000 7f1226000640 1 --2- 172.21.15.103:0/2556582082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12200d25f0 0x7f12200b3f80 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f121800ea20 tx=0x7f121800eee0 comp rx=0 tx=0).stop 2024-09-10T22:45:23.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.121+0000 7f1226000640 1 -- 172.21.15.103:0/2556582082 shutdown_connections 2024-09-10T22:45:23.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.121+0000 7f1226000640 1 --2- 172.21.15.103:0/2556582082 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f11fc0725e0 0x7f11fc074aa0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:23.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.121+0000 7f1226000640 1 --2- 172.21.15.103:0/2556582082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12200d25f0 0x7f12200b3f80 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:23.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.121+0000 7f1226000640 1 --2- 172.21.15.103:0/2556582082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12200cfda0 0x7f12200b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:23.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.121+0000 7f1226000640 1 --2- 172.21.15.103:0/2556582082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12200717a0 0x7f12200c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:23.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.121+0000 7f1226000640 1 -- 172.21.15.103:0/2556582082 >> 172.21.15.103:0/2556582082 conn(0x7f12200d1ad0 msgr2=0x7f12200cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:23.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.121+0000 7f1226000640 1 -- 172.21.15.103:0/2556582082 shutdown_connections 2024-09-10T22:45:23.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.121+0000 7f1226000640 1 -- 172.21.15.103:0/2556582082 wait complete. 2024-09-10T22:45:23.146 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T22:45:23.146 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:45:23.262 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:45:23.375 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T22:45:23.375 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:45:23.375 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:45:23.384 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350248k,nr_inodes=4087562,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3542 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T22:45:23.385 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:45:23.385 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:45:23.394 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:45:23.395 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:45:23.395 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:45:23.435 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350248k,nr_inodes=4087562,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3542 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T22:45:23.435 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:45:23.435 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:45:23.444 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:45:23.444 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T22:45:23.445 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:45:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f144a200640 1 -- 172.21.15.103:0/652372246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14440cf790 msgr2=0x7f14440cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f144a200640 1 --2- 172.21.15.103:0/652372246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14440cf790 0x7f14440cfc20 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f14440b4ee0 tx=0x7f143c01ccd0 comp rx=0 tx=0).stop 2024-09-10T22:45:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f144a200640 1 -- 172.21.15.103:0/652372246 shutdown_connections 2024-09-10T22:45:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f144a200640 1 --2- 172.21.15.103:0/652372246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14440cf790 0x7f14440cfc20 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f144a200640 1 --2- 172.21.15.103:0/652372246 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f144415c970 0x7f1444072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f144a200640 1 --2- 172.21.15.103:0/652372246 >> v2:172.21.15.131:3300/0 conn(0x7f14440cc120 0x7f14440aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f144a200640 1 -- 172.21.15.103:0/652372246 >> 172.21.15.103:0/652372246 conn(0x7f144406cc00 msgr2=0x7f144406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f144a200640 1 -- 172.21.15.103:0/652372246 shutdown_connections 2024-09-10T22:45:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f144a200640 1 -- 172.21.15.103:0/652372246 wait complete. 2024-09-10T22:45:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f144a200640 1 Processor -- start 2024-09-10T22:45:23.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f144a200640 1 -- start start 2024-09-10T22:45:23.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f144a200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14440cc120 0x7f1444152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:23.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f144a200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14440cf790 0x7f14441fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:23.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f144a200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f144415c970 0x7f144414ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:23.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f144a200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f144415f8a0 con 0x7f14440cf790 2024-09-10T22:45:23.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f144a200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f144415f720 con 0x7f14440cc120 2024-09-10T22:45:23.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f144a200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f144415fa20 con 0x7f144415c970 2024-09-10T22:45:23.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f143be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14440cf790 0x7f14441fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f1443400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14440cc120 0x7f1444152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f143be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14440cf790 0x7f14441fb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51514/0 (socket says 172.21.15.103:51514) 2024-09-10T22:45:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f143be00640 1 -- 172.21.15.103:0/1280534931 learned_addr learned my addr 172.21.15.103:0/1280534931 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.617+0000 7f1443e00640 1 --2- 172.21.15.103:0/1280534931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f144415c970 0x7f144414ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.621+0000 7f143be00640 1 -- 172.21.15.103:0/1280534931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f144415c970 msgr2=0x7f144414ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.621+0000 7f143be00640 1 --2- 172.21.15.103:0/1280534931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f144415c970 0x7f144414ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.621+0000 7f143be00640 1 -- 172.21.15.103:0/1280534931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14440cc120 msgr2=0x7f1444152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.621+0000 7f143be00640 1 --2- 172.21.15.103:0/1280534931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14440cc120 0x7f1444152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.621+0000 7f143be00640 1 -- 172.21.15.103:0/1280534931 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14441fb6f0 con 0x7f14440cf790 2024-09-10T22:45:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.621+0000 7f143be00640 1 --2- 172.21.15.103:0/1280534931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14440cf790 0x7f14441fb1b0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f142c00d750 tx=0x7f142c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.621+0000 7f143b400640 1 -- 172.21.15.103:0/1280534931 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c017070 con 0x7f14440cf790 2024-09-10T22:45:23.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.621+0000 7f143b400640 1 -- 172.21.15.103:0/1280534931 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f142c009d20 con 0x7f14440cf790 2024-09-10T22:45:23.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.621+0000 7f144a200640 1 -- 172.21.15.103:0/1280534931 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14441550c0 con 0x7f14440cf790 2024-09-10T22:45:23.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.621+0000 7f143b400640 1 -- 172.21.15.103:0/1280534931 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c00de60 con 0x7f14440cf790 2024-09-10T22:45:23.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.621+0000 7f144a200640 1 -- 172.21.15.103:0/1280534931 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1444155680 con 0x7f14440cf790 2024-09-10T22:45:23.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.621+0000 7f144a200640 1 -- 172.21.15.103:0/1280534931 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14440cfc20 con 0x7f14440cf790 2024-09-10T22:45:23.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.621+0000 7f143b400640 1 -- 172.21.15.103:0/1280534931 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f142c004280 con 0x7f14440cf790 2024-09-10T22:45:23.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.621+0000 7f143b400640 1 --2- 172.21.15.103:0/1280534931 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f14200725e0 0x7f1420074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:23.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.621+0000 7f143b400640 1 -- 172.21.15.103:0/1280534931 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5507+0+0 (secure 0 0 0) 0x7f142c093500 con 0x7f14440cf790 2024-09-10T22:45:23.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.625+0000 7f1443400640 1 --2- 172.21.15.103:0/1280534931 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f14200725e0 0x7f1420074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:23.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.625+0000 7f1443400640 1 --2- 172.21.15.103:0/1280534931 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f14200725e0 0x7f1420074aa0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1434009b60 tx=0x7f14340091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.625+0000 7f143b400640 1 -- 172.21.15.103:0/1280534931 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f142c020020 con 0x7f14440cf790 2024-09-10T22:45:23.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.821+0000 7f144a200640 1 -- 172.21.15.103:0/1280534931 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1444075df0 con 0x7f14440cf790 2024-09-10T22:45:23.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.825+0000 7f143b400640 1 -- 172.21.15.103:0/1280534931 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+3927 (secure 0 0 0) 0x7f142c067320 con 0x7f14440cf790 2024-09-10T22:45:23.828 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:23.828 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":101,"btime":"2024-09-10T22:45:17:207666+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2586411857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2586411857},{"type":"v1","addr":"172.21.15.131:6837","nonce":2586411857}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84},{"gid":6920,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/2246557609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2246557609},{"type":"v1","addr":"172.21.15.131:6836","nonce":2246557609}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":7630,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2912219553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2912219553},{"type":"v1","addr":"172.21.15.103:6833","nonce":2912219553}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":7633,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/2768320454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2768320454},{"type":"v1","addr":"172.21.15.103:6835","nonce":2768320454}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[]} 2024-09-10T22:45:23.828 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 101 2024-09-10T22:45:23.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.825+0000 7f144a200640 1 -- 172.21.15.103:0/1280534931 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f14200725e0 msgr2=0x7f1420074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:23.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.825+0000 7f144a200640 1 --2- 172.21.15.103:0/1280534931 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f14200725e0 0x7f1420074aa0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1434009b60 tx=0x7f14340091e0 comp rx=0 tx=0).stop 2024-09-10T22:45:23.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.825+0000 7f144a200640 1 -- 172.21.15.103:0/1280534931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14440cf790 msgr2=0x7f14441fb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:23.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.825+0000 7f144a200640 1 --2- 172.21.15.103:0/1280534931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14440cf790 0x7f14441fb1b0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f142c00d750 tx=0x7f142c00dc10 comp rx=0 tx=0).stop 2024-09-10T22:45:23.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.825+0000 7f144a200640 1 -- 172.21.15.103:0/1280534931 shutdown_connections 2024-09-10T22:45:23.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.825+0000 7f144a200640 1 --2- 172.21.15.103:0/1280534931 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f14200725e0 0x7f1420074aa0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:23.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.825+0000 7f144a200640 1 --2- 172.21.15.103:0/1280534931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f144415c970 0x7f144414ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:23.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.825+0000 7f144a200640 1 --2- 172.21.15.103:0/1280534931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14440cf790 0x7f14441fb1b0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:23.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.825+0000 7f144a200640 1 --2- 172.21.15.103:0/1280534931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14440cc120 0x7f1444152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:23.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.825+0000 7f144a200640 1 -- 172.21.15.103:0/1280534931 >> 172.21.15.103:0/1280534931 conn(0x7f144406cc00 msgr2=0x7f14440b35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:23.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.825+0000 7f144a200640 1 -- 172.21.15.103:0/1280534931 shutdown_connections 2024-09-10T22:45:23.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:23.825+0000 7f144a200640 1 -- 172.21.15.103:0/1280534931 wait complete. 2024-09-10T22:45:23.849 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T22:45:23.849 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T22:45:23.849 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T22:45:23.849 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:45:23.850 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T22:45:23.850 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T22:45:23.850 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T22:45:23.850 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:45:23.850 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T22:45:23.850 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T22:45:23.851 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T22:45:23.851 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:45:23.851 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T22:45:23.851 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T22:45:23.851 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T22:45:23.851 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:45:23.862 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T22:45:23.862 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T22:45:23.863 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T22:45:23.863 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T22:45:23.866 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T22:45:23.866 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T22:45:23.866 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T22:45:23.867 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T22:45:23.910 INFO:tasks.ceph.mds.a:Started 2024-09-10T22:45:23.910 DEBUG:teuthology.parallel:result is None 2024-09-10T22:45:23.911 INFO:tasks.ceph.mds.d:Started 2024-09-10T22:45:23.911 DEBUG:teuthology.parallel:result is None 2024-09-10T22:45:23.912 INFO:tasks.ceph.mds.c:Started 2024-09-10T22:45:23.912 DEBUG:teuthology.parallel:result is None 2024-09-10T22:45:23.912 INFO:tasks.ceph.mds.b:Started 2024-09-10T22:45:23.912 DEBUG:teuthology.parallel:result is None 2024-09-10T22:45:23.913 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T22:45:23.997 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-09-10T22:45:23.998 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-09-10T22:45:24.002 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2024-09-10T22:45:24.003 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2024-09-10T22:45:24.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.057+0000 7f8e08a00640 1 -- 172.21.15.103:0/1702065618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e040b0510 msgr2=0x7f8e04070430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:24.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.057+0000 7f8e08a00640 1 --2- 172.21.15.103:0/1702065618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e040b0510 0x7f8e04070430 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc009840 tx=0x7f8dfc01c6b0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.057+0000 7f8e08a00640 1 -- 172.21.15.103:0/1702065618 shutdown_connections 2024-09-10T22:45:24.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.057+0000 7f8e08a00640 1 --2- 172.21.15.103:0/1702065618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e040b0510 0x7f8e04070430 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.057+0000 7f8e08a00640 1 --2- 172.21.15.103:0/1702065618 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e040714d0 0x7f8e040affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.057+0000 7f8e08a00640 1 -- 172.21.15.103:0/1702065618 >> 172.21.15.103:0/1702065618 conn(0x7f8e040d18f0 msgr2=0x7f8e040d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:24.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.057+0000 7f8e08a00640 1 -- 172.21.15.103:0/1702065618 shutdown_connections 2024-09-10T22:45:24.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.057+0000 7f8e08a00640 1 -- 172.21.15.103:0/1702065618 wait complete. 2024-09-10T22:45:24.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e08a00640 1 Processor -- start 2024-09-10T22:45:24.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e08a00640 1 -- start start 2024-09-10T22:45:24.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e08a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e040714d0 0x7f8e040b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:24.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e08a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e040b0510 0x7f8e041f80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:24.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e08a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e0415f0e0 0x7f8e0415a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:24.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e08a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8e04168ce0 con 0x7f8e0415f0e0 2024-09-10T22:45:24.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e08a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8e04168b60 con 0x7f8e040b0510 2024-09-10T22:45:24.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e08a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8e04168e60 con 0x7f8e040714d0 2024-09-10T22:45:24.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e03200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e0415f0e0 0x7f8e0415a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:24.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e03200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e0415f0e0 0x7f8e0415a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51556/0 (socket says 172.21.15.103:51556) 2024-09-10T22:45:24.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e03200640 1 -- 172.21.15.103:0/375310787 learned_addr learned my addr 172.21.15.103:0/375310787 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:24.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8df9e00640 1 --2- 172.21.15.103:0/375310787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e040b0510 0x7f8e041f80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:24.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e02800640 1 --2- 172.21.15.103:0/375310787 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e040714d0 0x7f8e040b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:24.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e03200640 1 -- 172.21.15.103:0/375310787 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e040714d0 msgr2=0x7f8e040b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:24.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e03200640 1 --2- 172.21.15.103:0/375310787 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e040714d0 0x7f8e040b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e03200640 1 -- 172.21.15.103:0/375310787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e040b0510 msgr2=0x7f8e041f80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:24.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e03200640 1 --2- 172.21.15.103:0/375310787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e040b0510 0x7f8e041f80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e03200640 1 -- 172.21.15.103:0/375310787 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e041f8600 con 0x7f8e0415f0e0 2024-09-10T22:45:24.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e03200640 1 --2- 172.21.15.103:0/375310787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e0415f0e0 0x7f8e0415a790 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0ac040 tx=0x7f8dfc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:24.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8dfb400640 1 -- 172.21.15.103:0/375310787 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc005220 con 0x7f8e0415f0e0 2024-09-10T22:45:24.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8dfb400640 1 -- 172.21.15.103:0/375310787 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8dfc0054b0 con 0x7f8e0415f0e0 2024-09-10T22:45:24.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e08a00640 1 -- 172.21.15.103:0/375310787 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e040b5830 con 0x7f8e0415f0e0 2024-09-10T22:45:24.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8dfb400640 1 -- 172.21.15.103:0/375310787 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc004910 con 0x7f8e0415f0e0 2024-09-10T22:45:24.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.061+0000 7f8e08a00640 1 -- 172.21.15.103:0/375310787 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e040b5db0 con 0x7f8e0415f0e0 2024-09-10T22:45:24.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.065+0000 7f8e08a00640 1 -- 172.21.15.103:0/375310787 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e040b4320 con 0x7f8e0415f0e0 2024-09-10T22:45:24.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.065+0000 7f8dfb400640 1 -- 172.21.15.103:0/375310787 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8dfc0c6030 con 0x7f8e0415f0e0 2024-09-10T22:45:24.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.065+0000 7f8dfb400640 1 --2- 172.21.15.103:0/375310787 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8de00725e0 0x7f8de0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:24.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.065+0000 7f8dfb400640 1 -- 172.21.15.103:0/375310787 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5507+0+0 (secure 0 0 0) 0x7f8dfc12e1e0 con 0x7f8e0415f0e0 2024-09-10T22:45:24.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.065+0000 7f8e02800640 1 --2- 172.21.15.103:0/375310787 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8de00725e0 0x7f8de0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:24.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.065+0000 7f8e02800640 1 --2- 172.21.15.103:0/375310787 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8de00725e0 0x7f8de0074aa0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8df4001ec0 tx=0x7f8df40019e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:24.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.069+0000 7f8dfb400640 1 -- 172.21.15.103:0/375310787 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8e041f8600 con 0x7f8e0415f0e0 2024-09-10T22:45:24.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.245+0000 7f8e08a00640 1 -- 172.21.15.103:0/375310787 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8e040affd0 con 0x7f8e0415f0e0 2024-09-10T22:45:24.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.437+0000 7f8dfb400640 1 -- 172.21.15.103:0/375310787 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v99) ==== 97+0+0 (secure 0 0 0) 0x7f8dfc016330 con 0x7f8e0415f0e0 2024-09-10T22:45:24.441 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blocklist entries 2024-09-10T22:45:24.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.437+0000 7f8e08a00640 1 -- 172.21.15.103:0/375310787 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8de00725e0 msgr2=0x7f8de0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:24.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.437+0000 7f8e08a00640 1 --2- 172.21.15.103:0/375310787 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8de00725e0 0x7f8de0074aa0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8df4001ec0 tx=0x7f8df40019e0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.437+0000 7f8e08a00640 1 -- 172.21.15.103:0/375310787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e0415f0e0 msgr2=0x7f8e0415a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:24.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.437+0000 7f8e08a00640 1 --2- 172.21.15.103:0/375310787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e0415f0e0 0x7f8e0415a790 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0ac040 tx=0x7f8dfc005740 comp rx=0 tx=0).stop 2024-09-10T22:45:24.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.437+0000 7f8e08a00640 1 -- 172.21.15.103:0/375310787 shutdown_connections 2024-09-10T22:45:24.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.437+0000 7f8e08a00640 1 --2- 172.21.15.103:0/375310787 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8de00725e0 0x7f8de0074aa0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.437+0000 7f8e08a00640 1 --2- 172.21.15.103:0/375310787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e0415f0e0 0x7f8e0415a790 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.437+0000 7f8e08a00640 1 --2- 172.21.15.103:0/375310787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e040b0510 0x7f8e041f80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.437+0000 7f8e08a00640 1 --2- 172.21.15.103:0/375310787 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e040714d0 0x7f8e040b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.437+0000 7f8e08a00640 1 -- 172.21.15.103:0/375310787 >> 172.21.15.103:0/375310787 conn(0x7f8e040d18f0 msgr2=0x7f8e0406e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:24.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.437+0000 7f8e08a00640 1 -- 172.21.15.103:0/375310787 shutdown_connections 2024-09-10T22:45:24.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.437+0000 7f8e08a00640 1 -- 172.21.15.103:0/375310787 wait complete. 2024-09-10T22:45:24.465 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T22:45:24.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.601+0000 7f79ed200640 1 -- 172.21.15.103:0/1644546890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e80cfdd0 msgr2=0x7f79e815eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:24.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.601+0000 7f79ed200640 1 --2- 172.21.15.103:0/1644546890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e80cfdd0 0x7f79e815eda0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f79e80d08e0 tx=0x7f79d401c800 comp rx=0 tx=0).stop 2024-09-10T22:45:24.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.601+0000 7f79ed200640 1 -- 172.21.15.103:0/1644546890 shutdown_connections 2024-09-10T22:45:24.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.601+0000 7f79ed200640 1 --2- 172.21.15.103:0/1644546890 >> v2:172.21.15.131:3300/0 conn(0x7f79e815f2e0 0x7f79e815f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.601+0000 7f79ed200640 1 --2- 172.21.15.103:0/1644546890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e80cfdd0 0x7f79e815eda0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.601+0000 7f79ed200640 1 -- 172.21.15.103:0/1644546890 >> 172.21.15.103:0/1644546890 conn(0x7f79e806cc00 msgr2=0x7f79e806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:24.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.601+0000 7f79ed200640 1 -- 172.21.15.103:0/1644546890 shutdown_connections 2024-09-10T22:45:24.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.601+0000 7f79ed200640 1 -- 172.21.15.103:0/1644546890 wait complete. 2024-09-10T22:45:24.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79ed200640 1 Processor -- start 2024-09-10T22:45:24.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79ed200640 1 -- start start 2024-09-10T22:45:24.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79ed200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e80cf9f0 0x7f79e8157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79ed200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79e80cfdd0 0x7f79e80af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79ed200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79e815f2e0 0x7f79e8145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79ed200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f79e80cd670 con 0x7f79e80cf9f0 2024-09-10T22:45:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79ed200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f79e80cd4f0 con 0x7f79e80cfdd0 2024-09-10T22:45:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79ed200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f79e80cd7f0 con 0x7f79e815f2e0 2024-09-10T22:45:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79e5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e80cf9f0 0x7f79e8157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79e5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e80cf9f0 0x7f79e8157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51568/0 (socket says 172.21.15.103:51568) 2024-09-10T22:45:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79e5e00640 1 -- 172.21.15.103:0/2993705195 learned_addr learned my addr 172.21.15.103:0/2993705195 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79e5400640 1 --2- 172.21.15.103:0/2993705195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79e80cfdd0 0x7f79e80af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79e6800640 1 --2- 172.21.15.103:0/2993705195 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79e815f2e0 0x7f79e8145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79e5e00640 1 -- 172.21.15.103:0/2993705195 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79e815f2e0 msgr2=0x7f79e8145200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79e5e00640 1 --2- 172.21.15.103:0/2993705195 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79e815f2e0 0x7f79e8145200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79e5e00640 1 -- 172.21.15.103:0/2993705195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79e80cfdd0 msgr2=0x7f79e80af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:24.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79e5e00640 1 --2- 172.21.15.103:0/2993705195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79e80cfdd0 0x7f79e80af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79e5e00640 1 -- 172.21.15.103:0/2993705195 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e80afd30 con 0x7f79e80cf9f0 2024-09-10T22:45:24.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79e5e00640 1 --2- 172.21.15.103:0/2993705195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e80cf9f0 0x7f79e8157030 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f79d800c500 tx=0x7f79d800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:24.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79de000640 1 -- 172.21.15.103:0/2993705195 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8018070 con 0x7f79e80cf9f0 2024-09-10T22:45:24.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79de000640 1 -- 172.21.15.103:0/2993705195 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79d8003600 con 0x7f79e80cf9f0 2024-09-10T22:45:24.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79ed200640 1 -- 172.21.15.103:0/2993705195 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e80b1e50 con 0x7f79e80cf9f0 2024-09-10T22:45:24.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79de000640 1 -- 172.21.15.103:0/2993705195 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8003a90 con 0x7f79e80cf9f0 2024-09-10T22:45:24.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.605+0000 7f79ed200640 1 -- 172.21.15.103:0/2993705195 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e80b20f0 con 0x7f79e80cf9f0 2024-09-10T22:45:24.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.609+0000 7f79ed200640 1 -- 172.21.15.103:0/2993705195 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e80b1c80 con 0x7f79e80cf9f0 2024-09-10T22:45:24.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.609+0000 7f79de000640 1 -- 172.21.15.103:0/2993705195 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f79d8003c30 con 0x7f79e80cf9f0 2024-09-10T22:45:24.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.609+0000 7f79de000640 1 --2- 172.21.15.103:0/2993705195 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f79c80725e0 0x7f79c8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:24.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.609+0000 7f79de000640 1 -- 172.21.15.103:0/2993705195 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5249+0+0 (secure 0 0 0) 0x7f79d80926f0 con 0x7f79e80cf9f0 2024-09-10T22:45:24.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.609+0000 7f79e5400640 1 --2- 172.21.15.103:0/2993705195 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f79c80725e0 0x7f79c8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:24.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.613+0000 7f79e5400640 1 --2- 172.21.15.103:0/2993705195 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f79c80725e0 0x7f79c8074aa0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f79d40af000 tx=0x7f79d401b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:24.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.613+0000 7f79de000640 1 -- 172.21.15.103:0/2993705195 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f79d805d970 con 0x7f79e80cf9f0 2024-09-10T22:45:24.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.837+0000 7f79ed200640 1 -- 172.21.15.103:0/2993705195 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f79e815eda0 con 0x7f79e80cf9f0 2024-09-10T22:45:24.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.837+0000 7f79de000640 1 -- 172.21.15.103:0/2993705195 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7f79d80623a0 con 0x7f79e80cf9f0 2024-09-10T22:45:24.840 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:24.840 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:45:24.840 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2024-09-10T22:45:24.840 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.840 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2024-09-10T22:45:24.840 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmh8HQHBAAZlp4CnHLegqhgWrgXoyltw==", 2024-09-10T22:45:24.840 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.840 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:45:24.841 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:45:24.841 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:45:24.841 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:45:24.841 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:24.841 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.841 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2024-09-10T22:45:24.841 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmpYUNKRAAstv0pZDy3081UKcsSWnWIg==", 2024-09-10T22:45:24.841 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.841 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:45:24.841 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:45:24.841 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:45:24.841 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:45:24.842 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:24.842 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.842 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.c", 2024-09-10T22:45:24.842 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBm8I0TJBAAmW480qKYYrolVm7+SlJ97w==", 2024-09-10T22:45:24.842 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.842 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:45:24.842 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:45:24.842 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:45:24.842 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:45:24.842 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:24.843 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.843 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.d", 2024-09-10T22:45:24.843 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmB55uMBAA1VqVuUEAk1i2LFBoZXiRmA==", 2024-09-10T22:45:24.843 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.843 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:45:24.843 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:45:24.843 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:45:24.843 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:45:24.843 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.843 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:24.843 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.843 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2024-09-10T22:45:24.843 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA/yuBm+fNzNRAAwt8IZXd3mcEh5UbXc924UQ==", 2024-09-10T22:45:24.843 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.844 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:45:24.844 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:45:24.844 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:45:24.844 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:24.844 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.844 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2024-09-10T22:45:24.844 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBDyuBmNBfvDhAAcBNATtrJNZ4RFzYXqWt2pg==", 2024-09-10T22:45:24.844 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.844 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:45:24.844 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:45:24.844 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:45:24.844 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:24.845 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.845 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2024-09-10T22:45:24.845 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBGyuBmJD9HJBAAgq8tqoeDT8WNr7pMxQCCJw==", 2024-09-10T22:45:24.845 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.845 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:45:24.845 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:45:24.845 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:45:24.845 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:24.845 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.845 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2024-09-10T22:45:24.845 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBJyuBmzxWIOhAA4yOLmTZAY0MRLj+w3mhCeQ==", 2024-09-10T22:45:24.845 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.845 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:45:24.846 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:45:24.846 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:45:24.846 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:24.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.846 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2024-09-10T22:45:24.846 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBQyuBm3pi6ABAAnwu13uYkLRJuU5y+DE2Isw==", 2024-09-10T22:45:24.846 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.846 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:45:24.846 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:45:24.846 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:45:24.846 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:24.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.847 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2024-09-10T22:45:24.847 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBTyuBmkaPVFhAALlwgsnQ/dUJVLTK2iAh6Ww==", 2024-09-10T22:45:24.847 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.847 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:45:24.847 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:45:24.847 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:45:24.847 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:24.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.847 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2024-09-10T22:45:24.847 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBWyuBmL2kKKxAAbxeyAuzd994tvNfKKs+WIA==", 2024-09-10T22:45:24.847 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.847 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:45:24.848 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:45:24.848 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:45:24.848 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:24.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.848 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2024-09-10T22:45:24.848 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBayuBmUmSwBBAAWTFVgtYXlyEI+rJzGIM+Aw==", 2024-09-10T22:45:24.848 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.848 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-09-10T22:45:24.848 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-09-10T22:45:24.848 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:45:24.848 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:24.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.849 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2024-09-10T22:45:24.849 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmtOhZNBAAeszxWpV60NIn/zOInT5Zzw==", 2024-09-10T22:45:24.849 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.849 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:45:24.849 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2024-09-10T22:45:24.849 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T22:45:24.849 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:24.849 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.849 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2024-09-10T22:45:24.849 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9yuBmu20iAhAASacT/hh3sxW1XU/XD6uDjA==", 2024-09-10T22:45:24.849 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.849 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:45:24.849 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:45:24.850 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:45:24.850 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:45:24.850 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.850 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:24.850 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.850 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2024-09-10T22:45:24.850 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmd1E5OhAAfidEn8dwfGna8gwefsYtUg==", 2024-09-10T22:45:24.850 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.850 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:45:24.850 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:45:24.850 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:45:24.850 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:45:24.850 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.850 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:24.850 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.851 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2024-09-10T22:45:24.851 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9yuBmGGhVCBAAAs3y0cfqMN0t0/PTNsVEQw==", 2024-09-10T22:45:24.851 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.851 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-09-10T22:45:24.851 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-09-10T22:45:24.851 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-09-10T22:45:24.851 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-09-10T22:45:24.851 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.851 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:24.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.851 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2024-09-10T22:45:24.851 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmsY75ABAAYeEF+hTiVUtmqzwU0IIpjA==", 2024-09-10T22:45:24.851 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.851 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-09-10T22:45:24.852 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-09-10T22:45:24.852 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-09-10T22:45:24.852 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:45:24.852 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:24.852 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.852 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2024-09-10T22:45:24.852 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBmghJQGBAAXvlC58nhT9H/c71/ToGCSw==", 2024-09-10T22:45:24.852 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.852 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-09-10T22:45:24.852 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2024-09-10T22:45:24.852 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:45:24.852 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:24.853 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:24.853 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2024-09-10T22:45:24.853 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA8yuBma9x+FBAAQrKkw3eGcKnLxSqVz/DHJQ==", 2024-09-10T22:45:24.853 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-09-10T22:45:24.853 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-09-10T22:45:24.853 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2024-09-10T22:45:24.853 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-09-10T22:45:24.853 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.853 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:24.853 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T22:45:24.853 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:45:24.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.837+0000 7f79ed200640 1 -- 172.21.15.103:0/2993705195 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f79c80725e0 msgr2=0x7f79c8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:24.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.837+0000 7f79ed200640 1 --2- 172.21.15.103:0/2993705195 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f79c80725e0 0x7f79c8074aa0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f79d40af000 tx=0x7f79d401b040 comp rx=0 tx=0).stop 2024-09-10T22:45:24.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.837+0000 7f79ed200640 1 -- 172.21.15.103:0/2993705195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e80cf9f0 msgr2=0x7f79e8157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:24.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.837+0000 7f79ed200640 1 --2- 172.21.15.103:0/2993705195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e80cf9f0 0x7f79e8157030 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f79d800c500 tx=0x7f79d800c9c0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.837+0000 7f79ed200640 1 -- 172.21.15.103:0/2993705195 shutdown_connections 2024-09-10T22:45:24.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.837+0000 7f79ed200640 1 --2- 172.21.15.103:0/2993705195 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f79c80725e0 0x7f79c8074aa0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.837+0000 7f79ed200640 1 --2- 172.21.15.103:0/2993705195 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79e815f2e0 0x7f79e8145200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.837+0000 7f79ed200640 1 --2- 172.21.15.103:0/2993705195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79e80cfdd0 0x7f79e80af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.837+0000 7f79ed200640 1 --2- 172.21.15.103:0/2993705195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e80cf9f0 0x7f79e8157030 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:24.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.837+0000 7f79ed200640 1 -- 172.21.15.103:0/2993705195 >> 172.21.15.103:0/2993705195 conn(0x7f79e806cc00 msgr2=0x7f79e815a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:24.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.837+0000 7f79ed200640 1 -- 172.21.15.103:0/2993705195 shutdown_connections 2024-09-10T22:45:24.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:24.837+0000 7f79ed200640 1 -- 172.21.15.103:0/2993705195 wait complete. 2024-09-10T22:45:24.861 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T22:45:25.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f574b400640 1 -- 172.21.15.103:0/3517323677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57440cdd00 msgr2=0x7f57440ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:25.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f574b400640 1 --2- 172.21.15.103:0/3517323677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57440cdd00 0x7f57440ae7f0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f572c009840 tx=0x7f572c01c820 comp rx=0 tx=0).stop 2024-09-10T22:45:25.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f574b400640 1 -- 172.21.15.103:0/3517323677 shutdown_connections 2024-09-10T22:45:25.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f574b400640 1 --2- 172.21.15.103:0/3517323677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57440cdd00 0x7f57440ae7f0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:25.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f574b400640 1 -- 172.21.15.103:0/3517323677 >> 172.21.15.103:0/3517323677 conn(0x7f57440d1a20 msgr2=0x7f57440d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:25.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f574b400640 1 -- 172.21.15.103:0/3517323677 shutdown_connections 2024-09-10T22:45:25.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f574b400640 1 -- 172.21.15.103:0/3517323677 wait complete. 2024-09-10T22:45:25.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f574b400640 1 Processor -- start 2024-09-10T22:45:25.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f574b400640 1 -- start start 2024-09-10T22:45:25.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f574b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57440cd500 0x7f57440c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:25.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f574b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57440cdd00 0x7f57440718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:25.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f574b400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f574415f1a0 0x7f57440c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:25.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f574b400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5744169f70 con 0x7f57440cdd00 2024-09-10T22:45:25.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f574b400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5744169df0 con 0x7f57440cd500 2024-09-10T22:45:25.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f574b400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f574416a0f0 con 0x7f574415f1a0 2024-09-10T22:45:25.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f573be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57440cdd00 0x7f57440718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:25.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f573be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57440cdd00 0x7f57440718f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51578/0 (socket says 172.21.15.103:51578) 2024-09-10T22:45:25.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f573be00640 1 -- 172.21.15.103:0/4202599768 learned_addr learned my addr 172.21.15.103:0/4202599768 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:25.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f5748a00640 1 --2- 172.21.15.103:0/4202599768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57440cd500 0x7f57440c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:25.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f5749400640 1 --2- 172.21.15.103:0/4202599768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f574415f1a0 0x7f57440c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:25.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f573be00640 1 -- 172.21.15.103:0/4202599768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f574415f1a0 msgr2=0x7f57440c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:25.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f573be00640 1 --2- 172.21.15.103:0/4202599768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f574415f1a0 0x7f57440c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:25.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f573be00640 1 -- 172.21.15.103:0/4202599768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57440cd500 msgr2=0x7f57440c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:25.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f573be00640 1 --2- 172.21.15.103:0/4202599768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57440cd500 0x7f57440c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:25.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.001+0000 7f573be00640 1 -- 172.21.15.103:0/4202599768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574414be10 con 0x7f57440cdd00 2024-09-10T22:45:25.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.005+0000 7f573be00640 1 --2- 172.21.15.103:0/4202599768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57440cdd00 0x7f57440718f0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f572c009790 tx=0x7f572c0a6650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:25.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.005+0000 7f5741600640 1 -- 172.21.15.103:0/4202599768 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c0a7d20 con 0x7f57440cdd00 2024-09-10T22:45:25.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.005+0000 7f5741600640 1 -- 172.21.15.103:0/4202599768 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f572c005020 con 0x7f57440cdd00 2024-09-10T22:45:25.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.005+0000 7f574b400640 1 -- 172.21.15.103:0/4202599768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f574414bb30 con 0x7f57440cdd00 2024-09-10T22:45:25.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.005+0000 7f5741600640 1 -- 172.21.15.103:0/4202599768 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c005430 con 0x7f57440cdd00 2024-09-10T22:45:25.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.005+0000 7f574b400640 1 -- 172.21.15.103:0/4202599768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57440c7840 con 0x7f57440cdd00 2024-09-10T22:45:25.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.005+0000 7f574b400640 1 -- 172.21.15.103:0/4202599768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57440ae7f0 con 0x7f57440cdd00 2024-09-10T22:45:25.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.005+0000 7f5741600640 1 -- 172.21.15.103:0/4202599768 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f572c0046d0 con 0x7f57440cdd00 2024-09-10T22:45:25.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.005+0000 7f5741600640 1 --2- 172.21.15.103:0/4202599768 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f57200725e0 0x7f5720074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:25.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.005+0000 7f5741600640 1 -- 172.21.15.103:0/4202599768 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5249+0+0 (secure 0 0 0) 0x7f572c12d8f0 con 0x7f57440cdd00 2024-09-10T22:45:25.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.009+0000 7f5748a00640 1 --2- 172.21.15.103:0/4202599768 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f57200725e0 0x7f5720074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:25.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.009+0000 7f5748a00640 1 --2- 172.21.15.103:0/4202599768 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f57200725e0 0x7f5720074aa0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f57340015f0 tx=0x7f5734009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:25.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.009+0000 7f5741600640 1 -- 172.21.15.103:0/4202599768 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f572c016410 con 0x7f57440cdd00 2024-09-10T22:45:25.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.181+0000 7f574b400640 1 -- 172.21.15.103:0/4202599768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5744071380 con 0x7f57440cdd00 2024-09-10T22:45:25.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.181+0000 7f5741600640 1 -- 172.21.15.103:0/4202599768 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v101) ==== 84+0+65 (secure 0 0 0) 0x7f572c0f9060 con 0x7f57440cdd00 2024-09-10T22:45:25.185 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:25.185 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-09-10T22:45:25.185 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T22:45:25.185 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2024-09-10T22:45:25.185 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": ".mgr" 2024-09-10T22:45:25.185 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:25.185 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-09-10T22:45:25.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.181+0000 7f574b400640 1 -- 172.21.15.103:0/4202599768 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f57200725e0 msgr2=0x7f5720074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:25.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.181+0000 7f574b400640 1 --2- 172.21.15.103:0/4202599768 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f57200725e0 0x7f5720074aa0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f57340015f0 tx=0x7f5734009040 comp rx=0 tx=0).stop 2024-09-10T22:45:25.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.181+0000 7f574b400640 1 -- 172.21.15.103:0/4202599768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57440cdd00 msgr2=0x7f57440718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:25.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.181+0000 7f574b400640 1 --2- 172.21.15.103:0/4202599768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57440cdd00 0x7f57440718f0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f572c009790 tx=0x7f572c0a6650 comp rx=0 tx=0).stop 2024-09-10T22:45:25.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.181+0000 7f574b400640 1 -- 172.21.15.103:0/4202599768 shutdown_connections 2024-09-10T22:45:25.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.181+0000 7f574b400640 1 --2- 172.21.15.103:0/4202599768 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f57200725e0 0x7f5720074aa0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:25.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.181+0000 7f574b400640 1 --2- 172.21.15.103:0/4202599768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f574415f1a0 0x7f57440c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:25.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.181+0000 7f574b400640 1 --2- 172.21.15.103:0/4202599768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57440cdd00 0x7f57440718f0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:25.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.181+0000 7f574b400640 1 --2- 172.21.15.103:0/4202599768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57440cd500 0x7f57440c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:25.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.181+0000 7f574b400640 1 -- 172.21.15.103:0/4202599768 >> 172.21.15.103:0/4202599768 conn(0x7f57440d1a20 msgr2=0x7f57440707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:25.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.181+0000 7f574b400640 1 -- 172.21.15.103:0/4202599768 shutdown_connections 2024-09-10T22:45:25.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.181+0000 7f574b400640 1 -- 172.21.15.103:0/4202599768 wait complete. 2024-09-10T22:45:25.206 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T22:45:25.206 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T22:45:25.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.345+0000 7f71c1e00640 1 -- 172.21.15.103:0/2928955090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71bc072a40 msgr2=0x7f71bc157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:25.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.345+0000 7f71c1e00640 1 --2- 172.21.15.103:0/2928955090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71bc072a40 0x7f71bc157090 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0b4f10 tx=0x7f71b401dbf0 comp rx=0 tx=0).stop 2024-09-10T22:45:25.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.345+0000 7f71c1e00640 1 -- 172.21.15.103:0/2928955090 shutdown_connections 2024-09-10T22:45:25.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.345+0000 7f71c1e00640 1 --2- 172.21.15.103:0/2928955090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71bc072a40 0x7f71bc157090 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:25.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.345+0000 7f71c1e00640 1 --2- 172.21.15.103:0/2928955090 >> v2:172.21.15.131:3300/0 conn(0x7f71bc0b3320 0x7f71bc072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:25.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.345+0000 7f71c1e00640 1 -- 172.21.15.103:0/2928955090 >> 172.21.15.103:0/2928955090 conn(0x7f71bc06cc00 msgr2=0x7f71bc06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:25.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.345+0000 7f71c1e00640 1 -- 172.21.15.103:0/2928955090 shutdown_connections 2024-09-10T22:45:25.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.345+0000 7f71c1e00640 1 -- 172.21.15.103:0/2928955090 wait complete. 2024-09-10T22:45:25.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71c1e00640 1 Processor -- start 2024-09-10T22:45:25.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71c1e00640 1 -- start start 2024-09-10T22:45:25.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71c1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71bc072a40 0x7f71bc165240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:25.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71c1e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71bc0b3320 0x7f71bc147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:25.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71c1e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71bc0cf260 0x7f71bc0ae730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:25.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71c1e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc06e800 con 0x7f71bc072a40 2024-09-10T22:45:25.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71c1e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc157ed0 con 0x7f71bc0cf260 2024-09-10T22:45:25.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71c1e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f71bc06e980 con 0x7f71bc0b3320 2024-09-10T22:45:25.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71baa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71bc072a40 0x7f71bc165240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:25.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71baa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71bc072a40 0x7f71bc165240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51602/0 (socket says 172.21.15.103:51602) 2024-09-10T22:45:25.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71baa00640 1 -- 172.21.15.103:0/3943312509 learned_addr learned my addr 172.21.15.103:0/3943312509 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:25.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71bb400640 1 --2- 172.21.15.103:0/3943312509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71bc0cf260 0x7f71bc0ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:25.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71ba000640 1 --2- 172.21.15.103:0/3943312509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71bc0b3320 0x7f71bc147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:25.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71baa00640 1 -- 172.21.15.103:0/3943312509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71bc0b3320 msgr2=0x7f71bc147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:25.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71baa00640 1 --2- 172.21.15.103:0/3943312509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71bc0b3320 0x7f71bc147bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71baa00640 1 -- 172.21.15.103:0/3943312509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71bc0cf260 msgr2=0x7f71bc0ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71baa00640 1 --2- 172.21.15.103:0/3943312509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71bc0cf260 0x7f71bc0ae730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71baa00640 1 -- 172.21.15.103:0/3943312509 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71bc1488b0 con 0x7f71bc072a40 2024-09-10T22:45:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71ba000640 1 --2- 172.21.15.103:0/3943312509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71bc0b3320 0x7f71bc147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71baa00640 1 --2- 172.21.15.103:0/3943312509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71bc072a40 0x7f71bc165240 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00ba50 tx=0x7f71ac00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71b3400640 1 -- 172.21.15.103:0/3943312509 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac019070 con 0x7f71bc072a40 2024-09-10T22:45:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71b3400640 1 -- 172.21.15.103:0/3943312509 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71ac00cd00 con 0x7f71bc072a40 2024-09-10T22:45:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71c1e00640 1 -- 172.21.15.103:0/3943312509 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71bc1658b0 con 0x7f71bc072a40 2024-09-10T22:45:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71b3400640 1 -- 172.21.15.103:0/3943312509 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0146a0 con 0x7f71bc072a40 2024-09-10T22:45:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.349+0000 7f71c1e00640 1 -- 172.21.15.103:0/3943312509 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71bc1fb210 con 0x7f71bc072a40 2024-09-10T22:45:25.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.353+0000 7f71c1e00640 1 -- 172.21.15.103:0/3943312509 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71bc1faab0 con 0x7f71bc072a40 2024-09-10T22:45:25.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.353+0000 7f71b3400640 1 -- 172.21.15.103:0/3943312509 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f71ac01d3b0 con 0x7f71bc072a40 2024-09-10T22:45:25.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.353+0000 7f71b3400640 1 --2- 172.21.15.103:0/3943312509 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f719c0725e0 0x7f719c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:25.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.353+0000 7f71b3400640 1 -- 172.21.15.103:0/3943312509 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5249+0+0 (secure 0 0 0) 0x7f71ac093130 con 0x7f71bc072a40 2024-09-10T22:45:25.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.353+0000 7f71ba000640 1 --2- 172.21.15.103:0/3943312509 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f719c0725e0 0x7f719c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:25.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.353+0000 7f71ba000640 1 --2- 172.21.15.103:0/3943312509 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f719c0725e0 0x7f719c074aa0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f71a80058d0 tx=0x7f71a8005860 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:25.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.357+0000 7f71b3400640 1 -- 172.21.15.103:0/3943312509 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f71ac05e370 con 0x7f71bc072a40 2024-09-10T22:45:25.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:25.529+0000 7f71c1e00640 1 -- 172.21.15.103:0/3943312509 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f71bc157090 con 0x7f71bc072a40 2024-09-10T22:45:26.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.445+0000 7f71b3400640 1 -- 172.21.15.103:0/3943312509 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v102) ==== 138+0+0 (secure 0 0 0) 0x7f71ac062da0 con 0x7f71bc072a40 2024-09-10T22:45:26.450 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2024-09-10T22:45:26.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.449+0000 7f71c1e00640 1 -- 172.21.15.103:0/3943312509 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f719c0725e0 msgr2=0x7f719c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:26.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.449+0000 7f71c1e00640 1 --2- 172.21.15.103:0/3943312509 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f719c0725e0 0x7f719c074aa0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f71a80058d0 tx=0x7f71a8005860 comp rx=0 tx=0).stop 2024-09-10T22:45:26.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.449+0000 7f71c1e00640 1 -- 172.21.15.103:0/3943312509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71bc072a40 msgr2=0x7f71bc165240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:26.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.449+0000 7f71c1e00640 1 --2- 172.21.15.103:0/3943312509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71bc072a40 0x7f71bc165240 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00ba50 tx=0x7f71ac00bf10 comp rx=0 tx=0).stop 2024-09-10T22:45:26.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.449+0000 7f71c1e00640 1 -- 172.21.15.103:0/3943312509 shutdown_connections 2024-09-10T22:45:26.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.449+0000 7f71c1e00640 1 --2- 172.21.15.103:0/3943312509 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f719c0725e0 0x7f719c074aa0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:26.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.449+0000 7f71c1e00640 1 --2- 172.21.15.103:0/3943312509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71bc0cf260 0x7f71bc0ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:26.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.449+0000 7f71c1e00640 1 --2- 172.21.15.103:0/3943312509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71bc0b3320 0x7f71bc147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:26.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.449+0000 7f71c1e00640 1 --2- 172.21.15.103:0/3943312509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71bc072a40 0x7f71bc165240 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:26.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.449+0000 7f71c1e00640 1 -- 172.21.15.103:0/3943312509 >> 172.21.15.103:0/3943312509 conn(0x7f71bc06cc00 msgr2=0x7f71bc0b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:26.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.449+0000 7f71c1e00640 1 -- 172.21.15.103:0/3943312509 shutdown_connections 2024-09-10T22:45:26.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.449+0000 7f71c1e00640 1 -- 172.21.15.103:0/3943312509 wait complete. 2024-09-10T22:45:26.480 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T22:45:26.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.629+0000 7f8d2ea00640 1 -- 172.21.15.103:0/2082416568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d0c003a60 msgr2=0x7f8d0c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:26.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.629+0000 7f8d2ea00640 1 --2- 172.21.15.103:0/2082416568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d0c003a60 0x7f8d0c003e80 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f8d18006fd0 tx=0x7f8d1801caf0 comp rx=0 tx=0).stop 2024-09-10T22:45:26.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.629+0000 7f8d2ea00640 1 -- 172.21.15.103:0/2082416568 shutdown_connections 2024-09-10T22:45:26.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.629+0000 7f8d2ea00640 1 --2- 172.21.15.103:0/2082416568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d0c003a60 0x7f8d0c003e80 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:26.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.629+0000 7f8d2ea00640 1 -- 172.21.15.103:0/2082416568 >> 172.21.15.103:0/2082416568 conn(0x7f8d280d1ad0 msgr2=0x7f8d280d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:26.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.629+0000 7f8d2ea00640 1 -- 172.21.15.103:0/2082416568 shutdown_connections 2024-09-10T22:45:26.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.629+0000 7f8d2ea00640 1 -- 172.21.15.103:0/2082416568 wait complete. 2024-09-10T22:45:26.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.629+0000 7f8d2ea00640 1 Processor -- start 2024-09-10T22:45:26.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.629+0000 7f8d2ea00640 1 -- start start 2024-09-10T22:45:26.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.629+0000 7f8d2ea00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d0c003a60 0x7f8d280b7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:26.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.629+0000 7f8d2ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d281fba00 0x7f8d280ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:26.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.629+0000 7f8d2ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d281fae60 0x7f8d281fb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:26.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.629+0000 7f8d2ea00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8d280d04e0 con 0x7f8d281fae60 2024-09-10T22:45:26.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.629+0000 7f8d2ea00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8d280d0360 con 0x7f8d281fba00 2024-09-10T22:45:26.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.629+0000 7f8d2ea00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8d280d0660 con 0x7f8d0c003a60 2024-09-10T22:45:26.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.633+0000 7f8d2ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d281fae60 0x7f8d281fb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:26.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.633+0000 7f8d2ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d281fae60 0x7f8d281fb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51620/0 (socket says 172.21.15.103:51620) 2024-09-10T22:45:26.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.633+0000 7f8d2ca00640 1 -- 172.21.15.103:0/19662695 learned_addr learned my addr 172.21.15.103:0/19662695 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:26.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.633+0000 7f8d2ca00640 1 -- 172.21.15.103:0/19662695 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d0c003a60 msgr2=0x7f8d280b7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:26.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.633+0000 7f8d2ca00640 1 --2- 172.21.15.103:0/19662695 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d0c003a60 0x7f8d280b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:26.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.633+0000 7f8d2ca00640 1 -- 172.21.15.103:0/19662695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d281fba00 msgr2=0x7f8d280ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:26.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.633+0000 7f8d2ca00640 1 --2- 172.21.15.103:0/19662695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d281fba00 0x7f8d280ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:26.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.633+0000 7f8d2ca00640 1 -- 172.21.15.103:0/19662695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d280caa50 con 0x7f8d281fae60 2024-09-10T22:45:26.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.633+0000 7f8d2ca00640 1 --2- 172.21.15.103:0/19662695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d281fae60 0x7f8d281fb310 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f8d280d17c0 tx=0x7f8d2000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:26.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.633+0000 7f8d24c00640 1 -- 172.21.15.103:0/19662695 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20017070 con 0x7f8d281fae60 2024-09-10T22:45:26.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.633+0000 7f8d24c00640 1 -- 172.21.15.103:0/19662695 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d20003600 con 0x7f8d281fae60 2024-09-10T22:45:26.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.633+0000 7f8d2ea00640 1 -- 172.21.15.103:0/19662695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d280cad30 con 0x7f8d281fae60 2024-09-10T22:45:26.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.633+0000 7f8d24c00640 1 -- 172.21.15.103:0/19662695 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20003a50 con 0x7f8d281fae60 2024-09-10T22:45:26.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.633+0000 7f8d2ea00640 1 -- 172.21.15.103:0/19662695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d280cb2f0 con 0x7f8d281fae60 2024-09-10T22:45:26.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.633+0000 7f8d2ea00640 1 -- 172.21.15.103:0/19662695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d280b2900 con 0x7f8d281fae60 2024-09-10T22:45:26.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.633+0000 7f8d24c00640 1 -- 172.21.15.103:0/19662695 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8d20003bf0 con 0x7f8d281fae60 2024-09-10T22:45:26.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.637+0000 7f8d24c00640 1 --2- 172.21.15.103:0/19662695 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8d040725e0 0x7f8d04074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:26.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.637+0000 7f8d24c00640 1 -- 172.21.15.103:0/19662695 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5619+0+0 (secure 0 0 0) 0x7f8d20092650 con 0x7f8d281fae60 2024-09-10T22:45:26.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.637+0000 7f8d27e00640 1 --2- 172.21.15.103:0/19662695 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8d040725e0 0x7f8d04074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:26.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.637+0000 7f8d27e00640 1 --2- 172.21.15.103:0/19662695 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8d040725e0 0x7f8d04074aa0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8d180aa000 tx=0x7f8d0c005840 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:26.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.641+0000 7f8d24c00640 1 -- 172.21.15.103:0/19662695 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8d2005dd70 con 0x7f8d281fae60 2024-09-10T22:45:26.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:26.809+0000 7f8d2ea00640 1 -- 172.21.15.103:0/19662695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8d280d2050 con 0x7f8d281fae60 2024-09-10T22:45:27.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.453+0000 7f8d24c00640 1 -- 172.21.15.103:0/19662695 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v103) ==== 170+0+0 (secure 0 0 0) 0x7f8d2005d670 con 0x7f8d281fae60 2024-09-10T22:45:27.458 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2024-09-10T22:45:27.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.457+0000 7f8d2ea00640 1 -- 172.21.15.103:0/19662695 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8d040725e0 msgr2=0x7f8d04074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:27.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.457+0000 7f8d2ea00640 1 --2- 172.21.15.103:0/19662695 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8d040725e0 0x7f8d04074aa0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8d180aa000 tx=0x7f8d0c005840 comp rx=0 tx=0).stop 2024-09-10T22:45:27.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.457+0000 7f8d2ea00640 1 -- 172.21.15.103:0/19662695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d281fae60 msgr2=0x7f8d281fb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:27.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.457+0000 7f8d2ea00640 1 --2- 172.21.15.103:0/19662695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d281fae60 0x7f8d281fb310 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f8d280d17c0 tx=0x7f8d2000c890 comp rx=0 tx=0).stop 2024-09-10T22:45:27.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.457+0000 7f8d2ea00640 1 -- 172.21.15.103:0/19662695 shutdown_connections 2024-09-10T22:45:27.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.457+0000 7f8d2ea00640 1 --2- 172.21.15.103:0/19662695 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f8d040725e0 0x7f8d04074aa0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:27.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.457+0000 7f8d2ea00640 1 --2- 172.21.15.103:0/19662695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d281fae60 0x7f8d281fb310 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:27.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.457+0000 7f8d2ea00640 1 --2- 172.21.15.103:0/19662695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d281fba00 0x7f8d280ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:27.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.457+0000 7f8d2ea00640 1 --2- 172.21.15.103:0/19662695 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d0c003a60 0x7f8d280b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:27.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.457+0000 7f8d2ea00640 1 -- 172.21.15.103:0/19662695 >> 172.21.15.103:0/19662695 conn(0x7f8d280d1ad0 msgr2=0x7f8d2815df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:27.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.461+0000 7f8d2ea00640 1 -- 172.21.15.103:0/19662695 shutdown_connections 2024-09-10T22:45:27.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.461+0000 7f8d2ea00640 1 -- 172.21.15.103:0/19662695 wait complete. 2024-09-10T22:45:27.499 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T22:45:27.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.641+0000 7f768b800640 1 -- 172.21.15.103:0/3138440901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7684072a40 msgr2=0x7f7684157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:27.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.641+0000 7f768b800640 1 --2- 172.21.15.103:0/3138440901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7684072a40 0x7f7684157090 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f76840b4f10 tx=0x7f767c01cd80 comp rx=0 tx=0).stop 2024-09-10T22:45:27.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.641+0000 7f768b800640 1 -- 172.21.15.103:0/3138440901 shutdown_connections 2024-09-10T22:45:27.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.641+0000 7f768b800640 1 --2- 172.21.15.103:0/3138440901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7684072a40 0x7f7684157090 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:27.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.641+0000 7f768b800640 1 --2- 172.21.15.103:0/3138440901 >> v2:172.21.15.131:3300/0 conn(0x7f76840b3320 0x7f7684072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:27.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.641+0000 7f768b800640 1 -- 172.21.15.103:0/3138440901 >> 172.21.15.103:0/3138440901 conn(0x7f768406cc00 msgr2=0x7f768406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:27.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.641+0000 7f768b800640 1 -- 172.21.15.103:0/3138440901 shutdown_connections 2024-09-10T22:45:27.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.641+0000 7f768b800640 1 -- 172.21.15.103:0/3138440901 wait complete. 2024-09-10T22:45:27.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.641+0000 7f768b800640 1 Processor -- start 2024-09-10T22:45:27.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.641+0000 7f768b800640 1 -- start start 2024-09-10T22:45:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f768b800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7684072a40 0x7f768414b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f768b800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76840b3320 0x7f76840ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f768b800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76840cf260 0x7f768413e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f768b800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f768406e800 con 0x7f76840cf260 2024-09-10T22:45:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f768b800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7684157ed0 con 0x7f76840b3320 2024-09-10T22:45:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f768b800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f768406e980 con 0x7f7684072a40 2024-09-10T22:45:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f7689800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76840cf260 0x7f768413e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:27.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f7689800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76840cf260 0x7f768413e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40998/0 (socket says 172.21.15.103:40998) 2024-09-10T22:45:27.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f7689800640 1 -- 172.21.15.103:0/3985934841 learned_addr learned my addr 172.21.15.103:0/3985934841 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f7689800640 1 -- 172.21.15.103:0/3985934841 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7684072a40 msgr2=0x7f768414b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f7689800640 1 --2- 172.21.15.103:0/3985934841 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7684072a40 0x7f768414b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f7689800640 1 -- 172.21.15.103:0/3985934841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76840b3320 msgr2=0x7f76840ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f7689800640 1 --2- 172.21.15.103:0/3985934841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76840b3320 0x7f76840ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f7689800640 1 -- 172.21.15.103:0/3985934841 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76840b05b0 con 0x7f76840cf260 2024-09-10T22:45:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f7689800640 1 --2- 172.21.15.103:0/3985934841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76840cf260 0x7f768413e040 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f767c01b430 tx=0x7f767c009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:27.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f7681600640 1 -- 172.21.15.103:0/3985934841 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c0bb070 con 0x7f76840cf260 2024-09-10T22:45:27.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f7681600640 1 -- 172.21.15.103:0/3985934841 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f767c004d40 con 0x7f76840cf260 2024-09-10T22:45:27.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f768b800640 1 -- 172.21.15.103:0/3985934841 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f768414bd60 con 0x7f76840cf260 2024-09-10T22:45:27.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f7681600640 1 -- 172.21.15.103:0/3985934841 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c0b2040 con 0x7f76840cf260 2024-09-10T22:45:27.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f768b800640 1 -- 172.21.15.103:0/3985934841 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f768414c320 con 0x7f76840cf260 2024-09-10T22:45:27.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.645+0000 7f768b800640 1 -- 172.21.15.103:0/3985934841 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7684158e30 con 0x7f76840cf260 2024-09-10T22:45:27.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.649+0000 7f7681600640 1 -- 172.21.15.103:0/3985934841 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f767c0b5030 con 0x7f76840cf260 2024-09-10T22:45:27.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.649+0000 7f7681600640 1 --2- 172.21.15.103:0/3985934841 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76600725e0 0x7f7660074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:27.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.649+0000 7f7681600640 1 -- 172.21.15.103:0/3985934841 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6001+0+0 (secure 0 0 0) 0x7f767c12d660 con 0x7f76840cf260 2024-09-10T22:45:27.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.649+0000 7f7688e00640 1 --2- 172.21.15.103:0/3985934841 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76600725e0 0x7f7660074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:27.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.649+0000 7f7688e00640 1 --2- 172.21.15.103:0/3985934841 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76600725e0 0x7f7660074aa0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f768414dd40 tx=0x7f7674006bd0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:27.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.653+0000 7f7681600640 1 -- 172.21.15.103:0/3985934841 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f767c016970 con 0x7f76840cf260 2024-09-10T22:45:27.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:27.853+0000 7f768b800640 1 -- 172.21.15.103:0/3985934841 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7684157050 con 0x7f76840cf260 2024-09-10T22:45:28.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.465+0000 7f7681600640 1 -- 172.21.15.103:0/3985934841 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v104) ==== 174+0+0 (secure 0 0 0) 0x7f767c0f8c80 con 0x7f76840cf260 2024-09-10T22:45:28.475 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 15 and data pool 16 2024-09-10T22:45:28.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.481+0000 7f768b800640 1 -- 172.21.15.103:0/3985934841 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76600725e0 msgr2=0x7f7660074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:28.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.481+0000 7f768b800640 1 --2- 172.21.15.103:0/3985934841 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76600725e0 0x7f7660074aa0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f768414dd40 tx=0x7f7674006bd0 comp rx=0 tx=0).stop 2024-09-10T22:45:28.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.481+0000 7f768b800640 1 -- 172.21.15.103:0/3985934841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76840cf260 msgr2=0x7f768413e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:28.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.481+0000 7f768b800640 1 --2- 172.21.15.103:0/3985934841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76840cf260 0x7f768413e040 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f767c01b430 tx=0x7f767c009300 comp rx=0 tx=0).stop 2024-09-10T22:45:28.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.493+0000 7f768b800640 1 -- 172.21.15.103:0/3985934841 shutdown_connections 2024-09-10T22:45:28.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.493+0000 7f768b800640 1 --2- 172.21.15.103:0/3985934841 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f76600725e0 0x7f7660074aa0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:28.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.493+0000 7f768b800640 1 --2- 172.21.15.103:0/3985934841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76840cf260 0x7f768413e040 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:28.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.493+0000 7f768b800640 1 --2- 172.21.15.103:0/3985934841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76840b3320 0x7f76840ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:28.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.493+0000 7f768b800640 1 --2- 172.21.15.103:0/3985934841 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7684072a40 0x7f768414b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:28.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.493+0000 7f768b800640 1 -- 172.21.15.103:0/3985934841 >> 172.21.15.103:0/3985934841 conn(0x7f768406cc00 msgr2=0x7f7684159350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:28.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.493+0000 7f768b800640 1 -- 172.21.15.103:0/3985934841 shutdown_connections 2024-09-10T22:45:28.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.493+0000 7f768b800640 1 -- 172.21.15.103:0/3985934841 wait complete. 2024-09-10T22:45:28.528 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:45:28.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.677+0000 7f0d9b200640 1 -- 172.21.15.103:0/3892724210 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d78004810 msgr2=0x7f0d78004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:28.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.677+0000 7f0d9b200640 1 --2- 172.21.15.103:0/3892724210 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d78004810 0x7f0d78004c90 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c001860 tx=0x7f0d7c01c8b0 comp rx=0 tx=0).stop 2024-09-10T22:45:28.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.677+0000 7f0d99200640 1 -- 172.21.15.103:0/3892724210 reap_dead start 2024-09-10T22:45:28.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.677+0000 7f0d9b200640 1 -- 172.21.15.103:0/3892724210 shutdown_connections 2024-09-10T22:45:28.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.677+0000 7f0d9b200640 1 -- 172.21.15.103:0/3892724210 >> 172.21.15.103:0/3892724210 conn(0x7f0d9406cc00 msgr2=0x7f0d9406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:28.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.677+0000 7f0d9b200640 1 -- 172.21.15.103:0/3892724210 shutdown_connections 2024-09-10T22:45:28.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.677+0000 7f0d9b200640 1 -- 172.21.15.103:0/3892724210 wait complete. 2024-09-10T22:45:28.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.677+0000 7f0d9b200640 1 Processor -- start 2024-09-10T22:45:28.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.677+0000 7f0d9b200640 1 -- start start 2024-09-10T22:45:28.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.677+0000 7f0d9b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d78004810 0x7f0d9414eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:28.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.677+0000 7f0d9b200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d941531e0 0x7f0d9414e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:28.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.677+0000 7f0d9b200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d941f7de0 0x7f0d941f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:28.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.677+0000 7f0d9b200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0d94167b90 con 0x7f0d78004810 2024-09-10T22:45:28.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.677+0000 7f0d9b200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0d94167a10 con 0x7f0d941f7de0 2024-09-10T22:45:28.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.677+0000 7f0d9b200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0d94167d10 con 0x7f0d941531e0 2024-09-10T22:45:28.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.677+0000 7f0d93e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d78004810 0x7f0d9414eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:28.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.677+0000 7f0d93e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d78004810 0x7f0d9414eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41006/0 (socket says 172.21.15.103:41006) 2024-09-10T22:45:28.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.677+0000 7f0d93e00640 1 -- 172.21.15.103:0/2658799351 learned_addr learned my addr 172.21.15.103:0/2658799351 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:28.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.681+0000 7f0d93e00640 1 -- 172.21.15.103:0/2658799351 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d941531e0 msgr2=0x7f0d9414e520 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T22:45:28.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.681+0000 7f0d93e00640 1 --2- 172.21.15.103:0/2658799351 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d941531e0 0x7f0d9414e520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:28.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.681+0000 7f0d93e00640 1 -- 172.21.15.103:0/2658799351 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d941f7de0 msgr2=0x7f0d941f87c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T22:45:28.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.681+0000 7f0d93e00640 1 --2- 172.21.15.103:0/2658799351 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d941f7de0 0x7f0d941f87c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:28.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.681+0000 7f0d93e00640 1 -- 172.21.15.103:0/2658799351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d94153dd0 con 0x7f0d78004810 2024-09-10T22:45:28.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.681+0000 7f0d93e00640 1 --2- 172.21.15.103:0/2658799351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d78004810 0x7f0d9414eb80 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f0d84002240 tx=0x7f0d8400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:28.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.681+0000 7f0d90c00640 1 -- 172.21.15.103:0/2658799351 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d84015070 con 0x7f0d78004810 2024-09-10T22:45:28.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.681+0000 7f0d90c00640 1 -- 172.21.15.103:0/2658799351 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d8400ccc0 con 0x7f0d78004810 2024-09-10T22:45:28.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.681+0000 7f0d9b200640 1 -- 172.21.15.103:0/2658799351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d941540b0 con 0x7f0d78004810 2024-09-10T22:45:28.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.681+0000 7f0d90c00640 1 -- 172.21.15.103:0/2658799351 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d840116c0 con 0x7f0d78004810 2024-09-10T22:45:28.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.681+0000 7f0d9b200640 1 -- 172.21.15.103:0/2658799351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d941f8290 con 0x7f0d78004810 2024-09-10T22:45:28.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.681+0000 7f0d9b200640 1 -- 172.21.15.103:0/2658799351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d94153600 con 0x7f0d78004810 2024-09-10T22:45:28.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.681+0000 7f0d90c00640 1 -- 172.21.15.103:0/2658799351 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0d84011860 con 0x7f0d78004810 2024-09-10T22:45:28.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.681+0000 7f0d90c00640 1 --2- 172.21.15.103:0/2658799351 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0d70072610 0x7f0d70074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:28.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.685+0000 7f0d90c00640 1 -- 172.21.15.103:0/2658799351 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f0d84093e20 con 0x7f0d78004810 2024-09-10T22:45:28.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.685+0000 7f0d8b400640 1 --2- 172.21.15.103:0/2658799351 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0d70072610 0x7f0d70074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:28.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.685+0000 7f0d8b400640 1 --2- 172.21.15.103:0/2658799351 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0d70072610 0x7f0d70074ad0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c001830 tx=0x7f0d7c0196f0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:28.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.689+0000 7f0d90c00640 1 -- 172.21.15.103:0/2658799351 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0d94153600 con 0x7f0d78004810 2024-09-10T22:45:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.857+0000 7f0d9b200640 1 -- 172.21.15.103:0/2658799351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d941f76c0 con 0x7f0d78004810 2024-09-10T22:45:28.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.857+0000 7f0d90c00640 1 -- 172.21.15.103:0/2658799351 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+17017 (secure 0 0 0) 0x7f0d8405f2e0 con 0x7f0d78004810 2024-09-10T22:45:28.861 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:28.861 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":104,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:45:27.857938+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:45:25.542643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-10T22:45:26.823498+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:45:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.857+0000 7f0d9b200640 1 -- 172.21.15.103:0/2658799351 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0d70072610 msgr2=0x7f0d70074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.857+0000 7f0d9b200640 1 --2- 172.21.15.103:0/2658799351 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0d70072610 0x7f0d70074ad0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c001830 tx=0x7f0d7c0196f0 comp rx=0 tx=0).stop 2024-09-10T22:45:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.857+0000 7f0d9b200640 1 -- 172.21.15.103:0/2658799351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d78004810 msgr2=0x7f0d9414eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.857+0000 7f0d9b200640 1 --2- 172.21.15.103:0/2658799351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d78004810 0x7f0d9414eb80 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f0d84002240 tx=0x7f0d8400ed70 comp rx=0 tx=0).stop 2024-09-10T22:45:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.857+0000 7f0d9b200640 1 -- 172.21.15.103:0/2658799351 shutdown_connections 2024-09-10T22:45:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.857+0000 7f0d9b200640 1 --2- 172.21.15.103:0/2658799351 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0d70072610 0x7f0d70074ad0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.857+0000 7f0d9b200640 1 --2- 172.21.15.103:0/2658799351 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d941f7de0 0x7f0d941f87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.857+0000 7f0d9b200640 1 --2- 172.21.15.103:0/2658799351 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d941531e0 0x7f0d9414e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.857+0000 7f0d9b200640 1 --2- 172.21.15.103:0/2658799351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d78004810 0x7f0d9414eb80 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.857+0000 7f0d9b200640 1 -- 172.21.15.103:0/2658799351 >> 172.21.15.103:0/2658799351 conn(0x7f0d9406cc00 msgr2=0x7f0d940b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.857+0000 7f0d9b200640 1 -- 172.21.15.103:0/2658799351 shutdown_connections 2024-09-10T22:45:28.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:28.857+0000 7f0d9b200640 1 -- 172.21.15.103:0/2658799351 wait complete. 2024-09-10T22:45:28.883 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:45:29.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.021+0000 7f6324200640 1 -- 172.21.15.103:0/2250286554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6304004810 msgr2=0x7f6304004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:29.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.021+0000 7f6324200640 1 --2- 172.21.15.103:0/2250286554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6304004810 0x7f6304004c90 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f63080016f0 tx=0x7f630801c750 comp rx=0 tx=0).stop 2024-09-10T22:45:29.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6324200640 1 -- 172.21.15.103:0/2250286554 shutdown_connections 2024-09-10T22:45:29.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6324200640 1 --2- 172.21.15.103:0/2250286554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6304004810 0x7f6304004c90 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:29.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6324200640 1 -- 172.21.15.103:0/2250286554 >> 172.21.15.103:0/2250286554 conn(0x7f631c0d1ac0 msgr2=0x7f631c0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:29.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6324200640 1 -- 172.21.15.103:0/2250286554 shutdown_connections 2024-09-10T22:45:29.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6324200640 1 -- 172.21.15.103:0/2250286554 wait complete. 2024-09-10T22:45:29.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6324200640 1 Processor -- start 2024-09-10T22:45:29.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6324200640 1 -- start start 2024-09-10T22:45:29.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6324200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6304004810 0x7f631c1f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:29.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6324200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c1f4bd0 0x7f631c1f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:29.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6324200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f631c0b6cb0 0x7f631c0b7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:29.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6324200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f631c0b27f0 con 0x7f631c1f4bd0 2024-09-10T22:45:29.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6324200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f631c0b2670 con 0x7f631c0b6cb0 2024-09-10T22:45:29.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6324200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f631c0ae810 con 0x7f6304004810 2024-09-10T22:45:29.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6320e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c1f4bd0 0x7f631c1f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:29.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6320e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c1f4bd0 0x7f631c1f5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41030/0 (socket says 172.21.15.103:41030) 2024-09-10T22:45:29.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6320e00640 1 -- 172.21.15.103:0/761631906 learned_addr learned my addr 172.21.15.103:0/761631906 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:29.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6321800640 1 --2- 172.21.15.103:0/761631906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6304004810 0x7f631c1f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:29.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6322200640 1 --2- 172.21.15.103:0/761631906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f631c0b6cb0 0x7f631c0b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:29.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6320e00640 1 -- 172.21.15.103:0/761631906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6304004810 msgr2=0x7f631c1f45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:29.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6320e00640 1 --2- 172.21.15.103:0/761631906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6304004810 0x7f631c1f45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:29.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6320e00640 1 -- 172.21.15.103:0/761631906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f631c0b6cb0 msgr2=0x7f631c0b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:29.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6320e00640 1 --2- 172.21.15.103:0/761631906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f631c0b6cb0 0x7f631c0b7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:29.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6320e00640 1 -- 172.21.15.103:0/761631906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631c1f5570 con 0x7f631c1f4bd0 2024-09-10T22:45:29.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6322200640 1 --2- 172.21.15.103:0/761631906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f631c0b6cb0 0x7f631c0b7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:29.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.025+0000 7f6320e00640 1 --2- 172.21.15.103:0/761631906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c1f4bd0 0x7f631c1f5030 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f630801ae50 tx=0x7f6308006950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:29.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.029+0000 7f6319600640 1 -- 172.21.15.103:0/761631906 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6308003890 con 0x7f631c1f4bd0 2024-09-10T22:45:29.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.029+0000 7f6319600640 1 -- 172.21.15.103:0/761631906 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6308003b20 con 0x7f631c1f4bd0 2024-09-10T22:45:29.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.029+0000 7f6319600640 1 -- 172.21.15.103:0/761631906 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63080a55b0 con 0x7f631c1f4bd0 2024-09-10T22:45:29.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.029+0000 7f6324200640 1 -- 172.21.15.103:0/761631906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f631c0b4c40 con 0x7f631c1f4bd0 2024-09-10T22:45:29.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.029+0000 7f6324200640 1 -- 172.21.15.103:0/761631906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f631c0b5200 con 0x7f631c1f4bd0 2024-09-10T22:45:29.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.029+0000 7f6324200640 1 -- 172.21.15.103:0/761631906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f631c15d0a0 con 0x7f631c1f4bd0 2024-09-10T22:45:29.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.029+0000 7f6319600640 1 -- 172.21.15.103:0/761631906 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f63080a5750 con 0x7f631c1f4bd0 2024-09-10T22:45:29.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.029+0000 7f6319600640 1 --2- 172.21.15.103:0/761631906 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f62fc0725e0 0x7f62fc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:29.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.033+0000 7f6319600640 1 -- 172.21.15.103:0/761631906 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f630812d270 con 0x7f631c1f4bd0 2024-09-10T22:45:29.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.033+0000 7f6321800640 1 --2- 172.21.15.103:0/761631906 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f62fc0725e0 0x7f62fc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:29.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.033+0000 7f6321800640 1 --2- 172.21.15.103:0/761631906 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f62fc0725e0 0x7f62fc074aa0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f631c052890 tx=0x7f63100091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:29.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.033+0000 7f6319600640 1 -- 172.21.15.103:0/761631906 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f63080b3070 con 0x7f631c1f4bd0 2024-09-10T22:45:29.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.201+0000 7f6324200640 1 -- 172.21.15.103:0/761631906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f631c0720b0 con 0x7f631c1f4bd0 2024-09-10T22:45:29.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.205+0000 7f6319600640 1 -- 172.21.15.103:0/761631906 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+17017 (secure 0 0 0) 0x7f63080164b0 con 0x7f631c1f4bd0 2024-09-10T22:45:29.208 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:29.208 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":104,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:45:27.857938+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:45:25.542643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-10T22:45:26.823498+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:45:29.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.205+0000 7f6324200640 1 -- 172.21.15.103:0/761631906 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f62fc0725e0 msgr2=0x7f62fc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:29.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.205+0000 7f6324200640 1 --2- 172.21.15.103:0/761631906 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f62fc0725e0 0x7f62fc074aa0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f631c052890 tx=0x7f63100091e0 comp rx=0 tx=0).stop 2024-09-10T22:45:29.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.205+0000 7f6324200640 1 -- 172.21.15.103:0/761631906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c1f4bd0 msgr2=0x7f631c1f5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:29.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.205+0000 7f6324200640 1 --2- 172.21.15.103:0/761631906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c1f4bd0 0x7f631c1f5030 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f630801ae50 tx=0x7f6308006950 comp rx=0 tx=0).stop 2024-09-10T22:45:29.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.205+0000 7f6324200640 1 -- 172.21.15.103:0/761631906 shutdown_connections 2024-09-10T22:45:29.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.205+0000 7f6324200640 1 --2- 172.21.15.103:0/761631906 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f62fc0725e0 0x7f62fc074aa0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:29.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.205+0000 7f6324200640 1 --2- 172.21.15.103:0/761631906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f631c0b6cb0 0x7f631c0b7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:29.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.205+0000 7f6324200640 1 --2- 172.21.15.103:0/761631906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c1f4bd0 0x7f631c1f5030 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:29.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.205+0000 7f6324200640 1 --2- 172.21.15.103:0/761631906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6304004810 0x7f631c1f45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:29.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.205+0000 7f6324200640 1 -- 172.21.15.103:0/761631906 >> 172.21.15.103:0/761631906 conn(0x7f631c0d1ac0 msgr2=0x7f631c070600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:29.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.205+0000 7f6324200640 1 -- 172.21.15.103:0/761631906 shutdown_connections 2024-09-10T22:45:29.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.205+0000 7f6324200640 1 -- 172.21.15.103:0/761631906 wait complete. 2024-09-10T22:45:29.230 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T22:45:29.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.369+0000 7f7c42600640 1 -- 172.21.15.103:0/1517621961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c3c0cf9f0 msgr2=0x7f7c3c06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:29.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.369+0000 7f7c42600640 1 --2- 172.21.15.103:0/1517621961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c3c0cf9f0 0x7f7c3c06eb80 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009900 tx=0x7f7c2c01c8e0 comp rx=0 tx=0).stop 2024-09-10T22:45:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.369+0000 7f7c42600640 1 -- 172.21.15.103:0/1517621961 shutdown_connections 2024-09-10T22:45:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.369+0000 7f7c42600640 1 --2- 172.21.15.103:0/1517621961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c3c0cfdd0 0x7f7c3c073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.369+0000 7f7c42600640 1 --2- 172.21.15.103:0/1517621961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c3c0cf9f0 0x7f7c3c06eb80 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.369+0000 7f7c42600640 1 -- 172.21.15.103:0/1517621961 >> 172.21.15.103:0/1517621961 conn(0x7f7c3c06cc00 msgr2=0x7f7c3c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.369+0000 7f7c42600640 1 -- 172.21.15.103:0/1517621961 shutdown_connections 2024-09-10T22:45:29.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.369+0000 7f7c42600640 1 -- 172.21.15.103:0/1517621961 wait complete. 2024-09-10T22:45:29.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c42600640 1 Processor -- start 2024-09-10T22:45:29.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c42600640 1 -- start start 2024-09-10T22:45:29.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c42600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c3c06f0c0 0x7f7c3c073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:29.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c42600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c3c0cf9f0 0x7f7c3c149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:29.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c42600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c3c0cfdd0 0x7f7c3c072500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:29.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c42600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3c0cd690 con 0x7f7c3c0cfdd0 2024-09-10T22:45:29.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c42600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3c0cd510 con 0x7f7c3c0cf9f0 2024-09-10T22:45:29.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c42600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7c3c0cd810 con 0x7f7c3c06f0c0 2024-09-10T22:45:29.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c3be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c3c0cfdd0 0x7f7c3c072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:29.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c3be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c3c0cfdd0 0x7f7c3c072500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41038/0 (socket says 172.21.15.103:41038) 2024-09-10T22:45:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c3be00640 1 -- 172.21.15.103:0/1583917812 learned_addr learned my addr 172.21.15.103:0/1583917812 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c3b400640 1 --2- 172.21.15.103:0/1583917812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c3c06f0c0 0x7f7c3c073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c32a00640 1 --2- 172.21.15.103:0/1583917812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c3c0cf9f0 0x7f7c3c149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c3be00640 1 -- 172.21.15.103:0/1583917812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c3c06f0c0 msgr2=0x7f7c3c073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c3be00640 1 --2- 172.21.15.103:0/1583917812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c3c06f0c0 0x7f7c3c073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c3be00640 1 -- 172.21.15.103:0/1583917812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c3c0cf9f0 msgr2=0x7f7c3c149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c3be00640 1 --2- 172.21.15.103:0/1583917812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c3c0cf9f0 0x7f7c3c149450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c3be00640 1 -- 172.21.15.103:0/1583917812 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c3c1f8750 con 0x7f7c3c0cfdd0 2024-09-10T22:45:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c32a00640 1 --2- 172.21.15.103:0/1583917812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c3c0cf9f0 0x7f7c3c149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c3be00640 1 --2- 172.21.15.103:0/1583917812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c3c0cfdd0 0x7f7c3c072500 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400cd10 tx=0x7f7c3400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c33e00640 1 -- 172.21.15.103:0/1583917812 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3400f450 con 0x7f7c3c0cfdd0 2024-09-10T22:45:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c33e00640 1 -- 172.21.15.103:0/1583917812 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c3400f700 con 0x7f7c3c0cfdd0 2024-09-10T22:45:29.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c42600640 1 -- 172.21.15.103:0/1583917812 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c3c1f89f0 con 0x7f7c3c0cfdd0 2024-09-10T22:45:29.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.373+0000 7f7c33e00640 1 -- 172.21.15.103:0/1583917812 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3400fb50 con 0x7f7c3c0cfdd0 2024-09-10T22:45:29.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.377+0000 7f7c42600640 1 -- 172.21.15.103:0/1583917812 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c3c1f9290 con 0x7f7c3c0cfdd0 2024-09-10T22:45:29.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.377+0000 7f7c42600640 1 -- 172.21.15.103:0/1583917812 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c3c06eb80 con 0x7f7c3c0cfdd0 2024-09-10T22:45:29.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.377+0000 7f7c33e00640 1 -- 172.21.15.103:0/1583917812 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7c34018400 con 0x7f7c3c0cfdd0 2024-09-10T22:45:29.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.381+0000 7f7c33e00640 1 --2- 172.21.15.103:0/1583917812 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7c180725e0 0x7f7c18074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:29.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.381+0000 7f7c33e00640 1 -- 172.21.15.103:0/1583917812 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f7c34093fc0 con 0x7f7c3c0cfdd0 2024-09-10T22:45:29.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.381+0000 7f7c3b400640 1 --2- 172.21.15.103:0/1583917812 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7c180725e0 0x7f7c18074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:29.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.381+0000 7f7c3b400640 1 --2- 172.21.15.103:0/1583917812 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7c180725e0 0x7f7c18074aa0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0af000 tx=0x7f7c2c01b120 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:29.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.381+0000 7f7c33e00640 1 -- 172.21.15.103:0/1583917812 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7c34014030 con 0x7f7c3c0cfdd0 2024-09-10T22:45:29.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:29.589+0000 7f7c42600640 1 -- 172.21.15.103:0/1583917812 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7c3c14af40 con 0x7f7c3c0cfdd0 2024-09-10T22:45:30.448 INFO:tasks.ceph.mds.c.smithi103.stderr:2024-09-10T22:45:30.445+0000 7fa8c6600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T22:45:30.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.477+0000 7f7c33e00640 1 -- 172.21.15.103:0/1583917812 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v106) ==== 118+0+0 (secure 0 0 0) 0x7f7c3405f580 con 0x7f7c3c0cfdd0 2024-09-10T22:45:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.481+0000 7f7c42600640 1 -- 172.21.15.103:0/1583917812 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7c180725e0 msgr2=0x7f7c18074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.481+0000 7f7c42600640 1 --2- 172.21.15.103:0/1583917812 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7c180725e0 0x7f7c18074aa0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0af000 tx=0x7f7c2c01b120 comp rx=0 tx=0).stop 2024-09-10T22:45:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.481+0000 7f7c42600640 1 -- 172.21.15.103:0/1583917812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c3c0cfdd0 msgr2=0x7f7c3c072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.481+0000 7f7c42600640 1 --2- 172.21.15.103:0/1583917812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c3c0cfdd0 0x7f7c3c072500 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400cd10 tx=0x7f7c3400a620 comp rx=0 tx=0).stop 2024-09-10T22:45:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.481+0000 7f7c42600640 1 -- 172.21.15.103:0/1583917812 shutdown_connections 2024-09-10T22:45:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.481+0000 7f7c42600640 1 --2- 172.21.15.103:0/1583917812 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f7c180725e0 0x7f7c18074aa0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.481+0000 7f7c42600640 1 --2- 172.21.15.103:0/1583917812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c3c0cfdd0 0x7f7c3c072500 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.481+0000 7f7c42600640 1 --2- 172.21.15.103:0/1583917812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c3c0cf9f0 0x7f7c3c149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.481+0000 7f7c42600640 1 --2- 172.21.15.103:0/1583917812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c3c06f0c0 0x7f7c3c073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.481+0000 7f7c42600640 1 -- 172.21.15.103:0/1583917812 >> 172.21.15.103:0/1583917812 conn(0x7f7c3c06cc00 msgr2=0x7f7c3c14a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:30.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.481+0000 7f7c42600640 1 -- 172.21.15.103:0/1583917812 shutdown_connections 2024-09-10T22:45:30.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.481+0000 7f7c42600640 1 -- 172.21.15.103:0/1583917812 wait complete. 2024-09-10T22:45:30.507 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T22:45:30.507 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T22:45:30.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.649+0000 7f293d200640 1 -- 172.21.15.103:0/3504762055 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29381612c0 msgr2=0x7f29380d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:30.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.649+0000 7f293d200640 1 --2- 172.21.15.103:0/3504762055 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29381612c0 0x7f29380d0a50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2928009840 tx=0x7f292801c820 comp rx=0 tx=0).stop 2024-09-10T22:45:30.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.649+0000 7f293d200640 1 -- 172.21.15.103:0/3504762055 shutdown_connections 2024-09-10T22:45:30.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.649+0000 7f293d200640 1 --2- 172.21.15.103:0/3504762055 >> v2:172.21.15.131:3300/0 conn(0x7f29380b2970 0x7f29380b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:30.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.649+0000 7f293d200640 1 --2- 172.21.15.103:0/3504762055 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29381612c0 0x7f29380d0a50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:30.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.649+0000 7f293d200640 1 -- 172.21.15.103:0/3504762055 >> 172.21.15.103:0/3504762055 conn(0x7f29380d1a20 msgr2=0x7f29380d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:30.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.649+0000 7f293d200640 1 -- 172.21.15.103:0/3504762055 shutdown_connections 2024-09-10T22:45:30.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.649+0000 7f293d200640 1 -- 172.21.15.103:0/3504762055 wait complete. 2024-09-10T22:45:30.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f293d200640 1 Processor -- start 2024-09-10T22:45:30.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f293d200640 1 -- start start 2024-09-10T22:45:30.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f293d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29380b1780 0x7f2938159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:30.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f293d200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29380b2970 0x7f29380b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:30.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f293d200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29381612c0 0x7f29380b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:30.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f293d200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f293816b200 con 0x7f29380b1780 2024-09-10T22:45:30.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f293d200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f293816b080 con 0x7f29381612c0 2024-09-10T22:45:30.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f293d200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f293816b380 con 0x7f29380b2970 2024-09-10T22:45:30.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f2935e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29380b1780 0x7f2938159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:30.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f2935e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29380b1780 0x7f2938159e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41048/0 (socket says 172.21.15.103:41048) 2024-09-10T22:45:30.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f2935e00640 1 -- 172.21.15.103:0/2735875102 learned_addr learned my addr 172.21.15.103:0/2735875102 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:30.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f2935400640 1 --2- 172.21.15.103:0/2735875102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29380b2970 0x7f29380b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:30.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f2936800640 1 --2- 172.21.15.103:0/2735875102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29381612c0 0x7f29380b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:30.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f2935e00640 1 -- 172.21.15.103:0/2735875102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29380b2970 msgr2=0x7f29380b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:30.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f2935e00640 1 --2- 172.21.15.103:0/2735875102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29380b2970 0x7f29380b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:30.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f2935e00640 1 -- 172.21.15.103:0/2735875102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29381612c0 msgr2=0x7f29380b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:30.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f2935e00640 1 --2- 172.21.15.103:0/2735875102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29381612c0 0x7f29380b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:30.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f2935e00640 1 -- 172.21.15.103:0/2735875102 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293814fdc0 con 0x7f29380b1780 2024-09-10T22:45:30.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f2936800640 1 --2- 172.21.15.103:0/2735875102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29381612c0 0x7f29380b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:30.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f2935e00640 1 --2- 172.21.15.103:0/2735875102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29380b1780 0x7f2938159e70 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f2928009790 tx=0x7f29280a5810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:30.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f292e000640 1 -- 172.21.15.103:0/2735875102 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29280b2040 con 0x7f29380b1780 2024-09-10T22:45:30.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f292e000640 1 -- 172.21.15.103:0/2735875102 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2928004430 con 0x7f29380b1780 2024-09-10T22:45:30.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f292e000640 1 -- 172.21.15.103:0/2735875102 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2928005280 con 0x7f29380b1780 2024-09-10T22:45:30.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f293d200640 1 -- 172.21.15.103:0/2735875102 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29381500a0 con 0x7f29380b1780 2024-09-10T22:45:30.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.653+0000 7f293d200640 1 -- 172.21.15.103:0/2735875102 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2938150660 con 0x7f29380b1780 2024-09-10T22:45:30.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.657+0000 7f293d200640 1 -- 172.21.15.103:0/2735875102 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29380b1240 con 0x7f29380b1780 2024-09-10T22:45:30.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.657+0000 7f292e000640 1 -- 172.21.15.103:0/2735875102 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f29280b5070 con 0x7f29380b1780 2024-09-10T22:45:30.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.657+0000 7f292e000640 1 --2- 172.21.15.103:0/2735875102 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2918072610 0x7f2918074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:30.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.657+0000 7f292e000640 1 -- 172.21.15.103:0/2735875102 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7f292812cb80 con 0x7f29380b1780 2024-09-10T22:45:30.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.657+0000 7f2935400640 1 --2- 172.21.15.103:0/2735875102 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2918072610 0x7f2918074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:30.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.657+0000 7f2935400640 1 --2- 172.21.15.103:0/2735875102 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2918072610 0x7f2918074ad0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f29380730f0 tx=0x7f29240091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:30.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.661+0000 7f292e000640 1 -- 172.21.15.103:0/2735875102 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2928016410 con 0x7f29380b1780 2024-09-10T22:45:30.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:30.861+0000 7f293d200640 1 -- 172.21.15.103:0/2735875102 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f29380b4120 con 0x7f29380b1780 2024-09-10T22:45:31.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.481+0000 7f292e000640 1 -- 172.21.15.103:0/2735875102 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v107) ==== 122+0+0 (secure 0 0 0) 0x7f29280f8030 con 0x7f29380b1780 2024-09-10T22:45:31.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.481+0000 7f293d200640 1 -- 172.21.15.103:0/2735875102 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2918072610 msgr2=0x7f2918074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:31.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.481+0000 7f293d200640 1 --2- 172.21.15.103:0/2735875102 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2918072610 0x7f2918074ad0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f29380730f0 tx=0x7f29240091e0 comp rx=0 tx=0).stop 2024-09-10T22:45:31.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.481+0000 7f293d200640 1 -- 172.21.15.103:0/2735875102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29380b1780 msgr2=0x7f2938159e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:31.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.481+0000 7f293d200640 1 --2- 172.21.15.103:0/2735875102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29380b1780 0x7f2938159e70 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f2928009790 tx=0x7f29280a5810 comp rx=0 tx=0).stop 2024-09-10T22:45:31.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.481+0000 7f293d200640 1 -- 172.21.15.103:0/2735875102 shutdown_connections 2024-09-10T22:45:31.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.481+0000 7f293d200640 1 --2- 172.21.15.103:0/2735875102 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2918072610 0x7f2918074ad0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:31.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.481+0000 7f293d200640 1 --2- 172.21.15.103:0/2735875102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29381612c0 0x7f29380b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:31.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.481+0000 7f293d200640 1 --2- 172.21.15.103:0/2735875102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29380b2970 0x7f29380b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:31.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.481+0000 7f293d200640 1 --2- 172.21.15.103:0/2735875102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29380b1780 0x7f2938159e70 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:31.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.481+0000 7f293d200640 1 -- 172.21.15.103:0/2735875102 >> 172.21.15.103:0/2735875102 conn(0x7f29380d1a20 msgr2=0x7f29380ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:31.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.481+0000 7f293d200640 1 -- 172.21.15.103:0/2735875102 shutdown_connections 2024-09-10T22:45:31.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.481+0000 7f293d200640 1 -- 172.21.15.103:0/2735875102 wait complete. 2024-09-10T22:45:31.507 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T22:45:31.507 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:45:31.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.645+0000 7f01e9600640 1 -- 172.21.15.103:0/702547966 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01e40b0ce0 msgr2=0x7f01e40d1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:31.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.645+0000 7f01e9600640 1 --2- 172.21.15.103:0/702547966 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01e40b0ce0 0x7f01e40d1840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009900 tx=0x7f01d001c7c0 comp rx=0 tx=0).stop 2024-09-10T22:45:31.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.645+0000 7f01e9600640 1 -- 172.21.15.103:0/702547966 shutdown_connections 2024-09-10T22:45:31.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.645+0000 7f01e9600640 1 --2- 172.21.15.103:0/702547966 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01e40b0ce0 0x7f01e40d1840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:31.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.645+0000 7f01e9600640 1 --2- 172.21.15.103:0/702547966 >> v2:172.21.15.131:3300/0 conn(0x7f01e415b730 0x7f01e40cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:31.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.645+0000 7f01e9600640 1 -- 172.21.15.103:0/702547966 >> 172.21.15.103:0/702547966 conn(0x7f01e409a9f0 msgr2=0x7f01e409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:31.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.645+0000 7f01e9600640 1 -- 172.21.15.103:0/702547966 shutdown_connections 2024-09-10T22:45:31.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.645+0000 7f01e9600640 1 -- 172.21.15.103:0/702547966 wait complete. 2024-09-10T22:45:31.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e9600640 1 Processor -- start 2024-09-10T22:45:31.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e9600640 1 -- start start 2024-09-10T22:45:31.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e9600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01e40b0ce0 0x7f01e40b7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:31.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e9600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e40d1d80 0x7f01e41589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:31.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e9600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01e415b730 0x7f01e4158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:31.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e9600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f01e4168800 con 0x7f01e40d1d80 2024-09-10T22:45:31.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e9600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f01e4168680 con 0x7f01e40b0ce0 2024-09-10T22:45:31.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e9600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f01e4168980 con 0x7f01e415b730 2024-09-10T22:45:31.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e40d1d80 0x7f01e41589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:31.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e40d1d80 0x7f01e41589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41050/0 (socket says 172.21.15.103:41050) 2024-09-10T22:45:31.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e3400640 1 -- 172.21.15.103:0/1397672612 learned_addr learned my addr 172.21.15.103:0/1397672612 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:31.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e3e00640 1 --2- 172.21.15.103:0/1397672612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01e40b0ce0 0x7f01e40b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:31.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e3400640 1 -- 172.21.15.103:0/1397672612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01e415b730 msgr2=0x7f01e4158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:31.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e3400640 1 --2- 172.21.15.103:0/1397672612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01e415b730 0x7f01e4158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:31.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e3400640 1 -- 172.21.15.103:0/1397672612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01e40b0ce0 msgr2=0x7f01e40b7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:31.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e3400640 1 --2- 172.21.15.103:0/1397672612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01e40b0ce0 0x7f01e40b7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:31.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e3400640 1 -- 172.21.15.103:0/1397672612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e41f8c60 con 0x7f01e40d1d80 2024-09-10T22:45:31.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e3400640 1 --2- 172.21.15.103:0/1397672612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e40d1d80 0x7f01e41589b0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f01d001a3f0 tx=0x7f01d00a8410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:31.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01dbe00640 1 -- 172.21.15.103:0/1397672612 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d0004240 con 0x7f01e40d1d80 2024-09-10T22:45:31.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01dbe00640 1 -- 172.21.15.103:0/1397672612 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01d00043e0 con 0x7f01e40d1d80 2024-09-10T22:45:31.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e9600640 1 -- 172.21.15.103:0/1397672612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e4143920 con 0x7f01e40d1d80 2024-09-10T22:45:31.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01dbe00640 1 -- 172.21.15.103:0/1397672612 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d00052d0 con 0x7f01e40d1d80 2024-09-10T22:45:31.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e9600640 1 -- 172.21.15.103:0/1397672612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e4144400 con 0x7f01e40d1d80 2024-09-10T22:45:31.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.649+0000 7f01e9600640 1 -- 172.21.15.103:0/1397672612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e4143740 con 0x7f01e40d1d80 2024-09-10T22:45:31.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.653+0000 7f01dbe00640 1 -- 172.21.15.103:0/1397672612 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f01d00b7070 con 0x7f01e40d1d80 2024-09-10T22:45:31.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.653+0000 7f01dbe00640 1 --2- 172.21.15.103:0/1397672612 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f01c4072610 0x7f01c4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:31.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.653+0000 7f01dbe00640 1 -- 172.21.15.103:0/1397672612 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7f01d012ce30 con 0x7f01e40d1d80 2024-09-10T22:45:31.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.653+0000 7f01e3e00640 1 --2- 172.21.15.103:0/1397672612 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f01c4072610 0x7f01c4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:31.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.657+0000 7f01dbe00640 1 -- 172.21.15.103:0/1397672612 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f01e4143740 con 0x7f01e40d1d80 2024-09-10T22:45:31.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.657+0000 7f01e3e00640 1 --2- 172.21.15.103:0/1397672612 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f01c4072610 0x7f01c4074ad0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f01d4011440 tx=0x7f01d4009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:31.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.857+0000 7f01e9600640 1 -- 172.21.15.103:0/1397672612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01e40d1840 con 0x7f01e40d1d80 2024-09-10T22:45:31.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.857+0000 7f01dbe00640 1 -- 172.21.15.103:0/1397672612 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5240 (secure 0 0 0) 0x7f01d00ac030 con 0x7f01e40d1d80 2024-09-10T22:45:31.861 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:31.861 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":107,"btime":"2024-09-10T22:45:31:483183+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7717,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":8235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:45:30.865944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238]},"id":7}]} 2024-09-10T22:45:31.861 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 107 2024-09-10T22:45:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.857+0000 7f01e9600640 1 -- 172.21.15.103:0/1397672612 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f01c4072610 msgr2=0x7f01c4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.857+0000 7f01e9600640 1 --2- 172.21.15.103:0/1397672612 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f01c4072610 0x7f01c4074ad0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f01d4011440 tx=0x7f01d4009500 comp rx=0 tx=0).stop 2024-09-10T22:45:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.857+0000 7f01e9600640 1 -- 172.21.15.103:0/1397672612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e40d1d80 msgr2=0x7f01e41589b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.857+0000 7f01e9600640 1 --2- 172.21.15.103:0/1397672612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e40d1d80 0x7f01e41589b0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f01d001a3f0 tx=0x7f01d00a8410 comp rx=0 tx=0).stop 2024-09-10T22:45:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.857+0000 7f01e9600640 1 -- 172.21.15.103:0/1397672612 shutdown_connections 2024-09-10T22:45:31.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.857+0000 7f01e9600640 1 --2- 172.21.15.103:0/1397672612 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f01c4072610 0x7f01c4074ad0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:31.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.857+0000 7f01e9600640 1 --2- 172.21.15.103:0/1397672612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01e415b730 0x7f01e4158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:31.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.857+0000 7f01e9600640 1 --2- 172.21.15.103:0/1397672612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e40d1d80 0x7f01e41589b0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:31.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.857+0000 7f01e9600640 1 --2- 172.21.15.103:0/1397672612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01e40b0ce0 0x7f01e40b7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:31.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.857+0000 7f01e9600640 1 -- 172.21.15.103:0/1397672612 >> 172.21.15.103:0/1397672612 conn(0x7f01e409a9f0 msgr2=0x7f01e4070550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:31.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.857+0000 7f01e9600640 1 -- 172.21.15.103:0/1397672612 shutdown_connections 2024-09-10T22:45:31.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:31.857+0000 7f01e9600640 1 -- 172.21.15.103:0/1397672612 wait complete. 2024-09-10T22:45:31.882 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:45:32.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.021+0000 7f3cd5c00640 1 -- 172.21.15.103:0/2075411585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb4004e70 msgr2=0x7f3cb400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:32.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.021+0000 7f3cd5c00640 1 --2- 172.21.15.103:0/2075411585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb4004e70 0x7f3cb400b9d0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8001690 tx=0x7f3cc801c740 comp rx=0 tx=0).stop 2024-09-10T22:45:32.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.021+0000 7f3ccf400640 1 -- 172.21.15.103:0/2075411585 reap_dead start 2024-09-10T22:45:32.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.021+0000 7f3cd5c00640 1 -- 172.21.15.103:0/2075411585 shutdown_connections 2024-09-10T22:45:32.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.021+0000 7f3cd5c00640 1 -- 172.21.15.103:0/2075411585 >> 172.21.15.103:0/2075411585 conn(0x7f3cd00d1ac0 msgr2=0x7f3cd00d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:32.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.021+0000 7f3cd5c00640 1 -- 172.21.15.103:0/2075411585 shutdown_connections 2024-09-10T22:45:32.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.021+0000 7f3cd5c00640 1 -- 172.21.15.103:0/2075411585 wait complete. 2024-09-10T22:45:32.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.021+0000 7f3cd5c00640 1 Processor -- start 2024-09-10T22:45:32.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.021+0000 7f3cd5c00640 1 -- start start 2024-09-10T22:45:32.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.021+0000 7f3cd5c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cb4004e70 0x7f3cd00cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:32.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.021+0000 7f3cd5c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cd00b3af0 0x7f3cd0147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:32.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.021+0000 7f3cd5c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd01f6390 0x7f3cd00c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:32.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.021+0000 7f3cd5c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd00cee90 con 0x7f3cd01f6390 2024-09-10T22:45:32.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.021+0000 7f3cd5c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd00ced10 con 0x7f3cb4004e70 2024-09-10T22:45:32.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.021+0000 7f3cd5c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd00ce0c0 con 0x7f3cd00b3af0 2024-09-10T22:45:32.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3ccf400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd01f6390 0x7f3cd00c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:32.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3ccf400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd01f6390 0x7f3cd00c5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41058/0 (socket says 172.21.15.103:41058) 2024-09-10T22:45:32.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3ccf400640 1 -- 172.21.15.103:0/2275411507 learned_addr learned my addr 172.21.15.103:0/2275411507 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:32.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3cce000640 1 --2- 172.21.15.103:0/2275411507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cd00b3af0 0x7f3cd0147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:32.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3ccea00640 1 --2- 172.21.15.103:0/2275411507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cb4004e70 0x7f3cd00cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:32.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3ccf400640 1 -- 172.21.15.103:0/2275411507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cd00b3af0 msgr2=0x7f3cd0147c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:32.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3ccf400640 1 --2- 172.21.15.103:0/2275411507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cd00b3af0 0x7f3cd0147c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3ccf400640 1 -- 172.21.15.103:0/2275411507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cb4004e70 msgr2=0x7f3cd00cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:32.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3ccf400640 1 --2- 172.21.15.103:0/2275411507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cb4004e70 0x7f3cd00cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3ccf400640 1 -- 172.21.15.103:0/2275411507 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd00cbc10 con 0x7f3cd01f6390 2024-09-10T22:45:32.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3ccea00640 1 --2- 172.21.15.103:0/2275411507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cb4004e70 0x7f3cd00cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:32.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3ccf400640 1 --2- 172.21.15.103:0/2275411507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd01f6390 0x7f3cd00c5fb0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f3cc801cc20 tx=0x7f3cc8001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:32.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3cc6a00640 1 -- 172.21.15.103:0/2275411507 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8006930 con 0x7f3cd01f6390 2024-09-10T22:45:32.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3cc6a00640 1 -- 172.21.15.103:0/2275411507 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cc8003810 con 0x7f3cd01f6390 2024-09-10T22:45:32.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3cd5c00640 1 -- 172.21.15.103:0/2275411507 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd0148160 con 0x7f3cd01f6390 2024-09-10T22:45:32.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3cc6a00640 1 -- 172.21.15.103:0/2275411507 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8003c20 con 0x7f3cd01f6390 2024-09-10T22:45:32.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3cd5c00640 1 -- 172.21.15.103:0/2275411507 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd01486e0 con 0x7f3cd01f6390 2024-09-10T22:45:32.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3cd5c00640 1 -- 172.21.15.103:0/2275411507 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd00ce5b0 con 0x7f3cd01f6390 2024-09-10T22:45:32.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.025+0000 7f3cc6a00640 1 -- 172.21.15.103:0/2275411507 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3cc80a55a0 con 0x7f3cd01f6390 2024-09-10T22:45:32.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.029+0000 7f3cc6a00640 1 --2- 172.21.15.103:0/2275411507 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3cac072610 0x7f3cac074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:32.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.029+0000 7f3cc6a00640 1 -- 172.21.15.103:0/2275411507 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7f3cc812c940 con 0x7f3cd01f6390 2024-09-10T22:45:32.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.029+0000 7f3ccea00640 1 --2- 172.21.15.103:0/2275411507 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3cac072610 0x7f3cac074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:32.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.029+0000 7f3ccea00640 1 --2- 172.21.15.103:0/2275411507 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3cac072610 0x7f3cac074ad0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009e70 tx=0x7f3cc0009810 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:32.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.033+0000 7f3cc6a00640 1 -- 172.21.15.103:0/2275411507 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3cc80b4070 con 0x7f3cd01f6390 2024-09-10T22:45:32.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.201+0000 7f3cd5c00640 1 -- 172.21.15.103:0/2275411507 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3cd00b5970 con 0x7f3cd01f6390 2024-09-10T22:45:32.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.201+0000 7f3cc6a00640 1 -- 172.21.15.103:0/2275411507 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+17004 (secure 0 0 0) 0x7f3cc80164b0 con 0x7f3cd01f6390 2024-09-10T22:45:32.205 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:32.205 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":105,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:45:29.468582+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:45:25.542643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-10T22:45:26.823498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:45:32.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.205+0000 7f3cd5c00640 1 -- 172.21.15.103:0/2275411507 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3cac072610 msgr2=0x7f3cac074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:32.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.205+0000 7f3cd5c00640 1 --2- 172.21.15.103:0/2275411507 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3cac072610 0x7f3cac074ad0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009e70 tx=0x7f3cc0009810 comp rx=0 tx=0).stop 2024-09-10T22:45:32.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.205+0000 7f3cd5c00640 1 -- 172.21.15.103:0/2275411507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd01f6390 msgr2=0x7f3cd00c5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:32.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.205+0000 7f3cd5c00640 1 --2- 172.21.15.103:0/2275411507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd01f6390 0x7f3cd00c5fb0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f3cc801cc20 tx=0x7f3cc8001130 comp rx=0 tx=0).stop 2024-09-10T22:45:32.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.205+0000 7f3cd5c00640 1 -- 172.21.15.103:0/2275411507 shutdown_connections 2024-09-10T22:45:32.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.205+0000 7f3cd5c00640 1 --2- 172.21.15.103:0/2275411507 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3cac072610 0x7f3cac074ad0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.205+0000 7f3cd5c00640 1 --2- 172.21.15.103:0/2275411507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd01f6390 0x7f3cd00c5fb0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.205+0000 7f3cd5c00640 1 --2- 172.21.15.103:0/2275411507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cd00b3af0 0x7f3cd0147c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.205+0000 7f3cd5c00640 1 --2- 172.21.15.103:0/2275411507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cb4004e70 0x7f3cd00cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.205+0000 7f3cd5c00640 1 -- 172.21.15.103:0/2275411507 >> 172.21.15.103:0/2275411507 conn(0x7f3cd00d1ac0 msgr2=0x7f3cd01551b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:32.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.205+0000 7f3cd5c00640 1 -- 172.21.15.103:0/2275411507 shutdown_connections 2024-09-10T22:45:32.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.205+0000 7f3cd5c00640 1 -- 172.21.15.103:0/2275411507 wait complete. 2024-09-10T22:45:32.227 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T22:45:32.227 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:45:32.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.365+0000 7eff70000640 1 -- 172.21.15.103:0/1704329903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff68072c10 msgr2=0x7eff68157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:32.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.365+0000 7eff70000640 1 --2- 172.21.15.103:0/1704329903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff68072c10 0x7eff68157090 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7eff6000acd0 tx=0x7eff6001def0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.365+0000 7eff70000640 1 -- 172.21.15.103:0/1704329903 shutdown_connections 2024-09-10T22:45:32.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.365+0000 7eff70000640 1 --2- 172.21.15.103:0/1704329903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff68072c10 0x7eff68157090 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.365+0000 7eff70000640 1 --2- 172.21.15.103:0/1704329903 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff680cf260 0x7eff680b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.365+0000 7eff70000640 1 -- 172.21.15.103:0/1704329903 >> 172.21.15.103:0/1704329903 conn(0x7eff6806cc00 msgr2=0x7eff6806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:32.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.365+0000 7eff70000640 1 -- 172.21.15.103:0/1704329903 shutdown_connections 2024-09-10T22:45:32.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.365+0000 7eff70000640 1 -- 172.21.15.103:0/1704329903 wait complete. 2024-09-10T22:45:32.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff70000640 1 Processor -- start 2024-09-10T22:45:32.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff70000640 1 -- start start 2024-09-10T22:45:32.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff70000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff68072c10 0x7eff6813c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:32.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff70000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff680b3150 0x7eff6813be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:32.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff70000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff680cf260 0x7eff681fa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:32.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff70000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7eff6806e7e0 con 0x7eff680cf260 2024-09-10T22:45:32.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff70000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7eff68157e50 con 0x7eff68072c10 2024-09-10T22:45:32.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff70000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7eff6806e960 con 0x7eff680b3150 2024-09-10T22:45:32.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff6e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff680cf260 0x7eff681fa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:32.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff6e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff680cf260 0x7eff681fa870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41068/0 (socket says 172.21.15.103:41068) 2024-09-10T22:45:32.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff6e000640 1 -- 172.21.15.103:0/2038633710 learned_addr learned my addr 172.21.15.103:0/2038633710 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:32.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff6d600640 1 --2- 172.21.15.103:0/2038633710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff68072c10 0x7eff6813c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:32.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff6cc00640 1 --2- 172.21.15.103:0/2038633710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff680b3150 0x7eff6813be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:32.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff6e000640 1 -- 172.21.15.103:0/2038633710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff680b3150 msgr2=0x7eff6813be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:32.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff6e000640 1 --2- 172.21.15.103:0/2038633710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff680b3150 0x7eff6813be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff6e000640 1 -- 172.21.15.103:0/2038633710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff68072c10 msgr2=0x7eff6813c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:32.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff6e000640 1 --2- 172.21.15.103:0/2038633710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff68072c10 0x7eff6813c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff6e000640 1 -- 172.21.15.103:0/2038633710 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff681487a0 con 0x7eff680cf260 2024-09-10T22:45:32.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff6e000640 1 --2- 172.21.15.103:0/2038633710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff680cf260 0x7eff681fa870 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7eff600b1040 tx=0x7eff60005a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:32.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff65600640 1 -- 172.21.15.103:0/2038633710 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff600be070 con 0x7eff680cf260 2024-09-10T22:45:32.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff65600640 1 -- 172.21.15.103:0/2038633710 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff60004130 con 0x7eff680cf260 2024-09-10T22:45:32.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff70000640 1 -- 172.21.15.103:0/2038633710 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff6814b250 con 0x7eff680cf260 2024-09-10T22:45:32.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff65600640 1 -- 172.21.15.103:0/2038633710 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff600b3040 con 0x7eff680cf260 2024-09-10T22:45:32.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff70000640 1 -- 172.21.15.103:0/2038633710 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff6814b810 con 0x7eff680cf260 2024-09-10T22:45:32.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.369+0000 7eff70000640 1 -- 172.21.15.103:0/2038633710 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff680b3530 con 0x7eff680cf260 2024-09-10T22:45:32.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.373+0000 7eff65600640 1 -- 172.21.15.103:0/2038633710 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7eff6000b040 con 0x7eff680cf260 2024-09-10T22:45:32.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.373+0000 7eff65600640 1 --2- 172.21.15.103:0/2038633710 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7eff480725e0 0x7eff48074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:32.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.373+0000 7eff65600640 1 -- 172.21.15.103:0/2038633710 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7eff6012d9b0 con 0x7eff680cf260 2024-09-10T22:45:32.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.373+0000 7eff6d600640 1 --2- 172.21.15.103:0/2038633710 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7eff480725e0 0x7eff48074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:32.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.373+0000 7eff6d600640 1 --2- 172.21.15.103:0/2038633710 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7eff480725e0 0x7eff48074aa0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7eff681555d0 tx=0x7eff5c0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:32.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.377+0000 7eff65600640 1 -- 172.21.15.103:0/2038633710 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7eff60017ae0 con 0x7eff680cf260 2024-09-10T22:45:32.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.545+0000 7eff70000640 1 -- 172.21.15.103:0/2038633710 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff68155a20 con 0x7eff480725e0 2024-09-10T22:45:32.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.549+0000 7eff65600640 1 -- 172.21.15.103:0/2038633710 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252468 (secure 0 0 0) 0x7eff68155a20 con 0x7eff480725e0 2024-09-10T22:45:32.556 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:32.558 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:45:32.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.553+0000 7eff70000640 1 -- 172.21.15.103:0/2038633710 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7eff480725e0 msgr2=0x7eff48074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:32.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.553+0000 7eff70000640 1 --2- 172.21.15.103:0/2038633710 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7eff480725e0 0x7eff48074aa0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7eff681555d0 tx=0x7eff5c0091e0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.553+0000 7eff70000640 1 -- 172.21.15.103:0/2038633710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff680cf260 msgr2=0x7eff681fa870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:32.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.553+0000 7eff70000640 1 --2- 172.21.15.103:0/2038633710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff680cf260 0x7eff681fa870 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7eff600b1040 tx=0x7eff60005a80 comp rx=0 tx=0).stop 2024-09-10T22:45:32.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.553+0000 7eff70000640 1 -- 172.21.15.103:0/2038633710 shutdown_connections 2024-09-10T22:45:32.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.553+0000 7eff70000640 1 --2- 172.21.15.103:0/2038633710 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7eff480725e0 0x7eff48074aa0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.553+0000 7eff70000640 1 --2- 172.21.15.103:0/2038633710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff680cf260 0x7eff681fa870 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.553+0000 7eff70000640 1 --2- 172.21.15.103:0/2038633710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff680b3150 0x7eff6813be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.553+0000 7eff70000640 1 --2- 172.21.15.103:0/2038633710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff68072c10 0x7eff6813c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.553+0000 7eff70000640 1 -- 172.21.15.103:0/2038633710 >> 172.21.15.103:0/2038633710 conn(0x7eff6806cc00 msgr2=0x7eff68148a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:32.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.553+0000 7eff70000640 1 -- 172.21.15.103:0/2038633710 shutdown_connections 2024-09-10T22:45:32.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.553+0000 7eff70000640 1 -- 172.21.15.103:0/2038633710 wait complete. 2024-09-10T22:45:32.576 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-09-10T22:45:32.497004+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260696,"kb_used_data":11160,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714024,"statfs":{"total":773094113280,"available":772827160576,"internally_reserved":0,"allocated":11427840,"data_stored":5919317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.035770"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.508687+0000","last_change":"2024-09-10T22:45:28.503013+0000","last_active":"2024-09-10T22:45:28.508687+0000","last_peered":"2024-09-10T22:45:28.508687+0000","last_clean":"2024-09-10T22:45:28.508687+0000","last_became_active":"2024-09-10T22:45:28.502696+0000","last_became_peered":"2024-09-10T22:45:28.502696+0000","last_unstale":"2024-09-10T22:45:28.508687+0000","last_undegraded":"2024-09-10T22:45:28.508687+0000","last_fullsized":"2024-09-10T22:45:28.508687+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:20.247883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.495296+0000","last_change":"2024-09-10T22:45:28.490351+0000","last_active":"2024-09-10T22:45:28.495296+0000","last_peered":"2024-09-10T22:45:28.495296+0000","last_clean":"2024-09-10T22:45:28.495296+0000","last_became_active":"2024-09-10T22:45:28.489866+0000","last_became_peered":"2024-09-10T22:45:28.489866+0000","last_unstale":"2024-09-10T22:45:28.495296+0000","last_undegraded":"2024-09-10T22:45:28.495296+0000","last_fullsized":"2024-09-10T22:45:28.495296+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:29.267021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.508891+0000","last_change":"2024-09-10T22:45:28.506673+0000","last_active":"2024-09-10T22:45:28.508891+0000","last_peered":"2024-09-10T22:45:28.508891+0000","last_clean":"2024-09-10T22:45:28.508891+0000","last_became_active":"2024-09-10T22:45:28.506414+0000","last_became_peered":"2024-09-10T22:45:28.506414+0000","last_unstale":"2024-09-10T22:45:28.508891+0000","last_undegraded":"2024-09-10T22:45:28.508891+0000","last_fullsized":"2024-09-10T22:45:28.508891+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:08.837425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.480796+0000","last_change":"2024-09-10T22:45:28.478618+0000","last_active":"2024-09-10T22:45:28.480796+0000","last_peered":"2024-09-10T22:45:28.480796+0000","last_clean":"2024-09-10T22:45:28.480796+0000","last_became_active":"2024-09-10T22:45:28.478333+0000","last_became_peered":"2024-09-10T22:45:28.478333+0000","last_unstale":"2024-09-10T22:45:28.480796+0000","last_undegraded":"2024-09-10T22:45:28.480796+0000","last_fullsized":"2024-09-10T22:45:28.480796+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:55.487553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.888213+0000","last_change":"2024-09-10T22:45:28.477408+0000","last_active":"2024-09-10T22:45:30.888213+0000","last_peered":"2024-09-10T22:45:30.888213+0000","last_clean":"2024-09-10T22:45:30.888213+0000","last_became_active":"2024-09-10T22:45:28.476875+0000","last_became_peered":"2024-09-10T22:45:28.476875+0000","last_unstale":"2024-09-10T22:45:30.888213+0000","last_undegraded":"2024-09-10T22:45:30.888213+0000","last_fullsized":"2024-09-10T22:45:30.888213+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:40.949358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.491516+0000","last_change":"2024-09-10T22:45:28.487420+0000","last_active":"2024-09-10T22:45:28.491516+0000","last_peered":"2024-09-10T22:45:28.491516+0000","last_clean":"2024-09-10T22:45:28.491516+0000","last_became_active":"2024-09-10T22:45:28.487040+0000","last_became_peered":"2024-09-10T22:45:28.487040+0000","last_unstale":"2024-09-10T22:45:28.491516+0000","last_undegraded":"2024-09-10T22:45:28.491516+0000","last_fullsized":"2024-09-10T22:45:28.491516+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:50.705470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.492809+0000","last_change":"2024-09-10T22:45:28.487507+0000","last_active":"2024-09-10T22:45:28.492809+0000","last_peered":"2024-09-10T22:45:28.492809+0000","last_clean":"2024-09-10T22:45:28.492809+0000","last_became_active":"2024-09-10T22:45:28.487223+0000","last_became_peered":"2024-09-10T22:45:28.487223+0000","last_unstale":"2024-09-10T22:45:28.492809+0000","last_undegraded":"2024-09-10T22:45:28.492809+0000","last_fullsized":"2024-09-10T22:45:28.492809+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:04:48.701951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.481498+0000","last_change":"2024-09-10T22:45:28.478232+0000","last_active":"2024-09-10T22:45:28.481498+0000","last_peered":"2024-09-10T22:45:28.481498+0000","last_clean":"2024-09-10T22:45:28.481498+0000","last_became_active":"2024-09-10T22:45:28.477954+0000","last_became_peered":"2024-09-10T22:45:28.477954+0000","last_unstale":"2024-09-10T22:45:28.481498+0000","last_undegraded":"2024-09-10T22:45:28.481498+0000","last_fullsized":"2024-09-10T22:45:28.481498+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:13.276642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.498957+0000","last_change":"2024-09-10T22:45:28.492468+0000","last_active":"2024-09-10T22:45:28.498957+0000","last_peered":"2024-09-10T22:45:28.498957+0000","last_clean":"2024-09-10T22:45:28.498957+0000","last_became_active":"2024-09-10T22:45:28.491826+0000","last_became_peered":"2024-09-10T22:45:28.491826+0000","last_unstale":"2024-09-10T22:45:28.498957+0000","last_undegraded":"2024-09-10T22:45:28.498957+0000","last_fullsized":"2024-09-10T22:45:28.498957+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:56.488176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.888506+0000","last_change":"2024-09-10T22:45:28.494878+0000","last_active":"2024-09-10T22:45:30.888506+0000","last_peered":"2024-09-10T22:45:30.888506+0000","last_clean":"2024-09-10T22:45:30.888506+0000","last_became_active":"2024-09-10T22:45:28.494601+0000","last_became_peered":"2024-09-10T22:45:28.494601+0000","last_unstale":"2024-09-10T22:45:30.888506+0000","last_undegraded":"2024-09-10T22:45:30.888506+0000","last_fullsized":"2024-09-10T22:45:30.888506+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:56.464927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.492591+0000","last_change":"2024-09-10T22:45:28.486978+0000","last_active":"2024-09-10T22:45:28.492591+0000","last_peered":"2024-09-10T22:45:28.492591+0000","last_clean":"2024-09-10T22:45:28.492591+0000","last_became_active":"2024-09-10T22:45:28.486661+0000","last_became_peered":"2024-09-10T22:45:28.486661+0000","last_unstale":"2024-09-10T22:45:28.492591+0000","last_undegraded":"2024-09-10T22:45:28.492591+0000","last_fullsized":"2024-09-10T22:45:28.492591+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:52.754149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.484742+0000","last_change":"2024-09-10T22:45:28.476167+0000","last_active":"2024-09-10T22:45:28.484742+0000","last_peered":"2024-09-10T22:45:28.484742+0000","last_clean":"2024-09-10T22:45:28.484742+0000","last_became_active":"2024-09-10T22:45:28.475895+0000","last_became_peered":"2024-09-10T22:45:28.475895+0000","last_unstale":"2024-09-10T22:45:28.484742+0000","last_undegraded":"2024-09-10T22:45:28.484742+0000","last_fullsized":"2024-09-10T22:45:28.484742+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:31.979693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.484360+0000","last_change":"2024-09-10T22:45:28.482493+0000","last_active":"2024-09-10T22:45:28.484360+0000","last_peered":"2024-09-10T22:45:28.484360+0000","last_clean":"2024-09-10T22:45:28.484360+0000","last_became_active":"2024-09-10T22:45:28.480087+0000","last_became_peered":"2024-09-10T22:45:28.480087+0000","last_unstale":"2024-09-10T22:45:28.484360+0000","last_undegraded":"2024-09-10T22:45:28.484360+0000","last_fullsized":"2024-09-10T22:45:28.484360+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:45.946611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.493325+0000","last_change":"2024-09-10T22:45:28.490883+0000","last_active":"2024-09-10T22:45:28.493325+0000","last_peered":"2024-09-10T22:45:28.493325+0000","last_clean":"2024-09-10T22:45:28.493325+0000","last_became_active":"2024-09-10T22:45:28.489978+0000","last_became_peered":"2024-09-10T22:45:28.489978+0000","last_unstale":"2024-09-10T22:45:28.493325+0000","last_undegraded":"2024-09-10T22:45:28.493325+0000","last_fullsized":"2024-09-10T22:45:28.493325+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:59.736437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.488038+0000","last_change":"2024-09-10T22:45:28.483552+0000","last_active":"2024-09-10T22:45:28.488038+0000","last_peered":"2024-09-10T22:45:28.488038+0000","last_clean":"2024-09-10T22:45:28.488038+0000","last_became_active":"2024-09-10T22:45:28.483273+0000","last_became_peered":"2024-09-10T22:45:28.483273+0000","last_unstale":"2024-09-10T22:45:28.488038+0000","last_undegraded":"2024-09-10T22:45:28.488038+0000","last_fullsized":"2024-09-10T22:45:28.488038+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:06.287409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.489127+0000","last_change":"2024-09-10T22:45:28.485855+0000","last_active":"2024-09-10T22:45:28.489127+0000","last_peered":"2024-09-10T22:45:28.489127+0000","last_clean":"2024-09-10T22:45:28.489127+0000","last_became_active":"2024-09-10T22:45:28.485600+0000","last_became_peered":"2024-09-10T22:45:28.485600+0000","last_unstale":"2024-09-10T22:45:28.489127+0000","last_undegraded":"2024-09-10T22:45:28.489127+0000","last_fullsized":"2024-09-10T22:45:28.489127+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:05.101217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.508664+0000","last_change":"2024-09-10T22:45:28.502888+0000","last_active":"2024-09-10T22:45:28.508664+0000","last_peered":"2024-09-10T22:45:28.508664+0000","last_clean":"2024-09-10T22:45:28.508664+0000","last_became_active":"2024-09-10T22:45:28.502442+0000","last_became_peered":"2024-09-10T22:45:28.502442+0000","last_unstale":"2024-09-10T22:45:28.508664+0000","last_undegraded":"2024-09-10T22:45:28.508664+0000","last_fullsized":"2024-09-10T22:45:28.508664+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:37.054147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.499638+0000","last_change":"2024-09-10T22:45:28.495022+0000","last_active":"2024-09-10T22:45:28.499638+0000","last_peered":"2024-09-10T22:45:28.499638+0000","last_clean":"2024-09-10T22:45:28.499638+0000","last_became_active":"2024-09-10T22:45:28.494751+0000","last_became_peered":"2024-09-10T22:45:28.494751+0000","last_unstale":"2024-09-10T22:45:28.499638+0000","last_undegraded":"2024-09-10T22:45:28.499638+0000","last_fullsized":"2024-09-10T22:45:28.499638+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:24.671212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.508419+0000","last_change":"2024-09-10T22:45:28.500200+0000","last_active":"2024-09-10T22:45:28.508419+0000","last_peered":"2024-09-10T22:45:28.508419+0000","last_clean":"2024-09-10T22:45:28.508419+0000","last_became_active":"2024-09-10T22:45:28.499930+0000","last_became_peered":"2024-09-10T22:45:28.499930+0000","last_unstale":"2024-09-10T22:45:28.508419+0000","last_undegraded":"2024-09-10T22:45:28.508419+0000","last_fullsized":"2024-09-10T22:45:28.508419+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:08.243639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.484764+0000","last_change":"2024-09-10T22:45:28.479540+0000","last_active":"2024-09-10T22:45:28.484764+0000","last_peered":"2024-09-10T22:45:28.484764+0000","last_clean":"2024-09-10T22:45:28.484764+0000","last_became_active":"2024-09-10T22:45:28.479276+0000","last_became_peered":"2024-09-10T22:45:28.479276+0000","last_unstale":"2024-09-10T22:45:28.484764+0000","last_undegraded":"2024-09-10T22:45:28.484764+0000","last_fullsized":"2024-09-10T22:45:28.484764+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:36.854227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.495245+0000","last_change":"2024-09-10T22:45:28.485088+0000","last_active":"2024-09-10T22:45:28.495245+0000","last_peered":"2024-09-10T22:45:28.495245+0000","last_clean":"2024-09-10T22:45:28.495245+0000","last_became_active":"2024-09-10T22:45:28.484729+0000","last_became_peered":"2024-09-10T22:45:28.484729+0000","last_unstale":"2024-09-10T22:45:28.495245+0000","last_undegraded":"2024-09-10T22:45:28.495245+0000","last_fullsized":"2024-09-10T22:45:28.495245+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:51.829723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.888180+0000","last_change":"2024-09-10T22:45:28.481591+0000","last_active":"2024-09-10T22:45:30.888180+0000","last_peered":"2024-09-10T22:45:30.888180+0000","last_clean":"2024-09-10T22:45:30.888180+0000","last_became_active":"2024-09-10T22:45:28.481314+0000","last_became_peered":"2024-09-10T22:45:28.481314+0000","last_unstale":"2024-09-10T22:45:30.888180+0000","last_undegraded":"2024-09-10T22:45:30.888180+0000","last_fullsized":"2024-09-10T22:45:30.888180+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:24.545062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.499526+0000","last_change":"2024-09-10T22:45:28.486514+0000","last_active":"2024-09-10T22:45:28.499526+0000","last_peered":"2024-09-10T22:45:28.499526+0000","last_clean":"2024-09-10T22:45:28.499526+0000","last_became_active":"2024-09-10T22:45:28.486174+0000","last_became_peered":"2024-09-10T22:45:28.486174+0000","last_unstale":"2024-09-10T22:45:28.499526+0000","last_undegraded":"2024-09-10T22:45:28.499526+0000","last_fullsized":"2024-09-10T22:45:28.499526+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:13.557017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.887709+0000","last_change":"2024-09-10T22:45:28.500785+0000","last_active":"2024-09-10T22:45:30.887709+0000","last_peered":"2024-09-10T22:45:30.887709+0000","last_clean":"2024-09-10T22:45:30.887709+0000","last_became_active":"2024-09-10T22:45:28.500446+0000","last_became_peered":"2024-09-10T22:45:28.500446+0000","last_unstale":"2024-09-10T22:45:30.887709+0000","last_undegraded":"2024-09-10T22:45:30.887709+0000","last_fullsized":"2024-09-10T22:45:30.887709+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:08.116238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.484980+0000","last_change":"2024-09-10T22:45:28.482468+0000","last_active":"2024-09-10T22:45:28.484980+0000","last_peered":"2024-09-10T22:45:28.484980+0000","last_clean":"2024-09-10T22:45:28.484980+0000","last_became_active":"2024-09-10T22:45:28.482182+0000","last_became_peered":"2024-09-10T22:45:28.482182+0000","last_unstale":"2024-09-10T22:45:28.484980+0000","last_undegraded":"2024-09-10T22:45:28.484980+0000","last_fullsized":"2024-09-10T22:45:28.484980+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:41:06.859451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.488644+0000","last_change":"2024-09-10T22:45:28.487753+0000","last_active":"2024-09-10T22:45:28.488644+0000","last_peered":"2024-09-10T22:45:28.488644+0000","last_clean":"2024-09-10T22:45:28.488644+0000","last_became_active":"2024-09-10T22:45:28.487444+0000","last_became_peered":"2024-09-10T22:45:28.487444+0000","last_unstale":"2024-09-10T22:45:28.488644+0000","last_undegraded":"2024-09-10T22:45:28.488644+0000","last_fullsized":"2024-09-10T22:45:28.488644+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:45.946611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.488620+0000","last_change":"2024-09-10T22:45:28.482769+0000","last_active":"2024-09-10T22:45:28.488620+0000","last_peered":"2024-09-10T22:45:28.488620+0000","last_clean":"2024-09-10T22:45:28.488620+0000","last_became_active":"2024-09-10T22:45:28.482509+0000","last_became_peered":"2024-09-10T22:45:28.482509+0000","last_unstale":"2024-09-10T22:45:28.488620+0000","last_undegraded":"2024-09-10T22:45:28.488620+0000","last_fullsized":"2024-09-10T22:45:28.488620+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:38.079911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.489676+0000","last_change":"2024-09-10T22:45:28.483766+0000","last_active":"2024-09-10T22:45:28.489676+0000","last_peered":"2024-09-10T22:45:28.489676+0000","last_clean":"2024-09-10T22:45:28.489676+0000","last_became_active":"2024-09-10T22:45:28.483492+0000","last_became_peered":"2024-09-10T22:45:28.483492+0000","last_unstale":"2024-09-10T22:45:28.489676+0000","last_undegraded":"2024-09-10T22:45:28.489676+0000","last_fullsized":"2024-09-10T22:45:28.489676+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:31.528991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.495221+0000","last_change":"2024-09-10T22:45:28.481482+0000","last_active":"2024-09-10T22:45:28.495221+0000","last_peered":"2024-09-10T22:45:28.495221+0000","last_clean":"2024-09-10T22:45:28.495221+0000","last_became_active":"2024-09-10T22:45:28.481239+0000","last_became_peered":"2024-09-10T22:45:28.481239+0000","last_unstale":"2024-09-10T22:45:28.495221+0000","last_undegraded":"2024-09-10T22:45:28.495221+0000","last_fullsized":"2024-09-10T22:45:28.495221+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:55.892468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.485584+0000","last_change":"2024-09-10T22:45:28.483551+0000","last_active":"2024-09-10T22:45:28.485584+0000","last_peered":"2024-09-10T22:45:28.485584+0000","last_clean":"2024-09-10T22:45:28.485584+0000","last_became_active":"2024-09-10T22:45:28.481269+0000","last_became_peered":"2024-09-10T22:45:28.481269+0000","last_unstale":"2024-09-10T22:45:28.485584+0000","last_undegraded":"2024-09-10T22:45:28.485584+0000","last_fullsized":"2024-09-10T22:45:28.485584+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:55.487553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.505153+0000","last_change":"2024-09-10T22:45:28.502931+0000","last_active":"2024-09-10T22:45:28.505153+0000","last_peered":"2024-09-10T22:45:28.505153+0000","last_clean":"2024-09-10T22:45:28.505153+0000","last_became_active":"2024-09-10T22:45:28.502679+0000","last_became_peered":"2024-09-10T22:45:28.502679+0000","last_unstale":"2024-09-10T22:45:28.505153+0000","last_undegraded":"2024-09-10T22:45:28.505153+0000","last_fullsized":"2024-09-10T22:45:28.505153+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:27.581321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.473018+0000","last_change":"2024-09-10T22:45:28.470128+0000","last_active":"2024-09-10T22:45:28.473018+0000","last_peered":"2024-09-10T22:45:28.473018+0000","last_clean":"2024-09-10T22:45:28.473018+0000","last_became_active":"2024-09-10T22:45:28.469270+0000","last_became_peered":"2024-09-10T22:45:28.469270+0000","last_unstale":"2024-09-10T22:45:28.473018+0000","last_undegraded":"2024-09-10T22:45:28.473018+0000","last_fullsized":"2024-09-10T22:45:28.473018+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:48.333006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.500915+0000","last_change":"2024-09-10T22:45:28.499122+0000","last_active":"2024-09-10T22:45:28.500915+0000","last_peered":"2024-09-10T22:45:28.500915+0000","last_clean":"2024-09-10T22:45:28.500915+0000","last_became_active":"2024-09-10T22:45:28.487562+0000","last_became_peered":"2024-09-10T22:45:28.487562+0000","last_unstale":"2024-09-10T22:45:28.500915+0000","last_undegraded":"2024-09-10T22:45:28.500915+0000","last_fullsized":"2024-09-10T22:45:28.500915+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:27.575027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"104'4","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.499338+0000","last_change":"2024-09-10T22:45:27.477849+0000","last_active":"2024-09-10T22:45:28.499338+0000","last_peered":"2024-09-10T22:45:28.499338+0000","last_clean":"2024-09-10T22:45:28.499338+0000","last_became_active":"2024-09-10T22:45:27.477600+0000","last_became_peered":"2024-09-10T22:45:27.477600+0000","last_unstale":"2024-09-10T22:45:28.499338+0000","last_undegraded":"2024-09-10T22:45:28.499338+0000","last_fullsized":"2024-09-10T22:45:28.499338+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:41:05.851996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.494397+0000","last_change":"2024-09-10T22:45:28.486472+0000","last_active":"2024-09-10T22:45:28.494397+0000","last_peered":"2024-09-10T22:45:28.494397+0000","last_clean":"2024-09-10T22:45:28.494397+0000","last_became_active":"2024-09-10T22:45:28.486151+0000","last_became_peered":"2024-09-10T22:45:28.486151+0000","last_unstale":"2024-09-10T22:45:28.494397+0000","last_undegraded":"2024-09-10T22:45:28.494397+0000","last_fullsized":"2024-09-10T22:45:28.494397+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:31.451338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"104'1","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.503864+0000","last_change":"2024-09-10T22:45:27.478140+0000","last_active":"2024-09-10T22:45:28.503864+0000","last_peered":"2024-09-10T22:45:28.503864+0000","last_clean":"2024-09-10T22:45:28.503864+0000","last_became_active":"2024-09-10T22:45:27.477627+0000","last_became_peered":"2024-09-10T22:45:27.477627+0000","last_unstale":"2024-09-10T22:45:28.503864+0000","last_undegraded":"2024-09-10T22:45:28.503864+0000","last_fullsized":"2024-09-10T22:45:28.503864+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:13.407486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.484622+0000","last_change":"2024-09-10T22:45:28.477435+0000","last_active":"2024-09-10T22:45:28.484622+0000","last_peered":"2024-09-10T22:45:28.484622+0000","last_clean":"2024-09-10T22:45:28.484622+0000","last_became_active":"2024-09-10T22:45:28.476311+0000","last_became_peered":"2024-09-10T22:45:28.476311+0000","last_unstale":"2024-09-10T22:45:28.484622+0000","last_undegraded":"2024-09-10T22:45:28.484622+0000","last_fullsized":"2024-09-10T22:45:28.484622+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:57.435890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"104'2","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.506077+0000","last_change":"2024-09-10T22:45:27.482286+0000","last_active":"2024-09-10T22:45:28.506077+0000","last_peered":"2024-09-10T22:45:28.506077+0000","last_clean":"2024-09-10T22:45:28.506077+0000","last_became_active":"2024-09-10T22:45:27.482003+0000","last_became_peered":"2024-09-10T22:45:27.482003+0000","last_unstale":"2024-09-10T22:45:28.506077+0000","last_undegraded":"2024-09-10T22:45:28.506077+0000","last_fullsized":"2024-09-10T22:45:28.506077+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:37.072456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.488719+0000","last_change":"2024-09-10T22:45:28.481326+0000","last_active":"2024-09-10T22:45:28.488719+0000","last_peered":"2024-09-10T22:45:28.488719+0000","last_clean":"2024-09-10T22:45:28.488719+0000","last_became_active":"2024-09-10T22:45:28.481023+0000","last_became_peered":"2024-09-10T22:45:28.481023+0000","last_unstale":"2024-09-10T22:45:28.488719+0000","last_undegraded":"2024-09-10T22:45:28.488719+0000","last_fullsized":"2024-09-10T22:45:28.488719+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:08.115561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"104'2","reported_seq":17,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.888716+0000","last_change":"2024-09-10T22:45:27.481006+0000","last_active":"2024-09-10T22:45:30.888716+0000","last_peered":"2024-09-10T22:45:30.888716+0000","last_clean":"2024-09-10T22:45:30.888716+0000","last_became_active":"2024-09-10T22:45:27.480741+0000","last_became_peered":"2024-09-10T22:45:27.480741+0000","last_unstale":"2024-09-10T22:45:30.888716+0000","last_undegraded":"2024-09-10T22:45:30.888716+0000","last_fullsized":"2024-09-10T22:45:30.888716+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:58.772621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.498375+0000","last_change":"2024-09-10T22:45:28.489057+0000","last_active":"2024-09-10T22:45:28.498375+0000","last_peered":"2024-09-10T22:45:28.498375+0000","last_clean":"2024-09-10T22:45:28.498375+0000","last_became_active":"2024-09-10T22:45:28.488579+0000","last_became_peered":"2024-09-10T22:45:28.488579+0000","last_unstale":"2024-09-10T22:45:28.498375+0000","last_undegraded":"2024-09-10T22:45:28.498375+0000","last_fullsized":"2024-09-10T22:45:28.498375+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:38.633361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"104'1","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.502103+0000","last_change":"2024-09-10T22:45:27.486533+0000","last_active":"2024-09-10T22:45:28.502103+0000","last_peered":"2024-09-10T22:45:28.502103+0000","last_clean":"2024-09-10T22:45:28.502103+0000","last_became_active":"2024-09-10T22:45:27.486259+0000","last_became_peered":"2024-09-10T22:45:27.486259+0000","last_unstale":"2024-09-10T22:45:28.502103+0000","last_undegraded":"2024-09-10T22:45:28.502103+0000","last_fullsized":"2024-09-10T22:45:28.502103+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:54.480097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.508392+0000","last_change":"2024-09-10T22:45:28.499871+0000","last_active":"2024-09-10T22:45:28.508392+0000","last_peered":"2024-09-10T22:45:28.508392+0000","last_clean":"2024-09-10T22:45:28.508392+0000","last_became_active":"2024-09-10T22:45:28.499637+0000","last_became_peered":"2024-09-10T22:45:28.499637+0000","last_unstale":"2024-09-10T22:45:28.508392+0000","last_undegraded":"2024-09-10T22:45:28.508392+0000","last_fullsized":"2024-09-10T22:45:28.508392+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:06.905497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"104'1","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.503675+0000","last_change":"2024-09-10T22:45:27.477709+0000","last_active":"2024-09-10T22:45:28.503675+0000","last_peered":"2024-09-10T22:45:28.503675+0000","last_clean":"2024-09-10T22:45:28.503675+0000","last_became_active":"2024-09-10T22:45:27.477454+0000","last_became_peered":"2024-09-10T22:45:27.477454+0000","last_unstale":"2024-09-10T22:45:28.503675+0000","last_undegraded":"2024-09-10T22:45:28.503675+0000","last_fullsized":"2024-09-10T22:45:28.503675+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:44.591551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.498763+0000","last_change":"2024-09-10T22:45:28.491598+0000","last_active":"2024-09-10T22:45:28.498763+0000","last_peered":"2024-09-10T22:45:28.498763+0000","last_clean":"2024-09-10T22:45:28.498763+0000","last_became_active":"2024-09-10T22:45:28.491193+0000","last_became_peered":"2024-09-10T22:45:28.491193+0000","last_unstale":"2024-09-10T22:45:28.498763+0000","last_undegraded":"2024-09-10T22:45:28.498763+0000","last_fullsized":"2024-09-10T22:45:28.498763+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:39.343147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.468822+0000","last_change":"2024-09-10T22:45:27.481853+0000","last_active":"2024-09-10T22:45:28.468822+0000","last_peered":"2024-09-10T22:45:28.468822+0000","last_clean":"2024-09-10T22:45:28.468822+0000","last_became_active":"2024-09-10T22:45:27.481506+0000","last_became_peered":"2024-09-10T22:45:27.481506+0000","last_unstale":"2024-09-10T22:45:28.468822+0000","last_undegraded":"2024-09-10T22:45:28.468822+0000","last_fullsized":"2024-09-10T22:45:28.468822+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:07.108106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.499415+0000","last_change":"2024-09-10T22:45:28.494363+0000","last_active":"2024-09-10T22:45:28.499415+0000","last_peered":"2024-09-10T22:45:28.499415+0000","last_clean":"2024-09-10T22:45:28.499415+0000","last_became_active":"2024-09-10T22:45:28.493947+0000","last_became_peered":"2024-09-10T22:45:28.493947+0000","last_unstale":"2024-09-10T22:45:28.499415+0000","last_undegraded":"2024-09-10T22:45:28.499415+0000","last_fullsized":"2024-09-10T22:45:28.499415+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:48.943618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.468128+0000","last_change":"2024-09-10T22:45:27.481957+0000","last_active":"2024-09-10T22:45:28.468128+0000","last_peered":"2024-09-10T22:45:28.468128+0000","last_clean":"2024-09-10T22:45:28.468128+0000","last_became_active":"2024-09-10T22:45:27.481706+0000","last_became_peered":"2024-09-10T22:45:27.481706+0000","last_unstale":"2024-09-10T22:45:28.468128+0000","last_undegraded":"2024-09-10T22:45:28.468128+0000","last_fullsized":"2024-09-10T22:45:28.468128+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:56.428435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.508837+0000","last_change":"2024-09-10T22:45:28.504201+0000","last_active":"2024-09-10T22:45:28.508837+0000","last_peered":"2024-09-10T22:45:28.508837+0000","last_clean":"2024-09-10T22:45:28.508837+0000","last_became_active":"2024-09-10T22:45:28.500725+0000","last_became_peered":"2024-09-10T22:45:28.500725+0000","last_unstale":"2024-09-10T22:45:28.508837+0000","last_undegraded":"2024-09-10T22:45:28.508837+0000","last_fullsized":"2024-09-10T22:45:28.508837+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:51.355358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.469195+0000","last_change":"2024-09-10T22:45:27.482302+0000","last_active":"2024-09-10T22:45:28.469195+0000","last_peered":"2024-09-10T22:45:28.469195+0000","last_clean":"2024-09-10T22:45:28.469195+0000","last_became_active":"2024-09-10T22:45:27.480011+0000","last_became_peered":"2024-09-10T22:45:27.480011+0000","last_unstale":"2024-09-10T22:45:28.469195+0000","last_undegraded":"2024-09-10T22:45:28.469195+0000","last_fullsized":"2024-09-10T22:45:28.469195+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:51.746694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.887870+0000","last_change":"2024-09-10T22:45:28.476133+0000","last_active":"2024-09-10T22:45:30.887870+0000","last_peered":"2024-09-10T22:45:30.887870+0000","last_clean":"2024-09-10T22:45:30.887870+0000","last_became_active":"2024-09-10T22:45:28.475828+0000","last_became_peered":"2024-09-10T22:45:28.475828+0000","last_unstale":"2024-09-10T22:45:30.887870+0000","last_undegraded":"2024-09-10T22:45:30.887870+0000","last_fullsized":"2024-09-10T22:45:30.887870+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:37.386163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.471132+0000","last_change":"2024-09-10T22:45:27.473036+0000","last_active":"2024-09-10T22:45:28.471132+0000","last_peered":"2024-09-10T22:45:28.471132+0000","last_clean":"2024-09-10T22:45:28.471132+0000","last_became_active":"2024-09-10T22:45:27.472761+0000","last_became_peered":"2024-09-10T22:45:27.472761+0000","last_unstale":"2024-09-10T22:45:28.471132+0000","last_undegraded":"2024-09-10T22:45:28.471132+0000","last_fullsized":"2024-09-10T22:45:28.471132+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:26.117355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.492588+0000","last_change":"2024-09-10T22:45:28.486455+0000","last_active":"2024-09-10T22:45:28.492588+0000","last_peered":"2024-09-10T22:45:28.492588+0000","last_clean":"2024-09-10T22:45:28.492588+0000","last_became_active":"2024-09-10T22:45:28.486063+0000","last_became_peered":"2024-09-10T22:45:28.486063+0000","last_unstale":"2024-09-10T22:45:28.492588+0000","last_undegraded":"2024-09-10T22:45:28.492588+0000","last_fullsized":"2024-09-10T22:45:28.492588+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:11.775979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"104'3","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.510785+0000","last_change":"2024-09-10T22:45:27.481754+0000","last_active":"2024-09-10T22:45:28.510785+0000","last_peered":"2024-09-10T22:45:28.510785+0000","last_clean":"2024-09-10T22:45:28.510785+0000","last_became_active":"2024-09-10T22:45:27.481468+0000","last_became_peered":"2024-09-10T22:45:27.481468+0000","last_unstale":"2024-09-10T22:45:28.510785+0000","last_undegraded":"2024-09-10T22:45:28.510785+0000","last_fullsized":"2024-09-10T22:45:28.510785+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:44.939156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.888417+0000","last_change":"2024-09-10T22:45:28.477677+0000","last_active":"2024-09-10T22:45:30.888417+0000","last_peered":"2024-09-10T22:45:30.888417+0000","last_clean":"2024-09-10T22:45:30.888417+0000","last_became_active":"2024-09-10T22:45:28.477157+0000","last_became_peered":"2024-09-10T22:45:28.477157+0000","last_unstale":"2024-09-10T22:45:30.888417+0000","last_undegraded":"2024-09-10T22:45:30.888417+0000","last_fullsized":"2024-09-10T22:45:30.888417+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:59:37.032271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"104'6","reported_seq":19,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.517433+0000","last_change":"2024-09-10T22:45:27.484306+0000","last_active":"2024-09-10T22:45:28.517433+0000","last_peered":"2024-09-10T22:45:28.517433+0000","last_clean":"2024-09-10T22:45:28.517433+0000","last_became_active":"2024-09-10T22:45:27.484039+0000","last_became_peered":"2024-09-10T22:45:27.484039+0000","last_unstale":"2024-09-10T22:45:28.517433+0000","last_undegraded":"2024-09-10T22:45:28.517433+0000","last_fullsized":"2024-09-10T22:45:28.517433+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:44.809352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.507582+0000","last_change":"2024-09-10T22:45:28.505482+0000","last_active":"2024-09-10T22:45:28.507582+0000","last_peered":"2024-09-10T22:45:28.507582+0000","last_clean":"2024-09-10T22:45:28.507582+0000","last_became_active":"2024-09-10T22:45:28.504844+0000","last_became_peered":"2024-09-10T22:45:28.504844+0000","last_unstale":"2024-09-10T22:45:28.507582+0000","last_undegraded":"2024-09-10T22:45:28.507582+0000","last_fullsized":"2024-09-10T22:45:28.507582+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:57.435890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"104'2","reported_seq":17,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.888431+0000","last_change":"2024-09-10T22:45:27.480267+0000","last_active":"2024-09-10T22:45:30.888431+0000","last_peered":"2024-09-10T22:45:30.888431+0000","last_clean":"2024-09-10T22:45:30.888431+0000","last_became_active":"2024-09-10T22:45:27.480012+0000","last_became_peered":"2024-09-10T22:45:27.480012+0000","last_unstale":"2024-09-10T22:45:30.888431+0000","last_undegraded":"2024-09-10T22:45:30.888431+0000","last_fullsized":"2024-09-10T22:45:30.888431+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:23:39.896962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.489639+0000","last_change":"2024-09-10T22:45:28.484959+0000","last_active":"2024-09-10T22:45:28.489639+0000","last_peered":"2024-09-10T22:45:28.489639+0000","last_clean":"2024-09-10T22:45:28.489639+0000","last_became_active":"2024-09-10T22:45:28.484703+0000","last_became_peered":"2024-09-10T22:45:28.484703+0000","last_unstale":"2024-09-10T22:45:28.489639+0000","last_undegraded":"2024-09-10T22:45:28.489639+0000","last_fullsized":"2024-09-10T22:45:28.489639+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:13:19.439264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.468131+0000","last_change":"2024-09-10T22:45:27.476121+0000","last_active":"2024-09-10T22:45:28.468131+0000","last_peered":"2024-09-10T22:45:28.468131+0000","last_clean":"2024-09-10T22:45:28.468131+0000","last_became_active":"2024-09-10T22:45:27.475904+0000","last_became_peered":"2024-09-10T22:45:27.475904+0000","last_unstale":"2024-09-10T22:45:28.468131+0000","last_undegraded":"2024-09-10T22:45:28.468131+0000","last_fullsized":"2024-09-10T22:45:28.468131+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:23.663757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.471427+0000","last_change":"2024-09-10T22:45:28.468968+0000","last_active":"2024-09-10T22:45:28.471427+0000","last_peered":"2024-09-10T22:45:28.471427+0000","last_clean":"2024-09-10T22:45:28.471427+0000","last_became_active":"2024-09-10T22:45:28.468638+0000","last_became_peered":"2024-09-10T22:45:28.468638+0000","last_unstale":"2024-09-10T22:45:28.471427+0000","last_undegraded":"2024-09-10T22:45:28.471427+0000","last_fullsized":"2024-09-10T22:45:28.471427+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:44.728731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.463539+0000","last_change":"2024-09-10T22:45:27.477173+0000","last_active":"2024-09-10T22:45:28.463539+0000","last_peered":"2024-09-10T22:45:28.463539+0000","last_clean":"2024-09-10T22:45:28.463539+0000","last_became_active":"2024-09-10T22:45:27.476553+0000","last_became_peered":"2024-09-10T22:45:27.476553+0000","last_unstale":"2024-09-10T22:45:28.463539+0000","last_undegraded":"2024-09-10T22:45:28.463539+0000","last_fullsized":"2024-09-10T22:45:28.463539+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:31.707144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.508641+0000","last_change":"2024-09-10T22:45:28.502727+0000","last_active":"2024-09-10T22:45:28.508641+0000","last_peered":"2024-09-10T22:45:28.508641+0000","last_clean":"2024-09-10T22:45:28.508641+0000","last_became_active":"2024-09-10T22:45:28.501274+0000","last_became_peered":"2024-09-10T22:45:28.501274+0000","last_unstale":"2024-09-10T22:45:28.508641+0000","last_undegraded":"2024-09-10T22:45:28.508641+0000","last_fullsized":"2024-09-10T22:45:28.508641+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:32.746952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"104'8","reported_seq":21,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.507617+0000","last_change":"2024-09-10T22:45:27.483081+0000","last_active":"2024-09-10T22:45:28.507617+0000","last_peered":"2024-09-10T22:45:28.507617+0000","last_clean":"2024-09-10T22:45:28.507617+0000","last_became_active":"2024-09-10T22:45:27.479934+0000","last_became_peered":"2024-09-10T22:45:27.479934+0000","last_unstale":"2024-09-10T22:45:28.507617+0000","last_undegraded":"2024-09-10T22:45:28.507617+0000","last_fullsized":"2024-09-10T22:45:28.507617+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:44.591551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.507687+0000","last_change":"2024-09-10T22:45:28.502480+0000","last_active":"2024-09-10T22:45:28.507687+0000","last_peered":"2024-09-10T22:45:28.507687+0000","last_clean":"2024-09-10T22:45:28.507687+0000","last_became_active":"2024-09-10T22:45:28.502216+0000","last_became_peered":"2024-09-10T22:45:28.502216+0000","last_unstale":"2024-09-10T22:45:28.507687+0000","last_undegraded":"2024-09-10T22:45:28.507687+0000","last_fullsized":"2024-09-10T22:45:28.507687+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:11.991796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"104'1","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.501450+0000","last_change":"2024-09-10T22:45:27.486191+0000","last_active":"2024-09-10T22:45:28.501450+0000","last_peered":"2024-09-10T22:45:28.501450+0000","last_clean":"2024-09-10T22:45:28.501450+0000","last_became_active":"2024-09-10T22:45:27.485132+0000","last_became_peered":"2024-09-10T22:45:27.485132+0000","last_unstale":"2024-09-10T22:45:28.501450+0000","last_undegraded":"2024-09-10T22:45:28.501450+0000","last_fullsized":"2024-09-10T22:45:28.501450+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:09.100230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.504796+0000","last_change":"2024-09-10T22:45:28.502224+0000","last_active":"2024-09-10T22:45:28.504796+0000","last_peered":"2024-09-10T22:45:28.504796+0000","last_clean":"2024-09-10T22:45:28.504796+0000","last_became_active":"2024-09-10T22:45:28.501961+0000","last_became_peered":"2024-09-10T22:45:28.501961+0000","last_unstale":"2024-09-10T22:45:28.504796+0000","last_undegraded":"2024-09-10T22:45:28.504796+0000","last_fullsized":"2024-09-10T22:45:28.504796+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:43:07.579451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"104'1","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.504897+0000","last_change":"2024-09-10T22:45:27.484040+0000","last_active":"2024-09-10T22:45:28.504897+0000","last_peered":"2024-09-10T22:45:28.504897+0000","last_clean":"2024-09-10T22:45:28.504897+0000","last_became_active":"2024-09-10T22:45:27.483683+0000","last_became_peered":"2024-09-10T22:45:27.483683+0000","last_unstale":"2024-09-10T22:45:28.504897+0000","last_undegraded":"2024-09-10T22:45:28.504897+0000","last_fullsized":"2024-09-10T22:45:28.504897+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:33.348128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.888319+0000","last_change":"2024-09-10T22:45:28.479371+0000","last_active":"2024-09-10T22:45:30.888319+0000","last_peered":"2024-09-10T22:45:30.888319+0000","last_clean":"2024-09-10T22:45:30.888319+0000","last_became_active":"2024-09-10T22:45:28.478796+0000","last_became_peered":"2024-09-10T22:45:28.478796+0000","last_unstale":"2024-09-10T22:45:30.888319+0000","last_undegraded":"2024-09-10T22:45:30.888319+0000","last_fullsized":"2024-09-10T22:45:30.888319+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:02:25.103888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.472107+0000","last_change":"2024-09-10T22:45:27.485639+0000","last_active":"2024-09-10T22:45:28.472107+0000","last_peered":"2024-09-10T22:45:28.472107+0000","last_clean":"2024-09-10T22:45:28.472107+0000","last_became_active":"2024-09-10T22:45:27.483957+0000","last_became_peered":"2024-09-10T22:45:27.483957+0000","last_unstale":"2024-09-10T22:45:28.472107+0000","last_undegraded":"2024-09-10T22:45:28.472107+0000","last_fullsized":"2024-09-10T22:45:28.472107+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:39.084340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.499463+0000","last_change":"2024-09-10T22:45:28.490519+0000","last_active":"2024-09-10T22:45:28.499463+0000","last_peered":"2024-09-10T22:45:28.499463+0000","last_clean":"2024-09-10T22:45:28.499463+0000","last_became_active":"2024-09-10T22:45:28.490252+0000","last_became_peered":"2024-09-10T22:45:28.490252+0000","last_unstale":"2024-09-10T22:45:28.499463+0000","last_undegraded":"2024-09-10T22:45:28.499463+0000","last_fullsized":"2024-09-10T22:45:28.499463+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:13.177380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"104'2","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.509338+0000","last_change":"2024-09-10T22:45:27.476922+0000","last_active":"2024-09-10T22:45:28.509338+0000","last_peered":"2024-09-10T22:45:28.509338+0000","last_clean":"2024-09-10T22:45:28.509338+0000","last_became_active":"2024-09-10T22:45:27.476630+0000","last_became_peered":"2024-09-10T22:45:27.476630+0000","last_unstale":"2024-09-10T22:45:28.509338+0000","last_undegraded":"2024-09-10T22:45:28.509338+0000","last_fullsized":"2024-09-10T22:45:28.509338+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:12.157762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.508442+0000","last_change":"2024-09-10T22:45:28.500721+0000","last_active":"2024-09-10T22:45:28.508442+0000","last_peered":"2024-09-10T22:45:28.508442+0000","last_clean":"2024-09-10T22:45:28.508442+0000","last_became_active":"2024-09-10T22:45:28.500278+0000","last_became_peered":"2024-09-10T22:45:28.500278+0000","last_unstale":"2024-09-10T22:45:28.508442+0000","last_undegraded":"2024-09-10T22:45:28.508442+0000","last_fullsized":"2024-09-10T22:45:28.508442+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:30:28.766298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.463408+0000","last_change":"2024-09-10T22:45:27.473235+0000","last_active":"2024-09-10T22:45:28.463408+0000","last_peered":"2024-09-10T22:45:28.463408+0000","last_clean":"2024-09-10T22:45:28.463408+0000","last_became_active":"2024-09-10T22:45:27.472995+0000","last_became_peered":"2024-09-10T22:45:27.472995+0000","last_unstale":"2024-09-10T22:45:28.463408+0000","last_undegraded":"2024-09-10T22:45:28.463408+0000","last_fullsized":"2024-09-10T22:45:28.463408+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:41:51.273887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.497116+0000","last_change":"2024-09-10T22:45:28.488573+0000","last_active":"2024-09-10T22:45:28.497116+0000","last_peered":"2024-09-10T22:45:28.497116+0000","last_clean":"2024-09-10T22:45:28.497116+0000","last_became_active":"2024-09-10T22:45:28.488258+0000","last_became_peered":"2024-09-10T22:45:28.488258+0000","last_unstale":"2024-09-10T22:45:28.497116+0000","last_undegraded":"2024-09-10T22:45:28.497116+0000","last_fullsized":"2024-09-10T22:45:28.497116+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:52.460919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.478734+0000","last_change":"2024-09-10T22:45:27.482696+0000","last_active":"2024-09-10T22:45:28.478734+0000","last_peered":"2024-09-10T22:45:28.478734+0000","last_clean":"2024-09-10T22:45:28.478734+0000","last_became_active":"2024-09-10T22:45:27.482410+0000","last_became_peered":"2024-09-10T22:45:27.482410+0000","last_unstale":"2024-09-10T22:45:28.478734+0000","last_undegraded":"2024-09-10T22:45:28.478734+0000","last_fullsized":"2024-09-10T22:45:28.478734+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:32.277554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.495924+0000","last_change":"2024-09-10T22:45:28.485970+0000","last_active":"2024-09-10T22:45:28.495924+0000","last_peered":"2024-09-10T22:45:28.495924+0000","last_clean":"2024-09-10T22:45:28.495924+0000","last_became_active":"2024-09-10T22:45:28.485653+0000","last_became_peered":"2024-09-10T22:45:28.485653+0000","last_unstale":"2024-09-10T22:45:28.495924+0000","last_undegraded":"2024-09-10T22:45:28.495924+0000","last_fullsized":"2024-09-10T22:45:28.495924+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:47.422042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.464174+0000","last_change":"2024-09-10T22:45:27.472399+0000","last_active":"2024-09-10T22:45:28.464174+0000","last_peered":"2024-09-10T22:45:28.464174+0000","last_clean":"2024-09-10T22:45:28.464174+0000","last_became_active":"2024-09-10T22:45:27.472146+0000","last_became_peered":"2024-09-10T22:45:27.472146+0000","last_unstale":"2024-09-10T22:45:28.464174+0000","last_undegraded":"2024-09-10T22:45:28.464174+0000","last_fullsized":"2024-09-10T22:45:28.464174+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:51.550385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.508481+0000","last_change":"2024-09-10T22:45:28.501026+0000","last_active":"2024-09-10T22:45:28.508481+0000","last_peered":"2024-09-10T22:45:28.508481+0000","last_clean":"2024-09-10T22:45:28.508481+0000","last_became_active":"2024-09-10T22:45:28.492025+0000","last_became_peered":"2024-09-10T22:45:28.492025+0000","last_unstale":"2024-09-10T22:45:28.508481+0000","last_undegraded":"2024-09-10T22:45:28.508481+0000","last_fullsized":"2024-09-10T22:45:28.508481+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:44.278096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"104'2","reported_seq":17,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.888506+0000","last_change":"2024-09-10T22:45:27.480293+0000","last_active":"2024-09-10T22:45:30.888506+0000","last_peered":"2024-09-10T22:45:30.888506+0000","last_clean":"2024-09-10T22:45:30.888506+0000","last_became_active":"2024-09-10T22:45:27.479192+0000","last_became_peered":"2024-09-10T22:45:27.479192+0000","last_unstale":"2024-09-10T22:45:30.888506+0000","last_undegraded":"2024-09-10T22:45:30.888506+0000","last_fullsized":"2024-09-10T22:45:30.888506+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:16.885487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.480260+0000","last_change":"2024-09-10T22:45:28.476747+0000","last_active":"2024-09-10T22:45:28.480260+0000","last_peered":"2024-09-10T22:45:28.480260+0000","last_clean":"2024-09-10T22:45:28.480260+0000","last_became_active":"2024-09-10T22:45:28.475277+0000","last_became_peered":"2024-09-10T22:45:28.475277+0000","last_unstale":"2024-09-10T22:45:28.480260+0000","last_undegraded":"2024-09-10T22:45:28.480260+0000","last_fullsized":"2024-09-10T22:45:28.480260+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:18.106895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.471332+0000","last_change":"2024-09-10T22:45:27.482149+0000","last_active":"2024-09-10T22:45:28.471332+0000","last_peered":"2024-09-10T22:45:28.471332+0000","last_clean":"2024-09-10T22:45:28.471332+0000","last_became_active":"2024-09-10T22:45:27.480562+0000","last_became_peered":"2024-09-10T22:45:27.480562+0000","last_unstale":"2024-09-10T22:45:28.471332+0000","last_undegraded":"2024-09-10T22:45:28.471332+0000","last_fullsized":"2024-09-10T22:45:28.471332+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:41.004419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.486909+0000","last_change":"2024-09-10T22:45:28.483238+0000","last_active":"2024-09-10T22:45:28.486909+0000","last_peered":"2024-09-10T22:45:28.486909+0000","last_clean":"2024-09-10T22:45:28.486909+0000","last_became_active":"2024-09-10T22:45:28.482946+0000","last_became_peered":"2024-09-10T22:45:28.482946+0000","last_unstale":"2024-09-10T22:45:28.486909+0000","last_undegraded":"2024-09-10T22:45:28.486909+0000","last_fullsized":"2024-09-10T22:45:28.486909+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:06:26.263054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.479211+0000","last_change":"2024-09-10T22:45:27.479540+0000","last_active":"2024-09-10T22:45:28.479211+0000","last_peered":"2024-09-10T22:45:28.479211+0000","last_clean":"2024-09-10T22:45:28.479211+0000","last_became_active":"2024-09-10T22:45:27.478041+0000","last_became_peered":"2024-09-10T22:45:27.478041+0000","last_unstale":"2024-09-10T22:45:28.479211+0000","last_undegraded":"2024-09-10T22:45:28.479211+0000","last_fullsized":"2024-09-10T22:45:28.479211+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:30.721819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.491831+0000","last_change":"2024-09-10T22:45:28.487455+0000","last_active":"2024-09-10T22:45:28.491831+0000","last_peered":"2024-09-10T22:45:28.491831+0000","last_clean":"2024-09-10T22:45:28.491831+0000","last_became_active":"2024-09-10T22:45:28.487064+0000","last_became_peered":"2024-09-10T22:45:28.487064+0000","last_unstale":"2024-09-10T22:45:28.491831+0000","last_undegraded":"2024-09-10T22:45:28.491831+0000","last_fullsized":"2024-09-10T22:45:28.491831+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:31.979693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.888824+0000","last_change":"2024-09-10T22:45:27.484900+0000","last_active":"2024-09-10T22:45:30.888824+0000","last_peered":"2024-09-10T22:45:30.888824+0000","last_clean":"2024-09-10T22:45:30.888824+0000","last_became_active":"2024-09-10T22:45:27.484631+0000","last_became_peered":"2024-09-10T22:45:27.484631+0000","last_unstale":"2024-09-10T22:45:30.888824+0000","last_undegraded":"2024-09-10T22:45:30.888824+0000","last_fullsized":"2024-09-10T22:45:30.888824+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:50.051323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.483498+0000","last_change":"2024-09-10T22:45:28.477685+0000","last_active":"2024-09-10T22:45:28.483498+0000","last_peered":"2024-09-10T22:45:28.483498+0000","last_clean":"2024-09-10T22:45:28.483498+0000","last_became_active":"2024-09-10T22:45:28.477426+0000","last_became_peered":"2024-09-10T22:45:28.477426+0000","last_unstale":"2024-09-10T22:45:28.483498+0000","last_undegraded":"2024-09-10T22:45:28.483498+0000","last_fullsized":"2024-09-10T22:45:28.483498+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:38.156932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.468572+0000","last_change":"2024-09-10T22:45:27.478764+0000","last_active":"2024-09-10T22:45:28.468572+0000","last_peered":"2024-09-10T22:45:28.468572+0000","last_clean":"2024-09-10T22:45:28.468572+0000","last_became_active":"2024-09-10T22:45:27.478510+0000","last_became_peered":"2024-09-10T22:45:27.478510+0000","last_unstale":"2024-09-10T22:45:28.468572+0000","last_undegraded":"2024-09-10T22:45:28.468572+0000","last_fullsized":"2024-09-10T22:45:28.468572+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:37.236881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.493105+0000","last_change":"2024-09-10T22:45:28.486883+0000","last_active":"2024-09-10T22:45:28.493105+0000","last_peered":"2024-09-10T22:45:28.493105+0000","last_clean":"2024-09-10T22:45:28.493105+0000","last_became_active":"2024-09-10T22:45:28.486639+0000","last_became_peered":"2024-09-10T22:45:28.486639+0000","last_unstale":"2024-09-10T22:45:28.493105+0000","last_undegraded":"2024-09-10T22:45:28.493105+0000","last_fullsized":"2024-09-10T22:45:28.493105+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:59.997959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.463651+0000","last_change":"2024-09-10T22:45:27.475182+0000","last_active":"2024-09-10T22:45:28.463651+0000","last_peered":"2024-09-10T22:45:28.463651+0000","last_clean":"2024-09-10T22:45:28.463651+0000","last_became_active":"2024-09-10T22:45:27.474736+0000","last_became_peered":"2024-09-10T22:45:27.474736+0000","last_unstale":"2024-09-10T22:45:28.463651+0000","last_undegraded":"2024-09-10T22:45:28.463651+0000","last_fullsized":"2024-09-10T22:45:28.463651+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:25.135572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.491691+0000","last_change":"2024-09-10T22:45:28.489632+0000","last_active":"2024-09-10T22:45:28.491691+0000","last_peered":"2024-09-10T22:45:28.491691+0000","last_clean":"2024-09-10T22:45:28.491691+0000","last_became_active":"2024-09-10T22:45:28.489031+0000","last_became_peered":"2024-09-10T22:45:28.489031+0000","last_unstale":"2024-09-10T22:45:28.491691+0000","last_undegraded":"2024-09-10T22:45:28.491691+0000","last_fullsized":"2024-09-10T22:45:28.491691+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:56.780870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.478940+0000","last_change":"2024-09-10T22:45:27.477649+0000","last_active":"2024-09-10T22:45:28.478940+0000","last_peered":"2024-09-10T22:45:28.478940+0000","last_clean":"2024-09-10T22:45:28.478940+0000","last_became_active":"2024-09-10T22:45:27.477395+0000","last_became_peered":"2024-09-10T22:45:27.477395+0000","last_unstale":"2024-09-10T22:45:28.478940+0000","last_undegraded":"2024-09-10T22:45:28.478940+0000","last_fullsized":"2024-09-10T22:45:28.478940+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:12.025390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.485153+0000","last_change":"2024-09-10T22:45:28.480731+0000","last_active":"2024-09-10T22:45:28.485153+0000","last_peered":"2024-09-10T22:45:28.485153+0000","last_clean":"2024-09-10T22:45:28.485153+0000","last_became_active":"2024-09-10T22:45:28.480407+0000","last_became_peered":"2024-09-10T22:45:28.480407+0000","last_unstale":"2024-09-10T22:45:28.485153+0000","last_undegraded":"2024-09-10T22:45:28.485153+0000","last_fullsized":"2024-09-10T22:45:28.485153+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:38.244336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.464294+0000","last_change":"2024-09-10T22:45:27.477068+0000","last_active":"2024-09-10T22:45:28.464294+0000","last_peered":"2024-09-10T22:45:28.464294+0000","last_clean":"2024-09-10T22:45:28.464294+0000","last_became_active":"2024-09-10T22:45:27.476442+0000","last_became_peered":"2024-09-10T22:45:27.476442+0000","last_unstale":"2024-09-10T22:45:28.464294+0000","last_undegraded":"2024-09-10T22:45:28.464294+0000","last_fullsized":"2024-09-10T22:45:28.464294+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:01.070870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.506486+0000","last_change":"2024-09-10T22:45:28.503779+0000","last_active":"2024-09-10T22:45:28.506486+0000","last_peered":"2024-09-10T22:45:28.506486+0000","last_clean":"2024-09-10T22:45:28.506486+0000","last_became_active":"2024-09-10T22:45:28.503472+0000","last_became_peered":"2024-09-10T22:45:28.503472+0000","last_unstale":"2024-09-10T22:45:28.506486+0000","last_undegraded":"2024-09-10T22:45:28.506486+0000","last_fullsized":"2024-09-10T22:45:28.506486+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:18.106895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"104'2","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.500105+0000","last_change":"2024-09-10T22:45:27.472450+0000","last_active":"2024-09-10T22:45:28.500105+0000","last_peered":"2024-09-10T22:45:28.500105+0000","last_clean":"2024-09-10T22:45:28.500105+0000","last_became_active":"2024-09-10T22:45:27.472185+0000","last_became_peered":"2024-09-10T22:45:27.472185+0000","last_unstale":"2024-09-10T22:45:28.500105+0000","last_undegraded":"2024-09-10T22:45:28.500105+0000","last_fullsized":"2024-09-10T22:45:28.500105+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:44.343501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":263,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.474546+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:45:28.474546+0000","last_peered":"2024-09-10T22:45:28.474546+0000","last_clean":"2024-09-10T22:45:28.474546+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:45:28.474546+0000","last_undegraded":"2024-09-10T22:45:28.474546+0000","last_fullsized":"2024-09-10T22:45:28.474546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509525,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":1185437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509525,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1269760,"data_stored":587742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509526,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1282048,"data_stored":594909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509525,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1269760,"data_stored":587742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509525,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1286144,"data_stored":595491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509525,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1286144,"data_stored":594943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509525,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33008,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338832,"statfs":{"total":96636764160,"available":96602963968,"internally_reserved":0,"allocated":1863680,"data_stored":1178110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1286144,"data_stored":594943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:45:32.581 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:45:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.757+0000 7f3f26800640 1 -- 172.21.15.103:0/1474385433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f04003a40 msgr2=0x7f3f04003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.757+0000 7f3f26800640 1 --2- 172.21.15.103:0/1474385433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f04003a40 0x7f3f04003e60 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000c2e0 tx=0x7f3f1001cf60 comp rx=0 tx=0).stop 2024-09-10T22:45:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.757+0000 7f3f1fe00640 1 -- 172.21.15.103:0/1474385433 reap_dead start 2024-09-10T22:45:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.757+0000 7f3f26800640 1 -- 172.21.15.103:0/1474385433 shutdown_connections 2024-09-10T22:45:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.757+0000 7f3f26800640 1 -- 172.21.15.103:0/1474385433 >> 172.21.15.103:0/1474385433 conn(0x7f3f200d0940 msgr2=0x7f3f200d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.757+0000 7f3f26800640 1 -- 172.21.15.103:0/1474385433 shutdown_connections 2024-09-10T22:45:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.757+0000 7f3f26800640 1 -- 172.21.15.103:0/1474385433 wait complete. 2024-09-10T22:45:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.757+0000 7f3f26800640 1 Processor -- start 2024-09-10T22:45:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.757+0000 7f3f26800640 1 -- start start 2024-09-10T22:45:32.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f26800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f04003a40 0x7f3f20156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:32.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f26800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f201fb110 0x7f3f2014cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:32.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f26800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f201fb570 0x7f3f2014d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:32.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f26800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3f201678c0 con 0x7f3f201fb110 2024-09-10T22:45:32.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f26800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3f20167740 con 0x7f3f201fb570 2024-09-10T22:45:32.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f26800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3f20167a40 con 0x7f3f04003a40 2024-09-10T22:45:32.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f16a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f201fb110 0x7f3f2014cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:32.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f16a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f201fb110 0x7f3f2014cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41090/0 (socket says 172.21.15.103:41090) 2024-09-10T22:45:32.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f16a00640 1 -- 172.21.15.103:0/61517580 learned_addr learned my addr 172.21.15.103:0/61517580 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:32.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f1f400640 1 --2- 172.21.15.103:0/61517580 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f04003a40 0x7f3f20156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:32.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f1fe00640 1 --2- 172.21.15.103:0/61517580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f201fb570 0x7f3f2014d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:32.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f16a00640 1 -- 172.21.15.103:0/61517580 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f04003a40 msgr2=0x7f3f20156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:32.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f16a00640 1 --2- 172.21.15.103:0/61517580 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f04003a40 0x7f3f20156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f16a00640 1 -- 172.21.15.103:0/61517580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f201fb570 msgr2=0x7f3f2014d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:32.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f16a00640 1 --2- 172.21.15.103:0/61517580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f201fb570 0x7f3f2014d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f16a00640 1 -- 172.21.15.103:0/61517580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2014d9a0 con 0x7f3f201fb110 2024-09-10T22:45:32.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f16a00640 1 --2- 172.21.15.103:0/61517580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f201fb110 0x7f3f2014cf20 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f3f08003ef0 tx=0x7f3f08001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:32.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f17e00640 1 -- 172.21.15.103:0/61517580 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08011640 con 0x7f3f201fb110 2024-09-10T22:45:32.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f17e00640 1 -- 172.21.15.103:0/61517580 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f08016020 con 0x7f3f201fb110 2024-09-10T22:45:32.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f26800640 1 -- 172.21.15.103:0/61517580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f2006f700 con 0x7f3f201fb110 2024-09-10T22:45:32.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f17e00640 1 -- 172.21.15.103:0/61517580 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08011a40 con 0x7f3f201fb110 2024-09-10T22:45:32.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f26800640 1 -- 172.21.15.103:0/61517580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f2006fcc0 con 0x7f3f201fb110 2024-09-10T22:45:32.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f26800640 1 -- 172.21.15.103:0/61517580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f2006cfe0 con 0x7f3f201fb110 2024-09-10T22:45:32.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.761+0000 7f3f17e00640 1 -- 172.21.15.103:0/61517580 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3f08011be0 con 0x7f3f201fb110 2024-09-10T22:45:32.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.765+0000 7f3f17e00640 1 --2- 172.21.15.103:0/61517580 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3efc072610 0x7f3efc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:32.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.765+0000 7f3f17e00640 1 -- 172.21.15.103:0/61517580 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6188+0+0 (secure 0 0 0) 0x7f3f08093fc0 con 0x7f3f201fb110 2024-09-10T22:45:32.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.765+0000 7f3f1f400640 1 --2- 172.21.15.103:0/61517580 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3efc072610 0x7f3efc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:32.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.765+0000 7f3f1f400640 1 --2- 172.21.15.103:0/61517580 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3efc072610 0x7f3efc074ad0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3f100ab000 tx=0x7f3f10019da0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:32.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.769+0000 7f3f17e00640 1 -- 172.21.15.103:0/61517580 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3f08020020 con 0x7f3f201fb110 2024-09-10T22:45:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.929+0000 7f3f26800640 1 -- 172.21.15.103:0/61517580 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3f200cd0c0 con 0x7f3efc072610 2024-09-10T22:45:32.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.937+0000 7f3f17e00640 1 -- 172.21.15.103:0/61517580 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252468 (secure 0 0 0) 0x7f3f200cd0c0 con 0x7f3efc072610 2024-09-10T22:45:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:32.943 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:45:32.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.937+0000 7f3f26800640 1 -- 172.21.15.103:0/61517580 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3efc072610 msgr2=0x7f3efc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:32.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.937+0000 7f3f26800640 1 --2- 172.21.15.103:0/61517580 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3efc072610 0x7f3efc074ad0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3f100ab000 tx=0x7f3f10019da0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.937+0000 7f3f26800640 1 -- 172.21.15.103:0/61517580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f201fb110 msgr2=0x7f3f2014cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:32.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.937+0000 7f3f26800640 1 --2- 172.21.15.103:0/61517580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f201fb110 0x7f3f2014cf20 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f3f08003ef0 tx=0x7f3f08001640 comp rx=0 tx=0).stop 2024-09-10T22:45:32.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.937+0000 7f3f26800640 1 -- 172.21.15.103:0/61517580 shutdown_connections 2024-09-10T22:45:32.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.937+0000 7f3f26800640 1 --2- 172.21.15.103:0/61517580 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f3efc072610 0x7f3efc074ad0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.937+0000 7f3f26800640 1 --2- 172.21.15.103:0/61517580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f201fb570 0x7f3f2014d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.937+0000 7f3f26800640 1 --2- 172.21.15.103:0/61517580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f201fb110 0x7f3f2014cf20 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.937+0000 7f3f26800640 1 --2- 172.21.15.103:0/61517580 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f04003a40 0x7f3f20156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:32.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.941+0000 7f3f26800640 1 -- 172.21.15.103:0/61517580 >> 172.21.15.103:0/61517580 conn(0x7f3f200d0940 msgr2=0x7f3f20152e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:32.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.941+0000 7f3f26800640 1 -- 172.21.15.103:0/61517580 shutdown_connections 2024-09-10T22:45:32.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:32.941+0000 7f3f26800640 1 -- 172.21.15.103:0/61517580 wait complete. 2024-09-10T22:45:32.963 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-09-10T22:45:32.497004+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260696,"kb_used_data":11160,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714024,"statfs":{"total":773094113280,"available":772827160576,"internally_reserved":0,"allocated":11427840,"data_stored":5919317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.035770"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.508687+0000","last_change":"2024-09-10T22:45:28.503013+0000","last_active":"2024-09-10T22:45:28.508687+0000","last_peered":"2024-09-10T22:45:28.508687+0000","last_clean":"2024-09-10T22:45:28.508687+0000","last_became_active":"2024-09-10T22:45:28.502696+0000","last_became_peered":"2024-09-10T22:45:28.502696+0000","last_unstale":"2024-09-10T22:45:28.508687+0000","last_undegraded":"2024-09-10T22:45:28.508687+0000","last_fullsized":"2024-09-10T22:45:28.508687+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:20.247883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.495296+0000","last_change":"2024-09-10T22:45:28.490351+0000","last_active":"2024-09-10T22:45:28.495296+0000","last_peered":"2024-09-10T22:45:28.495296+0000","last_clean":"2024-09-10T22:45:28.495296+0000","last_became_active":"2024-09-10T22:45:28.489866+0000","last_became_peered":"2024-09-10T22:45:28.489866+0000","last_unstale":"2024-09-10T22:45:28.495296+0000","last_undegraded":"2024-09-10T22:45:28.495296+0000","last_fullsized":"2024-09-10T22:45:28.495296+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:29.267021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.508891+0000","last_change":"2024-09-10T22:45:28.506673+0000","last_active":"2024-09-10T22:45:28.508891+0000","last_peered":"2024-09-10T22:45:28.508891+0000","last_clean":"2024-09-10T22:45:28.508891+0000","last_became_active":"2024-09-10T22:45:28.506414+0000","last_became_peered":"2024-09-10T22:45:28.506414+0000","last_unstale":"2024-09-10T22:45:28.508891+0000","last_undegraded":"2024-09-10T22:45:28.508891+0000","last_fullsized":"2024-09-10T22:45:28.508891+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:08.837425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.480796+0000","last_change":"2024-09-10T22:45:28.478618+0000","last_active":"2024-09-10T22:45:28.480796+0000","last_peered":"2024-09-10T22:45:28.480796+0000","last_clean":"2024-09-10T22:45:28.480796+0000","last_became_active":"2024-09-10T22:45:28.478333+0000","last_became_peered":"2024-09-10T22:45:28.478333+0000","last_unstale":"2024-09-10T22:45:28.480796+0000","last_undegraded":"2024-09-10T22:45:28.480796+0000","last_fullsized":"2024-09-10T22:45:28.480796+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:55.487553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.888213+0000","last_change":"2024-09-10T22:45:28.477408+0000","last_active":"2024-09-10T22:45:30.888213+0000","last_peered":"2024-09-10T22:45:30.888213+0000","last_clean":"2024-09-10T22:45:30.888213+0000","last_became_active":"2024-09-10T22:45:28.476875+0000","last_became_peered":"2024-09-10T22:45:28.476875+0000","last_unstale":"2024-09-10T22:45:30.888213+0000","last_undegraded":"2024-09-10T22:45:30.888213+0000","last_fullsized":"2024-09-10T22:45:30.888213+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:40.949358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.491516+0000","last_change":"2024-09-10T22:45:28.487420+0000","last_active":"2024-09-10T22:45:28.491516+0000","last_peered":"2024-09-10T22:45:28.491516+0000","last_clean":"2024-09-10T22:45:28.491516+0000","last_became_active":"2024-09-10T22:45:28.487040+0000","last_became_peered":"2024-09-10T22:45:28.487040+0000","last_unstale":"2024-09-10T22:45:28.491516+0000","last_undegraded":"2024-09-10T22:45:28.491516+0000","last_fullsized":"2024-09-10T22:45:28.491516+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:50.705470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.492809+0000","last_change":"2024-09-10T22:45:28.487507+0000","last_active":"2024-09-10T22:45:28.492809+0000","last_peered":"2024-09-10T22:45:28.492809+0000","last_clean":"2024-09-10T22:45:28.492809+0000","last_became_active":"2024-09-10T22:45:28.487223+0000","last_became_peered":"2024-09-10T22:45:28.487223+0000","last_unstale":"2024-09-10T22:45:28.492809+0000","last_undegraded":"2024-09-10T22:45:28.492809+0000","last_fullsized":"2024-09-10T22:45:28.492809+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:04:48.701951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.481498+0000","last_change":"2024-09-10T22:45:28.478232+0000","last_active":"2024-09-10T22:45:28.481498+0000","last_peered":"2024-09-10T22:45:28.481498+0000","last_clean":"2024-09-10T22:45:28.481498+0000","last_became_active":"2024-09-10T22:45:28.477954+0000","last_became_peered":"2024-09-10T22:45:28.477954+0000","last_unstale":"2024-09-10T22:45:28.481498+0000","last_undegraded":"2024-09-10T22:45:28.481498+0000","last_fullsized":"2024-09-10T22:45:28.481498+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:13.276642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.498957+0000","last_change":"2024-09-10T22:45:28.492468+0000","last_active":"2024-09-10T22:45:28.498957+0000","last_peered":"2024-09-10T22:45:28.498957+0000","last_clean":"2024-09-10T22:45:28.498957+0000","last_became_active":"2024-09-10T22:45:28.491826+0000","last_became_peered":"2024-09-10T22:45:28.491826+0000","last_unstale":"2024-09-10T22:45:28.498957+0000","last_undegraded":"2024-09-10T22:45:28.498957+0000","last_fullsized":"2024-09-10T22:45:28.498957+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:56.488176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.888506+0000","last_change":"2024-09-10T22:45:28.494878+0000","last_active":"2024-09-10T22:45:30.888506+0000","last_peered":"2024-09-10T22:45:30.888506+0000","last_clean":"2024-09-10T22:45:30.888506+0000","last_became_active":"2024-09-10T22:45:28.494601+0000","last_became_peered":"2024-09-10T22:45:28.494601+0000","last_unstale":"2024-09-10T22:45:30.888506+0000","last_undegraded":"2024-09-10T22:45:30.888506+0000","last_fullsized":"2024-09-10T22:45:30.888506+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:56.464927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.492591+0000","last_change":"2024-09-10T22:45:28.486978+0000","last_active":"2024-09-10T22:45:28.492591+0000","last_peered":"2024-09-10T22:45:28.492591+0000","last_clean":"2024-09-10T22:45:28.492591+0000","last_became_active":"2024-09-10T22:45:28.486661+0000","last_became_peered":"2024-09-10T22:45:28.486661+0000","last_unstale":"2024-09-10T22:45:28.492591+0000","last_undegraded":"2024-09-10T22:45:28.492591+0000","last_fullsized":"2024-09-10T22:45:28.492591+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:52.754149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.484742+0000","last_change":"2024-09-10T22:45:28.476167+0000","last_active":"2024-09-10T22:45:28.484742+0000","last_peered":"2024-09-10T22:45:28.484742+0000","last_clean":"2024-09-10T22:45:28.484742+0000","last_became_active":"2024-09-10T22:45:28.475895+0000","last_became_peered":"2024-09-10T22:45:28.475895+0000","last_unstale":"2024-09-10T22:45:28.484742+0000","last_undegraded":"2024-09-10T22:45:28.484742+0000","last_fullsized":"2024-09-10T22:45:28.484742+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:31.979693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.484360+0000","last_change":"2024-09-10T22:45:28.482493+0000","last_active":"2024-09-10T22:45:28.484360+0000","last_peered":"2024-09-10T22:45:28.484360+0000","last_clean":"2024-09-10T22:45:28.484360+0000","last_became_active":"2024-09-10T22:45:28.480087+0000","last_became_peered":"2024-09-10T22:45:28.480087+0000","last_unstale":"2024-09-10T22:45:28.484360+0000","last_undegraded":"2024-09-10T22:45:28.484360+0000","last_fullsized":"2024-09-10T22:45:28.484360+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:45.946611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.493325+0000","last_change":"2024-09-10T22:45:28.490883+0000","last_active":"2024-09-10T22:45:28.493325+0000","last_peered":"2024-09-10T22:45:28.493325+0000","last_clean":"2024-09-10T22:45:28.493325+0000","last_became_active":"2024-09-10T22:45:28.489978+0000","last_became_peered":"2024-09-10T22:45:28.489978+0000","last_unstale":"2024-09-10T22:45:28.493325+0000","last_undegraded":"2024-09-10T22:45:28.493325+0000","last_fullsized":"2024-09-10T22:45:28.493325+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:59.736437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.488038+0000","last_change":"2024-09-10T22:45:28.483552+0000","last_active":"2024-09-10T22:45:28.488038+0000","last_peered":"2024-09-10T22:45:28.488038+0000","last_clean":"2024-09-10T22:45:28.488038+0000","last_became_active":"2024-09-10T22:45:28.483273+0000","last_became_peered":"2024-09-10T22:45:28.483273+0000","last_unstale":"2024-09-10T22:45:28.488038+0000","last_undegraded":"2024-09-10T22:45:28.488038+0000","last_fullsized":"2024-09-10T22:45:28.488038+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:06.287409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.489127+0000","last_change":"2024-09-10T22:45:28.485855+0000","last_active":"2024-09-10T22:45:28.489127+0000","last_peered":"2024-09-10T22:45:28.489127+0000","last_clean":"2024-09-10T22:45:28.489127+0000","last_became_active":"2024-09-10T22:45:28.485600+0000","last_became_peered":"2024-09-10T22:45:28.485600+0000","last_unstale":"2024-09-10T22:45:28.489127+0000","last_undegraded":"2024-09-10T22:45:28.489127+0000","last_fullsized":"2024-09-10T22:45:28.489127+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:05.101217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.508664+0000","last_change":"2024-09-10T22:45:28.502888+0000","last_active":"2024-09-10T22:45:28.508664+0000","last_peered":"2024-09-10T22:45:28.508664+0000","last_clean":"2024-09-10T22:45:28.508664+0000","last_became_active":"2024-09-10T22:45:28.502442+0000","last_became_peered":"2024-09-10T22:45:28.502442+0000","last_unstale":"2024-09-10T22:45:28.508664+0000","last_undegraded":"2024-09-10T22:45:28.508664+0000","last_fullsized":"2024-09-10T22:45:28.508664+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:37.054147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.499638+0000","last_change":"2024-09-10T22:45:28.495022+0000","last_active":"2024-09-10T22:45:28.499638+0000","last_peered":"2024-09-10T22:45:28.499638+0000","last_clean":"2024-09-10T22:45:28.499638+0000","last_became_active":"2024-09-10T22:45:28.494751+0000","last_became_peered":"2024-09-10T22:45:28.494751+0000","last_unstale":"2024-09-10T22:45:28.499638+0000","last_undegraded":"2024-09-10T22:45:28.499638+0000","last_fullsized":"2024-09-10T22:45:28.499638+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:24.671212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.508419+0000","last_change":"2024-09-10T22:45:28.500200+0000","last_active":"2024-09-10T22:45:28.508419+0000","last_peered":"2024-09-10T22:45:28.508419+0000","last_clean":"2024-09-10T22:45:28.508419+0000","last_became_active":"2024-09-10T22:45:28.499930+0000","last_became_peered":"2024-09-10T22:45:28.499930+0000","last_unstale":"2024-09-10T22:45:28.508419+0000","last_undegraded":"2024-09-10T22:45:28.508419+0000","last_fullsized":"2024-09-10T22:45:28.508419+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:08.243639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.484764+0000","last_change":"2024-09-10T22:45:28.479540+0000","last_active":"2024-09-10T22:45:28.484764+0000","last_peered":"2024-09-10T22:45:28.484764+0000","last_clean":"2024-09-10T22:45:28.484764+0000","last_became_active":"2024-09-10T22:45:28.479276+0000","last_became_peered":"2024-09-10T22:45:28.479276+0000","last_unstale":"2024-09-10T22:45:28.484764+0000","last_undegraded":"2024-09-10T22:45:28.484764+0000","last_fullsized":"2024-09-10T22:45:28.484764+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:36.854227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.495245+0000","last_change":"2024-09-10T22:45:28.485088+0000","last_active":"2024-09-10T22:45:28.495245+0000","last_peered":"2024-09-10T22:45:28.495245+0000","last_clean":"2024-09-10T22:45:28.495245+0000","last_became_active":"2024-09-10T22:45:28.484729+0000","last_became_peered":"2024-09-10T22:45:28.484729+0000","last_unstale":"2024-09-10T22:45:28.495245+0000","last_undegraded":"2024-09-10T22:45:28.495245+0000","last_fullsized":"2024-09-10T22:45:28.495245+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:51.829723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.888180+0000","last_change":"2024-09-10T22:45:28.481591+0000","last_active":"2024-09-10T22:45:30.888180+0000","last_peered":"2024-09-10T22:45:30.888180+0000","last_clean":"2024-09-10T22:45:30.888180+0000","last_became_active":"2024-09-10T22:45:28.481314+0000","last_became_peered":"2024-09-10T22:45:28.481314+0000","last_unstale":"2024-09-10T22:45:30.888180+0000","last_undegraded":"2024-09-10T22:45:30.888180+0000","last_fullsized":"2024-09-10T22:45:30.888180+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:24.545062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.499526+0000","last_change":"2024-09-10T22:45:28.486514+0000","last_active":"2024-09-10T22:45:28.499526+0000","last_peered":"2024-09-10T22:45:28.499526+0000","last_clean":"2024-09-10T22:45:28.499526+0000","last_became_active":"2024-09-10T22:45:28.486174+0000","last_became_peered":"2024-09-10T22:45:28.486174+0000","last_unstale":"2024-09-10T22:45:28.499526+0000","last_undegraded":"2024-09-10T22:45:28.499526+0000","last_fullsized":"2024-09-10T22:45:28.499526+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:13.557017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.887709+0000","last_change":"2024-09-10T22:45:28.500785+0000","last_active":"2024-09-10T22:45:30.887709+0000","last_peered":"2024-09-10T22:45:30.887709+0000","last_clean":"2024-09-10T22:45:30.887709+0000","last_became_active":"2024-09-10T22:45:28.500446+0000","last_became_peered":"2024-09-10T22:45:28.500446+0000","last_unstale":"2024-09-10T22:45:30.887709+0000","last_undegraded":"2024-09-10T22:45:30.887709+0000","last_fullsized":"2024-09-10T22:45:30.887709+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:08.116238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.484980+0000","last_change":"2024-09-10T22:45:28.482468+0000","last_active":"2024-09-10T22:45:28.484980+0000","last_peered":"2024-09-10T22:45:28.484980+0000","last_clean":"2024-09-10T22:45:28.484980+0000","last_became_active":"2024-09-10T22:45:28.482182+0000","last_became_peered":"2024-09-10T22:45:28.482182+0000","last_unstale":"2024-09-10T22:45:28.484980+0000","last_undegraded":"2024-09-10T22:45:28.484980+0000","last_fullsized":"2024-09-10T22:45:28.484980+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:41:06.859451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.488644+0000","last_change":"2024-09-10T22:45:28.487753+0000","last_active":"2024-09-10T22:45:28.488644+0000","last_peered":"2024-09-10T22:45:28.488644+0000","last_clean":"2024-09-10T22:45:28.488644+0000","last_became_active":"2024-09-10T22:45:28.487444+0000","last_became_peered":"2024-09-10T22:45:28.487444+0000","last_unstale":"2024-09-10T22:45:28.488644+0000","last_undegraded":"2024-09-10T22:45:28.488644+0000","last_fullsized":"2024-09-10T22:45:28.488644+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:45.946611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.488620+0000","last_change":"2024-09-10T22:45:28.482769+0000","last_active":"2024-09-10T22:45:28.488620+0000","last_peered":"2024-09-10T22:45:28.488620+0000","last_clean":"2024-09-10T22:45:28.488620+0000","last_became_active":"2024-09-10T22:45:28.482509+0000","last_became_peered":"2024-09-10T22:45:28.482509+0000","last_unstale":"2024-09-10T22:45:28.488620+0000","last_undegraded":"2024-09-10T22:45:28.488620+0000","last_fullsized":"2024-09-10T22:45:28.488620+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:38.079911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.489676+0000","last_change":"2024-09-10T22:45:28.483766+0000","last_active":"2024-09-10T22:45:28.489676+0000","last_peered":"2024-09-10T22:45:28.489676+0000","last_clean":"2024-09-10T22:45:28.489676+0000","last_became_active":"2024-09-10T22:45:28.483492+0000","last_became_peered":"2024-09-10T22:45:28.483492+0000","last_unstale":"2024-09-10T22:45:28.489676+0000","last_undegraded":"2024-09-10T22:45:28.489676+0000","last_fullsized":"2024-09-10T22:45:28.489676+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:31.528991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.495221+0000","last_change":"2024-09-10T22:45:28.481482+0000","last_active":"2024-09-10T22:45:28.495221+0000","last_peered":"2024-09-10T22:45:28.495221+0000","last_clean":"2024-09-10T22:45:28.495221+0000","last_became_active":"2024-09-10T22:45:28.481239+0000","last_became_peered":"2024-09-10T22:45:28.481239+0000","last_unstale":"2024-09-10T22:45:28.495221+0000","last_undegraded":"2024-09-10T22:45:28.495221+0000","last_fullsized":"2024-09-10T22:45:28.495221+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:55.892468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.485584+0000","last_change":"2024-09-10T22:45:28.483551+0000","last_active":"2024-09-10T22:45:28.485584+0000","last_peered":"2024-09-10T22:45:28.485584+0000","last_clean":"2024-09-10T22:45:28.485584+0000","last_became_active":"2024-09-10T22:45:28.481269+0000","last_became_peered":"2024-09-10T22:45:28.481269+0000","last_unstale":"2024-09-10T22:45:28.485584+0000","last_undegraded":"2024-09-10T22:45:28.485584+0000","last_fullsized":"2024-09-10T22:45:28.485584+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:55.487553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.505153+0000","last_change":"2024-09-10T22:45:28.502931+0000","last_active":"2024-09-10T22:45:28.505153+0000","last_peered":"2024-09-10T22:45:28.505153+0000","last_clean":"2024-09-10T22:45:28.505153+0000","last_became_active":"2024-09-10T22:45:28.502679+0000","last_became_peered":"2024-09-10T22:45:28.502679+0000","last_unstale":"2024-09-10T22:45:28.505153+0000","last_undegraded":"2024-09-10T22:45:28.505153+0000","last_fullsized":"2024-09-10T22:45:28.505153+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:27.581321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.473018+0000","last_change":"2024-09-10T22:45:28.470128+0000","last_active":"2024-09-10T22:45:28.473018+0000","last_peered":"2024-09-10T22:45:28.473018+0000","last_clean":"2024-09-10T22:45:28.473018+0000","last_became_active":"2024-09-10T22:45:28.469270+0000","last_became_peered":"2024-09-10T22:45:28.469270+0000","last_unstale":"2024-09-10T22:45:28.473018+0000","last_undegraded":"2024-09-10T22:45:28.473018+0000","last_fullsized":"2024-09-10T22:45:28.473018+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:48.333006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.500915+0000","last_change":"2024-09-10T22:45:28.499122+0000","last_active":"2024-09-10T22:45:28.500915+0000","last_peered":"2024-09-10T22:45:28.500915+0000","last_clean":"2024-09-10T22:45:28.500915+0000","last_became_active":"2024-09-10T22:45:28.487562+0000","last_became_peered":"2024-09-10T22:45:28.487562+0000","last_unstale":"2024-09-10T22:45:28.500915+0000","last_undegraded":"2024-09-10T22:45:28.500915+0000","last_fullsized":"2024-09-10T22:45:28.500915+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:27.575027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"104'4","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.499338+0000","last_change":"2024-09-10T22:45:27.477849+0000","last_active":"2024-09-10T22:45:28.499338+0000","last_peered":"2024-09-10T22:45:28.499338+0000","last_clean":"2024-09-10T22:45:28.499338+0000","last_became_active":"2024-09-10T22:45:27.477600+0000","last_became_peered":"2024-09-10T22:45:27.477600+0000","last_unstale":"2024-09-10T22:45:28.499338+0000","last_undegraded":"2024-09-10T22:45:28.499338+0000","last_fullsized":"2024-09-10T22:45:28.499338+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:41:05.851996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.494397+0000","last_change":"2024-09-10T22:45:28.486472+0000","last_active":"2024-09-10T22:45:28.494397+0000","last_peered":"2024-09-10T22:45:28.494397+0000","last_clean":"2024-09-10T22:45:28.494397+0000","last_became_active":"2024-09-10T22:45:28.486151+0000","last_became_peered":"2024-09-10T22:45:28.486151+0000","last_unstale":"2024-09-10T22:45:28.494397+0000","last_undegraded":"2024-09-10T22:45:28.494397+0000","last_fullsized":"2024-09-10T22:45:28.494397+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:31.451338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"104'1","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.503864+0000","last_change":"2024-09-10T22:45:27.478140+0000","last_active":"2024-09-10T22:45:28.503864+0000","last_peered":"2024-09-10T22:45:28.503864+0000","last_clean":"2024-09-10T22:45:28.503864+0000","last_became_active":"2024-09-10T22:45:27.477627+0000","last_became_peered":"2024-09-10T22:45:27.477627+0000","last_unstale":"2024-09-10T22:45:28.503864+0000","last_undegraded":"2024-09-10T22:45:28.503864+0000","last_fullsized":"2024-09-10T22:45:28.503864+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:13.407486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.484622+0000","last_change":"2024-09-10T22:45:28.477435+0000","last_active":"2024-09-10T22:45:28.484622+0000","last_peered":"2024-09-10T22:45:28.484622+0000","last_clean":"2024-09-10T22:45:28.484622+0000","last_became_active":"2024-09-10T22:45:28.476311+0000","last_became_peered":"2024-09-10T22:45:28.476311+0000","last_unstale":"2024-09-10T22:45:28.484622+0000","last_undegraded":"2024-09-10T22:45:28.484622+0000","last_fullsized":"2024-09-10T22:45:28.484622+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:57.435890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"104'2","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.506077+0000","last_change":"2024-09-10T22:45:27.482286+0000","last_active":"2024-09-10T22:45:28.506077+0000","last_peered":"2024-09-10T22:45:28.506077+0000","last_clean":"2024-09-10T22:45:28.506077+0000","last_became_active":"2024-09-10T22:45:27.482003+0000","last_became_peered":"2024-09-10T22:45:27.482003+0000","last_unstale":"2024-09-10T22:45:28.506077+0000","last_undegraded":"2024-09-10T22:45:28.506077+0000","last_fullsized":"2024-09-10T22:45:28.506077+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:37.072456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.488719+0000","last_change":"2024-09-10T22:45:28.481326+0000","last_active":"2024-09-10T22:45:28.488719+0000","last_peered":"2024-09-10T22:45:28.488719+0000","last_clean":"2024-09-10T22:45:28.488719+0000","last_became_active":"2024-09-10T22:45:28.481023+0000","last_became_peered":"2024-09-10T22:45:28.481023+0000","last_unstale":"2024-09-10T22:45:28.488719+0000","last_undegraded":"2024-09-10T22:45:28.488719+0000","last_fullsized":"2024-09-10T22:45:28.488719+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:08.115561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"104'2","reported_seq":17,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.888716+0000","last_change":"2024-09-10T22:45:27.481006+0000","last_active":"2024-09-10T22:45:30.888716+0000","last_peered":"2024-09-10T22:45:30.888716+0000","last_clean":"2024-09-10T22:45:30.888716+0000","last_became_active":"2024-09-10T22:45:27.480741+0000","last_became_peered":"2024-09-10T22:45:27.480741+0000","last_unstale":"2024-09-10T22:45:30.888716+0000","last_undegraded":"2024-09-10T22:45:30.888716+0000","last_fullsized":"2024-09-10T22:45:30.888716+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:58.772621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.498375+0000","last_change":"2024-09-10T22:45:28.489057+0000","last_active":"2024-09-10T22:45:28.498375+0000","last_peered":"2024-09-10T22:45:28.498375+0000","last_clean":"2024-09-10T22:45:28.498375+0000","last_became_active":"2024-09-10T22:45:28.488579+0000","last_became_peered":"2024-09-10T22:45:28.488579+0000","last_unstale":"2024-09-10T22:45:28.498375+0000","last_undegraded":"2024-09-10T22:45:28.498375+0000","last_fullsized":"2024-09-10T22:45:28.498375+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:38.633361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"104'1","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.502103+0000","last_change":"2024-09-10T22:45:27.486533+0000","last_active":"2024-09-10T22:45:28.502103+0000","last_peered":"2024-09-10T22:45:28.502103+0000","last_clean":"2024-09-10T22:45:28.502103+0000","last_became_active":"2024-09-10T22:45:27.486259+0000","last_became_peered":"2024-09-10T22:45:27.486259+0000","last_unstale":"2024-09-10T22:45:28.502103+0000","last_undegraded":"2024-09-10T22:45:28.502103+0000","last_fullsized":"2024-09-10T22:45:28.502103+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:54.480097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.508392+0000","last_change":"2024-09-10T22:45:28.499871+0000","last_active":"2024-09-10T22:45:28.508392+0000","last_peered":"2024-09-10T22:45:28.508392+0000","last_clean":"2024-09-10T22:45:28.508392+0000","last_became_active":"2024-09-10T22:45:28.499637+0000","last_became_peered":"2024-09-10T22:45:28.499637+0000","last_unstale":"2024-09-10T22:45:28.508392+0000","last_undegraded":"2024-09-10T22:45:28.508392+0000","last_fullsized":"2024-09-10T22:45:28.508392+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:06.905497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"104'1","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.503675+0000","last_change":"2024-09-10T22:45:27.477709+0000","last_active":"2024-09-10T22:45:28.503675+0000","last_peered":"2024-09-10T22:45:28.503675+0000","last_clean":"2024-09-10T22:45:28.503675+0000","last_became_active":"2024-09-10T22:45:27.477454+0000","last_became_peered":"2024-09-10T22:45:27.477454+0000","last_unstale":"2024-09-10T22:45:28.503675+0000","last_undegraded":"2024-09-10T22:45:28.503675+0000","last_fullsized":"2024-09-10T22:45:28.503675+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:44.591551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.498763+0000","last_change":"2024-09-10T22:45:28.491598+0000","last_active":"2024-09-10T22:45:28.498763+0000","last_peered":"2024-09-10T22:45:28.498763+0000","last_clean":"2024-09-10T22:45:28.498763+0000","last_became_active":"2024-09-10T22:45:28.491193+0000","last_became_peered":"2024-09-10T22:45:28.491193+0000","last_unstale":"2024-09-10T22:45:28.498763+0000","last_undegraded":"2024-09-10T22:45:28.498763+0000","last_fullsized":"2024-09-10T22:45:28.498763+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:39.343147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.468822+0000","last_change":"2024-09-10T22:45:27.481853+0000","last_active":"2024-09-10T22:45:28.468822+0000","last_peered":"2024-09-10T22:45:28.468822+0000","last_clean":"2024-09-10T22:45:28.468822+0000","last_became_active":"2024-09-10T22:45:27.481506+0000","last_became_peered":"2024-09-10T22:45:27.481506+0000","last_unstale":"2024-09-10T22:45:28.468822+0000","last_undegraded":"2024-09-10T22:45:28.468822+0000","last_fullsized":"2024-09-10T22:45:28.468822+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:29:07.108106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.499415+0000","last_change":"2024-09-10T22:45:28.494363+0000","last_active":"2024-09-10T22:45:28.499415+0000","last_peered":"2024-09-10T22:45:28.499415+0000","last_clean":"2024-09-10T22:45:28.499415+0000","last_became_active":"2024-09-10T22:45:28.493947+0000","last_became_peered":"2024-09-10T22:45:28.493947+0000","last_unstale":"2024-09-10T22:45:28.499415+0000","last_undegraded":"2024-09-10T22:45:28.499415+0000","last_fullsized":"2024-09-10T22:45:28.499415+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:48.943618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.468128+0000","last_change":"2024-09-10T22:45:27.481957+0000","last_active":"2024-09-10T22:45:28.468128+0000","last_peered":"2024-09-10T22:45:28.468128+0000","last_clean":"2024-09-10T22:45:28.468128+0000","last_became_active":"2024-09-10T22:45:27.481706+0000","last_became_peered":"2024-09-10T22:45:27.481706+0000","last_unstale":"2024-09-10T22:45:28.468128+0000","last_undegraded":"2024-09-10T22:45:28.468128+0000","last_fullsized":"2024-09-10T22:45:28.468128+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:56.428435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.508837+0000","last_change":"2024-09-10T22:45:28.504201+0000","last_active":"2024-09-10T22:45:28.508837+0000","last_peered":"2024-09-10T22:45:28.508837+0000","last_clean":"2024-09-10T22:45:28.508837+0000","last_became_active":"2024-09-10T22:45:28.500725+0000","last_became_peered":"2024-09-10T22:45:28.500725+0000","last_unstale":"2024-09-10T22:45:28.508837+0000","last_undegraded":"2024-09-10T22:45:28.508837+0000","last_fullsized":"2024-09-10T22:45:28.508837+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:51.355358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.469195+0000","last_change":"2024-09-10T22:45:27.482302+0000","last_active":"2024-09-10T22:45:28.469195+0000","last_peered":"2024-09-10T22:45:28.469195+0000","last_clean":"2024-09-10T22:45:28.469195+0000","last_became_active":"2024-09-10T22:45:27.480011+0000","last_became_peered":"2024-09-10T22:45:27.480011+0000","last_unstale":"2024-09-10T22:45:28.469195+0000","last_undegraded":"2024-09-10T22:45:28.469195+0000","last_fullsized":"2024-09-10T22:45:28.469195+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:51.746694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.887870+0000","last_change":"2024-09-10T22:45:28.476133+0000","last_active":"2024-09-10T22:45:30.887870+0000","last_peered":"2024-09-10T22:45:30.887870+0000","last_clean":"2024-09-10T22:45:30.887870+0000","last_became_active":"2024-09-10T22:45:28.475828+0000","last_became_peered":"2024-09-10T22:45:28.475828+0000","last_unstale":"2024-09-10T22:45:30.887870+0000","last_undegraded":"2024-09-10T22:45:30.887870+0000","last_fullsized":"2024-09-10T22:45:30.887870+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:37.386163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.471132+0000","last_change":"2024-09-10T22:45:27.473036+0000","last_active":"2024-09-10T22:45:28.471132+0000","last_peered":"2024-09-10T22:45:28.471132+0000","last_clean":"2024-09-10T22:45:28.471132+0000","last_became_active":"2024-09-10T22:45:27.472761+0000","last_became_peered":"2024-09-10T22:45:27.472761+0000","last_unstale":"2024-09-10T22:45:28.471132+0000","last_undegraded":"2024-09-10T22:45:28.471132+0000","last_fullsized":"2024-09-10T22:45:28.471132+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:26.117355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.492588+0000","last_change":"2024-09-10T22:45:28.486455+0000","last_active":"2024-09-10T22:45:28.492588+0000","last_peered":"2024-09-10T22:45:28.492588+0000","last_clean":"2024-09-10T22:45:28.492588+0000","last_became_active":"2024-09-10T22:45:28.486063+0000","last_became_peered":"2024-09-10T22:45:28.486063+0000","last_unstale":"2024-09-10T22:45:28.492588+0000","last_undegraded":"2024-09-10T22:45:28.492588+0000","last_fullsized":"2024-09-10T22:45:28.492588+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:11.775979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"104'3","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.510785+0000","last_change":"2024-09-10T22:45:27.481754+0000","last_active":"2024-09-10T22:45:28.510785+0000","last_peered":"2024-09-10T22:45:28.510785+0000","last_clean":"2024-09-10T22:45:28.510785+0000","last_became_active":"2024-09-10T22:45:27.481468+0000","last_became_peered":"2024-09-10T22:45:27.481468+0000","last_unstale":"2024-09-10T22:45:28.510785+0000","last_undegraded":"2024-09-10T22:45:28.510785+0000","last_fullsized":"2024-09-10T22:45:28.510785+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:44.939156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.888417+0000","last_change":"2024-09-10T22:45:28.477677+0000","last_active":"2024-09-10T22:45:30.888417+0000","last_peered":"2024-09-10T22:45:30.888417+0000","last_clean":"2024-09-10T22:45:30.888417+0000","last_became_active":"2024-09-10T22:45:28.477157+0000","last_became_peered":"2024-09-10T22:45:28.477157+0000","last_unstale":"2024-09-10T22:45:30.888417+0000","last_undegraded":"2024-09-10T22:45:30.888417+0000","last_fullsized":"2024-09-10T22:45:30.888417+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:59:37.032271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"104'6","reported_seq":19,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.517433+0000","last_change":"2024-09-10T22:45:27.484306+0000","last_active":"2024-09-10T22:45:28.517433+0000","last_peered":"2024-09-10T22:45:28.517433+0000","last_clean":"2024-09-10T22:45:28.517433+0000","last_became_active":"2024-09-10T22:45:27.484039+0000","last_became_peered":"2024-09-10T22:45:27.484039+0000","last_unstale":"2024-09-10T22:45:28.517433+0000","last_undegraded":"2024-09-10T22:45:28.517433+0000","last_fullsized":"2024-09-10T22:45:28.517433+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:44.809352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.507582+0000","last_change":"2024-09-10T22:45:28.505482+0000","last_active":"2024-09-10T22:45:28.507582+0000","last_peered":"2024-09-10T22:45:28.507582+0000","last_clean":"2024-09-10T22:45:28.507582+0000","last_became_active":"2024-09-10T22:45:28.504844+0000","last_became_peered":"2024-09-10T22:45:28.504844+0000","last_unstale":"2024-09-10T22:45:28.507582+0000","last_undegraded":"2024-09-10T22:45:28.507582+0000","last_fullsized":"2024-09-10T22:45:28.507582+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:57.435890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"104'2","reported_seq":17,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.888431+0000","last_change":"2024-09-10T22:45:27.480267+0000","last_active":"2024-09-10T22:45:30.888431+0000","last_peered":"2024-09-10T22:45:30.888431+0000","last_clean":"2024-09-10T22:45:30.888431+0000","last_became_active":"2024-09-10T22:45:27.480012+0000","last_became_peered":"2024-09-10T22:45:27.480012+0000","last_unstale":"2024-09-10T22:45:30.888431+0000","last_undegraded":"2024-09-10T22:45:30.888431+0000","last_fullsized":"2024-09-10T22:45:30.888431+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:23:39.896962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.489639+0000","last_change":"2024-09-10T22:45:28.484959+0000","last_active":"2024-09-10T22:45:28.489639+0000","last_peered":"2024-09-10T22:45:28.489639+0000","last_clean":"2024-09-10T22:45:28.489639+0000","last_became_active":"2024-09-10T22:45:28.484703+0000","last_became_peered":"2024-09-10T22:45:28.484703+0000","last_unstale":"2024-09-10T22:45:28.489639+0000","last_undegraded":"2024-09-10T22:45:28.489639+0000","last_fullsized":"2024-09-10T22:45:28.489639+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:13:19.439264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.468131+0000","last_change":"2024-09-10T22:45:27.476121+0000","last_active":"2024-09-10T22:45:28.468131+0000","last_peered":"2024-09-10T22:45:28.468131+0000","last_clean":"2024-09-10T22:45:28.468131+0000","last_became_active":"2024-09-10T22:45:27.475904+0000","last_became_peered":"2024-09-10T22:45:27.475904+0000","last_unstale":"2024-09-10T22:45:28.468131+0000","last_undegraded":"2024-09-10T22:45:28.468131+0000","last_fullsized":"2024-09-10T22:45:28.468131+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:23.663757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.471427+0000","last_change":"2024-09-10T22:45:28.468968+0000","last_active":"2024-09-10T22:45:28.471427+0000","last_peered":"2024-09-10T22:45:28.471427+0000","last_clean":"2024-09-10T22:45:28.471427+0000","last_became_active":"2024-09-10T22:45:28.468638+0000","last_became_peered":"2024-09-10T22:45:28.468638+0000","last_unstale":"2024-09-10T22:45:28.471427+0000","last_undegraded":"2024-09-10T22:45:28.471427+0000","last_fullsized":"2024-09-10T22:45:28.471427+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:44.728731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.463539+0000","last_change":"2024-09-10T22:45:27.477173+0000","last_active":"2024-09-10T22:45:28.463539+0000","last_peered":"2024-09-10T22:45:28.463539+0000","last_clean":"2024-09-10T22:45:28.463539+0000","last_became_active":"2024-09-10T22:45:27.476553+0000","last_became_peered":"2024-09-10T22:45:27.476553+0000","last_unstale":"2024-09-10T22:45:28.463539+0000","last_undegraded":"2024-09-10T22:45:28.463539+0000","last_fullsized":"2024-09-10T22:45:28.463539+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:31.707144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.508641+0000","last_change":"2024-09-10T22:45:28.502727+0000","last_active":"2024-09-10T22:45:28.508641+0000","last_peered":"2024-09-10T22:45:28.508641+0000","last_clean":"2024-09-10T22:45:28.508641+0000","last_became_active":"2024-09-10T22:45:28.501274+0000","last_became_peered":"2024-09-10T22:45:28.501274+0000","last_unstale":"2024-09-10T22:45:28.508641+0000","last_undegraded":"2024-09-10T22:45:28.508641+0000","last_fullsized":"2024-09-10T22:45:28.508641+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:32.746952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"104'8","reported_seq":21,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.507617+0000","last_change":"2024-09-10T22:45:27.483081+0000","last_active":"2024-09-10T22:45:28.507617+0000","last_peered":"2024-09-10T22:45:28.507617+0000","last_clean":"2024-09-10T22:45:28.507617+0000","last_became_active":"2024-09-10T22:45:27.479934+0000","last_became_peered":"2024-09-10T22:45:27.479934+0000","last_unstale":"2024-09-10T22:45:28.507617+0000","last_undegraded":"2024-09-10T22:45:28.507617+0000","last_fullsized":"2024-09-10T22:45:28.507617+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:44.591551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.507687+0000","last_change":"2024-09-10T22:45:28.502480+0000","last_active":"2024-09-10T22:45:28.507687+0000","last_peered":"2024-09-10T22:45:28.507687+0000","last_clean":"2024-09-10T22:45:28.507687+0000","last_became_active":"2024-09-10T22:45:28.502216+0000","last_became_peered":"2024-09-10T22:45:28.502216+0000","last_unstale":"2024-09-10T22:45:28.507687+0000","last_undegraded":"2024-09-10T22:45:28.507687+0000","last_fullsized":"2024-09-10T22:45:28.507687+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:11.991796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"104'1","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.501450+0000","last_change":"2024-09-10T22:45:27.486191+0000","last_active":"2024-09-10T22:45:28.501450+0000","last_peered":"2024-09-10T22:45:28.501450+0000","last_clean":"2024-09-10T22:45:28.501450+0000","last_became_active":"2024-09-10T22:45:27.485132+0000","last_became_peered":"2024-09-10T22:45:27.485132+0000","last_unstale":"2024-09-10T22:45:28.501450+0000","last_undegraded":"2024-09-10T22:45:28.501450+0000","last_fullsized":"2024-09-10T22:45:28.501450+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:09.100230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.504796+0000","last_change":"2024-09-10T22:45:28.502224+0000","last_active":"2024-09-10T22:45:28.504796+0000","last_peered":"2024-09-10T22:45:28.504796+0000","last_clean":"2024-09-10T22:45:28.504796+0000","last_became_active":"2024-09-10T22:45:28.501961+0000","last_became_peered":"2024-09-10T22:45:28.501961+0000","last_unstale":"2024-09-10T22:45:28.504796+0000","last_undegraded":"2024-09-10T22:45:28.504796+0000","last_fullsized":"2024-09-10T22:45:28.504796+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:43:07.579451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"104'1","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.504897+0000","last_change":"2024-09-10T22:45:27.484040+0000","last_active":"2024-09-10T22:45:28.504897+0000","last_peered":"2024-09-10T22:45:28.504897+0000","last_clean":"2024-09-10T22:45:28.504897+0000","last_became_active":"2024-09-10T22:45:27.483683+0000","last_became_peered":"2024-09-10T22:45:27.483683+0000","last_unstale":"2024-09-10T22:45:28.504897+0000","last_undegraded":"2024-09-10T22:45:28.504897+0000","last_fullsized":"2024-09-10T22:45:28.504897+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:33.348128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.888319+0000","last_change":"2024-09-10T22:45:28.479371+0000","last_active":"2024-09-10T22:45:30.888319+0000","last_peered":"2024-09-10T22:45:30.888319+0000","last_clean":"2024-09-10T22:45:30.888319+0000","last_became_active":"2024-09-10T22:45:28.478796+0000","last_became_peered":"2024-09-10T22:45:28.478796+0000","last_unstale":"2024-09-10T22:45:30.888319+0000","last_undegraded":"2024-09-10T22:45:30.888319+0000","last_fullsized":"2024-09-10T22:45:30.888319+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:02:25.103888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.472107+0000","last_change":"2024-09-10T22:45:27.485639+0000","last_active":"2024-09-10T22:45:28.472107+0000","last_peered":"2024-09-10T22:45:28.472107+0000","last_clean":"2024-09-10T22:45:28.472107+0000","last_became_active":"2024-09-10T22:45:27.483957+0000","last_became_peered":"2024-09-10T22:45:27.483957+0000","last_unstale":"2024-09-10T22:45:28.472107+0000","last_undegraded":"2024-09-10T22:45:28.472107+0000","last_fullsized":"2024-09-10T22:45:28.472107+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:39.084340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.499463+0000","last_change":"2024-09-10T22:45:28.490519+0000","last_active":"2024-09-10T22:45:28.499463+0000","last_peered":"2024-09-10T22:45:28.499463+0000","last_clean":"2024-09-10T22:45:28.499463+0000","last_became_active":"2024-09-10T22:45:28.490252+0000","last_became_peered":"2024-09-10T22:45:28.490252+0000","last_unstale":"2024-09-10T22:45:28.499463+0000","last_undegraded":"2024-09-10T22:45:28.499463+0000","last_fullsized":"2024-09-10T22:45:28.499463+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:13.177380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"104'2","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.509338+0000","last_change":"2024-09-10T22:45:27.476922+0000","last_active":"2024-09-10T22:45:28.509338+0000","last_peered":"2024-09-10T22:45:28.509338+0000","last_clean":"2024-09-10T22:45:28.509338+0000","last_became_active":"2024-09-10T22:45:27.476630+0000","last_became_peered":"2024-09-10T22:45:27.476630+0000","last_unstale":"2024-09-10T22:45:28.509338+0000","last_undegraded":"2024-09-10T22:45:28.509338+0000","last_fullsized":"2024-09-10T22:45:28.509338+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:12.157762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.508442+0000","last_change":"2024-09-10T22:45:28.500721+0000","last_active":"2024-09-10T22:45:28.508442+0000","last_peered":"2024-09-10T22:45:28.508442+0000","last_clean":"2024-09-10T22:45:28.508442+0000","last_became_active":"2024-09-10T22:45:28.500278+0000","last_became_peered":"2024-09-10T22:45:28.500278+0000","last_unstale":"2024-09-10T22:45:28.508442+0000","last_undegraded":"2024-09-10T22:45:28.508442+0000","last_fullsized":"2024-09-10T22:45:28.508442+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:30:28.766298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.463408+0000","last_change":"2024-09-10T22:45:27.473235+0000","last_active":"2024-09-10T22:45:28.463408+0000","last_peered":"2024-09-10T22:45:28.463408+0000","last_clean":"2024-09-10T22:45:28.463408+0000","last_became_active":"2024-09-10T22:45:27.472995+0000","last_became_peered":"2024-09-10T22:45:27.472995+0000","last_unstale":"2024-09-10T22:45:28.463408+0000","last_undegraded":"2024-09-10T22:45:28.463408+0000","last_fullsized":"2024-09-10T22:45:28.463408+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:41:51.273887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.497116+0000","last_change":"2024-09-10T22:45:28.488573+0000","last_active":"2024-09-10T22:45:28.497116+0000","last_peered":"2024-09-10T22:45:28.497116+0000","last_clean":"2024-09-10T22:45:28.497116+0000","last_became_active":"2024-09-10T22:45:28.488258+0000","last_became_peered":"2024-09-10T22:45:28.488258+0000","last_unstale":"2024-09-10T22:45:28.497116+0000","last_undegraded":"2024-09-10T22:45:28.497116+0000","last_fullsized":"2024-09-10T22:45:28.497116+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:52.460919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.478734+0000","last_change":"2024-09-10T22:45:27.482696+0000","last_active":"2024-09-10T22:45:28.478734+0000","last_peered":"2024-09-10T22:45:28.478734+0000","last_clean":"2024-09-10T22:45:28.478734+0000","last_became_active":"2024-09-10T22:45:27.482410+0000","last_became_peered":"2024-09-10T22:45:27.482410+0000","last_unstale":"2024-09-10T22:45:28.478734+0000","last_undegraded":"2024-09-10T22:45:28.478734+0000","last_fullsized":"2024-09-10T22:45:28.478734+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:32.277554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.495924+0000","last_change":"2024-09-10T22:45:28.485970+0000","last_active":"2024-09-10T22:45:28.495924+0000","last_peered":"2024-09-10T22:45:28.495924+0000","last_clean":"2024-09-10T22:45:28.495924+0000","last_became_active":"2024-09-10T22:45:28.485653+0000","last_became_peered":"2024-09-10T22:45:28.485653+0000","last_unstale":"2024-09-10T22:45:28.495924+0000","last_undegraded":"2024-09-10T22:45:28.495924+0000","last_fullsized":"2024-09-10T22:45:28.495924+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:47.422042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.464174+0000","last_change":"2024-09-10T22:45:27.472399+0000","last_active":"2024-09-10T22:45:28.464174+0000","last_peered":"2024-09-10T22:45:28.464174+0000","last_clean":"2024-09-10T22:45:28.464174+0000","last_became_active":"2024-09-10T22:45:27.472146+0000","last_became_peered":"2024-09-10T22:45:27.472146+0000","last_unstale":"2024-09-10T22:45:28.464174+0000","last_undegraded":"2024-09-10T22:45:28.464174+0000","last_fullsized":"2024-09-10T22:45:28.464174+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:51.550385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.508481+0000","last_change":"2024-09-10T22:45:28.501026+0000","last_active":"2024-09-10T22:45:28.508481+0000","last_peered":"2024-09-10T22:45:28.508481+0000","last_clean":"2024-09-10T22:45:28.508481+0000","last_became_active":"2024-09-10T22:45:28.492025+0000","last_became_peered":"2024-09-10T22:45:28.492025+0000","last_unstale":"2024-09-10T22:45:28.508481+0000","last_undegraded":"2024-09-10T22:45:28.508481+0000","last_fullsized":"2024-09-10T22:45:28.508481+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:44.278096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"104'2","reported_seq":17,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.888506+0000","last_change":"2024-09-10T22:45:27.480293+0000","last_active":"2024-09-10T22:45:30.888506+0000","last_peered":"2024-09-10T22:45:30.888506+0000","last_clean":"2024-09-10T22:45:30.888506+0000","last_became_active":"2024-09-10T22:45:27.479192+0000","last_became_peered":"2024-09-10T22:45:27.479192+0000","last_unstale":"2024-09-10T22:45:30.888506+0000","last_undegraded":"2024-09-10T22:45:30.888506+0000","last_fullsized":"2024-09-10T22:45:30.888506+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:16.885487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.480260+0000","last_change":"2024-09-10T22:45:28.476747+0000","last_active":"2024-09-10T22:45:28.480260+0000","last_peered":"2024-09-10T22:45:28.480260+0000","last_clean":"2024-09-10T22:45:28.480260+0000","last_became_active":"2024-09-10T22:45:28.475277+0000","last_became_peered":"2024-09-10T22:45:28.475277+0000","last_unstale":"2024-09-10T22:45:28.480260+0000","last_undegraded":"2024-09-10T22:45:28.480260+0000","last_fullsized":"2024-09-10T22:45:28.480260+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:18.106895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.471332+0000","last_change":"2024-09-10T22:45:27.482149+0000","last_active":"2024-09-10T22:45:28.471332+0000","last_peered":"2024-09-10T22:45:28.471332+0000","last_clean":"2024-09-10T22:45:28.471332+0000","last_became_active":"2024-09-10T22:45:27.480562+0000","last_became_peered":"2024-09-10T22:45:27.480562+0000","last_unstale":"2024-09-10T22:45:28.471332+0000","last_undegraded":"2024-09-10T22:45:28.471332+0000","last_fullsized":"2024-09-10T22:45:28.471332+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:41.004419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.486909+0000","last_change":"2024-09-10T22:45:28.483238+0000","last_active":"2024-09-10T22:45:28.486909+0000","last_peered":"2024-09-10T22:45:28.486909+0000","last_clean":"2024-09-10T22:45:28.486909+0000","last_became_active":"2024-09-10T22:45:28.482946+0000","last_became_peered":"2024-09-10T22:45:28.482946+0000","last_unstale":"2024-09-10T22:45:28.486909+0000","last_undegraded":"2024-09-10T22:45:28.486909+0000","last_fullsized":"2024-09-10T22:45:28.486909+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:06:26.263054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.479211+0000","last_change":"2024-09-10T22:45:27.479540+0000","last_active":"2024-09-10T22:45:28.479211+0000","last_peered":"2024-09-10T22:45:28.479211+0000","last_clean":"2024-09-10T22:45:28.479211+0000","last_became_active":"2024-09-10T22:45:27.478041+0000","last_became_peered":"2024-09-10T22:45:27.478041+0000","last_unstale":"2024-09-10T22:45:28.479211+0000","last_undegraded":"2024-09-10T22:45:28.479211+0000","last_fullsized":"2024-09-10T22:45:28.479211+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:30.721819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.491831+0000","last_change":"2024-09-10T22:45:28.487455+0000","last_active":"2024-09-10T22:45:28.491831+0000","last_peered":"2024-09-10T22:45:28.491831+0000","last_clean":"2024-09-10T22:45:28.491831+0000","last_became_active":"2024-09-10T22:45:28.487064+0000","last_became_peered":"2024-09-10T22:45:28.487064+0000","last_unstale":"2024-09-10T22:45:28.491831+0000","last_undegraded":"2024-09-10T22:45:28.491831+0000","last_fullsized":"2024-09-10T22:45:28.491831+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:31.979693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-10T22:45:30.888824+0000","last_change":"2024-09-10T22:45:27.484900+0000","last_active":"2024-09-10T22:45:30.888824+0000","last_peered":"2024-09-10T22:45:30.888824+0000","last_clean":"2024-09-10T22:45:30.888824+0000","last_became_active":"2024-09-10T22:45:27.484631+0000","last_became_peered":"2024-09-10T22:45:27.484631+0000","last_unstale":"2024-09-10T22:45:30.888824+0000","last_undegraded":"2024-09-10T22:45:30.888824+0000","last_fullsized":"2024-09-10T22:45:30.888824+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:50.051323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.483498+0000","last_change":"2024-09-10T22:45:28.477685+0000","last_active":"2024-09-10T22:45:28.483498+0000","last_peered":"2024-09-10T22:45:28.483498+0000","last_clean":"2024-09-10T22:45:28.483498+0000","last_became_active":"2024-09-10T22:45:28.477426+0000","last_became_peered":"2024-09-10T22:45:28.477426+0000","last_unstale":"2024-09-10T22:45:28.483498+0000","last_undegraded":"2024-09-10T22:45:28.483498+0000","last_fullsized":"2024-09-10T22:45:28.483498+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:38.156932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.468572+0000","last_change":"2024-09-10T22:45:27.478764+0000","last_active":"2024-09-10T22:45:28.468572+0000","last_peered":"2024-09-10T22:45:28.468572+0000","last_clean":"2024-09-10T22:45:28.468572+0000","last_became_active":"2024-09-10T22:45:27.478510+0000","last_became_peered":"2024-09-10T22:45:27.478510+0000","last_unstale":"2024-09-10T22:45:28.468572+0000","last_undegraded":"2024-09-10T22:45:28.468572+0000","last_fullsized":"2024-09-10T22:45:28.468572+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:37.236881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.493105+0000","last_change":"2024-09-10T22:45:28.486883+0000","last_active":"2024-09-10T22:45:28.493105+0000","last_peered":"2024-09-10T22:45:28.493105+0000","last_clean":"2024-09-10T22:45:28.493105+0000","last_became_active":"2024-09-10T22:45:28.486639+0000","last_became_peered":"2024-09-10T22:45:28.486639+0000","last_unstale":"2024-09-10T22:45:28.493105+0000","last_undegraded":"2024-09-10T22:45:28.493105+0000","last_fullsized":"2024-09-10T22:45:28.493105+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:59.997959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.463651+0000","last_change":"2024-09-10T22:45:27.475182+0000","last_active":"2024-09-10T22:45:28.463651+0000","last_peered":"2024-09-10T22:45:28.463651+0000","last_clean":"2024-09-10T22:45:28.463651+0000","last_became_active":"2024-09-10T22:45:27.474736+0000","last_became_peered":"2024-09-10T22:45:27.474736+0000","last_unstale":"2024-09-10T22:45:28.463651+0000","last_undegraded":"2024-09-10T22:45:28.463651+0000","last_fullsized":"2024-09-10T22:45:28.463651+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:25.135572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.491691+0000","last_change":"2024-09-10T22:45:28.489632+0000","last_active":"2024-09-10T22:45:28.491691+0000","last_peered":"2024-09-10T22:45:28.491691+0000","last_clean":"2024-09-10T22:45:28.491691+0000","last_became_active":"2024-09-10T22:45:28.489031+0000","last_became_peered":"2024-09-10T22:45:28.489031+0000","last_unstale":"2024-09-10T22:45:28.491691+0000","last_undegraded":"2024-09-10T22:45:28.491691+0000","last_fullsized":"2024-09-10T22:45:28.491691+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:56.780870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.478940+0000","last_change":"2024-09-10T22:45:27.477649+0000","last_active":"2024-09-10T22:45:28.478940+0000","last_peered":"2024-09-10T22:45:28.478940+0000","last_clean":"2024-09-10T22:45:28.478940+0000","last_became_active":"2024-09-10T22:45:27.477395+0000","last_became_peered":"2024-09-10T22:45:27.477395+0000","last_unstale":"2024-09-10T22:45:28.478940+0000","last_undegraded":"2024-09-10T22:45:28.478940+0000","last_fullsized":"2024-09-10T22:45:28.478940+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:12.025390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.485153+0000","last_change":"2024-09-10T22:45:28.480731+0000","last_active":"2024-09-10T22:45:28.485153+0000","last_peered":"2024-09-10T22:45:28.485153+0000","last_clean":"2024-09-10T22:45:28.485153+0000","last_became_active":"2024-09-10T22:45:28.480407+0000","last_became_peered":"2024-09-10T22:45:28.480407+0000","last_unstale":"2024-09-10T22:45:28.485153+0000","last_undegraded":"2024-09-10T22:45:28.485153+0000","last_fullsized":"2024-09-10T22:45:28.485153+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:38.244336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.464294+0000","last_change":"2024-09-10T22:45:27.477068+0000","last_active":"2024-09-10T22:45:28.464294+0000","last_peered":"2024-09-10T22:45:28.464294+0000","last_clean":"2024-09-10T22:45:28.464294+0000","last_became_active":"2024-09-10T22:45:27.476442+0000","last_became_peered":"2024-09-10T22:45:27.476442+0000","last_unstale":"2024-09-10T22:45:28.464294+0000","last_undegraded":"2024-09-10T22:45:28.464294+0000","last_fullsized":"2024-09-10T22:45:28.464294+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:01.070870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.506486+0000","last_change":"2024-09-10T22:45:28.503779+0000","last_active":"2024-09-10T22:45:28.506486+0000","last_peered":"2024-09-10T22:45:28.506486+0000","last_clean":"2024-09-10T22:45:28.506486+0000","last_became_active":"2024-09-10T22:45:28.503472+0000","last_became_peered":"2024-09-10T22:45:28.503472+0000","last_unstale":"2024-09-10T22:45:28.506486+0000","last_undegraded":"2024-09-10T22:45:28.506486+0000","last_fullsized":"2024-09-10T22:45:28.506486+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:27.451497+0000","last_clean_scrub_stamp":"2024-09-10T22:45:27.451497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:18.106895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"104'2","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.500105+0000","last_change":"2024-09-10T22:45:27.472450+0000","last_active":"2024-09-10T22:45:28.500105+0000","last_peered":"2024-09-10T22:45:28.500105+0000","last_clean":"2024-09-10T22:45:28.500105+0000","last_became_active":"2024-09-10T22:45:27.472185+0000","last_became_peered":"2024-09-10T22:45:27.472185+0000","last_unstale":"2024-09-10T22:45:28.500105+0000","last_undegraded":"2024-09-10T22:45:28.500105+0000","last_fullsized":"2024-09-10T22:45:28.500105+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:45:26.444042+0000","last_clean_scrub_stamp":"2024-09-10T22:45:26.444042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:44.343501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":263,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-10T22:45:28.474546+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:45:28.474546+0000","last_peered":"2024-09-10T22:45:28.474546+0000","last_clean":"2024-09-10T22:45:28.474546+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:45:28.474546+0000","last_undegraded":"2024-09-10T22:45:28.474546+0000","last_fullsized":"2024-09-10T22:45:28.474546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509525,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":1185437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509525,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1269760,"data_stored":587742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509526,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1282048,"data_stored":594909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509525,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1269760,"data_stored":587742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509525,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1286144,"data_stored":595491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509525,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1286144,"data_stored":594943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509525,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33008,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338832,"statfs":{"total":96636764160,"available":96602963968,"internally_reserved":0,"allocated":1863680,"data_stored":1178110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1286144,"data_stored":594943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:45:32.967 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T22:45:32.967 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T22:45:33.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78c600640 1 -- 172.21.15.103:0/2765414474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa784161320 msgr2=0x7fa784073940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:33.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78c600640 1 --2- 172.21.15.103:0/2765414474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa784161320 0x7fa784073940 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa778009900 tx=0x7fa77801c8e0 comp rx=0 tx=0).stop 2024-09-10T22:45:33.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78c600640 1 -- 172.21.15.103:0/2765414474 shutdown_connections 2024-09-10T22:45:33.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78c600640 1 --2- 172.21.15.103:0/2765414474 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7840b4d30 0x7fa78406cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:33.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78c600640 1 --2- 172.21.15.103:0/2765414474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa784161320 0x7fa784073940 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:33.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78c600640 1 -- 172.21.15.103:0/2765414474 >> 172.21.15.103:0/2765414474 conn(0x7fa7840b2d70 msgr2=0x7fa7840d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:33.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78c600640 1 -- 172.21.15.103:0/2765414474 shutdown_connections 2024-09-10T22:45:33.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78c600640 1 -- 172.21.15.103:0/2765414474 wait complete. 2024-09-10T22:45:33.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78c600640 1 Processor -- start 2024-09-10T22:45:33.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78c600640 1 -- start start 2024-09-10T22:45:33.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78c600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa784074290 0x7fa78415cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:33.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78c600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7840b4d30 0x7fa784148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:33.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78c600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa784161320 0x7fa7840ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:33.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78c600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa78416b1d0 con 0x7fa784161320 2024-09-10T22:45:33.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78c600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa78416b050 con 0x7fa7840b4d30 2024-09-10T22:45:33.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78c600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa78416b350 con 0x7fa784074290 2024-09-10T22:45:33.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78a600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa784161320 0x7fa7840ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:33.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78a600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa784161320 0x7fa7840ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41104/0 (socket says 172.21.15.103:41104) 2024-09-10T22:45:33.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78a600640 1 -- 172.21.15.103:0/3762750964 learned_addr learned my addr 172.21.15.103:0/3762750964 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:33.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa789c00640 1 --2- 172.21.15.103:0/3762750964 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa784074290 0x7fa78415cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:33.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa789200640 1 --2- 172.21.15.103:0/3762750964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7840b4d30 0x7fa784148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:33.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78a600640 1 -- 172.21.15.103:0/3762750964 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa784074290 msgr2=0x7fa78415cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:33.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78a600640 1 --2- 172.21.15.103:0/3762750964 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa784074290 0x7fa78415cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:33.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78a600640 1 -- 172.21.15.103:0/3762750964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7840b4d30 msgr2=0x7fa784148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:33.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78a600640 1 --2- 172.21.15.103:0/3762750964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7840b4d30 0x7fa784148450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:33.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78a600640 1 -- 172.21.15.103:0/3762750964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7841faf70 con 0x7fa784161320 2024-09-10T22:45:33.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa789200640 1 --2- 172.21.15.103:0/3762750964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7840b4d30 0x7fa784148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:33.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa789c00640 1 --2- 172.21.15.103:0/3762750964 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa784074290 0x7fa78415cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:33.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.153+0000 7fa78a600640 1 --2- 172.21.15.103:0/3762750964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa784161320 0x7fa7840ad860 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00c780 tx=0x7fa77c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:33.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.157+0000 7fa781600640 1 -- 172.21.15.103:0/3762750964 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c004b70 con 0x7fa784161320 2024-09-10T22:45:33.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.157+0000 7fa781600640 1 -- 172.21.15.103:0/3762750964 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa77c004e00 con 0x7fa784161320 2024-09-10T22:45:33.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.157+0000 7fa781600640 1 -- 172.21.15.103:0/3762750964 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c00aa90 con 0x7fa784161320 2024-09-10T22:45:33.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.157+0000 7fa78c600640 1 -- 172.21.15.103:0/3762750964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7841fb210 con 0x7fa784161320 2024-09-10T22:45:33.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.157+0000 7fa78c600640 1 -- 172.21.15.103:0/3762750964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7841fb7d0 con 0x7fa784161320 2024-09-10T22:45:33.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.157+0000 7fa78c600640 1 -- 172.21.15.103:0/3762750964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa78406cc00 con 0x7fa784161320 2024-09-10T22:45:33.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.157+0000 7fa781600640 1 -- 172.21.15.103:0/3762750964 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa77c00ac30 con 0x7fa784161320 2024-09-10T22:45:33.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.157+0000 7fa781600640 1 --2- 172.21.15.103:0/3762750964 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa7640725e0 0x7fa764074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:33.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.157+0000 7fa781600640 1 -- 172.21.15.103:0/3762750964 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 6188+0+0 (secure 0 0 0) 0x7fa77c0937c0 con 0x7fa784161320 2024-09-10T22:45:33.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.157+0000 7fa789c00640 1 --2- 172.21.15.103:0/3762750964 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa7640725e0 0x7fa764074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:33.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.161+0000 7fa789c00640 1 --2- 172.21.15.103:0/3762750964 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa7640725e0 0x7fa764074aa0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa7780af000 tx=0x7fa77801b120 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:33.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.161+0000 7fa781600640 1 -- 172.21.15.103:0/3762750964 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa77c020070 con 0x7fa784161320 2024-09-10T22:45:33.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.385+0000 7fa78c600640 1 -- 172.21.15.103:0/3762750964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa7840ce940 con 0x7fa784161320 2024-09-10T22:45:33.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.389+0000 7fa781600640 1 -- 172.21.15.103:0/3762750964 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7fa77c05ec20 con 0x7fa784161320 2024-09-10T22:45:33.392 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-09-10T22:45:33.392 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA8yuBmtOhZNBAAeszxWpV60NIn/zOInT5Zzw== 2024-09-10T22:45:33.392 INFO:teuthology.orchestra.run.smithi103.stdout: caps mds = "allow" 2024-09-10T22:45:33.392 INFO:teuthology.orchestra.run.smithi103.stdout: caps mon = "allow r" 2024-09-10T22:45:33.392 INFO:teuthology.orchestra.run.smithi103.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T22:45:33.392 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2024-09-10T22:45:33.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.389+0000 7fa78c600640 1 -- 172.21.15.103:0/3762750964 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa7640725e0 msgr2=0x7fa764074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:33.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.389+0000 7fa78c600640 1 --2- 172.21.15.103:0/3762750964 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa7640725e0 0x7fa764074aa0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa7780af000 tx=0x7fa77801b120 comp rx=0 tx=0).stop 2024-09-10T22:45:33.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.389+0000 7fa78c600640 1 -- 172.21.15.103:0/3762750964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa784161320 msgr2=0x7fa7840ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:33.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.389+0000 7fa78c600640 1 --2- 172.21.15.103:0/3762750964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa784161320 0x7fa7840ad860 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00c780 tx=0x7fa77c00cc40 comp rx=0 tx=0).stop 2024-09-10T22:45:33.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.389+0000 7fa78c600640 1 -- 172.21.15.103:0/3762750964 shutdown_connections 2024-09-10T22:45:33.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.389+0000 7fa78c600640 1 --2- 172.21.15.103:0/3762750964 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa7640725e0 0x7fa764074aa0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:33.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.389+0000 7fa78c600640 1 --2- 172.21.15.103:0/3762750964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa784161320 0x7fa7840ad860 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:33.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.389+0000 7fa78c600640 1 --2- 172.21.15.103:0/3762750964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7840b4d30 0x7fa784148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:33.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.389+0000 7fa78c600640 1 --2- 172.21.15.103:0/3762750964 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa784074290 0x7fa78415cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:33.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.389+0000 7fa78c600640 1 -- 172.21.15.103:0/3762750964 >> 172.21.15.103:0/3762750964 conn(0x7fa7840b2d70 msgr2=0x7fa78406dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:33.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.389+0000 7fa78c600640 1 -- 172.21.15.103:0/3762750964 shutdown_connections 2024-09-10T22:45:33.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.389+0000 7fa78c600640 1 -- 172.21.15.103:0/3762750964 wait complete. 2024-09-10T22:45:33.413 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:45:33.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.557+0000 7f4325c00640 1 -- 172.21.15.103:0/2593236997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4304004810 msgr2=0x7f4304004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:33.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.557+0000 7f4325c00640 1 --2- 172.21.15.103:0/2593236997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4304004810 0x7f4304004c90 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f430c006fd0 tx=0x7f430c01f6a0 comp rx=0 tx=0).stop 2024-09-10T22:45:33.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.557+0000 7f431f400640 1 -- 172.21.15.103:0/2593236997 reap_dead start 2024-09-10T22:45:33.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.557+0000 7f4325c00640 1 -- 172.21.15.103:0/2593236997 shutdown_connections 2024-09-10T22:45:33.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.557+0000 7f4325c00640 1 -- 172.21.15.103:0/2593236997 >> 172.21.15.103:0/2593236997 conn(0x7f43200cd420 msgr2=0x7f43200cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:33.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.557+0000 7f4325c00640 1 -- 172.21.15.103:0/2593236997 shutdown_connections 2024-09-10T22:45:33.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.557+0000 7f4325c00640 1 -- 172.21.15.103:0/2593236997 wait complete. 2024-09-10T22:45:33.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.557+0000 7f4325c00640 1 Processor -- start 2024-09-10T22:45:33.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.557+0000 7f4325c00640 1 -- start start 2024-09-10T22:45:33.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f4325c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4304004810 0x7f4320147a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:33.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f4325c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43200c7a70 0x7f43201f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:33.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f4325c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43201f3d90 0x7f43201f4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:33.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f4325c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4320163970 con 0x7f43201f3d90 2024-09-10T22:45:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f4325c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f43200d0600 con 0x7f4304004810 2024-09-10T22:45:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f4325c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4320163af0 con 0x7f43200c7a70 2024-09-10T22:45:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f431f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43201f3d90 0x7f43201f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f431f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43201f3d90 0x7f43201f4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41128/0 (socket says 172.21.15.103:41128) 2024-09-10T22:45:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f431f400640 1 -- 172.21.15.103:0/2914195782 learned_addr learned my addr 172.21.15.103:0/2914195782 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f431e000640 1 --2- 172.21.15.103:0/2914195782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43200c7a70 0x7f43201f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f431ea00640 1 --2- 172.21.15.103:0/2914195782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4304004810 0x7f4320147a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f431f400640 1 -- 172.21.15.103:0/2914195782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43200c7a70 msgr2=0x7f43201f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f431f400640 1 --2- 172.21.15.103:0/2914195782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43200c7a70 0x7f43201f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f431f400640 1 -- 172.21.15.103:0/2914195782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4304004810 msgr2=0x7f4320147a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f431f400640 1 --2- 172.21.15.103:0/2914195782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4304004810 0x7f4320147a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f431f400640 1 -- 172.21.15.103:0/2914195782 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43201f4780 con 0x7f43201f3d90 2024-09-10T22:45:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f431f400640 1 --2- 172.21.15.103:0/2914195782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43201f3d90 0x7f43201f4240 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f43200742e0 tx=0x7f431800fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f4316a00640 1 -- 172.21.15.103:0/2914195782 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318011910 con 0x7f43201f3d90 2024-09-10T22:45:33.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f4316a00640 1 -- 172.21.15.103:0/2914195782 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4318011ba0 con 0x7f43201f3d90 2024-09-10T22:45:33.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f4316a00640 1 -- 172.21.15.103:0/2914195782 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318010430 con 0x7f43201f3d90 2024-09-10T22:45:33.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f4325c00640 1 -- 172.21.15.103:0/2914195782 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43200ca350 con 0x7f43201f3d90 2024-09-10T22:45:33.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f4325c00640 1 -- 172.21.15.103:0/2914195782 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43200ca910 con 0x7f43201f3d90 2024-09-10T22:45:33.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.561+0000 7f4325c00640 1 -- 172.21.15.103:0/2914195782 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43200cab10 con 0x7f43201f3d90 2024-09-10T22:45:33.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.565+0000 7f4316a00640 1 -- 172.21.15.103:0/2914195782 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f43180105d0 con 0x7f43201f3d90 2024-09-10T22:45:33.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.565+0000 7f4316a00640 1 --2- 172.21.15.103:0/2914195782 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f43000725e0 0x7f4300074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:33.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.565+0000 7f4316a00640 1 -- 172.21.15.103:0/2914195782 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f4318093ab0 con 0x7f43201f3d90 2024-09-10T22:45:33.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.565+0000 7f431ea00640 1 --2- 172.21.15.103:0/2914195782 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f43000725e0 0x7f4300074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:33.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.565+0000 7f431ea00640 1 --2- 172.21.15.103:0/2914195782 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f43000725e0 0x7f4300074aa0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4320152bd0 tx=0x7f4310006f00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:33.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.569+0000 7f4316a00640 1 -- 172.21.15.103:0/2914195782 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f43200cab10 con 0x7f43201f3d90 2024-09-10T22:45:33.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.769+0000 7f4325c00640 1 -- 172.21.15.103:0/2914195782 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f432006ff40 con 0x7f43201f3d90 2024-09-10T22:45:33.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.769+0000 7f4316a00640 1 -- 172.21.15.103:0/2914195782 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5240 (secure 0 0 0) 0x7f4318022020 con 0x7f43201f3d90 2024-09-10T22:45:33.773 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:33.773 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":107,"btime":"2024-09-10T22:45:31:483183+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7717,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":8235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:45:30.865944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238]},"id":7}]} 2024-09-10T22:45:33.774 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 107 2024-09-10T22:45:33.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.769+0000 7f4325c00640 1 -- 172.21.15.103:0/2914195782 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f43000725e0 msgr2=0x7f4300074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:33.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.769+0000 7f4325c00640 1 --2- 172.21.15.103:0/2914195782 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f43000725e0 0x7f4300074aa0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4320152bd0 tx=0x7f4310006f00 comp rx=0 tx=0).stop 2024-09-10T22:45:33.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.769+0000 7f4325c00640 1 -- 172.21.15.103:0/2914195782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43201f3d90 msgr2=0x7f43201f4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:33.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.769+0000 7f4325c00640 1 --2- 172.21.15.103:0/2914195782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43201f3d90 0x7f43201f4240 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f43200742e0 tx=0x7f431800fa20 comp rx=0 tx=0).stop 2024-09-10T22:45:33.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.769+0000 7f4325c00640 1 -- 172.21.15.103:0/2914195782 shutdown_connections 2024-09-10T22:45:33.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.769+0000 7f4325c00640 1 --2- 172.21.15.103:0/2914195782 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f43000725e0 0x7f4300074aa0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:33.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.769+0000 7f4325c00640 1 --2- 172.21.15.103:0/2914195782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43201f3d90 0x7f43201f4240 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:33.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.769+0000 7f4325c00640 1 --2- 172.21.15.103:0/2914195782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43200c7a70 0x7f43201f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:33.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.769+0000 7f4325c00640 1 --2- 172.21.15.103:0/2914195782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4304004810 0x7f4320147a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:33.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.769+0000 7f4325c00640 1 -- 172.21.15.103:0/2914195782 >> 172.21.15.103:0/2914195782 conn(0x7f43200cd420 msgr2=0x7f432015eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:33.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.773+0000 7f4325c00640 1 -- 172.21.15.103:0/2914195782 shutdown_connections 2024-09-10T22:45:33.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:33.773+0000 7f4325c00640 1 -- 172.21.15.103:0/2914195782 wait complete. 2024-09-10T22:45:34.197 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 107, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:45:27.857904+0000', 'modified': '2024-09-10T22:45:30.865944+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8238}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8238': {'gid': 8238, 'name': 'c', 'rank': 0, 'incarnation': 104, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/3550082240', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6834', 'nonce': 3550082240}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 3550082240}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8238, 'qdb_cluster': [8238]} 2024-09-10T22:45:34.197 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T22:45:34.197 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T22:45:34.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.337+0000 7f13cec00640 1 -- 172.21.15.103:0/843829181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13ac004d50 msgr2=0x7f13ac0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:34.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.337+0000 7f13cec00640 1 --2- 172.21.15.103:0/843829181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13ac004d50 0x7f13ac0051d0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f13c000c640 tx=0x7f13c001d2d0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.337+0000 7f13ccc00640 1 -- 172.21.15.103:0/843829181 reap_dead start 2024-09-10T22:45:34.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.337+0000 7f13cec00640 1 -- 172.21.15.103:0/843829181 shutdown_connections 2024-09-10T22:45:34.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.337+0000 7f13cec00640 1 -- 172.21.15.103:0/843829181 >> 172.21.15.103:0/843829181 conn(0x7f13c80d1ad0 msgr2=0x7f13c80d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:34.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.337+0000 7f13cec00640 1 -- 172.21.15.103:0/843829181 shutdown_connections 2024-09-10T22:45:34.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.337+0000 7f13cec00640 1 -- 172.21.15.103:0/843829181 wait complete. 2024-09-10T22:45:34.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13cec00640 1 Processor -- start 2024-09-10T22:45:34.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13cec00640 1 -- start start 2024-09-10T22:45:34.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13cec00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13ac004d50 0x7f13c80b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13cec00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13c815d0d0 0x7f13c815c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13cec00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13c80b23e0 0x7f13c80b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13cec00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f13c8166b00 con 0x7f13c815d0d0 2024-09-10T22:45:34.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13cec00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f13c8166980 con 0x7f13c80b23e0 2024-09-10T22:45:34.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13cec00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f13c8166c80 con 0x7f13ac004d50 2024-09-10T22:45:34.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13c7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13c815d0d0 0x7f13c815c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13c7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13c815d0d0 0x7f13c815c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41146/0 (socket says 172.21.15.103:41146) 2024-09-10T22:45:34.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13c7400640 1 -- 172.21.15.103:0/926576257 learned_addr learned my addr 172.21.15.103:0/926576257 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:34.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13c7e00640 1 --2- 172.21.15.103:0/926576257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13ac004d50 0x7f13c80b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13ccc00640 1 --2- 172.21.15.103:0/926576257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13c80b23e0 0x7f13c80b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13c7400640 1 -- 172.21.15.103:0/926576257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13ac004d50 msgr2=0x7f13c80b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:34.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13c7400640 1 --2- 172.21.15.103:0/926576257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13ac004d50 0x7f13c80b3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13c7400640 1 -- 172.21.15.103:0/926576257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13c80b23e0 msgr2=0x7f13c80b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:34.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13c7400640 1 --2- 172.21.15.103:0/926576257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13c80b23e0 0x7f13c80b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13c7400640 1 -- 172.21.15.103:0/926576257 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c815ced0 con 0x7f13c815d0d0 2024-09-10T22:45:34.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13ccc00640 1 --2- 172.21.15.103:0/926576257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13c80b23e0 0x7f13c80b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:34.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13c7400640 1 --2- 172.21.15.103:0/926576257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13c815d0d0 0x7f13c815c990 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f13b4011a50 tx=0x7f13b4011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:34.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13bfe00640 1 -- 172.21.15.103:0/926576257 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b401f070 con 0x7f13c815d0d0 2024-09-10T22:45:34.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13bfe00640 1 -- 172.21.15.103:0/926576257 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13b4012450 con 0x7f13c815d0d0 2024-09-10T22:45:34.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13bfe00640 1 -- 172.21.15.103:0/926576257 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4012820 con 0x7f13c815d0d0 2024-09-10T22:45:34.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13cec00640 1 -- 172.21.15.103:0/926576257 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c80c8510 con 0x7f13c815d0d0 2024-09-10T22:45:34.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.341+0000 7f13cec00640 1 -- 172.21.15.103:0/926576257 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c80c8230 con 0x7f13c815d0d0 2024-09-10T22:45:34.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13bfe00640 1 -- 172.21.15.103:0/926576257 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f13b40129c0 con 0x7f13c815d0d0 2024-09-10T22:45:34.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13bfe00640 1 --2- 172.21.15.103:0/926576257 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f13a8072610 0x7f13a8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13bfe00640 1 -- 172.21.15.103:0/926576257 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f13b40942d0 con 0x7f13c815d0d0 2024-09-10T22:45:34.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13d1f80000 1 Processor -- start 2024-09-10T22:45:34.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13c7e00640 1 --2- 172.21.15.103:0/926576257 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f13a8072610 0x7f13a8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13d1f80000 1 -- start start 2024-09-10T22:45:34.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13c7e00640 1 --2- 172.21.15.103:0/926576257 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f13a8072610 0x7f13a8074ad0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f13b8009c60 tx=0x7f13b80091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:34.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13d1f80000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d4269d0 0x56363d426db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13d1f80000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 0x56363d3da8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13d1f80000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d3dae10 0x56363d3db1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13d1f80000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56363d2fb3f0 con 0x56363d4272f0 2024-09-10T22:45:34.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13d1f80000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56363d238b20 con 0x56363d3dae10 2024-09-10T22:45:34.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13d1f80000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56363d227f50 con 0x56363d4269d0 2024-09-10T22:45:34.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13c7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 0x56363d3da8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13c7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 0x56363d3da8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41158/0 (socket says 172.21.15.103:41158) 2024-09-10T22:45:34.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13c7400640 1 -- 172.21.15.103:0/3063239002 learned_addr learned my addr 172.21.15.103:0/3063239002 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:34.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13c7e00640 1 --2- 172.21.15.103:0/3063239002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d4269d0 0x56363d426db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13ccc00640 1 --2- 172.21.15.103:0/3063239002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d3dae10 0x56363d3db1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13c7400640 1 -- 172.21.15.103:0/3063239002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d4269d0 msgr2=0x56363d426db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:34.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13c7400640 1 --2- 172.21.15.103:0/3063239002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d4269d0 0x56363d426db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13c7400640 1 -- 172.21.15.103:0/3063239002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d3dae10 msgr2=0x56363d3db1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:34.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13c7400640 1 --2- 172.21.15.103:0/3063239002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d3dae10 0x56363d3db1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13c7400640 1 -- 172.21.15.103:0/3063239002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56363d1ef590 con 0x56363d4272f0 2024-09-10T22:45:34.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.345+0000 7f13c7400640 1 --2- 172.21.15.103:0/3063239002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 0x56363d3da8d0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f13b400f730 tx=0x7f13b405f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4503df8a6e83caed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:34.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13bcc00640 1 -- 172.21.15.103:0/3063239002 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b40940c0 con 0x56363d4272f0 2024-09-10T22:45:34.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13bcc00640 1 -- 172.21.15.103:0/3063239002 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13b40660d0 con 0x56363d4272f0 2024-09-10T22:45:34.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13bcc00640 1 -- 172.21.15.103:0/3063239002 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4063ba0 con 0x56363d4272f0 2024-09-10T22:45:34.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 1 -- 172.21.15.103:0/3063239002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 msgr2=0x56363d3da8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 1 --2- 172.21.15.103:0/3063239002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 0x56363d3da8d0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f13b400f730 tx=0x7f13b405f070 comp rx=0 tx=0).stop 2024-09-10T22:45:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 1 -- 172.21.15.103:0/3063239002 shutdown_connections 2024-09-10T22:45:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 1 --2- 172.21.15.103:0/3063239002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d3dae10 0x56363d3db1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 1 --2- 172.21.15.103:0/3063239002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 0x56363d3da8d0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 1 --2- 172.21.15.103:0/3063239002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d4269d0 0x56363d426db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 1 -- 172.21.15.103:0/3063239002 >> 172.21.15.103:0/3063239002 conn(0x56363d2c4130 msgr2=0x56363d409e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:34.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 1 -- 172.21.15.103:0/3063239002 shutdown_connections 2024-09-10T22:45:34.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 1 -- 172.21.15.103:0/3063239002 wait complete. 2024-09-10T22:45:34.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 1 -- start start 2024-09-10T22:45:34.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 1 Processor -- start 2024-09-10T22:45:34.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d3dae10 0x56363d4076a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d4269d0 0x56363d407e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 0x56363d4083b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56363d1c25d0 con 0x56363d4272f0 2024-09-10T22:45:34.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56363d22bd60 con 0x56363d4269d0 2024-09-10T22:45:34.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56363d1ce500 con 0x56363d3dae10 2024-09-10T22:45:34.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 10 client.0 _ll_register_callbacks cb 0x56363d1d2810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:34.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13ccc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 0x56363d4083b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13ccc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 0x56363d4083b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41162/0 (socket says 172.21.15.103:41162) 2024-09-10T22:45:34.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13ccc00640 1 -- 172.21.15.103:0/365091519 learned_addr learned my addr 172.21.15.103:0/365091519 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:34.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13c7e00640 1 --2- 172.21.15.103:0/365091519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d3dae10 0x56363d4076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13c7400640 1 --2- 172.21.15.103:0/365091519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d4269d0 0x56363d407e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13ccc00640 1 -- 172.21.15.103:0/365091519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d3dae10 msgr2=0x56363d4076a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:34.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13ccc00640 1 --2- 172.21.15.103:0/365091519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d3dae10 0x56363d4076a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13ccc00640 1 -- 172.21.15.103:0/365091519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d4269d0 msgr2=0x56363d407e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:34.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13ccc00640 1 --2- 172.21.15.103:0/365091519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d4269d0 0x56363d407e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13ccc00640 1 -- 172.21.15.103:0/365091519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56363d1c6170 con 0x56363d4272f0 2024-09-10T22:45:34.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13ccc00640 1 --2- 172.21.15.103:0/365091519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 0x56363d4083b0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f13c000c640 tx=0x7f13c00013b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fca44dcd1b5b334 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13b1600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13b1600640 1 -- 172.21.15.103:0/365091519 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0002040 con 0x56363d4272f0 2024-09-10T22:45:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13b1600640 1 -- 172.21.15.103:0/365091519 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f13c00bab70 con 0x56363d4272f0 2024-09-10T22:45:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.349+0000 7f13d1f80000 1 -- 172.21.15.103:0/365091519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56363d1c00f0 con 0x56363d4272f0 2024-09-10T22:45:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13b1600640 1 -- 172.21.15.103:0/365091519 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7f13c00bad70 con 0x56363d4272f0 2024-09-10T22:45:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 10 client.8346 fetch_fsmap learned FSMap version 107 2024-09-10T22:45:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 1 -- 172.21.15.103:0/365091519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x56363d2acef0 con 0x56363d4272f0 2024-09-10T22:45:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13b1600640 1 -- 172.21.15.103:0/365091519 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56363d1c00f0 con 0x56363d4272f0 2024-09-10T22:45:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13b1600640 1 -- 172.21.15.103:0/365091519 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7f13c00bb020 con 0x56363d4272f0 2024-09-10T22:45:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 10 client.8346 fetch_fsmap finished waiting for FSMap version 107 2024-09-10T22:45:34.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 10 client.8346 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:45:34.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 20 client.8346 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:34.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 1 --2- 172.21.15.103:0/365091519 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56363d4090f0 0x56363d438c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 4 client.8346 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:45:34.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 1 -- 172.21.15.103:0/365091519 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56363d23aa70 con 0x56363d4090f0 2024-09-10T22:45:34.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13c7e00640 1 --2- 172.21.15.103:0/365091519 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56363d4090f0 0x56363d438c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13c7e00640 1 --2- 172.21.15.103:0/365091519 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56363d4090f0 0x56363d438c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9be904fa4eea0b61 server_cookie=5d75dfafd58b1f57 in_seq=0 out_seq=0 2024-09-10T22:45:34.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13b1600640 10 client.8346 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:34.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13b1600640 1 -- 172.21.15.103:0/365091519 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56363d23aa70 con 0x56363d4090f0 2024-09-10T22:45:34.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13b1600640 10 client.8346 handle_command_reply: tid=0 2024-09-10T22:45:34.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 1 client.8346 shutdown 2024-09-10T22:45:34.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 1 -- 172.21.15.103:0/365091519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 msgr2=0x56363d4083b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:34.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 1 --2- 172.21.15.103:0/365091519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 0x56363d4083b0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f13c000c640 tx=0x7f13c00013b0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 1 -- 172.21.15.103:0/365091519 shutdown_connections 2024-09-10T22:45:34.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 1 --2- 172.21.15.103:0/365091519 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56363d4090f0 0x56363d438c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 1 --2- 172.21.15.103:0/365091519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 0x56363d4083b0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 1 --2- 172.21.15.103:0/365091519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d4269d0 0x56363d407e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13b1600640 0 client.8346 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:34.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 1 --2- 172.21.15.103:0/365091519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d3dae10 0x56363d4076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 1 -- 172.21.15.103:0/365091519 >> 172.21.15.103:0/365091519 conn(0x56363d2c4130 msgr2=0x56363d3d9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:34.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 1 -- 172.21.15.103:0/365091519 shutdown_connections 2024-09-10T22:45:34.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 1 -- 172.21.15.103:0/365091519 wait complete. 2024-09-10T22:45:34.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.353+0000 7f13d1f80000 20 client.8346 trim_cache size 0 max 16384 2024-09-10T22:45:34.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13d1f80000 1 Processor -- start 2024-09-10T22:45:34.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13d1f80000 1 -- start start 2024-09-10T22:45:34.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13d1f80000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d3dae10 0x56363d425cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13d1f80000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d4269d0 0x56363d426200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13d1f80000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 0x56363d3d90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13d1f80000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f13c8205160 con 0x56363d4272f0 2024-09-10T22:45:34.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13d1f80000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f13c8204140 con 0x56363d3dae10 2024-09-10T22:45:34.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13d1f80000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f13c82034d0 con 0x56363d4269d0 2024-09-10T22:45:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13ccc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 0x56363d3d90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13ccc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 0x56363d3d90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41172/0 (socket says 172.21.15.103:41172) 2024-09-10T22:45:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13ccc00640 1 -- 172.21.15.103:0/3548867306 learned_addr learned my addr 172.21.15.103:0/3548867306 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13c7400640 1 --2- 172.21.15.103:0/3548867306 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d4269d0 0x56363d426200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13c7e00640 1 --2- 172.21.15.103:0/3548867306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d3dae10 0x56363d425cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13ccc00640 1 -- 172.21.15.103:0/3548867306 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d4269d0 msgr2=0x56363d426200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13ccc00640 1 --2- 172.21.15.103:0/3548867306 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d4269d0 0x56363d426200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13ccc00640 1 -- 172.21.15.103:0/3548867306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d3dae10 msgr2=0x56363d425cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13ccc00640 1 --2- 172.21.15.103:0/3548867306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d3dae10 0x56363d425cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13ccc00640 1 -- 172.21.15.103:0/3548867306 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56363d283d90 con 0x56363d4272f0 2024-09-10T22:45:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13ccc00640 1 --2- 172.21.15.103:0/3548867306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 0x56363d3d90a0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f13c001db70 tx=0x7f13c0006d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8455a7a6958efcea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13b3e00640 1 -- 172.21.15.103:0/3548867306 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0002040 con 0x56363d4272f0 2024-09-10T22:45:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13b3e00640 1 -- 172.21.15.103:0/3548867306 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13c00b3030 con 0x56363d4272f0 2024-09-10T22:45:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.373+0000 7f13b3e00640 1 -- 172.21.15.103:0/3548867306 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0003e50 con 0x56363d4272f0 2024-09-10T22:45:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 -- 172.21.15.103:0/3548867306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 msgr2=0x56363d3d90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:34.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 --2- 172.21.15.103:0/3548867306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 0x56363d3d90a0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f13c001db70 tx=0x7f13c0006d90 comp rx=0 tx=0).stop 2024-09-10T22:45:34.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 -- 172.21.15.103:0/3548867306 shutdown_connections 2024-09-10T22:45:34.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 --2- 172.21.15.103:0/3548867306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4272f0 0x56363d3d90a0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 --2- 172.21.15.103:0/3548867306 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d4269d0 0x56363d426200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 --2- 172.21.15.103:0/3548867306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d3dae10 0x56363d425cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 -- 172.21.15.103:0/3548867306 >> 172.21.15.103:0/3548867306 conn(0x56363d2c4130 msgr2=0x56363d4255b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:34.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 -- 172.21.15.103:0/3548867306 shutdown_connections 2024-09-10T22:45:34.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 -- 172.21.15.103:0/3548867306 wait complete. 2024-09-10T22:45:34.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 -- start start 2024-09-10T22:45:34.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 Processor -- start 2024-09-10T22:45:34.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d3dae10 0x56363d4a5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4269d0 0x56363d4a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d4272f0 0x56363d4a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f13c8203b20 con 0x56363d4269d0 2024-09-10T22:45:34.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56363d1c25d0 con 0x56363d3dae10 2024-09-10T22:45:34.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56363d43dce0 con 0x56363d4272f0 2024-09-10T22:45:34.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 10 client.0 _ll_register_callbacks cb 0x7f13ac003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:34.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13c7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4269d0 0x56363d4a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13c7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4269d0 0x56363d4a5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41180/0 (socket says 172.21.15.103:41180) 2024-09-10T22:45:34.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13c7400640 1 -- 172.21.15.103:0/1907636187 learned_addr learned my addr 172.21.15.103:0/1907636187 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:34.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13c7e00640 1 --2- 172.21.15.103:0/1907636187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d3dae10 0x56363d4a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13ccc00640 1 --2- 172.21.15.103:0/1907636187 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d4272f0 0x56363d4a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13c7400640 1 -- 172.21.15.103:0/1907636187 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d4272f0 msgr2=0x56363d4a60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:34.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13c7400640 1 --2- 172.21.15.103:0/1907636187 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d4272f0 0x56363d4a60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13c7400640 1 -- 172.21.15.103:0/1907636187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d3dae10 msgr2=0x56363d4a5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:34.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13c7400640 1 --2- 172.21.15.103:0/1907636187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d3dae10 0x56363d4a5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13c7400640 1 -- 172.21.15.103:0/1907636187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56363d1eea90 con 0x56363d4269d0 2024-09-10T22:45:34.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13c7400640 1 --2- 172.21.15.103:0/1907636187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4269d0 0x56363d4a5b60 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f13b405b930 tx=0x7f13b405b030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81515c5403c5fc79 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:34.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13b1600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:34.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13b1600640 1 -- 172.21.15.103:0/1907636187 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b40660d0 con 0x56363d4269d0 2024-09-10T22:45:34.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13b1600640 1 -- 172.21.15.103:0/1907636187 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f13b4068130 con 0x56363d4269d0 2024-09-10T22:45:34.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 -- 172.21.15.103:0/1907636187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13c00b3030 con 0x56363d4269d0 2024-09-10T22:45:34.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13b1600640 1 -- 172.21.15.103:0/1907636187 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7f13b40685c0 con 0x56363d4269d0 2024-09-10T22:45:34.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 10 client.8352 fetch_fsmap learned FSMap version 107 2024-09-10T22:45:34.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 -- 172.21.15.103:0/1907636187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x56363d1cd050 con 0x56363d4269d0 2024-09-10T22:45:34.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13b1600640 1 -- 172.21.15.103:0/1907636187 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13c00b3030 con 0x56363d4269d0 2024-09-10T22:45:34.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13b1600640 1 -- 172.21.15.103:0/1907636187 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7f13b4092170 con 0x56363d4269d0 2024-09-10T22:45:34.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 10 client.8352 fetch_fsmap finished waiting for FSMap version 107 2024-09-10T22:45:34.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 10 client.8352 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:45:34.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 20 client.8352 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:34.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 --2- 172.21.15.103:0/1907636187 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56363d43b070 0x56363d43b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 4 client.8352 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:45:34.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13d1f80000 1 -- 172.21.15.103:0/1907636187 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "status"}) -- 0x56363d236520 con 0x56363d43b070 2024-09-10T22:45:34.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.377+0000 7f13c7e00640 1 --2- 172.21.15.103:0/1907636187 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56363d43b070 0x56363d43b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13c7e00640 1 --2- 172.21.15.103:0/1907636187 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56363d43b070 0x56363d43b450 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4f0809edf5951c0 server_cookie=9a12ba5d9eca62c2 in_seq=0 out_seq=0 2024-09-10T22:45:34.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13b1600640 10 client.8352 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:34.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13b1600640 1 -- 172.21.15.103:0/1907636187 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x56363d236520 con 0x56363d43b070 2024-09-10T22:45:34.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13b1600640 10 client.8352 handle_command_reply: tid=0 2024-09-10T22:45:34.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13d1f80000 1 client.8352 shutdown 2024-09-10T22:45:34.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13d1f80000 1 -- 172.21.15.103:0/1907636187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4269d0 msgr2=0x56363d4a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:34.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13d1f80000 1 --2- 172.21.15.103:0/1907636187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4269d0 0x56363d4a5b60 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f13b405b930 tx=0x7f13b405b030 comp rx=0 tx=0).stop 2024-09-10T22:45:34.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13d1f80000 1 -- 172.21.15.103:0/1907636187 shutdown_connections 2024-09-10T22:45:34.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13d1f80000 1 --2- 172.21.15.103:0/1907636187 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56363d43b070 0x56363d43b450 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13d1f80000 1 --2- 172.21.15.103:0/1907636187 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56363d4272f0 0x56363d4a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13d1f80000 1 --2- 172.21.15.103:0/1907636187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56363d4269d0 0x56363d4a5b60 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13d1f80000 1 --2- 172.21.15.103:0/1907636187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56363d3dae10 0x56363d4a5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13b1600640 0 client.8352 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:34.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13d1f80000 1 -- 172.21.15.103:0/1907636187 >> 172.21.15.103:0/1907636187 conn(0x56363d2c4130 msgr2=0x56363d3d90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:34.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13d1f80000 1 -- 172.21.15.103:0/1907636187 shutdown_connections 2024-09-10T22:45:34.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13d1f80000 1 -- 172.21.15.103:0/1907636187 wait complete. 2024-09-10T22:45:34.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13d1f80000 20 client.8352 trim_cache size 0 max 16384 2024-09-10T22:45:34.390 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:45:34.390 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:45:34.390 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-10T22:45:34.390 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 8238, 2024-09-10T22:45:34.390 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:45:34.391 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:45:34.391 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:45:34.391 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 5.9139534759999997, 2024-09-10T22:45:34.391 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 107, 2024-09-10T22:45:34.391 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 107, 2024-09-10T22:45:34.391 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 105, 2024-09-10T22:45:34.391 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 10.380609789999999 2024-09-10T22:45:34.391 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:45:34.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13cec00640 1 -- 172.21.15.103:0/926576257 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f13a8072610 msgr2=0x7f13a8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:34.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13cec00640 1 --2- 172.21.15.103:0/926576257 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f13a8072610 0x7f13a8074ad0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f13b8009c60 tx=0x7f13b80091e0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13cec00640 1 -- 172.21.15.103:0/926576257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13c815d0d0 msgr2=0x7f13c815c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13cec00640 1 --2- 172.21.15.103:0/926576257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13c815d0d0 0x7f13c815c990 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f13b4011a50 tx=0x7f13b4011e50 comp rx=0 tx=0).stop 2024-09-10T22:45:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13cec00640 1 -- 172.21.15.103:0/926576257 shutdown_connections 2024-09-10T22:45:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13cec00640 1 --2- 172.21.15.103:0/926576257 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f13a8072610 0x7f13a8074ad0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13cec00640 1 --2- 172.21.15.103:0/926576257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13c80b23e0 0x7f13c80b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13cec00640 1 --2- 172.21.15.103:0/926576257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13c815d0d0 0x7f13c815c990 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13cec00640 1 --2- 172.21.15.103:0/926576257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13ac004d50 0x7f13c80b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13cec00640 1 -- 172.21.15.103:0/926576257 >> 172.21.15.103:0/926576257 conn(0x7f13c80d1ad0 msgr2=0x7f13c8070700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13cec00640 1 -- 172.21.15.103:0/926576257 shutdown_connections 2024-09-10T22:45:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.381+0000 7f13cec00640 1 -- 172.21.15.103:0/926576257 wait complete. 2024-09-10T22:45:34.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T22:45:34.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.541+0000 7f5b21200640 1 -- 172.21.15.103:0/860372642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b1c072a40 msgr2=0x7f5b1c157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:34.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.541+0000 7f5b21200640 1 --2- 172.21.15.103:0/860372642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b1c072a40 0x7f5b1c157090 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0d0340 tx=0x7f5b1401c8c0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.541+0000 7f5b21200640 1 -- 172.21.15.103:0/860372642 shutdown_connections 2024-09-10T22:45:34.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.541+0000 7f5b21200640 1 --2- 172.21.15.103:0/860372642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b1c072a40 0x7f5b1c157090 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.541+0000 7f5b21200640 1 --2- 172.21.15.103:0/860372642 >> v2:172.21.15.131:3300/0 conn(0x7f5b1c0b3150 0x7f5b1c072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.541+0000 7f5b21200640 1 --2- 172.21.15.103:0/860372642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b1c0cf260 0x7f5b1c0b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.541+0000 7f5b21200640 1 -- 172.21.15.103:0/860372642 >> 172.21.15.103:0/860372642 conn(0x7f5b1c06cc00 msgr2=0x7f5b1c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:34.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.541+0000 7f5b21200640 1 -- 172.21.15.103:0/860372642 shutdown_connections 2024-09-10T22:45:34.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.541+0000 7f5b21200640 1 -- 172.21.15.103:0/860372642 wait complete. 2024-09-10T22:45:34.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b21200640 1 Processor -- start 2024-09-10T22:45:34.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b21200640 1 -- start start 2024-09-10T22:45:34.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b21200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b1c072a40 0x7f5b1c15cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b21200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b1c0b3150 0x7f5b1c14e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b21200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b1c0cf260 0x7f5b1c14ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b21200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1c157e70 con 0x7f5b1c072a40 2024-09-10T22:45:34.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b21200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1c157cf0 con 0x7f5b1c0cf260 2024-09-10T22:45:34.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b21200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5b1c15dab0 con 0x7f5b1c0b3150 2024-09-10T22:45:34.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b19e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b1c072a40 0x7f5b1c15cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b19e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b1c072a40 0x7f5b1c15cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41198/0 (socket says 172.21.15.103:41198) 2024-09-10T22:45:34.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b19e00640 1 -- 172.21.15.103:0/3458729981 learned_addr learned my addr 172.21.15.103:0/3458729981 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:34.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b19400640 1 --2- 172.21.15.103:0/3458729981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b1c0b3150 0x7f5b1c14e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b1a800640 1 --2- 172.21.15.103:0/3458729981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b1c0cf260 0x7f5b1c14ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b19e00640 1 -- 172.21.15.103:0/3458729981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b1c0b3150 msgr2=0x7f5b1c14e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:34.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b19e00640 1 --2- 172.21.15.103:0/3458729981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b1c0b3150 0x7f5b1c14e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b19e00640 1 -- 172.21.15.103:0/3458729981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b1c0cf260 msgr2=0x7f5b1c14ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:34.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b19e00640 1 --2- 172.21.15.103:0/3458729981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b1c0cf260 0x7f5b1c14ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b19e00640 1 -- 172.21.15.103:0/3458729981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1c14dd30 con 0x7f5b1c072a40 2024-09-10T22:45:34.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b19e00640 1 --2- 172.21.15.103:0/3458729981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b1c072a40 0x7f5b1c15cf70 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00de30 tx=0x7f5b0c00b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:34.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b12000640 1 -- 172.21.15.103:0/3458729981 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c01b070 con 0x7f5b1c072a40 2024-09-10T22:45:34.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b12000640 1 -- 172.21.15.103:0/3458729981 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b0c00e740 con 0x7f5b1c072a40 2024-09-10T22:45:34.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b12000640 1 -- 172.21.15.103:0/3458729981 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00eb70 con 0x7f5b1c072a40 2024-09-10T22:45:34.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b21200640 1 -- 172.21.15.103:0/3458729981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b1c15d4b0 con 0x7f5b1c072a40 2024-09-10T22:45:34.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.545+0000 7f5b21200640 1 -- 172.21.15.103:0/3458729981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b1c1fa670 con 0x7f5b1c072a40 2024-09-10T22:45:34.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.549+0000 7f5b21200640 1 -- 172.21.15.103:0/3458729981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b1c072500 con 0x7f5b1c072a40 2024-09-10T22:45:34.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.549+0000 7f5b12000640 1 -- 172.21.15.103:0/3458729981 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5b0c00b040 con 0x7f5b1c072a40 2024-09-10T22:45:34.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.549+0000 7f5b12000640 1 --2- 172.21.15.103:0/3458729981 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5afc072610 0x7f5afc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:34.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.549+0000 7f5b12000640 1 -- 172.21.15.103:0/3458729981 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f5b0c093c50 con 0x7f5b1c072a40 2024-09-10T22:45:34.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.549+0000 7f5b19400640 1 --2- 172.21.15.103:0/3458729981 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5afc072610 0x7f5afc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:34.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.549+0000 7f5b19400640 1 --2- 172.21.15.103:0/3458729981 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5afc072610 0x7f5afc074ad0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c154ef0 tx=0x7f5b0800b310 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:34.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.553+0000 7f5b12000640 1 -- 172.21.15.103:0/3458729981 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5b0c05eaf0 con 0x7f5b1c072a40 2024-09-10T22:45:34.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.753+0000 7f5b21200640 1 -- 172.21.15.103:0/3458729981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5b1c155a00 con 0x7f5b1c072a40 2024-09-10T22:45:34.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.753+0000 7f5b12000640 1 -- 172.21.15.103:0/3458729981 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v107) ==== 53+0+73 (secure 0 0 0) 0x7f5b0c063520 con 0x7f5b1c072a40 2024-09-10T22:45:34.759 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T22:45:34.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.757+0000 7f5b21200640 1 -- 172.21.15.103:0/3458729981 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5afc072610 msgr2=0x7f5afc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:34.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.757+0000 7f5b21200640 1 --2- 172.21.15.103:0/3458729981 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5afc072610 0x7f5afc074ad0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c154ef0 tx=0x7f5b0800b310 comp rx=0 tx=0).stop 2024-09-10T22:45:34.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.757+0000 7f5b21200640 1 -- 172.21.15.103:0/3458729981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b1c072a40 msgr2=0x7f5b1c15cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:34.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.757+0000 7f5b21200640 1 --2- 172.21.15.103:0/3458729981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b1c072a40 0x7f5b1c15cf70 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00de30 tx=0x7f5b0c00b730 comp rx=0 tx=0).stop 2024-09-10T22:45:34.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.757+0000 7f5b21200640 1 -- 172.21.15.103:0/3458729981 shutdown_connections 2024-09-10T22:45:34.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.757+0000 7f5b21200640 1 --2- 172.21.15.103:0/3458729981 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5afc072610 0x7f5afc074ad0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.757+0000 7f5b21200640 1 --2- 172.21.15.103:0/3458729981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b1c0cf260 0x7f5b1c14ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.757+0000 7f5b21200640 1 --2- 172.21.15.103:0/3458729981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b1c0b3150 0x7f5b1c14e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.757+0000 7f5b21200640 1 --2- 172.21.15.103:0/3458729981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b1c072a40 0x7f5b1c15cf70 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:34.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.757+0000 7f5b21200640 1 -- 172.21.15.103:0/3458729981 >> 172.21.15.103:0/3458729981 conn(0x7f5b1c06cc00 msgr2=0x7f5b1c151680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:34.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.757+0000 7f5b21200640 1 -- 172.21.15.103:0/3458729981 shutdown_connections 2024-09-10T22:45:34.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34.757+0000 7f5b21200640 1 -- 172.21.15.103:0/3458729981 wait complete. 2024-09-10T22:45:34.780 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T22:45:34.780 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T22:45:34.780 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-10T22:45:34.780 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T22:45:34.780 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T22:45:34.780 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T22:45:34.781 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T22:45:34.781 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T22:45:34.781 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:45:34.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:34.781 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-10T22:45:34.790 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T22:45:34.790 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T22:45:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T22:45:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:45:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-10T22:45:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:45:34.791 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:45:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:45:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-10T22:45:34.791 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:45:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:45:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-10T22:45:34.791 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T22:45:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-10T22:45:34.792 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T22:45:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-10T22:45:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-10T22:45:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42047sec preferred_lft 42047sec 2024-09-10T22:45:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2024-09-10T22:45:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:45:34.792 INFO:teuthology.orchestra.run.smithi103.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T22:45:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 02:42:c3:dd:ba:ba brd ff:ff:ff:ff:ff:ff 2024-09-10T22:45:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T22:45:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:45:34.792 INFO:teuthology.orchestra.run.smithi103.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T22:45:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T22:45:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T22:45:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:45:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T22:45:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:45:34.793 INFO:teuthology.orchestra.run.smithi103.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T22:45:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:45:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T22:45:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:45:34.793 INFO:teuthology.orchestra.run.smithi103.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T22:45:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:45:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T22:45:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:45:34.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:34.794 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T22:45:34.852 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-10T22:45:34.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:34.854 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-10T22:45:34.906 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-10T22:45:34.906 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T22:45:34.906 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-10T22:45:34.906 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T22:45:34.906 INFO:teuthology.orchestra.run.smithi103.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-10T22:45:34.906 INFO:teuthology.orchestra.run.smithi103.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T22:45:34.906 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T22:45:34.906 INFO:teuthology.orchestra.run.smithi103.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:45:34.906 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:45:34.906 INFO:teuthology.orchestra.run.smithi103.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T22:45:34.907 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T22:45:34.907 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:45:34.907 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T22:45:34.907 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T22:45:34.907 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T22:45:34.907 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T22:45:34.907 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T22:45:34.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:45:35.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:45:35.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:35.041 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-10T22:45:35.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T22:45:35.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T22:45:35.092 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:45:35.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:35.092 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-10T22:45:35.158 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T22:45:35.158 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:45:35.158 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T22:45:35.206 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:45:35.207 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:45:35.207 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T22:45:35.258 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:45:35.323 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:45:35.380 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:45:35.380 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:45:35.380 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:45:35.380 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:45:35.380 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:45:35.381 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:45:35.381 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:45:35.381 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:45:35.381 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:45:35.381 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:45:35.381 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:45:35.381 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:45:35.381 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:45:35.381 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:45:35.381 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:45:35.381 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:45:35.381 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:45:35.381 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:45:35.382 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:45:35.382 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:45:35.382 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:45:35.382 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:45:35.382 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:45:35.382 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:45:35.382 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:45:35.382 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:45:35.382 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:45:35.382 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:45:35.382 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:45:35.382 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:45:35.382 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:45:35.382 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:45:35.383 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:45:35.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:35.383 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:45:35.434 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T22:45:35.434 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T22:45:35.477 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T22:45:35.498 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T22:45:35.552 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T22:45:35.552 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T22:45:35.552 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T22:45:35.552 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T22:45:35.553 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T22:45:35.553 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T22:45:35.553 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T22:45:35.553 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T22:45:35.553 INFO:teuthology.orchestra.run.smithi103.stdout:/run/lock 2024-09-10T22:45:35.553 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T22:45:35.553 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T22:45:35.553 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T22:45:35.553 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T22:45:35.553 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T22:45:35.553 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T22:45:35.553 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T22:45:35.553 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T22:45:35.553 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/fs/nfsd 2024-09-10T22:45:35.554 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T22:45:35.554 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T22:45:35.554 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T22:45:35.554 INFO:teuthology.orchestra.run.smithi103.stdout:/run/rpc_pipefs 2024-09-10T22:45:35.554 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T22:45:35.554 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T22:45:35.554 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T22:45:35.554 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T22:45:35.555 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T22:45:35.555 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T22:45:35.556 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T22:45:35.556 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:45:35.556 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:45:35.556 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:45:35.556 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:45:35.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:35.557 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T22:45:35.572 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2024-09-10T22:45:35.569+0000 7f45c2db4580 -1 init, newargv = 0x55f8bd446940 newargc=15 2024-09-10T22:45:35.572 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[49249]: starting ceph client 2024-09-10T22:45:35.578 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[49249]: starting fuse 2024-09-10T22:45:35.580 INFO:teuthology.orchestra.run.smithi103.stdout:44 2024-09-10T22:45:35.580 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T22:45:35.580 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-09-10T22:45:35.581 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-09-10T22:45:35.581 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-09-10T22:45:35.581 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:45:35.581 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-09-10T22:45:35.581 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:45:35.581 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-09-10T22:45:35.581 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T22:45:35.581 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-09-10T22:45:35.581 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T22:45:35.581 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:45:35.581 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-09-10T22:45:35.581 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-09-10T22:45:35.581 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-09-10T22:45:35.581 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-09-10T22:45:35.581 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:45:35.582 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-09-10T22:45:35.582 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T22:45:35.582 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T22:45:35.582 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T22:45:35.582 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-09-10T22:45:35.582 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-09-10T22:45:35.582 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-09-10T22:45:35.582 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T22:45:35.582 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:45:35.582 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.0")) 2024-09-10T22:45:35.582 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:45:35.703 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.49249.asok 2024-09-10T22:45:35.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:45:35.714 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49249.asok 2024-09-10T22:45:35.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:35.714 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49249.asok status 2024-09-10T22:45:35.880 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:45:35.881 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-09-10T22:45:35.881 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T22:45:35.881 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:45:35.881 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2024-09-10T22:45:35.881 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-09-10T22:45:35.881 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T22:45:35.881 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "49249", 2024-09-10T22:45:35.881 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-09-10T22:45:35.881 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:35.881 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-09-10T22:45:35.881 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-09-10T22:45:35.881 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 8364, 2024-09-10T22:45:35.882 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-09-10T22:45:35.882 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-09-10T22:45:35.882 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-09-10T22:45:35.882 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8364 2024-09-10T22:45:35.882 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:35.882 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T22:45:35.882 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T22:45:35.882 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-10T22:45:35.882 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1455429831 2024-09-10T22:45:35.882 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:35.882 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:35.882 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T22:45:35.882 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T22:45:35.882 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-10T22:45:35.882 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1455429831 2024-09-10T22:45:35.883 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:35.883 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.8364 192.168.0.1:0/1455429831", 2024-09-10T22:45:35.883 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/1455429831", 2024-09-10T22:45:35.883 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-09-10T22:45:35.883 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 107, 2024-09-10T22:45:35.883 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 107, 2024-09-10T22:45:35.883 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-09-10T22:45:35.883 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-09-10T22:45:35.883 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-09-10T22:45:35.883 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:45:35.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:35.895 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-09-10T22:45:35.895 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T22:45:35.904 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-09-10T22:45:35.904 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T22:45:35.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:35.905 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T22:45:35.970 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-10T22:45:36.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.149+0000 7f6a70a00640 1 -- 172.21.15.103:0/1633597065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a50004810 msgr2=0x7f6a50004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.149+0000 7f6a70a00640 1 --2- 172.21.15.103:0/1633597065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a50004810 0x7f6a50004c90 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400c310 tx=0x7f6a5401f720 comp rx=0 tx=0).stop 2024-09-10T22:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.149+0000 7f6a6a800640 1 -- 172.21.15.103:0/1633597065 reap_dead start 2024-09-10T22:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.149+0000 7f6a70a00640 1 -- 172.21.15.103:0/1633597065 shutdown_connections 2024-09-10T22:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.149+0000 7f6a70a00640 1 -- 172.21.15.103:0/1633597065 >> 172.21.15.103:0/1633597065 conn(0x7f6a6c06cc00 msgr2=0x7f6a6c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.149+0000 7f6a70a00640 1 -- 172.21.15.103:0/1633597065 shutdown_connections 2024-09-10T22:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.149+0000 7f6a70a00640 1 -- 172.21.15.103:0/1633597065 wait complete. 2024-09-10T22:45:36.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a70a00640 1 Processor -- start 2024-09-10T22:45:36.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a70a00640 1 -- start start 2024-09-10T22:45:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a70a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a50004810 0x7f6a6c154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a70a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a6c0a9450 0x7f6a6c1e3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a70a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a6c0aaf60 0x7f6a6c0ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a70a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c0cfb90 con 0x7f6a6c0a9450 2024-09-10T22:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a70a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c0cfa10 con 0x7f6a6c0aaf60 2024-09-10T22:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a70a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6c0cfd10 con 0x7f6a50004810 2024-09-10T22:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a61400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a6c0a9450 0x7f6a6c1e3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a61400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a6c0a9450 0x7f6a6c1e3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41206/0 (socket says 172.21.15.103:41206) 2024-09-10T22:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a61400640 1 -- 172.21.15.103:0/2319566707 learned_addr learned my addr 172.21.15.103:0/2319566707 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a6a800640 1 --2- 172.21.15.103:0/2319566707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a6c0aaf60 0x7f6a6c0ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a69e00640 1 --2- 172.21.15.103:0/2319566707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a50004810 0x7f6a6c154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a61400640 1 -- 172.21.15.103:0/2319566707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a50004810 msgr2=0x7f6a6c154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a61400640 1 --2- 172.21.15.103:0/2319566707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a50004810 0x7f6a6c154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a61400640 1 -- 172.21.15.103:0/2319566707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a6c0aaf60 msgr2=0x7f6a6c0ab3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a61400640 1 --2- 172.21.15.103:0/2319566707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a6c0aaf60 0x7f6a6c0ab3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a61400640 1 -- 172.21.15.103:0/2319566707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c0a98e0 con 0x7f6a6c0a9450 2024-09-10T22:45:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a6a800640 1 --2- 172.21.15.103:0/2319566707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a6c0aaf60 0x7f6a6c0ab3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a61400640 1 --2- 172.21.15.103:0/2319566707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a6c0a9450 0x7f6a6c1e3e20 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f6a5401de20 tx=0x7f6a54001d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a62a00640 1 -- 172.21.15.103:0/2319566707 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a540c0070 con 0x7f6a6c0a9450 2024-09-10T22:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a62a00640 1 -- 172.21.15.103:0/2319566707 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a54006420 con 0x7f6a6c0a9450 2024-09-10T22:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a62a00640 1 -- 172.21.15.103:0/2319566707 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a540b2030 con 0x7f6a6c0a9450 2024-09-10T22:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a70a00640 1 -- 172.21.15.103:0/2319566707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6c0a9bc0 con 0x7f6a6c0a9450 2024-09-10T22:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.153+0000 7f6a70a00640 1 -- 172.21.15.103:0/2319566707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6c0aa180 con 0x7f6a6c0a9450 2024-09-10T22:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.157+0000 7f6a70a00640 1 -- 172.21.15.103:0/2319566707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a6c072500 con 0x7f6a6c0a9450 2024-09-10T22:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.157+0000 7f6a62a00640 1 -- 172.21.15.103:0/2319566707 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6a540b8070 con 0x7f6a6c0a9450 2024-09-10T22:45:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.157+0000 7f6a62a00640 1 --2- 172.21.15.103:0/2319566707 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6a48072610 0x7f6a48074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.157+0000 7f6a62a00640 1 -- 172.21.15.103:0/2319566707 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f6a541302f0 con 0x7f6a6c0a9450 2024-09-10T22:45:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.157+0000 7f6a69e00640 1 --2- 172.21.15.103:0/2319566707 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6a48072610 0x7f6a48074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.161+0000 7f6a69e00640 1 --2- 172.21.15.103:0/2319566707 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6a48072610 0x7f6a48074ad0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c000c10 tx=0x7f6a5c006b80 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:36.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.161+0000 7f6a62a00640 1 -- 172.21.15.103:0/2319566707 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6a540194d0 con 0x7f6a6c0a9450 2024-09-10T22:45:36.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.361+0000 7f6a70a00640 1 -- 172.21.15.103:0/2319566707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f6a6c15acc0 con 0x7f6a6c0a9450 2024-09-10T22:45:36.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.513+0000 7f6a62a00640 1 -- 172.21.15.103:0/2319566707 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v108) ==== 105+0+0 (secure 0 0 0) 0x7f6a54102e20 con 0x7f6a6c0a9450 2024-09-10T22:45:36.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.517+0000 7f6a70a00640 1 -- 172.21.15.103:0/2319566707 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6a48072610 msgr2=0x7f6a48074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:36.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.517+0000 7f6a70a00640 1 --2- 172.21.15.103:0/2319566707 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6a48072610 0x7f6a48074ad0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c000c10 tx=0x7f6a5c006b80 comp rx=0 tx=0).stop 2024-09-10T22:45:36.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.517+0000 7f6a70a00640 1 -- 172.21.15.103:0/2319566707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a6c0a9450 msgr2=0x7f6a6c1e3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:36.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.517+0000 7f6a70a00640 1 --2- 172.21.15.103:0/2319566707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a6c0a9450 0x7f6a6c1e3e20 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f6a5401de20 tx=0x7f6a54001d70 comp rx=0 tx=0).stop 2024-09-10T22:45:36.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.517+0000 7f6a70a00640 1 -- 172.21.15.103:0/2319566707 shutdown_connections 2024-09-10T22:45:36.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.517+0000 7f6a70a00640 1 --2- 172.21.15.103:0/2319566707 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6a48072610 0x7f6a48074ad0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:36.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.517+0000 7f6a70a00640 1 --2- 172.21.15.103:0/2319566707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a6c0aaf60 0x7f6a6c0ab3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:36.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.517+0000 7f6a70a00640 1 --2- 172.21.15.103:0/2319566707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a6c0a9450 0x7f6a6c1e3e20 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:36.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.517+0000 7f6a70a00640 1 --2- 172.21.15.103:0/2319566707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a50004810 0x7f6a6c154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:36.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.517+0000 7f6a70a00640 1 -- 172.21.15.103:0/2319566707 >> 172.21.15.103:0/2319566707 conn(0x7f6a6c06cc00 msgr2=0x7f6a6c156210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:36.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.517+0000 7f6a70a00640 1 -- 172.21.15.103:0/2319566707 shutdown_connections 2024-09-10T22:45:36.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.517+0000 7f6a70a00640 1 -- 172.21.15.103:0/2319566707 wait complete. 2024-09-10T22:45:36.547 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:45:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.685+0000 7f026b000640 1 -- 172.21.15.103:0/2806291197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f024c005380 msgr2=0x7f024c00b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.685+0000 7f026b000640 1 --2- 172.21.15.103:0/2806291197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f024c005380 0x7f024c00b9f0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f025c009e30 tx=0x7f025c01d1b0 comp rx=0 tx=0).stop 2024-09-10T22:45:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.685+0000 7f026b000640 1 -- 172.21.15.103:0/2806291197 shutdown_connections 2024-09-10T22:45:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.685+0000 7f026b000640 1 --2- 172.21.15.103:0/2806291197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f024c005380 0x7f024c00b9f0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.685+0000 7f026b000640 1 -- 172.21.15.103:0/2806291197 >> 172.21.15.103:0/2806291197 conn(0x7f02640d18d0 msgr2=0x7f02640d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.685+0000 7f026b000640 1 -- 172.21.15.103:0/2806291197 shutdown_connections 2024-09-10T22:45:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.685+0000 7f026b000640 1 -- 172.21.15.103:0/2806291197 wait complete. 2024-09-10T22:45:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f026b000640 1 Processor -- start 2024-09-10T22:45:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f026b000640 1 -- start start 2024-09-10T22:45:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f026b000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f024c005380 0x7f0264158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f026b000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02641f5e70 0x7f0264156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f026b000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0264157160 0x7f0264149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f026b000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f026415f640 con 0x7f024c005380 2024-09-10T22:45:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f026b000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f026415f4c0 con 0x7f02641f5e70 2024-09-10T22:45:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f026b000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f02640d1280 con 0x7f0264157160 2024-09-10T22:45:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f0269c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f024c005380 0x7f0264158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f0269c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f024c005380 0x7f0264158b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41188/0 (socket says 172.21.15.103:41188) 2024-09-10T22:45:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f0269c00640 1 -- 172.21.15.103:0/32226429 learned_addr learned my addr 172.21.15.103:0/32226429 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f026a600640 1 --2- 172.21.15.103:0/32226429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0264157160 0x7f0264149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f0269200640 1 --2- 172.21.15.103:0/32226429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02641f5e70 0x7f0264156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f0269c00640 1 -- 172.21.15.103:0/32226429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0264157160 msgr2=0x7f0264149500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f0269c00640 1 --2- 172.21.15.103:0/32226429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0264157160 0x7f0264149500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f0269c00640 1 -- 172.21.15.103:0/32226429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02641f5e70 msgr2=0x7f0264156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f0269c00640 1 --2- 172.21.15.103:0/32226429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02641f5e70 0x7f0264156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f0269c00640 1 -- 172.21.15.103:0/32226429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0264143d10 con 0x7f024c005380 2024-09-10T22:45:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f0269c00640 1 --2- 172.21.15.103:0/32226429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f024c005380 0x7f0264158b30 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f0258004e00 tx=0x7f0258001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f0261600640 1 -- 172.21.15.103:0/32226429 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0258015020 con 0x7f024c005380 2024-09-10T22:45:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f0261600640 1 -- 172.21.15.103:0/32226429 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0258011960 con 0x7f024c005380 2024-09-10T22:45:36.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f0261600640 1 -- 172.21.15.103:0/32226429 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0258011d90 con 0x7f024c005380 2024-09-10T22:45:36.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f026b000640 1 -- 172.21.15.103:0/32226429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0264159140 con 0x7f024c005380 2024-09-10T22:45:36.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f026b000640 1 -- 172.21.15.103:0/32226429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0264159700 con 0x7f024c005380 2024-09-10T22:45:36.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.689+0000 7f026b000640 1 -- 172.21.15.103:0/32226429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0264070430 con 0x7f024c005380 2024-09-10T22:45:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.693+0000 7f0261600640 1 -- 172.21.15.103:0/32226429 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f025801a400 con 0x7f024c005380 2024-09-10T22:45:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.693+0000 7f0261600640 1 --2- 172.21.15.103:0/32226429 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f02440725e0 0x7f0244074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.693+0000 7f0261600640 1 -- 172.21.15.103:0/32226429 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f0258094180 con 0x7f024c005380 2024-09-10T22:45:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.693+0000 7f0269200640 1 --2- 172.21.15.103:0/32226429 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f02440725e0 0x7f0244074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:36.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.693+0000 7f0269200640 1 --2- 172.21.15.103:0/32226429 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f02440725e0 0x7f0244074aa0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f02640cbe80 tx=0x7f0250000ee0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:36.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.697+0000 7f0261600640 1 -- 172.21.15.103:0/32226429 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f025801f020 con 0x7f024c005380 2024-09-10T22:45:36.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.897+0000 7f026b000640 1 -- 172.21.15.103:0/32226429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02640b6ca0 con 0x7f024c005380 2024-09-10T22:45:36.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.897+0000 7f0261600640 1 -- 172.21.15.103:0/32226429 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+5256 (secure 0 0 0) 0x7f0264143d10 con 0x7f024c005380 2024-09-10T22:45:36.902 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:36.902 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":109,"btime":"2024-09-10T22:45:36:522179+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7717,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:45:36.522167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":8238,"mds_1":8235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8235":{"gid":8235,"name":"a","rank":1,"incarnation":109,"state":"up:creating","state_seq":1,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238]},"id":7}]} 2024-09-10T22:45:36.902 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 109 2024-09-10T22:45:36.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.901+0000 7f026b000640 1 -- 172.21.15.103:0/32226429 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f02440725e0 msgr2=0x7f0244074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:36.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.901+0000 7f026b000640 1 --2- 172.21.15.103:0/32226429 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f02440725e0 0x7f0244074aa0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f02640cbe80 tx=0x7f0250000ee0 comp rx=0 tx=0).stop 2024-09-10T22:45:36.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.901+0000 7f026b000640 1 -- 172.21.15.103:0/32226429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f024c005380 msgr2=0x7f0264158b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:36.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.901+0000 7f026b000640 1 --2- 172.21.15.103:0/32226429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f024c005380 0x7f0264158b30 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f0258004e00 tx=0x7f0258001640 comp rx=0 tx=0).stop 2024-09-10T22:45:36.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.901+0000 7f026b000640 1 -- 172.21.15.103:0/32226429 shutdown_connections 2024-09-10T22:45:36.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.901+0000 7f026b000640 1 --2- 172.21.15.103:0/32226429 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f02440725e0 0x7f0244074aa0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:36.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.901+0000 7f026b000640 1 --2- 172.21.15.103:0/32226429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0264157160 0x7f0264149500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:36.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.901+0000 7f026b000640 1 --2- 172.21.15.103:0/32226429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02641f5e70 0x7f0264156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:36.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.901+0000 7f026b000640 1 --2- 172.21.15.103:0/32226429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f024c005380 0x7f0264158b30 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:36.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.901+0000 7f026b000640 1 -- 172.21.15.103:0/32226429 >> 172.21.15.103:0/32226429 conn(0x7f02640d18d0 msgr2=0x7f02640b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:36.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.901+0000 7f026b000640 1 -- 172.21.15.103:0/32226429 shutdown_connections 2024-09-10T22:45:36.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:36.901+0000 7f026b000640 1 -- 172.21.15.103:0/32226429 wait complete. 2024-09-10T22:45:37.326 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 109, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:45:27.857904+0000', 'modified': '2024-09-10T22:45:36.522167+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 8238, 'mds_1': 8235}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8235': {'gid': 8235, 'name': 'a', 'rank': 1, 'incarnation': 109, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.103:6833/1191295180', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6832', 'nonce': 1191295180}, {'type': 'v1', 'addr': '172.21.15.103:6833', 'nonce': 1191295180}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_8238': {'gid': 8238, 'name': 'c', 'rank': 0, 'incarnation': 104, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/3550082240', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6834', 'nonce': 3550082240}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 3550082240}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8238, 'qdb_cluster': [8238]} 2024-09-10T22:45:37.326 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8235:up:creating 2024-09-10T22:45:38.327 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:45:38.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a7e00640 1 -- 172.21.15.103:0/372327248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a0072a40 msgr2=0x7fe5a0157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:38.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a7e00640 1 --2- 172.21.15.103:0/372327248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a0072a40 0x7fe5a0157090 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00d0150 tx=0x7fe59801cd80 comp rx=0 tx=0).stop 2024-09-10T22:45:38.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a7e00640 1 -- 172.21.15.103:0/372327248 shutdown_connections 2024-09-10T22:45:38.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a7e00640 1 --2- 172.21.15.103:0/372327248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a0072a40 0x7fe5a0157090 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:38.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a7e00640 1 --2- 172.21.15.103:0/372327248 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5a00b3150 0x7fe5a0072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:38.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a7e00640 1 --2- 172.21.15.103:0/372327248 >> v2:172.21.15.131:3300/0 conn(0x7fe5a00cf260 0x7fe5a00b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:38.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a7e00640 1 -- 172.21.15.103:0/372327248 >> 172.21.15.103:0/372327248 conn(0x7fe5a006cc00 msgr2=0x7fe5a006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:38.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a7e00640 1 -- 172.21.15.103:0/372327248 shutdown_connections 2024-09-10T22:45:38.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a7e00640 1 -- 172.21.15.103:0/372327248 wait complete. 2024-09-10T22:45:38.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a7e00640 1 Processor -- start 2024-09-10T22:45:38.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a7e00640 1 -- start start 2024-09-10T22:45:38.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a7e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5a0072a40 0x7fe5a01433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:38.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a00b3150 0x7fe5a01fa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:38.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5a00cf260 0x7fe5a015bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:38.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a7e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a0157e70 con 0x7fe5a00b3150 2024-09-10T22:45:38.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a7e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a0157cf0 con 0x7fe5a00cf260 2024-09-10T22:45:38.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a7e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe5a015dab0 con 0x7fe5a0072a40 2024-09-10T22:45:38.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a4a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a00b3150 0x7fe5a01fa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:38.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a4a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a00b3150 0x7fe5a01fa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41208/0 (socket says 172.21.15.103:41208) 2024-09-10T22:45:38.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a4a00640 1 -- 172.21.15.103:0/3598794760 learned_addr learned my addr 172.21.15.103:0/3598794760 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:38.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a5400640 1 --2- 172.21.15.103:0/3598794760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5a0072a40 0x7fe5a01433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:38.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.477+0000 7fe5a5e00640 1 --2- 172.21.15.103:0/3598794760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5a00cf260 0x7fe5a015bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:38.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.481+0000 7fe5a4a00640 1 -- 172.21.15.103:0/3598794760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5a0072a40 msgr2=0x7fe5a01433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:38.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.481+0000 7fe5a4a00640 1 --2- 172.21.15.103:0/3598794760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5a0072a40 0x7fe5a01433e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:38.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.481+0000 7fe5a4a00640 1 -- 172.21.15.103:0/3598794760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5a00cf260 msgr2=0x7fe5a015bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:38.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.481+0000 7fe5a4a00640 1 --2- 172.21.15.103:0/3598794760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5a00cf260 0x7fe5a015bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:38.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.481+0000 7fe5a4a00640 1 -- 172.21.15.103:0/3598794760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a01fadd0 con 0x7fe5a00b3150 2024-09-10T22:45:38.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.481+0000 7fe5a4a00640 1 --2- 172.21.15.103:0/3598794760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a00b3150 0x7fe5a01fa890 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00b480 tx=0x7fe58c00b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:38.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.481+0000 7fe59d600640 1 -- 172.21.15.103:0/3598794760 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c014070 con 0x7fe5a00b3150 2024-09-10T22:45:38.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.481+0000 7fe59d600640 1 -- 172.21.15.103:0/3598794760 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe58c010980 con 0x7fe5a00b3150 2024-09-10T22:45:38.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.481+0000 7fe59d600640 1 -- 172.21.15.103:0/3598794760 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c010dd0 con 0x7fe5a00b3150 2024-09-10T22:45:38.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.481+0000 7fe5a7e00640 1 -- 172.21.15.103:0/3598794760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a01fb070 con 0x7fe5a00b3150 2024-09-10T22:45:38.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.481+0000 7fe5a7e00640 1 -- 172.21.15.103:0/3598794760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a01fb630 con 0x7fe5a00b3150 2024-09-10T22:45:38.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.481+0000 7fe5a7e00640 1 -- 172.21.15.103:0/3598794760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5a0154870 con 0x7fe5a00b3150 2024-09-10T22:45:38.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.481+0000 7fe59d600640 1 -- 172.21.15.103:0/3598794760 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe58c00f3c0 con 0x7fe5a00b3150 2024-09-10T22:45:38.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.481+0000 7fe59d600640 1 --2- 172.21.15.103:0/3598794760 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe5800725e0 0x7fe580074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:38.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.481+0000 7fe59d600640 1 -- 172.21.15.103:0/3598794760 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fe58c0934a0 con 0x7fe5a00b3150 2024-09-10T22:45:38.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.485+0000 7fe5a5400640 1 --2- 172.21.15.103:0/3598794760 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe5800725e0 0x7fe580074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:38.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.485+0000 7fe5a5400640 1 --2- 172.21.15.103:0/3598794760 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe5800725e0 0x7fe580074aa0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe59400ab40 tx=0x7fe59400a250 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:38.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.485+0000 7fe59d600640 1 -- 172.21.15.103:0/3598794760 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe58c05e340 con 0x7fe5a00b3150 2024-09-10T22:45:38.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.689+0000 7fe5a7e00640 1 -- 172.21.15.103:0/3598794760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5a0072500 con 0x7fe5a00b3150 2024-09-10T22:45:38.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.693+0000 7fe59d600640 1 -- 172.21.15.103:0/3598794760 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5278 (secure 0 0 0) 0x7fe58c062d70 con 0x7fe5a00b3150 2024-09-10T22:45:38.695 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:38.695 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":112,"btime":"2024-09-10T22:45:38:529602+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:45:38.529595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8238,"mds_1":8235,"mds_2":7717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7717":{"gid":7717,"name":"b","rank":2,"incarnation":111,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8235":{"gid":8235,"name":"a","rank":1,"incarnation":109,"state":"up:active","state_seq":5,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[7717,8235,8238]},"id":7}]} 2024-09-10T22:45:38.696 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 112 2024-09-10T22:45:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.693+0000 7fe5a7e00640 1 -- 172.21.15.103:0/3598794760 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe5800725e0 msgr2=0x7fe580074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.693+0000 7fe5a7e00640 1 --2- 172.21.15.103:0/3598794760 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe5800725e0 0x7fe580074aa0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe59400ab40 tx=0x7fe59400a250 comp rx=0 tx=0).stop 2024-09-10T22:45:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.693+0000 7fe5a7e00640 1 -- 172.21.15.103:0/3598794760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a00b3150 msgr2=0x7fe5a01fa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.693+0000 7fe5a7e00640 1 --2- 172.21.15.103:0/3598794760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a00b3150 0x7fe5a01fa890 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00b480 tx=0x7fe58c00b940 comp rx=0 tx=0).stop 2024-09-10T22:45:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.693+0000 7fe5a7e00640 1 -- 172.21.15.103:0/3598794760 shutdown_connections 2024-09-10T22:45:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.693+0000 7fe5a7e00640 1 --2- 172.21.15.103:0/3598794760 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe5800725e0 0x7fe580074aa0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.693+0000 7fe5a7e00640 1 --2- 172.21.15.103:0/3598794760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5a00cf260 0x7fe5a015bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.693+0000 7fe5a7e00640 1 --2- 172.21.15.103:0/3598794760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a00b3150 0x7fe5a01fa890 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.693+0000 7fe5a7e00640 1 --2- 172.21.15.103:0/3598794760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5a0072a40 0x7fe5a01433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.693+0000 7fe5a7e00640 1 -- 172.21.15.103:0/3598794760 >> 172.21.15.103:0/3598794760 conn(0x7fe5a006cc00 msgr2=0x7fe5a006fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.693+0000 7fe5a7e00640 1 -- 172.21.15.103:0/3598794760 shutdown_connections 2024-09-10T22:45:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:38.693+0000 7fe5a7e00640 1 -- 172.21.15.103:0/3598794760 wait complete. 2024-09-10T22:45:39.119 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 112, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T22:45:27.857904+0000', 'modified': '2024-09-10T22:45:38.529595+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 8238, 'mds_1': 8235, 'mds_2': 7717}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7717': {'gid': 7717, 'name': 'b', 'rank': 2, 'incarnation': 111, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.131:6837/1281268106', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6835', 'nonce': 1281268106}, {'type': 'v1', 'addr': '172.21.15.131:6837', 'nonce': 1281268106}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_8235': {'gid': 8235, 'name': 'a', 'rank': 1, 'incarnation': 109, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.103:6833/1191295180', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6832', 'nonce': 1191295180}, {'type': 'v1', 'addr': '172.21.15.103:6833', 'nonce': 1191295180}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_8238': {'gid': 8238, 'name': 'c', 'rank': 0, 'incarnation': 104, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/3550082240', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6834', 'nonce': 3550082240}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 3550082240}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8238, 'qdb_cluster': [7717, 8235, 8238]} 2024-09-10T22:45:39.476 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T22:45:39.476 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-10T22:45:39.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.621+0000 7facbb600640 1 -- 172.21.15.103:0/2444241692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb40ae7f0 msgr2=0x7facb4166bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:39.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.621+0000 7facbb600640 1 --2- 172.21.15.103:0/2444241692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb40ae7f0 0x7facb4166bc0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7facac009bc0 tx=0x7facac01cba0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.621+0000 7facbb600640 1 -- 172.21.15.103:0/2444241692 shutdown_connections 2024-09-10T22:45:39.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.621+0000 7facbb600640 1 --2- 172.21.15.103:0/2444241692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb40ae7f0 0x7facb4166bc0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.621+0000 7facbb600640 1 -- 172.21.15.103:0/2444241692 >> 172.21.15.103:0/2444241692 conn(0x7facb40d1a20 msgr2=0x7facb40d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:39.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.621+0000 7facbb600640 1 -- 172.21.15.103:0/2444241692 shutdown_connections 2024-09-10T22:45:39.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.621+0000 7facbb600640 1 -- 172.21.15.103:0/2444241692 wait complete. 2024-09-10T22:45:39.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facbb600640 1 Processor -- start 2024-09-10T22:45:39.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facbb600640 1 -- start start 2024-09-10T22:45:39.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facbb600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facb40ae7f0 0x7facb4158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facbb600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facb40cdd00 0x7facb4157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facbb600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb415f1a0 0x7facb414f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facbb600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7facb4169cb0 con 0x7facb40ae7f0 2024-09-10T22:45:39.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facbb600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7facb4169b30 con 0x7facb415f1a0 2024-09-10T22:45:39.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facbb600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7facb4169e30 con 0x7facb40cdd00 2024-09-10T22:45:39.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facb8c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facb40ae7f0 0x7facb4158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facb8c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facb40ae7f0 0x7facb4158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41214/0 (socket says 172.21.15.103:41214) 2024-09-10T22:45:39.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facb8c00640 1 -- 172.21.15.103:0/1444314270 learned_addr learned my addr 172.21.15.103:0/1444314270 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:39.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facb9600640 1 --2- 172.21.15.103:0/1444314270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb415f1a0 0x7facb414f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facb3e00640 1 --2- 172.21.15.103:0/1444314270 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facb40cdd00 0x7facb4157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facb8c00640 1 -- 172.21.15.103:0/1444314270 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facb40cdd00 msgr2=0x7facb4157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:39.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facb8c00640 1 --2- 172.21.15.103:0/1444314270 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facb40cdd00 0x7facb4157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facb8c00640 1 -- 172.21.15.103:0/1444314270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb415f1a0 msgr2=0x7facb414f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:39.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facb8c00640 1 --2- 172.21.15.103:0/1444314270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb415f1a0 0x7facb414f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facb8c00640 1 -- 172.21.15.103:0/1444314270 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb414f880 con 0x7facb40ae7f0 2024-09-10T22:45:39.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facb3e00640 1 --2- 172.21.15.103:0/1444314270 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facb40cdd00 0x7facb4157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:39.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facb8c00640 1 --2- 172.21.15.103:0/1444314270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facb40ae7f0 0x7facb4158880 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7faca8001ec0 tx=0x7faca800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:39.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facb0c00640 1 -- 172.21.15.103:0/1444314270 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8017070 con 0x7facb40ae7f0 2024-09-10T22:45:39.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facb0c00640 1 -- 172.21.15.103:0/1444314270 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faca8003600 con 0x7facb40ae7f0 2024-09-10T22:45:39.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facb0c00640 1 -- 172.21.15.103:0/1444314270 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8003a50 con 0x7facb40ae7f0 2024-09-10T22:45:39.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facbb600640 1 -- 172.21.15.103:0/1444314270 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb4156ec0 con 0x7facb40ae7f0 2024-09-10T22:45:39.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.625+0000 7facbb600640 1 -- 172.21.15.103:0/1444314270 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb4157480 con 0x7facb40ae7f0 2024-09-10T22:45:39.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.629+0000 7facb0c00640 1 -- 172.21.15.103:0/1444314270 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7faca8003bf0 con 0x7facb40ae7f0 2024-09-10T22:45:39.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.629+0000 7facbea91000 1 Processor -- start 2024-09-10T22:45:39.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.629+0000 7facbea91000 1 -- start start 2024-09-10T22:45:39.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.629+0000 7facb0c00640 1 --2- 172.21.15.103:0/1444314270 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fac940725e0 0x7fac94074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.629+0000 7facb0c00640 1 -- 172.21.15.103:0/1444314270 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7faca8092a50 con 0x7facb40ae7f0 2024-09-10T22:45:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.629+0000 7facb9600640 1 --2- 172.21.15.103:0/1444314270 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fac940725e0 0x7fac94074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.629+0000 7facbea91000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbb389d0 0x55aacbb38db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.629+0000 7facbea91000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 0x55aacbaec8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.629+0000 7facbea91000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 0x55aacbaed1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.629+0000 7facbea91000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55aacba0d3f0 con 0x55aacbaece10 2024-09-10T22:45:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.629+0000 7facbea91000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55aacb94ab20 con 0x55aacbb389d0 2024-09-10T22:45:39.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.629+0000 7facbea91000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55aacb939f50 con 0x55aacbb392f0 2024-09-10T22:45:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.629+0000 7facb9600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 0x55aacbaed1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.629+0000 7facb8c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbb389d0 0x55aacbb38db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facb8c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbb389d0 0x55aacbb38db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:51306/0 (socket says 172.21.15.103:51306) 2024-09-10T22:45:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facb3e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 0x55aacbaec8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facb8c00640 1 -- 172.21.15.103:0/3456267442 learned_addr learned my addr 172.21.15.103:0/3456267442 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facb9600640 1 --2- 172.21.15.103:0/1444314270 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fac940725e0 0x7fac94074aa0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7facac0af000 tx=0x7facac01b3e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facb8c00640 1 -- 172.21.15.103:0/3456267442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 msgr2=0x55aacbaec8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facb8c00640 1 --2- 172.21.15.103:0/3456267442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 0x55aacbaec8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facb8c00640 1 -- 172.21.15.103:0/3456267442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 msgr2=0x55aacbaed1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:39.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facb8c00640 1 --2- 172.21.15.103:0/3456267442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 0x55aacbaed1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facb8c00640 1 -- 172.21.15.103:0/3456267442 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aacb901590 con 0x55aacbb389d0 2024-09-10T22:45:39.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facb8c00640 1 --2- 172.21.15.103:0/3456267442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbb389d0 0x55aacbb38db0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7faca8003fd0 tx=0x7faca805cfc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f673645dc9baec1b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:39.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7faca5600640 1 -- 172.21.15.103:0/3456267442 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca805d850 con 0x55aacbb389d0 2024-09-10T22:45:39.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7faca5600640 1 -- 172.21.15.103:0/3456267442 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faca8062030 con 0x55aacbb389d0 2024-09-10T22:45:39.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7faca5600640 1 -- 172.21.15.103:0/3456267442 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca805ede0 con 0x55aacbb389d0 2024-09-10T22:45:39.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facbea91000 1 -- 172.21.15.103:0/3456267442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbb389d0 msgr2=0x55aacbb38db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:39.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facbea91000 1 --2- 172.21.15.103:0/3456267442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbb389d0 0x55aacbb38db0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7faca8003fd0 tx=0x7faca805cfc0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facbea91000 1 -- 172.21.15.103:0/3456267442 shutdown_connections 2024-09-10T22:45:39.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facbea91000 1 --2- 172.21.15.103:0/3456267442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 0x55aacbaed1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facbea91000 1 --2- 172.21.15.103:0/3456267442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 0x55aacbaec8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facbea91000 1 --2- 172.21.15.103:0/3456267442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbb389d0 0x55aacbb38db0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facbea91000 1 -- 172.21.15.103:0/3456267442 >> 172.21.15.103:0/3456267442 conn(0x55aacb9d6130 msgr2=0x55aacbb1be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:39.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facbea91000 1 -- 172.21.15.103:0/3456267442 shutdown_connections 2024-09-10T22:45:39.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facbea91000 1 -- 172.21.15.103:0/3456267442 wait complete. 2024-09-10T22:45:39.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facbea91000 1 -- start start 2024-09-10T22:45:39.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facbea91000 1 Processor -- start 2024-09-10T22:45:39.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facbea91000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbaece10 0x55aacbb196a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facbea91000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbb389d0 0x55aacbb19e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facbea91000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 0x55aacbb1a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facbea91000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55aacb8d45d0 con 0x55aacbb389d0 2024-09-10T22:45:39.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facbea91000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55aacb93dd60 con 0x55aacbaece10 2024-09-10T22:45:39.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facbea91000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55aacb8e0500 con 0x55aacbb392f0 2024-09-10T22:45:39.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facbea91000 10 client.0 _ll_register_callbacks cb 0x55aacb8e4810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:39.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facb3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbb389d0 0x55aacbb19e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facb3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbb389d0 0x55aacbb19e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41240/0 (socket says 172.21.15.103:41240) 2024-09-10T22:45:39.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facb3e00640 1 -- 172.21.15.103:0/3421806198 learned_addr learned my addr 172.21.15.103:0/3421806198 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:39.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facb8c00640 1 --2- 172.21.15.103:0/3421806198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbaece10 0x55aacbb196a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.633+0000 7facb9600640 1 --2- 172.21.15.103:0/3421806198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 0x55aacbb1a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facb3e00640 1 -- 172.21.15.103:0/3421806198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 msgr2=0x55aacbb1a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:39.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facb3e00640 1 --2- 172.21.15.103:0/3421806198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 0x55aacbb1a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facb3e00640 1 -- 172.21.15.103:0/3421806198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbaece10 msgr2=0x55aacbb196a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:39.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facb3e00640 1 --2- 172.21.15.103:0/3421806198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbaece10 0x55aacbb196a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facb3e00640 1 -- 172.21.15.103:0/3421806198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aacb8d8170 con 0x55aacbb389d0 2024-09-10T22:45:39.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facb3e00640 1 --2- 172.21.15.103:0/3421806198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbb389d0 0x55aacbb19e70 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7faca0010470 tx=0x7faca0010930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a5db4509266f60 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:39.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7fac9a000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:39.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7fac9a000640 1 -- 172.21.15.103:0/3421806198 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca0018070 con 0x55aacbb389d0 2024-09-10T22:45:39.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7fac9a000640 1 -- 172.21.15.103:0/3421806198 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7faca0014850 con 0x55aacbb389d0 2024-09-10T22:45:39.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 1 -- 172.21.15.103:0/3421806198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aacb8d20f0 con 0x55aacbb389d0 2024-09-10T22:45:39.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7fac9a000640 1 -- 172.21.15.103:0/3421806198 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7faca0023050 con 0x55aacbb389d0 2024-09-10T22:45:39.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 10 client.8394 fetch_fsmap learned FSMap version 112 2024-09-10T22:45:39.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 1 -- 172.21.15.103:0/3421806198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55aacb9beef0 con 0x55aacbb389d0 2024-09-10T22:45:39.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7fac9a000640 1 -- 172.21.15.103:0/3421806198 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55aacb8d20f0 con 0x55aacbb389d0 2024-09-10T22:45:39.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7fac9a000640 1 -- 172.21.15.103:0/3421806198 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 112) ==== 3542+0+0 (secure 0 0 0) 0x7faca0026020 con 0x55aacbb389d0 2024-09-10T22:45:39.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 10 client.8394 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T22:45:39.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 10 client.8394 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T22:45:39.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 20 client.8394 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:39.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 1 --2- 172.21.15.103:0/3421806198 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55aacbb1b0f0 0x55aacbb4ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 4 client.8394 mds_command: new command op to 7717 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:45:39.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 1 -- 172.21.15.103:0/3421806198 --> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aacb94ca70 con 0x55aacbb1b0f0 2024-09-10T22:45:39.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facb8c00640 1 --2- 172.21.15.103:0/3421806198 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55aacbb1b0f0 0x55aacbb4ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facb8c00640 1 --2- 172.21.15.103:0/3421806198 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55aacbb1b0f0 0x55aacbb4ac90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3fee995693709d07 server_cookie=c5422e0462b0b3fb in_seq=0 out_seq=0 2024-09-10T22:45:39.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7fac9a000640 10 client.8394 ms_handle_connect on v2:172.21.15.131:6835/1281268106 2024-09-10T22:45:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7fac9a000640 1 -- 172.21.15.103:0/3421806198 <== mds.2 v2:172.21.15.131:6835/1281268106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aacb94ca70 con 0x55aacbb1b0f0 2024-09-10T22:45:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7fac9a000640 10 client.8394 handle_command_reply: tid=0 2024-09-10T22:45:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 1 client.8394 shutdown 2024-09-10T22:45:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 1 -- 172.21.15.103:0/3421806198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbb389d0 msgr2=0x55aacbb19e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 1 --2- 172.21.15.103:0/3421806198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbb389d0 0x55aacbb19e70 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7faca0010470 tx=0x7faca0010930 comp rx=0 tx=0).stop 2024-09-10T22:45:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 1 -- 172.21.15.103:0/3421806198 shutdown_connections 2024-09-10T22:45:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 1 --2- 172.21.15.103:0/3421806198 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55aacbb1b0f0 0x55aacbb4ac90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 1 --2- 172.21.15.103:0/3421806198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 0x55aacbb1a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 1 --2- 172.21.15.103:0/3421806198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbb389d0 0x55aacbb19e70 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 1 --2- 172.21.15.103:0/3421806198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbaece10 0x55aacbb196a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7fac9a000640 0 client.8394 ms_handle_reset on v2:172.21.15.131:6835/1281268106 2024-09-10T22:45:39.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 1 -- 172.21.15.103:0/3421806198 >> 172.21.15.103:0/3421806198 conn(0x55aacb9d6130 msgr2=0x55aacbaebfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:39.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 1 -- 172.21.15.103:0/3421806198 shutdown_connections 2024-09-10T22:45:39.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 1 -- 172.21.15.103:0/3421806198 wait complete. 2024-09-10T22:45:39.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.637+0000 7facbea91000 20 client.8394 trim_cache size 0 max 16384 2024-09-10T22:45:39.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facbea91000 1 Processor -- start 2024-09-10T22:45:39.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facbea91000 1 -- start start 2024-09-10T22:45:39.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facbea91000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 0x55aacbbb33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facbea91000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbb389d0 0x55aacbbb3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facbea91000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 0x55aacbbb3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facbea91000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7facb42042a0 con 0x55aacbaece10 2024-09-10T22:45:39.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facbea91000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7facb4203520 con 0x55aacbb389d0 2024-09-10T22:45:39.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facbea91000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7facb4203bd0 con 0x55aacbb392f0 2024-09-10T22:45:39.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facb8c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 0x55aacbbb33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facb8c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 0x55aacbbb33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41248/0 (socket says 172.21.15.103:41248) 2024-09-10T22:45:39.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facb8c00640 1 -- 172.21.15.103:0/2995034960 learned_addr learned my addr 172.21.15.103:0/2995034960 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facb9600640 1 --2- 172.21.15.103:0/2995034960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 0x55aacbbb3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facb8c00640 1 -- 172.21.15.103:0/2995034960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 msgr2=0x55aacbbb3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facb3e00640 1 --2- 172.21.15.103:0/2995034960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbb389d0 0x55aacbbb3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facb8c00640 1 --2- 172.21.15.103:0/2995034960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 0x55aacbbb3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facb8c00640 1 -- 172.21.15.103:0/2995034960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbb389d0 msgr2=0x55aacbbb3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facb8c00640 1 --2- 172.21.15.103:0/2995034960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbb389d0 0x55aacbbb3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facb8c00640 1 -- 172.21.15.103:0/2995034960 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aacb995d90 con 0x55aacbaece10 2024-09-10T22:45:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facb9600640 1 --2- 172.21.15.103:0/2995034960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 0x55aacbbb3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facb3e00640 1 --2- 172.21.15.103:0/2995034960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbb389d0 0x55aacbbb3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7facb8c00640 1 --2- 172.21.15.103:0/2995034960 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 0x55aacbbb33d0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7faca800cd90 tx=0x7faca8001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93ef22dc2225681 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.657+0000 7faca4c00640 1 -- 172.21.15.103:0/2995034960 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8059ea0 con 0x55aacbaece10 2024-09-10T22:45:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7faca4c00640 1 -- 172.21.15.103:0/2995034960 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faca8062040 con 0x55aacbaece10 2024-09-10T22:45:39.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7faca4c00640 1 -- 172.21.15.103:0/2995034960 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca805d850 con 0x55aacbaece10 2024-09-10T22:45:39.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 -- 172.21.15.103:0/2995034960 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 msgr2=0x55aacbbb33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:39.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 --2- 172.21.15.103:0/2995034960 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 0x55aacbbb33d0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7faca800cd90 tx=0x7faca8001090 comp rx=0 tx=0).stop 2024-09-10T22:45:39.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 -- 172.21.15.103:0/2995034960 shutdown_connections 2024-09-10T22:45:39.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 --2- 172.21.15.103:0/2995034960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 0x55aacbbb3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 --2- 172.21.15.103:0/2995034960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbb389d0 0x55aacbbb3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 --2- 172.21.15.103:0/2995034960 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 0x55aacbbb33d0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 -- 172.21.15.103:0/2995034960 >> 172.21.15.103:0/2995034960 conn(0x55aacb9d6130 msgr2=0x55aacbb45fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:39.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 -- 172.21.15.103:0/2995034960 shutdown_connections 2024-09-10T22:45:39.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 -- 172.21.15.103:0/2995034960 wait complete. 2024-09-10T22:45:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 -- start start 2024-09-10T22:45:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 Processor -- start 2024-09-10T22:45:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 0x55aacbbb7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbb389d0 0x55aacbbb7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 0x55aacbbb7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55aacb8d45d0 con 0x55aacbaece10 2024-09-10T22:45:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55aacbb4fce0 con 0x55aacbb389d0 2024-09-10T22:45:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55aacb93d070 con 0x55aacbb392f0 2024-09-10T22:45:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 10 client.0 _ll_register_callbacks cb 0x7faca0001420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facb8c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 0x55aacbbb7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facb8c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 0x55aacbbb7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41262/0 (socket says 172.21.15.103:41262) 2024-09-10T22:45:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facb8c00640 1 -- 172.21.15.103:0/1293018424 learned_addr learned my addr 172.21.15.103:0/1293018424 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facb8c00640 1 -- 172.21.15.103:0/1293018424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 msgr2=0x55aacbbb7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facb8c00640 1 --2- 172.21.15.103:0/1293018424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 0x55aacbbb7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facb8c00640 1 -- 172.21.15.103:0/1293018424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbb389d0 msgr2=0x55aacbbb7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facb8c00640 1 --2- 172.21.15.103:0/1293018424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbb389d0 0x55aacbbb7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facb8c00640 1 -- 172.21.15.103:0/1293018424 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aacb900a90 con 0x55aacbaece10 2024-09-10T22:45:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facb8c00640 1 --2- 172.21.15.103:0/1293018424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 0x55aacbbb7200 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7faca8090da0 tx=0x7faca8059f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61277b9c49ac3afe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7fac9a000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:39.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7fac9a000640 1 -- 172.21.15.103:0/1293018424 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8087060 con 0x55aacbaece10 2024-09-10T22:45:39.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7fac9a000640 1 -- 172.21.15.103:0/1293018424 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7faca805eb80 con 0x55aacbaece10 2024-09-10T22:45:39.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 -- 172.21.15.103:0/1293018424 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faca8062040 con 0x55aacbaece10 2024-09-10T22:45:39.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7fac9a000640 1 -- 172.21.15.103:0/1293018424 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7faca805d850 con 0x55aacbaece10 2024-09-10T22:45:39.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 10 client.8400 fetch_fsmap learned FSMap version 112 2024-09-10T22:45:39.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 1 -- 172.21.15.103:0/1293018424 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55aacb8df050 con 0x55aacbaece10 2024-09-10T22:45:39.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7fac9a000640 1 -- 172.21.15.103:0/1293018424 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faca8062040 con 0x55aacbaece10 2024-09-10T22:45:39.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7fac9a000640 1 -- 172.21.15.103:0/1293018424 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 112) ==== 3542+0+0 (secure 0 0 0) 0x7faca805cab0 con 0x55aacbaece10 2024-09-10T22:45:39.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.661+0000 7facbea91000 10 client.8400 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T22:45:39.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbea91000 10 client.8400 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T22:45:39.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbea91000 20 client.8400 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:39.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbea91000 1 --2- 172.21.15.103:0/1293018424 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55aacbb4cc10 0x55aacbb4cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbea91000 4 client.8400 mds_command: new command op to 7717 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:45:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbea91000 1 -- 172.21.15.103:0/1293018424 --> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] -- command(tid 0: {"prefix": "status"}) -- 0x55aacb948520 con 0x55aacbb4cc10 2024-09-10T22:45:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facb3e00640 1 --2- 172.21.15.103:0/1293018424 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55aacbb4cc10 0x55aacbb4cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facb3e00640 1 --2- 172.21.15.103:0/1293018424 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55aacbb4cc10 0x55aacbb4cff0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=778303bf96cbd6b0 server_cookie=4982c323a9a8e4c3 in_seq=0 out_seq=0 2024-09-10T22:45:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7fac9a000640 10 client.8400 ms_handle_connect on v2:172.21.15.131:6835/1281268106 2024-09-10T22:45:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7fac9a000640 1 -- 172.21.15.103:0/1293018424 <== mds.2 v2:172.21.15.131:6835/1281268106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x55aacb948520 con 0x55aacbb4cc10 2024-09-10T22:45:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7fac9a000640 10 client.8400 handle_command_reply: tid=0 2024-09-10T22:45:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbea91000 1 client.8400 shutdown 2024-09-10T22:45:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbea91000 1 -- 172.21.15.103:0/1293018424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 msgr2=0x55aacbbb7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbea91000 1 --2- 172.21.15.103:0/1293018424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 0x55aacbbb7200 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7faca8090da0 tx=0x7faca8059f20 comp rx=0 tx=0).stop 2024-09-10T22:45:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbea91000 1 -- 172.21.15.103:0/1293018424 shutdown_connections 2024-09-10T22:45:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbea91000 1 --2- 172.21.15.103:0/1293018424 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55aacbb4cc10 0x55aacbb4cff0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbea91000 1 --2- 172.21.15.103:0/1293018424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aacbb392f0 0x55aacbbb7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbea91000 1 --2- 172.21.15.103:0/1293018424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aacbb389d0 0x55aacbbb7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbea91000 1 --2- 172.21.15.103:0/1293018424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aacbaece10 0x55aacbbb7200 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7fac9a000640 0 client.8400 ms_handle_reset on v2:172.21.15.131:6835/1281268106 2024-09-10T22:45:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbea91000 1 -- 172.21.15.103:0/1293018424 >> 172.21.15.103:0/1293018424 conn(0x55aacb9d6130 msgr2=0x55aacbaf4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbea91000 1 -- 172.21.15.103:0/1293018424 shutdown_connections 2024-09-10T22:45:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbea91000 1 -- 172.21.15.103:0/1293018424 wait complete. 2024-09-10T22:45:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbea91000 20 client.8400 trim_cache size 0 max 16384 2024-09-10T22:45:39.675 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:45:39.675 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:45:39.675 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 2, 2024-09-10T22:45:39.676 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7717, 2024-09-10T22:45:39.676 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:45:39.676 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:45:39.676 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:45:39.676 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 2.1395409929999998, 2024-09-10T22:45:39.676 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 112, 2024-09-10T22:45:39.676 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 107, 2024-09-10T22:45:39.676 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 107, 2024-09-10T22:45:39.676 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 15.662189504000001 2024-09-10T22:45:39.676 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:45:39.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbb600640 1 -- 172.21.15.103:0/1444314270 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fac940725e0 msgr2=0x7fac94074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:39.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbb600640 1 --2- 172.21.15.103:0/1444314270 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fac940725e0 0x7fac94074aa0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7facac0af000 tx=0x7facac01b3e0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbb600640 1 -- 172.21.15.103:0/1444314270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facb40ae7f0 msgr2=0x7facb4158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbb600640 1 --2- 172.21.15.103:0/1444314270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facb40ae7f0 0x7facb4158880 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7faca8001ec0 tx=0x7faca800c890 comp rx=0 tx=0).stop 2024-09-10T22:45:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbb600640 1 -- 172.21.15.103:0/1444314270 shutdown_connections 2024-09-10T22:45:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbb600640 1 --2- 172.21.15.103:0/1444314270 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fac940725e0 0x7fac94074aa0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbb600640 1 --2- 172.21.15.103:0/1444314270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb415f1a0 0x7facb414f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbb600640 1 --2- 172.21.15.103:0/1444314270 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7facb40cdd00 0x7facb4157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbb600640 1 --2- 172.21.15.103:0/1444314270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facb40ae7f0 0x7facb4158880 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbb600640 1 -- 172.21.15.103:0/1444314270 >> 172.21.15.103:0/1444314270 conn(0x7facb40d1a20 msgr2=0x7facb4070830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:39.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbb600640 1 -- 172.21.15.103:0/1444314270 shutdown_connections 2024-09-10T22:45:39.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.665+0000 7facbb600640 1 -- 172.21.15.103:0/1444314270 wait complete. 2024-09-10T22:45:39.688 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T22:45:39.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.825+0000 7fc950600640 1 -- 172.21.15.103:0/1471711171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9480b3150 msgr2=0x7fc948072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:39.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.825+0000 7fc950600640 1 --2- 172.21.15.103:0/1471711171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9480b3150 0x7fc948072500 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fc948070730 tx=0x7fc93401c8c0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc950600640 1 -- 172.21.15.103:0/1471711171 shutdown_connections 2024-09-10T22:45:39.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc950600640 1 --2- 172.21.15.103:0/1471711171 >> v2:172.21.15.131:3300/0 conn(0x7fc948072a40 0x7fc948157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc950600640 1 --2- 172.21.15.103:0/1471711171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9480b3150 0x7fc948072500 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc950600640 1 --2- 172.21.15.103:0/1471711171 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9480cf260 0x7fc9480b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc950600640 1 -- 172.21.15.103:0/1471711171 >> 172.21.15.103:0/1471711171 conn(0x7fc94806cc00 msgr2=0x7fc94806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:39.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc950600640 1 -- 172.21.15.103:0/1471711171 shutdown_connections 2024-09-10T22:45:39.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc950600640 1 -- 172.21.15.103:0/1471711171 wait complete. 2024-09-10T22:45:39.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc950600640 1 Processor -- start 2024-09-10T22:45:39.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc950600640 1 -- start start 2024-09-10T22:45:39.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc950600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc948072a40 0x7fc9480aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc950600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9480b3150 0x7fc9481508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc950600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9480cf260 0x7fc948149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc950600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc948157a10 con 0x7fc9480b3150 2024-09-10T22:45:39.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc950600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc948157890 con 0x7fc948072a40 2024-09-10T22:45:39.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc950600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc948157b90 con 0x7fc9480cf260 2024-09-10T22:45:39.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc94d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9480b3150 0x7fc9481508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc94d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9480b3150 0x7fc9481508a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41276/0 (socket says 172.21.15.103:41276) 2024-09-10T22:45:39.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc94d200640 1 -- 172.21.15.103:0/2737330136 learned_addr learned my addr 172.21.15.103:0/2737330136 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:39.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc94dc00640 1 --2- 172.21.15.103:0/2737330136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc948072a40 0x7fc9480aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc94e600640 1 --2- 172.21.15.103:0/2737330136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9480cf260 0x7fc948149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc94d200640 1 -- 172.21.15.103:0/2737330136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9480cf260 msgr2=0x7fc948149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:39.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc94d200640 1 --2- 172.21.15.103:0/2737330136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9480cf260 0x7fc948149140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc94d200640 1 -- 172.21.15.103:0/2737330136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc948072a40 msgr2=0x7fc9480aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:39.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc94d200640 1 --2- 172.21.15.103:0/2737330136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc948072a40 0x7fc9480aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc94d200640 1 -- 172.21.15.103:0/2737330136 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc948151210 con 0x7fc9480b3150 2024-09-10T22:45:39.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc94dc00640 1 --2- 172.21.15.103:0/2737330136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc948072a40 0x7fc9480aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:39.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc94d200640 1 --2- 172.21.15.103:0/2737330136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9480b3150 0x7fc9481508a0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fc9340b0040 tx=0x7fc9340a5630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:39.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc945600640 1 -- 172.21.15.103:0/2737330136 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9340b2040 con 0x7fc9480b3150 2024-09-10T22:45:39.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc945600640 1 -- 172.21.15.103:0/2737330136 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9340043a0 con 0x7fc9480b3150 2024-09-10T22:45:39.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc950600640 1 -- 172.21.15.103:0/2737330136 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9481514f0 con 0x7fc9480b3150 2024-09-10T22:45:39.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.829+0000 7fc945600640 1 -- 172.21.15.103:0/2737330136 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934005290 con 0x7fc9480b3150 2024-09-10T22:45:39.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.833+0000 7fc950600640 1 -- 172.21.15.103:0/2737330136 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc94814d340 con 0x7fc9480b3150 2024-09-10T22:45:39.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.833+0000 7fc945600640 1 -- 172.21.15.103:0/2737330136 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc934005430 con 0x7fc9480b3150 2024-09-10T22:45:39.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.833+0000 7fc945600640 1 --2- 172.21.15.103:0/2737330136 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9280725e0 0x7fc928074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.833+0000 7fc945600640 1 -- 172.21.15.103:0/2737330136 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fc93412cf40 con 0x7fc9480b3150 2024-09-10T22:45:39.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.833+0000 7fc9539e4000 1 Processor -- start 2024-09-10T22:45:39.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.833+0000 7fc94dc00640 1 --2- 172.21.15.103:0/2737330136 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9280725e0 0x7fc928074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.833+0000 7fc9539e4000 1 -- start start 2024-09-10T22:45:39.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc94dc00640 1 --2- 172.21.15.103:0/2737330136 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9280725e0 0x7fc928074aa0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc93c006fd0 tx=0x7fc93c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:39.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc9539e4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5fcdc0 0x5613fb5fd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc9539e4000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fd6e0 0x5613fb5b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc9539e4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5613fb5b1220 0x5613fb5b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc9539e4000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5613fb4cd3f0 con 0x5613fb5fd6e0 2024-09-10T22:45:39.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc9539e4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5613fb40ab20 con 0x5613fb5b1220 2024-09-10T22:45:39.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc9539e4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5613fb3f9f50 con 0x5613fb5fcdc0 2024-09-10T22:45:39.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc94d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fd6e0 0x5613fb5b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc94d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fd6e0 0x5613fb5b0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41292/0 (socket says 172.21.15.103:41292) 2024-09-10T22:45:39.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc94d200640 1 -- 172.21.15.103:0/377375279 learned_addr learned my addr 172.21.15.103:0/377375279 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:39.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc94d200640 1 -- 172.21.15.103:0/377375279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5fcdc0 msgr2=0x5613fb5fd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:39.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc94d200640 1 --2- 172.21.15.103:0/377375279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5fcdc0 0x5613fb5fd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc94d200640 1 -- 172.21.15.103:0/377375279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5613fb5b1220 msgr2=0x5613fb5b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:39.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc94d200640 1 --2- 172.21.15.103:0/377375279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5613fb5b1220 0x5613fb5b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc94d200640 1 -- 172.21.15.103:0/377375279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613fb3c1590 con 0x5613fb5fd6e0 2024-09-10T22:45:39.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc94d200640 1 --2- 172.21.15.103:0/377375279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fd6e0 0x5613fb5b0ce0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fc9340f7c40 tx=0x7fc9340f4430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3f6ab293f24499 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:39.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc93a000640 1 -- 172.21.15.103:0/377375279 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9340f7420 con 0x5613fb5fd6e0 2024-09-10T22:45:39.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc93a000640 1 -- 172.21.15.103:0/377375279 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9340f83b0 con 0x5613fb5fd6e0 2024-09-10T22:45:39.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc93a000640 1 -- 172.21.15.103:0/377375279 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9340f7cb0 con 0x5613fb5fd6e0 2024-09-10T22:45:39.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc9539e4000 1 -- 172.21.15.103:0/377375279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fd6e0 msgr2=0x5613fb5b0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:39.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc9539e4000 1 --2- 172.21.15.103:0/377375279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fd6e0 0x5613fb5b0ce0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fc9340f7c40 tx=0x7fc9340f4430 comp rx=0 tx=0).stop 2024-09-10T22:45:39.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc9539e4000 1 -- 172.21.15.103:0/377375279 shutdown_connections 2024-09-10T22:45:39.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc9539e4000 1 --2- 172.21.15.103:0/377375279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5613fb5b1220 0x5613fb5b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc9539e4000 1 --2- 172.21.15.103:0/377375279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fd6e0 0x5613fb5b0ce0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc9539e4000 1 --2- 172.21.15.103:0/377375279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5fcdc0 0x5613fb5fd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc9539e4000 1 -- 172.21.15.103:0/377375279 >> 172.21.15.103:0/377375279 conn(0x5613fb496130 msgr2=0x5613fb5dbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:39.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc9539e4000 1 -- 172.21.15.103:0/377375279 shutdown_connections 2024-09-10T22:45:39.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc9539e4000 1 -- 172.21.15.103:0/377375279 wait complete. 2024-09-10T22:45:39.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc9539e4000 1 -- start start 2024-09-10T22:45:39.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc9539e4000 1 Processor -- start 2024-09-10T22:45:39.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.837+0000 7fc9539e4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5b1220 0x5613fb5e7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fcdc0 0x5613fb5e78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5613fb5fd6e0 0x5613fb5e7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5613fb3945d0 con 0x5613fb5fcdc0 2024-09-10T22:45:39.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5613fb3fdd60 con 0x5613fb5fd6e0 2024-09-10T22:45:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5613fb3a0500 con 0x5613fb5b1220 2024-09-10T22:45:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 10 client.0 _ll_register_callbacks cb 0x5613fb3a4810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc94d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fcdc0 0x5613fb5e78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc94d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fcdc0 0x5613fb5e78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41298/0 (socket says 172.21.15.103:41298) 2024-09-10T22:45:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc94d200640 1 -- 172.21.15.103:0/3792509630 learned_addr learned my addr 172.21.15.103:0/3792509630 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc94d200640 1 -- 172.21.15.103:0/3792509630 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5b1220 msgr2=0x5613fb5e7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc94d200640 1 --2- 172.21.15.103:0/3792509630 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5b1220 0x5613fb5e7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc94d200640 1 -- 172.21.15.103:0/3792509630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5613fb5fd6e0 msgr2=0x5613fb5e7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc94d200640 1 --2- 172.21.15.103:0/3792509630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5613fb5fd6e0 0x5613fb5e7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc94d200640 1 -- 172.21.15.103:0/3792509630 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613fb398170 con 0x5613fb5fcdc0 2024-09-10T22:45:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc94d200640 1 --2- 172.21.15.103:0/3792509630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fcdc0 0x5613fb5e78a0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fc934098350 tx=0x7fc9340f7530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc2d0e0ff364584 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:39.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc92ea00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc92ea00640 1 -- 172.21.15.103:0/3792509630 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9340f83b0 con 0x5613fb5fcdc0 2024-09-10T22:45:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc92ea00640 1 -- 172.21.15.103:0/3792509630 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fc9340f6f10 con 0x5613fb5fcdc0 2024-09-10T22:45:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 -- 172.21.15.103:0/3792509630 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5613fb3920f0 con 0x5613fb5fcdc0 2024-09-10T22:45:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc92ea00640 1 -- 172.21.15.103:0/3792509630 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7fc9340fc790 con 0x5613fb5fcdc0 2024-09-10T22:45:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 10 client.8412 fetch_fsmap learned FSMap version 112 2024-09-10T22:45:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 -- 172.21.15.103:0/3792509630 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x5613fb47eef0 con 0x5613fb5fcdc0 2024-09-10T22:45:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc92ea00640 1 -- 172.21.15.103:0/3792509630 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5613fb3920f0 con 0x5613fb5fcdc0 2024-09-10T22:45:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc92ea00640 1 -- 172.21.15.103:0/3792509630 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 112) ==== 3542+0+0 (secure 0 0 0) 0x7fc934111b40 con 0x5613fb5fcdc0 2024-09-10T22:45:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 10 client.8412 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T22:45:39.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 10 client.8412 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T22:45:39.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 20 client.8412 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:39.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 --2- 172.21.15.103:0/3792509630 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x5613fb5e87f0 0x5613fb60e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 4 client.8412 mds_command: new command op to 8235 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:45:39.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 -- 172.21.15.103:0/3792509630 --> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613fb40ca70 con 0x5613fb5e87f0 2024-09-10T22:45:39.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc94dc00640 1 --2- 172.21.15.103:0/3792509630 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x5613fb5e87f0 0x5613fb60e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc92ea00640 10 client.8412 ms_handle_connect on v2:172.21.15.103:6832/1191295180 2024-09-10T22:45:39.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc94dc00640 1 --2- 172.21.15.103:0/3792509630 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x5613fb5e87f0 0x5613fb60e070 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c8bbf94db6ec174b server_cookie=344dab445d184840 in_seq=0 out_seq=0 2024-09-10T22:45:39.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc92ea00640 1 -- 172.21.15.103:0/3792509630 <== mds.1 v2:172.21.15.103:6832/1191295180 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5613fb40ca70 con 0x5613fb5e87f0 2024-09-10T22:45:39.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc92ea00640 10 client.8412 handle_command_reply: tid=0 2024-09-10T22:45:39.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 client.8412 shutdown 2024-09-10T22:45:39.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 -- 172.21.15.103:0/3792509630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fcdc0 msgr2=0x5613fb5e78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:39.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 --2- 172.21.15.103:0/3792509630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fcdc0 0x5613fb5e78a0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fc934098350 tx=0x7fc9340f7530 comp rx=0 tx=0).stop 2024-09-10T22:45:39.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 -- 172.21.15.103:0/3792509630 shutdown_connections 2024-09-10T22:45:39.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 --2- 172.21.15.103:0/3792509630 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x5613fb5e87f0 0x5613fb60e070 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 --2- 172.21.15.103:0/3792509630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5613fb5fd6e0 0x5613fb5e7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 --2- 172.21.15.103:0/3792509630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fcdc0 0x5613fb5e78a0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc92ea00640 0 client.8412 ms_handle_reset on v2:172.21.15.103:6832/1191295180 2024-09-10T22:45:39.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 --2- 172.21.15.103:0/3792509630 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5b1220 0x5613fb5e7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 -- 172.21.15.103:0/3792509630 >> 172.21.15.103:0/3792509630 conn(0x5613fb496130 msgr2=0x5613fb5ab8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:39.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 -- 172.21.15.103:0/3792509630 shutdown_connections 2024-09-10T22:45:39.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 1 -- 172.21.15.103:0/3792509630 wait complete. 2024-09-10T22:45:39.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.841+0000 7fc9539e4000 20 client.8412 trim_cache size 0 max 16384 2024-09-10T22:45:39.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.861+0000 7fc9539e4000 1 Processor -- start 2024-09-10T22:45:39.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.861+0000 7fc9539e4000 1 -- start start 2024-09-10T22:45:39.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.861+0000 7fc9539e4000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5b1220 0x5613fb5d8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.861+0000 7fc9539e4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5fcdc0 0x5613fb5d9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.861+0000 7fc9539e4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5613fb5fd6e0 0x5613fb5ae850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.861+0000 7fc9539e4000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5613fb40ab20 con 0x5613fb5b1220 2024-09-10T22:45:39.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.861+0000 7fc9539e4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5613fb47ea60 con 0x5613fb5fd6e0 2024-09-10T22:45:39.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.861+0000 7fc9539e4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5613fb4cd3f0 con 0x5613fb5fcdc0 2024-09-10T22:45:39.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.861+0000 7fc94dc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5b1220 0x5613fb5d8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.861+0000 7fc94dc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5b1220 0x5613fb5d8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41304/0 (socket says 172.21.15.103:41304) 2024-09-10T22:45:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.861+0000 7fc94dc00640 1 -- 172.21.15.103:0/3419347405 learned_addr learned my addr 172.21.15.103:0/3419347405 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.861+0000 7fc94d200640 1 --2- 172.21.15.103:0/3419347405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5fcdc0 0x5613fb5d9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.861+0000 7fc94e600640 1 --2- 172.21.15.103:0/3419347405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5613fb5fd6e0 0x5613fb5ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.861+0000 7fc94dc00640 1 -- 172.21.15.103:0/3419347405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5fcdc0 msgr2=0x5613fb5d9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.861+0000 7fc94dc00640 1 --2- 172.21.15.103:0/3419347405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5fcdc0 0x5613fb5d9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.861+0000 7fc94dc00640 1 -- 172.21.15.103:0/3419347405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5613fb5fd6e0 msgr2=0x5613fb5ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.861+0000 7fc94dc00640 1 --2- 172.21.15.103:0/3419347405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5613fb5fd6e0 0x5613fb5ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.861+0000 7fc94dc00640 1 -- 172.21.15.103:0/3419347405 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613fb455d90 con 0x5613fb5b1220 2024-09-10T22:45:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc94dc00640 1 --2- 172.21.15.103:0/3419347405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5b1220 0x5613fb5d8f40 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x5613fb3fcdc0 tx=0x7fc93c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6612dfa7a9e90ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:39.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc939600640 1 -- 172.21.15.103:0/3419347405 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c016110 con 0x5613fb5b1220 2024-09-10T22:45:39.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc939600640 1 -- 172.21.15.103:0/3419347405 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc93c005930 con 0x5613fb5b1220 2024-09-10T22:45:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc939600640 1 -- 172.21.15.103:0/3419347405 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c005d40 con 0x5613fb5b1220 2024-09-10T22:45:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc9539e4000 1 -- 172.21.15.103:0/3419347405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5b1220 msgr2=0x5613fb5d8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc9539e4000 1 --2- 172.21.15.103:0/3419347405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5b1220 0x5613fb5d8f40 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x5613fb3fcdc0 tx=0x7fc93c004740 comp rx=0 tx=0).stop 2024-09-10T22:45:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc9539e4000 1 -- 172.21.15.103:0/3419347405 shutdown_connections 2024-09-10T22:45:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc9539e4000 1 --2- 172.21.15.103:0/3419347405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5613fb5fd6e0 0x5613fb5ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc9539e4000 1 --2- 172.21.15.103:0/3419347405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5fcdc0 0x5613fb5d9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc9539e4000 1 --2- 172.21.15.103:0/3419347405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5b1220 0x5613fb5d8f40 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc9539e4000 1 -- 172.21.15.103:0/3419347405 >> 172.21.15.103:0/3419347405 conn(0x5613fb496130 msgr2=0x5613fb5ba280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc9539e4000 1 -- 172.21.15.103:0/3419347405 shutdown_connections 2024-09-10T22:45:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc9539e4000 1 -- 172.21.15.103:0/3419347405 wait complete. 2024-09-10T22:45:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc9539e4000 1 -- start start 2024-09-10T22:45:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc9539e4000 1 Processor -- start 2024-09-10T22:45:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc9539e4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5b1220 0x5613fb6777c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc9539e4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5613fb5fcdc0 0x5613fb677d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc9539e4000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fd6e0 0x5613fb678240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc9539e4000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5613fb4b9730 con 0x5613fb5fd6e0 2024-09-10T22:45:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc9539e4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5613fb3fd070 con 0x5613fb5fcdc0 2024-09-10T22:45:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc9539e4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5613fb3c5ec0 con 0x5613fb5b1220 2024-09-10T22:45:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc9539e4000 10 client.0 _ll_register_callbacks cb 0x7fc9340f4300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc94dc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5b1220 0x5613fb6777c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc94e600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fd6e0 0x5613fb678240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc94dc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5b1220 0x5613fb6777c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:42672/0 (socket says 172.21.15.103:42672) 2024-09-10T22:45:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc94dc00640 1 -- 172.21.15.103:0/682246830 learned_addr learned my addr 172.21.15.103:0/682246830 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc94d200640 1 --2- 172.21.15.103:0/682246830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5613fb5fcdc0 0x5613fb677d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc94e600640 1 -- 172.21.15.103:0/682246830 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5b1220 msgr2=0x5613fb6777c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc94e600640 1 --2- 172.21.15.103:0/682246830 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5b1220 0x5613fb6777c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc94e600640 1 -- 172.21.15.103:0/682246830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5613fb5fcdc0 msgr2=0x5613fb677d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc94e600640 1 --2- 172.21.15.103:0/682246830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5613fb5fcdc0 0x5613fb677d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc94e600640 1 -- 172.21.15.103:0/682246830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613fb3c0a90 con 0x5613fb5fd6e0 2024-09-10T22:45:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.865+0000 7fc94dc00640 1 --2- 172.21.15.103:0/682246830 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5b1220 0x5613fb6777c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:45:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc94e600640 1 --2- 172.21.15.103:0/682246830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fd6e0 0x5613fb678240 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fc9400098a0 tx=0x7fc940005410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3453b58df8d0cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc92ea00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc92ea00640 1 -- 172.21.15.103:0/682246830 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940003b80 con 0x5613fb5fd6e0 2024-09-10T22:45:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc92ea00640 1 -- 172.21.15.103:0/682246830 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fc940003d20 con 0x5613fb5fd6e0 2024-09-10T22:45:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 1 -- 172.21.15.103:0/682246830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc93c005930 con 0x5613fb5fd6e0 2024-09-10T22:45:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc92ea00640 1 -- 172.21.15.103:0/682246830 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7fc940022050 con 0x5613fb5fd6e0 2024-09-10T22:45:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 10 client.8418 fetch_fsmap learned FSMap version 112 2024-09-10T22:45:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 1 -- 172.21.15.103:0/682246830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x5613fb39f050 con 0x5613fb5fd6e0 2024-09-10T22:45:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc92ea00640 1 -- 172.21.15.103:0/682246830 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc93c005930 con 0x5613fb5fd6e0 2024-09-10T22:45:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc92ea00640 1 -- 172.21.15.103:0/682246830 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 112) ==== 3542+0+0 (secure 0 0 0) 0x7fc940025020 con 0x5613fb5fd6e0 2024-09-10T22:45:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 10 client.8418 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T22:45:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 10 client.8418 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T22:45:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 20 client.8418 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 1 --2- 172.21.15.103:0/682246830 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x5613fb60e5f0 0x5613fb60d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 4 client.8418 mds_command: new command op to 8235 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:45:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 1 -- 172.21.15.103:0/682246830 --> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] -- command(tid 0: {"prefix": "status"}) -- 0x5613fb408520 con 0x5613fb60e5f0 2024-09-10T22:45:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc94dc00640 1 --2- 172.21.15.103:0/682246830 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x5613fb60e5f0 0x5613fb60d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc94dc00640 1 --2- 172.21.15.103:0/682246830 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x5613fb60e5f0 0x5613fb60d6b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3d8b1915f80c44c9 server_cookie=ab1cae04a3595782 in_seq=0 out_seq=0 2024-09-10T22:45:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc92ea00640 10 client.8418 ms_handle_connect on v2:172.21.15.103:6832/1191295180 2024-09-10T22:45:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc92ea00640 1 -- 172.21.15.103:0/682246830 <== mds.1 v2:172.21.15.103:6832/1191295180 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x5613fb408520 con 0x5613fb60e5f0 2024-09-10T22:45:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc92ea00640 10 client.8418 handle_command_reply: tid=0 2024-09-10T22:45:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 1 client.8418 shutdown 2024-09-10T22:45:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 1 -- 172.21.15.103:0/682246830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fd6e0 msgr2=0x5613fb678240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 1 --2- 172.21.15.103:0/682246830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fd6e0 0x5613fb678240 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fc9400098a0 tx=0x7fc940005410 comp rx=0 tx=0).stop 2024-09-10T22:45:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 1 -- 172.21.15.103:0/682246830 shutdown_connections 2024-09-10T22:45:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 1 --2- 172.21.15.103:0/682246830 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x5613fb60e5f0 0x5613fb60d6b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 1 --2- 172.21.15.103:0/682246830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613fb5fd6e0 0x5613fb678240 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 1 --2- 172.21.15.103:0/682246830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5613fb5fcdc0 0x5613fb677d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 1 --2- 172.21.15.103:0/682246830 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5613fb5b1220 0x5613fb6777c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc92ea00640 0 client.8418 ms_handle_reset on v2:172.21.15.103:6832/1191295180 2024-09-10T22:45:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 1 -- 172.21.15.103:0/682246830 >> 172.21.15.103:0/682246830 conn(0x5613fb496130 msgr2=0x5613fb5d7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 1 -- 172.21.15.103:0/682246830 shutdown_connections 2024-09-10T22:45:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 1 -- 172.21.15.103:0/682246830 wait complete. 2024-09-10T22:45:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc9539e4000 20 client.8418 trim_cache size 0 max 16384 2024-09-10T22:45:39.878 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:45:39.878 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:45:39.879 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 1, 2024-09-10T22:45:39.879 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 8235, 2024-09-10T22:45:39.879 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:45:39.879 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:45:39.879 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:45:39.879 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 3.350171258, 2024-09-10T22:45:39.879 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 112, 2024-09-10T22:45:39.879 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 107, 2024-09-10T22:45:39.879 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 107, 2024-09-10T22:45:39.879 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 15.872669167 2024-09-10T22:45:39.880 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:45:39.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc950600640 1 -- 172.21.15.103:0/2737330136 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9280725e0 msgr2=0x7fc928074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:39.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc950600640 1 --2- 172.21.15.103:0/2737330136 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9280725e0 0x7fc928074aa0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc93c006fd0 tx=0x7fc93c008040 comp rx=0 tx=0).stop 2024-09-10T22:45:39.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc950600640 1 -- 172.21.15.103:0/2737330136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9480b3150 msgr2=0x7fc9481508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:39.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc950600640 1 --2- 172.21.15.103:0/2737330136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9480b3150 0x7fc9481508a0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fc9340b0040 tx=0x7fc9340a5630 comp rx=0 tx=0).stop 2024-09-10T22:45:39.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc950600640 1 -- 172.21.15.103:0/2737330136 shutdown_connections 2024-09-10T22:45:39.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc950600640 1 --2- 172.21.15.103:0/2737330136 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9280725e0 0x7fc928074aa0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc950600640 1 --2- 172.21.15.103:0/2737330136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9480cf260 0x7fc948149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc950600640 1 --2- 172.21.15.103:0/2737330136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9480b3150 0x7fc9481508a0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc950600640 1 --2- 172.21.15.103:0/2737330136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc948072a40 0x7fc9480aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:39.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc950600640 1 -- 172.21.15.103:0/2737330136 >> 172.21.15.103:0/2737330136 conn(0x7fc94806cc00 msgr2=0x7fc948156740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:39.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc950600640 1 -- 172.21.15.103:0/2737330136 shutdown_connections 2024-09-10T22:45:39.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:39.869+0000 7fc950600640 1 -- 172.21.15.103:0/2737330136 wait complete. 2024-09-10T22:45:39.893 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T22:45:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa513a00640 1 -- 172.21.15.103:0/428467254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa50c0cdd00 msgr2=0x7fa50c0ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa513a00640 1 --2- 172.21.15.103:0/428467254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa50c0cdd00 0x7fa50c0ae7f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009900 tx=0x7fa4f401c8e0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa513a00640 1 -- 172.21.15.103:0/428467254 shutdown_connections 2024-09-10T22:45:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa513a00640 1 --2- 172.21.15.103:0/428467254 >> v2:172.21.15.131:3300/0 conn(0x7fa50c0cd500 0x7fa50c15f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa513a00640 1 --2- 172.21.15.103:0/428467254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa50c0cdd00 0x7fa50c0ae7f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa513a00640 1 -- 172.21.15.103:0/428467254 >> 172.21.15.103:0/428467254 conn(0x7fa50c0d1a20 msgr2=0x7fa50c0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:40.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa513a00640 1 -- 172.21.15.103:0/428467254 shutdown_connections 2024-09-10T22:45:40.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa513a00640 1 -- 172.21.15.103:0/428467254 wait complete. 2024-09-10T22:45:40.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa513a00640 1 Processor -- start 2024-09-10T22:45:40.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa513a00640 1 -- start start 2024-09-10T22:45:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa513a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c0cd500 0x7fa50c156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa513a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c0cdd00 0x7fa50c1f7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa513a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa50c15f1a0 0x7fa50c0b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa513a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa50c168f60 con 0x7fa50c0cdd00 2024-09-10T22:45:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa513a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa50c168de0 con 0x7fa50c0cd500 2024-09-10T22:45:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa513a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa50c1690e0 con 0x7fa50c15f1a0 2024-09-10T22:45:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa503e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c0cdd00 0x7fa50c1f7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa503e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c0cdd00 0x7fa50c1f7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41322/0 (socket says 172.21.15.103:41322) 2024-09-10T22:45:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa503e00640 1 -- 172.21.15.103:0/3716573776 learned_addr learned my addr 172.21.15.103:0/3716573776 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa511a00640 1 --2- 172.21.15.103:0/3716573776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa50c15f1a0 0x7fa50c0b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.033+0000 7fa511000640 1 --2- 172.21.15.103:0/3716573776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c0cd500 0x7fa50c156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.037+0000 7fa503e00640 1 -- 172.21.15.103:0/3716573776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa50c15f1a0 msgr2=0x7fa50c0b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:40.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.037+0000 7fa503e00640 1 --2- 172.21.15.103:0/3716573776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa50c15f1a0 0x7fa50c0b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.037+0000 7fa503e00640 1 -- 172.21.15.103:0/3716573776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c0cd500 msgr2=0x7fa50c156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:40.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.037+0000 7fa503e00640 1 --2- 172.21.15.103:0/3716573776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c0cd500 0x7fa50c156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.037+0000 7fa503e00640 1 -- 172.21.15.103:0/3716573776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa50c1f85b0 con 0x7fa50c0cdd00 2024-09-10T22:45:40.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.037+0000 7fa503e00640 1 --2- 172.21.15.103:0/3716573776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c0cdd00 0x7fa50c1f7c10 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fa4f401a510 tx=0x7fa4f40a55a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:40.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.037+0000 7fa509600640 1 -- 172.21.15.103:0/3716573776 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40b2040 con 0x7fa50c0cdd00 2024-09-10T22:45:40.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.037+0000 7fa509600640 1 -- 172.21.15.103:0/3716573776 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4f40042c0 con 0x7fa50c0cdd00 2024-09-10T22:45:40.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.037+0000 7fa513a00640 1 -- 172.21.15.103:0/3716573776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa50c1f8890 con 0x7fa50c0cdd00 2024-09-10T22:45:40.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.037+0000 7fa509600640 1 -- 172.21.15.103:0/3716573776 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4005030 con 0x7fa50c0cdd00 2024-09-10T22:45:40.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.037+0000 7fa513a00640 1 -- 172.21.15.103:0/3716573776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa50c0aee80 con 0x7fa50c0cdd00 2024-09-10T22:45:40.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.037+0000 7fa509600640 1 -- 172.21.15.103:0/3716573776 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa4f40051d0 con 0x7fa50c0cdd00 2024-09-10T22:45:40.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.037+0000 7fa509600640 1 --2- 172.21.15.103:0/3716573776 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa4e80725e0 0x7fa4e8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.037+0000 7fa509600640 1 -- 172.21.15.103:0/3716573776 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fa4f412cdc0 con 0x7fa50c0cdd00 2024-09-10T22:45:40.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa516da3000 1 Processor -- start 2024-09-10T22:45:40.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa511000640 1 --2- 172.21.15.103:0/3716573776 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa4e80725e0 0x7fa4e8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa516da3000 1 -- start start 2024-09-10T22:45:40.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa511000640 1 --2- 172.21.15.103:0/3716573776 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa4e80725e0 0x7fa4e8074aa0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa50c1577e0 tx=0x7fa4fc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:40.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa516da3000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb519d0 0x5637bdb51db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa516da3000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb522f0 0x5637bdb058d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa516da3000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb05e10 0x5637bdb061f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa516da3000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5637bda263f0 con 0x5637bdb05e10 2024-09-10T22:45:40.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa516da3000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5637bd963b20 con 0x5637bdb519d0 2024-09-10T22:45:40.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa516da3000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5637bd952f50 con 0x5637bdb522f0 2024-09-10T22:45:40.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa511a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb05e10 0x5637bdb061f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa511a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb05e10 0x5637bdb061f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41328/0 (socket says 172.21.15.103:41328) 2024-09-10T22:45:40.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa511a00640 1 -- 172.21.15.103:0/2174314078 learned_addr learned my addr 172.21.15.103:0/2174314078 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:40.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa503e00640 1 --2- 172.21.15.103:0/2174314078 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb522f0 0x5637bdb058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa511000640 1 --2- 172.21.15.103:0/2174314078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb519d0 0x5637bdb51db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa511a00640 1 -- 172.21.15.103:0/2174314078 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb522f0 msgr2=0x5637bdb058d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:40.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa511a00640 1 --2- 172.21.15.103:0/2174314078 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb522f0 0x5637bdb058d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa511a00640 1 -- 172.21.15.103:0/2174314078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb519d0 msgr2=0x5637bdb51db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:40.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa511a00640 1 --2- 172.21.15.103:0/2174314078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb519d0 0x5637bdb51db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa511a00640 1 -- 172.21.15.103:0/2174314078 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637bd91a590 con 0x5637bdb05e10 2024-09-10T22:45:40.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa511a00640 1 --2- 172.21.15.103:0/2174314078 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb05e10 0x5637bdb061f0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fa504011490 tx=0x7fa504011950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67dba2c969cbdd86 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:40.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa501600640 1 -- 172.21.15.103:0/2174314078 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50401e070 con 0x5637bdb05e10 2024-09-10T22:45:40.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa501600640 1 -- 172.21.15.103:0/2174314078 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa50400f630 con 0x5637bdb05e10 2024-09-10T22:45:40.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa501600640 1 -- 172.21.15.103:0/2174314078 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50400fa20 con 0x5637bdb05e10 2024-09-10T22:45:40.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa516da3000 1 -- 172.21.15.103:0/2174314078 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb05e10 msgr2=0x5637bdb061f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:40.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa516da3000 1 --2- 172.21.15.103:0/2174314078 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb05e10 0x5637bdb061f0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fa504011490 tx=0x7fa504011950 comp rx=0 tx=0).stop 2024-09-10T22:45:40.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa516da3000 1 -- 172.21.15.103:0/2174314078 shutdown_connections 2024-09-10T22:45:40.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa516da3000 1 --2- 172.21.15.103:0/2174314078 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb05e10 0x5637bdb061f0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa516da3000 1 --2- 172.21.15.103:0/2174314078 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb522f0 0x5637bdb058d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa516da3000 1 --2- 172.21.15.103:0/2174314078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb519d0 0x5637bdb51db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa516da3000 1 -- 172.21.15.103:0/2174314078 >> 172.21.15.103:0/2174314078 conn(0x5637bd9ef130 msgr2=0x5637bdb34e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa516da3000 1 -- 172.21.15.103:0/2174314078 shutdown_connections 2024-09-10T22:45:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.041+0000 7fa516da3000 1 -- 172.21.15.103:0/2174314078 wait complete. 2024-09-10T22:45:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa516da3000 1 -- start start 2024-09-10T22:45:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa516da3000 1 Processor -- start 2024-09-10T22:45:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa516da3000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb05e10 0x5637bdb326a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa516da3000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb519d0 0x5637bdb32e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa516da3000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 0x5637bdb333b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa516da3000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5637bd8ed5d0 con 0x5637bdb522f0 2024-09-10T22:45:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa516da3000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5637bd956d60 con 0x5637bdb519d0 2024-09-10T22:45:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa516da3000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5637bd8f9500 con 0x5637bdb05e10 2024-09-10T22:45:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa516da3000 10 client.0 _ll_register_callbacks cb 0x5637bd8fd810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa511a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 0x5637bdb333b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa511a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 0x5637bdb333b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41344/0 (socket says 172.21.15.103:41344) 2024-09-10T22:45:40.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa511a00640 1 -- 172.21.15.103:0/4041375457 learned_addr learned my addr 172.21.15.103:0/4041375457 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:40.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa503e00640 1 --2- 172.21.15.103:0/4041375457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb519d0 0x5637bdb32e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa511000640 1 --2- 172.21.15.103:0/4041375457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb05e10 0x5637bdb326a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa511a00640 1 -- 172.21.15.103:0/4041375457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb05e10 msgr2=0x5637bdb326a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:40.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa511a00640 1 --2- 172.21.15.103:0/4041375457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb05e10 0x5637bdb326a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa511a00640 1 -- 172.21.15.103:0/4041375457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb519d0 msgr2=0x5637bdb32e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:40.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa511a00640 1 --2- 172.21.15.103:0/4041375457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb519d0 0x5637bdb32e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa511a00640 1 -- 172.21.15.103:0/4041375457 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637bd8f1170 con 0x5637bdb522f0 2024-09-10T22:45:40.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa511000640 1 --2- 172.21.15.103:0/4041375457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb05e10 0x5637bdb326a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:40.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa511a00640 1 --2- 172.21.15.103:0/4041375457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 0x5637bdb333b0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fa50401c040 tx=0x7fa50400fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63be82c9d200994d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:40.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa4fa000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:40.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa4fa000640 1 -- 172.21.15.103:0/4041375457 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa504026020 con 0x5637bdb522f0 2024-09-10T22:45:40.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa4fa000640 1 -- 172.21.15.103:0/4041375457 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fa50400fd00 con 0x5637bdb522f0 2024-09-10T22:45:40.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa516da3000 1 -- 172.21.15.103:0/4041375457 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5637bd8eb0f0 con 0x5637bdb522f0 2024-09-10T22:45:40.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa4fa000640 1 -- 172.21.15.103:0/4041375457 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7fa504030050 con 0x5637bdb522f0 2024-09-10T22:45:40.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa516da3000 10 client.8427 fetch_fsmap learned FSMap version 112 2024-09-10T22:45:40.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa516da3000 1 -- 172.21.15.103:0/4041375457 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x5637bd9d7ef0 con 0x5637bdb522f0 2024-09-10T22:45:40.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa4fa000640 1 -- 172.21.15.103:0/4041375457 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5637bd8eb0f0 con 0x5637bdb522f0 2024-09-10T22:45:40.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa4fa000640 1 -- 172.21.15.103:0/4041375457 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 112) ==== 3542+0+0 (secure 0 0 0) 0x7fa504033020 con 0x5637bdb522f0 2024-09-10T22:45:40.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa516da3000 10 client.8427 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T22:45:40.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa516da3000 10 client.8427 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:45:40.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa516da3000 20 client.8427 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:40.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa516da3000 1 --2- 172.21.15.103:0/4041375457 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x5637bdb340f0 0x5637bdb63c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa516da3000 4 client.8427 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:45:40.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa516da3000 1 -- 172.21.15.103:0/4041375457 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637bd965a70 con 0x5637bdb340f0 2024-09-10T22:45:40.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa511000640 1 --2- 172.21.15.103:0/4041375457 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x5637bdb340f0 0x5637bdb63c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa511000640 1 --2- 172.21.15.103:0/4041375457 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x5637bdb340f0 0x5637bdb63c90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a82697865ab41867 server_cookie=7799b08e37cb4ec in_seq=0 out_seq=0 2024-09-10T22:45:40.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.045+0000 7fa4fa000640 10 client.8427 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:40.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.049+0000 7fa4fa000640 1 -- 172.21.15.103:0/4041375457 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5637bd965a70 con 0x5637bdb340f0 2024-09-10T22:45:40.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.049+0000 7fa4fa000640 10 client.8427 handle_command_reply: tid=0 2024-09-10T22:45:40.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.049+0000 7fa516da3000 1 client.8427 shutdown 2024-09-10T22:45:40.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.049+0000 7fa516da3000 1 -- 172.21.15.103:0/4041375457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 msgr2=0x5637bdb333b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:40.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.049+0000 7fa516da3000 1 --2- 172.21.15.103:0/4041375457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 0x5637bdb333b0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fa50401c040 tx=0x7fa50400fb10 comp rx=0 tx=0).stop 2024-09-10T22:45:40.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.049+0000 7fa516da3000 1 -- 172.21.15.103:0/4041375457 shutdown_connections 2024-09-10T22:45:40.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.049+0000 7fa516da3000 1 --2- 172.21.15.103:0/4041375457 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x5637bdb340f0 0x5637bdb63c90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.049+0000 7fa516da3000 1 --2- 172.21.15.103:0/4041375457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 0x5637bdb333b0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.049+0000 7fa516da3000 1 --2- 172.21.15.103:0/4041375457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb519d0 0x5637bdb32e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.049+0000 7fa516da3000 1 --2- 172.21.15.103:0/4041375457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb05e10 0x5637bdb326a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.049+0000 7fa4fa000640 0 client.8427 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:40.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.049+0000 7fa516da3000 1 -- 172.21.15.103:0/4041375457 >> 172.21.15.103:0/4041375457 conn(0x5637bd9ef130 msgr2=0x5637bdb04fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:40.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.049+0000 7fa516da3000 1 -- 172.21.15.103:0/4041375457 shutdown_connections 2024-09-10T22:45:40.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.049+0000 7fa516da3000 1 -- 172.21.15.103:0/4041375457 wait complete. 2024-09-10T22:45:40.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.049+0000 7fa516da3000 20 client.8427 trim_cache size 0 max 16384 2024-09-10T22:45:40.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.065+0000 7fa516da3000 1 Processor -- start 2024-09-10T22:45:40.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.065+0000 7fa516da3000 1 -- start start 2024-09-10T22:45:40.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb05e10 0x5637bdbcc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb519d0 0x5637bdbccb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 0x5637bdbcd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa50c204a10 con 0x5637bdb522f0 2024-09-10T22:45:40.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa50c203c70 con 0x5637bdb519d0 2024-09-10T22:45:40.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa50c204340 con 0x5637bdb05e10 2024-09-10T22:45:40.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa511a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 0x5637bdbcd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa511a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 0x5637bdbcd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41360/0 (socket says 172.21.15.103:41360) 2024-09-10T22:45:40.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa511a00640 1 -- 172.21.15.103:0/2738392476 learned_addr learned my addr 172.21.15.103:0/2738392476 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:40.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa511a00640 1 -- 172.21.15.103:0/2738392476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb05e10 msgr2=0x5637bdbcc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:40.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa511a00640 1 --2- 172.21.15.103:0/2738392476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb05e10 0x5637bdbcc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa511a00640 1 -- 172.21.15.103:0/2738392476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb519d0 msgr2=0x5637bdbccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:40.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa511a00640 1 --2- 172.21.15.103:0/2738392476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb519d0 0x5637bdbccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa511a00640 1 -- 172.21.15.103:0/2738392476 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637bd9aed90 con 0x5637bdb522f0 2024-09-10T22:45:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa511a00640 1 --2- 172.21.15.103:0/2738392476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 0x5637bdbcd060 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fa504011e50 tx=0x7fa50400fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d16ce13944abf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa500c00640 1 -- 172.21.15.103:0/2738392476 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa504026040 con 0x5637bdb522f0 2024-09-10T22:45:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa500c00640 1 -- 172.21.15.103:0/2738392476 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa504011240 con 0x5637bdb522f0 2024-09-10T22:45:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa500c00640 1 -- 172.21.15.103:0/2738392476 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50401e040 con 0x5637bdb522f0 2024-09-10T22:45:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 -- 172.21.15.103:0/2738392476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 msgr2=0x5637bdbcd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 --2- 172.21.15.103:0/2738392476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 0x5637bdbcd060 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fa504011e50 tx=0x7fa50400fd90 comp rx=0 tx=0).stop 2024-09-10T22:45:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 -- 172.21.15.103:0/2738392476 shutdown_connections 2024-09-10T22:45:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 --2- 172.21.15.103:0/2738392476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 0x5637bdbcd060 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 --2- 172.21.15.103:0/2738392476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb519d0 0x5637bdbccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 --2- 172.21.15.103:0/2738392476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb05e10 0x5637bdbcc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 -- 172.21.15.103:0/2738392476 >> 172.21.15.103:0/2738392476 conn(0x5637bd9ef130 msgr2=0x5637bdb0da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:40.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 -- 172.21.15.103:0/2738392476 shutdown_connections 2024-09-10T22:45:40.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 -- 172.21.15.103:0/2738392476 wait complete. 2024-09-10T22:45:40.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 -- start start 2024-09-10T22:45:40.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 Processor -- start 2024-09-10T22:45:40.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb05e10 0x5637bdbd0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb519d0 0x5637bdbd0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 0x5637bdbd0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5637bda12730 con 0x5637bdb522f0 2024-09-10T22:45:40.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5637bd9628f0 con 0x5637bdb05e10 2024-09-10T22:45:40.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.069+0000 7fa516da3000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5637bd95b390 con 0x5637bdb519d0 2024-09-10T22:45:40.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 10 client.0 _ll_register_callbacks cb 0x7fa50401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:40.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa511a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 0x5637bdbd0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa511a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 0x5637bdbd0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41368/0 (socket says 172.21.15.103:41368) 2024-09-10T22:45:40.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa511a00640 1 -- 172.21.15.103:0/1793573059 learned_addr learned my addr 172.21.15.103:0/1793573059 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:40.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa503e00640 1 --2- 172.21.15.103:0/1793573059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb519d0 0x5637bdbd0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa511000640 1 --2- 172.21.15.103:0/1793573059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb05e10 0x5637bdbd0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa511a00640 1 -- 172.21.15.103:0/1793573059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb519d0 msgr2=0x5637bdbd0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:40.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa511a00640 1 --2- 172.21.15.103:0/1793573059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb519d0 0x5637bdbd0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa511a00640 1 -- 172.21.15.103:0/1793573059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb05e10 msgr2=0x5637bdbd0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:40.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa511a00640 1 --2- 172.21.15.103:0/1793573059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb05e10 0x5637bdbd0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa511a00640 1 -- 172.21.15.103:0/1793573059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637bd919a90 con 0x5637bdb522f0 2024-09-10T22:45:40.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa511a00640 1 --2- 172.21.15.103:0/1793573059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 0x5637bdbd0c80 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fa504025040 tx=0x7fa50402bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee21bd3499965513 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:40.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa4fa000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:40.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa4fa000640 1 -- 172.21.15.103:0/1793573059 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa504038030 con 0x5637bdb522f0 2024-09-10T22:45:40.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa4fa000640 1 -- 172.21.15.103:0/1793573059 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fa504004b30 con 0x5637bdb522f0 2024-09-10T22:45:40.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 1 -- 172.21.15.103:0/1793573059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa504011240 con 0x5637bdb522f0 2024-09-10T22:45:40.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa4fa000640 1 -- 172.21.15.103:0/1793573059 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7fa504043050 con 0x5637bdb522f0 2024-09-10T22:45:40.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 10 client.8433 fetch_fsmap learned FSMap version 112 2024-09-10T22:45:40.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 1 -- 172.21.15.103:0/1793573059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x5637bd8f8050 con 0x5637bdb522f0 2024-09-10T22:45:40.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa4fa000640 1 -- 172.21.15.103:0/1793573059 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa504011240 con 0x5637bdb522f0 2024-09-10T22:45:40.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa4fa000640 1 -- 172.21.15.103:0/1793573059 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 112) ==== 3542+0+0 (secure 0 0 0) 0x7fa504046020 con 0x5637bdb522f0 2024-09-10T22:45:40.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 10 client.8433 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T22:45:40.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 10 client.8433 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:45:40.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 20 client.8433 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:40.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 1 --2- 172.21.15.103:0/1793573059 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x5637bdb66360 0x5637bdb66740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 4 client.8433 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:45:40.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 1 -- 172.21.15.103:0/1793573059 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "status"}) -- 0x5637bd961520 con 0x5637bdb66360 2024-09-10T22:45:40.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa511000640 1 --2- 172.21.15.103:0/1793573059 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x5637bdb66360 0x5637bdb66740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa511000640 1 --2- 172.21.15.103:0/1793573059 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x5637bdb66360 0x5637bdb66740 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3704e8c36ab4f0 server_cookie=33af3b471bfd2fd6 in_seq=0 out_seq=0 2024-09-10T22:45:40.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa4fa000640 10 client.8433 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:40.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa4fa000640 1 -- 172.21.15.103:0/1793573059 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x5637bd961520 con 0x5637bdb66360 2024-09-10T22:45:40.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa4fa000640 10 client.8433 handle_command_reply: tid=0 2024-09-10T22:45:40.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 1 client.8433 shutdown 2024-09-10T22:45:40.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 1 -- 172.21.15.103:0/1793573059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 msgr2=0x5637bdbd0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:40.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 1 --2- 172.21.15.103:0/1793573059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 0x5637bdbd0c80 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fa504025040 tx=0x7fa50402bb90 comp rx=0 tx=0).stop 2024-09-10T22:45:40.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 1 -- 172.21.15.103:0/1793573059 shutdown_connections 2024-09-10T22:45:40.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 1 --2- 172.21.15.103:0/1793573059 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x5637bdb66360 0x5637bdb66740 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 1 --2- 172.21.15.103:0/1793573059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637bdb522f0 0x5637bdbd0c80 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 1 --2- 172.21.15.103:0/1793573059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5637bdb519d0 0x5637bdbd0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa4fa000640 0 client.8433 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:40.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 1 --2- 172.21.15.103:0/1793573059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5637bdb05e10 0x5637bdbd0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 1 -- 172.21.15.103:0/1793573059 >> 172.21.15.103:0/1793573059 conn(0x5637bd9ef130 msgr2=0x5637bdb505b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:40.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 1 -- 172.21.15.103:0/1793573059 shutdown_connections 2024-09-10T22:45:40.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 1 -- 172.21.15.103:0/1793573059 wait complete. 2024-09-10T22:45:40.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa516da3000 20 client.8433 trim_cache size 0 max 16384 2024-09-10T22:45:40.082 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:45:40.083 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "fb22394a-7771-44f4-99d8-bddd262146a5", 2024-09-10T22:45:40.083 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-10T22:45:40.083 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 8238, 2024-09-10T22:45:40.083 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T22:45:40.083 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T22:45:40.083 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-10T22:45:40.083 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 11.608067699999999, 2024-09-10T22:45:40.083 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 112, 2024-09-10T22:45:40.083 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 107, 2024-09-10T22:45:40.083 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 107, 2024-09-10T22:45:40.083 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 16.074726989999998 2024-09-10T22:45:40.084 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:45:40.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa513a00640 1 -- 172.21.15.103:0/3716573776 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa4e80725e0 msgr2=0x7fa4e8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:40.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa513a00640 1 --2- 172.21.15.103:0/3716573776 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa4e80725e0 0x7fa4e8074aa0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa50c1577e0 tx=0x7fa4fc009040 comp rx=0 tx=0).stop 2024-09-10T22:45:40.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa513a00640 1 -- 172.21.15.103:0/3716573776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c0cdd00 msgr2=0x7fa50c1f7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:40.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa513a00640 1 --2- 172.21.15.103:0/3716573776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c0cdd00 0x7fa50c1f7c10 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fa4f401a510 tx=0x7fa4f40a55a0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa513a00640 1 -- 172.21.15.103:0/3716573776 shutdown_connections 2024-09-10T22:45:40.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa513a00640 1 --2- 172.21.15.103:0/3716573776 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa4e80725e0 0x7fa4e8074aa0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa513a00640 1 --2- 172.21.15.103:0/3716573776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa50c15f1a0 0x7fa50c0b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa513a00640 1 --2- 172.21.15.103:0/3716573776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c0cdd00 0x7fa50c1f7c10 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa513a00640 1 --2- 172.21.15.103:0/3716573776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c0cd500 0x7fa50c156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.073+0000 7fa513a00640 1 -- 172.21.15.103:0/3716573776 >> 172.21.15.103:0/3716573776 conn(0x7fa50c0d1a20 msgr2=0x7fa50c159f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:40.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.077+0000 7fa513a00640 1 -- 172.21.15.103:0/3716573776 shutdown_connections 2024-09-10T22:45:40.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.077+0000 7fa513a00640 1 -- 172.21.15.103:0/3716573776 wait complete. 2024-09-10T22:45:40.098 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:45:40.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.233+0000 7f4a9bc00640 1 -- 172.21.15.103:0/3138452217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a940cc120 msgr2=0x7f4a940aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:40.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.233+0000 7f4a9bc00640 1 --2- 172.21.15.103:0/3138452217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a940cc120 0x7f4a940aeb40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4a84009900 tx=0x7f4a8401c850 comp rx=0 tx=0).stop 2024-09-10T22:45:40.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.233+0000 7f4a9bc00640 1 -- 172.21.15.103:0/3138452217 shutdown_connections 2024-09-10T22:45:40.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.233+0000 7f4a9bc00640 1 --2- 172.21.15.103:0/3138452217 >> v2:172.21.15.131:3300/0 conn(0x7f4a940cf790 0x7f4a940cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.233+0000 7f4a9bc00640 1 --2- 172.21.15.103:0/3138452217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a940cc120 0x7f4a940aeb40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.233+0000 7f4a9bc00640 1 -- 172.21.15.103:0/3138452217 >> 172.21.15.103:0/3138452217 conn(0x7f4a9406cc00 msgr2=0x7f4a9406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:40.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.233+0000 7f4a9bc00640 1 -- 172.21.15.103:0/3138452217 shutdown_connections 2024-09-10T22:45:40.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a9bc00640 1 -- 172.21.15.103:0/3138452217 wait complete. 2024-09-10T22:45:40.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a9bc00640 1 Processor -- start 2024-09-10T22:45:40.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a9bc00640 1 -- start start 2024-09-10T22:45:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a9bc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a940cc120 0x7f4a94156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a9bc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a940cf790 0x7f4a94161020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a9bc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a9415c970 0x7f4a9415ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a9bc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4a94168bf0 con 0x7f4a9415c970 2024-09-10T22:45:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a9bc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4a94168a70 con 0x7f4a940cf790 2024-09-10T22:45:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a9bc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4a94168d70 con 0x7f4a940cc120 2024-09-10T22:45:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a99c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a9415c970 0x7f4a9415ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a99200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a940cc120 0x7f4a94156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a93e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a940cf790 0x7f4a94161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a99200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a940cc120 0x7f4a94156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:42762/0 (socket says 172.21.15.103:42762) 2024-09-10T22:45:40.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a99200640 1 -- 172.21.15.103:0/3308731618 learned_addr learned my addr 172.21.15.103:0/3308731618 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:40.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a99200640 1 -- 172.21.15.103:0/3308731618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a940cf790 msgr2=0x7f4a94161020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a99200640 1 --2- 172.21.15.103:0/3308731618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a940cf790 0x7f4a94161020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a99200640 1 -- 172.21.15.103:0/3308731618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a9415c970 msgr2=0x7f4a9415ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a99200640 1 --2- 172.21.15.103:0/3308731618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a9415c970 0x7f4a9415ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a99200640 1 -- 172.21.15.103:0/3308731618 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a940af410 con 0x7f4a940cc120 2024-09-10T22:45:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.237+0000 7f4a99200640 1 --2- 172.21.15.103:0/3308731618 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a940cc120 0x7f4a94156ad0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a84009850 tx=0x7f4a840a5680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.241+0000 7f4a90c00640 1 -- 172.21.15.103:0/3308731618 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a840b2040 con 0x7f4a940cc120 2024-09-10T22:45:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.241+0000 7f4a90c00640 1 -- 172.21.15.103:0/3308731618 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a84004380 con 0x7f4a940cc120 2024-09-10T22:45:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.241+0000 7f4a9bc00640 1 -- 172.21.15.103:0/3308731618 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a940af6b0 con 0x7f4a940cc120 2024-09-10T22:45:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.241+0000 7f4a90c00640 1 -- 172.21.15.103:0/3308731618 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a84005290 con 0x7f4a940cc120 2024-09-10T22:45:40.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.241+0000 7f4a9bc00640 1 -- 172.21.15.103:0/3308731618 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a940afc70 con 0x7f4a940cc120 2024-09-10T22:45:40.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.241+0000 7f4a9bc00640 1 -- 172.21.15.103:0/3308731618 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a940cfc40 con 0x7f4a940cc120 2024-09-10T22:45:40.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.241+0000 7f4a90c00640 1 -- 172.21.15.103:0/3308731618 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4a84005430 con 0x7f4a940cc120 2024-09-10T22:45:40.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.241+0000 7f4a90c00640 1 --2- 172.21.15.103:0/3308731618 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4a740725e0 0x7f4a74074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:40.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.241+0000 7f4a90c00640 1 -- 172.21.15.103:0/3308731618 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f4a8412ce80 con 0x7f4a940cc120 2024-09-10T22:45:40.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.245+0000 7f4a93e00640 1 --2- 172.21.15.103:0/3308731618 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4a740725e0 0x7f4a74074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:40.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.245+0000 7f4a93e00640 1 --2- 172.21.15.103:0/3308731618 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4a740725e0 0x7f4a74074aa0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4a94070090 tx=0x7f4a80009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:40.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.245+0000 7f4a90c00640 1 -- 172.21.15.103:0/3308731618 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4a840164d0 con 0x7f4a940cc120 2024-09-10T22:45:40.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.445+0000 7f4a9bc00640 1 -- 172.21.15.103:0/3308731618 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a94075df0 con 0x7f4a940cc120 2024-09-10T22:45:40.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.445+0000 7f4a90c00640 1 -- 172.21.15.103:0/3308731618 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5278 (secure 0 0 0) 0x7f4a840f7d20 con 0x7f4a940cc120 2024-09-10T22:45:40.450 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:40.450 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":112,"btime":"2024-09-10T22:45:38:529602+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:45:38.529595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8238,"mds_1":8235,"mds_2":7717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7717":{"gid":7717,"name":"b","rank":2,"incarnation":111,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8235":{"gid":8235,"name":"a","rank":1,"incarnation":109,"state":"up:active","state_seq":5,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[7717,8235,8238]},"id":7}]} 2024-09-10T22:45:40.451 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 112 2024-09-10T22:45:40.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.449+0000 7f4a9bc00640 1 -- 172.21.15.103:0/3308731618 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4a740725e0 msgr2=0x7f4a74074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:40.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.449+0000 7f4a9bc00640 1 --2- 172.21.15.103:0/3308731618 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4a740725e0 0x7f4a74074aa0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4a94070090 tx=0x7f4a80009040 comp rx=0 tx=0).stop 2024-09-10T22:45:40.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.449+0000 7f4a9bc00640 1 -- 172.21.15.103:0/3308731618 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a940cc120 msgr2=0x7f4a94156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:40.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.449+0000 7f4a9bc00640 1 --2- 172.21.15.103:0/3308731618 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a940cc120 0x7f4a94156ad0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a84009850 tx=0x7f4a840a5680 comp rx=0 tx=0).stop 2024-09-10T22:45:40.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.449+0000 7f4a9bc00640 1 -- 172.21.15.103:0/3308731618 shutdown_connections 2024-09-10T22:45:40.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.449+0000 7f4a9bc00640 1 --2- 172.21.15.103:0/3308731618 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4a740725e0 0x7f4a74074aa0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.449+0000 7f4a9bc00640 1 --2- 172.21.15.103:0/3308731618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a9415c970 0x7f4a9415ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.449+0000 7f4a9bc00640 1 --2- 172.21.15.103:0/3308731618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a940cf790 0x7f4a94161020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.449+0000 7f4a9bc00640 1 --2- 172.21.15.103:0/3308731618 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4a940cc120 0x7f4a94156ad0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:40.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.449+0000 7f4a9bc00640 1 -- 172.21.15.103:0/3308731618 >> 172.21.15.103:0/3308731618 conn(0x7f4a9406cc00 msgr2=0x7f4a9415a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:40.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.449+0000 7f4a9bc00640 1 -- 172.21.15.103:0/3308731618 shutdown_connections 2024-09-10T22:45:40.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:40.449+0000 7f4a9bc00640 1 -- 172.21.15.103:0/3308731618 wait complete. 2024-09-10T22:45:40.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:40.473 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-10T22:45:40.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:40.502 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-10T22:45:40.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:40.559 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2024-09-10T22:45:40.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:40.613 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2024-09-10T22:45:40.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:40.665 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2024-09-10T22:45:40.717 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:45:40.915 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:45:40.915 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:45:40.916 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:45:42.917 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:45:43.085 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:45:43.086 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:45:43.086 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:45:45.087 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:45:45.255 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:45:45.255 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:45:45.255 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:45:47.256 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:45:47.426 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:45:47.426 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:45:47.426 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:45:47.562 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:45:47.565 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:45:49.428 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:45:49.595 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}}] 2024-09-10T22:45:49.596 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:45:49.596 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:45:51.597 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-10T22:45:51.765 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2024-09-10T22:45:51.766 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-10T22:45:51.766 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-10T22:45:51.767 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:45:51.922 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:45:51.923 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:45:51.923 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:45:53.924 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:45:54.091 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:45:54.092 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:45:54.092 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:45:56.093 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-10T22:45:56.260 INFO:teuthology.orchestra.run.smithi103.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-10T22:45:56.260 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:45:56.260 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:45:56.261 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-09-10T22:45:56.430 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-10T22:45:56.430 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-10T22:45:56.430 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-10T22:45:56.431 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 flush journal 2024-09-10T22:45:56.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.572+0000 7fa39c000640 1 -- 172.21.15.103:0/698929031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c004810 msgr2=0x7fa37c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:56.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.572+0000 7fa39c000640 1 --2- 172.21.15.103:0/698929031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c004810 0x7fa37c004c90 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fa380006f80 tx=0x7fa38001cec0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.572+0000 7fa39a000640 1 -- 172.21.15.103:0/698929031 reap_dead start 2024-09-10T22:45:56.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.572+0000 7fa39c000640 1 -- 172.21.15.103:0/698929031 shutdown_connections 2024-09-10T22:45:56.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.572+0000 7fa39c000640 1 -- 172.21.15.103:0/698929031 >> 172.21.15.103:0/698929031 conn(0x7fa39406cc00 msgr2=0x7fa39406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:56.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.572+0000 7fa39c000640 1 -- 172.21.15.103:0/698929031 shutdown_connections 2024-09-10T22:45:56.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.572+0000 7fa39c000640 1 -- 172.21.15.103:0/698929031 wait complete. 2024-09-10T22:45:56.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.572+0000 7fa39c000640 1 Processor -- start 2024-09-10T22:45:56.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.572+0000 7fa39c000640 1 -- start start 2024-09-10T22:45:56.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.572+0000 7fa39c000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c004810 0x7fa39414fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.572+0000 7fa39c000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa394153f20 0x7fa3940b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.572+0000 7fa39c000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3940b1af0 0x7fa39414d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.572+0000 7fa39c000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa39415f630 con 0x7fa37c004810 2024-09-10T22:45:56.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.572+0000 7fa39c000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa39415f4b0 con 0x7fa394153f20 2024-09-10T22:45:56.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.572+0000 7fa39c000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa39415f7b0 con 0x7fa3940b1af0 2024-09-10T22:45:56.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.572+0000 7fa399600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c004810 0x7fa39414fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.576+0000 7fa399600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c004810 0x7fa39414fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59468/0 (socket says 172.21.15.103:59468) 2024-09-10T22:45:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.576+0000 7fa399600640 1 -- 172.21.15.103:0/223690812 learned_addr learned my addr 172.21.15.103:0/223690812 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.576+0000 7fa398c00640 1 --2- 172.21.15.103:0/223690812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa394153f20 0x7fa3940b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.576+0000 7fa39a000640 1 --2- 172.21.15.103:0/223690812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3940b1af0 0x7fa39414d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.576+0000 7fa399600640 1 -- 172.21.15.103:0/223690812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3940b1af0 msgr2=0x7fa39414d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.576+0000 7fa399600640 1 --2- 172.21.15.103:0/223690812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3940b1af0 0x7fa39414d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.576+0000 7fa399600640 1 -- 172.21.15.103:0/223690812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa394153f20 msgr2=0x7fa3940b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.576+0000 7fa399600640 1 --2- 172.21.15.103:0/223690812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa394153f20 0x7fa3940b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.576+0000 7fa399600640 1 -- 172.21.15.103:0/223690812 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3941501b0 con 0x7fa37c004810 2024-09-10T22:45:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.576+0000 7fa399600640 1 --2- 172.21.15.103:0/223690812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c004810 0x7fa39414fc70 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fa388012b70 tx=0x7fa388012f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:56.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.576+0000 7fa391600640 1 -- 172.21.15.103:0/223690812 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa388013450 con 0x7fa37c004810 2024-09-10T22:45:56.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.576+0000 7fa391600640 1 -- 172.21.15.103:0/223690812 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa388017030 con 0x7fa37c004810 2024-09-10T22:45:56.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.576+0000 7fa391600640 1 -- 172.21.15.103:0/223690812 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa388013890 con 0x7fa37c004810 2024-09-10T22:45:56.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.576+0000 7fa39c000640 1 -- 172.21.15.103:0/223690812 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa39414dd90 con 0x7fa37c004810 2024-09-10T22:45:56.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.576+0000 7fa39c000640 1 -- 172.21.15.103:0/223690812 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa394153440 con 0x7fa37c004810 2024-09-10T22:45:56.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa391600640 1 -- 172.21.15.103:0/223690812 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa388013a30 con 0x7fa37c004810 2024-09-10T22:45:56.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa391600640 1 --2- 172.21.15.103:0/223690812 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa374072610 0x7fa374074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39f480000 1 Processor -- start 2024-09-10T22:45:56.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39f480000 1 -- start start 2024-09-10T22:45:56.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa391600640 1 -- 172.21.15.103:0/223690812 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fa3880975e0 con 0x7fa37c004810 2024-09-10T22:45:56.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa398c00640 1 --2- 172.21.15.103:0/223690812 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa374072610 0x7fa374074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39f480000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c6f1a0 0x563e25c6f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39f480000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 0x563e25c25680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39f480000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c25bc0 0x563e25c25fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39f480000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563e25b0dcb0 con 0x563e25c6f1a0 2024-09-10T22:45:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39f480000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563e25a23310 con 0x563e25c6fac0 2024-09-10T22:45:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39f480000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563e25a80b90 con 0x563e25c25bc0 2024-09-10T22:45:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa398c00640 1 --2- 172.21.15.103:0/223690812 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa374072610 0x7fa374074ad0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa3800aa000 tx=0x7fa380019d00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa399600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c6f1a0 0x563e25c6f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa399600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c6f1a0 0x563e25c6f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59470/0 (socket says 172.21.15.103:59470) 2024-09-10T22:45:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa399600640 1 -- 172.21.15.103:0/871247594 learned_addr learned my addr 172.21.15.103:0/871247594 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39a000640 1 --2- 172.21.15.103:0/871247594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c25bc0 0x563e25c25fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa398c00640 1 --2- 172.21.15.103:0/871247594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 0x563e25c25680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa399600640 1 -- 172.21.15.103:0/871247594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c25bc0 msgr2=0x563e25c25fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa399600640 1 --2- 172.21.15.103:0/871247594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c25bc0 0x563e25c25fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa399600640 1 -- 172.21.15.103:0/871247594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 msgr2=0x563e25c25680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa399600640 1 --2- 172.21.15.103:0/871247594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 0x563e25c25680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa399600640 1 -- 172.21.15.103:0/871247594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e25a24c60 con 0x563e25c6f1a0 2024-09-10T22:45:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39a000640 1 --2- 172.21.15.103:0/871247594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c25bc0 0x563e25c25fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa399600640 1 --2- 172.21.15.103:0/871247594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c6f1a0 0x563e25c6f580 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fa388001380 tx=0x7fa388061b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5baa9226c854941 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa386000640 1 -- 172.21.15.103:0/871247594 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa388022040 con 0x563e25c6f1a0 2024-09-10T22:45:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa386000640 1 -- 172.21.15.103:0/871247594 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa38806b1b0 con 0x563e25c6f1a0 2024-09-10T22:45:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa386000640 1 -- 172.21.15.103:0/871247594 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa388066e40 con 0x563e25c6f1a0 2024-09-10T22:45:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39f480000 1 -- 172.21.15.103:0/871247594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c6f1a0 msgr2=0x563e25c6f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39f480000 1 --2- 172.21.15.103:0/871247594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c6f1a0 0x563e25c6f580 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fa388001380 tx=0x7fa388061b80 comp rx=0 tx=0).stop 2024-09-10T22:45:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39f480000 1 -- 172.21.15.103:0/871247594 shutdown_connections 2024-09-10T22:45:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39f480000 1 --2- 172.21.15.103:0/871247594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c25bc0 0x563e25c25fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39f480000 1 --2- 172.21.15.103:0/871247594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 0x563e25c25680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39f480000 1 --2- 172.21.15.103:0/871247594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c6f1a0 0x563e25c6f580 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39f480000 1 -- 172.21.15.103:0/871247594 >> 172.21.15.103:0/871247594 conn(0x563e25c2bd20 msgr2=0x563e25c23f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39f480000 1 -- 172.21.15.103:0/871247594 shutdown_connections 2024-09-10T22:45:56.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.580+0000 7fa39f480000 1 -- 172.21.15.103:0/871247594 wait complete. 2024-09-10T22:45:56.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39f480000 1 -- start start 2024-09-10T22:45:56.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39f480000 1 Processor -- start 2024-09-10T22:45:56.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39f480000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 0x563e25c76530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39f480000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c6f1a0 0x563e25c76a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39f480000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 0x563e25c76fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39f480000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563e25a73dd0 con 0x563e25c25bc0 2024-09-10T22:45:56.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39f480000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563e25a6ffc0 con 0x563e25c6fac0 2024-09-10T22:45:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39f480000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563e25a154b0 con 0x563e25c6f1a0 2024-09-10T22:45:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39f480000 10 client.0 _ll_register_callbacks cb 0x563e259f37d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa399600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 0x563e25c76530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa399600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 0x563e25c76530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59472/0 (socket says 172.21.15.103:59472) 2024-09-10T22:45:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa399600640 1 -- 172.21.15.103:0/2524516498 learned_addr learned my addr 172.21.15.103:0/2524516498 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa398c00640 1 --2- 172.21.15.103:0/2524516498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c6f1a0 0x563e25c76a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39a000640 1 --2- 172.21.15.103:0/2524516498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 0x563e25c76fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa399600640 1 -- 172.21.15.103:0/2524516498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c6f1a0 msgr2=0x563e25c76a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa399600640 1 --2- 172.21.15.103:0/2524516498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c6f1a0 0x563e25c76a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa399600640 1 -- 172.21.15.103:0/2524516498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 msgr2=0x563e25c76fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa399600640 1 --2- 172.21.15.103:0/2524516498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 0x563e25c76fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa399600640 1 -- 172.21.15.103:0/2524516498 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e25a0e1f0 con 0x563e25c25bc0 2024-09-10T22:45:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa399600640 1 --2- 172.21.15.103:0/2524516498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 0x563e25c76530 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fa388095900 tx=0x7fa38806b1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771d59a6735de00e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa37aa00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa37aa00640 1 -- 172.21.15.103:0/2524516498 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa388087060 con 0x563e25c25bc0 2024-09-10T22:45:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa37aa00640 1 -- 172.21.15.103:0/2524516498 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fa388087200 con 0x563e25c25bc0 2024-09-10T22:45:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39f480000 1 -- 172.21.15.103:0/2524516498 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563e25a08330 con 0x563e25c25bc0 2024-09-10T22:45:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa37aa00640 1 -- 172.21.15.103:0/2524516498 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7fa388022070 con 0x563e25c25bc0 2024-09-10T22:45:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39f480000 10 client.8448 fetch_fsmap learned FSMap version 114 2024-09-10T22:45:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39f480000 1 -- 172.21.15.103:0/2524516498 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x563e259f4fa0 con 0x563e25c25bc0 2024-09-10T22:45:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa37aa00640 1 -- 172.21.15.103:0/2524516498 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa388077e50 con 0x563e25c25bc0 2024-09-10T22:45:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa37aa00640 1 -- 172.21.15.103:0/2524516498 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 114) ==== 3554+0+0 (secure 0 0 0) 0x7fa388069070 con 0x563e25c25bc0 2024-09-10T22:45:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39f480000 10 client.8448 fetch_fsmap finished waiting for FSMap version 114 2024-09-10T22:45:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39f480000 10 client.8448 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T22:45:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39f480000 20 client.8448 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39f480000 1 --2- 172.21.15.103:0/2524516498 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x563e25c7e900 0x563e25c80cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39f480000 4 client.8448 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:45:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa39f480000 1 -- 172.21.15.103:0/2524516498 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e25a82ae0 con 0x563e25c7e900 2024-09-10T22:45:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.584+0000 7fa398c00640 1 --2- 172.21.15.103:0/2524516498 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x563e25c7e900 0x563e25c80cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.588+0000 7fa398c00640 1 --2- 172.21.15.103:0/2524516498 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x563e25c7e900 0x563e25c80cf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e3787f886a2ce29 server_cookie=d2e336c93aba5b8e in_seq=0 out_seq=0 2024-09-10T22:45:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.588+0000 7fa37aa00640 10 client.8448 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.588+0000 7fa37aa00640 1 -- 172.21.15.103:0/2524516498 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563e25a82ae0 con 0x563e25c7e900 2024-09-10T22:45:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.588+0000 7fa37aa00640 10 client.8448 handle_command_reply: tid=0 2024-09-10T22:45:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.588+0000 7fa39f480000 1 client.8448 shutdown 2024-09-10T22:45:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.588+0000 7fa39f480000 1 -- 172.21.15.103:0/2524516498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 msgr2=0x563e25c76530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.588+0000 7fa39f480000 1 --2- 172.21.15.103:0/2524516498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 0x563e25c76530 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fa388095900 tx=0x7fa38806b1b0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.588+0000 7fa39f480000 1 -- 172.21.15.103:0/2524516498 shutdown_connections 2024-09-10T22:45:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.588+0000 7fa39f480000 1 --2- 172.21.15.103:0/2524516498 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x563e25c7e900 0x563e25c80cf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.588+0000 7fa39f480000 1 --2- 172.21.15.103:0/2524516498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 0x563e25c76fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.588+0000 7fa39f480000 1 --2- 172.21.15.103:0/2524516498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c6f1a0 0x563e25c76a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.588+0000 7fa39f480000 1 --2- 172.21.15.103:0/2524516498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 0x563e25c76530 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.588+0000 7fa37aa00640 0 client.8448 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:56.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.588+0000 7fa39f480000 1 -- 172.21.15.103:0/2524516498 >> 172.21.15.103:0/2524516498 conn(0x563e25c2bd20 msgr2=0x563e25c23f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:56.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.588+0000 7fa39f480000 1 -- 172.21.15.103:0/2524516498 shutdown_connections 2024-09-10T22:45:56.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.588+0000 7fa39f480000 1 -- 172.21.15.103:0/2524516498 wait complete. 2024-09-10T22:45:56.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.588+0000 7fa39f480000 20 client.8448 trim_cache size 0 max 16384 2024-09-10T22:45:56.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39f480000 1 Processor -- start 2024-09-10T22:45:56.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39f480000 1 -- start start 2024-09-10T22:45:56.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39f480000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 0x563e25c25070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39f480000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c6f1a0 0x563e25c255b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39f480000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 0x563e25c79310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39f480000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa394201d80 con 0x563e25c25bc0 2024-09-10T22:45:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39f480000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa394200f50 con 0x563e25c6fac0 2024-09-10T22:45:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39f480000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa394201650 con 0x563e25c6f1a0 2024-09-10T22:45:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa399600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 0x563e25c25070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa399600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 0x563e25c25070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59480/0 (socket says 172.21.15.103:59480) 2024-09-10T22:45:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa399600640 1 -- 172.21.15.103:0/243163124 learned_addr learned my addr 172.21.15.103:0/243163124 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa398c00640 1 --2- 172.21.15.103:0/243163124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c6f1a0 0x563e25c255b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa399600640 1 -- 172.21.15.103:0/243163124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c6f1a0 msgr2=0x563e25c255b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39a000640 1 --2- 172.21.15.103:0/243163124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 0x563e25c79310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa399600640 1 --2- 172.21.15.103:0/243163124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c6f1a0 0x563e25c255b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa399600640 1 -- 172.21.15.103:0/243163124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 msgr2=0x563e25c79310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:56.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa399600640 1 --2- 172.21.15.103:0/243163124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 0x563e25c79310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa399600640 1 -- 172.21.15.103:0/243163124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e25acd660 con 0x563e25c25bc0 2024-09-10T22:45:56.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa398c00640 1 --2- 172.21.15.103:0/243163124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c6f1a0 0x563e25c255b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:56.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39a000640 1 --2- 172.21.15.103:0/243163124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 0x563e25c79310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:56.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa399600640 1 --2- 172.21.15.103:0/243163124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 0x563e25c25070 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fa38807c160 tx=0x7fa388001320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d52c29b9382d74c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:56.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa385600640 1 -- 172.21.15.103:0/243163124 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa388061f20 con 0x563e25c25bc0 2024-09-10T22:45:56.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa385600640 1 -- 172.21.15.103:0/243163124 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563e25a08330 con 0x563e25c25bc0 2024-09-10T22:45:56.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa385600640 1 -- 172.21.15.103:0/243163124 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa388066e40 con 0x563e25c25bc0 2024-09-10T22:45:56.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39f480000 1 -- 172.21.15.103:0/243163124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 msgr2=0x563e25c25070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:56.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39f480000 1 --2- 172.21.15.103:0/243163124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 0x563e25c25070 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fa38807c160 tx=0x7fa388001320 comp rx=0 tx=0).stop 2024-09-10T22:45:56.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39f480000 1 -- 172.21.15.103:0/243163124 shutdown_connections 2024-09-10T22:45:56.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39f480000 1 --2- 172.21.15.103:0/243163124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 0x563e25c79310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39f480000 1 --2- 172.21.15.103:0/243163124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c6f1a0 0x563e25c255b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39f480000 1 --2- 172.21.15.103:0/243163124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 0x563e25c25070 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39f480000 1 -- 172.21.15.103:0/243163124 >> 172.21.15.103:0/243163124 conn(0x563e25c2bd20 msgr2=0x563e25c24960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:56.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39f480000 1 -- 172.21.15.103:0/243163124 shutdown_connections 2024-09-10T22:45:56.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39f480000 1 -- 172.21.15.103:0/243163124 wait complete. 2024-09-10T22:45:56.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.604+0000 7fa39f480000 1 -- start start 2024-09-10T22:45:56.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39f480000 1 Processor -- start 2024-09-10T22:45:56.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39f480000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 0x563e25c7bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39f480000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c6f1a0 0x563e25c7c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39f480000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 0x563e25ca1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39f480000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563e25a6ffc0 con 0x563e25c25bc0 2024-09-10T22:45:56.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39f480000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563e25a6aec0 con 0x563e25c6fac0 2024-09-10T22:45:56.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39f480000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563e25c2ed40 con 0x563e25c6f1a0 2024-09-10T22:45:56.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39f480000 10 client.0 _ll_register_callbacks cb 0x7fa388062270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:56.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa399600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 0x563e25c7bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa399600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 0x563e25c7bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59488/0 (socket says 172.21.15.103:59488) 2024-09-10T22:45:56.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa399600640 1 -- 172.21.15.103:0/3984705137 learned_addr learned my addr 172.21.15.103:0/3984705137 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:56.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa398c00640 1 --2- 172.21.15.103:0/3984705137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c6f1a0 0x563e25c7c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39a000640 1 --2- 172.21.15.103:0/3984705137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 0x563e25ca1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa399600640 1 -- 172.21.15.103:0/3984705137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c6f1a0 msgr2=0x563e25c7c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:56.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa399600640 1 --2- 172.21.15.103:0/3984705137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c6f1a0 0x563e25c7c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa399600640 1 -- 172.21.15.103:0/3984705137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 msgr2=0x563e25ca1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:56.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa399600640 1 --2- 172.21.15.103:0/3984705137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 0x563e25ca1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa399600640 1 -- 172.21.15.103:0/3984705137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e25a3a090 con 0x563e25c25bc0 2024-09-10T22:45:56.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39a000640 1 --2- 172.21.15.103:0/3984705137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 0x563e25ca1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:56.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa399600640 1 --2- 172.21.15.103:0/3984705137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 0x563e25c7bfc0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fa388062110 tx=0x7fa388069210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7d1fe719812ade server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:56.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa37aa00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:56.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa37aa00640 1 -- 172.21.15.103:0/3984705137 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa388061f20 con 0x563e25c25bc0 2024-09-10T22:45:56.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa37aa00640 1 -- 172.21.15.103:0/3984705137 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fa3880970e0 con 0x563e25c25bc0 2024-09-10T22:45:56.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39f480000 1 -- 172.21.15.103:0/3984705137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563e25a08330 con 0x563e25c25bc0 2024-09-10T22:45:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa37aa00640 1 -- 172.21.15.103:0/3984705137 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7fa388066e40 con 0x563e25c25bc0 2024-09-10T22:45:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39f480000 10 client.8454 fetch_fsmap learned FSMap version 114 2024-09-10T22:45:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39f480000 1 -- 172.21.15.103:0/3984705137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x563e25a065f0 con 0x563e25c25bc0 2024-09-10T22:45:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa37aa00640 1 -- 172.21.15.103:0/3984705137 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563e25a08330 con 0x563e25c25bc0 2024-09-10T22:45:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa37aa00640 1 -- 172.21.15.103:0/3984705137 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 114) ==== 3554+0+0 (secure 0 0 0) 0x7fa38805dd60 con 0x563e25c25bc0 2024-09-10T22:45:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39f480000 10 client.8454 fetch_fsmap finished waiting for FSMap version 114 2024-09-10T22:45:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39f480000 10 client.8454 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T22:45:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39f480000 20 client.8454 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39f480000 1 --2- 172.21.15.103:0/3984705137 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x563e25ca1c00 0x563e25ce4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39f480000 4 client.8454 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:45:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa39f480000 1 -- 172.21.15.103:0/3984705137 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563e25a7e590 con 0x563e25ca1c00 2024-09-10T22:45:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa398c00640 1 --2- 172.21.15.103:0/3984705137 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x563e25ca1c00 0x563e25ce4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa37aa00640 10 client.8454 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:56.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.608+0000 7fa398c00640 1 --2- 172.21.15.103:0/3984705137 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x563e25ca1c00 0x563e25ce4640 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c2ce2b97d00d173 server_cookie=6862b9c2b199ed0a in_seq=0 out_seq=0 2024-09-10T22:45:56.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa37aa00640 1 -- 172.21.15.103:0/3984705137 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563e25a7e590 con 0x563e25ca1c00 2024-09-10T22:45:56.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa37aa00640 10 client.8454 handle_command_reply: tid=0 2024-09-10T22:45:56.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39f480000 1 client.8454 shutdown 2024-09-10T22:45:56.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39f480000 1 -- 172.21.15.103:0/3984705137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 msgr2=0x563e25c7bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:56.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39f480000 1 --2- 172.21.15.103:0/3984705137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 0x563e25c7bfc0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fa388062110 tx=0x7fa388069210 comp rx=0 tx=0).stop 2024-09-10T22:45:56.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39f480000 1 -- 172.21.15.103:0/3984705137 shutdown_connections 2024-09-10T22:45:56.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39f480000 1 --2- 172.21.15.103:0/3984705137 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x563e25ca1c00 0x563e25ce4640 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39f480000 1 --2- 172.21.15.103:0/3984705137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563e25c6fac0 0x563e25ca1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39f480000 1 --2- 172.21.15.103:0/3984705137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563e25c6f1a0 0x563e25c7c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39f480000 1 --2- 172.21.15.103:0/3984705137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e25c25bc0 0x563e25c7bfc0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa37aa00640 0 client.8454 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:56.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39f480000 1 -- 172.21.15.103:0/3984705137 >> 172.21.15.103:0/3984705137 conn(0x563e25c2bd20 msgr2=0x563e25c25180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:56.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39f480000 1 -- 172.21.15.103:0/3984705137 shutdown_connections 2024-09-10T22:45:56.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39f480000 1 -- 172.21.15.103:0/3984705137 wait complete. 2024-09-10T22:45:56.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39f480000 20 client.8454 trim_cache size 0 max 16384 2024-09-10T22:45:56.630 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:45:56.630 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:45:56.630 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:45:56.630 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:45:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39c000640 1 -- 172.21.15.103:0/223690812 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa374072610 msgr2=0x7fa374074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39c000640 1 --2- 172.21.15.103:0/223690812 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa374072610 0x7fa374074ad0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa3800aa000 tx=0x7fa380019d00 comp rx=0 tx=0).stop 2024-09-10T22:45:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39c000640 1 -- 172.21.15.103:0/223690812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c004810 msgr2=0x7fa39414fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39c000640 1 --2- 172.21.15.103:0/223690812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c004810 0x7fa39414fc70 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fa388012b70 tx=0x7fa388012f70 comp rx=0 tx=0).stop 2024-09-10T22:45:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39c000640 1 -- 172.21.15.103:0/223690812 shutdown_connections 2024-09-10T22:45:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39c000640 1 --2- 172.21.15.103:0/223690812 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa374072610 0x7fa374074ad0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39c000640 1 --2- 172.21.15.103:0/223690812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3940b1af0 0x7fa39414d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39c000640 1 --2- 172.21.15.103:0/223690812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa394153f20 0x7fa3940b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39c000640 1 --2- 172.21.15.103:0/223690812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa37c004810 0x7fa39414fc70 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39c000640 1 -- 172.21.15.103:0/223690812 >> 172.21.15.103:0/223690812 conn(0x7fa39406cc00 msgr2=0x7fa394159600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:56.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39c000640 1 -- 172.21.15.103:0/223690812 shutdown_connections 2024-09-10T22:45:56.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.624+0000 7fa39c000640 1 -- 172.21.15.103:0/223690812 wait complete. 2024-09-10T22:45:56.647 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:1 flush journal 2024-09-10T22:45:56.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feed6c00640 1 -- 172.21.15.103:0/153678585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feed0072a40 msgr2=0x7feed0157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:56.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feed6c00640 1 --2- 172.21.15.103:0/153678585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feed0072a40 0x7feed0157090 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7feed00b4f10 tx=0x7feec801deb0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feed6c00640 1 -- 172.21.15.103:0/153678585 shutdown_connections 2024-09-10T22:45:56.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feed6c00640 1 --2- 172.21.15.103:0/153678585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feed0072a40 0x7feed0157090 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feed6c00640 1 --2- 172.21.15.103:0/153678585 >> v2:172.21.15.131:3300/0 conn(0x7feed00b3320 0x7feed0072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feed6c00640 1 -- 172.21.15.103:0/153678585 >> 172.21.15.103:0/153678585 conn(0x7feed006cc00 msgr2=0x7feed006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:56.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feed6c00640 1 -- 172.21.15.103:0/153678585 shutdown_connections 2024-09-10T22:45:56.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feed6c00640 1 -- 172.21.15.103:0/153678585 wait complete. 2024-09-10T22:45:56.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feed6c00640 1 Processor -- start 2024-09-10T22:45:56.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feed6c00640 1 -- start start 2024-09-10T22:45:56.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feed6c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feed0072a40 0x7feed014a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feed6c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feed00b3320 0x7feed0159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feed6c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feed00cf260 0x7feed0148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feed6c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feed006e800 con 0x7feed00b3320 2024-09-10T22:45:56.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feed6c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feed0157ed0 con 0x7feed00cf260 2024-09-10T22:45:56.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feed6c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7feed006e980 con 0x7feed0072a40 2024-09-10T22:45:56.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feec7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feed00b3320 0x7feed0159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feec7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feed00b3320 0x7feed0159430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48448/0 (socket says 172.21.15.103:48448) 2024-09-10T22:45:56.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feec7400640 1 -- 172.21.15.103:0/1389623776 learned_addr learned my addr 172.21.15.103:0/1389623776 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:56.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feecfe00640 1 --2- 172.21.15.103:0/1389623776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feed0072a40 0x7feed014a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feed4c00640 1 --2- 172.21.15.103:0/1389623776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feed00cf260 0x7feed0148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feec7400640 1 -- 172.21.15.103:0/1389623776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feed0072a40 msgr2=0x7feed014a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:56.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feec7400640 1 --2- 172.21.15.103:0/1389623776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feed0072a40 0x7feed014a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feec7400640 1 -- 172.21.15.103:0/1389623776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feed00cf260 msgr2=0x7feed0148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:56.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feec7400640 1 --2- 172.21.15.103:0/1389623776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feed00cf260 0x7feed0148970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feec7400640 1 -- 172.21.15.103:0/1389623776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed01fa380 con 0x7feed00b3320 2024-09-10T22:45:56.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.788+0000 7feec7400640 1 --2- 172.21.15.103:0/1389623776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feed00b3320 0x7feed0159430 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c970 tx=0x7feeb800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:56.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.792+0000 7feeccc00640 1 -- 172.21.15.103:0/1389623776 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb8007c10 con 0x7feed00b3320 2024-09-10T22:45:56.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.792+0000 7feeccc00640 1 -- 172.21.15.103:0/1389623776 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feeb800f450 con 0x7feed00b3320 2024-09-10T22:45:56.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.792+0000 7feed6c00640 1 -- 172.21.15.103:0/1389623776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed01fa5f0 con 0x7feed00b3320 2024-09-10T22:45:56.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.792+0000 7feeccc00640 1 -- 172.21.15.103:0/1389623776 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb800f8a0 con 0x7feed00b3320 2024-09-10T22:45:56.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.792+0000 7feed6c00640 1 -- 172.21.15.103:0/1389623776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed01fabb0 con 0x7feed00b3320 2024-09-10T22:45:56.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.792+0000 7feeccc00640 1 -- 172.21.15.103:0/1389623776 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7feeb8020030 con 0x7feed00b3320 2024-09-10T22:45:56.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeda037000 1 Processor -- start 2024-09-10T22:45:56.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeccc00640 1 --2- 172.21.15.103:0/1389623776 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feeac0725e0 0x7feeac074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeda037000 1 -- start start 2024-09-10T22:45:56.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeccc00640 1 -- 172.21.15.103:0/1389623776 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7feeb80937c0 con 0x7feed00b3320 2024-09-10T22:45:56.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feed4c00640 1 --2- 172.21.15.103:0/1389623776 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feeac0725e0 0x7feeac074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeda037000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb0781b1a0 0x55cb0781b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeda037000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb0781bac0 0x55cb077d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeda037000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb077d1bc0 0x55cb077d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeda037000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cb076b9cb0 con 0x55cb077d1bc0 2024-09-10T22:45:56.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeda037000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cb075cf310 con 0x55cb0781b1a0 2024-09-10T22:45:56.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeda037000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55cb0762cb90 con 0x55cb0781bac0 2024-09-10T22:45:56.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feecfe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb0781b1a0 0x55cb0781b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feecfe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb0781b1a0 0x55cb0781b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:45668/0 (socket says 172.21.15.103:45668) 2024-09-10T22:45:56.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feecfe00640 1 -- 172.21.15.103:0/3629190407 learned_addr learned my addr 172.21.15.103:0/3629190407 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:56.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feed4c00640 1 --2- 172.21.15.103:0/3629190407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb077d1bc0 0x55cb077d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feec7400640 1 --2- 172.21.15.103:0/3629190407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb0781bac0 0x55cb077d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feecfe00640 1 -- 172.21.15.103:0/3629190407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb0781bac0 msgr2=0x55cb077d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:56.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feecfe00640 1 --2- 172.21.15.103:0/3629190407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb0781bac0 0x55cb077d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feecfe00640 1 -- 172.21.15.103:0/3629190407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb077d1bc0 msgr2=0x55cb077d1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:56.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feecfe00640 1 --2- 172.21.15.103:0/3629190407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb077d1bc0 0x55cb077d1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feecfe00640 1 -- 172.21.15.103:0/3629190407 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb075d0c60 con 0x55cb0781b1a0 2024-09-10T22:45:56.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feed4c00640 1 --2- 172.21.15.103:0/3629190407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb077d1bc0 0x55cb077d1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:45:56.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feed4c00640 1 --2- 172.21.15.103:0/1389623776 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feeac0725e0 0x7feeac074aa0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7feec80b0000 tx=0x7feec801ac50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:56.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feecfe00640 1 --2- 172.21.15.103:0/3629190407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb0781b1a0 0x55cb0781b580 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7feec0001840 tx=0x7feec0007dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=455750493953ddd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:56.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feec4c00640 1 -- 172.21.15.103:0/3629190407 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec00053a0 con 0x55cb0781b1a0 2024-09-10T22:45:56.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feec4c00640 1 -- 172.21.15.103:0/3629190407 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feec0018070 con 0x55cb0781b1a0 2024-09-10T22:45:56.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feec4c00640 1 -- 172.21.15.103:0/3629190407 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec000f9f0 con 0x55cb0781b1a0 2024-09-10T22:45:56.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeda037000 1 -- 172.21.15.103:0/3629190407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb0781b1a0 msgr2=0x55cb0781b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:56.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeda037000 1 --2- 172.21.15.103:0/3629190407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb0781b1a0 0x55cb0781b580 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7feec0001840 tx=0x7feec0007dc0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeda037000 1 -- 172.21.15.103:0/3629190407 shutdown_connections 2024-09-10T22:45:56.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeda037000 1 --2- 172.21.15.103:0/3629190407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb077d1bc0 0x55cb077d1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeda037000 1 --2- 172.21.15.103:0/3629190407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb0781bac0 0x55cb077d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeda037000 1 --2- 172.21.15.103:0/3629190407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb0781b1a0 0x55cb0781b580 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeda037000 1 -- 172.21.15.103:0/3629190407 >> 172.21.15.103:0/3629190407 conn(0x55cb077d7d20 msgr2=0x55cb077cff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:56.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeda037000 1 -- 172.21.15.103:0/3629190407 shutdown_connections 2024-09-10T22:45:56.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.796+0000 7feeda037000 1 -- 172.21.15.103:0/3629190407 wait complete. 2024-09-10T22:45:56.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feeda037000 1 -- start start 2024-09-10T22:45:56.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feeda037000 1 Processor -- start 2024-09-10T22:45:56.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feeda037000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb077d1bc0 0x55cb07822530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feeda037000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb0781b1a0 0x55cb07822a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feeda037000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb0781bac0 0x55cb07822fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feeda037000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cb0761fdd0 con 0x55cb0781b1a0 2024-09-10T22:45:56.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feeda037000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cb0761bfc0 con 0x55cb077d1bc0 2024-09-10T22:45:56.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feeda037000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55cb075c14b0 con 0x55cb0781bac0 2024-09-10T22:45:56.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feeda037000 10 client.0 _ll_register_callbacks cb 0x55cb0759f7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:56.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feec7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb0781b1a0 0x55cb07822a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feec7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb0781b1a0 0x55cb07822a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48468/0 (socket says 172.21.15.103:48468) 2024-09-10T22:45:56.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feec7400640 1 -- 172.21.15.103:0/3219338955 learned_addr learned my addr 172.21.15.103:0/3219338955 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:56.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feec7400640 1 -- 172.21.15.103:0/3219338955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb0781bac0 msgr2=0x55cb07822fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:56.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feec7400640 1 --2- 172.21.15.103:0/3219338955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb0781bac0 0x55cb07822fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feec7400640 1 -- 172.21.15.103:0/3219338955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb077d1bc0 msgr2=0x55cb07822530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:56.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feec7400640 1 --2- 172.21.15.103:0/3219338955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb077d1bc0 0x55cb07822530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feec7400640 1 -- 172.21.15.103:0/3219338955 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb075ba1f0 con 0x55cb0781b1a0 2024-09-10T22:45:56.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feec7400640 1 --2- 172.21.15.103:0/3219338955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb0781b1a0 0x55cb07822a70 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c940 tx=0x7feeb805ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf5aefa439190e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:56.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feebd600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:56.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feebd600640 1 -- 172.21.15.103:0/3219338955 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb805e180 con 0x55cb0781b1a0 2024-09-10T22:45:56.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feebd600640 1 -- 172.21.15.103:0/3219338955 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7feeb8059fc0 con 0x55cb0781b1a0 2024-09-10T22:45:56.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feeda037000 1 -- 172.21.15.103:0/3219338955 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cb075b4330 con 0x55cb0781b1a0 2024-09-10T22:45:56.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feebd600640 1 -- 172.21.15.103:0/3219338955 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7feeb8091050 con 0x55cb0781b1a0 2024-09-10T22:45:56.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feeda037000 10 client.8469 fetch_fsmap learned FSMap version 114 2024-09-10T22:45:56.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feeda037000 1 -- 172.21.15.103:0/3219338955 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x55cb075a0fa0 con 0x55cb0781b1a0 2024-09-10T22:45:56.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feebd600640 1 -- 172.21.15.103:0/3219338955 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55cb075b4330 con 0x55cb0781b1a0 2024-09-10T22:45:56.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feebd600640 1 -- 172.21.15.103:0/3219338955 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 114) ==== 3554+0+0 (secure 0 0 0) 0x7feeb805a1c0 con 0x55cb0781b1a0 2024-09-10T22:45:56.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feeda037000 10 client.8469 fetch_fsmap finished waiting for FSMap version 114 2024-09-10T22:45:56.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feeda037000 10 client.8469 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-10T22:45:56.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feeda037000 20 client.8469 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:56.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feeda037000 1 --2- 172.21.15.103:0/3219338955 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x55cb0782a900 0x55cb0782ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feeda037000 4 client.8469 mds_command: new command op to 8235 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:45:56.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feeda037000 1 -- 172.21.15.103:0/3219338955 --> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb0762eae0 con 0x55cb0782a900 2024-09-10T22:45:56.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feecfe00640 1 --2- 172.21.15.103:0/3219338955 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x55cb0782a900 0x55cb0782ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feecfe00640 1 --2- 172.21.15.103:0/3219338955 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x55cb0782a900 0x55cb0782ccf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eaf7703c09f8e87f server_cookie=4245a3844acf1abb in_seq=0 out_seq=0 2024-09-10T22:45:56.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.800+0000 7feebd600640 10 client.8469 ms_handle_connect on v2:172.21.15.103:6832/1191295180 2024-09-10T22:45:56.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.804+0000 7feebd600640 1 -- 172.21.15.103:0/3219338955 <== mds.1 v2:172.21.15.103:6832/1191295180 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cb0762eae0 con 0x55cb0782a900 2024-09-10T22:45:56.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.804+0000 7feebd600640 10 client.8469 handle_command_reply: tid=0 2024-09-10T22:45:56.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.804+0000 7feeda037000 1 client.8469 shutdown 2024-09-10T22:45:56.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.804+0000 7feeda037000 1 -- 172.21.15.103:0/3219338955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb0781b1a0 msgr2=0x55cb07822a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:56.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.804+0000 7feeda037000 1 --2- 172.21.15.103:0/3219338955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb0781b1a0 0x55cb07822a70 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c940 tx=0x7feeb805ec10 comp rx=0 tx=0).stop 2024-09-10T22:45:56.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.804+0000 7feeda037000 1 -- 172.21.15.103:0/3219338955 shutdown_connections 2024-09-10T22:45:56.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.804+0000 7feeda037000 1 --2- 172.21.15.103:0/3219338955 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x55cb0782a900 0x55cb0782ccf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.804+0000 7feeda037000 1 --2- 172.21.15.103:0/3219338955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb0781bac0 0x55cb07822fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.804+0000 7feeda037000 1 --2- 172.21.15.103:0/3219338955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb0781b1a0 0x55cb07822a70 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.804+0000 7feeda037000 1 --2- 172.21.15.103:0/3219338955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb077d1bc0 0x55cb07822530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.804+0000 7feebd600640 0 client.8469 ms_handle_reset on v2:172.21.15.103:6832/1191295180 2024-09-10T22:45:56.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.804+0000 7feeda037000 1 -- 172.21.15.103:0/3219338955 >> 172.21.15.103:0/3219338955 conn(0x55cb077d7d20 msgr2=0x55cb077cff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:56.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.804+0000 7feeda037000 1 -- 172.21.15.103:0/3219338955 shutdown_connections 2024-09-10T22:45:56.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.804+0000 7feeda037000 1 -- 172.21.15.103:0/3219338955 wait complete. 2024-09-10T22:45:56.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.804+0000 7feeda037000 20 client.8469 trim_cache size 0 max 16384 2024-09-10T22:45:56.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feeda037000 1 Processor -- start 2024-09-10T22:45:56.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feeda037000 1 -- start start 2024-09-10T22:45:56.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feeda037000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb077d1bc0 0x55cb077d1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feeda037000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb0781b1a0 0x55cb077d15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feeda037000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb0781bac0 0x55cb07825310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feeda037000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feed0204300 con 0x55cb0781b1a0 2024-09-10T22:45:56.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feeda037000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feed02034d0 con 0x55cb0781bac0 2024-09-10T22:45:56.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feeda037000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7feed0203bd0 con 0x55cb077d1bc0 2024-09-10T22:45:56.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feec7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb0781b1a0 0x55cb077d15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feec7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb0781b1a0 0x55cb077d15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48482/0 (socket says 172.21.15.103:48482) 2024-09-10T22:45:56.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feec7400640 1 -- 172.21.15.103:0/767126702 learned_addr learned my addr 172.21.15.103:0/767126702 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:56.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feecfe00640 1 --2- 172.21.15.103:0/767126702 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb077d1bc0 0x55cb077d1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feed4c00640 1 --2- 172.21.15.103:0/767126702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb0781bac0 0x55cb07825310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feec7400640 1 -- 172.21.15.103:0/767126702 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb077d1bc0 msgr2=0x55cb077d1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:56.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feec7400640 1 --2- 172.21.15.103:0/767126702 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb077d1bc0 0x55cb077d1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feec7400640 1 -- 172.21.15.103:0/767126702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb0781bac0 msgr2=0x55cb07825310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:56.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feec7400640 1 --2- 172.21.15.103:0/767126702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb0781bac0 0x55cb07825310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feec7400640 1 -- 172.21.15.103:0/767126702 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb07679660 con 0x55cb0781b1a0 2024-09-10T22:45:56.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feec7400640 1 --2- 172.21.15.103:0/767126702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb0781b1a0 0x55cb077d15b0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7feeb8007590 tx=0x7feeb805e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7eaeb31c07db69 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:56.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feebfe00640 1 -- 172.21.15.103:0/767126702 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb80630f0 con 0x55cb0781b1a0 2024-09-10T22:45:56.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feebfe00640 1 -- 172.21.15.103:0/767126702 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feeb804b020 con 0x55cb0781b1a0 2024-09-10T22:45:56.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feebfe00640 1 -- 172.21.15.103:0/767126702 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb805a220 con 0x55cb0781b1a0 2024-09-10T22:45:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feeda037000 1 -- 172.21.15.103:0/767126702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb0781b1a0 msgr2=0x55cb077d15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feeda037000 1 --2- 172.21.15.103:0/767126702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb0781b1a0 0x55cb077d15b0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7feeb8007590 tx=0x7feeb805e040 comp rx=0 tx=0).stop 2024-09-10T22:45:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feeda037000 1 -- 172.21.15.103:0/767126702 shutdown_connections 2024-09-10T22:45:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feeda037000 1 --2- 172.21.15.103:0/767126702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb0781bac0 0x55cb07825310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feeda037000 1 --2- 172.21.15.103:0/767126702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb0781b1a0 0x55cb077d15b0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feeda037000 1 --2- 172.21.15.103:0/767126702 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb077d1bc0 0x55cb077d1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feeda037000 1 -- 172.21.15.103:0/767126702 >> 172.21.15.103:0/767126702 conn(0x55cb077d7d20 msgr2=0x55cb077d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feeda037000 1 -- 172.21.15.103:0/767126702 shutdown_connections 2024-09-10T22:45:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.820+0000 7feeda037000 1 -- 172.21.15.103:0/767126702 wait complete. 2024-09-10T22:45:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feeda037000 1 -- start start 2024-09-10T22:45:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feeda037000 1 Processor -- start 2024-09-10T22:45:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feeda037000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb077d1bc0 0x55cb07827fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feeda037000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb0781b1a0 0x55cb07828500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feeda037000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb0781bac0 0x55cb0784d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feeda037000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cb077dad40 con 0x55cb077d1bc0 2024-09-10T22:45:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feeda037000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cb077d8100 con 0x55cb0781b1a0 2024-09-10T22:45:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feeda037000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55cb07616ec0 con 0x55cb0781bac0 2024-09-10T22:45:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feeda037000 10 client.0 _ll_register_callbacks cb 0x7feeb805a600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feecfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb077d1bc0 0x55cb07827fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feecfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb077d1bc0 0x55cb07827fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48496/0 (socket says 172.21.15.103:48496) 2024-09-10T22:45:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feecfe00640 1 -- 172.21.15.103:0/2160914135 learned_addr learned my addr 172.21.15.103:0/2160914135 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feed4c00640 1 --2- 172.21.15.103:0/2160914135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb0781bac0 0x55cb0784d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feec7400640 1 --2- 172.21.15.103:0/2160914135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb0781b1a0 0x55cb07828500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feecfe00640 1 -- 172.21.15.103:0/2160914135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb0781bac0 msgr2=0x55cb0784d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feecfe00640 1 --2- 172.21.15.103:0/2160914135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb0781bac0 0x55cb0784d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feecfe00640 1 -- 172.21.15.103:0/2160914135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb0781b1a0 msgr2=0x55cb07828500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feecfe00640 1 --2- 172.21.15.103:0/2160914135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb0781b1a0 0x55cb07828500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feecfe00640 1 -- 172.21.15.103:0/2160914135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb075e6090 con 0x55cb077d1bc0 2024-09-10T22:45:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feecfe00640 1 --2- 172.21.15.103:0/2160914135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb077d1bc0 0x55cb07827fc0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7feec0007e20 tx=0x7feec0007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b278f8d97e793be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feebd600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feebd600640 1 -- 172.21.15.103:0/2160914135 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec00053a0 con 0x55cb077d1bc0 2024-09-10T22:45:56.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feebd600640 1 -- 172.21.15.103:0/2160914135 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7feec001ec90 con 0x55cb077d1bc0 2024-09-10T22:45:56.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feeda037000 1 -- 172.21.15.103:0/2160914135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feeb804b020 con 0x55cb077d1bc0 2024-09-10T22:45:56.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feebd600640 1 -- 172.21.15.103:0/2160914135 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7feec002d050 con 0x55cb077d1bc0 2024-09-10T22:45:56.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feeda037000 10 client.8475 fetch_fsmap learned FSMap version 114 2024-09-10T22:45:56.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feeda037000 1 -- 172.21.15.103:0/2160914135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x55cb075b25f0 con 0x55cb077d1bc0 2024-09-10T22:45:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feebd600640 1 -- 172.21.15.103:0/2160914135 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feeb804b020 con 0x55cb077d1bc0 2024-09-10T22:45:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feebd600640 1 -- 172.21.15.103:0/2160914135 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 114) ==== 3554+0+0 (secure 0 0 0) 0x7feec0030020 con 0x55cb077d1bc0 2024-09-10T22:45:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feeda037000 10 client.8475 fetch_fsmap finished waiting for FSMap version 114 2024-09-10T22:45:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feeda037000 10 client.8475 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-10T22:45:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feeda037000 20 client.8475 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feeda037000 1 --2- 172.21.15.103:0/2160914135 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x55cb0784db70 0x55cb07890640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feeda037000 4 client.8475 mds_command: new command op to 8235 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:45:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feeda037000 1 -- 172.21.15.103:0/2160914135 --> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cb0762a590 con 0x55cb0784db70 2024-09-10T22:45:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feec7400640 1 --2- 172.21.15.103:0/2160914135 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x55cb0784db70 0x55cb07890640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feec7400640 1 --2- 172.21.15.103:0/2160914135 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x55cb0784db70 0x55cb07890640 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4d6ce218992d3a99 server_cookie=dc2f8483f68ec94 in_seq=0 out_seq=0 2024-09-10T22:45:56.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.824+0000 7feebd600640 10 client.8475 ms_handle_connect on v2:172.21.15.103:6832/1191295180 2024-09-10T22:45:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feebd600640 1 -- 172.21.15.103:0/2160914135 <== mds.1 v2:172.21.15.103:6832/1191295180 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cb0762a590 con 0x55cb0784db70 2024-09-10T22:45:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feebd600640 10 client.8475 handle_command_reply: tid=0 2024-09-10T22:45:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feeda037000 1 client.8475 shutdown 2024-09-10T22:45:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feeda037000 1 -- 172.21.15.103:0/2160914135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb077d1bc0 msgr2=0x55cb07827fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feeda037000 1 --2- 172.21.15.103:0/2160914135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb077d1bc0 0x55cb07827fc0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7feec0007e20 tx=0x7feec0007e50 comp rx=0 tx=0).stop 2024-09-10T22:45:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feeda037000 1 -- 172.21.15.103:0/2160914135 shutdown_connections 2024-09-10T22:45:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feeda037000 1 --2- 172.21.15.103:0/2160914135 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x55cb0784db70 0x55cb07890640 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feeda037000 1 --2- 172.21.15.103:0/2160914135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cb0781bac0 0x55cb0784d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feeda037000 1 --2- 172.21.15.103:0/2160914135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb0781b1a0 0x55cb07828500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feeda037000 1 --2- 172.21.15.103:0/2160914135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cb077d1bc0 0x55cb07827fc0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feebd600640 0 client.8475 ms_handle_reset on v2:172.21.15.103:6832/1191295180 2024-09-10T22:45:56.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feeda037000 1 -- 172.21.15.103:0/2160914135 >> 172.21.15.103:0/2160914135 conn(0x55cb077d7d20 msgr2=0x55cb077d1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:56.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feeda037000 1 -- 172.21.15.103:0/2160914135 shutdown_connections 2024-09-10T22:45:56.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feeda037000 1 -- 172.21.15.103:0/2160914135 wait complete. 2024-09-10T22:45:56.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feeda037000 20 client.8475 trim_cache size 0 max 16384 2024-09-10T22:45:56.842 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:45:56.842 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:45:56.842 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:45:56.843 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:45:56.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feed6c00640 1 -- 172.21.15.103:0/1389623776 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feeac0725e0 msgr2=0x7feeac074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:56.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feed6c00640 1 --2- 172.21.15.103:0/1389623776 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feeac0725e0 0x7feeac074aa0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7feec80b0000 tx=0x7feec801ac50 comp rx=0 tx=0).stop 2024-09-10T22:45:56.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feed6c00640 1 -- 172.21.15.103:0/1389623776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feed00b3320 msgr2=0x7feed0159430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:56.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feed6c00640 1 --2- 172.21.15.103:0/1389623776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feed00b3320 0x7feed0159430 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c970 tx=0x7feeb800ce30 comp rx=0 tx=0).stop 2024-09-10T22:45:56.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feed6c00640 1 -- 172.21.15.103:0/1389623776 shutdown_connections 2024-09-10T22:45:56.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feed6c00640 1 --2- 172.21.15.103:0/1389623776 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feeac0725e0 0x7feeac074aa0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feed6c00640 1 --2- 172.21.15.103:0/1389623776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feed00cf260 0x7feed0148970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feed6c00640 1 --2- 172.21.15.103:0/1389623776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feed00b3320 0x7feed0159430 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feed6c00640 1 --2- 172.21.15.103:0/1389623776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feed0072a40 0x7feed014a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:56.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feed6c00640 1 -- 172.21.15.103:0/1389623776 >> 172.21.15.103:0/1389623776 conn(0x7feed006cc00 msgr2=0x7feed015b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:56.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feed6c00640 1 -- 172.21.15.103:0/1389623776 shutdown_connections 2024-09-10T22:45:56.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:56.836+0000 7feed6c00640 1 -- 172.21.15.103:0/1389623776 wait complete. 2024-09-10T22:45:56.861 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:2 flush journal 2024-09-10T22:45:57.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.000+0000 7f209d800640 1 -- 172.21.15.103:0/1160202364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20980d1460 msgr2=0x7f20981634e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:57.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.000+0000 7f209d800640 1 --2- 172.21.15.103:0/1160202364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20980d1460 0x7f20981634e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2080009bf0 tx=0x7f208001cb50 comp rx=0 tx=0).stop 2024-09-10T22:45:57.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.000+0000 7f209d800640 1 -- 172.21.15.103:0/1160202364 shutdown_connections 2024-09-10T22:45:57.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.000+0000 7f209d800640 1 --2- 172.21.15.103:0/1160202364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20980d1460 0x7f20981634e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.000+0000 7f209d800640 1 -- 172.21.15.103:0/1160202364 >> 172.21.15.103:0/1160202364 conn(0x7f20980d0940 msgr2=0x7f20980d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:57.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.000+0000 7f209d800640 1 -- 172.21.15.103:0/1160202364 shutdown_connections 2024-09-10T22:45:57.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.000+0000 7f209d800640 1 -- 172.21.15.103:0/1160202364 wait complete. 2024-09-10T22:45:57.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f209d800640 1 Processor -- start 2024-09-10T22:45:57.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f209d800640 1 -- start start 2024-09-10T22:45:57.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f209d800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f209806cc00 0x7f2098148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f209d800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20980d02c0 0x7f2098150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f209d800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20980d1460 0x7f209814b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f209d800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2098169ef0 con 0x7f209806cc00 2024-09-10T22:45:57.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f209d800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2098169d70 con 0x7f20980d1460 2024-09-10T22:45:57.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f209d800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f209816a070 con 0x7f20980d02c0 2024-09-10T22:45:57.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f2096a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f209806cc00 0x7f2098148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f2096a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f209806cc00 0x7f2098148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48498/0 (socket says 172.21.15.103:48498) 2024-09-10T22:45:57.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f2096a00640 1 -- 172.21.15.103:0/3854396550 learned_addr learned my addr 172.21.15.103:0/3854396550 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:57.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f2096a00640 1 -- 172.21.15.103:0/3854396550 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20980d02c0 msgr2=0x7f2098150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:57.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f2096a00640 1 --2- 172.21.15.103:0/3854396550 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20980d02c0 0x7f2098150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f2096a00640 1 -- 172.21.15.103:0/3854396550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20980d1460 msgr2=0x7f209814b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:57.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f2096a00640 1 --2- 172.21.15.103:0/3854396550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20980d1460 0x7f209814b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f2096a00640 1 -- 172.21.15.103:0/3854396550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20981fac50 con 0x7f209806cc00 2024-09-10T22:45:57.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f2096a00640 1 --2- 172.21.15.103:0/3854396550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f209806cc00 0x7f2098148d60 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f208800c490 tx=0x7f208800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:57.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f208f400640 1 -- 172.21.15.103:0/3854396550 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2088017070 con 0x7f209806cc00 2024-09-10T22:45:57.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f208f400640 1 -- 172.21.15.103:0/3854396550 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20880053e0 con 0x7f209806cc00 2024-09-10T22:45:57.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f209d800640 1 -- 172.21.15.103:0/3854396550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20981faf30 con 0x7f209806cc00 2024-09-10T22:45:57.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f208f400640 1 -- 172.21.15.103:0/3854396550 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2088003860 con 0x7f209806cc00 2024-09-10T22:45:57.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.004+0000 7f209d800640 1 -- 172.21.15.103:0/3854396550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20981fb4f0 con 0x7f209806cc00 2024-09-10T22:45:57.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f208f400640 1 -- 172.21.15.103:0/3854396550 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2088003a00 con 0x7f209806cc00 2024-09-10T22:45:57.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f208f400640 1 --2- 172.21.15.103:0/3854396550 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2074072610 0x7f2074074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f208f400640 1 -- 172.21.15.103:0/3854396550 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f2088092b90 con 0x7f209806cc00 2024-09-10T22:45:57.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f20a0bcc000 1 Processor -- start 2024-09-10T22:45:57.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f208e000640 1 --2- 172.21.15.103:0/3854396550 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2074072610 0x7f2074074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f20a0bcc000 1 -- start start 2024-09-10T22:45:57.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f208e000640 1 --2- 172.21.15.103:0/3854396550 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2074072610 0x7f2074074ad0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f20800af000 tx=0x7f20800198f0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:57.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f20a0bcc000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a5741a0 0x55a24a574580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f20a0bcc000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a574ac0 0x55a24a52a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f20a0bcc000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a52abc0 0x55a24a52afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f20a0bcc000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a24a412cb0 con 0x55a24a52abc0 2024-09-10T22:45:57.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f20a0bcc000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a24a328310 con 0x55a24a5741a0 2024-09-10T22:45:57.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f20a0bcc000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a24a385b90 con 0x55a24a574ac0 2024-09-10T22:45:57.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f2096a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a5741a0 0x55a24a574580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f208e000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a574ac0 0x55a24a52a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f2096a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a5741a0 0x55a24a574580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:45730/0 (socket says 172.21.15.103:45730) 2024-09-10T22:45:57.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f2096a00640 1 -- 172.21.15.103:0/1300829699 learned_addr learned my addr 172.21.15.103:0/1300829699 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:57.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f2097400640 1 --2- 172.21.15.103:0/1300829699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a52abc0 0x55a24a52afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f2096a00640 1 -- 172.21.15.103:0/1300829699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a574ac0 msgr2=0x55a24a52a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:57.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f2096a00640 1 --2- 172.21.15.103:0/1300829699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a574ac0 0x55a24a52a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f2096a00640 1 -- 172.21.15.103:0/1300829699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a52abc0 msgr2=0x55a24a52afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:57.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f2096a00640 1 --2- 172.21.15.103:0/1300829699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a52abc0 0x55a24a52afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f2096a00640 1 -- 172.21.15.103:0/1300829699 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a24a329c60 con 0x55a24a5741a0 2024-09-10T22:45:57.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.008+0000 7f2097400640 1 --2- 172.21.15.103:0/1300829699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a52abc0 0x55a24a52afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:57.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f2096a00640 1 --2- 172.21.15.103:0/1300829699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a5741a0 0x55a24a574580 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f208805d910 tx=0x7f208805d5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fe876924de0f8e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:57.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f2087400640 1 -- 172.21.15.103:0/1300829699 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2088062070 con 0x55a24a5741a0 2024-09-10T22:45:57.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f2087400640 1 -- 172.21.15.103:0/1300829699 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2088062460 con 0x55a24a5741a0 2024-09-10T22:45:57.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f2087400640 1 -- 172.21.15.103:0/1300829699 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208805cde0 con 0x55a24a5741a0 2024-09-10T22:45:57.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f20a0bcc000 1 -- 172.21.15.103:0/1300829699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a5741a0 msgr2=0x55a24a574580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:57.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/1300829699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a5741a0 0x55a24a574580 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f208805d910 tx=0x7f208805d5d0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f20a0bcc000 1 -- 172.21.15.103:0/1300829699 shutdown_connections 2024-09-10T22:45:57.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/1300829699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a52abc0 0x55a24a52afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/1300829699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a574ac0 0x55a24a52a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/1300829699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a5741a0 0x55a24a574580 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f20a0bcc000 1 -- 172.21.15.103:0/1300829699 >> 172.21.15.103:0/1300829699 conn(0x55a24a530d20 msgr2=0x55a24a528f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:57.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f20a0bcc000 1 -- 172.21.15.103:0/1300829699 shutdown_connections 2024-09-10T22:45:57.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f20a0bcc000 1 -- 172.21.15.103:0/1300829699 wait complete. 2024-09-10T22:45:57.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f20a0bcc000 1 -- start start 2024-09-10T22:45:57.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f20a0bcc000 1 Processor -- start 2024-09-10T22:45:57.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f20a0bcc000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a52abc0 0x55a24a57b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f20a0bcc000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a5741a0 0x55a24a57ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f20a0bcc000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a574ac0 0x55a24a57bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f20a0bcc000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a24a378dd0 con 0x55a24a5741a0 2024-09-10T22:45:57.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f20a0bcc000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a24a374fc0 con 0x55a24a574ac0 2024-09-10T22:45:57.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f20a0bcc000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a24a31a4b0 con 0x55a24a52abc0 2024-09-10T22:45:57.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f20a0bcc000 10 client.0 _ll_register_callbacks cb 0x55a24a2f87d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:57.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f208e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a5741a0 0x55a24a57ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f208e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a5741a0 0x55a24a57ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48514/0 (socket says 172.21.15.103:48514) 2024-09-10T22:45:57.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f208e000640 1 -- 172.21.15.103:0/3316843981 learned_addr learned my addr 172.21.15.103:0/3316843981 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:57.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f2097400640 1 --2- 172.21.15.103:0/3316843981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a574ac0 0x55a24a57bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f2096a00640 1 --2- 172.21.15.103:0/3316843981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a52abc0 0x55a24a57b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f208e000640 1 -- 172.21.15.103:0/3316843981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a52abc0 msgr2=0x55a24a57b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:57.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f208e000640 1 --2- 172.21.15.103:0/3316843981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a52abc0 0x55a24a57b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f208e000640 1 -- 172.21.15.103:0/3316843981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a574ac0 msgr2=0x55a24a57bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:57.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f208e000640 1 --2- 172.21.15.103:0/3316843981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a574ac0 0x55a24a57bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f208e000640 1 -- 172.21.15.103:0/3316843981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a24a3131f0 con 0x55a24a5741a0 2024-09-10T22:45:57.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f2096a00640 1 --2- 172.21.15.103:0/3316843981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a52abc0 0x55a24a57b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:57.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f208e000640 1 --2- 172.21.15.103:0/3316843981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a5741a0 0x55a24a57ba70 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f2080000f90 tx=0x7f208001b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351d94947d95aa35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:57.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.012+0000 7f207be00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:57.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f207be00640 1 -- 172.21.15.103:0/3316843981 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20800b2040 con 0x55a24a5741a0 2024-09-10T22:45:57.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f207be00640 1 -- 172.21.15.103:0/3316843981 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f20800a5b30 con 0x55a24a5741a0 2024-09-10T22:45:57.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 1 -- 172.21.15.103:0/3316843981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a24a30d330 con 0x55a24a5741a0 2024-09-10T22:45:57.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f207be00640 1 -- 172.21.15.103:0/3316843981 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7f20800d1050 con 0x55a24a5741a0 2024-09-10T22:45:57.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 10 client.8487 fetch_fsmap learned FSMap version 114 2024-09-10T22:45:57.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 1 -- 172.21.15.103:0/3316843981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x55a24a2f9fa0 con 0x55a24a5741a0 2024-09-10T22:45:57.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f207be00640 1 -- 172.21.15.103:0/3316843981 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a24a30d330 con 0x55a24a5741a0 2024-09-10T22:45:57.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f207be00640 1 -- 172.21.15.103:0/3316843981 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 114) ==== 3554+0+0 (secure 0 0 0) 0x7f20800d4020 con 0x55a24a5741a0 2024-09-10T22:45:57.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 10 client.8487 fetch_fsmap finished waiting for FSMap version 114 2024-09-10T22:45:57.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 10 client.8487 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2024-09-10T22:45:57.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 20 client.8487 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:57.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/3316843981 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55a24a583900 0x55a24a585cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 4 client.8487 mds_command: new command op to 7717 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:45:57.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 1 -- 172.21.15.103:0/3316843981 --> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a24a387ae0 con 0x55a24a583900 2024-09-10T22:45:57.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f2096a00640 1 --2- 172.21.15.103:0/3316843981 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55a24a583900 0x55a24a585cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f2096a00640 1 --2- 172.21.15.103:0/3316843981 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55a24a583900 0x55a24a585cf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4ca8eb48993e43e server_cookie=54feec27048d2d3 in_seq=0 out_seq=0 2024-09-10T22:45:57.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f207be00640 10 client.8487 ms_handle_connect on v2:172.21.15.131:6835/1281268106 2024-09-10T22:45:57.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f207be00640 1 -- 172.21.15.103:0/3316843981 <== mds.2 v2:172.21.15.131:6835/1281268106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a24a387ae0 con 0x55a24a583900 2024-09-10T22:45:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f207be00640 10 client.8487 handle_command_reply: tid=0 2024-09-10T22:45:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 1 client.8487 shutdown 2024-09-10T22:45:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 1 -- 172.21.15.103:0/3316843981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a5741a0 msgr2=0x55a24a57ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/3316843981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a5741a0 0x55a24a57ba70 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f2080000f90 tx=0x7f208001b390 comp rx=0 tx=0).stop 2024-09-10T22:45:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 1 -- 172.21.15.103:0/3316843981 shutdown_connections 2024-09-10T22:45:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/3316843981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a574ac0 0x55a24a57bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/3316843981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a5741a0 0x55a24a57ba70 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/3316843981 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55a24a583900 0x55a24a585cf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/3316843981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a52abc0 0x55a24a57b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f207be00640 0 client.8487 ms_handle_reset on v2:172.21.15.131:6835/1281268106 2024-09-10T22:45:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 1 -- 172.21.15.103:0/3316843981 >> 172.21.15.103:0/3316843981 conn(0x55a24a530d20 msgr2=0x55a24a528f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 1 -- 172.21.15.103:0/3316843981 shutdown_connections 2024-09-10T22:45:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 1 -- 172.21.15.103:0/3316843981 wait complete. 2024-09-10T22:45:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.016+0000 7f20a0bcc000 20 client.8487 trim_cache size 0 max 16384 2024-09-10T22:45:57.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f20a0bcc000 1 Processor -- start 2024-09-10T22:45:57.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f20a0bcc000 1 -- start start 2024-09-10T22:45:57.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f20a0bcc000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a52abc0 0x55a24a5e5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f20a0bcc000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a5741a0 0x55a24a5e5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f20a0bcc000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a574ac0 0x55a24a5e64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f20a0bcc000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f20982048b0 con 0x55a24a574ac0 2024-09-10T22:45:57.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f20a0bcc000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2098203a80 con 0x55a24a5741a0 2024-09-10T22:45:57.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f20a0bcc000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2098204180 con 0x55a24a52abc0 2024-09-10T22:45:57.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f2097400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a574ac0 0x55a24a5e64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f2097400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a574ac0 0x55a24a5e64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48526/0 (socket says 172.21.15.103:48526) 2024-09-10T22:45:57.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f2097400640 1 -- 172.21.15.103:0/4105431204 learned_addr learned my addr 172.21.15.103:0/4105431204 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f2097400640 1 -- 172.21.15.103:0/4105431204 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a52abc0 msgr2=0x55a24a5e5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f2097400640 1 --2- 172.21.15.103:0/4105431204 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a52abc0 0x55a24a5e5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f2097400640 1 -- 172.21.15.103:0/4105431204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a5741a0 msgr2=0x55a24a5e5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f2097400640 1 --2- 172.21.15.103:0/4105431204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a5741a0 0x55a24a5e5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f2097400640 1 -- 172.21.15.103:0/4105431204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a24a3d2660 con 0x55a24a574ac0 2024-09-10T22:45:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f2097400640 1 --2- 172.21.15.103:0/4105431204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a574ac0 0x55a24a5e64a0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f2090001590 tx=0x7f2090001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c33899b065827e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f2086a00640 1 -- 172.21.15.103:0/4105431204 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2090019070 con 0x55a24a574ac0 2024-09-10T22:45:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f2086a00640 1 -- 172.21.15.103:0/4105431204 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2090005110 con 0x55a24a574ac0 2024-09-10T22:45:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.032+0000 7f2086a00640 1 -- 172.21.15.103:0/4105431204 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2090005560 con 0x55a24a574ac0 2024-09-10T22:45:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 -- 172.21.15.103:0/4105431204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a574ac0 msgr2=0x55a24a5e64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/4105431204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a574ac0 0x55a24a5e64a0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f2090001590 tx=0x7f2090001a50 comp rx=0 tx=0).stop 2024-09-10T22:45:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 -- 172.21.15.103:0/4105431204 shutdown_connections 2024-09-10T22:45:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/4105431204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a574ac0 0x55a24a5e64a0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/4105431204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a5741a0 0x55a24a5e5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/4105431204 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a52abc0 0x55a24a5e5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 -- 172.21.15.103:0/4105431204 >> 172.21.15.103:0/4105431204 conn(0x55a24a530d20 msgr2=0x55a24a52c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 -- 172.21.15.103:0/4105431204 shutdown_connections 2024-09-10T22:45:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 -- 172.21.15.103:0/4105431204 wait complete. 2024-09-10T22:45:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 -- start start 2024-09-10T22:45:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 Processor -- start 2024-09-10T22:45:57.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a52abc0 0x55a24a58a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a5741a0 0x55a24a58aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a574ac0 0x55a24a5a6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a24a378dd0 con 0x55a24a574ac0 2024-09-10T22:45:57.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a24a533d40 con 0x55a24a52abc0 2024-09-10T22:45:57.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a24a531100 con 0x55a24a5741a0 2024-09-10T22:45:57.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 10 client.0 _ll_register_callbacks cb 0x7f20981564e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:57.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f2097400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a574ac0 0x55a24a5a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f2097400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a574ac0 0x55a24a5a6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48542/0 (socket says 172.21.15.103:48542) 2024-09-10T22:45:57.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f2097400640 1 -- 172.21.15.103:0/2681747799 learned_addr learned my addr 172.21.15.103:0/2681747799 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:57.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f2096a00640 1 --2- 172.21.15.103:0/2681747799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a52abc0 0x55a24a58a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f208e000640 1 --2- 172.21.15.103:0/2681747799 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a5741a0 0x55a24a58aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f2097400640 1 -- 172.21.15.103:0/2681747799 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a5741a0 msgr2=0x55a24a58aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:57.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f2097400640 1 --2- 172.21.15.103:0/2681747799 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a5741a0 0x55a24a58aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f2097400640 1 -- 172.21.15.103:0/2681747799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a52abc0 msgr2=0x55a24a58a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:57.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f2097400640 1 --2- 172.21.15.103:0/2681747799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a52abc0 0x55a24a58a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f2097400640 1 -- 172.21.15.103:0/2681747799 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a24a33f090 con 0x55a24a574ac0 2024-09-10T22:45:57.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f2096a00640 1 --2- 172.21.15.103:0/2681747799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a52abc0 0x55a24a58a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:45:57.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f2097400640 1 --2- 172.21.15.103:0/2681747799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a574ac0 0x55a24a5a6210 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f2090011620 tx=0x7f2090011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8caa32c4c12f9621 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:57.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f207be00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:57.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f207be00640 1 -- 172.21.15.103:0/2681747799 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2090019040 con 0x55a24a574ac0 2024-09-10T22:45:57.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 -- 172.21.15.103:0/2681747799 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2090005110 con 0x55a24a574ac0 2024-09-10T22:45:57.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f207be00640 1 -- 172.21.15.103:0/2681747799 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f20900046d0 con 0x55a24a574ac0 2024-09-10T22:45:57.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f207be00640 1 -- 172.21.15.103:0/2681747799 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7f209002a050 con 0x55a24a574ac0 2024-09-10T22:45:57.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 10 client.8493 fetch_fsmap learned FSMap version 114 2024-09-10T22:45:57.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.036+0000 7f20a0bcc000 1 -- 172.21.15.103:0/2681747799 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x55a24a30b5f0 con 0x55a24a574ac0 2024-09-10T22:45:57.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.040+0000 7f207be00640 1 -- 172.21.15.103:0/2681747799 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2090005110 con 0x55a24a574ac0 2024-09-10T22:45:57.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.040+0000 7f207be00640 1 -- 172.21.15.103:0/2681747799 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 114) ==== 3554+0+0 (secure 0 0 0) 0x7f209002d020 con 0x55a24a574ac0 2024-09-10T22:45:57.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.040+0000 7f20a0bcc000 10 client.8493 fetch_fsmap finished waiting for FSMap version 114 2024-09-10T22:45:57.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.040+0000 7f20a0bcc000 10 client.8493 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2024-09-10T22:45:57.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.040+0000 7f20a0bcc000 20 client.8493 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:57.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.040+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/2681747799 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55a24a5a6b40 0x55a24a5f1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.040+0000 7f20a0bcc000 4 client.8493 mds_command: new command op to 7717 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:45:57.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.040+0000 7f20a0bcc000 1 -- 172.21.15.103:0/2681747799 --> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a24a383590 con 0x55a24a5a6b40 2024-09-10T22:45:57.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.040+0000 7f2096a00640 1 --2- 172.21.15.103:0/2681747799 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55a24a5a6b40 0x55a24a5f1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.040+0000 7f2096a00640 1 --2- 172.21.15.103:0/2681747799 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55a24a5a6b40 0x55a24a5f1aa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a1103049d7664425 server_cookie=8694f9cca2e63034 in_seq=0 out_seq=0 2024-09-10T22:45:57.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.040+0000 7f207be00640 10 client.8493 ms_handle_connect on v2:172.21.15.131:6835/1281268106 2024-09-10T22:45:57.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.048+0000 7f207be00640 1 -- 172.21.15.103:0/2681747799 <== mds.2 v2:172.21.15.131:6835/1281268106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a24a383590 con 0x55a24a5a6b40 2024-09-10T22:45:57.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.048+0000 7f207be00640 10 client.8493 handle_command_reply: tid=0 2024-09-10T22:45:57.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.048+0000 7f20a0bcc000 1 client.8493 shutdown 2024-09-10T22:45:57.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.048+0000 7f20a0bcc000 1 -- 172.21.15.103:0/2681747799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a574ac0 msgr2=0x55a24a5a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:57.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.048+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/2681747799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a574ac0 0x55a24a5a6210 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f2090011620 tx=0x7f2090011a60 comp rx=0 tx=0).stop 2024-09-10T22:45:57.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.048+0000 7f20a0bcc000 1 -- 172.21.15.103:0/2681747799 shutdown_connections 2024-09-10T22:45:57.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.048+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/2681747799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a24a574ac0 0x55a24a5a6210 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.048+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/2681747799 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55a24a5a6b40 0x55a24a5f1aa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.048+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/2681747799 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a24a5741a0 0x55a24a58aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.048+0000 7f20a0bcc000 1 --2- 172.21.15.103:0/2681747799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a24a52abc0 0x55a24a58a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.048+0000 7f20a0bcc000 1 -- 172.21.15.103:0/2681747799 >> 172.21.15.103:0/2681747799 conn(0x55a24a530d20 msgr2=0x55a24a585cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:57.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.048+0000 7f207be00640 0 client.8493 ms_handle_reset on v2:172.21.15.131:6835/1281268106 2024-09-10T22:45:57.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.048+0000 7f20a0bcc000 1 -- 172.21.15.103:0/2681747799 shutdown_connections 2024-09-10T22:45:57.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.048+0000 7f20a0bcc000 1 -- 172.21.15.103:0/2681747799 wait complete. 2024-09-10T22:45:57.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.048+0000 7f20a0bcc000 20 client.8493 trim_cache size 0 max 16384 2024-09-10T22:45:57.056 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:45:57.056 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:45:57.056 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:45:57.056 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:45:57.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.052+0000 7f209d800640 1 -- 172.21.15.103:0/3854396550 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2074072610 msgr2=0x7f2074074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:57.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.052+0000 7f209d800640 1 --2- 172.21.15.103:0/3854396550 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2074072610 0x7f2074074ad0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f20800af000 tx=0x7f20800198f0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.052+0000 7f209d800640 1 -- 172.21.15.103:0/3854396550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f209806cc00 msgr2=0x7f2098148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:57.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.052+0000 7f209d800640 1 --2- 172.21.15.103:0/3854396550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f209806cc00 0x7f2098148d60 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f208800c490 tx=0x7f208800c950 comp rx=0 tx=0).stop 2024-09-10T22:45:57.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.052+0000 7f209d800640 1 -- 172.21.15.103:0/3854396550 shutdown_connections 2024-09-10T22:45:57.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.052+0000 7f209d800640 1 --2- 172.21.15.103:0/3854396550 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2074072610 0x7f2074074ad0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.052+0000 7f209d800640 1 --2- 172.21.15.103:0/3854396550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20980d1460 0x7f209814b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.052+0000 7f209d800640 1 --2- 172.21.15.103:0/3854396550 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20980d02c0 0x7f2098150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.052+0000 7f209d800640 1 --2- 172.21.15.103:0/3854396550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f209806cc00 0x7f2098148d60 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.052+0000 7f209d800640 1 -- 172.21.15.103:0/3854396550 >> 172.21.15.103:0/3854396550 conn(0x7f20980d0940 msgr2=0x7f20980b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:57.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.052+0000 7f209d800640 1 -- 172.21.15.103:0/3854396550 shutdown_connections 2024-09-10T22:45:57.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.052+0000 7f209d800640 1 -- 172.21.15.103:0/3854396550 wait complete. 2024-09-10T22:45:57.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:57.074 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2024-09-10T22:45:57.110 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/ 2024-09-10T22:45:57.110 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4 2024-09-10T22:45:57.110 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5 2024-09-10T22:45:57.110 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5/d6 2024-09-10T22:45:57.110 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5/d6/d7 2024-09-10T22:45:57.110 INFO:teuthology.orchestra.run.smithi103.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2024-09-10T22:45:57.111 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:45:57.111 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:45:57.111 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:45:57.111 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:45:57.112 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2024-09-10T22:45:57.112 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:45:57.218 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627778 2024-09-10T22:45:57.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:45:57.227 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:45:57.227 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:45:57.228 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:45:57.228 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:45:57.228 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2024-09-10T22:45:57.228 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:45:57.334 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627779 2024-09-10T22:45:57.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:45:57.344 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:45:57.344 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:45:57.344 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:45:57.344 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:45:57.344 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2024-09-10T22:45:57.344 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:45:57.451 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627780 2024-09-10T22:45:57.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:45:57.460 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:45:57.460 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:45:57.460 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:45:57.460 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:45:57.460 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2024-09-10T22:45:57.460 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:45:57.572 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627781 2024-09-10T22:45:57.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:45:57.581 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:45:57.581 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:45:57.581 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:45:57.581 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:45:57.581 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2024-09-10T22:45:57.582 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:45:57.687 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627782 2024-09-10T22:45:57.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:45:57.696 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-09-10T22:45:57.696 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T22:45:57.696 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-09-10T22:45:57.696 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T22:45:57.697 DEBUG:teuthology.orchestra.run.smithi103:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2024-09-10T22:45:57.697 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T22:45:57.807 INFO:teuthology.orchestra.run.smithi103.stdout:1099511627783 2024-09-10T22:45:57.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:45:57.817 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2024-09-10T22:45:57.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff537dc0080 1 Processor -- start 2024-09-10T22:45:57.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff537dc0080 1 -- start start 2024-09-10T22:45:57.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff537dc0080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a9c3f418b0 0x55a9c3fc8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff537dc0080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a9c3f5b8e0 0x55a9c3f0d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff537dc0080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a9c3fe5570 0x55a9c3fdec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff537dc0080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a9c3e5da00 con 0x55a9c3f5b8e0 2024-09-10T22:45:57.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff537dc0080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a9c3ebbf40 con 0x55a9c3f418b0 2024-09-10T22:45:57.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff537dc0080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a9c3fcabf0 con 0x55a9c3fe5570 2024-09-10T22:45:57.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff52fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a9c3f5b8e0 0x55a9c3f0d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff52fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a9c3f5b8e0 0x55a9c3f0d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48552/0 (socket says 172.21.15.103:48552) 2024-09-10T22:45:57.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff52fe00640 1 -- 172.21.15.103:0/2868128524 learned_addr learned my addr 172.21.15.103:0/2868128524 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:57.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff535a00640 1 --2- 172.21.15.103:0/2868128524 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a9c3fe5570 0x55a9c3fdec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff535000640 1 --2- 172.21.15.103:0/2868128524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a9c3f418b0 0x55a9c3fc8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff52fe00640 1 -- 172.21.15.103:0/2868128524 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a9c3fe5570 msgr2=0x55a9c3fdec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:57.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff52fe00640 1 --2- 172.21.15.103:0/2868128524 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a9c3fe5570 0x55a9c3fdec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff52fe00640 1 -- 172.21.15.103:0/2868128524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a9c3f418b0 msgr2=0x55a9c3fc8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:57.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff52fe00640 1 --2- 172.21.15.103:0/2868128524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a9c3f418b0 0x55a9c3fc8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff52fe00640 1 -- 172.21.15.103:0/2868128524 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9c3e36c10 con 0x55a9c3f5b8e0 2024-09-10T22:45:57.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff52fe00640 1 --2- 172.21.15.103:0/2868128524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a9c3f5b8e0 0x55a9c3f0d400 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7ff52000b2a0 tx=0x7ff52000b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72fd39a6d1e0341 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:57.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff52ea00640 1 -- 172.21.15.103:0/2868128524 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52000a040 con 0x55a9c3f5b8e0 2024-09-10T22:45:57.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff52ea00640 1 -- 172.21.15.103:0/2868128524 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff52000f620 con 0x55a9c3f5b8e0 2024-09-10T22:45:57.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.904+0000 7ff52ea00640 1 -- 172.21.15.103:0/2868128524 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52000fa70 con 0x55a9c3f5b8e0 2024-09-10T22:45:57.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 -- 172.21.15.103:0/2868128524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a9c3f5b8e0 msgr2=0x55a9c3f0d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:57.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 --2- 172.21.15.103:0/2868128524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a9c3f5b8e0 0x55a9c3f0d400 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7ff52000b2a0 tx=0x7ff52000b760 comp rx=0 tx=0).stop 2024-09-10T22:45:57.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 -- 172.21.15.103:0/2868128524 shutdown_connections 2024-09-10T22:45:57.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 --2- 172.21.15.103:0/2868128524 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a9c3fe5570 0x55a9c3fdec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 --2- 172.21.15.103:0/2868128524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a9c3f5b8e0 0x55a9c3f0d400 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 --2- 172.21.15.103:0/2868128524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a9c3f418b0 0x55a9c3fc8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 -- 172.21.15.103:0/2868128524 >> 172.21.15.103:0/2868128524 conn(0x55a9c3f0cdb0 msgr2=0x55a9c3fe1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:57.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 -- 172.21.15.103:0/2868128524 shutdown_connections 2024-09-10T22:45:57.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 -- 172.21.15.103:0/2868128524 wait complete. 2024-09-10T22:45:57.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 Processor -- start 2024-09-10T22:45:57.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 -- start start 2024-09-10T22:45:57.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a9c3f418b0 0x55a9c3f52fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a9c3f5b8e0 0x55a9c3fc7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a9c3fe5570 0x55a9c3f5a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a9c3f0eeb0 con 0x55a9c3f5b8e0 2024-09-10T22:45:57.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a9c3fe3ef0 con 0x55a9c3f418b0 2024-09-10T22:45:57.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a9c3f0f150 con 0x55a9c3fe5570 2024-09-10T22:45:57.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff52fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a9c3f5b8e0 0x55a9c3fc7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff52fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a9c3f5b8e0 0x55a9c3fc7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48568/0 (socket says 172.21.15.103:48568) 2024-09-10T22:45:57.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff52fe00640 1 -- 172.21.15.103:0/824848338 learned_addr learned my addr 172.21.15.103:0/824848338 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:57.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff535a00640 1 --2- 172.21.15.103:0/824848338 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a9c3fe5570 0x55a9c3f5a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff535000640 1 --2- 172.21.15.103:0/824848338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a9c3f418b0 0x55a9c3f52fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff52fe00640 1 -- 172.21.15.103:0/824848338 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a9c3fe5570 msgr2=0x55a9c3f5a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:57.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff52fe00640 1 --2- 172.21.15.103:0/824848338 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a9c3fe5570 0x55a9c3f5a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff52fe00640 1 -- 172.21.15.103:0/824848338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a9c3f418b0 msgr2=0x55a9c3f52fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:57.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff52fe00640 1 --2- 172.21.15.103:0/824848338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a9c3f418b0 0x55a9c3f52fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff52fe00640 1 -- 172.21.15.103:0/824848338 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9c3f53f10 con 0x55a9c3f5b8e0 2024-09-10T22:45:57.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff52fe00640 1 --2- 172.21.15.103:0/824848338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a9c3f5b8e0 0x55a9c3fc7cb0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7ff520001ac0 tx=0x7ff520001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:57.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff52d600640 1 -- 172.21.15.103:0/824848338 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52001b640 con 0x55a9c3f5b8e0 2024-09-10T22:45:57.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff52d600640 1 -- 172.21.15.103:0/824848338 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff520020020 con 0x55a9c3f5b8e0 2024-09-10T22:45:57.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 -- 172.21.15.103:0/824848338 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9c3f541b0 con 0x55a9c3f5b8e0 2024-09-10T22:45:57.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff52d600640 1 -- 172.21.15.103:0/824848338 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52001b970 con 0x55a9c3f5b8e0 2024-09-10T22:45:57.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.908+0000 7ff537dc0080 1 -- 172.21.15.103:0/824848338 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9c3f546f0 con 0x55a9c3f5b8e0 2024-09-10T22:45:57.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.912+0000 7ff52d600640 1 -- 172.21.15.103:0/824848338 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff52001bb10 con 0x55a9c3f5b8e0 2024-09-10T22:45:57.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.912+0000 7ff52d600640 1 --2- 172.21.15.103:0/824848338 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff514070fc0 0x7ff514073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.912+0000 7ff52d600640 1 -- 172.21.15.103:0/824848338 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7ff5200937f0 con 0x55a9c3f5b8e0 2024-09-10T22:45:57.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.912+0000 7ff535000640 1 --2- 172.21.15.103:0/824848338 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff514070fc0 0x7ff514073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.912+0000 7ff537dc0080 1 --2- 172.21.15.103:0/824848338 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x55a9c407f980 0x55a9c407fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:57.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.912+0000 7ff537dc0080 1 -- 172.21.15.103:0/824848338 --> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] -- osd_op(unknown.0.0:1 15.12 15:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55a9c40802a0 con 0x55a9c407f980 2024-09-10T22:45:57.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.912+0000 7ff535a00640 1 --2- 172.21.15.103:0/824848338 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x55a9c407f980 0x55a9c407fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:57.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.912+0000 7ff535000640 1 --2- 172.21.15.103:0/824848338 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff514070fc0 0x7ff514073480 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff52800c670 tx=0x7ff52800e040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:57.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.912+0000 7ff535a00640 1 --2- 172.21.15.103:0/824848338 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x55a9c407f980 0x55a9c407fd60 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:57.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.916+0000 7ff535a00640 1 -- 172.21.15.103:0/824848338 <== osd.3 v2:172.21.15.103:6824/3403069661 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v107'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff530002050 con 0x55a9c407f980 2024-09-10T22:45:57.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.916+0000 7ff537dc0080 1 -- 172.21.15.103:0/824848338 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x55a9c407f980 msgr2=0x55a9c407fd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:57.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.916+0000 7ff537dc0080 1 --2- 172.21.15.103:0/824848338 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x55a9c407f980 0x55a9c407fd60 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.916+0000 7ff537dc0080 1 -- 172.21.15.103:0/824848338 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff514070fc0 msgr2=0x7ff514073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:57.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.916+0000 7ff537dc0080 1 --2- 172.21.15.103:0/824848338 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff514070fc0 0x7ff514073480 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff52800c670 tx=0x7ff52800e040 comp rx=0 tx=0).stop 2024-09-10T22:45:57.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.916+0000 7ff537dc0080 1 -- 172.21.15.103:0/824848338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a9c3f5b8e0 msgr2=0x55a9c3fc7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:57.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.916+0000 7ff537dc0080 1 --2- 172.21.15.103:0/824848338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a9c3f5b8e0 0x55a9c3fc7cb0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7ff520001ac0 tx=0x7ff520001af0 comp rx=0 tx=0).stop 2024-09-10T22:45:57.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.916+0000 7ff535a00640 1 -- 172.21.15.103:0/824848338 reap_dead start 2024-09-10T22:45:57.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.916+0000 7ff537dc0080 1 -- 172.21.15.103:0/824848338 shutdown_connections 2024-09-10T22:45:57.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.916+0000 7ff537dc0080 1 -- 172.21.15.103:0/824848338 >> 172.21.15.103:0/824848338 conn(0x55a9c3f0cdb0 msgr2=0x55a9c3fc8830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:57.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.916+0000 7ff537dc0080 1 -- 172.21.15.103:0/824848338 shutdown_connections 2024-09-10T22:45:57.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:57.916+0000 7ff537dc0080 1 -- 172.21.15.103:0/824848338 wait complete. 2024-09-10T22:45:57.925 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2024-09-10T22:45:58.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f6190af0080 1 Processor -- start 2024-09-10T22:45:58.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f6190af0080 1 -- start start 2024-09-10T22:45:58.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f6190af0080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ebce516700 0x55ebce4fbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f6190af0080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ebce5a35c0 0x55ebce5a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f6190af0080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ebce5a39a0 0x55ebce5a20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f6190af0080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ebce41ba00 con 0x55ebce5a39a0 2024-09-10T22:45:58.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f6190af0080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ebce479f40 con 0x55ebce5a35c0 2024-09-10T22:45:58.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f6190af0080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ebce4fe340 con 0x55ebce516700 2024-09-10T22:45:58.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f618e600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ebce5a39a0 0x55ebce5a20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f618e600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ebce5a39a0 0x55ebce5a20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48582/0 (socket says 172.21.15.103:48582) 2024-09-10T22:45:58.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f618e600640 1 -- 172.21.15.103:0/1326947411 learned_addr learned my addr 172.21.15.103:0/1326947411 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f618dc00640 1 --2- 172.21.15.103:0/1326947411 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ebce516700 0x55ebce4fbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f6187e00640 1 --2- 172.21.15.103:0/1326947411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ebce5a35c0 0x55ebce5a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f618e600640 1 -- 172.21.15.103:0/1326947411 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ebce516700 msgr2=0x55ebce4fbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f618e600640 1 --2- 172.21.15.103:0/1326947411 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ebce516700 0x55ebce4fbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f618e600640 1 -- 172.21.15.103:0/1326947411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ebce5a35c0 msgr2=0x55ebce5a1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f618e600640 1 --2- 172.21.15.103:0/1326947411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ebce5a35c0 0x55ebce5a1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f618e600640 1 -- 172.21.15.103:0/1326947411 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebce3f4c10 con 0x55ebce5a39a0 2024-09-10T22:45:58.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f6187e00640 1 --2- 172.21.15.103:0/1326947411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ebce5a35c0 0x55ebce5a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:58.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f618e600640 1 --2- 172.21.15.103:0/1326947411 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ebce5a39a0 0x55ebce5a20c0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f618800b920 tx=0x7f618800bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60df7c63dd428adf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f6187400640 1 -- 172.21.15.103:0/1326947411 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618800dbf0 con 0x55ebce5a39a0 2024-09-10T22:45:58.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f6187400640 1 -- 172.21.15.103:0/1326947411 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f618800de80 con 0x55ebce5a39a0 2024-09-10T22:45:58.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.008+0000 7f6187400640 1 -- 172.21.15.103:0/1326947411 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618800f690 con 0x55ebce5a39a0 2024-09-10T22:45:58.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 -- 172.21.15.103:0/1326947411 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ebce5a39a0 msgr2=0x55ebce5a20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 --2- 172.21.15.103:0/1326947411 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ebce5a39a0 0x55ebce5a20c0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f618800b920 tx=0x7f618800bde0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 -- 172.21.15.103:0/1326947411 shutdown_connections 2024-09-10T22:45:58.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 --2- 172.21.15.103:0/1326947411 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ebce5a39a0 0x55ebce5a20c0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 --2- 172.21.15.103:0/1326947411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ebce5a35c0 0x55ebce5a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 --2- 172.21.15.103:0/1326947411 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ebce516700 0x55ebce4fbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 -- 172.21.15.103:0/1326947411 >> 172.21.15.103:0/1326947411 conn(0x55ebce4cef30 msgr2=0x55ebce513370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 -- 172.21.15.103:0/1326947411 shutdown_connections 2024-09-10T22:45:58.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 -- 172.21.15.103:0/1326947411 wait complete. 2024-09-10T22:45:58.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 Processor -- start 2024-09-10T22:45:58.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 -- start start 2024-09-10T22:45:58.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ebce516700 0x55ebce599c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ebce5a35c0 0x55ebce59f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ebce5a39a0 0x55ebce59a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ebce5a6480 con 0x55ebce5a35c0 2024-09-10T22:45:58.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ebce59cdb0 con 0x55ebce5a39a0 2024-09-10T22:45:58.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ebce5a6720 con 0x55ebce516700 2024-09-10T22:45:58.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6187e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ebce5a35c0 0x55ebce59f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6187e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ebce5a35c0 0x55ebce59f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48592/0 (socket says 172.21.15.103:48592) 2024-09-10T22:45:58.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6187e00640 1 -- 172.21.15.103:0/2676824565 learned_addr learned my addr 172.21.15.103:0/2676824565 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f618e600640 1 --2- 172.21.15.103:0/2676824565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ebce5a39a0 0x55ebce59a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f618dc00640 1 --2- 172.21.15.103:0/2676824565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ebce516700 0x55ebce599c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6187e00640 1 -- 172.21.15.103:0/2676824565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ebce516700 msgr2=0x55ebce599c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6187e00640 1 --2- 172.21.15.103:0/2676824565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ebce516700 0x55ebce599c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6187e00640 1 -- 172.21.15.103:0/2676824565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ebce5a39a0 msgr2=0x55ebce59a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6187e00640 1 --2- 172.21.15.103:0/2676824565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ebce5a39a0 0x55ebce59a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6187e00640 1 -- 172.21.15.103:0/2676824565 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebce59f9a0 con 0x55ebce5a35c0 2024-09-10T22:45:58.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6187e00640 1 --2- 172.21.15.103:0/2676824565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ebce5a35c0 0x55ebce59f090 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f617800df10 tx=0x7f617800b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6186000640 1 -- 172.21.15.103:0/2676824565 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6178014020 con 0x55ebce5a35c0 2024-09-10T22:45:58.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6186000640 1 -- 172.21.15.103:0/2676824565 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61780033c0 con 0x55ebce5a35c0 2024-09-10T22:45:58.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 -- 172.21.15.103:0/2676824565 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebce59fc40 con 0x55ebce5a35c0 2024-09-10T22:45:58.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6186000640 1 -- 172.21.15.103:0/2676824565 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617800a040 con 0x55ebce5a35c0 2024-09-10T22:45:58.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.012+0000 7f6190af0080 1 -- 172.21.15.103:0/2676824565 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebce5a0180 con 0x55ebce5a35c0 2024-09-10T22:45:58.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.016+0000 7f6186000640 1 -- 172.21.15.103:0/2676824565 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6178001820 con 0x55ebce5a35c0 2024-09-10T22:45:58.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.016+0000 7f6186000640 1 --2- 172.21.15.103:0/2676824565 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f616c070ff0 0x7f616c0734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.016+0000 7f6186000640 1 -- 172.21.15.103:0/2676824565 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f6178092200 con 0x55ebce5a35c0 2024-09-10T22:45:58.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.016+0000 7f618dc00640 1 --2- 172.21.15.103:0/2676824565 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f616c070ff0 0x7f616c0734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.016+0000 7f6190af0080 1 --2- 172.21.15.103:0/2676824565 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x55ebce59eb30 0x55ebce5a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.016+0000 7f6190af0080 1 -- 172.21.15.103:0/2676824565 --> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] -- osd_op(unknown.0.0:1 15.12 15:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55ebce5aa190 con 0x55ebce59eb30 2024-09-10T22:45:58.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.016+0000 7f618e600640 1 --2- 172.21.15.103:0/2676824565 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x55ebce59eb30 0x55ebce5a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.016+0000 7f618dc00640 1 --2- 172.21.15.103:0/2676824565 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f616c070ff0 0x7f616c0734b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f61800ab000 tx=0x7f61800199e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.016+0000 7f618e600640 1 --2- 172.21.15.103:0/2676824565 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x55ebce59eb30 0x55ebce5a9c50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.020+0000 7f618e600640 1 -- 172.21.15.103:0/2676824565 <== osd.3 v2:172.21.15.103:6824/3403069661 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v107'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6188002030 con 0x55ebce59eb30 2024-09-10T22:45:58.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.020+0000 7f6190af0080 1 -- 172.21.15.103:0/2676824565 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x55ebce59eb30 msgr2=0x55ebce5a9c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.020+0000 7f6190af0080 1 --2- 172.21.15.103:0/2676824565 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x55ebce59eb30 0x55ebce5a9c50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.020+0000 7f6190af0080 1 -- 172.21.15.103:0/2676824565 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f616c070ff0 msgr2=0x7f616c0734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.020+0000 7f6190af0080 1 --2- 172.21.15.103:0/2676824565 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f616c070ff0 0x7f616c0734b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f61800ab000 tx=0x7f61800199e0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.020+0000 7f6190af0080 1 -- 172.21.15.103:0/2676824565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ebce5a35c0 msgr2=0x55ebce59f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.020+0000 7f6190af0080 1 --2- 172.21.15.103:0/2676824565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ebce5a35c0 0x55ebce59f090 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f617800df10 tx=0x7f617800b5c0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.020+0000 7f618e600640 1 -- 172.21.15.103:0/2676824565 reap_dead start 2024-09-10T22:45:58.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.020+0000 7f6190af0080 1 -- 172.21.15.103:0/2676824565 shutdown_connections 2024-09-10T22:45:58.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.020+0000 7f6190af0080 1 -- 172.21.15.103:0/2676824565 >> 172.21.15.103:0/2676824565 conn(0x55ebce4cef30 msgr2=0x55ebce513e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.020+0000 7f6190af0080 1 -- 172.21.15.103:0/2676824565 shutdown_connections 2024-09-10T22:45:58.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.020+0000 7f6190af0080 1 -- 172.21.15.103:0/2676824565 wait complete. 2024-09-10T22:45:58.029 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2024-09-10T22:45:58.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.068+0000 7ff134e4d080 1 Processor -- start 2024-09-10T22:45:58.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.068+0000 7ff134e4d080 1 -- start start 2024-09-10T22:45:58.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff134e4d080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ad8eb2c80 0x557ad8e70ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff134e4d080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ad8f2fe00 0x557ad8e71400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff134e4d080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ad8f494f0 0x557ad8f51430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff134e4d080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x557ad8e1ef40 con 0x557ad8f2fe00 2024-09-10T22:45:58.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff134e4d080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557ad8e2bd00 con 0x557ad8eb2c80 2024-09-10T22:45:58.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff134e4d080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x557ad8dc0a00 con 0x557ad8f494f0 2024-09-10T22:45:58.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff130c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ad8f2fe00 0x557ad8e71400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff130c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ad8f2fe00 0x557ad8e71400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48602/0 (socket says 172.21.15.103:48602) 2024-09-10T22:45:58.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff130c00640 1 -- 172.21.15.103:0/3374931464 learned_addr learned my addr 172.21.15.103:0/3374931464 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff132000640 1 --2- 172.21.15.103:0/3374931464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ad8f494f0 0x557ad8f51430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff131600640 1 --2- 172.21.15.103:0/3374931464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ad8eb2c80 0x557ad8e70ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff130c00640 1 -- 172.21.15.103:0/3374931464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ad8f494f0 msgr2=0x557ad8f51430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff130c00640 1 --2- 172.21.15.103:0/3374931464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ad8f494f0 0x557ad8f51430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff130c00640 1 -- 172.21.15.103:0/3374931464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ad8eb2c80 msgr2=0x557ad8e70ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff130c00640 1 --2- 172.21.15.103:0/3374931464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ad8eb2c80 0x557ad8e70ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff130c00640 1 -- 172.21.15.103:0/3374931464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ad8e71b70 con 0x557ad8f2fe00 2024-09-10T22:45:58.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff132000640 1 --2- 172.21.15.103:0/3374931464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ad8f494f0 0x557ad8f51430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:58.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff131600640 1 --2- 172.21.15.103:0/3374931464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ad8eb2c80 0x557ad8e70ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:58.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff130c00640 1 --2- 172.21.15.103:0/3374931464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ad8f2fe00 0x557ad8e71400 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7ff12000b330 tx=0x7ff12000b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e4a61bed190e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff12b400640 1 -- 172.21.15.103:0/3374931464 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff120016070 con 0x557ad8f2fe00 2024-09-10T22:45:58.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff12b400640 1 -- 172.21.15.103:0/3374931464 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff12000d4c0 con 0x557ad8f2fe00 2024-09-10T22:45:58.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff12b400640 1 -- 172.21.15.103:0/3374931464 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12000d710 con 0x557ad8f2fe00 2024-09-10T22:45:58.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff134e4d080 1 -- 172.21.15.103:0/3374931464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ad8f2fe00 msgr2=0x557ad8e71400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff134e4d080 1 --2- 172.21.15.103:0/3374931464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ad8f2fe00 0x557ad8e71400 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7ff12000b330 tx=0x7ff12000b7f0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff134e4d080 1 -- 172.21.15.103:0/3374931464 shutdown_connections 2024-09-10T22:45:58.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff134e4d080 1 --2- 172.21.15.103:0/3374931464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ad8f494f0 0x557ad8f51430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff134e4d080 1 --2- 172.21.15.103:0/3374931464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ad8f2fe00 0x557ad8e71400 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff134e4d080 1 --2- 172.21.15.103:0/3374931464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ad8eb2c80 0x557ad8e70ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff134e4d080 1 -- 172.21.15.103:0/3374931464 >> 172.21.15.103:0/3374931464 conn(0x557ad8e73f30 msgr2=0x557ad8ebbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff134e4d080 1 -- 172.21.15.103:0/3374931464 shutdown_connections 2024-09-10T22:45:58.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff134e4d080 1 -- 172.21.15.103:0/3374931464 wait complete. 2024-09-10T22:45:58.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff134e4d080 1 Processor -- start 2024-09-10T22:45:58.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.072+0000 7ff134e4d080 1 -- start start 2024-09-10T22:45:58.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff134e4d080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ad8eb2c80 0x557ad8eb4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff134e4d080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ad8f2fe00 0x557ad8eb4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff134e4d080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ad8f494f0 0x557ad8fe2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff134e4d080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x557ad8e71e10 con 0x557ad8eb2c80 2024-09-10T22:45:58.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff134e4d080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557ad8eb8c60 con 0x557ad8f494f0 2024-09-10T22:45:58.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff134e4d080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x557ad8eb88a0 con 0x557ad8f2fe00 2024-09-10T22:45:58.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff131600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ad8eb2c80 0x557ad8eb4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff131600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ad8eb2c80 0x557ad8eb4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48604/0 (socket says 172.21.15.103:48604) 2024-09-10T22:45:58.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff131600640 1 -- 172.21.15.103:0/3586830770 learned_addr learned my addr 172.21.15.103:0/3586830770 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff130c00640 1 --2- 172.21.15.103:0/3586830770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ad8f2fe00 0x557ad8eb4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff132000640 1 --2- 172.21.15.103:0/3586830770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ad8f494f0 0x557ad8fe2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff131600640 1 -- 172.21.15.103:0/3586830770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ad8f2fe00 msgr2=0x557ad8eb4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff131600640 1 --2- 172.21.15.103:0/3586830770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ad8f2fe00 0x557ad8eb4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff131600640 1 -- 172.21.15.103:0/3586830770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ad8f494f0 msgr2=0x557ad8fe2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff131600640 1 --2- 172.21.15.103:0/3586830770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557ad8f494f0 0x557ad8fe2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff131600640 1 -- 172.21.15.103:0/3586830770 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ad8fe3300 con 0x557ad8eb2c80 2024-09-10T22:45:58.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff130c00640 1 --2- 172.21.15.103:0/3586830770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557ad8f2fe00 0x557ad8eb4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:45:58.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff131600640 1 --2- 172.21.15.103:0/3586830770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ad8eb2c80 0x557ad8eb4710 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7ff12400b4d0 tx=0x7ff12400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff12a000640 1 -- 172.21.15.103:0/3586830770 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124001e50 con 0x557ad8eb2c80 2024-09-10T22:45:58.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff12a000640 1 -- 172.21.15.103:0/3586830770 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff124015070 con 0x557ad8eb2c80 2024-09-10T22:45:58.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff12a000640 1 -- 172.21.15.103:0/3586830770 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1240032d0 con 0x557ad8eb2c80 2024-09-10T22:45:58.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff134e4d080 1 -- 172.21.15.103:0/3586830770 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ad8fe35a0 con 0x557ad8eb2c80 2024-09-10T22:45:58.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff134e4d080 1 -- 172.21.15.103:0/3586830770 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ad8fe3ae0 con 0x557ad8eb2c80 2024-09-10T22:45:58.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.076+0000 7ff12a000640 1 -- 172.21.15.103:0/3586830770 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff124003470 con 0x557ad8eb2c80 2024-09-10T22:45:58.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff12a000640 1 --2- 172.21.15.103:0/3586830770 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff114071190 0x7ff114073650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff12a000640 1 -- 172.21.15.103:0/3586830770 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7ff1240920c0 con 0x557ad8eb2c80 2024-09-10T22:45:58.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff130c00640 1 --2- 172.21.15.103:0/3586830770 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff114071190 0x7ff114073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff134e4d080 1 --2- 172.21.15.103:0/3586830770 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x557ad8f4f990 0x557ad8f4fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff134e4d080 1 -- 172.21.15.103:0/3586830770 --> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] -- osd_op(unknown.0.0:1 15.5 15:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x557ad8f502b0 con 0x557ad8f4f990 2024-09-10T22:45:58.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff132000640 1 --2- 172.21.15.103:0/3586830770 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x557ad8f4f990 0x557ad8f4fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff130c00640 1 --2- 172.21.15.103:0/3586830770 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff114071190 0x7ff114073650 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff120000c10 tx=0x7ff1200011e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff132000640 1 --2- 172.21.15.103:0/3586830770 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x557ad8f4f990 0x557ad8f4fd70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff132000640 1 -- 172.21.15.103:0/3586830770 <== osd.6 v2:172.21.15.131:6818/3165743337 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v107'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff12c0b1040 con 0x557ad8f4f990 2024-09-10T22:45:58.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff134e4d080 1 -- 172.21.15.103:0/3586830770 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x557ad8f4f990 msgr2=0x557ad8f4fd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff134e4d080 1 --2- 172.21.15.103:0/3586830770 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x557ad8f4f990 0x557ad8f4fd70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff134e4d080 1 -- 172.21.15.103:0/3586830770 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff114071190 msgr2=0x7ff114073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff134e4d080 1 --2- 172.21.15.103:0/3586830770 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff114071190 0x7ff114073650 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff120000c10 tx=0x7ff1200011e0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff134e4d080 1 -- 172.21.15.103:0/3586830770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ad8eb2c80 msgr2=0x557ad8eb4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff134e4d080 1 --2- 172.21.15.103:0/3586830770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557ad8eb2c80 0x557ad8eb4710 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7ff12400b4d0 tx=0x7ff12400b990 comp rx=0 tx=0).stop 2024-09-10T22:45:58.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff132000640 1 -- 172.21.15.103:0/3586830770 reap_dead start 2024-09-10T22:45:58.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff134e4d080 1 -- 172.21.15.103:0/3586830770 shutdown_connections 2024-09-10T22:45:58.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff134e4d080 1 -- 172.21.15.103:0/3586830770 >> 172.21.15.103:0/3586830770 conn(0x557ad8e73f30 msgr2=0x557ad8eb2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff134e4d080 1 -- 172.21.15.103:0/3586830770 shutdown_connections 2024-09-10T22:45:58.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.080+0000 7ff134e4d080 1 -- 172.21.15.103:0/3586830770 wait complete. 2024-09-10T22:45:58.091 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2024-09-10T22:45:58.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90ac908080 1 Processor -- start 2024-09-10T22:45:58.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90ac908080 1 -- start start 2024-09-10T22:45:58.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90ac908080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55638f1c58b0 0x55638f252130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90ac908080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55638f1df8e0 0x55638f252670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90ac908080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55638f269570 0x55638f252bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90ac908080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55638f0e1a00 con 0x55638f1c58b0 2024-09-10T22:45:58.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90ac908080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55638f13ff40 con 0x55638f269570 2024-09-10T22:45:58.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90ac908080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55638f24ebf0 con 0x55638f1df8e0 2024-09-10T22:45:58.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90a9c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55638f1c58b0 0x55638f252130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90a9c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55638f1c58b0 0x55638f252130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48616/0 (socket says 172.21.15.103:48616) 2024-09-10T22:45:58.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90a9c00640 1 -- 172.21.15.103:0/3637088422 learned_addr learned my addr 172.21.15.103:0/3637088422 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90aa600640 1 --2- 172.21.15.103:0/3637088422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55638f269570 0x55638f252bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90a9200640 1 --2- 172.21.15.103:0/3637088422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55638f1df8e0 0x55638f252670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90a9c00640 1 -- 172.21.15.103:0/3637088422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55638f1df8e0 msgr2=0x55638f252670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90a9c00640 1 --2- 172.21.15.103:0/3637088422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55638f1df8e0 0x55638f252670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90a9c00640 1 -- 172.21.15.103:0/3637088422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55638f269570 msgr2=0x55638f252bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90a9c00640 1 --2- 172.21.15.103:0/3637088422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55638f269570 0x55638f252bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90a9c00640 1 -- 172.21.15.103:0/3637088422 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55638f0bac10 con 0x55638f1c58b0 2024-09-10T22:45:58.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90a9200640 1 --2- 172.21.15.103:0/3637088422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55638f1df8e0 0x55638f252670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:58.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90aa600640 1 --2- 172.21.15.103:0/3637088422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55638f269570 0x55638f252bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:58.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90a9c00640 1 --2- 172.21.15.103:0/3637088422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55638f1c58b0 0x55638f252130 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f909c00b7d0 tx=0x7f909c00bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9385daf523bf0caf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90a3400640 1 -- 172.21.15.103:0/3637088422 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c00abb0 con 0x55638f1c58b0 2024-09-10T22:45:58.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90a3400640 1 -- 172.21.15.103:0/3637088422 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f909c00ad50 con 0x55638f1c58b0 2024-09-10T22:45:58.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.132+0000 7f90a3400640 1 -- 172.21.15.103:0/3637088422 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c0086c0 con 0x55638f1c58b0 2024-09-10T22:45:58.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 -- 172.21.15.103:0/3637088422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55638f1c58b0 msgr2=0x55638f252130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 --2- 172.21.15.103:0/3637088422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55638f1c58b0 0x55638f252130 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f909c00b7d0 tx=0x7f909c00bc90 comp rx=0 tx=0).stop 2024-09-10T22:45:58.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 -- 172.21.15.103:0/3637088422 shutdown_connections 2024-09-10T22:45:58.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 --2- 172.21.15.103:0/3637088422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55638f269570 0x55638f252bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 --2- 172.21.15.103:0/3637088422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55638f1df8e0 0x55638f252670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 --2- 172.21.15.103:0/3637088422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55638f1c58b0 0x55638f252130 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 -- 172.21.15.103:0/3637088422 >> 172.21.15.103:0/3637088422 conn(0x55638f190db0 msgr2=0x55638f191190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 -- 172.21.15.103:0/3637088422 shutdown_connections 2024-09-10T22:45:58.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 -- 172.21.15.103:0/3637088422 wait complete. 2024-09-10T22:45:58.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 Processor -- start 2024-09-10T22:45:58.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 -- start start 2024-09-10T22:45:58.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55638f1c58b0 0x55638f266100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55638f1df8e0 0x55638f252090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55638f269570 0x55638f253700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55638f191ab0 con 0x55638f1df8e0 2024-09-10T22:45:58.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55638f24cf00 con 0x55638f269570 2024-09-10T22:45:58.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55638f191d10 con 0x55638f1c58b0 2024-09-10T22:45:58.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90a9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55638f1df8e0 0x55638f252090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90a9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55638f1df8e0 0x55638f252090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48622/0 (socket says 172.21.15.103:48622) 2024-09-10T22:45:58.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90a9200640 1 -- 172.21.15.103:0/1482448799 learned_addr learned my addr 172.21.15.103:0/1482448799 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90aa600640 1 --2- 172.21.15.103:0/1482448799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55638f269570 0x55638f253700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90a9c00640 1 --2- 172.21.15.103:0/1482448799 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55638f1c58b0 0x55638f266100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90a9200640 1 -- 172.21.15.103:0/1482448799 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55638f1c58b0 msgr2=0x55638f266100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90a9200640 1 --2- 172.21.15.103:0/1482448799 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55638f1c58b0 0x55638f266100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90a9200640 1 -- 172.21.15.103:0/1482448799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55638f269570 msgr2=0x55638f253700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90a9200640 1 --2- 172.21.15.103:0/1482448799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55638f269570 0x55638f253700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90a9200640 1 -- 172.21.15.103:0/1482448799 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55638f252af0 con 0x55638f1df8e0 2024-09-10T22:45:58.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90a9200640 1 --2- 172.21.15.103:0/1482448799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55638f1df8e0 0x55638f252090 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f9098002eb0 tx=0x7f909800b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90a2000640 1 -- 172.21.15.103:0/1482448799 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9098013070 con 0x55638f1df8e0 2024-09-10T22:45:58.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90a2000640 1 -- 172.21.15.103:0/1482448799 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f909800f910 con 0x55638f1df8e0 2024-09-10T22:45:58.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 -- 172.21.15.103:0/1482448799 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55638f2471b0 con 0x55638f1df8e0 2024-09-10T22:45:58.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90a2000640 1 -- 172.21.15.103:0/1482448799 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909800fd20 con 0x55638f1df8e0 2024-09-10T22:45:58.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.136+0000 7f90ac908080 1 -- 172.21.15.103:0/1482448799 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55638f2476f0 con 0x55638f1df8e0 2024-09-10T22:45:58.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.140+0000 7f90a2000640 1 -- 172.21.15.103:0/1482448799 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f909801f030 con 0x55638f1df8e0 2024-09-10T22:45:58.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.140+0000 7f90a2000640 1 --2- 172.21.15.103:0/1482448799 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f908c070fc0 0x7f908c073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.140+0000 7f90a2000640 1 -- 172.21.15.103:0/1482448799 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f9098092070 con 0x55638f1df8e0 2024-09-10T22:45:58.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.140+0000 7f90a9c00640 1 --2- 172.21.15.103:0/1482448799 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f908c070fc0 0x7f908c073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.140+0000 7f90ac908080 1 --2- 172.21.15.103:0/1482448799 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x55638f2525d0 0x55638f2480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.140+0000 7f90ac908080 1 -- 172.21.15.103:0/1482448799 --> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] -- osd_op(unknown.0.0:1 15.9 15:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55638f2485e0 con 0x55638f2525d0 2024-09-10T22:45:58.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.140+0000 7f90aa600640 1 --2- 172.21.15.103:0/1482448799 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x55638f2525d0 0x55638f2480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.140+0000 7f90a9c00640 1 --2- 172.21.15.103:0/1482448799 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f908c070fc0 0x7f908c073480 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f909c000c10 tx=0x7f909c019040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.140+0000 7f90aa600640 1 --2- 172.21.15.103:0/1482448799 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x55638f2525d0 0x55638f2480a0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.144+0000 7f90aa600640 1 -- 172.21.15.103:0/1482448799 <== osd.6 v2:172.21.15.131:6818/3165743337 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v107'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f90a4002050 con 0x55638f2525d0 2024-09-10T22:45:58.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.144+0000 7f90ac908080 1 -- 172.21.15.103:0/1482448799 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x55638f2525d0 msgr2=0x55638f2480a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.144+0000 7f90ac908080 1 --2- 172.21.15.103:0/1482448799 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x55638f2525d0 0x55638f2480a0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.144+0000 7f90ac908080 1 -- 172.21.15.103:0/1482448799 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f908c070fc0 msgr2=0x7f908c073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.144+0000 7f90ac908080 1 --2- 172.21.15.103:0/1482448799 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f908c070fc0 0x7f908c073480 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f909c000c10 tx=0x7f909c019040 comp rx=0 tx=0).stop 2024-09-10T22:45:58.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.144+0000 7f90ac908080 1 -- 172.21.15.103:0/1482448799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55638f1df8e0 msgr2=0x55638f252090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.144+0000 7f90ac908080 1 --2- 172.21.15.103:0/1482448799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55638f1df8e0 0x55638f252090 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f9098002eb0 tx=0x7f909800b740 comp rx=0 tx=0).stop 2024-09-10T22:45:58.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.144+0000 7f90aa600640 1 -- 172.21.15.103:0/1482448799 reap_dead start 2024-09-10T22:45:58.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.144+0000 7f90ac908080 1 -- 172.21.15.103:0/1482448799 shutdown_connections 2024-09-10T22:45:58.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.144+0000 7f90ac908080 1 -- 172.21.15.103:0/1482448799 >> 172.21.15.103:0/1482448799 conn(0x55638f190db0 msgr2=0x55638f1c34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.144+0000 7f90ac908080 1 -- 172.21.15.103:0/1482448799 shutdown_connections 2024-09-10T22:45:58.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.144+0000 7f90ac908080 1 -- 172.21.15.103:0/1482448799 wait complete. 2024-09-10T22:45:58.153 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2024-09-10T22:45:58.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2fc21080 1 Processor -- start 2024-09-10T22:45:58.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2fc21080 1 -- start start 2024-09-10T22:45:58.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2fc21080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394898c8b0 0x563948a135d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2fc21080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639489a68e0 0x563948a328a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2fc21080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563948a30570 0x563948a2f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2fc21080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563948906f40 con 0x5639489a68e0 2024-09-10T22:45:58.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2fc21080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563948913d00 con 0x56394898c8b0 2024-09-10T22:45:58.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2fc21080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5639488a8a00 con 0x563948a30570 2024-09-10T22:45:58.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa27e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639489a68e0 0x563948a328a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa27e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639489a68e0 0x563948a328a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48630/0 (socket says 172.21.15.103:48630) 2024-09-10T22:45:58.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa27e00640 1 -- 172.21.15.103:0/167425269 learned_addr learned my addr 172.21.15.103:0/167425269 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2ce00640 1 --2- 172.21.15.103:0/167425269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394898c8b0 0x563948a135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2d800640 1 --2- 172.21.15.103:0/167425269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563948a30570 0x563948a2f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa27e00640 1 -- 172.21.15.103:0/167425269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563948a30570 msgr2=0x563948a2f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa27e00640 1 --2- 172.21.15.103:0/167425269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563948a30570 0x563948a2f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa27e00640 1 -- 172.21.15.103:0/167425269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394898c8b0 msgr2=0x563948a135d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa27e00640 1 --2- 172.21.15.103:0/167425269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394898c8b0 0x563948a135d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa27e00640 1 -- 172.21.15.103:0/167425269 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563948a2fd80 con 0x5639489a68e0 2024-09-10T22:45:58.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa27e00640 1 --2- 172.21.15.103:0/167425269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639489a68e0 0x563948a328a0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800b3b0 tx=0x7ffa1800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a82c18592d5ab1f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa26a00640 1 -- 172.21.15.103:0/167425269 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18001e60 con 0x5639489a68e0 2024-09-10T22:45:58.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa26a00640 1 -- 172.21.15.103:0/167425269 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa1800f620 con 0x5639489a68e0 2024-09-10T22:45:58.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa26a00640 1 -- 172.21.15.103:0/167425269 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1800a040 con 0x5639489a68e0 2024-09-10T22:45:58.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2fc21080 1 -- 172.21.15.103:0/167425269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639489a68e0 msgr2=0x563948a328a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2fc21080 1 --2- 172.21.15.103:0/167425269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639489a68e0 0x563948a328a0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800b3b0 tx=0x7ffa1800b870 comp rx=0 tx=0).stop 2024-09-10T22:45:58.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2fc21080 1 -- 172.21.15.103:0/167425269 shutdown_connections 2024-09-10T22:45:58.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2fc21080 1 --2- 172.21.15.103:0/167425269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563948a30570 0x563948a2f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2fc21080 1 --2- 172.21.15.103:0/167425269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5639489a68e0 0x563948a328a0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2fc21080 1 --2- 172.21.15.103:0/167425269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56394898c8b0 0x563948a135d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2fc21080 1 -- 172.21.15.103:0/167425269 >> 172.21.15.103:0/167425269 conn(0x563948957db0 msgr2=0x56394895a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2fc21080 1 -- 172.21.15.103:0/167425269 shutdown_connections 2024-09-10T22:45:58.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.236+0000 7ffa2fc21080 1 -- 172.21.15.103:0/167425269 wait complete. 2024-09-10T22:45:58.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2fc21080 1 Processor -- start 2024-09-10T22:45:58.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2fc21080 1 -- start start 2024-09-10T22:45:58.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2fc21080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394898c8b0 0x563948a12860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2fc21080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639489a68e0 0x563948acd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2fc21080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563948a30570 0x563948acdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2fc21080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563948958380 con 0x56394898c8b0 2024-09-10T22:45:58.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2fc21080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563948a13c00 con 0x563948a30570 2024-09-10T22:45:58.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2fc21080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563948958620 con 0x5639489a68e0 2024-09-10T22:45:58.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394898c8b0 0x563948a12860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394898c8b0 0x563948a12860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48644/0 (socket says 172.21.15.103:48644) 2024-09-10T22:45:58.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2ce00640 1 -- 172.21.15.103:0/3753502065 learned_addr learned my addr 172.21.15.103:0/3753502065 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa27e00640 1 --2- 172.21.15.103:0/3753502065 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639489a68e0 0x563948acd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2d800640 1 --2- 172.21.15.103:0/3753502065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563948a30570 0x563948acdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2ce00640 1 -- 172.21.15.103:0/3753502065 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639489a68e0 msgr2=0x563948acd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2ce00640 1 --2- 172.21.15.103:0/3753502065 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639489a68e0 0x563948acd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2ce00640 1 -- 172.21.15.103:0/3753502065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563948a30570 msgr2=0x563948acdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2ce00640 1 --2- 172.21.15.103:0/3753502065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563948a30570 0x563948acdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2ce00640 1 -- 172.21.15.103:0/3753502065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639489a25c0 con 0x56394898c8b0 2024-09-10T22:45:58.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2ce00640 1 --2- 172.21.15.103:0/3753502065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394898c8b0 0x563948a12860 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7ffa20096be0 tx=0x7ffa200abb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa25600640 1 -- 172.21.15.103:0/3753502065 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa200b0040 con 0x56394898c8b0 2024-09-10T22:45:58.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa25600640 1 -- 172.21.15.103:0/3753502065 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa200b7610 con 0x56394898c8b0 2024-09-10T22:45:58.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2fc21080 1 -- 172.21.15.103:0/3753502065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639489a2860 con 0x56394898c8b0 2024-09-10T22:45:58.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa25600640 1 -- 172.21.15.103:0/3753502065 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa200b7a20 con 0x56394898c8b0 2024-09-10T22:45:58.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.240+0000 7ffa2fc21080 1 -- 172.21.15.103:0/3753502065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639489a2da0 con 0x56394898c8b0 2024-09-10T22:45:58.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.244+0000 7ffa25600640 1 -- 172.21.15.103:0/3753502065 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ffa200b7bc0 con 0x56394898c8b0 2024-09-10T22:45:58.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.244+0000 7ffa25600640 1 --2- 172.21.15.103:0/3753502065 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffa0c070ff0 0x7ffa0c0734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.244+0000 7ffa25600640 1 -- 172.21.15.103:0/3753502065 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7ffa2012d610 con 0x56394898c8b0 2024-09-10T22:45:58.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.244+0000 7ffa2fc21080 1 --2- 172.21.15.103:0/3753502065 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x56394899e5c0 0x5639489596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.244+0000 7ffa27e00640 1 --2- 172.21.15.103:0/3753502065 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffa0c070ff0 0x7ffa0c0734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.244+0000 7ffa2fc21080 1 -- 172.21.15.103:0/3753502065 --> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] -- osd_op(unknown.0.0:1 15.5 15:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x563948959bf0 con 0x56394899e5c0 2024-09-10T22:45:58.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.244+0000 7ffa2d800640 1 --2- 172.21.15.103:0/3753502065 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x56394899e5c0 0x5639489596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.244+0000 7ffa27e00640 1 --2- 172.21.15.103:0/3753502065 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffa0c070ff0 0x7ffa0c0734b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffa18000c10 tx=0x7ffa18001130 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.244+0000 7ffa2d800640 1 --2- 172.21.15.103:0/3753502065 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x56394899e5c0 0x5639489596b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.248+0000 7ffa2d800640 1 -- 172.21.15.103:0/3753502065 <== osd.6 v2:172.21.15.131:6818/3165743337 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v107'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ffa28002710 con 0x56394899e5c0 2024-09-10T22:45:58.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.248+0000 7ffa2fc21080 1 -- 172.21.15.103:0/3753502065 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x56394899e5c0 msgr2=0x5639489596b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.248+0000 7ffa2fc21080 1 --2- 172.21.15.103:0/3753502065 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x56394899e5c0 0x5639489596b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.248+0000 7ffa2fc21080 1 -- 172.21.15.103:0/3753502065 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffa0c070ff0 msgr2=0x7ffa0c0734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.248+0000 7ffa2fc21080 1 --2- 172.21.15.103:0/3753502065 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffa0c070ff0 0x7ffa0c0734b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffa18000c10 tx=0x7ffa18001130 comp rx=0 tx=0).stop 2024-09-10T22:45:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.248+0000 7ffa2fc21080 1 -- 172.21.15.103:0/3753502065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394898c8b0 msgr2=0x563948a12860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.248+0000 7ffa2fc21080 1 --2- 172.21.15.103:0/3753502065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56394898c8b0 0x563948a12860 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7ffa20096be0 tx=0x7ffa200abb60 comp rx=0 tx=0).stop 2024-09-10T22:45:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.248+0000 7ffa2d800640 1 -- 172.21.15.103:0/3753502065 reap_dead start 2024-09-10T22:45:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.248+0000 7ffa2fc21080 1 -- 172.21.15.103:0/3753502065 shutdown_connections 2024-09-10T22:45:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.248+0000 7ffa2fc21080 1 -- 172.21.15.103:0/3753502065 >> 172.21.15.103:0/3753502065 conn(0x563948957db0 msgr2=0x56394898d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.248+0000 7ffa2fc21080 1 -- 172.21.15.103:0/3753502065 shutdown_connections 2024-09-10T22:45:58.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.248+0000 7ffa2fc21080 1 -- 172.21.15.103:0/3753502065 wait complete. 2024-09-10T22:45:58.267 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2024-09-10T22:45:58.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee2741d080 1 Processor -- start 2024-09-10T22:45:58.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee2741d080 1 -- start start 2024-09-10T22:45:58.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee2741d080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca717c01d0 0x55ca71772400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee2741d080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca7184a570 0x55ca717a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee2741d080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ca717a4d10 0x55ca7182cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee2741d080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ca716c2a00 con 0x55ca717a4d10 2024-09-10T22:45:58.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee2741d080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ca71720f40 con 0x55ca717c01d0 2024-09-10T22:45:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee2741d080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ca7182fbf0 con 0x55ca7184a570 2024-09-10T22:45:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee25000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ca717a4d10 0x55ca7182cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee25000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ca717a4d10 0x55ca7182cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48668/0 (socket says 172.21.15.103:48668) 2024-09-10T22:45:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee25000640 1 -- 172.21.15.103:0/1072389111 learned_addr learned my addr 172.21.15.103:0/1072389111 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee23c00640 1 --2- 172.21.15.103:0/1072389111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca7184a570 0x55ca717a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee24600640 1 --2- 172.21.15.103:0/1072389111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca717c01d0 0x55ca71772400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee25000640 1 -- 172.21.15.103:0/1072389111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca7184a570 msgr2=0x55ca717a47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee25000640 1 --2- 172.21.15.103:0/1072389111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca7184a570 0x55ca717a47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee25000640 1 -- 172.21.15.103:0/1072389111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca717c01d0 msgr2=0x55ca71772400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee25000640 1 --2- 172.21.15.103:0/1072389111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca717c01d0 0x55ca71772400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee25000640 1 -- 172.21.15.103:0/1072389111 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca7169bc10 con 0x55ca717a4d10 2024-09-10T22:45:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee23c00640 1 --2- 172.21.15.103:0/1072389111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca7184a570 0x55ca717a47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee24600640 1 --2- 172.21.15.103:0/1072389111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca717c01d0 0x55ca71772400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee25000640 1 --2- 172.21.15.103:0/1072389111 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ca717a4d10 0x55ca7182cc90 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00c800 tx=0x7fee1c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f3a2a4cca9ec91 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee22800640 1 -- 172.21.15.103:0/1072389111 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c013070 con 0x55ca717a4d10 2024-09-10T22:45:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee22800640 1 -- 172.21.15.103:0/1072389111 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee1c00aaf0 con 0x55ca717a4d10 2024-09-10T22:45:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee22800640 1 -- 172.21.15.103:0/1072389111 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c00f460 con 0x55ca717a4d10 2024-09-10T22:45:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee2741d080 1 -- 172.21.15.103:0/1072389111 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ca717a4d10 msgr2=0x55ca7182cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee2741d080 1 --2- 172.21.15.103:0/1072389111 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ca717a4d10 0x55ca7182cc90 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00c800 tx=0x7fee1c00ccc0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee2741d080 1 -- 172.21.15.103:0/1072389111 shutdown_connections 2024-09-10T22:45:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee2741d080 1 --2- 172.21.15.103:0/1072389111 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ca717a4d10 0x55ca7182cc90 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee2741d080 1 --2- 172.21.15.103:0/1072389111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca7184a570 0x55ca717a47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee2741d080 1 --2- 172.21.15.103:0/1072389111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca717c01d0 0x55ca71772400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee2741d080 1 -- 172.21.15.103:0/1072389111 >> 172.21.15.103:0/1072389111 conn(0x55ca71771db0 msgr2=0x55ca718497a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee2741d080 1 -- 172.21.15.103:0/1072389111 shutdown_connections 2024-09-10T22:45:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.348+0000 7fee2741d080 1 -- 172.21.15.103:0/1072389111 wait complete. 2024-09-10T22:45:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee2741d080 1 Processor -- start 2024-09-10T22:45:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee2741d080 1 -- start start 2024-09-10T22:45:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee2741d080 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca717a4d10 0x55ca7182a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee2741d080 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ca717c01d0 0x55ca717b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee2741d080 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca7184a570 0x55ca71847330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee2741d080 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ca718489b0 con 0x55ca717c01d0 2024-09-10T22:45:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee2741d080 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ca71848710 con 0x55ca7184a570 2024-09-10T22:45:58.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee2741d080 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ca71848c50 con 0x55ca717a4d10 2024-09-10T22:45:58.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee23c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ca717c01d0 0x55ca717b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee23c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ca717c01d0 0x55ca717b74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48684/0 (socket says 172.21.15.103:48684) 2024-09-10T22:45:58.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee23c00640 1 -- 172.21.15.103:0/433723666 learned_addr learned my addr 172.21.15.103:0/433723666 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee24600640 1 --2- 172.21.15.103:0/433723666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca717a4d10 0x55ca7182a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee25000640 1 --2- 172.21.15.103:0/433723666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca7184a570 0x55ca71847330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee23c00640 1 -- 172.21.15.103:0/433723666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca717a4d10 msgr2=0x55ca7182a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee23c00640 1 --2- 172.21.15.103:0/433723666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca717a4d10 0x55ca7182a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee23c00640 1 -- 172.21.15.103:0/433723666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca7184a570 msgr2=0x55ca71847330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee23c00640 1 --2- 172.21.15.103:0/433723666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca7184a570 0x55ca71847330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee23c00640 1 -- 172.21.15.103:0/433723666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca71834140 con 0x55ca717c01d0 2024-09-10T22:45:58.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee23c00640 1 --2- 172.21.15.103:0/433723666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ca717c01d0 0x55ca717b74d0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fee1001b7a0 tx=0x7fee100ab590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee21400640 1 -- 172.21.15.103:0/433723666 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee100acb40 con 0x55ca717c01d0 2024-09-10T22:45:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee21400640 1 -- 172.21.15.103:0/433723666 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee100acdd0 con 0x55ca717c01d0 2024-09-10T22:45:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee21400640 1 -- 172.21.15.103:0/433723666 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee100b8470 con 0x55ca717c01d0 2024-09-10T22:45:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee2741d080 1 -- 172.21.15.103:0/433723666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca718343e0 con 0x55ca717c01d0 2024-09-10T22:45:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.352+0000 7fee2741d080 1 -- 172.21.15.103:0/433723666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca717b80a0 con 0x55ca717c01d0 2024-09-10T22:45:58.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.356+0000 7fee21400640 1 -- 172.21.15.103:0/433723666 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fee100b6040 con 0x55ca717c01d0 2024-09-10T22:45:58.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.356+0000 7fee21400640 1 --2- 172.21.15.103:0/433723666 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fee04070fc0 0x7fee04073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.356+0000 7fee21400640 1 -- 172.21.15.103:0/433723666 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fee1012d1b0 con 0x55ca717c01d0 2024-09-10T22:45:58.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.356+0000 7fee24600640 1 --2- 172.21.15.103:0/433723666 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fee04070fc0 0x7fee04073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.356+0000 7fee2741d080 1 --2- 172.21.15.103:0/433723666 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x55ca7184d360 0x55ca718e41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.356+0000 7fee2741d080 1 -- 172.21.15.103:0/433723666 --> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] -- osd_op(unknown.0.0:1 15.1d 15:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) -- 0x55ca718e46f0 con 0x55ca7184d360 2024-09-10T22:45:58.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.356+0000 7fee25000640 1 --2- 172.21.15.103:0/433723666 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x55ca7184d360 0x55ca718e41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.356+0000 7fee24600640 1 --2- 172.21.15.103:0/433723666 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fee04070fc0 0x7fee04073480 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fee14010500 tx=0x7fee14003820 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.356+0000 7fee25000640 1 --2- 172.21.15.103:0/433723666 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x55ca7184d360 0x55ca718e41b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.360+0000 7fee25000640 1 -- 172.21.15.103:0/433723666 <== osd.4 v2:172.21.15.131:6810/2178799193 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v107'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fee1c015030 con 0x55ca7184d360 2024-09-10T22:45:58.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.360+0000 7fee2741d080 1 -- 172.21.15.103:0/433723666 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x55ca7184d360 msgr2=0x55ca718e41b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.360+0000 7fee2741d080 1 --2- 172.21.15.103:0/433723666 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x55ca7184d360 0x55ca718e41b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.360+0000 7fee2741d080 1 -- 172.21.15.103:0/433723666 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fee04070fc0 msgr2=0x7fee04073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.360+0000 7fee2741d080 1 --2- 172.21.15.103:0/433723666 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fee04070fc0 0x7fee04073480 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fee14010500 tx=0x7fee14003820 comp rx=0 tx=0).stop 2024-09-10T22:45:58.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.360+0000 7fee2741d080 1 -- 172.21.15.103:0/433723666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ca717c01d0 msgr2=0x55ca717b74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.360+0000 7fee2741d080 1 --2- 172.21.15.103:0/433723666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ca717c01d0 0x55ca717b74d0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fee1001b7a0 tx=0x7fee100ab590 comp rx=0 tx=0).stop 2024-09-10T22:45:58.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.360+0000 7fee25000640 1 -- 172.21.15.103:0/433723666 reap_dead start 2024-09-10T22:45:58.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.360+0000 7fee2741d080 1 -- 172.21.15.103:0/433723666 shutdown_connections 2024-09-10T22:45:58.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.360+0000 7fee2741d080 1 -- 172.21.15.103:0/433723666 >> 172.21.15.103:0/433723666 conn(0x55ca71771db0 msgr2=0x55ca718497a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.360+0000 7fee2741d080 1 -- 172.21.15.103:0/433723666 shutdown_connections 2024-09-10T22:45:58.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.360+0000 7fee2741d080 1 -- 172.21.15.103:0/433723666 wait complete. 2024-09-10T22:45:58.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:58.369 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start /d1/d2/d3 recursive,force 2024-09-10T22:45:58.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.552+0000 7ff86f200640 1 -- 172.21.15.103:0/1229403586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff87015f0e0 msgr2=0x7ff8700d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.552+0000 7ff86f200640 1 --2- 172.21.15.103:0/1229403586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff87015f0e0 0x7ff8700d1280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff860009900 tx=0x7ff86001c850 comp rx=0 tx=0).stop 2024-09-10T22:45:58.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.552+0000 7ff86f200640 1 -- 172.21.15.103:0/1229403586 shutdown_connections 2024-09-10T22:45:58.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.552+0000 7ff86f200640 1 --2- 172.21.15.103:0/1229403586 >> v2:172.21.15.131:3300/0 conn(0x7ff870070b40 0x7ff8700cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.552+0000 7ff86f200640 1 --2- 172.21.15.103:0/1229403586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff87015f0e0 0x7ff8700d1280 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.552+0000 7ff86f200640 1 -- 172.21.15.103:0/1229403586 >> 172.21.15.103:0/1229403586 conn(0x7ff8700d18d0 msgr2=0x7ff8700d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.552+0000 7ff86f200640 1 -- 172.21.15.103:0/1229403586 shutdown_connections 2024-09-10T22:45:58.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.552+0000 7ff86f200640 1 -- 172.21.15.103:0/1229403586 wait complete. 2024-09-10T22:45:58.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.552+0000 7ff86f200640 1 Processor -- start 2024-09-10T22:45:58.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.552+0000 7ff86f200640 1 -- start start 2024-09-10T22:45:58.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86f200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff870070b40 0x7ff8700b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86f200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8700d23f0 0x7ff870152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff87015f0e0 0x7ff8700c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff8701688a0 con 0x7ff87015f0e0 2024-09-10T22:45:58.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86f200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff870168a20 con 0x7ff870070b40 2024-09-10T22:45:58.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86f200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff870168ba0 con 0x7ff8700d23f0 2024-09-10T22:45:58.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff87015f0e0 0x7ff8700c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff87015f0e0 0x7ff8700c7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48692/0 (socket says 172.21.15.103:48692) 2024-09-10T22:45:58.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86e800640 1 -- 172.21.15.103:0/372861814 learned_addr learned my addr 172.21.15.103:0/372861814 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86de00640 1 --2- 172.21.15.103:0/372861814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff870070b40 0x7ff8700b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86d400640 1 --2- 172.21.15.103:0/372861814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8700d23f0 0x7ff870152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86e800640 1 -- 172.21.15.103:0/372861814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8700d23f0 msgr2=0x7ff870152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86e800640 1 --2- 172.21.15.103:0/372861814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8700d23f0 0x7ff870152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86e800640 1 -- 172.21.15.103:0/372861814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff870070b40 msgr2=0x7ff8700b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86e800640 1 --2- 172.21.15.103:0/372861814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff870070b40 0x7ff8700b1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86e800640 1 -- 172.21.15.103:0/372861814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87006de40 con 0x7ff87015f0e0 2024-09-10T22:45:58.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86d400640 1 --2- 172.21.15.103:0/372861814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8700d23f0 0x7ff870152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:58.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86e800640 1 --2- 172.21.15.103:0/372861814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff87015f0e0 0x7ff8700c7750 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7ff86800eb20 tx=0x7ff86800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff866000640 1 -- 172.21.15.103:0/372861814 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff868004b30 con 0x7ff87015f0e0 2024-09-10T22:45:58.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff866000640 1 -- 172.21.15.103:0/372861814 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff868004cf0 con 0x7ff87015f0e0 2024-09-10T22:45:58.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff866000640 1 -- 172.21.15.103:0/372861814 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff868005280 con 0x7ff87015f0e0 2024-09-10T22:45:58.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86f200640 1 -- 172.21.15.103:0/372861814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff87006e120 con 0x7ff87015f0e0 2024-09-10T22:45:58.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.556+0000 7ff86f200640 1 -- 172.21.15.103:0/372861814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff87006e6e0 con 0x7ff87015f0e0 2024-09-10T22:45:58.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff866000640 1 -- 172.21.15.103:0/372861814 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff868005420 con 0x7ff87015f0e0 2024-09-10T22:45:58.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff866000640 1 --2- 172.21.15.103:0/372861814 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff8500725e0 0x7ff850074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff866000640 1 -- 172.21.15.103:0/372861814 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7ff8680940f0 con 0x7ff87015f0e0 2024-09-10T22:45:58.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff878698000 1 Processor -- start 2024-09-10T22:45:58.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff878698000 1 -- start start 2024-09-10T22:45:58.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff86de00640 1 --2- 172.21.15.103:0/372861814 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff8500725e0 0x7ff850074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff86de00640 1 --2- 172.21.15.103:0/372861814 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff8500725e0 0x7ff850074aa0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff8600af000 tx=0x7ff86001b090 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff878698000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636470 0x5644d5636850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff878698000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d5636d90 0x5644d55ecb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff878698000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d55ed0b0 0x5644d55ed490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff878698000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5644d5448bb0 con 0x5644d5636470 2024-09-10T22:45:58.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff878698000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5644d5437fe0 con 0x5644d55ed0b0 2024-09-10T22:45:58.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff878698000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5644d543bdf0 con 0x5644d5636d90 2024-09-10T22:45:58.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff86de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636470 0x5644d5636850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff86de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636470 0x5644d5636850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48696/0 (socket says 172.21.15.103:48696) 2024-09-10T22:45:58.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff86de00640 1 -- 172.21.15.103:0/1686255292 learned_addr learned my addr 172.21.15.103:0/1686255292 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff86d400640 1 --2- 172.21.15.103:0/1686255292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d5636d90 0x5644d55ecb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff86e800640 1 --2- 172.21.15.103:0/1686255292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d55ed0b0 0x5644d55ed490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff86de00640 1 -- 172.21.15.103:0/1686255292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d5636d90 msgr2=0x5644d55ecb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff86de00640 1 --2- 172.21.15.103:0/1686255292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d5636d90 0x5644d55ecb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff86de00640 1 -- 172.21.15.103:0/1686255292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d55ed0b0 msgr2=0x5644d55ed490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff86de00640 1 --2- 172.21.15.103:0/1686255292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d55ed0b0 0x5644d55ed490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff86de00640 1 -- 172.21.15.103:0/1686255292 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644d54134a0 con 0x5644d5636470 2024-09-10T22:45:58.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.560+0000 7ff86de00640 1 --2- 172.21.15.103:0/1686255292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636470 0x5644d5636850 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7ff860009850 tx=0x7ff8600b4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9272db239b58e486 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff85aa00640 1 -- 172.21.15.103:0/1686255292 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8600c8070 con 0x5644d5636470 2024-09-10T22:45:58.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff85aa00640 1 -- 172.21.15.103:0/1686255292 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff860005040 con 0x5644d5636470 2024-09-10T22:45:58.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff85aa00640 1 -- 172.21.15.103:0/1686255292 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8600b2040 con 0x5644d5636470 2024-09-10T22:45:58.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff878698000 1 -- 172.21.15.103:0/1686255292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636470 msgr2=0x5644d5636850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff878698000 1 --2- 172.21.15.103:0/1686255292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636470 0x5644d5636850 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7ff860009850 tx=0x7ff8600b4000 comp rx=0 tx=0).stop 2024-09-10T22:45:58.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff878698000 1 -- 172.21.15.103:0/1686255292 shutdown_connections 2024-09-10T22:45:58.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff878698000 1 --2- 172.21.15.103:0/1686255292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d55ed0b0 0x5644d55ed490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff878698000 1 --2- 172.21.15.103:0/1686255292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d5636d90 0x5644d55ecb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff878698000 1 --2- 172.21.15.103:0/1686255292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636470 0x5644d5636850 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff878698000 1 -- 172.21.15.103:0/1686255292 >> 172.21.15.103:0/1686255292 conn(0x5644d55e9060 msgr2=0x5644d55eb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff878698000 1 -- 172.21.15.103:0/1686255292 shutdown_connections 2024-09-10T22:45:58.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff878698000 1 -- 172.21.15.103:0/1686255292 wait complete. 2024-09-10T22:45:58.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff878698000 1 -- start start 2024-09-10T22:45:58.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff878698000 1 Processor -- start 2024-09-10T22:45:58.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff878698000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d55ed0b0 0x5644d55f7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff878698000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d5636470 0x5644d55f7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff878698000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d5636d90 0x5644d55f7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff878698000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5644d54f3a10 con 0x5644d55ed0b0 2024-09-10T22:45:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff878698000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5644d53e1b30 con 0x5644d5636d90 2024-09-10T22:45:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff878698000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5644d53de990 con 0x5644d5636470 2024-09-10T22:45:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff878698000 10 client.0 _ll_register_callbacks cb 0x5644d54eec90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff86de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d55ed0b0 0x5644d55f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff86e800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d5636d90 0x5644d55f7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff86de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d55ed0b0 0x5644d55f7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48700/0 (socket says 172.21.15.103:48700) 2024-09-10T22:45:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff86de00640 1 -- 172.21.15.103:0/985983861 learned_addr learned my addr 172.21.15.103:0/985983861 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff86d400640 1 --2- 172.21.15.103:0/985983861 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d5636470 0x5644d55f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff86de00640 1 -- 172.21.15.103:0/985983861 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d5636470 msgr2=0x5644d55f7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff86de00640 1 --2- 172.21.15.103:0/985983861 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d5636470 0x5644d55f7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff86de00640 1 -- 172.21.15.103:0/985983861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d5636d90 msgr2=0x5644d55f7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff86de00640 1 --2- 172.21.15.103:0/985983861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d5636d90 0x5644d55f7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff86de00640 1 -- 172.21.15.103:0/985983861 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644d5481600 con 0x5644d55ed0b0 2024-09-10T22:45:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff86e800640 1 --2- 172.21.15.103:0/985983861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d5636d90 0x5644d55f7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:45:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff86de00640 1 --2- 172.21.15.103:0/985983861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d55ed0b0 0x5644d55f7430 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7ff860009850 tx=0x7ff860005480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f55641800e901cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff84f400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.564+0000 7ff84f400640 1 -- 172.21.15.103:0/985983861 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8600c8070 con 0x5644d55ed0b0 2024-09-10T22:45:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff84f400640 1 -- 172.21.15.103:0/985983861 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7ff8600046d0 con 0x5644d55ed0b0 2024-09-10T22:45:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 1 -- 172.21.15.103:0/985983861 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5644d53d0240 con 0x5644d55ed0b0 2024-09-10T22:45:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff84f400640 1 -- 172.21.15.103:0/985983861 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7ff8600bc020 con 0x5644d55ed0b0 2024-09-10T22:45:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 10 client.8562 fetch_fsmap learned FSMap version 114 2024-09-10T22:45:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 1 -- 172.21.15.103:0/985983861 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x5644d53eb350 con 0x5644d55ed0b0 2024-09-10T22:45:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff84f400640 1 -- 172.21.15.103:0/985983861 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5644d53d0240 con 0x5644d55ed0b0 2024-09-10T22:45:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff84f400640 1 -- 172.21.15.103:0/985983861 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 114) ==== 3554+0+0 (secure 0 0 0) 0x7ff8600b5030 con 0x5644d55ed0b0 2024-09-10T22:45:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 10 client.8562 fetch_fsmap finished waiting for FSMap version 114 2024-09-10T22:45:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 10 client.8562 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T22:45:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 20 client.8562 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 1 --2- 172.21.15.103:0/985983861 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x5644d5645710 0x5644d5647b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 4 client.8562 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:45:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 1 -- 172.21.15.103:0/985983861 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644d544ab00 con 0x5644d5645710 2024-09-10T22:45:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff86d400640 1 --2- 172.21.15.103:0/985983861 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x5644d5645710 0x5644d5647b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff86d400640 1 --2- 172.21.15.103:0/985983861 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x5644d5645710 0x5644d5647b00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba3786f03e1cdf39 server_cookie=b32a96c29578a5b in_seq=0 out_seq=0 2024-09-10T22:45:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff84f400640 10 client.8562 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff84f400640 1 -- 172.21.15.103:0/985983861 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5644d544ab00 con 0x5644d5645710 2024-09-10T22:45:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff84f400640 10 client.8562 handle_command_reply: tid=0 2024-09-10T22:45:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 1 client.8562 shutdown 2024-09-10T22:45:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 1 -- 172.21.15.103:0/985983861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d55ed0b0 msgr2=0x5644d55f7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 1 --2- 172.21.15.103:0/985983861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d55ed0b0 0x5644d55f7430 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7ff860009850 tx=0x7ff860005480 comp rx=0 tx=0).stop 2024-09-10T22:45:58.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 1 -- 172.21.15.103:0/985983861 shutdown_connections 2024-09-10T22:45:58.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 1 --2- 172.21.15.103:0/985983861 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x5644d5645710 0x5644d5647b00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 1 --2- 172.21.15.103:0/985983861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d5636d90 0x5644d55f7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff84f400640 0 client.8562 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:58.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 1 --2- 172.21.15.103:0/985983861 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d5636470 0x5644d55f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 1 --2- 172.21.15.103:0/985983861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d55ed0b0 0x5644d55f7430 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 1 -- 172.21.15.103:0/985983861 >> 172.21.15.103:0/985983861 conn(0x5644d55e9060 msgr2=0x5644d55ebc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 1 -- 172.21.15.103:0/985983861 shutdown_connections 2024-09-10T22:45:58.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 1 -- 172.21.15.103:0/985983861 wait complete. 2024-09-10T22:45:58.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.568+0000 7ff878698000 20 client.8562 trim_cache size 0 max 16384 2024-09-10T22:45:58.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff878698000 1 Processor -- start 2024-09-10T22:45:58.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff878698000 1 -- start start 2024-09-10T22:45:58.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff878698000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d55ed0b0 0x5644d55f2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff878698000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636470 0x5644d55f28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff878698000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d5636d90 0x5644d5645af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff878698000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff870203240 con 0x5644d5636470 2024-09-10T22:45:58.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff878698000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff870203940 con 0x5644d5636d90 2024-09-10T22:45:58.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff878698000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff870164500 con 0x5644d55ed0b0 2024-09-10T22:45:58.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff86d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636470 0x5644d55f28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff86d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636470 0x5644d55f28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48710/0 (socket says 172.21.15.103:48710) 2024-09-10T22:45:58.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff86d400640 1 -- 172.21.15.103:0/1486960172 learned_addr learned my addr 172.21.15.103:0/1486960172 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff86de00640 1 --2- 172.21.15.103:0/1486960172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d55ed0b0 0x5644d55f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff86e800640 1 --2- 172.21.15.103:0/1486960172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d5636d90 0x5644d5645af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff86d400640 1 -- 172.21.15.103:0/1486960172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d55ed0b0 msgr2=0x5644d55f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff86d400640 1 --2- 172.21.15.103:0/1486960172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d55ed0b0 0x5644d55f2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff86d400640 1 -- 172.21.15.103:0/1486960172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d5636d90 msgr2=0x5644d5645af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff86d400640 1 --2- 172.21.15.103:0/1486960172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d5636d90 0x5644d5645af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff86d400640 1 -- 172.21.15.103:0/1486960172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644d53d6100 con 0x5644d5636470 2024-09-10T22:45:58.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff86e800640 1 --2- 172.21.15.103:0/1486960172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d5636d90 0x5644d5645af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:58.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff86d400640 1 --2- 172.21.15.103:0/1486960172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636470 0x5644d55f28a0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7ff85c001430 tx=0x7ff85c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4cec266d142518d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff85a000640 1 -- 172.21.15.103:0/1486960172 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c005110 con 0x5644d5636470 2024-09-10T22:45:58.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff85a000640 1 -- 172.21.15.103:0/1486960172 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff85c023070 con 0x5644d5636470 2024-09-10T22:45:58.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff85a000640 1 -- 172.21.15.103:0/1486960172 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c016990 con 0x5644d5636470 2024-09-10T22:45:58.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff878698000 1 -- 172.21.15.103:0/1486960172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636470 msgr2=0x5644d55f28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff878698000 1 --2- 172.21.15.103:0/1486960172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636470 0x5644d55f28a0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7ff85c001430 tx=0x7ff85c009040 comp rx=0 tx=0).stop 2024-09-10T22:45:58.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff878698000 1 -- 172.21.15.103:0/1486960172 shutdown_connections 2024-09-10T22:45:58.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff878698000 1 --2- 172.21.15.103:0/1486960172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d5636d90 0x5644d5645af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff878698000 1 --2- 172.21.15.103:0/1486960172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636470 0x5644d55f28a0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff878698000 1 --2- 172.21.15.103:0/1486960172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d55ed0b0 0x5644d55f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff878698000 1 -- 172.21.15.103:0/1486960172 >> 172.21.15.103:0/1486960172 conn(0x5644d55e9060 msgr2=0x5644d55ec2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff878698000 1 -- 172.21.15.103:0/1486960172 shutdown_connections 2024-09-10T22:45:58.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff878698000 1 -- 172.21.15.103:0/1486960172 wait complete. 2024-09-10T22:45:58.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.588+0000 7ff878698000 1 -- start start 2024-09-10T22:45:58.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff878698000 1 Processor -- start 2024-09-10T22:45:58.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff878698000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d55ed0b0 0x5644d56abc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff878698000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d5636470 0x5644d56ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff878698000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636d90 0x5644d56ac700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff878698000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5644d543b100 con 0x5644d5636d90 2024-09-10T22:45:58.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff878698000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5644d5405a90 con 0x5644d5636470 2024-09-10T22:45:58.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff878698000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5644d5440420 con 0x5644d55ed0b0 2024-09-10T22:45:58.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff878698000 10 client.0 _ll_register_callbacks cb 0x7ff8600c6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:58.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff86e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636d90 0x5644d56ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff86e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636d90 0x5644d56ac700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48718/0 (socket says 172.21.15.103:48718) 2024-09-10T22:45:58.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff86e800640 1 -- 172.21.15.103:0/594353713 learned_addr learned my addr 172.21.15.103:0/594353713 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff86de00640 1 --2- 172.21.15.103:0/594353713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d55ed0b0 0x5644d56abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff86d400640 1 --2- 172.21.15.103:0/594353713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d5636470 0x5644d56ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff86e800640 1 -- 172.21.15.103:0/594353713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d55ed0b0 msgr2=0x5644d56abc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff86e800640 1 --2- 172.21.15.103:0/594353713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d55ed0b0 0x5644d56abc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff86e800640 1 -- 172.21.15.103:0/594353713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d5636470 msgr2=0x5644d56ac1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff86e800640 1 --2- 172.21.15.103:0/594353713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d5636470 0x5644d56ac1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff86e800640 1 -- 172.21.15.103:0/594353713 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644d54bd290 con 0x5644d5636d90 2024-09-10T22:45:58.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff86e800640 1 --2- 172.21.15.103:0/594353713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636d90 0x5644d56ac700 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7ff86805ebe0 tx=0x7ff868068290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e0434743416c8b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff84f400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:58.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff84f400640 1 -- 172.21.15.103:0/594353713 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff868090060 con 0x5644d5636d90 2024-09-10T22:45:58.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff84f400640 1 -- 172.21.15.103:0/594353713 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7ff868064b50 con 0x5644d5636d90 2024-09-10T22:45:58.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff878698000 1 -- 172.21.15.103:0/594353713 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff85c023070 con 0x5644d5636d90 2024-09-10T22:45:58.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff84f400640 1 -- 172.21.15.103:0/594353713 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7ff868078070 con 0x5644d5636d90 2024-09-10T22:45:58.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff878698000 10 client.8568 fetch_fsmap learned FSMap version 114 2024-09-10T22:45:58.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff878698000 1 -- 172.21.15.103:0/594353713 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x5644d53ce600 con 0x5644d5636d90 2024-09-10T22:45:58.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff84f400640 1 -- 172.21.15.103:0/594353713 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff85c023070 con 0x5644d5636d90 2024-09-10T22:45:58.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff84f400640 1 -- 172.21.15.103:0/594353713 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 114) ==== 3554+0+0 (secure 0 0 0) 0x7ff868086030 con 0x5644d5636d90 2024-09-10T22:45:58.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff878698000 10 client.8568 fetch_fsmap finished waiting for FSMap version 114 2024-09-10T22:45:58.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff878698000 10 client.8568 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T22:45:58.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff878698000 20 client.8568 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:58.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff878698000 1 --2- 172.21.15.103:0/594353713 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x5644d56491b0 0x5644d56495c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff878698000 4 client.8568 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2024-09-10T22:45:58.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff878698000 1 -- 172.21.15.103:0/594353713 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) -- 0x5644d54465b0 con 0x5644d56491b0 2024-09-10T22:45:58.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff86de00640 1 --2- 172.21.15.103:0/594353713 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x5644d56491b0 0x5644d56495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff84f400640 10 client.8568 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:58.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.592+0000 7ff86de00640 1 --2- 172.21.15.103:0/594353713 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x5644d56491b0 0x5644d56495c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc7545389c554e0b server_cookie=dccc139041040c3e in_seq=0 out_seq=0 2024-09-10T22:45:58.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff84f400640 1 -- 172.21.15.103:0/594353713 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5644d54465b0 con 0x5644d56491b0 2024-09-10T22:45:58.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff84f400640 10 client.8568 handle_command_reply: tid=0 2024-09-10T22:45:58.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff878698000 1 client.8568 shutdown 2024-09-10T22:45:58.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff878698000 1 -- 172.21.15.103:0/594353713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636d90 msgr2=0x5644d56ac700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff878698000 1 --2- 172.21.15.103:0/594353713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636d90 0x5644d56ac700 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7ff86805ebe0 tx=0x7ff868068290 comp rx=0 tx=0).stop 2024-09-10T22:45:58.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff878698000 1 -- 172.21.15.103:0/594353713 shutdown_connections 2024-09-10T22:45:58.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff878698000 1 --2- 172.21.15.103:0/594353713 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x5644d56491b0 0x5644d56495c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff878698000 1 --2- 172.21.15.103:0/594353713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5644d5636d90 0x5644d56ac700 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff878698000 1 --2- 172.21.15.103:0/594353713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644d5636470 0x5644d56ac1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff878698000 1 --2- 172.21.15.103:0/594353713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644d55ed0b0 0x5644d56abc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.603 INFO:tasks.ceph.mds.c.smithi103.stderr:2024-09-10T22:45:58.596+0000 7fa8c1600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-10T22:45:40.494005+0000 1=0+1) n(v3 rc2024-09-10T22:45:40.717416+0000 6=0+6) (inest mix dirty) (ifile excl) caps={8364=pAsLsXsFsx/AsLsXsFsx@9},l=8364 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55becc78f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:45:40.494005+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:45:40.717416+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-10T22:45:40.494005+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-10T22:45:40.717416+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-10T22:45:58.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff878698000 1 -- 172.21.15.103:0/594353713 >> 172.21.15.103:0/594353713 conn(0x5644d55e9060 msgr2=0x5644d55f1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff84f400640 0 client.8568 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:58.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff878698000 1 -- 172.21.15.103:0/594353713 shutdown_connections 2024-09-10T22:45:58.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff878698000 1 -- 172.21.15.103:0/594353713 wait complete. 2024-09-10T22:45:58.605 INFO:tasks.ceph.mds.b.smithi131.stderr:2024-09-10T22:45:58.601+0000 7f132ba00640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-10T22:45:40.501264+0000 1=0+1) n(v0 rc2024-09-10T22:45:40.501264+0000 2=0+2) (inest lock) (ifile excl) caps={8364=pAsLsXsFsx/-@6},l=8364 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x557016854000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:45:40.501264+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:45:40.501264+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-10T22:45:40.501264+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-10T22:45:40.501264+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-10T22:45:58.605 INFO:tasks.ceph.mds.b.smithi131.stderr:2024-09-10T22:45:58.601+0000 7f132ba00640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) caps={8364=pAsLsXsFs/-@3},l=8364 | request=0 lock=0 importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x557016854580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-10T22:45:58.605 INFO:tasks.ceph.mds.a.smithi103.stderr:2024-09-10T22:45:58.596+0000 7fa390a00640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-10T22:45:40.497526+0000 1=0+1) n(v2 rc2024-09-10T22:45:40.717416+0000 4=0+4) (inest lock) caps={8364=pAsLsXsFs/-@7},l=8364 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55b981b6ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:45:40.497526+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:45:40.717416+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-10T22:45:40.497526+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-10T22:45:40.717416+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-10T22:45:58.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff878698000 20 client.8568 trim_cache size 0 max 16384 2024-09-10T22:45:58.606 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:45:58.606 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0, 2024-09-10T22:45:58.606 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_tag": "13d979f1-0660-40c8-9ef3-e228e32f6cb4", 2024-09-10T22:45:58.606 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": "asynchronous" 2024-09-10T22:45:58.606 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:45:58.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff86f200640 1 -- 172.21.15.103:0/372861814 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff8500725e0 msgr2=0x7ff850074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff86f200640 1 --2- 172.21.15.103:0/372861814 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff8500725e0 0x7ff850074aa0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff8600af000 tx=0x7ff86001b090 comp rx=0 tx=0).stop 2024-09-10T22:45:58.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff86f200640 1 -- 172.21.15.103:0/372861814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff87015f0e0 msgr2=0x7ff8700c7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff86f200640 1 --2- 172.21.15.103:0/372861814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff87015f0e0 0x7ff8700c7750 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7ff86800eb20 tx=0x7ff86800c2d0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff86f200640 1 -- 172.21.15.103:0/372861814 shutdown_connections 2024-09-10T22:45:58.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff86f200640 1 --2- 172.21.15.103:0/372861814 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff8500725e0 0x7ff850074aa0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff86f200640 1 --2- 172.21.15.103:0/372861814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff87015f0e0 0x7ff8700c7750 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff86f200640 1 --2- 172.21.15.103:0/372861814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8700d23f0 0x7ff870152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff86f200640 1 --2- 172.21.15.103:0/372861814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff870070b40 0x7ff8700b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff86f200640 1 -- 172.21.15.103:0/372861814 >> 172.21.15.103:0/372861814 conn(0x7ff8700d18d0 msgr2=0x7ff8700ae620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff86f200640 1 -- 172.21.15.103:0/372861814 shutdown_connections 2024-09-10T22:45:58.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.596+0000 7ff86f200640 1 -- 172.21.15.103:0/372861814 wait complete. 2024-09-10T22:45:58.608 INFO:tasks.ceph.mds.c.smithi103.stderr:2024-09-10T22:45:58.596+0000 7fa8c9800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-10T22:45:40.495695+0000 1=0+1) n(v4 rc2024-09-10T22:45:40.717416+0000 5=0+5) (inest sync->mix g=1,2) caps={8364=pAsLsXsFs/-@11} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55becc78f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:45:40.495695+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:45:40.717416+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-10T22:45:40.495695+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-10T22:45:40.717416+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-10T22:45:58.608 INFO:tasks.ceph.mds.a.smithi103.stderr:2024-09-10T22:45:58.596+0000 7fa398c00640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-10T22:45:40.499257+0000 1=0+1) n(v1 rc2024-09-10T22:45:40.717416+0000 3=0+3) (inest sync->mix g=0,2 scatter_wanted) caps={8364=pAsLsXsFs/-@7} | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55b981b6e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:45:40.499257+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:45:40.501264+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-10T22:45:40.499257+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-10T22:45:40.717416+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-10T22:45:58.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:45:58.620 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub pause 2024-09-10T22:45:58.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51b4e00640 1 -- 172.21.15.103:0/3044417609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51b00b09c0 msgr2=0x7f51b00ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51b4e00640 1 --2- 172.21.15.103:0/3044417609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51b00b09c0 0x7f51b00ce600 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5198009840 tx=0x7f519801c790 comp rx=0 tx=0).stop 2024-09-10T22:45:58.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51b4e00640 1 -- 172.21.15.103:0/3044417609 shutdown_connections 2024-09-10T22:45:58.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51b4e00640 1 --2- 172.21.15.103:0/3044417609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51b00b09c0 0x7f51b00ce600 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51b4e00640 1 --2- 172.21.15.103:0/3044417609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51b015be30 0x7f51b00ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51b4e00640 1 -- 172.21.15.103:0/3044417609 >> 172.21.15.103:0/3044417609 conn(0x7f51b00d1ac0 msgr2=0x7f51b00d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51b4e00640 1 -- 172.21.15.103:0/3044417609 shutdown_connections 2024-09-10T22:45:58.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51b4e00640 1 -- 172.21.15.103:0/3044417609 wait complete. 2024-09-10T22:45:58.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51b4e00640 1 Processor -- start 2024-09-10T22:45:58.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51b4e00640 1 -- start start 2024-09-10T22:45:58.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51b4e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51b00b09c0 0x7f51b00b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51b4e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51b00ceb40 0x7f51b00b3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51b4e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51b015be30 0x7f51b0156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51b4e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f51b0169110 con 0x7f51b015be30 2024-09-10T22:45:58.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51b4e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f51b0168f90 con 0x7f51b00b09c0 2024-09-10T22:45:58.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51b4e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f51b0169290 con 0x7f51b00ceb40 2024-09-10T22:45:58.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51ae800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51b015be30 0x7f51b0156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51ae800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51b015be30 0x7f51b0156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48730/0 (socket says 172.21.15.103:48730) 2024-09-10T22:45:58.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51ae800640 1 -- 172.21.15.103:0/1645408799 learned_addr learned my addr 172.21.15.103:0/1645408799 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51ade00640 1 --2- 172.21.15.103:0/1645408799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51b00b09c0 0x7f51b00b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51a7e00640 1 --2- 172.21.15.103:0/1645408799 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51b00ceb40 0x7f51b00b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51ae800640 1 -- 172.21.15.103:0/1645408799 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51b00ceb40 msgr2=0x7f51b00b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.760+0000 7f51ae800640 1 --2- 172.21.15.103:0/1645408799 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51b00ceb40 0x7f51b00b3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.764+0000 7f51ae800640 1 -- 172.21.15.103:0/1645408799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51b00b09c0 msgr2=0x7f51b00b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.764+0000 7f51ae800640 1 --2- 172.21.15.103:0/1645408799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51b00b09c0 0x7f51b00b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.764+0000 7f51ae800640 1 -- 172.21.15.103:0/1645408799 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b00c9740 con 0x7f51b015be30 2024-09-10T22:45:58.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.764+0000 7f51ade00640 1 --2- 172.21.15.103:0/1645408799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51b00b09c0 0x7f51b00b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:45:58.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.764+0000 7f51ae800640 1 --2- 172.21.15.103:0/1645408799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51b015be30 0x7f51b0156580 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f51a800cbc0 tx=0x7f51a800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.764+0000 7f51a6000640 1 -- 172.21.15.103:0/1645408799 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8016020 con 0x7f51b015be30 2024-09-10T22:45:58.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.764+0000 7f51a6000640 1 -- 172.21.15.103:0/1645408799 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51a800ab00 con 0x7f51b015be30 2024-09-10T22:45:58.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.764+0000 7f51a6000640 1 -- 172.21.15.103:0/1645408799 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8012420 con 0x7f51b015be30 2024-09-10T22:45:58.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.764+0000 7f51b4e00640 1 -- 172.21.15.103:0/1645408799 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b00c99e0 con 0x7f51b015be30 2024-09-10T22:45:58.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.764+0000 7f51b4e00640 1 -- 172.21.15.103:0/1645408799 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b00b0ed0 con 0x7f51b015be30 2024-09-10T22:45:58.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.764+0000 7f51a6000640 1 -- 172.21.15.103:0/1645408799 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f51a80125c0 con 0x7f51b015be30 2024-09-10T22:45:58.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.764+0000 7f51a6000640 1 --2- 172.21.15.103:0/1645408799 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f518c0725e0 0x7f518c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51a6000640 1 -- 172.21.15.103:0/1645408799 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f51a80937f0 con 0x7f51b015be30 2024-09-10T22:45:58.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51b82bf000 1 Processor -- start 2024-09-10T22:45:58.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51b82bf000 1 -- start start 2024-09-10T22:45:58.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51ade00640 1 --2- 172.21.15.103:0/1645408799 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f518c0725e0 0x7f518c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51ade00640 1 --2- 172.21.15.103:0/1645408799 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f518c0725e0 0x7f518c074aa0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009f30 tx=0x7f51a00091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51b82bf000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfaba761d0 0x55dfabbd7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51b82bf000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabbd83d0 0x55dfabbd87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51b82bf000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfabb8e5a0 0x55dfabb8e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51b82bf000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55dfab98c2c0 con 0x55dfabbd83d0 2024-09-10T22:45:58.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51b82bf000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55dfab9e9b90 con 0x55dfabb8e5a0 2024-09-10T22:45:58.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51b82bf000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55dfab9d8fc0 con 0x55dfaba761d0 2024-09-10T22:45:58.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51a7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabbd83d0 0x55dfabbd87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51ade00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfaba761d0 0x55dfabbd7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51a7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabbd83d0 0x55dfabbd87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48732/0 (socket says 172.21.15.103:48732) 2024-09-10T22:45:58.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51a7e00640 1 -- 172.21.15.103:0/2647581190 learned_addr learned my addr 172.21.15.103:0/2647581190 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51ae800640 1 --2- 172.21.15.103:0/2647581190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfabb8e5a0 0x55dfabb8e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51a7e00640 1 -- 172.21.15.103:0/2647581190 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfaba761d0 msgr2=0x55dfabbd7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51a7e00640 1 --2- 172.21.15.103:0/2647581190 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfaba761d0 0x55dfabbd7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51a7e00640 1 -- 172.21.15.103:0/2647581190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfabb8e5a0 msgr2=0x55dfabb8e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51a7e00640 1 --2- 172.21.15.103:0/2647581190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfabb8e5a0 0x55dfabb8e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51a7e00640 1 -- 172.21.15.103:0/2647581190 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfab9771a0 con 0x55dfabbd83d0 2024-09-10T22:45:58.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51a7e00640 1 --2- 172.21.15.103:0/2647581190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabbd83d0 0x55dfabbd87b0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f5198000c10 tx=0x7f5198019530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68198dcf2b1fede server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f519ea00640 1 -- 172.21.15.103:0/2647581190 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51980ac040 con 0x55dfabbd83d0 2024-09-10T22:45:58.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f519ea00640 1 -- 172.21.15.103:0/2647581190 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51980051c0 con 0x55dfabbd83d0 2024-09-10T22:45:58.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f519ea00640 1 -- 172.21.15.103:0/2647581190 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5198005590 con 0x55dfabbd83d0 2024-09-10T22:45:58.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51b82bf000 1 -- 172.21.15.103:0/2647581190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabbd83d0 msgr2=0x55dfabbd87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51b82bf000 1 --2- 172.21.15.103:0/2647581190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabbd83d0 0x55dfabbd87b0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f5198000c10 tx=0x7f5198019530 comp rx=0 tx=0).stop 2024-09-10T22:45:58.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51b82bf000 1 -- 172.21.15.103:0/2647581190 shutdown_connections 2024-09-10T22:45:58.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51b82bf000 1 --2- 172.21.15.103:0/2647581190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfabb8e5a0 0x55dfabb8e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51b82bf000 1 --2- 172.21.15.103:0/2647581190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabbd83d0 0x55dfabbd87b0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51b82bf000 1 --2- 172.21.15.103:0/2647581190 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfaba761d0 0x55dfabbd7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51b82bf000 1 -- 172.21.15.103:0/2647581190 >> 172.21.15.103:0/2647581190 conn(0x55dfab697880 msgr2=0x55dfabb8ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51b82bf000 1 -- 172.21.15.103:0/2647581190 shutdown_connections 2024-09-10T22:45:58.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51b82bf000 1 -- 172.21.15.103:0/2647581190 wait complete. 2024-09-10T22:45:58.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.768+0000 7f51b82bf000 1 -- start start 2024-09-10T22:45:58.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51b82bf000 1 Processor -- start 2024-09-10T22:45:58.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51b82bf000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfaba761d0 0x55dfabbdea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51b82bf000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 0x55dfabbdef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51b82bf000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfabbd83d0 0x55dfabbdf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51b82bf000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55dfab97e4d0 con 0x55dfabb8e5a0 2024-09-10T22:45:58.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51b82bf000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55dfab9dcdd0 con 0x55dfaba761d0 2024-09-10T22:45:58.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51b82bf000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55dfab69e620 con 0x55dfabbd83d0 2024-09-10T22:45:58.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51b82bf000 10 client.0 _ll_register_callbacks cb 0x55dfab9afcd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:58.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51a7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 0x55dfabbdef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51a7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 0x55dfabbdef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48746/0 (socket says 172.21.15.103:48746) 2024-09-10T22:45:58.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51a7e00640 1 -- 172.21.15.103:0/1805268221 learned_addr learned my addr 172.21.15.103:0/1805268221 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51ade00640 1 --2- 172.21.15.103:0/1805268221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfaba761d0 0x55dfabbdea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51ae800640 1 --2- 172.21.15.103:0/1805268221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfabbd83d0 0x55dfabbdf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51a7e00640 1 -- 172.21.15.103:0/1805268221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfabbd83d0 msgr2=0x55dfabbdf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51a7e00640 1 --2- 172.21.15.103:0/1805268221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfabbd83d0 0x55dfabbdf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51a7e00640 1 -- 172.21.15.103:0/1805268221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfaba761d0 msgr2=0x55dfabbdea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51a7e00640 1 --2- 172.21.15.103:0/1805268221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfaba761d0 0x55dfabbdea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51a7e00640 1 -- 172.21.15.103:0/1805268221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfabaa8720 con 0x55dfabb8e5a0 2024-09-10T22:45:58.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51ade00640 1 --2- 172.21.15.103:0/1805268221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfaba761d0 0x55dfabbdea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:58.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51ae800640 1 --2- 172.21.15.103:0/1805268221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfabbd83d0 0x55dfabbdf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:58.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51a7e00640 1 --2- 172.21.15.103:0/1805268221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 0x55dfabbdef60 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f519801a3c0 tx=0x7f5198005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472a4de33816fc36 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f5193400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:58.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f5193400640 1 -- 172.21.15.103:0/1805268221 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51980ac070 con 0x55dfabb8e5a0 2024-09-10T22:45:58.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f5193400640 1 -- 172.21.15.103:0/1805268221 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f5198004020 con 0x55dfabb8e5a0 2024-09-10T22:45:58.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51b82bf000 1 -- 172.21.15.103:0/1805268221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dfab9712e0 con 0x55dfabb8e5a0 2024-09-10T22:45:58.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f5193400640 1 -- 172.21.15.103:0/1805268221 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7f51980ca050 con 0x55dfabb8e5a0 2024-09-10T22:45:58.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51b82bf000 10 client.8580 fetch_fsmap learned FSMap version 114 2024-09-10T22:45:58.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51b82bf000 1 -- 172.21.15.103:0/1805268221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x55dfaba5e420 con 0x55dfabb8e5a0 2024-09-10T22:45:58.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f5193400640 1 -- 172.21.15.103:0/1805268221 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55dfab9712e0 con 0x55dfabb8e5a0 2024-09-10T22:45:58.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f5193400640 1 -- 172.21.15.103:0/1805268221 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 114) ==== 3554+0+0 (secure 0 0 0) 0x7f51980cd020 con 0x55dfabb8e5a0 2024-09-10T22:45:58.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51b82bf000 10 client.8580 fetch_fsmap finished waiting for FSMap version 114 2024-09-10T22:45:58.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51b82bf000 10 client.8580 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T22:45:58.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51b82bf000 20 client.8580 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:58.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51b82bf000 1 --2- 172.21.15.103:0/1805268221 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55dfabbe6df0 0x55dfabbe91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51b82bf000 4 client.8580 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:45:58.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51b82bf000 1 -- 172.21.15.103:0/1805268221 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfab9ebae0 con 0x55dfabbe6df0 2024-09-10T22:45:58.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51ade00640 1 --2- 172.21.15.103:0/1805268221 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55dfabbe6df0 0x55dfabbe91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f51ade00640 1 --2- 172.21.15.103:0/1805268221 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55dfabbe6df0 0x55dfabbe91e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dfc77b7bc3fdeba server_cookie=fcd9704fdb573c9f in_seq=0 out_seq=0 2024-09-10T22:45:58.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.772+0000 7f5193400640 10 client.8580 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:58.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.776+0000 7f5193400640 1 -- 172.21.15.103:0/1805268221 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dfab9ebae0 con 0x55dfabbe6df0 2024-09-10T22:45:58.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.776+0000 7f5193400640 10 client.8580 handle_command_reply: tid=0 2024-09-10T22:45:58.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.776+0000 7f51b82bf000 1 client.8580 shutdown 2024-09-10T22:45:58.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.776+0000 7f51b82bf000 1 -- 172.21.15.103:0/1805268221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 msgr2=0x55dfabbdef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.776+0000 7f51b82bf000 1 --2- 172.21.15.103:0/1805268221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 0x55dfabbdef60 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f519801a3c0 tx=0x7f5198005550 comp rx=0 tx=0).stop 2024-09-10T22:45:58.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.776+0000 7f51b82bf000 1 -- 172.21.15.103:0/1805268221 shutdown_connections 2024-09-10T22:45:58.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.776+0000 7f51b82bf000 1 --2- 172.21.15.103:0/1805268221 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55dfabbe6df0 0x55dfabbe91e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.776+0000 7f51b82bf000 1 --2- 172.21.15.103:0/1805268221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfabbd83d0 0x55dfabbdf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.776+0000 7f51b82bf000 1 --2- 172.21.15.103:0/1805268221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 0x55dfabbdef60 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.776+0000 7f51b82bf000 1 --2- 172.21.15.103:0/1805268221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfaba761d0 0x55dfabbdea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.776+0000 7f5193400640 0 client.8580 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:58.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.776+0000 7f51b82bf000 1 -- 172.21.15.103:0/1805268221 >> 172.21.15.103:0/1805268221 conn(0x55dfab697880 msgr2=0x55dfabb8d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.776+0000 7f51b82bf000 1 -- 172.21.15.103:0/1805268221 shutdown_connections 2024-09-10T22:45:58.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.776+0000 7f51b82bf000 1 -- 172.21.15.103:0/1805268221 wait complete. 2024-09-10T22:45:58.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.776+0000 7f51b82bf000 20 client.8580 trim_cache size 0 max 16384 2024-09-10T22:45:58.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.792+0000 7f51b82bf000 1 Processor -- start 2024-09-10T22:45:58.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.792+0000 7f51b82bf000 1 -- start start 2024-09-10T22:45:58.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.792+0000 7f51b82bf000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfab697880 0x55dfabb8c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.792+0000 7f51b82bf000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfaba761d0 0x55dfabb8cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.792+0000 7f51b82bf000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 0x55dfabb8d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.792+0000 7f51b82bf000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f51b0204a30 con 0x55dfabb8e5a0 2024-09-10T22:45:58.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.792+0000 7f51b82bf000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f51b0203c50 con 0x55dfaba761d0 2024-09-10T22:45:58.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.792+0000 7f51b82bf000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f51b0204300 con 0x55dfab697880 2024-09-10T22:45:58.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.792+0000 7f51ae800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 0x55dfabb8d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.792+0000 7f51ae800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 0x55dfabb8d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48762/0 (socket says 172.21.15.103:48762) 2024-09-10T22:45:58.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.792+0000 7f51ae800640 1 -- 172.21.15.103:0/3098989888 learned_addr learned my addr 172.21.15.103:0/3098989888 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51ade00640 1 --2- 172.21.15.103:0/3098989888 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfab697880 0x55dfabb8c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51a7e00640 1 --2- 172.21.15.103:0/3098989888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfaba761d0 0x55dfabb8cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51ae800640 1 -- 172.21.15.103:0/3098989888 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfab697880 msgr2=0x55dfabb8c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51ae800640 1 --2- 172.21.15.103:0/3098989888 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfab697880 0x55dfabb8c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51ae800640 1 -- 172.21.15.103:0/3098989888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfaba761d0 msgr2=0x55dfabb8cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51ae800640 1 --2- 172.21.15.103:0/3098989888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfaba761d0 0x55dfabb8cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51ae800640 1 -- 172.21.15.103:0/3098989888 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfaba35ae0 con 0x55dfabb8e5a0 2024-09-10T22:45:58.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51a7e00640 1 --2- 172.21.15.103:0/3098989888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfaba761d0 0x55dfabb8cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:58.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51ae800640 1 --2- 172.21.15.103:0/3098989888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 0x55dfabb8d0e0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f51a805aef0 tx=0x7f51a805ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ef89059e5d1f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f519e000640 1 -- 172.21.15.103:0/3098989888 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8075070 con 0x55dfabb8e5a0 2024-09-10T22:45:58.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f519e000640 1 -- 172.21.15.103:0/3098989888 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51a8067b80 con 0x55dfabb8e5a0 2024-09-10T22:45:58.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f519e000640 1 -- 172.21.15.103:0/3098989888 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a807fda0 con 0x55dfabb8e5a0 2024-09-10T22:45:58.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51b82bf000 1 -- 172.21.15.103:0/3098989888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 msgr2=0x55dfabb8d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51b82bf000 1 --2- 172.21.15.103:0/3098989888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 0x55dfabb8d0e0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f51a805aef0 tx=0x7f51a805ad80 comp rx=0 tx=0).stop 2024-09-10T22:45:58.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51b82bf000 1 -- 172.21.15.103:0/3098989888 shutdown_connections 2024-09-10T22:45:58.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51b82bf000 1 --2- 172.21.15.103:0/3098989888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 0x55dfabb8d0e0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51b82bf000 1 --2- 172.21.15.103:0/3098989888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfaba761d0 0x55dfabb8cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51b82bf000 1 --2- 172.21.15.103:0/3098989888 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfab697880 0x55dfabb8c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51b82bf000 1 -- 172.21.15.103:0/3098989888 >> 172.21.15.103:0/3098989888 conn(0x55dfabbdf320 msgr2=0x55dfabb931d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51b82bf000 1 -- 172.21.15.103:0/3098989888 shutdown_connections 2024-09-10T22:45:58.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51b82bf000 1 -- 172.21.15.103:0/3098989888 wait complete. 2024-09-10T22:45:58.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51b82bf000 1 -- start start 2024-09-10T22:45:58.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51b82bf000 1 Processor -- start 2024-09-10T22:45:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51b82bf000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfab697880 0x55dfabc4e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51b82bf000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfaba761d0 0x55dfabc4ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51b82bf000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 0x55dfabc4f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51b82bf000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55dfabb90c40 con 0x55dfabb8e5a0 2024-09-10T22:45:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51b82bf000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55dfab9dc0e0 con 0x55dfaba761d0 2024-09-10T22:45:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51b82bf000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55dfab9e9b90 con 0x55dfab697880 2024-09-10T22:45:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51b82bf000 10 client.0 _ll_register_callbacks cb 0x7f51a8001cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51ae800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 0x55dfabc4f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51ae800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 0x55dfabc4f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48764/0 (socket says 172.21.15.103:48764) 2024-09-10T22:45:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51ae800640 1 -- 172.21.15.103:0/3199173811 learned_addr learned my addr 172.21.15.103:0/3199173811 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51ade00640 1 --2- 172.21.15.103:0/3199173811 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfab697880 0x55dfabc4e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51a7e00640 1 --2- 172.21.15.103:0/3199173811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfaba761d0 0x55dfabc4ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51ae800640 1 -- 172.21.15.103:0/3199173811 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfab697880 msgr2=0x55dfabc4e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51ae800640 1 --2- 172.21.15.103:0/3199173811 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfab697880 0x55dfabc4e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51ae800640 1 -- 172.21.15.103:0/3199173811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfaba761d0 msgr2=0x55dfabc4ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51ae800640 1 --2- 172.21.15.103:0/3199173811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfaba761d0 0x55dfabc4ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.796+0000 7f51ae800640 1 -- 172.21.15.103:0/3199173811 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfab9a3040 con 0x55dfabb8e5a0 2024-09-10T22:45:58.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51ae800640 1 --2- 172.21.15.103:0/3199173811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 0x55dfabc4f210 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f51a800a430 tx=0x7f51a80632a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1632283c154ed6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f5193400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:58.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f5193400640 1 -- 172.21.15.103:0/3199173811 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8075040 con 0x55dfabb8e5a0 2024-09-10T22:45:58.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f5193400640 1 -- 172.21.15.103:0/3199173811 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f51a805d990 con 0x55dfabb8e5a0 2024-09-10T22:45:58.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 1 -- 172.21.15.103:0/3199173811 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51a8067b80 con 0x55dfabb8e5a0 2024-09-10T22:45:58.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f5193400640 1 -- 172.21.15.103:0/3199173811 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7f51a805aae0 con 0x55dfabb8e5a0 2024-09-10T22:45:58.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 10 client.8586 fetch_fsmap learned FSMap version 114 2024-09-10T22:45:58.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 1 -- 172.21.15.103:0/3199173811 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x55dfab96f620 con 0x55dfabb8e5a0 2024-09-10T22:45:58.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f5193400640 1 -- 172.21.15.103:0/3199173811 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51a8067b80 con 0x55dfabb8e5a0 2024-09-10T22:45:58.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f5193400640 1 -- 172.21.15.103:0/3199173811 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 114) ==== 3554+0+0 (secure 0 0 0) 0x7f51a8065040 con 0x55dfabb8e5a0 2024-09-10T22:45:58.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 10 client.8586 fetch_fsmap finished waiting for FSMap version 114 2024-09-10T22:45:58.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 10 client.8586 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T22:45:58.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 20 client.8586 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:58.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 1 --2- 172.21.15.103:0/3199173811 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55dfabbd83d0 0x55dfabbe4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 4 client.8586 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-10T22:45:58.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 1 -- 172.21.15.103:0/3199173811 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55dfabbef500 con 0x55dfabbd83d0 2024-09-10T22:45:58.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51ade00640 1 --2- 172.21.15.103:0/3199173811 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55dfabbd83d0 0x55dfabbe4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f5193400640 10 client.8586 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:58.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51ade00640 1 --2- 172.21.15.103:0/3199173811 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55dfabbd83d0 0x55dfabbe4230 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d5f0fbd8289db3d server_cookie=c7f6130438dfe8c1 in_seq=0 out_seq=0 2024-09-10T22:45:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f5193400640 1 -- 172.21.15.103:0/3199173811 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dfabbef500 con 0x55dfabbd83d0 2024-09-10T22:45:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f5193400640 10 client.8586 handle_command_reply: tid=0 2024-09-10T22:45:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 1 client.8586 shutdown 2024-09-10T22:45:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 1 -- 172.21.15.103:0/3199173811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 msgr2=0x55dfabc4f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 1 --2- 172.21.15.103:0/3199173811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 0x55dfabc4f210 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f51a800a430 tx=0x7f51a80632a0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 1 -- 172.21.15.103:0/3199173811 shutdown_connections 2024-09-10T22:45:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 1 --2- 172.21.15.103:0/3199173811 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55dfabbd83d0 0x55dfabbe4230 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 1 --2- 172.21.15.103:0/3199173811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfabb8e5a0 0x55dfabc4f210 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 1 --2- 172.21.15.103:0/3199173811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfaba761d0 0x55dfabc4ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 1 --2- 172.21.15.103:0/3199173811 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dfab697880 0x55dfabc4e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 1 -- 172.21.15.103:0/3199173811 >> 172.21.15.103:0/3199173811 conn(0x55dfabbdf320 msgr2=0x55dfabb939f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f5193400640 0 client.8586 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 1 -- 172.21.15.103:0/3199173811 shutdown_connections 2024-09-10T22:45:58.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 1 -- 172.21.15.103:0/3199173811 wait complete. 2024-09-10T22:45:58.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b82bf000 20 client.8586 trim_cache size 0 max 16384 2024-09-10T22:45:58.810 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:45:58.810 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:45:58.810 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:45:58.810 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:45:58.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b4e00640 1 -- 172.21.15.103:0/1645408799 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f518c0725e0 msgr2=0x7f518c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b4e00640 1 --2- 172.21.15.103:0/1645408799 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f518c0725e0 0x7f518c074aa0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009f30 tx=0x7f51a00091e0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b4e00640 1 -- 172.21.15.103:0/1645408799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51b015be30 msgr2=0x7f51b0156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b4e00640 1 --2- 172.21.15.103:0/1645408799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51b015be30 0x7f51b0156580 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f51a800cbc0 tx=0x7f51a800ccb0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b4e00640 1 -- 172.21.15.103:0/1645408799 shutdown_connections 2024-09-10T22:45:58.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b4e00640 1 --2- 172.21.15.103:0/1645408799 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f518c0725e0 0x7f518c074aa0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b4e00640 1 --2- 172.21.15.103:0/1645408799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51b015be30 0x7f51b0156580 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b4e00640 1 --2- 172.21.15.103:0/1645408799 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51b00ceb40 0x7f51b00b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b4e00640 1 --2- 172.21.15.103:0/1645408799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51b00b09c0 0x7f51b00b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b4e00640 1 -- 172.21.15.103:0/1645408799 >> 172.21.15.103:0/1645408799 conn(0x7f51b00d1ac0 msgr2=0x7f51b015acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b4e00640 1 -- 172.21.15.103:0/1645408799 shutdown_connections 2024-09-10T22:45:58.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.800+0000 7f51b4e00640 1 -- 172.21.15.103:0/1645408799 wait complete. 2024-09-10T22:45:58.825 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:45:58.825 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:1 scrub status 2024-09-10T22:45:58.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.964+0000 7f6389e00640 1 -- 172.21.15.103:0/3497249674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63840d04a0 msgr2=0x7f63840affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.964+0000 7f6389e00640 1 --2- 172.21.15.103:0/3497249674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63840d04a0 0x7f63840affd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6370009900 tx=0x7f637001c850 comp rx=0 tx=0).stop 2024-09-10T22:45:58.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.964+0000 7f6389e00640 1 -- 172.21.15.103:0/3497249674 shutdown_connections 2024-09-10T22:45:58.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.964+0000 7f6389e00640 1 --2- 172.21.15.103:0/3497249674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63840d04a0 0x7f63840affd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.964+0000 7f6389e00640 1 --2- 172.21.15.103:0/3497249674 >> v2:172.21.15.131:3300/0 conn(0x7f638415f0e0 0x7f63840cff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.964+0000 7f6389e00640 1 -- 172.21.15.103:0/3497249674 >> 172.21.15.103:0/3497249674 conn(0x7f63840d18f0 msgr2=0x7f63840d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.964+0000 7f6389e00640 1 -- 172.21.15.103:0/3497249674 shutdown_connections 2024-09-10T22:45:58.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.964+0000 7f6389e00640 1 -- 172.21.15.103:0/3497249674 wait complete. 2024-09-10T22:45:58.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6389e00640 1 Processor -- start 2024-09-10T22:45:58.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6389e00640 1 -- start start 2024-09-10T22:45:58.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6389e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63840714d0 0x7f63840b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6389e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63840d04a0 0x7f63840b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6389e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f638415f0e0 0x7f6384147850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6389e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6384168da0 con 0x7f63840d04a0 2024-09-10T22:45:58.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6389e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6384168c20 con 0x7f63840714d0 2024-09-10T22:45:58.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6389e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6384168f20 con 0x7f638415f0e0 2024-09-10T22:45:58.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6383e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63840d04a0 0x7f63840b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6383e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63840d04a0 0x7f63840b2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48766/0 (socket says 172.21.15.103:48766) 2024-09-10T22:45:58.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6383e00640 1 -- 172.21.15.103:0/1789527368 learned_addr learned my addr 172.21.15.103:0/1789527368 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6388a00640 1 --2- 172.21.15.103:0/1789527368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63840714d0 0x7f63840b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6389400640 1 --2- 172.21.15.103:0/1789527368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f638415f0e0 0x7f6384147850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6383e00640 1 -- 172.21.15.103:0/1789527368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f638415f0e0 msgr2=0x7f6384147850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6383e00640 1 --2- 172.21.15.103:0/1789527368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f638415f0e0 0x7f6384147850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6383e00640 1 -- 172.21.15.103:0/1789527368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63840714d0 msgr2=0x7f63840b71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6383e00640 1 --2- 172.21.15.103:0/1789527368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63840714d0 0x7f63840b71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6383e00640 1 -- 172.21.15.103:0/1789527368 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63840b1400 con 0x7f63840d04a0 2024-09-10T22:45:58.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6388a00640 1 --2- 172.21.15.103:0/1789527368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63840714d0 0x7f63840b71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:58.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6383e00640 1 --2- 172.21.15.103:0/1789527368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63840d04a0 0x7f63840b2fe0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f6370009850 tx=0x7f6370005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6380c00640 1 -- 172.21.15.103:0/1789527368 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63700b2040 con 0x7f63840d04a0 2024-09-10T22:45:58.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6380c00640 1 -- 172.21.15.103:0/1789527368 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63700043f0 con 0x7f63840d04a0 2024-09-10T22:45:58.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6389e00640 1 -- 172.21.15.103:0/1789527368 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63840b16e0 con 0x7f63840d04a0 2024-09-10T22:45:58.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6380c00640 1 -- 172.21.15.103:0/1789527368 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63700052d0 con 0x7f63840d04a0 2024-09-10T22:45:58.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.968+0000 7f6389e00640 1 -- 172.21.15.103:0/1789527368 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63840b3520 con 0x7f63840d04a0 2024-09-10T22:45:58.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f6380c00640 1 -- 172.21.15.103:0/1789527368 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6370005470 con 0x7f63840d04a0 2024-09-10T22:45:58.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f6380c00640 1 --2- 172.21.15.103:0/1789527368 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f63640725e0 0x7f6364074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f6380c00640 1 -- 172.21.15.103:0/1789527368 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f637012cef0 con 0x7f63840d04a0 2024-09-10T22:45:58.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f638e869000 1 Processor -- start 2024-09-10T22:45:58.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f638e869000 1 -- start start 2024-09-10T22:45:58.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f6388a00640 1 --2- 172.21.15.103:0/1789527368 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f63640725e0 0x7f6364074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f638e869000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 0x561857bf7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f6388a00640 1 --2- 172.21.15.103:0/1789527368 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f63640725e0 0x7f6364074aa0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6374009b90 tx=0x7f63740091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f638e869000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857bf7ac0 0x561857bad680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f638e869000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857badbc0 0x561857badfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f638e869000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x561857a95cb0 con 0x561857bf71a0 2024-09-10T22:45:58.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f638e869000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5618579ab310 con 0x561857badbc0 2024-09-10T22:45:58.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f638e869000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x561857a08b90 con 0x561857bf7ac0 2024-09-10T22:45:58.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f6388a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 0x561857bf7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f6388a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 0x561857bf7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48774/0 (socket says 172.21.15.103:48774) 2024-09-10T22:45:58.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f6388a00640 1 -- 172.21.15.103:0/527390247 learned_addr learned my addr 172.21.15.103:0/527390247 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f6383e00640 1 --2- 172.21.15.103:0/527390247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857bf7ac0 0x561857bad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f6389400640 1 --2- 172.21.15.103:0/527390247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857badbc0 0x561857badfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f6383e00640 1 -- 172.21.15.103:0/527390247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857badbc0 msgr2=0x561857badfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f6383e00640 1 --2- 172.21.15.103:0/527390247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857badbc0 0x561857badfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.972+0000 7f6383e00640 1 -- 172.21.15.103:0/527390247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 msgr2=0x561857bf7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6383e00640 1 --2- 172.21.15.103:0/527390247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 0x561857bf7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6383e00640 1 -- 172.21.15.103:0/527390247 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618579acc60 con 0x561857bf7ac0 2024-09-10T22:45:58.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6388a00640 1 --2- 172.21.15.103:0/527390247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 0x561857bf7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:45:58.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6383e00640 1 --2- 172.21.15.103:0/527390247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857bf7ac0 0x561857bad680 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f637012b230 tx=0x7f63700f3c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f30fe123e2d04bdd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6379600640 1 -- 172.21.15.103:0/527390247 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63700f77f0 con 0x561857bf7ac0 2024-09-10T22:45:58.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6379600640 1 -- 172.21.15.103:0/527390247 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63700f83e0 con 0x561857bf7ac0 2024-09-10T22:45:58.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6379600640 1 -- 172.21.15.103:0/527390247 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63700f7ce0 con 0x561857bf7ac0 2024-09-10T22:45:58.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f638e869000 1 -- 172.21.15.103:0/527390247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857bf7ac0 msgr2=0x561857bad680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f638e869000 1 --2- 172.21.15.103:0/527390247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857bf7ac0 0x561857bad680 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f637012b230 tx=0x7f63700f3c00 comp rx=0 tx=0).stop 2024-09-10T22:45:58.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f638e869000 1 -- 172.21.15.103:0/527390247 shutdown_connections 2024-09-10T22:45:58.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f638e869000 1 --2- 172.21.15.103:0/527390247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857badbc0 0x561857badfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f638e869000 1 --2- 172.21.15.103:0/527390247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857bf7ac0 0x561857bad680 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f638e869000 1 --2- 172.21.15.103:0/527390247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 0x561857bf7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f638e869000 1 -- 172.21.15.103:0/527390247 >> 172.21.15.103:0/527390247 conn(0x561857bb3d20 msgr2=0x561857babf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f638e869000 1 -- 172.21.15.103:0/527390247 shutdown_connections 2024-09-10T22:45:58.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f638e869000 1 -- 172.21.15.103:0/527390247 wait complete. 2024-09-10T22:45:58.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f638e869000 1 -- start start 2024-09-10T22:45:58.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f638e869000 1 Processor -- start 2024-09-10T22:45:58.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f638e869000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857badbc0 0x561857bfe530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f638e869000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 0x561857bfea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f638e869000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857bf7ac0 0x561857bfefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f638e869000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5618579fbdd0 con 0x561857bf71a0 2024-09-10T22:45:58.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f638e869000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5618579f7fc0 con 0x561857badbc0 2024-09-10T22:45:58.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f638e869000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56185799d4b0 con 0x561857bf7ac0 2024-09-10T22:45:58.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f638e869000 10 client.0 _ll_register_callbacks cb 0x56185797b7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:58.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6383e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 0x561857bfea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6383e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 0x561857bfea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48788/0 (socket says 172.21.15.103:48788) 2024-09-10T22:45:58.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6383e00640 1 -- 172.21.15.103:0/435812274 learned_addr learned my addr 172.21.15.103:0/435812274 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:58.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6383e00640 1 -- 172.21.15.103:0/435812274 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857bf7ac0 msgr2=0x561857bfefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6389400640 1 --2- 172.21.15.103:0/435812274 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857bf7ac0 0x561857bfefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6388a00640 1 --2- 172.21.15.103:0/435812274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857badbc0 0x561857bfe530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6383e00640 1 --2- 172.21.15.103:0/435812274 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857bf7ac0 0x561857bfefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6383e00640 1 -- 172.21.15.103:0/435812274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857badbc0 msgr2=0x561857bfe530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:58.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6383e00640 1 --2- 172.21.15.103:0/435812274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857badbc0 0x561857bfe530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6383e00640 1 -- 172.21.15.103:0/435812274 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618579961f0 con 0x561857bf71a0 2024-09-10T22:45:58.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6389400640 1 --2- 172.21.15.103:0/435812274 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857bf7ac0 0x561857bfefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:58.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.976+0000 7f6388a00640 1 --2- 172.21.15.103:0/435812274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857badbc0 0x561857bfe530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:58.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f6383e00640 1 --2- 172.21.15.103:0/435812274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 0x561857bfea70 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f6370098320 tx=0x7f6370005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f056bcd75bb8a575 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:58.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f636e000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:58.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f636e000640 1 -- 172.21.15.103:0/435812274 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63700fc7c0 con 0x561857bf71a0 2024-09-10T22:45:58.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f636e000640 1 -- 172.21.15.103:0/435812274 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f6370126cb0 con 0x561857bf71a0 2024-09-10T22:45:58.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 1 -- 172.21.15.103:0/435812274 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561857990330 con 0x561857bf71a0 2024-09-10T22:45:58.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f636e000640 1 -- 172.21.15.103:0/435812274 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7f6370126eb0 con 0x561857bf71a0 2024-09-10T22:45:58.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 10 client.8595 fetch_fsmap learned FSMap version 114 2024-09-10T22:45:58.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 1 -- 172.21.15.103:0/435812274 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x56185797cfa0 con 0x561857bf71a0 2024-09-10T22:45:58.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f636e000640 1 -- 172.21.15.103:0/435812274 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x561857990330 con 0x561857bf71a0 2024-09-10T22:45:58.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f636e000640 1 -- 172.21.15.103:0/435812274 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 114) ==== 3554+0+0 (secure 0 0 0) 0x7f6370124020 con 0x561857bf71a0 2024-09-10T22:45:58.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 10 client.8595 fetch_fsmap finished waiting for FSMap version 114 2024-09-10T22:45:58.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 10 client.8595 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-10T22:45:58.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 20 client.8595 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:58.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 1 --2- 172.21.15.103:0/435812274 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x561857c06900 0x561857c08cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:58.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 4 client.8595 mds_command: new command op to 8235 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:45:58.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 1 -- 172.21.15.103:0/435812274 --> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561857a0aae0 con 0x561857c06900 2024-09-10T22:45:58.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f6388a00640 1 --2- 172.21.15.103:0/435812274 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x561857c06900 0x561857c08cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:58.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f6388a00640 1 --2- 172.21.15.103:0/435812274 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x561857c06900 0x561857c08cf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6e7784cf17840a64 server_cookie=abb3548fe61edef0 in_seq=0 out_seq=0 2024-09-10T22:45:58.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f636e000640 10 client.8595 ms_handle_connect on v2:172.21.15.103:6832/1191295180 2024-09-10T22:45:58.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f636e000640 1 -- 172.21.15.103:0/435812274 <== mds.1 v2:172.21.15.103:6832/1191295180 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561857a0aae0 con 0x561857c06900 2024-09-10T22:45:58.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f636e000640 10 client.8595 handle_command_reply: tid=0 2024-09-10T22:45:58.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 1 client.8595 shutdown 2024-09-10T22:45:58.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 1 -- 172.21.15.103:0/435812274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 msgr2=0x561857bfea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:58.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 1 --2- 172.21.15.103:0/435812274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 0x561857bfea70 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f6370098320 tx=0x7f6370005bf0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 1 -- 172.21.15.103:0/435812274 shutdown_connections 2024-09-10T22:45:58.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 1 --2- 172.21.15.103:0/435812274 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x561857c06900 0x561857c08cf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 1 --2- 172.21.15.103:0/435812274 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857bf7ac0 0x561857bfefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 1 --2- 172.21.15.103:0/435812274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 0x561857bfea70 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 1 --2- 172.21.15.103:0/435812274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857badbc0 0x561857bfe530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:58.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f636e000640 0 client.8595 ms_handle_reset on v2:172.21.15.103:6832/1191295180 2024-09-10T22:45:58.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 1 -- 172.21.15.103:0/435812274 >> 172.21.15.103:0/435812274 conn(0x561857bb3d20 msgr2=0x561857babf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:58.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 1 -- 172.21.15.103:0/435812274 shutdown_connections 2024-09-10T22:45:58.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 1 -- 172.21.15.103:0/435812274 wait complete. 2024-09-10T22:45:58.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:58.980+0000 7f638e869000 20 client.8595 trim_cache size 0 max 16384 2024-09-10T22:45:59.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f638e869000 1 Processor -- start 2024-09-10T22:45:59.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f638e869000 1 -- start start 2024-09-10T22:45:59.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f638e869000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857badbc0 0x561857c04dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f638e869000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 0x561857bad070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f638e869000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857bf7ac0 0x561857bad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f638e869000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6384204690 con 0x561857bf71a0 2024-09-10T22:45:59.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f638e869000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6384203860 con 0x561857badbc0 2024-09-10T22:45:59.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f638e869000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6384203f60 con 0x561857bf7ac0 2024-09-10T22:45:59.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f6383e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 0x561857bad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f6383e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 0x561857bad070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48792/0 (socket says 172.21.15.103:48792) 2024-09-10T22:45:59.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f6383e00640 1 -- 172.21.15.103:0/1538732392 learned_addr learned my addr 172.21.15.103:0/1538732392 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:59.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f6389400640 1 --2- 172.21.15.103:0/1538732392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857bf7ac0 0x561857bad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f6388a00640 1 --2- 172.21.15.103:0/1538732392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857badbc0 0x561857c04dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f6383e00640 1 -- 172.21.15.103:0/1538732392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857bf7ac0 msgr2=0x561857bad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f6383e00640 1 --2- 172.21.15.103:0/1538732392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857bf7ac0 0x561857bad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f6383e00640 1 -- 172.21.15.103:0/1538732392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857badbc0 msgr2=0x561857c04dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f6383e00640 1 --2- 172.21.15.103:0/1538732392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857badbc0 0x561857c04dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f6383e00640 1 -- 172.21.15.103:0/1538732392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561857a55660 con 0x561857bf71a0 2024-09-10T22:45:59.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f6383e00640 1 --2- 172.21.15.103:0/1538732392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 0x561857bad070 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f63700f3d90 tx=0x7f6370004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558c7d1a1ea1d5dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:59.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f6378c00640 1 -- 172.21.15.103:0/1538732392 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63700fc7c0 con 0x561857bf71a0 2024-09-10T22:45:59.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f6378c00640 1 -- 172.21.15.103:0/1538732392 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6370124020 con 0x561857bf71a0 2024-09-10T22:45:59.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f6378c00640 1 -- 172.21.15.103:0/1538732392 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370100fb0 con 0x561857bf71a0 2024-09-10T22:45:59.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f638e869000 1 -- 172.21.15.103:0/1538732392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 msgr2=0x561857bad070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f638e869000 1 --2- 172.21.15.103:0/1538732392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 0x561857bad070 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f63700f3d90 tx=0x7f6370004620 comp rx=0 tx=0).stop 2024-09-10T22:45:59.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f638e869000 1 -- 172.21.15.103:0/1538732392 shutdown_connections 2024-09-10T22:45:59.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f638e869000 1 --2- 172.21.15.103:0/1538732392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857bf7ac0 0x561857bad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f638e869000 1 --2- 172.21.15.103:0/1538732392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf71a0 0x561857bad070 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f638e869000 1 --2- 172.21.15.103:0/1538732392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857badbc0 0x561857c04dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f638e869000 1 -- 172.21.15.103:0/1538732392 >> 172.21.15.103:0/1538732392 conn(0x561857bb3d20 msgr2=0x561857bac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:59.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f638e869000 1 -- 172.21.15.103:0/1538732392 shutdown_connections 2024-09-10T22:45:59.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.000+0000 7f638e869000 1 -- 172.21.15.103:0/1538732392 wait complete. 2024-09-10T22:45:59.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f638e869000 1 -- start start 2024-09-10T22:45:59.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f638e869000 1 Processor -- start 2024-09-10T22:45:59.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f638e869000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857badbc0 0x561857c03fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f638e869000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857bf71a0 0x561857c04500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f638e869000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf7ac0 0x561857c29210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f638e869000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x561857bb6d40 con 0x561857bf7ac0 2024-09-10T22:45:59.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f638e869000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x561857a08b90 con 0x561857bf71a0 2024-09-10T22:45:59.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f638e869000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x561857bb4100 con 0x561857badbc0 2024-09-10T22:45:59.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f638e869000 10 client.0 _ll_register_callbacks cb 0x7f637c0016b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:59.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f6389400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf7ac0 0x561857c29210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f6389400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf7ac0 0x561857c29210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48808/0 (socket says 172.21.15.103:48808) 2024-09-10T22:45:59.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f6389400640 1 -- 172.21.15.103:0/2830133326 learned_addr learned my addr 172.21.15.103:0/2830133326 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f6388a00640 1 --2- 172.21.15.103:0/2830133326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857badbc0 0x561857c03fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f6383e00640 1 --2- 172.21.15.103:0/2830133326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857bf71a0 0x561857c04500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f6389400640 1 -- 172.21.15.103:0/2830133326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857badbc0 msgr2=0x561857c03fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f6389400640 1 --2- 172.21.15.103:0/2830133326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857badbc0 0x561857c03fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f6389400640 1 -- 172.21.15.103:0/2830133326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857bf71a0 msgr2=0x561857c04500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f6389400640 1 --2- 172.21.15.103:0/2830133326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857bf71a0 0x561857c04500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f6389400640 1 -- 172.21.15.103:0/2830133326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618579c2090 con 0x561857bf7ac0 2024-09-10T22:45:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f6389400640 1 --2- 172.21.15.103:0/2830133326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf7ac0 0x561857c29210 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f637c001bc0 tx=0x7f637c002080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34ff64b80293d91 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f636e000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f636e000640 1 -- 172.21.15.103:0/2830133326 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c01b020 con 0x561857bf7ac0 2024-09-10T22:45:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f636e000640 1 -- 172.21.15.103:0/2830133326 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f637c0057c0 con 0x561857bf7ac0 2024-09-10T22:45:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f638e869000 1 -- 172.21.15.103:0/2830133326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6370124020 con 0x561857bf7ac0 2024-09-10T22:45:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f636e000640 1 -- 172.21.15.103:0/2830133326 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7f637c025050 con 0x561857bf7ac0 2024-09-10T22:45:59.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f638e869000 10 client.8601 fetch_fsmap learned FSMap version 114 2024-09-10T22:45:59.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f638e869000 1 -- 172.21.15.103:0/2830133326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x56185798e5f0 con 0x561857bf7ac0 2024-09-10T22:45:59.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f636e000640 1 -- 172.21.15.103:0/2830133326 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6370124020 con 0x561857bf7ac0 2024-09-10T22:45:59.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f636e000640 1 -- 172.21.15.103:0/2830133326 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 114) ==== 3554+0+0 (secure 0 0 0) 0x7f637c028020 con 0x561857bf7ac0 2024-09-10T22:45:59.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f638e869000 10 client.8601 fetch_fsmap finished waiting for FSMap version 114 2024-09-10T22:45:59.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f638e869000 10 client.8601 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-10T22:45:59.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f638e869000 20 client.8601 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:59.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f638e869000 1 --2- 172.21.15.103:0/2830133326 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x561857c6ca60 0x561857c6ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f638e869000 4 client.8601 mds_command: new command op to 8235 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:45:59.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f638e869000 1 -- 172.21.15.103:0/2830133326 --> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561857a06590 con 0x561857c6ca60 2024-09-10T22:45:59.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f6388a00640 1 --2- 172.21.15.103:0/2830133326 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x561857c6ca60 0x561857c6ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f6388a00640 1 --2- 172.21.15.103:0/2830133326 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x561857c6ca60 0x561857c6ce70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=73933a20bf4f6f56 server_cookie=7f5f031f7011d080 in_seq=0 out_seq=0 2024-09-10T22:45:59.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.004+0000 7f636e000640 10 client.8601 ms_handle_connect on v2:172.21.15.103:6832/1191295180 2024-09-10T22:45:59.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f636e000640 1 -- 172.21.15.103:0/2830133326 <== mds.1 v2:172.21.15.103:6832/1191295180 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x561857a06590 con 0x561857c6ca60 2024-09-10T22:45:59.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f636e000640 10 client.8601 handle_command_reply: tid=0 2024-09-10T22:45:59.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f638e869000 1 client.8601 shutdown 2024-09-10T22:45:59.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f638e869000 1 -- 172.21.15.103:0/2830133326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf7ac0 msgr2=0x561857c29210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f638e869000 1 --2- 172.21.15.103:0/2830133326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf7ac0 0x561857c29210 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f637c001bc0 tx=0x7f637c002080 comp rx=0 tx=0).stop 2024-09-10T22:45:59.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f638e869000 1 -- 172.21.15.103:0/2830133326 shutdown_connections 2024-09-10T22:45:59.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f638e869000 1 --2- 172.21.15.103:0/2830133326 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x561857c6ca60 0x561857c6ce70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f638e869000 1 --2- 172.21.15.103:0/2830133326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561857bf7ac0 0x561857c29210 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f638e869000 1 --2- 172.21.15.103:0/2830133326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561857bf71a0 0x561857c04500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f638e869000 1 --2- 172.21.15.103:0/2830133326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561857badbc0 0x561857c03fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f636e000640 0 client.8601 ms_handle_reset on v2:172.21.15.103:6832/1191295180 2024-09-10T22:45:59.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f638e869000 1 -- 172.21.15.103:0/2830133326 >> 172.21.15.103:0/2830133326 conn(0x561857bb3d20 msgr2=0x561857bad180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:59.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f638e869000 1 -- 172.21.15.103:0/2830133326 shutdown_connections 2024-09-10T22:45:59.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f638e869000 1 -- 172.21.15.103:0/2830133326 wait complete. 2024-09-10T22:45:59.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f638e869000 20 client.8601 trim_cache size 0 max 16384 2024-09-10T22:45:59.016 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:45:59.016 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-10T22:45:59.016 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:45:59.016 INFO:teuthology.orchestra.run.smithi103.stdout: "13d979f1-0660-40c8-9ef3-e228e32f6cb4": { 2024-09-10T22:45:59.017 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:45:59.017 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "13d979f1-0660-40c8-9ef3-e228e32f6cb4", 2024-09-10T22:45:59.017 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:45:59.017 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:59.017 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:59.017 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:45:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f6389e00640 1 -- 172.21.15.103:0/1789527368 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f63640725e0 msgr2=0x7f6364074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f6389e00640 1 --2- 172.21.15.103:0/1789527368 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f63640725e0 0x7f6364074aa0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6374009b90 tx=0x7f63740091e0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f6389e00640 1 -- 172.21.15.103:0/1789527368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63840d04a0 msgr2=0x7f63840b2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f6389e00640 1 --2- 172.21.15.103:0/1789527368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63840d04a0 0x7f63840b2fe0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f6370009850 tx=0x7f6370005e70 comp rx=0 tx=0).stop 2024-09-10T22:45:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f6389e00640 1 -- 172.21.15.103:0/1789527368 shutdown_connections 2024-09-10T22:45:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f6389e00640 1 --2- 172.21.15.103:0/1789527368 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f63640725e0 0x7f6364074aa0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f6389e00640 1 --2- 172.21.15.103:0/1789527368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f638415f0e0 0x7f6384147850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f6389e00640 1 --2- 172.21.15.103:0/1789527368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63840d04a0 0x7f63840b2fe0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f6389e00640 1 --2- 172.21.15.103:0/1789527368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63840714d0 0x7f63840b71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f6389e00640 1 -- 172.21.15.103:0/1789527368 >> 172.21.15.103:0/1789527368 conn(0x7f63840d18f0 msgr2=0x7f638406f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f6389e00640 1 -- 172.21.15.103:0/1789527368 shutdown_connections 2024-09-10T22:45:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.008+0000 7f6389e00640 1 -- 172.21.15.103:0/1789527368 wait complete. 2024-09-10T22:45:59.031 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:45:59.031 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:45:59.031 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:2 scrub status 2024-09-10T22:45:59.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e8e00640 1 -- 172.21.15.103:0/15855434 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9e40cfdd0 msgr2=0x7fc9e415eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e8e00640 1 --2- 172.21.15.103:0/15855434 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9e40cfdd0 0x7fc9e415eda0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc009c80 tx=0x7fc9cc01cda0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e8e00640 1 -- 172.21.15.103:0/15855434 shutdown_connections 2024-09-10T22:45:59.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e8e00640 1 --2- 172.21.15.103:0/15855434 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9e40cfdd0 0x7fc9e415eda0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e8e00640 1 -- 172.21.15.103:0/15855434 >> 172.21.15.103:0/15855434 conn(0x7fc9e406cc00 msgr2=0x7fc9e406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:59.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e8e00640 1 -- 172.21.15.103:0/15855434 shutdown_connections 2024-09-10T22:45:59.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e8e00640 1 -- 172.21.15.103:0/15855434 wait complete. 2024-09-10T22:45:59.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e8e00640 1 Processor -- start 2024-09-10T22:45:59.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e8e00640 1 -- start start 2024-09-10T22:45:59.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e8e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e40cf9f0 0x7fc9e41400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e8e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9e40cfdd0 0x7fc9e4159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e8e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9e415f2e0 0x7fc9e415a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e8e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e4169010 con 0x7fc9e40cfdd0 2024-09-10T22:45:59.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e8e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e40cdbf0 con 0x7fc9e40cf9f0 2024-09-10T22:45:59.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e8e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e4169190 con 0x7fc9e415f2e0 2024-09-10T22:45:59.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9e40cfdd0 0x7fc9e4159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9e40cfdd0 0x7fc9e4159bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48826/0 (socket says 172.21.15.103:48826) 2024-09-10T22:45:59.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e1400640 1 -- 172.21.15.103:0/3875996335 learned_addr learned my addr 172.21.15.103:0/3875996335 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:59.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e2800640 1 --2- 172.21.15.103:0/3875996335 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9e415f2e0 0x7fc9e415a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e1e00640 1 --2- 172.21.15.103:0/3875996335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e40cf9f0 0x7fc9e41400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e1400640 1 -- 172.21.15.103:0/3875996335 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9e415f2e0 msgr2=0x7fc9e415a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e1400640 1 --2- 172.21.15.103:0/3875996335 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9e415f2e0 0x7fc9e415a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e1400640 1 -- 172.21.15.103:0/3875996335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e40cf9f0 msgr2=0x7fc9e41400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e1400640 1 --2- 172.21.15.103:0/3875996335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e40cf9f0 0x7fc9e41400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e1400640 1 -- 172.21.15.103:0/3875996335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e415ebd0 con 0x7fc9e40cfdd0 2024-09-10T22:45:59.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.172+0000 7fc9e1e00640 1 --2- 172.21.15.103:0/3875996335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e40cf9f0 0x7fc9e41400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:59.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.176+0000 7fc9e1400640 1 --2- 172.21.15.103:0/3875996335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9e40cfdd0 0x7fc9e4159bc0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc000f90 tx=0x7fc9cc0092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:59.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.176+0000 7fc9da000640 1 -- 172.21.15.103:0/3875996335 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc0bb070 con 0x7fc9e40cfdd0 2024-09-10T22:45:59.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.176+0000 7fc9da000640 1 -- 172.21.15.103:0/3875996335 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9cc004d40 con 0x7fc9e40cfdd0 2024-09-10T22:45:59.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.176+0000 7fc9e8e00640 1 -- 172.21.15.103:0/3875996335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e415e8f0 con 0x7fc9e40cfdd0 2024-09-10T22:45:59.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.176+0000 7fc9da000640 1 -- 172.21.15.103:0/3875996335 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc0b2040 con 0x7fc9e40cfdd0 2024-09-10T22:45:59.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.176+0000 7fc9e8e00640 1 -- 172.21.15.103:0/3875996335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e4140f50 con 0x7fc9e40cfdd0 2024-09-10T22:45:59.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.176+0000 7fc9da000640 1 -- 172.21.15.103:0/3875996335 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc9cc0b5030 con 0x7fc9e40cfdd0 2024-09-10T22:45:59.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9da000640 1 --2- 172.21.15.103:0/3875996335 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9c00725e0 0x7fc9c0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9ec2b4000 1 Processor -- start 2024-09-10T22:45:59.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9da000640 1 -- 172.21.15.103:0/3875996335 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fc9cc12cf00 con 0x7fc9e40cfdd0 2024-09-10T22:45:59.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9ec2b4000 1 -- start start 2024-09-10T22:45:59.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9e1e00640 1 --2- 172.21.15.103:0/3875996335 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9c00725e0 0x7fc9c0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9ec2b4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56053743b1a0 0x56053743b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9ec2b4000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743bac0 0x5605373f1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9ec2b4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605373f1bc0 0x5605373f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9ec2b4000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5605372d9cb0 con 0x56053743bac0 2024-09-10T22:45:59.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9ec2b4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5605371ef310 con 0x5605373f1bc0 2024-09-10T22:45:59.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9ec2b4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56053724cb90 con 0x56053743b1a0 2024-09-10T22:45:59.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9e1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743bac0 0x5605373f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9e1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743bac0 0x5605373f1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48838/0 (socket says 172.21.15.103:48838) 2024-09-10T22:45:59.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9e1400640 1 -- 172.21.15.103:0/3533933885 learned_addr learned my addr 172.21.15.103:0/3533933885 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:59.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9e2800640 1 --2- 172.21.15.103:0/3533933885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605373f1bc0 0x5605373f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9e1e00640 1 --2- 172.21.15.103:0/3533933885 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56053743b1a0 0x56053743b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9e1400640 1 -- 172.21.15.103:0/3533933885 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56053743b1a0 msgr2=0x56053743b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9e1e00640 1 --2- 172.21.15.103:0/3875996335 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9c00725e0 0x7fc9c0074aa0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40017a0 tx=0x7fc9d4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:59.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9e1400640 1 --2- 172.21.15.103:0/3533933885 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56053743b1a0 0x56053743b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9e1400640 1 -- 172.21.15.103:0/3533933885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605373f1bc0 msgr2=0x5605373f1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9e1400640 1 --2- 172.21.15.103:0/3533933885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605373f1bc0 0x5605373f1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9e1400640 1 -- 172.21.15.103:0/3533933885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605371f0c60 con 0x56053743bac0 2024-09-10T22:45:59.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9e2800640 1 --2- 172.21.15.103:0/3533933885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605373f1bc0 0x5605373f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:59.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9e1400640 1 --2- 172.21.15.103:0/3533933885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743bac0 0x5605373f1680 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0f7b90 tx=0x7fc9cc0f7550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c2812b5e550c98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:59.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9d2a00640 1 -- 172.21.15.103:0/3533933885 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc11b070 con 0x56053743bac0 2024-09-10T22:45:59.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9d2a00640 1 -- 172.21.15.103:0/3533933885 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9cc0f7c00 con 0x56053743bac0 2024-09-10T22:45:59.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9d2a00640 1 -- 172.21.15.103:0/3533933885 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc0fc630 con 0x56053743bac0 2024-09-10T22:45:59.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/3533933885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743bac0 msgr2=0x5605373f1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/3533933885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743bac0 0x5605373f1680 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0f7b90 tx=0x7fc9cc0f7550 comp rx=0 tx=0).stop 2024-09-10T22:45:59.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/3533933885 shutdown_connections 2024-09-10T22:45:59.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/3533933885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605373f1bc0 0x5605373f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/3533933885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743bac0 0x5605373f1680 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/3533933885 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56053743b1a0 0x56053743b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/3533933885 >> 172.21.15.103:0/3533933885 conn(0x5605373f7d20 msgr2=0x5605373eff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:59.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/3533933885 shutdown_connections 2024-09-10T22:45:59.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.180+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/3533933885 wait complete. 2024-09-10T22:45:59.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9ec2b4000 1 -- start start 2024-09-10T22:45:59.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9ec2b4000 1 Processor -- start 2024-09-10T22:45:59.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9ec2b4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605373f1bc0 0x560537442530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9ec2b4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56053743b1a0 0x560537442a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9ec2b4000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743bac0 0x560537442fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9ec2b4000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56053723fdd0 con 0x56053743bac0 2024-09-10T22:45:59.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9ec2b4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56053723bfc0 con 0x5605373f1bc0 2024-09-10T22:45:59.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9ec2b4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5605371e14b0 con 0x56053743b1a0 2024-09-10T22:45:59.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9ec2b4000 10 client.0 _ll_register_callbacks cb 0x5605371bf7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:59.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9e2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743bac0 0x560537442fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9e2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743bac0 0x560537442fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48842/0 (socket says 172.21.15.103:48842) 2024-09-10T22:45:59.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9e2800640 1 -- 172.21.15.103:0/3129507881 learned_addr learned my addr 172.21.15.103:0/3129507881 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:59.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9e1400640 1 --2- 172.21.15.103:0/3129507881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56053743b1a0 0x560537442a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9e1e00640 1 --2- 172.21.15.103:0/3129507881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605373f1bc0 0x560537442530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9e2800640 1 -- 172.21.15.103:0/3129507881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56053743b1a0 msgr2=0x560537442a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9e2800640 1 --2- 172.21.15.103:0/3129507881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56053743b1a0 0x560537442a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9e2800640 1 -- 172.21.15.103:0/3129507881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605373f1bc0 msgr2=0x560537442530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9e2800640 1 --2- 172.21.15.103:0/3129507881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605373f1bc0 0x560537442530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9e2800640 1 -- 172.21.15.103:0/3129507881 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605371da1f0 con 0x56053743bac0 2024-09-10T22:45:59.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9e2800640 1 --2- 172.21.15.103:0/3129507881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743bac0 0x560537442fb0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc007b00 tx=0x7fc9dc001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e318f35f6d4c28 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:59.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9c7400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:59.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9c7400640 1 -- 172.21.15.103:0/3129507881 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc013540 con 0x56053743bac0 2024-09-10T22:45:59.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/3129507881 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5605371d4330 con 0x56053743bac0 2024-09-10T22:45:59.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9c7400640 1 -- 172.21.15.103:0/3129507881 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fc9dc0136e0 con 0x56053743bac0 2024-09-10T22:45:59.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9c7400640 1 -- 172.21.15.103:0/3129507881 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7fc9dc021050 con 0x56053743bac0 2024-09-10T22:45:59.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9ec2b4000 10 client.8616 fetch_fsmap learned FSMap version 114 2024-09-10T22:45:59.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/3129507881 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x5605371c0fa0 con 0x56053743bac0 2024-09-10T22:45:59.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9c7400640 1 -- 172.21.15.103:0/3129507881 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5605371d4330 con 0x56053743bac0 2024-09-10T22:45:59.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9c7400640 1 -- 172.21.15.103:0/3129507881 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 114) ==== 3554+0+0 (secure 0 0 0) 0x7fc9dc024020 con 0x56053743bac0 2024-09-10T22:45:59.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9ec2b4000 10 client.8616 fetch_fsmap finished waiting for FSMap version 114 2024-09-10T22:45:59.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9ec2b4000 10 client.8616 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2024-09-10T22:45:59.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9ec2b4000 20 client.8616 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:59.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/3129507881 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x56053744a900 0x56053744ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9ec2b4000 4 client.8616 mds_command: new command op to 7717 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:45:59.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/3129507881 --> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56053724eae0 con 0x56053744a900 2024-09-10T22:45:59.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.184+0000 7fc9e1e00640 1 --2- 172.21.15.103:0/3129507881 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x56053744a900 0x56053744ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.188+0000 7fc9e1e00640 1 --2- 172.21.15.103:0/3129507881 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x56053744a900 0x56053744ccf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=67de1341aa0dc838 server_cookie=65805b6305dfc3fa in_seq=0 out_seq=0 2024-09-10T22:45:59.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.188+0000 7fc9c7400640 10 client.8616 ms_handle_connect on v2:172.21.15.131:6835/1281268106 2024-09-10T22:45:59.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.188+0000 7fc9c7400640 1 -- 172.21.15.103:0/3129507881 <== mds.2 v2:172.21.15.131:6835/1281268106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56053724eae0 con 0x56053744a900 2024-09-10T22:45:59.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.188+0000 7fc9c7400640 10 client.8616 handle_command_reply: tid=0 2024-09-10T22:45:59.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.188+0000 7fc9ec2b4000 1 client.8616 shutdown 2024-09-10T22:45:59.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.188+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/3129507881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743bac0 msgr2=0x560537442fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.188+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/3129507881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743bac0 0x560537442fb0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc007b00 tx=0x7fc9dc001610 comp rx=0 tx=0).stop 2024-09-10T22:45:59.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.188+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/3129507881 shutdown_connections 2024-09-10T22:45:59.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.188+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/3129507881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743bac0 0x560537442fb0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.188+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/3129507881 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x56053744a900 0x56053744ccf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.188+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/3129507881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56053743b1a0 0x560537442a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.188+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/3129507881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5605373f1bc0 0x560537442530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.188+0000 7fc9c7400640 0 client.8616 ms_handle_reset on v2:172.21.15.131:6835/1281268106 2024-09-10T22:45:59.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.188+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/3129507881 >> 172.21.15.103:0/3129507881 conn(0x5605373f7d20 msgr2=0x5605373eff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:59.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.188+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/3129507881 shutdown_connections 2024-09-10T22:45:59.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.188+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/3129507881 wait complete. 2024-09-10T22:45:59.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.188+0000 7fc9ec2b4000 20 client.8616 trim_cache size 0 max 16384 2024-09-10T22:45:59.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.204+0000 7fc9ec2b4000 1 Processor -- start 2024-09-10T22:45:59.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.204+0000 7fc9ec2b4000 1 -- start start 2024-09-10T22:45:59.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.204+0000 7fc9ec2b4000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5605373f1bc0 0x560537448bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.204+0000 7fc9ec2b4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56053743b1a0 0x5605373f1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.204+0000 7fc9ec2b4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56053743bac0 0x5605373f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.204+0000 7fc9ec2b4000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e4204810 con 0x5605373f1bc0 2024-09-10T22:45:59.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.204+0000 7fc9ec2b4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e42039e0 con 0x56053743b1a0 2024-09-10T22:45:59.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.204+0000 7fc9ec2b4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e42040e0 con 0x56053743bac0 2024-09-10T22:45:59.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9e1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5605373f1bc0 0x560537448bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9e1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5605373f1bc0 0x560537448bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48856/0 (socket says 172.21.15.103:48856) 2024-09-10T22:45:59.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9e1e00640 1 -- 172.21.15.103:0/1530037902 learned_addr learned my addr 172.21.15.103:0/1530037902 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:59.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9e2800640 1 --2- 172.21.15.103:0/1530037902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56053743bac0 0x5605373f15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9e1400640 1 --2- 172.21.15.103:0/1530037902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56053743b1a0 0x5605373f1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9e1e00640 1 -- 172.21.15.103:0/1530037902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56053743bac0 msgr2=0x5605373f15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9e1e00640 1 --2- 172.21.15.103:0/1530037902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56053743bac0 0x5605373f15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9e1e00640 1 -- 172.21.15.103:0/1530037902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56053743b1a0 msgr2=0x5605373f1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9e1e00640 1 --2- 172.21.15.103:0/1530037902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56053743b1a0 0x5605373f1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9e1e00640 1 -- 172.21.15.103:0/1530037902 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560537299660 con 0x5605373f1bc0 2024-09-10T22:45:59.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9e2800640 1 --2- 172.21.15.103:0/1530037902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56053743bac0 0x5605373f15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:59.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9e1400640 1 --2- 172.21.15.103:0/1530037902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56053743b1a0 0x5605373f1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:59.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9e1e00640 1 --2- 172.21.15.103:0/1530037902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5605373f1bc0 0x560537448bb0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4007fa0 tx=0x7fc9d4005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775b91d0dc17dc17 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:59.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9d2000640 1 -- 172.21.15.103:0/1530037902 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4030070 con 0x5605373f1bc0 2024-09-10T22:45:59.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9d2000640 1 -- 172.21.15.103:0/1530037902 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9d400ec90 con 0x5605373f1bc0 2024-09-10T22:45:59.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9d2000640 1 -- 172.21.15.103:0/1530037902 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d400eea0 con 0x5605373f1bc0 2024-09-10T22:45:59.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/1530037902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5605373f1bc0 msgr2=0x560537448bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/1530037902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5605373f1bc0 0x560537448bb0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4007fa0 tx=0x7fc9d4005000 comp rx=0 tx=0).stop 2024-09-10T22:45:59.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/1530037902 shutdown_connections 2024-09-10T22:45:59.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/1530037902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56053743bac0 0x5605373f15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/1530037902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56053743b1a0 0x5605373f1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/1530037902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5605373f1bc0 0x560537448bb0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/1530037902 >> 172.21.15.103:0/1530037902 conn(0x5605373f7d20 msgr2=0x5605373f0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:59.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/1530037902 shutdown_connections 2024-09-10T22:45:59.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/1530037902 wait complete. 2024-09-10T22:45:59.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9ec2b4000 1 -- start start 2024-09-10T22:45:59.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9ec2b4000 1 Processor -- start 2024-09-10T22:45:59.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9ec2b4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5605373f1bc0 0x560537447fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9ec2b4000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743b1a0 0x560537448500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9ec2b4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56053743bac0 0x56053746d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9ec2b4000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5605373fad40 con 0x56053743b1a0 2024-09-10T22:45:59.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9ec2b4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5605373f8100 con 0x56053743bac0 2024-09-10T22:45:59.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9ec2b4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560537236ec0 con 0x5605373f1bc0 2024-09-10T22:45:59.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9ec2b4000 10 client.0 _ll_register_callbacks cb 0x7fc9dc005050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:59.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9e1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743b1a0 0x560537448500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9e1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743b1a0 0x560537448500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48860/0 (socket says 172.21.15.103:48860) 2024-09-10T22:45:59.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9e1400640 1 -- 172.21.15.103:0/1839918751 learned_addr learned my addr 172.21.15.103:0/1839918751 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:59.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9e1e00640 1 --2- 172.21.15.103:0/1839918751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5605373f1bc0 0x560537447fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.208+0000 7fc9e2800640 1 --2- 172.21.15.103:0/1839918751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56053743bac0 0x56053746d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e1400640 1 -- 172.21.15.103:0/1839918751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5605373f1bc0 msgr2=0x560537447fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e1400640 1 --2- 172.21.15.103:0/1839918751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5605373f1bc0 0x560537447fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e1400640 1 -- 172.21.15.103:0/1839918751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56053743bac0 msgr2=0x56053746d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e1400640 1 --2- 172.21.15.103:0/1839918751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56053743bac0 0x56053746d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e1400640 1 -- 172.21.15.103:0/1839918751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560537206090 con 0x56053743b1a0 2024-09-10T22:45:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e1400640 1 --2- 172.21.15.103:0/1839918751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743b1a0 0x560537448500 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc01c810 tx=0x7fc9cc0a5f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20bd55965987243d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9c7400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9c7400640 1 -- 172.21.15.103:0/1839918751 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc11b040 con 0x56053743b1a0 2024-09-10T22:45:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9c7400640 1 -- 172.21.15.103:0/1839918751 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fc9cc100e50 con 0x56053743b1a0 2024-09-10T22:45:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/1839918751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9d400ec90 con 0x56053743b1a0 2024-09-10T22:45:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9c7400640 1 -- 172.21.15.103:0/1839918751 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7fc9cc1010e0 con 0x56053743b1a0 2024-09-10T22:45:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 10 client.8622 fetch_fsmap learned FSMap version 114 2024-09-10T22:45:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/1839918751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x5605371d25f0 con 0x56053743b1a0 2024-09-10T22:45:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9c7400640 1 -- 172.21.15.103:0/1839918751 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9d400ec90 con 0x56053743b1a0 2024-09-10T22:45:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9c7400640 1 -- 172.21.15.103:0/1839918751 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 114) ==== 3554+0+0 (secure 0 0 0) 0x7fc9cc0fc100 con 0x56053743b1a0 2024-09-10T22:45:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 10 client.8622 fetch_fsmap finished waiting for FSMap version 114 2024-09-10T22:45:59.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 10 client.8622 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2024-09-10T22:45:59.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 20 client.8622 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:59.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/1839918751 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x56053746dc00 0x5605374b0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 4 client.8622 mds_command: new command op to 7717 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:45:59.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/1839918751 --> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56053724a590 con 0x56053746dc00 2024-09-10T22:45:59.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e1e00640 1 --2- 172.21.15.103:0/1839918751 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x56053746dc00 0x5605374b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e1e00640 1 --2- 172.21.15.103:0/1839918751 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x56053746dc00 0x5605374b0640 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e0cf7468a48cd871 server_cookie=f976162209799dd9 in_seq=0 out_seq=0 2024-09-10T22:45:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9c7400640 10 client.8622 ms_handle_connect on v2:172.21.15.131:6835/1281268106 2024-09-10T22:45:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9c7400640 1 -- 172.21.15.103:0/1839918751 <== mds.2 v2:172.21.15.131:6835/1281268106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x56053724a590 con 0x56053746dc00 2024-09-10T22:45:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9c7400640 10 client.8622 handle_command_reply: tid=0 2024-09-10T22:45:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 1 client.8622 shutdown 2024-09-10T22:45:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/1839918751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743b1a0 msgr2=0x560537448500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/1839918751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743b1a0 0x560537448500 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc01c810 tx=0x7fc9cc0a5f50 comp rx=0 tx=0).stop 2024-09-10T22:45:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/1839918751 shutdown_connections 2024-09-10T22:45:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/1839918751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56053743bac0 0x56053746d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/1839918751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56053743b1a0 0x560537448500 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/1839918751 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x56053746dc00 0x5605374b0640 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 1 --2- 172.21.15.103:0/1839918751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5605373f1bc0 0x560537447fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9c7400640 0 client.8622 ms_handle_reset on v2:172.21.15.131:6835/1281268106 2024-09-10T22:45:59.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/1839918751 >> 172.21.15.103:0/1839918751 conn(0x5605373f7d20 msgr2=0x5605373f1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:59.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/1839918751 shutdown_connections 2024-09-10T22:45:59.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 1 -- 172.21.15.103:0/1839918751 wait complete. 2024-09-10T22:45:59.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9ec2b4000 20 client.8622 trim_cache size 0 max 16384 2024-09-10T22:45:59.223 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:45:59.223 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-10T22:45:59.223 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:45:59.223 INFO:teuthology.orchestra.run.smithi103.stdout: "13d979f1-0660-40c8-9ef3-e228e32f6cb4": { 2024-09-10T22:45:59.223 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:45:59.224 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "13d979f1-0660-40c8-9ef3-e228e32f6cb4", 2024-09-10T22:45:59.224 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:45:59.224 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:59.224 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:59.224 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:45:59.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e8e00640 1 -- 172.21.15.103:0/3875996335 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9c00725e0 msgr2=0x7fc9c0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e8e00640 1 --2- 172.21.15.103:0/3875996335 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9c00725e0 0x7fc9c0074aa0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40017a0 tx=0x7fc9d4009040 comp rx=0 tx=0).stop 2024-09-10T22:45:59.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e8e00640 1 -- 172.21.15.103:0/3875996335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9e40cfdd0 msgr2=0x7fc9e4159bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e8e00640 1 --2- 172.21.15.103:0/3875996335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9e40cfdd0 0x7fc9e4159bc0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc000f90 tx=0x7fc9cc0092c0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e8e00640 1 -- 172.21.15.103:0/3875996335 shutdown_connections 2024-09-10T22:45:59.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e8e00640 1 --2- 172.21.15.103:0/3875996335 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fc9c00725e0 0x7fc9c0074aa0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e8e00640 1 --2- 172.21.15.103:0/3875996335 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9e415f2e0 0x7fc9e415a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e8e00640 1 --2- 172.21.15.103:0/3875996335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9e40cfdd0 0x7fc9e4159bc0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e8e00640 1 --2- 172.21.15.103:0/3875996335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e40cf9f0 0x7fc9e41400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e8e00640 1 -- 172.21.15.103:0/3875996335 >> 172.21.15.103:0/3875996335 conn(0x7fc9e406cc00 msgr2=0x7fc9e4151030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:59.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e8e00640 1 -- 172.21.15.103:0/3875996335 shutdown_connections 2024-09-10T22:45:59.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.212+0000 7fc9e8e00640 1 -- 172.21.15.103:0/3875996335 wait complete. 2024-09-10T22:45:59.237 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:45:59.237 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:45:59.237 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-10T22:45:59.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.376+0000 7f69b6200640 1 -- 172.21.15.103:0/2562931237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69b00af9d0 msgr2=0x7f69b0166a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.376+0000 7f69b6200640 1 --2- 172.21.15.103:0/2562931237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69b00af9d0 0x7f69b0166a50 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f69a8009840 tx=0x7f69a801c790 comp rx=0 tx=0).stop 2024-09-10T22:45:59.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.376+0000 7f69b6200640 1 -- 172.21.15.103:0/2562931237 shutdown_connections 2024-09-10T22:45:59.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.376+0000 7f69b6200640 1 --2- 172.21.15.103:0/2562931237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69b00af9d0 0x7f69b0166a50 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.376+0000 7f69b6200640 1 -- 172.21.15.103:0/2562931237 >> 172.21.15.103:0/2562931237 conn(0x7f69b00d1ac0 msgr2=0x7f69b00d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:59.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.376+0000 7f69b6200640 1 -- 172.21.15.103:0/2562931237 shutdown_connections 2024-09-10T22:45:59.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.376+0000 7f69b6200640 1 -- 172.21.15.103:0/2562931237 wait complete. 2024-09-10T22:45:59.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.376+0000 7f69b6200640 1 Processor -- start 2024-09-10T22:45:59.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.376+0000 7f69b6200640 1 -- start start 2024-09-10T22:45:59.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69b6200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69b00af9d0 0x7f69b01f8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69b6200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69b00b09c0 0x7f69b0157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69b6200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69b015be30 0x7f69b00b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69b6200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f69b0169c50 con 0x7f69b00b09c0 2024-09-10T22:45:59.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69b6200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f69b0169ad0 con 0x7f69b00af9d0 2024-09-10T22:45:59.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69b6200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f69b0169dd0 con 0x7f69b015be30 2024-09-10T22:45:59.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69a6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69b00b09c0 0x7f69b0157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69a6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69b00b09c0 0x7f69b0157930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48874/0 (socket says 172.21.15.103:48874) 2024-09-10T22:45:59.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69a6a00640 1 -- 172.21.15.103:0/3930505185 learned_addr learned my addr 172.21.15.103:0/3930505185 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:59.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69a6a00640 1 -- 172.21.15.103:0/3930505185 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69b015be30 msgr2=0x7f69b00b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69a6a00640 1 --2- 172.21.15.103:0/3930505185 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69b015be30 0x7f69b00b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69a6a00640 1 -- 172.21.15.103:0/3930505185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69b00af9d0 msgr2=0x7f69b01f8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69a6a00640 1 --2- 172.21.15.103:0/3930505185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69b00af9d0 0x7f69b01f8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69a6a00640 1 -- 172.21.15.103:0/3930505185 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b00c8cc0 con 0x7f69b00b09c0 2024-09-10T22:45:59.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69a6a00640 1 --2- 172.21.15.103:0/3930505185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69b00b09c0 0x7f69b0157930 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f699800c500 tx=0x7f699800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:59.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69a7e00640 1 -- 172.21.15.103:0/3930505185 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6998017070 con 0x7f69b00b09c0 2024-09-10T22:45:59.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69a7e00640 1 -- 172.21.15.103:0/3930505185 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6998003600 con 0x7f69b00b09c0 2024-09-10T22:45:59.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69a7e00640 1 -- 172.21.15.103:0/3930505185 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6998003a90 con 0x7f69b00b09c0 2024-09-10T22:45:59.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69b6200640 1 -- 172.21.15.103:0/3930505185 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b00c8fa0 con 0x7f69b00b09c0 2024-09-10T22:45:59.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69b6200640 1 -- 172.21.15.103:0/3930505185 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b01f7940 con 0x7f69b00b09c0 2024-09-10T22:45:59.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.380+0000 7f69a7e00640 1 -- 172.21.15.103:0/3930505185 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6998003c30 con 0x7f69b00b09c0 2024-09-10T22:45:59.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69a7e00640 1 --2- 172.21.15.103:0/3930505185 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f698c072610 0x7f698c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69b961d000 1 Processor -- start 2024-09-10T22:45:59.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69a7e00640 1 -- 172.21.15.103:0/3930505185 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f6998092c20 con 0x7f69b00b09c0 2024-09-10T22:45:59.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69b961d000 1 -- start start 2024-09-10T22:45:59.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69af400640 1 --2- 172.21.15.103:0/3930505185 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f698c072610 0x7f698c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69b961d000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a09b1a0 0x56309a09b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69b961d000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09bac0 0x56309a051680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69b961d000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a051bc0 0x56309a051fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69b961d000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563099f39cb0 con 0x56309a09bac0 2024-09-10T22:45:59.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69b961d000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563099e4f310 con 0x56309a09b1a0 2024-09-10T22:45:59.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69b961d000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563099eacb90 con 0x56309a051bc0 2024-09-10T22:45:59.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69af400640 1 --2- 172.21.15.103:0/3930505185 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f698c072610 0x7f698c074ad0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f69b00c9450 tx=0x7f69a0009230 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:59.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69a6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09bac0 0x56309a051680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69a6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09bac0 0x56309a051680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48882/0 (socket says 172.21.15.103:48882) 2024-09-10T22:45:59.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69a6a00640 1 -- 172.21.15.103:0/632506776 learned_addr learned my addr 172.21.15.103:0/632506776 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:59.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69af400640 1 --2- 172.21.15.103:0/632506776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a09b1a0 0x56309a09b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69afe00640 1 --2- 172.21.15.103:0/632506776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a051bc0 0x56309a051fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69a6a00640 1 -- 172.21.15.103:0/632506776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a051bc0 msgr2=0x56309a051fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69a6a00640 1 --2- 172.21.15.103:0/632506776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a051bc0 0x56309a051fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69a6a00640 1 -- 172.21.15.103:0/632506776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a09b1a0 msgr2=0x56309a09b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69a6a00640 1 --2- 172.21.15.103:0/632506776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a09b1a0 0x56309a09b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69a6a00640 1 -- 172.21.15.103:0/632506776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563099e50c60 con 0x56309a09bac0 2024-09-10T22:45:59.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69a6a00640 1 --2- 172.21.15.103:0/632506776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09bac0 0x56309a051680 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f69980010d0 tx=0x7f699805d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1a51cfa37d5bc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:59.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f699fe00640 1 -- 172.21.15.103:0/632506776 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6998066fd0 con 0x56309a09bac0 2024-09-10T22:45:59.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f699fe00640 1 -- 172.21.15.103:0/632506776 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6998062030 con 0x56309a09bac0 2024-09-10T22:45:59.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f699fe00640 1 -- 172.21.15.103:0/632506776 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69980621e0 con 0x56309a09bac0 2024-09-10T22:45:59.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69b961d000 1 -- 172.21.15.103:0/632506776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09bac0 msgr2=0x56309a051680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69b961d000 1 --2- 172.21.15.103:0/632506776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09bac0 0x56309a051680 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f69980010d0 tx=0x7f699805d720 comp rx=0 tx=0).stop 2024-09-10T22:45:59.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69b961d000 1 -- 172.21.15.103:0/632506776 shutdown_connections 2024-09-10T22:45:59.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69b961d000 1 --2- 172.21.15.103:0/632506776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a051bc0 0x56309a051fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69b961d000 1 --2- 172.21.15.103:0/632506776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09bac0 0x56309a051680 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69b961d000 1 --2- 172.21.15.103:0/632506776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a09b1a0 0x56309a09b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69b961d000 1 -- 172.21.15.103:0/632506776 >> 172.21.15.103:0/632506776 conn(0x56309a057d20 msgr2=0x56309a04ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:59.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69b961d000 1 -- 172.21.15.103:0/632506776 shutdown_connections 2024-09-10T22:45:59.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.384+0000 7f69b961d000 1 -- 172.21.15.103:0/632506776 wait complete. 2024-09-10T22:45:59.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69b961d000 1 -- start start 2024-09-10T22:45:59.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69b961d000 1 Processor -- start 2024-09-10T22:45:59.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69b961d000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a051bc0 0x56309a0a2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69b961d000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09b1a0 0x56309a0a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69b961d000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a09bac0 0x56309a0a2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69b961d000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563099e9fdd0 con 0x56309a09b1a0 2024-09-10T22:45:59.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69b961d000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x563099e9bfc0 con 0x56309a051bc0 2024-09-10T22:45:59.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69b961d000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563099e414b0 con 0x56309a09bac0 2024-09-10T22:45:59.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69b961d000 10 client.0 _ll_register_callbacks cb 0x563099e1f7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:59.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69a6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09b1a0 0x56309a0a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69a6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09b1a0 0x56309a0a2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48884/0 (socket says 172.21.15.103:48884) 2024-09-10T22:45:59.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69a6a00640 1 -- 172.21.15.103:0/1533235666 learned_addr learned my addr 172.21.15.103:0/1533235666 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:59.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69afe00640 1 --2- 172.21.15.103:0/1533235666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a09bac0 0x56309a0a2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69af400640 1 --2- 172.21.15.103:0/1533235666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a051bc0 0x56309a0a2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69a6a00640 1 -- 172.21.15.103:0/1533235666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a09bac0 msgr2=0x56309a0a2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69a6a00640 1 --2- 172.21.15.103:0/1533235666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a09bac0 0x56309a0a2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69a6a00640 1 -- 172.21.15.103:0/1533235666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a051bc0 msgr2=0x56309a0a2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69a6a00640 1 --2- 172.21.15.103:0/1533235666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a051bc0 0x56309a0a2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69a6a00640 1 -- 172.21.15.103:0/1533235666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563099e3a1f0 con 0x56309a09b1a0 2024-09-10T22:45:59.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69af400640 1 --2- 172.21.15.103:0/1533235666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a051bc0 0x56309a0a2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:45:59.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69a6a00640 1 --2- 172.21.15.103:0/1533235666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09b1a0 0x56309a0a2a70 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f699805ad40 tx=0x7f69980624a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295cad19615ec399 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:59.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f699cc00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:59.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f699cc00640 1 -- 172.21.15.103:0/1533235666 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6998066fd0 con 0x56309a09b1a0 2024-09-10T22:45:59.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f699cc00640 1 -- 172.21.15.103:0/1533235666 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f699805cd30 con 0x56309a09b1a0 2024-09-10T22:45:59.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69b961d000 1 -- 172.21.15.103:0/1533235666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563099e34330 con 0x56309a09b1a0 2024-09-10T22:45:59.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f699cc00640 1 -- 172.21.15.103:0/1533235666 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7f699805cf30 con 0x56309a09b1a0 2024-09-10T22:45:59.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69b961d000 10 client.8637 fetch_fsmap learned FSMap version 114 2024-09-10T22:45:59.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69b961d000 1 -- 172.21.15.103:0/1533235666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x563099e20fa0 con 0x56309a09b1a0 2024-09-10T22:45:59.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f699cc00640 1 -- 172.21.15.103:0/1533235666 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563099e34330 con 0x56309a09b1a0 2024-09-10T22:45:59.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f699cc00640 1 -- 172.21.15.103:0/1533235666 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 114) ==== 3554+0+0 (secure 0 0 0) 0x7f699808f030 con 0x56309a09b1a0 2024-09-10T22:45:59.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69b961d000 10 client.8637 fetch_fsmap finished waiting for FSMap version 114 2024-09-10T22:45:59.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69b961d000 10 client.8637 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T22:45:59.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69b961d000 20 client.8637 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:59.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69b961d000 1 --2- 172.21.15.103:0/1533235666 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56309a0aa900 0x56309a0accf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69b961d000 4 client.8637 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:45:59.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69b961d000 1 -- 172.21.15.103:0/1533235666 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563099eaeae0 con 0x56309a0aa900 2024-09-10T22:45:59.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69af400640 1 --2- 172.21.15.103:0/1533235666 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56309a0aa900 0x56309a0accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f69af400640 1 --2- 172.21.15.103:0/1533235666 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56309a0aa900 0x56309a0accf0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a862c4df3766e0f server_cookie=66e6acbac9130f34 in_seq=0 out_seq=0 2024-09-10T22:45:59.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.388+0000 7f699cc00640 10 client.8637 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:59.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.392+0000 7f699cc00640 1 -- 172.21.15.103:0/1533235666 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563099eaeae0 con 0x56309a0aa900 2024-09-10T22:45:59.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.392+0000 7f699cc00640 10 client.8637 handle_command_reply: tid=0 2024-09-10T22:45:59.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.392+0000 7f69b961d000 1 client.8637 shutdown 2024-09-10T22:45:59.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.392+0000 7f69b961d000 1 -- 172.21.15.103:0/1533235666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09b1a0 msgr2=0x56309a0a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.392+0000 7f69b961d000 1 --2- 172.21.15.103:0/1533235666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09b1a0 0x56309a0a2a70 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f699805ad40 tx=0x7f69980624a0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.392+0000 7f69b961d000 1 -- 172.21.15.103:0/1533235666 shutdown_connections 2024-09-10T22:45:59.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.392+0000 7f69b961d000 1 --2- 172.21.15.103:0/1533235666 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56309a0aa900 0x56309a0accf0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.392+0000 7f69b961d000 1 --2- 172.21.15.103:0/1533235666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a09bac0 0x56309a0a2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.392+0000 7f69b961d000 1 --2- 172.21.15.103:0/1533235666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09b1a0 0x56309a0a2a70 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.392+0000 7f69b961d000 1 --2- 172.21.15.103:0/1533235666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a051bc0 0x56309a0a2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.392+0000 7f699cc00640 0 client.8637 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:59.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.392+0000 7f69b961d000 1 -- 172.21.15.103:0/1533235666 >> 172.21.15.103:0/1533235666 conn(0x56309a057d20 msgr2=0x56309a04ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:59.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.392+0000 7f69b961d000 1 -- 172.21.15.103:0/1533235666 shutdown_connections 2024-09-10T22:45:59.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.392+0000 7f69b961d000 1 -- 172.21.15.103:0/1533235666 wait complete. 2024-09-10T22:45:59.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.392+0000 7f69b961d000 20 client.8637 trim_cache size 0 max 16384 2024-09-10T22:45:59.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.408+0000 7f69b961d000 1 Processor -- start 2024-09-10T22:45:59.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.408+0000 7f69b961d000 1 -- start start 2024-09-10T22:45:59.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.408+0000 7f69b961d000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a051bc0 0x56309a0a5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.408+0000 7f69b961d000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09b1a0 0x56309a0a5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.408+0000 7f69b961d000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a09bac0 0x56309a0a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.408+0000 7f69b961d000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f69b0204330 con 0x56309a09b1a0 2024-09-10T22:45:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.408+0000 7f69b961d000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f69b0203500 con 0x56309a051bc0 2024-09-10T22:45:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.408+0000 7f69b961d000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f69b0203c00 con 0x56309a09bac0 2024-09-10T22:45:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.408+0000 7f69a6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09b1a0 0x56309a0a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69a6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09b1a0 0x56309a0a5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48894/0 (socket says 172.21.15.103:48894) 2024-09-10T22:45:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69a6a00640 1 -- 172.21.15.103:0/3474383881 learned_addr learned my addr 172.21.15.103:0/3474383881 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69afe00640 1 --2- 172.21.15.103:0/3474383881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a09bac0 0x56309a0a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69af400640 1 --2- 172.21.15.103:0/3474383881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a051bc0 0x56309a0a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69a6a00640 1 -- 172.21.15.103:0/3474383881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a09bac0 msgr2=0x56309a0a5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69a6a00640 1 --2- 172.21.15.103:0/3474383881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a09bac0 0x56309a0a5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69a6a00640 1 -- 172.21.15.103:0/3474383881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a051bc0 msgr2=0x56309a0a5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69a6a00640 1 --2- 172.21.15.103:0/3474383881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a051bc0 0x56309a0a5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69a6a00640 1 -- 172.21.15.103:0/3474383881 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563099ef9660 con 0x56309a09b1a0 2024-09-10T22:45:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69a6a00640 1 --2- 172.21.15.103:0/3474383881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09b1a0 0x56309a0a5850 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f699805d590 tx=0x7f699805d420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397d4a9abb65a013 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f699f400640 1 -- 172.21.15.103:0/3474383881 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6998066d50 con 0x56309a09b1a0 2024-09-10T22:45:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f699f400640 1 -- 172.21.15.103:0/3474383881 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6998062040 con 0x56309a09b1a0 2024-09-10T22:45:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f699f400640 1 -- 172.21.15.103:0/3474383881 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699805c7a0 con 0x56309a09b1a0 2024-09-10T22:45:59.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69b961d000 1 -- 172.21.15.103:0/3474383881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09b1a0 msgr2=0x56309a0a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69b961d000 1 --2- 172.21.15.103:0/3474383881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09b1a0 0x56309a0a5850 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f699805d590 tx=0x7f699805d420 comp rx=0 tx=0).stop 2024-09-10T22:45:59.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69b961d000 1 -- 172.21.15.103:0/3474383881 shutdown_connections 2024-09-10T22:45:59.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69b961d000 1 --2- 172.21.15.103:0/3474383881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a09bac0 0x56309a0a5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69b961d000 1 --2- 172.21.15.103:0/3474383881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09b1a0 0x56309a0a5850 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69b961d000 1 --2- 172.21.15.103:0/3474383881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a051bc0 0x56309a0a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69b961d000 1 -- 172.21.15.103:0/3474383881 >> 172.21.15.103:0/3474383881 conn(0x56309a057d20 msgr2=0x56309a051fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:59.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69b961d000 1 -- 172.21.15.103:0/3474383881 shutdown_connections 2024-09-10T22:45:59.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69b961d000 1 -- 172.21.15.103:0/3474383881 wait complete. 2024-09-10T22:45:59.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69b961d000 1 -- start start 2024-09-10T22:45:59.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69b961d000 1 Processor -- start 2024-09-10T22:45:59.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69b961d000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a051bc0 0x56309a0a8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69b961d000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a09b1a0 0x56309a0a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69b961d000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09bac0 0x56309a0cd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69b961d000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56309a05ad40 con 0x56309a09bac0 2024-09-10T22:45:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69b961d000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56309a058100 con 0x56309a09b1a0 2024-09-10T22:45:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69b961d000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x563099e96ec0 con 0x56309a051bc0 2024-09-10T22:45:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69b961d000 10 client.0 _ll_register_callbacks cb 0x7f699805d4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:45:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69afe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09bac0 0x56309a0cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69afe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09bac0 0x56309a0cd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48908/0 (socket says 172.21.15.103:48908) 2024-09-10T22:45:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69afe00640 1 -- 172.21.15.103:0/3838395968 learned_addr learned my addr 172.21.15.103:0/3838395968 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69a6a00640 1 --2- 172.21.15.103:0/3838395968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a09b1a0 0x56309a0a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69af400640 1 --2- 172.21.15.103:0/3838395968 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a051bc0 0x56309a0a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.412+0000 7f69afe00640 1 -- 172.21.15.103:0/3838395968 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a051bc0 msgr2=0x56309a0a8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69afe00640 1 --2- 172.21.15.103:0/3838395968 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a051bc0 0x56309a0a8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69afe00640 1 -- 172.21.15.103:0/3838395968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a09b1a0 msgr2=0x56309a0a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:45:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69afe00640 1 --2- 172.21.15.103:0/3838395968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a09b1a0 0x56309a0a8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69afe00640 1 -- 172.21.15.103:0/3838395968 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563099e66090 con 0x56309a09bac0 2024-09-10T22:45:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69af400640 1 --2- 172.21.15.103:0/3838395968 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a051bc0 0x56309a0a8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69afe00640 1 --2- 172.21.15.103:0/3838395968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09bac0 0x56309a0cd210 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f69a8009840 tx=0x7f69a8009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e987cd59ff65b5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f699cc00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:45:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f699cc00640 1 -- 172.21.15.103:0/3838395968 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a80ac040 con 0x56309a09bac0 2024-09-10T22:45:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 1 -- 172.21.15.103:0/3838395968 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6998062040 con 0x56309a09bac0 2024-09-10T22:45:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f699cc00640 1 -- 172.21.15.103:0/3838395968 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f69a80becc0 con 0x56309a09bac0 2024-09-10T22:45:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f699cc00640 1 -- 172.21.15.103:0/3838395968 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7f69a80beec0 con 0x56309a09bac0 2024-09-10T22:45:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 10 client.8643 fetch_fsmap learned FSMap version 114 2024-09-10T22:45:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 1 -- 172.21.15.103:0/3838395968 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x563099e325f0 con 0x56309a09bac0 2024-09-10T22:45:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f699cc00640 1 -- 172.21.15.103:0/3838395968 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6998062040 con 0x56309a09bac0 2024-09-10T22:45:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f699cc00640 1 -- 172.21.15.103:0/3838395968 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 114) ==== 3554+0+0 (secure 0 0 0) 0x7f69a80bc070 con 0x56309a09bac0 2024-09-10T22:45:59.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 10 client.8643 fetch_fsmap finished waiting for FSMap version 114 2024-09-10T22:45:59.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 10 client.8643 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T22:45:59.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 20 client.8643 populate_metadata read hostname 'smithi103' 2024-09-10T22:45:59.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 1 --2- 172.21.15.103:0/3838395968 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56309a110a60 0x56309a110e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 4 client.8643 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:45:59.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 1 -- 172.21.15.103:0/3838395968 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563099eaa590 con 0x56309a110a60 2024-09-10T22:45:59.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69af400640 1 --2- 172.21.15.103:0/3838395968 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56309a110a60 0x56309a110e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69af400640 1 --2- 172.21.15.103:0/3838395968 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56309a110a60 0x56309a110e70 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f8aa3228f8f79b8 server_cookie=9e73127dafbc407f in_seq=0 out_seq=0 2024-09-10T22:45:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f699cc00640 10 client.8643 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f699cc00640 1 -- 172.21.15.103:0/3838395968 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x563099eaa590 con 0x56309a110a60 2024-09-10T22:45:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f699cc00640 10 client.8643 handle_command_reply: tid=0 2024-09-10T22:45:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 1 client.8643 shutdown 2024-09-10T22:45:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 1 -- 172.21.15.103:0/3838395968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09bac0 msgr2=0x56309a0cd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 1 --2- 172.21.15.103:0/3838395968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09bac0 0x56309a0cd210 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f69a8009840 tx=0x7f69a8009540 comp rx=0 tx=0).stop 2024-09-10T22:45:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 1 -- 172.21.15.103:0/3838395968 shutdown_connections 2024-09-10T22:45:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 1 --2- 172.21.15.103:0/3838395968 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56309a110a60 0x56309a110e70 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 1 --2- 172.21.15.103:0/3838395968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56309a09bac0 0x56309a0cd210 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 1 --2- 172.21.15.103:0/3838395968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56309a09b1a0 0x56309a0a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 1 --2- 172.21.15.103:0/3838395968 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56309a051bc0 0x56309a0a8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f699cc00640 0 client.8643 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:45:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 1 -- 172.21.15.103:0/3838395968 >> 172.21.15.103:0/3838395968 conn(0x56309a057d20 msgr2=0x56309a051070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 1 -- 172.21.15.103:0/3838395968 shutdown_connections 2024-09-10T22:45:59.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 1 -- 172.21.15.103:0/3838395968 wait complete. 2024-09-10T22:45:59.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b961d000 20 client.8643 trim_cache size 0 max 16384 2024-09-10T22:45:59.427 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:45:59.427 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-10T22:45:59.427 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:45:59.427 INFO:teuthology.orchestra.run.smithi103.stdout: "13d979f1-0660-40c8-9ef3-e228e32f6cb4": { 2024-09-10T22:45:59.427 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:45:59.427 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "13d979f1-0660-40c8-9ef3-e228e32f6cb4", 2024-09-10T22:45:59.427 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:45:59.428 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:59.428 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:45:59.428 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_stats": { 2024-09-10T22:45:59.428 INFO:teuthology.orchestra.run.smithi103.stdout: "13d979f1-0660-40c8-9ef3-e228e32f6cb4": { 2024-09-10T22:45:59.428 INFO:teuthology.orchestra.run.smithi103.stdout: "start_time": "2024-09-10T22:45:58.592812+0000", 2024-09-10T22:45:59.428 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:45:59.428 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_started": 0, 2024-09-10T22:45:59.428 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_passed": 0, 2024-09-10T22:45:59.428 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_failed": 0, 2024-09-10T22:45:59.428 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_skipped": 0 2024-09-10T22:45:59.428 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:59.428 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:45:59.428 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:45:59.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b6200640 1 -- 172.21.15.103:0/3930505185 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f698c072610 msgr2=0x7f698c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b6200640 1 --2- 172.21.15.103:0/3930505185 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f698c072610 0x7f698c074ad0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f69b00c9450 tx=0x7f69a0009230 comp rx=0 tx=0).stop 2024-09-10T22:45:59.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b6200640 1 -- 172.21.15.103:0/3930505185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69b00b09c0 msgr2=0x7f69b0157930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b6200640 1 --2- 172.21.15.103:0/3930505185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69b00b09c0 0x7f69b0157930 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f699800c500 tx=0x7f699800c9c0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b6200640 1 -- 172.21.15.103:0/3930505185 shutdown_connections 2024-09-10T22:45:59.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b6200640 1 --2- 172.21.15.103:0/3930505185 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f698c072610 0x7f698c074ad0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b6200640 1 --2- 172.21.15.103:0/3930505185 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69b015be30 0x7f69b00b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b6200640 1 --2- 172.21.15.103:0/3930505185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69b00b09c0 0x7f69b0157930 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b6200640 1 --2- 172.21.15.103:0/3930505185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69b00af9d0 0x7f69b01f8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b6200640 1 -- 172.21.15.103:0/3930505185 >> 172.21.15.103:0/3930505185 conn(0x7f69b00d1ac0 msgr2=0x7f69b00c7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:59.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b6200640 1 -- 172.21.15.103:0/3930505185 shutdown_connections 2024-09-10T22:45:59.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.416+0000 7f69b6200640 1 -- 172.21.15.103:0/3930505185 wait complete. 2024-09-10T22:45:59.440 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:45:59.440 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:45:59.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6434800640 1 -- 172.21.15.103:0/2625543858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c072a40 msgr2=0x7f642c157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6434800640 1 --2- 172.21.15.103:0/2625543858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c072a40 0x7f642c157090 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f642c0d0340 tx=0x7f642801dc70 comp rx=0 tx=0).stop 2024-09-10T22:45:59.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6434800640 1 -- 172.21.15.103:0/2625543858 shutdown_connections 2024-09-10T22:45:59.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6434800640 1 --2- 172.21.15.103:0/2625543858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c072a40 0x7f642c157090 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6434800640 1 --2- 172.21.15.103:0/2625543858 >> v2:172.21.15.131:3300/0 conn(0x7f642c0b3150 0x7f642c072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6434800640 1 --2- 172.21.15.103:0/2625543858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f642c0cf260 0x7f642c0b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6434800640 1 -- 172.21.15.103:0/2625543858 >> 172.21.15.103:0/2625543858 conn(0x7f642c06cc00 msgr2=0x7f642c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:59.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6434800640 1 -- 172.21.15.103:0/2625543858 shutdown_connections 2024-09-10T22:45:59.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6434800640 1 -- 172.21.15.103:0/2625543858 wait complete. 2024-09-10T22:45:59.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6434800640 1 Processor -- start 2024-09-10T22:45:59.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6434800640 1 -- start start 2024-09-10T22:45:59.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6434800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c072a40 0x7f642c1f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6434800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f642c0b3150 0x7f642c161520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6434800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f642c0cf260 0x7f642c147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6434800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f642c157e70 con 0x7f642c072a40 2024-09-10T22:45:59.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6434800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f642c157cf0 con 0x7f642c0b3150 2024-09-10T22:45:59.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6434800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f642c15dab0 con 0x7f642c0cf260 2024-09-10T22:45:59.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6431e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c072a40 0x7f642c1f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6431e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c072a40 0x7f642c1f77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48928/0 (socket says 172.21.15.103:48928) 2024-09-10T22:45:59.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6431e00640 1 -- 172.21.15.103:0/440722371 learned_addr learned my addr 172.21.15.103:0/440722371 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:59.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6432800640 1 --2- 172.21.15.103:0/440722371 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f642c0cf260 0x7f642c147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6431400640 1 --2- 172.21.15.103:0/440722371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f642c0b3150 0x7f642c161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6431e00640 1 -- 172.21.15.103:0/440722371 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f642c0cf260 msgr2=0x7f642c147e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6431e00640 1 --2- 172.21.15.103:0/440722371 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f642c0cf260 0x7f642c147e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6431e00640 1 -- 172.21.15.103:0/440722371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f642c0b3150 msgr2=0x7f642c161520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6431e00640 1 --2- 172.21.15.103:0/440722371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f642c0b3150 0x7f642c161520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6431e00640 1 -- 172.21.15.103:0/440722371 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642c1f8060 con 0x7f642c072a40 2024-09-10T22:45:59.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6432800640 1 --2- 172.21.15.103:0/440722371 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f642c0cf260 0x7f642c147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:45:59.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.580+0000 7f6431e00640 1 --2- 172.21.15.103:0/440722371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c072a40 0x7f642c1f77c0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f642000b440 tx=0x7f642000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:59.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.584+0000 7f6426000640 1 -- 172.21.15.103:0/440722371 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420015020 con 0x7f642c072a40 2024-09-10T22:45:59.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.584+0000 7f6426000640 1 -- 172.21.15.103:0/440722371 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64200119a0 con 0x7f642c072a40 2024-09-10T22:45:59.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.584+0000 7f6426000640 1 -- 172.21.15.103:0/440722371 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420011df0 con 0x7f642c072a40 2024-09-10T22:45:59.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.584+0000 7f6434800640 1 -- 172.21.15.103:0/440722371 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f642c1f8620 con 0x7f642c072a40 2024-09-10T22:45:59.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.584+0000 7f6434800640 1 -- 172.21.15.103:0/440722371 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f642c1f7d00 con 0x7f642c072a40 2024-09-10T22:45:59.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.584+0000 7f6434800640 1 -- 172.21.15.103:0/440722371 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f642c072500 con 0x7f642c072a40 2024-09-10T22:45:59.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.584+0000 7f6426000640 1 -- 172.21.15.103:0/440722371 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f642001a400 con 0x7f642c072a40 2024-09-10T22:45:59.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.584+0000 7f6426000640 1 --2- 172.21.15.103:0/440722371 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6410072610 0x7f6410074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.584+0000 7f6426000640 1 -- 172.21.15.103:0/440722371 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f6420093950 con 0x7f642c072a40 2024-09-10T22:45:59.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.588+0000 7f6431400640 1 --2- 172.21.15.103:0/440722371 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6410072610 0x7f6410074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.588+0000 7f6431400640 1 --2- 172.21.15.103:0/440722371 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6410072610 0x7f6410074ad0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f641c006fd0 tx=0x7f641c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:59.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.588+0000 7f6426000640 1 -- 172.21.15.103:0/440722371 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f642001f020 con 0x7f642c072a40 2024-09-10T22:45:59.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.784+0000 7f6434800640 1 -- 172.21.15.103:0/440722371 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f642c0703f0 con 0x7f642c072a40 2024-09-10T22:45:59.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.788+0000 7f6426000640 1 -- 172.21.15.103:0/440722371 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+5282 (secure 0 0 0) 0x7f642000d040 con 0x7f642c072a40 2024-09-10T22:45:59.792 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:45:59.792 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":114,"btime":"2024-09-10T22:45:54:810302+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:45:54.005705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8238,"mds_1":8235,"mds_2":7717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7717":{"gid":7717,"name":"b","rank":2,"incarnation":111,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8235":{"gid":8235,"name":"a","rank":1,"incarnation":109,"state":"up:active","state_seq":5,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[7717,8235,8238]},"id":7}]} 2024-09-10T22:45:59.792 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 114 2024-09-10T22:45:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.788+0000 7f6434800640 1 -- 172.21.15.103:0/440722371 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6410072610 msgr2=0x7f6410074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.788+0000 7f6434800640 1 --2- 172.21.15.103:0/440722371 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6410072610 0x7f6410074ad0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f641c006fd0 tx=0x7f641c008040 comp rx=0 tx=0).stop 2024-09-10T22:45:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.788+0000 7f6434800640 1 -- 172.21.15.103:0/440722371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c072a40 msgr2=0x7f642c1f77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.788+0000 7f6434800640 1 --2- 172.21.15.103:0/440722371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c072a40 0x7f642c1f77c0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f642000b440 tx=0x7f642000b900 comp rx=0 tx=0).stop 2024-09-10T22:45:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.788+0000 7f6434800640 1 -- 172.21.15.103:0/440722371 shutdown_connections 2024-09-10T22:45:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.788+0000 7f6434800640 1 --2- 172.21.15.103:0/440722371 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6410072610 0x7f6410074ad0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.788+0000 7f6434800640 1 --2- 172.21.15.103:0/440722371 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f642c0cf260 0x7f642c147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.788+0000 7f6434800640 1 --2- 172.21.15.103:0/440722371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f642c0b3150 0x7f642c161520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.788+0000 7f6434800640 1 --2- 172.21.15.103:0/440722371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c072a40 0x7f642c1f77c0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.788+0000 7f6434800640 1 -- 172.21.15.103:0/440722371 >> 172.21.15.103:0/440722371 conn(0x7f642c06cc00 msgr2=0x7f642c158220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.788+0000 7f6434800640 1 -- 172.21.15.103:0/440722371 shutdown_connections 2024-09-10T22:45:59.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.788+0000 7f6434800640 1 -- 172.21.15.103:0/440722371 wait complete. 2024-09-10T22:45:59.814 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'b'] 2024-09-10T22:45:59.814 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:45:59.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01f6400640 1 -- 172.21.15.103:0/400055744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01f015c970 msgr2=0x7f01f0072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01f6400640 1 --2- 172.21.15.103:0/400055744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01f015c970 0x7f01f0072e30 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f01f00b4ee0 tx=0x7f01d801c810 comp rx=0 tx=0).stop 2024-09-10T22:45:59.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01f6400640 1 -- 172.21.15.103:0/400055744 shutdown_connections 2024-09-10T22:45:59.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01f6400640 1 --2- 172.21.15.103:0/400055744 >> v2:172.21.15.131:3300/0 conn(0x7f01f00cf790 0x7f01f00cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01f6400640 1 --2- 172.21.15.103:0/400055744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01f015c970 0x7f01f0072e30 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01f6400640 1 --2- 172.21.15.103:0/400055744 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01f00cc120 0x7f01f00aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01f6400640 1 -- 172.21.15.103:0/400055744 >> 172.21.15.103:0/400055744 conn(0x7f01f006cc00 msgr2=0x7f01f006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:45:59.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01f6400640 1 -- 172.21.15.103:0/400055744 shutdown_connections 2024-09-10T22:45:59.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01f6400640 1 -- 172.21.15.103:0/400055744 wait complete. 2024-09-10T22:45:59.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01f6400640 1 Processor -- start 2024-09-10T22:45:59.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01f6400640 1 -- start start 2024-09-10T22:45:59.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01f6400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01f00cc120 0x7f01f0153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01f6400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01f00cf790 0x7f01f01550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01f6400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01f015c970 0x7f01f00b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01f6400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f01f015f8a0 con 0x7f01f015c970 2024-09-10T22:45:59.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01f6400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f01f015f720 con 0x7f01f00cc120 2024-09-10T22:45:59.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01f6400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f01f015fa20 con 0x7f01f00cf790 2024-09-10T22:45:59.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01efe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01f015c970 0x7f01f00b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01efe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01f015c970 0x7f01f00b0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48944/0 (socket says 172.21.15.103:48944) 2024-09-10T22:45:59.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01efe00640 1 -- 172.21.15.103:0/1782160367 learned_addr learned my addr 172.21.15.103:0/1782160367 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:45:59.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01e6a00640 1 --2- 172.21.15.103:0/1782160367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01f00cf790 0x7f01f01550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.952+0000 7f01ef400640 1 --2- 172.21.15.103:0/1782160367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01f00cc120 0x7f01f0153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.956+0000 7f01efe00640 1 -- 172.21.15.103:0/1782160367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01f00cf790 msgr2=0x7f01f01550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.956+0000 7f01efe00640 1 --2- 172.21.15.103:0/1782160367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01f00cf790 0x7f01f01550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.956+0000 7f01efe00640 1 -- 172.21.15.103:0/1782160367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01f00cc120 msgr2=0x7f01f0153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:45:59.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.956+0000 7f01efe00640 1 --2- 172.21.15.103:0/1782160367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01f00cc120 0x7f01f0153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:45:59.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.956+0000 7f01efe00640 1 -- 172.21.15.103:0/1782160367 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f0155b10 con 0x7f01f015c970 2024-09-10T22:45:59.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.956+0000 7f01efe00640 1 --2- 172.21.15.103:0/1782160367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01f015c970 0x7f01f00b0890 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f01e800eb20 tx=0x7f01e800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:59.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.956+0000 7f01e7e00640 1 -- 172.21.15.103:0/1782160367 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8004b30 con 0x7f01f015c970 2024-09-10T22:45:59.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.956+0000 7f01e7e00640 1 -- 172.21.15.103:0/1782160367 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01e8004cf0 con 0x7f01f015c970 2024-09-10T22:45:59.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.956+0000 7f01e7e00640 1 -- 172.21.15.103:0/1782160367 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8005280 con 0x7f01f015c970 2024-09-10T22:45:59.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.956+0000 7f01f6400640 1 -- 172.21.15.103:0/1782160367 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f0155df0 con 0x7f01f015c970 2024-09-10T22:45:59.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.956+0000 7f01f6400640 1 -- 172.21.15.103:0/1782160367 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f01563b0 con 0x7f01f015c970 2024-09-10T22:45:59.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.956+0000 7f01f6400640 1 -- 172.21.15.103:0/1782160367 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f00cfc40 con 0x7f01f015c970 2024-09-10T22:45:59.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.956+0000 7f01e7e00640 1 -- 172.21.15.103:0/1782160367 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f01e8005420 con 0x7f01f015c970 2024-09-10T22:45:59.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.960+0000 7f01e7e00640 1 --2- 172.21.15.103:0/1782160367 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f01cc0725e0 0x7f01cc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:45:59.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.960+0000 7f01e7e00640 1 -- 172.21.15.103:0/1782160367 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f01e8094110 con 0x7f01f015c970 2024-09-10T22:45:59.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.960+0000 7f01ef400640 1 --2- 172.21.15.103:0/1782160367 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f01cc0725e0 0x7f01cc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:45:59.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.960+0000 7f01ef400640 1 --2- 172.21.15.103:0/1782160367 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f01cc0725e0 0x7f01cc074aa0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f01e0009b60 tx=0x7f01e00091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:45:59.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:45:59.964+0000 7f01e7e00640 1 -- 172.21.15.103:0/1782160367 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f01e805ef20 con 0x7f01f015c970 2024-09-10T22:46:00.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:00.192+0000 7f01f6400640 1 -- 172.21.15.103:0/1782160367 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f01f0166260 con 0x7f01f015c970 2024-09-10T22:46:00.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:00.192+0000 7f01e7e00640 1 -- 172.21.15.103:0/1782160367 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1640 (secure 0 0 0) 0x7f01e8063950 con 0x7f01f015c970 2024-09-10T22:46:00.197 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:00.197 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":455,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":69,"data_bytes":694889,"bytes_used":267558912,"bytes_avail":772826554368,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9981,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":115,"btime":"2024-09-10T22:45:59:826742+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":7717},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8235},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8238}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-10T22:45:21.721344+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T22:46:00.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:00.192+0000 7f01f6400640 1 -- 172.21.15.103:0/1782160367 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f01cc0725e0 msgr2=0x7f01cc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:00.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:00.192+0000 7f01f6400640 1 --2- 172.21.15.103:0/1782160367 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f01cc0725e0 0x7f01cc074aa0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f01e0009b60 tx=0x7f01e00091e0 comp rx=0 tx=0).stop 2024-09-10T22:46:00.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:00.192+0000 7f01f6400640 1 -- 172.21.15.103:0/1782160367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01f015c970 msgr2=0x7f01f00b0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:00.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:00.192+0000 7f01f6400640 1 --2- 172.21.15.103:0/1782160367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01f015c970 0x7f01f00b0890 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f01e800eb20 tx=0x7f01e800c2d0 comp rx=0 tx=0).stop 2024-09-10T22:46:00.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:00.192+0000 7f01f6400640 1 -- 172.21.15.103:0/1782160367 shutdown_connections 2024-09-10T22:46:00.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:00.192+0000 7f01f6400640 1 --2- 172.21.15.103:0/1782160367 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f01cc0725e0 0x7f01cc074aa0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:00.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:00.192+0000 7f01f6400640 1 --2- 172.21.15.103:0/1782160367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01f015c970 0x7f01f00b0890 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:00.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:00.192+0000 7f01f6400640 1 --2- 172.21.15.103:0/1782160367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01f00cf790 0x7f01f01550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:00.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:00.192+0000 7f01f6400640 1 --2- 172.21.15.103:0/1782160367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01f00cc120 0x7f01f0153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:00.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:00.192+0000 7f01f6400640 1 -- 172.21.15.103:0/1782160367 >> 172.21.15.103:0/1782160367 conn(0x7f01f006cc00 msgr2=0x7f01f0164a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:00.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:00.192+0000 7f01f6400640 1 -- 172.21.15.103:0/1782160367 shutdown_connections 2024-09-10T22:46:00.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:00.192+0000 7f01f6400640 1 -- 172.21.15.103:0/1782160367 wait complete. 2024-09-10T22:46:00.218 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T22:46:00.833 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-10T22:46:00.832+0000 7fb5aec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-10T22:46:01.218 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:46:01.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.360+0000 7f4398200640 1 -- 172.21.15.103:0/2031771636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43900b3150 msgr2=0x7f4390072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:01.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.360+0000 7f4398200640 1 --2- 172.21.15.103:0/2031771636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43900b3150 0x7f4390072500 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f437c009900 tx=0x7f437c01c8e0 comp rx=0 tx=0).stop 2024-09-10T22:46:01.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.360+0000 7f4398200640 1 -- 172.21.15.103:0/2031771636 shutdown_connections 2024-09-10T22:46:01.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.360+0000 7f4398200640 1 --2- 172.21.15.103:0/2031771636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43900b3150 0x7f4390072500 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:01.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.360+0000 7f4398200640 1 --2- 172.21.15.103:0/2031771636 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43900cf260 0x7f43900b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:01.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.360+0000 7f4398200640 1 -- 172.21.15.103:0/2031771636 >> 172.21.15.103:0/2031771636 conn(0x7f439006cc00 msgr2=0x7f439006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:01.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.360+0000 7f4398200640 1 -- 172.21.15.103:0/2031771636 shutdown_connections 2024-09-10T22:46:01.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.360+0000 7f4398200640 1 -- 172.21.15.103:0/2031771636 wait complete. 2024-09-10T22:46:01.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.360+0000 7f4398200640 1 Processor -- start 2024-09-10T22:46:01.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.360+0000 7f4398200640 1 -- start start 2024-09-10T22:46:01.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.360+0000 7f4398200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4390072a40 0x7f43900aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:01.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.360+0000 7f4398200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43900b3150 0x7f43901f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:01.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f4398200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43900cf260 0x7f4390154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:01.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f4398200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f439006e7e0 con 0x7f4390072a40 2024-09-10T22:46:01.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f4398200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4390157e70 con 0x7f43900cf260 2024-09-10T22:46:01.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f4398200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f439006e960 con 0x7f43900b3150 2024-09-10T22:46:01.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f4395800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4390072a40 0x7f43900aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:01.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f4395800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4390072a40 0x7f43900aa3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48964/0 (socket says 172.21.15.103:48964) 2024-09-10T22:46:01.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f4395800640 1 -- 172.21.15.103:0/1792618001 learned_addr learned my addr 172.21.15.103:0/1792618001 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:01.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f4394e00640 1 --2- 172.21.15.103:0/1792618001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43900b3150 0x7f43901f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:01.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f4396200640 1 --2- 172.21.15.103:0/1792618001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43900cf260 0x7f4390154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:01.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f4395800640 1 -- 172.21.15.103:0/1792618001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43900b3150 msgr2=0x7f43901f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:01.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f4395800640 1 --2- 172.21.15.103:0/1792618001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43900b3150 0x7f43901f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:01.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f4395800640 1 -- 172.21.15.103:0/1792618001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43900cf260 msgr2=0x7f4390154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:01.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f4395800640 1 --2- 172.21.15.103:0/1792618001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43900cf260 0x7f4390154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:01.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f4395800640 1 -- 172.21.15.103:0/1792618001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43900a95f0 con 0x7f4390072a40 2024-09-10T22:46:01.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f4395800640 1 --2- 172.21.15.103:0/1792618001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4390072a40 0x7f43900aa3b0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f438400d720 tx=0x7f438400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:01.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f438d600640 1 -- 172.21.15.103:0/1792618001 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4384017070 con 0x7f4390072a40 2024-09-10T22:46:01.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f438d600640 1 -- 172.21.15.103:0/1792618001 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4384009d20 con 0x7f4390072a40 2024-09-10T22:46:01.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f438d600640 1 -- 172.21.15.103:0/1792618001 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4384005280 con 0x7f4390072a40 2024-09-10T22:46:01.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f4398200640 1 -- 172.21.15.103:0/1792618001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43900a98d0 con 0x7f4390072a40 2024-09-10T22:46:01.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f4398200640 1 -- 172.21.15.103:0/1792618001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43900a9e90 con 0x7f4390072a40 2024-09-10T22:46:01.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f4398200640 1 -- 172.21.15.103:0/1792618001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4390072500 con 0x7f4390072a40 2024-09-10T22:46:01.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.364+0000 7f438d600640 1 -- 172.21.15.103:0/1792618001 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4384005420 con 0x7f4390072a40 2024-09-10T22:46:01.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.368+0000 7f438d600640 1 --2- 172.21.15.103:0/1792618001 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4370072610 0x7f4370074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:01.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.368+0000 7f438d600640 1 -- 172.21.15.103:0/1792618001 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f4384093520 con 0x7f4390072a40 2024-09-10T22:46:01.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.368+0000 7f4394e00640 1 --2- 172.21.15.103:0/1792618001 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4370072610 0x7f4370074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:01.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.368+0000 7f4394e00640 1 --2- 172.21.15.103:0/1792618001 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4370072610 0x7f4370074ad0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f437c0af000 tx=0x7f437c01b120 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:01.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.372+0000 7f438d600640 1 -- 172.21.15.103:0/1792618001 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f438405e330 con 0x7f4390072a40 2024-09-10T22:46:01.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.568+0000 7f4398200640 1 -- 172.21.15.103:0/1792618001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f439015a640 con 0x7f4390072a40 2024-09-10T22:46:01.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.568+0000 7f438d600640 1 -- 172.21.15.103:0/1792618001 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+5286 (secure 0 0 0) 0x7f43840670a0 con 0x7f4390072a40 2024-09-10T22:46:01.574 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:01.574 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":116,"btime":"2024-09-10T22:46:00:834336+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:46:00.543444+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8238,"mds_1":8235,"mds_2":7717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7717":{"gid":7717,"name":"b","rank":2,"incarnation":111,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8235":{"gid":8235,"name":"a","rank":1,"incarnation":109,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[7717,8235,8238]},"id":7}]} 2024-09-10T22:46:01.575 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 116 2024-09-10T22:46:01.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.572+0000 7f4398200640 1 -- 172.21.15.103:0/1792618001 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4370072610 msgr2=0x7f4370074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:01.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.572+0000 7f4398200640 1 --2- 172.21.15.103:0/1792618001 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4370072610 0x7f4370074ad0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f437c0af000 tx=0x7f437c01b120 comp rx=0 tx=0).stop 2024-09-10T22:46:01.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.572+0000 7f4398200640 1 -- 172.21.15.103:0/1792618001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4390072a40 msgr2=0x7f43900aa3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:01.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.572+0000 7f4398200640 1 --2- 172.21.15.103:0/1792618001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4390072a40 0x7f43900aa3b0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f438400d720 tx=0x7f438400dbe0 comp rx=0 tx=0).stop 2024-09-10T22:46:01.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.572+0000 7f4398200640 1 -- 172.21.15.103:0/1792618001 shutdown_connections 2024-09-10T22:46:01.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.572+0000 7f4398200640 1 --2- 172.21.15.103:0/1792618001 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4370072610 0x7f4370074ad0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:01.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.572+0000 7f4398200640 1 --2- 172.21.15.103:0/1792618001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43900cf260 0x7f4390154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:01.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.572+0000 7f4398200640 1 --2- 172.21.15.103:0/1792618001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43900b3150 0x7f43901f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:01.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.572+0000 7f4398200640 1 --2- 172.21.15.103:0/1792618001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4390072a40 0x7f43900aa3b0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:01.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.572+0000 7f4398200640 1 -- 172.21.15.103:0/1792618001 >> 172.21.15.103:0/1792618001 conn(0x7f439006cc00 msgr2=0x7f439015b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:01.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.572+0000 7f4398200640 1 -- 172.21.15.103:0/1792618001 shutdown_connections 2024-09-10T22:46:01.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.572+0000 7f4398200640 1 -- 172.21.15.103:0/1792618001 wait complete. 2024-09-10T22:46:01.595 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'b'] 2024-09-10T22:46:01.595 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:46:01.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.732+0000 7f5c15c00640 1 -- 172.21.15.103:0/1331679436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bf40051d0 msgr2=0x7f5bf400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:01.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.732+0000 7f5c15c00640 1 --2- 172.21.15.103:0/1331679436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bf40051d0 0x7f5bf400b9d0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f5c080078d0 tx=0x7f5c0801db60 comp rx=0 tx=0).stop 2024-09-10T22:46:01.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.732+0000 7f5c15c00640 1 -- 172.21.15.103:0/1331679436 shutdown_connections 2024-09-10T22:46:01.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.732+0000 7f5c15c00640 1 --2- 172.21.15.103:0/1331679436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bf40051d0 0x7f5bf400b9d0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:01.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.732+0000 7f5c15c00640 1 -- 172.21.15.103:0/1331679436 >> 172.21.15.103:0/1331679436 conn(0x7f5c1006cc00 msgr2=0x7f5c1006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:01.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.732+0000 7f5c15c00640 1 -- 172.21.15.103:0/1331679436 shutdown_connections 2024-09-10T22:46:01.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.732+0000 7f5c15c00640 1 -- 172.21.15.103:0/1331679436 wait complete. 2024-09-10T22:46:01.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.732+0000 7f5c15c00640 1 Processor -- start 2024-09-10T22:46:01.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.732+0000 7f5c15c00640 1 -- start start 2024-09-10T22:46:01.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.732+0000 7f5c15c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bf40051d0 0x7f5c101e5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:01.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.732+0000 7f5c15c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c10153e70 0x7f5c1014dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:01.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.732+0000 7f5c15c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c101f4c70 0x7f5c101e8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:01.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.732+0000 7f5c15c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5c100740e0 con 0x7f5bf40051d0 2024-09-10T22:46:01.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.732+0000 7f5c15c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5c10070800 con 0x7f5c101f4c70 2024-09-10T22:46:01.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.732+0000 7f5c15c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5c10074260 con 0x7f5c10153e70 2024-09-10T22:46:01.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.732+0000 7f5c0ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bf40051d0 0x7f5c101e5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:01.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.732+0000 7f5c0ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bf40051d0 0x7f5c101e5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48986/0 (socket says 172.21.15.103:48986) 2024-09-10T22:46:01.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.732+0000 7f5c0ea00640 1 -- 172.21.15.103:0/3517608056 learned_addr learned my addr 172.21.15.103:0/3517608056 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:01.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.736+0000 7f5c0f400640 1 --2- 172.21.15.103:0/3517608056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c101f4c70 0x7f5c101e8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:01.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.736+0000 7f5c07e00640 1 --2- 172.21.15.103:0/3517608056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c10153e70 0x7f5c1014dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:01.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.736+0000 7f5c0ea00640 1 -- 172.21.15.103:0/3517608056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c10153e70 msgr2=0x7f5c1014dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:01.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.736+0000 7f5c0ea00640 1 --2- 172.21.15.103:0/3517608056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c10153e70 0x7f5c1014dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:01.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.736+0000 7f5c0ea00640 1 -- 172.21.15.103:0/3517608056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c101f4c70 msgr2=0x7f5c101e8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:01.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.736+0000 7f5c0ea00640 1 --2- 172.21.15.103:0/3517608056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c101f4c70 0x7f5c101e8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:01.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.736+0000 7f5c0ea00640 1 -- 172.21.15.103:0/3517608056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c10070320 con 0x7f5bf40051d0 2024-09-10T22:46:01.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.736+0000 7f5c07e00640 1 --2- 172.21.15.103:0/3517608056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c10153e70 0x7f5c1014dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:01.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.736+0000 7f5c0ea00640 1 --2- 172.21.15.103:0/3517608056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bf40051d0 0x7f5c101e5380 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f5c00004fd0 tx=0x7f5c0000ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.736+0000 7f5c06a00640 1 -- 172.21.15.103:0/3517608056 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c00015070 con 0x7f5bf40051d0 2024-09-10T22:46:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.736+0000 7f5c06a00640 1 -- 172.21.15.103:0/3517608056 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c00010980 con 0x7f5bf40051d0 2024-09-10T22:46:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.736+0000 7f5c15c00640 1 -- 172.21.15.103:0/3517608056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c101e5960 con 0x7f5bf40051d0 2024-09-10T22:46:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.736+0000 7f5c06a00640 1 -- 172.21.15.103:0/3517608056 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c00010dd0 con 0x7f5bf40051d0 2024-09-10T22:46:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.736+0000 7f5c15c00640 1 -- 172.21.15.103:0/3517608056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c101e5f20 con 0x7f5bf40051d0 2024-09-10T22:46:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.736+0000 7f5c15c00640 1 -- 172.21.15.103:0/3517608056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c1015d6a0 con 0x7f5bf40051d0 2024-09-10T22:46:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.736+0000 7f5c06a00640 1 -- 172.21.15.103:0/3517608056 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5c00011460 con 0x7f5bf40051d0 2024-09-10T22:46:01.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.736+0000 7f5c06a00640 1 --2- 172.21.15.103:0/3517608056 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5bec072610 0x7f5bec074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:01.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.740+0000 7f5c06a00640 1 -- 172.21.15.103:0/3517608056 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f5c00093900 con 0x7f5bf40051d0 2024-09-10T22:46:01.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.740+0000 7f5c07e00640 1 --2- 172.21.15.103:0/3517608056 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5bec072610 0x7f5bec074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:01.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.740+0000 7f5c07e00640 1 --2- 172.21.15.103:0/3517608056 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5bec072610 0x7f5bec074ad0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5c1015b270 tx=0x7f5bf8006f20 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:01.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.740+0000 7f5c06a00640 1 -- 172.21.15.103:0/3517608056 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5c0005e7b0 con 0x7f5bf40051d0 2024-09-10T22:46:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.972+0000 7f5c15c00640 1 -- 172.21.15.103:0/3517608056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f5c100af580 con 0x7f5bf40051d0 2024-09-10T22:46:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.972+0000 7f5c06a00640 1 -- 172.21.15.103:0/3517608056 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1928 (secure 0 0 0) 0x7f5c000631e0 con 0x7f5bf40051d0 2024-09-10T22:46:01.976 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:01.976 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":457,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":694889,"bytes_used":267558912,"bytes_avail":772826554368,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9554,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":7717},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8235},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8238}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-10T22:46:01.732006+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T22:46:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.972+0000 7f5c15c00640 1 -- 172.21.15.103:0/3517608056 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5bec072610 msgr2=0x7f5bec074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.972+0000 7f5c15c00640 1 --2- 172.21.15.103:0/3517608056 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5bec072610 0x7f5bec074ad0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5c1015b270 tx=0x7f5bf8006f20 comp rx=0 tx=0).stop 2024-09-10T22:46:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.972+0000 7f5c15c00640 1 -- 172.21.15.103:0/3517608056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bf40051d0 msgr2=0x7f5c101e5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.972+0000 7f5c15c00640 1 --2- 172.21.15.103:0/3517608056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bf40051d0 0x7f5c101e5380 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f5c00004fd0 tx=0x7f5c0000ea20 comp rx=0 tx=0).stop 2024-09-10T22:46:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.972+0000 7f5c15c00640 1 -- 172.21.15.103:0/3517608056 shutdown_connections 2024-09-10T22:46:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.972+0000 7f5c15c00640 1 --2- 172.21.15.103:0/3517608056 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5bec072610 0x7f5bec074ad0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.972+0000 7f5c15c00640 1 --2- 172.21.15.103:0/3517608056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c101f4c70 0x7f5c101e8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.972+0000 7f5c15c00640 1 --2- 172.21.15.103:0/3517608056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c10153e70 0x7f5c1014dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:01.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.972+0000 7f5c15c00640 1 --2- 172.21.15.103:0/3517608056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bf40051d0 0x7f5c101e5380 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:01.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.972+0000 7f5c15c00640 1 -- 172.21.15.103:0/3517608056 >> 172.21.15.103:0/3517608056 conn(0x7f5c1006cc00 msgr2=0x7f5c10159310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:01.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.972+0000 7f5c15c00640 1 -- 172.21.15.103:0/3517608056 shutdown_connections 2024-09-10T22:46:01.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:01.972+0000 7f5c15c00640 1 -- 172.21.15.103:0/3517608056 wait complete. 2024-09-10T22:46:01.998 INFO:tasks.ceph.ceph_manager.ceph:{'b': 'paused paths [/d1/d2/d3]'} 2024-09-10T22:46:02.999 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:46:03.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.148+0000 7f1f95200640 1 -- 172.21.15.103:0/2472093312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1f9015c970 msgr2=0x7f1f90072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:03.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.148+0000 7f1f95200640 1 --2- 172.21.15.103:0/2472093312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1f9015c970 0x7f1f90072e30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009840 tx=0x7f1f7801c760 comp rx=0 tx=0).stop 2024-09-10T22:46:03.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.148+0000 7f1f95200640 1 -- 172.21.15.103:0/2472093312 shutdown_connections 2024-09-10T22:46:03.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.148+0000 7f1f95200640 1 --2- 172.21.15.103:0/2472093312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1f9015c970 0x7f1f90072e30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:03.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.148+0000 7f1f95200640 1 --2- 172.21.15.103:0/2472093312 >> v2:172.21.15.131:3300/0 conn(0x7f1f900cc120 0x7f1f900aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:03.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.148+0000 7f1f95200640 1 -- 172.21.15.103:0/2472093312 >> 172.21.15.103:0/2472093312 conn(0x7f1f9006cc00 msgr2=0x7f1f9006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:03.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.148+0000 7f1f95200640 1 -- 172.21.15.103:0/2472093312 shutdown_connections 2024-09-10T22:46:03.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.148+0000 7f1f95200640 1 -- 172.21.15.103:0/2472093312 wait complete. 2024-09-10T22:46:03.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.148+0000 7f1f95200640 1 Processor -- start 2024-09-10T22:46:03.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f95200640 1 -- start start 2024-09-10T22:46:03.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f95200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1f900cc120 0x7f1f9014f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:03.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f95200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f900cf790 0x7f1f9006f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:03.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f95200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f9015c970 0x7f1f90150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:03.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f95200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1f901690c0 con 0x7f1f9015c970 2024-09-10T22:46:03.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f95200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1f90073510 con 0x7f1f900cf790 2024-09-10T22:46:03.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f95200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1f90169240 con 0x7f1f900cc120 2024-09-10T22:46:03.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f8e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f9015c970 0x7f1f90150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:03.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f8e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f9015c970 0x7f1f90150c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48992/0 (socket says 172.21.15.103:48992) 2024-09-10T22:46:03.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f8e800640 1 -- 172.21.15.103:0/2096620218 learned_addr learned my addr 172.21.15.103:0/2096620218 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:03.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f85400640 1 --2- 172.21.15.103:0/2096620218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f900cf790 0x7f1f9006f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:03.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f8de00640 1 --2- 172.21.15.103:0/2096620218 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1f900cc120 0x7f1f9014f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:03.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f8e800640 1 -- 172.21.15.103:0/2096620218 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1f900cc120 msgr2=0x7f1f9014f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:03.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f8e800640 1 --2- 172.21.15.103:0/2096620218 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1f900cc120 0x7f1f9014f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:03.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f8e800640 1 -- 172.21.15.103:0/2096620218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f900cf790 msgr2=0x7f1f9006f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:03.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f8e800640 1 --2- 172.21.15.103:0/2096620218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f900cf790 0x7f1f9006f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:03.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f8e800640 1 -- 172.21.15.103:0/2096620218 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9006e730 con 0x7f1f9015c970 2024-09-10T22:46:03.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f8e800640 1 --2- 172.21.15.103:0/2096620218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f9015c970 0x7f1f90150c30 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800c410 tx=0x7f1f8800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:03.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f86a00640 1 -- 172.21.15.103:0/2096620218 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88011790 con 0x7f1f9015c970 2024-09-10T22:46:03.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f86a00640 1 -- 172.21.15.103:0/2096620218 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f88017070 con 0x7f1f9015c970 2024-09-10T22:46:03.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f86a00640 1 -- 172.21.15.103:0/2096620218 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88011cc0 con 0x7f1f9015c970 2024-09-10T22:46:03.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f95200640 1 -- 172.21.15.103:0/2096620218 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9006ea10 con 0x7f1f9015c970 2024-09-10T22:46:03.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f95200640 1 -- 172.21.15.103:0/2096620218 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f9006efd0 con 0x7f1f9015c970 2024-09-10T22:46:03.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.152+0000 7f1f95200640 1 -- 172.21.15.103:0/2096620218 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f90072e30 con 0x7f1f9015c970 2024-09-10T22:46:03.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.156+0000 7f1f86a00640 1 -- 172.21.15.103:0/2096620218 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1f8801c460 con 0x7f1f9015c970 2024-09-10T22:46:03.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.156+0000 7f1f86a00640 1 --2- 172.21.15.103:0/2096620218 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1f6c0725e0 0x7f1f6c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:03.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.156+0000 7f1f86a00640 1 -- 172.21.15.103:0/2096620218 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f1f880931b0 con 0x7f1f9015c970 2024-09-10T22:46:03.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.156+0000 7f1f8de00640 1 --2- 172.21.15.103:0/2096620218 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1f6c0725e0 0x7f1f6c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:03.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.156+0000 7f1f8de00640 1 --2- 172.21.15.103:0/2096620218 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1f6c0725e0 0x7f1f6c074aa0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009980 tx=0x7f1f80009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:03.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.160+0000 7f1f86a00640 1 -- 172.21.15.103:0/2096620218 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1f8805dfc0 con 0x7f1f9015c970 2024-09-10T22:46:03.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.360+0000 7f1f95200640 1 -- 172.21.15.103:0/2096620218 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f90070510 con 0x7f1f9015c970 2024-09-10T22:46:03.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.360+0000 7f1f86a00640 1 -- 172.21.15.103:0/2096620218 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5287 (secure 0 0 0) 0x7f1f880629f0 con 0x7f1f9015c970 2024-09-10T22:46:03.361 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:03.361 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:46:01.549542+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8238,"mds_1":8235,"mds_2":7717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7717":{"gid":7717,"name":"b","rank":2,"incarnation":111,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8235":{"gid":8235,"name":"a","rank":1,"incarnation":109,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238,8235,7717]},"id":7}]} 2024-09-10T22:46:03.361 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 117 2024-09-10T22:46:03.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.360+0000 7f1f95200640 1 -- 172.21.15.103:0/2096620218 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1f6c0725e0 msgr2=0x7f1f6c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:03.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.360+0000 7f1f95200640 1 --2- 172.21.15.103:0/2096620218 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1f6c0725e0 0x7f1f6c074aa0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009980 tx=0x7f1f80009500 comp rx=0 tx=0).stop 2024-09-10T22:46:03.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.360+0000 7f1f95200640 1 -- 172.21.15.103:0/2096620218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f9015c970 msgr2=0x7f1f90150c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:03.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.360+0000 7f1f95200640 1 --2- 172.21.15.103:0/2096620218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f9015c970 0x7f1f90150c30 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800c410 tx=0x7f1f8800c8d0 comp rx=0 tx=0).stop 2024-09-10T22:46:03.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.364+0000 7f1f95200640 1 -- 172.21.15.103:0/2096620218 shutdown_connections 2024-09-10T22:46:03.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.364+0000 7f1f95200640 1 --2- 172.21.15.103:0/2096620218 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1f6c0725e0 0x7f1f6c074aa0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:03.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.364+0000 7f1f95200640 1 --2- 172.21.15.103:0/2096620218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f9015c970 0x7f1f90150c30 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:03.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.364+0000 7f1f95200640 1 --2- 172.21.15.103:0/2096620218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f900cf790 0x7f1f9006f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:03.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.364+0000 7f1f95200640 1 --2- 172.21.15.103:0/2096620218 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1f900cc120 0x7f1f9014f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:03.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.364+0000 7f1f95200640 1 -- 172.21.15.103:0/2096620218 >> 172.21.15.103:0/2096620218 conn(0x7f1f9006cc00 msgr2=0x7f1f900afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:03.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.364+0000 7f1f95200640 1 -- 172.21.15.103:0/2096620218 shutdown_connections 2024-09-10T22:46:03.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.364+0000 7f1f95200640 1 -- 172.21.15.103:0/2096620218 wait complete. 2024-09-10T22:46:03.383 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'b'] 2024-09-10T22:46:03.383 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:46:03.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7338600640 1 -- 172.21.15.103:0/3208226674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73300aeb40 msgr2=0x7f7330072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:03.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7338600640 1 --2- 172.21.15.103:0/3208226674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73300aeb40 0x7f7330072e30 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f73300d0870 tx=0x7f731c01c770 comp rx=0 tx=0).stop 2024-09-10T22:46:03.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7338600640 1 -- 172.21.15.103:0/3208226674 shutdown_connections 2024-09-10T22:46:03.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7338600640 1 --2- 172.21.15.103:0/3208226674 >> v2:172.21.15.131:3300/0 conn(0x7f73300cf790 0x7f73300cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:03.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7338600640 1 --2- 172.21.15.103:0/3208226674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73300aeb40 0x7f7330072e30 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:03.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7338600640 1 -- 172.21.15.103:0/3208226674 >> 172.21.15.103:0/3208226674 conn(0x7f733006cc00 msgr2=0x7f733006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:03.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7338600640 1 -- 172.21.15.103:0/3208226674 shutdown_connections 2024-09-10T22:46:03.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7338600640 1 -- 172.21.15.103:0/3208226674 wait complete. 2024-09-10T22:46:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7338600640 1 Processor -- start 2024-09-10T22:46:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7338600640 1 -- start start 2024-09-10T22:46:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7338600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73300aeb40 0x7f73300aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7338600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73300cc120 0x7f73301578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7338600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73300cf790 0x7f7330160640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7338600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7330168c40 con 0x7f73300aeb40 2024-09-10T22:46:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7338600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7330168ac0 con 0x7f73300cc120 2024-09-10T22:46:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7338600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7330168dc0 con 0x7f73300cf790 2024-09-10T22:46:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7335c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73300aeb40 0x7f73300aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7335c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73300aeb40 0x7f73300aa4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49008/0 (socket says 172.21.15.103:49008) 2024-09-10T22:46:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7335c00640 1 -- 172.21.15.103:0/2895645484 learned_addr learned my addr 172.21.15.103:0/2895645484 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:03.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7335200640 1 --2- 172.21.15.103:0/2895645484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73300cc120 0x7f73301578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:03.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7336600640 1 --2- 172.21.15.103:0/2895645484 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73300cf790 0x7f7330160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:03.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7335c00640 1 -- 172.21.15.103:0/2895645484 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73300cf790 msgr2=0x7f7330160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:03.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7335c00640 1 --2- 172.21.15.103:0/2895645484 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73300cf790 0x7f7330160640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:03.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7335c00640 1 -- 172.21.15.103:0/2895645484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73300cc120 msgr2=0x7f73301578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:03.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7335c00640 1 --2- 172.21.15.103:0/2895645484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73300cc120 0x7f73301578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:03.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7335c00640 1 -- 172.21.15.103:0/2895645484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7330158ba0 con 0x7f73300aeb40 2024-09-10T22:46:03.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7335200640 1 --2- 172.21.15.103:0/2895645484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73300cc120 0x7f73301578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:03.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7336600640 1 --2- 172.21.15.103:0/2895645484 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73300cf790 0x7f7330160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:03.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f7335c00640 1 --2- 172.21.15.103:0/2895645484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73300aeb40 0x7f73300aa4a0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f732400c480 tx=0x7f732400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:03.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.524+0000 7f732d600640 1 -- 172.21.15.103:0/2895645484 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7324016020 con 0x7f73300aeb40 2024-09-10T22:46:03.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.528+0000 7f732d600640 1 -- 172.21.15.103:0/2895645484 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7324012920 con 0x7f73300aeb40 2024-09-10T22:46:03.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.528+0000 7f7338600640 1 -- 172.21.15.103:0/2895645484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7330158e40 con 0x7f73300aeb40 2024-09-10T22:46:03.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.528+0000 7f732d600640 1 -- 172.21.15.103:0/2895645484 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7324012d70 con 0x7f73300aeb40 2024-09-10T22:46:03.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.528+0000 7f7338600640 1 -- 172.21.15.103:0/2895645484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73300aca00 con 0x7f73300aeb40 2024-09-10T22:46:03.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.528+0000 7f7338600640 1 -- 172.21.15.103:0/2895645484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7330072e30 con 0x7f73300aeb40 2024-09-10T22:46:03.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.528+0000 7f732d600640 1 -- 172.21.15.103:0/2895645484 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f732401b400 con 0x7f73300aeb40 2024-09-10T22:46:03.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.528+0000 7f732d600640 1 --2- 172.21.15.103:0/2895645484 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f73100725e0 0x7f7310074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:03.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.528+0000 7f732d600640 1 -- 172.21.15.103:0/2895645484 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f73240936f0 con 0x7f73300aeb40 2024-09-10T22:46:03.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.528+0000 7f7335200640 1 --2- 172.21.15.103:0/2895645484 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f73100725e0 0x7f7310074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:03.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.532+0000 7f7335200640 1 --2- 172.21.15.103:0/2895645484 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f73100725e0 0x7f7310074aa0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f731c0af000 tx=0x7f731c01afb0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:03.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.532+0000 7f732d600640 1 -- 172.21.15.103:0/2895645484 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7324020020 con 0x7f73300aeb40 2024-09-10T22:46:03.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.756+0000 7f7338600640 1 -- 172.21.15.103:0/2895645484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f73300b3930 con 0x7f73300aeb40 2024-09-10T22:46:03.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.756+0000 7f732d600640 1 -- 172.21.15.103:0/2895645484 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1928 (secure 0 0 0) 0x7f732405ec80 con 0x7f73300aeb40 2024-09-10T22:46:03.759 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:03.759 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":459,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":694889,"bytes_used":267558912,"bytes_avail":772826554368,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9554,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":7717},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8235},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8238}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-10T22:46:01.732006+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T22:46:03.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.760+0000 7f7338600640 1 -- 172.21.15.103:0/2895645484 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f73100725e0 msgr2=0x7f7310074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:03.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.760+0000 7f7338600640 1 --2- 172.21.15.103:0/2895645484 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f73100725e0 0x7f7310074aa0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f731c0af000 tx=0x7f731c01afb0 comp rx=0 tx=0).stop 2024-09-10T22:46:03.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.760+0000 7f7338600640 1 -- 172.21.15.103:0/2895645484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73300aeb40 msgr2=0x7f73300aa4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:03.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.760+0000 7f7338600640 1 --2- 172.21.15.103:0/2895645484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73300aeb40 0x7f73300aa4a0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f732400c480 tx=0x7f732400c940 comp rx=0 tx=0).stop 2024-09-10T22:46:03.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.760+0000 7f7338600640 1 -- 172.21.15.103:0/2895645484 shutdown_connections 2024-09-10T22:46:03.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.760+0000 7f7338600640 1 --2- 172.21.15.103:0/2895645484 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f73100725e0 0x7f7310074aa0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:03.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.760+0000 7f7338600640 1 --2- 172.21.15.103:0/2895645484 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73300cf790 0x7f7330160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:03.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.760+0000 7f7338600640 1 --2- 172.21.15.103:0/2895645484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73300cc120 0x7f73301578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:03.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.760+0000 7f7338600640 1 --2- 172.21.15.103:0/2895645484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73300aeb40 0x7f73300aa4a0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:03.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.760+0000 7f7338600640 1 -- 172.21.15.103:0/2895645484 >> 172.21.15.103:0/2895645484 conn(0x7f733006cc00 msgr2=0x7f73300b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:03.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.760+0000 7f7338600640 1 -- 172.21.15.103:0/2895645484 shutdown_connections 2024-09-10T22:46:03.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:03.760+0000 7f7338600640 1 -- 172.21.15.103:0/2895645484 wait complete. 2024-09-10T22:46:03.780 INFO:tasks.ceph.ceph_manager.ceph:{'b': 'paused paths [/d1/d2/d3]'} 2024-09-10T22:46:04.784 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:46:04.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.936+0000 7f07f7000640 1 -- 172.21.15.103:0/2197562218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07f0073b50 msgr2=0x7f07f015eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:04.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.936+0000 7f07f7000640 1 --2- 172.21.15.103:0/2197562218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07f0073b50 0x7f07f015eaf0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009900 tx=0x7f07e801c8b0 comp rx=0 tx=0).stop 2024-09-10T22:46:04.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.936+0000 7f07f7000640 1 -- 172.21.15.103:0/2197562218 shutdown_connections 2024-09-10T22:46:04.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.936+0000 7f07f7000640 1 --2- 172.21.15.103:0/2197562218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07f0073b50 0x7f07f015eaf0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:04.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.936+0000 7f07f7000640 1 --2- 172.21.15.103:0/2197562218 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07f0158600 0x7f07f0073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:04.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.936+0000 7f07f7000640 1 -- 172.21.15.103:0/2197562218 >> 172.21.15.103:0/2197562218 conn(0x7f07f00b2660 msgr2=0x7f07f00b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:04.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.936+0000 7f07f7000640 1 -- 172.21.15.103:0/2197562218 shutdown_connections 2024-09-10T22:46:04.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.936+0000 7f07f7000640 1 -- 172.21.15.103:0/2197562218 wait complete. 2024-09-10T22:46:04.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07f7000640 1 Processor -- start 2024-09-10T22:46:04.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07f7000640 1 -- start start 2024-09-10T22:46:04.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07f7000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07f0073b50 0x7f07f00d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:04.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07f7000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07f0158220 0x7f07f0147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07f7000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07f0158600 0x7f07f0147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07f7000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f07f00aef60 con 0x7f07f0073b50 2024-09-10T22:46:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07f7000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f07f00aede0 con 0x7f07f0158600 2024-09-10T22:46:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07f7000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f07f00af0e0 con 0x7f07f0158220 2024-09-10T22:46:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07efe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07f0073b50 0x7f07f00d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07efe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07f0073b50 0x7f07f00d0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49032/0 (socket says 172.21.15.103:49032) 2024-09-10T22:46:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07efe00640 1 -- 172.21.15.103:0/519454640 learned_addr learned my addr 172.21.15.103:0/519454640 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07f5000640 1 --2- 172.21.15.103:0/519454640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07f0158600 0x7f07f0147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07e7400640 1 --2- 172.21.15.103:0/519454640 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07f0158220 0x7f07f0147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07efe00640 1 -- 172.21.15.103:0/519454640 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07f0158220 msgr2=0x7f07f0147400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07efe00640 1 --2- 172.21.15.103:0/519454640 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07f0158220 0x7f07f0147400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07efe00640 1 -- 172.21.15.103:0/519454640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07f0158600 msgr2=0x7f07f0147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07efe00640 1 --2- 172.21.15.103:0/519454640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07f0158600 0x7f07f0147940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:04.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07efe00640 1 -- 172.21.15.103:0/519454640 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f0155a40 con 0x7f07f0073b50 2024-09-10T22:46:04.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07f5000640 1 --2- 172.21.15.103:0/519454640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07f0158600 0x7f07f0147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:04.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07efe00640 1 --2- 172.21.15.103:0/519454640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07f0073b50 0x7f07f00d0bb0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f07e000c870 tx=0x7f07e000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:04.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07ecc00640 1 -- 172.21.15.103:0/519454640 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e0003ba0 con 0x7f07f0073b50 2024-09-10T22:46:04.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07ecc00640 1 -- 172.21.15.103:0/519454640 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07e0003d40 con 0x7f07f0073b50 2024-09-10T22:46:04.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07ecc00640 1 -- 172.21.15.103:0/519454640 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e000aab0 con 0x7f07f0073b50 2024-09-10T22:46:04.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07f7000640 1 -- 172.21.15.103:0/519454640 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f0155760 con 0x7f07f0073b50 2024-09-10T22:46:04.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07f7000640 1 -- 172.21.15.103:0/519454640 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f01fb560 con 0x7f07f0073b50 2024-09-10T22:46:04.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.940+0000 7f07f7000640 1 -- 172.21.15.103:0/519454640 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07f015eaf0 con 0x7f07f0073b50 2024-09-10T22:46:04.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.944+0000 7f07ecc00640 1 -- 172.21.15.103:0/519454640 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f07e000ac50 con 0x7f07f0073b50 2024-09-10T22:46:04.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.944+0000 7f07ecc00640 1 --2- 172.21.15.103:0/519454640 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07cc0725e0 0x7f07cc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:04.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.944+0000 7f07ecc00640 1 -- 172.21.15.103:0/519454640 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f07e0093370 con 0x7f07f0073b50 2024-09-10T22:46:04.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.944+0000 7f07e7400640 1 --2- 172.21.15.103:0/519454640 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07cc0725e0 0x7f07cc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:04.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.944+0000 7f07e7400640 1 --2- 172.21.15.103:0/519454640 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07cc0725e0 0x7f07cc074aa0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f07d8005fd0 tx=0x7f07d8005d10 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:04.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:04.948+0000 7f07ecc00640 1 -- 172.21.15.103:0/519454640 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f07e005e860 con 0x7f07f0073b50 2024-09-10T22:46:05.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.148+0000 7f07f7000640 1 -- 172.21.15.103:0/519454640 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07f01faf40 con 0x7f07f0073b50 2024-09-10T22:46:05.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.148+0000 7f07ecc00640 1 -- 172.21.15.103:0/519454640 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5287 (secure 0 0 0) 0x7f07f01faf40 con 0x7f07f0073b50 2024-09-10T22:46:05.149 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:05.149 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:46:01.549542+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8238,"mds_1":8235,"mds_2":7717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7717":{"gid":7717,"name":"b","rank":2,"incarnation":111,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8235":{"gid":8235,"name":"a","rank":1,"incarnation":109,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238,8235,7717]},"id":7}]} 2024-09-10T22:46:05.149 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 117 2024-09-10T22:46:05.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.148+0000 7f07f7000640 1 -- 172.21.15.103:0/519454640 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07cc0725e0 msgr2=0x7f07cc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:05.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.148+0000 7f07f7000640 1 --2- 172.21.15.103:0/519454640 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07cc0725e0 0x7f07cc074aa0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f07d8005fd0 tx=0x7f07d8005d10 comp rx=0 tx=0).stop 2024-09-10T22:46:05.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.148+0000 7f07f7000640 1 -- 172.21.15.103:0/519454640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07f0073b50 msgr2=0x7f07f00d0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:05.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.148+0000 7f07f7000640 1 --2- 172.21.15.103:0/519454640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07f0073b50 0x7f07f00d0bb0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f07e000c870 tx=0x7f07e000cd30 comp rx=0 tx=0).stop 2024-09-10T22:46:05.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.152+0000 7f07f7000640 1 -- 172.21.15.103:0/519454640 shutdown_connections 2024-09-10T22:46:05.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.152+0000 7f07f7000640 1 --2- 172.21.15.103:0/519454640 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f07cc0725e0 0x7f07cc074aa0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:05.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.152+0000 7f07f7000640 1 --2- 172.21.15.103:0/519454640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07f0158600 0x7f07f0147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:05.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.152+0000 7f07f7000640 1 --2- 172.21.15.103:0/519454640 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07f0158220 0x7f07f0147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:05.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.152+0000 7f07f7000640 1 --2- 172.21.15.103:0/519454640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07f0073b50 0x7f07f00d0bb0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:05.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.152+0000 7f07f7000640 1 -- 172.21.15.103:0/519454640 >> 172.21.15.103:0/519454640 conn(0x7f07f00b2660 msgr2=0x7f07f014aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:05.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.152+0000 7f07f7000640 1 -- 172.21.15.103:0/519454640 shutdown_connections 2024-09-10T22:46:05.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.152+0000 7f07f7000640 1 -- 172.21.15.103:0/519454640 wait complete. 2024-09-10T22:46:05.172 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'b'] 2024-09-10T22:46:05.172 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:46:05.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.312+0000 7fd549200640 1 -- 172.21.15.103:0/483390989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd528003a60 msgr2=0x7fd528003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:05.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.312+0000 7fd549200640 1 --2- 172.21.15.103:0/483390989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd528003a60 0x7fd528003e80 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fd53400c260 tx=0x7fd53401cf40 comp rx=0 tx=0).stop 2024-09-10T22:46:05.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.312+0000 7fd549200640 1 -- 172.21.15.103:0/483390989 shutdown_connections 2024-09-10T22:46:05.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.312+0000 7fd549200640 1 --2- 172.21.15.103:0/483390989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd528003a60 0x7fd528003e80 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:05.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.312+0000 7fd549200640 1 -- 172.21.15.103:0/483390989 >> 172.21.15.103:0/483390989 conn(0x7fd5440d09d0 msgr2=0x7fd5440d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:05.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.312+0000 7fd549200640 1 -- 172.21.15.103:0/483390989 shutdown_connections 2024-09-10T22:46:05.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.312+0000 7fd549200640 1 -- 172.21.15.103:0/483390989 wait complete. 2024-09-10T22:46:05.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd549200640 1 Processor -- start 2024-09-10T22:46:05.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd549200640 1 -- start start 2024-09-10T22:46:05.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd549200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd528003a60 0x7fd5441f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:05.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd549200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd544158380 0x7fd54414e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:05.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd549200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5440cdd30 0x7fd5440ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:05.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd549200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd544070160 con 0x7fd5440cdd30 2024-09-10T22:46:05.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd549200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd54406ffe0 con 0x7fd544158380 2024-09-10T22:46:05.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd549200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd5440702e0 con 0x7fd528003a60 2024-09-10T22:46:05.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd542800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5440cdd30 0x7fd5440ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:05.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd542800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5440cdd30 0x7fd5440ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49044/0 (socket says 172.21.15.103:49044) 2024-09-10T22:46:05.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd542800640 1 -- 172.21.15.103:0/406030883 learned_addr learned my addr 172.21.15.103:0/406030883 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:05.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd541e00640 1 --2- 172.21.15.103:0/406030883 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd528003a60 0x7fd5441f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:05.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd541400640 1 --2- 172.21.15.103:0/406030883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd544158380 0x7fd54414e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:05.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd542800640 1 -- 172.21.15.103:0/406030883 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd528003a60 msgr2=0x7fd5441f74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:05.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd542800640 1 --2- 172.21.15.103:0/406030883 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd528003a60 0x7fd5441f74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:05.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd542800640 1 -- 172.21.15.103:0/406030883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd544158380 msgr2=0x7fd54414e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:05.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd542800640 1 --2- 172.21.15.103:0/406030883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd544158380 0x7fd54414e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:05.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd542800640 1 -- 172.21.15.103:0/406030883 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5441f83d0 con 0x7fd5440cdd30 2024-09-10T22:46:05.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd541400640 1 --2- 172.21.15.103:0/406030883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd544158380 0x7fd54414e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:05.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd542800640 1 --2- 172.21.15.103:0/406030883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5440cdd30 0x7fd5440ce1b0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fd5441589f0 tx=0x7fd53c0019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:05.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd53a000640 1 -- 172.21.15.103:0/406030883 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53c015020 con 0x7fd5440cdd30 2024-09-10T22:46:05.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd53a000640 1 -- 172.21.15.103:0/406030883 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd53c011960 con 0x7fd5440cdd30 2024-09-10T22:46:05.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd53a000640 1 -- 172.21.15.103:0/406030883 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53c011d50 con 0x7fd5440cdd30 2024-09-10T22:46:05.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd549200640 1 -- 172.21.15.103:0/406030883 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5441f7b30 con 0x7fd5440cdd30 2024-09-10T22:46:05.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd549200640 1 -- 172.21.15.103:0/406030883 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5441f80f0 con 0x7fd5440cdd30 2024-09-10T22:46:05.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.316+0000 7fd549200640 1 -- 172.21.15.103:0/406030883 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd54406ce80 con 0x7fd5440cdd30 2024-09-10T22:46:05.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.320+0000 7fd53a000640 1 -- 172.21.15.103:0/406030883 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd53c01a400 con 0x7fd5440cdd30 2024-09-10T22:46:05.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.320+0000 7fd53a000640 1 --2- 172.21.15.103:0/406030883 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd524072610 0x7fd524074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:05.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.320+0000 7fd53a000640 1 -- 172.21.15.103:0/406030883 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fd53c0940b0 con 0x7fd5440cdd30 2024-09-10T22:46:05.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.320+0000 7fd541e00640 1 --2- 172.21.15.103:0/406030883 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd524072610 0x7fd524074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:05.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.320+0000 7fd541e00640 1 --2- 172.21.15.103:0/406030883 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd524072610 0x7fd524074ad0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd5340ab000 tx=0x7fd534019d80 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:05.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.324+0000 7fd53a000640 1 -- 172.21.15.103:0/406030883 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd53c01f020 con 0x7fd5440cdd30 2024-09-10T22:46:05.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.548+0000 7fd549200640 1 -- 172.21.15.103:0/406030883 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd5440d07b0 con 0x7fd5440cdd30 2024-09-10T22:46:05.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.548+0000 7fd53a000640 1 -- 172.21.15.103:0/406030883 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1928 (secure 0 0 0) 0x7fd53c05f5a0 con 0x7fd5440cdd30 2024-09-10T22:46:05.549 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:05.550 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":461,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":694889,"bytes_used":267558912,"bytes_avail":772826554368,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9554,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":7717},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8235},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8238}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-10T22:46:01.732006+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T22:46:05.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.552+0000 7fd549200640 1 -- 172.21.15.103:0/406030883 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd524072610 msgr2=0x7fd524074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:05.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.552+0000 7fd549200640 1 --2- 172.21.15.103:0/406030883 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd524072610 0x7fd524074ad0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd5340ab000 tx=0x7fd534019d80 comp rx=0 tx=0).stop 2024-09-10T22:46:05.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.552+0000 7fd549200640 1 -- 172.21.15.103:0/406030883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5440cdd30 msgr2=0x7fd5440ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:05.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.552+0000 7fd549200640 1 --2- 172.21.15.103:0/406030883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5440cdd30 0x7fd5440ce1b0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fd5441589f0 tx=0x7fd53c0019c0 comp rx=0 tx=0).stop 2024-09-10T22:46:05.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.552+0000 7fd549200640 1 -- 172.21.15.103:0/406030883 shutdown_connections 2024-09-10T22:46:05.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.552+0000 7fd549200640 1 --2- 172.21.15.103:0/406030883 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd524072610 0x7fd524074ad0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:05.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.552+0000 7fd549200640 1 --2- 172.21.15.103:0/406030883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5440cdd30 0x7fd5440ce1b0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:05.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.552+0000 7fd549200640 1 --2- 172.21.15.103:0/406030883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd544158380 0x7fd54414e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:05.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.552+0000 7fd549200640 1 --2- 172.21.15.103:0/406030883 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd528003a60 0x7fd5441f74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:05.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.552+0000 7fd549200640 1 -- 172.21.15.103:0/406030883 >> 172.21.15.103:0/406030883 conn(0x7fd5440d09d0 msgr2=0x7fd544158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:05.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.552+0000 7fd549200640 1 -- 172.21.15.103:0/406030883 shutdown_connections 2024-09-10T22:46:05.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:05.552+0000 7fd549200640 1 -- 172.21.15.103:0/406030883 wait complete. 2024-09-10T22:46:05.574 INFO:tasks.ceph.ceph_manager.ceph:{'b': 'paused paths [/d1/d2/d3]'} 2024-09-10T22:46:06.575 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:46:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.724+0000 7fe8aaa00640 1 -- 172.21.15.103:0/102941327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8a40cf9f0 msgr2=0x7fe8a406eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.724+0000 7fe8aaa00640 1 --2- 172.21.15.103:0/102941327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8a40cf9f0 0x7fe8a406eb80 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40cc6e0 tx=0x7fe89401cd80 comp rx=0 tx=0).stop 2024-09-10T22:46:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.724+0000 7fe8aaa00640 1 -- 172.21.15.103:0/102941327 shutdown_connections 2024-09-10T22:46:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.724+0000 7fe8aaa00640 1 --2- 172.21.15.103:0/102941327 >> v2:172.21.15.131:3300/0 conn(0x7fe8a40cfdd0 0x7fe8a4073b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.724+0000 7fe8aaa00640 1 --2- 172.21.15.103:0/102941327 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8a406f0c0 0x7fe8a4073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.724+0000 7fe8aaa00640 1 --2- 172.21.15.103:0/102941327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8a40cf9f0 0x7fe8a406eb80 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.724+0000 7fe8aaa00640 1 -- 172.21.15.103:0/102941327 >> 172.21.15.103:0/102941327 conn(0x7fe8a406cc00 msgr2=0x7fe8a406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.724+0000 7fe8aaa00640 1 -- 172.21.15.103:0/102941327 shutdown_connections 2024-09-10T22:46:06.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.724+0000 7fe8aaa00640 1 -- 172.21.15.103:0/102941327 wait complete. 2024-09-10T22:46:06.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8aaa00640 1 Processor -- start 2024-09-10T22:46:06.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8aaa00640 1 -- start start 2024-09-10T22:46:06.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8aaa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8a406f0c0 0x7fe8a4157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:06.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8aaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8a40cf9f0 0x7fe8a415d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:06.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8aaa00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8a40cfdd0 0x7fe8a414e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:06.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8aaa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a40ccab0 con 0x7fe8a40cf9f0 2024-09-10T22:46:06.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8aaa00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a40cc930 con 0x7fe8a406f0c0 2024-09-10T22:46:06.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8aaa00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a40ccc30 con 0x7fe8a40cfdd0 2024-09-10T22:46:06.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8a3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8a40cf9f0 0x7fe8a415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:06.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8a3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8a40cf9f0 0x7fe8a415d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58006/0 (socket says 172.21.15.103:58006) 2024-09-10T22:46:06.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8a3400640 1 -- 172.21.15.103:0/1620429692 learned_addr learned my addr 172.21.15.103:0/1620429692 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:06.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8a3e00640 1 --2- 172.21.15.103:0/1620429692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8a406f0c0 0x7fe8a4157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:06.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8a8a00640 1 --2- 172.21.15.103:0/1620429692 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8a40cfdd0 0x7fe8a414e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:06.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8a3400640 1 -- 172.21.15.103:0/1620429692 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8a40cfdd0 msgr2=0x7fe8a414e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:06.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8a3400640 1 --2- 172.21.15.103:0/1620429692 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8a40cfdd0 0x7fe8a414e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:06.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8a3400640 1 -- 172.21.15.103:0/1620429692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8a406f0c0 msgr2=0x7fe8a4157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8a3400640 1 --2- 172.21.15.103:0/1620429692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8a406f0c0 0x7fe8a4157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8a3400640 1 -- 172.21.15.103:0/1620429692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a4157e40 con 0x7fe8a40cf9f0 2024-09-10T22:46:06.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8a3400640 1 --2- 172.21.15.103:0/1620429692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8a40cf9f0 0x7fe8a415d340 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fe89000e940 tx=0x7fe89000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:06.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe89be00640 1 -- 172.21.15.103:0/1620429692 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89000cd80 con 0x7fe8a40cf9f0 2024-09-10T22:46:06.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe89be00640 1 -- 172.21.15.103:0/1620429692 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe890005020 con 0x7fe8a40cf9f0 2024-09-10T22:46:06.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe89be00640 1 -- 172.21.15.103:0/1620429692 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890005450 con 0x7fe8a40cf9f0 2024-09-10T22:46:06.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8aaa00640 1 -- 172.21.15.103:0/1620429692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a415dc70 con 0x7fe8a40cf9f0 2024-09-10T22:46:06.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.728+0000 7fe8aaa00640 1 -- 172.21.15.103:0/1620429692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a413e220 con 0x7fe8a40cf9f0 2024-09-10T22:46:06.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.732+0000 7fe8aaa00640 1 -- 172.21.15.103:0/1620429692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8a406eb80 con 0x7fe8a40cf9f0 2024-09-10T22:46:06.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.732+0000 7fe89be00640 1 -- 172.21.15.103:0/1620429692 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe8900047b0 con 0x7fe8a40cf9f0 2024-09-10T22:46:06.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.732+0000 7fe89be00640 1 --2- 172.21.15.103:0/1620429692 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe8840725e0 0x7fe884074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:06.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.732+0000 7fe89be00640 1 -- 172.21.15.103:0/1620429692 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fe890093df0 con 0x7fe8a40cf9f0 2024-09-10T22:46:06.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.732+0000 7fe8a3e00640 1 --2- 172.21.15.103:0/1620429692 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe8840725e0 0x7fe884074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:06.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.736+0000 7fe8a3e00640 1 --2- 172.21.15.103:0/1620429692 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe8840725e0 0x7fe884074aa0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe8940af000 tx=0x7fe89401b5c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:06.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.736+0000 7fe89be00640 1 -- 172.21.15.103:0/1620429692 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe89005ec90 con 0x7fe8a40cf9f0 2024-09-10T22:46:06.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.936+0000 7fe8aaa00640 1 -- 172.21.15.103:0/1620429692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8a40cbeb0 con 0x7fe8a40cf9f0 2024-09-10T22:46:06.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.936+0000 7fe89be00640 1 -- 172.21.15.103:0/1620429692 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5287 (secure 0 0 0) 0x7fe8900636c0 con 0x7fe8a40cf9f0 2024-09-10T22:46:06.937 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:06.937 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:46:01.549542+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8238,"mds_1":8235,"mds_2":7717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7717":{"gid":7717,"name":"b","rank":2,"incarnation":111,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8235":{"gid":8235,"name":"a","rank":1,"incarnation":109,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238,8235,7717]},"id":7}]} 2024-09-10T22:46:06.937 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 117 2024-09-10T22:46:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.936+0000 7fe8aaa00640 1 -- 172.21.15.103:0/1620429692 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe8840725e0 msgr2=0x7fe884074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.936+0000 7fe8aaa00640 1 --2- 172.21.15.103:0/1620429692 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe8840725e0 0x7fe884074aa0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe8940af000 tx=0x7fe89401b5c0 comp rx=0 tx=0).stop 2024-09-10T22:46:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.936+0000 7fe8aaa00640 1 -- 172.21.15.103:0/1620429692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8a40cf9f0 msgr2=0x7fe8a415d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.936+0000 7fe8aaa00640 1 --2- 172.21.15.103:0/1620429692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8a40cf9f0 0x7fe8a415d340 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fe89000e940 tx=0x7fe89000ee00 comp rx=0 tx=0).stop 2024-09-10T22:46:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.936+0000 7fe8aaa00640 1 -- 172.21.15.103:0/1620429692 shutdown_connections 2024-09-10T22:46:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.936+0000 7fe8aaa00640 1 --2- 172.21.15.103:0/1620429692 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe8840725e0 0x7fe884074aa0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.936+0000 7fe8aaa00640 1 --2- 172.21.15.103:0/1620429692 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8a40cfdd0 0x7fe8a414e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.936+0000 7fe8aaa00640 1 --2- 172.21.15.103:0/1620429692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8a40cf9f0 0x7fe8a415d340 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.936+0000 7fe8aaa00640 1 --2- 172.21.15.103:0/1620429692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8a406f0c0 0x7fe8a4157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.936+0000 7fe8aaa00640 1 -- 172.21.15.103:0/1620429692 >> 172.21.15.103:0/1620429692 conn(0x7fe8a406cc00 msgr2=0x7fe8a40ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.936+0000 7fe8aaa00640 1 -- 172.21.15.103:0/1620429692 shutdown_connections 2024-09-10T22:46:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:06.940+0000 7fe8aaa00640 1 -- 172.21.15.103:0/1620429692 wait complete. 2024-09-10T22:46:06.959 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'b'] 2024-09-10T22:46:06.959 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:46:07.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88ad200640 1 -- 172.21.15.103:0/2246853813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88a80aeb40 msgr2=0x7f88a8072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88ad200640 1 --2- 172.21.15.103:0/2246853813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88a80aeb40 0x7f88a8072e30 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f88a80d0870 tx=0x7f889401c830 comp rx=0 tx=0).stop 2024-09-10T22:46:07.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88ad200640 1 -- 172.21.15.103:0/2246853813 shutdown_connections 2024-09-10T22:46:07.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88ad200640 1 --2- 172.21.15.103:0/2246853813 >> v2:172.21.15.131:3300/0 conn(0x7f88a80cf790 0x7f88a80cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88ad200640 1 --2- 172.21.15.103:0/2246853813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88a80aeb40 0x7f88a8072e30 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88ad200640 1 -- 172.21.15.103:0/2246853813 >> 172.21.15.103:0/2246853813 conn(0x7f88a806cc00 msgr2=0x7f88a806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88ad200640 1 -- 172.21.15.103:0/2246853813 shutdown_connections 2024-09-10T22:46:07.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88ad200640 1 -- 172.21.15.103:0/2246853813 wait complete. 2024-09-10T22:46:07.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88ad200640 1 Processor -- start 2024-09-10T22:46:07.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88ad200640 1 -- start start 2024-09-10T22:46:07.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88ad200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88a80aeb40 0x7f88a806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88ad200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88a80cc120 0x7f88a8147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88ad200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88a80cf790 0x7f88a8164a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88ad200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f88a8168c40 con 0x7f88a80aeb40 2024-09-10T22:46:07.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88ad200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f88a8168ac0 con 0x7f88a80cc120 2024-09-10T22:46:07.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88ad200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f88a8168dc0 con 0x7f88a80cf790 2024-09-10T22:46:07.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88a5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88a80aeb40 0x7f88a806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88a5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88a80aeb40 0x7f88a806eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58024/0 (socket says 172.21.15.103:58024) 2024-09-10T22:46:07.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88a5e00640 1 -- 172.21.15.103:0/196791117 learned_addr learned my addr 172.21.15.103:0/196791117 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:07.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88a6800640 1 --2- 172.21.15.103:0/196791117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88a80cf790 0x7f88a8164a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88a5400640 1 --2- 172.21.15.103:0/196791117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88a80cc120 0x7f88a8147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88a5e00640 1 -- 172.21.15.103:0/196791117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88a80cf790 msgr2=0x7f88a8164a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88a5e00640 1 --2- 172.21.15.103:0/196791117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88a80cf790 0x7f88a8164a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88a5e00640 1 -- 172.21.15.103:0/196791117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88a80cc120 msgr2=0x7f88a8147140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88a5e00640 1 --2- 172.21.15.103:0/196791117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88a80cc120 0x7f88a8147140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.100+0000 7f88a5e00640 1 -- 172.21.15.103:0/196791117 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a81fae80 con 0x7f88a80aeb40 2024-09-10T22:46:07.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.104+0000 7f88a5e00640 1 --2- 172.21.15.103:0/196791117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88a80aeb40 0x7f88a806eb80 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f889800c4c0 tx=0x7f8898001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.104+0000 7f889e000640 1 -- 172.21.15.103:0/196791117 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8898017070 con 0x7f88a80aeb40 2024-09-10T22:46:07.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.104+0000 7f889e000640 1 -- 172.21.15.103:0/196791117 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8898003600 con 0x7f88a80aeb40 2024-09-10T22:46:07.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.104+0000 7f889e000640 1 -- 172.21.15.103:0/196791117 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8898003a50 con 0x7f88a80aeb40 2024-09-10T22:46:07.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.104+0000 7f88ad200640 1 -- 172.21.15.103:0/196791117 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a81fb160 con 0x7f88a80aeb40 2024-09-10T22:46:07.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.104+0000 7f88ad200640 1 -- 172.21.15.103:0/196791117 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a81fb720 con 0x7f88a80aeb40 2024-09-10T22:46:07.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.104+0000 7f88ad200640 1 -- 172.21.15.103:0/196791117 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a8072e30 con 0x7f88a80aeb40 2024-09-10T22:46:07.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.104+0000 7f889e000640 1 -- 172.21.15.103:0/196791117 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8898003bf0 con 0x7f88a80aeb40 2024-09-10T22:46:07.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.104+0000 7f889e000640 1 --2- 172.21.15.103:0/196791117 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f88880725e0 0x7f8888074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.108+0000 7f889e000640 1 -- 172.21.15.103:0/196791117 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f88980925d0 con 0x7f88a80aeb40 2024-09-10T22:46:07.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.108+0000 7f88a5400640 1 --2- 172.21.15.103:0/196791117 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f88880725e0 0x7f8888074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.108+0000 7f88a5400640 1 --2- 172.21.15.103:0/196791117 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f88880725e0 0x7f8888074aa0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f88940af000 tx=0x7f889401b070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.112+0000 7f889e000640 1 -- 172.21.15.103:0/196791117 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f889805db60 con 0x7f88a80aeb40 2024-09-10T22:46:07.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.336+0000 7f88ad200640 1 -- 172.21.15.103:0/196791117 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f88a815eee0 con 0x7f88a80aeb40 2024-09-10T22:46:07.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.336+0000 7f889e000640 1 -- 172.21.15.103:0/196791117 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2010 (secure 0 0 0) 0x7f889805d460 con 0x7f88a80aeb40 2024-09-10T22:46:07.336 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:07.337 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":463,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":695463,"bytes_used":267558912,"bytes_avail":772826554368,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9640,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":7717},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8235},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8238}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-09-10T22:46:05.733362+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T22:46:07.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.336+0000 7f88ad200640 1 -- 172.21.15.103:0/196791117 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f88880725e0 msgr2=0x7f8888074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.336+0000 7f88ad200640 1 --2- 172.21.15.103:0/196791117 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f88880725e0 0x7f8888074aa0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f88940af000 tx=0x7f889401b070 comp rx=0 tx=0).stop 2024-09-10T22:46:07.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.336+0000 7f88ad200640 1 -- 172.21.15.103:0/196791117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88a80aeb40 msgr2=0x7f88a806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.336+0000 7f88ad200640 1 --2- 172.21.15.103:0/196791117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88a80aeb40 0x7f88a806eb80 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f889800c4c0 tx=0x7f8898001e80 comp rx=0 tx=0).stop 2024-09-10T22:46:07.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.336+0000 7f88ad200640 1 -- 172.21.15.103:0/196791117 shutdown_connections 2024-09-10T22:46:07.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.336+0000 7f88ad200640 1 --2- 172.21.15.103:0/196791117 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f88880725e0 0x7f8888074aa0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.336+0000 7f88ad200640 1 --2- 172.21.15.103:0/196791117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88a80cf790 0x7f88a8164a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.336+0000 7f88ad200640 1 --2- 172.21.15.103:0/196791117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88a80cc120 0x7f88a8147140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.336+0000 7f88ad200640 1 --2- 172.21.15.103:0/196791117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88a80aeb40 0x7f88a806eb80 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.336+0000 7f88ad200640 1 -- 172.21.15.103:0/196791117 >> 172.21.15.103:0/196791117 conn(0x7f88a806cc00 msgr2=0x7f88a8159020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.336+0000 7f88ad200640 1 -- 172.21.15.103:0/196791117 shutdown_connections 2024-09-10T22:46:07.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.336+0000 7f88ad200640 1 -- 172.21.15.103:0/196791117 wait complete. 2024-09-10T22:46:07.357 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]', 'b': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]'} 2024-09-10T22:46:07.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:46:07.358 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub abort 2024-09-10T22:46:07.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.500+0000 7fcaeb000640 1 -- 172.21.15.103:0/3724609261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae415f290 msgr2=0x7fcae40cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.500+0000 7fcaeb000640 1 --2- 172.21.15.103:0/3724609261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae415f290 0x7fcae40cf970 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fcae406a310 tx=0x7fcad001f090 comp rx=0 tx=0).stop 2024-09-10T22:46:07.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.500+0000 7fcaeb000640 1 -- 172.21.15.103:0/3724609261 shutdown_connections 2024-09-10T22:46:07.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.500+0000 7fcaeb000640 1 --2- 172.21.15.103:0/3724609261 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcae40cfeb0 0x7fcae4070570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.500+0000 7fcaeb000640 1 --2- 172.21.15.103:0/3724609261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae415f290 0x7fcae40cf970 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.500+0000 7fcaeb000640 1 --2- 172.21.15.103:0/3724609261 >> v2:172.21.15.131:3300/0 conn(0x7fcae415eeb0 0x7fcae4071e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcaeb000640 1 -- 172.21.15.103:0/3724609261 >> 172.21.15.103:0/3724609261 conn(0x7fcae40d1870 msgr2=0x7fcae40d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcaeb000640 1 -- 172.21.15.103:0/3724609261 shutdown_connections 2024-09-10T22:46:07.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcaeb000640 1 -- 172.21.15.103:0/3724609261 wait complete. 2024-09-10T22:46:07.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcaeb000640 1 Processor -- start 2024-09-10T22:46:07.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcaeb000640 1 -- start start 2024-09-10T22:46:07.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcaeb000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcae40cfeb0 0x7fcae415a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcaeb000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae415eeb0 0x7fcae40c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcaeb000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcae415f290 0x7fcae40c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcaeb000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcae4070e40 con 0x7fcae415eeb0 2024-09-10T22:46:07.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcaeb000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcae4070cc0 con 0x7fcae40cfeb0 2024-09-10T22:46:07.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcaeb000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcae4070fc0 con 0x7fcae415f290 2024-09-10T22:46:07.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcae9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae415eeb0 0x7fcae40c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcae9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae415eeb0 0x7fcae40c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58032/0 (socket says 172.21.15.103:58032) 2024-09-10T22:46:07.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcae9200640 1 -- 172.21.15.103:0/3096013518 learned_addr learned my addr 172.21.15.103:0/3096013518 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:07.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcaea600640 1 --2- 172.21.15.103:0/3096013518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcae415f290 0x7fcae40c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcae9c00640 1 --2- 172.21.15.103:0/3096013518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcae40cfeb0 0x7fcae415a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcae9200640 1 -- 172.21.15.103:0/3096013518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcae415f290 msgr2=0x7fcae40c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcae9200640 1 --2- 172.21.15.103:0/3096013518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcae415f290 0x7fcae40c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcae9200640 1 -- 172.21.15.103:0/3096013518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcae40cfeb0 msgr2=0x7fcae415a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcae9200640 1 --2- 172.21.15.103:0/3096013518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcae40cfeb0 0x7fcae415a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcae9200640 1 -- 172.21.15.103:0/3096013518 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae415a550 con 0x7fcae415eeb0 2024-09-10T22:46:07.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcaea600640 1 --2- 172.21.15.103:0/3096013518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcae415f290 0x7fcae40c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:07.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcae9c00640 1 --2- 172.21.15.103:0/3096013518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcae40cfeb0 0x7fcae415a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:07.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.504+0000 7fcae9200640 1 --2- 172.21.15.103:0/3096013518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae415eeb0 0x7fcae40c6050 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fcad00b3040 tx=0x7fcad0005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.508+0000 7fcae1600640 1 -- 172.21.15.103:0/3096013518 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad00b5040 con 0x7fcae415eeb0 2024-09-10T22:46:07.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.508+0000 7fcae1600640 1 -- 172.21.15.103:0/3096013518 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcad0005340 con 0x7fcae415eeb0 2024-09-10T22:46:07.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.508+0000 7fcaeb000640 1 -- 172.21.15.103:0/3096013518 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcae40cca40 con 0x7fcae415eeb0 2024-09-10T22:46:07.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.508+0000 7fcae1600640 1 -- 172.21.15.103:0/3096013518 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad00046d0 con 0x7fcae415eeb0 2024-09-10T22:46:07.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.508+0000 7fcaeb000640 1 -- 172.21.15.103:0/3096013518 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcae40cc3b0 con 0x7fcae415eeb0 2024-09-10T22:46:07.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.508+0000 7fcae1600640 1 -- 172.21.15.103:0/3096013518 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcad00c4060 con 0x7fcae415eeb0 2024-09-10T22:46:07.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.508+0000 7fcae1600640 1 --2- 172.21.15.103:0/3096013518 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcac40725e0 0x7fcac4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.508+0000 7fcaefa81000 1 Processor -- start 2024-09-10T22:46:07.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.508+0000 7fcae1600640 1 -- 172.21.15.103:0/3096013518 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fcad01301e0 con 0x7fcae415eeb0 2024-09-10T22:46:07.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.508+0000 7fcaefa81000 1 -- start start 2024-09-10T22:46:07.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.508+0000 7fcae9c00640 1 --2- 172.21.15.103:0/3096013518 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcac40725e0 0x7fcac4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcae9c00640 1 --2- 172.21.15.103:0/3096013518 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcac40725e0 0x7fcac4074aa0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcad80058d0 tx=0x7fcad8005860 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcaefa81000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d6051d0 0x55a41d766e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcaefa81000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d7673d0 0x55a41d7677b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcaefa81000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d71d5a0 0x55a41d71d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcaefa81000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a41d51b2c0 con 0x55a41d6051d0 2024-09-10T22:46:07.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcaefa81000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a41d578b90 con 0x55a41d7673d0 2024-09-10T22:46:07.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcaefa81000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a41d567fc0 con 0x55a41d71d5a0 2024-09-10T22:46:07.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcae9c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d6051d0 0x55a41d766e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcae9c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d6051d0 0x55a41d766e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58038/0 (socket says 172.21.15.103:58038) 2024-09-10T22:46:07.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcae9c00640 1 -- 172.21.15.103:0/1829449523 learned_addr learned my addr 172.21.15.103:0/1829449523 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:07.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcae9200640 1 --2- 172.21.15.103:0/1829449523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d7673d0 0x55a41d7677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcaea600640 1 --2- 172.21.15.103:0/1829449523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d71d5a0 0x55a41d71d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcae9c00640 1 -- 172.21.15.103:0/1829449523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d71d5a0 msgr2=0x55a41d71d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcae9c00640 1 --2- 172.21.15.103:0/1829449523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d71d5a0 0x55a41d71d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcae9c00640 1 -- 172.21.15.103:0/1829449523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d7673d0 msgr2=0x55a41d7677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcae9c00640 1 --2- 172.21.15.103:0/1829449523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d7673d0 0x55a41d7677b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcae9c00640 1 -- 172.21.15.103:0/1829449523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a41d5061a0 con 0x55a41d6051d0 2024-09-10T22:46:07.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcae9c00640 1 --2- 172.21.15.103:0/1829449523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d6051d0 0x55a41d766e90 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fcad8010010 tx=0x7fcad8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b119234b0e77ade server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcad6000640 1 -- 172.21.15.103:0/1829449523 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8022070 con 0x55a41d6051d0 2024-09-10T22:46:07.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcad6000640 1 -- 172.21.15.103:0/1829449523 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcad801e740 con 0x55a41d6051d0 2024-09-10T22:46:07.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcad6000640 1 -- 172.21.15.103:0/1829449523 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad801eaf0 con 0x55a41d6051d0 2024-09-10T22:46:07.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcaefa81000 1 -- 172.21.15.103:0/1829449523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d6051d0 msgr2=0x55a41d766e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcaefa81000 1 --2- 172.21.15.103:0/1829449523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d6051d0 0x55a41d766e90 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fcad8010010 tx=0x7fcad8012000 comp rx=0 tx=0).stop 2024-09-10T22:46:07.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcaefa81000 1 -- 172.21.15.103:0/1829449523 shutdown_connections 2024-09-10T22:46:07.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcaefa81000 1 --2- 172.21.15.103:0/1829449523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d71d5a0 0x55a41d71d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcaefa81000 1 --2- 172.21.15.103:0/1829449523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d7673d0 0x55a41d7677b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcaefa81000 1 --2- 172.21.15.103:0/1829449523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d6051d0 0x55a41d766e90 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcaefa81000 1 -- 172.21.15.103:0/1829449523 >> 172.21.15.103:0/1829449523 conn(0x55a41d226880 msgr2=0x55a41d71be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcaefa81000 1 -- 172.21.15.103:0/1829449523 shutdown_connections 2024-09-10T22:46:07.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcaefa81000 1 -- 172.21.15.103:0/1829449523 wait complete. 2024-09-10T22:46:07.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcaefa81000 1 -- start start 2024-09-10T22:46:07.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.512+0000 7fcaefa81000 1 Processor -- start 2024-09-10T22:46:07.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d6051d0 0x55a41d76da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d71d5a0 0x55a41d76df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d7673d0 0x55a41d76e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a41d50d4d0 con 0x55a41d71d5a0 2024-09-10T22:46:07.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a41d56bdd0 con 0x55a41d7673d0 2024-09-10T22:46:07.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a41d22d620 con 0x55a41d6051d0 2024-09-10T22:46:07.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 10 client.0 _ll_register_callbacks cb 0x55a41d53ecd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:07.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcae9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d71d5a0 0x55a41d76df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcae9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d71d5a0 0x55a41d76df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58040/0 (socket says 172.21.15.103:58040) 2024-09-10T22:46:07.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcae9200640 1 -- 172.21.15.103:0/2001207838 learned_addr learned my addr 172.21.15.103:0/2001207838 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:07.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcae9200640 1 -- 172.21.15.103:0/2001207838 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d6051d0 msgr2=0x55a41d76da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcae9c00640 1 --2- 172.21.15.103:0/2001207838 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d6051d0 0x55a41d76da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaea600640 1 --2- 172.21.15.103:0/2001207838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d7673d0 0x55a41d76e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcae9200640 1 --2- 172.21.15.103:0/2001207838 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d6051d0 0x55a41d76da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcae9200640 1 -- 172.21.15.103:0/2001207838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d7673d0 msgr2=0x55a41d76e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcae9200640 1 --2- 172.21.15.103:0/2001207838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d7673d0 0x55a41d76e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcae9200640 1 -- 172.21.15.103:0/2001207838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a41d637720 con 0x55a41d71d5a0 2024-09-10T22:46:07.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcae9c00640 1 --2- 172.21.15.103:0/2001207838 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d6051d0 0x55a41d76da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:07.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaea600640 1 --2- 172.21.15.103:0/2001207838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d7673d0 0x55a41d76e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:07.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcae9200640 1 --2- 172.21.15.103:0/2001207838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d71d5a0 0x55a41d76df60 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fcad001d740 tx=0x7fcad00fa760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59790527caa057f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcacaa00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:07.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcacaa00640 1 -- 172.21.15.103:0/2001207838 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad00c1040 con 0x55a41d71d5a0 2024-09-10T22:46:07.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcacaa00640 1 -- 172.21.15.103:0/2001207838 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fcad0104260 con 0x55a41d71d5a0 2024-09-10T22:46:07.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 -- 172.21.15.103:0/2001207838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a41d5002e0 con 0x55a41d71d5a0 2024-09-10T22:46:07.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcacaa00640 1 -- 172.21.15.103:0/2001207838 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7fcad00faff0 con 0x55a41d71d5a0 2024-09-10T22:46:07.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 10 client.8721 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:07.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 -- 172.21.15.103:0/2001207838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55a41d5ed420 con 0x55a41d71d5a0 2024-09-10T22:46:07.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcacaa00640 1 -- 172.21.15.103:0/2001207838 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a41d5002e0 con 0x55a41d71d5a0 2024-09-10T22:46:07.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcacaa00640 1 -- 172.21.15.103:0/2001207838 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7fcad011abc0 con 0x55a41d71d5a0 2024-09-10T22:46:07.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 10 client.8721 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:07.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 10 client.8721 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T22:46:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 20 client.8721 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 --2- 172.21.15.103:0/2001207838 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55a41d775df0 0x55a41d7781e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 4 client.8721 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:46:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 -- 172.21.15.103:0/2001207838 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a41d57aae0 con 0x55a41d775df0 2024-09-10T22:46:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcae9c00640 1 --2- 172.21.15.103:0/2001207838 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55a41d775df0 0x55a41d7781e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcae9c00640 1 --2- 172.21.15.103:0/2001207838 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55a41d775df0 0x55a41d7781e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7914bfc09e23442 server_cookie=a245de1e28de4250 in_seq=0 out_seq=0 2024-09-10T22:46:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcacaa00640 10 client.8721 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcacaa00640 1 -- 172.21.15.103:0/2001207838 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a41d57aae0 con 0x55a41d775df0 2024-09-10T22:46:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcacaa00640 10 client.8721 handle_command_reply: tid=0 2024-09-10T22:46:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 client.8721 shutdown 2024-09-10T22:46:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 -- 172.21.15.103:0/2001207838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d71d5a0 msgr2=0x55a41d76df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 --2- 172.21.15.103:0/2001207838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d71d5a0 0x55a41d76df60 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fcad001d740 tx=0x7fcad00fa760 comp rx=0 tx=0).stop 2024-09-10T22:46:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 -- 172.21.15.103:0/2001207838 shutdown_connections 2024-09-10T22:46:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 --2- 172.21.15.103:0/2001207838 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55a41d775df0 0x55a41d7781e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 --2- 172.21.15.103:0/2001207838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d7673d0 0x55a41d76e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 --2- 172.21.15.103:0/2001207838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d71d5a0 0x55a41d76df60 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 --2- 172.21.15.103:0/2001207838 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d6051d0 0x55a41d76da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 -- 172.21.15.103:0/2001207838 >> 172.21.15.103:0/2001207838 conn(0x55a41d226880 msgr2=0x55a41d71c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcacaa00640 0 client.8721 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 -- 172.21.15.103:0/2001207838 shutdown_connections 2024-09-10T22:46:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 1 -- 172.21.15.103:0/2001207838 wait complete. 2024-09-10T22:46:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.516+0000 7fcaefa81000 20 client.8721 trim_cache size 0 max 16384 2024-09-10T22:46:07.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcaefa81000 1 Processor -- start 2024-09-10T22:46:07.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcaefa81000 1 -- start start 2024-09-10T22:46:07.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcaefa81000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d6051d0 0x55a41d71c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcaefa81000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d71d5a0 0x55a41d71cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcaefa81000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d7673d0 0x55a41d7791f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcaefa81000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcae4201500 con 0x55a41d71d5a0 2024-09-10T22:46:07.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcaefa81000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcae42006a0 con 0x55a41d6051d0 2024-09-10T22:46:07.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcaefa81000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcae4200dd0 con 0x55a41d7673d0 2024-09-10T22:46:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcae9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d71d5a0 0x55a41d71cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcae9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d71d5a0 0x55a41d71cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58052/0 (socket says 172.21.15.103:58052) 2024-09-10T22:46:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcae9200640 1 -- 172.21.15.103:0/3650733409 learned_addr learned my addr 172.21.15.103:0/3650733409 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcae9200640 1 -- 172.21.15.103:0/3650733409 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d7673d0 msgr2=0x55a41d7791f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcaea600640 1 --2- 172.21.15.103:0/3650733409 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d7673d0 0x55a41d7791f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcae9c00640 1 --2- 172.21.15.103:0/3650733409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d6051d0 0x55a41d71c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcae9200640 1 --2- 172.21.15.103:0/3650733409 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d7673d0 0x55a41d7791f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcae9200640 1 -- 172.21.15.103:0/3650733409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d6051d0 msgr2=0x55a41d71c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcae9200640 1 --2- 172.21.15.103:0/3650733409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d6051d0 0x55a41d71c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcae9200640 1 -- 172.21.15.103:0/3650733409 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a41d5c4ae0 con 0x55a41d71d5a0 2024-09-10T22:46:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcaea600640 1 --2- 172.21.15.103:0/3650733409 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d7673d0 0x55a41d7791f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcae9c00640 1 --2- 172.21.15.103:0/3650733409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d6051d0 0x55a41d71c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcae9200640 1 --2- 172.21.15.103:0/3650733409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d71d5a0 0x55a41d71cad0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fcad009b980 tx=0x7fcad00a8ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f851089f3ee2a58 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcad5600640 1 -- 172.21.15.103:0/3650733409 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad00c1040 con 0x55a41d71d5a0 2024-09-10T22:46:07.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcad5600640 1 -- 172.21.15.103:0/3650733409 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcad0130020 con 0x55a41d71d5a0 2024-09-10T22:46:07.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcad5600640 1 -- 172.21.15.103:0/3650733409 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad01044f0 con 0x55a41d71d5a0 2024-09-10T22:46:07.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcaefa81000 1 -- 172.21.15.103:0/3650733409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d71d5a0 msgr2=0x55a41d71cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcaefa81000 1 --2- 172.21.15.103:0/3650733409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d71d5a0 0x55a41d71cad0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fcad009b980 tx=0x7fcad00a8ae0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcaefa81000 1 -- 172.21.15.103:0/3650733409 shutdown_connections 2024-09-10T22:46:07.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcaefa81000 1 --2- 172.21.15.103:0/3650733409 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d7673d0 0x55a41d7791f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcaefa81000 1 --2- 172.21.15.103:0/3650733409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d71d5a0 0x55a41d71cad0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcaefa81000 1 --2- 172.21.15.103:0/3650733409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d6051d0 0x55a41d71c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.536+0000 7fcaefa81000 1 -- 172.21.15.103:0/3650733409 >> 172.21.15.103:0/3650733409 conn(0x55a41d226880 msgr2=0x55a41d71be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 1 -- 172.21.15.103:0/3650733409 shutdown_connections 2024-09-10T22:46:07.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 1 -- 172.21.15.103:0/3650733409 wait complete. 2024-09-10T22:46:07.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 1 -- start start 2024-09-10T22:46:07.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 1 Processor -- start 2024-09-10T22:46:07.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d6051d0 0x55a41d7dcf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d71d5a0 0x55a41d7dd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d7673d0 0x55a41d7dd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a41d513020 con 0x55a41d6051d0 2024-09-10T22:46:07.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcae406edb0 con 0x55a41d71d5a0 2024-09-10T22:46:07.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a41d52e2c0 con 0x55a41d7673d0 2024-09-10T22:46:07.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 10 client.0 _ll_register_callbacks cb 0x7fcad00f6e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:07.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcae9c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d6051d0 0x55a41d7dcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcae9c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d6051d0 0x55a41d7dcf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58056/0 (socket says 172.21.15.103:58056) 2024-09-10T22:46:07.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcae9c00640 1 -- 172.21.15.103:0/3100877217 learned_addr learned my addr 172.21.15.103:0/3100877217 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:07.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaea600640 1 --2- 172.21.15.103:0/3100877217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d7673d0 0x55a41d7dd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcae9200640 1 --2- 172.21.15.103:0/3100877217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d71d5a0 0x55a41d7dd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcae9c00640 1 -- 172.21.15.103:0/3100877217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d7673d0 msgr2=0x55a41d7dd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcae9c00640 1 --2- 172.21.15.103:0/3100877217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d7673d0 0x55a41d7dd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcae9c00640 1 -- 172.21.15.103:0/3100877217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d71d5a0 msgr2=0x55a41d7dd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcae9c00640 1 --2- 172.21.15.103:0/3100877217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d71d5a0 0x55a41d7dd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcae9c00640 1 -- 172.21.15.103:0/3100877217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a41d532040 con 0x55a41d6051d0 2024-09-10T22:46:07.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcae9c00640 1 --2- 172.21.15.103:0/3100877217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d6051d0 0x55a41d7dcf50 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fcad8021000 tx=0x7fcad8005fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bcb929f94e154f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcacaa00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:07.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcacaa00640 1 -- 172.21.15.103:0/3100877217 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8015040 con 0x55a41d6051d0 2024-09-10T22:46:07.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcacaa00640 1 -- 172.21.15.103:0/3100877217 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fcad8028220 con 0x55a41d6051d0 2024-09-10T22:46:07.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 1 -- 172.21.15.103:0/3100877217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a41d576590 con 0x55a41d6051d0 2024-09-10T22:46:07.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcacaa00640 1 -- 172.21.15.103:0/3100877217 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7fcad8042050 con 0x55a41d6051d0 2024-09-10T22:46:07.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 10 client.8727 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:07.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 1 -- 172.21.15.103:0/3100877217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55a41d4fe620 con 0x55a41d6051d0 2024-09-10T22:46:07.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcacaa00640 1 -- 172.21.15.103:0/3100877217 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a41d576590 con 0x55a41d6051d0 2024-09-10T22:46:07.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcacaa00640 1 -- 172.21.15.103:0/3100877217 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7fcad8045020 con 0x55a41d6051d0 2024-09-10T22:46:07.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 10 client.8727 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:07.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 10 client.8727 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T22:46:07.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 20 client.8727 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:07.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 1 --2- 172.21.15.103:0/3100877217 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55a41d77c6e0 0x55a41d77caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 4 client.8727 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-10T22:46:07.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcaefa81000 1 -- 172.21.15.103:0/3100877217 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55a41d5739c0 con 0x55a41d77c6e0 2024-09-10T22:46:07.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.540+0000 7fcae9200640 1 --2- 172.21.15.103:0/3100877217 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55a41d77c6e0 0x55a41d77caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcae9200640 1 --2- 172.21.15.103:0/3100877217 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55a41d77c6e0 0x55a41d77caf0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0b33fcb2d7803b5 server_cookie=fc3b40a2bb37ecfb in_seq=0 out_seq=0 2024-09-10T22:46:07.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcacaa00640 10 client.8727 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:07.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcacaa00640 1 -- 172.21.15.103:0/3100877217 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a41d5739c0 con 0x55a41d77c6e0 2024-09-10T22:46:07.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcacaa00640 10 client.8727 handle_command_reply: tid=0 2024-09-10T22:46:07.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaefa81000 1 client.8727 shutdown 2024-09-10T22:46:07.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaefa81000 1 -- 172.21.15.103:0/3100877217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d6051d0 msgr2=0x55a41d7dcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaefa81000 1 --2- 172.21.15.103:0/3100877217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d6051d0 0x55a41d7dcf50 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fcad8021000 tx=0x7fcad8005fc0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaefa81000 1 -- 172.21.15.103:0/3100877217 shutdown_connections 2024-09-10T22:46:07.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaefa81000 1 --2- 172.21.15.103:0/3100877217 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55a41d77c6e0 0x55a41d77caf0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaefa81000 1 --2- 172.21.15.103:0/3100877217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a41d7673d0 0x55a41d7dd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaefa81000 1 --2- 172.21.15.103:0/3100877217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a41d71d5a0 0x55a41d7dd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcacaa00640 0 client.8727 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:07.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaefa81000 1 --2- 172.21.15.103:0/3100877217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a41d6051d0 0x55a41d7dcf50 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaefa81000 1 -- 172.21.15.103:0/3100877217 >> 172.21.15.103:0/3100877217 conn(0x55a41d226880 msgr2=0x55a41d71c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaefa81000 1 -- 172.21.15.103:0/3100877217 shutdown_connections 2024-09-10T22:46:07.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaefa81000 1 -- 172.21.15.103:0/3100877217 wait complete. 2024-09-10T22:46:07.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaefa81000 20 client.8727 trim_cache size 0 max 16384 2024-09-10T22:46:07.549 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:07.549 INFO:teuthology.orchestra.run.smithi103.stdout: "message": "", 2024-09-10T22:46:07.549 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:46:07.549 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:07.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaeb000640 1 -- 172.21.15.103:0/3096013518 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcac40725e0 msgr2=0x7fcac4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaeb000640 1 --2- 172.21.15.103:0/3096013518 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcac40725e0 0x7fcac4074aa0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcad80058d0 tx=0x7fcad8005860 comp rx=0 tx=0).stop 2024-09-10T22:46:07.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaeb000640 1 -- 172.21.15.103:0/3096013518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae415eeb0 msgr2=0x7fcae40c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaeb000640 1 --2- 172.21.15.103:0/3096013518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae415eeb0 0x7fcae40c6050 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fcad00b3040 tx=0x7fcad0005e00 comp rx=0 tx=0).stop 2024-09-10T22:46:07.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaeb000640 1 -- 172.21.15.103:0/3096013518 shutdown_connections 2024-09-10T22:46:07.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaeb000640 1 --2- 172.21.15.103:0/3096013518 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fcac40725e0 0x7fcac4074aa0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaeb000640 1 --2- 172.21.15.103:0/3096013518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcae415f290 0x7fcae40c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaeb000640 1 --2- 172.21.15.103:0/3096013518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae415eeb0 0x7fcae40c6050 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaeb000640 1 --2- 172.21.15.103:0/3096013518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcae40cfeb0 0x7fcae415a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaeb000640 1 -- 172.21.15.103:0/3096013518 >> 172.21.15.103:0/3096013518 conn(0x7fcae40d1870 msgr2=0x7fcae40b66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaeb000640 1 -- 172.21.15.103:0/3096013518 shutdown_connections 2024-09-10T22:46:07.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.544+0000 7fcaeb000640 1 -- 172.21.15.103:0/3096013518 wait complete. 2024-09-10T22:46:07.563 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:46:07.563 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:1 scrub status 2024-09-10T22:46:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.704+0000 7f1b75e00640 1 -- 172.21.15.103:0/1925352822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b700ae8c0 msgr2=0x7f1b7006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.704+0000 7f1b75e00640 1 --2- 172.21.15.103:0/1925352822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b700ae8c0 0x7f1b7006e410 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f1b68009c80 tx=0x7f1b6801cc80 comp rx=0 tx=0).stop 2024-09-10T22:46:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.704+0000 7f1b75e00640 1 -- 172.21.15.103:0/1925352822 shutdown_connections 2024-09-10T22:46:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.704+0000 7f1b75e00640 1 --2- 172.21.15.103:0/1925352822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b700ae8c0 0x7f1b7006e410 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.704+0000 7f1b75e00640 1 --2- 172.21.15.103:0/1925352822 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b70074190 0x7f1b700b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.704+0000 7f1b75e00640 1 -- 172.21.15.103:0/1925352822 >> 172.21.15.103:0/1925352822 conn(0x7f1b700b1490 msgr2=0x7f1b700b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.704+0000 7f1b75e00640 1 -- 172.21.15.103:0/1925352822 shutdown_connections 2024-09-10T22:46:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.704+0000 7f1b75e00640 1 -- 172.21.15.103:0/1925352822 wait complete. 2024-09-10T22:46:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75e00640 1 Processor -- start 2024-09-10T22:46:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75e00640 1 -- start start 2024-09-10T22:46:07.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b70074190 0x7f1b7015c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b700ae8c0 0x7f1b701511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b7015b750 0x7f1b701550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1b70168970 con 0x7f1b7015b750 2024-09-10T22:46:07.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1b701687f0 con 0x7f1b700ae8c0 2024-09-10T22:46:07.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1b70168af0 con 0x7f1b70074190 2024-09-10T22:46:07.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b7015b750 0x7f1b701550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b7015b750 0x7f1b701550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58084/0 (socket says 172.21.15.103:58084) 2024-09-10T22:46:07.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75400640 1 -- 172.21.15.103:0/155363200 learned_addr learned my addr 172.21.15.103:0/155363200 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:07.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b6fe00640 1 --2- 172.21.15.103:0/155363200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b700ae8c0 0x7f1b701511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b74a00640 1 --2- 172.21.15.103:0/155363200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b70074190 0x7f1b7015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75400640 1 -- 172.21.15.103:0/155363200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b70074190 msgr2=0x7f1b7015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75400640 1 --2- 172.21.15.103:0/155363200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b70074190 0x7f1b7015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75400640 1 -- 172.21.15.103:0/155363200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b700ae8c0 msgr2=0x7f1b701511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75400640 1 --2- 172.21.15.103:0/155363200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b700ae8c0 0x7f1b701511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75400640 1 -- 172.21.15.103:0/155363200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7015cd10 con 0x7f1b7015b750 2024-09-10T22:46:07.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b6fe00640 1 --2- 172.21.15.103:0/155363200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b700ae8c0 0x7f1b701511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:07.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b74a00640 1 --2- 172.21.15.103:0/155363200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b70074190 0x7f1b7015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:07.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75400640 1 --2- 172.21.15.103:0/155363200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b7015b750 0x7f1b701550c0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f1b68009bd0 tx=0x7f1b68009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b6cc00640 1 -- 172.21.15.103:0/155363200 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b680bb070 con 0x7f1b7015b750 2024-09-10T22:46:07.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b6cc00640 1 -- 172.21.15.103:0/155363200 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b68004e00 con 0x7f1b7015b750 2024-09-10T22:46:07.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b6cc00640 1 -- 172.21.15.103:0/155363200 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b680b2040 con 0x7f1b7015b750 2024-09-10T22:46:07.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75e00640 1 -- 172.21.15.103:0/155363200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b701f7a40 con 0x7f1b7015b750 2024-09-10T22:46:07.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.708+0000 7f1b75e00640 1 -- 172.21.15.103:0/155363200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b7015be70 con 0x7f1b7015b750 2024-09-10T22:46:07.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.712+0000 7f1b6cc00640 1 -- 172.21.15.103:0/155363200 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1b680b5030 con 0x7f1b7015b750 2024-09-10T22:46:07.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.712+0000 7f1b6cc00640 1 --2- 172.21.15.103:0/155363200 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1b500725e0 0x7f1b50074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.712+0000 7f1b7a7d5000 1 Processor -- start 2024-09-10T22:46:07.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.712+0000 7f1b6cc00640 1 -- 172.21.15.103:0/155363200 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f1b6812d0b0 con 0x7f1b7015b750 2024-09-10T22:46:07.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.712+0000 7f1b7a7d5000 1 -- start start 2024-09-10T22:46:07.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.712+0000 7f1b74a00640 1 --2- 172.21.15.103:0/155363200 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1b500725e0 0x7f1b50074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.712+0000 7f1b7a7d5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b8be1a0 0x560a1b8be580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8beac0 0x560a1b874680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b874bc0 0x560a1b874fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560a1b75ccb0 con 0x560a1b8beac0 2024-09-10T22:46:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560a1b672310 con 0x560a1b8be1a0 2024-09-10T22:46:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560a1b6cfb90 con 0x560a1b874bc0 2024-09-10T22:46:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b74a00640 1 --2- 172.21.15.103:0/155363200 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1b500725e0 0x7f1b50074aa0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1b701664f0 tx=0x7f1b64009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b6fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8beac0 0x560a1b874680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b6fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8beac0 0x560a1b874680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58086/0 (socket says 172.21.15.103:58086) 2024-09-10T22:46:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b6fe00640 1 -- 172.21.15.103:0/821821851 learned_addr learned my addr 172.21.15.103:0/821821851 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b74a00640 1 --2- 172.21.15.103:0/821821851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b8be1a0 0x560a1b8be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b75400640 1 --2- 172.21.15.103:0/821821851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b874bc0 0x560a1b874fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b6fe00640 1 -- 172.21.15.103:0/821821851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b874bc0 msgr2=0x560a1b874fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b6fe00640 1 --2- 172.21.15.103:0/821821851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b874bc0 0x560a1b874fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b6fe00640 1 -- 172.21.15.103:0/821821851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b8be1a0 msgr2=0x560a1b8be580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b6fe00640 1 --2- 172.21.15.103:0/821821851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b8be1a0 0x560a1b8be580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b6fe00640 1 -- 172.21.15.103:0/821821851 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a1b673c60 con 0x560a1b8beac0 2024-09-10T22:46:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b75400640 1 --2- 172.21.15.103:0/821821851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b874bc0 0x560a1b874fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b6fe00640 1 --2- 172.21.15.103:0/821821851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8beac0 0x560a1b874680 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00bcf0 tx=0x7f1b5c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861326608e2ece77 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b61600640 1 -- 172.21.15.103:0/821821851 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c015070 con 0x560a1b8beac0 2024-09-10T22:46:07.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b61600640 1 -- 172.21.15.103:0/821821851 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b5c005020 con 0x560a1b8beac0 2024-09-10T22:46:07.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b61600640 1 -- 172.21.15.103:0/821821851 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c005430 con 0x560a1b8beac0 2024-09-10T22:46:07.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/821821851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8beac0 msgr2=0x560a1b874680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/821821851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8beac0 0x560a1b874680 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00bcf0 tx=0x7f1b5c00f730 comp rx=0 tx=0).stop 2024-09-10T22:46:07.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/821821851 shutdown_connections 2024-09-10T22:46:07.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/821821851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b874bc0 0x560a1b874fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/821821851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8beac0 0x560a1b874680 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/821821851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b8be1a0 0x560a1b8be580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/821821851 >> 172.21.15.103:0/821821851 conn(0x560a1b87ad20 msgr2=0x560a1b872f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/821821851 shutdown_connections 2024-09-10T22:46:07.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/821821851 wait complete. 2024-09-10T22:46:07.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 -- start start 2024-09-10T22:46:07.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 Processor -- start 2024-09-10T22:46:07.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b874bc0 0x560a1b8c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8be1a0 0x560a1b8c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b8beac0 0x560a1b8c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560a1b6c2dd0 con 0x560a1b8be1a0 2024-09-10T22:46:07.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560a1b6befc0 con 0x560a1b874bc0 2024-09-10T22:46:07.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560a1b6644b0 con 0x560a1b8beac0 2024-09-10T22:46:07.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.716+0000 7f1b7a7d5000 10 client.0 _ll_register_callbacks cb 0x560a1b6427d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:07.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b6fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8be1a0 0x560a1b8c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b6fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8be1a0 0x560a1b8c5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58098/0 (socket says 172.21.15.103:58098) 2024-09-10T22:46:07.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b6fe00640 1 -- 172.21.15.103:0/2100543223 learned_addr learned my addr 172.21.15.103:0/2100543223 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:07.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b75400640 1 --2- 172.21.15.103:0/2100543223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b8beac0 0x560a1b8c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b74a00640 1 --2- 172.21.15.103:0/2100543223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b874bc0 0x560a1b8c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b6fe00640 1 -- 172.21.15.103:0/2100543223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b8beac0 msgr2=0x560a1b8c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b6fe00640 1 --2- 172.21.15.103:0/2100543223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b8beac0 0x560a1b8c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b6fe00640 1 -- 172.21.15.103:0/2100543223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b874bc0 msgr2=0x560a1b8c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b6fe00640 1 --2- 172.21.15.103:0/2100543223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b874bc0 0x560a1b8c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b6fe00640 1 -- 172.21.15.103:0/2100543223 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a1b65d1f0 con 0x560a1b8be1a0 2024-09-10T22:46:07.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b74a00640 1 --2- 172.21.15.103:0/2100543223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b874bc0 0x560a1b8c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:07.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b6fe00640 1 --2- 172.21.15.103:0/2100543223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8be1a0 0x560a1b8c5a70 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x560a1b6ca5e0 tx=0x7f1b5c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd261b886d478bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b56000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:07.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b56000640 1 -- 172.21.15.103:0/2100543223 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c015070 con 0x560a1b8be1a0 2024-09-10T22:46:07.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/2100543223 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560a1b657330 con 0x560a1b8be1a0 2024-09-10T22:46:07.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b56000640 1 -- 172.21.15.103:0/2100543223 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f1b5c003600 con 0x560a1b8be1a0 2024-09-10T22:46:07.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b56000640 1 -- 172.21.15.103:0/2100543223 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f1b5c029050 con 0x560a1b8be1a0 2024-09-10T22:46:07.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 10 client.8739 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:07.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/2100543223 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x560a1b643fa0 con 0x560a1b8be1a0 2024-09-10T22:46:07.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b56000640 1 -- 172.21.15.103:0/2100543223 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560a1b657330 con 0x560a1b8be1a0 2024-09-10T22:46:07.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b56000640 1 -- 172.21.15.103:0/2100543223 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7f1b5c02c020 con 0x560a1b8be1a0 2024-09-10T22:46:07.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 10 client.8739 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:07.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 10 client.8739 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-10T22:46:07.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 20 client.8739 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:07.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/2100543223 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x560a1b8cd900 0x560a1b8cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 4 client.8739 mds_command: new command op to 8235 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:46:07.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/2100543223 --> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a1b6d1ae0 con 0x560a1b8cd900 2024-09-10T22:46:07.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b74a00640 1 --2- 172.21.15.103:0/2100543223 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x560a1b8cd900 0x560a1b8cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b56000640 10 client.8739 ms_handle_connect on v2:172.21.15.103:6832/1191295180 2024-09-10T22:46:07.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b74a00640 1 --2- 172.21.15.103:0/2100543223 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x560a1b8cd900 0x560a1b8cfcf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ac815b308f10eba8 server_cookie=4d8f7cad584828cf in_seq=0 out_seq=0 2024-09-10T22:46:07.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b56000640 1 -- 172.21.15.103:0/2100543223 <== mds.1 v2:172.21.15.103:6832/1191295180 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560a1b6d1ae0 con 0x560a1b8cd900 2024-09-10T22:46:07.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b56000640 10 client.8739 handle_command_reply: tid=0 2024-09-10T22:46:07.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 1 client.8739 shutdown 2024-09-10T22:46:07.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/2100543223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8be1a0 msgr2=0x560a1b8c5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/2100543223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8be1a0 0x560a1b8c5a70 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x560a1b6ca5e0 tx=0x7f1b5c004040 comp rx=0 tx=0).stop 2024-09-10T22:46:07.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/2100543223 shutdown_connections 2024-09-10T22:46:07.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/2100543223 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x560a1b8cd900 0x560a1b8cfcf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/2100543223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b8beac0 0x560a1b8c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/2100543223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8be1a0 0x560a1b8c5a70 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/2100543223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b874bc0 0x560a1b8c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b56000640 0 client.8739 ms_handle_reset on v2:172.21.15.103:6832/1191295180 2024-09-10T22:46:07.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/2100543223 >> 172.21.15.103:0/2100543223 conn(0x560a1b87ad20 msgr2=0x560a1b872f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/2100543223 shutdown_connections 2024-09-10T22:46:07.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/2100543223 wait complete. 2024-09-10T22:46:07.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.720+0000 7f1b7a7d5000 20 client.8739 trim_cache size 0 max 16384 2024-09-10T22:46:07.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b7a7d5000 1 Processor -- start 2024-09-10T22:46:07.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b7a7d5000 1 -- start start 2024-09-10T22:46:07.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b7a7d5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b874bc0 0x560a1b8c8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b7a7d5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8be1a0 0x560a1b8c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b7a7d5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b8beac0 0x560a1b8c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b7a7d5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1b702042e0 con 0x560a1b8be1a0 2024-09-10T22:46:07.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b7a7d5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1b70203480 con 0x560a1b8beac0 2024-09-10T22:46:07.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b7a7d5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1b70203bb0 con 0x560a1b874bc0 2024-09-10T22:46:07.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b6fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8be1a0 0x560a1b8c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b6fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8be1a0 0x560a1b8c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58106/0 (socket says 172.21.15.103:58106) 2024-09-10T22:46:07.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b6fe00640 1 -- 172.21.15.103:0/3195133515 learned_addr learned my addr 172.21.15.103:0/3195133515 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b6fe00640 1 -- 172.21.15.103:0/3195133515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b874bc0 msgr2=0x560a1b8c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b74a00640 1 --2- 172.21.15.103:0/3195133515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b874bc0 0x560a1b8c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b75400640 1 --2- 172.21.15.103:0/3195133515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b8beac0 0x560a1b8c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b6fe00640 1 --2- 172.21.15.103:0/3195133515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b874bc0 0x560a1b8c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b6fe00640 1 -- 172.21.15.103:0/3195133515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b8beac0 msgr2=0x560a1b8c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b6fe00640 1 --2- 172.21.15.103:0/3195133515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b8beac0 0x560a1b8c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b6fe00640 1 -- 172.21.15.103:0/3195133515 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a1b71c660 con 0x560a1b8be1a0 2024-09-10T22:46:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b74a00640 1 --2- 172.21.15.103:0/3195133515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b874bc0 0x560a1b8c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b6fe00640 1 --2- 172.21.15.103:0/3195133515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8be1a0 0x560a1b8c8a90 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00b630 tx=0x7f1b5c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7d2a7886ed55a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b60c00640 1 -- 172.21.15.103:0/3195133515 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c015070 con 0x560a1b8be1a0 2024-09-10T22:46:07.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b60c00640 1 -- 172.21.15.103:0/3195133515 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b5c000e50 con 0x560a1b8be1a0 2024-09-10T22:46:07.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.740+0000 7f1b60c00640 1 -- 172.21.15.103:0/3195133515 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c01a480 con 0x560a1b8be1a0 2024-09-10T22:46:07.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/3195133515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8be1a0 msgr2=0x560a1b8c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/3195133515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8be1a0 0x560a1b8c8a90 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00b630 tx=0x7f1b5c00f730 comp rx=0 tx=0).stop 2024-09-10T22:46:07.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/3195133515 shutdown_connections 2024-09-10T22:46:07.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/3195133515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b8beac0 0x560a1b8c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/3195133515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b8be1a0 0x560a1b8c8a90 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/3195133515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b874bc0 0x560a1b8c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/3195133515 >> 172.21.15.103:0/3195133515 conn(0x560a1b87ad20 msgr2=0x560a1b874fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/3195133515 shutdown_connections 2024-09-10T22:46:07.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/3195133515 wait complete. 2024-09-10T22:46:07.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 -- start start 2024-09-10T22:46:07.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 Processor -- start 2024-09-10T22:46:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b874bc0 0x560a1b8cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b8be1a0 0x560a1b8cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b8beac0 0x560a1b8f0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560a1b6c2dd0 con 0x560a1b874bc0 2024-09-10T22:46:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x560a1b87dd40 con 0x560a1b8be1a0 2024-09-10T22:46:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x560a1b87b100 con 0x560a1b8beac0 2024-09-10T22:46:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 10 client.0 _ll_register_callbacks cb 0x7f1b5c00bb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b74a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b874bc0 0x560a1b8cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b74a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b874bc0 0x560a1b8cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58120/0 (socket says 172.21.15.103:58120) 2024-09-10T22:46:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b74a00640 1 -- 172.21.15.103:0/3321112209 learned_addr learned my addr 172.21.15.103:0/3321112209 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b75400640 1 --2- 172.21.15.103:0/3321112209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b8beac0 0x560a1b8f0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b6fe00640 1 --2- 172.21.15.103:0/3321112209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b8be1a0 0x560a1b8cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b74a00640 1 -- 172.21.15.103:0/3321112209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b8beac0 msgr2=0x560a1b8f0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b74a00640 1 --2- 172.21.15.103:0/3321112209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b8beac0 0x560a1b8f0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b74a00640 1 -- 172.21.15.103:0/3321112209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b8be1a0 msgr2=0x560a1b8cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b74a00640 1 --2- 172.21.15.103:0/3321112209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b8be1a0 0x560a1b8cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b74a00640 1 -- 172.21.15.103:0/3321112209 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a1b689090 con 0x560a1b874bc0 2024-09-10T22:46:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b74a00640 1 --2- 172.21.15.103:0/3321112209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b874bc0 0x560a1b8cb100 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f1b640051f0 tx=0x7f1b64000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ba7ede62d646c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b56000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b56000640 1 -- 172.21.15.103:0/3321112209 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64030060 con 0x560a1b874bc0 2024-09-10T22:46:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b56000640 1 -- 172.21.15.103:0/3321112209 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f1b64010040 con 0x560a1b874bc0 2024-09-10T22:46:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/3321112209 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b5c000e50 con 0x560a1b874bc0 2024-09-10T22:46:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b56000640 1 -- 172.21.15.103:0/3321112209 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f1b64003810 con 0x560a1b874bc0 2024-09-10T22:46:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 10 client.8745 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.744+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/3321112209 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x560a1b6555f0 con 0x560a1b874bc0 2024-09-10T22:46:07.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b56000640 1 -- 172.21.15.103:0/3321112209 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b5c000e50 con 0x560a1b874bc0 2024-09-10T22:46:07.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b56000640 1 -- 172.21.15.103:0/3321112209 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7f1b64029040 con 0x560a1b874bc0 2024-09-10T22:46:07.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b7a7d5000 10 client.8745 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:07.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b7a7d5000 10 client.8745 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-10T22:46:07.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b7a7d5000 20 client.8745 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:07.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/3321112209 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x560a1b8f0c00 0x560a1b933a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b7a7d5000 4 client.8745 mds_command: new command op to 8235 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:46:07.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/3321112209 --> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560a1b6cd590 con 0x560a1b8f0c00 2024-09-10T22:46:07.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b6fe00640 1 --2- 172.21.15.103:0/3321112209 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x560a1b8f0c00 0x560a1b933a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b6fe00640 1 --2- 172.21.15.103:0/3321112209 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x560a1b8f0c00 0x560a1b933a60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7ccd70af340e297e server_cookie=127604273a3dbe82 in_seq=0 out_seq=0 2024-09-10T22:46:07.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b56000640 10 client.8745 ms_handle_connect on v2:172.21.15.103:6832/1191295180 2024-09-10T22:46:07.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b56000640 1 -- 172.21.15.103:0/3321112209 <== mds.1 v2:172.21.15.103:6832/1191295180 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x560a1b6cd590 con 0x560a1b8f0c00 2024-09-10T22:46:07.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b56000640 10 client.8745 handle_command_reply: tid=0 2024-09-10T22:46:07.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b7a7d5000 1 client.8745 shutdown 2024-09-10T22:46:07.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/3321112209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b874bc0 msgr2=0x560a1b8cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/3321112209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b874bc0 0x560a1b8cb100 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f1b640051f0 tx=0x7f1b64000bd0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/3321112209 shutdown_connections 2024-09-10T22:46:07.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/3321112209 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x560a1b8f0c00 0x560a1b933a60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/3321112209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560a1b8beac0 0x560a1b8f0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/3321112209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1b8be1a0 0x560a1b8cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b56000640 0 client.8745 ms_handle_reset on v2:172.21.15.103:6832/1191295180 2024-09-10T22:46:07.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b7a7d5000 1 --2- 172.21.15.103:0/3321112209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560a1b874bc0 0x560a1b8cb100 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/3321112209 >> 172.21.15.103:0/3321112209 conn(0x560a1b87ad20 msgr2=0x560a1b874070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/3321112209 shutdown_connections 2024-09-10T22:46:07.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b7a7d5000 1 -- 172.21.15.103:0/3321112209 wait complete. 2024-09-10T22:46:07.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b7a7d5000 20 client.8745 trim_cache size 0 max 16384 2024-09-10T22:46:07.753 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:07.753 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-10T22:46:07.753 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:46:07.753 INFO:teuthology.orchestra.run.smithi103.stdout: "13d979f1-0660-40c8-9ef3-e228e32f6cb4": { 2024-09-10T22:46:07.753 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:46:07.753 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "13d979f1-0660-40c8-9ef3-e228e32f6cb4", 2024-09-10T22:46:07.753 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:46:07.753 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:46:07.753 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:46:07.753 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:07.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b75e00640 1 -- 172.21.15.103:0/155363200 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1b500725e0 msgr2=0x7f1b50074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b75e00640 1 --2- 172.21.15.103:0/155363200 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1b500725e0 0x7f1b50074aa0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1b701664f0 tx=0x7f1b64009040 comp rx=0 tx=0).stop 2024-09-10T22:46:07.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b75e00640 1 -- 172.21.15.103:0/155363200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b7015b750 msgr2=0x7f1b701550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b75e00640 1 --2- 172.21.15.103:0/155363200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b7015b750 0x7f1b701550c0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f1b68009bd0 tx=0x7f1b68009390 comp rx=0 tx=0).stop 2024-09-10T22:46:07.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b75e00640 1 -- 172.21.15.103:0/155363200 shutdown_connections 2024-09-10T22:46:07.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b75e00640 1 --2- 172.21.15.103:0/155363200 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1b500725e0 0x7f1b50074aa0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b75e00640 1 --2- 172.21.15.103:0/155363200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b7015b750 0x7f1b701550c0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b75e00640 1 --2- 172.21.15.103:0/155363200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b700ae8c0 0x7f1b701511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b75e00640 1 --2- 172.21.15.103:0/155363200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b70074190 0x7f1b7015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b75e00640 1 -- 172.21.15.103:0/155363200 >> 172.21.15.103:0/155363200 conn(0x7f1b700b1490 msgr2=0x7f1b700ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b75e00640 1 -- 172.21.15.103:0/155363200 shutdown_connections 2024-09-10T22:46:07.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.748+0000 7f1b75e00640 1 -- 172.21.15.103:0/155363200 wait complete. 2024-09-10T22:46:07.768 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:46:07.768 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:46:07.768 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:2 scrub status 2024-09-10T22:46:07.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.912+0000 7f24c9000640 1 -- 172.21.15.103:0/2319863900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24c40cf260 msgr2=0x7f24c40b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.912+0000 7f24c9000640 1 --2- 172.21.15.103:0/2319863900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24c40cf260 0x7f24c40b2c10 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f24c4074960 tx=0x7f24b401c8c0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.912+0000 7f24c9000640 1 -- 172.21.15.103:0/2319863900 shutdown_connections 2024-09-10T22:46:07.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.912+0000 7f24c9000640 1 --2- 172.21.15.103:0/2319863900 >> v2:172.21.15.131:3300/0 conn(0x7f24c4072c10 0x7f24c4157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.912+0000 7f24c9000640 1 --2- 172.21.15.103:0/2319863900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24c40cf260 0x7f24c40b2c10 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.912+0000 7f24c9000640 1 -- 172.21.15.103:0/2319863900 >> 172.21.15.103:0/2319863900 conn(0x7f24c406cc00 msgr2=0x7f24c406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.912+0000 7f24c9000640 1 -- 172.21.15.103:0/2319863900 shutdown_connections 2024-09-10T22:46:07.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.912+0000 7f24c9000640 1 -- 172.21.15.103:0/2319863900 wait complete. 2024-09-10T22:46:07.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.912+0000 7f24c9000640 1 Processor -- start 2024-09-10T22:46:07.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.912+0000 7f24c9000640 1 -- start start 2024-09-10T22:46:07.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.912+0000 7f24c9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24c4072c10 0x7f24c4138130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.912+0000 7f24c9000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24c40b3150 0x7f24c41fa790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.912+0000 7f24c9000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24c40cf260 0x7f24c414d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.912+0000 7f24c9000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f24c406e800 con 0x7f24c4072c10 2024-09-10T22:46:07.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.912+0000 7f24c9000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f24c4157ed0 con 0x7f24c40cf260 2024-09-10T22:46:07.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.912+0000 7f24c9000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f24c406e980 con 0x7f24c40b3150 2024-09-10T22:46:07.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.912+0000 7f24c1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24c4072c10 0x7f24c4138130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.916+0000 7f24c1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24c4072c10 0x7f24c4138130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58140/0 (socket says 172.21.15.103:58140) 2024-09-10T22:46:07.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.916+0000 7f24c1e00640 1 -- 172.21.15.103:0/2211160474 learned_addr learned my addr 172.21.15.103:0/2211160474 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:07.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.916+0000 7f24c2800640 1 --2- 172.21.15.103:0/2211160474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24c40cf260 0x7f24c414d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.916+0000 7f24c1400640 1 --2- 172.21.15.103:0/2211160474 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24c40b3150 0x7f24c41fa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.916+0000 7f24c1e00640 1 -- 172.21.15.103:0/2211160474 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24c40b3150 msgr2=0x7f24c41fa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.916+0000 7f24c1e00640 1 --2- 172.21.15.103:0/2211160474 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24c40b3150 0x7f24c41fa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.916+0000 7f24c1e00640 1 -- 172.21.15.103:0/2211160474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24c40cf260 msgr2=0x7f24c414d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.916+0000 7f24c1e00640 1 --2- 172.21.15.103:0/2211160474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24c40cf260 0x7f24c414d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.916+0000 7f24c1e00640 1 -- 172.21.15.103:0/2211160474 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c40b0570 con 0x7f24c4072c10 2024-09-10T22:46:07.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.916+0000 7f24c1e00640 1 --2- 172.21.15.103:0/2211160474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24c4072c10 0x7f24c4138130 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f24b40b0040 tx=0x7f24b4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.916+0000 7f24ba000640 1 -- 172.21.15.103:0/2211160474 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b4004230 con 0x7f24c4072c10 2024-09-10T22:46:07.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.916+0000 7f24ba000640 1 -- 172.21.15.103:0/2211160474 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24b40044c0 con 0x7f24c4072c10 2024-09-10T22:46:07.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.916+0000 7f24ba000640 1 -- 172.21.15.103:0/2211160474 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b4005250 con 0x7f24c4072c10 2024-09-10T22:46:07.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.916+0000 7f24c9000640 1 -- 172.21.15.103:0/2211160474 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24c41fb1e0 con 0x7f24c4072c10 2024-09-10T22:46:07.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.916+0000 7f24c9000640 1 -- 172.21.15.103:0/2211160474 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24c40b0830 con 0x7f24c4072c10 2024-09-10T22:46:07.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.916+0000 7f24ba000640 1 -- 172.21.15.103:0/2211160474 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f24b40053f0 con 0x7f24c4072c10 2024-09-10T22:46:07.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24cc4e5000 1 Processor -- start 2024-09-10T22:46:07.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24ba000640 1 --2- 172.21.15.103:0/2211160474 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f24a40725e0 0x7f24a4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24ba000640 1 -- 172.21.15.103:0/2211160474 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f24b412d940 con 0x7f24c4072c10 2024-09-10T22:46:07.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24cc4e5000 1 -- start start 2024-09-10T22:46:07.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24c2800640 1 --2- 172.21.15.103:0/2211160474 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f24a40725e0 0x7f24a4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24cc4e5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4d2a1a0 0x5561d4d2a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24cc4e5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2aac0 0x5561d4ce0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24cc4e5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4ce0bc0 0x5561d4ce0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24cc4e5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5561d4bc8cb0 con 0x5561d4d2aac0 2024-09-10T22:46:07.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24cc4e5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5561d4ade310 con 0x5561d4ce0bc0 2024-09-10T22:46:07.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24cc4e5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5561d4b3bb90 con 0x5561d4d2a1a0 2024-09-10T22:46:07.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24c2800640 1 --2- 172.21.15.103:0/2211160474 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f24a40725e0 0x7f24a4074aa0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f24c4156480 tx=0x7f24bc00a660 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24c1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2aac0 0x5561d4ce0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24c1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2aac0 0x5561d4ce0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58146/0 (socket says 172.21.15.103:58146) 2024-09-10T22:46:07.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24c1400640 1 -- 172.21.15.103:0/1212641053 learned_addr learned my addr 172.21.15.103:0/1212641053 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:07.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24c1e00640 1 --2- 172.21.15.103:0/1212641053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4d2a1a0 0x5561d4d2a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24c2800640 1 --2- 172.21.15.103:0/1212641053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4ce0bc0 0x5561d4ce0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24c1400640 1 -- 172.21.15.103:0/1212641053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4d2a1a0 msgr2=0x5561d4d2a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24c1400640 1 --2- 172.21.15.103:0/1212641053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4d2a1a0 0x5561d4d2a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24c1400640 1 -- 172.21.15.103:0/1212641053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4ce0bc0 msgr2=0x5561d4ce0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24c1400640 1 --2- 172.21.15.103:0/1212641053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4ce0bc0 0x5561d4ce0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24c1400640 1 -- 172.21.15.103:0/1212641053 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561d4adfc60 con 0x5561d4d2aac0 2024-09-10T22:46:07.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24c2800640 1 --2- 172.21.15.103:0/1212641053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4ce0bc0 0x5561d4ce0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:07.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24c1400640 1 --2- 172.21.15.103:0/1212641053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2aac0 0x5561d4ce0680 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f24b0001870 tx=0x7f24b0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5888b8c48e1357b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24aea00640 1 -- 172.21.15.103:0/1212641053 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b00052e0 con 0x5561d4d2aac0 2024-09-10T22:46:07.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24aea00640 1 -- 172.21.15.103:0/1212641053 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24b0018070 con 0x5561d4d2aac0 2024-09-10T22:46:07.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24aea00640 1 -- 172.21.15.103:0/1212641053 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b000fad0 con 0x5561d4d2aac0 2024-09-10T22:46:07.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24cc4e5000 1 -- 172.21.15.103:0/1212641053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2aac0 msgr2=0x5561d4ce0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/1212641053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2aac0 0x5561d4ce0680 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f24b0001870 tx=0x7f24b0007e00 comp rx=0 tx=0).stop 2024-09-10T22:46:07.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24cc4e5000 1 -- 172.21.15.103:0/1212641053 shutdown_connections 2024-09-10T22:46:07.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/1212641053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4ce0bc0 0x5561d4ce0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/1212641053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2aac0 0x5561d4ce0680 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/1212641053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4d2a1a0 0x5561d4d2a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24cc4e5000 1 -- 172.21.15.103:0/1212641053 >> 172.21.15.103:0/1212641053 conn(0x5561d4ce6d20 msgr2=0x5561d4cdef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24cc4e5000 1 -- 172.21.15.103:0/1212641053 shutdown_connections 2024-09-10T22:46:07.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.920+0000 7f24cc4e5000 1 -- 172.21.15.103:0/1212641053 wait complete. 2024-09-10T22:46:07.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24cc4e5000 1 -- start start 2024-09-10T22:46:07.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24cc4e5000 1 Processor -- start 2024-09-10T22:46:07.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24cc4e5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4ce0bc0 0x5561d4d31530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24cc4e5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4d2a1a0 0x5561d4d31a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24cc4e5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2aac0 0x5561d4d31fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24cc4e5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5561d4b2edd0 con 0x5561d4d2aac0 2024-09-10T22:46:07.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24cc4e5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5561d4b2afc0 con 0x5561d4ce0bc0 2024-09-10T22:46:07.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24cc4e5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5561d4ad04b0 con 0x5561d4d2a1a0 2024-09-10T22:46:07.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24cc4e5000 10 client.0 _ll_register_callbacks cb 0x5561d4aae7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:07.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24c2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2aac0 0x5561d4d31fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24c1e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4ce0bc0 0x5561d4d31530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24c2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2aac0 0x5561d4d31fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58162/0 (socket says 172.21.15.103:58162) 2024-09-10T22:46:07.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24c2800640 1 -- 172.21.15.103:0/4253123263 learned_addr learned my addr 172.21.15.103:0/4253123263 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:07.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24c1400640 1 --2- 172.21.15.103:0/4253123263 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4d2a1a0 0x5561d4d31a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24c2800640 1 -- 172.21.15.103:0/4253123263 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4d2a1a0 msgr2=0x5561d4d31a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24c2800640 1 --2- 172.21.15.103:0/4253123263 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4d2a1a0 0x5561d4d31a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24c2800640 1 -- 172.21.15.103:0/4253123263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4ce0bc0 msgr2=0x5561d4d31530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24c2800640 1 --2- 172.21.15.103:0/4253123263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4ce0bc0 0x5561d4d31530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24c2800640 1 -- 172.21.15.103:0/4253123263 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561d4ac91f0 con 0x5561d4d2aac0 2024-09-10T22:46:07.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24c2800640 1 --2- 172.21.15.103:0/4253123263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2aac0 0x5561d4d31fb0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f24bc0042b0 tx=0x7f24bc004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e332b8f4a176363 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24a3400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24a3400640 1 -- 172.21.15.103:0/4253123263 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc00d940 con 0x5561d4d2aac0 2024-09-10T22:46:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24a3400640 1 -- 172.21.15.103:0/4253123263 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f24bc014070 con 0x5561d4d2aac0 2024-09-10T22:46:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24cc4e5000 1 -- 172.21.15.103:0/4253123263 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5561d4ac3330 con 0x5561d4d2aac0 2024-09-10T22:46:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24a3400640 1 -- 172.21.15.103:0/4253123263 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f24bc00dae0 con 0x5561d4d2aac0 2024-09-10T22:46:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24cc4e5000 10 client.8757 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24cc4e5000 1 -- 172.21.15.103:0/4253123263 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x5561d4aaffa0 con 0x5561d4d2aac0 2024-09-10T22:46:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24a3400640 1 -- 172.21.15.103:0/4253123263 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5561d4ac3330 con 0x5561d4d2aac0 2024-09-10T22:46:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24a3400640 1 -- 172.21.15.103:0/4253123263 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7f24bc02d050 con 0x5561d4d2aac0 2024-09-10T22:46:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24cc4e5000 10 client.8757 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24cc4e5000 10 client.8757 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2024-09-10T22:46:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24cc4e5000 20 client.8757 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/4253123263 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x5561d4d39900 0x5561d4d3bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24cc4e5000 4 client.8757 mds_command: new command op to 7717 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:46:07.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24cc4e5000 1 -- 172.21.15.103:0/4253123263 --> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561d4b3dae0 con 0x5561d4d39900 2024-09-10T22:46:07.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.924+0000 7f24c1e00640 1 --2- 172.21.15.103:0/4253123263 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x5561d4d39900 0x5561d4d3bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.928+0000 7f24c1e00640 1 --2- 172.21.15.103:0/4253123263 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x5561d4d39900 0x5561d4d3bcf0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e5581f6ce391583f server_cookie=18449d2ca043d08e in_seq=0 out_seq=0 2024-09-10T22:46:07.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.928+0000 7f24a3400640 10 client.8757 ms_handle_connect on v2:172.21.15.131:6835/1281268106 2024-09-10T22:46:07.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.928+0000 7f24a3400640 1 -- 172.21.15.103:0/4253123263 <== mds.2 v2:172.21.15.131:6835/1281268106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5561d4b3dae0 con 0x5561d4d39900 2024-09-10T22:46:07.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.928+0000 7f24a3400640 10 client.8757 handle_command_reply: tid=0 2024-09-10T22:46:07.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.928+0000 7f24cc4e5000 1 client.8757 shutdown 2024-09-10T22:46:07.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.928+0000 7f24cc4e5000 1 -- 172.21.15.103:0/4253123263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2aac0 msgr2=0x5561d4d31fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.928+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/4253123263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2aac0 0x5561d4d31fb0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f24bc0042b0 tx=0x7f24bc004a50 comp rx=0 tx=0).stop 2024-09-10T22:46:07.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.928+0000 7f24cc4e5000 1 -- 172.21.15.103:0/4253123263 shutdown_connections 2024-09-10T22:46:07.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.928+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/4253123263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2aac0 0x5561d4d31fb0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.928+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/4253123263 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x5561d4d39900 0x5561d4d3bcf0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.928+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/4253123263 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4d2a1a0 0x5561d4d31a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.928+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/4253123263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4ce0bc0 0x5561d4d31530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.928+0000 7f24a3400640 0 client.8757 ms_handle_reset on v2:172.21.15.131:6835/1281268106 2024-09-10T22:46:07.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.928+0000 7f24cc4e5000 1 -- 172.21.15.103:0/4253123263 >> 172.21.15.103:0/4253123263 conn(0x5561d4ce6d20 msgr2=0x5561d4cdef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.928+0000 7f24cc4e5000 1 -- 172.21.15.103:0/4253123263 shutdown_connections 2024-09-10T22:46:07.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.928+0000 7f24cc4e5000 1 -- 172.21.15.103:0/4253123263 wait complete. 2024-09-10T22:46:07.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.928+0000 7f24cc4e5000 20 client.8757 trim_cache size 0 max 16384 2024-09-10T22:46:07.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.944+0000 7f24cc4e5000 1 Processor -- start 2024-09-10T22:46:07.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.944+0000 7f24cc4e5000 1 -- start start 2024-09-10T22:46:07.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.944+0000 7f24cc4e5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4ce0bc0 0x5561d4d34310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2a1a0 0x5561d4d34850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4d2aac0 0x5561d4d34d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f24c4204590 con 0x5561d4d2a1a0 2024-09-10T22:46:07.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f24c4203730 con 0x5561d4d2aac0 2024-09-10T22:46:07.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f24c4203e60 con 0x5561d4ce0bc0 2024-09-10T22:46:07.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24c1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2a1a0 0x5561d4d34850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24c1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2a1a0 0x5561d4d34850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58172/0 (socket says 172.21.15.103:58172) 2024-09-10T22:46:07.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24c1400640 1 -- 172.21.15.103:0/3443788795 learned_addr learned my addr 172.21.15.103:0/3443788795 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:07.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24c1400640 1 -- 172.21.15.103:0/3443788795 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4ce0bc0 msgr2=0x5561d4d34310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24c1400640 1 --2- 172.21.15.103:0/3443788795 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4ce0bc0 0x5561d4d34310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24c1400640 1 -- 172.21.15.103:0/3443788795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4d2aac0 msgr2=0x5561d4d34d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24c1400640 1 --2- 172.21.15.103:0/3443788795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4d2aac0 0x5561d4d34d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24c1400640 1 -- 172.21.15.103:0/3443788795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561d4b88660 con 0x5561d4d2a1a0 2024-09-10T22:46:07.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24c1400640 1 --2- 172.21.15.103:0/3443788795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2a1a0 0x5561d4d34850 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x5561d4b365e0 tx=0x7f24b0001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0ec631a1b4b41d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24ae000640 1 -- 172.21.15.103:0/3443788795 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b000f870 con 0x5561d4d2a1a0 2024-09-10T22:46:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24ae000640 1 -- 172.21.15.103:0/3443788795 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24b0018040 con 0x5561d4d2a1a0 2024-09-10T22:46:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24ae000640 1 -- 172.21.15.103:0/3443788795 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b000fe00 con 0x5561d4d2a1a0 2024-09-10T22:46:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 -- 172.21.15.103:0/3443788795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2a1a0 msgr2=0x5561d4d34850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/3443788795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2a1a0 0x5561d4d34850 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x5561d4b365e0 tx=0x7f24b0001130 comp rx=0 tx=0).stop 2024-09-10T22:46:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 -- 172.21.15.103:0/3443788795 shutdown_connections 2024-09-10T22:46:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/3443788795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4d2aac0 0x5561d4d34d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/3443788795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2a1a0 0x5561d4d34850 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/3443788795 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4ce0bc0 0x5561d4d34310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 -- 172.21.15.103:0/3443788795 >> 172.21.15.103:0/3443788795 conn(0x5561d4ce6d20 msgr2=0x5561d4ce0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 -- 172.21.15.103:0/3443788795 shutdown_connections 2024-09-10T22:46:07.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 -- 172.21.15.103:0/3443788795 wait complete. 2024-09-10T22:46:07.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 -- start start 2024-09-10T22:46:07.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 Processor -- start 2024-09-10T22:46:07.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4ce0bc0 0x5561d4d37560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2a1a0 0x5561d4d37aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4d2aac0 0x5561d4d5c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5561d4ce9d40 con 0x5561d4d2a1a0 2024-09-10T22:46:07.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5561d4ce7100 con 0x5561d4d2aac0 2024-09-10T22:46:07.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5561d4b25ec0 con 0x5561d4ce0bc0 2024-09-10T22:46:07.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24cc4e5000 10 client.0 _ll_register_callbacks cb 0x7f24bc00af50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:07.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24c1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2a1a0 0x5561d4d37aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24c1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2a1a0 0x5561d4d37aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58180/0 (socket says 172.21.15.103:58180) 2024-09-10T22:46:07.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.948+0000 7f24c1400640 1 -- 172.21.15.103:0/1466073234 learned_addr learned my addr 172.21.15.103:0/1466073234 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:07.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c2800640 1 --2- 172.21.15.103:0/1466073234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4d2aac0 0x5561d4d5c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c1e00640 1 --2- 172.21.15.103:0/1466073234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4ce0bc0 0x5561d4d37560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c1400640 1 -- 172.21.15.103:0/1466073234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4ce0bc0 msgr2=0x5561d4d37560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c1400640 1 --2- 172.21.15.103:0/1466073234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4ce0bc0 0x5561d4d37560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c1400640 1 -- 172.21.15.103:0/1466073234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4d2aac0 msgr2=0x5561d4d5c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:07.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c1400640 1 --2- 172.21.15.103:0/1466073234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4d2aac0 0x5561d4d5c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c1400640 1 -- 172.21.15.103:0/1466073234 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561d4af5090 con 0x5561d4d2a1a0 2024-09-10T22:46:07.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c1400640 1 --2- 172.21.15.103:0/1466073234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2a1a0 0x5561d4d37aa0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f24b0015040 tx=0x7f24b000faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b141ec52f8ff8c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:07.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24a3400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:07.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24a3400640 1 -- 172.21.15.103:0/1466073234 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b00069e0 con 0x5561d4d2a1a0 2024-09-10T22:46:07.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24a3400640 1 -- 172.21.15.103:0/1466073234 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f24b0006b80 con 0x5561d4d2a1a0 2024-09-10T22:46:07.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 1 -- 172.21.15.103:0/1466073234 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24b0018040 con 0x5561d4d2a1a0 2024-09-10T22:46:07.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24a3400640 1 -- 172.21.15.103:0/1466073234 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f24b0006dc0 con 0x5561d4d2a1a0 2024-09-10T22:46:07.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 10 client.8763 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:07.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 1 -- 172.21.15.103:0/1466073234 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x5561d4ac15f0 con 0x5561d4d2a1a0 2024-09-10T22:46:07.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24a3400640 1 -- 172.21.15.103:0/1466073234 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24b0018040 con 0x5561d4d2a1a0 2024-09-10T22:46:07.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24a3400640 1 -- 172.21.15.103:0/1466073234 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7f24b0031030 con 0x5561d4d2a1a0 2024-09-10T22:46:07.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 10 client.8763 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:07.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 10 client.8763 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2024-09-10T22:46:07.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 20 client.8763 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:07.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/1466073234 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x5561d4d5cbd0 0x5561d4d9fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:07.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 4 client.8763 mds_command: new command op to 7717 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:46:07.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 1 -- 172.21.15.103:0/1466073234 --> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5561d4b39590 con 0x5561d4d5cbd0 2024-09-10T22:46:07.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c1e00640 1 --2- 172.21.15.103:0/1466073234 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x5561d4d5cbd0 0x5561d4d9fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:07.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24a3400640 10 client.8763 ms_handle_connect on v2:172.21.15.131:6835/1281268106 2024-09-10T22:46:07.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c1e00640 1 --2- 172.21.15.103:0/1466073234 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x5561d4d5cbd0 0x5561d4d9fc70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c49c70e2e2ffe322 server_cookie=a9a0964cb55752cc in_seq=0 out_seq=0 2024-09-10T22:46:07.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24a3400640 1 -- 172.21.15.103:0/1466073234 <== mds.2 v2:172.21.15.131:6835/1281268106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x5561d4b39590 con 0x5561d4d5cbd0 2024-09-10T22:46:07.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24a3400640 10 client.8763 handle_command_reply: tid=0 2024-09-10T22:46:07.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 1 client.8763 shutdown 2024-09-10T22:46:07.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 1 -- 172.21.15.103:0/1466073234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2a1a0 msgr2=0x5561d4d37aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/1466073234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2a1a0 0x5561d4d37aa0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f24b0015040 tx=0x7f24b000faa0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 1 -- 172.21.15.103:0/1466073234 shutdown_connections 2024-09-10T22:46:07.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/1466073234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561d4d2aac0 0x5561d4d5c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/1466073234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d4d2a1a0 0x5561d4d37aa0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/1466073234 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x5561d4d5cbd0 0x5561d4d9fc70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 1 --2- 172.21.15.103:0/1466073234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561d4ce0bc0 0x5561d4d37560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 1 -- 172.21.15.103:0/1466073234 >> 172.21.15.103:0/1466073234 conn(0x5561d4ce6d20 msgr2=0x5561d4ce0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24a3400640 0 client.8763 ms_handle_reset on v2:172.21.15.131:6835/1281268106 2024-09-10T22:46:07.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 1 -- 172.21.15.103:0/1466073234 shutdown_connections 2024-09-10T22:46:07.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 1 -- 172.21.15.103:0/1466073234 wait complete. 2024-09-10T22:46:07.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24cc4e5000 20 client.8763 trim_cache size 0 max 16384 2024-09-10T22:46:07.959 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:07.959 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-10T22:46:07.959 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:46:07.959 INFO:teuthology.orchestra.run.smithi103.stdout: "13d979f1-0660-40c8-9ef3-e228e32f6cb4": { 2024-09-10T22:46:07.959 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:46:07.960 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "13d979f1-0660-40c8-9ef3-e228e32f6cb4", 2024-09-10T22:46:07.960 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:46:07.960 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:46:07.960 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:46:07.960 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:07.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c9000640 1 -- 172.21.15.103:0/2211160474 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f24a40725e0 msgr2=0x7f24a4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c9000640 1 --2- 172.21.15.103:0/2211160474 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f24a40725e0 0x7f24a4074aa0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f24c4156480 tx=0x7f24bc00a660 comp rx=0 tx=0).stop 2024-09-10T22:46:07.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c9000640 1 -- 172.21.15.103:0/2211160474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24c4072c10 msgr2=0x7f24c4138130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:07.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c9000640 1 --2- 172.21.15.103:0/2211160474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24c4072c10 0x7f24c4138130 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f24b40b0040 tx=0x7f24b4004040 comp rx=0 tx=0).stop 2024-09-10T22:46:07.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c9000640 1 -- 172.21.15.103:0/2211160474 shutdown_connections 2024-09-10T22:46:07.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c9000640 1 --2- 172.21.15.103:0/2211160474 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f24a40725e0 0x7f24a4074aa0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c9000640 1 --2- 172.21.15.103:0/2211160474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24c40cf260 0x7f24c414d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c9000640 1 --2- 172.21.15.103:0/2211160474 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24c40b3150 0x7f24c41fa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c9000640 1 --2- 172.21.15.103:0/2211160474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24c4072c10 0x7f24c4138130 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:07.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c9000640 1 -- 172.21.15.103:0/2211160474 >> 172.21.15.103:0/2211160474 conn(0x7f24c406cc00 msgr2=0x7f24c415b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:07.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.952+0000 7f24c9000640 1 -- 172.21.15.103:0/2211160474 shutdown_connections 2024-09-10T22:46:07.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:07.956+0000 7f24c9000640 1 -- 172.21.15.103:0/2211160474 wait complete. 2024-09-10T22:46:07.973 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:46:07.973 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:46:07.974 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-10T22:46:08.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.116+0000 7efda3200640 1 -- 172.21.15.103:0/2045610011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd80005220 msgr2=0x7efd8000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.116+0000 7efda3200640 1 --2- 172.21.15.103:0/2045610011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd80005220 0x7efd8000b9d0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7efd94006fd0 tx=0x7efd9401caf0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.116+0000 7efda3200640 1 -- 172.21.15.103:0/2045610011 shutdown_connections 2024-09-10T22:46:08.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.116+0000 7efda3200640 1 --2- 172.21.15.103:0/2045610011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd80005220 0x7efd8000b9d0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.116+0000 7efda3200640 1 -- 172.21.15.103:0/2045610011 >> 172.21.15.103:0/2045610011 conn(0x7efd9c0d1a20 msgr2=0x7efd9c0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.116+0000 7efda3200640 1 -- 172.21.15.103:0/2045610011 shutdown_connections 2024-09-10T22:46:08.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.116+0000 7efda3200640 1 -- 172.21.15.103:0/2045610011 wait complete. 2024-09-10T22:46:08.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efda3200640 1 Processor -- start 2024-09-10T22:46:08.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efda3200640 1 -- start start 2024-09-10T22:46:08.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efda3200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd80005220 0x7efd9c15e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efda3200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd9c1f8270 0x7efd9c15c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efda3200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd9c14d590 0x7efd9c14da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efda3200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c0cf980 con 0x7efd9c1f8270 2024-09-10T22:46:08.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efda3200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c0cf800 con 0x7efd80005220 2024-09-10T22:46:08.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efda3200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7efd9c0d0000 con 0x7efd9c14d590 2024-09-10T22:46:08.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efd93400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd9c1f8270 0x7efd9c15c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efd93400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd9c1f8270 0x7efd9c15c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58198/0 (socket says 172.21.15.103:58198) 2024-09-10T22:46:08.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efd93400640 1 -- 172.21.15.103:0/1913380538 learned_addr learned my addr 172.21.15.103:0/1913380538 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efda1200640 1 --2- 172.21.15.103:0/1913380538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd9c14d590 0x7efd9c14da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efd9be00640 1 --2- 172.21.15.103:0/1913380538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd80005220 0x7efd9c15e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efd93400640 1 -- 172.21.15.103:0/1913380538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd9c14d590 msgr2=0x7efd9c14da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efd93400640 1 --2- 172.21.15.103:0/1913380538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd9c14d590 0x7efd9c14da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efd93400640 1 -- 172.21.15.103:0/1913380538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd80005220 msgr2=0x7efd9c15e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efd93400640 1 --2- 172.21.15.103:0/1913380538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd80005220 0x7efd9c15e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efd93400640 1 -- 172.21.15.103:0/1913380538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c15e900 con 0x7efd9c1f8270 2024-09-10T22:46:08.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efd93400640 1 --2- 172.21.15.103:0/1913380538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd9c1f8270 0x7efd9c15c4c0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7efd84011890 tx=0x7efd84011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efd98c00640 1 -- 172.21.15.103:0/1913380538 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8400f9a0 con 0x7efd9c1f8270 2024-09-10T22:46:08.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efd98c00640 1 -- 172.21.15.103:0/1913380538 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd8400fb40 con 0x7efd9c1f8270 2024-09-10T22:46:08.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efda3200640 1 -- 172.21.15.103:0/1913380538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9c15ebe0 con 0x7efd9c1f8270 2024-09-10T22:46:08.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efd98c00640 1 -- 172.21.15.103:0/1913380538 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd84003600 con 0x7efd9c1f8270 2024-09-10T22:46:08.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.120+0000 7efda3200640 1 -- 172.21.15.103:0/1913380538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd9c15f1a0 con 0x7efd9c1f8270 2024-09-10T22:46:08.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.124+0000 7efd98c00640 1 -- 172.21.15.103:0/1913380538 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7efd84018070 con 0x7efd9c1f8270 2024-09-10T22:46:08.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.124+0000 7efd98c00640 1 --2- 172.21.15.103:0/1913380538 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efd780725e0 0x7efd78074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.124+0000 7efd98c00640 1 -- 172.21.15.103:0/1913380538 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7efd84093ff0 con 0x7efd9c1f8270 2024-09-10T22:46:08.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.124+0000 7efda650e000 1 Processor -- start 2024-09-10T22:46:08.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.124+0000 7efda650e000 1 -- start start 2024-09-10T22:46:08.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.124+0000 7efd9be00640 1 --2- 172.21.15.103:0/1913380538 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efd780725e0 0x7efd78074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.124+0000 7efda650e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1e1a0 0x55a618a1e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.124+0000 7efd9be00640 1 --2- 172.21.15.103:0/1913380538 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efd780725e0 0x7efd78074aa0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7efd8c001ec0 tx=0x7efd8c006730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.124+0000 7efda650e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a618a1eac0 0x55a6189d4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.124+0000 7efda650e000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a6189d4bc0 0x55a6189d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.124+0000 7efda650e000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a6188bccb0 con 0x55a6189d4bc0 2024-09-10T22:46:08.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.124+0000 7efda650e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a6187d2310 con 0x55a618a1eac0 2024-09-10T22:46:08.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.124+0000 7efda650e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a61882fb90 con 0x55a618a1e1a0 2024-09-10T22:46:08.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efd9be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1e1a0 0x55a618a1e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda1200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a6189d4bc0 0x55a6189d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efd93400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a618a1eac0 0x55a6189d4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efd9be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1e1a0 0x55a618a1e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:45066/0 (socket says 172.21.15.103:45066) 2024-09-10T22:46:08.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efd9be00640 1 -- 172.21.15.103:0/3691361088 learned_addr learned my addr 172.21.15.103:0/3691361088 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efd9be00640 1 -- 172.21.15.103:0/3691361088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a618a1eac0 msgr2=0x55a6189d4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efd9be00640 1 --2- 172.21.15.103:0/3691361088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a618a1eac0 0x55a6189d4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efd9be00640 1 -- 172.21.15.103:0/3691361088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a6189d4bc0 msgr2=0x55a6189d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efd9be00640 1 --2- 172.21.15.103:0/3691361088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a6189d4bc0 0x55a6189d4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efd9be00640 1 -- 172.21.15.103:0/3691361088 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6187d3c60 con 0x55a618a1e1a0 2024-09-10T22:46:08.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda1200640 1 --2- 172.21.15.103:0/3691361088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a6189d4bc0 0x55a6189d4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:46:08.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efd9be00640 1 --2- 172.21.15.103:0/3691361088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1e1a0 0x55a618a1e580 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efd8c004a30 tx=0x7efd8c015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb22a1aa50c0ce86 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efd90c00640 1 -- 172.21.15.103:0/3691361088 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c012a80 con 0x55a618a1e1a0 2024-09-10T22:46:08.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efd90c00640 1 -- 172.21.15.103:0/3691361088 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd8c023020 con 0x55a618a1e1a0 2024-09-10T22:46:08.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efd90c00640 1 -- 172.21.15.103:0/3691361088 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c012cc0 con 0x55a618a1e1a0 2024-09-10T22:46:08.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda650e000 1 -- 172.21.15.103:0/3691361088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1e1a0 msgr2=0x55a618a1e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda650e000 1 --2- 172.21.15.103:0/3691361088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1e1a0 0x55a618a1e580 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efd8c004a30 tx=0x7efd8c015000 comp rx=0 tx=0).stop 2024-09-10T22:46:08.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda650e000 1 -- 172.21.15.103:0/3691361088 shutdown_connections 2024-09-10T22:46:08.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda650e000 1 --2- 172.21.15.103:0/3691361088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a6189d4bc0 0x55a6189d4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda650e000 1 --2- 172.21.15.103:0/3691361088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a618a1eac0 0x55a6189d4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda650e000 1 --2- 172.21.15.103:0/3691361088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1e1a0 0x55a618a1e580 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda650e000 1 -- 172.21.15.103:0/3691361088 >> 172.21.15.103:0/3691361088 conn(0x55a6189dad20 msgr2=0x55a6189d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda650e000 1 -- 172.21.15.103:0/3691361088 shutdown_connections 2024-09-10T22:46:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda650e000 1 -- 172.21.15.103:0/3691361088 wait complete. 2024-09-10T22:46:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda650e000 1 -- start start 2024-09-10T22:46:08.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda650e000 1 Processor -- start 2024-09-10T22:46:08.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda650e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6189d4bc0 0x55a618a25530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda650e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1e1a0 0x55a618a25a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda650e000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1eac0 0x55a618a25fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda650e000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a618822dd0 con 0x55a618a1eac0 2024-09-10T22:46:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda650e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a61881efc0 con 0x55a6189d4bc0 2024-09-10T22:46:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda650e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a6187c44b0 con 0x55a618a1e1a0 2024-09-10T22:46:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.128+0000 7efda650e000 10 client.0 _ll_register_callbacks cb 0x55a6187a27d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efd9be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6189d4bc0 0x55a618a25530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda1200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1eac0 0x55a618a25fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efd93400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1e1a0 0x55a618a25a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efd9be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6189d4bc0 0x55a618a25530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.103:46994/0 (socket says 172.21.15.103:46994) 2024-09-10T22:46:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efd9be00640 1 -- 172.21.15.103:0/459619731 learned_addr learned my addr 172.21.15.103:0/459619731 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda1200640 1 -- 172.21.15.103:0/459619731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1e1a0 msgr2=0x55a618a25a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda1200640 1 --2- 172.21.15.103:0/459619731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1e1a0 0x55a618a25a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda1200640 1 -- 172.21.15.103:0/459619731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6189d4bc0 msgr2=0x55a618a25530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda1200640 1 --2- 172.21.15.103:0/459619731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6189d4bc0 0x55a618a25530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda1200640 1 -- 172.21.15.103:0/459619731 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6187bd1f0 con 0x55a618a1eac0 2024-09-10T22:46:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda1200640 1 --2- 172.21.15.103:0/459619731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1eac0 0x55a618a25fb0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7efd9c06a430 tx=0x7efd94001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149252c752a85aec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efd89600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efd89600640 1 -- 172.21.15.103:0/459619731 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940c0060 con 0x55a618a1eac0 2024-09-10T22:46:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 1 -- 172.21.15.103:0/459619731 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a6187b7330 con 0x55a618a1eac0 2024-09-10T22:46:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efd89600640 1 -- 172.21.15.103:0/459619731 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7efd94003980 con 0x55a618a1eac0 2024-09-10T22:46:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efd89600640 1 -- 172.21.15.103:0/459619731 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7efd94003b80 con 0x55a618a1eac0 2024-09-10T22:46:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 10 client.8775 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 1 -- 172.21.15.103:0/459619731 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55a6187a3fa0 con 0x55a618a1eac0 2024-09-10T22:46:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efd89600640 1 -- 172.21.15.103:0/459619731 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a6187b7330 con 0x55a618a1eac0 2024-09-10T22:46:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efd89600640 1 -- 172.21.15.103:0/459619731 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7efd94006020 con 0x55a618a1eac0 2024-09-10T22:46:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 10 client.8775 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 10 client.8775 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T22:46:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 20 client.8775 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 1 --2- 172.21.15.103:0/459619731 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55a618a2d900 0x55a618a2fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 4 client.8775 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:46:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 1 -- 172.21.15.103:0/459619731 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a618831ae0 con 0x55a618a2d900 2024-09-10T22:46:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efd9be00640 1 --2- 172.21.15.103:0/459619731 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55a618a2d900 0x55a618a2fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efd9be00640 1 --2- 172.21.15.103:0/459619731 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55a618a2d900 0x55a618a2fcf0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31db37bc96e4486d server_cookie=44b4e6a36e51a2d6 in_seq=0 out_seq=0 2024-09-10T22:46:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efd89600640 10 client.8775 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efd89600640 1 -- 172.21.15.103:0/459619731 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a618831ae0 con 0x55a618a2d900 2024-09-10T22:46:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efd89600640 10 client.8775 handle_command_reply: tid=0 2024-09-10T22:46:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 1 client.8775 shutdown 2024-09-10T22:46:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 1 -- 172.21.15.103:0/459619731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1eac0 msgr2=0x55a618a25fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 1 --2- 172.21.15.103:0/459619731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1eac0 0x55a618a25fb0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7efd9c06a430 tx=0x7efd94001a60 comp rx=0 tx=0).stop 2024-09-10T22:46:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 1 -- 172.21.15.103:0/459619731 shutdown_connections 2024-09-10T22:46:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 1 --2- 172.21.15.103:0/459619731 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55a618a2d900 0x55a618a2fcf0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 1 --2- 172.21.15.103:0/459619731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1eac0 0x55a618a25fb0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 1 --2- 172.21.15.103:0/459619731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1e1a0 0x55a618a25a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 1 --2- 172.21.15.103:0/459619731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6189d4bc0 0x55a618a25530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efd89600640 0 client.8775 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 1 -- 172.21.15.103:0/459619731 >> 172.21.15.103:0/459619731 conn(0x55a6189dad20 msgr2=0x55a6189d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 1 -- 172.21.15.103:0/459619731 shutdown_connections 2024-09-10T22:46:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 1 -- 172.21.15.103:0/459619731 wait complete. 2024-09-10T22:46:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.132+0000 7efda650e000 20 client.8775 trim_cache size 0 max 16384 2024-09-10T22:46:08.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efda650e000 1 Processor -- start 2024-09-10T22:46:08.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efda650e000 1 -- start start 2024-09-10T22:46:08.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efda650e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6189d4bc0 0x55a6189d4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efda650e000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1e1a0 0x55a6189d45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efda650e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1eac0 0x55a618a28310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efda650e000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c201d60 con 0x55a618a1e1a0 2024-09-10T22:46:08.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efda650e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c200f40 con 0x55a6189d4bc0 2024-09-10T22:46:08.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efda650e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7efd9c201630 con 0x55a618a1eac0 2024-09-10T22:46:08.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efd93400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1e1a0 0x55a6189d45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efd93400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1e1a0 0x55a6189d45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58236/0 (socket says 172.21.15.103:58236) 2024-09-10T22:46:08.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efd93400640 1 -- 172.21.15.103:0/850011756 learned_addr learned my addr 172.21.15.103:0/850011756 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efda1200640 1 --2- 172.21.15.103:0/850011756 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1eac0 0x55a618a28310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efd9be00640 1 --2- 172.21.15.103:0/850011756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6189d4bc0 0x55a6189d4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efd93400640 1 -- 172.21.15.103:0/850011756 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1eac0 msgr2=0x55a618a28310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efd93400640 1 --2- 172.21.15.103:0/850011756 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1eac0 0x55a618a28310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efd93400640 1 -- 172.21.15.103:0/850011756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6189d4bc0 msgr2=0x55a6189d4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efd93400640 1 --2- 172.21.15.103:0/850011756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6189d4bc0 0x55a6189d4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efd93400640 1 -- 172.21.15.103:0/850011756 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a61887c660 con 0x55a618a1e1a0 2024-09-10T22:46:08.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efd9be00640 1 --2- 172.21.15.103:0/850011756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6189d4bc0 0x55a6189d4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:08.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efd93400640 1 --2- 172.21.15.103:0/850011756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1e1a0 0x55a6189d45b0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7efd8405b5b0 tx=0x7efd8405e850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f74af03ad4bc034 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efd8be00640 1 -- 172.21.15.103:0/850011756 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd84078070 con 0x55a618a1e1a0 2024-09-10T22:46:08.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efd8be00640 1 -- 172.21.15.103:0/850011756 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd8405ee40 con 0x55a618a1e1a0 2024-09-10T22:46:08.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.152+0000 7efd8be00640 1 -- 172.21.15.103:0/850011756 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd84068060 con 0x55a618a1e1a0 2024-09-10T22:46:08.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 -- 172.21.15.103:0/850011756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1e1a0 msgr2=0x55a6189d45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 --2- 172.21.15.103:0/850011756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1e1a0 0x55a6189d45b0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7efd8405b5b0 tx=0x7efd8405e850 comp rx=0 tx=0).stop 2024-09-10T22:46:08.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 -- 172.21.15.103:0/850011756 shutdown_connections 2024-09-10T22:46:08.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 --2- 172.21.15.103:0/850011756 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1eac0 0x55a618a28310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 --2- 172.21.15.103:0/850011756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1e1a0 0x55a6189d45b0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 --2- 172.21.15.103:0/850011756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6189d4bc0 0x55a6189d4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 -- 172.21.15.103:0/850011756 >> 172.21.15.103:0/850011756 conn(0x55a6189dad20 msgr2=0x55a6189d3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 -- 172.21.15.103:0/850011756 shutdown_connections 2024-09-10T22:46:08.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 -- 172.21.15.103:0/850011756 wait complete. 2024-09-10T22:46:08.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 -- start start 2024-09-10T22:46:08.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 Processor -- start 2024-09-10T22:46:08.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6189d4bc0 0x55a618a2afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1e1a0 0x55a618a2b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1eac0 0x55a618a50210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a6189ddd40 con 0x55a618a1e1a0 2024-09-10T22:46:08.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a6189db100 con 0x55a6189d4bc0 2024-09-10T22:46:08.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a618819ec0 con 0x55a618a1eac0 2024-09-10T22:46:08.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 10 client.0 _ll_register_callbacks cb 0x7efd84005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:08.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efd93400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1e1a0 0x55a618a2b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efd93400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1e1a0 0x55a618a2b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58240/0 (socket says 172.21.15.103:58240) 2024-09-10T22:46:08.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efd93400640 1 -- 172.21.15.103:0/13616447 learned_addr learned my addr 172.21.15.103:0/13616447 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efd9be00640 1 --2- 172.21.15.103:0/13616447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6189d4bc0 0x55a618a2afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda1200640 1 --2- 172.21.15.103:0/13616447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1eac0 0x55a618a50210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efd93400640 1 -- 172.21.15.103:0/13616447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1eac0 msgr2=0x55a618a50210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efd93400640 1 --2- 172.21.15.103:0/13616447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1eac0 0x55a618a50210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efd93400640 1 -- 172.21.15.103:0/13616447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6189d4bc0 msgr2=0x55a618a2afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efd93400640 1 --2- 172.21.15.103:0/13616447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6189d4bc0 0x55a618a2afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efd93400640 1 -- 172.21.15.103:0/13616447 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6187e9090 con 0x55a618a1e1a0 2024-09-10T22:46:08.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efd9be00640 1 --2- 172.21.15.103:0/13616447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6189d4bc0 0x55a618a2afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:08.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda1200640 1 --2- 172.21.15.103:0/13616447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1eac0 0x55a618a50210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efd93400640 1 --2- 172.21.15.103:0/13616447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1e1a0 0x55a618a2b500 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7efd8400f790 tx=0x7efd84068090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc7e86587b8e3e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efd89600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efd89600640 1 -- 172.21.15.103:0/13616447 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd84078070 con 0x55a618a1e1a0 2024-09-10T22:46:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efd89600640 1 -- 172.21.15.103:0/13616447 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7efd84066b60 con 0x55a618a1e1a0 2024-09-10T22:46:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 -- 172.21.15.103:0/13616447 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd8405ee40 con 0x55a618a1e1a0 2024-09-10T22:46:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efd89600640 1 -- 172.21.15.103:0/13616447 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7efd8408b050 con 0x55a618a1e1a0 2024-09-10T22:46:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 10 client.8781 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 -- 172.21.15.103:0/13616447 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55a6187b55f0 con 0x55a618a1e1a0 2024-09-10T22:46:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efd89600640 1 -- 172.21.15.103:0/13616447 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd8405ee40 con 0x55a618a1e1a0 2024-09-10T22:46:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efd89600640 1 -- 172.21.15.103:0/13616447 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7efd8405e0a0 con 0x55a618a1e1a0 2024-09-10T22:46:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 10 client.8781 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 10 client.8781 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T22:46:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 20 client.8781 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:08.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 --2- 172.21.15.103:0/13616447 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55a618a50bd0 0x55a618a93640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 4 client.8781 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:46:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.156+0000 7efda650e000 1 -- 172.21.15.103:0/13616447 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a61882d590 con 0x55a618a50bd0 2024-09-10T22:46:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efd9be00640 1 --2- 172.21.15.103:0/13616447 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55a618a50bd0 0x55a618a93640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efd9be00640 1 --2- 172.21.15.103:0/13616447 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55a618a50bd0 0x55a618a93640 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a680629dd3aa979 server_cookie=ac8778aa31ea9d4d in_seq=0 out_seq=0 2024-09-10T22:46:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efd89600640 10 client.8781 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efd89600640 1 -- 172.21.15.103:0/13616447 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55a61882d590 con 0x55a618a50bd0 2024-09-10T22:46:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efd89600640 10 client.8781 handle_command_reply: tid=0 2024-09-10T22:46:08.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda650e000 1 client.8781 shutdown 2024-09-10T22:46:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda650e000 1 -- 172.21.15.103:0/13616447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1e1a0 msgr2=0x55a618a2b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda650e000 1 --2- 172.21.15.103:0/13616447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1e1a0 0x55a618a2b500 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7efd8400f790 tx=0x7efd84068090 comp rx=0 tx=0).stop 2024-09-10T22:46:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda650e000 1 -- 172.21.15.103:0/13616447 shutdown_connections 2024-09-10T22:46:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda650e000 1 --2- 172.21.15.103:0/13616447 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55a618a50bd0 0x55a618a93640 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda650e000 1 --2- 172.21.15.103:0/13616447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a618a1eac0 0x55a618a50210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda650e000 1 --2- 172.21.15.103:0/13616447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a618a1e1a0 0x55a618a2b500 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efd89600640 0 client.8781 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:08.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda650e000 1 --2- 172.21.15.103:0/13616447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6189d4bc0 0x55a618a2afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda650e000 1 -- 172.21.15.103:0/13616447 >> 172.21.15.103:0/13616447 conn(0x55a6189dad20 msgr2=0x55a6189d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda650e000 1 -- 172.21.15.103:0/13616447 shutdown_connections 2024-09-10T22:46:08.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda650e000 1 -- 172.21.15.103:0/13616447 wait complete. 2024-09-10T22:46:08.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda650e000 20 client.8781 trim_cache size 0 max 16384 2024-09-10T22:46:08.165 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:08.165 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-10T22:46:08.165 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:46:08.165 INFO:teuthology.orchestra.run.smithi103.stdout: "13d979f1-0660-40c8-9ef3-e228e32f6cb4": { 2024-09-10T22:46:08.166 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:46:08.166 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "13d979f1-0660-40c8-9ef3-e228e32f6cb4", 2024-09-10T22:46:08.166 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:46:08.166 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:46:08.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:46:08.166 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_stats": { 2024-09-10T22:46:08.166 INFO:teuthology.orchestra.run.smithi103.stdout: "13d979f1-0660-40c8-9ef3-e228e32f6cb4": { 2024-09-10T22:46:08.166 INFO:teuthology.orchestra.run.smithi103.stdout: "start_time": "2024-09-10T22:45:58.592812+0000", 2024-09-10T22:46:08.166 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:46:08.166 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_started": 0, 2024-09-10T22:46:08.166 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_passed": 0, 2024-09-10T22:46:08.166 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_failed": 0, 2024-09-10T22:46:08.166 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_skipped": 0 2024-09-10T22:46:08.166 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:46:08.167 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:46:08.167 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda3200640 1 -- 172.21.15.103:0/1913380538 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efd780725e0 msgr2=0x7efd78074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda3200640 1 --2- 172.21.15.103:0/1913380538 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efd780725e0 0x7efd78074aa0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7efd8c001ec0 tx=0x7efd8c006730 comp rx=0 tx=0).stop 2024-09-10T22:46:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda3200640 1 -- 172.21.15.103:0/1913380538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd9c1f8270 msgr2=0x7efd9c15c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda3200640 1 --2- 172.21.15.103:0/1913380538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd9c1f8270 0x7efd9c15c4c0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7efd84011890 tx=0x7efd84011d50 comp rx=0 tx=0).stop 2024-09-10T22:46:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda3200640 1 -- 172.21.15.103:0/1913380538 shutdown_connections 2024-09-10T22:46:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda3200640 1 --2- 172.21.15.103:0/1913380538 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7efd780725e0 0x7efd78074aa0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda3200640 1 --2- 172.21.15.103:0/1913380538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd9c14d590 0x7efd9c14da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda3200640 1 --2- 172.21.15.103:0/1913380538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd9c1f8270 0x7efd9c15c4c0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda3200640 1 --2- 172.21.15.103:0/1913380538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd80005220 0x7efd9c15e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda3200640 1 -- 172.21.15.103:0/1913380538 >> 172.21.15.103:0/1913380538 conn(0x7efd9c0d1a20 msgr2=0x7efd9c0b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda3200640 1 -- 172.21.15.103:0/1913380538 shutdown_connections 2024-09-10T22:46:08.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.160+0000 7efda3200640 1 -- 172.21.15.103:0/1913380538 wait complete. 2024-09-10T22:46:08.179 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:46:08.179 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:46:08.180 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:1 scrub status 2024-09-10T22:46:08.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.320+0000 7fdb26400640 1 -- 172.21.15.103:0/4226025550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb200ae9c0 msgr2=0x7fdb200aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.320+0000 7fdb26400640 1 --2- 172.21.15.103:0/4226025550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb200ae9c0 0x7fdb200aee70 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009c80 tx=0x7fdb1801cd10 comp rx=0 tx=0).stop 2024-09-10T22:46:08.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.320+0000 7fdb26400640 1 -- 172.21.15.103:0/4226025550 shutdown_connections 2024-09-10T22:46:08.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.320+0000 7fdb26400640 1 --2- 172.21.15.103:0/4226025550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb200ae9c0 0x7fdb200aee70 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.320+0000 7fdb26400640 1 --2- 172.21.15.103:0/4226025550 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb2015be30 0x7fdb200ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.320+0000 7fdb26400640 1 -- 172.21.15.103:0/4226025550 >> 172.21.15.103:0/4226025550 conn(0x7fdb200d1ac0 msgr2=0x7fdb200d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.320+0000 7fdb26400640 1 -- 172.21.15.103:0/4226025550 shutdown_connections 2024-09-10T22:46:08.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.320+0000 7fdb26400640 1 -- 172.21.15.103:0/4226025550 wait complete. 2024-09-10T22:46:08.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb26400640 1 Processor -- start 2024-09-10T22:46:08.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb26400640 1 -- start start 2024-09-10T22:46:08.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb26400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb200ae9c0 0x7fdb2014a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb26400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb200b09c0 0x7fdb200b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb26400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb2015be30 0x7fdb2006dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb26400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdb20168df0 con 0x7fdb200b09c0 2024-09-10T22:46:08.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb26400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdb20168c70 con 0x7fdb200ae9c0 2024-09-10T22:46:08.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb26400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdb20168f70 con 0x7fdb2015be30 2024-09-10T22:46:08.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb1ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb200b09c0 0x7fdb200b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb1ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb200b09c0 0x7fdb200b4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58258/0 (socket says 172.21.15.103:58258) 2024-09-10T22:46:08.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb1ea00640 1 -- 172.21.15.103:0/2109832275 learned_addr learned my addr 172.21.15.103:0/2109832275 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb1f400640 1 --2- 172.21.15.103:0/2109832275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb200ae9c0 0x7fdb2014a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb1fe00640 1 --2- 172.21.15.103:0/2109832275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb2015be30 0x7fdb2006dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb1ea00640 1 -- 172.21.15.103:0/2109832275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb2015be30 msgr2=0x7fdb2006dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb1ea00640 1 --2- 172.21.15.103:0/2109832275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb2015be30 0x7fdb2006dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb1ea00640 1 -- 172.21.15.103:0/2109832275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb200ae9c0 msgr2=0x7fdb2014a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb1ea00640 1 --2- 172.21.15.103:0/2109832275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb200ae9c0 0x7fdb2014a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb1ea00640 1 -- 172.21.15.103:0/2109832275 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb200b0140 con 0x7fdb200b09c0 2024-09-10T22:46:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb1ea00640 1 --2- 172.21.15.103:0/2109832275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb200b09c0 0x7fdb200b4e40 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00c410 tx=0x7fdb0c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb17400640 1 -- 172.21.15.103:0/2109832275 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c011790 con 0x7fdb200b09c0 2024-09-10T22:46:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb17400640 1 -- 172.21.15.103:0/2109832275 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb0c017070 con 0x7fdb200b09c0 2024-09-10T22:46:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb17400640 1 -- 172.21.15.103:0/2109832275 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c011d00 con 0x7fdb200b09c0 2024-09-10T22:46:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb26400640 1 -- 172.21.15.103:0/2109832275 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb200c6130 con 0x7fdb200b09c0 2024-09-10T22:46:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.324+0000 7fdb26400640 1 -- 172.21.15.103:0/2109832275 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb200c66f0 con 0x7fdb200b09c0 2024-09-10T22:46:08.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb17400640 1 -- 172.21.15.103:0/2109832275 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdb0c01c460 con 0x7fdb200b09c0 2024-09-10T22:46:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb17400640 1 --2- 172.21.15.103:0/2109832275 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdb000725e0 0x7fdb00074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb297a7000 1 Processor -- start 2024-09-10T22:46:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb297a7000 1 -- start start 2024-09-10T22:46:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb17400640 1 -- 172.21.15.103:0/2109832275 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fdb0c092f20 con 0x7fdb200b09c0 2024-09-10T22:46:08.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb1f400640 1 --2- 172.21.15.103:0/2109832275 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdb000725e0 0x7fdb00074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb297a7000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a11a0 0x55f79d5a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb297a7000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a1ac0 0x55f79d557680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb297a7000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d557bc0 0x55f79d557fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb297a7000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f79d43fcb0 con 0x55f79d5a1ac0 2024-09-10T22:46:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb297a7000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f79d355310 con 0x55f79d557bc0 2024-09-10T22:46:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb297a7000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55f79d3b2b90 con 0x55f79d5a11a0 2024-09-10T22:46:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb1ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a1ac0 0x55f79d557680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb1f400640 1 --2- 172.21.15.103:0/2109832275 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdb000725e0 0x7fdb00074aa0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fdb201577c0 tx=0x7fdb1000b2e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb1ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a1ac0 0x55f79d557680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58260/0 (socket says 172.21.15.103:58260) 2024-09-10T22:46:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb1ea00640 1 -- 172.21.15.103:0/467066091 learned_addr learned my addr 172.21.15.103:0/467066091 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb1f400640 1 --2- 172.21.15.103:0/467066091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a11a0 0x55f79d5a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb1fe00640 1 --2- 172.21.15.103:0/467066091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d557bc0 0x55f79d557fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb1ea00640 1 -- 172.21.15.103:0/467066091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a11a0 msgr2=0x55f79d5a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb1ea00640 1 --2- 172.21.15.103:0/467066091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a11a0 0x55f79d5a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb1ea00640 1 -- 172.21.15.103:0/467066091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d557bc0 msgr2=0x55f79d557fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb1ea00640 1 --2- 172.21.15.103:0/467066091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d557bc0 0x55f79d557fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb1ea00640 1 -- 172.21.15.103:0/467066091 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f79d356c60 con 0x55f79d5a1ac0 2024-09-10T22:46:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.328+0000 7fdb1ea00640 1 --2- 172.21.15.103:0/467066091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a1ac0 0x55f79d557680 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0911a0 tx=0x7fdb0c05d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ee25d39c363dc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb0be00640 1 -- 172.21.15.103:0/467066091 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c0627f0 con 0x55f79d5a1ac0 2024-09-10T22:46:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb0be00640 1 -- 172.21.15.103:0/467066091 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb0c062030 con 0x55f79d5a1ac0 2024-09-10T22:46:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb0be00640 1 -- 172.21.15.103:0/467066091 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c067210 con 0x55f79d5a1ac0 2024-09-10T22:46:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 1 -- 172.21.15.103:0/467066091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a1ac0 msgr2=0x55f79d557680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 1 --2- 172.21.15.103:0/467066091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a1ac0 0x55f79d557680 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0911a0 tx=0x7fdb0c05d990 comp rx=0 tx=0).stop 2024-09-10T22:46:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 1 -- 172.21.15.103:0/467066091 shutdown_connections 2024-09-10T22:46:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 1 --2- 172.21.15.103:0/467066091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d557bc0 0x55f79d557fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 1 --2- 172.21.15.103:0/467066091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a1ac0 0x55f79d557680 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 1 --2- 172.21.15.103:0/467066091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a11a0 0x55f79d5a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 1 -- 172.21.15.103:0/467066091 >> 172.21.15.103:0/467066091 conn(0x55f79d55dd20 msgr2=0x55f79d555f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 1 -- 172.21.15.103:0/467066091 shutdown_connections 2024-09-10T22:46:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 1 -- 172.21.15.103:0/467066091 wait complete. 2024-09-10T22:46:08.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 1 -- start start 2024-09-10T22:46:08.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 1 Processor -- start 2024-09-10T22:46:08.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d557bc0 0x55f79d5a8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a11a0 0x55f79d5a8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a1ac0 0x55f79d5a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f79d3a5dd0 con 0x55f79d5a11a0 2024-09-10T22:46:08.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f79d3a1fc0 con 0x55f79d557bc0 2024-09-10T22:46:08.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55f79d3474b0 con 0x55f79d5a1ac0 2024-09-10T22:46:08.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 10 client.0 _ll_register_callbacks cb 0x55f79d3257d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:08.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb1ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a11a0 0x55f79d5a8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb1ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a11a0 0x55f79d5a8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58272/0 (socket says 172.21.15.103:58272) 2024-09-10T22:46:08.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb1ea00640 1 -- 172.21.15.103:0/1857081949 learned_addr learned my addr 172.21.15.103:0/1857081949 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb1f400640 1 --2- 172.21.15.103:0/1857081949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d557bc0 0x55f79d5a8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb1fe00640 1 --2- 172.21.15.103:0/1857081949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a1ac0 0x55f79d5a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb1ea00640 1 -- 172.21.15.103:0/1857081949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a1ac0 msgr2=0x55f79d5a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb1ea00640 1 --2- 172.21.15.103:0/1857081949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a1ac0 0x55f79d5a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb1ea00640 1 -- 172.21.15.103:0/1857081949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d557bc0 msgr2=0x55f79d5a8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb1ea00640 1 --2- 172.21.15.103:0/1857081949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d557bc0 0x55f79d5a8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb1ea00640 1 -- 172.21.15.103:0/1857081949 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f79d3401f0 con 0x55f79d5a11a0 2024-09-10T22:46:08.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb1ea00640 1 --2- 172.21.15.103:0/1857081949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a11a0 0x55f79d5a8a70 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c067180 tx=0x7fdb0c05a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21b43866f7322db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb08c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:08.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb08c00640 1 -- 172.21.15.103:0/1857081949 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c0627f0 con 0x55f79d5a11a0 2024-09-10T22:46:08.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb08c00640 1 -- 172.21.15.103:0/1857081949 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fdb0c05d230 con 0x55f79d5a11a0 2024-09-10T22:46:08.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.332+0000 7fdb297a7000 1 -- 172.21.15.103:0/1857081949 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f79d33a330 con 0x55f79d5a11a0 2024-09-10T22:46:08.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb08c00640 1 -- 172.21.15.103:0/1857081949 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7fdb0c065ae0 con 0x55f79d5a11a0 2024-09-10T22:46:08.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 10 client.8793 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:08.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 1 -- 172.21.15.103:0/1857081949 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55f79d326fa0 con 0x55f79d5a11a0 2024-09-10T22:46:08.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb08c00640 1 -- 172.21.15.103:0/1857081949 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f79d33a330 con 0x55f79d5a11a0 2024-09-10T22:46:08.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb08c00640 1 -- 172.21.15.103:0/1857081949 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7fdb0c065c80 con 0x55f79d5a11a0 2024-09-10T22:46:08.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 10 client.8793 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:08.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 10 client.8793 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-10T22:46:08.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 20 client.8793 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:08.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 1 --2- 172.21.15.103:0/1857081949 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x55f79d5b0900 0x55f79d5b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 4 client.8793 mds_command: new command op to 8235 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:46:08.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 1 -- 172.21.15.103:0/1857081949 --> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f79d3b4ae0 con 0x55f79d5b0900 2024-09-10T22:46:08.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb1f400640 1 --2- 172.21.15.103:0/1857081949 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x55f79d5b0900 0x55f79d5b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb1f400640 1 --2- 172.21.15.103:0/1857081949 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x55f79d5b0900 0x55f79d5b2cf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3c57644a2995de3b server_cookie=b75f66a8531eaf7e in_seq=0 out_seq=0 2024-09-10T22:46:08.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb08c00640 10 client.8793 ms_handle_connect on v2:172.21.15.103:6832/1191295180 2024-09-10T22:46:08.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb08c00640 1 -- 172.21.15.103:0/1857081949 <== mds.1 v2:172.21.15.103:6832/1191295180 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f79d3b4ae0 con 0x55f79d5b0900 2024-09-10T22:46:08.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb08c00640 10 client.8793 handle_command_reply: tid=0 2024-09-10T22:46:08.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 1 client.8793 shutdown 2024-09-10T22:46:08.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 1 -- 172.21.15.103:0/1857081949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a11a0 msgr2=0x55f79d5a8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 1 --2- 172.21.15.103:0/1857081949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a11a0 0x55f79d5a8a70 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c067180 tx=0x7fdb0c05a2e0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 1 -- 172.21.15.103:0/1857081949 shutdown_connections 2024-09-10T22:46:08.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 1 --2- 172.21.15.103:0/1857081949 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x55f79d5b0900 0x55f79d5b2cf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 1 --2- 172.21.15.103:0/1857081949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a1ac0 0x55f79d5a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 1 --2- 172.21.15.103:0/1857081949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a11a0 0x55f79d5a8a70 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb08c00640 0 client.8793 ms_handle_reset on v2:172.21.15.103:6832/1191295180 2024-09-10T22:46:08.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 1 --2- 172.21.15.103:0/1857081949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d557bc0 0x55f79d5a8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 1 -- 172.21.15.103:0/1857081949 >> 172.21.15.103:0/1857081949 conn(0x55f79d55dd20 msgr2=0x55f79d555f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 1 -- 172.21.15.103:0/1857081949 shutdown_connections 2024-09-10T22:46:08.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 1 -- 172.21.15.103:0/1857081949 wait complete. 2024-09-10T22:46:08.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.336+0000 7fdb297a7000 20 client.8793 trim_cache size 0 max 16384 2024-09-10T22:46:08.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.352+0000 7fdb297a7000 1 Processor -- start 2024-09-10T22:46:08.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb297a7000 1 -- start start 2024-09-10T22:46:08.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb297a7000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d557bc0 0x55f79d5aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb297a7000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d5a11a0 0x55f79d557070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb297a7000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a1ac0 0x55f79d5575b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb297a7000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdb202048f0 con 0x55f79d557bc0 2024-09-10T22:46:08.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb297a7000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdb20203a90 con 0x55f79d5a11a0 2024-09-10T22:46:08.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb297a7000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdb202041c0 con 0x55f79d5a1ac0 2024-09-10T22:46:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb1f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d557bc0 0x55f79d5aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb1fe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a1ac0 0x55f79d5575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb1f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d557bc0 0x55f79d5aedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58276/0 (socket says 172.21.15.103:58276) 2024-09-10T22:46:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb1f400640 1 -- 172.21.15.103:0/3947613441 learned_addr learned my addr 172.21.15.103:0/3947613441 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb1ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d5a11a0 0x55f79d557070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb1f400640 1 -- 172.21.15.103:0/3947613441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a1ac0 msgr2=0x55f79d5575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb1f400640 1 --2- 172.21.15.103:0/3947613441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a1ac0 0x55f79d5575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb1f400640 1 -- 172.21.15.103:0/3947613441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d5a11a0 msgr2=0x55f79d557070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb1f400640 1 --2- 172.21.15.103:0/3947613441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d5a11a0 0x55f79d557070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb1f400640 1 -- 172.21.15.103:0/3947613441 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f79d3ff660 con 0x55f79d557bc0 2024-09-10T22:46:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb1f400640 1 --2- 172.21.15.103:0/3947613441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d557bc0 0x55f79d5aedc0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000bd10 tx=0x7fdb10013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebc5ad5e4f08449 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb0b400640 1 -- 172.21.15.103:0/3947613441 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb10011940 con 0x55f79d557bc0 2024-09-10T22:46:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb0b400640 1 -- 172.21.15.103:0/3947613441 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb10011ae0 con 0x55f79d557bc0 2024-09-10T22:46:08.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb0b400640 1 -- 172.21.15.103:0/3947613441 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb10005020 con 0x55f79d557bc0 2024-09-10T22:46:08.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb297a7000 1 -- 172.21.15.103:0/3947613441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d557bc0 msgr2=0x55f79d5aedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb297a7000 1 --2- 172.21.15.103:0/3947613441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d557bc0 0x55f79d5aedc0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000bd10 tx=0x7fdb10013000 comp rx=0 tx=0).stop 2024-09-10T22:46:08.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb297a7000 1 -- 172.21.15.103:0/3947613441 shutdown_connections 2024-09-10T22:46:08.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb297a7000 1 --2- 172.21.15.103:0/3947613441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a1ac0 0x55f79d5575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb297a7000 1 --2- 172.21.15.103:0/3947613441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d5a11a0 0x55f79d557070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb297a7000 1 --2- 172.21.15.103:0/3947613441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d557bc0 0x55f79d5aedc0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb297a7000 1 -- 172.21.15.103:0/3947613441 >> 172.21.15.103:0/3947613441 conn(0x55f79d55dd20 msgr2=0x55f79d556960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb297a7000 1 -- 172.21.15.103:0/3947613441 shutdown_connections 2024-09-10T22:46:08.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb297a7000 1 -- 172.21.15.103:0/3947613441 wait complete. 2024-09-10T22:46:08.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb297a7000 1 -- start start 2024-09-10T22:46:08.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.356+0000 7fdb297a7000 1 Processor -- start 2024-09-10T22:46:08.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a11a0 0x55f79d5ae200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a1ac0 0x55f79d5ae740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d5d3210 0x55f79d5d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f79d3a1fc0 con 0x55f79d5a1ac0 2024-09-10T22:46:08.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f79d39cec0 con 0x55f79d5d3210 2024-09-10T22:46:08.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55f79d560d40 con 0x55f79d5a11a0 2024-09-10T22:46:08.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 10 client.0 _ll_register_callbacks cb 0x7fdb0c05d530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:08.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb1ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a1ac0 0x55f79d5ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb1ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a1ac0 0x55f79d5ae740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58292/0 (socket says 172.21.15.103:58292) 2024-09-10T22:46:08.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb1ea00640 1 -- 172.21.15.103:0/928132919 learned_addr learned my addr 172.21.15.103:0/928132919 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb1f400640 1 --2- 172.21.15.103:0/928132919 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a11a0 0x55f79d5ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb1fe00640 1 --2- 172.21.15.103:0/928132919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d5d3210 0x55f79d5d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb1ea00640 1 -- 172.21.15.103:0/928132919 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a11a0 msgr2=0x55f79d5ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb1ea00640 1 --2- 172.21.15.103:0/928132919 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a11a0 0x55f79d5ae200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb1ea00640 1 -- 172.21.15.103:0/928132919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d5d3210 msgr2=0x55f79d5d35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb1ea00640 1 --2- 172.21.15.103:0/928132919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d5d3210 0x55f79d5d35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb1ea00640 1 -- 172.21.15.103:0/928132919 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f79d36c090 con 0x55f79d5a1ac0 2024-09-10T22:46:08.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb1f400640 1 --2- 172.21.15.103:0/928132919 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a11a0 0x55f79d5ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:08.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb1ea00640 1 --2- 172.21.15.103:0/928132919 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a1ac0 0x55f79d5ae740 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c067150 tx=0x7fdb0c0639f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e3ac2d52eb793f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb08c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:08.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb08c00640 1 -- 172.21.15.103:0/928132919 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c085020 con 0x55f79d5a1ac0 2024-09-10T22:46:08.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb08c00640 1 -- 172.21.15.103:0/928132919 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fdb0c063d80 con 0x55f79d5a1ac0 2024-09-10T22:46:08.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 -- 172.21.15.103:0/928132919 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb10011ae0 con 0x55f79d5a1ac0 2024-09-10T22:46:08.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb08c00640 1 -- 172.21.15.103:0/928132919 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7fdb0c05db90 con 0x55f79d5a1ac0 2024-09-10T22:46:08.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 10 client.8799 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:08.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 -- 172.21.15.103:0/928132919 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55f79d3385f0 con 0x55f79d5a1ac0 2024-09-10T22:46:08.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb08c00640 1 -- 172.21.15.103:0/928132919 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb10011ae0 con 0x55f79d5a1ac0 2024-09-10T22:46:08.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb08c00640 1 -- 172.21.15.103:0/928132919 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7fdb0c077ba0 con 0x55f79d5a1ac0 2024-09-10T22:46:08.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 10 client.8799 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:08.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 10 client.8799 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-10T22:46:08.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 20 client.8799 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:08.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 --2- 172.21.15.103:0/928132919 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x55f79d616a60 0x55f79d616e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 4 client.8799 mds_command: new command op to 8235 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:46:08.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 -- 172.21.15.103:0/928132919 --> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f79d3b0590 con 0x55f79d616a60 2024-09-10T22:46:08.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb1f400640 1 --2- 172.21.15.103:0/928132919 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x55f79d616a60 0x55f79d616e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb1f400640 1 --2- 172.21.15.103:0/928132919 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x55f79d616a60 0x55f79d616e70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=60917c2adc994f15 server_cookie=e8b81d377c2f9964 in_seq=0 out_seq=0 2024-09-10T22:46:08.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb08c00640 10 client.8799 ms_handle_connect on v2:172.21.15.103:6832/1191295180 2024-09-10T22:46:08.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb08c00640 1 -- 172.21.15.103:0/928132919 <== mds.1 v2:172.21.15.103:6832/1191295180 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x55f79d3b0590 con 0x55f79d616a60 2024-09-10T22:46:08.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb08c00640 10 client.8799 handle_command_reply: tid=0 2024-09-10T22:46:08.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 client.8799 shutdown 2024-09-10T22:46:08.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 -- 172.21.15.103:0/928132919 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a1ac0 msgr2=0x55f79d5ae740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 --2- 172.21.15.103:0/928132919 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a1ac0 0x55f79d5ae740 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c067150 tx=0x7fdb0c0639f0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 -- 172.21.15.103:0/928132919 shutdown_connections 2024-09-10T22:46:08.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 --2- 172.21.15.103:0/928132919 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x55f79d616a60 0x55f79d616e70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 --2- 172.21.15.103:0/928132919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f79d5d3210 0x55f79d5d35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 --2- 172.21.15.103:0/928132919 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f79d5a1ac0 0x55f79d5ae740 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 --2- 172.21.15.103:0/928132919 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f79d5a11a0 0x55f79d5ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb08c00640 0 client.8799 ms_handle_reset on v2:172.21.15.103:6832/1191295180 2024-09-10T22:46:08.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 -- 172.21.15.103:0/928132919 >> 172.21.15.103:0/928132919 conn(0x55f79d55dd20 msgr2=0x55f79d557180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 -- 172.21.15.103:0/928132919 shutdown_connections 2024-09-10T22:46:08.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 1 -- 172.21.15.103:0/928132919 wait complete. 2024-09-10T22:46:08.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.360+0000 7fdb297a7000 20 client.8799 trim_cache size 0 max 16384 2024-09-10T22:46:08.367 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:08.367 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-10T22:46:08.367 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:46:08.367 INFO:teuthology.orchestra.run.smithi103.stdout: "13d979f1-0660-40c8-9ef3-e228e32f6cb4": { 2024-09-10T22:46:08.367 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:46:08.367 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "13d979f1-0660-40c8-9ef3-e228e32f6cb4", 2024-09-10T22:46:08.368 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:46:08.368 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:46:08.368 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:46:08.368 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:08.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.364+0000 7fdb26400640 1 -- 172.21.15.103:0/2109832275 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdb000725e0 msgr2=0x7fdb00074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.364+0000 7fdb26400640 1 --2- 172.21.15.103:0/2109832275 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdb000725e0 0x7fdb00074aa0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fdb201577c0 tx=0x7fdb1000b2e0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.364+0000 7fdb26400640 1 -- 172.21.15.103:0/2109832275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb200b09c0 msgr2=0x7fdb200b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.364+0000 7fdb26400640 1 --2- 172.21.15.103:0/2109832275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb200b09c0 0x7fdb200b4e40 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00c410 tx=0x7fdb0c00c8d0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.364+0000 7fdb26400640 1 -- 172.21.15.103:0/2109832275 shutdown_connections 2024-09-10T22:46:08.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.364+0000 7fdb26400640 1 --2- 172.21.15.103:0/2109832275 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdb000725e0 0x7fdb00074aa0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.364+0000 7fdb26400640 1 --2- 172.21.15.103:0/2109832275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb2015be30 0x7fdb2006dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.364+0000 7fdb26400640 1 --2- 172.21.15.103:0/2109832275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb200b09c0 0x7fdb200b4e40 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.364+0000 7fdb26400640 1 --2- 172.21.15.103:0/2109832275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb200ae9c0 0x7fdb2014a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.364+0000 7fdb26400640 1 -- 172.21.15.103:0/2109832275 >> 172.21.15.103:0/2109832275 conn(0x7fdb200d1ac0 msgr2=0x7fdb20071e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.364+0000 7fdb26400640 1 -- 172.21.15.103:0/2109832275 shutdown_connections 2024-09-10T22:46:08.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.364+0000 7fdb26400640 1 -- 172.21.15.103:0/2109832275 wait complete. 2024-09-10T22:46:08.382 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:46:08.383 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:46:08.383 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:2 scrub status 2024-09-10T22:46:08.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.528+0000 7f34bae00640 1 -- 172.21.15.103:0/2872657727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34b406f470 msgr2=0x7f34b40cfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.528+0000 7f34bae00640 1 --2- 172.21.15.103:0/2872657727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34b406f470 0x7f34b40cfff0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009bc0 tx=0x7f34ac01cba0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.528+0000 7f34bae00640 1 -- 172.21.15.103:0/2872657727 shutdown_connections 2024-09-10T22:46:08.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.528+0000 7f34bae00640 1 --2- 172.21.15.103:0/2872657727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34b406f470 0x7f34b40cfff0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.528+0000 7f34bae00640 1 -- 172.21.15.103:0/2872657727 >> 172.21.15.103:0/2872657727 conn(0x7f34b40d18f0 msgr2=0x7f34b40d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.528+0000 7f34bae00640 1 -- 172.21.15.103:0/2872657727 shutdown_connections 2024-09-10T22:46:08.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.528+0000 7f34bae00640 1 -- 172.21.15.103:0/2872657727 wait complete. 2024-09-10T22:46:08.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34bae00640 1 Processor -- start 2024-09-10T22:46:08.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34bae00640 1 -- start start 2024-09-10T22:46:08.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34bae00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34b406f470 0x7f34b4159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34bae00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34b40ce880 0x7f34b4150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34bae00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34b4161120 0x7f34b4158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34bae00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f34b416c490 con 0x7f34b40ce880 2024-09-10T22:46:08.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34bae00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f34b416c310 con 0x7f34b406f470 2024-09-10T22:46:08.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34bae00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f34b416c610 con 0x7f34b4161120 2024-09-10T22:46:08.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34b9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34b40ce880 0x7f34b4150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34b9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34b40ce880 0x7f34b4150bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58308/0 (socket says 172.21.15.103:58308) 2024-09-10T22:46:08.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34b9000640 1 -- 172.21.15.103:0/2312087304 learned_addr learned my addr 172.21.15.103:0/2312087304 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34ba400640 1 --2- 172.21.15.103:0/2312087304 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34b4161120 0x7f34b4158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34b9000640 1 -- 172.21.15.103:0/2312087304 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34b4161120 msgr2=0x7f34b4158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34b9a00640 1 --2- 172.21.15.103:0/2312087304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34b406f470 0x7f34b4159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34b9000640 1 --2- 172.21.15.103:0/2312087304 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34b4161120 0x7f34b4158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34b9000640 1 -- 172.21.15.103:0/2312087304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34b406f470 msgr2=0x7f34b4159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34b9000640 1 --2- 172.21.15.103:0/2312087304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34b406f470 0x7f34b4159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34b9000640 1 -- 172.21.15.103:0/2312087304 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b4159380 con 0x7f34b40ce880 2024-09-10T22:46:08.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34ba400640 1 --2- 172.21.15.103:0/2312087304 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34b4161120 0x7f34b4158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:08.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34b9a00640 1 --2- 172.21.15.103:0/2312087304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34b406f470 0x7f34b4159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:08.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34b9000640 1 --2- 172.21.15.103:0/2312087304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34b40ce880 0x7f34b4150bb0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f34a000c530 tx=0x7f34a000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34b1600640 1 -- 172.21.15.103:0/2312087304 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a0017070 con 0x7f34b40ce880 2024-09-10T22:46:08.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34b1600640 1 -- 172.21.15.103:0/2312087304 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34a00053c0 con 0x7f34b40ce880 2024-09-10T22:46:08.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34b1600640 1 -- 172.21.15.103:0/2312087304 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a0012890 con 0x7f34b40ce880 2024-09-10T22:46:08.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34bae00640 1 -- 172.21.15.103:0/2312087304 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b4159660 con 0x7f34b40ce880 2024-09-10T22:46:08.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.532+0000 7f34bae00640 1 -- 172.21.15.103:0/2312087304 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b4153bd0 con 0x7f34b40ce880 2024-09-10T22:46:08.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34b1600640 1 -- 172.21.15.103:0/2312087304 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f34a0003600 con 0x7f34b40ce880 2024-09-10T22:46:08.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34b1600640 1 --2- 172.21.15.103:0/2312087304 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f34940725e0 0x7f3494074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34b1600640 1 -- 172.21.15.103:0/2312087304 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f34a00929d0 con 0x7f34b40ce880 2024-09-10T22:46:08.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34bf896000 1 Processor -- start 2024-09-10T22:46:08.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34bf896000 1 -- start start 2024-09-10T22:46:08.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34b9a00640 1 --2- 172.21.15.103:0/2312087304 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f34940725e0 0x7f3494074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34bf896000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 0x55e0efd87580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34b9a00640 1 --2- 172.21.15.103:0/2312087304 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f34940725e0 0x7f3494074aa0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f34b4154390 tx=0x7f34a8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34bf896000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd87ac0 0x55e0efd3d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34bf896000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd3dbc0 0x55e0efd3dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34bf896000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e0efc25cb0 con 0x55e0efd871a0 2024-09-10T22:46:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34bf896000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e0efb3b310 con 0x55e0efd3dbc0 2024-09-10T22:46:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34bf896000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55e0efb98b90 con 0x55e0efd87ac0 2024-09-10T22:46:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34b9a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 0x55e0efd87580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34b9a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 0x55e0efd87580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58310/0 (socket says 172.21.15.103:58310) 2024-09-10T22:46:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34b9a00640 1 -- 172.21.15.103:0/4274143571 learned_addr learned my addr 172.21.15.103:0/4274143571 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34b9000640 1 --2- 172.21.15.103:0/4274143571 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd87ac0 0x55e0efd3d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34ba400640 1 --2- 172.21.15.103:0/4274143571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd3dbc0 0x55e0efd3dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34b9a00640 1 -- 172.21.15.103:0/4274143571 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd87ac0 msgr2=0x55e0efd3d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34b9a00640 1 --2- 172.21.15.103:0/4274143571 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd87ac0 0x55e0efd3d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34b9a00640 1 -- 172.21.15.103:0/4274143571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd3dbc0 msgr2=0x55e0efd3dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34b9a00640 1 --2- 172.21.15.103:0/4274143571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd3dbc0 0x55e0efd3dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.536+0000 7f34b9a00640 1 -- 172.21.15.103:0/4274143571 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0efb3cc60 con 0x55e0efd871a0 2024-09-10T22:46:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34b9a00640 1 --2- 172.21.15.103:0/4274143571 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 0x55e0efd87580 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f34a800d830 tx=0x7f34a8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9dcab3a2587f2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34a6000640 1 -- 172.21.15.103:0/4274143571 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a8024070 con 0x55e0efd871a0 2024-09-10T22:46:08.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34a6000640 1 -- 172.21.15.103:0/4274143571 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34a8014ba0 con 0x55e0efd871a0 2024-09-10T22:46:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34a6000640 1 -- 172.21.15.103:0/4274143571 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a801f400 con 0x55e0efd871a0 2024-09-10T22:46:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34bf896000 1 -- 172.21.15.103:0/4274143571 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 msgr2=0x55e0efd87580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34bf896000 1 --2- 172.21.15.103:0/4274143571 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 0x55e0efd87580 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f34a800d830 tx=0x7f34a8010000 comp rx=0 tx=0).stop 2024-09-10T22:46:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34bf896000 1 -- 172.21.15.103:0/4274143571 shutdown_connections 2024-09-10T22:46:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34bf896000 1 --2- 172.21.15.103:0/4274143571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd3dbc0 0x55e0efd3dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34bf896000 1 --2- 172.21.15.103:0/4274143571 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd87ac0 0x55e0efd3d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34bf896000 1 --2- 172.21.15.103:0/4274143571 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 0x55e0efd87580 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34bf896000 1 -- 172.21.15.103:0/4274143571 >> 172.21.15.103:0/4274143571 conn(0x55e0efd43d20 msgr2=0x55e0efd3bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34bf896000 1 -- 172.21.15.103:0/4274143571 shutdown_connections 2024-09-10T22:46:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34bf896000 1 -- 172.21.15.103:0/4274143571 wait complete. 2024-09-10T22:46:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34bf896000 1 -- start start 2024-09-10T22:46:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34bf896000 1 Processor -- start 2024-09-10T22:46:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34bf896000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd3dbc0 0x55e0efd8e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34bf896000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 0x55e0efd8ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34bf896000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd87ac0 0x55e0efd8efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34bf896000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e0efb8bdd0 con 0x55e0efd871a0 2024-09-10T22:46:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34bf896000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e0efb87fc0 con 0x55e0efd3dbc0 2024-09-10T22:46:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34bf896000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55e0efb2d4b0 con 0x55e0efd87ac0 2024-09-10T22:46:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34bf896000 10 client.0 _ll_register_callbacks cb 0x55e0efb0b7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34b9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 0x55e0efd8ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34b9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 0x55e0efd8ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58314/0 (socket says 172.21.15.103:58314) 2024-09-10T22:46:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34b9000640 1 -- 172.21.15.103:0/1731878805 learned_addr learned my addr 172.21.15.103:0/1731878805 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34ba400640 1 --2- 172.21.15.103:0/1731878805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd87ac0 0x55e0efd8efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34b9a00640 1 --2- 172.21.15.103:0/1731878805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd3dbc0 0x55e0efd8e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34b9000640 1 -- 172.21.15.103:0/1731878805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd87ac0 msgr2=0x55e0efd8efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34b9000640 1 --2- 172.21.15.103:0/1731878805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd87ac0 0x55e0efd8efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34b9000640 1 -- 172.21.15.103:0/1731878805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd3dbc0 msgr2=0x55e0efd8e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34b9000640 1 --2- 172.21.15.103:0/1731878805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd3dbc0 0x55e0efd8e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34b9000640 1 -- 172.21.15.103:0/1731878805 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0efb261f0 con 0x55e0efd871a0 2024-09-10T22:46:08.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f34b9000640 1 --2- 172.21.15.103:0/1731878805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 0x55e0efd8ea70 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f34a000cef0 tx=0x7f34a005e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f5b0d23c83ef46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.540+0000 7f349aa00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:08.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f349aa00640 1 -- 172.21.15.103:0/1731878805 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a005cc20 con 0x55e0efd871a0 2024-09-10T22:46:08.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f349aa00640 1 -- 172.21.15.103:0/1731878805 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f34a005eaf0 con 0x55e0efd871a0 2024-09-10T22:46:08.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 1 -- 172.21.15.103:0/1731878805 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e0efb20330 con 0x55e0efd871a0 2024-09-10T22:46:08.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f349aa00640 1 -- 172.21.15.103:0/1731878805 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f34a0066cc0 con 0x55e0efd871a0 2024-09-10T22:46:08.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 10 client.8814 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:08.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 1 -- 172.21.15.103:0/1731878805 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55e0efb0cfa0 con 0x55e0efd871a0 2024-09-10T22:46:08.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f349aa00640 1 -- 172.21.15.103:0/1731878805 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55e0efb20330 con 0x55e0efd871a0 2024-09-10T22:46:08.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f349aa00640 1 -- 172.21.15.103:0/1731878805 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7f34a0082b80 con 0x55e0efd871a0 2024-09-10T22:46:08.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 10 client.8814 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:08.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 10 client.8814 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2024-09-10T22:46:08.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 20 client.8814 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:08.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 1 --2- 172.21.15.103:0/1731878805 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55e0efd96900 0x55e0efd98cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 4 client.8814 mds_command: new command op to 7717 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:46:08.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 1 -- 172.21.15.103:0/1731878805 --> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0efb9aae0 con 0x55e0efd96900 2024-09-10T22:46:08.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34b9a00640 1 --2- 172.21.15.103:0/1731878805 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55e0efd96900 0x55e0efd98cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34b9a00640 1 --2- 172.21.15.103:0/1731878805 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55e0efd96900 0x55e0efd98cf0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=69d66aa5508ef780 server_cookie=51d4d99d92e3da90 in_seq=0 out_seq=0 2024-09-10T22:46:08.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f349aa00640 10 client.8814 ms_handle_connect on v2:172.21.15.131:6835/1281268106 2024-09-10T22:46:08.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f349aa00640 1 -- 172.21.15.103:0/1731878805 <== mds.2 v2:172.21.15.131:6835/1281268106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e0efb9aae0 con 0x55e0efd96900 2024-09-10T22:46:08.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f349aa00640 10 client.8814 handle_command_reply: tid=0 2024-09-10T22:46:08.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 1 client.8814 shutdown 2024-09-10T22:46:08.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 1 -- 172.21.15.103:0/1731878805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 msgr2=0x55e0efd8ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 1 --2- 172.21.15.103:0/1731878805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 0x55e0efd8ea70 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f34a000cef0 tx=0x7f34a005e000 comp rx=0 tx=0).stop 2024-09-10T22:46:08.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 1 -- 172.21.15.103:0/1731878805 shutdown_connections 2024-09-10T22:46:08.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 1 --2- 172.21.15.103:0/1731878805 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55e0efd96900 0x55e0efd98cf0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 1 --2- 172.21.15.103:0/1731878805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd87ac0 0x55e0efd8efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 1 --2- 172.21.15.103:0/1731878805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 0x55e0efd8ea70 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 1 --2- 172.21.15.103:0/1731878805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd3dbc0 0x55e0efd8e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f349aa00640 0 client.8814 ms_handle_reset on v2:172.21.15.131:6835/1281268106 2024-09-10T22:46:08.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 1 -- 172.21.15.103:0/1731878805 >> 172.21.15.103:0/1731878805 conn(0x55e0efd43d20 msgr2=0x55e0efd3bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 1 -- 172.21.15.103:0/1731878805 shutdown_connections 2024-09-10T22:46:08.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 1 -- 172.21.15.103:0/1731878805 wait complete. 2024-09-10T22:46:08.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.544+0000 7f34bf896000 20 client.8814 trim_cache size 0 max 16384 2024-09-10T22:46:08.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34bf896000 1 Processor -- start 2024-09-10T22:46:08.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34bf896000 1 -- start start 2024-09-10T22:46:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34bf896000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd3dbc0 0x55e0efdf9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34bf896000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 0x55e0efdf97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34bf896000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd87ac0 0x55e0efdf9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34bf896000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f34b42049c0 con 0x55e0efd871a0 2024-09-10T22:46:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34bf896000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f34b4203b60 con 0x55e0efd87ac0 2024-09-10T22:46:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34bf896000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f34b4204290 con 0x55e0efd3dbc0 2024-09-10T22:46:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34b9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 0x55e0efdf97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34b9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 0x55e0efdf97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58324/0 (socket says 172.21.15.103:58324) 2024-09-10T22:46:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34b9000640 1 -- 172.21.15.103:0/4077472087 learned_addr learned my addr 172.21.15.103:0/4077472087 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34ba400640 1 --2- 172.21.15.103:0/4077472087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd87ac0 0x55e0efdf9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34b9a00640 1 --2- 172.21.15.103:0/4077472087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd3dbc0 0x55e0efdf9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34b9000640 1 -- 172.21.15.103:0/4077472087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd3dbc0 msgr2=0x55e0efdf9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34b9000640 1 --2- 172.21.15.103:0/4077472087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd3dbc0 0x55e0efdf9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34b9000640 1 -- 172.21.15.103:0/4077472087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd87ac0 msgr2=0x55e0efdf9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34b9000640 1 --2- 172.21.15.103:0/4077472087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd87ac0 0x55e0efdf9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34b9000640 1 -- 172.21.15.103:0/4077472087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0efbe5660 con 0x55e0efd871a0 2024-09-10T22:46:08.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34b9000640 1 --2- 172.21.15.103:0/4077472087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 0x55e0efdf97a0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f34a000c4a0 tx=0x7f34a0059e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d23a43b6958adb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34a5600640 1 -- 172.21.15.103:0/4077472087 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a0086030 con 0x55e0efd871a0 2024-09-10T22:46:08.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34a5600640 1 -- 172.21.15.103:0/4077472087 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34a0082b80 con 0x55e0efd871a0 2024-09-10T22:46:08.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34a5600640 1 -- 172.21.15.103:0/4077472087 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a005ed10 con 0x55e0efd871a0 2024-09-10T22:46:08.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34bf896000 1 -- 172.21.15.103:0/4077472087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 msgr2=0x55e0efdf97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34bf896000 1 --2- 172.21.15.103:0/4077472087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 0x55e0efdf97a0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f34a000c4a0 tx=0x7f34a0059e10 comp rx=0 tx=0).stop 2024-09-10T22:46:08.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34bf896000 1 -- 172.21.15.103:0/4077472087 shutdown_connections 2024-09-10T22:46:08.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34bf896000 1 --2- 172.21.15.103:0/4077472087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd87ac0 0x55e0efdf9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34bf896000 1 --2- 172.21.15.103:0/4077472087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd871a0 0x55e0efdf97a0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34bf896000 1 --2- 172.21.15.103:0/4077472087 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd3dbc0 0x55e0efdf9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34bf896000 1 -- 172.21.15.103:0/4077472087 >> 172.21.15.103:0/4077472087 conn(0x55e0efd43d20 msgr2=0x55e0efd3f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34bf896000 1 -- 172.21.15.103:0/4077472087 shutdown_connections 2024-09-10T22:46:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.564+0000 7f34bf896000 1 -- 172.21.15.103:0/4077472087 wait complete. 2024-09-10T22:46:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34bf896000 1 -- start start 2024-09-10T22:46:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34bf896000 1 Processor -- start 2024-09-10T22:46:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34bf896000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd3dbc0 0x55e0efd9dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34bf896000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd871a0 0x55e0efd9e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34bf896000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd87ac0 0x55e0efdb9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34bf896000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e0efb8bdd0 con 0x55e0efd3dbc0 2024-09-10T22:46:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34bf896000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55e0efd46d40 con 0x55e0efd871a0 2024-09-10T22:46:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34bf896000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55e0efd44100 con 0x55e0efd87ac0 2024-09-10T22:46:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34bf896000 10 client.0 _ll_register_callbacks cb 0x7f34a00055b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34b9a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd3dbc0 0x55e0efd9dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34b9a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd3dbc0 0x55e0efd9dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58328/0 (socket says 172.21.15.103:58328) 2024-09-10T22:46:08.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34b9a00640 1 -- 172.21.15.103:0/1658015417 learned_addr learned my addr 172.21.15.103:0/1658015417 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34b9000640 1 --2- 172.21.15.103:0/1658015417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd871a0 0x55e0efd9e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34ba400640 1 --2- 172.21.15.103:0/1658015417 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd87ac0 0x55e0efdb9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34b9a00640 1 -- 172.21.15.103:0/1658015417 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd87ac0 msgr2=0x55e0efdb9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34b9a00640 1 --2- 172.21.15.103:0/1658015417 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd87ac0 0x55e0efdb9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34b9a00640 1 -- 172.21.15.103:0/1658015417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd871a0 msgr2=0x55e0efd9e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34b9a00640 1 --2- 172.21.15.103:0/1658015417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd871a0 0x55e0efd9e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34b9a00640 1 -- 172.21.15.103:0/1658015417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0efb52090 con 0x55e0efd3dbc0 2024-09-10T22:46:08.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34b9a00640 1 --2- 172.21.15.103:0/1658015417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd3dbc0 0x55e0efd9dc10 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x55e0efb935e0 tx=0x7f34a80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6f881ec8e7f71b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f349aa00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:08.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f349aa00640 1 -- 172.21.15.103:0/1658015417 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a8024040 con 0x55e0efd3dbc0 2024-09-10T22:46:08.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f349aa00640 1 -- 172.21.15.103:0/1658015417 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f34a8014ba0 con 0x55e0efd3dbc0 2024-09-10T22:46:08.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34bf896000 1 -- 172.21.15.103:0/1658015417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34a0082b80 con 0x55e0efd3dbc0 2024-09-10T22:46:08.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f349aa00640 1 -- 172.21.15.103:0/1658015417 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f34a803b050 con 0x55e0efd3dbc0 2024-09-10T22:46:08.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34bf896000 10 client.8820 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:08.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34bf896000 1 -- 172.21.15.103:0/1658015417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55e0efb1e5f0 con 0x55e0efd3dbc0 2024-09-10T22:46:08.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f349aa00640 1 -- 172.21.15.103:0/1658015417 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34a0082b80 con 0x55e0efd3dbc0 2024-09-10T22:46:08.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f349aa00640 1 -- 172.21.15.103:0/1658015417 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7f34a803e020 con 0x55e0efd3dbc0 2024-09-10T22:46:08.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34bf896000 10 client.8820 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:08.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34bf896000 10 client.8820 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2024-09-10T22:46:08.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34bf896000 20 client.8820 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:08.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34bf896000 1 --2- 172.21.15.103:0/1658015417 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55e0efdb9ba0 0x55e0efdfca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34bf896000 4 client.8820 mds_command: new command op to 7717 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:46:08.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34bf896000 1 -- 172.21.15.103:0/1658015417 --> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e0efb96590 con 0x55e0efdb9ba0 2024-09-10T22:46:08.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.568+0000 7f34b9000640 1 --2- 172.21.15.103:0/1658015417 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55e0efdb9ba0 0x55e0efdfca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34b9000640 1 --2- 172.21.15.103:0/1658015417 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55e0efdb9ba0 0x55e0efdfca60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c1b0d29578e2753c server_cookie=fe7d3233a0e4f636 in_seq=0 out_seq=0 2024-09-10T22:46:08.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f349aa00640 10 client.8820 ms_handle_connect on v2:172.21.15.131:6835/1281268106 2024-09-10T22:46:08.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f349aa00640 1 -- 172.21.15.103:0/1658015417 <== mds.2 v2:172.21.15.131:6835/1281268106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x55e0efb96590 con 0x55e0efdb9ba0 2024-09-10T22:46:08.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f349aa00640 10 client.8820 handle_command_reply: tid=0 2024-09-10T22:46:08.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bf896000 1 client.8820 shutdown 2024-09-10T22:46:08.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bf896000 1 -- 172.21.15.103:0/1658015417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd3dbc0 msgr2=0x55e0efd9dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bf896000 1 --2- 172.21.15.103:0/1658015417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd3dbc0 0x55e0efd9dc10 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x55e0efb935e0 tx=0x7f34a80014a0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bf896000 1 -- 172.21.15.103:0/1658015417 shutdown_connections 2024-09-10T22:46:08.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bf896000 1 --2- 172.21.15.103:0/1658015417 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55e0efdb9ba0 0x55e0efdfca60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bf896000 1 --2- 172.21.15.103:0/1658015417 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e0efd87ac0 0x55e0efdb9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bf896000 1 --2- 172.21.15.103:0/1658015417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0efd871a0 0x55e0efd9e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bf896000 1 --2- 172.21.15.103:0/1658015417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e0efd3dbc0 0x55e0efd9dc10 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f349aa00640 0 client.8820 ms_handle_reset on v2:172.21.15.131:6835/1281268106 2024-09-10T22:46:08.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bf896000 1 -- 172.21.15.103:0/1658015417 >> 172.21.15.103:0/1658015417 conn(0x55e0efd43d20 msgr2=0x55e0efd98cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bf896000 1 -- 172.21.15.103:0/1658015417 shutdown_connections 2024-09-10T22:46:08.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bf896000 1 -- 172.21.15.103:0/1658015417 wait complete. 2024-09-10T22:46:08.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bf896000 20 client.8820 trim_cache size 0 max 16384 2024-09-10T22:46:08.576 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:08.576 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-10T22:46:08.576 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:46:08.577 INFO:teuthology.orchestra.run.smithi103.stdout: "13d979f1-0660-40c8-9ef3-e228e32f6cb4": { 2024-09-10T22:46:08.577 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:46:08.577 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "13d979f1-0660-40c8-9ef3-e228e32f6cb4", 2024-09-10T22:46:08.577 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:46:08.577 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:46:08.577 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:46:08.577 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:08.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bae00640 1 -- 172.21.15.103:0/2312087304 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f34940725e0 msgr2=0x7f3494074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bae00640 1 --2- 172.21.15.103:0/2312087304 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f34940725e0 0x7f3494074aa0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f34b4154390 tx=0x7f34a8009040 comp rx=0 tx=0).stop 2024-09-10T22:46:08.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bae00640 1 -- 172.21.15.103:0/2312087304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34b40ce880 msgr2=0x7f34b4150bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bae00640 1 --2- 172.21.15.103:0/2312087304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34b40ce880 0x7f34b4150bb0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f34a000c530 tx=0x7f34a000c9f0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bae00640 1 -- 172.21.15.103:0/2312087304 shutdown_connections 2024-09-10T22:46:08.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bae00640 1 --2- 172.21.15.103:0/2312087304 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f34940725e0 0x7f3494074aa0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bae00640 1 --2- 172.21.15.103:0/2312087304 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34b4161120 0x7f34b4158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bae00640 1 --2- 172.21.15.103:0/2312087304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34b40ce880 0x7f34b4150bb0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bae00640 1 --2- 172.21.15.103:0/2312087304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34b406f470 0x7f34b4159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bae00640 1 -- 172.21.15.103:0/2312087304 >> 172.21.15.103:0/2312087304 conn(0x7f34b40d18f0 msgr2=0x7f34b41602f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bae00640 1 -- 172.21.15.103:0/2312087304 shutdown_connections 2024-09-10T22:46:08.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.572+0000 7f34bae00640 1 -- 172.21.15.103:0/2312087304 wait complete. 2024-09-10T22:46:08.592 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:46:08.592 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:46:08.592 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-10T22:46:08.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f412cc00640 1 -- 172.21.15.103:0/1039986323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41280714d0 msgr2=0x7f41280b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f412cc00640 1 --2- 172.21.15.103:0/1039986323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41280714d0 0x7f41280b0510 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f4128073b00 tx=0x7f412001c810 comp rx=0 tx=0).stop 2024-09-10T22:46:08.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f412cc00640 1 -- 172.21.15.103:0/1039986323 shutdown_connections 2024-09-10T22:46:08.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f412cc00640 1 --2- 172.21.15.103:0/1039986323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41280714d0 0x7f41280b0510 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f412cc00640 1 --2- 172.21.15.103:0/1039986323 >> v2:172.21.15.131:3300/0 conn(0x7f41280d04a0 0x7f41280affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f412cc00640 1 --2- 172.21.15.103:0/1039986323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f412815f0e0 0x7f41280cff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f412cc00640 1 -- 172.21.15.103:0/1039986323 >> 172.21.15.103:0/1039986323 conn(0x7f41280d18f0 msgr2=0x7f41280d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f412cc00640 1 -- 172.21.15.103:0/1039986323 shutdown_connections 2024-09-10T22:46:08.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f412cc00640 1 -- 172.21.15.103:0/1039986323 wait complete. 2024-09-10T22:46:08.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f412cc00640 1 Processor -- start 2024-09-10T22:46:08.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f412cc00640 1 -- start start 2024-09-10T22:46:08.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f412cc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41280714d0 0x7f41281f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f412cc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41280d04a0 0x7f412806dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f412cc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f412815f0e0 0x7f412806e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f412cc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4128070430 con 0x7f41280d04a0 2024-09-10T22:46:08.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f412cc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f41280705b0 con 0x7f412815f0e0 2024-09-10T22:46:08.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f412cc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4128070730 con 0x7f41280714d0 2024-09-10T22:46:08.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f411ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41280d04a0 0x7f412806dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f411ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41280d04a0 0x7f412806dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58344/0 (socket says 172.21.15.103:58344) 2024-09-10T22:46:08.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f411ea00640 1 -- 172.21.15.103:0/698309758 learned_addr learned my addr 172.21.15.103:0/698309758 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f4127e00640 1 --2- 172.21.15.103:0/698309758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f412815f0e0 0x7f412806e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f4127400640 1 --2- 172.21.15.103:0/698309758 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41280714d0 0x7f41281f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f411ea00640 1 -- 172.21.15.103:0/698309758 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41280714d0 msgr2=0x7f41281f6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f411ea00640 1 --2- 172.21.15.103:0/698309758 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41280714d0 0x7f41281f6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f411ea00640 1 -- 172.21.15.103:0/698309758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f412815f0e0 msgr2=0x7f412806e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f411ea00640 1 --2- 172.21.15.103:0/698309758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f412815f0e0 0x7f412806e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f411ea00640 1 -- 172.21.15.103:0/698309758 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41280c94f0 con 0x7f41280d04a0 2024-09-10T22:46:08.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.736+0000 7f411ea00640 1 --2- 172.21.15.103:0/698309758 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41280d04a0 0x7f412806dfc0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f411000e9f0 tx=0x7f411000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.740+0000 7f411fe00640 1 -- 172.21.15.103:0/698309758 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411000ccc0 con 0x7f41280d04a0 2024-09-10T22:46:08.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.740+0000 7f411fe00640 1 -- 172.21.15.103:0/698309758 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4110010430 con 0x7f41280d04a0 2024-09-10T22:46:08.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.740+0000 7f411fe00640 1 -- 172.21.15.103:0/698309758 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110010860 con 0x7f41280d04a0 2024-09-10T22:46:08.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.740+0000 7f412cc00640 1 -- 172.21.15.103:0/698309758 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41280c9790 con 0x7f41280d04a0 2024-09-10T22:46:08.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.740+0000 7f412cc00640 1 -- 172.21.15.103:0/698309758 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41280c9d50 con 0x7f41280d04a0 2024-09-10T22:46:08.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.740+0000 7f411fe00640 1 -- 172.21.15.103:0/698309758 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4110010a00 con 0x7f41280d04a0 2024-09-10T22:46:08.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.740+0000 7f411fe00640 1 --2- 172.21.15.103:0/698309758 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f41040725e0 0x7f4104074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.740+0000 7f411fe00640 1 -- 172.21.15.103:0/698309758 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f4110093f40 con 0x7f41280d04a0 2024-09-10T22:46:08.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.740+0000 7f4131651000 1 Processor -- start 2024-09-10T22:46:08.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.740+0000 7f4131651000 1 -- start start 2024-09-10T22:46:08.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.740+0000 7f4127400640 1 --2- 172.21.15.103:0/698309758 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f41040725e0 0x7f4104074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4127400640 1 --2- 172.21.15.103:0/698309758 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f41040725e0 0x7f4104074aa0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4118009eb0 tx=0x7f4118009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4131651000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde371a0 0x556abde37580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4131651000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abde37ac0 0x556abdded680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4131651000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abddedbc0 0x556abddedfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4131651000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556abdcd5cb0 con 0x556abddedbc0 2024-09-10T22:46:08.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4131651000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x556abdbeb310 con 0x556abde37ac0 2024-09-10T22:46:08.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4131651000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x556abdc48b90 con 0x556abde371a0 2024-09-10T22:46:08.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4127e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abddedbc0 0x556abddedfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4127400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde371a0 0x556abde37580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4127400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde371a0 0x556abde37580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:45234/0 (socket says 172.21.15.103:45234) 2024-09-10T22:46:08.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4127e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abddedbc0 0x556abddedfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58356/0 (socket says 172.21.15.103:58356) 2024-09-10T22:46:08.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4127400640 1 -- 172.21.15.103:0/3703160149 learned_addr learned my addr 172.21.15.103:0/3703160149 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f411ea00640 1 --2- 172.21.15.103:0/3703160149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abde37ac0 0x556abdded680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4127e00640 1 -- 172.21.15.103:0/3703160149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde371a0 msgr2=0x556abde37580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4127e00640 1 --2- 172.21.15.103:0/3703160149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde371a0 0x556abde37580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4127e00640 1 -- 172.21.15.103:0/3703160149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abde37ac0 msgr2=0x556abdded680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4127e00640 1 --2- 172.21.15.103:0/3703160149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abde37ac0 0x556abdded680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4127e00640 1 -- 172.21.15.103:0/3703160149 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556abdbecc60 con 0x556abddedbc0 2024-09-10T22:46:08.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4127e00640 1 --2- 172.21.15.103:0/3703160149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abddedbc0 0x556abddedfa0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f41200ac000 tx=0x7f41200195b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c6c603c0cc65f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4117e00640 1 -- 172.21.15.103:0/3703160149 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41200ba070 con 0x556abddedbc0 2024-09-10T22:46:08.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4117e00640 1 -- 172.21.15.103:0/3703160149 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4120004310 con 0x556abddedbc0 2024-09-10T22:46:08.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4117e00640 1 -- 172.21.15.103:0/3703160149 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41200b2040 con 0x556abddedbc0 2024-09-10T22:46:08.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4131651000 1 -- 172.21.15.103:0/3703160149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abddedbc0 msgr2=0x556abddedfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4131651000 1 --2- 172.21.15.103:0/3703160149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abddedbc0 0x556abddedfa0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f41200ac000 tx=0x7f41200195b0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4131651000 1 -- 172.21.15.103:0/3703160149 shutdown_connections 2024-09-10T22:46:08.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4131651000 1 --2- 172.21.15.103:0/3703160149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abddedbc0 0x556abddedfa0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4131651000 1 --2- 172.21.15.103:0/3703160149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abde37ac0 0x556abdded680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4131651000 1 --2- 172.21.15.103:0/3703160149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde371a0 0x556abde37580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4131651000 1 -- 172.21.15.103:0/3703160149 >> 172.21.15.103:0/3703160149 conn(0x556abddf3d20 msgr2=0x556abddebf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4131651000 1 -- 172.21.15.103:0/3703160149 shutdown_connections 2024-09-10T22:46:08.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4131651000 1 -- 172.21.15.103:0/3703160149 wait complete. 2024-09-10T22:46:08.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4131651000 1 -- start start 2024-09-10T22:46:08.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.744+0000 7f4131651000 1 Processor -- start 2024-09-10T22:46:08.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4131651000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddedbc0 0x556abde3e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4131651000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde371a0 0x556abde3ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4131651000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abde37ac0 0x556abde3efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4131651000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556abdc3bdd0 con 0x556abde37ac0 2024-09-10T22:46:08.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4131651000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x556abdc37fc0 con 0x556abddedbc0 2024-09-10T22:46:08.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4131651000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x556abdbdd4b0 con 0x556abde371a0 2024-09-10T22:46:08.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4131651000 10 client.0 _ll_register_callbacks cb 0x556abdbbb7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:08.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4127e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abde37ac0 0x556abde3efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4127e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abde37ac0 0x556abde3efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58366/0 (socket says 172.21.15.103:58366) 2024-09-10T22:46:08.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4127e00640 1 -- 172.21.15.103:0/3178511333 learned_addr learned my addr 172.21.15.103:0/3178511333 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4127400640 1 --2- 172.21.15.103:0/3178511333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddedbc0 0x556abde3e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f411ea00640 1 --2- 172.21.15.103:0/3178511333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde371a0 0x556abde3ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4127e00640 1 -- 172.21.15.103:0/3178511333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde371a0 msgr2=0x556abde3ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4127e00640 1 --2- 172.21.15.103:0/3178511333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde371a0 0x556abde3ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4127e00640 1 -- 172.21.15.103:0/3178511333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddedbc0 msgr2=0x556abde3e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4127e00640 1 --2- 172.21.15.103:0/3178511333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddedbc0 0x556abde3e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4127e00640 1 -- 172.21.15.103:0/3178511333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556abdbd61f0 con 0x556abde37ac0 2024-09-10T22:46:08.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4127e00640 1 --2- 172.21.15.103:0/3178511333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abde37ac0 0x556abde3efb0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f4120009850 tx=0x7f4120004400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b161946e353636e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4114c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:08.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4114c00640 1 -- 172.21.15.103:0/3178511333 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41200b2070 con 0x556abde37ac0 2024-09-10T22:46:08.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4131651000 1 -- 172.21.15.103:0/3178511333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556abdbd0330 con 0x556abde37ac0 2024-09-10T22:46:08.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4114c00640 1 -- 172.21.15.103:0/3178511333 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f41200bfc90 con 0x556abde37ac0 2024-09-10T22:46:08.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4114c00640 1 -- 172.21.15.103:0/3178511333 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f41200ba040 con 0x556abde37ac0 2024-09-10T22:46:08.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4131651000 10 client.8832 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:08.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4131651000 1 -- 172.21.15.103:0/3178511333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x556abdbbcfa0 con 0x556abde37ac0 2024-09-10T22:46:08.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4114c00640 1 -- 172.21.15.103:0/3178511333 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x556abdbd0330 con 0x556abde37ac0 2024-09-10T22:46:08.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4114c00640 1 -- 172.21.15.103:0/3178511333 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7f41200b5050 con 0x556abde37ac0 2024-09-10T22:46:08.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4131651000 10 client.8832 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:08.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4131651000 10 client.8832 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T22:46:08.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4131651000 20 client.8832 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:08.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4131651000 1 --2- 172.21.15.103:0/3178511333 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x556abde46900 0x556abde48cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4131651000 4 client.8832 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:46:08.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4131651000 1 -- 172.21.15.103:0/3178511333 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556abdc4aae0 con 0x556abde46900 2024-09-10T22:46:08.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4127400640 1 --2- 172.21.15.103:0/3178511333 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x556abde46900 0x556abde48cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4127400640 1 --2- 172.21.15.103:0/3178511333 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x556abde46900 0x556abde48cf0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65cf60d60c813089 server_cookie=eec22e44e1d275fd in_seq=0 out_seq=0 2024-09-10T22:46:08.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4114c00640 10 client.8832 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:08.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4114c00640 1 -- 172.21.15.103:0/3178511333 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556abdc4aae0 con 0x556abde46900 2024-09-10T22:46:08.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4114c00640 10 client.8832 handle_command_reply: tid=0 2024-09-10T22:46:08.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4131651000 1 client.8832 shutdown 2024-09-10T22:46:08.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.748+0000 7f4131651000 1 -- 172.21.15.103:0/3178511333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abde37ac0 msgr2=0x556abde3efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.752+0000 7f4131651000 1 --2- 172.21.15.103:0/3178511333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abde37ac0 0x556abde3efb0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f4120009850 tx=0x7f4120004400 comp rx=0 tx=0).stop 2024-09-10T22:46:08.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.752+0000 7f4131651000 1 -- 172.21.15.103:0/3178511333 shutdown_connections 2024-09-10T22:46:08.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.752+0000 7f4131651000 1 --2- 172.21.15.103:0/3178511333 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x556abde46900 0x556abde48cf0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.752+0000 7f4131651000 1 --2- 172.21.15.103:0/3178511333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abde37ac0 0x556abde3efb0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.752+0000 7f4131651000 1 --2- 172.21.15.103:0/3178511333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde371a0 0x556abde3ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.752+0000 7f4131651000 1 --2- 172.21.15.103:0/3178511333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddedbc0 0x556abde3e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.752+0000 7f4114c00640 0 client.8832 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:08.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.752+0000 7f4131651000 1 -- 172.21.15.103:0/3178511333 >> 172.21.15.103:0/3178511333 conn(0x556abddf3d20 msgr2=0x556abddebf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.752+0000 7f4131651000 1 -- 172.21.15.103:0/3178511333 shutdown_connections 2024-09-10T22:46:08.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.752+0000 7f4131651000 1 -- 172.21.15.103:0/3178511333 wait complete. 2024-09-10T22:46:08.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.752+0000 7f4131651000 20 client.8832 trim_cache size 0 max 16384 2024-09-10T22:46:08.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4131651000 1 Processor -- start 2024-09-10T22:46:08.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4131651000 1 -- start start 2024-09-10T22:46:08.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4131651000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abddedbc0 0x556abde44bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4131651000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde371a0 0x556abdded070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4131651000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abde37ac0 0x556abdded5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4131651000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4128204370 con 0x556abddedbc0 2024-09-10T22:46:08.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4131651000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4128203510 con 0x556abde37ac0 2024-09-10T22:46:08.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4131651000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4128203c40 con 0x556abde371a0 2024-09-10T22:46:08.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4127400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abddedbc0 0x556abde44bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4127400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abddedbc0 0x556abde44bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58378/0 (socket says 172.21.15.103:58378) 2024-09-10T22:46:08.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4127400640 1 -- 172.21.15.103:0/678554001 learned_addr learned my addr 172.21.15.103:0/678554001 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4127e00640 1 --2- 172.21.15.103:0/678554001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abde37ac0 0x556abdded5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f411ea00640 1 --2- 172.21.15.103:0/678554001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde371a0 0x556abdded070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4127400640 1 -- 172.21.15.103:0/678554001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde371a0 msgr2=0x556abdded070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4127400640 1 --2- 172.21.15.103:0/678554001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde371a0 0x556abdded070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4127400640 1 -- 172.21.15.103:0/678554001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abde37ac0 msgr2=0x556abdded5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4127400640 1 --2- 172.21.15.103:0/678554001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abde37ac0 0x556abdded5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4127400640 1 -- 172.21.15.103:0/678554001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556abdc95660 con 0x556abddedbc0 2024-09-10T22:46:08.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4127400640 1 --2- 172.21.15.103:0/678554001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abddedbc0 0x556abde44bb0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f4118009870 tx=0x7f4118013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff1b54f8ba9dfbd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4117400640 1 -- 172.21.15.103:0/678554001 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118003b80 con 0x556abddedbc0 2024-09-10T22:46:08.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4117400640 1 -- 172.21.15.103:0/678554001 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4118003d20 con 0x556abddedbc0 2024-09-10T22:46:08.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.768+0000 7f4117400640 1 -- 172.21.15.103:0/678554001 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411801ebc0 con 0x556abddedbc0 2024-09-10T22:46:08.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 -- 172.21.15.103:0/678554001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abddedbc0 msgr2=0x556abde44bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 --2- 172.21.15.103:0/678554001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abddedbc0 0x556abde44bb0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f4118009870 tx=0x7f4118013000 comp rx=0 tx=0).stop 2024-09-10T22:46:08.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 -- 172.21.15.103:0/678554001 shutdown_connections 2024-09-10T22:46:08.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 --2- 172.21.15.103:0/678554001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abde37ac0 0x556abdded5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 --2- 172.21.15.103:0/678554001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde371a0 0x556abdded070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 --2- 172.21.15.103:0/678554001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abddedbc0 0x556abde44bb0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 -- 172.21.15.103:0/678554001 >> 172.21.15.103:0/678554001 conn(0x556abddf3d20 msgr2=0x556abddec960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 -- 172.21.15.103:0/678554001 shutdown_connections 2024-09-10T22:46:08.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 -- 172.21.15.103:0/678554001 wait complete. 2024-09-10T22:46:08.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 -- start start 2024-09-10T22:46:08.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 Processor -- start 2024-09-10T22:46:08.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddedbc0 0x556abde44200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abde371a0 0x556abde44740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde37ac0 0x556abde69210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556abdc3bdd0 con 0x556abde371a0 2024-09-10T22:46:08.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x556abddf6d40 con 0x556abddedbc0 2024-09-10T22:46:08.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x556abddf4100 con 0x556abde37ac0 2024-09-10T22:46:08.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 10 client.0 _ll_register_callbacks cb 0x7f411000cf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:08.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f411ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abde371a0 0x556abde44740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f411ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abde371a0 0x556abde44740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58382/0 (socket says 172.21.15.103:58382) 2024-09-10T22:46:08.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f411ea00640 1 -- 172.21.15.103:0/40162167 learned_addr learned my addr 172.21.15.103:0/40162167 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4127e00640 1 --2- 172.21.15.103:0/40162167 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde37ac0 0x556abde69210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4127400640 1 --2- 172.21.15.103:0/40162167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddedbc0 0x556abde44200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f411ea00640 1 -- 172.21.15.103:0/40162167 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde37ac0 msgr2=0x556abde69210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f411ea00640 1 --2- 172.21.15.103:0/40162167 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde37ac0 0x556abde69210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f411ea00640 1 -- 172.21.15.103:0/40162167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddedbc0 msgr2=0x556abde44200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:08.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f411ea00640 1 --2- 172.21.15.103:0/40162167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddedbc0 0x556abde44200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f411ea00640 1 -- 172.21.15.103:0/40162167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556abdc02090 con 0x556abde371a0 2024-09-10T22:46:08.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f411ea00640 1 --2- 172.21.15.103:0/40162167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abde371a0 0x556abde44740 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f4110092280 tx=0x7f411005e780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3846f4e593d4f7dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4114c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:08.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4114c00640 1 -- 172.21.15.103:0/40162167 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411005ed30 con 0x556abde371a0 2024-09-10T22:46:08.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4114c00640 1 -- 172.21.15.103:0/40162167 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f411008ccb0 con 0x556abde371a0 2024-09-10T22:46:08.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 -- 172.21.15.103:0/40162167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4118003d20 con 0x556abde371a0 2024-09-10T22:46:08.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4114c00640 1 -- 172.21.15.103:0/40162167 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f411008ceb0 con 0x556abde371a0 2024-09-10T22:46:08.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 10 client.8838 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:08.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.772+0000 7f4131651000 1 -- 172.21.15.103:0/40162167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x556abdbce5f0 con 0x556abde371a0 2024-09-10T22:46:08.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4114c00640 1 -- 172.21.15.103:0/40162167 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4118003d20 con 0x556abde371a0 2024-09-10T22:46:08.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4114c00640 1 -- 172.21.15.103:0/40162167 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7f4110078bc0 con 0x556abde371a0 2024-09-10T22:46:08.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4131651000 10 client.8838 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:08.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4131651000 10 client.8838 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T22:46:08.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4131651000 20 client.8838 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:08.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4131651000 1 --2- 172.21.15.103:0/40162167 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x556abdeac640 0x556abdeaca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4131651000 4 client.8838 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:46:08.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4131651000 1 -- 172.21.15.103:0/40162167 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556abdc46590 con 0x556abdeac640 2024-09-10T22:46:08.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4127400640 1 --2- 172.21.15.103:0/40162167 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x556abdeac640 0x556abdeaca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4127400640 1 --2- 172.21.15.103:0/40162167 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x556abdeac640 0x556abdeaca50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9c7c57f8dd2b4d2 server_cookie=7329288bd9a71ad7 in_seq=0 out_seq=0 2024-09-10T22:46:08.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4114c00640 10 client.8838 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:08.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4114c00640 1 -- 172.21.15.103:0/40162167 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x556abdc46590 con 0x556abdeac640 2024-09-10T22:46:08.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4114c00640 10 client.8838 handle_command_reply: tid=0 2024-09-10T22:46:08.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4131651000 1 client.8838 shutdown 2024-09-10T22:46:08.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4131651000 1 -- 172.21.15.103:0/40162167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abde371a0 msgr2=0x556abde44740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4131651000 1 --2- 172.21.15.103:0/40162167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abde371a0 0x556abde44740 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f4110092280 tx=0x7f411005e780 comp rx=0 tx=0).stop 2024-09-10T22:46:08.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4131651000 1 -- 172.21.15.103:0/40162167 shutdown_connections 2024-09-10T22:46:08.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4131651000 1 --2- 172.21.15.103:0/40162167 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x556abdeac640 0x556abdeaca50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4131651000 1 --2- 172.21.15.103:0/40162167 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556abde37ac0 0x556abde69210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4131651000 1 --2- 172.21.15.103:0/40162167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556abde371a0 0x556abde44740 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4114c00640 0 client.8838 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:08.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4131651000 1 --2- 172.21.15.103:0/40162167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddedbc0 0x556abde44200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4131651000 1 -- 172.21.15.103:0/40162167 >> 172.21.15.103:0/40162167 conn(0x556abddf3d20 msgr2=0x556abdded180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4131651000 1 -- 172.21.15.103:0/40162167 shutdown_connections 2024-09-10T22:46:08.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4131651000 1 -- 172.21.15.103:0/40162167 wait complete. 2024-09-10T22:46:08.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f4131651000 20 client.8838 trim_cache size 0 max 16384 2024-09-10T22:46:08.781 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:08.781 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-10T22:46:08.781 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-09-10T22:46:08.781 INFO:teuthology.orchestra.run.smithi103.stdout: "13d979f1-0660-40c8-9ef3-e228e32f6cb4": { 2024-09-10T22:46:08.781 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:46:08.781 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "13d979f1-0660-40c8-9ef3-e228e32f6cb4", 2024-09-10T22:46:08.781 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-09-10T22:46:08.781 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:46:08.781 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T22:46:08.781 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_stats": { 2024-09-10T22:46:08.781 INFO:teuthology.orchestra.run.smithi103.stdout: "13d979f1-0660-40c8-9ef3-e228e32f6cb4": { 2024-09-10T22:46:08.781 INFO:teuthology.orchestra.run.smithi103.stdout: "start_time": "2024-09-10T22:45:58.592812+0000", 2024-09-10T22:46:08.781 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:46:08.782 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_started": 0, 2024-09-10T22:46:08.782 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_passed": 0, 2024-09-10T22:46:08.782 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_failed": 0, 2024-09-10T22:46:08.782 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_skipped": 0 2024-09-10T22:46:08.782 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:46:08.782 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:46:08.782 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:08.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f412cc00640 1 -- 172.21.15.103:0/698309758 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f41040725e0 msgr2=0x7f4104074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f412cc00640 1 --2- 172.21.15.103:0/698309758 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f41040725e0 0x7f4104074aa0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4118009eb0 tx=0x7f4118009500 comp rx=0 tx=0).stop 2024-09-10T22:46:08.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f412cc00640 1 -- 172.21.15.103:0/698309758 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41280d04a0 msgr2=0x7f412806dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f412cc00640 1 --2- 172.21.15.103:0/698309758 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41280d04a0 0x7f412806dfc0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f411000e9f0 tx=0x7f411000eeb0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f412cc00640 1 -- 172.21.15.103:0/698309758 shutdown_connections 2024-09-10T22:46:08.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f412cc00640 1 --2- 172.21.15.103:0/698309758 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f41040725e0 0x7f4104074aa0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f412cc00640 1 --2- 172.21.15.103:0/698309758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f412815f0e0 0x7f412806e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f412cc00640 1 --2- 172.21.15.103:0/698309758 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41280d04a0 0x7f412806dfc0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f412cc00640 1 --2- 172.21.15.103:0/698309758 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41280714d0 0x7f41281f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f412cc00640 1 -- 172.21.15.103:0/698309758 >> 172.21.15.103:0/698309758 conn(0x7f41280d18f0 msgr2=0x7f41280afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f412cc00640 1 -- 172.21.15.103:0/698309758 shutdown_connections 2024-09-10T22:46:08.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.776+0000 7f412cc00640 1 -- 172.21.15.103:0/698309758 wait complete. 2024-09-10T22:46:08.796 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:46:08.796 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:46:08.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.940+0000 7fdba0800640 1 -- 172.21.15.103:0/867711552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb80004810 msgr2=0x7fdb80004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.940+0000 7fdba0800640 1 --2- 172.21.15.103:0/867711552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb80004810 0x7fdb80004c90 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fdb880016c0 tx=0x7fdb8801c710 comp rx=0 tx=0).stop 2024-09-10T22:46:08.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.940+0000 7fdba0800640 1 -- 172.21.15.103:0/867711552 shutdown_connections 2024-09-10T22:46:08.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.940+0000 7fdba0800640 1 --2- 172.21.15.103:0/867711552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb80004810 0x7fdb80004c90 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.940+0000 7fdba0800640 1 -- 172.21.15.103:0/867711552 >> 172.21.15.103:0/867711552 conn(0x7fdb980d1ac0 msgr2=0x7fdb980d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:08.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.940+0000 7fdba0800640 1 -- 172.21.15.103:0/867711552 shutdown_connections 2024-09-10T22:46:08.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.940+0000 7fdba0800640 1 -- 172.21.15.103:0/867711552 wait complete. 2024-09-10T22:46:08.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdba0800640 1 Processor -- start 2024-09-10T22:46:08.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdba0800640 1 -- start start 2024-09-10T22:46:08.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdba0800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb80004810 0x7fdb980c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdba0800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb980b5320 0x7fdb980b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdba0800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb980b2630 0x7fdb980b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdba0800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdb980cec60 con 0x7fdb80004810 2024-09-10T22:46:08.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdba0800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdb980ceae0 con 0x7fdb980b2630 2024-09-10T22:46:08.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdba0800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdb980ae9c0 con 0x7fdb980b5320 2024-09-10T22:46:08.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdb9de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb80004810 0x7fdb980c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdb9de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb80004810 0x7fdb980c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58412/0 (socket says 172.21.15.103:58412) 2024-09-10T22:46:08.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdb9de00640 1 -- 172.21.15.103:0/1094473173 learned_addr learned my addr 172.21.15.103:0/1094473173 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:08.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdb9d400640 1 --2- 172.21.15.103:0/1094473173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb980b5320 0x7fdb980b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdb9de00640 1 -- 172.21.15.103:0/1094473173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb980b5320 msgr2=0x7fdb980b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdb9de00640 1 --2- 172.21.15.103:0/1094473173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb980b5320 0x7fdb980b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdb9e800640 1 --2- 172.21.15.103:0/1094473173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb980b2630 0x7fdb980b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdb9de00640 1 -- 172.21.15.103:0/1094473173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb980b2630 msgr2=0x7fdb980b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:08.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdb9de00640 1 --2- 172.21.15.103:0/1094473173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb980b2630 0x7fdb980b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:08.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdb9de00640 1 -- 172.21.15.103:0/1094473173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb980b6e80 con 0x7fdb80004810 2024-09-10T22:46:08.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdb9d400640 1 --2- 172.21.15.103:0/1094473173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb980b5320 0x7fdb980b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:08.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdb9e800640 1 --2- 172.21.15.103:0/1094473173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb980b2630 0x7fdb980b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:08.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdb9de00640 1 --2- 172.21.15.103:0/1094473173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb80004810 0x7fdb980c49c0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0066b0 tx=0x7fdb8c0039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdb92000640 1 -- 172.21.15.103:0/1094473173 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c015070 con 0x7fdb80004810 2024-09-10T22:46:08.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdb92000640 1 -- 172.21.15.103:0/1094473173 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb8c011900 con 0x7fdb80004810 2024-09-10T22:46:08.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdba0800640 1 -- 172.21.15.103:0/1094473173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb980b5de0 con 0x7fdb80004810 2024-09-10T22:46:08.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdb92000640 1 -- 172.21.15.103:0/1094473173 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c011d50 con 0x7fdb80004810 2024-09-10T22:46:08.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdba0800640 1 -- 172.21.15.103:0/1094473173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb980b63a0 con 0x7fdb80004810 2024-09-10T22:46:08.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.944+0000 7fdba0800640 1 -- 172.21.15.103:0/1094473173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb980cede0 con 0x7fdb80004810 2024-09-10T22:46:08.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.948+0000 7fdb92000640 1 -- 172.21.15.103:0/1094473173 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdb8c010420 con 0x7fdb80004810 2024-09-10T22:46:08.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.948+0000 7fdb92000640 1 --2- 172.21.15.103:0/1094473173 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdb7c072610 0x7fdb7c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:08.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.948+0000 7fdb92000640 1 -- 172.21.15.103:0/1094473173 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fdb8c0944b0 con 0x7fdb80004810 2024-09-10T22:46:08.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.948+0000 7fdb9d400640 1 --2- 172.21.15.103:0/1094473173 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdb7c072610 0x7fdb7c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:08.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.948+0000 7fdb9d400640 1 --2- 172.21.15.103:0/1094473173 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdb7c072610 0x7fdb7c074ad0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fdb800057f0 tx=0x7fdb88019500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:08.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:08.952+0000 7fdb92000640 1 -- 172.21.15.103:0/1094473173 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdb8c05f9b0 con 0x7fdb80004810 2024-09-10T22:46:09.130 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-10T22:46:09.128+0000 7fb5aec00640 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-10T22:46:09.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.152+0000 7fdba0800640 1 -- 172.21.15.103:0/1094473173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb98070bf0 con 0x7fdb80004810 2024-09-10T22:46:09.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.156+0000 7fdb92000640 1 -- 172.21.15.103:0/1094473173 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5287 (secure 0 0 0) 0x7fdb8c05f2b0 con 0x7fdb80004810 2024-09-10T22:46:09.155 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:09.155 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:46:01.549542+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8238,"mds_1":8235,"mds_2":7717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7717":{"gid":7717,"name":"b","rank":2,"incarnation":111,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8235":{"gid":8235,"name":"a","rank":1,"incarnation":109,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238,8235,7717]},"id":7}]} 2024-09-10T22:46:09.156 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 117 2024-09-10T22:46:09.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.156+0000 7fdba0800640 1 -- 172.21.15.103:0/1094473173 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdb7c072610 msgr2=0x7fdb7c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.156+0000 7fdba0800640 1 --2- 172.21.15.103:0/1094473173 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdb7c072610 0x7fdb7c074ad0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fdb800057f0 tx=0x7fdb88019500 comp rx=0 tx=0).stop 2024-09-10T22:46:09.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.156+0000 7fdba0800640 1 -- 172.21.15.103:0/1094473173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb80004810 msgr2=0x7fdb980c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.156+0000 7fdba0800640 1 --2- 172.21.15.103:0/1094473173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb80004810 0x7fdb980c49c0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0066b0 tx=0x7fdb8c0039d0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.156+0000 7fdba0800640 1 -- 172.21.15.103:0/1094473173 shutdown_connections 2024-09-10T22:46:09.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.156+0000 7fdba0800640 1 --2- 172.21.15.103:0/1094473173 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fdb7c072610 0x7fdb7c074ad0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.156+0000 7fdba0800640 1 --2- 172.21.15.103:0/1094473173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb980b2630 0x7fdb980b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.156+0000 7fdba0800640 1 --2- 172.21.15.103:0/1094473173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb980b5320 0x7fdb980b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.156+0000 7fdba0800640 1 --2- 172.21.15.103:0/1094473173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb80004810 0x7fdb980c49c0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.156+0000 7fdba0800640 1 -- 172.21.15.103:0/1094473173 >> 172.21.15.103:0/1094473173 conn(0x7fdb980d1ac0 msgr2=0x7fdb980aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:09.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.156+0000 7fdba0800640 1 -- 172.21.15.103:0/1094473173 shutdown_connections 2024-09-10T22:46:09.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.156+0000 7fdba0800640 1 -- 172.21.15.103:0/1094473173 wait complete. 2024-09-10T22:46:09.177 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'b'] 2024-09-10T22:46:09.177 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:46:09.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.316+0000 7fb053800640 1 -- 172.21.15.103:0/2905347093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb04c0ae9c0 msgr2=0x7fb04c0aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.316+0000 7fb053800640 1 --2- 172.21.15.103:0/2905347093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb04c0ae9c0 0x7fb04c0aee50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb044009c80 tx=0x7fb04401cd10 comp rx=0 tx=0).stop 2024-09-10T22:46:09.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.316+0000 7fb053800640 1 -- 172.21.15.103:0/2905347093 shutdown_connections 2024-09-10T22:46:09.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.316+0000 7fb053800640 1 --2- 172.21.15.103:0/2905347093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb04c0ae9c0 0x7fb04c0aee50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.316+0000 7fb053800640 1 --2- 172.21.15.103:0/2905347093 >> v2:172.21.15.131:3300/0 conn(0x7fb04c15be30 0x7fb04c0ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.316+0000 7fb053800640 1 -- 172.21.15.103:0/2905347093 >> 172.21.15.103:0/2905347093 conn(0x7fb04c0d1ac0 msgr2=0x7fb04c0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:09.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.316+0000 7fb053800640 1 -- 172.21.15.103:0/2905347093 shutdown_connections 2024-09-10T22:46:09.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.316+0000 7fb053800640 1 -- 172.21.15.103:0/2905347093 wait complete. 2024-09-10T22:46:09.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb053800640 1 Processor -- start 2024-09-10T22:46:09.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb053800640 1 -- start start 2024-09-10T22:46:09.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb053800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c0ae9c0 0x7fb04c14baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb053800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb04c0b09c0 0x7fb04c1f81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb053800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb04c15be30 0x7fb04c1547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb053800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c168df0 con 0x7fb04c0ae9c0 2024-09-10T22:46:09.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb053800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c168c70 con 0x7fb04c15be30 2024-09-10T22:46:09.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb053800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb04c168f70 con 0x7fb04c0b09c0 2024-09-10T22:46:09.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb050e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c0ae9c0 0x7fb04c14baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb050e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c0ae9c0 0x7fb04c14baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58426/0 (socket says 172.21.15.103:58426) 2024-09-10T22:46:09.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb050e00640 1 -- 172.21.15.103:0/708707709 learned_addr learned my addr 172.21.15.103:0/708707709 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:09.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb04be00640 1 --2- 172.21.15.103:0/708707709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb04c0b09c0 0x7fb04c1f81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb050e00640 1 -- 172.21.15.103:0/708707709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb04c0b09c0 msgr2=0x7fb04c1f81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb050e00640 1 --2- 172.21.15.103:0/708707709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb04c0b09c0 0x7fb04c1f81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb051800640 1 --2- 172.21.15.103:0/708707709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb04c15be30 0x7fb04c1547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb050e00640 1 -- 172.21.15.103:0/708707709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb04c15be30 msgr2=0x7fb04c1547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb050e00640 1 --2- 172.21.15.103:0/708707709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb04c15be30 0x7fb04c1547f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb050e00640 1 -- 172.21.15.103:0/708707709 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb04c154d30 con 0x7fb04c0ae9c0 2024-09-10T22:46:09.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb050e00640 1 --2- 172.21.15.103:0/708707709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c0ae9c0 0x7fb04c14baa0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fb04000e7a0 tx=0x7fb04000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:09.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb048c00640 1 -- 172.21.15.103:0/708707709 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04000ccc0 con 0x7fb04c0ae9c0 2024-09-10T22:46:09.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb048c00640 1 -- 172.21.15.103:0/708707709 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb040010430 con 0x7fb04c0ae9c0 2024-09-10T22:46:09.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb053800640 1 -- 172.21.15.103:0/708707709 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb04c06eee0 con 0x7fb04c0ae9c0 2024-09-10T22:46:09.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb048c00640 1 -- 172.21.15.103:0/708707709 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040010860 con 0x7fb04c0ae9c0 2024-09-10T22:46:09.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb053800640 1 -- 172.21.15.103:0/708707709 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb04c06f4a0 con 0x7fb04c0ae9c0 2024-09-10T22:46:09.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.320+0000 7fb053800640 1 -- 172.21.15.103:0/708707709 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb04c0aee50 con 0x7fb04c0ae9c0 2024-09-10T22:46:09.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.324+0000 7fb048c00640 1 -- 172.21.15.103:0/708707709 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb040010a00 con 0x7fb04c0ae9c0 2024-09-10T22:46:09.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.324+0000 7fb048c00640 1 --2- 172.21.15.103:0/708707709 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb02c072610 0x7fb02c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.324+0000 7fb048c00640 1 -- 172.21.15.103:0/708707709 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fb040093db0 con 0x7fb04c0ae9c0 2024-09-10T22:46:09.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.324+0000 7fb04be00640 1 --2- 172.21.15.103:0/708707709 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb02c072610 0x7fb02c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.324+0000 7fb04be00640 1 --2- 172.21.15.103:0/708707709 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb02c072610 0x7fb02c074ad0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb04c1593d0 tx=0x7fb038009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:09.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.328+0000 7fb048c00640 1 -- 172.21.15.103:0/708707709 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb04c154d30 con 0x7fb04c0ae9c0 2024-09-10T22:46:09.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.556+0000 7fb053800640 1 -- 172.21.15.103:0/708707709 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb04c155850 con 0x7fb04c0ae9c0 2024-09-10T22:46:09.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.556+0000 7fb048c00640 1 -- 172.21.15.103:0/708707709 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2010 (secure 0 0 0) 0x7fb04005f340 con 0x7fb04c0ae9c0 2024-09-10T22:46:09.556 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:09.556 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":465,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":695463,"bytes_used":267558912,"bytes_avail":772826554368,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":6483,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":7717},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8235},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8238}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-09-10T22:46:05.733362+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T22:46:09.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.556+0000 7fb053800640 1 -- 172.21.15.103:0/708707709 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb02c072610 msgr2=0x7fb02c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.556+0000 7fb053800640 1 --2- 172.21.15.103:0/708707709 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb02c072610 0x7fb02c074ad0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb04c1593d0 tx=0x7fb038009040 comp rx=0 tx=0).stop 2024-09-10T22:46:09.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.556+0000 7fb053800640 1 -- 172.21.15.103:0/708707709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c0ae9c0 msgr2=0x7fb04c14baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.556+0000 7fb053800640 1 --2- 172.21.15.103:0/708707709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c0ae9c0 0x7fb04c14baa0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fb04000e7a0 tx=0x7fb04000ec60 comp rx=0 tx=0).stop 2024-09-10T22:46:09.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.556+0000 7fb053800640 1 -- 172.21.15.103:0/708707709 shutdown_connections 2024-09-10T22:46:09.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.556+0000 7fb053800640 1 --2- 172.21.15.103:0/708707709 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb02c072610 0x7fb02c074ad0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.556+0000 7fb053800640 1 --2- 172.21.15.103:0/708707709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb04c15be30 0x7fb04c1547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.556+0000 7fb053800640 1 --2- 172.21.15.103:0/708707709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb04c0b09c0 0x7fb04c1f81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.556+0000 7fb053800640 1 --2- 172.21.15.103:0/708707709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c0ae9c0 0x7fb04c14baa0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.556+0000 7fb053800640 1 -- 172.21.15.103:0/708707709 >> 172.21.15.103:0/708707709 conn(0x7fb04c0d1ac0 msgr2=0x7fb04c0ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:09.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.556+0000 7fb053800640 1 -- 172.21.15.103:0/708707709 shutdown_connections 2024-09-10T22:46:09.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.556+0000 7fb053800640 1 -- 172.21.15.103:0/708707709 wait complete. 2024-09-10T22:46:09.576 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]', 'b': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]'} 2024-09-10T22:46:09.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:46:09.577 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub resume 2024-09-10T22:46:09.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.720+0000 7fedc9c00640 1 -- 172.21.15.103:0/1761859464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc40ae9c0 msgr2=0x7fedc40aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.720+0000 7fedc9c00640 1 --2- 172.21.15.103:0/1761859464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc40ae9c0 0x7fedc40aee10 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fedc40cbf40 tx=0x7fedbc01ccf0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.720+0000 7fedc9c00640 1 -- 172.21.15.103:0/1761859464 shutdown_connections 2024-09-10T22:46:09.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.720+0000 7fedc9c00640 1 --2- 172.21.15.103:0/1761859464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc40ae9c0 0x7fedc40aee10 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.720+0000 7fedc9c00640 1 --2- 172.21.15.103:0/1761859464 >> v2:172.21.15.131:3300/0 conn(0x7fedc40b09c0 0x7fedc40ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.720+0000 7fedc9c00640 1 -- 172.21.15.103:0/1761859464 >> 172.21.15.103:0/1761859464 conn(0x7fedc40d1ac0 msgr2=0x7fedc40d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:09.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.720+0000 7fedc9c00640 1 -- 172.21.15.103:0/1761859464 shutdown_connections 2024-09-10T22:46:09.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.720+0000 7fedc9c00640 1 -- 172.21.15.103:0/1761859464 wait complete. 2024-09-10T22:46:09.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.720+0000 7fedc9c00640 1 Processor -- start 2024-09-10T22:46:09.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.720+0000 7fedc9c00640 1 -- start start 2024-09-10T22:46:09.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.720+0000 7fedc9c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc40ae9c0 0x7fedc40c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.720+0000 7fedc9c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedc40b09c0 0x7fedc414d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.720+0000 7fedc9c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fedc415be30 0x7fedc40b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.720+0000 7fedc9c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fedc4168df0 con 0x7fedc40ae9c0 2024-09-10T22:46:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.720+0000 7fedc9c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fedc4168c70 con 0x7fedc40b09c0 2024-09-10T22:46:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.720+0000 7fedc9c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fedc4168f70 con 0x7fedc415be30 2024-09-10T22:46:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.724+0000 7fedc2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc40ae9c0 0x7fedc40c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.724+0000 7fedc2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc40ae9c0 0x7fedc40c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58442/0 (socket says 172.21.15.103:58442) 2024-09-10T22:46:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.724+0000 7fedc2a00640 1 -- 172.21.15.103:0/1340048508 learned_addr learned my addr 172.21.15.103:0/1340048508 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.724+0000 7fedc2000640 1 --2- 172.21.15.103:0/1340048508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedc40b09c0 0x7fedc414d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.724+0000 7fedc3400640 1 --2- 172.21.15.103:0/1340048508 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fedc415be30 0x7fedc40b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.724+0000 7fedc2a00640 1 -- 172.21.15.103:0/1340048508 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fedc415be30 msgr2=0x7fedc40b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.724+0000 7fedc2a00640 1 --2- 172.21.15.103:0/1340048508 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fedc415be30 0x7fedc40b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.724+0000 7fedc2a00640 1 -- 172.21.15.103:0/1340048508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedc40b09c0 msgr2=0x7fedc414d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.724+0000 7fedc2a00640 1 --2- 172.21.15.103:0/1340048508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedc40b09c0 0x7fedc414d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.724+0000 7fedc2a00640 1 -- 172.21.15.103:0/1340048508 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc40b07b0 con 0x7fedc40ae9c0 2024-09-10T22:46:09.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.724+0000 7fedc3400640 1 --2- 172.21.15.103:0/1340048508 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fedc415be30 0x7fedc40b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:09.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.724+0000 7fedc2a00640 1 --2- 172.21.15.103:0/1340048508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc40ae9c0 0x7fedc40c8b90 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fedb400c3f0 tx=0x7fedb400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:09.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.724+0000 7fedbaa00640 1 -- 172.21.15.103:0/1340048508 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb4017070 con 0x7fedc40ae9c0 2024-09-10T22:46:09.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.724+0000 7fedbaa00640 1 -- 172.21.15.103:0/1340048508 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedb40053c0 con 0x7fedc40ae9c0 2024-09-10T22:46:09.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.724+0000 7fedbaa00640 1 -- 172.21.15.103:0/1340048508 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb4003860 con 0x7fedc40ae9c0 2024-09-10T22:46:09.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.724+0000 7fedc9c00640 1 -- 172.21.15.103:0/1340048508 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc40b4d80 con 0x7fedc40ae9c0 2024-09-10T22:46:09.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.724+0000 7fedc9c00640 1 -- 172.21.15.103:0/1340048508 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc40b5340 con 0x7fedc40ae9c0 2024-09-10T22:46:09.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.724+0000 7fedbaa00640 1 -- 172.21.15.103:0/1340048508 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fedb4003a00 con 0x7fedc40ae9c0 2024-09-10T22:46:09.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedccf41000 1 Processor -- start 2024-09-10T22:46:09.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedbaa00640 1 --2- 172.21.15.103:0/1340048508 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feda40725e0 0x7feda4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedccf41000 1 -- start start 2024-09-10T22:46:09.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedbaa00640 1 -- 172.21.15.103:0/1340048508 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fedb40929f0 con 0x7fedc40ae9c0 2024-09-10T22:46:09.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedc3400640 1 --2- 172.21.15.103:0/1340048508 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feda40725e0 0x7feda4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedccf41000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f88301a0 0x55d3f8830580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedccf41000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 0x55d3f87e6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedccf41000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f87e6bc0 0x55d3f87e6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedccf41000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d3f86cecb0 con 0x55d3f8830ac0 2024-09-10T22:46:09.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedccf41000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d3f85e4310 con 0x55d3f87e6bc0 2024-09-10T22:46:09.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedccf41000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55d3f8641b90 con 0x55d3f88301a0 2024-09-10T22:46:09.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedc2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 0x55d3f87e6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedc2a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f88301a0 0x55d3f8830580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedc2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 0x55d3f87e6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58458/0 (socket says 172.21.15.103:58458) 2024-09-10T22:46:09.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedc2000640 1 -- 172.21.15.103:0/1893024504 learned_addr learned my addr 172.21.15.103:0/1893024504 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:09.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedc3400640 1 --2- 172.21.15.103:0/1340048508 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feda40725e0 0x7feda4074aa0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0af000 tx=0x7fedbc01b530 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:09.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedc3400640 1 --2- 172.21.15.103:0/1893024504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f87e6bc0 0x55d3f87e6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedc2000640 1 -- 172.21.15.103:0/1893024504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f88301a0 msgr2=0x55d3f8830580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:09.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedc2000640 1 --2- 172.21.15.103:0/1893024504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f88301a0 0x55d3f8830580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedc2000640 1 -- 172.21.15.103:0/1893024504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f87e6bc0 msgr2=0x55d3f87e6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:09.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedc2000640 1 --2- 172.21.15.103:0/1893024504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f87e6bc0 0x55d3f87e6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedc2000640 1 -- 172.21.15.103:0/1893024504 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3f85e5c60 con 0x55d3f8830ac0 2024-09-10T22:46:09.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedc2000640 1 --2- 172.21.15.103:0/1893024504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 0x55d3f87e6680 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009c30 tx=0x7fedb0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da6db1b145ad8ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:09.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedaf400640 1 -- 172.21.15.103:0/1893024504 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0004030 con 0x55d3f8830ac0 2024-09-10T22:46:09.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedaf400640 1 -- 172.21.15.103:0/1893024504 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedb00041d0 con 0x55d3f8830ac0 2024-09-10T22:46:09.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedaf400640 1 -- 172.21.15.103:0/1893024504 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0005020 con 0x55d3f8830ac0 2024-09-10T22:46:09.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedccf41000 1 -- 172.21.15.103:0/1893024504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 msgr2=0x55d3f87e6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedccf41000 1 --2- 172.21.15.103:0/1893024504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 0x55d3f87e6680 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009c30 tx=0x7fedb0011810 comp rx=0 tx=0).stop 2024-09-10T22:46:09.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedccf41000 1 -- 172.21.15.103:0/1893024504 shutdown_connections 2024-09-10T22:46:09.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedccf41000 1 --2- 172.21.15.103:0/1893024504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f87e6bc0 0x55d3f87e6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedccf41000 1 --2- 172.21.15.103:0/1893024504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 0x55d3f87e6680 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedccf41000 1 --2- 172.21.15.103:0/1893024504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f88301a0 0x55d3f8830580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedccf41000 1 -- 172.21.15.103:0/1893024504 >> 172.21.15.103:0/1893024504 conn(0x55d3f87ecd20 msgr2=0x55d3f87e4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:09.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedccf41000 1 -- 172.21.15.103:0/1893024504 shutdown_connections 2024-09-10T22:46:09.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.728+0000 7fedccf41000 1 -- 172.21.15.103:0/1893024504 wait complete. 2024-09-10T22:46:09.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedccf41000 1 -- start start 2024-09-10T22:46:09.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedccf41000 1 Processor -- start 2024-09-10T22:46:09.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedccf41000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f87e6bc0 0x55d3f8837530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedccf41000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f88301a0 0x55d3f8837a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedccf41000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 0x55d3f8837fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedccf41000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d3f8634dd0 con 0x55d3f8830ac0 2024-09-10T22:46:09.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedccf41000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d3f8630fc0 con 0x55d3f87e6bc0 2024-09-10T22:46:09.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedccf41000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55d3f85d64b0 con 0x55d3f88301a0 2024-09-10T22:46:09.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedccf41000 10 client.0 _ll_register_callbacks cb 0x55d3f85b47d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:09.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedc3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 0x55d3f8837fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedc3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 0x55d3f8837fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58470/0 (socket says 172.21.15.103:58470) 2024-09-10T22:46:09.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedc3400640 1 -- 172.21.15.103:0/1577071266 learned_addr learned my addr 172.21.15.103:0/1577071266 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:09.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedc2a00640 1 --2- 172.21.15.103:0/1577071266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f87e6bc0 0x55d3f8837530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedc2000640 1 --2- 172.21.15.103:0/1577071266 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f88301a0 0x55d3f8837a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedc3400640 1 -- 172.21.15.103:0/1577071266 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f88301a0 msgr2=0x55d3f8837a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:09.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedc3400640 1 --2- 172.21.15.103:0/1577071266 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f88301a0 0x55d3f8837a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedc3400640 1 -- 172.21.15.103:0/1577071266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f87e6bc0 msgr2=0x55d3f8837530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:09.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedc3400640 1 --2- 172.21.15.103:0/1577071266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f87e6bc0 0x55d3f8837530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedc3400640 1 -- 172.21.15.103:0/1577071266 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3f85cf1f0 con 0x55d3f8830ac0 2024-09-10T22:46:09.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedc3400640 1 --2- 172.21.15.103:0/1577071266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 0x55d3f8837fb0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0b0040 tx=0x7fedbc01ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6dd6df9ab4b8108 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:09.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7feda3e00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:09.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7feda3e00640 1 -- 172.21.15.103:0/1577071266 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedbc0be070 con 0x55d3f8830ac0 2024-09-10T22:46:09.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7feda3e00640 1 -- 172.21.15.103:0/1577071266 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fedbc004040 con 0x55d3f8830ac0 2024-09-10T22:46:09.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedccf41000 1 -- 172.21.15.103:0/1577071266 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d3f85c9330 con 0x55d3f8830ac0 2024-09-10T22:46:09.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7feda3e00640 1 -- 172.21.15.103:0/1577071266 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7fedbc0d1050 con 0x55d3f8830ac0 2024-09-10T22:46:09.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedccf41000 10 client.8859 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:09.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedccf41000 1 -- 172.21.15.103:0/1577071266 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55d3f85b5fa0 con 0x55d3f8830ac0 2024-09-10T22:46:09.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7feda3e00640 1 -- 172.21.15.103:0/1577071266 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55d3f85c9330 con 0x55d3f8830ac0 2024-09-10T22:46:09.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7feda3e00640 1 -- 172.21.15.103:0/1577071266 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7fedbc0d4020 con 0x55d3f8830ac0 2024-09-10T22:46:09.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedccf41000 10 client.8859 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:09.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedccf41000 10 client.8859 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T22:46:09.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedccf41000 20 client.8859 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:09.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedccf41000 1 --2- 172.21.15.103:0/1577071266 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55d3f883f900 0x55d3f8841cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedccf41000 4 client.8859 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:46:09.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedccf41000 1 -- 172.21.15.103:0/1577071266 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3f8643ae0 con 0x55d3f883f900 2024-09-10T22:46:09.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedc2a00640 1 --2- 172.21.15.103:0/1577071266 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55d3f883f900 0x55d3f8841cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7fedc2a00640 1 --2- 172.21.15.103:0/1577071266 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55d3f883f900 0x55d3f8841cf0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6afc615192c28c0b server_cookie=8a04bd8c525fc795 in_seq=0 out_seq=0 2024-09-10T22:46:09.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.732+0000 7feda3e00640 10 client.8859 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:09.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.736+0000 7feda3e00640 1 -- 172.21.15.103:0/1577071266 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d3f8643ae0 con 0x55d3f883f900 2024-09-10T22:46:09.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.736+0000 7feda3e00640 10 client.8859 handle_command_reply: tid=0 2024-09-10T22:46:09.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.736+0000 7fedccf41000 1 client.8859 shutdown 2024-09-10T22:46:09.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.736+0000 7fedccf41000 1 -- 172.21.15.103:0/1577071266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 msgr2=0x55d3f8837fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.736+0000 7fedccf41000 1 --2- 172.21.15.103:0/1577071266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 0x55d3f8837fb0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0b0040 tx=0x7fedbc01ccf0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.736+0000 7fedccf41000 1 -- 172.21.15.103:0/1577071266 shutdown_connections 2024-09-10T22:46:09.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.736+0000 7fedccf41000 1 --2- 172.21.15.103:0/1577071266 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55d3f883f900 0x55d3f8841cf0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.736+0000 7fedccf41000 1 --2- 172.21.15.103:0/1577071266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 0x55d3f8837fb0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.736+0000 7fedccf41000 1 --2- 172.21.15.103:0/1577071266 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f88301a0 0x55d3f8837a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.736+0000 7fedccf41000 1 --2- 172.21.15.103:0/1577071266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f87e6bc0 0x55d3f8837530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.736+0000 7feda3e00640 0 client.8859 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:09.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.736+0000 7fedccf41000 1 -- 172.21.15.103:0/1577071266 >> 172.21.15.103:0/1577071266 conn(0x55d3f87ecd20 msgr2=0x55d3f87e4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:09.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.736+0000 7fedccf41000 1 -- 172.21.15.103:0/1577071266 shutdown_connections 2024-09-10T22:46:09.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.736+0000 7fedccf41000 1 -- 172.21.15.103:0/1577071266 wait complete. 2024-09-10T22:46:09.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.736+0000 7fedccf41000 20 client.8859 trim_cache size 0 max 16384 2024-09-10T22:46:09.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.752+0000 7fedccf41000 1 Processor -- start 2024-09-10T22:46:09.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.752+0000 7fedccf41000 1 -- start start 2024-09-10T22:46:09.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.752+0000 7fedccf41000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f87e6bc0 0x55d3f88a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.752+0000 7fedccf41000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f88301a0 0x55d3f88a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.752+0000 7fedccf41000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f8830ac0 0x55d3f88a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.752+0000 7fedccf41000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fedc42048e0 con 0x55d3f88301a0 2024-09-10T22:46:09.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.752+0000 7fedccf41000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fedc4203a80 con 0x55d3f8830ac0 2024-09-10T22:46:09.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.752+0000 7fedccf41000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fedc42041b0 con 0x55d3f87e6bc0 2024-09-10T22:46:09.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.752+0000 7fedc2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f88301a0 0x55d3f88a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.752+0000 7fedc2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f88301a0 0x55d3f88a1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58472/0 (socket says 172.21.15.103:58472) 2024-09-10T22:46:09.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.752+0000 7fedc2000640 1 -- 172.21.15.103:0/3825144477 learned_addr learned my addr 172.21.15.103:0/3825144477 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:09.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.752+0000 7fedc2a00640 1 --2- 172.21.15.103:0/3825144477 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f87e6bc0 0x55d3f88a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.752+0000 7fedc3400640 1 --2- 172.21.15.103:0/3825144477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f8830ac0 0x55d3f88a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedc2000640 1 -- 172.21.15.103:0/3825144477 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f87e6bc0 msgr2=0x55d3f88a1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:09.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedc2000640 1 --2- 172.21.15.103:0/3825144477 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f87e6bc0 0x55d3f88a1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedc2000640 1 -- 172.21.15.103:0/3825144477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f8830ac0 msgr2=0x55d3f88a24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:09.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedc2000640 1 --2- 172.21.15.103:0/3825144477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f8830ac0 0x55d3f88a24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedc2000640 1 -- 172.21.15.103:0/3825144477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3f868e660 con 0x55d3f88301a0 2024-09-10T22:46:09.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedc2000640 1 --2- 172.21.15.103:0/3825144477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f88301a0 0x55d3f88a1f60 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x55d3f863c5e0 tx=0x7fedb00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af14a795adbcb27e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:09.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedaea00640 1 -- 172.21.15.103:0/3825144477 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0027070 con 0x55d3f88301a0 2024-09-10T22:46:09.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedaea00640 1 -- 172.21.15.103:0/3825144477 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedb0004250 con 0x55d3f88301a0 2024-09-10T22:46:09.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedaea00640 1 -- 172.21.15.103:0/3825144477 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0005020 con 0x55d3f88301a0 2024-09-10T22:46:09.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedccf41000 1 -- 172.21.15.103:0/3825144477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f88301a0 msgr2=0x55d3f88a1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedccf41000 1 --2- 172.21.15.103:0/3825144477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f88301a0 0x55d3f88a1f60 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x55d3f863c5e0 tx=0x7fedb00046d0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedccf41000 1 -- 172.21.15.103:0/3825144477 shutdown_connections 2024-09-10T22:46:09.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedccf41000 1 --2- 172.21.15.103:0/3825144477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f8830ac0 0x55d3f88a24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedccf41000 1 --2- 172.21.15.103:0/3825144477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f88301a0 0x55d3f88a1f60 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedccf41000 1 --2- 172.21.15.103:0/3825144477 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f87e6bc0 0x55d3f88a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedccf41000 1 -- 172.21.15.103:0/3825144477 >> 172.21.15.103:0/3825144477 conn(0x55d3f87ecd20 msgr2=0x55d3f87e8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:09.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedccf41000 1 -- 172.21.15.103:0/3825144477 shutdown_connections 2024-09-10T22:46:09.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedccf41000 1 -- 172.21.15.103:0/3825144477 wait complete. 2024-09-10T22:46:09.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedccf41000 1 -- start start 2024-09-10T22:46:09.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedccf41000 1 Processor -- start 2024-09-10T22:46:09.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedccf41000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f87e6bc0 0x55d3f8846660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedccf41000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f88301a0 0x55d3f8846ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedccf41000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 0x55d3f8862210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedccf41000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d3f8634dd0 con 0x55d3f8830ac0 2024-09-10T22:46:09.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedccf41000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55d3f862bec0 con 0x55d3f88301a0 2024-09-10T22:46:09.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedccf41000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55d3f87efd40 con 0x55d3f87e6bc0 2024-09-10T22:46:09.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedccf41000 10 client.0 _ll_register_callbacks cb 0x7fedbc0b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:09.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedc3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 0x55d3f8862210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedc2a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f87e6bc0 0x55d3f8846660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedc2a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f87e6bc0 0x55d3f8846660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:45358/0 (socket says 172.21.15.103:45358) 2024-09-10T22:46:09.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedc2000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f88301a0 0x55d3f8846ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedc2a00640 1 -- 172.21.15.103:0/1400281821 learned_addr learned my addr 172.21.15.103:0/1400281821 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:09.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedc2a00640 1 -- 172.21.15.103:0/1400281821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f88301a0 msgr2=0x55d3f8846ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:09.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedc2a00640 1 --2- 172.21.15.103:0/1400281821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f88301a0 0x55d3f8846ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedc2a00640 1 -- 172.21.15.103:0/1400281821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 msgr2=0x55d3f8862210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:09.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedc2a00640 1 --2- 172.21.15.103:0/1400281821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 0x55d3f8862210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedc2a00640 1 -- 172.21.15.103:0/1400281821 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55d3f85fb090 con 0x55d3f87e6bc0 2024-09-10T22:46:09.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.756+0000 7fedc3400640 1 --2- 172.21.15.103:0/1400281821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 0x55d3f8862210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:46:09.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedc2a00640 1 --2- 172.21.15.103:0/1400281821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f87e6bc0 0x55d3f8846660 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fedb405aa70 tx=0x7fedb4000bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7954b8feed29bb69 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:09.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7feda3e00640 10 client.0 ms_handle_connect on v2:172.21.15.131:3301/0 2024-09-10T22:46:09.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7feda3e00640 1 -- 172.21.15.103:0/1400281821 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb405cc60 con 0x55d3f87e6bc0 2024-09-10T22:46:09.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7feda3e00640 1 -- 172.21.15.103:0/1400281821 <== mon.2 v2:172.21.15.131:3301/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fedb4064430 con 0x55d3f87e6bc0 2024-09-10T22:46:09.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 1 -- 172.21.15.103:0/1400281821 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedb0004250 con 0x55d3f87e6bc0 2024-09-10T22:46:09.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7feda3e00640 1 -- 172.21.15.103:0/1400281821 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7fedb4064630 con 0x55d3f87e6bc0 2024-09-10T22:46:09.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 10 client.7442 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:09.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 1 -- 172.21.15.103:0/1400281821 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55d3f85c75f0 con 0x55d3f87e6bc0 2024-09-10T22:46:09.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7feda3e00640 1 -- 172.21.15.103:0/1400281821 <== mon.2 v2:172.21.15.131:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedb0004250 con 0x55d3f87e6bc0 2024-09-10T22:46:09.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7feda3e00640 1 -- 172.21.15.103:0/1400281821 <== mon.2 v2:172.21.15.131:3301/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7fedb4082b10 con 0x55d3f87e6bc0 2024-09-10T22:46:09.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 10 client.7442 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:09.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 10 client.7442 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T22:46:09.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 20 client.7442 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:09.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 1 --2- 172.21.15.103:0/1400281821 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55d3f88ab670 0x55d3f88ada60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 4 client.7442 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-10T22:46:09.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 1 -- 172.21.15.103:0/1400281821 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x55d3f863f590 con 0x55d3f88ab670 2024-09-10T22:46:09.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedc2000640 1 --2- 172.21.15.103:0/1400281821 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55d3f88ab670 0x55d3f88ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedc2000640 1 --2- 172.21.15.103:0/1400281821 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55d3f88ab670 0x55d3f88ada60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcca8bc8b81711f2 server_cookie=273f33f62fdc92aa in_seq=0 out_seq=0 2024-09-10T22:46:09.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7feda3e00640 10 client.7442 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:09.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7feda3e00640 1 -- 172.21.15.103:0/1400281821 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d3f863f590 con 0x55d3f88ab670 2024-09-10T22:46:09.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7feda3e00640 10 client.7442 handle_command_reply: tid=0 2024-09-10T22:46:09.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 1 client.7442 shutdown 2024-09-10T22:46:09.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 1 -- 172.21.15.103:0/1400281821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f87e6bc0 msgr2=0x55d3f8846660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 1 --2- 172.21.15.103:0/1400281821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f87e6bc0 0x55d3f8846660 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fedb405aa70 tx=0x7fedb4000bd0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 1 -- 172.21.15.103:0/1400281821 shutdown_connections 2024-09-10T22:46:09.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 1 --2- 172.21.15.103:0/1400281821 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x55d3f88ab670 0x55d3f88ada60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 1 --2- 172.21.15.103:0/1400281821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3f8830ac0 0x55d3f8862210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 1 --2- 172.21.15.103:0/1400281821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d3f88301a0 0x55d3f8846ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7feda3e00640 0 client.7442 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:09.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 1 --2- 172.21.15.103:0/1400281821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d3f87e6bc0 0x55d3f8846660 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 1 -- 172.21.15.103:0/1400281821 >> 172.21.15.103:0/1400281821 conn(0x55d3f87ecd20 msgr2=0x55d3f8841cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:09.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 1 -- 172.21.15.103:0/1400281821 shutdown_connections 2024-09-10T22:46:09.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 1 -- 172.21.15.103:0/1400281821 wait complete. 2024-09-10T22:46:09.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedccf41000 20 client.7442 trim_cache size 0 max 16384 2024-09-10T22:46:09.767 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:09.767 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0 2024-09-10T22:46:09.767 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:09.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedc9c00640 1 -- 172.21.15.103:0/1340048508 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feda40725e0 msgr2=0x7feda4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedc9c00640 1 --2- 172.21.15.103:0/1340048508 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feda40725e0 0x7feda4074aa0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0af000 tx=0x7fedbc01b530 comp rx=0 tx=0).stop 2024-09-10T22:46:09.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedc9c00640 1 -- 172.21.15.103:0/1340048508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc40ae9c0 msgr2=0x7fedc40c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedc9c00640 1 --2- 172.21.15.103:0/1340048508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc40ae9c0 0x7fedc40c8b90 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fedb400c3f0 tx=0x7fedb400c8b0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedc9c00640 1 -- 172.21.15.103:0/1340048508 shutdown_connections 2024-09-10T22:46:09.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedc9c00640 1 --2- 172.21.15.103:0/1340048508 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7feda40725e0 0x7feda4074aa0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedc9c00640 1 --2- 172.21.15.103:0/1340048508 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fedc415be30 0x7fedc40b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedc9c00640 1 --2- 172.21.15.103:0/1340048508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedc40b09c0 0x7fedc414d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedc9c00640 1 --2- 172.21.15.103:0/1340048508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc40ae9c0 0x7fedc40c8b90 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedc9c00640 1 -- 172.21.15.103:0/1340048508 >> 172.21.15.103:0/1340048508 conn(0x7fedc40d1ac0 msgr2=0x7fedc406eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:09.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedc9c00640 1 -- 172.21.15.103:0/1340048508 shutdown_connections 2024-09-10T22:46:09.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.760+0000 7fedc9c00640 1 -- 172.21.15.103:0/1340048508 wait complete. 2024-09-10T22:46:09.782 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:46:09.782 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:1 scrub status 2024-09-10T22:46:09.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f167ca00640 1 -- 172.21.15.103:0/1000422086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f165c003a60 msgr2=0x7f165c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f167ca00640 1 --2- 172.21.15.103:0/1000422086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f165c003a60 0x7f165c003e80 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f166800c260 tx=0x7f166801cf60 comp rx=0 tx=0).stop 2024-09-10T22:46:09.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f167ca00640 1 -- 172.21.15.103:0/1000422086 shutdown_connections 2024-09-10T22:46:09.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f167ca00640 1 --2- 172.21.15.103:0/1000422086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f165c003a60 0x7f165c003e80 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f167ca00640 1 -- 172.21.15.103:0/1000422086 >> 172.21.15.103:0/1000422086 conn(0x7f167806cc00 msgr2=0x7f167806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:09.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f167ca00640 1 -- 172.21.15.103:0/1000422086 shutdown_connections 2024-09-10T22:46:09.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f167ca00640 1 -- 172.21.15.103:0/1000422086 wait complete. 2024-09-10T22:46:09.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f167ca00640 1 Processor -- start 2024-09-10T22:46:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f167ca00640 1 -- start start 2024-09-10T22:46:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f167ca00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f165c003a60 0x7f16781ebeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f167ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16781e9e10 0x7f16781ea290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f167ca00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f167812cda0 0x7f167812d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f167ca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1678157530 con 0x7f16781e9e10 2024-09-10T22:46:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f167ca00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f16781573b0 con 0x7f167812cda0 2024-09-10T22:46:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f167ca00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f16781576b0 con 0x7f165c003a60 2024-09-10T22:46:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f166d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16781e9e10 0x7f16781ea290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f166d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16781e9e10 0x7f16781ea290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58494/0 (socket says 172.21.15.103:58494) 2024-09-10T22:46:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f166d400640 1 -- 172.21.15.103:0/192039394 learned_addr learned my addr 172.21.15.103:0/192039394 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f1675e00640 1 --2- 172.21.15.103:0/192039394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f165c003a60 0x7f16781ebeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f1676800640 1 --2- 172.21.15.103:0/192039394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f167812cda0 0x7f167812d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f166d400640 1 -- 172.21.15.103:0/192039394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f165c003a60 msgr2=0x7f16781ebeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f166d400640 1 --2- 172.21.15.103:0/192039394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f165c003a60 0x7f16781ebeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f166d400640 1 -- 172.21.15.103:0/192039394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f167812cda0 msgr2=0x7f167812d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f166d400640 1 --2- 172.21.15.103:0/192039394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f167812cda0 0x7f167812d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.928+0000 7f166d400640 1 -- 172.21.15.103:0/192039394 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16781ec600 con 0x7f16781e9e10 2024-09-10T22:46:09.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.932+0000 7f166d400640 1 --2- 172.21.15.103:0/192039394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16781e9e10 0x7f16781ea290 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f1660003860 tx=0x7f166000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:09.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.932+0000 7f166ea00640 1 -- 172.21.15.103:0/192039394 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166001c070 con 0x7f16781e9e10 2024-09-10T22:46:09.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.932+0000 7f166ea00640 1 -- 172.21.15.103:0/192039394 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1660003e40 con 0x7f16781e9e10 2024-09-10T22:46:09.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.932+0000 7f166ea00640 1 -- 172.21.15.103:0/192039394 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166000ed80 con 0x7f16781e9e10 2024-09-10T22:46:09.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.932+0000 7f167ca00640 1 -- 172.21.15.103:0/192039394 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16781ec8e0 con 0x7f16781e9e10 2024-09-10T22:46:09.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.932+0000 7f167ca00640 1 -- 172.21.15.103:0/192039394 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16781ecea0 con 0x7f16781e9e10 2024-09-10T22:46:09.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.932+0000 7f166ea00640 1 -- 172.21.15.103:0/192039394 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f166000b040 con 0x7f16781e9e10 2024-09-10T22:46:09.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.932+0000 7f166ea00640 1 --2- 172.21.15.103:0/192039394 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16540725e0 0x7f1654074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.932+0000 7f166ea00640 1 -- 172.21.15.103:0/192039394 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f16600933c0 con 0x7f16781e9e10 2024-09-10T22:46:09.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.932+0000 7f167fd4b000 1 Processor -- start 2024-09-10T22:46:09.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f167fd4b000 1 -- start start 2024-09-10T22:46:09.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f1675e00640 1 --2- 172.21.15.103:0/192039394 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16540725e0 0x7f1654074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f1675e00640 1 --2- 172.21.15.103:0/192039394 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16540725e0 0x7f1654074aa0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f16680ab000 tx=0x7f1668019da0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:09.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f167fd4b000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499b1a0 0x5567e499b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f167fd4b000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e499bac0 0x5567e4951680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f167fd4b000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5567e4951bc0 0x5567e4951fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f167fd4b000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5567e4839cb0 con 0x5567e499bac0 2024-09-10T22:46:09.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f167fd4b000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5567e474f310 con 0x5567e499b1a0 2024-09-10T22:46:09.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f167fd4b000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5567e47acb90 con 0x5567e4951bc0 2024-09-10T22:46:09.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f166d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e499bac0 0x5567e4951680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f166d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e499bac0 0x5567e4951680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58504/0 (socket says 172.21.15.103:58504) 2024-09-10T22:46:09.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f166d400640 1 -- 172.21.15.103:0/829088069 learned_addr learned my addr 172.21.15.103:0/829088069 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:09.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f1675e00640 1 --2- 172.21.15.103:0/829088069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499b1a0 0x5567e499b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f1676800640 1 --2- 172.21.15.103:0/829088069 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5567e4951bc0 0x5567e4951fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f166d400640 1 -- 172.21.15.103:0/829088069 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5567e4951bc0 msgr2=0x5567e4951fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:09.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f166d400640 1 --2- 172.21.15.103:0/829088069 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5567e4951bc0 0x5567e4951fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f166d400640 1 -- 172.21.15.103:0/829088069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499b1a0 msgr2=0x5567e499b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:09.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f166d400640 1 --2- 172.21.15.103:0/829088069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499b1a0 0x5567e499b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f166d400640 1 -- 172.21.15.103:0/829088069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567e4750c60 con 0x5567e499bac0 2024-09-10T22:46:09.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f166d400640 1 --2- 172.21.15.103:0/829088069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e499bac0 0x5567e4951680 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f166005ded0 tx=0x7f166005dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0383d9997e2276 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:09.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f1666a00640 1 -- 172.21.15.103:0/829088069 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660062c00 con 0x5567e499bac0 2024-09-10T22:46:09.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f1666a00640 1 -- 172.21.15.103:0/829088069 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1660067620 con 0x5567e499bac0 2024-09-10T22:46:09.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f1666a00640 1 -- 172.21.15.103:0/829088069 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166005a440 con 0x5567e499bac0 2024-09-10T22:46:09.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f167fd4b000 1 -- 172.21.15.103:0/829088069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e499bac0 msgr2=0x5567e4951680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f167fd4b000 1 --2- 172.21.15.103:0/829088069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e499bac0 0x5567e4951680 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f166005ded0 tx=0x7f166005dc20 comp rx=0 tx=0).stop 2024-09-10T22:46:09.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f167fd4b000 1 -- 172.21.15.103:0/829088069 shutdown_connections 2024-09-10T22:46:09.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f167fd4b000 1 --2- 172.21.15.103:0/829088069 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5567e4951bc0 0x5567e4951fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f167fd4b000 1 --2- 172.21.15.103:0/829088069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e499bac0 0x5567e4951680 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f167fd4b000 1 --2- 172.21.15.103:0/829088069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499b1a0 0x5567e499b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f167fd4b000 1 -- 172.21.15.103:0/829088069 >> 172.21.15.103:0/829088069 conn(0x5567e4957d20 msgr2=0x5567e494ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:09.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f167fd4b000 1 -- 172.21.15.103:0/829088069 shutdown_connections 2024-09-10T22:46:09.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f167fd4b000 1 -- 172.21.15.103:0/829088069 wait complete. 2024-09-10T22:46:09.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.936+0000 7f167fd4b000 1 -- start start 2024-09-10T22:46:09.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f167fd4b000 1 Processor -- start 2024-09-10T22:46:09.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f167fd4b000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e4951bc0 0x5567e49a2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f167fd4b000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5567e499b1a0 0x5567e49a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f167fd4b000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499bac0 0x5567e49a2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f167fd4b000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5567e479fdd0 con 0x5567e4951bc0 2024-09-10T22:46:09.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f167fd4b000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5567e479bfc0 con 0x5567e499bac0 2024-09-10T22:46:09.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f167fd4b000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5567e47414b0 con 0x5567e499b1a0 2024-09-10T22:46:09.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f167fd4b000 10 client.0 _ll_register_callbacks cb 0x5567e471f7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:09.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f1675e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e4951bc0 0x5567e49a2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f1675e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e4951bc0 0x5567e49a2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58506/0 (socket says 172.21.15.103:58506) 2024-09-10T22:46:09.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f1675e00640 1 -- 172.21.15.103:0/4136758808 learned_addr learned my addr 172.21.15.103:0/4136758808 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:09.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f1676800640 1 --2- 172.21.15.103:0/4136758808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499bac0 0x5567e49a2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f1675e00640 1 -- 172.21.15.103:0/4136758808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5567e499b1a0 msgr2=0x5567e49a2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:09.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f1675e00640 1 --2- 172.21.15.103:0/4136758808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5567e499b1a0 0x5567e49a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f1675e00640 1 -- 172.21.15.103:0/4136758808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499bac0 msgr2=0x5567e49a2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:09.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f1675e00640 1 --2- 172.21.15.103:0/4136758808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499bac0 0x5567e49a2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f1675e00640 1 -- 172.21.15.103:0/4136758808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567e473a1f0 con 0x5567e4951bc0 2024-09-10T22:46:09.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f1675e00640 1 --2- 172.21.15.103:0/4136758808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e4951bc0 0x5567e49a2530 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f166801ca20 tx=0x7f16680067b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ee05b105bb453 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:09.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f165b400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:09.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f165b400640 1 -- 172.21.15.103:0/4136758808 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668006560 con 0x5567e4951bc0 2024-09-10T22:46:09.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f167fd4b000 1 -- 172.21.15.103:0/4136758808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5567e4734330 con 0x5567e4951bc0 2024-09-10T22:46:09.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f165b400640 1 -- 172.21.15.103:0/4136758808 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f1668004b60 con 0x5567e4951bc0 2024-09-10T22:46:09.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f165b400640 1 -- 172.21.15.103:0/4136758808 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f1668004d60 con 0x5567e4951bc0 2024-09-10T22:46:09.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f167fd4b000 10 client.8877 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:09.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f167fd4b000 1 -- 172.21.15.103:0/4136758808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x5567e4720fa0 con 0x5567e4951bc0 2024-09-10T22:46:09.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f165b400640 1 -- 172.21.15.103:0/4136758808 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5567e4734330 con 0x5567e4951bc0 2024-09-10T22:46:09.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f165b400640 1 -- 172.21.15.103:0/4136758808 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7f16680b9460 con 0x5567e4951bc0 2024-09-10T22:46:09.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f167fd4b000 10 client.8877 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:09.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f167fd4b000 10 client.8877 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-10T22:46:09.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f167fd4b000 20 client.8877 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:09.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f167fd4b000 1 --2- 172.21.15.103:0/4136758808 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x5567e49aa900 0x5567e49accf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f167fd4b000 4 client.8877 mds_command: new command op to 8235 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:46:09.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f167fd4b000 1 -- 172.21.15.103:0/4136758808 --> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567e47aeae0 con 0x5567e49aa900 2024-09-10T22:46:09.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f166d400640 1 --2- 172.21.15.103:0/4136758808 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x5567e49aa900 0x5567e49accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f166d400640 1 --2- 172.21.15.103:0/4136758808 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x5567e49aa900 0x5567e49accf0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b2f715f22ba9f2b7 server_cookie=ee28cc18b83f4f02 in_seq=0 out_seq=0 2024-09-10T22:46:09.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.940+0000 7f165b400640 10 client.8877 ms_handle_connect on v2:172.21.15.103:6832/1191295180 2024-09-10T22:46:09.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.944+0000 7f165b400640 1 -- 172.21.15.103:0/4136758808 <== mds.1 v2:172.21.15.103:6832/1191295180 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5567e47aeae0 con 0x5567e49aa900 2024-09-10T22:46:09.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.944+0000 7f165b400640 10 client.8877 handle_command_reply: tid=0 2024-09-10T22:46:09.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.944+0000 7f167fd4b000 1 client.8877 shutdown 2024-09-10T22:46:09.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.944+0000 7f167fd4b000 1 -- 172.21.15.103:0/4136758808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e4951bc0 msgr2=0x5567e49a2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.944+0000 7f167fd4b000 1 --2- 172.21.15.103:0/4136758808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e4951bc0 0x5567e49a2530 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f166801ca20 tx=0x7f16680067b0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.944+0000 7f167fd4b000 1 -- 172.21.15.103:0/4136758808 shutdown_connections 2024-09-10T22:46:09.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.944+0000 7f167fd4b000 1 --2- 172.21.15.103:0/4136758808 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x5567e49aa900 0x5567e49accf0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.944+0000 7f167fd4b000 1 --2- 172.21.15.103:0/4136758808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499bac0 0x5567e49a2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.944+0000 7f167fd4b000 1 --2- 172.21.15.103:0/4136758808 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5567e499b1a0 0x5567e49a2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.944+0000 7f165b400640 0 client.8877 ms_handle_reset on v2:172.21.15.103:6832/1191295180 2024-09-10T22:46:09.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.944+0000 7f167fd4b000 1 --2- 172.21.15.103:0/4136758808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e4951bc0 0x5567e49a2530 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.944+0000 7f167fd4b000 1 -- 172.21.15.103:0/4136758808 >> 172.21.15.103:0/4136758808 conn(0x5567e4957d20 msgr2=0x5567e494ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:09.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.944+0000 7f167fd4b000 1 -- 172.21.15.103:0/4136758808 shutdown_connections 2024-09-10T22:46:09.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.944+0000 7f167fd4b000 1 -- 172.21.15.103:0/4136758808 wait complete. 2024-09-10T22:46:09.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.944+0000 7f167fd4b000 20 client.8877 trim_cache size 0 max 16384 2024-09-10T22:46:09.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.960+0000 7f167fd4b000 1 Processor -- start 2024-09-10T22:46:09.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.960+0000 7f167fd4b000 1 -- start start 2024-09-10T22:46:09.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.960+0000 7f167fd4b000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e4951bc0 0x5567e4951070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.960+0000 7f167fd4b000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5567e499b1a0 0x5567e49515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.960+0000 7f167fd4b000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499bac0 0x5567e49a5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.960+0000 7f167fd4b000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f16782054e0 con 0x5567e4951bc0 2024-09-10T22:46:09.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.960+0000 7f167fd4b000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f16782046e0 con 0x5567e499bac0 2024-09-10T22:46:09.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.960+0000 7f167fd4b000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1678204db0 con 0x5567e499b1a0 2024-09-10T22:46:09.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.960+0000 7f1675e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e4951bc0 0x5567e4951070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.960+0000 7f1675e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e4951bc0 0x5567e4951070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58510/0 (socket says 172.21.15.103:58510) 2024-09-10T22:46:09.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.960+0000 7f1675e00640 1 -- 172.21.15.103:0/3686113284 learned_addr learned my addr 172.21.15.103:0/3686113284 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:09.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.960+0000 7f1675e00640 1 -- 172.21.15.103:0/3686113284 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5567e499b1a0 msgr2=0x5567e49515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:09.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.960+0000 7f1675e00640 1 --2- 172.21.15.103:0/3686113284 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5567e499b1a0 0x5567e49515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.960+0000 7f1675e00640 1 -- 172.21.15.103:0/3686113284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499bac0 msgr2=0x5567e49a5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:09.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f1675e00640 1 --2- 172.21.15.103:0/3686113284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499bac0 0x5567e49a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f1675e00640 1 -- 172.21.15.103:0/3686113284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567e47f9660 con 0x5567e4951bc0 2024-09-10T22:46:09.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f1675e00640 1 --2- 172.21.15.103:0/3686113284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e4951bc0 0x5567e4951070 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f16680066f0 tx=0x7f1668006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd64d602f8acc90a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:09.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f1666000640 1 -- 172.21.15.103:0/3686113284 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16680dc070 con 0x5567e4951bc0 2024-09-10T22:46:09.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f1666000640 1 -- 172.21.15.103:0/3686113284 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16680b9e50 con 0x5567e4951bc0 2024-09-10T22:46:09.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f1666000640 1 -- 172.21.15.103:0/3686113284 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16680b9a00 con 0x5567e4951bc0 2024-09-10T22:46:09.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f167fd4b000 1 -- 172.21.15.103:0/3686113284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e4951bc0 msgr2=0x5567e4951070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f167fd4b000 1 --2- 172.21.15.103:0/3686113284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e4951bc0 0x5567e4951070 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f16680066f0 tx=0x7f1668006720 comp rx=0 tx=0).stop 2024-09-10T22:46:09.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f167fd4b000 1 -- 172.21.15.103:0/3686113284 shutdown_connections 2024-09-10T22:46:09.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f167fd4b000 1 --2- 172.21.15.103:0/3686113284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499bac0 0x5567e49a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f167fd4b000 1 --2- 172.21.15.103:0/3686113284 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5567e499b1a0 0x5567e49515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f167fd4b000 1 --2- 172.21.15.103:0/3686113284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e4951bc0 0x5567e4951070 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f167fd4b000 1 -- 172.21.15.103:0/3686113284 >> 172.21.15.103:0/3686113284 conn(0x5567e4957d20 msgr2=0x5567e4950960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:09.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f167fd4b000 1 -- 172.21.15.103:0/3686113284 shutdown_connections 2024-09-10T22:46:09.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f167fd4b000 1 -- 172.21.15.103:0/3686113284 wait complete. 2024-09-10T22:46:09.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f167fd4b000 1 -- start start 2024-09-10T22:46:09.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f167fd4b000 1 Processor -- start 2024-09-10T22:46:09.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f167fd4b000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5567e4951bc0 0x5567e49a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f167fd4b000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e499b1a0 0x5567e49a8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f167fd4b000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499bac0 0x5567e49cd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f167fd4b000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5567e479fdd0 con 0x5567e499b1a0 2024-09-10T22:46:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f167fd4b000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5567e495ad40 con 0x5567e499bac0 2024-09-10T22:46:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f167fd4b000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5567e4958100 con 0x5567e4951bc0 2024-09-10T22:46:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f167fd4b000 10 client.0 _ll_register_callbacks cb 0x7f165c0051d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f166d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e499b1a0 0x5567e49a8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f166d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e499b1a0 0x5567e49a8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58526/0 (socket says 172.21.15.103:58526) 2024-09-10T22:46:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f166d400640 1 -- 172.21.15.103:0/3394533737 learned_addr learned my addr 172.21.15.103:0/3394533737 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f1675e00640 1 --2- 172.21.15.103:0/3394533737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5567e4951bc0 0x5567e49a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f1676800640 1 --2- 172.21.15.103:0/3394533737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499bac0 0x5567e49cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f166d400640 1 -- 172.21.15.103:0/3394533737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5567e4951bc0 msgr2=0x5567e49a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f166d400640 1 --2- 172.21.15.103:0/3394533737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5567e4951bc0 0x5567e49a7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f166d400640 1 -- 172.21.15.103:0/3394533737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499bac0 msgr2=0x5567e49cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f166d400640 1 --2- 172.21.15.103:0/3394533737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499bac0 0x5567e49cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f166d400640 1 -- 172.21.15.103:0/3394533737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567e4766090 con 0x5567e499b1a0 2024-09-10T22:46:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f1676800640 1 --2- 172.21.15.103:0/3394533737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499bac0 0x5567e49cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f166d400640 1 --2- 172.21.15.103:0/3394533737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e499b1a0 0x5567e49a8500 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f166005e160 tx=0x7f166000e870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb04670df03921d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f165b400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.964+0000 7f165b400640 1 -- 172.21.15.103:0/3394533737 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660067620 con 0x5567e499b1a0 2024-09-10T22:46:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f165b400640 1 -- 172.21.15.103:0/3394533737 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f16600930b0 con 0x5567e499b1a0 2024-09-10T22:46:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 1 -- 172.21.15.103:0/3394533737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16680b9e50 con 0x5567e499b1a0 2024-09-10T22:46:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f165b400640 1 -- 172.21.15.103:0/3394533737 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f166005a440 con 0x5567e499b1a0 2024-09-10T22:46:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 10 client.8883 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 1 -- 172.21.15.103:0/3394533737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x5567e47325f0 con 0x5567e499b1a0 2024-09-10T22:46:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f165b400640 1 -- 172.21.15.103:0/3394533737 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16680b9e50 con 0x5567e499b1a0 2024-09-10T22:46:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f165b400640 1 -- 172.21.15.103:0/3394533737 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7f1660047be0 con 0x5567e499b1a0 2024-09-10T22:46:09.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 10 client.8883 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:09.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 10 client.8883 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-10T22:46:09.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 20 client.8883 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:09.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 1 --2- 172.21.15.103:0/3394533737 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x5567e49cdc00 0x5567e4a10a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:09.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 4 client.8883 mds_command: new command op to 8235 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:46:09.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 1 -- 172.21.15.103:0/3394533737 --> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5567e47aa590 con 0x5567e49cdc00 2024-09-10T22:46:09.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f1675e00640 1 --2- 172.21.15.103:0/3394533737 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x5567e49cdc00 0x5567e4a10a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:09.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f1675e00640 1 --2- 172.21.15.103:0/3394533737 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x5567e49cdc00 0x5567e4a10a60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e729c0ceafbf2671 server_cookie=671f8670f0ea61b0 in_seq=0 out_seq=0 2024-09-10T22:46:09.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f165b400640 10 client.8883 ms_handle_connect on v2:172.21.15.103:6832/1191295180 2024-09-10T22:46:09.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f165b400640 1 -- 172.21.15.103:0/3394533737 <== mds.1 v2:172.21.15.103:6832/1191295180 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5567e47aa590 con 0x5567e49cdc00 2024-09-10T22:46:09.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f165b400640 10 client.8883 handle_command_reply: tid=0 2024-09-10T22:46:09.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 1 client.8883 shutdown 2024-09-10T22:46:09.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 1 -- 172.21.15.103:0/3394533737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e499b1a0 msgr2=0x5567e49a8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 1 --2- 172.21.15.103:0/3394533737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e499b1a0 0x5567e49a8500 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f166005e160 tx=0x7f166000e870 comp rx=0 tx=0).stop 2024-09-10T22:46:09.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 1 -- 172.21.15.103:0/3394533737 shutdown_connections 2024-09-10T22:46:09.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 1 --2- 172.21.15.103:0/3394533737 >> [v2:172.21.15.103:6832/1191295180,v1:172.21.15.103:6833/1191295180] conn(0x5567e49cdc00 0x5567e4a10a60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 1 --2- 172.21.15.103:0/3394533737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5567e499bac0 0x5567e49cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 1 --2- 172.21.15.103:0/3394533737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5567e499b1a0 0x5567e49a8500 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f165b400640 0 client.8883 ms_handle_reset on v2:172.21.15.103:6832/1191295180 2024-09-10T22:46:09.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 1 --2- 172.21.15.103:0/3394533737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5567e4951bc0 0x5567e49a7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 1 -- 172.21.15.103:0/3394533737 >> 172.21.15.103:0/3394533737 conn(0x5567e4957d20 msgr2=0x5567e4951180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:09.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 1 -- 172.21.15.103:0/3394533737 shutdown_connections 2024-09-10T22:46:09.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 1 -- 172.21.15.103:0/3394533737 wait complete. 2024-09-10T22:46:09.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167fd4b000 20 client.8883 trim_cache size 0 max 16384 2024-09-10T22:46:09.975 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:09.975 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "no active scrubs running", 2024-09-10T22:46:09.975 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": {} 2024-09-10T22:46:09.975 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:09.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167ca00640 1 -- 172.21.15.103:0/192039394 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16540725e0 msgr2=0x7f1654074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167ca00640 1 --2- 172.21.15.103:0/192039394 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16540725e0 0x7f1654074aa0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f16680ab000 tx=0x7f1668019da0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167ca00640 1 -- 172.21.15.103:0/192039394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16781e9e10 msgr2=0x7f16781ea290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:09.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167ca00640 1 --2- 172.21.15.103:0/192039394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16781e9e10 0x7f16781ea290 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f1660003860 tx=0x7f166000cf90 comp rx=0 tx=0).stop 2024-09-10T22:46:09.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167ca00640 1 -- 172.21.15.103:0/192039394 shutdown_connections 2024-09-10T22:46:09.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167ca00640 1 --2- 172.21.15.103:0/192039394 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f16540725e0 0x7f1654074aa0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167ca00640 1 --2- 172.21.15.103:0/192039394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f167812cda0 0x7f167812d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167ca00640 1 --2- 172.21.15.103:0/192039394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16781e9e10 0x7f16781ea290 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167ca00640 1 --2- 172.21.15.103:0/192039394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f165c003a60 0x7f16781ebeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:09.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167ca00640 1 -- 172.21.15.103:0/192039394 >> 172.21.15.103:0/192039394 conn(0x7f167806cc00 msgr2=0x7f167806cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:09.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167ca00640 1 -- 172.21.15.103:0/192039394 shutdown_connections 2024-09-10T22:46:09.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:09.968+0000 7f167ca00640 1 -- 172.21.15.103:0/192039394 wait complete. 2024-09-10T22:46:09.988 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:46:10.446 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:46:10.446 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:2 scrub status 2024-09-10T22:46:10.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f4095a00640 1 -- 172.21.15.103:0/2435345293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40900d0640 msgr2=0x7f40900ce4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:10.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f4095a00640 1 --2- 172.21.15.103:0/2435345293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40900d0640 0x7f40900ce4c0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f4090073cc0 tx=0x7f408801ca30 comp rx=0 tx=0).stop 2024-09-10T22:46:10.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f4095a00640 1 -- 172.21.15.103:0/2435345293 shutdown_connections 2024-09-10T22:46:10.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f4095a00640 1 --2- 172.21.15.103:0/2435345293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40900d0640 0x7f40900ce4c0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f4095a00640 1 --2- 172.21.15.103:0/2435345293 >> v2:172.21.15.131:3300/0 conn(0x7f40900b2840 0x7f40900d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f4095a00640 1 --2- 172.21.15.103:0/2435345293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f409015f330 0x7f40900cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f4095a00640 1 -- 172.21.15.103:0/2435345293 >> 172.21.15.103:0/2435345293 conn(0x7f40900d1ab0 msgr2=0x7f40900d1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:10.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f4095a00640 1 -- 172.21.15.103:0/2435345293 shutdown_connections 2024-09-10T22:46:10.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f4095a00640 1 -- 172.21.15.103:0/2435345293 wait complete. 2024-09-10T22:46:10.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f4095a00640 1 Processor -- start 2024-09-10T22:46:10.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f4095a00640 1 -- start start 2024-09-10T22:46:10.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f4095a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40900b2840 0x7f409014eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f4095a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40900d0640 0x7f40900b6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f4095a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f409015f330 0x7f40900b6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f4095a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f40900cd220 con 0x7f40900b2840 2024-09-10T22:46:10.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f4095a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f40900cd0a0 con 0x7f40900d0640 2024-09-10T22:46:10.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f4095a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f40900cd3a0 con 0x7f409015f330 2024-09-10T22:46:10.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f408ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40900b2840 0x7f409014eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f408ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40900b2840 0x7f409014eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58532/0 (socket says 172.21.15.103:58532) 2024-09-10T22:46:10.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f408ea00640 1 -- 172.21.15.103:0/991630767 learned_addr learned my addr 172.21.15.103:0/991630767 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:10.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f408f400640 1 --2- 172.21.15.103:0/991630767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f409015f330 0x7f40900b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f408e000640 1 --2- 172.21.15.103:0/991630767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40900d0640 0x7f40900b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f408ea00640 1 -- 172.21.15.103:0/991630767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f409015f330 msgr2=0x7f40900b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:10.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f408ea00640 1 --2- 172.21.15.103:0/991630767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f409015f330 0x7f40900b6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f408ea00640 1 -- 172.21.15.103:0/991630767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40900d0640 msgr2=0x7f40900b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:10.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f408ea00640 1 --2- 172.21.15.103:0/991630767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40900d0640 0x7f40900b6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.592+0000 7f408ea00640 1 -- 172.21.15.103:0/991630767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40900b75e0 con 0x7f40900b2840 2024-09-10T22:46:10.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.596+0000 7f408ea00640 1 --2- 172.21.15.103:0/991630767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40900b2840 0x7f409014eb30 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f408000ca20 tx=0x7f408000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:10.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.596+0000 7f4086a00640 1 -- 172.21.15.103:0/991630767 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080007c70 con 0x7f40900b2840 2024-09-10T22:46:10.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.596+0000 7f4086a00640 1 -- 172.21.15.103:0/991630767 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f408000f450 con 0x7f40900b2840 2024-09-10T22:46:10.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.596+0000 7f4086a00640 1 -- 172.21.15.103:0/991630767 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408000f8a0 con 0x7f40900b2840 2024-09-10T22:46:10.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.596+0000 7f4095a00640 1 -- 172.21.15.103:0/991630767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40901565d0 con 0x7f40900b2840 2024-09-10T22:46:10.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.596+0000 7f4095a00640 1 -- 172.21.15.103:0/991630767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40901530b0 con 0x7f40900b2840 2024-09-10T22:46:10.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.596+0000 7f4086a00640 1 -- 172.21.15.103:0/991630767 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f408000fa40 con 0x7f40900b2840 2024-09-10T22:46:10.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4086a00640 1 --2- 172.21.15.103:0/991630767 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f40700725e0 0x7f4070074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4098d41000 1 Processor -- start 2024-09-10T22:46:10.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4086a00640 1 -- 172.21.15.103:0/991630767 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f4080093aa0 con 0x7f40900b2840 2024-09-10T22:46:10.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4098d41000 1 -- start start 2024-09-10T22:46:10.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f408e000640 1 --2- 172.21.15.103:0/991630767 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f40700725e0 0x7f4070074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f408e000640 1 --2- 172.21.15.103:0/991630767 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f40700725e0 0x7f4070074aa0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4090159610 tx=0x7f407c010040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:10.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4098d41000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 0x55cac53ac580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4098d41000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac53acac0 0x55cac5362680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4098d41000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac5362bc0 0x55cac5362fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4098d41000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cac524acb0 con 0x55cac53acac0 2024-09-10T22:46:10.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4098d41000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cac5160310 con 0x55cac5362bc0 2024-09-10T22:46:10.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4098d41000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55cac51bdb90 con 0x55cac53ac1a0 2024-09-10T22:46:10.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f408e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac53acac0 0x55cac5362680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f408e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac53acac0 0x55cac5362680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58548/0 (socket says 172.21.15.103:58548) 2024-09-10T22:46:10.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f408e000640 1 -- 172.21.15.103:0/2482982674 learned_addr learned my addr 172.21.15.103:0/2482982674 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:10.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f408f400640 1 --2- 172.21.15.103:0/2482982674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac5362bc0 0x55cac5362fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f408ea00640 1 --2- 172.21.15.103:0/2482982674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 0x55cac53ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f408e000640 1 -- 172.21.15.103:0/2482982674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 msgr2=0x55cac53ac580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:10.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f408e000640 1 --2- 172.21.15.103:0/2482982674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 0x55cac53ac580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f408e000640 1 -- 172.21.15.103:0/2482982674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac5362bc0 msgr2=0x55cac5362fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:10.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f408e000640 1 --2- 172.21.15.103:0/2482982674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac5362bc0 0x55cac5362fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f408e000640 1 -- 172.21.15.103:0/2482982674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cac5161c60 con 0x55cac53acac0 2024-09-10T22:46:10.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f408ea00640 1 --2- 172.21.15.103:0/2482982674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 0x55cac53ac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:10.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f408e000640 1 --2- 172.21.15.103:0/2482982674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac53acac0 0x55cac5362680 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f407c00ede0 tx=0x7f407c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ada0ece78d3834 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:10.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f407b400640 1 -- 172.21.15.103:0/2482982674 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c020040 con 0x55cac53acac0 2024-09-10T22:46:10.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f407b400640 1 -- 172.21.15.103:0/2482982674 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f407c005020 con 0x55cac53acac0 2024-09-10T22:46:10.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f407b400640 1 -- 172.21.15.103:0/2482982674 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c005430 con 0x55cac53acac0 2024-09-10T22:46:10.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4098d41000 1 -- 172.21.15.103:0/2482982674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac53acac0 msgr2=0x55cac5362680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:10.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4098d41000 1 --2- 172.21.15.103:0/2482982674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac53acac0 0x55cac5362680 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f407c00ede0 tx=0x7f407c016000 comp rx=0 tx=0).stop 2024-09-10T22:46:10.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4098d41000 1 -- 172.21.15.103:0/2482982674 shutdown_connections 2024-09-10T22:46:10.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4098d41000 1 --2- 172.21.15.103:0/2482982674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac5362bc0 0x55cac5362fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4098d41000 1 --2- 172.21.15.103:0/2482982674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac53acac0 0x55cac5362680 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4098d41000 1 --2- 172.21.15.103:0/2482982674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 0x55cac53ac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4098d41000 1 -- 172.21.15.103:0/2482982674 >> 172.21.15.103:0/2482982674 conn(0x55cac5368d20 msgr2=0x55cac5360f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:10.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4098d41000 1 -- 172.21.15.103:0/2482982674 shutdown_connections 2024-09-10T22:46:10.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.600+0000 7f4098d41000 1 -- 172.21.15.103:0/2482982674 wait complete. 2024-09-10T22:46:10.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f4098d41000 1 -- start start 2024-09-10T22:46:10.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f4098d41000 1 Processor -- start 2024-09-10T22:46:10.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f4098d41000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac5362bc0 0x55cac53b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f4098d41000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 0x55cac53b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f4098d41000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac53acac0 0x55cac53b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f4098d41000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cac51b0dd0 con 0x55cac5362bc0 2024-09-10T22:46:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f4098d41000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cac51acfc0 con 0x55cac53acac0 2024-09-10T22:46:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f4098d41000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55cac51524b0 con 0x55cac53ac1a0 2024-09-10T22:46:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f4098d41000 10 client.0 _ll_register_callbacks cb 0x55cac51307d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f408ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac5362bc0 0x55cac53b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f408ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac5362bc0 0x55cac53b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58560/0 (socket says 172.21.15.103:58560) 2024-09-10T22:46:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f408ea00640 1 -- 172.21.15.103:0/2320993052 learned_addr learned my addr 172.21.15.103:0/2320993052 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f408f400640 1 --2- 172.21.15.103:0/2320993052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac53acac0 0x55cac53b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f408e000640 1 --2- 172.21.15.103:0/2320993052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 0x55cac53b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f408ea00640 1 -- 172.21.15.103:0/2320993052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 msgr2=0x55cac53b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f408ea00640 1 --2- 172.21.15.103:0/2320993052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 0x55cac53b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f408ea00640 1 -- 172.21.15.103:0/2320993052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac53acac0 msgr2=0x55cac53b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f408ea00640 1 --2- 172.21.15.103:0/2320993052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac53acac0 0x55cac53b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f408ea00640 1 -- 172.21.15.103:0/2320993052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cac514b1f0 con 0x55cac5362bc0 2024-09-10T22:46:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f408ea00640 1 --2- 172.21.15.103:0/2320993052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac5362bc0 0x55cac53b3530 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f408005bbb0 tx=0x7f408000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1aee8e51de9f72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f406fe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f406fe00640 1 -- 172.21.15.103:0/2320993052 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408001d070 con 0x55cac5362bc0 2024-09-10T22:46:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f406fe00640 1 -- 172.21.15.103:0/2320993052 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f408005fbc0 con 0x55cac5362bc0 2024-09-10T22:46:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f4098d41000 1 -- 172.21.15.103:0/2320993052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cac5145330 con 0x55cac5362bc0 2024-09-10T22:46:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f406fe00640 1 -- 172.21.15.103:0/2320993052 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f4080063370 con 0x55cac5362bc0 2024-09-10T22:46:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f4098d41000 10 client.8895 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f4098d41000 1 -- 172.21.15.103:0/2320993052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55cac5131fa0 con 0x55cac5362bc0 2024-09-10T22:46:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f406fe00640 1 -- 172.21.15.103:0/2320993052 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55cac5145330 con 0x55cac5362bc0 2024-09-10T22:46:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f406fe00640 1 -- 172.21.15.103:0/2320993052 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7f408005dba0 con 0x55cac5362bc0 2024-09-10T22:46:10.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f4098d41000 10 client.8895 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:10.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f4098d41000 10 client.8895 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2024-09-10T22:46:10.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f4098d41000 20 client.8895 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:10.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f4098d41000 1 --2- 172.21.15.103:0/2320993052 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55cac53bb900 0x55cac53bdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f4098d41000 4 client.8895 mds_command: new command op to 7717 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:46:10.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f4098d41000 1 -- 172.21.15.103:0/2320993052 --> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cac51bfae0 con 0x55cac53bb900 2024-09-10T22:46:10.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f408e000640 1 --2- 172.21.15.103:0/2320993052 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55cac53bb900 0x55cac53bdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f408e000640 1 --2- 172.21.15.103:0/2320993052 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55cac53bb900 0x55cac53bdcf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3124fda2a27c2e2e server_cookie=cd43c909057b1aa4 in_seq=0 out_seq=0 2024-09-10T22:46:10.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.604+0000 7f406fe00640 10 client.8895 ms_handle_connect on v2:172.21.15.131:6835/1281268106 2024-09-10T22:46:10.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.608+0000 7f406fe00640 1 -- 172.21.15.103:0/2320993052 <== mds.2 v2:172.21.15.131:6835/1281268106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cac51bfae0 con 0x55cac53bb900 2024-09-10T22:46:10.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.608+0000 7f406fe00640 10 client.8895 handle_command_reply: tid=0 2024-09-10T22:46:10.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.608+0000 7f4098d41000 1 client.8895 shutdown 2024-09-10T22:46:10.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.608+0000 7f4098d41000 1 -- 172.21.15.103:0/2320993052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac5362bc0 msgr2=0x55cac53b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:10.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.608+0000 7f4098d41000 1 --2- 172.21.15.103:0/2320993052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac5362bc0 0x55cac53b3530 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f408005bbb0 tx=0x7f408000ff90 comp rx=0 tx=0).stop 2024-09-10T22:46:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.608+0000 7f4098d41000 1 -- 172.21.15.103:0/2320993052 shutdown_connections 2024-09-10T22:46:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.608+0000 7f4098d41000 1 --2- 172.21.15.103:0/2320993052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac53acac0 0x55cac53b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.608+0000 7f4098d41000 1 --2- 172.21.15.103:0/2320993052 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55cac53bb900 0x55cac53bdcf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.608+0000 7f4098d41000 1 --2- 172.21.15.103:0/2320993052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 0x55cac53b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.608+0000 7f4098d41000 1 --2- 172.21.15.103:0/2320993052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac5362bc0 0x55cac53b3530 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.608+0000 7f406fe00640 0 client.8895 ms_handle_reset on v2:172.21.15.131:6835/1281268106 2024-09-10T22:46:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.608+0000 7f4098d41000 1 -- 172.21.15.103:0/2320993052 >> 172.21.15.103:0/2320993052 conn(0x55cac5368d20 msgr2=0x55cac5360f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.608+0000 7f4098d41000 1 -- 172.21.15.103:0/2320993052 shutdown_connections 2024-09-10T22:46:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.608+0000 7f4098d41000 1 -- 172.21.15.103:0/2320993052 wait complete. 2024-09-10T22:46:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.608+0000 7f4098d41000 20 client.8895 trim_cache size 0 max 16384 2024-09-10T22:46:10.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.624+0000 7f4098d41000 1 Processor -- start 2024-09-10T22:46:10.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.624+0000 7f4098d41000 1 -- start start 2024-09-10T22:46:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.624+0000 7f4098d41000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac5362bc0 0x55cac53b6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.624+0000 7f4098d41000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 0x55cac53b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.624+0000 7f4098d41000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac53acac0 0x55cac53b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.624+0000 7f4098d41000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f40902002a0 con 0x55cac5362bc0 2024-09-10T22:46:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.624+0000 7f4098d41000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f409006f7f0 con 0x55cac53acac0 2024-09-10T22:46:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.624+0000 7f4098d41000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4090156410 con 0x55cac53ac1a0 2024-09-10T22:46:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f408ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac5362bc0 0x55cac53b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f408ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac5362bc0 0x55cac53b6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58564/0 (socket says 172.21.15.103:58564) 2024-09-10T22:46:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f408ea00640 1 -- 172.21.15.103:0/3344136624 learned_addr learned my addr 172.21.15.103:0/3344136624 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f408ea00640 1 -- 172.21.15.103:0/3344136624 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 msgr2=0x55cac53b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f408ea00640 1 --2- 172.21.15.103:0/3344136624 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 0x55cac53b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f408ea00640 1 -- 172.21.15.103:0/3344136624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac53acac0 msgr2=0x55cac53b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f408ea00640 1 --2- 172.21.15.103:0/3344136624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac53acac0 0x55cac53b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f408ea00640 1 -- 172.21.15.103:0/3344136624 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cac520a660 con 0x55cac5362bc0 2024-09-10T22:46:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f408ea00640 1 --2- 172.21.15.103:0/3344136624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac5362bc0 0x55cac53b6550 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f408004c0f0 tx=0x7f408005ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ac33d4204ecf04 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:10.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f407aa00640 1 -- 172.21.15.103:0/3344136624 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408001d040 con 0x55cac5362bc0 2024-09-10T22:46:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f407aa00640 1 -- 172.21.15.103:0/3344136624 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4080063070 con 0x55cac5362bc0 2024-09-10T22:46:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f407aa00640 1 -- 172.21.15.103:0/3344136624 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408005fbc0 con 0x55cac5362bc0 2024-09-10T22:46:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f4098d41000 1 -- 172.21.15.103:0/3344136624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac5362bc0 msgr2=0x55cac53b6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f4098d41000 1 --2- 172.21.15.103:0/3344136624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac5362bc0 0x55cac53b6550 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f408004c0f0 tx=0x7f408005ea20 comp rx=0 tx=0).stop 2024-09-10T22:46:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f4098d41000 1 -- 172.21.15.103:0/3344136624 shutdown_connections 2024-09-10T22:46:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f4098d41000 1 --2- 172.21.15.103:0/3344136624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac53acac0 0x55cac53b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f4098d41000 1 --2- 172.21.15.103:0/3344136624 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 0x55cac53b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f4098d41000 1 --2- 172.21.15.103:0/3344136624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac5362bc0 0x55cac53b6550 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f4098d41000 1 -- 172.21.15.103:0/3344136624 >> 172.21.15.103:0/3344136624 conn(0x55cac5368d20 msgr2=0x55cac5362fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f4098d41000 1 -- 172.21.15.103:0/3344136624 shutdown_connections 2024-09-10T22:46:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f4098d41000 1 -- 172.21.15.103:0/3344136624 wait complete. 2024-09-10T22:46:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f4098d41000 1 -- start start 2024-09-10T22:46:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f4098d41000 1 Processor -- start 2024-09-10T22:46:10.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f4098d41000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac5362bc0 0x55cac53b9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f4098d41000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 0x55cac53b9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f4098d41000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac53acac0 0x55cac53e6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f4098d41000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cac536bd40 con 0x55cac53acac0 2024-09-10T22:46:10.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f4098d41000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cac5369100 con 0x55cac5362bc0 2024-09-10T22:46:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f4098d41000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55cac51a7ec0 con 0x55cac53ac1a0 2024-09-10T22:46:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f4098d41000 10 client.0 _ll_register_callbacks cb 0x7f408000a4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f408f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac53acac0 0x55cac53e6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f408f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac53acac0 0x55cac53e6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58568/0 (socket says 172.21.15.103:58568) 2024-09-10T22:46:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f408f400640 1 -- 172.21.15.103:0/1568779858 learned_addr learned my addr 172.21.15.103:0/1568779858 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f408ea00640 1 --2- 172.21.15.103:0/1568779858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac5362bc0 0x55cac53b9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.628+0000 7f408e000640 1 --2- 172.21.15.103:0/1568779858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 0x55cac53b9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f408f400640 1 -- 172.21.15.103:0/1568779858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 msgr2=0x55cac53b9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f408f400640 1 --2- 172.21.15.103:0/1568779858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 0x55cac53b9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f408f400640 1 -- 172.21.15.103:0/1568779858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac5362bc0 msgr2=0x55cac53b9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f408f400640 1 --2- 172.21.15.103:0/1568779858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac5362bc0 0x55cac53b9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f408f400640 1 -- 172.21.15.103:0/1568779858 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cac5177090 con 0x55cac53acac0 2024-09-10T22:46:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f408f400640 1 --2- 172.21.15.103:0/1568779858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac53acac0 0x55cac53e6a20 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f4088009bd0 tx=0x7f4088004f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2c4db7dc965aef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f406fe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f406fe00640 1 -- 172.21.15.103:0/1568779858 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40880b2040 con 0x55cac53acac0 2024-09-10T22:46:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f406fe00640 1 -- 172.21.15.103:0/1568779858 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f4088003c80 con 0x55cac53acac0 2024-09-10T22:46:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 1 -- 172.21.15.103:0/1568779858 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4080063070 con 0x55cac53acac0 2024-09-10T22:46:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f406fe00640 1 -- 172.21.15.103:0/1568779858 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f40880c5050 con 0x55cac53acac0 2024-09-10T22:46:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 10 client.8901 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 1 -- 172.21.15.103:0/1568779858 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55cac51435f0 con 0x55cac53acac0 2024-09-10T22:46:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f406fe00640 1 -- 172.21.15.103:0/1568779858 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4080063070 con 0x55cac53acac0 2024-09-10T22:46:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f406fe00640 1 -- 172.21.15.103:0/1568779858 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7f40880c8020 con 0x55cac53acac0 2024-09-10T22:46:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 10 client.8901 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 10 client.8901 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2024-09-10T22:46:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 20 client.8901 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 1 --2- 172.21.15.103:0/1568779858 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55cac542aab0 0x55cac542aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 4 client.8901 mds_command: new command op to 7717 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:46:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 1 -- 172.21.15.103:0/1568779858 --> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cac51bb590 con 0x55cac542aab0 2024-09-10T22:46:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f408ea00640 1 --2- 172.21.15.103:0/1568779858 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55cac542aab0 0x55cac542aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f408ea00640 1 --2- 172.21.15.103:0/1568779858 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55cac542aab0 0x55cac542aec0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=531e814ca2fce178 server_cookie=9da637bd20948288 in_seq=0 out_seq=0 2024-09-10T22:46:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f406fe00640 10 client.8901 ms_handle_connect on v2:172.21.15.131:6835/1281268106 2024-09-10T22:46:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f406fe00640 1 -- 172.21.15.103:0/1568779858 <== mds.2 v2:172.21.15.131:6835/1281268106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cac51bb590 con 0x55cac542aab0 2024-09-10T22:46:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f406fe00640 10 client.8901 handle_command_reply: tid=0 2024-09-10T22:46:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 1 client.8901 shutdown 2024-09-10T22:46:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 1 -- 172.21.15.103:0/1568779858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac53acac0 msgr2=0x55cac53e6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 1 --2- 172.21.15.103:0/1568779858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac53acac0 0x55cac53e6a20 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f4088009bd0 tx=0x7f4088004f30 comp rx=0 tx=0).stop 2024-09-10T22:46:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 1 -- 172.21.15.103:0/1568779858 shutdown_connections 2024-09-10T22:46:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 1 --2- 172.21.15.103:0/1568779858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cac53acac0 0x55cac53e6a20 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 1 --2- 172.21.15.103:0/1568779858 >> [v2:172.21.15.131:6835/1281268106,v1:172.21.15.131:6837/1281268106] conn(0x55cac542aab0 0x55cac542aec0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 1 --2- 172.21.15.103:0/1568779858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cac53ac1a0 0x55cac53b9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 1 --2- 172.21.15.103:0/1568779858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cac5362bc0 0x55cac53b9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f406fe00640 0 client.8901 ms_handle_reset on v2:172.21.15.131:6835/1281268106 2024-09-10T22:46:10.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 1 -- 172.21.15.103:0/1568779858 >> 172.21.15.103:0/1568779858 conn(0x55cac5368d20 msgr2=0x55cac5362070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:10.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 1 -- 172.21.15.103:0/1568779858 shutdown_connections 2024-09-10T22:46:10.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 1 -- 172.21.15.103:0/1568779858 wait complete. 2024-09-10T22:46:10.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4098d41000 20 client.8901 trim_cache size 0 max 16384 2024-09-10T22:46:10.638 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:10.638 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "no active scrubs running", 2024-09-10T22:46:10.638 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": {} 2024-09-10T22:46:10.638 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:10.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4095a00640 1 -- 172.21.15.103:0/991630767 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f40700725e0 msgr2=0x7f4070074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:10.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4095a00640 1 --2- 172.21.15.103:0/991630767 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f40700725e0 0x7f4070074aa0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4090159610 tx=0x7f407c010040 comp rx=0 tx=0).stop 2024-09-10T22:46:10.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4095a00640 1 -- 172.21.15.103:0/991630767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40900b2840 msgr2=0x7f409014eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:10.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4095a00640 1 --2- 172.21.15.103:0/991630767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40900b2840 0x7f409014eb30 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f408000ca20 tx=0x7f408000cee0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4095a00640 1 -- 172.21.15.103:0/991630767 shutdown_connections 2024-09-10T22:46:10.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4095a00640 1 --2- 172.21.15.103:0/991630767 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f40700725e0 0x7f4070074aa0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4095a00640 1 --2- 172.21.15.103:0/991630767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f409015f330 0x7f40900b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4095a00640 1 --2- 172.21.15.103:0/991630767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40900d0640 0x7f40900b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4095a00640 1 --2- 172.21.15.103:0/991630767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40900b2840 0x7f409014eb30 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4095a00640 1 -- 172.21.15.103:0/991630767 >> 172.21.15.103:0/991630767 conn(0x7f40900d1ab0 msgr2=0x7f40900aec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:10.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4095a00640 1 -- 172.21.15.103:0/991630767 shutdown_connections 2024-09-10T22:46:10.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.632+0000 7f4095a00640 1 -- 172.21.15.103:0/991630767 wait complete. 2024-09-10T22:46:10.653 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:46:10.654 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T22:46:10.654 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-10T22:46:10.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.836+0000 7ff69e200640 1 -- 172.21.15.103:0/2798068843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff67c003f80 msgr2=0x7ff67c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:10.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.836+0000 7ff69e200640 1 --2- 172.21.15.103:0/2798068843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff67c003f80 0x7ff67c004810 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7ff6980b4f10 tx=0x7ff68001c800 comp rx=0 tx=0).stop 2024-09-10T22:46:10.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.836+0000 7ff697e00640 1 -- 172.21.15.103:0/2798068843 reap_dead start 2024-09-10T22:46:10.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.836+0000 7ff69e200640 1 -- 172.21.15.103:0/2798068843 shutdown_connections 2024-09-10T22:46:10.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.836+0000 7ff69e200640 1 -- 172.21.15.103:0/2798068843 >> 172.21.15.103:0/2798068843 conn(0x7ff69806cc00 msgr2=0x7ff69806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:10.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.836+0000 7ff69e200640 1 -- 172.21.15.103:0/2798068843 shutdown_connections 2024-09-10T22:46:10.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.836+0000 7ff69e200640 1 -- 172.21.15.103:0/2798068843 wait complete. 2024-09-10T22:46:10.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff69e200640 1 Processor -- start 2024-09-10T22:46:10.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff69e200640 1 -- start start 2024-09-10T22:46:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff69e200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff67c003f80 0x7ff69815e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff69e200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6980ce3e0 0x7ff6981f73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff69e200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6981f78e0 0x7ff698164d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff69e200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff698165da0 con 0x7ff67c003f80 2024-09-10T22:46:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff69e200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff698165c20 con 0x7ff6980ce3e0 2024-09-10T22:46:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff69e200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff698165f20 con 0x7ff6981f78e0 2024-09-10T22:46:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff697400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff67c003f80 0x7ff69815e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff697400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff67c003f80 0x7ff69815e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58584/0 (socket says 172.21.15.103:58584) 2024-09-10T22:46:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff697400640 1 -- 172.21.15.103:0/951562237 learned_addr learned my addr 172.21.15.103:0/951562237 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:10.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff68ea00640 1 --2- 172.21.15.103:0/951562237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6980ce3e0 0x7ff6981f73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff697400640 1 -- 172.21.15.103:0/951562237 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6981f78e0 msgr2=0x7ff698164d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:10.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff697e00640 1 --2- 172.21.15.103:0/951562237 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6981f78e0 0x7ff698164d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff697400640 1 --2- 172.21.15.103:0/951562237 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6981f78e0 0x7ff698164d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff697400640 1 -- 172.21.15.103:0/951562237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6980ce3e0 msgr2=0x7ff6981f73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:10.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff697400640 1 --2- 172.21.15.103:0/951562237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6980ce3e0 0x7ff6981f73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff697400640 1 -- 172.21.15.103:0/951562237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69815e8b0 con 0x7ff67c003f80 2024-09-10T22:46:10.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff68ea00640 1 --2- 172.21.15.103:0/951562237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6980ce3e0 0x7ff6981f73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:10.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff697400640 1 --2- 172.21.15.103:0/951562237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff67c003f80 0x7ff69815e370 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7ff68800edb0 tx=0x7ff68800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:10.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff68fe00640 1 -- 172.21.15.103:0/951562237 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff688003c50 con 0x7ff67c003f80 2024-09-10T22:46:10.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff68fe00640 1 -- 172.21.15.103:0/951562237 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff688003df0 con 0x7ff67c003f80 2024-09-10T22:46:10.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff68fe00640 1 -- 172.21.15.103:0/951562237 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6880042b0 con 0x7ff67c003f80 2024-09-10T22:46:10.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff69e200640 1 -- 172.21.15.103:0/951562237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff69815d8b0 con 0x7ff67c003f80 2024-09-10T22:46:10.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.840+0000 7ff69e200640 1 -- 172.21.15.103:0/951562237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6981f7f60 con 0x7ff67c003f80 2024-09-10T22:46:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.844+0000 7ff68fe00640 1 -- 172.21.15.103:0/951562237 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff688021030 con 0x7ff67c003f80 2024-09-10T22:46:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.844+0000 7ff68fe00640 1 --2- 172.21.15.103:0/951562237 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff674072610 0x7ff674074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.844+0000 7ff6a16e6000 1 Processor -- start 2024-09-10T22:46:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.844+0000 7ff68fe00640 1 -- 172.21.15.103:0/951562237 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7ff688094120 con 0x7ff67c003f80 2024-09-10T22:46:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.844+0000 7ff6a16e6000 1 -- start start 2024-09-10T22:46:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.844+0000 7ff68ea00640 1 --2- 172.21.15.103:0/951562237 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff674072610 0x7ff674074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff6a16e6000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266ca2a1a0 0x56266ca2a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff6a16e6000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266ca2aac0 0x56266c9e0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff68ea00640 1 --2- 172.21.15.103:0/951562237 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff674072610 0x7ff674074ad0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff6800a9000 tx=0x7ff6800195a0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff6a16e6000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266c9e0bc0 0x56266c9e0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff6a16e6000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56266c8c8cb0 con 0x56266c9e0bc0 2024-09-10T22:46:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff6a16e6000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56266c7de310 con 0x56266ca2aac0 2024-09-10T22:46:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff6a16e6000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56266c83bb90 con 0x56266ca2a1a0 2024-09-10T22:46:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff697e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266c9e0bc0 0x56266c9e0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff68ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266ca2aac0 0x56266c9e0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff697e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266c9e0bc0 0x56266c9e0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58592/0 (socket says 172.21.15.103:58592) 2024-09-10T22:46:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff697e00640 1 -- 172.21.15.103:0/2026068240 learned_addr learned my addr 172.21.15.103:0/2026068240 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff697400640 1 --2- 172.21.15.103:0/2026068240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266ca2a1a0 0x56266ca2a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff697e00640 1 -- 172.21.15.103:0/2026068240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266ca2a1a0 msgr2=0x56266ca2a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff697e00640 1 --2- 172.21.15.103:0/2026068240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266ca2a1a0 0x56266ca2a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff697e00640 1 -- 172.21.15.103:0/2026068240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266ca2aac0 msgr2=0x56266c9e0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:10.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff697e00640 1 --2- 172.21.15.103:0/2026068240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266ca2aac0 0x56266c9e0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff697e00640 1 -- 172.21.15.103:0/2026068240 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56266c7dfc60 con 0x56266c9e0bc0 2024-09-10T22:46:10.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff697e00640 1 --2- 172.21.15.103:0/2026068240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266c9e0bc0 0x56266c9e0fa0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7ff690000c10 tx=0x7ff690006f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee88ef5286102c29 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:10.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff687e00640 1 -- 172.21.15.103:0/2026068240 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690012640 con 0x56266c9e0bc0 2024-09-10T22:46:10.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff687e00640 1 -- 172.21.15.103:0/2026068240 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6900127e0 con 0x56266c9e0bc0 2024-09-10T22:46:10.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff687e00640 1 -- 172.21.15.103:0/2026068240 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690012bf0 con 0x56266c9e0bc0 2024-09-10T22:46:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff6a16e6000 1 -- 172.21.15.103:0/2026068240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266c9e0bc0 msgr2=0x56266c9e0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/2026068240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266c9e0bc0 0x56266c9e0fa0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7ff690000c10 tx=0x7ff690006f10 comp rx=0 tx=0).stop 2024-09-10T22:46:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff6a16e6000 1 -- 172.21.15.103:0/2026068240 shutdown_connections 2024-09-10T22:46:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/2026068240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266c9e0bc0 0x56266c9e0fa0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/2026068240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266ca2aac0 0x56266c9e0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/2026068240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266ca2a1a0 0x56266ca2a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff6a16e6000 1 -- 172.21.15.103:0/2026068240 >> 172.21.15.103:0/2026068240 conn(0x56266c9e6d20 msgr2=0x56266c9def60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff6a16e6000 1 -- 172.21.15.103:0/2026068240 shutdown_connections 2024-09-10T22:46:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff6a16e6000 1 -- 172.21.15.103:0/2026068240 wait complete. 2024-09-10T22:46:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff6a16e6000 1 -- start start 2024-09-10T22:46:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.848+0000 7ff6a16e6000 1 Processor -- start 2024-09-10T22:46:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266c9e0bc0 0x56266ca31530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 0x56266ca31a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266ca2aac0 0x56266ca31fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56266c82edd0 con 0x56266ca2a1a0 2024-09-10T22:46:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56266c82afc0 con 0x56266ca2aac0 2024-09-10T22:46:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56266c7d04b0 con 0x56266c9e0bc0 2024-09-10T22:46:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 10 client.0 _ll_register_callbacks cb 0x56266c7ae7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff68ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 0x56266ca31a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff697400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266c9e0bc0 0x56266ca31530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff68ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 0x56266ca31a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58606/0 (socket says 172.21.15.103:58606) 2024-09-10T22:46:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff697e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266ca2aac0 0x56266ca31fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff697400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266c9e0bc0 0x56266ca31530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.103:45494/0 (socket says 172.21.15.103:45494) 2024-09-10T22:46:10.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff68ea00640 1 -- 172.21.15.103:0/1542474557 learned_addr learned my addr 172.21.15.103:0/1542474557 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:10.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff68ea00640 1 -- 172.21.15.103:0/1542474557 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266c9e0bc0 msgr2=0x56266ca31530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:10.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff68ea00640 1 --2- 172.21.15.103:0/1542474557 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266c9e0bc0 0x56266ca31530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff68ea00640 1 -- 172.21.15.103:0/1542474557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266ca2aac0 msgr2=0x56266ca31fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:10.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff68ea00640 1 --2- 172.21.15.103:0/1542474557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266ca2aac0 0x56266ca31fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff68ea00640 1 -- 172.21.15.103:0/1542474557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56266c7c91f0 con 0x56266ca2a1a0 2024-09-10T22:46:10.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff697400640 1 --2- 172.21.15.103:0/1542474557 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266c9e0bc0 0x56266ca31530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:46:10.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff68ea00640 1 --2- 172.21.15.103:0/1542474557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 0x56266ca31a70 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7ff68001b080 tx=0x7ff680006b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4083c31e92f04b17 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:10.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff684c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:10.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff684c00640 1 -- 172.21.15.103:0/1542474557 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6800ca470 con 0x56266ca2a1a0 2024-09-10T22:46:10.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff684c00640 1 -- 172.21.15.103:0/1542474557 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7ff6800ca610 con 0x56266ca2a1a0 2024-09-10T22:46:10.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 1 -- 172.21.15.103:0/1542474557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56266c7c3330 con 0x56266ca2a1a0 2024-09-10T22:46:10.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff684c00640 1 -- 172.21.15.103:0/1542474557 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7ff6800d2050 con 0x56266ca2a1a0 2024-09-10T22:46:10.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 10 client.8913 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:10.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 1 -- 172.21.15.103:0/1542474557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x56266c7affa0 con 0x56266ca2a1a0 2024-09-10T22:46:10.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff684c00640 1 -- 172.21.15.103:0/1542474557 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56266c7c3330 con 0x56266ca2a1a0 2024-09-10T22:46:10.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff684c00640 1 -- 172.21.15.103:0/1542474557 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7ff6800ca810 con 0x56266ca2a1a0 2024-09-10T22:46:10.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 10 client.8913 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:10.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 10 client.8913 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T22:46:10.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 20 client.8913 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:10.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/1542474557 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56266ca39900 0x56266ca3bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 4 client.8913 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:46:10.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 1 -- 172.21.15.103:0/1542474557 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56266c83dae0 con 0x56266ca39900 2024-09-10T22:46:10.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff697400640 1 --2- 172.21.15.103:0/1542474557 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56266ca39900 0x56266ca3bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff697400640 1 --2- 172.21.15.103:0/1542474557 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56266ca39900 0x56266ca3bcf0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec475abed013bcb6 server_cookie=deb5b8ad5e0b9f96 in_seq=0 out_seq=0 2024-09-10T22:46:10.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff684c00640 10 client.8913 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:10.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff684c00640 1 -- 172.21.15.103:0/1542474557 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56266c83dae0 con 0x56266ca39900 2024-09-10T22:46:10.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff684c00640 10 client.8913 handle_command_reply: tid=0 2024-09-10T22:46:10.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 1 client.8913 shutdown 2024-09-10T22:46:10.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 1 -- 172.21.15.103:0/1542474557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 msgr2=0x56266ca31a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:10.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.852+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/1542474557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 0x56266ca31a70 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7ff68001b080 tx=0x7ff680006b20 comp rx=0 tx=0).stop 2024-09-10T22:46:10.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.856+0000 7ff6a16e6000 1 -- 172.21.15.103:0/1542474557 shutdown_connections 2024-09-10T22:46:10.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.856+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/1542474557 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56266ca39900 0x56266ca3bcf0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.856+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/1542474557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266ca2aac0 0x56266ca31fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.856+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/1542474557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 0x56266ca31a70 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.856+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/1542474557 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266c9e0bc0 0x56266ca31530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.856+0000 7ff684c00640 0 client.8913 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:10.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.856+0000 7ff6a16e6000 1 -- 172.21.15.103:0/1542474557 >> 172.21.15.103:0/1542474557 conn(0x56266c9e6d20 msgr2=0x56266c9def60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:10.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.856+0000 7ff6a16e6000 1 -- 172.21.15.103:0/1542474557 shutdown_connections 2024-09-10T22:46:10.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.856+0000 7ff6a16e6000 1 -- 172.21.15.103:0/1542474557 wait complete. 2024-09-10T22:46:10.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.856+0000 7ff6a16e6000 20 client.8913 trim_cache size 0 max 16384 2024-09-10T22:46:10.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff6a16e6000 1 Processor -- start 2024-09-10T22:46:10.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff6a16e6000 1 -- start start 2024-09-10T22:46:10.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff6a16e6000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266c9e0bc0 0x56266ca37dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff6a16e6000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 0x56266c9e0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff6a16e6000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266ca2aac0 0x56266c9e05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff6a16e6000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff698205330 con 0x56266ca2a1a0 2024-09-10T22:46:10.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff6a16e6000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff6982044d0 con 0x56266c9e0bc0 2024-09-10T22:46:10.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff6a16e6000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff698204c00 con 0x56266ca2aac0 2024-09-10T22:46:10.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff68ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 0x56266c9e0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff68ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 0x56266c9e0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58622/0 (socket says 172.21.15.103:58622) 2024-09-10T22:46:10.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff68ea00640 1 -- 172.21.15.103:0/2332154812 learned_addr learned my addr 172.21.15.103:0/2332154812 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:10.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff697e00640 1 --2- 172.21.15.103:0/2332154812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266ca2aac0 0x56266c9e05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff697400640 1 --2- 172.21.15.103:0/2332154812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266c9e0bc0 0x56266ca37dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff68ea00640 1 -- 172.21.15.103:0/2332154812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266ca2aac0 msgr2=0x56266c9e05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:10.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff68ea00640 1 --2- 172.21.15.103:0/2332154812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266ca2aac0 0x56266c9e05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff68ea00640 1 -- 172.21.15.103:0/2332154812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266c9e0bc0 msgr2=0x56266ca37dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:10.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff68ea00640 1 --2- 172.21.15.103:0/2332154812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266c9e0bc0 0x56266ca37dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff68ea00640 1 -- 172.21.15.103:0/2332154812 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56266c888660 con 0x56266ca2a1a0 2024-09-10T22:46:10.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff697400640 1 --2- 172.21.15.103:0/2332154812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266c9e0bc0 0x56266ca37dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:10.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.872+0000 7ff68ea00640 1 --2- 172.21.15.103:0/2332154812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 0x56266c9e0070 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7ff680006fd0 tx=0x7ff67c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fd65830e32b35c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff687400640 1 -- 172.21.15.103:0/2332154812 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6800ca670 con 0x56266ca2a1a0 2024-09-10T22:46:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff687400640 1 -- 172.21.15.103:0/2332154812 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6800c5070 con 0x56266ca2a1a0 2024-09-10T22:46:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff687400640 1 -- 172.21.15.103:0/2332154812 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6800a86d0 con 0x56266ca2a1a0 2024-09-10T22:46:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff6a16e6000 1 -- 172.21.15.103:0/2332154812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 msgr2=0x56266c9e0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/2332154812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 0x56266c9e0070 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7ff680006fd0 tx=0x7ff67c005840 comp rx=0 tx=0).stop 2024-09-10T22:46:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff6a16e6000 1 -- 172.21.15.103:0/2332154812 shutdown_connections 2024-09-10T22:46:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/2332154812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266ca2aac0 0x56266c9e05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/2332154812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 0x56266c9e0070 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/2332154812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266c9e0bc0 0x56266ca37dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff6a16e6000 1 -- 172.21.15.103:0/2332154812 >> 172.21.15.103:0/2332154812 conn(0x56266c9e6d20 msgr2=0x56266c9df960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff6a16e6000 1 -- 172.21.15.103:0/2332154812 shutdown_connections 2024-09-10T22:46:10.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff6a16e6000 1 -- 172.21.15.103:0/2332154812 wait complete. 2024-09-10T22:46:10.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff6a16e6000 1 -- start start 2024-09-10T22:46:10.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff6a16e6000 1 Processor -- start 2024-09-10T22:46:10.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff6a16e6000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266c9e0bc0 0x56266ca37200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff6a16e6000 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 0x56266ca37740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff6a16e6000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266ca2aac0 0x56266ca5c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff6a16e6000 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56266c9e9d40 con 0x56266ca2a1a0 2024-09-10T22:46:10.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff6a16e6000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56266c9e7100 con 0x56266c9e0bc0 2024-09-10T22:46:10.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff6a16e6000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56266c825ec0 con 0x56266ca2aac0 2024-09-10T22:46:10.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff6a16e6000 10 client.0 _ll_register_callbacks cb 0x7ff67c00b9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:46:10.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff68ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 0x56266ca37740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff68ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 0x56266ca37740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58630/0 (socket says 172.21.15.103:58630) 2024-09-10T22:46:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff68ea00640 1 -- 172.21.15.103:0/3476231651 learned_addr learned my addr 172.21.15.103:0/3476231651 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff697e00640 1 --2- 172.21.15.103:0/3476231651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266ca2aac0 0x56266ca5c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff697400640 1 --2- 172.21.15.103:0/3476231651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266c9e0bc0 0x56266ca37200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff68ea00640 1 -- 172.21.15.103:0/3476231651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266ca2aac0 msgr2=0x56266ca5c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff68ea00640 1 --2- 172.21.15.103:0/3476231651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266ca2aac0 0x56266ca5c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff68ea00640 1 -- 172.21.15.103:0/3476231651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266c9e0bc0 msgr2=0x56266ca37200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:46:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff68ea00640 1 --2- 172.21.15.103:0/3476231651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266c9e0bc0 0x56266ca37200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff68ea00640 1 -- 172.21.15.103:0/3476231651 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56266c7f5090 con 0x56266ca2a1a0 2024-09-10T22:46:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff68ea00640 1 --2- 172.21.15.103:0/3476231651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 0x56266ca37740 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7ff6800aa040 tx=0x7ff6800016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bbf6706373311a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:10.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.876+0000 7ff684c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T22:46:10.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff684c00640 1 -- 172.21.15.103:0/3476231651 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6800ca670 con 0x56266ca2a1a0 2024-09-10T22:46:10.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff684c00640 1 -- 172.21.15.103:0/3476231651 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7ff6800a8470 con 0x56266ca2a1a0 2024-09-10T22:46:10.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 1 -- 172.21.15.103:0/3476231651 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6800c5070 con 0x56266ca2a1a0 2024-09-10T22:46:10.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff684c00640 1 -- 172.21.15.103:0/3476231651 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7ff6800ee050 con 0x56266ca2a1a0 2024-09-10T22:46:10.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 10 client.8919 fetch_fsmap learned FSMap version 117 2024-09-10T22:46:10.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 1 -- 172.21.15.103:0/3476231651 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x56266c7c15f0 con 0x56266ca2a1a0 2024-09-10T22:46:10.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff684c00640 1 -- 172.21.15.103:0/3476231651 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6800c5070 con 0x56266ca2a1a0 2024-09-10T22:46:10.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff684c00640 1 -- 172.21.15.103:0/3476231651 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 117) ==== 3558+0+0 (secure 0 0 0) 0x7ff6800f1020 con 0x56266ca2a1a0 2024-09-10T22:46:10.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 10 client.8919 fetch_fsmap finished waiting for FSMap version 117 2024-09-10T22:46:10.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 10 client.8919 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T22:46:10.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 20 client.8919 populate_metadata read hostname 'smithi103' 2024-09-10T22:46:10.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/3476231651 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56266ca5cc00 0x56266ca9fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:10.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 4 client.8919 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:46:10.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 1 -- 172.21.15.103:0/3476231651 --> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56266c839590 con 0x56266ca5cc00 2024-09-10T22:46:10.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff697400640 1 --2- 172.21.15.103:0/3476231651 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56266ca5cc00 0x56266ca9fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:10.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff697400640 1 --2- 172.21.15.103:0/3476231651 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56266ca5cc00 0x56266ca9fa60 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d61818f037d58c7 server_cookie=abd89e6985b1ccc in_seq=0 out_seq=0 2024-09-10T22:46:10.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff684c00640 10 client.8919 ms_handle_connect on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:10.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff684c00640 1 -- 172.21.15.103:0/3476231651 <== mds.0 v2:172.21.15.103:6834/3550082240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+382 (crc 0 0 0) 0x56266c839590 con 0x56266ca5cc00 2024-09-10T22:46:10.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff684c00640 10 client.8919 handle_command_reply: tid=0 2024-09-10T22:46:10.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 1 client.8919 shutdown 2024-09-10T22:46:10.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 1 -- 172.21.15.103:0/3476231651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 msgr2=0x56266ca37740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:10.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/3476231651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 0x56266ca37740 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7ff6800aa040 tx=0x7ff6800016b0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 1 -- 172.21.15.103:0/3476231651 shutdown_connections 2024-09-10T22:46:10.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/3476231651 >> [v2:172.21.15.103:6834/3550082240,v1:172.21.15.103:6835/3550082240] conn(0x56266ca5cc00 0x56266ca9fa60 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/3476231651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56266ca2aac0 0x56266ca5c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/3476231651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56266ca2a1a0 0x56266ca37740 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff684c00640 0 client.8919 ms_handle_reset on v2:172.21.15.103:6834/3550082240 2024-09-10T22:46:10.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 1 --2- 172.21.15.103:0/3476231651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56266c9e0bc0 0x56266ca37200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 1 -- 172.21.15.103:0/3476231651 >> 172.21.15.103:0/3476231651 conn(0x56266c9e6d20 msgr2=0x56266c9e0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:10.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 1 -- 172.21.15.103:0/3476231651 shutdown_connections 2024-09-10T22:46:10.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 1 -- 172.21.15.103:0/3476231651 wait complete. 2024-09-10T22:46:10.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff6a16e6000 20 client.8919 trim_cache size 0 max 16384 2024-09-10T22:46:10.888 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:10.888 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "no active scrubs running", 2024-09-10T22:46:10.888 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": {}, 2024-09-10T22:46:10.888 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_stats": { 2024-09-10T22:46:10.888 INFO:teuthology.orchestra.run.smithi103.stdout: "13d979f1-0660-40c8-9ef3-e228e32f6cb4": { 2024-09-10T22:46:10.888 INFO:teuthology.orchestra.run.smithi103.stdout: "start_time": "2024-09-10T22:45:58.592812+0000", 2024-09-10T22:46:10.888 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/d1/d2/d3", 2024-09-10T22:46:10.888 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_started": 0, 2024-09-10T22:46:10.889 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_passed": 0, 2024-09-10T22:46:10.889 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_failed": 0, 2024-09-10T22:46:10.889 INFO:teuthology.orchestra.run.smithi103.stdout: "uninline_skipped": 0 2024-09-10T22:46:10.889 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:46:10.889 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T22:46:10.889 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff69e200640 1 -- 172.21.15.103:0/951562237 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff674072610 msgr2=0x7ff674074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff69e200640 1 --2- 172.21.15.103:0/951562237 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff674072610 0x7ff674074ad0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff6800a9000 tx=0x7ff6800195a0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff69e200640 1 -- 172.21.15.103:0/951562237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff67c003f80 msgr2=0x7ff69815e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff69e200640 1 --2- 172.21.15.103:0/951562237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff67c003f80 0x7ff69815e370 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7ff68800edb0 tx=0x7ff68800d7b0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff69e200640 1 -- 172.21.15.103:0/951562237 shutdown_connections 2024-09-10T22:46:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff69e200640 1 --2- 172.21.15.103:0/951562237 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff674072610 0x7ff674074ad0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff69e200640 1 --2- 172.21.15.103:0/951562237 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6981f78e0 0x7ff698164d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff69e200640 1 --2- 172.21.15.103:0/951562237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6980ce3e0 0x7ff6981f73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff69e200640 1 --2- 172.21.15.103:0/951562237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff67c003f80 0x7ff69815e370 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff69e200640 1 -- 172.21.15.103:0/951562237 >> 172.21.15.103:0/951562237 conn(0x7ff69806cc00 msgr2=0x7ff6980b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff69e200640 1 -- 172.21.15.103:0/951562237 shutdown_connections 2024-09-10T22:46:10.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:10.884+0000 7ff69e200640 1 -- 172.21.15.103:0/951562237 wait complete. 2024-09-10T22:46:10.905 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:46:10.905 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:46:11.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff94ca00640 1 -- 172.21.15.103:0/3055562195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff92c004d50 msgr2=0x7ff92c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:11.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff94ca00640 1 --2- 172.21.15.103:0/3055562195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff92c004d50 0x7ff92c0051d0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7ff94000c610 tx=0x7ff94001f9a0 comp rx=0 tx=0).stop 2024-09-10T22:46:11.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff946800640 1 -- 172.21.15.103:0/3055562195 reap_dead start 2024-09-10T22:46:11.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff94ca00640 1 -- 172.21.15.103:0/3055562195 shutdown_connections 2024-09-10T22:46:11.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff94ca00640 1 -- 172.21.15.103:0/3055562195 >> 172.21.15.103:0/3055562195 conn(0x7ff9480d1a20 msgr2=0x7ff9480d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:11.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff94ca00640 1 -- 172.21.15.103:0/3055562195 shutdown_connections 2024-09-10T22:46:11.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff94ca00640 1 -- 172.21.15.103:0/3055562195 wait complete. 2024-09-10T22:46:11.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff94ca00640 1 Processor -- start 2024-09-10T22:46:11.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff94ca00640 1 -- start start 2024-09-10T22:46:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff94ca00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff92c004d50 0x7ff94815dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff94ca00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9480c9ea0 0x7ff9480c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff94ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9480ca320 0x7ff9480c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff94ca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff9480cdb30 con 0x7ff9480ca320 2024-09-10T22:46:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff94ca00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff9480cd9b0 con 0x7ff9480c9ea0 2024-09-10T22:46:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff94ca00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff9480ae7f0 con 0x7ff92c004d50 2024-09-10T22:46:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff946800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9480ca320 0x7ff9480c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff946800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9480ca320 0x7ff9480c6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58644/0 (socket says 172.21.15.103:58644) 2024-09-10T22:46:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff946800640 1 -- 172.21.15.103:0/3330104376 learned_addr learned my addr 172.21.15.103:0/3330104376 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff93d400640 1 --2- 172.21.15.103:0/3330104376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9480c9ea0 0x7ff9480c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:11.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff945e00640 1 --2- 172.21.15.103:0/3330104376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff92c004d50 0x7ff94815dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:11.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff946800640 1 -- 172.21.15.103:0/3330104376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff92c004d50 msgr2=0x7ff94815dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:11.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff946800640 1 --2- 172.21.15.103:0/3330104376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff92c004d50 0x7ff94815dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:11.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff946800640 1 -- 172.21.15.103:0/3330104376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9480c9ea0 msgr2=0x7ff9480c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:11.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff946800640 1 --2- 172.21.15.103:0/3330104376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9480c9ea0 0x7ff9480c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:11.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.048+0000 7ff946800640 1 -- 172.21.15.103:0/3330104376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9480c6b50 con 0x7ff9480ca320 2024-09-10T22:46:11.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.052+0000 7ff946800640 1 --2- 172.21.15.103:0/3330104376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9480ca320 0x7ff9480c6610 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7ff9400014e0 tx=0x7ff940001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:11.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.052+0000 7ff93ea00640 1 -- 172.21.15.103:0/3330104376 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940001fc0 con 0x7ff9480ca320 2024-09-10T22:46:11.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.052+0000 7ff93ea00640 1 -- 172.21.15.103:0/3330104376 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff940004e40 con 0x7ff9480ca320 2024-09-10T22:46:11.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.052+0000 7ff94ca00640 1 -- 172.21.15.103:0/3330104376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9480caf10 con 0x7ff9480ca320 2024-09-10T22:46:11.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.052+0000 7ff93ea00640 1 -- 172.21.15.103:0/3330104376 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940003be0 con 0x7ff9480ca320 2024-09-10T22:46:11.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.052+0000 7ff94ca00640 1 -- 172.21.15.103:0/3330104376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9480c96a0 con 0x7ff9480ca320 2024-09-10T22:46:11.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.052+0000 7ff94ca00640 1 -- 172.21.15.103:0/3330104376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9480ccdf0 con 0x7ff9480ca320 2024-09-10T22:46:11.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.052+0000 7ff93ea00640 1 -- 172.21.15.103:0/3330104376 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff940006070 con 0x7ff9480ca320 2024-09-10T22:46:11.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.052+0000 7ff93ea00640 1 --2- 172.21.15.103:0/3330104376 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff924072610 0x7ff924074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:11.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.052+0000 7ff93ea00640 1 -- 172.21.15.103:0/3330104376 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7ff9400b9020 con 0x7ff9480ca320 2024-09-10T22:46:11.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.052+0000 7ff945e00640 1 --2- 172.21.15.103:0/3330104376 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff924072610 0x7ff924074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:11.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.056+0000 7ff945e00640 1 --2- 172.21.15.103:0/3330104376 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff924072610 0x7ff924074ad0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff938006fd0 tx=0x7ff938006cd0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:11.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.056+0000 7ff93ea00640 1 -- 172.21.15.103:0/3330104376 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff940019750 con 0x7ff9480ca320 2024-09-10T22:46:11.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.256+0000 7ff94ca00640 1 -- 172.21.15.103:0/3330104376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9480cb430 con 0x7ff9480ca320 2024-09-10T22:46:11.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.256+0000 7ff93ea00640 1 -- 172.21.15.103:0/3330104376 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5287 (secure 0 0 0) 0x7ff9400fb1b0 con 0x7ff9480ca320 2024-09-10T22:46:11.258 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:11.258 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:46:01.549542+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8238,"mds_1":8235,"mds_2":7717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7717":{"gid":7717,"name":"b","rank":2,"incarnation":111,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8235":{"gid":8235,"name":"a","rank":1,"incarnation":109,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238,8235,7717]},"id":7}]} 2024-09-10T22:46:11.259 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 117 2024-09-10T22:46:11.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.260+0000 7ff94ca00640 1 -- 172.21.15.103:0/3330104376 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff924072610 msgr2=0x7ff924074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:11.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.260+0000 7ff94ca00640 1 --2- 172.21.15.103:0/3330104376 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff924072610 0x7ff924074ad0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff938006fd0 tx=0x7ff938006cd0 comp rx=0 tx=0).stop 2024-09-10T22:46:11.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.260+0000 7ff94ca00640 1 -- 172.21.15.103:0/3330104376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9480ca320 msgr2=0x7ff9480c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:11.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.260+0000 7ff94ca00640 1 --2- 172.21.15.103:0/3330104376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9480ca320 0x7ff9480c6610 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7ff9400014e0 tx=0x7ff940001cc0 comp rx=0 tx=0).stop 2024-09-10T22:46:11.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.260+0000 7ff94ca00640 1 -- 172.21.15.103:0/3330104376 shutdown_connections 2024-09-10T22:46:11.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.260+0000 7ff94ca00640 1 --2- 172.21.15.103:0/3330104376 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff924072610 0x7ff924074ad0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:11.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.260+0000 7ff94ca00640 1 --2- 172.21.15.103:0/3330104376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9480ca320 0x7ff9480c6610 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:11.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.260+0000 7ff94ca00640 1 --2- 172.21.15.103:0/3330104376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9480c9ea0 0x7ff9480c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:11.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.260+0000 7ff94ca00640 1 --2- 172.21.15.103:0/3330104376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff92c004d50 0x7ff94815dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:11.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.260+0000 7ff94ca00640 1 -- 172.21.15.103:0/3330104376 >> 172.21.15.103:0/3330104376 conn(0x7ff9480d1a20 msgr2=0x7ff9480707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:11.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.260+0000 7ff94ca00640 1 -- 172.21.15.103:0/3330104376 shutdown_connections 2024-09-10T22:46:11.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.260+0000 7ff94ca00640 1 -- 172.21.15.103:0/3330104376 wait complete. 2024-09-10T22:46:11.279 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'b'] 2024-09-10T22:46:11.280 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:46:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.420+0000 7f538d800640 1 -- 172.21.15.103:0/1938546596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f536c003a60 msgr2=0x7f536c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.420+0000 7f538d800640 1 --2- 172.21.15.103:0/1938546596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f536c003a60 0x7f536c003e80 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f5378009b30 tx=0x7f537801d210 comp rx=0 tx=0).stop 2024-09-10T22:46:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.420+0000 7f538d800640 1 -- 172.21.15.103:0/1938546596 shutdown_connections 2024-09-10T22:46:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.420+0000 7f538d800640 1 --2- 172.21.15.103:0/1938546596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f536c003a60 0x7f536c003e80 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.420+0000 7f538d800640 1 -- 172.21.15.103:0/1938546596 >> 172.21.15.103:0/1938546596 conn(0x7f53880d1ac0 msgr2=0x7f53880d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.420+0000 7f538d800640 1 -- 172.21.15.103:0/1938546596 shutdown_connections 2024-09-10T22:46:11.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.420+0000 7f538d800640 1 -- 172.21.15.103:0/1938546596 wait complete. 2024-09-10T22:46:11.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f538d800640 1 Processor -- start 2024-09-10T22:46:11.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f538d800640 1 -- start start 2024-09-10T22:46:11.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f538d800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f536c003a60 0x7f53880b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:11.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f538d800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f538806f660 0x7f538814fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:11.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f538d800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5388150050 0x7f53881fa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:11.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f538d800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f53880ceed0 con 0x7f5388150050 2024-09-10T22:46:11.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f538d800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f53880ced50 con 0x7f536c003a60 2024-09-10T22:46:11.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f538d800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f53880cf9c0 con 0x7f538806f660 2024-09-10T22:46:11.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f5387400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5388150050 0x7f53881fa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:11.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f5387400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5388150050 0x7f53881fa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58666/0 (socket says 172.21.15.103:58666) 2024-09-10T22:46:11.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f5387400640 1 -- 172.21.15.103:0/3612476391 learned_addr learned my addr 172.21.15.103:0/3612476391 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:11.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f5386a00640 1 --2- 172.21.15.103:0/3612476391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f536c003a60 0x7f53880b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:11.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f5386000640 1 --2- 172.21.15.103:0/3612476391 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f538806f660 0x7f538814fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:11.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f5387400640 1 -- 172.21.15.103:0/3612476391 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f538806f660 msgr2=0x7f538814fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:11.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f5387400640 1 --2- 172.21.15.103:0/3612476391 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f538806f660 0x7f538814fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:11.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f5387400640 1 -- 172.21.15.103:0/3612476391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f536c003a60 msgr2=0x7f53880b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:11.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f5387400640 1 --2- 172.21.15.103:0/3612476391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f536c003a60 0x7f53880b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:11.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f5387400640 1 -- 172.21.15.103:0/3612476391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53880b4f40 con 0x7f5388150050 2024-09-10T22:46:11.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f5386000640 1 --2- 172.21.15.103:0/3612476391 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f538806f660 0x7f538814fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:11.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f5387400640 1 --2- 172.21.15.103:0/3612476391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5388150050 0x7f53881fa890 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f5388073b50 tx=0x7f5380006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:11.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f537ea00640 1 -- 172.21.15.103:0/3612476391 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538000fa20 con 0x7f5388150050 2024-09-10T22:46:11.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f537ea00640 1 -- 172.21.15.103:0/3612476391 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f538000fbe0 con 0x7f5388150050 2024-09-10T22:46:11.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f537ea00640 1 -- 172.21.15.103:0/3612476391 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5380011430 con 0x7f5388150050 2024-09-10T22:46:11.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f538d800640 1 -- 172.21.15.103:0/3612476391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f538806e8a0 con 0x7f5388150050 2024-09-10T22:46:11.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f538d800640 1 -- 172.21.15.103:0/3612476391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f538806ee60 con 0x7f5388150050 2024-09-10T22:46:11.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.424+0000 7f538d800640 1 -- 172.21.15.103:0/3612476391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f538806fa40 con 0x7f5388150050 2024-09-10T22:46:11.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.428+0000 7f537ea00640 1 -- 172.21.15.103:0/3612476391 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f53800115f0 con 0x7f5388150050 2024-09-10T22:46:11.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.428+0000 7f537ea00640 1 --2- 172.21.15.103:0/3612476391 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5368072610 0x7f5368074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:11.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.428+0000 7f537ea00640 1 -- 172.21.15.103:0/3612476391 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f5380093cf0 con 0x7f5388150050 2024-09-10T22:46:11.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.428+0000 7f5386a00640 1 --2- 172.21.15.103:0/3612476391 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5368072610 0x7f5368074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:11.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.428+0000 7f5386a00640 1 --2- 172.21.15.103:0/3612476391 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5368072610 0x7f5368074ad0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f53780ae000 tx=0x7f5378019fb0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:11.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.432+0000 7f537ea00640 1 -- 172.21.15.103:0/3612476391 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f538005eb00 con 0x7f5388150050 2024-09-10T22:46:11.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.656+0000 7f538d800640 1 -- 172.21.15.103:0/3612476391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f53880cff20 con 0x7f5388150050 2024-09-10T22:46:11.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.656+0000 7f537ea00640 1 -- 172.21.15.103:0/3612476391 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2010 (secure 0 0 0) 0x7f5380063530 con 0x7f5388150050 2024-09-10T22:46:11.658 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:11.658 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":467,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700795,"bytes_used":267567104,"bytes_avail":772826546176,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":7166,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":7717},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8235},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8238}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-09-10T22:46:05.733362+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T22:46:11.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.660+0000 7f538d800640 1 -- 172.21.15.103:0/3612476391 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5368072610 msgr2=0x7f5368074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:11.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.660+0000 7f538d800640 1 --2- 172.21.15.103:0/3612476391 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5368072610 0x7f5368074ad0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f53780ae000 tx=0x7f5378019fb0 comp rx=0 tx=0).stop 2024-09-10T22:46:11.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.660+0000 7f538d800640 1 -- 172.21.15.103:0/3612476391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5388150050 msgr2=0x7f53881fa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:11.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.660+0000 7f538d800640 1 --2- 172.21.15.103:0/3612476391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5388150050 0x7f53881fa890 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f5388073b50 tx=0x7f5380006720 comp rx=0 tx=0).stop 2024-09-10T22:46:11.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.660+0000 7f538d800640 1 -- 172.21.15.103:0/3612476391 shutdown_connections 2024-09-10T22:46:11.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.660+0000 7f538d800640 1 --2- 172.21.15.103:0/3612476391 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5368072610 0x7f5368074ad0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:11.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.660+0000 7f538d800640 1 --2- 172.21.15.103:0/3612476391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5388150050 0x7f53881fa890 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:11.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.660+0000 7f538d800640 1 --2- 172.21.15.103:0/3612476391 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f538806f660 0x7f538814fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:11.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.660+0000 7f538d800640 1 --2- 172.21.15.103:0/3612476391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f536c003a60 0x7f53880b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:11.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.660+0000 7f538d800640 1 -- 172.21.15.103:0/3612476391 >> 172.21.15.103:0/3612476391 conn(0x7f53880d1ac0 msgr2=0x7f5388071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:11.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.660+0000 7f538d800640 1 -- 172.21.15.103:0/3612476391 shutdown_connections 2024-09-10T22:46:11.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:11.660+0000 7f538d800640 1 -- 172.21.15.103:0/3612476391 wait complete. 2024-09-10T22:46:11.678 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]', 'b': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]'} 2024-09-10T22:46:12.679 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:46:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.832+0000 7f5d43c00640 1 -- 172.21.15.103:0/2446779288 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d20004810 msgr2=0x7f5d20004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.832+0000 7f5d43c00640 1 --2- 172.21.15.103:0/2446779288 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d20004810 0x7f5d20004c90 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009b60 tx=0x7f5d2401d230 comp rx=0 tx=0).stop 2024-09-10T22:46:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.832+0000 7f5d41c00640 1 -- 172.21.15.103:0/2446779288 reap_dead start 2024-09-10T22:46:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.832+0000 7f5d43c00640 1 -- 172.21.15.103:0/2446779288 shutdown_connections 2024-09-10T22:46:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.832+0000 7f5d43c00640 1 -- 172.21.15.103:0/2446779288 >> 172.21.15.103:0/2446779288 conn(0x7f5d3c0d1a20 msgr2=0x7f5d3c0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.832+0000 7f5d43c00640 1 -- 172.21.15.103:0/2446779288 shutdown_connections 2024-09-10T22:46:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.832+0000 7f5d43c00640 1 -- 172.21.15.103:0/2446779288 wait complete. 2024-09-10T22:46:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.832+0000 7f5d43c00640 1 Processor -- start 2024-09-10T22:46:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.832+0000 7f5d43c00640 1 -- start start 2024-09-10T22:46:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d43c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d20004810 0x7f5d3c0c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d43c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d3c06e720 0x7f5d3c0cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d43c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d3c06eb60 0x7f5d3c0cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d43c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c0cdb30 con 0x7f5d20004810 2024-09-10T22:46:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d43c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c0cd9b0 con 0x7f5d3c06e720 2024-09-10T22:46:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d43c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3c0ae7f0 con 0x7f5d3c06eb60 2024-09-10T22:46:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d41200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d20004810 0x7f5d3c0c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d41200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d20004810 0x7f5d3c0c4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58672/0 (socket says 172.21.15.103:58672) 2024-09-10T22:46:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d41200640 1 -- 172.21.15.103:0/3684528038 learned_addr learned my addr 172.21.15.103:0/3684528038 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d33e00640 1 --2- 172.21.15.103:0/3684528038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d3c06e720 0x7f5d3c0cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d41c00640 1 --2- 172.21.15.103:0/3684528038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d3c06eb60 0x7f5d3c0cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d41200640 1 -- 172.21.15.103:0/3684528038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d3c06eb60 msgr2=0x7f5d3c0cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d41200640 1 --2- 172.21.15.103:0/3684528038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d3c06eb60 0x7f5d3c0cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d41200640 1 -- 172.21.15.103:0/3684528038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d3c06e720 msgr2=0x7f5d3c0cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d41200640 1 --2- 172.21.15.103:0/3684528038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d3c06e720 0x7f5d3c0cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d41200640 1 -- 172.21.15.103:0/3684528038 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c0c5080 con 0x7f5d20004810 2024-09-10T22:46:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d41200640 1 --2- 172.21.15.103:0/3684528038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d20004810 0x7f5d3c0c4b40 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c006660 tx=0x7f5d2c0039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d39600640 1 -- 172.21.15.103:0/3684528038 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c015070 con 0x7f5d20004810 2024-09-10T22:46:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d39600640 1 -- 172.21.15.103:0/3684528038 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d2c011900 con 0x7f5d20004810 2024-09-10T22:46:12.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d43c00640 1 -- 172.21.15.103:0/3684528038 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3c0c9830 con 0x7f5d20004810 2024-09-10T22:46:12.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d39600640 1 -- 172.21.15.103:0/3684528038 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c011d50 con 0x7f5d20004810 2024-09-10T22:46:12.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d43c00640 1 -- 172.21.15.103:0/3684528038 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3c0c8b90 con 0x7f5d20004810 2024-09-10T22:46:12.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.836+0000 7f5d43c00640 1 -- 172.21.15.103:0/3684528038 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d3c0ccdf0 con 0x7f5d20004810 2024-09-10T22:46:12.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.840+0000 7f5d39600640 1 -- 172.21.15.103:0/3684528038 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5d2c010420 con 0x7f5d20004810 2024-09-10T22:46:12.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.840+0000 7f5d39600640 1 --2- 172.21.15.103:0/3684528038 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5d18072610 0x7f5d18074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:12.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.840+0000 7f5d39600640 1 -- 172.21.15.103:0/3684528038 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f5d2c094130 con 0x7f5d20004810 2024-09-10T22:46:12.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.840+0000 7f5d33e00640 1 --2- 172.21.15.103:0/3684528038 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5d18072610 0x7f5d18074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:12.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.840+0000 7f5d33e00640 1 --2- 172.21.15.103:0/3684528038 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5d18072610 0x7f5d18074ad0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5d240ae000 tx=0x7f5d24019fd0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:12.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:12.844+0000 7f5d39600640 1 -- 172.21.15.103:0/3684528038 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5d3c0c5080 con 0x7f5d20004810 2024-09-10T22:46:13.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.040+0000 7f5d43c00640 1 -- 172.21.15.103:0/3684528038 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d3c0aef50 con 0x7f5d20004810 2024-09-10T22:46:13.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.044+0000 7f5d39600640 1 -- 172.21.15.103:0/3684528038 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5287 (secure 0 0 0) 0x7f5d2c05efc0 con 0x7f5d20004810 2024-09-10T22:46:13.044 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:13.044 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:46:01.549542+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8238,"mds_1":8235,"mds_2":7717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7717":{"gid":7717,"name":"b","rank":2,"incarnation":111,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8235":{"gid":8235,"name":"a","rank":1,"incarnation":109,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238,8235,7717]},"id":7}]} 2024-09-10T22:46:13.044 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 117 2024-09-10T22:46:13.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.044+0000 7f5d43c00640 1 -- 172.21.15.103:0/3684528038 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5d18072610 msgr2=0x7f5d18074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:13.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.044+0000 7f5d43c00640 1 --2- 172.21.15.103:0/3684528038 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5d18072610 0x7f5d18074ad0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5d240ae000 tx=0x7f5d24019fd0 comp rx=0 tx=0).stop 2024-09-10T22:46:13.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.044+0000 7f5d43c00640 1 -- 172.21.15.103:0/3684528038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d20004810 msgr2=0x7f5d3c0c4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:13.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.044+0000 7f5d43c00640 1 --2- 172.21.15.103:0/3684528038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d20004810 0x7f5d3c0c4b40 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c006660 tx=0x7f5d2c0039d0 comp rx=0 tx=0).stop 2024-09-10T22:46:13.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.044+0000 7f5d43c00640 1 -- 172.21.15.103:0/3684528038 shutdown_connections 2024-09-10T22:46:13.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.044+0000 7f5d43c00640 1 --2- 172.21.15.103:0/3684528038 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5d18072610 0x7f5d18074ad0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:13.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.044+0000 7f5d43c00640 1 --2- 172.21.15.103:0/3684528038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d3c06eb60 0x7f5d3c0cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:13.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.044+0000 7f5d43c00640 1 --2- 172.21.15.103:0/3684528038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d3c06e720 0x7f5d3c0cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:13.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.044+0000 7f5d43c00640 1 --2- 172.21.15.103:0/3684528038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d20004810 0x7f5d3c0c4b40 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:13.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.044+0000 7f5d43c00640 1 -- 172.21.15.103:0/3684528038 >> 172.21.15.103:0/3684528038 conn(0x7f5d3c0d1a20 msgr2=0x7f5d3c0c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:13.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.044+0000 7f5d43c00640 1 -- 172.21.15.103:0/3684528038 shutdown_connections 2024-09-10T22:46:13.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.044+0000 7f5d43c00640 1 -- 172.21.15.103:0/3684528038 wait complete. 2024-09-10T22:46:13.065 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'b'] 2024-09-10T22:46:13.065 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:46:13.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.204+0000 7f78f1400640 1 -- 172.21.15.103:0/875785029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec15be30 msgr2=0x7f78ec0ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:13.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.204+0000 7f78f1400640 1 --2- 172.21.15.103:0/875785029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec15be30 0x7f78ec0ce0c0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009900 tx=0x7f78dc01c850 comp rx=0 tx=0).stop 2024-09-10T22:46:13.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.204+0000 7f78f1400640 1 -- 172.21.15.103:0/875785029 shutdown_connections 2024-09-10T22:46:13.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.204+0000 7f78f1400640 1 --2- 172.21.15.103:0/875785029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec15be30 0x7f78ec0ce0c0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:13.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.204+0000 7f78f1400640 1 -- 172.21.15.103:0/875785029 >> 172.21.15.103:0/875785029 conn(0x7f78ec0d1ac0 msgr2=0x7f78ec0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:13.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.204+0000 7f78f1400640 1 -- 172.21.15.103:0/875785029 shutdown_connections 2024-09-10T22:46:13.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.204+0000 7f78f1400640 1 -- 172.21.15.103:0/875785029 wait complete. 2024-09-10T22:46:13.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78f1400640 1 Processor -- start 2024-09-10T22:46:13.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78f1400640 1 -- start start 2024-09-10T22:46:13.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78f1400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78ec0ae9c0 0x7f78ec0b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:13.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78f1400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78ec0b09c0 0x7f78ec1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:13.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78f1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec15be30 0x7f78ec156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:13.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78f1400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec169e50 con 0x7f78ec15be30 2024-09-10T22:46:13.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78f1400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec169cd0 con 0x7f78ec0b09c0 2024-09-10T22:46:13.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78f1400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f78ec169fd0 con 0x7f78ec0ae9c0 2024-09-10T22:46:13.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78eb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec15be30 0x7f78ec156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:13.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78eb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec15be30 0x7f78ec156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58698/0 (socket says 172.21.15.103:58698) 2024-09-10T22:46:13.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78eb200640 1 -- 172.21.15.103:0/2648072638 learned_addr learned my addr 172.21.15.103:0/2648072638 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:13.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78ea800640 1 --2- 172.21.15.103:0/2648072638 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78ec0ae9c0 0x7f78ec0b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:13.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78e1e00640 1 --2- 172.21.15.103:0/2648072638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78ec0b09c0 0x7f78ec1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:13.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78eb200640 1 -- 172.21.15.103:0/2648072638 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78ec0ae9c0 msgr2=0x7f78ec0b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:13.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78eb200640 1 --2- 172.21.15.103:0/2648072638 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78ec0ae9c0 0x7f78ec0b5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:13.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78eb200640 1 -- 172.21.15.103:0/2648072638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78ec0b09c0 msgr2=0x7f78ec1567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:13.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78eb200640 1 --2- 172.21.15.103:0/2648072638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78ec0b09c0 0x7f78ec1567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:13.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78eb200640 1 -- 172.21.15.103:0/2648072638 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ec155e40 con 0x7f78ec15be30 2024-09-10T22:46:13.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78eb200640 1 --2- 172.21.15.103:0/2648072638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec15be30 0x7f78ec156ce0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f78e400c4d0 tx=0x7f78e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:13.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78e3400640 1 -- 172.21.15.103:0/2648072638 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e40052d0 con 0x7f78ec15be30 2024-09-10T22:46:13.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78e3400640 1 -- 172.21.15.103:0/2648072638 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78e4005470 con 0x7f78ec15be30 2024-09-10T22:46:13.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78e3400640 1 -- 172.21.15.103:0/2648072638 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e4012870 con 0x7f78ec15be30 2024-09-10T22:46:13.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78f1400640 1 -- 172.21.15.103:0/2648072638 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78ec167170 con 0x7f78ec15be30 2024-09-10T22:46:13.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78f1400640 1 -- 172.21.15.103:0/2648072638 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ec167430 con 0x7f78ec15be30 2024-09-10T22:46:13.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.208+0000 7f78f1400640 1 -- 172.21.15.103:0/2648072638 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78ec0b48f0 con 0x7f78ec15be30 2024-09-10T22:46:13.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.212+0000 7f78e3400640 1 -- 172.21.15.103:0/2648072638 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f78e4003600 con 0x7f78ec15be30 2024-09-10T22:46:13.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.212+0000 7f78e3400640 1 --2- 172.21.15.103:0/2648072638 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f78c80725e0 0x7f78c8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:13.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.212+0000 7f78e3400640 1 -- 172.21.15.103:0/2648072638 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f78e4092ee0 con 0x7f78ec15be30 2024-09-10T22:46:13.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.212+0000 7f78ea800640 1 --2- 172.21.15.103:0/2648072638 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f78c80725e0 0x7f78c8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:13.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.212+0000 7f78ea800640 1 --2- 172.21.15.103:0/2648072638 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f78c80725e0 0x7f78c8074aa0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0af000 tx=0x7f78dc01b090 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:13.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.216+0000 7f78e3400640 1 -- 172.21.15.103:0/2648072638 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f78e405dcf0 con 0x7f78ec15be30 2024-09-10T22:46:13.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.440+0000 7f78f1400640 1 -- 172.21.15.103:0/2648072638 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f78ec0aee10 con 0x7f78ec15be30 2024-09-10T22:46:13.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.440+0000 7f78e3400640 1 -- 172.21.15.103:0/2648072638 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1972 (secure 0 0 0) 0x7f78e4062720 con 0x7f78ec15be30 2024-09-10T22:46:13.442 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:13.443 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":469,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700795,"bytes_used":267567104,"bytes_avail":772826546176,"bytes_total":773094113280,"write_bytes_sec":938,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":7717},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8235},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8238}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2024-09-10T22:46:11.734946+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T22:46:13.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.444+0000 7f78f1400640 1 -- 172.21.15.103:0/2648072638 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f78c80725e0 msgr2=0x7f78c8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.444+0000 7f78f1400640 1 --2- 172.21.15.103:0/2648072638 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f78c80725e0 0x7f78c8074aa0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0af000 tx=0x7f78dc01b090 comp rx=0 tx=0).stop 2024-09-10T22:46:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.444+0000 7f78f1400640 1 -- 172.21.15.103:0/2648072638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec15be30 msgr2=0x7f78ec156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.444+0000 7f78f1400640 1 --2- 172.21.15.103:0/2648072638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec15be30 0x7f78ec156ce0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f78e400c4d0 tx=0x7f78e400c990 comp rx=0 tx=0).stop 2024-09-10T22:46:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.444+0000 7f78f1400640 1 -- 172.21.15.103:0/2648072638 shutdown_connections 2024-09-10T22:46:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.444+0000 7f78f1400640 1 --2- 172.21.15.103:0/2648072638 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f78c80725e0 0x7f78c8074aa0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.444+0000 7f78f1400640 1 --2- 172.21.15.103:0/2648072638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec15be30 0x7f78ec156ce0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.444+0000 7f78f1400640 1 --2- 172.21.15.103:0/2648072638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78ec0b09c0 0x7f78ec1567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.444+0000 7f78f1400640 1 --2- 172.21.15.103:0/2648072638 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78ec0ae9c0 0x7f78ec0b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.444+0000 7f78f1400640 1 -- 172.21.15.103:0/2648072638 >> 172.21.15.103:0/2648072638 conn(0x7f78ec0d1ac0 msgr2=0x7f78ec0d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.444+0000 7f78f1400640 1 -- 172.21.15.103:0/2648072638 shutdown_connections 2024-09-10T22:46:13.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:13.444+0000 7f78f1400640 1 -- 172.21.15.103:0/2648072638 wait complete. 2024-09-10T22:46:13.464 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]', 'b': 'paused', 'c': 'paused paths [/d1/d2/d3]'} 2024-09-10T22:46:14.464 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:46:14.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.612+0000 7f1dd8000640 1 -- 172.21.15.103:0/519426928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1db8004d50 msgr2=0x7f1db80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:14.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.612+0000 7f1dd8000640 1 --2- 172.21.15.103:0/519426928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1db8004d50 0x7f1db80051d0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800c640 tx=0x7f1dc801d320 comp rx=0 tx=0).stop 2024-09-10T22:46:14.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.612+0000 7f1dd6000640 1 -- 172.21.15.103:0/519426928 reap_dead start 2024-09-10T22:46:14.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.612+0000 7f1dd8000640 1 -- 172.21.15.103:0/519426928 shutdown_connections 2024-09-10T22:46:14.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.612+0000 7f1dd8000640 1 -- 172.21.15.103:0/519426928 >> 172.21.15.103:0/519426928 conn(0x7f1dd00d1a20 msgr2=0x7f1dd00d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:14.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.612+0000 7f1dd8000640 1 -- 172.21.15.103:0/519426928 shutdown_connections 2024-09-10T22:46:14.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.612+0000 7f1dd8000640 1 -- 172.21.15.103:0/519426928 wait complete. 2024-09-10T22:46:14.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.612+0000 7f1dd8000640 1 Processor -- start 2024-09-10T22:46:14.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.612+0000 7f1dd8000640 1 -- start start 2024-09-10T22:46:14.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.612+0000 7f1dd8000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1db8004d50 0x7f1dd0151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:14.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.612+0000 7f1dd8000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1dd00c8070 0x7f1dd00b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:14.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.612+0000 7f1dd8000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dd00b6330 0x7f1dd0151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:14.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.612+0000 7f1dd8000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd00cd960 con 0x7f1db8004d50 2024-09-10T22:46:14.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.612+0000 7f1dd8000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd00cd7e0 con 0x7f1dd00c8070 2024-09-10T22:46:14.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.612+0000 7f1dd8000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1dd00cdae0 con 0x7f1dd00b6330 2024-09-10T22:46:14.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.612+0000 7f1dd5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1db8004d50 0x7f1dd0151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:14.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dd5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1db8004d50 0x7f1dd0151390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58716/0 (socket says 172.21.15.103:58716) 2024-09-10T22:46:14.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dd5600640 1 -- 172.21.15.103:0/3671642605 learned_addr learned my addr 172.21.15.103:0/3671642605 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:14.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dd4c00640 1 --2- 172.21.15.103:0/3671642605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1dd00c8070 0x7f1dd00b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:14.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dd6000640 1 --2- 172.21.15.103:0/3671642605 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dd00b6330 0x7f1dd0151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:14.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dd5600640 1 -- 172.21.15.103:0/3671642605 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dd00b6330 msgr2=0x7f1dd0151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:14.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dd5600640 1 --2- 172.21.15.103:0/3671642605 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dd00b6330 0x7f1dd0151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:14.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dd5600640 1 -- 172.21.15.103:0/3671642605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1dd00c8070 msgr2=0x7f1dd00b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:14.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dd5600640 1 --2- 172.21.15.103:0/3671642605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1dd00c8070 0x7f1dd00b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:14.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dd5600640 1 -- 172.21.15.103:0/3671642605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd0151b00 con 0x7f1db8004d50 2024-09-10T22:46:14.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dd6000640 1 --2- 172.21.15.103:0/3671642605 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dd00b6330 0x7f1dd0151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:14.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dd5600640 1 --2- 172.21.15.103:0/3671642605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1db8004d50 0x7f1dd0151390 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4011ae0 tx=0x7f1dc4009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:14.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dcd600640 1 -- 172.21.15.103:0/3671642605 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc401e070 con 0x7f1db8004d50 2024-09-10T22:46:14.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dcd600640 1 -- 172.21.15.103:0/3671642605 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1dc400fe40 con 0x7f1db8004d50 2024-09-10T22:46:14.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dd8000640 1 -- 172.21.15.103:0/3671642605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dd01f2550 con 0x7f1db8004d50 2024-09-10T22:46:14.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dcd600640 1 -- 172.21.15.103:0/3671642605 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40042b0 con 0x7f1db8004d50 2024-09-10T22:46:14.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dd8000640 1 -- 172.21.15.103:0/3671642605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dd01f27f0 con 0x7f1db8004d50 2024-09-10T22:46:14.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dd8000640 1 -- 172.21.15.103:0/3671642605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dd00aea00 con 0x7f1db8004d50 2024-09-10T22:46:14.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dcd600640 1 -- 172.21.15.103:0/3671642605 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1dc4003600 con 0x7f1db8004d50 2024-09-10T22:46:14.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.616+0000 7f1dcd600640 1 --2- 172.21.15.103:0/3671642605 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1db00725e0 0x7f1db0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:14.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.620+0000 7f1dcd600640 1 -- 172.21.15.103:0/3671642605 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f1dc4094380 con 0x7f1db8004d50 2024-09-10T22:46:14.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.620+0000 7f1dd4c00640 1 --2- 172.21.15.103:0/3671642605 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1db00725e0 0x7f1db0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:14.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.620+0000 7f1dd4c00640 1 --2- 172.21.15.103:0/3671642605 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1db00725e0 0x7f1db0074aa0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc005950 tx=0x7f1dbc0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:14.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.620+0000 7f1dcd600640 1 -- 172.21.15.103:0/3671642605 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1dc405f1c0 con 0x7f1db8004d50 2024-09-10T22:46:14.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.820+0000 7f1dd8000640 1 -- 172.21.15.103:0/3671642605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1dd00af370 con 0x7f1db8004d50 2024-09-10T22:46:14.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.820+0000 7f1dcd600640 1 -- 172.21.15.103:0/3671642605 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5287 (secure 0 0 0) 0x7f1dc4063bf0 con 0x7f1db8004d50 2024-09-10T22:46:14.821 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:14.821 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:46:01.549542+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8238,"mds_1":8235,"mds_2":7717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7717":{"gid":7717,"name":"b","rank":2,"incarnation":111,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8235":{"gid":8235,"name":"a","rank":1,"incarnation":109,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238,8235,7717]},"id":7}]} 2024-09-10T22:46:14.821 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 117 2024-09-10T22:46:14.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.820+0000 7f1dd8000640 1 -- 172.21.15.103:0/3671642605 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1db00725e0 msgr2=0x7f1db0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:14.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.820+0000 7f1dd8000640 1 --2- 172.21.15.103:0/3671642605 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1db00725e0 0x7f1db0074aa0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc005950 tx=0x7f1dbc0091e0 comp rx=0 tx=0).stop 2024-09-10T22:46:14.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.820+0000 7f1dd8000640 1 -- 172.21.15.103:0/3671642605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1db8004d50 msgr2=0x7f1dd0151390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:14.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.820+0000 7f1dd8000640 1 --2- 172.21.15.103:0/3671642605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1db8004d50 0x7f1dd0151390 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4011ae0 tx=0x7f1dc4009ea0 comp rx=0 tx=0).stop 2024-09-10T22:46:14.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.820+0000 7f1dd8000640 1 -- 172.21.15.103:0/3671642605 shutdown_connections 2024-09-10T22:46:14.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.820+0000 7f1dd8000640 1 --2- 172.21.15.103:0/3671642605 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1db00725e0 0x7f1db0074aa0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:14.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.820+0000 7f1dd8000640 1 --2- 172.21.15.103:0/3671642605 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dd00b6330 0x7f1dd0151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:14.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.820+0000 7f1dd8000640 1 --2- 172.21.15.103:0/3671642605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1dd00c8070 0x7f1dd00b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:14.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.820+0000 7f1dd8000640 1 --2- 172.21.15.103:0/3671642605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1db8004d50 0x7f1dd0151390 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:14.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.820+0000 7f1dd8000640 1 -- 172.21.15.103:0/3671642605 >> 172.21.15.103:0/3671642605 conn(0x7f1dd00d1a20 msgr2=0x7f1dd0154320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:14.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.820+0000 7f1dd8000640 1 -- 172.21.15.103:0/3671642605 shutdown_connections 2024-09-10T22:46:14.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.820+0000 7f1dd8000640 1 -- 172.21.15.103:0/3671642605 wait complete. 2024-09-10T22:46:14.842 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'b'] 2024-09-10T22:46:14.842 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:46:14.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.980+0000 7f87f3200640 1 -- 172.21.15.103:0/2489158328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87ec15f1a0 msgr2=0x7f87ec0ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:14.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.980+0000 7f87f3200640 1 --2- 172.21.15.103:0/2489158328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87ec15f1a0 0x7f87ec0ae7f0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f87dc009c80 tx=0x7f87dc01cda0 comp rx=0 tx=0).stop 2024-09-10T22:46:14.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f3200640 1 -- 172.21.15.103:0/2489158328 shutdown_connections 2024-09-10T22:46:14.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f3200640 1 --2- 172.21.15.103:0/2489158328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87ec15f1a0 0x7f87ec0ae7f0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:14.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f3200640 1 -- 172.21.15.103:0/2489158328 >> 172.21.15.103:0/2489158328 conn(0x7f87ec0d1a20 msgr2=0x7f87ec0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:14.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f3200640 1 -- 172.21.15.103:0/2489158328 shutdown_connections 2024-09-10T22:46:14.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f3200640 1 -- 172.21.15.103:0/2489158328 wait complete. 2024-09-10T22:46:14.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f3200640 1 Processor -- start 2024-09-10T22:46:14.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f3200640 1 -- start start 2024-09-10T22:46:14.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f3200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87ec0cd500 0x7f87ec158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f3200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87ec0cdd00 0x7f87ec071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f3200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87ec15f1a0 0x7f87ec0afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f3200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec169f70 con 0x7f87ec15f1a0 2024-09-10T22:46:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f3200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec169df0 con 0x7f87ec0cd500 2024-09-10T22:46:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f3200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f87ec16a0f0 con 0x7f87ec0cdd00 2024-09-10T22:46:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f1200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87ec15f1a0 0x7f87ec0afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f1200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87ec15f1a0 0x7f87ec0afdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58736/0 (socket says 172.21.15.103:58736) 2024-09-10T22:46:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f1200640 1 -- 172.21.15.103:0/4105300586 learned_addr learned my addr 172.21.15.103:0/4105300586 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87ebe00640 1 --2- 172.21.15.103:0/4105300586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87ec0cd500 0x7f87ec158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87e3400640 1 --2- 172.21.15.103:0/4105300586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87ec0cdd00 0x7f87ec071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f1200640 1 -- 172.21.15.103:0/4105300586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87ec0cdd00 msgr2=0x7f87ec071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f1200640 1 --2- 172.21.15.103:0/4105300586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87ec0cdd00 0x7f87ec071ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:14.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f1200640 1 -- 172.21.15.103:0/4105300586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87ec0cd500 msgr2=0x7f87ec158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:14.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f1200640 1 --2- 172.21.15.103:0/4105300586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87ec0cd500 0x7f87ec158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:14.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f1200640 1 -- 172.21.15.103:0/4105300586 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87ec072310 con 0x7f87ec15f1a0 2024-09-10T22:46:14.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87ebe00640 1 --2- 172.21.15.103:0/4105300586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87ec0cd500 0x7f87ec158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:14.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.984+0000 7f87f1200640 1 --2- 172.21.15.103:0/4105300586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87ec15f1a0 0x7f87ec0afdf0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f87e400c4d0 tx=0x7f87e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:14.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.988+0000 7f87e8c00640 1 -- 172.21.15.103:0/4105300586 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e40052d0 con 0x7f87ec15f1a0 2024-09-10T22:46:14.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.988+0000 7f87e8c00640 1 -- 172.21.15.103:0/4105300586 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f87e4005470 con 0x7f87ec15f1a0 2024-09-10T22:46:14.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.988+0000 7f87e8c00640 1 -- 172.21.15.103:0/4105300586 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4012870 con 0x7f87ec15f1a0 2024-09-10T22:46:14.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.988+0000 7f87f3200640 1 -- 172.21.15.103:0/4105300586 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87ec1f7980 con 0x7f87ec15f1a0 2024-09-10T22:46:14.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.988+0000 7f87f3200640 1 -- 172.21.15.103:0/4105300586 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87ec1f7f40 con 0x7f87ec15f1a0 2024-09-10T22:46:14.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.988+0000 7f87f3200640 1 -- 172.21.15.103:0/4105300586 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87ec0ae7f0 con 0x7f87ec15f1a0 2024-09-10T22:46:14.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.988+0000 7f87e8c00640 1 -- 172.21.15.103:0/4105300586 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f87e4003600 con 0x7f87ec15f1a0 2024-09-10T22:46:14.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.988+0000 7f87e8c00640 1 --2- 172.21.15.103:0/4105300586 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f87c8072610 0x7f87c8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:14.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.988+0000 7f87e8c00640 1 -- 172.21.15.103:0/4105300586 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f87e4092ed0 con 0x7f87ec15f1a0 2024-09-10T22:46:14.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.988+0000 7f87ebe00640 1 --2- 172.21.15.103:0/4105300586 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f87c8072610 0x7f87c8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:14.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.992+0000 7f87ebe00640 1 --2- 172.21.15.103:0/4105300586 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f87c8072610 0x7f87c8074ad0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f87dc0af000 tx=0x7f87dc01b5e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:14.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:14.992+0000 7f87e8c00640 1 -- 172.21.15.103:0/4105300586 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f87e405e3d0 con 0x7f87ec15f1a0 2024-09-10T22:46:15.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:15.216+0000 7f87f3200640 1 -- 172.21.15.103:0/4105300586 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f87ec0cd170 con 0x7f87ec15f1a0 2024-09-10T22:46:15.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:15.216+0000 7f87e8c00640 1 -- 172.21.15.103:0/4105300586 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1972 (secure 0 0 0) 0x7f87e405dcd0 con 0x7f87ec15f1a0 2024-09-10T22:46:15.221 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:15.221 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":470,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700795,"bytes_used":267567104,"bytes_avail":772826546176,"bytes_total":773094113280,"write_bytes_sec":767,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":7717},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8235},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8238}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2024-09-10T22:46:11.734946+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T22:46:15.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:15.220+0000 7f87f3200640 1 -- 172.21.15.103:0/4105300586 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f87c8072610 msgr2=0x7f87c8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:15.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:15.220+0000 7f87f3200640 1 --2- 172.21.15.103:0/4105300586 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f87c8072610 0x7f87c8074ad0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f87dc0af000 tx=0x7f87dc01b5e0 comp rx=0 tx=0).stop 2024-09-10T22:46:15.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:15.220+0000 7f87f3200640 1 -- 172.21.15.103:0/4105300586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87ec15f1a0 msgr2=0x7f87ec0afdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:15.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:15.220+0000 7f87f3200640 1 --2- 172.21.15.103:0/4105300586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87ec15f1a0 0x7f87ec0afdf0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f87e400c4d0 tx=0x7f87e400c990 comp rx=0 tx=0).stop 2024-09-10T22:46:15.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:15.220+0000 7f87f3200640 1 -- 172.21.15.103:0/4105300586 shutdown_connections 2024-09-10T22:46:15.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:15.220+0000 7f87f3200640 1 --2- 172.21.15.103:0/4105300586 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f87c8072610 0x7f87c8074ad0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:15.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:15.220+0000 7f87f3200640 1 --2- 172.21.15.103:0/4105300586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87ec15f1a0 0x7f87ec0afdf0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:15.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:15.220+0000 7f87f3200640 1 --2- 172.21.15.103:0/4105300586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87ec0cdd00 0x7f87ec071ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:15.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:15.220+0000 7f87f3200640 1 --2- 172.21.15.103:0/4105300586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87ec0cd500 0x7f87ec158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:15.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:15.220+0000 7f87f3200640 1 -- 172.21.15.103:0/4105300586 >> 172.21.15.103:0/4105300586 conn(0x7f87ec0d1a20 msgr2=0x7f87ec0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:15.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:15.220+0000 7f87f3200640 1 -- 172.21.15.103:0/4105300586 shutdown_connections 2024-09-10T22:46:15.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:15.220+0000 7f87f3200640 1 -- 172.21.15.103:0/4105300586 wait complete. 2024-09-10T22:46:15.240 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]', 'b': 'paused', 'c': 'paused paths [/d1/d2/d3]'} 2024-09-10T22:46:16.241 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:46:16.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.392+0000 7f47a2800640 1 -- 172.21.15.103:0/3403374091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f479c0cd940 msgr2=0x7f479c15f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:16.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.392+0000 7f47a2800640 1 --2- 172.21.15.103:0/3403374091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f479c0cd940 0x7f479c15f4b0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f4794009c80 tx=0x7f479401cda0 comp rx=0 tx=0).stop 2024-09-10T22:46:16.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.392+0000 7f47a2800640 1 -- 172.21.15.103:0/3403374091 shutdown_connections 2024-09-10T22:46:16.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.392+0000 7f47a2800640 1 --2- 172.21.15.103:0/3403374091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f479c0cd940 0x7f479c15f4b0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:16.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.392+0000 7f47a2800640 1 -- 172.21.15.103:0/3403374091 >> 172.21.15.103:0/3403374091 conn(0x7f479c06cc00 msgr2=0x7f479c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:16.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.392+0000 7f47a2800640 1 -- 172.21.15.103:0/3403374091 shutdown_connections 2024-09-10T22:46:16.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.392+0000 7f47a2800640 1 -- 172.21.15.103:0/3403374091 wait complete. 2024-09-10T22:46:16.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.392+0000 7f47a2800640 1 Processor -- start 2024-09-10T22:46:16.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.392+0000 7f47a2800640 1 -- start start 2024-09-10T22:46:16.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.392+0000 7f47a2800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f479c0cd940 0x7f479c072850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:16.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.392+0000 7f47a2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f479c0cf9f0 0x7f479c152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:16.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.392+0000 7f47a2800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f479c0cfdd0 0x7f479c14f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:16.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.392+0000 7f47a2800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f479c168ba0 con 0x7f479c0cf9f0 2024-09-10T22:46:16.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.392+0000 7f47a2800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f479c168a20 con 0x7f479c0cfdd0 2024-09-10T22:46:16.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.392+0000 7f47a2800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f479c168d20 con 0x7f479c0cd940 2024-09-10T22:46:16.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.396+0000 7f4792a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f479c0cf9f0 0x7f479c152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:16.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.396+0000 7f4792a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f479c0cf9f0 0x7f479c152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58746/0 (socket says 172.21.15.103:58746) 2024-09-10T22:46:16.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.396+0000 7f4792a00640 1 -- 172.21.15.103:0/2460198481 learned_addr learned my addr 172.21.15.103:0/2460198481 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:16.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.396+0000 7f479be00640 1 --2- 172.21.15.103:0/2460198481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f479c0cfdd0 0x7f479c14f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:16.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.396+0000 7f479b400640 1 --2- 172.21.15.103:0/2460198481 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f479c0cd940 0x7f479c072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:16.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.396+0000 7f4792a00640 1 -- 172.21.15.103:0/2460198481 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f479c0cd940 msgr2=0x7f479c072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:16.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.396+0000 7f4792a00640 1 --2- 172.21.15.103:0/2460198481 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f479c0cd940 0x7f479c072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:16.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.396+0000 7f4792a00640 1 -- 172.21.15.103:0/2460198481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f479c0cfdd0 msgr2=0x7f479c14f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:16.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.396+0000 7f4792a00640 1 --2- 172.21.15.103:0/2460198481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f479c0cfdd0 0x7f479c14f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:16.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.396+0000 7f4792a00640 1 -- 172.21.15.103:0/2460198481 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479c072f30 con 0x7f479c0cf9f0 2024-09-10T22:46:16.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.396+0000 7f4792a00640 1 --2- 172.21.15.103:0/2460198481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f479c0cf9f0 0x7f479c152460 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f478400c420 tx=0x7f478400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:16.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.396+0000 7f4793e00640 1 -- 172.21.15.103:0/2460198481 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4784017070 con 0x7f479c0cf9f0 2024-09-10T22:46:16.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.396+0000 7f4793e00640 1 -- 172.21.15.103:0/2460198481 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47840053c0 con 0x7f479c0cf9f0 2024-09-10T22:46:16.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.396+0000 7f4793e00640 1 -- 172.21.15.103:0/2460198481 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4784003860 con 0x7f479c0cf9f0 2024-09-10T22:46:16.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.396+0000 7f47a2800640 1 -- 172.21.15.103:0/2460198481 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f479c073210 con 0x7f479c0cf9f0 2024-09-10T22:46:16.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.396+0000 7f47a2800640 1 -- 172.21.15.103:0/2460198481 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f479c0b0da0 con 0x7f479c0cf9f0 2024-09-10T22:46:16.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.396+0000 7f47a2800640 1 -- 172.21.15.103:0/2460198481 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f479c06eb80 con 0x7f479c0cf9f0 2024-09-10T22:46:16.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.396+0000 7f4793e00640 1 -- 172.21.15.103:0/2460198481 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4784003a00 con 0x7f479c0cf9f0 2024-09-10T22:46:16.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.400+0000 7f4793e00640 1 --2- 172.21.15.103:0/2460198481 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4778072610 0x7f4778074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:16.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.400+0000 7f4793e00640 1 -- 172.21.15.103:0/2460198481 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f4784092a40 con 0x7f479c0cf9f0 2024-09-10T22:46:16.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.400+0000 7f479b400640 1 --2- 172.21.15.103:0/2460198481 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4778072610 0x7f4778074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:16.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.400+0000 7f479b400640 1 --2- 172.21.15.103:0/2460198481 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4778072610 0x7f4778074ad0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f478c007fd0 tx=0x7f478c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:16.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.404+0000 7f4793e00640 1 -- 172.21.15.103:0/2460198481 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f478405d850 con 0x7f479c0cf9f0 2024-09-10T22:46:16.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.604+0000 7f47a2800640 1 -- 172.21.15.103:0/2460198481 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f479c150780 con 0x7f479c0cf9f0 2024-09-10T22:46:16.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.608+0000 7f4793e00640 1 -- 172.21.15.103:0/2460198481 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5287 (secure 0 0 0) 0x7f4784062280 con 0x7f479c0cf9f0 2024-09-10T22:46:16.607 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:16.607 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:46:01.549542+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8238,"mds_1":8235,"mds_2":7717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7717":{"gid":7717,"name":"b","rank":2,"incarnation":111,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8235":{"gid":8235,"name":"a","rank":1,"incarnation":109,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238,8235,7717]},"id":7}]} 2024-09-10T22:46:16.608 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 117 2024-09-10T22:46:16.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.608+0000 7f47a2800640 1 -- 172.21.15.103:0/2460198481 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4778072610 msgr2=0x7f4778074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:16.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.608+0000 7f47a2800640 1 --2- 172.21.15.103:0/2460198481 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4778072610 0x7f4778074ad0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f478c007fd0 tx=0x7f478c009040 comp rx=0 tx=0).stop 2024-09-10T22:46:16.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.608+0000 7f47a2800640 1 -- 172.21.15.103:0/2460198481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f479c0cf9f0 msgr2=0x7f479c152460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:16.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.608+0000 7f47a2800640 1 --2- 172.21.15.103:0/2460198481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f479c0cf9f0 0x7f479c152460 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f478400c420 tx=0x7f478400c8e0 comp rx=0 tx=0).stop 2024-09-10T22:46:16.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.608+0000 7f47a2800640 1 -- 172.21.15.103:0/2460198481 shutdown_connections 2024-09-10T22:46:16.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.608+0000 7f47a2800640 1 --2- 172.21.15.103:0/2460198481 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4778072610 0x7f4778074ad0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:16.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.608+0000 7f47a2800640 1 --2- 172.21.15.103:0/2460198481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f479c0cfdd0 0x7f479c14f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:16.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.608+0000 7f47a2800640 1 --2- 172.21.15.103:0/2460198481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f479c0cf9f0 0x7f479c152460 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:16.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.608+0000 7f47a2800640 1 --2- 172.21.15.103:0/2460198481 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f479c0cd940 0x7f479c072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:16.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.608+0000 7f47a2800640 1 -- 172.21.15.103:0/2460198481 >> 172.21.15.103:0/2460198481 conn(0x7f479c06cc00 msgr2=0x7f479c158cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:16.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.608+0000 7f47a2800640 1 -- 172.21.15.103:0/2460198481 shutdown_connections 2024-09-10T22:46:16.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.608+0000 7f47a2800640 1 -- 172.21.15.103:0/2460198481 wait complete. 2024-09-10T22:46:16.628 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'b'] 2024-09-10T22:46:16.629 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T22:46:16.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1253200640 1 -- 172.21.15.103:0/949353062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12540d23f0 msgr2=0x7f12540d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:16.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1253200640 1 --2- 172.21.15.103:0/949353062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12540d23f0 0x7f12540d1280 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f124c009c80 tx=0x7f124c01cd10 comp rx=0 tx=0).stop 2024-09-10T22:46:16.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1253200640 1 -- 172.21.15.103:0/949353062 shutdown_connections 2024-09-10T22:46:16.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1253200640 1 --2- 172.21.15.103:0/949353062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12540d23f0 0x7f12540d1280 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:16.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1253200640 1 -- 172.21.15.103:0/949353062 >> 172.21.15.103:0/949353062 conn(0x7f12540d18d0 msgr2=0x7f12540d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:16.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1253200640 1 -- 172.21.15.103:0/949353062 shutdown_connections 2024-09-10T22:46:16.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1253200640 1 -- 172.21.15.103:0/949353062 wait complete. 2024-09-10T22:46:16.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1253200640 1 Processor -- start 2024-09-10T22:46:16.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1253200640 1 -- start start 2024-09-10T22:46:16.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1253200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1254070b40 0x7f12541f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:16.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1253200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12540d23f0 0x7f12541573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:16.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1253200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f125415f0e0 0x7f1254151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:16.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1253200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1254169e00 con 0x7f125415f0e0 2024-09-10T22:46:16.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1253200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1254169c80 con 0x7f1254070b40 2024-09-10T22:46:16.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1253200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1254169f80 con 0x7f12540d23f0 2024-09-10T22:46:16.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1252800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f125415f0e0 0x7f1254151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:16.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1252800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f125415f0e0 0x7f1254151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40374/0 (socket says 172.21.15.103:40374) 2024-09-10T22:46:16.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1252800640 1 -- 172.21.15.103:0/1574745755 learned_addr learned my addr 172.21.15.103:0/1574745755 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:16.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1251e00640 1 --2- 172.21.15.103:0/1574745755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1254070b40 0x7f12541f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:16.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1251400640 1 --2- 172.21.15.103:0/1574745755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12540d23f0 0x7f12541573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:16.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1252800640 1 -- 172.21.15.103:0/1574745755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12540d23f0 msgr2=0x7f12541573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:16.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1252800640 1 --2- 172.21.15.103:0/1574745755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12540d23f0 0x7f12541573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:16.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1252800640 1 -- 172.21.15.103:0/1574745755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1254070b40 msgr2=0x7f12541f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:16.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1252800640 1 --2- 172.21.15.103:0/1574745755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1254070b40 0x7f12541f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:16.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1252800640 1 -- 172.21.15.103:0/1574745755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12541f8d30 con 0x7f125415f0e0 2024-09-10T22:46:16.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.768+0000 7f1251e00640 1 --2- 172.21.15.103:0/1574745755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1254070b40 0x7f12541f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:16.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.772+0000 7f1252800640 1 --2- 172.21.15.103:0/1574745755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f125415f0e0 0x7f1254151ad0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f124c019920 tx=0x7f124c0a5a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:16.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.772+0000 7f124a000640 1 -- 172.21.15.103:0/1574745755 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124c0bb070 con 0x7f125415f0e0 2024-09-10T22:46:16.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.772+0000 7f124a000640 1 -- 172.21.15.103:0/1574745755 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f124c004d40 con 0x7f125415f0e0 2024-09-10T22:46:16.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.772+0000 7f1253200640 1 -- 172.21.15.103:0/1574745755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12541f9010 con 0x7f125415f0e0 2024-09-10T22:46:16.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.772+0000 7f124a000640 1 -- 172.21.15.103:0/1574745755 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124c0b2040 con 0x7f125415f0e0 2024-09-10T22:46:16.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.772+0000 7f1253200640 1 -- 172.21.15.103:0/1574745755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12541f95d0 con 0x7f125415f0e0 2024-09-10T22:46:16.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.772+0000 7f1253200640 1 -- 172.21.15.103:0/1574745755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12540d1280 con 0x7f125415f0e0 2024-09-10T22:46:16.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.772+0000 7f124a000640 1 -- 172.21.15.103:0/1574745755 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f124c0b5030 con 0x7f125415f0e0 2024-09-10T22:46:16.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.772+0000 7f124a000640 1 --2- 172.21.15.103:0/1574745755 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f12340725e0 0x7f1234074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:16.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.772+0000 7f124a000640 1 -- 172.21.15.103:0/1574745755 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f124c12d190 con 0x7f125415f0e0 2024-09-10T22:46:16.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.776+0000 7f1251e00640 1 --2- 172.21.15.103:0/1574745755 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f12340725e0 0x7f1234074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:16.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.776+0000 7f1251e00640 1 --2- 172.21.15.103:0/1574745755 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f12340725e0 0x7f1234074aa0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1244000f70 tx=0x7f1244009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:16.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:16.776+0000 7f124a000640 1 -- 172.21.15.103:0/1574745755 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f124c016990 con 0x7f125415f0e0 2024-09-10T22:46:17.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.000+0000 7f1253200640 1 -- 172.21.15.103:0/1574745755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f12540b0e40 con 0x7f125415f0e0 2024-09-10T22:46:17.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.000+0000 7f124a000640 1 -- 172.21.15.103:0/1574745755 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1867 (secure 0 0 0) 0x7f124c0f85f0 con 0x7f125415f0e0 2024-09-10T22:46:17.001 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:17.001 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":472,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1726007918,"num_in_osds":8,"osd_in_since":1726007907,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700795,"bytes_used":267567104,"bytes_avail":772826546176,"bytes_total":773094113280,"write_bytes_sec":767,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":7717},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8235},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8238}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":29,"modified":"2024-09-10T22:46:15.736006+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T22:46:17.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.000+0000 7f1253200640 1 -- 172.21.15.103:0/1574745755 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f12340725e0 msgr2=0x7f1234074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:17.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.000+0000 7f1253200640 1 --2- 172.21.15.103:0/1574745755 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f12340725e0 0x7f1234074aa0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1244000f70 tx=0x7f1244009040 comp rx=0 tx=0).stop 2024-09-10T22:46:17.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.000+0000 7f1253200640 1 -- 172.21.15.103:0/1574745755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f125415f0e0 msgr2=0x7f1254151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:17.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.000+0000 7f1253200640 1 --2- 172.21.15.103:0/1574745755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f125415f0e0 0x7f1254151ad0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f124c019920 tx=0x7f124c0a5a00 comp rx=0 tx=0).stop 2024-09-10T22:46:17.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.004+0000 7f1253200640 1 -- 172.21.15.103:0/1574745755 shutdown_connections 2024-09-10T22:46:17.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.004+0000 7f1253200640 1 --2- 172.21.15.103:0/1574745755 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f12340725e0 0x7f1234074aa0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:17.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.004+0000 7f1253200640 1 --2- 172.21.15.103:0/1574745755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f125415f0e0 0x7f1254151ad0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:17.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.004+0000 7f1253200640 1 --2- 172.21.15.103:0/1574745755 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12540d23f0 0x7f12541573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:17.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.004+0000 7f1253200640 1 --2- 172.21.15.103:0/1574745755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1254070b40 0x7f12541f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:17.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.004+0000 7f1253200640 1 -- 172.21.15.103:0/1574745755 >> 172.21.15.103:0/1574745755 conn(0x7f12540d18d0 msgr2=0x7f12540d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:17.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.004+0000 7f1253200640 1 -- 172.21.15.103:0/1574745755 shutdown_connections 2024-09-10T22:46:17.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.004+0000 7f1253200640 1 -- 172.21.15.103:0/1574745755 wait complete. 2024-09-10T22:46:17.023 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T22:46:17.023 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T22:46:17.024 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:46:17.129 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T22:46:17.218 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T22:46:17.218 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:46:17.218 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:46:17.218 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:46:17.227 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:46:17.227 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:46:17.279 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T22:46:17.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.464+0000 7fa3de800640 1 -- 172.21.15.103:0/2069822071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3bc003a60 msgr2=0x7fa3bc003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:17.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.464+0000 7fa3de800640 1 --2- 172.21.15.103:0/2069822071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3bc003a60 0x7fa3bc003e80 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c2e0 tx=0x7fa3c801cef0 comp rx=0 tx=0).stop 2024-09-10T22:46:17.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.464+0000 7fa3de800640 1 -- 172.21.15.103:0/2069822071 shutdown_connections 2024-09-10T22:46:17.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.464+0000 7fa3de800640 1 --2- 172.21.15.103:0/2069822071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3bc003a60 0x7fa3bc003e80 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:17.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.464+0000 7fa3de800640 1 -- 172.21.15.103:0/2069822071 >> 172.21.15.103:0/2069822071 conn(0x7fa3d806cc00 msgr2=0x7fa3d806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:17.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.464+0000 7fa3de800640 1 -- 172.21.15.103:0/2069822071 shutdown_connections 2024-09-10T22:46:17.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.464+0000 7fa3de800640 1 -- 172.21.15.103:0/2069822071 wait complete. 2024-09-10T22:46:17.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3de800640 1 Processor -- start 2024-09-10T22:46:17.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3de800640 1 -- start start 2024-09-10T22:46:17.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3de800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3bc003a60 0x7fa3d8147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:17.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3de800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3d80adab0 0x7fa3d80adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:17.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3de800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3d80b1130 0x7fa3d80b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:17.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3de800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d80b2a80 con 0x7fa3d80adab0 2024-09-10T22:46:17.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3de800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d815cf10 con 0x7fa3bc003a60 2024-09-10T22:46:17.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3de800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d80b2c00 con 0x7fa3d80b1130 2024-09-10T22:46:17.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3cea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3d80adab0 0x7fa3d80adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:17.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3cea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3d80adab0 0x7fa3d80adf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40398/0 (socket says 172.21.15.103:40398) 2024-09-10T22:46:17.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3cea00640 1 -- 172.21.15.103:0/2766587559 learned_addr learned my addr 172.21.15.103:0/2766587559 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:17.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3d7e00640 1 --2- 172.21.15.103:0/2766587559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3d80b1130 0x7fa3d80b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:17.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3d7400640 1 --2- 172.21.15.103:0/2766587559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3bc003a60 0x7fa3d8147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:17.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3cea00640 1 -- 172.21.15.103:0/2766587559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3d80b1130 msgr2=0x7fa3d80b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:17.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3cea00640 1 --2- 172.21.15.103:0/2766587559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3d80b1130 0x7fa3d80b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:17.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3cea00640 1 -- 172.21.15.103:0/2766587559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3bc003a60 msgr2=0x7fa3d8147200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:17.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3cea00640 1 --2- 172.21.15.103:0/2766587559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3bc003a60 0x7fa3d8147200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:17.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3cea00640 1 -- 172.21.15.103:0/2766587559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d8158f40 con 0x7fa3d80adab0 2024-09-10T22:46:17.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3d7400640 1 --2- 172.21.15.103:0/2766587559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3bc003a60 0x7fa3d8147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:17.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3d7e00640 1 --2- 172.21.15.103:0/2766587559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3d80b1130 0x7fa3d80b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:17.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3cea00640 1 --2- 172.21.15.103:0/2766587559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3d80adab0 0x7fa3d80adf30 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0011b40 tx=0x7fa3c0009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3cfe00640 1 -- 172.21.15.103:0/2766587559 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c000fd30 con 0x7fa3d80adab0 2024-09-10T22:46:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3cfe00640 1 -- 172.21.15.103:0/2766587559 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3c0004020 con 0x7fa3d80adab0 2024-09-10T22:46:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3cfe00640 1 -- 172.21.15.103:0/2766587559 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0004470 con 0x7fa3d80adab0 2024-09-10T22:46:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3de800640 1 -- 172.21.15.103:0/2766587559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d8159220 con 0x7fa3d80adab0 2024-09-10T22:46:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3de800640 1 -- 172.21.15.103:0/2766587559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d8147740 con 0x7fa3d80adab0 2024-09-10T22:46:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.468+0000 7fa3de800640 1 -- 172.21.15.103:0/2766587559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d80ae470 con 0x7fa3d80adab0 2024-09-10T22:46:17.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.472+0000 7fa3cfe00640 1 -- 172.21.15.103:0/2766587559 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa3c0003600 con 0x7fa3d80adab0 2024-09-10T22:46:17.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.472+0000 7fa3cfe00640 1 --2- 172.21.15.103:0/2766587559 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa3b40725e0 0x7fa3b4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:17.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.472+0000 7fa3cfe00640 1 -- 172.21.15.103:0/2766587559 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fa3c0093eb0 con 0x7fa3d80adab0 2024-09-10T22:46:17.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.472+0000 7fa3d7400640 1 --2- 172.21.15.103:0/2766587559 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa3b40725e0 0x7fa3b4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:17.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.472+0000 7fa3d7400640 1 --2- 172.21.15.103:0/2766587559 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa3b40725e0 0x7fa3b4074aa0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80ab000 tx=0x7fa3c8019d30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.476+0000 7fa3cfe00640 1 -- 172.21.15.103:0/2766587559 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa3c005f3a0 con 0x7fa3d80adab0 2024-09-10T22:46:17.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.652+0000 7fa3de800640 1 -- 172.21.15.103:0/2766587559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa3d80b3160 con 0x7fa3d80adab0 2024-09-10T22:46:17.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.652+0000 7fa3cfe00640 1 -- 172.21.15.103:0/2766587559 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v107) ==== 80+0+0 (secure 0 0 0) 0x7fa3c005eca0 con 0x7fa3d80adab0 2024-09-10T22:46:17.654 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T22:46:17.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.656+0000 7fa3de800640 1 -- 172.21.15.103:0/2766587559 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa3b40725e0 msgr2=0x7fa3b4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:17.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.656+0000 7fa3de800640 1 --2- 172.21.15.103:0/2766587559 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa3b40725e0 0x7fa3b4074aa0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80ab000 tx=0x7fa3c8019d30 comp rx=0 tx=0).stop 2024-09-10T22:46:17.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.656+0000 7fa3de800640 1 -- 172.21.15.103:0/2766587559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3d80adab0 msgr2=0x7fa3d80adf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:17.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.656+0000 7fa3de800640 1 --2- 172.21.15.103:0/2766587559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3d80adab0 0x7fa3d80adf30 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0011b40 tx=0x7fa3c0009f20 comp rx=0 tx=0).stop 2024-09-10T22:46:17.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.656+0000 7fa3de800640 1 -- 172.21.15.103:0/2766587559 shutdown_connections 2024-09-10T22:46:17.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.656+0000 7fa3de800640 1 --2- 172.21.15.103:0/2766587559 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa3b40725e0 0x7fa3b4074aa0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:17.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.656+0000 7fa3de800640 1 --2- 172.21.15.103:0/2766587559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3d80b1130 0x7fa3d80b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:17.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.656+0000 7fa3de800640 1 --2- 172.21.15.103:0/2766587559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3d80adab0 0x7fa3d80adf30 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:17.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.656+0000 7fa3de800640 1 --2- 172.21.15.103:0/2766587559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3bc003a60 0x7fa3d8147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:17.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.656+0000 7fa3de800640 1 -- 172.21.15.103:0/2766587559 >> 172.21.15.103:0/2766587559 conn(0x7fa3d806cc00 msgr2=0x7fa3d806f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:17.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.656+0000 7fa3de800640 1 -- 172.21.15.103:0/2766587559 shutdown_connections 2024-09-10T22:46:17.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:17.656+0000 7fa3de800640 1 -- 172.21.15.103:0/2766587559 wait complete. 2024-09-10T22:46:17.676 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-09-10T22:46:17.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:46:17.676 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T22:46:17.693 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[49249]: fuse finished with error 0 and tester_r 0 2024-09-10T22:46:17.696 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:46:17.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:46:17.697 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T22:46:17.811 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:46:17.812 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:46:17.812 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:46:17.822 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:46:17.822 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:46:17.822 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:46:17.822 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:46:17.830 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350248k,nr_inodes=4087562,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3542 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T22:46:17.831 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T22:46:17.831 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:46:17.831 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:46:17.872 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:46:17.872 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:46:17.903 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:46:17.921 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:46:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faae0a00640 1 -- 172.21.15.103:0/1575007152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faac0004d50 msgr2=0x7faac00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faae0a00640 1 --2- 172.21.15.103:0/1575007152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faac0004d50 0x7faac00051d0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7faad400c310 tx=0x7faad401cfc0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faada800640 1 -- 172.21.15.103:0/1575007152 reap_dead start 2024-09-10T22:46:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faae0a00640 1 -- 172.21.15.103:0/1575007152 shutdown_connections 2024-09-10T22:46:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faae0a00640 1 -- 172.21.15.103:0/1575007152 >> 172.21.15.103:0/1575007152 conn(0x7faadc0b1c00 msgr2=0x7faadc0b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faae0a00640 1 -- 172.21.15.103:0/1575007152 shutdown_connections 2024-09-10T22:46:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faae0a00640 1 -- 172.21.15.103:0/1575007152 wait complete. 2024-09-10T22:46:18.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faae0a00640 1 Processor -- start 2024-09-10T22:46:18.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faae0a00640 1 -- start start 2024-09-10T22:46:18.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faae0a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faac0004d50 0x7faadc159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:18.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faae0a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faadc15a810 0x7faadc06fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:18.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faae0a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faadc156f90 0x7faadc1573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:18.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faae0a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faadc0cceb0 con 0x7faadc156f90 2024-09-10T22:46:18.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faae0a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faadc06e460 con 0x7faadc15a810 2024-09-10T22:46:18.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faae0a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7faadc0cd030 con 0x7faac0004d50 2024-09-10T22:46:18.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faada800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faadc156f90 0x7faadc1573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:18.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faada800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faadc156f90 0x7faadc1573d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40420/0 (socket says 172.21.15.103:40420) 2024-09-10T22:46:18.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faada800640 1 -- 172.21.15.103:0/1602009437 learned_addr learned my addr 172.21.15.103:0/1602009437 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:18.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faad9e00640 1 --2- 172.21.15.103:0/1602009437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faac0004d50 0x7faadc159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:18.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faad1400640 1 --2- 172.21.15.103:0/1602009437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faadc15a810 0x7faadc06fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:18.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faada800640 1 -- 172.21.15.103:0/1602009437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faac0004d50 msgr2=0x7faadc159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:18.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faada800640 1 --2- 172.21.15.103:0/1602009437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faac0004d50 0x7faadc159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faada800640 1 -- 172.21.15.103:0/1602009437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faadc15a810 msgr2=0x7faadc06fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:18.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faada800640 1 --2- 172.21.15.103:0/1602009437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faadc15a810 0x7faadc06fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.020+0000 7faada800640 1 -- 172.21.15.103:0/1602009437 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faadc15a280 con 0x7faadc156f90 2024-09-10T22:46:18.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.024+0000 7faada800640 1 --2- 172.21.15.103:0/1602009437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faadc156f90 0x7faadc1573d0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7faad4098b90 tx=0x7faad40a5c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:18.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.024+0000 7faad2a00640 1 -- 172.21.15.103:0/1602009437 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4006c60 con 0x7faadc156f90 2024-09-10T22:46:18.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.024+0000 7faad2a00640 1 -- 172.21.15.103:0/1602009437 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faad4006530 con 0x7faadc156f90 2024-09-10T22:46:18.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.024+0000 7faad2a00640 1 -- 172.21.15.103:0/1602009437 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4000e50 con 0x7faadc156f90 2024-09-10T22:46:18.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.024+0000 7faae0a00640 1 -- 172.21.15.103:0/1602009437 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faadc1f7700 con 0x7faadc156f90 2024-09-10T22:46:18.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.024+0000 7faae0a00640 1 -- 172.21.15.103:0/1602009437 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faadc157910 con 0x7faadc156f90 2024-09-10T22:46:18.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.024+0000 7faae0a00640 1 -- 172.21.15.103:0/1602009437 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faadc0cc970 con 0x7faadc156f90 2024-09-10T22:46:18.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.024+0000 7faad2a00640 1 -- 172.21.15.103:0/1602009437 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7faad4003820 con 0x7faadc156f90 2024-09-10T22:46:18.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.024+0000 7faad2a00640 1 --2- 172.21.15.103:0/1602009437 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faab80725e0 0x7faab8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:18.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.024+0000 7faad2a00640 1 -- 172.21.15.103:0/1602009437 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7faad412d5e0 con 0x7faadc156f90 2024-09-10T22:46:18.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.024+0000 7faad9e00640 1 --2- 172.21.15.103:0/1602009437 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faab80725e0 0x7faab8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:18.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.028+0000 7faad9e00640 1 --2- 172.21.15.103:0/1602009437 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faab80725e0 0x7faab8074aa0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7faadc159760 tx=0x7faacc009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:18.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.028+0000 7faad2a00640 1 -- 172.21.15.103:0/1602009437 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7faad4016d70 con 0x7faadc156f90 2024-09-10T22:46:18.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.224+0000 7faae0a00640 1 -- 172.21.15.103:0/1602009437 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faadc0d0c80 con 0x7faadc156f90 2024-09-10T22:46:18.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.228+0000 7faad2a00640 1 -- 172.21.15.103:0/1602009437 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5287 (secure 0 0 0) 0x7faad40f84b0 con 0x7faadc156f90 2024-09-10T22:46:18.228 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:18.228 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:46:01.549542+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8238,"mds_1":8235,"mds_2":7717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7717":{"gid":7717,"name":"b","rank":2,"incarnation":111,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8235":{"gid":8235,"name":"a","rank":1,"incarnation":109,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238,8235,7717]},"id":7}]} 2024-09-10T22:46:18.228 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 117 2024-09-10T22:46:18.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.228+0000 7faae0a00640 1 -- 172.21.15.103:0/1602009437 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faab80725e0 msgr2=0x7faab8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:18.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.228+0000 7faae0a00640 1 --2- 172.21.15.103:0/1602009437 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faab80725e0 0x7faab8074aa0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7faadc159760 tx=0x7faacc009500 comp rx=0 tx=0).stop 2024-09-10T22:46:18.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.228+0000 7faae0a00640 1 -- 172.21.15.103:0/1602009437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faadc156f90 msgr2=0x7faadc1573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:18.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.228+0000 7faae0a00640 1 --2- 172.21.15.103:0/1602009437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faadc156f90 0x7faadc1573d0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7faad4098b90 tx=0x7faad40a5c70 comp rx=0 tx=0).stop 2024-09-10T22:46:18.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.228+0000 7faae0a00640 1 -- 172.21.15.103:0/1602009437 shutdown_connections 2024-09-10T22:46:18.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.228+0000 7faae0a00640 1 --2- 172.21.15.103:0/1602009437 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7faab80725e0 0x7faab8074aa0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.228+0000 7faae0a00640 1 --2- 172.21.15.103:0/1602009437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faadc156f90 0x7faadc1573d0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.228+0000 7faae0a00640 1 --2- 172.21.15.103:0/1602009437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faadc15a810 0x7faadc06fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.228+0000 7faae0a00640 1 --2- 172.21.15.103:0/1602009437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faac0004d50 0x7faadc159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.228+0000 7faae0a00640 1 -- 172.21.15.103:0/1602009437 >> 172.21.15.103:0/1602009437 conn(0x7faadc0b1c00 msgr2=0x7faadc073290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:18.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.228+0000 7faae0a00640 1 -- 172.21.15.103:0/1602009437 shutdown_connections 2024-09-10T22:46:18.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.228+0000 7faae0a00640 1 -- 172.21.15.103:0/1602009437 wait complete. 2024-09-10T22:46:18.248 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:46:18.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.388+0000 7f32f6000640 1 -- 172.21.15.103:0/2043197845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32d4004810 msgr2=0x7f32d4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:18.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.388+0000 7f32f6000640 1 --2- 172.21.15.103:0/2043197845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32d4004810 0x7f32d4004c90 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009b60 tx=0x7f32d801d270 comp rx=0 tx=0).stop 2024-09-10T22:46:18.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.388+0000 7f32f6000640 1 -- 172.21.15.103:0/2043197845 shutdown_connections 2024-09-10T22:46:18.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.388+0000 7f32f6000640 1 --2- 172.21.15.103:0/2043197845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32d4004810 0x7f32d4004c90 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.388+0000 7f32f6000640 1 -- 172.21.15.103:0/2043197845 >> 172.21.15.103:0/2043197845 conn(0x7f32f00d1ac0 msgr2=0x7f32f00d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:18.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.388+0000 7f32f6000640 1 -- 172.21.15.103:0/2043197845 shutdown_connections 2024-09-10T22:46:18.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.388+0000 7f32f6000640 1 -- 172.21.15.103:0/2043197845 wait complete. 2024-09-10T22:46:18.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32f6000640 1 Processor -- start 2024-09-10T22:46:18.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32f6000640 1 -- start start 2024-09-10T22:46:18.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32f6000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32d4004810 0x7f32f01f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:18.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32f6000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f01f91b0 0x7f32f00b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:18.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32f6000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32f01f9630 0x7f32f00b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:18.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32f6000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f32f00ceed0 con 0x7f32f01f91b0 2024-09-10T22:46:18.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32f6000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f32f00ced50 con 0x7f32d4004810 2024-09-10T22:46:18.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32f6000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f32f00cf9c0 con 0x7f32f01f9630 2024-09-10T22:46:18.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32e6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f01f91b0 0x7f32f00b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:18.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32e6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f01f91b0 0x7f32f00b27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40426/0 (socket says 172.21.15.103:40426) 2024-09-10T22:46:18.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32e6a00640 1 -- 172.21.15.103:0/1005477433 learned_addr learned my addr 172.21.15.103:0/1005477433 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:18.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32ef400640 1 --2- 172.21.15.103:0/1005477433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32d4004810 0x7f32f01f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:18.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32efe00640 1 --2- 172.21.15.103:0/1005477433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32f01f9630 0x7f32f00b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:18.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32e6a00640 1 -- 172.21.15.103:0/1005477433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32f01f9630 msgr2=0x7f32f00b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:18.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32e6a00640 1 --2- 172.21.15.103:0/1005477433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32f01f9630 0x7f32f00b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32e6a00640 1 -- 172.21.15.103:0/1005477433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32d4004810 msgr2=0x7f32f01f4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:18.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32e6a00640 1 --2- 172.21.15.103:0/1005477433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32d4004810 0x7f32f01f4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32e6a00640 1 -- 172.21.15.103:0/1005477433 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f0143a50 con 0x7f32f01f91b0 2024-09-10T22:46:18.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32ef400640 1 --2- 172.21.15.103:0/1005477433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32d4004810 0x7f32f01f4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:18.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32e6a00640 1 --2- 172.21.15.103:0/1005477433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f01f91b0 0x7f32f00b27b0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f32d801d0a0 tx=0x7f32d8005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:18.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32e7e00640 1 -- 172.21.15.103:0/1005477433 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d80ba070 con 0x7f32f01f91b0 2024-09-10T22:46:18.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32e7e00640 1 -- 172.21.15.103:0/1005477433 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32d8004020 con 0x7f32f01f91b0 2024-09-10T22:46:18.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32e7e00640 1 -- 172.21.15.103:0/1005477433 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d80b1040 con 0x7f32f01f91b0 2024-09-10T22:46:18.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32f6000640 1 -- 172.21.15.103:0/1005477433 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f0143d30 con 0x7f32f01f91b0 2024-09-10T22:46:18.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.392+0000 7f32f6000640 1 -- 172.21.15.103:0/1005477433 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f01442f0 con 0x7f32f01f91b0 2024-09-10T22:46:18.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.396+0000 7f32f6000640 1 -- 172.21.15.103:0/1005477433 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f00cff20 con 0x7f32f01f91b0 2024-09-10T22:46:18.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.396+0000 7f32e7e00640 1 -- 172.21.15.103:0/1005477433 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f32d80046d0 con 0x7f32f01f91b0 2024-09-10T22:46:18.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.396+0000 7f32e7e00640 1 --2- 172.21.15.103:0/1005477433 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f32cc072610 0x7f32cc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:18.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.396+0000 7f32e7e00640 1 -- 172.21.15.103:0/1005477433 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f32d812e1b0 con 0x7f32f01f91b0 2024-09-10T22:46:18.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.396+0000 7f32ef400640 1 --2- 172.21.15.103:0/1005477433 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f32cc072610 0x7f32cc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:18.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.396+0000 7f32ef400640 1 --2- 172.21.15.103:0/1005477433 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f32cc072610 0x7f32cc074ad0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f32e0000fc0 tx=0x7f32e0001c40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:18.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.400+0000 7f32e7e00640 1 -- 172.21.15.103:0/1005477433 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f32d8016f80 con 0x7f32f01f91b0 2024-09-10T22:46:18.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.600+0000 7f32f6000640 1 -- 172.21.15.103:0/1005477433 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32f00ca480 con 0x7f32f01f91b0 2024-09-10T22:46:18.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.604+0000 7f32e7e00640 1 -- 172.21.15.103:0/1005477433 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5287 (secure 0 0 0) 0x7f32d80f96a0 con 0x7f32f01f91b0 2024-09-10T22:46:18.603 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:18.603 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:46:01.549542+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8238,"mds_1":8235,"mds_2":7717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7717":{"gid":7717,"name":"b","rank":2,"incarnation":111,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8235":{"gid":8235,"name":"a","rank":1,"incarnation":109,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238,8235,7717]},"id":7}]} 2024-09-10T22:46:18.603 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 117 2024-09-10T22:46:18.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.604+0000 7f32f6000640 1 -- 172.21.15.103:0/1005477433 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f32cc072610 msgr2=0x7f32cc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:18.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.604+0000 7f32f6000640 1 --2- 172.21.15.103:0/1005477433 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f32cc072610 0x7f32cc074ad0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f32e0000fc0 tx=0x7f32e0001c40 comp rx=0 tx=0).stop 2024-09-10T22:46:18.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.604+0000 7f32f6000640 1 -- 172.21.15.103:0/1005477433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f01f91b0 msgr2=0x7f32f00b27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:18.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.604+0000 7f32f6000640 1 --2- 172.21.15.103:0/1005477433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f01f91b0 0x7f32f00b27b0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f32d801d0a0 tx=0x7f32d8005520 comp rx=0 tx=0).stop 2024-09-10T22:46:18.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.604+0000 7f32f6000640 1 -- 172.21.15.103:0/1005477433 shutdown_connections 2024-09-10T22:46:18.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.604+0000 7f32f6000640 1 --2- 172.21.15.103:0/1005477433 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f32cc072610 0x7f32cc074ad0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.604+0000 7f32f6000640 1 --2- 172.21.15.103:0/1005477433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32f01f9630 0x7f32f00b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.604+0000 7f32f6000640 1 --2- 172.21.15.103:0/1005477433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f01f91b0 0x7f32f00b27b0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.604+0000 7f32f6000640 1 --2- 172.21.15.103:0/1005477433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32d4004810 0x7f32f01f4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.604+0000 7f32f6000640 1 -- 172.21.15.103:0/1005477433 >> 172.21.15.103:0/1005477433 conn(0x7f32f00d1ac0 msgr2=0x7f32f00b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:18.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.604+0000 7f32f6000640 1 -- 172.21.15.103:0/1005477433 shutdown_connections 2024-09-10T22:46:18.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.604+0000 7f32f6000640 1 -- 172.21.15.103:0/1005477433 wait complete. 2024-09-10T22:46:18.624 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:46:18.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.764+0000 7f78b9400640 1 -- 172.21.15.103:0/789742919 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78b406f0c0 msgr2=0x7f78b4073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:18.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.764+0000 7f78b9400640 1 --2- 172.21.15.103:0/789742919 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78b406f0c0 0x7f78b4073610 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f789c009bc0 tx=0x7f789c01cba0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.764+0000 7f78b9400640 1 -- 172.21.15.103:0/789742919 shutdown_connections 2024-09-10T22:46:18.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.764+0000 7f78b9400640 1 --2- 172.21.15.103:0/789742919 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78b406f0c0 0x7f78b4073610 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.764+0000 7f78b9400640 1 --2- 172.21.15.103:0/789742919 >> v2:172.21.15.131:3300/0 conn(0x7f78b40cf9f0 0x7f78b406eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.764+0000 7f78b9400640 1 -- 172.21.15.103:0/789742919 >> 172.21.15.103:0/789742919 conn(0x7f78b406cc00 msgr2=0x7f78b406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:18.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.764+0000 7f78b9400640 1 -- 172.21.15.103:0/789742919 shutdown_connections 2024-09-10T22:46:18.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.764+0000 7f78b9400640 1 -- 172.21.15.103:0/789742919 wait complete. 2024-09-10T22:46:18.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.764+0000 7f78b9400640 1 Processor -- start 2024-09-10T22:46:18.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b9400640 1 -- start start 2024-09-10T22:46:18.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b9400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78b406f0c0 0x7f78b41f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:18.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b9400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b40cf9f0 0x7f78b4149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:18.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b9400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78b40cfdd0 0x7f78b40abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:18.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b9400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f78b40cd690 con 0x7f78b406f0c0 2024-09-10T22:46:18.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b9400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f78b40cd510 con 0x7f78b40cf9f0 2024-09-10T22:46:18.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b9400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f78b40cd810 con 0x7f78b40cfdd0 2024-09-10T22:46:18.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78b406f0c0 0x7f78b41f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:18.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78b406f0c0 0x7f78b41f52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40442/0 (socket says 172.21.15.103:40442) 2024-09-10T22:46:18.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b2800640 1 -- 172.21.15.103:0/1478940406 learned_addr learned my addr 172.21.15.103:0/1478940406 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:18.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78a9e00640 1 --2- 172.21.15.103:0/1478940406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b40cf9f0 0x7f78b4149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:18.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b3200640 1 --2- 172.21.15.103:0/1478940406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78b40cfdd0 0x7f78b40abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:18.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b2800640 1 -- 172.21.15.103:0/1478940406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78b40cfdd0 msgr2=0x7f78b40abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:18.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b2800640 1 --2- 172.21.15.103:0/1478940406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78b40cfdd0 0x7f78b40abd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b2800640 1 -- 172.21.15.103:0/1478940406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b40cf9f0 msgr2=0x7f78b4149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:18.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b2800640 1 --2- 172.21.15.103:0/1478940406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b40cf9f0 0x7f78b4149cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b2800640 1 -- 172.21.15.103:0/1478940406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b41f5b30 con 0x7f78b406f0c0 2024-09-10T22:46:18.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b2800640 1 --2- 172.21.15.103:0/1478940406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78b406f0c0 0x7f78b41f52e0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f78a400ea10 tx=0x7f78a400eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:18.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78ab400640 1 -- 172.21.15.103:0/1478940406 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a400cde0 con 0x7f78b406f0c0 2024-09-10T22:46:18.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78ab400640 1 -- 172.21.15.103:0/1478940406 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78a4004020 con 0x7f78b406f0c0 2024-09-10T22:46:18.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78ab400640 1 -- 172.21.15.103:0/1478940406 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a4004470 con 0x7f78b406f0c0 2024-09-10T22:46:18.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b9400640 1 -- 172.21.15.103:0/1478940406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b41f5e10 con 0x7f78b406f0c0 2024-09-10T22:46:18.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b9400640 1 -- 172.21.15.103:0/1478940406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b414b150 con 0x7f78b406f0c0 2024-09-10T22:46:18.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.768+0000 7f78b9400640 1 -- 172.21.15.103:0/1478940406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b414af40 con 0x7f78b406f0c0 2024-09-10T22:46:18.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.772+0000 7f78ab400640 1 -- 172.21.15.103:0/1478940406 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f78a4003600 con 0x7f78b406f0c0 2024-09-10T22:46:18.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.772+0000 7f78ab400640 1 --2- 172.21.15.103:0/1478940406 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f78900725e0 0x7f7890074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:18.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.772+0000 7f78ab400640 1 -- 172.21.15.103:0/1478940406 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f78a4093d60 con 0x7f78b406f0c0 2024-09-10T22:46:18.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.772+0000 7f78a9e00640 1 --2- 172.21.15.103:0/1478940406 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f78900725e0 0x7f7890074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:18.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.772+0000 7f78a9e00640 1 --2- 172.21.15.103:0/1478940406 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f78900725e0 0x7f7890074aa0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f789c0af000 tx=0x7f789c01b3e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:18.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.776+0000 7f78ab400640 1 -- 172.21.15.103:0/1478940406 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f78a405ec00 con 0x7f78b406f0c0 2024-09-10T22:46:18.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.940+0000 7f78b9400640 1 -- 172.21.15.103:0/1478940406 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78b406eb80 con 0x7f78b406f0c0 2024-09-10T22:46:18.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.944+0000 7f78ab400640 1 -- 172.21.15.103:0/1478940406 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+17150 (secure 0 0 0) 0x7f78a4063630 con 0x7f78b406f0c0 2024-09-10T22:46:18.944 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:18.944 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":107,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:45:33.494944+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:45:25.542643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-10T22:45:26.823498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.13","mappings":[{"from":1,"to":4}]},{"pgid":"16.29","mappings":[{"from":5,"to":4}]},{"pgid":"16.39","mappings":[{"from":6,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:46:18.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.944+0000 7f78b9400640 1 -- 172.21.15.103:0/1478940406 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f78900725e0 msgr2=0x7f7890074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:18.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.944+0000 7f78b9400640 1 --2- 172.21.15.103:0/1478940406 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f78900725e0 0x7f7890074aa0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f789c0af000 tx=0x7f789c01b3e0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.944+0000 7f78b9400640 1 -- 172.21.15.103:0/1478940406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78b406f0c0 msgr2=0x7f78b41f52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:18.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.944+0000 7f78b9400640 1 --2- 172.21.15.103:0/1478940406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78b406f0c0 0x7f78b41f52e0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f78a400ea10 tx=0x7f78a400eed0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.944+0000 7f78b9400640 1 -- 172.21.15.103:0/1478940406 shutdown_connections 2024-09-10T22:46:18.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.944+0000 7f78b9400640 1 --2- 172.21.15.103:0/1478940406 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f78900725e0 0x7f7890074aa0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.944+0000 7f78b9400640 1 --2- 172.21.15.103:0/1478940406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78b40cfdd0 0x7f78b40abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.944+0000 7f78b9400640 1 --2- 172.21.15.103:0/1478940406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b40cf9f0 0x7f78b4149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.944+0000 7f78b9400640 1 --2- 172.21.15.103:0/1478940406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78b406f0c0 0x7f78b41f52e0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:18.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.944+0000 7f78b9400640 1 -- 172.21.15.103:0/1478940406 >> 172.21.15.103:0/1478940406 conn(0x7f78b406cc00 msgr2=0x7f78b4152290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:18.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.944+0000 7f78b9400640 1 -- 172.21.15.103:0/1478940406 shutdown_connections 2024-09-10T22:46:18.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:18.944+0000 7f78b9400640 1 -- 172.21.15.103:0/1478940406 wait complete. 2024-09-10T22:46:18.965 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T22:46:18.966 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:46:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.104+0000 7fe397a00640 1 -- 172.21.15.103:0/2439490076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3900cc120 msgr2=0x7fe3900aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.104+0000 7fe397a00640 1 --2- 172.21.15.103:0/2439490076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3900cc120 0x7fe3900aeb40 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fe3900d0870 tx=0x7fe38401c830 comp rx=0 tx=0).stop 2024-09-10T22:46:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.104+0000 7fe397a00640 1 -- 172.21.15.103:0/2439490076 shutdown_connections 2024-09-10T22:46:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.104+0000 7fe397a00640 1 --2- 172.21.15.103:0/2439490076 >> v2:172.21.15.131:3300/0 conn(0x7fe3900cf790 0x7fe3900cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.104+0000 7fe397a00640 1 --2- 172.21.15.103:0/2439490076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3900cc120 0x7fe3900aeb40 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.104+0000 7fe397a00640 1 -- 172.21.15.103:0/2439490076 >> 172.21.15.103:0/2439490076 conn(0x7fe39006cc00 msgr2=0x7fe39006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.104+0000 7fe397a00640 1 -- 172.21.15.103:0/2439490076 shutdown_connections 2024-09-10T22:46:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.104+0000 7fe397a00640 1 -- 172.21.15.103:0/2439490076 wait complete. 2024-09-10T22:46:19.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe397a00640 1 Processor -- start 2024-09-10T22:46:19.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe397a00640 1 -- start start 2024-09-10T22:46:19.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe397a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3900cc120 0x7fe3901651a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:19.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe397a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe3900cf790 0x7fe390141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:19.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe397a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe39015c970 0x7fe3901432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe397a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe390168b90 con 0x7fe3900cc120 2024-09-10T22:46:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe397a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe390168a10 con 0x7fe39015c970 2024-09-10T22:46:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe397a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe390168d10 con 0x7fe3900cf790 2024-09-10T22:46:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe395000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3900cc120 0x7fe3901651a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe395000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3900cc120 0x7fe3901651a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40462/0 (socket says 172.21.15.103:40462) 2024-09-10T22:46:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe395000640 1 -- 172.21.15.103:0/1145653028 learned_addr learned my addr 172.21.15.103:0/1145653028 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe38fe00640 1 --2- 172.21.15.103:0/1145653028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe3900cf790 0x7fe390141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe395a00640 1 --2- 172.21.15.103:0/1145653028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe39015c970 0x7fe3901432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe395000640 1 -- 172.21.15.103:0/1145653028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe3900cf790 msgr2=0x7fe390141260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe395000640 1 --2- 172.21.15.103:0/1145653028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe3900cf790 0x7fe390141260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe395000640 1 -- 172.21.15.103:0/1145653028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe39015c970 msgr2=0x7fe3901432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe395000640 1 --2- 172.21.15.103:0/1145653028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe39015c970 0x7fe3901432b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe395000640 1 -- 172.21.15.103:0/1145653028 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3901417a0 con 0x7fe3900cc120 2024-09-10T22:46:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe395000640 1 --2- 172.21.15.103:0/1145653028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3900cc120 0x7fe3901651a0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fe3840b0040 tx=0x7fe3840a5620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe38cc00640 1 -- 172.21.15.103:0/1145653028 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3840b2040 con 0x7fe3900cc120 2024-09-10T22:46:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe38cc00640 1 -- 172.21.15.103:0/1145653028 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3840043a0 con 0x7fe3900cc120 2024-09-10T22:46:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe38cc00640 1 -- 172.21.15.103:0/1145653028 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe384005290 con 0x7fe3900cc120 2024-09-10T22:46:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe397a00640 1 -- 172.21.15.103:0/1145653028 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe390143ad0 con 0x7fe3900cc120 2024-09-10T22:46:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.108+0000 7fe397a00640 1 -- 172.21.15.103:0/1145653028 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe390144090 con 0x7fe3900cc120 2024-09-10T22:46:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.112+0000 7fe397a00640 1 -- 172.21.15.103:0/1145653028 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3900cfc20 con 0x7fe3900cc120 2024-09-10T22:46:19.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.112+0000 7fe38cc00640 1 -- 172.21.15.103:0/1145653028 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe384005430 con 0x7fe3900cc120 2024-09-10T22:46:19.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.112+0000 7fe38cc00640 1 --2- 172.21.15.103:0/1145653028 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe3700725e0 0x7fe370074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:19.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.112+0000 7fe38cc00640 1 -- 172.21.15.103:0/1145653028 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fe38412cfd0 con 0x7fe3900cc120 2024-09-10T22:46:19.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.112+0000 7fe38fe00640 1 --2- 172.21.15.103:0/1145653028 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe3700725e0 0x7fe370074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:19.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.112+0000 7fe38fe00640 1 --2- 172.21.15.103:0/1145653028 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe3700725e0 0x7fe370074aa0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe39006d090 tx=0x7fe37c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:19.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.116+0000 7fe38cc00640 1 -- 172.21.15.103:0/1145653028 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe3840164b0 con 0x7fe3900cc120 2024-09-10T22:46:19.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.316+0000 7fe397a00640 1 -- 172.21.15.103:0/1145653028 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3901437f0 con 0x7fe3900cc120 2024-09-10T22:46:19.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.316+0000 7fe38cc00640 1 -- 172.21.15.103:0/1145653028 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5287 (secure 0 0 0) 0x7fe3840f8440 con 0x7fe3900cc120 2024-09-10T22:46:19.317 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:19.317 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:46:01.549542+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8238,"mds_1":8235,"mds_2":7717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7717":{"gid":7717,"name":"b","rank":2,"incarnation":111,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8235":{"gid":8235,"name":"a","rank":1,"incarnation":109,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238,8235,7717]},"id":7}]} 2024-09-10T22:46:19.317 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 117 2024-09-10T22:46:19.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.316+0000 7fe397a00640 1 -- 172.21.15.103:0/1145653028 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe3700725e0 msgr2=0x7fe370074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:19.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.316+0000 7fe397a00640 1 --2- 172.21.15.103:0/1145653028 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe3700725e0 0x7fe370074aa0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe39006d090 tx=0x7fe37c008040 comp rx=0 tx=0).stop 2024-09-10T22:46:19.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.316+0000 7fe397a00640 1 -- 172.21.15.103:0/1145653028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3900cc120 msgr2=0x7fe3901651a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:19.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.316+0000 7fe397a00640 1 --2- 172.21.15.103:0/1145653028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3900cc120 0x7fe3901651a0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fe3840b0040 tx=0x7fe3840a5620 comp rx=0 tx=0).stop 2024-09-10T22:46:19.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.316+0000 7fe397a00640 1 -- 172.21.15.103:0/1145653028 shutdown_connections 2024-09-10T22:46:19.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.316+0000 7fe397a00640 1 --2- 172.21.15.103:0/1145653028 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fe3700725e0 0x7fe370074aa0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.316+0000 7fe397a00640 1 --2- 172.21.15.103:0/1145653028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe39015c970 0x7fe3901432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.316+0000 7fe397a00640 1 --2- 172.21.15.103:0/1145653028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe3900cf790 0x7fe390141260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.316+0000 7fe397a00640 1 --2- 172.21.15.103:0/1145653028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3900cc120 0x7fe3901651a0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.316+0000 7fe397a00640 1 -- 172.21.15.103:0/1145653028 >> 172.21.15.103:0/1145653028 conn(0x7fe39006cc00 msgr2=0x7fe3900b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:19.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.320+0000 7fe397a00640 1 -- 172.21.15.103:0/1145653028 shutdown_connections 2024-09-10T22:46:19.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.320+0000 7fe397a00640 1 -- 172.21.15.103:0/1145653028 wait complete. 2024-09-10T22:46:19.338 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:46:19.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.480+0000 7fa9bc000640 1 -- 172.21.15.103:0/1574422790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa99c004810 msgr2=0x7fa99c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:19.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.480+0000 7fa9bc000640 1 --2- 172.21.15.103:0/1574422790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa99c004810 0x7fa99c004c90 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00016f0 tx=0x7fa9a001c750 comp rx=0 tx=0).stop 2024-09-10T22:46:19.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.480+0000 7fa9bc000640 1 -- 172.21.15.103:0/1574422790 shutdown_connections 2024-09-10T22:46:19.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.480+0000 7fa9bc000640 1 --2- 172.21.15.103:0/1574422790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa99c004810 0x7fa99c004c90 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.480+0000 7fa9bc000640 1 -- 172.21.15.103:0/1574422790 >> 172.21.15.103:0/1574422790 conn(0x7fa9b40d1a20 msgr2=0x7fa9b40d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:19.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.480+0000 7fa9bc000640 1 -- 172.21.15.103:0/1574422790 shutdown_connections 2024-09-10T22:46:19.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.480+0000 7fa9bc000640 1 -- 172.21.15.103:0/1574422790 wait complete. 2024-09-10T22:46:19.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.480+0000 7fa9bc000640 1 Processor -- start 2024-09-10T22:46:19.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.480+0000 7fa9bc000640 1 -- start start 2024-09-10T22:46:19.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9bc000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa99c004810 0x7fa9b40b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:19.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9bc000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9b4158f40 0x7fa9b40c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:19.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9bc000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9b4155960 0x7fa9b4155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:19.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9bc000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b40cf980 con 0x7fa9b4155960 2024-09-10T22:46:19.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9bc000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b40cf800 con 0x7fa99c004810 2024-09-10T22:46:19.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9bc000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b40d0000 con 0x7fa9b4158f40 2024-09-10T22:46:19.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9ba000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9b4155960 0x7fa9b4155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:19.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9ba000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9b4155960 0x7fa9b4155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40476/0 (socket says 172.21.15.103:40476) 2024-09-10T22:46:19.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9ba000640 1 -- 172.21.15.103:0/1998617142 learned_addr learned my addr 172.21.15.103:0/1998617142 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:19.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9b9600640 1 --2- 172.21.15.103:0/1998617142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa99c004810 0x7fa9b40b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:19.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9b8c00640 1 --2- 172.21.15.103:0/1998617142 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9b4158f40 0x7fa9b40c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:19.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9ba000640 1 -- 172.21.15.103:0/1998617142 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9b4158f40 msgr2=0x7fa9b40c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:19.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9ba000640 1 --2- 172.21.15.103:0/1998617142 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9b4158f40 0x7fa9b40c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9ba000640 1 -- 172.21.15.103:0/1998617142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa99c004810 msgr2=0x7fa9b40b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:19.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9ba000640 1 --2- 172.21.15.103:0/1998617142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa99c004810 0x7fa9b40b4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9ba000640 1 -- 172.21.15.103:0/1998617142 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b40b4ec0 con 0x7fa9b4155960 2024-09-10T22:46:19.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9ba000640 1 --2- 172.21.15.103:0/1998617142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9b4155960 0x7fa9b4155da0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40d16a0 tx=0x7fa9ac00e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:19.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9b1600640 1 -- 172.21.15.103:0/1998617142 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac012640 con 0x7fa9b4155960 2024-09-10T22:46:19.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9b1600640 1 -- 172.21.15.103:0/1998617142 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9ac012910 con 0x7fa9b4155960 2024-09-10T22:46:19.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9b1600640 1 -- 172.21.15.103:0/1998617142 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac012d60 con 0x7fa9b4155960 2024-09-10T22:46:19.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9bc000640 1 -- 172.21.15.103:0/1998617142 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9b40b51a0 con 0x7fa9b4155960 2024-09-10T22:46:19.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9bc000640 1 -- 172.21.15.103:0/1998617142 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b40b5760 con 0x7fa9b4155960 2024-09-10T22:46:19.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9bc000640 1 -- 172.21.15.103:0/1998617142 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9b40d0500 con 0x7fa9b4155960 2024-09-10T22:46:19.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.484+0000 7fa9b1600640 1 -- 172.21.15.103:0/1998617142 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa9ac0113d0 con 0x7fa9b4155960 2024-09-10T22:46:19.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.488+0000 7fa9b1600640 1 --2- 172.21.15.103:0/1998617142 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa994072610 0x7fa994074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:19.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.488+0000 7fa9b1600640 1 -- 172.21.15.103:0/1998617142 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7fa9ac096190 con 0x7fa9b4155960 2024-09-10T22:46:19.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.488+0000 7fa9b9600640 1 --2- 172.21.15.103:0/1998617142 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa994072610 0x7fa994074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:19.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.488+0000 7fa9b9600640 1 --2- 172.21.15.103:0/1998617142 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa994072610 0x7fa994074ad0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4052890 tx=0x7fa9a8009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:19.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.492+0000 7fa9b1600640 1 -- 172.21.15.103:0/1998617142 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa9ac021030 con 0x7fa9b4155960 2024-09-10T22:46:19.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.696+0000 7fa9bc000640 1 -- 172.21.15.103:0/1998617142 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9b40ce8c0 con 0x7fa9b4155960 2024-09-10T22:46:19.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.696+0000 7fa9b1600640 1 -- 172.21.15.103:0/1998617142 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5287 (secure 0 0 0) 0x7fa9ac016030 con 0x7fa9b4155960 2024-09-10T22:46:19.697 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:19.697 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":117,"btime":"2024-09-10T22:46:01:842971+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T22:45:27.857904+0000","modified":"2024-09-10T22:46:01.549542+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8238,"mds_1":8235,"mds_2":7717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7717":{"gid":7717,"name":"b","rank":2,"incarnation":111,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6837/1281268106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":1281268106},{"type":"v1","addr":"172.21.15.131:6837","nonce":1281268106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8235":{"gid":8235,"name":"a","rank":1,"incarnation":109,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6833/1191295180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1191295180},{"type":"v1","addr":"172.21.15.103:6833","nonce":1191295180}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8238":{"gid":8238,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/3550082240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3550082240},{"type":"v1","addr":"172.21.15.103:6835","nonce":3550082240}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238,8235,7717]},"id":7}]} 2024-09-10T22:46:19.697 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 117 2024-09-10T22:46:19.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.700+0000 7fa9bc000640 1 -- 172.21.15.103:0/1998617142 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa994072610 msgr2=0x7fa994074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:19.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.700+0000 7fa9bc000640 1 --2- 172.21.15.103:0/1998617142 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa994072610 0x7fa994074ad0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4052890 tx=0x7fa9a8009500 comp rx=0 tx=0).stop 2024-09-10T22:46:19.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.700+0000 7fa9bc000640 1 -- 172.21.15.103:0/1998617142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9b4155960 msgr2=0x7fa9b4155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:19.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.700+0000 7fa9bc000640 1 --2- 172.21.15.103:0/1998617142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9b4155960 0x7fa9b4155da0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40d16a0 tx=0x7fa9ac00e6b0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.700+0000 7fa9bc000640 1 -- 172.21.15.103:0/1998617142 shutdown_connections 2024-09-10T22:46:19.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.700+0000 7fa9bc000640 1 --2- 172.21.15.103:0/1998617142 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa994072610 0x7fa994074ad0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.700+0000 7fa9bc000640 1 --2- 172.21.15.103:0/1998617142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9b4155960 0x7fa9b4155da0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.700+0000 7fa9bc000640 1 --2- 172.21.15.103:0/1998617142 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9b4158f40 0x7fa9b40c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.700+0000 7fa9bc000640 1 --2- 172.21.15.103:0/1998617142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa99c004810 0x7fa9b40b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.700+0000 7fa9bc000640 1 -- 172.21.15.103:0/1998617142 >> 172.21.15.103:0/1998617142 conn(0x7fa9b40d1a20 msgr2=0x7fa9b406dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:19.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.700+0000 7fa9bc000640 1 -- 172.21.15.103:0/1998617142 shutdown_connections 2024-09-10T22:46:19.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.700+0000 7fa9bc000640 1 -- 172.21.15.103:0/1998617142 wait complete. 2024-09-10T22:46:19.718 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:46:19.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.856+0000 7f4af1800640 1 -- 172.21.15.103:0/2848236349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aec15be30 msgr2=0x7f4aec0ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:19.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.856+0000 7f4af1800640 1 --2- 172.21.15.103:0/2848236349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aec15be30 0x7f4aec0ce0c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009840 tx=0x7f4adc01c6b0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.856+0000 7f4af1800640 1 -- 172.21.15.103:0/2848236349 shutdown_connections 2024-09-10T22:46:19.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.856+0000 7f4af1800640 1 --2- 172.21.15.103:0/2848236349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aec15be30 0x7f4aec0ce0c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.856+0000 7f4af1800640 1 -- 172.21.15.103:0/2848236349 >> 172.21.15.103:0/2848236349 conn(0x7f4aec0d1ac0 msgr2=0x7f4aec0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:19.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.856+0000 7f4af1800640 1 -- 172.21.15.103:0/2848236349 shutdown_connections 2024-09-10T22:46:19.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.856+0000 7f4af1800640 1 -- 172.21.15.103:0/2848236349 wait complete. 2024-09-10T22:46:19.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4af1800640 1 Processor -- start 2024-09-10T22:46:19.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4af1800640 1 -- start start 2024-09-10T22:46:19.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4af1800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aec0ae9c0 0x7f4aec14c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:19.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4af1800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aec0b09c0 0x7f4aec1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:19.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4af1800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4aec15be30 0x7f4aec14ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:19.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4af1800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec169e00 con 0x7f4aec0ae9c0 2024-09-10T22:46:19.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4af1800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec169c80 con 0x7f4aec0b09c0 2024-09-10T22:46:19.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4af1800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4aec169f80 con 0x7f4aec15be30 2024-09-10T22:46:19.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4aeaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aec0ae9c0 0x7f4aec14c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:19.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4aeaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aec0ae9c0 0x7f4aec14c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40490/0 (socket says 172.21.15.103:40490) 2024-09-10T22:46:19.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4aeaa00640 1 -- 172.21.15.103:0/3425828255 learned_addr learned my addr 172.21.15.103:0/3425828255 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:19.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4aeb400640 1 --2- 172.21.15.103:0/3425828255 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4aec15be30 0x7f4aec14ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:19.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4ae2000640 1 --2- 172.21.15.103:0/3425828255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aec0b09c0 0x7f4aec1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:19.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4aeaa00640 1 -- 172.21.15.103:0/3425828255 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4aec15be30 msgr2=0x7f4aec14ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:19.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4aeaa00640 1 --2- 172.21.15.103:0/3425828255 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4aec15be30 0x7f4aec14ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4aeaa00640 1 -- 172.21.15.103:0/3425828255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aec0b09c0 msgr2=0x7f4aec1555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:19.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4aeaa00640 1 --2- 172.21.15.103:0/3425828255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aec0b09c0 0x7f4aec1555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:19.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4aeaa00640 1 -- 172.21.15.103:0/3425828255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec14fd50 con 0x7f4aec0ae9c0 2024-09-10T22:46:19.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4aeb400640 1 --2- 172.21.15.103:0/3425828255 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4aec15be30 0x7f4aec14ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:19.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4aeaa00640 1 --2- 172.21.15.103:0/3425828255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aec0ae9c0 0x7f4aec14c000 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009790 tx=0x7f4adc005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:19.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4ae3400640 1 -- 172.21.15.103:0/3425828255 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc0040f0 con 0x7f4aec0ae9c0 2024-09-10T22:46:19.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4ae3400640 1 -- 172.21.15.103:0/3425828255 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4adc004290 con 0x7f4aec0ae9c0 2024-09-10T22:46:19.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4af1800640 1 -- 172.21.15.103:0/3425828255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aec150030 con 0x7f4aec0ae9c0 2024-09-10T22:46:19.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4ae3400640 1 -- 172.21.15.103:0/3425828255 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc0a86f0 con 0x7f4aec0ae9c0 2024-09-10T22:46:19.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.860+0000 7f4af1800640 1 -- 172.21.15.103:0/3425828255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aec1505f0 con 0x7f4aec0ae9c0 2024-09-10T22:46:19.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.864+0000 7f4af1800640 1 -- 172.21.15.103:0/3425828255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aec0aee10 con 0x7f4aec0ae9c0 2024-09-10T22:46:19.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.864+0000 7f4ae3400640 1 -- 172.21.15.103:0/3425828255 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4adc0a8890 con 0x7f4aec0ae9c0 2024-09-10T22:46:19.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.864+0000 7f4ae3400640 1 --2- 172.21.15.103:0/3425828255 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4ac80725e0 0x7f4ac8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:19.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.864+0000 7f4ae3400640 1 -- 172.21.15.103:0/3425828255 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f4adc12db60 con 0x7f4aec0ae9c0 2024-09-10T22:46:19.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.864+0000 7f4ae2000640 1 --2- 172.21.15.103:0/3425828255 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4ac80725e0 0x7f4ac8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:19.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.864+0000 7f4ae2000640 1 --2- 172.21.15.103:0/3425828255 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4ac80725e0 0x7f4ac8074aa0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0b7020 tx=0x7f4ad4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:19.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:19.868+0000 7f4ae3400640 1 -- 172.21.15.103:0/3425828255 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4adc0c0060 con 0x7f4aec0ae9c0 2024-09-10T22:46:20.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.040+0000 7f4af1800640 1 -- 172.21.15.103:0/3425828255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4aec157630 con 0x7f4aec0ae9c0 2024-09-10T22:46:20.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.040+0000 7f4ae3400640 1 -- 172.21.15.103:0/3425828255 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+17150 (secure 0 0 0) 0x7f4adc0ac030 con 0x7f4aec0ae9c0 2024-09-10T22:46:20.042 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:20.042 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":107,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:45:33.494944+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:45:25.542643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-10T22:45:26.823498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.13","mappings":[{"from":1,"to":4}]},{"pgid":"16.29","mappings":[{"from":5,"to":4}]},{"pgid":"16.39","mappings":[{"from":6,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:46:20.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.044+0000 7f4af1800640 1 -- 172.21.15.103:0/3425828255 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4ac80725e0 msgr2=0x7f4ac8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:20.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.044+0000 7f4af1800640 1 --2- 172.21.15.103:0/3425828255 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4ac80725e0 0x7f4ac8074aa0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0b7020 tx=0x7f4ad4009040 comp rx=0 tx=0).stop 2024-09-10T22:46:20.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.044+0000 7f4af1800640 1 -- 172.21.15.103:0/3425828255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aec0ae9c0 msgr2=0x7f4aec14c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:20.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.044+0000 7f4af1800640 1 --2- 172.21.15.103:0/3425828255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aec0ae9c0 0x7f4aec14c000 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009790 tx=0x7f4adc005760 comp rx=0 tx=0).stop 2024-09-10T22:46:20.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.044+0000 7f4af1800640 1 -- 172.21.15.103:0/3425828255 shutdown_connections 2024-09-10T22:46:20.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.044+0000 7f4af1800640 1 --2- 172.21.15.103:0/3425828255 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f4ac80725e0 0x7f4ac8074aa0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:20.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.044+0000 7f4af1800640 1 --2- 172.21.15.103:0/3425828255 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4aec15be30 0x7f4aec14ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:20.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.044+0000 7f4af1800640 1 --2- 172.21.15.103:0/3425828255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aec0b09c0 0x7f4aec1555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:20.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.044+0000 7f4af1800640 1 --2- 172.21.15.103:0/3425828255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aec0ae9c0 0x7f4aec14c000 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:20.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.044+0000 7f4af1800640 1 -- 172.21.15.103:0/3425828255 >> 172.21.15.103:0/3425828255 conn(0x7f4aec0d1ac0 msgr2=0x7f4aec157e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:20.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.044+0000 7f4af1800640 1 -- 172.21.15.103:0/3425828255 shutdown_connections 2024-09-10T22:46:20.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.044+0000 7f4af1800640 1 -- 172.21.15.103:0/3425828255 wait complete. 2024-09-10T22:46:20.063 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T22:46:20.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246f200640 1 -- 172.21.15.103:0/2355793531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24540052a0 msgr2=0x7f24540037b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:20.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246f200640 1 --2- 172.21.15.103:0/2355793531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24540052a0 0x7f24540037b0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f2458001f50 tx=0x7f245801cc40 comp rx=0 tx=0).stop 2024-09-10T22:46:20.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246e800640 1 -- 172.21.15.103:0/2355793531 reap_dead start 2024-09-10T22:46:20.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246f200640 1 -- 172.21.15.103:0/2355793531 shutdown_connections 2024-09-10T22:46:20.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246f200640 1 -- 172.21.15.103:0/2355793531 >> 172.21.15.103:0/2355793531 conn(0x7f24700d18f0 msgr2=0x7f24700d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:20.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246f200640 1 -- 172.21.15.103:0/2355793531 shutdown_connections 2024-09-10T22:46:20.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246f200640 1 -- 172.21.15.103:0/2355793531 wait complete. 2024-09-10T22:46:20.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246f200640 1 Processor -- start 2024-09-10T22:46:20.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246f200640 1 -- start start 2024-09-10T22:46:20.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246f200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24540052a0 0x7f24701fb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:20.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246f200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f247015d0e0 0x7f247014aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f247014b540 0x7f247014b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2470167430 con 0x7f247014b540 2024-09-10T22:46:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246f200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f24701672b0 con 0x7f24540052a0 2024-09-10T22:46:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246f200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f24701675b0 con 0x7f247015d0e0 2024-09-10T22:46:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f247014b540 0x7f247014b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f247014b540 0x7f247014b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40494/0 (socket says 172.21.15.103:40494) 2024-09-10T22:46:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246e800640 1 -- 172.21.15.103:0/3183855101 learned_addr learned my addr 172.21.15.103:0/3183855101 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f2465400640 1 --2- 172.21.15.103:0/3183855101 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f247015d0e0 0x7f247014aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.208+0000 7f246de00640 1 --2- 172.21.15.103:0/3183855101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24540052a0 0x7f24701fb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.212+0000 7f246e800640 1 -- 172.21.15.103:0/3183855101 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f247015d0e0 msgr2=0x7f247014aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.212+0000 7f246e800640 1 --2- 172.21.15.103:0/3183855101 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f247015d0e0 0x7f247014aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.212+0000 7f246e800640 1 -- 172.21.15.103:0/3183855101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24540052a0 msgr2=0x7f24701fb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.212+0000 7f246e800640 1 --2- 172.21.15.103:0/3183855101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24540052a0 0x7f24701fb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.212+0000 7f246e800640 1 -- 172.21.15.103:0/3183855101 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247014e390 con 0x7f247014b540 2024-09-10T22:46:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.212+0000 7f246e800640 1 --2- 172.21.15.103:0/3183855101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f247014b540 0x7f247014b9c0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f2470075050 tx=0x7f2468011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.212+0000 7f2466a00640 1 -- 172.21.15.103:0/3183855101 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246800f890 con 0x7f247014b540 2024-09-10T22:46:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.212+0000 7f2466a00640 1 -- 172.21.15.103:0/3183855101 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f246800fa50 con 0x7f247014b540 2024-09-10T22:46:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.212+0000 7f246f200640 1 -- 172.21.15.103:0/3183855101 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24700c9e50 con 0x7f247014b540 2024-09-10T22:46:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.212+0000 7f2466a00640 1 -- 172.21.15.103:0/3183855101 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246800fea0 con 0x7f247014b540 2024-09-10T22:46:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.212+0000 7f246f200640 1 -- 172.21.15.103:0/3183855101 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24700ca3b0 con 0x7f247014b540 2024-09-10T22:46:20.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.212+0000 7f246f200640 1 -- 172.21.15.103:0/3183855101 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24700affd0 con 0x7f247014b540 2024-09-10T22:46:20.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.212+0000 7f2466a00640 1 -- 172.21.15.103:0/3183855101 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2468018030 con 0x7f247014b540 2024-09-10T22:46:20.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.212+0000 7f2466a00640 1 --2- 172.21.15.103:0/3183855101 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f244c0725e0 0x7f244c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:20.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.212+0000 7f2466a00640 1 -- 172.21.15.103:0/3183855101 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6188+0+0 (secure 0 0 0) 0x7f2468093850 con 0x7f247014b540 2024-09-10T22:46:20.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.216+0000 7f246de00640 1 --2- 172.21.15.103:0/3183855101 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f244c0725e0 0x7f244c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:20.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.216+0000 7f246de00640 1 --2- 172.21.15.103:0/3183855101 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f244c0725e0 0x7f244c074aa0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2460001ec0 tx=0x7f2460001050 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:20.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.216+0000 7f2466a00640 1 -- 172.21.15.103:0/3183855101 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f24700c9e50 con 0x7f247014b540 2024-09-10T22:46:20.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.416+0000 7f246f200640 1 -- 172.21.15.103:0/3183855101 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f24700cdda0 con 0x7f247014b540 2024-09-10T22:46:20.418 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-10T22:46:20.416+0000 7fb5aba00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:46:20.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.420+0000 7f2466a00640 1 -- 172.21.15.103:0/3183855101 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v118) ==== 161+0+0 (secure 0 0 0) 0x7f246805e6f0 con 0x7f247014b540 2024-09-10T22:46:20.420 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T22:46:20.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.424+0000 7f246f200640 1 -- 172.21.15.103:0/3183855101 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f244c0725e0 msgr2=0x7f244c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:20.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.424+0000 7f246f200640 1 --2- 172.21.15.103:0/3183855101 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f244c0725e0 0x7f244c074aa0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2460001ec0 tx=0x7f2460001050 comp rx=0 tx=0).stop 2024-09-10T22:46:20.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.424+0000 7f246f200640 1 -- 172.21.15.103:0/3183855101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f247014b540 msgr2=0x7f247014b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:20.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.424+0000 7f246f200640 1 --2- 172.21.15.103:0/3183855101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f247014b540 0x7f247014b9c0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f2470075050 tx=0x7f2468011c40 comp rx=0 tx=0).stop 2024-09-10T22:46:20.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.424+0000 7f246f200640 1 -- 172.21.15.103:0/3183855101 shutdown_connections 2024-09-10T22:46:20.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.424+0000 7f246f200640 1 --2- 172.21.15.103:0/3183855101 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f244c0725e0 0x7f244c074aa0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:20.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.424+0000 7f246f200640 1 --2- 172.21.15.103:0/3183855101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f247014b540 0x7f247014b9c0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:20.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.424+0000 7f246f200640 1 --2- 172.21.15.103:0/3183855101 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f247015d0e0 0x7f247014aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:20.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.424+0000 7f246f200640 1 --2- 172.21.15.103:0/3183855101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24540052a0 0x7f24701fb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:20.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.424+0000 7f246f200640 1 -- 172.21.15.103:0/3183855101 >> 172.21.15.103:0/3183855101 conn(0x7f24700d18f0 msgr2=0x7f2470163a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:20.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.424+0000 7f246f200640 1 -- 172.21.15.103:0/3183855101 shutdown_connections 2024-09-10T22:46:20.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.424+0000 7f246f200640 1 -- 172.21.15.103:0/3183855101 wait complete. 2024-09-10T22:46:20.437 INFO:tasks.ceph.mds.b.smithi131.stderr: -1230> 2024-09-10T22:45:58.601+0000 7f132ba00640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-10T22:45:40.501264+0000 1=0+1) n(v0 rc2024-09-10T22:45:40.501264+0000 2=0+2) (inest lock) (ifile excl) caps={8364=pAsLsXsFsx/-@6},l=8364 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x557016854000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:45:40.501264+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:45:40.501264+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-10T22:45:40.501264+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-10T22:45:40.501264+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-10T22:46:20.438 INFO:tasks.ceph.mds.b.smithi131.stderr: -1215> 2024-09-10T22:45:58.601+0000 7f132ba00640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) caps={8364=pAsLsXsFs/-@3},l=8364 | request=0 lock=0 importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x557016854580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-10T22:46:20.442 INFO:tasks.ceph.mds.c.smithi103.stderr: -2836> 2024-09-10T22:45:58.596+0000 7fa8c1600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-10T22:45:40.494005+0000 1=0+1) n(v3 rc2024-09-10T22:45:40.717416+0000 6=0+6) (inest mix dirty) (ifile excl) caps={8364=pAsLsXsFsx/AsLsXsFsx@9},l=8364 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55becc78f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:45:40.494005+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:45:40.717416+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-10T22:45:40.494005+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-10T22:45:40.717416+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-10T22:46:20.442 INFO:tasks.ceph.mds.c.smithi103.stderr: -2705> 2024-09-10T22:45:58.596+0000 7fa8c9800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-10T22:45:40.495695+0000 1=0+1) n(v4 rc2024-09-10T22:45:40.717416+0000 5=0+5) (inest sync->mix g=1,2) caps={8364=pAsLsXsFs/-@11} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55becc78f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:45:40.495695+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:45:40.717416+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-10T22:45:40.495695+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-10T22:45:40.717416+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-10T22:46:20.449 INFO:tasks.ceph.mds.a.smithi103.stderr: -1354> 2024-09-10T22:45:58.596+0000 7fa390a00640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-10T22:45:40.497526+0000 1=0+1) n(v2 rc2024-09-10T22:45:40.717416+0000 4=0+4) (inest lock) caps={8364=pAsLsXsFs/-@7},l=8364 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55b981b6ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:45:40.497526+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:45:40.717416+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-10T22:45:40.497526+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-10T22:45:40.717416+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-10T22:46:20.449 INFO:tasks.ceph.mds.a.smithi103.stderr: -1204> 2024-09-10T22:45:58.596+0000 7fa398c00640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-10T22:45:40.499257+0000 1=0+1) n(v1 rc2024-09-10T22:45:40.717416+0000 3=0+3) (inest sync->mix g=0,2 scatter_wanted) caps={8364=pAsLsXsFs/-@7} | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55b981b6e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-10T22:45:40.499257+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-10T22:45:40.501264+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-10T22:45:40.499257+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-10T22:45:40.717416+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-10T22:46:20.455 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T22:46:20.484 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2024-09-10T22:46:20.489 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-09-10T22:46:20.497 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-09-10T22:46:20.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.604+0000 7f703f800640 1 -- 172.21.15.103:0/3897096820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70380cfdd0 msgr2=0x7f7038073d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:20.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.604+0000 7f703f800640 1 --2- 172.21.15.103:0/3897096820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70380cfdd0 0x7f7038073d20 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f70380d08e0 tx=0x7f703001cd40 comp rx=0 tx=0).stop 2024-09-10T22:46:20.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.604+0000 7f703f800640 1 -- 172.21.15.103:0/3897096820 shutdown_connections 2024-09-10T22:46:20.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.604+0000 7f703f800640 1 --2- 172.21.15.103:0/3897096820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70380cfdd0 0x7f7038073d20 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:20.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.604+0000 7f703f800640 1 --2- 172.21.15.103:0/3897096820 >> v2:172.21.15.131:3300/0 conn(0x7f70380cf9f0 0x7f703806eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:20.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.604+0000 7f703f800640 1 -- 172.21.15.103:0/3897096820 >> 172.21.15.103:0/3897096820 conn(0x7f703806cc00 msgr2=0x7f703806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:20.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.604+0000 7f703f800640 1 -- 172.21.15.103:0/3897096820 shutdown_connections 2024-09-10T22:46:20.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.604+0000 7f703f800640 1 -- 172.21.15.103:0/3897096820 wait complete. 2024-09-10T22:46:20.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.604+0000 7f703f800640 1 Processor -- start 2024-09-10T22:46:20.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.604+0000 7f703f800640 1 -- start start 2024-09-10T22:46:20.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703f800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703806f0c0 0x7f70381f80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:20.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703f800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70380cf9f0 0x7f7038156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:20.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703f800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70380cfdd0 0x7f70381faad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:20.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703f800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f70380cd6c0 con 0x7f703806f0c0 2024-09-10T22:46:20.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703f800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f70380cd540 con 0x7f70380cf9f0 2024-09-10T22:46:20.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703f800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f70380cd840 con 0x7f70380cfdd0 2024-09-10T22:46:20.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703806f0c0 0x7f70381f80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:20.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703806f0c0 0x7f70381f80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40540/0 (socket says 172.21.15.103:40540) 2024-09-10T22:46:20.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703ce00640 1 -- 172.21.15.103:0/2077174137 learned_addr learned my addr 172.21.15.103:0/2077174137 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:20.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f7037e00640 1 --2- 172.21.15.103:0/2077174137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70380cf9f0 0x7f7038156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:20.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703d800640 1 --2- 172.21.15.103:0/2077174137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70380cfdd0 0x7f70381faad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:20.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703ce00640 1 -- 172.21.15.103:0/2077174137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70380cfdd0 msgr2=0x7f70381faad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:20.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703ce00640 1 --2- 172.21.15.103:0/2077174137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70380cfdd0 0x7f70381faad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:20.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703ce00640 1 -- 172.21.15.103:0/2077174137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70380cf9f0 msgr2=0x7f7038156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:20.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703ce00640 1 --2- 172.21.15.103:0/2077174137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70380cf9f0 0x7f7038156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:20.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703ce00640 1 -- 172.21.15.103:0/2077174137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70381fb3b0 con 0x7f703806f0c0 2024-09-10T22:46:20.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703ce00640 1 --2- 172.21.15.103:0/2077174137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703806f0c0 0x7f70381f80e0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f702c00d980 tx=0x7f702c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:20.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f7034c00640 1 -- 172.21.15.103:0/2077174137 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c017070 con 0x7f703806f0c0 2024-09-10T22:46:20.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f7034c00640 1 -- 172.21.15.103:0/2077174137 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f702c009d60 con 0x7f703806f0c0 2024-09-10T22:46:20.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f7034c00640 1 -- 172.21.15.103:0/2077174137 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c005280 con 0x7f703806f0c0 2024-09-10T22:46:20.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703f800640 1 -- 172.21.15.103:0/2077174137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70381fb690 con 0x7f703806f0c0 2024-09-10T22:46:20.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703f800640 1 -- 172.21.15.103:0/2077174137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f703814b6e0 con 0x7f703806f0c0 2024-09-10T22:46:20.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f703f800640 1 -- 172.21.15.103:0/2077174137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f703806eb80 con 0x7f703806f0c0 2024-09-10T22:46:20.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.608+0000 7f7034c00640 1 -- 172.21.15.103:0/2077174137 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f702c005420 con 0x7f703806f0c0 2024-09-10T22:46:20.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.612+0000 7f7034c00640 1 --2- 172.21.15.103:0/2077174137 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f70180725e0 0x7f7018074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:20.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.612+0000 7f7034c00640 1 -- 172.21.15.103:0/2077174137 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6446+0+0 (secure 0 0 0) 0x7f702c0936d0 con 0x7f703806f0c0 2024-09-10T22:46:20.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.612+0000 7f7037e00640 1 --2- 172.21.15.103:0/2077174137 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f70180725e0 0x7f7018074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:20.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.612+0000 7f7037e00640 1 --2- 172.21.15.103:0/2077174137 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f70180725e0 0x7f7018074aa0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f70381562e0 tx=0x7f7024007e40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:20.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.616+0000 7f7034c00640 1 -- 172.21.15.103:0/2077174137 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f702c05e470 con 0x7f703806f0c0 2024-09-10T22:46:20.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:20.812+0000 7f703f800640 1 -- 172.21.15.103:0/2077174137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f70380b3a30 con 0x7f703806f0c0 2024-09-10T22:46:21.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.420+0000 7f7034c00640 1 -- 172.21.15.103:0/2077174137 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v119) ==== 104+0+0 (secure 0 0 0) 0x7f702c062ea0 con 0x7f703806f0c0 2024-09-10T22:46:21.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.424+0000 7f703f800640 1 -- 172.21.15.103:0/2077174137 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f70180725e0 msgr2=0x7f7018074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:21.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.424+0000 7f703f800640 1 --2- 172.21.15.103:0/2077174137 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f70180725e0 0x7f7018074aa0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f70381562e0 tx=0x7f7024007e40 comp rx=0 tx=0).stop 2024-09-10T22:46:21.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.424+0000 7f703f800640 1 -- 172.21.15.103:0/2077174137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703806f0c0 msgr2=0x7f70381f80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:21.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.424+0000 7f703f800640 1 --2- 172.21.15.103:0/2077174137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703806f0c0 0x7f70381f80e0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f702c00d980 tx=0x7f702c00de40 comp rx=0 tx=0).stop 2024-09-10T22:46:21.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.424+0000 7f703f800640 1 -- 172.21.15.103:0/2077174137 shutdown_connections 2024-09-10T22:46:21.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.424+0000 7f703f800640 1 --2- 172.21.15.103:0/2077174137 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f70180725e0 0x7f7018074aa0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:21.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.424+0000 7f703f800640 1 --2- 172.21.15.103:0/2077174137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70380cfdd0 0x7f70381faad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:21.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.424+0000 7f703f800640 1 --2- 172.21.15.103:0/2077174137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70380cf9f0 0x7f7038156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:21.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.424+0000 7f703f800640 1 --2- 172.21.15.103:0/2077174137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703806f0c0 0x7f70381f80e0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:21.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.424+0000 7f703f800640 1 -- 172.21.15.103:0/2077174137 >> 172.21.15.103:0/2077174137 conn(0x7f703806cc00 msgr2=0x7f7038151130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:21.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.424+0000 7f703f800640 1 -- 172.21.15.103:0/2077174137 shutdown_connections 2024-09-10T22:46:21.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.424+0000 7f703f800640 1 -- 172.21.15.103:0/2077174137 wait complete. 2024-09-10T22:46:21.449 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T22:46:21.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d56e00640 1 -- 172.21.15.103:0/1650505890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d340052f0 msgr2=0x7f0d3400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:21.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d56e00640 1 --2- 172.21.15.103:0/1650505890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d340052f0 0x7f0d3400b9d0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009eb0 tx=0x7f0d4801d5f0 comp rx=0 tx=0).stop 2024-09-10T22:46:21.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d56e00640 1 -- 172.21.15.103:0/1650505890 shutdown_connections 2024-09-10T22:46:21.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d56e00640 1 --2- 172.21.15.103:0/1650505890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d340052f0 0x7f0d3400b9d0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:21.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d56e00640 1 -- 172.21.15.103:0/1650505890 >> 172.21.15.103:0/1650505890 conn(0x7f0d500d1ac0 msgr2=0x7f0d500d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:21.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d56e00640 1 -- 172.21.15.103:0/1650505890 shutdown_connections 2024-09-10T22:46:21.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d56e00640 1 -- 172.21.15.103:0/1650505890 wait complete. 2024-09-10T22:46:21.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d56e00640 1 Processor -- start 2024-09-10T22:46:21.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d56e00640 1 -- start start 2024-09-10T22:46:21.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d56e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d340052f0 0x7f0d5014a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:21.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d56e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d500c55f0 0x7f0d500c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:21.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d56e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d500c9be0 0x7f0d500ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:21.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d56e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5015c210 con 0x7f0d500c55f0 2024-09-10T22:46:21.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d56e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0d500cdcd0 con 0x7f0d500c9be0 2024-09-10T22:46:21.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d56e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5015c390 con 0x7f0d340052f0 2024-09-10T22:46:21.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d4f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d500c55f0 0x7f0d500c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:21.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d4f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d500c55f0 0x7f0d500c5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40560/0 (socket says 172.21.15.103:40560) 2024-09-10T22:46:21.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d4f400640 1 -- 172.21.15.103:0/2619448069 learned_addr learned my addr 172.21.15.103:0/2619448069 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:21.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d54e00640 1 --2- 172.21.15.103:0/2619448069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d500c9be0 0x7f0d500ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:21.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.644+0000 7f0d4fe00640 1 --2- 172.21.15.103:0/2619448069 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d340052f0 0x7f0d5014a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:21.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.648+0000 7f0d4f400640 1 -- 172.21.15.103:0/2619448069 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d340052f0 msgr2=0x7f0d5014a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:21.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.648+0000 7f0d4f400640 1 --2- 172.21.15.103:0/2619448069 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d340052f0 0x7f0d5014a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:21.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.648+0000 7f0d4f400640 1 -- 172.21.15.103:0/2619448069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d500c9be0 msgr2=0x7f0d500ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:21.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.648+0000 7f0d4f400640 1 --2- 172.21.15.103:0/2619448069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d500c9be0 0x7f0d500ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:21.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.648+0000 7f0d4f400640 1 -- 172.21.15.103:0/2619448069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5014ada0 con 0x7f0d500c55f0 2024-09-10T22:46:21.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.648+0000 7f0d4f400640 1 --2- 172.21.15.103:0/2619448069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d500c55f0 0x7f0d500c5a70 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c001780 tx=0x7f0d3c00e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:21.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.648+0000 7f0d47e00640 1 -- 172.21.15.103:0/2619448069 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c012850 con 0x7f0d500c55f0 2024-09-10T22:46:21.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.648+0000 7f0d47e00640 1 -- 172.21.15.103:0/2619448069 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d3c012ae0 con 0x7f0d500c55f0 2024-09-10T22:46:21.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.648+0000 7f0d56e00640 1 -- 172.21.15.103:0/2619448069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d500ca7c0 con 0x7f0d500c55f0 2024-09-10T22:46:21.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.648+0000 7f0d47e00640 1 -- 172.21.15.103:0/2619448069 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c01a400 con 0x7f0d500c55f0 2024-09-10T22:46:21.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.648+0000 7f0d56e00640 1 -- 172.21.15.103:0/2619448069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d500cad80 con 0x7f0d500c55f0 2024-09-10T22:46:21.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.648+0000 7f0d56e00640 1 -- 172.21.15.103:0/2619448069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d500ce440 con 0x7f0d500c55f0 2024-09-10T22:46:21.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.648+0000 7f0d47e00640 1 -- 172.21.15.103:0/2619448069 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0d3c0233f0 con 0x7f0d500c55f0 2024-09-10T22:46:21.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.648+0000 7f0d47e00640 1 --2- 172.21.15.103:0/2619448069 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0d30072610 0x7f0d30074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:21.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.648+0000 7f0d47e00640 1 -- 172.21.15.103:0/2619448069 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6446+0+0 (secure 0 0 0) 0x7f0d3c0967e0 con 0x7f0d500c55f0 2024-09-10T22:46:21.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.652+0000 7f0d4fe00640 1 --2- 172.21.15.103:0/2619448069 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0d30072610 0x7f0d30074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:21.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.652+0000 7f0d4fe00640 1 --2- 172.21.15.103:0/2619448069 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0d30072610 0x7f0d30074ad0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0d40000c10 tx=0x7f0d40006b80 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:21.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.652+0000 7f0d47e00640 1 -- 172.21.15.103:0/2619448069 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0d3c016030 con 0x7f0d500c55f0 2024-09-10T22:46:21.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:21.824+0000 7f0d56e00640 1 -- 172.21.15.103:0/2619448069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0d500d23d0 con 0x7f0d500c55f0 2024-09-10T22:46:22.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.428+0000 7f0d47e00640 1 -- 172.21.15.103:0/2619448069 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v109) ==== 181+0+0 (secure 0 0 0) 0x7f0d3c061580 con 0x7f0d500c55f0 2024-09-10T22:46:22.430 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2024-09-10T22:46:22.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.432+0000 7f0d56e00640 1 -- 172.21.15.103:0/2619448069 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0d30072610 msgr2=0x7f0d30074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:22.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.432+0000 7f0d56e00640 1 --2- 172.21.15.103:0/2619448069 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0d30072610 0x7f0d30074ad0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0d40000c10 tx=0x7f0d40006b80 comp rx=0 tx=0).stop 2024-09-10T22:46:22.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.432+0000 7f0d56e00640 1 -- 172.21.15.103:0/2619448069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d500c55f0 msgr2=0x7f0d500c5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:22.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.432+0000 7f0d56e00640 1 --2- 172.21.15.103:0/2619448069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d500c55f0 0x7f0d500c5a70 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c001780 tx=0x7f0d3c00e6b0 comp rx=0 tx=0).stop 2024-09-10T22:46:22.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.432+0000 7f0d56e00640 1 -- 172.21.15.103:0/2619448069 shutdown_connections 2024-09-10T22:46:22.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.432+0000 7f0d56e00640 1 --2- 172.21.15.103:0/2619448069 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0d30072610 0x7f0d30074ad0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:22.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.432+0000 7f0d56e00640 1 --2- 172.21.15.103:0/2619448069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d500c9be0 0x7f0d500ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:22.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.432+0000 7f0d56e00640 1 --2- 172.21.15.103:0/2619448069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d500c55f0 0x7f0d500c5a70 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:22.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.432+0000 7f0d56e00640 1 --2- 172.21.15.103:0/2619448069 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d340052f0 0x7f0d5014a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:22.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.432+0000 7f0d56e00640 1 -- 172.21.15.103:0/2619448069 >> 172.21.15.103:0/2619448069 conn(0x7f0d500d1ac0 msgr2=0x7f0d500ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:22.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.432+0000 7f0d56e00640 1 -- 172.21.15.103:0/2619448069 shutdown_connections 2024-09-10T22:46:22.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.432+0000 7f0d56e00640 1 -- 172.21.15.103:0/2619448069 wait complete. 2024-09-10T22:46:22.458 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T22:46:22.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.604+0000 7f5d35a00640 1 -- 172.21.15.103:0/1386399949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d14003ad0 msgr2=0x7f5d14003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:22.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.604+0000 7f5d35a00640 1 --2- 172.21.15.103:0/1386399949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d14003ad0 0x7f5d14003ef0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009b60 tx=0x7f5d2001d240 comp rx=0 tx=0).stop 2024-09-10T22:46:22.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.604+0000 7f5d35000640 1 -- 172.21.15.103:0/1386399949 reap_dead start 2024-09-10T22:46:22.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.604+0000 7f5d35a00640 1 -- 172.21.15.103:0/1386399949 shutdown_connections 2024-09-10T22:46:22.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.604+0000 7f5d35a00640 1 -- 172.21.15.103:0/1386399949 >> 172.21.15.103:0/1386399949 conn(0x7f5d300d18d0 msgr2=0x7f5d300d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:22.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.604+0000 7f5d35a00640 1 -- 172.21.15.103:0/1386399949 shutdown_connections 2024-09-10T22:46:22.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.604+0000 7f5d35a00640 1 -- 172.21.15.103:0/1386399949 wait complete. 2024-09-10T22:46:22.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d35a00640 1 Processor -- start 2024-09-10T22:46:22.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d35a00640 1 -- start start 2024-09-10T22:46:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d35a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d14003ad0 0x7f5d3014d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d35a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d300b2a30 0x7f5d300b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d35a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d3006ed90 0x7f5d3006f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d35a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30166890 con 0x7f5d14003ad0 2024-09-10T22:46:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d35a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5d300ceba0 con 0x7f5d300b2a30 2024-09-10T22:46:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d35a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5d30166a10 con 0x7f5d3006ed90 2024-09-10T22:46:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d2fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d14003ad0 0x7f5d3014d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d2fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d14003ad0 0x7f5d3014d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40578/0 (socket says 172.21.15.103:40578) 2024-09-10T22:46:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d2fe00640 1 -- 172.21.15.103:0/3530703628 learned_addr learned my addr 172.21.15.103:0/3530703628 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:22.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d35000640 1 --2- 172.21.15.103:0/3530703628 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d3006ed90 0x7f5d3006f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d2f400640 1 --2- 172.21.15.103:0/3530703628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d300b2a30 0x7f5d300b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d2fe00640 1 -- 172.21.15.103:0/3530703628 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d3006ed90 msgr2=0x7f5d3006f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d2fe00640 1 --2- 172.21.15.103:0/3530703628 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d3006ed90 0x7f5d3006f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d2fe00640 1 -- 172.21.15.103:0/3530703628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d300b2a30 msgr2=0x7f5d300b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d2fe00640 1 --2- 172.21.15.103:0/3530703628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d300b2a30 0x7f5d300b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d2fe00640 1 -- 172.21.15.103:0/3530703628 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3014e390 con 0x7f5d14003ad0 2024-09-10T22:46:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d2fe00640 1 --2- 172.21.15.103:0/3530703628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d14003ad0 0x7f5d3014d9d0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f5d2001d070 tx=0x7f5d20005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d27e00640 1 -- 172.21.15.103:0/3530703628 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d200b1040 con 0x7f5d14003ad0 2024-09-10T22:46:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d27e00640 1 -- 172.21.15.103:0/3530703628 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d200bb070 con 0x7f5d14003ad0 2024-09-10T22:46:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d27e00640 1 -- 172.21.15.103:0/3530703628 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d20004290 con 0x7f5d14003ad0 2024-09-10T22:46:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d35a00640 1 -- 172.21.15.103:0/3530703628 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d301fac00 con 0x7f5d14003ad0 2024-09-10T22:46:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.608+0000 7f5d35a00640 1 -- 172.21.15.103:0/3530703628 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d301fb1c0 con 0x7f5d14003ad0 2024-09-10T22:46:22.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.612+0000 7f5d35a00640 1 -- 172.21.15.103:0/3530703628 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d300b33f0 con 0x7f5d14003ad0 2024-09-10T22:46:22.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.612+0000 7f5d27e00640 1 -- 172.21.15.103:0/3530703628 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5d200046d0 con 0x7f5d14003ad0 2024-09-10T22:46:22.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.612+0000 7f5d27e00640 1 --2- 172.21.15.103:0/3530703628 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5d10072610 0x7f5d10074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:22.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.612+0000 7f5d27e00640 1 -- 172.21.15.103:0/3530703628 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 6008+0+0 (secure 0 0 0) 0x7f5d2012e370 con 0x7f5d14003ad0 2024-09-10T22:46:22.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.612+0000 7f5d2f400640 1 --2- 172.21.15.103:0/3530703628 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5d10072610 0x7f5d10074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:22.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.612+0000 7f5d2f400640 1 --2- 172.21.15.103:0/3530703628 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5d10072610 0x7f5d10074ad0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c000c10 tx=0x7f5d1c0067b0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:22.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.616+0000 7f5d27e00640 1 -- 172.21.15.103:0/3530703628 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5d3014e390 con 0x7f5d14003ad0 2024-09-10T22:46:22.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:22.784+0000 7f5d35a00640 1 -- 172.21.15.103:0/3530703628 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5d300cdc40 con 0x7f5d14003ad0 2024-09-10T22:46:23.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.432+0000 7f5d27e00640 1 -- 172.21.15.103:0/3530703628 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v110) ==== 169+0+0 (secure 0 0 0) 0x7f5d200a5e20 con 0x7f5d14003ad0 2024-09-10T22:46:23.434 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2024-09-10T22:46:23.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.436+0000 7f5d35a00640 1 -- 172.21.15.103:0/3530703628 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5d10072610 msgr2=0x7f5d10074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:23.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.436+0000 7f5d35a00640 1 --2- 172.21.15.103:0/3530703628 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5d10072610 0x7f5d10074ad0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c000c10 tx=0x7f5d1c0067b0 comp rx=0 tx=0).stop 2024-09-10T22:46:23.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.436+0000 7f5d35a00640 1 -- 172.21.15.103:0/3530703628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d14003ad0 msgr2=0x7f5d3014d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:23.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.436+0000 7f5d35a00640 1 --2- 172.21.15.103:0/3530703628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d14003ad0 0x7f5d3014d9d0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f5d2001d070 tx=0x7f5d20005590 comp rx=0 tx=0).stop 2024-09-10T22:46:23.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.436+0000 7f5d35a00640 1 -- 172.21.15.103:0/3530703628 shutdown_connections 2024-09-10T22:46:23.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.436+0000 7f5d35a00640 1 --2- 172.21.15.103:0/3530703628 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f5d10072610 0x7f5d10074ad0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:23.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.436+0000 7f5d35a00640 1 --2- 172.21.15.103:0/3530703628 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d3006ed90 0x7f5d3006f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:23.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.436+0000 7f5d35a00640 1 --2- 172.21.15.103:0/3530703628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d300b2a30 0x7f5d300b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:23.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.436+0000 7f5d35a00640 1 --2- 172.21.15.103:0/3530703628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d14003ad0 0x7f5d3014d9d0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:23.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.436+0000 7f5d35a00640 1 -- 172.21.15.103:0/3530703628 >> 172.21.15.103:0/3530703628 conn(0x7f5d300d18d0 msgr2=0x7f5d3015ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:23.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.436+0000 7f5d35a00640 1 -- 172.21.15.103:0/3530703628 shutdown_connections 2024-09-10T22:46:23.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.436+0000 7f5d35a00640 1 -- 172.21.15.103:0/3530703628 wait complete. 2024-09-10T22:46:23.463 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T22:46:23.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.612+0000 7f35f3400640 1 -- 172.21.15.103:0/3412789276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35ec0b09c0 msgr2=0x7f35ec0ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:23.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.612+0000 7f35f3400640 1 --2- 172.21.15.103:0/3412789276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35ec0b09c0 0x7f35ec0ce600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009900 tx=0x7f35d801c850 comp rx=0 tx=0).stop 2024-09-10T22:46:23.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.612+0000 7f35f3400640 1 -- 172.21.15.103:0/3412789276 shutdown_connections 2024-09-10T22:46:23.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.612+0000 7f35f3400640 1 --2- 172.21.15.103:0/3412789276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35ec0b09c0 0x7f35ec0ce600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:23.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.612+0000 7f35f3400640 1 --2- 172.21.15.103:0/3412789276 >> v2:172.21.15.131:3300/0 conn(0x7f35ec15be30 0x7f35ec0ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:23.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.612+0000 7f35f3400640 1 -- 172.21.15.103:0/3412789276 >> 172.21.15.103:0/3412789276 conn(0x7f35ec0d1ac0 msgr2=0x7f35ec0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:23.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.612+0000 7f35f3400640 1 -- 172.21.15.103:0/3412789276 shutdown_connections 2024-09-10T22:46:23.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.612+0000 7f35f3400640 1 -- 172.21.15.103:0/3412789276 wait complete. 2024-09-10T22:46:23.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.612+0000 7f35f3400640 1 Processor -- start 2024-09-10T22:46:23.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.612+0000 7f35f3400640 1 -- start start 2024-09-10T22:46:23.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35f3400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35ec0b09c0 0x7f35ec1fa240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:23.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35f3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ec0ceb40 0x7f35ec0b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:23.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35f3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35ec15be30 0x7f35ec0b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:23.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35f3400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec169160 con 0x7f35ec0ceb40 2024-09-10T22:46:23.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35f3400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec168fe0 con 0x7f35ec15be30 2024-09-10T22:46:23.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35f3400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f35ec1692e0 con 0x7f35ec0b09c0 2024-09-10T22:46:23.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35ebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ec0ceb40 0x7f35ec0b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:23.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35f0a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35ec0b09c0 0x7f35ec1fa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:23.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35f1400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35ec15be30 0x7f35ec0b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:23.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35ebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ec0ceb40 0x7f35ec0b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40590/0 (socket says 172.21.15.103:40590) 2024-09-10T22:46:23.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35ebe00640 1 -- 172.21.15.103:0/925332676 learned_addr learned my addr 172.21.15.103:0/925332676 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:23.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35ebe00640 1 -- 172.21.15.103:0/925332676 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35ec0b09c0 msgr2=0x7f35ec1fa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:23.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35ebe00640 1 --2- 172.21.15.103:0/925332676 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35ec0b09c0 0x7f35ec1fa240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35ebe00640 1 -- 172.21.15.103:0/925332676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35ec15be30 msgr2=0x7f35ec0b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35ebe00640 1 --2- 172.21.15.103:0/925332676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35ec15be30 0x7f35ec0b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35ebe00640 1 -- 172.21.15.103:0/925332676 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ec159880 con 0x7f35ec0ceb40 2024-09-10T22:46:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35ebe00640 1 --2- 172.21.15.103:0/925332676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ec0ceb40 0x7f35ec0b1f20 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009850 tx=0x7f35d8005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35e8c00640 1 -- 172.21.15.103:0/925332676 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d80b2040 con 0x7f35ec0ceb40 2024-09-10T22:46:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35e8c00640 1 -- 172.21.15.103:0/925332676 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35d8004300 con 0x7f35ec0ceb40 2024-09-10T22:46:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35e8c00640 1 -- 172.21.15.103:0/925332676 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d80052d0 con 0x7f35ec0ceb40 2024-09-10T22:46:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35f3400640 1 -- 172.21.15.103:0/925332676 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35ec159eb0 con 0x7f35ec0ceb40 2024-09-10T22:46:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35f3400640 1 -- 172.21.15.103:0/925332676 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ec0b50b0 con 0x7f35ec0ceb40 2024-09-10T22:46:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35f3400640 1 -- 172.21.15.103:0/925332676 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35ec0cf9c0 con 0x7f35ec0ceb40 2024-09-10T22:46:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.616+0000 7f35e8c00640 1 -- 172.21.15.103:0/925332676 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f35d8005470 con 0x7f35ec0ceb40 2024-09-10T22:46:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.620+0000 7f35e8c00640 1 --2- 172.21.15.103:0/925332676 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35cc0725e0 0x7f35cc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.620+0000 7f35e8c00640 1 -- 172.21.15.103:0/925332676 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7f35d812ca60 con 0x7f35ec0ceb40 2024-09-10T22:46:23.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.620+0000 7f35f0a00640 1 --2- 172.21.15.103:0/925332676 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35cc0725e0 0x7f35cc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:23.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.620+0000 7f35f0a00640 1 --2- 172.21.15.103:0/925332676 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35cc0725e0 0x7f35cc074aa0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009b40 tx=0x7f35e00091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:23.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.624+0000 7f35e8c00640 1 -- 172.21.15.103:0/925332676 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f35ec159880 con 0x7f35ec0ceb40 2024-09-10T22:46:23.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.788+0000 7f35f3400640 1 -- 172.21.15.103:0/925332676 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f35ec075d40 con 0x7f35ec0ceb40 2024-09-10T22:46:23.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.792+0000 7f35e8c00640 1 -- 172.21.15.103:0/925332676 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v39) ==== 71+0+0 (secure 0 0 0) 0x7f35d80164d0 con 0x7f35ec0ceb40 2024-09-10T22:46:23.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.796+0000 7f35f3400640 1 -- 172.21.15.103:0/925332676 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35cc0725e0 msgr2=0x7f35cc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:23.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.796+0000 7f35f3400640 1 --2- 172.21.15.103:0/925332676 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35cc0725e0 0x7f35cc074aa0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009b40 tx=0x7f35e00091e0 comp rx=0 tx=0).stop 2024-09-10T22:46:23.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.796+0000 7f35f3400640 1 -- 172.21.15.103:0/925332676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ec0ceb40 msgr2=0x7f35ec0b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:23.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.796+0000 7f35f3400640 1 --2- 172.21.15.103:0/925332676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ec0ceb40 0x7f35ec0b1f20 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009850 tx=0x7f35d8005e70 comp rx=0 tx=0).stop 2024-09-10T22:46:23.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.796+0000 7f35f3400640 1 -- 172.21.15.103:0/925332676 shutdown_connections 2024-09-10T22:46:23.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.796+0000 7f35f3400640 1 --2- 172.21.15.103:0/925332676 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f35cc0725e0 0x7f35cc074aa0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:23.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.796+0000 7f35f3400640 1 --2- 172.21.15.103:0/925332676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35ec15be30 0x7f35ec0b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:23.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.796+0000 7f35f3400640 1 --2- 172.21.15.103:0/925332676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35ec0ceb40 0x7f35ec0b1f20 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:23.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.796+0000 7f35f3400640 1 --2- 172.21.15.103:0/925332676 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35ec0b09c0 0x7f35ec1fa240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:23.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.796+0000 7f35f3400640 1 -- 172.21.15.103:0/925332676 >> 172.21.15.103:0/925332676 conn(0x7f35ec0d1ac0 msgr2=0x7f35ec15af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:23.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.796+0000 7f35f3400640 1 -- 172.21.15.103:0/925332676 shutdown_connections 2024-09-10T22:46:23.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.796+0000 7f35f3400640 1 -- 172.21.15.103:0/925332676 wait complete. 2024-09-10T22:46:23.815 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0' 2024-09-10T22:46:23.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.956+0000 7fbf3be00640 1 -- 172.21.15.103:0/2142349089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf3c06dac0 msgr2=0x7fbf3c0ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:23.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.956+0000 7fbf3be00640 1 --2- 172.21.15.103:0/2142349089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf3c06dac0 0x7fbf3c0ce690 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fbf24009840 tx=0x7fbf2401c820 comp rx=0 tx=0).stop 2024-09-10T22:46:23.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.956+0000 7fbf3be00640 1 -- 172.21.15.103:0/2142349089 shutdown_connections 2024-09-10T22:46:23.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.956+0000 7fbf3be00640 1 --2- 172.21.15.103:0/2142349089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf3c06dac0 0x7fbf3c0ce690 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:23.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.956+0000 7fbf3be00640 1 --2- 172.21.15.103:0/2142349089 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf3c15b6d0 0x7fbf3c06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:23.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.956+0000 7fbf3be00640 1 -- 172.21.15.103:0/2142349089 >> 172.21.15.103:0/2142349089 conn(0x7fbf3c0cff60 msgr2=0x7fbf3c0d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:23.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.956+0000 7fbf3be00640 1 -- 172.21.15.103:0/2142349089 shutdown_connections 2024-09-10T22:46:23.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.956+0000 7fbf3be00640 1 -- 172.21.15.103:0/2142349089 wait complete. 2024-09-10T22:46:23.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.956+0000 7fbf3be00640 1 Processor -- start 2024-09-10T22:46:23.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3be00640 1 -- start start 2024-09-10T22:46:23.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf3c06dac0 0x7fbf3c1658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:23.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf3c0cebd0 0x7fbf3c153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:23.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf3c15b6d0 0x7fbf3c0b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:23.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3be00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c168810 con 0x7fbf3c06dac0 2024-09-10T22:46:23.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3be00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c168690 con 0x7fbf3c0cebd0 2024-09-10T22:46:23.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3be00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fbf3c168990 con 0x7fbf3c15b6d0 2024-09-10T22:46:23.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf3c06dac0 0x7fbf3c1658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:23.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf3c06dac0 0x7fbf3c1658a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40612/0 (socket says 172.21.15.103:40612) 2024-09-10T22:46:23.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3aa00640 1 -- 172.21.15.103:0/722461546 learned_addr learned my addr 172.21.15.103:0/722461546 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:23.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf33e00640 1 --2- 172.21.15.103:0/722461546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf3c0cebd0 0x7fbf3c153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:23.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3b400640 1 --2- 172.21.15.103:0/722461546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf3c15b6d0 0x7fbf3c0b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:23.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3aa00640 1 -- 172.21.15.103:0/722461546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf3c15b6d0 msgr2=0x7fbf3c0b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:23.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3aa00640 1 --2- 172.21.15.103:0/722461546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf3c15b6d0 0x7fbf3c0b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:23.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3aa00640 1 -- 172.21.15.103:0/722461546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf3c0cebd0 msgr2=0x7fbf3c153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:23.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3aa00640 1 --2- 172.21.15.103:0/722461546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf3c0cebd0 0x7fbf3c153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:23.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3aa00640 1 -- 172.21.15.103:0/722461546 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3c152e40 con 0x7fbf3c06dac0 2024-09-10T22:46:23.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3aa00640 1 --2- 172.21.15.103:0/722461546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf3c06dac0 0x7fbf3c1658a0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0058d0 tx=0x7fbf2c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:23.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf33400640 1 -- 172.21.15.103:0/722461546 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c017070 con 0x7fbf3c06dac0 2024-09-10T22:46:23.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf33400640 1 -- 172.21.15.103:0/722461546 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf2c009d20 con 0x7fbf3c06dac0 2024-09-10T22:46:23.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf33400640 1 -- 172.21.15.103:0/722461546 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c0106c0 con 0x7fbf3c06dac0 2024-09-10T22:46:23.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3be00640 1 -- 172.21.15.103:0/722461546 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf3c153120 con 0x7fbf3c06dac0 2024-09-10T22:46:23.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3be00640 1 -- 172.21.15.103:0/722461546 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf3c1536e0 con 0x7fbf3c06dac0 2024-09-10T22:46:23.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.960+0000 7fbf3be00640 1 -- 172.21.15.103:0/722461546 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf3c0ce690 con 0x7fbf3c06dac0 2024-09-10T22:46:23.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.964+0000 7fbf33400640 1 -- 172.21.15.103:0/722461546 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbf2c010860 con 0x7fbf3c06dac0 2024-09-10T22:46:23.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.964+0000 7fbf33400640 1 --2- 172.21.15.103:0/722461546 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbf180725e0 0x7fbf18074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:23.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.964+0000 7fbf33400640 1 -- 172.21.15.103:0/722461546 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7fbf2c093660 con 0x7fbf3c06dac0 2024-09-10T22:46:23.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.964+0000 7fbf33e00640 1 --2- 172.21.15.103:0/722461546 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbf180725e0 0x7fbf18074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:23.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.964+0000 7fbf33e00640 1 --2- 172.21.15.103:0/722461546 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbf180725e0 0x7fbf18074aa0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbf240af000 tx=0x7fbf2401b060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:23.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:23.968+0000 7fbf33400640 1 -- 172.21.15.103:0/722461546 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbf2c05edf0 con 0x7fbf3c06dac0 2024-09-10T22:46:24.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:24.188+0000 7fbf3be00640 1 -- 172.21.15.103:0/722461546 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]} v 0) -- 0x7fbf3c0addb0 con 0x7fbf3c06dac0 2024-09-10T22:46:24.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:24.440+0000 7fbf33400640 1 -- 172.21.15.103:0/722461546 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]}]=0 v391) ==== 165+0+0 (secure 0 0 0) 0x7fbf2c05e6f0 con 0x7fbf3c06dac0 2024-09-10T22:46:24.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:24.440+0000 7fbf3be00640 1 -- 172.21.15.103:0/722461546 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbf180725e0 msgr2=0x7fbf18074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:24.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:24.440+0000 7fbf3be00640 1 --2- 172.21.15.103:0/722461546 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbf180725e0 0x7fbf18074aa0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbf240af000 tx=0x7fbf2401b060 comp rx=0 tx=0).stop 2024-09-10T22:46:24.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:24.440+0000 7fbf3be00640 1 -- 172.21.15.103:0/722461546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf3c06dac0 msgr2=0x7fbf3c1658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:24.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:24.440+0000 7fbf3be00640 1 --2- 172.21.15.103:0/722461546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf3c06dac0 0x7fbf3c1658a0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0058d0 tx=0x7fbf2c00dde0 comp rx=0 tx=0).stop 2024-09-10T22:46:24.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:24.440+0000 7fbf3be00640 1 -- 172.21.15.103:0/722461546 shutdown_connections 2024-09-10T22:46:24.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:24.440+0000 7fbf3be00640 1 --2- 172.21.15.103:0/722461546 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbf180725e0 0x7fbf18074aa0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:24.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:24.440+0000 7fbf3be00640 1 --2- 172.21.15.103:0/722461546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf3c15b6d0 0x7fbf3c0b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:24.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:24.440+0000 7fbf3be00640 1 --2- 172.21.15.103:0/722461546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf3c0cebd0 0x7fbf3c153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:24.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:24.440+0000 7fbf3be00640 1 --2- 172.21.15.103:0/722461546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf3c06dac0 0x7fbf3c1658a0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:24.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:24.440+0000 7fbf3be00640 1 -- 172.21.15.103:0/722461546 >> 172.21.15.103:0/722461546 conn(0x7fbf3c0cff60 msgr2=0x7fbf3c15a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:24.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:24.444+0000 7fbf3be00640 1 -- 172.21.15.103:0/722461546 shutdown_connections 2024-09-10T22:46:24.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:24.444+0000 7fbf3be00640 1 -- 172.21.15.103:0/722461546 wait complete. 2024-09-10T22:46:24.463 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2024-09-10T22:46:24.464 INFO:tasks.cephfs_test_runner: 2024-09-10T22:46:24.464 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-10T22:46:24.464 INFO:tasks.cephfs_test_runner:Ran 6 tests in 415.653s 2024-09-10T22:46:24.464 INFO:tasks.cephfs_test_runner: 2024-09-10T22:46:24.464 INFO:tasks.cephfs_test_runner:OK 2024-09-10T22:46:24.464 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-10T22:46:24.474 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-10T22:46:24.487 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-10T22:46:24.487 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:46:24.487 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:46:24.496 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350248k,nr_inodes=4087562,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3542 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T22:46:24.496 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T22:46:24.496 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:46:24.546 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350248k,nr_inodes=4087562,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3542 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T22:46:24.546 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:46:24.546 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:46:24.556 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:46:24.556 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-10T22:46:24.556 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:46:24.608 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3111 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T22:46:24.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:46:24.608 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-09-10T22:46:24.660 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T22:46:24.660 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T22:46:24.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:46:24.661 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T22:46:24.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:46:24.729 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T22:46:25.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:46:25.138 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2024-09-10T22:46:25.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:46:25.310 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-10T22:46:25.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T22:46:25.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T22:46:25.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:46:25.321 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:46:25.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:46:25.386 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T22:46:25.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:46:25.841 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-09-10T22:46:26.002 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T22:46:26.011 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T22:46:26.011 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:46:26.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.584+0000 7f0d5ac00640 1 -- 172.21.15.103:0/3420752614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d540ad8f0 msgr2=0x7f0d5406d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:26.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.584+0000 7f0d5ac00640 1 --2- 172.21.15.103:0/3420752614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d540ad8f0 0x7f0d5406d8d0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009c80 tx=0x7f0d5406e620 comp rx=0 tx=0).stop 2024-09-10T22:46:26.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.584+0000 7f0d5ac00640 1 -- 172.21.15.103:0/3420752614 shutdown_connections 2024-09-10T22:46:26.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.584+0000 7f0d5ac00640 1 --2- 172.21.15.103:0/3420752614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d540ad8f0 0x7f0d5406d8d0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:26.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.584+0000 7f0d5ac00640 1 -- 172.21.15.103:0/3420752614 >> 172.21.15.103:0/3420752614 conn(0x7f0d540b1c00 msgr2=0x7f0d540b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:26.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.584+0000 7f0d5ac00640 1 -- 172.21.15.103:0/3420752614 shutdown_connections 2024-09-10T22:46:26.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.584+0000 7f0d5ac00640 1 -- 172.21.15.103:0/3420752614 wait complete. 2024-09-10T22:46:26.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d5ac00640 1 Processor -- start 2024-09-10T22:46:26.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d5ac00640 1 -- start start 2024-09-10T22:46:26.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d5ac00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d540ad8f0 0x7f0d540b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:26.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d5ac00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d540cd080 0x7f0d540ced10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:26.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d5ac00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d5415b9e0 0x7f0d540cf250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:26.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d5ac00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5416a080 con 0x7f0d5415b9e0 2024-09-10T22:46:26.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d5ac00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0d54169f00 con 0x7f0d540cd080 2024-09-10T22:46:26.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d5ac00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5416a200 con 0x7f0d540ad8f0 2024-09-10T22:46:26.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d58c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d5415b9e0 0x7f0d540cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:26.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d58c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d5415b9e0 0x7f0d540cf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40620/0 (socket says 172.21.15.103:40620) 2024-09-10T22:46:26.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d58c00640 1 -- 172.21.15.103:0/3857398115 learned_addr learned my addr 172.21.15.103:0/3857398115 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:26.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d4b400640 1 --2- 172.21.15.103:0/3857398115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d540cd080 0x7f0d540ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:26.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d53e00640 1 --2- 172.21.15.103:0/3857398115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d540ad8f0 0x7f0d540b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:26.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d58c00640 1 -- 172.21.15.103:0/3857398115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d540ad8f0 msgr2=0x7f0d540b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:26.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d58c00640 1 --2- 172.21.15.103:0/3857398115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d540ad8f0 0x7f0d540b14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:26.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d58c00640 1 -- 172.21.15.103:0/3857398115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d540cd080 msgr2=0x7f0d540ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:26.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d58c00640 1 --2- 172.21.15.103:0/3857398115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d540cd080 0x7f0d540ced10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:26.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d58c00640 1 -- 172.21.15.103:0/3857398115 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d54155b80 con 0x7f0d5415b9e0 2024-09-10T22:46:26.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d53e00640 1 --2- 172.21.15.103:0/3857398115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d540ad8f0 0x7f0d540b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:26.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d4b400640 1 --2- 172.21.15.103:0/3857398115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d540cd080 0x7f0d540ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:26.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d58c00640 1 --2- 172.21.15.103:0/3857398115 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d5415b9e0 0x7f0d540cf250 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009bd0 tx=0x7f0d4c0a5b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:26.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d50c00640 1 -- 172.21.15.103:0/3857398115 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0b2040 con 0x7f0d5415b9e0 2024-09-10T22:46:26.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d50c00640 1 -- 172.21.15.103:0/3857398115 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d4c004d40 con 0x7f0d5415b9e0 2024-09-10T22:46:26.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d5ac00640 1 -- 172.21.15.103:0/3857398115 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d54159230 con 0x7f0d5415b9e0 2024-09-10T22:46:26.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d50c00640 1 -- 172.21.15.103:0/3857398115 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c004320 con 0x7f0d5415b9e0 2024-09-10T22:46:26.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.588+0000 7f0d5ac00640 1 -- 172.21.15.103:0/3857398115 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d541597f0 con 0x7f0d5415b9e0 2024-09-10T22:46:26.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.592+0000 7f0d5ac00640 1 -- 172.21.15.103:0/3857398115 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d540cc970 con 0x7f0d5415b9e0 2024-09-10T22:46:26.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.592+0000 7f0d50c00640 1 -- 172.21.15.103:0/3857398115 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0d4c0b5070 con 0x7f0d5415b9e0 2024-09-10T22:46:26.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.592+0000 7f0d50c00640 1 --2- 172.21.15.103:0/3857398115 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0d300725e0 0x7f0d30074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:26.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.592+0000 7f0d50c00640 1 -- 172.21.15.103:0/3857398115 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7f0d4c12cfe0 con 0x7f0d5415b9e0 2024-09-10T22:46:26.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.592+0000 7f0d53e00640 1 --2- 172.21.15.103:0/3857398115 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0d300725e0 0x7f0d30074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:26.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.592+0000 7f0d53e00640 1 --2- 172.21.15.103:0/3857398115 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0d300725e0 0x7f0d30074aa0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400a850 tx=0x7f0d44008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:26.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.596+0000 7f0d50c00640 1 -- 172.21.15.103:0/3857398115 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0d4c016990 con 0x7f0d5415b9e0 2024-09-10T22:46:26.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.760+0000 7f0d5ac00640 1 -- 172.21.15.103:0/3857398115 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d54157220 con 0x7f0d300725e0 2024-09-10T22:46:26.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.760+0000 7f0d50c00640 1 -- 172.21.15.103:0/3857398115 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13498 (secure 0 0 0) 0x7f0d54157220 con 0x7f0d300725e0 2024-09-10T22:46:26.761 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:26.761 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:46:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.760+0000 7f0d5ac00640 1 -- 172.21.15.103:0/3857398115 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0d300725e0 msgr2=0x7f0d30074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.760+0000 7f0d5ac00640 1 --2- 172.21.15.103:0/3857398115 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0d300725e0 0x7f0d30074aa0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400a850 tx=0x7f0d44008040 comp rx=0 tx=0).stop 2024-09-10T22:46:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.760+0000 7f0d5ac00640 1 -- 172.21.15.103:0/3857398115 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d5415b9e0 msgr2=0x7f0d540cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.760+0000 7f0d5ac00640 1 --2- 172.21.15.103:0/3857398115 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d5415b9e0 0x7f0d540cf250 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009bd0 tx=0x7f0d4c0a5b80 comp rx=0 tx=0).stop 2024-09-10T22:46:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.760+0000 7f0d5ac00640 1 -- 172.21.15.103:0/3857398115 shutdown_connections 2024-09-10T22:46:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.760+0000 7f0d5ac00640 1 --2- 172.21.15.103:0/3857398115 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f0d300725e0 0x7f0d30074aa0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.760+0000 7f0d5ac00640 1 --2- 172.21.15.103:0/3857398115 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d5415b9e0 0x7f0d540cf250 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.760+0000 7f0d5ac00640 1 --2- 172.21.15.103:0/3857398115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d540cd080 0x7f0d540ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:26.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.760+0000 7f0d5ac00640 1 --2- 172.21.15.103:0/3857398115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0d540ad8f0 0x7f0d540b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:26.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.760+0000 7f0d5ac00640 1 -- 172.21.15.103:0/3857398115 >> 172.21.15.103:0/3857398115 conn(0x7f0d540b1c00 msgr2=0x7f0d540741b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:26.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.764+0000 7f0d5ac00640 1 -- 172.21.15.103:0/3857398115 shutdown_connections 2024-09-10T22:46:26.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.764+0000 7f0d5ac00640 1 -- 172.21.15.103:0/3857398115 wait complete. 2024-09-10T22:46:26.782 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-10T22:46:25.738187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":261252,"kb_used_data":11732,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713468,"statfs":{"total":773094113280,"available":772826591232,"internally_reserved":0,"allocated":12013568,"data_stored":6224930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-116327,"num_objects":-68,"num_object_clones":0,"num_object_copies":-136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-68,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-254,"num_write_kb":-199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001391"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":275,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-10T22:46:23.592201+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:46:23.592201+0000","last_peered":"2024-09-10T22:46:23.592201+0000","last_clean":"2024-09-10T22:46:23.592201+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:46:23.592201+0000","last_undegraded":"2024-09-10T22:46:23.592201+0000","last_fullsized":"2024-09-10T22:46:23.592201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509536,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33104,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338736,"statfs":{"total":96636764160,"available":96602865664,"internally_reserved":0,"allocated":1957888,"data_stored":1224594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32504,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1347584,"data_stored":628046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509537,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32508,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1347584,"data_stored":628046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509536,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32504,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1347584,"data_stored":628046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509536,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32524,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1363968,"data_stored":634226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32508,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1351680,"data_stored":635862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509536,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33104,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338736,"statfs":{"total":96636764160,"available":96602865664,"internally_reserved":0,"allocated":1957888,"data_stored":1224594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1339392,"data_stored":621516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:46:26.783 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:46:26.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.924+0000 7f9ba8400640 1 -- 172.21.15.103:0/3152853041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b88003a40 msgr2=0x7f9b88003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:26.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.924+0000 7f9ba8400640 1 --2- 172.21.15.103:0/3152853041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b88003a40 0x7f9b88003e60 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400c2e0 tx=0x7f9b9401cf30 comp rx=0 tx=0).stop 2024-09-10T22:46:26.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.924+0000 7f9ba6400640 1 -- 172.21.15.103:0/3152853041 reap_dead start 2024-09-10T22:46:26.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.924+0000 7f9ba8400640 1 -- 172.21.15.103:0/3152853041 shutdown_connections 2024-09-10T22:46:26.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.924+0000 7f9ba8400640 1 -- 172.21.15.103:0/3152853041 >> 172.21.15.103:0/3152853041 conn(0x7f9ba006cc00 msgr2=0x7f9ba006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:26.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.924+0000 7f9ba8400640 1 -- 172.21.15.103:0/3152853041 shutdown_connections 2024-09-10T22:46:26.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.924+0000 7f9ba8400640 1 -- 172.21.15.103:0/3152853041 wait complete. 2024-09-10T22:46:26.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.924+0000 7f9ba8400640 1 Processor -- start 2024-09-10T22:46:26.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.924+0000 7f9ba8400640 1 -- start start 2024-09-10T22:46:26.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.924+0000 7f9ba8400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b88003a40 0x7f9ba00adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:26.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.924+0000 7f9ba8400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ba01f7a70 0x7f9ba0154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:26.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.924+0000 7f9ba8400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ba01f7ef0 0x7f9ba0155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:26.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.924+0000 7f9ba8400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba0167bd0 con 0x7f9b88003a40 2024-09-10T22:46:26.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.924+0000 7f9ba8400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba0167a50 con 0x7f9ba01f7ef0 2024-09-10T22:46:26.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.924+0000 7f9ba8400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba0167d50 con 0x7f9ba01f7a70 2024-09-10T22:46:26.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.924+0000 7f9ba5a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b88003a40 0x7f9ba00adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:26.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.924+0000 7f9ba5a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b88003a40 0x7f9ba00adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43732/0 (socket says 172.21.15.103:43732) 2024-09-10T22:46:26.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.924+0000 7f9ba5a00640 1 -- 172.21.15.103:0/1265207293 learned_addr learned my addr 172.21.15.103:0/1265207293 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:26.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.928+0000 7f9ba5000640 1 --2- 172.21.15.103:0/1265207293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ba01f7a70 0x7f9ba0154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:26.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.928+0000 7f9ba6400640 1 --2- 172.21.15.103:0/1265207293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ba01f7ef0 0x7f9ba0155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:26.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.928+0000 7f9ba5a00640 1 -- 172.21.15.103:0/1265207293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ba01f7a70 msgr2=0x7f9ba0154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:26.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.928+0000 7f9ba5a00640 1 --2- 172.21.15.103:0/1265207293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ba01f7a70 0x7f9ba0154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:26.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.928+0000 7f9ba5a00640 1 -- 172.21.15.103:0/1265207293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ba01f7ef0 msgr2=0x7f9ba0155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:26.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.928+0000 7f9ba5a00640 1 --2- 172.21.15.103:0/1265207293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ba01f7ef0 0x7f9ba0155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:26.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.928+0000 7f9ba5a00640 1 -- 172.21.15.103:0/1265207293 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba01f84c0 con 0x7f9b88003a40 2024-09-10T22:46:26.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.928+0000 7f9ba5a00640 1 --2- 172.21.15.103:0/1265207293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b88003a40 0x7f9ba00adac0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f9b9401c9f0 tx=0x7f9b94006d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:26.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.928+0000 7f9b9d600640 1 -- 172.21.15.103:0/1265207293 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b940014c0 con 0x7f9b88003a40 2024-09-10T22:46:26.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.928+0000 7f9b9d600640 1 -- 172.21.15.103:0/1265207293 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b94001660 con 0x7f9b88003a40 2024-09-10T22:46:26.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.928+0000 7f9ba8400640 1 -- 172.21.15.103:0/1265207293 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba01f87a0 con 0x7f9b88003a40 2024-09-10T22:46:26.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.928+0000 7f9b9d600640 1 -- 172.21.15.103:0/1265207293 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b940064e0 con 0x7f9b88003a40 2024-09-10T22:46:26.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.928+0000 7f9ba8400640 1 -- 172.21.15.103:0/1265207293 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba01fb1b0 con 0x7f9b88003a40 2024-09-10T22:46:26.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.928+0000 7f9ba8400640 1 -- 172.21.15.103:0/1265207293 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba00b2870 con 0x7f9b88003a40 2024-09-10T22:46:26.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.928+0000 7f9b9d600640 1 -- 172.21.15.103:0/1265207293 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9b94003600 con 0x7f9b88003a40 2024-09-10T22:46:26.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.932+0000 7f9b9d600640 1 --2- 172.21.15.103:0/1265207293 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9b800725e0 0x7f9b80074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:26.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.932+0000 7f9b9d600640 1 -- 172.21.15.103:0/1265207293 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7f9b9412c860 con 0x7f9b88003a40 2024-09-10T22:46:26.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.932+0000 7f9ba5000640 1 --2- 172.21.15.103:0/1265207293 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9b800725e0 0x7f9b80074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:26.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.932+0000 7f9ba5000640 1 --2- 172.21.15.103:0/1265207293 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9b800725e0 0x7f9b80074aa0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9ba01f55d0 tx=0x7f9b8c0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:26.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:26.932+0000 7f9b9d600640 1 -- 172.21.15.103:0/1265207293 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9b94016d10 con 0x7f9b88003a40 2024-09-10T22:46:27.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.096+0000 7f9ba8400640 1 -- 172.21.15.103:0/1265207293 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9ba01f8970 con 0x7f9b800725e0 2024-09-10T22:46:27.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.096+0000 7f9b9d600640 1 -- 172.21.15.103:0/1265207293 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13498 (secure 0 0 0) 0x7f9ba01f8970 con 0x7f9b800725e0 2024-09-10T22:46:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:27.099 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:46:27.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.100+0000 7f9ba8400640 1 -- 172.21.15.103:0/1265207293 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9b800725e0 msgr2=0x7f9b80074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:27.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.100+0000 7f9ba8400640 1 --2- 172.21.15.103:0/1265207293 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9b800725e0 0x7f9b80074aa0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9ba01f55d0 tx=0x7f9b8c0091e0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.100+0000 7f9ba8400640 1 -- 172.21.15.103:0/1265207293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b88003a40 msgr2=0x7f9ba00adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:27.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.100+0000 7f9ba8400640 1 --2- 172.21.15.103:0/1265207293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b88003a40 0x7f9ba00adac0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f9b9401c9f0 tx=0x7f9b94006d70 comp rx=0 tx=0).stop 2024-09-10T22:46:27.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.100+0000 7f9ba8400640 1 -- 172.21.15.103:0/1265207293 shutdown_connections 2024-09-10T22:46:27.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.100+0000 7f9ba8400640 1 --2- 172.21.15.103:0/1265207293 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f9b800725e0 0x7f9b80074aa0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.100+0000 7f9ba8400640 1 --2- 172.21.15.103:0/1265207293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ba01f7ef0 0x7f9ba0155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.100+0000 7f9ba8400640 1 --2- 172.21.15.103:0/1265207293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ba01f7a70 0x7f9ba0154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.100+0000 7f9ba8400640 1 --2- 172.21.15.103:0/1265207293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b88003a40 0x7f9ba00adac0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.100+0000 7f9ba8400640 1 -- 172.21.15.103:0/1265207293 >> 172.21.15.103:0/1265207293 conn(0x7f9ba006cc00 msgr2=0x7f9ba01647f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:27.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.100+0000 7f9ba8400640 1 -- 172.21.15.103:0/1265207293 shutdown_connections 2024-09-10T22:46:27.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.100+0000 7f9ba8400640 1 -- 172.21.15.103:0/1265207293 wait complete. 2024-09-10T22:46:27.119 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-10T22:46:25.738187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":261252,"kb_used_data":11732,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713468,"statfs":{"total":773094113280,"available":772826591232,"internally_reserved":0,"allocated":12013568,"data_stored":6224930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-116327,"num_objects":-68,"num_object_clones":0,"num_object_copies":-136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-68,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-254,"num_write_kb":-199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001391"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":275,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-10T22:46:23.592201+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:46:23.592201+0000","last_peered":"2024-09-10T22:46:23.592201+0000","last_clean":"2024-09-10T22:46:23.592201+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:46:23.592201+0000","last_undegraded":"2024-09-10T22:46:23.592201+0000","last_fullsized":"2024-09-10T22:46:23.592201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509536,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33104,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338736,"statfs":{"total":96636764160,"available":96602865664,"internally_reserved":0,"allocated":1957888,"data_stored":1224594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32504,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1347584,"data_stored":628046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509537,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32508,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1347584,"data_stored":628046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509536,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32504,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1347584,"data_stored":628046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509536,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32524,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1363968,"data_stored":634226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32508,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1351680,"data_stored":635862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509536,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33104,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338736,"statfs":{"total":96636764160,"available":96602865664,"internally_reserved":0,"allocated":1957888,"data_stored":1224594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1339392,"data_stored":621516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:46:27.120 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T22:46:27.120 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:46:27.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.260+0000 7fa2b7800640 1 -- 172.21.15.103:0/525887234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2b00cfdd0 msgr2=0x7fa2b015eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:27.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.260+0000 7fa2b7800640 1 --2- 172.21.15.103:0/525887234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2b00cfdd0 0x7fa2b015eda0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fa298009900 tx=0x7fa29801c8e0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.260+0000 7fa2b7800640 1 -- 172.21.15.103:0/525887234 shutdown_connections 2024-09-10T22:46:27.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.260+0000 7fa2b7800640 1 --2- 172.21.15.103:0/525887234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2b00cfdd0 0x7fa2b015eda0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.260+0000 7fa2b7800640 1 -- 172.21.15.103:0/525887234 >> 172.21.15.103:0/525887234 conn(0x7fa2b006cc00 msgr2=0x7fa2b006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:27.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.260+0000 7fa2b7800640 1 -- 172.21.15.103:0/525887234 shutdown_connections 2024-09-10T22:46:27.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.260+0000 7fa2b7800640 1 -- 172.21.15.103:0/525887234 wait complete. 2024-09-10T22:46:27.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.260+0000 7fa2b7800640 1 Processor -- start 2024-09-10T22:46:27.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.260+0000 7fa2b7800640 1 -- start start 2024-09-10T22:46:27.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2b7800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b00cf9f0 0x7fa2b0149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2b7800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2b00cfdd0 0x7fa2b0157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2b7800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2b015f2e0 0x7fa2b0157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2b7800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b0169010 con 0x7fa2b00cfdd0 2024-09-10T22:46:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2b7800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b00cdba0 con 0x7fa2b00cf9f0 2024-09-10T22:46:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2b7800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa2b0169190 con 0x7fa2b015f2e0 2024-09-10T22:46:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2a7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2b00cfdd0 0x7fa2b0157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2a7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2b00cfdd0 0x7fa2b0157200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43740/0 (socket says 172.21.15.103:43740) 2024-09-10T22:46:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2a7e00640 1 -- 172.21.15.103:0/2825529612 learned_addr learned my addr 172.21.15.103:0/2825529612 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2b4e00640 1 --2- 172.21.15.103:0/2825529612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b00cf9f0 0x7fa2b0149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2b5800640 1 --2- 172.21.15.103:0/2825529612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2b015f2e0 0x7fa2b0157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2a7e00640 1 -- 172.21.15.103:0/2825529612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2b015f2e0 msgr2=0x7fa2b0157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2a7e00640 1 --2- 172.21.15.103:0/2825529612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2b015f2e0 0x7fa2b0157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2a7e00640 1 -- 172.21.15.103:0/2825529612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b00cf9f0 msgr2=0x7fa2b0149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:27.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2a7e00640 1 --2- 172.21.15.103:0/2825529612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b00cf9f0 0x7fa2b0149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2a7e00640 1 -- 172.21.15.103:0/2825529612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b014c030 con 0x7fa2b00cfdd0 2024-09-10T22:46:27.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2a7e00640 1 --2- 172.21.15.103:0/2825529612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2b00cfdd0 0x7fa2b0157200 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fa298009850 tx=0x7fa2980040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:27.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2ad600640 1 -- 172.21.15.103:0/2825529612 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2980b2040 con 0x7fa2b00cfdd0 2024-09-10T22:46:27.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2ad600640 1 -- 172.21.15.103:0/2825529612 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa298005030 con 0x7fa2b00cfdd0 2024-09-10T22:46:27.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2ad600640 1 -- 172.21.15.103:0/2825529612 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa298005460 con 0x7fa2b00cfdd0 2024-09-10T22:46:27.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2b7800640 1 -- 172.21.15.103:0/2825529612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b00b21b0 con 0x7fa2b00cfdd0 2024-09-10T22:46:27.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2b7800640 1 -- 172.21.15.103:0/2825529612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b00b0960 con 0x7fa2b00cfdd0 2024-09-10T22:46:27.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.264+0000 7fa2b7800640 1 -- 172.21.15.103:0/2825529612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2b015eda0 con 0x7fa2b00cfdd0 2024-09-10T22:46:27.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.268+0000 7fa2ad600640 1 -- 172.21.15.103:0/2825529612 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa2980046d0 con 0x7fa2b00cfdd0 2024-09-10T22:46:27.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.268+0000 7fa2ad600640 1 --2- 172.21.15.103:0/2825529612 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa28c072610 0x7fa28c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:27.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.268+0000 7fa2ad600640 1 -- 172.21.15.103:0/2825529612 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7fa29812ce80 con 0x7fa2b00cfdd0 2024-09-10T22:46:27.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.268+0000 7fa2b4e00640 1 --2- 172.21.15.103:0/2825529612 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa28c072610 0x7fa28c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:27.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.268+0000 7fa2b4e00640 1 --2- 172.21.15.103:0/2825529612 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa28c072610 0x7fa28c074ad0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0007fd0 tx=0x7fa2a0007e40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:27.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.272+0000 7fa2ad600640 1 -- 172.21.15.103:0/2825529612 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa2b014c030 con 0x7fa2b00cfdd0 2024-09-10T22:46:27.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.432+0000 7fa2b7800640 1 -- 172.21.15.103:0/2825529612 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa2b00b3600 con 0x7fa28c072610 2024-09-10T22:46:27.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.432+0000 7fa2ad600640 1 -- 172.21.15.103:0/2825529612 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13498 (secure 0 0 0) 0x7fa2b00b3600 con 0x7fa28c072610 2024-09-10T22:46:27.435 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:27.435 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:46:27.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.436+0000 7fa2b7800640 1 -- 172.21.15.103:0/2825529612 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa28c072610 msgr2=0x7fa28c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:27.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.436+0000 7fa2b7800640 1 --2- 172.21.15.103:0/2825529612 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa28c072610 0x7fa28c074ad0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0007fd0 tx=0x7fa2a0007e40 comp rx=0 tx=0).stop 2024-09-10T22:46:27.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.436+0000 7fa2b7800640 1 -- 172.21.15.103:0/2825529612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2b00cfdd0 msgr2=0x7fa2b0157200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:27.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.436+0000 7fa2b7800640 1 --2- 172.21.15.103:0/2825529612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2b00cfdd0 0x7fa2b0157200 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fa298009850 tx=0x7fa2980040c0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.436+0000 7fa2b7800640 1 -- 172.21.15.103:0/2825529612 shutdown_connections 2024-09-10T22:46:27.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.436+0000 7fa2b7800640 1 --2- 172.21.15.103:0/2825529612 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa28c072610 0x7fa28c074ad0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.436+0000 7fa2b7800640 1 --2- 172.21.15.103:0/2825529612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2b015f2e0 0x7fa2b0157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.436+0000 7fa2b7800640 1 --2- 172.21.15.103:0/2825529612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2b00cfdd0 0x7fa2b0157200 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.436+0000 7fa2b7800640 1 --2- 172.21.15.103:0/2825529612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b00cf9f0 0x7fa2b0149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.436+0000 7fa2b7800640 1 -- 172.21.15.103:0/2825529612 >> 172.21.15.103:0/2825529612 conn(0x7fa2b006cc00 msgr2=0x7fa2b01584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:27.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.436+0000 7fa2b7800640 1 -- 172.21.15.103:0/2825529612 shutdown_connections 2024-09-10T22:46:27.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.436+0000 7fa2b7800640 1 -- 172.21.15.103:0/2825529612 wait complete. 2024-09-10T22:46:27.457 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-10T22:46:25.738187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":261252,"kb_used_data":11732,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713468,"statfs":{"total":773094113280,"available":772826591232,"internally_reserved":0,"allocated":12013568,"data_stored":6224930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-116327,"num_objects":-68,"num_object_clones":0,"num_object_copies":-136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-68,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-254,"num_write_kb":-199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001391"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":275,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-10T22:46:23.592201+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:46:23.592201+0000","last_peered":"2024-09-10T22:46:23.592201+0000","last_clean":"2024-09-10T22:46:23.592201+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:46:23.592201+0000","last_undegraded":"2024-09-10T22:46:23.592201+0000","last_fullsized":"2024-09-10T22:46:23.592201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509536,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33104,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338736,"statfs":{"total":96636764160,"available":96602865664,"internally_reserved":0,"allocated":1957888,"data_stored":1224594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32504,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1347584,"data_stored":628046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509537,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32508,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1347584,"data_stored":628046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509536,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32504,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1347584,"data_stored":628046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509536,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32524,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1363968,"data_stored":634226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32508,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1351680,"data_stored":635862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509536,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33104,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338736,"statfs":{"total":96636764160,"available":96602865664,"internally_reserved":0,"allocated":1957888,"data_stored":1224594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1339392,"data_stored":621516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:46:27.458 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:46:27.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94f2600640 1 -- 172.21.15.103:0/1484242536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94ec161500 msgr2=0x7f94ec0ae810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:27.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94f2600640 1 --2- 172.21.15.103:0/1484242536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94ec161500 0x7f94ec0ae810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009bc0 tx=0x7f94dc01cba0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94f2600640 1 -- 172.21.15.103:0/1484242536 shutdown_connections 2024-09-10T22:46:27.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94f2600640 1 --2- 172.21.15.103:0/1484242536 >> v2:172.21.15.131:3300/0 conn(0x7f94ec0b2fb0 0x7f94ec0b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94f2600640 1 --2- 172.21.15.103:0/1484242536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94ec161500 0x7f94ec0ae810 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94f2600640 1 -- 172.21.15.103:0/1484242536 >> 172.21.15.103:0/1484242536 conn(0x7f94ec0d1ac0 msgr2=0x7f94ec0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:27.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94f2600640 1 -- 172.21.15.103:0/1484242536 shutdown_connections 2024-09-10T22:46:27.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94f2600640 1 -- 172.21.15.103:0/1484242536 wait complete. 2024-09-10T22:46:27.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94f2600640 1 Processor -- start 2024-09-10T22:46:27.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94f2600640 1 -- start start 2024-09-10T22:46:27.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94f2600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94ec0b27e0 0x7f94ec1fbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:27.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94f2600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94ec0b2fb0 0x7f94ec154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:27.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94f2600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94ec161500 0x7f94ec153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:27.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94f2600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec16b650 con 0x7f94ec0b2fb0 2024-09-10T22:46:27.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94f2600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec16b4d0 con 0x7f94ec0b27e0 2024-09-10T22:46:27.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94f2600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f94ec16b7d0 con 0x7f94ec161500 2024-09-10T22:46:27.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94e2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94ec0b2fb0 0x7f94ec154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:27.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94e2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94ec0b2fb0 0x7f94ec154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43750/0 (socket says 172.21.15.103:43750) 2024-09-10T22:46:27.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.600+0000 7f94e2a00640 1 -- 172.21.15.103:0/1781134333 learned_addr learned my addr 172.21.15.103:0/1781134333 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:27.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.604+0000 7f94eb400640 1 --2- 172.21.15.103:0/1781134333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94ec0b27e0 0x7f94ec1fbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:27.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.604+0000 7f94ebe00640 1 --2- 172.21.15.103:0/1781134333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94ec161500 0x7f94ec153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:27.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.604+0000 7f94e2a00640 1 -- 172.21.15.103:0/1781134333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94ec161500 msgr2=0x7f94ec153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:27.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.604+0000 7f94e2a00640 1 --2- 172.21.15.103:0/1781134333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94ec161500 0x7f94ec153e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.604+0000 7f94e2a00640 1 -- 172.21.15.103:0/1781134333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94ec0b27e0 msgr2=0x7f94ec1fbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:27.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.604+0000 7f94e2a00640 1 --2- 172.21.15.103:0/1781134333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94ec0b27e0 0x7f94ec1fbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.604+0000 7f94e2a00640 1 -- 172.21.15.103:0/1781134333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ec0b49b0 con 0x7f94ec0b2fb0 2024-09-10T22:46:27.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.604+0000 7f94e2a00640 1 --2- 172.21.15.103:0/1781134333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94ec0b2fb0 0x7f94ec154c30 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f94d400e9c0 tx=0x7f94d400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:27.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.604+0000 7f94e3e00640 1 -- 172.21.15.103:0/1781134333 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d400cd80 con 0x7f94ec0b2fb0 2024-09-10T22:46:27.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.604+0000 7f94e3e00640 1 -- 172.21.15.103:0/1781134333 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94d4004020 con 0x7f94ec0b2fb0 2024-09-10T22:46:27.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.604+0000 7f94f2600640 1 -- 172.21.15.103:0/1781134333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94ec155170 con 0x7f94ec0b2fb0 2024-09-10T22:46:27.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.604+0000 7f94e3e00640 1 -- 172.21.15.103:0/1781134333 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d4004450 con 0x7f94ec0b2fb0 2024-09-10T22:46:27.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.604+0000 7f94f2600640 1 -- 172.21.15.103:0/1781134333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94ec0b4f00 con 0x7f94ec0b2fb0 2024-09-10T22:46:27.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.604+0000 7f94f2600640 1 -- 172.21.15.103:0/1781134333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94ec160cc0 con 0x7f94ec0b2fb0 2024-09-10T22:46:27.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.604+0000 7f94e3e00640 1 -- 172.21.15.103:0/1781134333 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f94d4003600 con 0x7f94ec0b2fb0 2024-09-10T22:46:27.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.608+0000 7f94e3e00640 1 --2- 172.21.15.103:0/1781134333 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f94c80725e0 0x7f94c8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:27.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.608+0000 7f94e3e00640 1 -- 172.21.15.103:0/1781134333 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7f94d4093c10 con 0x7f94ec0b2fb0 2024-09-10T22:46:27.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.608+0000 7f94eb400640 1 --2- 172.21.15.103:0/1781134333 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f94c80725e0 0x7f94c8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:27.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.608+0000 7f94eb400640 1 --2- 172.21.15.103:0/1781134333 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f94c80725e0 0x7f94c8074aa0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0af000 tx=0x7f94dc01b3e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:27.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.608+0000 7f94e3e00640 1 -- 172.21.15.103:0/1781134333 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f94d405ecc0 con 0x7f94ec0b2fb0 2024-09-10T22:46:27.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.776+0000 7f94f2600640 1 -- 172.21.15.103:0/1781134333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94ec0b2280 con 0x7f94ec0b2fb0 2024-09-10T22:46:27.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.776+0000 7f94e3e00640 1 -- 172.21.15.103:0/1781134333 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) ==== 74+0+13641 (secure 0 0 0) 0x7f94d40636f0 con 0x7f94ec0b2fb0 2024-09-10T22:46:27.779 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:27.779 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":110,"fsid":"fb22394a-7771-44f4-99d8-bddd262146a5","created":"2024-09-10T22:38:24.293182+0000","modified":"2024-09-10T22:46:23.431006+0000","last_up_change":"2024-09-10T22:38:38.575213+0000","last_in_change":"2024-09-10T22:38:27.956330+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:38:39.639064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce30f7bb-8593-4a94-bad7-0a8db358cac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6809","nonce":2662233365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6811","nonce":2662233365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6815","nonce":2662233365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2662233365},{"type":"v1","addr":"172.21.15.103:6813","nonce":2662233365}]},"public_addr":"172.21.15.103:6809/2662233365","cluster_addr":"172.21.15.103:6811/2662233365","heartbeat_back_addr":"172.21.15.103:6815/2662233365","heartbeat_front_addr":"172.21.15.103:6813/2662233365","state":["exists","up"]},{"osd":1,"uuid":"f357d2a3-0c7f-4148-90c5-eda524593f42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6801","nonce":4140822734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6803","nonce":4140822734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6807","nonce":4140822734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":4140822734},{"type":"v1","addr":"172.21.15.103:6805","nonce":4140822734}]},"public_addr":"172.21.15.103:6801/4140822734","cluster_addr":"172.21.15.103:6803/4140822734","heartbeat_back_addr":"172.21.15.103:6807/4140822734","heartbeat_front_addr":"172.21.15.103:6805/4140822734","state":["exists","up"]},{"osd":2,"uuid":"96b59070-0658-4edc-9d9d-f7beca957744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6817","nonce":3190036446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6819","nonce":3190036446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6823","nonce":3190036446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3190036446},{"type":"v1","addr":"172.21.15.103:6821","nonce":3190036446}]},"public_addr":"172.21.15.103:6817/3190036446","cluster_addr":"172.21.15.103:6819/3190036446","heartbeat_back_addr":"172.21.15.103:6823/3190036446","heartbeat_front_addr":"172.21.15.103:6821/3190036446","state":["exists","up"]},{"osd":3,"uuid":"293f6bbb-b099-4dac-939d-31d6cff71be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6825","nonce":3403069661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6827","nonce":3403069661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6831","nonce":3403069661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3403069661},{"type":"v1","addr":"172.21.15.103:6829","nonce":3403069661}]},"public_addr":"172.21.15.103:6825/3403069661","cluster_addr":"172.21.15.103:6827/3403069661","heartbeat_back_addr":"172.21.15.103:6831/3403069661","heartbeat_front_addr":"172.21.15.103:6829/3403069661","state":["exists","up"]},{"osd":4,"uuid":"f7fc4e89-2d18-40a3-9459-7d945f43d76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6811","nonce":2178799193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6813","nonce":2178799193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6817","nonce":2178799193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2178799193},{"type":"v1","addr":"172.21.15.131:6815","nonce":2178799193}]},"public_addr":"172.21.15.131:6811/2178799193","cluster_addr":"172.21.15.131:6813/2178799193","heartbeat_back_addr":"172.21.15.131:6817/2178799193","heartbeat_front_addr":"172.21.15.131:6815/2178799193","state":["exists","up"]},{"osd":5,"uuid":"f816f067-f546-49df-b936-c86b9dba2bf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6801","nonce":175724775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6803","nonce":175724775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6807","nonce":175724775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":175724775},{"type":"v1","addr":"172.21.15.131:6805","nonce":175724775}]},"public_addr":"172.21.15.131:6801/175724775","cluster_addr":"172.21.15.131:6803/175724775","heartbeat_back_addr":"172.21.15.131:6807/175724775","heartbeat_front_addr":"172.21.15.131:6805/175724775","state":["exists","up"]},{"osd":6,"uuid":"8086074e-005d-4d1c-ab5a-44065fbcf5a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6819","nonce":3165743337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6821","nonce":3165743337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6825","nonce":3165743337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3165743337},{"type":"v1","addr":"172.21.15.131:6823","nonce":3165743337}]},"public_addr":"172.21.15.131:6819/3165743337","cluster_addr":"172.21.15.131:6821/3165743337","heartbeat_back_addr":"172.21.15.131:6825/3165743337","heartbeat_front_addr":"172.21.15.131:6823/3165743337","state":["exists","up"]},{"osd":7,"uuid":"46616502-72f3-447a-bb60-8f7b936e58ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6827","nonce":1279722082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6829","nonce":1279722082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6833","nonce":1279722082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1279722082},{"type":"v1","addr":"172.21.15.131:6831","nonce":1279722082}]},"public_addr":"172.21.15.131:6827/1279722082","cluster_addr":"172.21.15.131:6829/1279722082","heartbeat_back_addr":"172.21.15.131:6833/1279722082","heartbeat_front_addr":"172.21.15.131:6831/1279722082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.469318+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.790244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.881467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.249493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.192214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:34.971516+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.036950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:38:35.652432+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6833/1191295180":"2024-09-11T22:46:20.419785+0000","172.21.15.103:6835/3550082240":"2024-09-11T22:46:20.419789+0000","172.21.15.103:6834/3550082240":"2024-09-11T22:46:20.419789+0000","172.21.15.131:6837/1281268106":"2024-09-11T22:46:20.419771+0000","172.21.15.103:6832/1191295180":"2024-09-11T22:46:20.419785+0000","172.21.15.131:6835/1281268106":"2024-09-11T22:46:20.419771+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:46:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.780+0000 7f94f2600640 1 -- 172.21.15.103:0/1781134333 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f94c80725e0 msgr2=0x7f94c8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.780+0000 7f94f2600640 1 --2- 172.21.15.103:0/1781134333 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f94c80725e0 0x7f94c8074aa0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0af000 tx=0x7f94dc01b3e0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.780+0000 7f94f2600640 1 -- 172.21.15.103:0/1781134333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94ec0b2fb0 msgr2=0x7f94ec154c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.780+0000 7f94f2600640 1 --2- 172.21.15.103:0/1781134333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94ec0b2fb0 0x7f94ec154c30 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f94d400e9c0 tx=0x7f94d400ee80 comp rx=0 tx=0).stop 2024-09-10T22:46:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.780+0000 7f94f2600640 1 -- 172.21.15.103:0/1781134333 shutdown_connections 2024-09-10T22:46:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.780+0000 7f94f2600640 1 --2- 172.21.15.103:0/1781134333 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f94c80725e0 0x7f94c8074aa0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.780+0000 7f94f2600640 1 --2- 172.21.15.103:0/1781134333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94ec161500 0x7f94ec153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.780+0000 7f94f2600640 1 --2- 172.21.15.103:0/1781134333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94ec0b2fb0 0x7f94ec154c30 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.780+0000 7f94f2600640 1 --2- 172.21.15.103:0/1781134333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94ec0b27e0 0x7f94ec1fbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:27.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.780+0000 7f94f2600640 1 -- 172.21.15.103:0/1781134333 >> 172.21.15.103:0/1781134333 conn(0x7f94ec0d1ac0 msgr2=0x7f94ec0b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:27.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.780+0000 7f94f2600640 1 -- 172.21.15.103:0/1781134333 shutdown_connections 2024-09-10T22:46:27.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:27.780+0000 7f94f2600640 1 -- 172.21.15.103:0/1781134333 wait complete. 2024-09-10T22:46:28.801 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T22:46:28.802 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T22:46:28.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.956+0000 7fae17400640 1 -- 172.21.15.103:0/1669207179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae1006e1d0 msgr2=0x7fae100cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:28.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.956+0000 7fae17400640 1 --2- 172.21.15.103:0/1669207179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae1006e1d0 0x7fae100cceb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fae08009bc0 tx=0x7fae0801cba0 comp rx=0 tx=0).stop 2024-09-10T22:46:28.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.956+0000 7fae17400640 1 -- 172.21.15.103:0/1669207179 shutdown_connections 2024-09-10T22:46:28.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.956+0000 7fae17400640 1 --2- 172.21.15.103:0/1669207179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae1006e1d0 0x7fae100cceb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:28.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.956+0000 7fae17400640 1 --2- 172.21.15.103:0/1669207179 >> v2:172.21.15.131:3300/0 conn(0x7fae1015b9e0 0x7fae100cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:28.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.956+0000 7fae17400640 1 -- 172.21.15.103:0/1669207179 >> 172.21.15.103:0/1669207179 conn(0x7fae100b1c00 msgr2=0x7fae100b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:28.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.956+0000 7fae17400640 1 -- 172.21.15.103:0/1669207179 shutdown_connections 2024-09-10T22:46:28.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.956+0000 7fae17400640 1 -- 172.21.15.103:0/1669207179 wait complete. 2024-09-10T22:46:28.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae17400640 1 Processor -- start 2024-09-10T22:46:28.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae17400640 1 -- start start 2024-09-10T22:46:28.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae17400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae1006e1d0 0x7fae10156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:28.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae17400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae100ad8f0 0x7fae100c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:28.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae17400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae1015b9e0 0x7fae1015a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:28.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae17400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae10168e50 con 0x7fae1015b9e0 2024-09-10T22:46:28.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae17400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fae10168cd0 con 0x7fae100ad8f0 2024-09-10T22:46:28.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae17400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fae10168fd0 con 0x7fae1006e1d0 2024-09-10T22:46:28.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae15400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae1015b9e0 0x7fae1015a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:28.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae15400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae1015b9e0 0x7fae1015a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43762/0 (socket says 172.21.15.103:43762) 2024-09-10T22:46:28.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae15400640 1 -- 172.21.15.103:0/2355183695 learned_addr learned my addr 172.21.15.103:0/2355183695 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:28.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae07e00640 1 --2- 172.21.15.103:0/2355183695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae100ad8f0 0x7fae100c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:28.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae14a00640 1 --2- 172.21.15.103:0/2355183695 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae1006e1d0 0x7fae10156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:28.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae15400640 1 -- 172.21.15.103:0/2355183695 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae1006e1d0 msgr2=0x7fae10156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:28.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae15400640 1 --2- 172.21.15.103:0/2355183695 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae1006e1d0 0x7fae10156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:28.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae15400640 1 -- 172.21.15.103:0/2355183695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae100ad8f0 msgr2=0x7fae100c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:28.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae15400640 1 --2- 172.21.15.103:0/2355183695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae100ad8f0 0x7fae100c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:28.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae15400640 1 -- 172.21.15.103:0/2355183695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae10159530 con 0x7fae1015b9e0 2024-09-10T22:46:28.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae15400640 1 --2- 172.21.15.103:0/2355183695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae1015b9e0 0x7fae1015a5d0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fae0801c610 tx=0x7fae08005a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:28.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae0d600640 1 -- 172.21.15.103:0/2355183695 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae080b2040 con 0x7fae1015b9e0 2024-09-10T22:46:28.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae17400640 1 -- 172.21.15.103:0/2355183695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae10159810 con 0x7fae1015b9e0 2024-09-10T22:46:28.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae0d600640 1 -- 172.21.15.103:0/2355183695 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae080bb070 con 0x7fae1015b9e0 2024-09-10T22:46:28.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae0d600640 1 -- 172.21.15.103:0/2355183695 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08004390 con 0x7fae1015b9e0 2024-09-10T22:46:28.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae17400640 1 -- 172.21.15.103:0/2355183695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae10159dd0 con 0x7fae1015b9e0 2024-09-10T22:46:28.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.960+0000 7fae17400640 1 -- 172.21.15.103:0/2355183695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae1015f470 con 0x7fae1015b9e0 2024-09-10T22:46:28.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.964+0000 7fae0d600640 1 -- 172.21.15.103:0/2355183695 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fae080b5070 con 0x7fae1015b9e0 2024-09-10T22:46:28.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.964+0000 7fae0d600640 1 --2- 172.21.15.103:0/2355183695 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fadec0725e0 0x7fadec074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:28.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.964+0000 7fae0d600640 1 -- 172.21.15.103:0/2355183695 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7fae0812e190 con 0x7fae1015b9e0 2024-09-10T22:46:28.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.964+0000 7fae0d600640 1 --2- 172.21.15.103:0/2355183695 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x7fadec078bc0 0x7fadec07b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:28.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.964+0000 7fae0d600640 1 -- 172.21.15.103:0/2355183695 --> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae080020c0 con 0x7fadec078bc0 2024-09-10T22:46:28.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.964+0000 7fae0d600640 1 -- 172.21.15.103:0/2355183695 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7fae0812e580 con 0x7fae1015b9e0 2024-09-10T22:46:28.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.964+0000 7fae14a00640 1 --2- 172.21.15.103:0/2355183695 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fadec0725e0 0x7fadec074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:28.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.964+0000 7fae07e00640 1 --2- 172.21.15.103:0/2355183695 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x7fadec078bc0 0x7fadec07b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:28.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.964+0000 7fae07e00640 1 --2- 172.21.15.103:0/2355183695 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x7fadec078bc0 0x7fadec07b000 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:28.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.964+0000 7fae14a00640 1 --2- 172.21.15.103:0/2355183695 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fadec0725e0 0x7fadec074aa0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fae00009600 tx=0x7fae000091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:28.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.964+0000 7fae0d600640 1 -- 172.21.15.103:0/2355183695 <== osd.0 v2:172.21.15.103:6808/2662233365 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fae080020c0 con 0x7fadec078bc0 2024-09-10T22:46:28.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.980+0000 7fae17400640 1 -- 172.21.15.103:0/2355183695 --> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fae100cc270 con 0x7fadec078bc0 2024-09-10T22:46:28.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.980+0000 7fae0d600640 1 -- 172.21.15.103:0/2355183695 <== osd.0 v2:172.21.15.103:6808/2662233365 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fae100cc270 con 0x7fadec078bc0 2024-09-10T22:46:28.980 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:28.980 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T22:46:28.980 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:28.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.980+0000 7fae17400640 1 -- 172.21.15.103:0/2355183695 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x7fadec078bc0 msgr2=0x7fadec07b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:28.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.980+0000 7fae17400640 1 --2- 172.21.15.103:0/2355183695 >> [v2:172.21.15.103:6808/2662233365,v1:172.21.15.103:6809/2662233365] conn(0x7fadec078bc0 0x7fadec07b000 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:28.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.980+0000 7fae17400640 1 -- 172.21.15.103:0/2355183695 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fadec0725e0 msgr2=0x7fadec074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:28.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.980+0000 7fae17400640 1 --2- 172.21.15.103:0/2355183695 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fadec0725e0 0x7fadec074aa0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fae00009600 tx=0x7fae000091e0 comp rx=0 tx=0).stop 2024-09-10T22:46:28.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.980+0000 7fae17400640 1 -- 172.21.15.103:0/2355183695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae1015b9e0 msgr2=0x7fae1015a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:28.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.980+0000 7fae17400640 1 --2- 172.21.15.103:0/2355183695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae1015b9e0 0x7fae1015a5d0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fae0801c610 tx=0x7fae08005a80 comp rx=0 tx=0).stop 2024-09-10T22:46:28.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.980+0000 7fae15400640 1 -- 172.21.15.103:0/2355183695 reap_dead start 2024-09-10T22:46:28.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.980+0000 7fae17400640 1 -- 172.21.15.103:0/2355183695 shutdown_connections 2024-09-10T22:46:28.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.980+0000 7fae17400640 1 -- 172.21.15.103:0/2355183695 >> 172.21.15.103:0/2355183695 conn(0x7fae100b1c00 msgr2=0x7fae100cb730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:28.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.980+0000 7fae17400640 1 -- 172.21.15.103:0/2355183695 shutdown_connections 2024-09-10T22:46:28.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:28.980+0000 7fae17400640 1 -- 172.21.15.103:0/2355183695 wait complete. 2024-09-10T22:46:28.998 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T22:46:29.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.140+0000 7f18c6600640 1 -- 172.21.15.103:0/485369373 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18c00afc80 msgr2=0x7f18c00d1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:29.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.140+0000 7f18c6600640 1 --2- 172.21.15.103:0/485369373 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18c00afc80 0x7f18c00d1460 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009840 tx=0x7f18a801c820 comp rx=0 tx=0).stop 2024-09-10T22:46:29.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.140+0000 7f18c6600640 1 -- 172.21.15.103:0/485369373 shutdown_connections 2024-09-10T22:46:29.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.140+0000 7f18c6600640 1 --2- 172.21.15.103:0/485369373 >> v2:172.21.15.131:3300/0 conn(0x7f18c006cc00 0x7f18c006d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.140+0000 7f18c6600640 1 --2- 172.21.15.103:0/485369373 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18c00afc80 0x7f18c00d1460 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.140+0000 7f18c6600640 1 -- 172.21.15.103:0/485369373 >> 172.21.15.103:0/485369373 conn(0x7f18c00d0940 msgr2=0x7f18c00d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:29.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.140+0000 7f18c6600640 1 -- 172.21.15.103:0/485369373 shutdown_connections 2024-09-10T22:46:29.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.140+0000 7f18c6600640 1 -- 172.21.15.103:0/485369373 wait complete. 2024-09-10T22:46:29.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18c6600640 1 Processor -- start 2024-09-10T22:46:29.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18c6600640 1 -- start start 2024-09-10T22:46:29.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18c6600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18c006cc00 0x7f18c0149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:29.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18c6600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18c00afc80 0x7f18c01508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:29.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18c6600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18c015de00 0x7f18c0158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:29.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18c6600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f18c016b850 con 0x7f18c015de00 2024-09-10T22:46:29.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18c6600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f18c016b6d0 con 0x7f18c00afc80 2024-09-10T22:46:29.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18c6600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f18c016b9d0 con 0x7f18c006cc00 2024-09-10T22:46:29.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18bfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18c015de00 0x7f18c0158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:29.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18bfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18c015de00 0x7f18c0158ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43764/0 (socket says 172.21.15.103:43764) 2024-09-10T22:46:29.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18bfe00640 1 -- 172.21.15.103:0/4060444371 learned_addr learned my addr 172.21.15.103:0/4060444371 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:29.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18bf400640 1 --2- 172.21.15.103:0/4060444371 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18c006cc00 0x7f18c0149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:29.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18b6a00640 1 --2- 172.21.15.103:0/4060444371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18c00afc80 0x7f18c01508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:29.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18bfe00640 1 -- 172.21.15.103:0/4060444371 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18c006cc00 msgr2=0x7f18c0149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:29.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18bfe00640 1 --2- 172.21.15.103:0/4060444371 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18c006cc00 0x7f18c0149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18bfe00640 1 -- 172.21.15.103:0/4060444371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18c00afc80 msgr2=0x7f18c01508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:29.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18bfe00640 1 --2- 172.21.15.103:0/4060444371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18c00afc80 0x7f18c01508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18bfe00640 1 -- 172.21.15.103:0/4060444371 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c014f470 con 0x7f18c015de00 2024-09-10T22:46:29.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18bfe00640 1 --2- 172.21.15.103:0/4060444371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18c015de00 0x7f18c0158ed0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f18b800eb20 tx=0x7f18b800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:29.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18b7e00640 1 -- 172.21.15.103:0/4060444371 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b8004b30 con 0x7f18c015de00 2024-09-10T22:46:29.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18b7e00640 1 -- 172.21.15.103:0/4060444371 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18b8004cf0 con 0x7f18c015de00 2024-09-10T22:46:29.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18b7e00640 1 -- 172.21.15.103:0/4060444371 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b8005280 con 0x7f18c015de00 2024-09-10T22:46:29.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18c6600640 1 -- 172.21.15.103:0/4060444371 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c014f750 con 0x7f18c015de00 2024-09-10T22:46:29.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.144+0000 7f18c6600640 1 -- 172.21.15.103:0/4060444371 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c014fd10 con 0x7f18c015de00 2024-09-10T22:46:29.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.148+0000 7f18c6600640 1 -- 172.21.15.103:0/4060444371 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c006d090 con 0x7f18c015de00 2024-09-10T22:46:29.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.148+0000 7f18b7e00640 1 -- 172.21.15.103:0/4060444371 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f18b8005420 con 0x7f18c015de00 2024-09-10T22:46:29.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.148+0000 7f18b7e00640 1 --2- 172.21.15.103:0/4060444371 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f189c0725e0 0x7f189c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:29.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.148+0000 7f18b7e00640 1 -- 172.21.15.103:0/4060444371 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7f18b8093dd0 con 0x7f18c015de00 2024-09-10T22:46:29.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.148+0000 7f18bf400640 1 --2- 172.21.15.103:0/4060444371 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f189c0725e0 0x7f189c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:29.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.148+0000 7f18bf400640 1 --2- 172.21.15.103:0/4060444371 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f189c0725e0 0x7f189c074aa0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f18b0007fd0 tx=0x7f18b0007ea0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:29.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.152+0000 7f18b7e00640 1 -- 172.21.15.103:0/4060444371 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f18b805ef20 con 0x7f18c015de00 2024-09-10T22:46:29.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.320+0000 7f18c6600640 1 -- 172.21.15.103:0/4060444371 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f18c014a4e0 con 0x7f189c0725e0 2024-09-10T22:46:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.320+0000 7f18b7e00640 1 -- 172.21.15.103:0/4060444371 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f18c014a4e0 con 0x7f189c0725e0 2024-09-10T22:46:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T22:46:29.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.320+0000 7f18c6600640 1 -- 172.21.15.103:0/4060444371 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f189c0725e0 msgr2=0x7f189c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:29.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.320+0000 7f18c6600640 1 --2- 172.21.15.103:0/4060444371 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f189c0725e0 0x7f189c074aa0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f18b0007fd0 tx=0x7f18b0007ea0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.320+0000 7f18c6600640 1 -- 172.21.15.103:0/4060444371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18c015de00 msgr2=0x7f18c0158ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:29.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.320+0000 7f18c6600640 1 --2- 172.21.15.103:0/4060444371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18c015de00 0x7f18c0158ed0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f18b800eb20 tx=0x7f18b800c2d0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.324+0000 7f18c6600640 1 -- 172.21.15.103:0/4060444371 shutdown_connections 2024-09-10T22:46:29.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.324+0000 7f18c6600640 1 --2- 172.21.15.103:0/4060444371 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f189c0725e0 0x7f189c074aa0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.324+0000 7f18c6600640 1 --2- 172.21.15.103:0/4060444371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18c015de00 0x7f18c0158ed0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.324+0000 7f18c6600640 1 --2- 172.21.15.103:0/4060444371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18c00afc80 0x7f18c01508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.324+0000 7f18c6600640 1 --2- 172.21.15.103:0/4060444371 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18c006cc00 0x7f18c0149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.324+0000 7f18c6600640 1 -- 172.21.15.103:0/4060444371 >> 172.21.15.103:0/4060444371 conn(0x7f18c00d0940 msgr2=0x7f18c00d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.324+0000 7f18c6600640 1 -- 172.21.15.103:0/4060444371 shutdown_connections 2024-09-10T22:46:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.324+0000 7f18c6600640 1 -- 172.21.15.103:0/4060444371 wait complete. 2024-09-10T22:46:29.342 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T22:46:29.342 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T22:46:29.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.488+0000 7fbfb7e00640 1 -- 172.21.15.103:0/1117622913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfb015f2e0 msgr2=0x7fbfb015f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:29.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.488+0000 7fbfb7e00640 1 --2- 172.21.15.103:0/1117622913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfb015f2e0 0x7fbfb015f6f0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0072490 tx=0x7fbfa801cd80 comp rx=0 tx=0).stop 2024-09-10T22:46:29.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.488+0000 7fbfb7e00640 1 -- 172.21.15.103:0/1117622913 shutdown_connections 2024-09-10T22:46:29.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.488+0000 7fbfb7e00640 1 --2- 172.21.15.103:0/1117622913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfb015f2e0 0x7fbfb015f6f0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.488+0000 7fbfb7e00640 1 --2- 172.21.15.103:0/1117622913 >> v2:172.21.15.131:3300/0 conn(0x7fbfb00cfdd0 0x7fbfb015eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.488+0000 7fbfb7e00640 1 -- 172.21.15.103:0/1117622913 >> 172.21.15.103:0/1117622913 conn(0x7fbfb006cc00 msgr2=0x7fbfb006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:29.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.488+0000 7fbfb7e00640 1 -- 172.21.15.103:0/1117622913 shutdown_connections 2024-09-10T22:46:29.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.488+0000 7fbfb7e00640 1 -- 172.21.15.103:0/1117622913 wait complete. 2024-09-10T22:46:29.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.488+0000 7fbfb7e00640 1 Processor -- start 2024-09-10T22:46:29.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.488+0000 7fbfb7e00640 1 -- start start 2024-09-10T22:46:29.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfb7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfb00cf9f0 0x7fbfb0150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:29.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfb7e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbfb00cfdd0 0x7fbfb00affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:29.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfb7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfb015f2e0 0x7fbfb00b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:29.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfb7e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb00cd690 con 0x7fbfb015f2e0 2024-09-10T22:46:29.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfb7e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb00cd510 con 0x7fbfb00cf9f0 2024-09-10T22:46:29.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfb7e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb00cd810 con 0x7fbfb00cfdd0 2024-09-10T22:46:29.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfb5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfb015f2e0 0x7fbfb00b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:29.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfb5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfb015f2e0 0x7fbfb00b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43782/0 (socket says 172.21.15.103:43782) 2024-09-10T22:46:29.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfb5e00640 1 -- 172.21.15.103:0/3107510641 learned_addr learned my addr 172.21.15.103:0/3107510641 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:29.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfb5e00640 1 -- 172.21.15.103:0/3107510641 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbfb00cfdd0 msgr2=0x7fbfb00affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:29.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfb5e00640 1 --2- 172.21.15.103:0/3107510641 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbfb00cfdd0 0x7fbfb00affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfb5e00640 1 -- 172.21.15.103:0/3107510641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfb00cf9f0 msgr2=0x7fbfb0150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:29.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfb5e00640 1 --2- 172.21.15.103:0/3107510641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbfb00cf9f0 0x7fbfb0150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfb5e00640 1 -- 172.21.15.103:0/3107510641 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb015b400 con 0x7fbfb015f2e0 2024-09-10T22:46:29.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfb5e00640 1 --2- 172.21.15.103:0/3107510641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfb015f2e0 0x7fbfb00b0510 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009bd0 tx=0x7fbfa8003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:29.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfad600640 1 -- 172.21.15.103:0/3107510641 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80bc070 con 0x7fbfb015f2e0 2024-09-10T22:46:29.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfad600640 1 -- 172.21.15.103:0/3107510641 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfa80042f0 con 0x7fbfb015f2e0 2024-09-10T22:46:29.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfb7e00640 1 -- 172.21.15.103:0/3107510641 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb015b6e0 con 0x7fbfb015f2e0 2024-09-10T22:46:29.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfad600640 1 -- 172.21.15.103:0/3107510641 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80b2040 con 0x7fbfb015f2e0 2024-09-10T22:46:29.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfb7e00640 1 -- 172.21.15.103:0/3107510641 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb015bca0 con 0x7fbfb015f2e0 2024-09-10T22:46:29.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfb7e00640 1 -- 172.21.15.103:0/3107510641 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbfb015b1b0 con 0x7fbfb015f2e0 2024-09-10T22:46:29.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.492+0000 7fbfad600640 1 -- 172.21.15.103:0/3107510641 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbfa80b5070 con 0x7fbfb015f2e0 2024-09-10T22:46:29.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.496+0000 7fbfad600640 1 --2- 172.21.15.103:0/3107510641 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbf90072610 0x7fbf90074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:29.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.496+0000 7fbfad600640 1 -- 172.21.15.103:0/3107510641 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7fbfa812ce80 con 0x7fbfb015f2e0 2024-09-10T22:46:29.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.496+0000 7fbfad600640 1 --2- 172.21.15.103:0/3107510641 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x7fbf90078bf0 0x7fbf9007b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:29.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.496+0000 7fbfad600640 1 -- 172.21.15.103:0/3107510641 --> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbfa80c3e50 con 0x7fbf90078bf0 2024-09-10T22:46:29.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.496+0000 7fbfb5400640 1 --2- 172.21.15.103:0/3107510641 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbf90072610 0x7fbf90074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:29.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.496+0000 7fbfad600640 1 -- 172.21.15.103:0/3107510641 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7fbfa812f4a0 con 0x7fbfb015f2e0 2024-09-10T22:46:29.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.496+0000 7fbfb4a00640 1 --2- 172.21.15.103:0/3107510641 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x7fbf90078bf0 0x7fbf9007b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:29.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.496+0000 7fbfb4a00640 1 --2- 172.21.15.103:0/3107510641 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x7fbf90078bf0 0x7fbf9007b030 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:29.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.496+0000 7fbfb5400640 1 --2- 172.21.15.103:0/3107510641 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbf90072610 0x7fbf90074ad0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4007fd0 tx=0x7fbfa40079a0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:29.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.496+0000 7fbfad600640 1 -- 172.21.15.103:0/3107510641 <== osd.1 v2:172.21.15.103:6800/4140822734 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbfa80c3e50 con 0x7fbf90078bf0 2024-09-10T22:46:29.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.508+0000 7fbfb7e00640 1 -- 172.21.15.103:0/3107510641 --> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbfb015bee0 con 0x7fbf90078bf0 2024-09-10T22:46:29.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.508+0000 7fbfad600640 1 -- 172.21.15.103:0/3107510641 <== osd.1 v2:172.21.15.103:6800/4140822734 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbfb015bee0 con 0x7fbf90078bf0 2024-09-10T22:46:29.510 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:29.510 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T22:46:29.510 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:29.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.508+0000 7fbfb7e00640 1 -- 172.21.15.103:0/3107510641 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x7fbf90078bf0 msgr2=0x7fbf9007b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:29.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.508+0000 7fbfb7e00640 1 --2- 172.21.15.103:0/3107510641 >> [v2:172.21.15.103:6800/4140822734,v1:172.21.15.103:6801/4140822734] conn(0x7fbf90078bf0 0x7fbf9007b030 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.508+0000 7fbfb7e00640 1 -- 172.21.15.103:0/3107510641 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbf90072610 msgr2=0x7fbf90074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:29.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.508+0000 7fbfb7e00640 1 --2- 172.21.15.103:0/3107510641 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fbf90072610 0x7fbf90074ad0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4007fd0 tx=0x7fbfa40079a0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.508+0000 7fbfb7e00640 1 -- 172.21.15.103:0/3107510641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfb015f2e0 msgr2=0x7fbfb00b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:29.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.508+0000 7fbfb7e00640 1 --2- 172.21.15.103:0/3107510641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfb015f2e0 0x7fbfb00b0510 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009bd0 tx=0x7fbfa8003f80 comp rx=0 tx=0).stop 2024-09-10T22:46:29.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.508+0000 7fbfb5e00640 1 -- 172.21.15.103:0/3107510641 reap_dead start 2024-09-10T22:46:29.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.508+0000 7fbfb7e00640 1 -- 172.21.15.103:0/3107510641 shutdown_connections 2024-09-10T22:46:29.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.508+0000 7fbfb7e00640 1 -- 172.21.15.103:0/3107510641 >> 172.21.15.103:0/3107510641 conn(0x7fbfb006cc00 msgr2=0x7fbfb01512f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:29.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.508+0000 7fbfb7e00640 1 -- 172.21.15.103:0/3107510641 shutdown_connections 2024-09-10T22:46:29.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.512+0000 7fbfb7e00640 1 -- 172.21.15.103:0/3107510641 wait complete. 2024-09-10T22:46:29.528 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T22:46:29.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4c1600640 1 -- 172.21.15.103:0/958826718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4bc0cdd00 msgr2=0x7fa4bc0ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:29.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4c1600640 1 --2- 172.21.15.103:0/958826718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4bc0cdd00 0x7fa4bc0ccdf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8009900 tx=0x7fa4a801c8e0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4c1600640 1 -- 172.21.15.103:0/958826718 shutdown_connections 2024-09-10T22:46:29.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4c1600640 1 --2- 172.21.15.103:0/958826718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4bc0cdd00 0x7fa4bc0ccdf0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4c1600640 1 --2- 172.21.15.103:0/958826718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4bc15f1a0 0x7fa4bc0ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4c1600640 1 -- 172.21.15.103:0/958826718 >> 172.21.15.103:0/958826718 conn(0x7fa4bc0d1a20 msgr2=0x7fa4bc0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:29.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4c1600640 1 -- 172.21.15.103:0/958826718 shutdown_connections 2024-09-10T22:46:29.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4c1600640 1 -- 172.21.15.103:0/958826718 wait complete. 2024-09-10T22:46:29.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4c1600640 1 Processor -- start 2024-09-10T22:46:29.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4c1600640 1 -- start start 2024-09-10T22:46:29.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4c1600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4bc0cd330 0x7fa4bc155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:29.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4c1600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4bc0cdd00 0x7fa4bc0c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:29.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4c1600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4bc15f1a0 0x7fa4bc159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:29.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4c1600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc1690c0 con 0x7fa4bc15f1a0 2024-09-10T22:46:29.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4c1600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc168f40 con 0x7fa4bc0cd330 2024-09-10T22:46:29.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4c1600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa4bc169240 con 0x7fa4bc0cdd00 2024-09-10T22:46:29.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4bb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4bc15f1a0 0x7fa4bc159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:29.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4bb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4bc15f1a0 0x7fa4bc159770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43784/0 (socket says 172.21.15.103:43784) 2024-09-10T22:46:29.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4bb400640 1 -- 172.21.15.103:0/3543271424 learned_addr learned my addr 172.21.15.103:0/3543271424 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:29.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4ba000640 1 --2- 172.21.15.103:0/3543271424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4bc0cdd00 0x7fa4bc0c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:29.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4baa00640 1 --2- 172.21.15.103:0/3543271424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4bc0cd330 0x7fa4bc155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:29.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4bb400640 1 -- 172.21.15.103:0/3543271424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4bc0cdd00 msgr2=0x7fa4bc0c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:29.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4bb400640 1 --2- 172.21.15.103:0/3543271424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4bc0cdd00 0x7fa4bc0c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4bb400640 1 -- 172.21.15.103:0/3543271424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4bc0cd330 msgr2=0x7fa4bc155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:29.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4bb400640 1 --2- 172.21.15.103:0/3543271424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4bc0cd330 0x7fa4bc155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4bb400640 1 -- 172.21.15.103:0/3543271424 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4bc0c6dd0 con 0x7fa4bc15f1a0 2024-09-10T22:46:29.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.672+0000 7fa4bb400640 1 --2- 172.21.15.103:0/3543271424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4bc15f1a0 0x7fa4bc159770 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400c7f0 tx=0x7fa4b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.676+0000 7fa4b2a00640 1 -- 172.21.15.103:0/3543271424 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4003b80 con 0x7fa4bc15f1a0 2024-09-10T22:46:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.676+0000 7fa4b2a00640 1 -- 172.21.15.103:0/3543271424 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4b4003d20 con 0x7fa4bc15f1a0 2024-09-10T22:46:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.676+0000 7fa4c1600640 1 -- 172.21.15.103:0/3543271424 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4bc0c70b0 con 0x7fa4bc15f1a0 2024-09-10T22:46:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.676+0000 7fa4b2a00640 1 -- 172.21.15.103:0/3543271424 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b400aab0 con 0x7fa4bc15f1a0 2024-09-10T22:46:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.676+0000 7fa4c1600640 1 -- 172.21.15.103:0/3543271424 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4bc0c7670 con 0x7fa4bc15f1a0 2024-09-10T22:46:29.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.676+0000 7fa4c1600640 1 -- 172.21.15.103:0/3543271424 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4bc0ccdf0 con 0x7fa4bc15f1a0 2024-09-10T22:46:29.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.676+0000 7fa4b2a00640 1 -- 172.21.15.103:0/3543271424 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa4b400ac50 con 0x7fa4bc15f1a0 2024-09-10T22:46:29.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.676+0000 7fa4b2a00640 1 --2- 172.21.15.103:0/3543271424 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa49c0725e0 0x7fa49c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:29.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.676+0000 7fa4b2a00640 1 -- 172.21.15.103:0/3543271424 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7fa4b4092fe0 con 0x7fa4bc15f1a0 2024-09-10T22:46:29.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.676+0000 7fa4baa00640 1 --2- 172.21.15.103:0/3543271424 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa49c0725e0 0x7fa49c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:29.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.676+0000 7fa4baa00640 1 --2- 172.21.15.103:0/3543271424 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa49c0725e0 0x7fa49c074aa0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009b40 tx=0x7fa4ac0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:29.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.680+0000 7fa4b2a00640 1 -- 172.21.15.103:0/3543271424 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa4b405e010 con 0x7fa4bc15f1a0 2024-09-10T22:46:29.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.848+0000 7fa4c1600640 1 -- 172.21.15.103:0/3543271424 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fa4bc072460 con 0x7fa49c0725e0 2024-09-10T22:46:29.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.848+0000 7fa4b2a00640 1 -- 172.21.15.103:0/3543271424 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa4bc072460 con 0x7fa49c0725e0 2024-09-10T22:46:29.851 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T22:46:29.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.852+0000 7fa4c1600640 1 -- 172.21.15.103:0/3543271424 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa49c0725e0 msgr2=0x7fa49c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:29.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.852+0000 7fa4c1600640 1 --2- 172.21.15.103:0/3543271424 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa49c0725e0 0x7fa49c074aa0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009b40 tx=0x7fa4ac0091e0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.852+0000 7fa4c1600640 1 -- 172.21.15.103:0/3543271424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4bc15f1a0 msgr2=0x7fa4bc159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:29.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.852+0000 7fa4c1600640 1 --2- 172.21.15.103:0/3543271424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4bc15f1a0 0x7fa4bc159770 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400c7f0 tx=0x7fa4b400ccb0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.852+0000 7fa4c1600640 1 -- 172.21.15.103:0/3543271424 shutdown_connections 2024-09-10T22:46:29.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.852+0000 7fa4c1600640 1 --2- 172.21.15.103:0/3543271424 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fa49c0725e0 0x7fa49c074aa0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.852+0000 7fa4c1600640 1 --2- 172.21.15.103:0/3543271424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4bc15f1a0 0x7fa4bc159770 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.852+0000 7fa4c1600640 1 --2- 172.21.15.103:0/3543271424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4bc0cdd00 0x7fa4bc0c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.852+0000 7fa4c1600640 1 --2- 172.21.15.103:0/3543271424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4bc0cd330 0x7fa4bc155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:29.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.852+0000 7fa4c1600640 1 -- 172.21.15.103:0/3543271424 >> 172.21.15.103:0/3543271424 conn(0x7fa4bc0d1a20 msgr2=0x7fa4bc071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:29.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.852+0000 7fa4c1600640 1 -- 172.21.15.103:0/3543271424 shutdown_connections 2024-09-10T22:46:29.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:29.852+0000 7fa4c1600640 1 -- 172.21.15.103:0/3543271424 wait complete. 2024-09-10T22:46:29.871 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T22:46:29.872 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T22:46:30.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.016+0000 7f2d7ca00640 1 -- 172.21.15.103:0/2250445092 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d7806e820 msgr2=0x7f2d780d20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.016+0000 7f2d7ca00640 1 --2- 172.21.15.103:0/2250445092 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d7806e820 0x7f2d780d20a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2d60009870 tx=0x7f2d6001c7d0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.016+0000 7f2d7ca00640 1 -- 172.21.15.103:0/2250445092 shutdown_connections 2024-09-10T22:46:30.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.016+0000 7f2d7ca00640 1 --2- 172.21.15.103:0/2250445092 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d7806e820 0x7f2d780d20a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.016+0000 7f2d7ca00640 1 -- 172.21.15.103:0/2250445092 >> 172.21.15.103:0/2250445092 conn(0x7f2d780d3ac0 msgr2=0x7f2d780d3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:30.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.016+0000 7f2d7ca00640 1 -- 172.21.15.103:0/2250445092 shutdown_connections 2024-09-10T22:46:30.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.016+0000 7f2d7ca00640 1 -- 172.21.15.103:0/2250445092 wait complete. 2024-09-10T22:46:30.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.016+0000 7f2d7ca00640 1 Processor -- start 2024-09-10T22:46:30.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.016+0000 7f2d7ca00640 1 -- start start 2024-09-10T22:46:30.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d7ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d7806e200 0x7f2d780b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:30.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d7ca00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d7806e820 0x7f2d78150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:30.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d7ca00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d781611b0 0x7f2d78151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:30.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d7ca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7816c580 con 0x7f2d7806e200 2024-09-10T22:46:30.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d7ca00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7816c400 con 0x7f2d781611b0 2024-09-10T22:46:30.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d7ca00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2d7816c700 con 0x7f2d7806e820 2024-09-10T22:46:30.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d76800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d7806e200 0x7f2d780b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:30.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d76800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d7806e200 0x7f2d780b58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43794/0 (socket says 172.21.15.103:43794) 2024-09-10T22:46:30.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d76800640 1 -- 172.21.15.103:0/2672364477 learned_addr learned my addr 172.21.15.103:0/2672364477 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:30.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d76800640 1 -- 172.21.15.103:0/2672364477 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d7806e820 msgr2=0x7f2d78150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d77200640 1 --2- 172.21.15.103:0/2672364477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d781611b0 0x7f2d78151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:30.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d6de00640 1 --2- 172.21.15.103:0/2672364477 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d7806e820 0x7f2d78150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:30.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d76800640 1 --2- 172.21.15.103:0/2672364477 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d7806e820 0x7f2d78150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d76800640 1 -- 172.21.15.103:0/2672364477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d781611b0 msgr2=0x7f2d78151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d76800640 1 --2- 172.21.15.103:0/2672364477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d781611b0 0x7f2d78151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d76800640 1 -- 172.21.15.103:0/2672364477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7815fa30 con 0x7f2d7806e200 2024-09-10T22:46:30.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d77200640 1 --2- 172.21.15.103:0/2672364477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d781611b0 0x7f2d78151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:30.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d6de00640 1 --2- 172.21.15.103:0/2672364477 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2d7806e820 0x7f2d78150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:30.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d76800640 1 --2- 172.21.15.103:0/2672364477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d7806e200 0x7f2d780b58b0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800cbc0 tx=0x7f2d6800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:30.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d6f400640 1 -- 172.21.15.103:0/2672364477 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68016020 con 0x7f2d7806e200 2024-09-10T22:46:30.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d6f400640 1 -- 172.21.15.103:0/2672364477 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d6800ab00 con 0x7f2d7806e200 2024-09-10T22:46:30.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d7ca00640 1 -- 172.21.15.103:0/2672364477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d7815fd10 con 0x7f2d7806e200 2024-09-10T22:46:30.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d6f400640 1 -- 172.21.15.103:0/2672364477 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68012420 con 0x7f2d7806e200 2024-09-10T22:46:30.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d7ca00640 1 -- 172.21.15.103:0/2672364477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d780cd4f0 con 0x7f2d7806e200 2024-09-10T22:46:30.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.020+0000 7f2d7ca00640 1 -- 172.21.15.103:0/2672364477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2d780ce080 con 0x7f2d7806e200 2024-09-10T22:46:30.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.024+0000 7f2d6f400640 1 -- 172.21.15.103:0/2672364477 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2d680125c0 con 0x7f2d7806e200 2024-09-10T22:46:30.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.024+0000 7f2d6f400640 1 --2- 172.21.15.103:0/2672364477 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2d540725e0 0x7f2d54074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:30.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.024+0000 7f2d6f400640 1 -- 172.21.15.103:0/2672364477 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7f2d68093cd0 con 0x7f2d7806e200 2024-09-10T22:46:30.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.024+0000 7f2d6f400640 1 --2- 172.21.15.103:0/2672364477 >> [v2:172.21.15.103:6816/3190036446,v1:172.21.15.103:6817/3190036446] conn(0x7f2d54078bc0 0x7f2d5407b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:30.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.024+0000 7f2d6f400640 1 -- 172.21.15.103:0/2672364477 --> [v2:172.21.15.103:6816/3190036446,v1:172.21.15.103:6817/3190036446] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d5407b6d0 con 0x7f2d54078bc0 2024-09-10T22:46:30.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.024+0000 7f2d6f400640 1 -- 172.21.15.103:0/2672364477 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7f2d68094160 con 0x7f2d7806e200 2024-09-10T22:46:30.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.024+0000 7f2d6de00640 1 --2- 172.21.15.103:0/2672364477 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2d540725e0 0x7f2d54074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:30.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.024+0000 7f2d77200640 1 --2- 172.21.15.103:0/2672364477 >> [v2:172.21.15.103:6816/3190036446,v1:172.21.15.103:6817/3190036446] conn(0x7f2d54078bc0 0x7f2d5407b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:30.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.024+0000 7f2d6de00640 1 --2- 172.21.15.103:0/2672364477 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2d540725e0 0x7f2d54074aa0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2d600af000 tx=0x7f2d6001b010 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:30.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.024+0000 7f2d77200640 1 --2- 172.21.15.103:0/2672364477 >> [v2:172.21.15.103:6816/3190036446,v1:172.21.15.103:6817/3190036446] conn(0x7f2d54078bc0 0x7f2d5407b000 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:30.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.024+0000 7f2d6f400640 1 -- 172.21.15.103:0/2672364477 <== osd.2 v2:172.21.15.103:6816/3190036446 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2d5407b6d0 con 0x7f2d54078bc0 2024-09-10T22:46:30.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.036+0000 7f2d7ca00640 1 -- 172.21.15.103:0/2672364477 --> [v2:172.21.15.103:6816/3190036446,v1:172.21.15.103:6817/3190036446] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2d780ce640 con 0x7f2d54078bc0 2024-09-10T22:46:30.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.040+0000 7f2d6f400640 1 -- 172.21.15.103:0/2672364477 <== osd.2 v2:172.21.15.103:6816/3190036446 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2d780ce640 con 0x7f2d54078bc0 2024-09-10T22:46:30.039 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:30.039 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T22:46:30.040 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:30.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.040+0000 7f2d7ca00640 1 -- 172.21.15.103:0/2672364477 >> [v2:172.21.15.103:6816/3190036446,v1:172.21.15.103:6817/3190036446] conn(0x7f2d54078bc0 msgr2=0x7f2d5407b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.040+0000 7f2d7ca00640 1 --2- 172.21.15.103:0/2672364477 >> [v2:172.21.15.103:6816/3190036446,v1:172.21.15.103:6817/3190036446] conn(0x7f2d54078bc0 0x7f2d5407b000 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.040+0000 7f2d7ca00640 1 -- 172.21.15.103:0/2672364477 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2d540725e0 msgr2=0x7f2d54074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.040+0000 7f2d7ca00640 1 --2- 172.21.15.103:0/2672364477 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2d540725e0 0x7f2d54074aa0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2d600af000 tx=0x7f2d6001b010 comp rx=0 tx=0).stop 2024-09-10T22:46:30.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.040+0000 7f2d7ca00640 1 -- 172.21.15.103:0/2672364477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d7806e200 msgr2=0x7f2d780b58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.040+0000 7f2d7ca00640 1 --2- 172.21.15.103:0/2672364477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d7806e200 0x7f2d780b58b0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800cbc0 tx=0x7f2d6800ccb0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.040+0000 7f2d77200640 1 -- 172.21.15.103:0/2672364477 reap_dead start 2024-09-10T22:46:30.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.040+0000 7f2d7ca00640 1 -- 172.21.15.103:0/2672364477 shutdown_connections 2024-09-10T22:46:30.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.040+0000 7f2d7ca00640 1 -- 172.21.15.103:0/2672364477 >> 172.21.15.103:0/2672364477 conn(0x7f2d780d3ac0 msgr2=0x7f2d780b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:30.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.040+0000 7f2d7ca00640 1 -- 172.21.15.103:0/2672364477 shutdown_connections 2024-09-10T22:46:30.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.040+0000 7f2d7ca00640 1 -- 172.21.15.103:0/2672364477 wait complete. 2024-09-10T22:46:30.058 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T22:46:30.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.200+0000 7f6341e00640 1 -- 172.21.15.103:0/3047048715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f633c161120 msgr2=0x7f633c0ce170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.200+0000 7f6341e00640 1 --2- 172.21.15.103:0/3047048715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f633c161120 0x7f633c0ce170 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f632c009840 tx=0x7f632c01c820 comp rx=0 tx=0).stop 2024-09-10T22:46:30.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.200+0000 7f6341e00640 1 -- 172.21.15.103:0/3047048715 shutdown_connections 2024-09-10T22:46:30.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.200+0000 7f6341e00640 1 --2- 172.21.15.103:0/3047048715 >> v2:172.21.15.131:3300/0 conn(0x7f633c06f470 0x7f633c0ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.200+0000 7f6341e00640 1 --2- 172.21.15.103:0/3047048715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f633c161120 0x7f633c0ce170 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.200+0000 7f6341e00640 1 -- 172.21.15.103:0/3047048715 >> 172.21.15.103:0/3047048715 conn(0x7f633c0d18f0 msgr2=0x7f633c0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:30.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.200+0000 7f6341e00640 1 -- 172.21.15.103:0/3047048715 shutdown_connections 2024-09-10T22:46:30.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.200+0000 7f6341e00640 1 -- 172.21.15.103:0/3047048715 wait complete. 2024-09-10T22:46:30.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6341e00640 1 Processor -- start 2024-09-10T22:46:30.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6341e00640 1 -- start start 2024-09-10T22:46:30.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6341e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f633c06f470 0x7f633c1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:30.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6341e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f633c0b0f00 0x7f633c0cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:30.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6341e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f633c161120 0x7f633c0b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:30.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6341e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f633c16ac70 con 0x7f633c06f470 2024-09-10T22:46:30.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6341e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f633c16aaf0 con 0x7f633c161120 2024-09-10T22:46:30.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6341e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f633c16adf0 con 0x7f633c0b0f00 2024-09-10T22:46:30.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6340a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f633c06f470 0x7f633c1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:30.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6340a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f633c06f470 0x7f633c1551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43800/0 (socket says 172.21.15.103:43800) 2024-09-10T22:46:30.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6340a00640 1 -- 172.21.15.103:0/3666736300 learned_addr learned my addr 172.21.15.103:0/3666736300 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:30.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6341400640 1 --2- 172.21.15.103:0/3666736300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f633c161120 0x7f633c0b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:30.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6333e00640 1 --2- 172.21.15.103:0/3666736300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f633c0b0f00 0x7f633c0cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:30.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6340a00640 1 -- 172.21.15.103:0/3666736300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f633c0b0f00 msgr2=0x7f633c0cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6340a00640 1 --2- 172.21.15.103:0/3666736300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f633c0b0f00 0x7f633c0cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6340a00640 1 -- 172.21.15.103:0/3666736300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f633c161120 msgr2=0x7f633c0b6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6340a00640 1 --2- 172.21.15.103:0/3666736300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f633c161120 0x7f633c0b6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6340a00640 1 -- 172.21.15.103:0/3666736300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633c155710 con 0x7f633c06f470 2024-09-10T22:46:30.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6333e00640 1 --2- 172.21.15.103:0/3666736300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f633c0b0f00 0x7f633c0cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:30.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6341400640 1 --2- 172.21.15.103:0/3666736300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f633c161120 0x7f633c0b6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:30.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6340a00640 1 --2- 172.21.15.103:0/3666736300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f633c06f470 0x7f633c1551d0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f632c000c10 tx=0x7f632c005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:30.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6339600640 1 -- 172.21.15.103:0/3666736300 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c0ac050 con 0x7f633c06f470 2024-09-10T22:46:30.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6339600640 1 -- 172.21.15.103:0/3666736300 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f632c0a6ba0 con 0x7f633c06f470 2024-09-10T22:46:30.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6341e00640 1 -- 172.21.15.103:0/3666736300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633c0b59a0 con 0x7f633c06f470 2024-09-10T22:46:30.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6339600640 1 -- 172.21.15.103:0/3666736300 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c0046d0 con 0x7f633c06f470 2024-09-10T22:46:30.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.204+0000 7f6341e00640 1 -- 172.21.15.103:0/3666736300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f633c0b5f60 con 0x7f633c06f470 2024-09-10T22:46:30.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.208+0000 7f6341e00640 1 -- 172.21.15.103:0/3666736300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f633c070430 con 0x7f633c06f470 2024-09-10T22:46:30.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.208+0000 7f6339600640 1 -- 172.21.15.103:0/3666736300 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f632c0b9020 con 0x7f633c06f470 2024-09-10T22:46:30.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.208+0000 7f6339600640 1 --2- 172.21.15.103:0/3666736300 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6318072610 0x7f6318074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:30.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.208+0000 7f6339600640 1 -- 172.21.15.103:0/3666736300 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7f632c12d290 con 0x7f633c06f470 2024-09-10T22:46:30.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.208+0000 7f6333e00640 1 --2- 172.21.15.103:0/3666736300 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6318072610 0x7f6318074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:30.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.208+0000 7f6333e00640 1 --2- 172.21.15.103:0/3666736300 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6318072610 0x7f6318074ad0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f633c09ed20 tx=0x7f6324009260 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:30.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.212+0000 7f6339600640 1 -- 172.21.15.103:0/3666736300 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f632c0c2030 con 0x7f633c06f470 2024-09-10T22:46:30.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.380+0000 7f6341e00640 1 -- 172.21.15.103:0/3666736300 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f633c15efd0 con 0x7f6318072610 2024-09-10T22:46:30.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.380+0000 7f6339600640 1 -- 172.21.15.103:0/3666736300 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f633c15efd0 con 0x7f6318072610 2024-09-10T22:46:30.380 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T22:46:30.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.380+0000 7f6341e00640 1 -- 172.21.15.103:0/3666736300 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6318072610 msgr2=0x7f6318074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.380+0000 7f6341e00640 1 --2- 172.21.15.103:0/3666736300 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6318072610 0x7f6318074ad0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f633c09ed20 tx=0x7f6324009260 comp rx=0 tx=0).stop 2024-09-10T22:46:30.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.380+0000 7f6341e00640 1 -- 172.21.15.103:0/3666736300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f633c06f470 msgr2=0x7f633c1551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.380+0000 7f6341e00640 1 --2- 172.21.15.103:0/3666736300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f633c06f470 0x7f633c1551d0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f632c000c10 tx=0x7f632c005790 comp rx=0 tx=0).stop 2024-09-10T22:46:30.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.380+0000 7f6341e00640 1 -- 172.21.15.103:0/3666736300 shutdown_connections 2024-09-10T22:46:30.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.380+0000 7f6341e00640 1 --2- 172.21.15.103:0/3666736300 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f6318072610 0x7f6318074ad0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.380+0000 7f6341e00640 1 --2- 172.21.15.103:0/3666736300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f633c161120 0x7f633c0b6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.380+0000 7f6341e00640 1 --2- 172.21.15.103:0/3666736300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f633c0b0f00 0x7f633c0cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.380+0000 7f6341e00640 1 --2- 172.21.15.103:0/3666736300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f633c06f470 0x7f633c1551d0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.380+0000 7f6341e00640 1 -- 172.21.15.103:0/3666736300 >> 172.21.15.103:0/3666736300 conn(0x7f633c0d18f0 msgr2=0x7f633c0d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:30.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.380+0000 7f6341e00640 1 -- 172.21.15.103:0/3666736300 shutdown_connections 2024-09-10T22:46:30.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.380+0000 7f6341e00640 1 -- 172.21.15.103:0/3666736300 wait complete. 2024-09-10T22:46:30.401 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T22:46:30.402 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T22:46:30.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.548+0000 7fcf00c00640 1 -- 172.21.15.103:0/3502830955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcee0003ab0 msgr2=0x7fcee0003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.548+0000 7fcf00c00640 1 --2- 172.21.15.103:0/3502830955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcee0003ab0 0x7fcee0003e90 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fceec00c640 tx=0x7fceec01d280 comp rx=0 tx=0).stop 2024-09-10T22:46:30.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.548+0000 7fcefbe00640 1 -- 172.21.15.103:0/3502830955 reap_dead start 2024-09-10T22:46:30.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.548+0000 7fcf00c00640 1 -- 172.21.15.103:0/3502830955 shutdown_connections 2024-09-10T22:46:30.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.548+0000 7fcf00c00640 1 -- 172.21.15.103:0/3502830955 >> 172.21.15.103:0/3502830955 conn(0x7fcefc0d0780 msgr2=0x7fcefc0d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:30.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.548+0000 7fcf00c00640 1 -- 172.21.15.103:0/3502830955 shutdown_connections 2024-09-10T22:46:30.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.548+0000 7fcf00c00640 1 -- 172.21.15.103:0/3502830955 wait complete. 2024-09-10T22:46:30.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.548+0000 7fcf00c00640 1 Processor -- start 2024-09-10T22:46:30.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.548+0000 7fcf00c00640 1 -- start start 2024-09-10T22:46:30.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcf00c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcee0003ab0 0x7fcefc1582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:30.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcf00c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc0b5150 0x7fcefc0b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:30.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcf00c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcefc0cf3a0 0x7fcefc0cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:30.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcf00c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc167910 con 0x7fcefc0b5150 2024-09-10T22:46:30.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcf00c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc167790 con 0x7fcee0003ab0 2024-09-10T22:46:30.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcf00c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcefc167a90 con 0x7fcefc0cf3a0 2024-09-10T22:46:30.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcef2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc0b5150 0x7fcefc0b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:30.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcef2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc0b5150 0x7fcefc0b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43804/0 (socket says 172.21.15.103:43804) 2024-09-10T22:46:30.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcef2a00640 1 -- 172.21.15.103:0/553676658 learned_addr learned my addr 172.21.15.103:0/553676658 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:30.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcefbe00640 1 --2- 172.21.15.103:0/553676658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcefc0cf3a0 0x7fcefc0cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:30.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcefb400640 1 --2- 172.21.15.103:0/553676658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcee0003ab0 0x7fcefc1582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:30.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcef2a00640 1 -- 172.21.15.103:0/553676658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcefc0cf3a0 msgr2=0x7fcefc0cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcef2a00640 1 --2- 172.21.15.103:0/553676658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcefc0cf3a0 0x7fcefc0cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcef2a00640 1 -- 172.21.15.103:0/553676658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcee0003ab0 msgr2=0x7fcefc1582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcef2a00640 1 --2- 172.21.15.103:0/553676658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcee0003ab0 0x7fcefc1582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcef2a00640 1 -- 172.21.15.103:0/553676658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcefc0b5cc0 con 0x7fcefc0b5150 2024-09-10T22:46:30.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcefb400640 1 --2- 172.21.15.103:0/553676658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcee0003ab0 0x7fcefc1582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:30.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcef2a00640 1 --2- 172.21.15.103:0/553676658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc0b5150 0x7fcefc0b55d0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fcee4011ae0 tx=0x7fcee4009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:30.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcef3e00640 1 -- 172.21.15.103:0/553676658 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee401e070 con 0x7fcefc0b5150 2024-09-10T22:46:30.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcef3e00640 1 -- 172.21.15.103:0/553676658 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcee400fe40 con 0x7fcefc0b5150 2024-09-10T22:46:30.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcf00c00640 1 -- 172.21.15.103:0/553676658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcefc1fb1b0 con 0x7fcefc0b5150 2024-09-10T22:46:30.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcef3e00640 1 -- 172.21.15.103:0/553676658 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee40042b0 con 0x7fcefc0b5150 2024-09-10T22:46:30.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcf00c00640 1 -- 172.21.15.103:0/553676658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcefc1fb770 con 0x7fcefc0b5150 2024-09-10T22:46:30.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.552+0000 7fcf00c00640 1 -- 172.21.15.103:0/553676658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcefc0cfd20 con 0x7fcefc0b5150 2024-09-10T22:46:30.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.556+0000 7fcef3e00640 1 -- 172.21.15.103:0/553676658 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcee4003600 con 0x7fcefc0b5150 2024-09-10T22:46:30.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.556+0000 7fcef3e00640 1 --2- 172.21.15.103:0/553676658 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fced8072610 0x7fced8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:30.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.556+0000 7fcef3e00640 1 -- 172.21.15.103:0/553676658 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7fcee40949e0 con 0x7fcefc0b5150 2024-09-10T22:46:30.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.556+0000 7fcef3e00640 1 --2- 172.21.15.103:0/553676658 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x7fced8078bf0 0x7fced807b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:30.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.556+0000 7fcef3e00640 1 -- 172.21.15.103:0/553676658 --> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcee4013e50 con 0x7fced8078bf0 2024-09-10T22:46:30.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.556+0000 7fcef3e00640 1 -- 172.21.15.103:0/553676658 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7fcee4094d90 con 0x7fcefc0b5150 2024-09-10T22:46:30.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.556+0000 7fcefb400640 1 --2- 172.21.15.103:0/553676658 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fced8072610 0x7fced8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:30.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.556+0000 7fcefbe00640 1 --2- 172.21.15.103:0/553676658 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x7fced8078bf0 0x7fced807b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:30.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.556+0000 7fcefbe00640 1 --2- 172.21.15.103:0/553676658 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x7fced8078bf0 0x7fced807b030 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:30.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.556+0000 7fcefb400640 1 --2- 172.21.15.103:0/553676658 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fced8072610 0x7fced8074ad0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fceec0ac000 tx=0x7fceec01a0c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:30.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.556+0000 7fcef3e00640 1 -- 172.21.15.103:0/553676658 <== osd.3 v2:172.21.15.103:6824/3403069661 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcee4013e50 con 0x7fced8078bf0 2024-09-10T22:46:30.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.572+0000 7fcf00c00640 1 -- 172.21.15.103:0/553676658 --> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcefc0733f0 con 0x7fced8078bf0 2024-09-10T22:46:30.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.572+0000 7fcef3e00640 1 -- 172.21.15.103:0/553676658 <== osd.3 v2:172.21.15.103:6824/3403069661 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcefc0733f0 con 0x7fced8078bf0 2024-09-10T22:46:30.572 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:30.572 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T22:46:30.572 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:30.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.572+0000 7fcf00c00640 1 -- 172.21.15.103:0/553676658 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x7fced8078bf0 msgr2=0x7fced807b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.572+0000 7fcf00c00640 1 --2- 172.21.15.103:0/553676658 >> [v2:172.21.15.103:6824/3403069661,v1:172.21.15.103:6825/3403069661] conn(0x7fced8078bf0 0x7fced807b030 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.572+0000 7fcf00c00640 1 -- 172.21.15.103:0/553676658 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fced8072610 msgr2=0x7fced8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.572+0000 7fcf00c00640 1 --2- 172.21.15.103:0/553676658 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fced8072610 0x7fced8074ad0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fceec0ac000 tx=0x7fceec01a0c0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.572+0000 7fcf00c00640 1 -- 172.21.15.103:0/553676658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc0b5150 msgr2=0x7fcefc0b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.572+0000 7fcf00c00640 1 --2- 172.21.15.103:0/553676658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc0b5150 0x7fcefc0b55d0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fcee4011ae0 tx=0x7fcee4009ea0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.572+0000 7fcefbe00640 1 -- 172.21.15.103:0/553676658 reap_dead start 2024-09-10T22:46:30.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.572+0000 7fcf00c00640 1 -- 172.21.15.103:0/553676658 shutdown_connections 2024-09-10T22:46:30.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.572+0000 7fcf00c00640 1 -- 172.21.15.103:0/553676658 >> 172.21.15.103:0/553676658 conn(0x7fcefc0d0780 msgr2=0x7fcefc15d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:30.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.572+0000 7fcf00c00640 1 -- 172.21.15.103:0/553676658 shutdown_connections 2024-09-10T22:46:30.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.572+0000 7fcf00c00640 1 -- 172.21.15.103:0/553676658 wait complete. 2024-09-10T22:46:30.590 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T22:46:30.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d8e00640 1 -- 172.21.15.103:0/2917905052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41d415be30 msgr2=0x7f41d40ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d8e00640 1 --2- 172.21.15.103:0/2917905052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41d415be30 0x7f41d40ce0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009840 tx=0x7f41c401c790 comp rx=0 tx=0).stop 2024-09-10T22:46:30.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d8e00640 1 -- 172.21.15.103:0/2917905052 shutdown_connections 2024-09-10T22:46:30.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d8e00640 1 --2- 172.21.15.103:0/2917905052 >> v2:172.21.15.131:3300/0 conn(0x7f41d40b09c0 0x7f41d40ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d8e00640 1 --2- 172.21.15.103:0/2917905052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41d415be30 0x7f41d40ce0c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d8e00640 1 -- 172.21.15.103:0/2917905052 >> 172.21.15.103:0/2917905052 conn(0x7f41d40d1ac0 msgr2=0x7f41d40d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:30.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d8e00640 1 -- 172.21.15.103:0/2917905052 shutdown_connections 2024-09-10T22:46:30.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d8e00640 1 -- 172.21.15.103:0/2917905052 wait complete. 2024-09-10T22:46:30.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d8e00640 1 Processor -- start 2024-09-10T22:46:30.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d8e00640 1 -- start start 2024-09-10T22:46:30.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d8e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41d40b09c0 0x7f41d4153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:30.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d8e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41d40ceb40 0x7f41d40b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:30.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d8e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41d415be30 0x7f41d41515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:30.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d8e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f41d41690c0 con 0x7f41d40b09c0 2024-09-10T22:46:30.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d8e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4168f40 con 0x7f41d415be30 2024-09-10T22:46:30.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d8e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f41d4169240 con 0x7f41d40ceb40 2024-09-10T22:46:30.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41d40b09c0 0x7f41d4153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:30.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41d40b09c0 0x7f41d4153d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43810/0 (socket says 172.21.15.103:43810) 2024-09-10T22:46:30.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d1e00640 1 -- 172.21.15.103:0/1324772679 learned_addr learned my addr 172.21.15.103:0/1324772679 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:30.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41cbe00640 1 --2- 172.21.15.103:0/1324772679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41d40ceb40 0x7f41d40b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:30.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d2800640 1 --2- 172.21.15.103:0/1324772679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41d415be30 0x7f41d41515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:30.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.732+0000 7f41d1e00640 1 -- 172.21.15.103:0/1324772679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41d40ceb40 msgr2=0x7f41d40b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.736+0000 7f41d1e00640 1 --2- 172.21.15.103:0/1324772679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41d40ceb40 0x7f41d40b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.736+0000 7f41d1e00640 1 -- 172.21.15.103:0/1324772679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41d415be30 msgr2=0x7f41d41515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.736+0000 7f41d1e00640 1 --2- 172.21.15.103:0/1324772679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41d415be30 0x7f41d41515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.736+0000 7f41d1e00640 1 -- 172.21.15.103:0/1324772679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d4156230 con 0x7f41d40b09c0 2024-09-10T22:46:30.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.736+0000 7f41d2800640 1 --2- 172.21.15.103:0/1324772679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41d415be30 0x7f41d41515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:30.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.736+0000 7f41d1e00640 1 --2- 172.21.15.103:0/1324772679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41d40b09c0 0x7f41d4153d10 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f41c401d030 tx=0x7f41c40a6f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:30.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.736+0000 7f41ca000640 1 -- 172.21.15.103:0/1324772679 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c40ac070 con 0x7f41d40b09c0 2024-09-10T22:46:30.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.736+0000 7f41ca000640 1 -- 172.21.15.103:0/1324772679 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41c4005130 con 0x7f41d40b09c0 2024-09-10T22:46:30.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.736+0000 7f41d8e00640 1 -- 172.21.15.103:0/1324772679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d4156510 con 0x7f41d40b09c0 2024-09-10T22:46:30.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.736+0000 7f41ca000640 1 -- 172.21.15.103:0/1324772679 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c4005560 con 0x7f41d40b09c0 2024-09-10T22:46:30.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.736+0000 7f41d8e00640 1 -- 172.21.15.103:0/1324772679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d4156ad0 con 0x7f41d40b09c0 2024-09-10T22:46:30.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.736+0000 7f41d8e00640 1 -- 172.21.15.103:0/1324772679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d40cf9c0 con 0x7f41d40b09c0 2024-09-10T22:46:30.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.736+0000 7f41ca000640 1 -- 172.21.15.103:0/1324772679 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f41c40c2060 con 0x7f41d40b09c0 2024-09-10T22:46:30.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.740+0000 7f41ca000640 1 --2- 172.21.15.103:0/1324772679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f41b00725e0 0x7f41b0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:30.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.740+0000 7f41ca000640 1 -- 172.21.15.103:0/1324772679 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7f41c412cf00 con 0x7f41d40b09c0 2024-09-10T22:46:30.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.740+0000 7f41cbe00640 1 --2- 172.21.15.103:0/1324772679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f41b00725e0 0x7f41b0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:30.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.740+0000 7f41cbe00640 1 --2- 172.21.15.103:0/1324772679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f41b00725e0 0x7f41b0074aa0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f41d40b3eb0 tx=0x7f41bc0091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:30.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.744+0000 7f41ca000640 1 -- 172.21.15.103:0/1324772679 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f41c4016410 con 0x7f41d40b09c0 2024-09-10T22:46:30.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.908+0000 7f41d8e00640 1 -- 172.21.15.103:0/1324772679 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f41d41553e0 con 0x7f41b00725e0 2024-09-10T22:46:30.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.908+0000 7f41ca000640 1 -- 172.21.15.103:0/1324772679 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f41d41553e0 con 0x7f41b00725e0 2024-09-10T22:46:30.908 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T22:46:30.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.908+0000 7f41d8e00640 1 -- 172.21.15.103:0/1324772679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f41b00725e0 msgr2=0x7f41b0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.908+0000 7f41d8e00640 1 --2- 172.21.15.103:0/1324772679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f41b00725e0 0x7f41b0074aa0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f41d40b3eb0 tx=0x7f41bc0091e0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.908+0000 7f41d8e00640 1 -- 172.21.15.103:0/1324772679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41d40b09c0 msgr2=0x7f41d4153d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:30.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.908+0000 7f41d8e00640 1 --2- 172.21.15.103:0/1324772679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41d40b09c0 0x7f41d4153d10 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f41c401d030 tx=0x7f41c40a6f90 comp rx=0 tx=0).stop 2024-09-10T22:46:30.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.908+0000 7f41d8e00640 1 -- 172.21.15.103:0/1324772679 shutdown_connections 2024-09-10T22:46:30.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.908+0000 7f41d8e00640 1 --2- 172.21.15.103:0/1324772679 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f41b00725e0 0x7f41b0074aa0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.908+0000 7f41d8e00640 1 --2- 172.21.15.103:0/1324772679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41d415be30 0x7f41d41515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.908+0000 7f41d8e00640 1 --2- 172.21.15.103:0/1324772679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41d40ceb40 0x7f41d40b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.908+0000 7f41d8e00640 1 --2- 172.21.15.103:0/1324772679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41d40b09c0 0x7f41d4153d10 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:30.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.908+0000 7f41d8e00640 1 -- 172.21.15.103:0/1324772679 >> 172.21.15.103:0/1324772679 conn(0x7f41d40d1ac0 msgr2=0x7f41d40b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:30.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.908+0000 7f41d8e00640 1 -- 172.21.15.103:0/1324772679 shutdown_connections 2024-09-10T22:46:30.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:30.908+0000 7f41d8e00640 1 -- 172.21.15.103:0/1324772679 wait complete. 2024-09-10T22:46:30.930 INFO:tasks.ceph:Scrubbing osd.4 2024-09-10T22:46:30.930 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-10T22:46:31.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffaab200640 1 -- 172.21.15.103:0/309340992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa88004060 msgr2=0x7ffa88004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffaab200640 1 --2- 172.21.15.103:0/309340992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa88004060 0x7ffa88004810 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c006f60 tx=0x7ffa8c01ce90 comp rx=0 tx=0).stop 2024-09-10T22:46:31.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffaa9200640 1 -- 172.21.15.103:0/309340992 reap_dead start 2024-09-10T22:46:31.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffaab200640 1 -- 172.21.15.103:0/309340992 shutdown_connections 2024-09-10T22:46:31.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffaab200640 1 -- 172.21.15.103:0/309340992 >> 172.21.15.103:0/309340992 conn(0x7ffaa406cc00 msgr2=0x7ffaa406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:31.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffaab200640 1 -- 172.21.15.103:0/309340992 shutdown_connections 2024-09-10T22:46:31.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffaab200640 1 -- 172.21.15.103:0/309340992 wait complete. 2024-09-10T22:46:31.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffaab200640 1 Processor -- start 2024-09-10T22:46:31.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffaab200640 1 -- start start 2024-09-10T22:46:31.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffaab200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa88004060 0x7ffaa41563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:31.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffaab200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaa40add60 0x7ffaa4164a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:31.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffaab200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffaa40a9450 0x7ffaa4164f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:31.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffaab200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa4167ae0 con 0x7ffaa40add60 2024-09-10T22:46:31.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffaab200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa4167960 con 0x7ffa88004060 2024-09-10T22:46:31.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffaab200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa4167c60 con 0x7ffaa40a9450 2024-09-10T22:46:31.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffa9b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaa40add60 0x7ffaa4164a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:31.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffa9b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaa40add60 0x7ffaa4164a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43820/0 (socket says 172.21.15.103:43820) 2024-09-10T22:46:31.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffa9b400640 1 -- 172.21.15.103:0/322690748 learned_addr learned my addr 172.21.15.103:0/322690748 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:31.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffaa3e00640 1 --2- 172.21.15.103:0/322690748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa88004060 0x7ffaa41563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:31.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffaa9200640 1 --2- 172.21.15.103:0/322690748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffaa40a9450 0x7ffaa4164f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:31.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffa9b400640 1 -- 172.21.15.103:0/322690748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffaa40a9450 msgr2=0x7ffaa4164f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffa9b400640 1 --2- 172.21.15.103:0/322690748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffaa40a9450 0x7ffaa4164f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffa9b400640 1 -- 172.21.15.103:0/322690748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa88004060 msgr2=0x7ffaa41563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffa9b400640 1 --2- 172.21.15.103:0/322690748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa88004060 0x7ffaa41563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffa9b400640 1 -- 172.21.15.103:0/322690748 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa41f7970 con 0x7ffaa40add60 2024-09-10T22:46:31.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.076+0000 7ffa9b400640 1 --2- 172.21.15.103:0/322690748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaa40add60 0x7ffaa4164a50 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c01b590 tx=0x7ffa8c001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:31.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.080+0000 7ffaa0c00640 1 -- 172.21.15.103:0/322690748 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c003620 con 0x7ffaa40add60 2024-09-10T22:46:31.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.080+0000 7ffaa0c00640 1 -- 172.21.15.103:0/322690748 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa8c0038d0 con 0x7ffaa40add60 2024-09-10T22:46:31.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.080+0000 7ffaa0c00640 1 -- 172.21.15.103:0/322690748 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c003d20 con 0x7ffaa40add60 2024-09-10T22:46:31.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.080+0000 7ffaab200640 1 -- 172.21.15.103:0/322690748 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa40a9a10 con 0x7ffaa40add60 2024-09-10T22:46:31.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.080+0000 7ffaab200640 1 -- 172.21.15.103:0/322690748 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa41f7f10 con 0x7ffaa40add60 2024-09-10T22:46:31.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.080+0000 7ffaab200640 1 -- 172.21.15.103:0/322690748 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffaa40ac010 con 0x7ffaa40add60 2024-09-10T22:46:31.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.080+0000 7ffaa0c00640 1 -- 172.21.15.103:0/322690748 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ffa8c0c2450 con 0x7ffaa40add60 2024-09-10T22:46:31.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.080+0000 7ffaa0c00640 1 --2- 172.21.15.103:0/322690748 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffa80072610 0x7ffa80074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:31.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.080+0000 7ffaa0c00640 1 -- 172.21.15.103:0/322690748 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7ffa8c12e040 con 0x7ffaa40add60 2024-09-10T22:46:31.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.080+0000 7ffaa0c00640 1 --2- 172.21.15.103:0/322690748 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x7ffa80078bf0 0x7ffa8007b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:31.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.080+0000 7ffaa0c00640 1 -- 172.21.15.103:0/322690748 --> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffa8c0bee50 con 0x7ffa80078bf0 2024-09-10T22:46:31.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.080+0000 7ffaa0c00640 1 -- 172.21.15.103:0/322690748 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7ffa8c12e4d0 con 0x7ffaa40add60 2024-09-10T22:46:31.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.080+0000 7ffaa3e00640 1 --2- 172.21.15.103:0/322690748 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffa80072610 0x7ffa80074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:31.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.080+0000 7ffaa9200640 1 --2- 172.21.15.103:0/322690748 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x7ffa80078bf0 0x7ffa8007b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:31.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.084+0000 7ffaa3e00640 1 --2- 172.21.15.103:0/322690748 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffa80072610 0x7ffa80074ad0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ffa94000c10 tx=0x7ffa94006b80 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:31.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.084+0000 7ffaa9200640 1 --2- 172.21.15.103:0/322690748 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x7ffa80078bf0 0x7ffa8007b030 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:31.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.084+0000 7ffaa0c00640 1 -- 172.21.15.103:0/322690748 <== osd.4 v2:172.21.15.131:6810/2178799193 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffa8c0bee50 con 0x7ffa80078bf0 2024-09-10T22:46:31.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.096+0000 7ffaab200640 1 -- 172.21.15.103:0/322690748 --> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffaa4072e30 con 0x7ffa80078bf0 2024-09-10T22:46:31.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.096+0000 7ffaa0c00640 1 -- 172.21.15.103:0/322690748 <== osd.4 v2:172.21.15.131:6810/2178799193 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffaa4072e30 con 0x7ffa80078bf0 2024-09-10T22:46:31.098 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:31.098 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T22:46:31.098 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:31.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.096+0000 7ffaab200640 1 -- 172.21.15.103:0/322690748 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x7ffa80078bf0 msgr2=0x7ffa8007b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.096+0000 7ffaab200640 1 --2- 172.21.15.103:0/322690748 >> [v2:172.21.15.131:6810/2178799193,v1:172.21.15.131:6811/2178799193] conn(0x7ffa80078bf0 0x7ffa8007b030 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.096+0000 7ffaab200640 1 -- 172.21.15.103:0/322690748 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffa80072610 msgr2=0x7ffa80074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.096+0000 7ffaab200640 1 --2- 172.21.15.103:0/322690748 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ffa80072610 0x7ffa80074ad0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ffa94000c10 tx=0x7ffa94006b80 comp rx=0 tx=0).stop 2024-09-10T22:46:31.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.096+0000 7ffaab200640 1 -- 172.21.15.103:0/322690748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaa40add60 msgr2=0x7ffaa4164a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.096+0000 7ffaab200640 1 --2- 172.21.15.103:0/322690748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaa40add60 0x7ffaa4164a50 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c01b590 tx=0x7ffa8c001cb0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.096+0000 7ffaa9200640 1 -- 172.21.15.103:0/322690748 reap_dead start 2024-09-10T22:46:31.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.096+0000 7ffaab200640 1 -- 172.21.15.103:0/322690748 shutdown_connections 2024-09-10T22:46:31.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.096+0000 7ffaab200640 1 -- 172.21.15.103:0/322690748 >> 172.21.15.103:0/322690748 conn(0x7ffaa406cc00 msgr2=0x7ffaa406fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:31.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.096+0000 7ffaab200640 1 -- 172.21.15.103:0/322690748 shutdown_connections 2024-09-10T22:46:31.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.096+0000 7ffaab200640 1 -- 172.21.15.103:0/322690748 wait complete. 2024-09-10T22:46:31.116 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-10T22:46:31.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.260+0000 7fd5a2a00640 1 -- 172.21.15.103:0/329678450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd580004810 msgr2=0x7fd580004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.260+0000 7fd5a2a00640 1 --2- 172.21.15.103:0/329678450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd580004810 0x7fd580004c90 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fd58800c2e0 tx=0x7fd58801cf50 comp rx=0 tx=0).stop 2024-09-10T22:46:31.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.260+0000 7fd5a0a00640 1 -- 172.21.15.103:0/329678450 reap_dead start 2024-09-10T22:46:31.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.260+0000 7fd5a2a00640 1 -- 172.21.15.103:0/329678450 shutdown_connections 2024-09-10T22:46:31.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.260+0000 7fd5a2a00640 1 -- 172.21.15.103:0/329678450 >> 172.21.15.103:0/329678450 conn(0x7fd59c06cc00 msgr2=0x7fd59c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:31.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.260+0000 7fd5a2a00640 1 -- 172.21.15.103:0/329678450 shutdown_connections 2024-09-10T22:46:31.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.260+0000 7fd5a2a00640 1 -- 172.21.15.103:0/329678450 wait complete. 2024-09-10T22:46:31.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.260+0000 7fd5a2a00640 1 Processor -- start 2024-09-10T22:46:31.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.260+0000 7fd5a2a00640 1 -- start start 2024-09-10T22:46:31.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.260+0000 7fd5a2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd580004810 0x7fd59c1fb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:31.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.260+0000 7fd5a2a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd59c158d70 0x7fd59c06ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:31.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.260+0000 7fd5a2a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd59c0b0a60 0x7fd59c0b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:31.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.260+0000 7fd5a2a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c1668a0 con 0x7fd580004810 2024-09-10T22:46:31.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.260+0000 7fd5a2a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c0d0140 con 0x7fd59c0b0a60 2024-09-10T22:46:31.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.260+0000 7fd5a2a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd59c166a20 con 0x7fd59c158d70 2024-09-10T22:46:31.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.260+0000 7fd59be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd580004810 0x7fd59c1fb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:31.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.260+0000 7fd59be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd580004810 0x7fd59c1fb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43838/0 (socket says 172.21.15.103:43838) 2024-09-10T22:46:31.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.260+0000 7fd59be00640 1 -- 172.21.15.103:0/4127030880 learned_addr learned my addr 172.21.15.103:0/4127030880 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:31.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.264+0000 7fd59b400640 1 --2- 172.21.15.103:0/4127030880 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd59c158d70 0x7fd59c06ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:31.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.264+0000 7fd5a0a00640 1 --2- 172.21.15.103:0/4127030880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd59c0b0a60 0x7fd59c0b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:31.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.264+0000 7fd59be00640 1 -- 172.21.15.103:0/4127030880 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd59c158d70 msgr2=0x7fd59c06ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.264+0000 7fd59be00640 1 --2- 172.21.15.103:0/4127030880 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd59c158d70 0x7fd59c06ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.264+0000 7fd59be00640 1 -- 172.21.15.103:0/4127030880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd59c0b0a60 msgr2=0x7fd59c0b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.264+0000 7fd59be00640 1 --2- 172.21.15.103:0/4127030880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd59c0b0a60 0x7fd59c0b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.264+0000 7fd59be00640 1 -- 172.21.15.103:0/4127030880 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59c1fbc90 con 0x7fd580004810 2024-09-10T22:46:31.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.264+0000 7fd59be00640 1 --2- 172.21.15.103:0/4127030880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd580004810 0x7fd59c1fb750 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fd58c011d10 tx=0x7fd58c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:31.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.264+0000 7fd593e00640 1 -- 172.21.15.103:0/4127030880 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58c003b90 con 0x7fd580004810 2024-09-10T22:46:31.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.264+0000 7fd593e00640 1 -- 172.21.15.103:0/4127030880 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd58c003d30 con 0x7fd580004810 2024-09-10T22:46:31.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.264+0000 7fd5a2a00640 1 -- 172.21.15.103:0/4127030880 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59c159310 con 0x7fd580004810 2024-09-10T22:46:31.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.264+0000 7fd593e00640 1 -- 172.21.15.103:0/4127030880 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58c0042b0 con 0x7fd580004810 2024-09-10T22:46:31.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.264+0000 7fd5a2a00640 1 -- 172.21.15.103:0/4127030880 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd59c1598d0 con 0x7fd580004810 2024-09-10T22:46:31.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.264+0000 7fd5a2a00640 1 -- 172.21.15.103:0/4127030880 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd59c0aeb40 con 0x7fd580004810 2024-09-10T22:46:31.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.264+0000 7fd593e00640 1 -- 172.21.15.103:0/4127030880 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd58c018070 con 0x7fd580004810 2024-09-10T22:46:31.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.268+0000 7fd593e00640 1 --2- 172.21.15.103:0/4127030880 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd57c0725e0 0x7fd57c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:31.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.268+0000 7fd593e00640 1 -- 172.21.15.103:0/4127030880 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7fd58c094330 con 0x7fd580004810 2024-09-10T22:46:31.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.268+0000 7fd59b400640 1 --2- 172.21.15.103:0/4127030880 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd57c0725e0 0x7fd57c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:31.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.268+0000 7fd59b400640 1 --2- 172.21.15.103:0/4127030880 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd57c0725e0 0x7fd57c074aa0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd5880ac000 tx=0x7fd588019d90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:31.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.272+0000 7fd593e00640 1 -- 172.21.15.103:0/4127030880 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd59c1fbc90 con 0x7fd580004810 2024-09-10T22:46:31.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.444+0000 7fd5a2a00640 1 -- 172.21.15.103:0/4127030880 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fd59c14f5d0 con 0x7fd57c0725e0 2024-09-10T22:46:31.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.444+0000 7fd593e00640 1 -- 172.21.15.103:0/4127030880 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd59c14f5d0 con 0x7fd57c0725e0 2024-09-10T22:46:31.444 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 4 to deep-scrub 2024-09-10T22:46:31.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.444+0000 7fd5a2a00640 1 -- 172.21.15.103:0/4127030880 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd57c0725e0 msgr2=0x7fd57c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.444+0000 7fd5a2a00640 1 --2- 172.21.15.103:0/4127030880 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd57c0725e0 0x7fd57c074aa0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd5880ac000 tx=0x7fd588019d90 comp rx=0 tx=0).stop 2024-09-10T22:46:31.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.444+0000 7fd5a2a00640 1 -- 172.21.15.103:0/4127030880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd580004810 msgr2=0x7fd59c1fb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.444+0000 7fd5a2a00640 1 --2- 172.21.15.103:0/4127030880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd580004810 0x7fd59c1fb750 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fd58c011d10 tx=0x7fd58c00f790 comp rx=0 tx=0).stop 2024-09-10T22:46:31.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.444+0000 7fd5a2a00640 1 -- 172.21.15.103:0/4127030880 shutdown_connections 2024-09-10T22:46:31.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.444+0000 7fd5a2a00640 1 --2- 172.21.15.103:0/4127030880 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd57c0725e0 0x7fd57c074aa0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.444+0000 7fd5a2a00640 1 --2- 172.21.15.103:0/4127030880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd59c0b0a60 0x7fd59c0b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.444+0000 7fd5a2a00640 1 --2- 172.21.15.103:0/4127030880 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd59c158d70 0x7fd59c06ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.444+0000 7fd5a2a00640 1 --2- 172.21.15.103:0/4127030880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd580004810 0x7fd59c1fb750 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.444+0000 7fd5a2a00640 1 -- 172.21.15.103:0/4127030880 >> 172.21.15.103:0/4127030880 conn(0x7fd59c06cc00 msgr2=0x7fd59c15c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:31.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.444+0000 7fd5a2a00640 1 -- 172.21.15.103:0/4127030880 shutdown_connections 2024-09-10T22:46:31.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.448+0000 7fd5a2a00640 1 -- 172.21.15.103:0/4127030880 wait complete. 2024-09-10T22:46:31.466 INFO:tasks.ceph:Scrubbing osd.5 2024-09-10T22:46:31.466 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-10T22:46:31.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.612+0000 7fd7fb200640 1 -- 172.21.15.103:0/4098836788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7d80051d0 msgr2=0x7fd7d800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.612+0000 7fd7fb200640 1 --2- 172.21.15.103:0/4098836788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7d80051d0 0x7fd7d800b9d0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec00e400 tx=0x7fd7ec01d7d0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.612+0000 7fd7f9200640 1 -- 172.21.15.103:0/4098836788 reap_dead start 2024-09-10T22:46:31.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.612+0000 7fd7fb200640 1 -- 172.21.15.103:0/4098836788 shutdown_connections 2024-09-10T22:46:31.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.612+0000 7fd7fb200640 1 -- 172.21.15.103:0/4098836788 >> 172.21.15.103:0/4098836788 conn(0x7fd7f40d1ab0 msgr2=0x7fd7f40d1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:31.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.612+0000 7fd7fb200640 1 -- 172.21.15.103:0/4098836788 shutdown_connections 2024-09-10T22:46:31.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.612+0000 7fd7fb200640 1 -- 172.21.15.103:0/4098836788 wait complete. 2024-09-10T22:46:31.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7fb200640 1 Processor -- start 2024-09-10T22:46:31.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7fb200640 1 -- start start 2024-09-10T22:46:31.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7fb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7d80051d0 0x7fd7f4150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:31.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7fb200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7f40b49c0 0x7fd7f41f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:31.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7fb200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7f40b02e0 0x7fd7f40c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:31.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7fb200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f40cfbc0 con 0x7fd7d80051d0 2024-09-10T22:46:31.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7fb200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f40b2fa0 con 0x7fd7f40b49c0 2024-09-10T22:46:31.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7fb200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd7f40cfd40 con 0x7fd7f40b02e0 2024-09-10T22:46:31.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7f3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7d80051d0 0x7fd7f4150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:31.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7f3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7d80051d0 0x7fd7f4150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43844/0 (socket says 172.21.15.103:43844) 2024-09-10T22:46:31.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7f3e00640 1 -- 172.21.15.103:0/1668063347 learned_addr learned my addr 172.21.15.103:0/1668063347 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:31.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7f3400640 1 --2- 172.21.15.103:0/1668063347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7f40b49c0 0x7fd7f41f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:31.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7f9200640 1 --2- 172.21.15.103:0/1668063347 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7f40b02e0 0x7fd7f40c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:31.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7f3e00640 1 -- 172.21.15.103:0/1668063347 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7f40b02e0 msgr2=0x7fd7f40c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7f3e00640 1 --2- 172.21.15.103:0/1668063347 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7f40b02e0 0x7fd7f40c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7f3e00640 1 -- 172.21.15.103:0/1668063347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7f40b49c0 msgr2=0x7fd7f41f7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7f3e00640 1 --2- 172.21.15.103:0/1668063347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7f40b49c0 0x7fd7f41f7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7f3e00640 1 -- 172.21.15.103:0/1668063347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f41f8ce0 con 0x7fd7d80051d0 2024-09-10T22:46:31.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7f3e00640 1 --2- 172.21.15.103:0/1668063347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7d80051d0 0x7fd7f4150fa0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4011a30 tx=0x7fd7e4011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:31.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7ebe00640 1 -- 172.21.15.103:0/1668063347 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e400fd50 con 0x7fd7d80051d0 2024-09-10T22:46:31.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7ebe00640 1 -- 172.21.15.103:0/1668063347 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7e4005020 con 0x7fd7d80051d0 2024-09-10T22:46:31.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7ebe00640 1 -- 172.21.15.103:0/1668063347 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4005470 con 0x7fd7d80051d0 2024-09-10T22:46:31.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7fb200640 1 -- 172.21.15.103:0/1668063347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f41f8720 con 0x7fd7d80051d0 2024-09-10T22:46:31.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7fb200640 1 -- 172.21.15.103:0/1668063347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f40ae8b0 con 0x7fd7d80051d0 2024-09-10T22:46:31.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.616+0000 7fd7fb200640 1 -- 172.21.15.103:0/1668063347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd7f40ccf50 con 0x7fd7d80051d0 2024-09-10T22:46:31.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.620+0000 7fd7ebe00640 1 -- 172.21.15.103:0/1668063347 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd7e40047b0 con 0x7fd7d80051d0 2024-09-10T22:46:31.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.620+0000 7fd7ebe00640 1 --2- 172.21.15.103:0/1668063347 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd7d4072610 0x7fd7d4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:31.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.620+0000 7fd7ebe00640 1 -- 172.21.15.103:0/1668063347 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7fd7e4094a40 con 0x7fd7d80051d0 2024-09-10T22:46:31.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.620+0000 7fd7ebe00640 1 --2- 172.21.15.103:0/1668063347 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x7fd7d4078bf0 0x7fd7d407b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:31.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.620+0000 7fd7ebe00640 1 -- 172.21.15.103:0/1668063347 --> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd7e4018e50 con 0x7fd7d4078bf0 2024-09-10T22:46:31.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.620+0000 7fd7f3400640 1 --2- 172.21.15.103:0/1668063347 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd7d4072610 0x7fd7d4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:31.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.620+0000 7fd7ebe00640 1 -- 172.21.15.103:0/1668063347 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7fd7e4094df0 con 0x7fd7d80051d0 2024-09-10T22:46:31.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.620+0000 7fd7f9200640 1 --2- 172.21.15.103:0/1668063347 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x7fd7d4078bf0 0x7fd7d407b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:31.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.620+0000 7fd7f3400640 1 --2- 172.21.15.103:0/1668063347 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd7d4072610 0x7fd7d4074ad0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd7f406f980 tx=0x7fd7e00015a0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:31.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.620+0000 7fd7f9200640 1 --2- 172.21.15.103:0/1668063347 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x7fd7d4078bf0 0x7fd7d407b030 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:31.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.620+0000 7fd7ebe00640 1 -- 172.21.15.103:0/1668063347 <== osd.5 v2:172.21.15.131:6800/175724775 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd7e4018e50 con 0x7fd7d4078bf0 2024-09-10T22:46:31.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.636+0000 7fd7fb200640 1 -- 172.21.15.103:0/1668063347 --> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd7f40c8940 con 0x7fd7d4078bf0 2024-09-10T22:46:31.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.636+0000 7fd7ebe00640 1 -- 172.21.15.103:0/1668063347 <== osd.5 v2:172.21.15.131:6800/175724775 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd7f40c8940 con 0x7fd7d4078bf0 2024-09-10T22:46:31.636 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:31.636 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T22:46:31.636 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:31.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.636+0000 7fd7fb200640 1 -- 172.21.15.103:0/1668063347 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x7fd7d4078bf0 msgr2=0x7fd7d407b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.636+0000 7fd7fb200640 1 --2- 172.21.15.103:0/1668063347 >> [v2:172.21.15.131:6800/175724775,v1:172.21.15.131:6801/175724775] conn(0x7fd7d4078bf0 0x7fd7d407b030 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.636+0000 7fd7fb200640 1 -- 172.21.15.103:0/1668063347 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd7d4072610 msgr2=0x7fd7d4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.636+0000 7fd7fb200640 1 --2- 172.21.15.103:0/1668063347 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd7d4072610 0x7fd7d4074ad0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd7f406f980 tx=0x7fd7e00015a0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.636+0000 7fd7fb200640 1 -- 172.21.15.103:0/1668063347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7d80051d0 msgr2=0x7fd7f4150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.636+0000 7fd7fb200640 1 --2- 172.21.15.103:0/1668063347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7d80051d0 0x7fd7f4150fa0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4011a30 tx=0x7fd7e4011ef0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.636+0000 7fd7f9200640 1 -- 172.21.15.103:0/1668063347 reap_dead start 2024-09-10T22:46:31.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.636+0000 7fd7fb200640 1 -- 172.21.15.103:0/1668063347 shutdown_connections 2024-09-10T22:46:31.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.636+0000 7fd7fb200640 1 -- 172.21.15.103:0/1668063347 >> 172.21.15.103:0/1668063347 conn(0x7fd7f40d1ab0 msgr2=0x7fd7f40ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:31.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.636+0000 7fd7fb200640 1 -- 172.21.15.103:0/1668063347 shutdown_connections 2024-09-10T22:46:31.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.636+0000 7fd7fb200640 1 -- 172.21.15.103:0/1668063347 wait complete. 2024-09-10T22:46:31.654 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-10T22:46:31.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2ffe00640 1 -- 172.21.15.103:0/3920616895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3000714d0 msgr2=0x7fd3000affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2ffe00640 1 --2- 172.21.15.103:0/3920616895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3000714d0 0x7fd3000affd0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8009900 tx=0x7fd2e801c850 comp rx=0 tx=0).stop 2024-09-10T22:46:31.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2ffe00640 1 -- 172.21.15.103:0/3920616895 shutdown_connections 2024-09-10T22:46:31.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2ffe00640 1 --2- 172.21.15.103:0/3920616895 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3000b0510 0x7fd300070430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2ffe00640 1 --2- 172.21.15.103:0/3920616895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3000714d0 0x7fd3000affd0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2ffe00640 1 -- 172.21.15.103:0/3920616895 >> 172.21.15.103:0/3920616895 conn(0x7fd3000d18f0 msgr2=0x7fd3000d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:31.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2ffe00640 1 -- 172.21.15.103:0/3920616895 shutdown_connections 2024-09-10T22:46:31.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2ffe00640 1 -- 172.21.15.103:0/3920616895 wait complete. 2024-09-10T22:46:31.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2ffe00640 1 Processor -- start 2024-09-10T22:46:31.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2ffe00640 1 -- start start 2024-09-10T22:46:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2ffe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3000714d0 0x7fd3000b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2ffe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3000b0510 0x7fd300158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2ffe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd30015f0e0 0x7fd300156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2ffe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd300168ad0 con 0x7fd3000b0510 2024-09-10T22:46:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2ffe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd300168950 con 0x7fd3000714d0 2024-09-10T22:46:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2ffe00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd300168c50 con 0x7fd30015f0e0 2024-09-10T22:46:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2f6000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3000b0510 0x7fd300158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2f6000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3000b0510 0x7fd300158c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43862/0 (socket says 172.21.15.103:43862) 2024-09-10T22:46:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2f6000640 1 -- 172.21.15.103:0/1078734751 learned_addr learned my addr 172.21.15.103:0/1078734751 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2fea00640 1 --2- 172.21.15.103:0/1078734751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3000714d0 0x7fd3000b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.796+0000 7fd2ff400640 1 --2- 172.21.15.103:0/1078734751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd30015f0e0 0x7fd300156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.800+0000 7fd2f6000640 1 -- 172.21.15.103:0/1078734751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd30015f0e0 msgr2=0x7fd300156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.800+0000 7fd2f6000640 1 --2- 172.21.15.103:0/1078734751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd30015f0e0 0x7fd300156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.800+0000 7fd2f6000640 1 -- 172.21.15.103:0/1078734751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3000714d0 msgr2=0x7fd3000b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.800+0000 7fd2f6000640 1 --2- 172.21.15.103:0/1078734751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3000714d0 0x7fd3000b71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.800+0000 7fd2f6000640 1 -- 172.21.15.103:0/1078734751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd300159f30 con 0x7fd3000b0510 2024-09-10T22:46:31.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.800+0000 7fd2f6000640 1 --2- 172.21.15.103:0/1078734751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3000b0510 0x7fd300158c90 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80b0040 tx=0x7fd2e80a5770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:31.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.800+0000 7fd2f7400640 1 -- 172.21.15.103:0/1078734751 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e80b2040 con 0x7fd3000b0510 2024-09-10T22:46:31.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.800+0000 7fd2f7400640 1 -- 172.21.15.103:0/1078734751 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2e80044b0 con 0x7fd3000b0510 2024-09-10T22:46:31.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.800+0000 7fd2ffe00640 1 -- 172.21.15.103:0/1078734751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd30015a210 con 0x7fd3000b0510 2024-09-10T22:46:31.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.800+0000 7fd2f7400640 1 -- 172.21.15.103:0/1078734751 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8003860 con 0x7fd3000b0510 2024-09-10T22:46:31.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.800+0000 7fd2ffe00640 1 -- 172.21.15.103:0/1078734751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd30015a7d0 con 0x7fd3000b0510 2024-09-10T22:46:31.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.800+0000 7fd2ffe00640 1 -- 172.21.15.103:0/1078734751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3000affd0 con 0x7fd3000b0510 2024-09-10T22:46:31.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.800+0000 7fd2f7400640 1 -- 172.21.15.103:0/1078734751 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd2e8003a00 con 0x7fd3000b0510 2024-09-10T22:46:31.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.804+0000 7fd2f7400640 1 --2- 172.21.15.103:0/1078734751 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2dc0725e0 0x7fd2dc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:31.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.804+0000 7fd2f7400640 1 -- 172.21.15.103:0/1078734751 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7fd2e812d320 con 0x7fd3000b0510 2024-09-10T22:46:31.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.804+0000 7fd2fea00640 1 --2- 172.21.15.103:0/1078734751 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2dc0725e0 0x7fd2dc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:31.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.804+0000 7fd2fea00640 1 --2- 172.21.15.103:0/1078734751 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2dc0725e0 0x7fd2dc074aa0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd3000cc670 tx=0x7fd2f0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:31.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.808+0000 7fd2f7400640 1 -- 172.21.15.103:0/1078734751 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd2e80164d0 con 0x7fd3000b0510 2024-09-10T22:46:31.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.972+0000 7fd2ffe00640 1 -- 172.21.15.103:0/1078734751 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fd3000b4240 con 0x7fd2dc0725e0 2024-09-10T22:46:31.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.972+0000 7fd2f7400640 1 -- 172.21.15.103:0/1078734751 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd3000b4240 con 0x7fd2dc0725e0 2024-09-10T22:46:31.974 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 5 to deep-scrub 2024-09-10T22:46:31.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.976+0000 7fd2ffe00640 1 -- 172.21.15.103:0/1078734751 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2dc0725e0 msgr2=0x7fd2dc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.976+0000 7fd2ffe00640 1 --2- 172.21.15.103:0/1078734751 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2dc0725e0 0x7fd2dc074aa0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd3000cc670 tx=0x7fd2f0009040 comp rx=0 tx=0).stop 2024-09-10T22:46:31.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.976+0000 7fd2ffe00640 1 -- 172.21.15.103:0/1078734751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3000b0510 msgr2=0x7fd300158c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:31.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.976+0000 7fd2ffe00640 1 --2- 172.21.15.103:0/1078734751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3000b0510 0x7fd300158c90 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80b0040 tx=0x7fd2e80a5770 comp rx=0 tx=0).stop 2024-09-10T22:46:31.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.976+0000 7fd2ffe00640 1 -- 172.21.15.103:0/1078734751 shutdown_connections 2024-09-10T22:46:31.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.976+0000 7fd2ffe00640 1 --2- 172.21.15.103:0/1078734751 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fd2dc0725e0 0x7fd2dc074aa0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.976+0000 7fd2ffe00640 1 --2- 172.21.15.103:0/1078734751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd30015f0e0 0x7fd300156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.976+0000 7fd2ffe00640 1 --2- 172.21.15.103:0/1078734751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3000b0510 0x7fd300158c90 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.976+0000 7fd2ffe00640 1 --2- 172.21.15.103:0/1078734751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3000714d0 0x7fd3000b71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:31.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.976+0000 7fd2ffe00640 1 -- 172.21.15.103:0/1078734751 >> 172.21.15.103:0/1078734751 conn(0x7fd3000d18f0 msgr2=0x7fd3000d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:31.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.976+0000 7fd2ffe00640 1 -- 172.21.15.103:0/1078734751 shutdown_connections 2024-09-10T22:46:31.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:31.976+0000 7fd2ffe00640 1 -- 172.21.15.103:0/1078734751 wait complete. 2024-09-10T22:46:31.995 INFO:tasks.ceph:Scrubbing osd.6 2024-09-10T22:46:31.996 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-10T22:46:32.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.140+0000 7f43f9200640 1 -- 172.21.15.103:0/1558226453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43d80040a0 msgr2=0x7f43d8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.140+0000 7f43f9200640 1 --2- 172.21.15.103:0/1558226453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43d80040a0 0x7f43d8004810 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f43f4073640 tx=0x7f43e001ced0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.140+0000 7f43f3e00640 1 -- 172.21.15.103:0/1558226453 reap_dead start 2024-09-10T22:46:32.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.140+0000 7f43f9200640 1 -- 172.21.15.103:0/1558226453 shutdown_connections 2024-09-10T22:46:32.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.140+0000 7f43f9200640 1 -- 172.21.15.103:0/1558226453 >> 172.21.15.103:0/1558226453 conn(0x7f43f40d18d0 msgr2=0x7f43f40d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:32.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.140+0000 7f43f9200640 1 -- 172.21.15.103:0/1558226453 shutdown_connections 2024-09-10T22:46:32.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.140+0000 7f43f9200640 1 -- 172.21.15.103:0/1558226453 wait complete. 2024-09-10T22:46:32.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f9200640 1 Processor -- start 2024-09-10T22:46:32.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f9200640 1 -- start start 2024-09-10T22:46:32.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43d80040a0 0x7f43f415bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:32.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f9200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43f40b4f80 0x7f43f40b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:32.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f9200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43f40b6c70 0x7f43f40b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:32.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f9200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f43f4168a90 con 0x7f43d80040a0 2024-09-10T22:46:32.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f9200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f43f40af580 con 0x7f43f40b6c70 2024-09-10T22:46:32.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f9200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f43f4168c10 con 0x7f43f40b4f80 2024-09-10T22:46:32.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43d80040a0 0x7f43f415bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:32.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43d80040a0 0x7f43f415bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43880/0 (socket says 172.21.15.103:43880) 2024-09-10T22:46:32.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f3400640 1 -- 172.21.15.103:0/3780065701 learned_addr learned my addr 172.21.15.103:0/3780065701 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:32.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f2a00640 1 --2- 172.21.15.103:0/3780065701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43f40b4f80 0x7f43f40b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:32.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f3e00640 1 --2- 172.21.15.103:0/3780065701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43f40b6c70 0x7f43f40b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:32.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f3400640 1 -- 172.21.15.103:0/3780065701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43f40b4f80 msgr2=0x7f43f40b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f3400640 1 --2- 172.21.15.103:0/3780065701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43f40b4f80 0x7f43f40b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f3400640 1 -- 172.21.15.103:0/3780065701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43f40b6c70 msgr2=0x7f43f40b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f3400640 1 --2- 172.21.15.103:0/3780065701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43f40b6c70 0x7f43f40b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f3400640 1 -- 172.21.15.103:0/3780065701 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f415c4d0 con 0x7f43d80040a0 2024-09-10T22:46:32.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.144+0000 7f43f3400640 1 --2- 172.21.15.103:0/3780065701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43d80040a0 0x7f43f415bf90 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f43e4011b40 tx=0x7f43e4009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:32.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.148+0000 7f43eb400640 1 -- 172.21.15.103:0/3780065701 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e401e070 con 0x7f43d80040a0 2024-09-10T22:46:32.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.148+0000 7f43eb400640 1 -- 172.21.15.103:0/3780065701 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43e4004050 con 0x7f43d80040a0 2024-09-10T22:46:32.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.148+0000 7f43eb400640 1 -- 172.21.15.103:0/3780065701 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e400fea0 con 0x7f43d80040a0 2024-09-10T22:46:32.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.148+0000 7f43f9200640 1 -- 172.21.15.103:0/3780065701 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f40c7720 con 0x7f43d80040a0 2024-09-10T22:46:32.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.148+0000 7f43f9200640 1 -- 172.21.15.103:0/3780065701 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f40c7ca0 con 0x7f43d80040a0 2024-09-10T22:46:32.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.148+0000 7f43f9200640 1 -- 172.21.15.103:0/3780065701 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f43f40c5330 con 0x7f43d80040a0 2024-09-10T22:46:32.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.148+0000 7f43eb400640 1 -- 172.21.15.103:0/3780065701 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f43e4003600 con 0x7f43d80040a0 2024-09-10T22:46:32.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.152+0000 7f43eb400640 1 --2- 172.21.15.103:0/3780065701 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f43d40725e0 0x7f43d4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:32.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.152+0000 7f43eb400640 1 -- 172.21.15.103:0/3780065701 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7f43e4093e60 con 0x7f43d80040a0 2024-09-10T22:46:32.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.152+0000 7f43eb400640 1 --2- 172.21.15.103:0/3780065701 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x7f43d4078bc0 0x7f43d407b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:32.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.152+0000 7f43eb400640 1 -- 172.21.15.103:0/3780065701 --> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f43e401dec0 con 0x7f43d4078bc0 2024-09-10T22:46:32.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.152+0000 7f43eb400640 1 -- 172.21.15.103:0/3780065701 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7f43e4096480 con 0x7f43d80040a0 2024-09-10T22:46:32.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.152+0000 7f43f2a00640 1 --2- 172.21.15.103:0/3780065701 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f43d40725e0 0x7f43d4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:32.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.152+0000 7f43f3e00640 1 --2- 172.21.15.103:0/3780065701 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x7f43d4078bc0 0x7f43d407b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:32.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.152+0000 7f43f2a00640 1 --2- 172.21.15.103:0/3780065701 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f43d40725e0 0x7f43d4074aa0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f43e00ab000 tx=0x7f43e0019d10 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:32.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.152+0000 7f43f3e00640 1 --2- 172.21.15.103:0/3780065701 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x7f43d4078bc0 0x7f43d407b000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:32.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.152+0000 7f43eb400640 1 -- 172.21.15.103:0/3780065701 <== osd.6 v2:172.21.15.131:6818/3165743337 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f43e401dec0 con 0x7f43d4078bc0 2024-09-10T22:46:32.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.164+0000 7f43f9200640 1 -- 172.21.15.103:0/3780065701 --> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f43f40ae620 con 0x7f43d4078bc0 2024-09-10T22:46:32.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.164+0000 7f43eb400640 1 -- 172.21.15.103:0/3780065701 <== osd.6 v2:172.21.15.131:6818/3165743337 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f43f40ae620 con 0x7f43d4078bc0 2024-09-10T22:46:32.167 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:32.167 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T22:46:32.167 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:32.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.168+0000 7f43f9200640 1 -- 172.21.15.103:0/3780065701 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x7f43d4078bc0 msgr2=0x7f43d407b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.168+0000 7f43f9200640 1 --2- 172.21.15.103:0/3780065701 >> [v2:172.21.15.131:6818/3165743337,v1:172.21.15.131:6819/3165743337] conn(0x7f43d4078bc0 0x7f43d407b000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.168+0000 7f43f9200640 1 -- 172.21.15.103:0/3780065701 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f43d40725e0 msgr2=0x7f43d4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.168+0000 7f43f9200640 1 --2- 172.21.15.103:0/3780065701 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f43d40725e0 0x7f43d4074aa0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f43e00ab000 tx=0x7f43e0019d10 comp rx=0 tx=0).stop 2024-09-10T22:46:32.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.168+0000 7f43f9200640 1 -- 172.21.15.103:0/3780065701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43d80040a0 msgr2=0x7f43f415bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.168+0000 7f43f9200640 1 --2- 172.21.15.103:0/3780065701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43d80040a0 0x7f43f415bf90 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f43e4011b40 tx=0x7f43e4009ea0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.168+0000 7f43f3e00640 1 -- 172.21.15.103:0/3780065701 reap_dead start 2024-09-10T22:46:32.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.168+0000 7f43f9200640 1 -- 172.21.15.103:0/3780065701 shutdown_connections 2024-09-10T22:46:32.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.168+0000 7f43f9200640 1 -- 172.21.15.103:0/3780065701 >> 172.21.15.103:0/3780065701 conn(0x7f43f40d18d0 msgr2=0x7f43f415ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:32.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.168+0000 7f43f9200640 1 -- 172.21.15.103:0/3780065701 shutdown_connections 2024-09-10T22:46:32.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.168+0000 7f43f9200640 1 -- 172.21.15.103:0/3780065701 wait complete. 2024-09-10T22:46:32.187 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-10T22:46:32.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.328+0000 7f9984a00640 1 -- 172.21.15.103:0/168488538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998015b050 msgr2=0x7f99800ce530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.328+0000 7f9984a00640 1 --2- 172.21.15.103:0/168488538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998015b050 0x7f99800ce530 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9978009900 tx=0x7f997801c820 comp rx=0 tx=0).stop 2024-09-10T22:46:32.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.328+0000 7f9984a00640 1 -- 172.21.15.103:0/168488538 shutdown_connections 2024-09-10T22:46:32.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.328+0000 7f9984a00640 1 --2- 172.21.15.103:0/168488538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998015b050 0x7f99800ce530 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.328+0000 7f9984a00640 1 --2- 172.21.15.103:0/168488538 >> v2:172.21.15.131:3300/0 conn(0x7f9980158120 0x7f998015ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.328+0000 7f9984a00640 1 -- 172.21.15.103:0/168488538 >> 172.21.15.103:0/168488538 conn(0x7f99800b24a0 msgr2=0x7f99800b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:32.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.328+0000 7f9984a00640 1 -- 172.21.15.103:0/168488538 shutdown_connections 2024-09-10T22:46:32.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.328+0000 7f9984a00640 1 -- 172.21.15.103:0/168488538 wait complete. 2024-09-10T22:46:32.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f9984a00640 1 Processor -- start 2024-09-10T22:46:32.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f9984a00640 1 -- start start 2024-09-10T22:46:32.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f9984a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99800d0670 0x7f9980160960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:32.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f9984a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9980158120 0x7f99800b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:32.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f9984a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998015b050 0x7f99800b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:32.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f9984a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9980167ba0 con 0x7f99800d0670 2024-09-10T22:46:32.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f9984a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9980167a20 con 0x7f9980158120 2024-09-10T22:46:32.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f9984a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9980167d20 con 0x7f998015b050 2024-09-10T22:46:32.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f997f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99800d0670 0x7f9980160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:32.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f997f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99800d0670 0x7f9980160960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43886/0 (socket says 172.21.15.103:43886) 2024-09-10T22:46:32.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f997f400640 1 -- 172.21.15.103:0/2713632267 learned_addr learned my addr 172.21.15.103:0/2713632267 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:32.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f9976a00640 1 --2- 172.21.15.103:0/2713632267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9980158120 0x7f99800b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:32.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f997fe00640 1 --2- 172.21.15.103:0/2713632267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998015b050 0x7f99800b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:32.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f997f400640 1 -- 172.21.15.103:0/2713632267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998015b050 msgr2=0x7f99800b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f997f400640 1 --2- 172.21.15.103:0/2713632267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998015b050 0x7f99800b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f997f400640 1 -- 172.21.15.103:0/2713632267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9980158120 msgr2=0x7f99800b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f997f400640 1 --2- 172.21.15.103:0/2713632267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9980158120 0x7f99800b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f997f400640 1 -- 172.21.15.103:0/2713632267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99801f66b0 con 0x7f99800d0670 2024-09-10T22:46:32.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f997f400640 1 --2- 172.21.15.103:0/2713632267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99800d0670 0x7f9980160960 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f9970009d90 tx=0x7f997000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:32.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f9977e00640 1 -- 172.21.15.103:0/2713632267 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970003b80 con 0x7f99800d0670 2024-09-10T22:46:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f9977e00640 1 -- 172.21.15.103:0/2713632267 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9970003d20 con 0x7f99800d0670 2024-09-10T22:46:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f9984a00640 1 -- 172.21.15.103:0/2713632267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99801f58f0 con 0x7f99800d0670 2024-09-10T22:46:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f9977e00640 1 -- 172.21.15.103:0/2713632267 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970004280 con 0x7f99800d0670 2024-09-10T22:46:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.332+0000 7f9984a00640 1 -- 172.21.15.103:0/2713632267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99801f6190 con 0x7f99800d0670 2024-09-10T22:46:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.336+0000 7f9984a00640 1 -- 172.21.15.103:0/2713632267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f998015ab10 con 0x7f99800d0670 2024-09-10T22:46:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.336+0000 7f9977e00640 1 -- 172.21.15.103:0/2713632267 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9970004420 con 0x7f99800d0670 2024-09-10T22:46:32.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.336+0000 7f9977e00640 1 --2- 172.21.15.103:0/2713632267 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f995c0725e0 0x7f995c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:32.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.336+0000 7f9977e00640 1 -- 172.21.15.103:0/2713632267 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7f9970093df0 con 0x7f99800d0670 2024-09-10T22:46:32.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.336+0000 7f9976a00640 1 --2- 172.21.15.103:0/2713632267 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f995c0725e0 0x7f995c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:32.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.336+0000 7f9976a00640 1 --2- 172.21.15.103:0/2713632267 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f995c0725e0 0x7f995c074aa0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f99801561e0 tx=0x7f9968009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:32.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.340+0000 7f9977e00640 1 -- 172.21.15.103:0/2713632267 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f997005ef30 con 0x7f99800d0670 2024-09-10T22:46:32.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.508+0000 7f9984a00640 1 -- 172.21.15.103:0/2713632267 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f99801f5ac0 con 0x7f995c0725e0 2024-09-10T22:46:32.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.508+0000 7f9977e00640 1 -- 172.21.15.103:0/2713632267 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f99801f5ac0 con 0x7f995c0725e0 2024-09-10T22:46:32.509 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 6 to deep-scrub 2024-09-10T22:46:32.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.512+0000 7f9984a00640 1 -- 172.21.15.103:0/2713632267 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f995c0725e0 msgr2=0x7f995c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.512+0000 7f9984a00640 1 --2- 172.21.15.103:0/2713632267 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f995c0725e0 0x7f995c074aa0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f99801561e0 tx=0x7f9968009040 comp rx=0 tx=0).stop 2024-09-10T22:46:32.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.512+0000 7f9984a00640 1 -- 172.21.15.103:0/2713632267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99800d0670 msgr2=0x7f9980160960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.512+0000 7f9984a00640 1 --2- 172.21.15.103:0/2713632267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99800d0670 0x7f9980160960 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f9970009d90 tx=0x7f997000c6a0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.512+0000 7f9984a00640 1 -- 172.21.15.103:0/2713632267 shutdown_connections 2024-09-10T22:46:32.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.512+0000 7f9984a00640 1 --2- 172.21.15.103:0/2713632267 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f995c0725e0 0x7f995c074aa0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.512+0000 7f9984a00640 1 --2- 172.21.15.103:0/2713632267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f998015b050 0x7f99800b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.512+0000 7f9984a00640 1 --2- 172.21.15.103:0/2713632267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9980158120 0x7f99800b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.512+0000 7f9984a00640 1 --2- 172.21.15.103:0/2713632267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99800d0670 0x7f9980160960 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.512+0000 7f9984a00640 1 -- 172.21.15.103:0/2713632267 >> 172.21.15.103:0/2713632267 conn(0x7f99800b24a0 msgr2=0x7f9980157160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:32.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.512+0000 7f9984a00640 1 -- 172.21.15.103:0/2713632267 shutdown_connections 2024-09-10T22:46:32.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.512+0000 7f9984a00640 1 -- 172.21.15.103:0/2713632267 wait complete. 2024-09-10T22:46:32.531 INFO:tasks.ceph:Scrubbing osd.7 2024-09-10T22:46:32.531 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-10T22:46:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.676+0000 7f20e5200640 1 -- 172.21.15.103:0/402917974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e006cc00 msgr2=0x7f20e006cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.676+0000 7f20e5200640 1 --2- 172.21.15.103:0/402917974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e006cc00 0x7f20e006cfe0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009bc0 tx=0x7f20d001ca80 comp rx=0 tx=0).stop 2024-09-10T22:46:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.676+0000 7f20e5200640 1 -- 172.21.15.103:0/402917974 shutdown_connections 2024-09-10T22:46:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.676+0000 7f20e5200640 1 --2- 172.21.15.103:0/402917974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20e0071be0 0x7f20e00cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.676+0000 7f20e5200640 1 --2- 172.21.15.103:0/402917974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e006cc00 0x7f20e006cfe0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.676+0000 7f20e5200640 1 -- 172.21.15.103:0/402917974 >> 172.21.15.103:0/402917974 conn(0x7f20e00d0940 msgr2=0x7f20e00d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.676+0000 7f20e5200640 1 -- 172.21.15.103:0/402917974 shutdown_connections 2024-09-10T22:46:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.676+0000 7f20e5200640 1 -- 172.21.15.103:0/402917974 wait complete. 2024-09-10T22:46:32.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.676+0000 7f20e5200640 1 Processor -- start 2024-09-10T22:46:32.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.676+0000 7f20e5200640 1 -- start start 2024-09-10T22:46:32.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20e5200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e006cc00 0x7f20e013ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:32.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20e5200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20e0071be0 0x7f20e00b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:32.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20e5200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20e00d1460 0x7f20e015e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:32.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20e5200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f20e01688a0 con 0x7f20e006cc00 2024-09-10T22:46:32.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20e5200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f20e0168720 con 0x7f20e00d1460 2024-09-10T22:46:32.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20e5200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f20e0168a20 con 0x7f20e0071be0 2024-09-10T22:46:32.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20dde00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e006cc00 0x7f20e013ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:32.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20dde00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e006cc00 0x7f20e013ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43898/0 (socket says 172.21.15.103:43898) 2024-09-10T22:46:32.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20dde00640 1 -- 172.21.15.103:0/1732664323 learned_addr learned my addr 172.21.15.103:0/1732664323 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:32.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20dd400640 1 --2- 172.21.15.103:0/1732664323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20e0071be0 0x7f20e00b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:32.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20de800640 1 --2- 172.21.15.103:0/1732664323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20e00d1460 0x7f20e015e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:32.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20dde00640 1 -- 172.21.15.103:0/1732664323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20e0071be0 msgr2=0x7f20e00b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20dde00640 1 --2- 172.21.15.103:0/1732664323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20e0071be0 0x7f20e00b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20dde00640 1 -- 172.21.15.103:0/1732664323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20e00d1460 msgr2=0x7f20e015e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20dde00640 1 --2- 172.21.15.103:0/1732664323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20e00d1460 0x7f20e015e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20dde00640 1 -- 172.21.15.103:0/1732664323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e00b59f0 con 0x7f20e006cc00 2024-09-10T22:46:32.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20de800640 1 --2- 172.21.15.103:0/1732664323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20e00d1460 0x7f20e015e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:46:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20dde00640 1 --2- 172.21.15.103:0/1732664323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e006cc00 0x7f20e013ed90 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009b10 tx=0x7f20d0005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20d6000640 1 -- 172.21.15.103:0/1732664323 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d00b2040 con 0x7f20e006cc00 2024-09-10T22:46:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20d6000640 1 -- 172.21.15.103:0/1732664323 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20d0004130 con 0x7f20e006cc00 2024-09-10T22:46:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20e5200640 1 -- 172.21.15.103:0/1732664323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e00b3f70 con 0x7f20e006cc00 2024-09-10T22:46:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20d6000640 1 -- 172.21.15.103:0/1732664323 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0004560 con 0x7f20e006cc00 2024-09-10T22:46:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20e5200640 1 -- 172.21.15.103:0/1732664323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e00b4530 con 0x7f20e006cc00 2024-09-10T22:46:32.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20e5200640 1 -- 172.21.15.103:0/1732664323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f20e006cfe0 con 0x7f20e006cc00 2024-09-10T22:46:32.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.680+0000 7f20d6000640 1 -- 172.21.15.103:0/1732664323 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f20d00b5070 con 0x7f20e006cc00 2024-09-10T22:46:32.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.684+0000 7f20d6000640 1 --2- 172.21.15.103:0/1732664323 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20c00725e0 0x7f20c0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:32.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.684+0000 7f20d6000640 1 -- 172.21.15.103:0/1732664323 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7f20d012d850 con 0x7f20e006cc00 2024-09-10T22:46:32.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.684+0000 7f20d6000640 1 --2- 172.21.15.103:0/1732664323 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x7f20c0078bc0 0x7f20c007b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:32.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.684+0000 7f20d6000640 1 -- 172.21.15.103:0/1732664323 --> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20d00b0e70 con 0x7f20c0078bc0 2024-09-10T22:46:32.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.684+0000 7f20d6000640 1 -- 172.21.15.103:0/1732664323 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7f20d012dc00 con 0x7f20e006cc00 2024-09-10T22:46:32.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.684+0000 7f20dd400640 1 --2- 172.21.15.103:0/1732664323 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20c00725e0 0x7f20c0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:32.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.684+0000 7f20de800640 1 --2- 172.21.15.103:0/1732664323 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x7f20c0078bc0 0x7f20c007b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:32.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.684+0000 7f20dd400640 1 --2- 172.21.15.103:0/1732664323 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20c00725e0 0x7f20c0074aa0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f20e0142ff0 tx=0x7f20cc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:32.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.684+0000 7f20de800640 1 --2- 172.21.15.103:0/1732664323 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x7f20c0078bc0 0x7f20c007b000 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:32.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.684+0000 7f20d6000640 1 -- 172.21.15.103:0/1732664323 <== osd.7 v2:172.21.15.131:6826/1279722082 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f20d00b0e70 con 0x7f20c0078bc0 2024-09-10T22:46:32.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.696+0000 7f20e5200640 1 -- 172.21.15.103:0/1732664323 --> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f20e00cd0c0 con 0x7f20c0078bc0 2024-09-10T22:46:32.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.700+0000 7f20d6000640 1 -- 172.21.15.103:0/1732664323 <== osd.7 v2:172.21.15.131:6826/1279722082 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f20e00cd0c0 con 0x7f20c0078bc0 2024-09-10T22:46:32.700 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T22:46:32.700 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T22:46:32.700 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T22:46:32.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.700+0000 7f20e5200640 1 -- 172.21.15.103:0/1732664323 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x7f20c0078bc0 msgr2=0x7f20c007b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.700+0000 7f20e5200640 1 --2- 172.21.15.103:0/1732664323 >> [v2:172.21.15.131:6826/1279722082,v1:172.21.15.131:6827/1279722082] conn(0x7f20c0078bc0 0x7f20c007b000 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.700+0000 7f20e5200640 1 -- 172.21.15.103:0/1732664323 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20c00725e0 msgr2=0x7f20c0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.700+0000 7f20e5200640 1 --2- 172.21.15.103:0/1732664323 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20c00725e0 0x7f20c0074aa0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f20e0142ff0 tx=0x7f20cc009040 comp rx=0 tx=0).stop 2024-09-10T22:46:32.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.700+0000 7f20e5200640 1 -- 172.21.15.103:0/1732664323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e006cc00 msgr2=0x7f20e013ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.700+0000 7f20e5200640 1 --2- 172.21.15.103:0/1732664323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e006cc00 0x7f20e013ed90 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009b10 tx=0x7f20d0005ae0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.700+0000 7f20de800640 1 -- 172.21.15.103:0/1732664323 reap_dead start 2024-09-10T22:46:32.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.700+0000 7f20e5200640 1 -- 172.21.15.103:0/1732664323 shutdown_connections 2024-09-10T22:46:32.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.700+0000 7f20e5200640 1 -- 172.21.15.103:0/1732664323 >> 172.21.15.103:0/1732664323 conn(0x7f20e00d0940 msgr2=0x7f20e00b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:32.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.700+0000 7f20e5200640 1 -- 172.21.15.103:0/1732664323 shutdown_connections 2024-09-10T22:46:32.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.700+0000 7f20e5200640 1 -- 172.21.15.103:0/1732664323 wait complete. 2024-09-10T22:46:32.719 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-10T22:46:32.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.860+0000 7f2f9c000640 1 -- 172.21.15.103:0/2701786982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f7c003a60 msgr2=0x7f2f7c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.860+0000 7f2f9c000640 1 --2- 172.21.15.103:0/2701786982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f7c003a60 0x7f2f7c003e80 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f2f880016c0 tx=0x7f2f8801c700 comp rx=0 tx=0).stop 2024-09-10T22:46:32.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.860+0000 7f2f9c000640 1 -- 172.21.15.103:0/2701786982 shutdown_connections 2024-09-10T22:46:32.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.860+0000 7f2f9c000640 1 --2- 172.21.15.103:0/2701786982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f7c003a60 0x7f2f7c003e80 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.860+0000 7f2f9c000640 1 -- 172.21.15.103:0/2701786982 >> 172.21.15.103:0/2701786982 conn(0x7f2f9406cc00 msgr2=0x7f2f9406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:32.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.860+0000 7f2f9c000640 1 -- 172.21.15.103:0/2701786982 shutdown_connections 2024-09-10T22:46:32.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.860+0000 7f2f9c000640 1 -- 172.21.15.103:0/2701786982 wait complete. 2024-09-10T22:46:32.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f9c000640 1 Processor -- start 2024-09-10T22:46:32.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f9c000640 1 -- start start 2024-09-10T22:46:32.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f9c000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f7c003a60 0x7f2f94147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:32.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f9c000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f9415a640 0x7f2f9415df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:32.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f9c000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f9415aac0 0x7f2f9415e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:32.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f9c000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2f940b2a80 con 0x7f2f7c003a60 2024-09-10T22:46:32.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f9c000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9415cf10 con 0x7f2f9415aac0 2024-09-10T22:46:32.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f9c000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2f940b2c00 con 0x7f2f9415a640 2024-09-10T22:46:32.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f99600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f7c003a60 0x7f2f94147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:32.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f99600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f7c003a60 0x7f2f94147370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43906/0 (socket says 172.21.15.103:43906) 2024-09-10T22:46:32.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f99600640 1 -- 172.21.15.103:0/1652790332 learned_addr learned my addr 172.21.15.103:0/1652790332 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:32.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f9a000640 1 --2- 172.21.15.103:0/1652790332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f9415aac0 0x7f2f9415e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:32.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f98c00640 1 --2- 172.21.15.103:0/1652790332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f9415a640 0x7f2f9415df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:32.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f99600640 1 -- 172.21.15.103:0/1652790332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f9415a640 msgr2=0x7f2f9415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f99600640 1 --2- 172.21.15.103:0/1652790332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f9415a640 0x7f2f9415df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f99600640 1 -- 172.21.15.103:0/1652790332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f9415aac0 msgr2=0x7f2f9415e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:32.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f99600640 1 --2- 172.21.15.103:0/1652790332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f9415aac0 0x7f2f9415e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:32.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f99600640 1 -- 172.21.15.103:0/1652790332 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f941f7b00 con 0x7f2f7c003a60 2024-09-10T22:46:32.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f99600640 1 --2- 172.21.15.103:0/1652790332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f7c003a60 0x7f2f94147370 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f2f8801ae00 tx=0x7f2f88003be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:32.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f91600640 1 -- 172.21.15.103:0/1652790332 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f880b9070 con 0x7f2f7c003a60 2024-09-10T22:46:32.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f91600640 1 -- 172.21.15.103:0/1652790332 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f880ae040 con 0x7f2f7c003a60 2024-09-10T22:46:32.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f9c000640 1 -- 172.21.15.103:0/1652790332 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f941f7d80 con 0x7f2f7c003a60 2024-09-10T22:46:32.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f91600640 1 -- 172.21.15.103:0/1652790332 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f880ad070 con 0x7f2f7c003a60 2024-09-10T22:46:32.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f9c000640 1 -- 172.21.15.103:0/1652790332 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f941f8340 con 0x7f2f7c003a60 2024-09-10T22:46:32.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.864+0000 7f2f9c000640 1 -- 172.21.15.103:0/1652790332 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f940b3160 con 0x7f2f7c003a60 2024-09-10T22:46:32.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.868+0000 7f2f91600640 1 -- 172.21.15.103:0/1652790332 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2f88006350 con 0x7f2f7c003a60 2024-09-10T22:46:32.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.868+0000 7f2f91600640 1 --2- 172.21.15.103:0/1652790332 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2f74072610 0x7f2f74074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:32.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.868+0000 7f2f91600640 1 -- 172.21.15.103:0/1652790332 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7f2f8812c090 con 0x7f2f7c003a60 2024-09-10T22:46:32.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.868+0000 7f2f98c00640 1 --2- 172.21.15.103:0/1652790332 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2f74072610 0x7f2f74074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:32.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.868+0000 7f2f98c00640 1 --2- 172.21.15.103:0/1652790332 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2f74072610 0x7f2f74074ad0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2f94159f40 tx=0x7f2f800091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:32.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:32.872+0000 7f2f91600640 1 -- 172.21.15.103:0/1652790332 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2f941f7b00 con 0x7f2f7c003a60 2024-09-10T22:46:33.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.036+0000 7f2f9c000640 1 -- 172.21.15.103:0/1652790332 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f2f9415b8e0 con 0x7f2f74072610 2024-09-10T22:46:33.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.036+0000 7f2f91600640 1 -- 172.21.15.103:0/1652790332 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2f9415b8e0 con 0x7f2f74072610 2024-09-10T22:46:33.039 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 7 to deep-scrub 2024-09-10T22:46:33.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.040+0000 7f2f9c000640 1 -- 172.21.15.103:0/1652790332 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2f74072610 msgr2=0x7f2f74074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:33.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.040+0000 7f2f9c000640 1 --2- 172.21.15.103:0/1652790332 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2f74072610 0x7f2f74074ad0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2f94159f40 tx=0x7f2f800091e0 comp rx=0 tx=0).stop 2024-09-10T22:46:33.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.040+0000 7f2f9c000640 1 -- 172.21.15.103:0/1652790332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f7c003a60 msgr2=0x7f2f94147370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:33.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.040+0000 7f2f9c000640 1 --2- 172.21.15.103:0/1652790332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f7c003a60 0x7f2f94147370 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f2f8801ae00 tx=0x7f2f88003be0 comp rx=0 tx=0).stop 2024-09-10T22:46:33.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.040+0000 7f2f9c000640 1 -- 172.21.15.103:0/1652790332 shutdown_connections 2024-09-10T22:46:33.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.040+0000 7f2f9c000640 1 --2- 172.21.15.103:0/1652790332 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f2f74072610 0x7f2f74074ad0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:33.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.040+0000 7f2f9c000640 1 --2- 172.21.15.103:0/1652790332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f9415aac0 0x7f2f9415e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:33.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.040+0000 7f2f9c000640 1 --2- 172.21.15.103:0/1652790332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f9415a640 0x7f2f9415df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:33.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.040+0000 7f2f9c000640 1 --2- 172.21.15.103:0/1652790332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f7c003a60 0x7f2f94147370 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:33.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.040+0000 7f2f9c000640 1 -- 172.21.15.103:0/1652790332 >> 172.21.15.103:0/1652790332 conn(0x7f2f9406cc00 msgr2=0x7f2f9415d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:33.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.040+0000 7f2f9c000640 1 -- 172.21.15.103:0/1652790332 shutdown_connections 2024-09-10T22:46:33.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.040+0000 7f2f9c000640 1 -- 172.21.15.103:0/1652790332 wait complete. 2024-09-10T22:46:33.060 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:46:33.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.200+0000 7f208ea00640 1 -- 172.21.15.103:0/1653287202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20880b22a0 msgr2=0x7f20880b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:33.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.200+0000 7f208ea00640 1 --2- 172.21.15.103:0/1653287202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20880b22a0 0x7f20880b2750 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f2080009bc0 tx=0x7f208001cba0 comp rx=0 tx=0).stop 2024-09-10T22:46:33.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.200+0000 7f208ea00640 1 -- 172.21.15.103:0/1653287202 shutdown_connections 2024-09-10T22:46:33.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.200+0000 7f208ea00640 1 --2- 172.21.15.103:0/1653287202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20880b22a0 0x7f20880b2750 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:33.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.200+0000 7f208ea00640 1 --2- 172.21.15.103:0/1653287202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20880b2fb0 0x7f208806f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:33.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.200+0000 7f208ea00640 1 -- 172.21.15.103:0/1653287202 >> 172.21.15.103:0/1653287202 conn(0x7f20880d1ac0 msgr2=0x7f20880d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:33.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.200+0000 7f208ea00640 1 -- 172.21.15.103:0/1653287202 shutdown_connections 2024-09-10T22:46:33.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.200+0000 7f208ea00640 1 -- 172.21.15.103:0/1653287202 wait complete. 2024-09-10T22:46:33.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f208ea00640 1 Processor -- start 2024-09-10T22:46:33.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f208ea00640 1 -- start start 2024-09-10T22:46:33.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f208ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20880b22a0 0x7f2088159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:33.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f208ea00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20880b2fb0 0x7f2088160500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:33.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f208ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2088161500 0x7f208815ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:33.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f208ea00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f208816ae90 con 0x7f20880b22a0 2024-09-10T22:46:33.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f208ea00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f208816ad10 con 0x7f2088161500 2024-09-10T22:46:33.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f208ea00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f208816b010 con 0x7f20880b2fb0 2024-09-10T22:46:33.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f2087e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20880b22a0 0x7f2088159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:33.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f2087e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20880b22a0 0x7f2088159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43916/0 (socket says 172.21.15.103:43916) 2024-09-10T22:46:33.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f2087e00640 1 -- 172.21.15.103:0/3514306393 learned_addr learned my addr 172.21.15.103:0/3514306393 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:33.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f2087400640 1 --2- 172.21.15.103:0/3514306393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20880b2fb0 0x7f2088160500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:33.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f2087e00640 1 -- 172.21.15.103:0/3514306393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20880b2fb0 msgr2=0x7f2088160500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:33.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f2087e00640 1 --2- 172.21.15.103:0/3514306393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20880b2fb0 0x7f2088160500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:33.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f2087e00640 1 -- 172.21.15.103:0/3514306393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2088161500 msgr2=0x7f208815ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:33.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f208ca00640 1 --2- 172.21.15.103:0/3514306393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2088161500 0x7f208815ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:33.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f2087e00640 1 --2- 172.21.15.103:0/3514306393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2088161500 0x7f208815ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:33.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f2087e00640 1 -- 172.21.15.103:0/3514306393 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2088158940 con 0x7f20880b22a0 2024-09-10T22:46:33.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f2087400640 1 --2- 172.21.15.103:0/3514306393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20880b2fb0 0x7f2088160500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:33.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f208ca00640 1 --2- 172.21.15.103:0/3514306393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2088161500 0x7f208815ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:33.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f2087e00640 1 --2- 172.21.15.103:0/3514306393 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20880b22a0 0x7f2088159b20 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f2078001ec0 tx=0x7f207800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:33.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f207fe00640 1 -- 172.21.15.103:0/3514306393 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2078017070 con 0x7f20880b22a0 2024-09-10T22:46:33.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f207fe00640 1 -- 172.21.15.103:0/3514306393 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2078003600 con 0x7f20880b22a0 2024-09-10T22:46:33.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f208ea00640 1 -- 172.21.15.103:0/3514306393 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2088158380 con 0x7f20880b22a0 2024-09-10T22:46:33.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f207fe00640 1 -- 172.21.15.103:0/3514306393 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2078003a50 con 0x7f20880b22a0 2024-09-10T22:46:33.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f208ea00640 1 -- 172.21.15.103:0/3514306393 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2088159600 con 0x7f20880b22a0 2024-09-10T22:46:33.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.204+0000 7f208ea00640 1 -- 172.21.15.103:0/3514306393 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20880b2750 con 0x7f20880b22a0 2024-09-10T22:46:33.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.208+0000 7f207fe00640 1 -- 172.21.15.103:0/3514306393 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2078003bf0 con 0x7f20880b22a0 2024-09-10T22:46:33.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.208+0000 7f207fe00640 1 --2- 172.21.15.103:0/3514306393 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20680725e0 0x7f2068074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:33.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.208+0000 7f207fe00640 1 -- 172.21.15.103:0/3514306393 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7f2078092860 con 0x7f20880b22a0 2024-09-10T22:46:33.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.208+0000 7f2087400640 1 --2- 172.21.15.103:0/3514306393 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20680725e0 0x7f2068074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:33.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.208+0000 7f2087400640 1 --2- 172.21.15.103:0/3514306393 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20680725e0 0x7f2068074aa0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f20880b2b80 tx=0x7f2074008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:33.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.212+0000 7f207fe00640 1 -- 172.21.15.103:0/3514306393 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f207805df70 con 0x7f20880b22a0 2024-09-10T22:46:33.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.376+0000 7f208ea00640 1 -- 172.21.15.103:0/3514306393 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f20880708a0 con 0x7f20680725e0 2024-09-10T22:46:33.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.376+0000 7f207fe00640 1 -- 172.21.15.103:0/3514306393 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13356 (secure 0 0 0) 0x7f20880708a0 con 0x7f20680725e0 2024-09-10T22:46:33.376 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:33.376 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:46:33.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.376+0000 7f208ea00640 1 -- 172.21.15.103:0/3514306393 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20680725e0 msgr2=0x7f2068074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:33.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.376+0000 7f208ea00640 1 --2- 172.21.15.103:0/3514306393 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20680725e0 0x7f2068074aa0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f20880b2b80 tx=0x7f2074008040 comp rx=0 tx=0).stop 2024-09-10T22:46:33.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.376+0000 7f208ea00640 1 -- 172.21.15.103:0/3514306393 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20880b22a0 msgr2=0x7f2088159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:33.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.376+0000 7f208ea00640 1 --2- 172.21.15.103:0/3514306393 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20880b22a0 0x7f2088159b20 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f2078001ec0 tx=0x7f207800c890 comp rx=0 tx=0).stop 2024-09-10T22:46:33.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.376+0000 7f208ea00640 1 -- 172.21.15.103:0/3514306393 shutdown_connections 2024-09-10T22:46:33.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.376+0000 7f208ea00640 1 --2- 172.21.15.103:0/3514306393 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f20680725e0 0x7f2068074aa0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:33.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.376+0000 7f208ea00640 1 --2- 172.21.15.103:0/3514306393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2088161500 0x7f208815ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:33.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.376+0000 7f208ea00640 1 --2- 172.21.15.103:0/3514306393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20880b2fb0 0x7f2088160500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:33.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.376+0000 7f208ea00640 1 --2- 172.21.15.103:0/3514306393 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20880b22a0 0x7f2088159b20 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:33.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.376+0000 7f208ea00640 1 -- 172.21.15.103:0/3514306393 >> 172.21.15.103:0/3514306393 conn(0x7f20880d1ac0 msgr2=0x7f2088070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:33.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.376+0000 7f208ea00640 1 -- 172.21.15.103:0/3514306393 shutdown_connections 2024-09-10T22:46:33.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:33.376+0000 7f208ea00640 1 -- 172.21.15.103:0/3514306393 wait complete. 2024-09-10T22:46:33.397 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-09-10T22:46:31.739427+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":261344,"kb_used_data":11816,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713376,"statfs":{"total":773094113280,"available":772826497024,"internally_reserved":0,"allocated":12099584,"data_stored":6254544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.305762"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":275,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-10T22:46:23.592201+0000","last_change":"2024-09-10T22:38:42.535012+0000","last_active":"2024-09-10T22:46:23.592201+0000","last_peered":"2024-09-10T22:46:23.592201+0000","last_clean":"2024-09-10T22:46:23.592201+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:46:23.592201+0000","last_undegraded":"2024-09-10T22:46:23.592201+0000","last_fullsized":"2024-09-10T22:46:23.592201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:38:40.593689+0000","last_clean_scrub_stamp":"2024-09-10T22:38:40.593689+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:59.447157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33104,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338736,"statfs":{"total":96636764160,"available":96602865664,"internally_reserved":0,"allocated":1957888,"data_stored":1224594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32524,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1363968,"data_stored":634226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32520,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1363968,"data_stored":634226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32524,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1363968,"data_stored":634226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32524,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1363968,"data_stored":634226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32520,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1363968,"data_stored":634226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33104,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338736,"statfs":{"total":96636764160,"available":96602865664,"internally_reserved":0,"allocated":1957888,"data_stored":1224594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32524,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1363968,"data_stored":634226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:46:33.400 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T22:38:40.593689+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=22, tm_min=38, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=22, tm_min=46, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T22:46:33.401 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T22:46:47.981 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:46:47.985 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:46:53.402 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:46:53.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.551+0000 7ff78e200640 1 -- 172.21.15.103:0/2039978841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7880cf260 msgr2=0x7ff7880b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:53.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.551+0000 7ff78e200640 1 --2- 172.21.15.103:0/2039978841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7880cf260 0x7ff7880b2c10 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7ff7880b4f10 tx=0x7ff77801c800 comp rx=0 tx=0).stop 2024-09-10T22:46:53.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.551+0000 7ff78e200640 1 -- 172.21.15.103:0/2039978841 shutdown_connections 2024-09-10T22:46:53.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.551+0000 7ff78e200640 1 --2- 172.21.15.103:0/2039978841 >> v2:172.21.15.131:3300/0 conn(0x7ff7880b3150 0x7ff788072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:53.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.551+0000 7ff78e200640 1 --2- 172.21.15.103:0/2039978841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7880cf260 0x7ff7880b2c10 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:53.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.551+0000 7ff78e200640 1 -- 172.21.15.103:0/2039978841 >> 172.21.15.103:0/2039978841 conn(0x7ff78806cc00 msgr2=0x7ff78806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:53.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.551+0000 7ff78e200640 1 -- 172.21.15.103:0/2039978841 shutdown_connections 2024-09-10T22:46:53.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.551+0000 7ff78e200640 1 -- 172.21.15.103:0/2039978841 wait complete. 2024-09-10T22:46:53.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff78e200640 1 Processor -- start 2024-09-10T22:46:53.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff78e200640 1 -- start start 2024-09-10T22:46:53.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff78e200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff788072a40 0x7ff788150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:53.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff78e200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7880b3150 0x7ff788147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:53.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff78e200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7880cf260 0x7ff788155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:53.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff78e200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff78806e800 con 0x7ff788072a40 2024-09-10T22:46:53.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff78e200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff788157e40 con 0x7ff7880b3150 2024-09-10T22:46:53.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff78e200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff78806e980 con 0x7ff7880cf260 2024-09-10T22:46:53.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff787400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff788072a40 0x7ff788150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:53.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff787400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff788072a40 0x7ff788150480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45978/0 (socket says 172.21.15.103:45978) 2024-09-10T22:46:53.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff787400640 1 -- 172.21.15.103:0/194939181 learned_addr learned my addr 172.21.15.103:0/194939181 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:53.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff787400640 1 -- 172.21.15.103:0/194939181 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7880cf260 msgr2=0x7ff788155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:53.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff787400640 1 --2- 172.21.15.103:0/194939181 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7880cf260 0x7ff788155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:53.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff787400640 1 -- 172.21.15.103:0/194939181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7880b3150 msgr2=0x7ff788147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:53.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff77ea00640 1 --2- 172.21.15.103:0/194939181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7880b3150 0x7ff788147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:53.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff787400640 1 --2- 172.21.15.103:0/194939181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7880b3150 0x7ff788147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:53.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff787400640 1 -- 172.21.15.103:0/194939181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7881f88f0 con 0x7ff788072a40 2024-09-10T22:46:53.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff77ea00640 1 --2- 172.21.15.103:0/194939181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7880b3150 0x7ff788147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:46:53.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff787400640 1 --2- 172.21.15.103:0/194939181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff788072a40 0x7ff788150480 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7ff778000c10 tx=0x7ff7780a5690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:53.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff77fe00640 1 -- 172.21.15.103:0/194939181 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7780bb070 con 0x7ff788072a40 2024-09-10T22:46:53.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff77fe00640 1 -- 172.21.15.103:0/194939181 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7780044b0 con 0x7ff788072a40 2024-09-10T22:46:53.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff77fe00640 1 -- 172.21.15.103:0/194939181 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7780b2040 con 0x7ff788072a40 2024-09-10T22:46:53.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff78e200640 1 -- 172.21.15.103:0/194939181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff788147860 con 0x7ff788072a40 2024-09-10T22:46:53.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.555+0000 7ff78e200640 1 -- 172.21.15.103:0/194939181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7881f8e40 con 0x7ff788072a40 2024-09-10T22:46:53.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.559+0000 7ff78e200640 1 -- 172.21.15.103:0/194939181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff788072500 con 0x7ff788072a40 2024-09-10T22:46:53.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.559+0000 7ff77fe00640 1 -- 172.21.15.103:0/194939181 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff7780b5030 con 0x7ff788072a40 2024-09-10T22:46:53.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.559+0000 7ff77fe00640 1 --2- 172.21.15.103:0/194939181 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff7640725e0 0x7ff764074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:53.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.559+0000 7ff77fe00640 1 -- 172.21.15.103:0/194939181 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7ff77812c870 con 0x7ff788072a40 2024-09-10T22:46:53.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.559+0000 7ff77ea00640 1 --2- 172.21.15.103:0/194939181 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff7640725e0 0x7ff764074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:53.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.563+0000 7ff77ea00640 1 --2- 172.21.15.103:0/194939181 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff7640725e0 0x7ff764074aa0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff788157000 tx=0x7ff770008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:53.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.567+0000 7ff77fe00640 1 -- 172.21.15.103:0/194939181 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff7780163f0 con 0x7ff788072a40 2024-09-10T22:46:53.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.727+0000 7ff78e200640 1 -- 172.21.15.103:0/194939181 --> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff78815cc70 con 0x7ff7640725e0 2024-09-10T22:46:53.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.727+0000 7ff77fe00640 1 -- 172.21.15.103:0/194939181 <== mgr.4114 v2:172.21.15.131:6808/1797156177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13364 (secure 0 0 0) 0x7ff78815cc70 con 0x7ff7640725e0 2024-09-10T22:46:53.729 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:53.730 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T22:46:53.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.731+0000 7ff78e200640 1 -- 172.21.15.103:0/194939181 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff7640725e0 msgr2=0x7ff764074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:53.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.731+0000 7ff78e200640 1 --2- 172.21.15.103:0/194939181 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff7640725e0 0x7ff764074aa0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff788157000 tx=0x7ff770008040 comp rx=0 tx=0).stop 2024-09-10T22:46:53.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.731+0000 7ff78e200640 1 -- 172.21.15.103:0/194939181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff788072a40 msgr2=0x7ff788150480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:53.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.731+0000 7ff78e200640 1 --2- 172.21.15.103:0/194939181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff788072a40 0x7ff788150480 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7ff778000c10 tx=0x7ff7780a5690 comp rx=0 tx=0).stop 2024-09-10T22:46:53.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.731+0000 7ff78e200640 1 -- 172.21.15.103:0/194939181 shutdown_connections 2024-09-10T22:46:53.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.731+0000 7ff78e200640 1 --2- 172.21.15.103:0/194939181 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7ff7640725e0 0x7ff764074aa0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:53.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.731+0000 7ff78e200640 1 --2- 172.21.15.103:0/194939181 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7880cf260 0x7ff788155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:53.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.731+0000 7ff78e200640 1 --2- 172.21.15.103:0/194939181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7880b3150 0x7ff788147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:53.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.731+0000 7ff78e200640 1 --2- 172.21.15.103:0/194939181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff788072a40 0x7ff788150480 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:53.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.731+0000 7ff78e200640 1 -- 172.21.15.103:0/194939181 >> 172.21.15.103:0/194939181 conn(0x7ff78806cc00 msgr2=0x7ff788158050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:53.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.731+0000 7ff78e200640 1 -- 172.21.15.103:0/194939181 shutdown_connections 2024-09-10T22:46:53.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.731+0000 7ff78e200640 1 -- 172.21.15.103:0/194939181 wait complete. 2024-09-10T22:46:53.751 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":351,"stamp":"2024-09-10T22:46:51.743987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":261328,"kb_used_data":11816,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713392,"statfs":{"total":773094113280,"available":772826513408,"internally_reserved":0,"allocated":12099584,"data_stored":6254544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002719"},"pg_stats":[{"pgid":"1.0","version":"110'74","reported_seq":286,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-10T22:46:33.848360+0000","last_change":"2024-09-10T22:46:33.848302+0000","last_active":"2024-09-10T22:46:33.848360+0000","last_peered":"2024-09-10T22:46:33.848360+0000","last_clean":"2024-09-10T22:46:33.848360+0000","last_became_active":"2024-09-10T22:38:42.534139+0000","last_became_peered":"2024-09-10T22:38:42.534139+0000","last_unstale":"2024-09-10T22:46:33.848360+0000","last_undegraded":"2024-09-10T22:46:33.848360+0000","last_fullsized":"2024-09-10T22:46:33.848360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'74","last_scrub_stamp":"2024-09-10T22:46:33.848211+0000","last_deep_scrub":"110'74","last_deep_scrub_stamp":"2024-09-10T22:46:33.848211+0000","last_clean_scrub_stamp":"2024-09-10T22:46:33.848211+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:14.577213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33096,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338744,"statfs":{"total":96636764160,"available":96602873856,"internally_reserved":0,"allocated":1957888,"data_stored":1224594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32524,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1363968,"data_stored":634226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32520,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1363968,"data_stored":634226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32524,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1363968,"data_stored":634226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32524,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1363968,"data_stored":634226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32520,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1363968,"data_stored":634226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33096,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338744,"statfs":{"total":96636764160,"available":96602873856,"internally_reserved":0,"allocated":1957888,"data_stored":1224594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32524,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1363968,"data_stored":634226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:46:53.753 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T22:46:53.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.891+0000 7fb72ee00640 1 -- 172.21.15.103:0/697644047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb70c004810 msgr2=0x7fb70c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:53.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.891+0000 7fb72ee00640 1 --2- 172.21.15.103:0/697644047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb70c004810 0x7fb70c004c90 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fb71400c310 tx=0x7fb71401f680 comp rx=0 tx=0).stop 2024-09-10T22:46:53.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.891+0000 7fb72ee00640 1 -- 172.21.15.103:0/697644047 shutdown_connections 2024-09-10T22:46:53.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.891+0000 7fb72ee00640 1 --2- 172.21.15.103:0/697644047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb70c004810 0x7fb70c004c90 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:53.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.891+0000 7fb72ee00640 1 -- 172.21.15.103:0/697644047 >> 172.21.15.103:0/697644047 conn(0x7fb72806cc00 msgr2=0x7fb72806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:53.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.891+0000 7fb72ee00640 1 -- 172.21.15.103:0/697644047 shutdown_connections 2024-09-10T22:46:53.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.891+0000 7fb72ee00640 1 -- 172.21.15.103:0/697644047 wait complete. 2024-09-10T22:46:53.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb72ee00640 1 Processor -- start 2024-09-10T22:46:53.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb72ee00640 1 -- start start 2024-09-10T22:46:53.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb72ee00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb70c004810 0x7fb7281f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:53.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb72ee00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7280afe80 0x7fb72813cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:53.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb72ee00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb72813e020 0x7fb72813e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:53.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb72ee00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb7280b3430 con 0x7fb7280afe80 2024-09-10T22:46:53.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb72ee00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb7280cf800 con 0x7fb70c004810 2024-09-10T22:46:53.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb72ee00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb7280b0e70 con 0x7fb72813e020 2024-09-10T22:46:53.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb727400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7280afe80 0x7fb72813cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:53.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb727400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7280afe80 0x7fb72813cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45990/0 (socket says 172.21.15.103:45990) 2024-09-10T22:46:53.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb727400640 1 -- 172.21.15.103:0/1790691933 learned_addr learned my addr 172.21.15.103:0/1790691933 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:53.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb727400640 1 -- 172.21.15.103:0/1790691933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb72813e020 msgr2=0x7fb72813e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:53.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb727400640 1 --2- 172.21.15.103:0/1790691933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb72813e020 0x7fb72813e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:53.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb727400640 1 -- 172.21.15.103:0/1790691933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb70c004810 msgr2=0x7fb7281f4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:53.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb727400640 1 --2- 172.21.15.103:0/1790691933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb70c004810 0x7fb7281f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:53.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb727400640 1 -- 172.21.15.103:0/1790691933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7280b0300 con 0x7fb7280afe80 2024-09-10T22:46:53.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb727400640 1 --2- 172.21.15.103:0/1790691933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7280afe80 0x7fb72813cf10 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fb71401dd80 tx=0x7fb714003be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:53.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb71fe00640 1 -- 172.21.15.103:0/1790691933 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7140b3070 con 0x7fb7280afe80 2024-09-10T22:46:53.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb71fe00640 1 -- 172.21.15.103:0/1790691933 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb714003dd0 con 0x7fb7280afe80 2024-09-10T22:46:53.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb72ee00640 1 -- 172.21.15.103:0/1790691933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7280b05d0 con 0x7fb7280afe80 2024-09-10T22:46:53.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb71fe00640 1 -- 172.21.15.103:0/1790691933 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb714006c80 con 0x7fb7280afe80 2024-09-10T22:46:53.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb72ee00640 1 -- 172.21.15.103:0/1790691933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7280b0b90 con 0x7fb7280afe80 2024-09-10T22:46:53.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.895+0000 7fb72ee00640 1 -- 172.21.15.103:0/1790691933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb728072970 con 0x7fb7280afe80 2024-09-10T22:46:53.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.899+0000 7fb71fe00640 1 -- 172.21.15.103:0/1790691933 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb7140b9070 con 0x7fb7280afe80 2024-09-10T22:46:53.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.899+0000 7fb71fe00640 1 --2- 172.21.15.103:0/1790691933 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb7080725e0 0x7fb708074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:53.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.899+0000 7fb71fe00640 1 -- 172.21.15.103:0/1790691933 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7fb714130ba0 con 0x7fb7280afe80 2024-09-10T22:46:53.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.899+0000 7fb727e00640 1 --2- 172.21.15.103:0/1790691933 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb7080725e0 0x7fb708074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:53.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.899+0000 7fb727e00640 1 --2- 172.21.15.103:0/1790691933 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb7080725e0 0x7fb708074aa0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb718000c10 tx=0x7fb718006930 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:53.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:53.903+0000 7fb71fe00640 1 -- 172.21.15.103:0/1790691933 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb7140ab070 con 0x7fb7280afe80 2024-09-10T22:46:54.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.067+0000 7fb72ee00640 1 -- 172.21.15.103:0/1790691933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fb728142090 con 0x7fb7280afe80 2024-09-10T22:46:54.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.071+0000 7fb71fe00640 1 -- 172.21.15.103:0/1790691933 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v40)=0 v40) ==== 123+0+0 (secure 0 0 0) 0x7fb714019430 con 0x7fb7280afe80 2024-09-10T22:46:54.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.071+0000 7fb71fe00640 1 -- 172.21.15.103:0/1790691933 <== mon.0 v2:172.21.15.103:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fb714136080 con 0x7fb7280afe80 2024-09-10T22:46:54.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.075+0000 7fb72ee00640 1 -- 172.21.15.103:0/1790691933 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb7080725e0 msgr2=0x7fb708074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:54.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.075+0000 7fb72ee00640 1 --2- 172.21.15.103:0/1790691933 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb7080725e0 0x7fb708074aa0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb718000c10 tx=0x7fb718006930 comp rx=0 tx=0).stop 2024-09-10T22:46:54.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.075+0000 7fb72ee00640 1 -- 172.21.15.103:0/1790691933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7280afe80 msgr2=0x7fb72813cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:54.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.075+0000 7fb72ee00640 1 --2- 172.21.15.103:0/1790691933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7280afe80 0x7fb72813cf10 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fb71401dd80 tx=0x7fb714003be0 comp rx=0 tx=0).stop 2024-09-10T22:46:54.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.075+0000 7fb72ee00640 1 -- 172.21.15.103:0/1790691933 shutdown_connections 2024-09-10T22:46:54.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.075+0000 7fb72ee00640 1 --2- 172.21.15.103:0/1790691933 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7fb7080725e0 0x7fb708074aa0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:54.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.075+0000 7fb72ee00640 1 --2- 172.21.15.103:0/1790691933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb72813e020 0x7fb72813e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:54.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.075+0000 7fb72ee00640 1 --2- 172.21.15.103:0/1790691933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7280afe80 0x7fb72813cf10 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:54.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.075+0000 7fb72ee00640 1 --2- 172.21.15.103:0/1790691933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb70c004810 0x7fb7281f4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:54.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.075+0000 7fb72ee00640 1 -- 172.21.15.103:0/1790691933 >> 172.21.15.103:0/1790691933 conn(0x7fb72806cc00 msgr2=0x7fb72815ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:54.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.075+0000 7fb72ee00640 1 -- 172.21.15.103:0/1790691933 shutdown_connections 2024-09-10T22:46:54.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.075+0000 7fb72ee00640 1 -- 172.21.15.103:0/1790691933 wait complete. 2024-09-10T22:46:54.094 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T22:46:54.094 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T22:46:54.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.235+0000 7f1d74800640 1 -- 172.21.15.103:0/1041285692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d6c0b3150 msgr2=0x7f1d6c072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:54.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.235+0000 7f1d74800640 1 --2- 172.21.15.103:0/1041285692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d6c0b3150 0x7f1d6c072500 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0d0150 tx=0x7f1d5c01dbf0 comp rx=0 tx=0).stop 2024-09-10T22:46:54.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.235+0000 7f1d74800640 1 -- 172.21.15.103:0/1041285692 shutdown_connections 2024-09-10T22:46:54.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.235+0000 7f1d74800640 1 --2- 172.21.15.103:0/1041285692 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d6c072a40 0x7f1d6c157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:54.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.235+0000 7f1d74800640 1 --2- 172.21.15.103:0/1041285692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d6c0b3150 0x7f1d6c072500 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:54.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.235+0000 7f1d74800640 1 --2- 172.21.15.103:0/1041285692 >> v2:172.21.15.131:3300/0 conn(0x7f1d6c0cf260 0x7f1d6c0b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:54.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.235+0000 7f1d74800640 1 -- 172.21.15.103:0/1041285692 >> 172.21.15.103:0/1041285692 conn(0x7f1d6c06cc00 msgr2=0x7f1d6c06d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:54.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.235+0000 7f1d74800640 1 -- 172.21.15.103:0/1041285692 shutdown_connections 2024-09-10T22:46:54.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.235+0000 7f1d74800640 1 -- 172.21.15.103:0/1041285692 wait complete. 2024-09-10T22:46:54.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d74800640 1 Processor -- start 2024-09-10T22:46:54.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d74800640 1 -- start start 2024-09-10T22:46:54.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d74800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d6c072a40 0x7f1d6c0b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:54.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d74800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d6c0b3150 0x7f1d6c0aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:54.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d74800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d6c0cf260 0x7f1d6c1486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:54.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d74800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6c157d20 con 0x7f1d6c072a40 2024-09-10T22:46:54.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d74800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6c157ba0 con 0x7f1d6c0b3150 2024-09-10T22:46:54.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d74800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1d6c157ea0 con 0x7f1d6c0cf260 2024-09-10T22:46:54.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d71e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d6c072a40 0x7f1d6c0b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:54.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d71e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d6c072a40 0x7f1d6c0b0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46014/0 (socket says 172.21.15.103:46014) 2024-09-10T22:46:54.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d71e00640 1 -- 172.21.15.103:0/621755562 learned_addr learned my addr 172.21.15.103:0/621755562 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T22:46:54.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d72800640 1 --2- 172.21.15.103:0/621755562 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d6c0cf260 0x7f1d6c1486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:54.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d71400640 1 --2- 172.21.15.103:0/621755562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d6c0b3150 0x7f1d6c0aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:54.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d71e00640 1 -- 172.21.15.103:0/621755562 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d6c0cf260 msgr2=0x7f1d6c1486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:54.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d71e00640 1 --2- 172.21.15.103:0/621755562 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d6c0cf260 0x7f1d6c1486c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:54.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d71e00640 1 -- 172.21.15.103:0/621755562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d6c0b3150 msgr2=0x7f1d6c0aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:54.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d71e00640 1 --2- 172.21.15.103:0/621755562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d6c0b3150 0x7f1d6c0aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:54.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d71e00640 1 -- 172.21.15.103:0/621755562 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6c0af3a0 con 0x7f1d6c072a40 2024-09-10T22:46:54.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d71e00640 1 --2- 172.21.15.103:0/621755562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d6c072a40 0x7f1d6c0b0140 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000ca20 tx=0x7f1d6000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:54.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d66000640 1 -- 172.21.15.103:0/621755562 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d60007c70 con 0x7f1d6c072a40 2024-09-10T22:46:54.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d66000640 1 -- 172.21.15.103:0/621755562 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f1d6000f450 con 0x7f1d6c072a40 2024-09-10T22:46:54.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d74800640 1 -- 172.21.15.103:0/621755562 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d6c0ae370 con 0x7f1d6c072a40 2024-09-10T22:46:54.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d66000640 1 -- 172.21.15.103:0/621755562 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000f8c0 con 0x7f1d6c072a40 2024-09-10T22:46:54.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.239+0000 7f1d74800640 1 -- 172.21.15.103:0/621755562 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d6c0af940 con 0x7f1d6c072a40 2024-09-10T22:46:54.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.243+0000 7f1d74800640 1 -- 172.21.15.103:0/621755562 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d6c072500 con 0x7f1d6c072a40 2024-09-10T22:46:54.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.243+0000 7f1d66000640 1 -- 172.21.15.103:0/621755562 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1d60020030 con 0x7f1d6c072a40 2024-09-10T22:46:54.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.243+0000 7f1d66000640 1 --2- 172.21.15.103:0/621755562 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1d500725e0 0x7f1d50074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:46:54.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.243+0000 7f1d66000640 1 -- 172.21.15.103:0/621755562 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5507+0+0 (secure 0 0 0) 0x7f1d60093780 con 0x7f1d6c072a40 2024-09-10T22:46:54.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.243+0000 7f1d71400640 1 --2- 172.21.15.103:0/621755562 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1d500725e0 0x7f1d50074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:46:54.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.243+0000 7f1d71400640 1 --2- 172.21.15.103:0/621755562 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1d500725e0 0x7f1d50074aa0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0b0000 tx=0x7f1d5c01a990 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:46:54.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.247+0000 7f1d66000640 1 -- 172.21.15.103:0/621755562 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1d60014030 con 0x7f1d6c072a40 2024-09-10T22:46:54.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.447+0000 7f1d74800640 1 -- 172.21.15.103:0/621755562 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d6c155a20 con 0x7f1d6c072a40 2024-09-10T22:46:54.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.447+0000 7f1d66000640 1 -- 172.21.15.103:0/621755562 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+3922 (secure 0 0 0) 0x7f1d6005ee80 con 0x7f1d6c072a40 2024-09-10T22:46:54.449 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T22:46:54.450 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":119,"btime":"2024-09-10T22:46:21:421928+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6983,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/519341200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":519341200},{"type":"v1","addr":"172.21.15.131:6836","nonce":519341200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":8440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3162161428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":3162161428},{"type":"v1","addr":"172.21.15.131:6837","nonce":3162161428}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119},{"gid":9039,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/723089577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":723089577},{"type":"v1","addr":"172.21.15.103:6833","nonce":723089577}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119},{"gid":9042,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1141196218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1141196218},{"type":"v1","addr":"172.21.15.103:6835","nonce":1141196218}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[]} 2024-09-10T22:46:54.450 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 119 2024-09-10T22:46:54.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.451+0000 7f1d74800640 1 -- 172.21.15.103:0/621755562 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1d500725e0 msgr2=0x7f1d50074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:54.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.451+0000 7f1d74800640 1 --2- 172.21.15.103:0/621755562 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1d500725e0 0x7f1d50074aa0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0b0000 tx=0x7f1d5c01a990 comp rx=0 tx=0).stop 2024-09-10T22:46:54.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.451+0000 7f1d74800640 1 -- 172.21.15.103:0/621755562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d6c072a40 msgr2=0x7f1d6c0b0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:46:54.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.451+0000 7f1d74800640 1 --2- 172.21.15.103:0/621755562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d6c072a40 0x7f1d6c0b0140 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000ca20 tx=0x7f1d6000cee0 comp rx=0 tx=0).stop 2024-09-10T22:46:54.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.451+0000 7f1d74800640 1 -- 172.21.15.103:0/621755562 shutdown_connections 2024-09-10T22:46:54.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.451+0000 7f1d74800640 1 --2- 172.21.15.103:0/621755562 >> [v2:172.21.15.131:6808/1797156177,v1:172.21.15.131:6809/1797156177] conn(0x7f1d500725e0 0x7f1d50074aa0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:54.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.451+0000 7f1d74800640 1 --2- 172.21.15.103:0/621755562 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d6c0cf260 0x7f1d6c1486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:54.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.451+0000 7f1d74800640 1 --2- 172.21.15.103:0/621755562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d6c0b3150 0x7f1d6c0aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:54.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.451+0000 7f1d74800640 1 --2- 172.21.15.103:0/621755562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d6c072a40 0x7f1d6c0b0140 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:46:54.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.451+0000 7f1d74800640 1 -- 172.21.15.103:0/621755562 >> 172.21.15.103:0/621755562 conn(0x7f1d6c06cc00 msgr2=0x7f1d6c0b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:46:54.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.451+0000 7f1d74800640 1 -- 172.21.15.103:0/621755562 shutdown_connections 2024-09-10T22:46:54.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T22:46:54.451+0000 7f1d74800640 1 -- 172.21.15.103:0/621755562 wait complete. 2024-09-10T22:46:54.470 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-10T22:46:54.470 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T22:46:54.471 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T22:46:54.471 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:46:54.483 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T22:46:54.483 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T22:46:54.483 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:46:54.539 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T22:46:54.539 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T22:46:54.539 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:46:54.553 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T22:46:54.553 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T22:46:54.553 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:46:54.609 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T22:46:54.609 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T22:46:54.609 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T22:46:54.609 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:46:54.683 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T22:46:54.683 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T22:46:54.684 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:46:54.773 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T22:46:54.774 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T22:46:54.774 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:46:54.865 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T22:46:54.866 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T22:46:54.866 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:46:56.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-10T22:47:00.968 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T22:47:00.968 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-10T22:47:00.969 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:47:01.036 INFO:tasks.ceph.osd.4:Stopped 2024-09-10T22:47:01.037 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-10T22:47:01.037 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:47:01.127 INFO:tasks.ceph.osd.5:Stopped 2024-09-10T22:47:01.128 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-10T22:47:01.128 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:47:01.842 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-10T22:47:07.230 INFO:tasks.ceph.osd.6:Stopped 2024-09-10T22:47:07.230 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-10T22:47:07.231 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:47:07.291 INFO:tasks.ceph.osd.7:Stopped 2024-09-10T22:47:07.292 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T22:47:07.292 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-10T22:47:07.292 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:47:07.351 INFO:tasks.ceph.mgr.y:Stopped 2024-09-10T22:47:07.351 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T22:47:07.351 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:47:07.412 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-10T22:47:07.412 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-09-10T22:47:07.412 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T22:47:07.413 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T22:47:07.413 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T22:47:07.413 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:47:07.432 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T22:47:07.432 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T22:47:07.433 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:47:07.448 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T22:47:07.448 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T22:47:07.448 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T22:47:07.510 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T22:47:07.511 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T22:47:07.511 DEBUG:teuthology.orchestra.run.smithi103:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Scrub error on inode' | head -n 1 2024-09-10T22:47:07.547 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:47:07.547 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T22:47:07.718 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:47:07.718 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T22:47:07.930 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:47:07.931 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T22:47:08.075 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:47:08.075 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T22:47:08.207 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-10T22:47:08.207 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-10T22:47:08.500 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-10T22:47:08.500 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-10T22:47:08.703 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-10T22:47:08.704 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-10T22:47:08.903 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-10T22:47:08.903 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-10T22:47:09.094 INFO:tasks.ceph:Archiving mon data... 2024-09-10T22:47:09.096 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899733/data/mon.a.tgz 2024-09-10T22:47:09.096 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-09-10T22:47:09.105 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.4GvqlYsZZj 2024-09-10T22:47:09.105 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.4GvqlYsZZj 2024-09-10T22:47:09.263 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.4GvqlYsZZj 2024-09-10T22:47:09.343 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.4GvqlYsZZj is 480KB 2024-09-10T22:47:09.409 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.4GvqlYsZZj 2024-09-10T22:47:09.417 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899733/data/mon.b.tgz 2024-09-10T22:47:09.417 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-09-10T22:47:09.425 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.635PsP2aDD 2024-09-10T22:47:09.426 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.635PsP2aDD 2024-09-10T22:47:09.591 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.635PsP2aDD 2024-09-10T22:47:09.666 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.635PsP2aDD is 491KB 2024-09-10T22:47:09.729 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.635PsP2aDD 2024-09-10T22:47:09.737 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899733/data/mon.c.tgz 2024-09-10T22:47:09.737 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-09-10T22:47:09.786 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.wdE2V5bOWi 2024-09-10T22:47:09.786 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.wdE2V5bOWi 2024-09-10T22:47:09.941 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.wdE2V5bOWi 2024-09-10T22:47:10.019 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.wdE2V5bOWi is 491KB 2024-09-10T22:47:10.083 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.wdE2V5bOWi 2024-09-10T22:47:10.091 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T22:47:10.091 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T22:47:10.095 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T22:47:10.165 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T22:47:10.210 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T22:47:10.211 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T22:47:10.212 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899733/remote/smithi103/crash 2024-09-10T22:47:10.213 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T22:47:10.234 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899733/remote/smithi131/crash 2024-09-10T22:47:10.235 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T22:47:10.272 INFO:tasks.ceph:Shutting down logrotate 2024-09-10T22:47:10.272 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:47:10.281 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T22:47:10.377 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T22:47:10.397 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T22:47:10.416 INFO:tasks.ceph:Compressing logs... 2024-09-10T22:47:10.416 DEBUG:teuthology.orchestra.run.smithi103:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T22:47:10.441 DEBUG:teuthology.orchestra.run.smithi131:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T22:47:10.467 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42078.log 2024-09-10T22:47:10.468 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49797.log 2024-09-10T22:47:10.469 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49960.log 2024-09-10T22:47:10.469 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42078.log.gz 2024-09-10T22:47:10.470 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47595.log 2024-09-10T22:47:10.470 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49797.log.gz 2024-09-10T22:47:10.471 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44979.log 2024-09-10T22:47:10.472 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47595.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.49960.log.gz 2024-09-10T22:47:10.472 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38774.log 2024-09-10T22:47:10.472 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47595.log.gz 2024-09-10T22:47:10.472 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44742.log 2024-09-10T22:47:10.473 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44979.log.gz 2024-09-10T22:47:10.473 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45618.log 2024-09-10T22:47:10.474 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38774.log.gz 2024-09-10T22:47:10.474 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44742.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.44742.log.gz 2024-09-10T22:47:10.474 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40123.log 2024-09-10T22:47:10.475 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37618.log 2024-09-10T22:47:10.476 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45618.log.gz 2024-09-10T22:47:10.476 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51517.log 2024-09-10T22:47:10.476 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40123.log.gz 2024-09-10T22:47:10.477 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51694.log 2024-09-10T22:47:10.477 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37618.log.gz 2024-09-10T22:47:10.478 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48524.log 2024-09-10T22:47:10.478 INFO:teuthology.orchestra.run.smithi103.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51517.log.gz 2024-09-10T22:47:10.479 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46577.log 2024-09-10T22:47:10.479 INFO:teuthology.orchestra.run.smithi103.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51694.log.gz 2024-09-10T22:47:10.480 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38884.log 2024-09-10T22:47:10.480 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48524.log.gz 2024-09-10T22:47:10.481 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.46577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38532.log 2024-09-10T22:47:10.481 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39156.log 2024-09-10T22:47:10.481 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38884.log.gz 2024-09-10T22:47:10.482 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34780.log 2024-09-10T22:47:10.483 INFO:teuthology.orchestra.run.smithi103.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.38532.log.gz 2024-09-10T22:47:10.483 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45573.log 2024-09-10T22:47:10.484 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39156.log.gz 2024-09-10T22:47:10.484 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41452.log 2024-09-10T22:47:10.484 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34780.log.gz 2024-09-10T22:47:10.485 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51022.log 2024-09-10T22:47:10.485 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45573.log.gz 2024-09-10T22:47:10.486 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41452.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-10T22:47:10.486 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41452.log.gz 2024-09-10T22:47:10.487 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38200.log 2024-09-10T22:47:10.487 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51022.log.gz 2024-09-10T22:47:10.488 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46393.log 2024-09-10T22:47:10.488 INFO:teuthology.orchestra.run.smithi103.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.46577.log.gz 2024-09-10T22:47:10.489 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39877.log 2024-09-10T22:47:10.489 INFO:teuthology.orchestra.run.smithi103.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.38200.log.gz 2024-09-10T22:47:10.490 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50620.log 2024-09-10T22:47:10.490 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46393.log.gz 2024-09-10T22:47:10.490 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36711.log 2024-09-10T22:47:10.490 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39877.log.gz 2024-09-10T22:47:10.491 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45644.log 2024-09-10T22:47:10.492 INFO:teuthology.orchestra.run.smithi103.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.50620.log.gz 2024-09-10T22:47:10.492 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44040.log 2024-09-10T22:47:10.492 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36711.log.gz 2024-09-10T22:47:10.493 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38910.log 2024-09-10T22:47:10.493 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45644.log.gz 2024-09-10T22:47:10.494 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50060.log 2024-09-10T22:47:10.494 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44040.log.gz 2024-09-10T22:47:10.494 INFO:teuthology.orchestra.run.smithi103.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-10T22:47:10.495 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41426.log 2024-09-10T22:47:10.495 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38910.log.gz 2024-09-10T22:47:10.496 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46102.log 2024-09-10T22:47:10.496 INFO:teuthology.orchestra.run.smithi103.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.50060.log.gz 2024-09-10T22:47:10.496 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39182.log 2024-09-10T22:47:10.497 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41426.log.gz 2024-09-10T22:47:10.497 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42710.log 2024-09-10T22:47:10.497 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46102.log.gz 2024-09-10T22:47:10.498 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36124.log 2024-09-10T22:47:10.498 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39182.log.gz 2024-09-10T22:47:10.499 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42710.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42710.log.gz 2024-09-10T22:47:10.499 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44240.log 2024-09-10T22:47:10.500 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47288.log 2024-09-10T22:47:10.500 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36124.log.gz 2024-09-10T22:47:10.501 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43508.log 2024-09-10T22:47:10.502 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44240.log.gz 2024-09-10T22:47:10.502 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36738.log 2024-09-10T22:47:10.503 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43508.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.47288.log.gz 2024-09-10T22:47:10.503 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41322.log 2024-09-10T22:47:10.503 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43508.log.gz 2024-09-10T22:47:10.504 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45670.log 2024-09-10T22:47:10.504 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36738.log.gz 2024-09-10T22:47:10.504 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28905.log 2024-09-10T22:47:10.505 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42104.log 2024-09-10T22:47:10.505 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41322.log.gz 2024-09-10T22:47:10.507 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50972.log 2024-09-10T22:47:10.507 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45670.log.gz 2024-09-10T22:47:10.507 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34832.log 2024-09-10T22:47:10.507 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42104.log.gz 2024-09-10T22:47:10.507 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35203.log 2024-09-10T22:47:10.508 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-10T22:47:10.508 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.28905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29032.log 2024-09-10T22:47:10.508 INFO:teuthology.orchestra.run.smithi131.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.28905.log.gz 2024-09-10T22:47:10.508 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28953.log 2024-09-10T22:47:10.508 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.29032.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-10T22:47:10.508 INFO:teuthology.orchestra.run.smithi131.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29032.log.gz 2024-09-10T22:47:10.508 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.28953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28977.log 2024-09-10T22:47:10.509 INFO:teuthology.orchestra.run.smithi131.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.28953.log.gz 2024-09-10T22:47:10.511 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29001.log 2024-09-10T22:47:10.511 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.28977.log: gzip 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28977.log.gz 2024-09-10T22:47:10.511 INFO:teuthology.orchestra.run.smithi131.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-10T22:47:10.511 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.29001.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T22:47:10.511 INFO:teuthology.orchestra.run.smithi131.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29001.log.gz 2024-09-10T22:47:10.513 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34832.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50972.log.gz 2024-09-10T22:47:10.513 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41776.log 2024-09-10T22:47:10.513 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34832.log.gz 2024-09-10T22:47:10.513 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41023.log 2024-09-10T22:47:10.513 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35203.log.gz 2024-09-10T22:47:10.513 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39642.log 2024-09-10T22:47:10.513 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41776.log.gz 2024-09-10T22:47:10.513 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35687.log 2024-09-10T22:47:10.513 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41023.log.gz 2024-09-10T22:47:10.513 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47438.log 2024-09-10T22:47:10.513 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39642.log.gz 2024-09-10T22:47:10.513 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43884.log 2024-09-10T22:47:10.513 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35687.log.gz 2024-09-10T22:47:10.514 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40423.log 2024-09-10T22:47:10.516 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T22:47:10.516 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-10T22:47:10.516 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28929.log 2024-09-10T22:47:10.516 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29080.log 2024-09-10T22:47:10.516 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.28929.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.28929.log.gz 2024-09-10T22:47:10.517 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43884.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47438.log.gz 2024-09-10T22:47:10.517 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34486.log 2024-09-10T22:47:10.517 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43884.log.gz 2024-09-10T22:47:10.517 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50264.log 2024-09-10T22:47:10.518 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.40423.log.gz 2024-09-10T22:47:10.518 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42186.log 2024-09-10T22:47:10.518 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34486.log.gz 2024-09-10T22:47:10.518 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50264.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50264.log.gz 2024-09-10T22:47:10.518 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T22:47:10.518 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34027.log 2024-09-10T22:47:10.518 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42186.log.gz 2024-09-10T22:47:10.518 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47647.log 2024-09-10T22:47:10.519 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.29080.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T22:47:10.519 INFO:teuthology.orchestra.run.smithi131.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29080.log.gz 2024-09-10T22:47:10.520 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.34880.log 2024-09-10T22:47:10.520 INFO:teuthology.orchestra.run.smithi131.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T22:47:10.520 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-10T22:47:10.520 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48114.log 2024-09-10T22:47:10.521 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34027.log.gz 2024-09-10T22:47:10.521 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44455.log 2024-09-10T22:47:10.521 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47647.log.gz 2024-09-10T22:47:10.521 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50520.log 2024-09-10T22:47:10.521 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48114.log.gz 2024-09-10T22:47:10.522 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.3.34880.log: 87.4% -- replaced with /var/log/ceph/ceph-client.3.34880.log.gz 2024-09-10T22:47:10.522 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42366.log 2024-09-10T22:47:10.522 INFO:teuthology.orchestra.run.smithi103.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44455.log.gz 2024-09-10T22:47:10.522 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39616.log 2024-09-10T22:47:10.523 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42366.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50520.log.gz 2024-09-10T22:47:10.523 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38962.log 2024-09-10T22:47:10.523 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42366.log.gz 2024-09-10T22:47:10.524 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mds.d.log: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T22:47:10.524 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29056.log 2024-09-10T22:47:10.524 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48933.log 2024-09-10T22:47:10.524 INFO:teuthology.orchestra.run.smithi103.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39616.log.gz 2024-09-10T22:47:10.524 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46941.log 2024-09-10T22:47:10.524 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38962.log.gz 2024-09-10T22:47:10.526 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-10T22:47:10.526 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.29056.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29056.log.gz 2024-09-10T22:47:10.527 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46236.log 2024-09-10T22:47:10.527 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48933.log.gz 2024-09-10T22:47:10.527 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43241.log 2024-09-10T22:47:10.527 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46236.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46941.log.gz 2024-09-10T22:47:10.527 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46366.log 2024-09-10T22:47:10.527 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46236.log.gz 2024-09-10T22:47:10.527 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46690.log 2024-09-10T22:47:10.528 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46366.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.43241.log.gz 2024-09-10T22:47:10.528 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36496.log 2024-09-10T22:47:10.528 INFO:teuthology.orchestra.run.smithi103.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46366.log.gz 2024-09-10T22:47:10.529 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39586.log 2024-09-10T22:47:10.529 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46690.log.gz 2024-09-10T22:47:10.530 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36548.log 2024-09-10T22:47:10.530 INFO:teuthology.orchestra.run.smithi103.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36496.log.gz 2024-09-10T22:47:10.531 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-10T22:47:10.531 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35333.log 2024-09-10T22:47:10.531 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39586.log.gz 2024-09-10T22:47:10.532 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40011.log 2024-09-10T22:47:10.532 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36548.log.gz 2024-09-10T22:47:10.533 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34761.log 2024-09-10T22:47:10.533 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-10T22:47:10.534 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35333.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35333.log.gz 2024-09-10T22:47:10.534 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34676.log 2024-09-10T22:47:10.534 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.40011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36037.log 2024-09-10T22:47:10.535 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36626.log 2024-09-10T22:47:10.535 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34676.log.gz 2024-09-10T22:47:10.535 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.1.34761.log: 88.1% -- replaced with /var/log/ceph/ceph-client.1.34761.log.gz 2024-09-10T22:47:10.536 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34540.log 2024-09-10T22:47:10.536 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36037.log.gz 2024-09-10T22:47:10.536 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29375.log 87.4% 2024-09-10T22:47:10.537 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36626.log.gz 2024-09-10T22:47:10.537 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49388.log 2024-09-10T22:47:10.538 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34540.log.gz 2024-09-10T22:47:10.539 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29375.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29375.log.gz 2024-09-10T22:47:10.539 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51980.log 2024-09-10T22:47:10.539 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41127.log 2024-09-10T22:47:10.540 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51980.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.49388.log.gz 2024-09-10T22:47:10.541 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50470.log 2024-09-10T22:47:10.541 INFO:teuthology.orchestra.run.smithi103.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51980.log.gz 2024-09-10T22:47:10.541 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49910.log 2024-09-10T22:47:10.541 INFO:teuthology.orchestra.run.smithi103.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.40011.log.gz 2024-09-10T22:47:10.542 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41127.log.gz 2024-09-10T22:47:10.542 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41841.log 2024-09-10T22:47:10.543 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49910.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.50470.log.gz 2024-09-10T22:47:10.543 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49143.log 2024-09-10T22:47:10.544 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49910.log.gz 2024-09-10T22:47:10.544 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40644.log 2024-09-10T22:47:10.544 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41841.log.gz 2024-09-10T22:47:10.545 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35437.log 2024-09-10T22:47:10.546 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40644.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49143.log.gz 2024-09-10T22:47:10.546 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40873.log 2024-09-10T22:47:10.546 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40644.log.gz 2024-09-10T22:47:10.547 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44066.log 2024-09-10T22:47:10.547 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35437.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35437.log.gz 2024-09-10T22:47:10.548 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40094.log 2024-09-10T22:47:10.548 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44066.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.40873.log.gz 2024-09-10T22:47:10.549 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44066.log.gz 2024-09-10T22:47:10.549 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41906.log 2024-09-10T22:47:10.549 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50290.log 2024-09-10T22:47:10.550 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40094.log.gz 2024-09-10T22:47:10.550 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29321.log 2024-09-10T22:47:10.550 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41906.log.gz 2024-09-10T22:47:10.551 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49841.log 2024-09-10T22:47:10.551 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50290.log.gz 2024-09-10T22:47:10.552 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45495.log 2024-09-10T22:47:10.552 INFO:teuthology.orchestra.run.smithi103.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29321.log.gz 2024-09-10T22:47:10.553 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36063.log 2024-09-10T22:47:10.553 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49841.log.gz 2024-09-10T22:47:10.554 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41348.log 2024-09-10T22:47:10.554 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45495.log.gz 2024-09-10T22:47:10.554 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47697.log 2024-09-10T22:47:10.555 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41348.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.36063.log.gz 2024-09-10T22:47:10.556 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50822.log 2024-09-10T22:47:10.556 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41348.log.gz 2024-09-10T22:47:10.556 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42837.log 2024-09-10T22:47:10.557 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50822.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47697.log.gz 2024-09-10T22:47:10.557 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43398.log 2024-09-10T22:47:10.558 INFO:teuthology.orchestra.run.smithi103.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50822.log.gz 2024-09-10T22:47:10.558 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35488.log 2024-09-10T22:47:10.559 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42837.log.gz 2024-09-10T22:47:10.559 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34420.log 2024-09-10T22:47:10.559 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43398.log.gz 2024-09-10T22:47:10.560 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36574.log 2024-09-10T22:47:10.560 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35488.log.gz 2024-09-10T22:47:10.561 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39078.log 2024-09-10T22:47:10.561 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34420.log.gz 2024-09-10T22:47:10.561 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45802.log 2024-09-10T22:47:10.562 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36574.log.gz 2024-09-10T22:47:10.562 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35121.log 87.0% 2024-09-10T22:47:10.562 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39078.log.gz 2024-09-10T22:47:10.563 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48576.log 2024-09-10T22:47:10.564 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45802.log.gz 2024-09-10T22:47:10.564 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45696.log 2024-09-10T22:47:10.564 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35121.log.gz 2024-09-10T22:47:10.565 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37700.log 2024-09-10T22:47:10.565 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48576.log.gz 2024-09-10T22:47:10.566 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41568.log 87.7% 2024-09-10T22:47:10.566 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45696.log.gz 2024-09-10T22:47:10.567 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47977.log 2024-09-10T22:47:10.567 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37700.log.gz 2024-09-10T22:47:10.567 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41568.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41568.log.gz 2024-09-10T22:47:10.567 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45722.log 2024-09-10T22:47:10.568 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41809.log 2024-09-10T22:47:10.569 INFO:teuthology.orchestra.run.smithi103.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47977.log.gz 2024-09-10T22:47:10.569 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45722.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45722.log.gz -5 2024-09-10T22:47:10.569 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43806.log 2024-09-10T22:47:10.570 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47951.log 2024-09-10T22:47:10.570 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41809.log.gz 2024-09-10T22:47:10.571 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29037.log 2024-09-10T22:47:10.571 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43806.log.gz 2024-09-10T22:47:10.572 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47951.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T22:47:10.572 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47951.log.gz 2024-09-10T22:47:10.572 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43341.log 2024-09-10T22:47:10.573 INFO:teuthology.orchestra.run.smithi103.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29037.log.gz 2024-09-10T22:47:10.573 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29011.log 2024-09-10T22:47:10.574 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49538.log 2024-09-10T22:47:10.575 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29011.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.43341.log.gz 2024-09-10T22:47:10.575 INFO:teuthology.orchestra.run.smithi103.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29011.log.gz 2024-09-10T22:47:10.575 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48758.log 2024-09-10T22:47:10.576 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49885.log 2024-09-10T22:47:10.577 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49538.log: /var/log/ceph/ceph-client.admin.48758.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.48813.log -- replaced with /var/log/ceph/ceph-client.admin.49538.log.gz 2024-09-10T22:47:10.577 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-10T22:47:10.577 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48758.log.gz 2024-09-10T22:47:10.578 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41153.log 2024-09-10T22:47:10.578 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49885.log.gz 2024-09-10T22:47:10.579 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47621.log 2024-09-10T22:47:10.579 INFO:teuthology.orchestra.run.smithi103.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.48813.log.gz 2024-09-10T22:47:10.580 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40149.log 2024-09-10T22:47:10.580 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41153.log.gz 2024-09-10T22:47:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37010.log 2024-09-10T22:47:10.581 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47621.log.gz 2024-09-10T22:47:10.582 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51824.log 2024-09-10T22:47:10.582 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.40149.log.gz 2024-09-10T22:47:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38417.log 2024-09-10T22:47:10.583 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37010.log.gz 2024-09-10T22:47:10.584 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51824.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51824.log.gz 2024-09-10T22:47:10.584 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49361.log 2024-09-10T22:47:10.585 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49117.log 2024-09-10T22:47:10.585 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49361.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.38417.log.gz 2024-09-10T22:47:10.586 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38074.log 2024-09-10T22:47:10.586 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49361.log.gz 2024-09-10T22:47:10.587 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37345.log 2024-09-10T22:47:10.587 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49117.log.gz 2024-09-10T22:47:10.587 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34387.log 2024-09-10T22:47:10.588 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38074.log.gz 2024-09-10T22:47:10.588 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37345.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37345.log.gz 2024-09-10T22:47:10.589 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35931.log 2024-09-10T22:47:10.589 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51595.log 2024-09-10T22:47:10.590 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34387.log.gz 2024-09-10T22:47:10.590 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35931.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35931.log.gz 2024-09-10T22:47:10.590 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49775.log 2024-09-10T22:47:10.591 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51595.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T22:47:10.592 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51595.log.gz 2024-09-10T22:47:10.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48146.log 2024-09-10T22:47:10.593 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49775.log.gz 2024-09-10T22:47:10.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46716.log 2024-09-10T22:47:10.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51269.log 2024-09-10T22:47:10.595 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48146.log.gz 2024-09-10T22:47:10.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46991.log 2024-09-10T22:47:10.596 INFO:teuthology.orchestra.run.smithi103.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46716.log.gz 2024-09-10T22:47:10.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42660.log 2024-09-10T22:47:10.597 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51269.log.gz 2024-09-10T22:47:10.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48877.log 2024-09-10T22:47:10.598 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46991.log.gz 2024-09-10T22:47:10.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35699.log 2024-09-10T22:47:10.599 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42660.log.gz 2024-09-10T22:47:10.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38482.log 2024-09-10T22:47:10.600 INFO:teuthology.orchestra.run.smithi103.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.48877.log.gz 2024-09-10T22:47:10.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43832.log 2024-09-10T22:47:10.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35699.log: /var/log/ceph/ceph-client.admin.38482.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35699.log.gz 2024-09-10T22:47:10.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41179.log 2024-09-10T22:47:10.602 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.38482.log.gz 2024-09-10T22:47:10.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35036.log 2024-09-10T22:47:10.603 INFO:teuthology.orchestra.run.smithi103.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43832.log.gz 2024-09-10T22:47:10.604 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37114.log 2024-09-10T22:47:10.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41179.log: /var/log/ceph/ceph-client.admin.35036.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41179.log.gz 2024-09-10T22:47:10.605 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40373.log 2024-09-10T22:47:10.606 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44583.log 2024-09-10T22:47:10.606 INFO:teuthology.orchestra.run.smithi103.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.35036.log.gz 2024-09-10T22:47:10.606 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37114.log.gz 2024-09-10T22:47:10.607 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41620.log 2024-09-10T22:47:10.608 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44583.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.40373.log.gz 2024-09-10T22:47:10.608 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39293.log 2024-09-10T22:47:10.608 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44583.log.gz 2024-09-10T22:47:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46010.log 2024-09-10T22:47:10.609 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41620.log.gz 2024-09-10T22:47:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37036.log 2024-09-10T22:47:10.611 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39293.log.gz 2024-09-10T22:47:10.611 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43754.log 2024-09-10T22:47:10.611 INFO:teuthology.orchestra.run.smithi103.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46010.log.gz 2024-09-10T22:47:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41101.log 2024-09-10T22:47:10.612 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37036.log.gz 2024-09-10T22:47:10.613 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44481.log 2024-09-10T22:47:10.614 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43754.log.gz 2024-09-10T22:47:10.615 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44423.log 2024-09-10T22:47:10.615 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41101.log.gz 2024-09-10T22:47:10.615 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48498.log 2024-09-10T22:47:10.616 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44481.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44481.log.gz 2024-09-10T22:47:10.617 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50796.log 2024-09-10T22:47:10.617 INFO:teuthology.orchestra.run.smithi103.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.44423.log.gz 2024-09-10T22:47:10.617 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48498.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48498.log.gz 2024-09-10T22:47:10.618 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41594.log 2024-09-10T22:47:10.618 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47873.log 2024-09-10T22:47:10.619 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50796.log.gz 2024-09-10T22:47:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34648.log 2024-09-10T22:47:10.620 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41594.log.gz 2024-09-10T22:47:10.621 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52244.log 2024-09-10T22:47:10.621 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47873.log.gz 2024-09-10T22:47:10.622 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36009.log 2024-09-10T22:47:10.622 INFO:teuthology.orchestra.run.smithi103.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34648.log.gz 2024-09-10T22:47:10.623 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47847.log 2024-09-10T22:47:10.623 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52244.log.gz 2024-09-10T22:47:10.624 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38742.log 2024-09-10T22:47:10.624 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36009.log.gz 2024-09-10T22:47:10.625 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36652.log 2024-09-10T22:47:10.625 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47847.log.gz 2024-09-10T22:47:10.626 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43088.log 2024-09-10T22:47:10.626 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36652.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38742.log.gz 2024-09-10T22:47:10.627 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36652.log.gz 2024-09-10T22:47:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52006.log 2024-09-10T22:47:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37167.log 2024-09-10T22:47:10.629 INFO:teuthology.orchestra.run.smithi103.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.43088.log.gz 2024-09-10T22:47:10.629 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40249.log 2024-09-10T22:47:10.630 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52006.log.gz 2024-09-10T22:47:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44714.log 2024-09-10T22:47:10.631 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37167.log.gz 2024-09-10T22:47:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39772.log 2024-09-10T22:47:10.632 INFO:teuthology.orchestra.run.smithi103.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.40249.log.gz 2024-09-10T22:47:10.632 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34728.log 2024-09-10T22:47:10.633 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44714.log.gz 2024-09-10T22:47:10.633 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39772.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.24002.log 2024-09-10T22:47:10.634 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39772.log.gz 2024-09-10T22:47:10.634 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34728.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34728.log.gz 2024-09-10T22:47:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35477.log 2024-09-10T22:47:10.635 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51401.log 2024-09-10T22:47:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.tmp-client.admin.24002.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.24002.log.gz 2024-09-10T22:47:10.636 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37830.log 2024-09-10T22:47:10.637 INFO:teuthology.orchestra.run.smithi103.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35477.log.gz 2024-09-10T22:47:10.638 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.4.log: 91.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-10T22:47:10.638 INFO:teuthology.orchestra.run.smithi131.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T22:47:10.639 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47925.log 2024-09-10T22:47:10.639 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51401.log.gz 2024-09-10T22:47:10.639 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43291.log 2024-09-10T22:47:10.639 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37830.log.gz 2024-09-10T22:47:10.640 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36522.log 2024-09-10T22:47:10.640 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47925.log.gz 2024-09-10T22:47:10.641 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51850.log 2024-09-10T22:47:10.641 INFO:teuthology.orchestra.run.smithi103.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.43291.log.gz 2024-09-10T22:47:10.642 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35385.log 2024-09-10T22:47:10.642 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36522.log.gz 2024-09-10T22:47:10.643 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38936.log 2024-09-10T22:47:10.643 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51850.log.gz 2024-09-10T22:47:10.644 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36438.log 2024-09-10T22:47:10.644 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35385.log.gz 2024-09-10T22:47:10.645 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.38936.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36464.log 2024-09-10T22:47:10.645 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38936.log.gz 2024-09-10T22:47:10.646 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39104.log 2024-09-10T22:47:10.646 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36438.log.gz 2024-09-10T22:47:10.647 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44818.log 2024-09-10T22:47:10.647 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36464.log.gz 2024-09-10T22:47:10.648 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48903.log 2024-09-10T22:47:10.648 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39104.log.gz 2024-09-10T22:47:10.649 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34908.log 2024-09-10T22:47:10.649 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44818.log.gz 2024-09-10T22:47:10.650 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51668.log 2024-09-10T22:47:10.650 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48903.log.gz 2024-09-10T22:47:10.651 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45861.log 2024-09-10T22:47:10.651 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34908.log.gz 2024-09-10T22:47:10.652 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46625.log 2024-09-10T22:47:10.652 INFO:teuthology.orchestra.run.smithi103.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51668.log.gz 2024-09-10T22:47:10.653 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34622.log 2024-09-10T22:47:10.653 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45861.log.gz 2024-09-10T22:47:10.654 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35698.log 2024-09-10T22:47:10.655 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46625.log: /var/log/ceph/ceph-client.admin.34622.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46625.log.gz 2024-09-10T22:47:10.655 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39325.log 2024-09-10T22:47:10.655 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34622.log.gz 2024-09-10T22:47:10.656 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43676.log 2024-09-10T22:47:10.656 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35698.log.gz 2024-09-10T22:47:10.657 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39851.log 2024-09-10T22:47:10.658 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39325.log.gz 2024-09-10T22:47:10.658 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39746.log 2024-09-10T22:47:10.658 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43676.log.gz 2024-09-10T22:47:10.659 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44292.log 2024-09-10T22:47:10.659 INFO:teuthology.orchestra.run.smithi103.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.39851.log.gz 2024-09-10T22:47:10.660 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38045.log 2024-09-10T22:47:10.661 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39746.log.gz 2024-09-10T22:47:10.662 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49065.log 2024-09-10T22:47:10.662 INFO:teuthology.orchestra.run.smithi103.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44292.log.gz 2024-09-10T22:47:10.665 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37644.log 2024-09-10T22:47:10.665 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38045.log.gz 2024-09-10T22:47:10.665 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51720.log 2024-09-10T22:47:10.665 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49065.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.49065.log.gz 2024-09-10T22:47:10.665 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41049.log 2024-09-10T22:47:10.665 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37644.log.gz 2024-09-10T22:47:10.666 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48732.log 2024-09-10T22:47:10.666 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51720.log.gz 2024-09-10T22:47:10.666 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48029.log 2024-09-10T22:47:10.667 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41049.log.gz 2024-09-10T22:47:10.668 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37674.log 2024-09-10T22:47:10.668 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48732.log.gz 2024-09-10T22:47:10.669 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46314.log 2024-09-10T22:47:10.669 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48029.log.gz 2024-09-10T22:47:10.670 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42264.log 2024-09-10T22:47:10.670 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37674.log: /var/log/ceph/ceph-client.admin.46314.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37674.log.gz 2024-09-10T22:47:10.670 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41231.log 2024-09-10T22:47:10.670 INFO:teuthology.orchestra.run.smithi103.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.46314.log.gz 2024-09-10T22:47:10.671 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35957.log 2024-09-10T22:47:10.672 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42264.log.gz 2024-09-10T22:47:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.41231.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34568.log 2024-09-10T22:47:10.678 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41231.log.gz 2024-09-10T22:47:10.678 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40669.log 2024-09-10T22:47:10.678 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35957.log.gz 2024-09-10T22:47:10.678 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34568.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34568.log.gz 2024-09-10T22:47:10.678 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51375.log 2024-09-10T22:47:10.678 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45469.log 2024-09-10T22:47:10.678 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40669.log: /var/log/ceph/ceph-client.admin.51375.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.40669.log.gz 2024-09-10T22:47:10.678 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37475.log 2024-09-10T22:47:10.678 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51375.log.gz 2024-09-10T22:47:10.678 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38317.log 2024-09-10T22:47:10.678 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45469.log.gz 2024-09-10T22:47:10.679 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50160.log 2024-09-10T22:47:10.680 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37475.log.gz 2024-09-10T22:47:10.680 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37501.log 2024-09-10T22:47:10.681 INFO:teuthology.orchestra.run.smithi103.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.38317.log.gz 2024-09-10T22:47:10.681 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36678.log 2024-09-10T22:47:10.681 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50160.log.gz 2024-09-10T22:47:10.682 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37501.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T22:47:10.682 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37501.log.gz 2024-09-10T22:47:10.683 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38632.log 2024-09-10T22:47:10.684 INFO:teuthology.orchestra.run.smithi103.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36678.log.gz 2024-09-10T22:47:10.684 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43949.log 2024-09-10T22:47:10.685 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48550.log 2024-09-10T22:47:10.685 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38632.log.gz 2024-09-10T22:47:10.686 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48328.log 2024-09-10T22:47:10.686 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43949.log.gz 2024-09-10T22:47:10.687 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47125.log 2024-09-10T22:47:10.688 INFO:teuthology.orchestra.run.smithi103.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.48550.log.gz 2024-09-10T22:47:10.688 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40534.log 2024-09-10T22:47:10.689 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48328.log.gz 2024-09-10T22:47:10.690 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48055.log 2024-09-10T22:47:10.690 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47125.log.gz 2024-09-10T22:47:10.691 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51453.log 2024-09-10T22:47:10.691 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40534.log.gz 2024-09-10T22:47:10.692 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43560.log 2024-09-10T22:47:10.692 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48055.log.gz 2024-09-10T22:47:10.693 INFO:teuthology.orchestra.run.smithi131.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-10T22:47:10.694 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38100.log 2024-09-10T22:47:10.694 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51453.log.gz 2024-09-10T22:47:10.694 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43456.log 2024-09-10T22:47:10.694 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43560.log.gz 2024-09-10T22:47:10.695 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38858.log 2024-09-10T22:47:10.696 INFO:teuthology.orchestra.run.smithi103.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.38100.log.gz/var/log/ceph/ceph-client.admin.43456.log: 2024-09-10T22:47:10.696 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44507.log 2024-09-10T22:47:10.696 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43456.log.gz 2024-09-10T22:47:10.697 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40973.log 2024-09-10T22:47:10.697 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38858.log.gz 2024-09-10T22:47:10.698 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43534.log 2024-09-10T22:47:10.698 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44507.log.gz 2024-09-10T22:47:10.699 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52218.log 2024-09-10T22:47:10.700 INFO:teuthology.orchestra.run.smithi103.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.40973.log.gz 2024-09-10T22:47:10.701 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43917.log 2024-09-10T22:47:10.701 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43534.log.gz 2024-09-10T22:47:10.701 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40059.log 2024-09-10T22:47:10.702 INFO:teuthology.orchestra.run.smithi103.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52218.log.gz 2024-09-10T22:47:10.702 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39560.log 2024-09-10T22:47:10.703 INFO:teuthology.orchestra.run.smithi103.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43917.log.gz 2024-09-10T22:47:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34754.log 2024-09-10T22:47:10.704 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40059.log.gz 2024-09-10T22:47:10.705 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50720.log 2024-09-10T22:47:10.705 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39560.log.gz 2024-09-10T22:47:10.706 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45893.log 2024-09-10T22:47:10.707 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34754.log.gz 2024-09-10T22:47:10.707 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35685.log 2024-09-10T22:47:10.708 INFO:teuthology.orchestra.run.smithi103.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50720.log.gz 2024-09-10T22:47:10.709 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42290.log 2024-09-10T22:47:10.709 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45893.log.gz 2024-09-10T22:47:10.710 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35490.log 2024-09-10T22:47:10.710 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35685.log.gz 2024-09-10T22:47:10.710 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44188.log 2024-09-10T22:47:10.711 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42290.log.gz 2024-09-10T22:47:10.712 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37371.log 2024-09-10T22:47:10.712 INFO:teuthology.orchestra.run.smithi103.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35490.log.gz 2024-09-10T22:47:10.713 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48276.log 2024-09-10T22:47:10.713 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44188.log.gz 2024-09-10T22:47:10.714 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35683.log 2024-09-10T22:47:10.715 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37371.log.gz 2024-09-10T22:47:10.715 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44344.log 2024-09-10T22:47:10.715 INFO:teuthology.orchestra.run.smithi103.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48276.log.gz 2024-09-10T22:47:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49663.log 2024-09-10T22:47:10.717 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35683.log.gz 2024-09-10T22:47:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36600.log 2024-09-10T22:47:10.717 INFO:teuthology.orchestra.run.smithi103.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44344.log.gz 2024-09-10T22:47:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50368.log 2024-09-10T22:47:10.719 INFO:teuthology.orchestra.run.smithi103.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49663.log.gz 2024-09-10T22:47:10.720 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47338.log 2024-09-10T22:47:10.720 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36600.log.gz 2024-09-10T22:47:10.721 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46039.log 2024-09-10T22:47:10.721 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50368.log.gz 2024-09-10T22:47:10.721 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35983.log 2024-09-10T22:47:10.722 INFO:teuthology.orchestra.run.smithi103.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.47338.log.gz 2024-09-10T22:47:10.723 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45547.log 2024-09-10T22:47:10.723 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46039.log.gz 2024-09-10T22:47:10.724 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35983.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T22:47:10.724 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35983.log.gz 2024-09-10T22:47:10.725 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29058.log 2024-09-10T22:47:10.726 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45547.log.gz 2024-09-10T22:47:10.726 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36984.log 2024-09-10T22:47:10.728 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48420.log 2024-09-10T22:47:10.728 INFO:teuthology.orchestra.run.smithi103.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29058.log.gz 2024-09-10T22:47:10.729 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35691.log 2024-09-10T22:47:10.729 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36984.log.gz 2024-09-10T22:47:10.730 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45984.log 2024-09-10T22:47:10.730 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48420.log.gz 2024-09-10T22:47:10.731 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42560.log 2024-09-10T22:47:10.731 INFO:teuthology.orchestra.run.smithi103.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35691.log.gz 2024-09-10T22:47:10.732 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39052.log 2024-09-10T22:47:10.733 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45984.log.gz 2024-09-10T22:47:10.734 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49012.log 2024-09-10T22:47:10.734 INFO:teuthology.orchestra.run.smithi103.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.42560.log.gz 2024-09-10T22:47:10.735 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39052.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39052.log.gz 2024-09-10T22:47:10.735 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28975.log 2024-09-10T22:47:10.736 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49012.log.gz 2024-09-10T22:47:10.737 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52110.log 2024-09-10T22:47:10.738 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41958.log 2024-09-10T22:47:10.738 INFO:teuthology.orchestra.run.smithi103.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.28975.log.gz 2024-09-10T22:47:10.739 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35281.log 2024-09-10T22:47:10.739 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52110.log.gz 2024-09-10T22:47:10.740 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40821.log 2024-09-10T22:47:10.740 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41958.log.gz 2024-09-10T22:47:10.741 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36850.log 2024-09-10T22:47:10.741 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35281.log.gz 2024-09-10T22:47:10.743 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35359.log 2024-09-10T22:47:10.743 INFO:teuthology.orchestra.run.smithi103.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.40821.log.gz 2024-09-10T22:47:10.744 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36850.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36850.log.gz 2024-09-10T22:47:10.745 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35359.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35359.log.gz 2024-09-10T22:47:10.745 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44095.log 2024-09-10T22:47:10.747 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36249.log 2024-09-10T22:47:10.748 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36932.log 2024-09-10T22:47:10.748 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44095.log.gz 2024-09-10T22:47:10.749 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.36249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52084.log 2024-09-10T22:47:10.750 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36932.log: 89.3% -- replaced with /var/log/ceph/ceph-client.0.36249.log.gz 2024-09-10T22:47:10.750 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41478.log 2024-09-10T22:47:10.751 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36932.log.gz 2024-09-10T22:47:10.752 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45828.log 2024-09-10T22:47:10.752 INFO:teuthology.orchestra.run.smithi103.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52084.log.gz 2024-09-10T22:47:10.753 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51048.log 2024-09-10T22:47:10.753 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41478.log.gz 2024-09-10T22:47:10.754 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45828.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45828.log.gz 2024-09-10T22:47:10.755 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35255.log 2024-09-10T22:47:10.755 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51048.log.gz 2024-09-10T22:47:10.756 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29048.log 2024-09-10T22:47:10.757 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48392.log 2024-09-10T22:47:10.757 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35255.log.gz 2024-09-10T22:47:10.759 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29048.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29048.log.gz 2024-09-10T22:47:10.759 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50316.log 2024-09-10T22:47:10.760 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48392.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48392.log.gz 2024-09-10T22:47:10.760 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45079.log 2024-09-10T22:47:10.762 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50316.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50316.log.gz 2024-09-10T22:47:10.762 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39443.log 2024-09-10T22:47:10.763 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45155.log 2024-09-10T22:47:10.765 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39443.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45079.log.gz 2024-09-10T22:47:10.765 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39443.log.gz 2024-09-10T22:47:10.765 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35905.log 2024-09-10T22:47:10.766 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45129.log 2024-09-10T22:47:10.766 INFO:teuthology.orchestra.run.smithi103.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45155.log.gz 2024-09-10T22:47:10.767 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40199.log 2024-09-10T22:47:10.767 INFO:teuthology.orchestra.run.smithi103.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35905.log.gz 2024-09-10T22:47:10.768 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45129.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45129.log.gz 2024-09-10T22:47:10.769 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41724.log 2024-09-10T22:47:10.770 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36795.log 2024-09-10T22:47:10.770 INFO:teuthology.orchestra.run.smithi103.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.40199.log.gz 2024-09-10T22:47:10.772 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39499.log 2024-09-10T22:47:10.772 INFO:teuthology.orchestra.run.smithi103.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41724.log.gz 2024-09-10T22:47:10.773 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36795.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36795.log.gz 2024-09-10T22:47:10.773 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37247.log 2024-09-10T22:47:10.773 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39499.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39499.log.gz 2024-09-10T22:47:10.774 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39694.log 2024-09-10T22:47:10.775 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48635.log 2024-09-10T22:47:10.775 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37247.log.gz 2024-09-10T22:47:10.776 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39694.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39694.log.gz 2024-09-10T22:47:10.776 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48003.log 2024-09-10T22:47:10.777 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48635.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48635.log.gz 2024-09-10T22:47:10.777 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42052.log 2024-09-10T22:47:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41075.log 2024-09-10T22:47:10.779 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48003.log.gz 2024-09-10T22:47:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28900.log 2024-09-10T22:47:10.780 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42052.log.gz 2024-09-10T22:47:10.781 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41075.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41075.log.gz 2024-09-10T22:47:10.781 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48172.log 2024-09-10T22:47:10.782 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28900.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.28900.log.gz 2024-09-10T22:47:10.782 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35229.log 2024-09-10T22:47:10.783 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47488.log 2024-09-10T22:47:10.783 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48172.log.gz 2024-09-10T22:47:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35229.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35229.log.gz 2024-09-10T22:47:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47488.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47488.log.gz 2024-09-10T22:47:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49438.log 2024-09-10T22:47:10.787 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51349.log 2024-09-10T22:47:10.789 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47238.log 2024-09-10T22:47:10.789 INFO:teuthology.orchestra.run.smithi103.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49438.log.gz 2024-09-10T22:47:10.790 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51204.log 2024-09-10T22:47:10.790 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51349.log.gz 2024-09-10T22:47:10.791 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29071.log 2024-09-10T22:47:10.792 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47238.log.gz 2024-09-10T22:47:10.792 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28826.log 2024-09-10T22:47:10.793 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51204.log.gz 2024-09-10T22:47:10.793 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40769.log 2024-09-10T22:47:10.793 INFO:teuthology.orchestra.run.smithi103.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29071.log.gz 2024-09-10T22:47:10.795 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28826.log: 75.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.28826.log.gz -5 2024-09-10T22:47:10.795 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48198.log 2024-09-10T22:47:10.796 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40769.log: /var/log/ceph/ceph-client.admin.48198.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.40769.log.gz 2024-09-10T22:47:10.797 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48667.log 2024-09-10T22:47:10.797 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48198.log.gz 2024-09-10T22:47:10.798 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51126.log 2024-09-10T22:47:10.800 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49332.log 2024-09-10T22:47:10.800 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48667.log.gz 2024-09-10T22:47:10.800 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51126.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51126.log.gz 2024-09-10T22:47:10.801 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43061.log 2024-09-10T22:47:10.802 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49332.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49332.log.gz 2024-09-10T22:47:10.802 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51297.log 2024-09-10T22:47:10.803 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51928.log 2024-09-10T22:47:10.803 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43061.log.gz 2024-09-10T22:47:10.805 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51297.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51297.log.gz 2024-09-10T22:47:10.805 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51928.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51928.log.gz 2024-09-10T22:47:10.806 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39825.log 2024-09-10T22:47:10.807 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40719.log 2024-09-10T22:47:10.809 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48446.log 2024-09-10T22:47:10.809 INFO:teuthology.orchestra.run.smithi103.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39825.log.gz 2024-09-10T22:47:10.809 INFO:teuthology.orchestra.run.smithi131.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-10T22:47:10.810 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40719.log: /var/log/ceph/ceph-client.admin.48446.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.40719.log.gz 2024-09-10T22:47:10.811 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40299.log 2024-09-10T22:47:10.811 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48446.log.gz 2024-09-10T22:47:10.812 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35151.log 2024-09-10T22:47:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42995.log 2024-09-10T22:47:10.814 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40299.log.gz 2024-09-10T22:47:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35151.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35151.log.gz 2024-09-10T22:47:10.815 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42995.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42995.log.gz 2024-09-10T22:47:10.816 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44533.log 2024-09-10T22:47:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40923.log 2024-09-10T22:47:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47899.log 2024-09-10T22:47:10.819 INFO:teuthology.orchestra.run.smithi103.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44533.log.gz 2024-09-10T22:47:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40923.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.40923.log.gz 2024-09-10T22:47:10.821 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47899.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47899.log.gz 2024-09-10T22:47:10.821 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T22:47:10.822 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37962.log 2024-09-10T22:47:10.826 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42610.log 2024-09-10T22:47:10.826 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.37962.log: /var/log/ceph/ceph-client.admin.42610.log: 87.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T22:47:10.826 INFO:teuthology.orchestra.run.smithi103.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.42610.log.gz 2024-09-10T22:47:10.826 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43482.log 2024-09-10T22:47:10.827 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42160.log 2024-09-10T22:47:10.829 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43482.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43482.log.gz 2024-09-10T22:47:10.830 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42160.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42160.log.gz 2024-09-10T22:47:10.830 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49488.log 2024-09-10T22:47:10.831 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47747.log 2024-09-10T22:47:10.833 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49488.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49488.log.gz 2024-09-10T22:47:10.834 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47747.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47747.log.gz 2024-09-10T22:47:10.835 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37752.log 2024-09-10T22:47:10.836 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51178.log 2024-09-10T22:47:10.836 INFO:teuthology.orchestra.run.smithi103.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.37962.log.gz 2024-09-10T22:47:10.837 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37752.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37752.log.gz 2024-09-10T22:47:10.838 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39668.log 2024-09-10T22:47:10.838 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51178.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51178.log.gz 2024-09-10T22:47:10.839 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46154.log 2024-09-10T22:47:10.840 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41374.log 2024-09-10T22:47:10.840 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39668.log.gz 2024-09-10T22:47:10.841 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46154.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46154.log.gz 2024-09-10T22:47:10.842 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41374.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41374.log.gz 2024-09-10T22:47:10.843 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51772.log 2024-09-10T22:47:10.844 INFO:teuthology.orchestra.run.smithi131.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-10T22:47:10.844 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45417.log 2024-09-10T22:47:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41504.log 2024-09-10T22:47:10.846 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51772.log.gz 2024-09-10T22:47:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45417.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45417.log.gz 2024-09-10T22:47:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41504.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41504.log.gz 2024-09-10T22:47:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45253.log 2024-09-10T22:47:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38585.log 2024-09-10T22:47:10.851 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40556.log 2024-09-10T22:47:10.851 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45253.log.gz 2024-09-10T22:47:10.852 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38585.log: /var/log/ceph/ceph-client.admin.40556.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.38585.log.gz 2024-09-10T22:47:10.852 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40556.log.gz 2024-09-10T22:47:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51746.log 2024-09-10T22:47:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48224.log 2024-09-10T22:47:10.856 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50010.log 2024-09-10T22:47:10.856 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51746.log.gz 2024-09-10T22:47:10.856 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48224.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48224.log.gz 2024-09-10T22:47:10.858 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50010.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50010.log.gz 2024-09-10T22:47:10.858 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42422.log 2024-09-10T22:47:10.859 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.36394.log 2024-09-10T22:47:10.862 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.42422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48250.log 2024-09-10T22:47:10.863 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.2.36394.log: 88.8% -- replaced with /var/log/ceph/ceph-client.2.36394.log.gz 2024-09-10T22:47:10.863 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48250.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48250.log.gz 2024-09-10T22:47:10.863 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44318.log 2024-09-10T22:47:10.865 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43780.log 2024-09-10T22:47:10.866 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44318.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44318.log.gz 2024-09-10T22:47:10.867 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43780.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43780.log.gz 2024-09-10T22:47:10.867 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47169.log 2024-09-10T22:47:10.869 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49713.log 2024-09-10T22:47:10.870 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47169.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47169.log.gz 2024-09-10T22:47:10.871 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51100.log 2024-09-10T22:47:10.873 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50238.log 2024-09-10T22:47:10.874 INFO:teuthology.orchestra.run.smithi103.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.42422.log.gz 2024-09-10T22:47:10.874 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51100.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49713.log.gz 2024-09-10T22:47:10.874 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28867.log 2024-09-10T22:47:10.874 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51100.log.gz 2024-09-10T22:47:10.875 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50238.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50238.log.gz 2024-09-10T22:47:10.876 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42212.log 2024-09-10T22:47:10.876 INFO:teuthology.orchestra.run.smithi103.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28867.log.gz 2024-09-10T22:47:10.876 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35411.log 2024-09-10T22:47:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29072.log 2024-09-10T22:47:10.881 INFO:teuthology.orchestra.run.smithi103.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42212.log.gz 2024-09-10T22:47:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35411.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35411.log.gz 2024-09-10T22:47:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29072.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29072.log.gz 2024-09-10T22:47:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47103.log 2024-09-10T22:47:10.882 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37319.log 2024-09-10T22:47:10.882 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44397.log 2024-09-10T22:47:10.883 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5%/var/log/ceph/ceph-client.admin.37319.log: -- replaced with /var/log/ceph/ceph-client.admin.47103.log.gz 2024-09-10T22:47:10.884 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37319.log.gz 2024-09-10T22:47:10.885 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44397.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44397.log.gz 2024-09-10T22:47:10.885 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36958.log 2024-09-10T22:47:10.886 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46816.log 2024-09-10T22:47:10.888 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28995.log 2024-09-10T22:47:10.888 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36958.log.gz 2024-09-10T22:47:10.889 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46816.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46816.log.gz 2024-09-10T22:47:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28995.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.28995.log.gz 2024-09-10T22:47:10.891 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44918.log 2024-09-10T22:47:10.892 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50420.log 2024-09-10T22:47:10.893 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45204.log 2024-09-10T22:47:10.893 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44918.log.gz 2024-09-10T22:47:10.894 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37726.log 2024-09-10T22:47:10.894 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45204.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.50420.log.gz 2024-09-10T22:47:10.895 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37778.log 2024-09-10T22:47:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37726.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45204.log.gz 2024-09-10T22:47:10.896 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37726.log.gz 2024-09-10T22:47:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50110.log 2024-09-10T22:47:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41646.log 2024-09-10T22:47:10.897 INFO:teuthology.orchestra.run.smithi103.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37778.log.gz 2024-09-10T22:47:10.899 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42973.log 2024-09-10T22:47:10.899 INFO:teuthology.orchestra.run.smithi103.stderr: 91.2%/var/log/ceph/ceph-client.admin.41646.log: -- replaced with /var/log/ceph/ceph-client.admin.50110.log.gz 2024-09-10T22:47:10.900 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41646.log.gz 2024-09-10T22:47:10.900 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46471.log 2024-09-10T22:47:10.901 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50770.log 2024-09-10T22:47:10.901 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42973.log.gz 2024-09-10T22:47:10.902 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46445.log 2024-09-10T22:47:10.903 INFO:teuthology.orchestra.run.smithi103.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.46471.log.gz/var/log/ceph/ceph-client.admin.50770.log: 2024-09-10T22:47:10.904 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50770.log.gz 2024-09-10T22:47:10.904 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48784.log 2024-09-10T22:47:10.905 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46445.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46445.log.gz 2024-09-10T22:47:10.905 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48986.log 2024-09-10T22:47:10.907 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46067.log 2024-09-10T22:47:10.907 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48784.log.gz 2024-09-10T22:47:10.907 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48986.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48986.log.gz 2024-09-10T22:47:10.908 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46067.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46067.log.gz 2024-09-10T22:47:10.909 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29036.log 2024-09-10T22:47:10.910 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35879.log 2024-09-10T22:47:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48472.log 2024-09-10T22:47:10.912 INFO:teuthology.orchestra.run.smithi103.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29036.log.gz 2024-09-10T22:47:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35879.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35879.log.gz 2024-09-10T22:47:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48472.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48472.log.gz 2024-09-10T22:47:10.914 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39720.log 2024-09-10T22:47:10.915 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37062.log 2024-09-10T22:47:10.917 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44158.log 2024-09-10T22:47:10.917 INFO:teuthology.orchestra.run.smithi103.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.39720.log.gz 2024-09-10T22:47:10.918 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42015.log 2024-09-10T22:47:10.918 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37062.log.gz 2024-09-10T22:47:10.919 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44158.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44158.log.gz 2024-09-10T22:47:10.919 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38250.log 2024-09-10T22:47:10.920 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42015.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42015.log.gz 2024-09-10T22:47:10.920 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42470.log 2024-09-10T22:47:10.922 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35177.log 2024-09-10T22:47:10.922 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38250.log.gz 2024-09-10T22:47:10.923 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42470.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42470.log.gz 2024-09-10T22:47:10.924 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35177.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35177.log.gz 2024-09-10T22:47:10.924 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45748.log 2024-09-10T22:47:10.925 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46128.log 2024-09-10T22:47:10.927 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44266.log 2024-09-10T22:47:10.927 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45748.log.gz 2024-09-10T22:47:10.928 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46128.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46128.log.gz 2024-09-10T22:47:10.929 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44266.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44266.log.gz 2024-09-10T22:47:10.929 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43039.log 2024-09-10T22:47:10.930 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44768.log 2024-09-10T22:47:10.932 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37856.log 2024-09-10T22:47:10.932 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43039.log.gz 2024-09-10T22:47:10.933 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44768.log: /var/log/ceph/ceph-client.admin.37856.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44768.log.gz 2024-09-10T22:47:10.935 INFO:teuthology.orchestra.run.smithi103.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.37856.log.gz 2024-09-10T22:47:10.935 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50570.log 2024-09-10T22:47:10.936 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41987.log 2024-09-10T22:47:10.938 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28869.log 2024-09-10T22:47:10.938 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41987.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50570.log.gz 2024-09-10T22:47:10.939 INFO:teuthology.orchestra.run.smithi103.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41987.log.gz 2024-09-10T22:47:10.939 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28869.log: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.28869.log.gz 2024-09-10T22:47:10.940 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42316.log 2024-09-10T22:47:10.941 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35094.log 2024-09-10T22:47:10.943 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49193.log 2024-09-10T22:47:10.943 INFO:teuthology.orchestra.run.smithi103.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.42316.log.gz 2024-09-10T22:47:10.944 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35094.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35094.log.gz 2024-09-10T22:47:10.945 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49193.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49193.log.gz 2024-09-10T22:47:10.945 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51641.log 2024-09-10T22:47:10.946 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43702.log 2024-09-10T22:47:10.948 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38010.log 2024-09-10T22:47:10.948 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51641.log.gz 2024-09-10T22:47:10.949 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43702.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43702.log.gz 2024-09-10T22:47:10.950 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38010.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38010.log.gz 2024-09-10T22:47:10.950 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47569.log 2024-09-10T22:47:10.951 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34596.log 2024-09-10T22:47:10.953 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45958.log 2024-09-10T22:47:10.953 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47569.log.gz 2024-09-10T22:47:10.954 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34596.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34596.log.gz 2024-09-10T22:47:10.955 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45958.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45958.log.gz 2024-09-10T22:47:10.955 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39798.log 2024-09-10T22:47:10.956 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37141.log 2024-09-10T22:47:10.958 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47041.log 2024-09-10T22:47:10.958 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39798.log.gz 2024-09-10T22:47:10.959 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36769.log 2024-09-10T22:47:10.959 INFO:teuthology.orchestra.run.smithi103.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37141.log.gz 2024-09-10T22:47:10.961 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47041.log: /var/log/ceph/ceph-client.admin.36769.log: 91.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.47041.log.gz 2024-09-10T22:47:10.961 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43858.log 2024-09-10T22:47:10.961 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36769.log.gz 2024-09-10T22:47:10.962 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44639.log 2024-09-10T22:47:10.963 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44214.log 2024-09-10T22:47:10.964 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43858.log.gz 2024-09-10T22:47:10.964 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.44639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49297.log 2024-09-10T22:47:10.966 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44214.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44214.log.gz 2024-09-10T22:47:10.967 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49297.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49297.log.gz 2024-09-10T22:47:10.967 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43612.log 2024-09-10T22:47:10.968 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47388.log 2024-09-10T22:47:10.970 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43612.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43612.log.gz 2024-09-10T22:47:10.971 INFO:teuthology.orchestra.run.smithi103.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.0.44639.log.gz 2024-09-10T22:47:10.971 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47388.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T22:47:10.971 INFO:teuthology.orchestra.run.smithi103.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.47388.log.gz 2024-09-10T22:47:10.971 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46766.log 2024-09-10T22:47:10.974 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-10T22:47:10.974 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46766.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.46766.log.gz 2024-09-10T22:47:10.975 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36906.log 2024-09-10T22:47:10.975 INFO:teuthology.orchestra.run.smithi103.stderr: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T22:47:10.979 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38698.log 2024-09-10T22:47:10.979 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37193.log 2024-09-10T22:47:10.979 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38698.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38698.log.gz 2024-09-10T22:47:10.980 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37193.log: /var/log/ceph/ceph-client.admin.36906.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46210.log 2024-09-10T22:47:10.980 INFO:teuthology.orchestra.run.smithi103.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36906.log.gz 2024-09-10T22:47:10.980 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37193.log.gz 2024-09-10T22:47:10.981 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40600.log 2024-09-10T22:47:10.983 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46210.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46210.log.gz 2024-09-10T22:47:10.984 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40600.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40600.log.gz 2024-09-10T22:47:10.984 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35489.log 2024-09-10T22:47:10.985 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43191.log 2024-09-10T22:47:10.987 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35489.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35489.log.gz 2024-09-10T22:47:10.988 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43191.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.43191.log.gz 2024-09-10T22:47:10.989 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35491.log 2024-09-10T22:47:10.990 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51954.log 2024-09-10T22:47:10.992 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35491.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35491.log.gz 2024-09-10T22:47:10.992 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51954.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51954.log.gz 2024-09-10T22:47:10.993 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39208.log 2024-09-10T22:47:10.994 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-10T22:47:10.995 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39208.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39208.log.gz 2024-09-10T22:47:10.999 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52032.log 2024-09-10T22:47:11.001 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51543.log 2024-09-10T22:47:11.002 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29055.log 2024-09-10T22:47:11.002 INFO:teuthology.orchestra.run.smithi103.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52032.log.gz 2024-09-10T22:47:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35673.log 2024-09-10T22:47:11.003 INFO:teuthology.orchestra.run.smithi103.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51543.log.gz 2024-09-10T22:47:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29055.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29055.log.gz 2024-09-10T22:47:11.006 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37423.log 2024-09-10T22:47:11.008 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.35673.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51323.log 2024-09-10T22:47:11.008 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37423.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37423.log.gz 2024-09-10T22:47:11.009 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35673.log.gz 2024-09-10T22:47:11.011 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36823.log 2024-09-10T22:47:11.012 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51323.log.gz 2024-09-10T22:47:11.013 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46184.log 2024-09-10T22:47:11.015 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36823.log: /var/log/ceph/ceph-client.admin.46184.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36823.log.gz 2024-09-10T22:47:11.016 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46184.log.gz 2024-09-10T22:47:11.016 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41257.log 2024-09-10T22:47:11.019 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41257.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41257.log.gz 2024-09-10T22:47:11.019 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50212.log 2024-09-10T22:47:11.025 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50212.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50212.log.gz 2024-09-10T22:47:11.025 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34702.log 2024-09-10T22:47:11.025 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34702.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34702.log.gz 2024-09-10T22:47:11.025 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35307.log 2024-09-10T22:47:11.028 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35307.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35307.log.gz 2024-09-10T22:47:11.028 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35474.log 2024-09-10T22:47:11.031 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41750.log 2024-09-10T22:47:11.031 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35474.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35474.log.gz 2024-09-10T22:47:11.033 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41750.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41750.log.gz 2024-09-10T22:47:11.033 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37449.log 2024-09-10T22:47:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37449.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37449.log.gz 2024-09-10T22:47:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49249.log 2024-09-10T22:47:11.043 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.49249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45029.log 2024-09-10T22:47:11.048 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35476.log 2024-09-10T22:47:11.050 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45029.log.gz 2024-09-10T22:47:11.050 INFO:teuthology.orchestra.run.smithi103.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.0.49249.log.gz 2024-09-10T22:47:11.052 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43728.log 2024-09-10T22:47:11.053 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35476.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35476.log.gz 2024-09-10T22:47:11.054 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47147.log 2024-09-10T22:47:11.055 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43728.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43728.log.gz 2024-09-10T22:47:11.057 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37397.log 2024-09-10T22:47:11.058 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47147.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47147.log.gz 2024-09-10T22:47:11.060 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51569.log 2024-09-10T22:47:11.061 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37397.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37397.log.gz 2024-09-10T22:47:11.064 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51569.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51569.log.gz 2024-09-10T22:47:11.065 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42787.log 2024-09-10T22:47:11.067 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39234.log 2024-09-10T22:47:11.068 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42787.log.gz 2024-09-10T22:47:11.070 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47191.log 2024-09-10T22:47:11.075 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47191.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47191.log.gz 2024-09-10T22:47:11.075 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39234.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39234.log.gz 2024-09-10T22:47:11.075 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50394.log 2024-09-10T22:47:11.078 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50394.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50394.log.gz 2024-09-10T22:47:11.078 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51152.log 2024-09-10T22:47:11.079 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44868.log 2024-09-10T22:47:11.081 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51152.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51152.log.gz 2024-09-10T22:47:11.084 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44868.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.44868.log.gz 2024-09-10T22:47:11.084 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34806.log 2024-09-10T22:47:11.088 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34806.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34806.log.gz 2024-09-10T22:47:11.089 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39955.log 2024-09-10T22:47:11.090 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39955.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39955.log.gz 2024-09-10T22:47:11.090 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34514.log 2024-09-10T22:47:11.094 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50670.log 2024-09-10T22:47:11.094 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34514.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34514.log.gz 2024-09-10T22:47:11.095 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48841.log 2024-09-10T22:47:11.095 INFO:teuthology.orchestra.run.smithi103.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50670.log.gz 2024-09-10T22:47:11.098 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48841.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48841.log.gz 2024-09-10T22:47:11.099 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40473.log 2024-09-10T22:47:11.101 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52194.log 2024-09-10T22:47:11.103 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41400.log 2024-09-10T22:47:11.104 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52194.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.40473.log.gz 2024-09-10T22:47:11.105 INFO:teuthology.orchestra.run.smithi103.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.52194.log.gz 2024-09-10T22:47:11.107 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36880.log 2024-09-10T22:47:11.109 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36880.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36880.log.gz 2024-09-10T22:47:11.111 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38988.log 2024-09-10T22:47:11.111 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41400.log.gz 2024-09-10T22:47:11.114 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38988.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38988.log.gz 2024-09-10T22:47:11.114 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43586.log 2024-09-10T22:47:11.117 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43586.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43586.log.gz 2024-09-10T22:47:11.117 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37293.log 2024-09-10T22:47:11.124 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37293.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37293.log.gz 2024-09-10T22:47:11.124 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51902.log 2024-09-10T22:47:11.124 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51902.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51902.log.gz 2024-09-10T22:47:11.125 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50872.log 2024-09-10T22:47:11.128 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50872.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50872.log.gz 2024-09-10T22:47:11.128 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45359.log 2024-09-10T22:47:11.131 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49819.log 2024-09-10T22:47:11.132 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45359.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45359.log.gz 2024-09-10T22:47:11.132 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42238.log 2024-09-10T22:47:11.134 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49819.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49819.log.gz 2024-09-10T22:47:11.134 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49863.log 2024-09-10T22:47:11.135 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42238.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42238.log.gz 2024-09-10T22:47:11.138 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49863.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49863.log.gz 2024-09-10T22:47:11.138 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42505.log 2024-09-10T22:47:11.141 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42505.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42505.log.gz 2024-09-10T22:47:11.141 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47213.log 2024-09-10T22:47:11.144 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43430.log 2024-09-10T22:47:11.144 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47213.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47213.log.gz 2024-09-10T22:47:11.147 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43430.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43430.log.gz 2024-09-10T22:47:11.147 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39391.log 2024-09-10T22:47:11.150 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39391.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39391.log.gz 2024-09-10T22:47:11.150 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48960.log 2024-09-10T22:47:11.153 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48960.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48960.log.gz 2024-09-10T22:47:11.153 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46262.log 2024-09-10T22:47:11.155 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29462.log 2024-09-10T22:47:11.156 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46262.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46262.log.gz 2024-09-10T22:47:11.158 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29462.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29462.log.gz 2024-09-10T22:47:11.158 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37592.log 2024-09-10T22:47:11.165 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37592.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37592.log.gz 2024-09-10T22:47:11.165 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50186.log 2024-09-10T22:47:11.168 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37088.log 2024-09-10T22:47:11.168 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50186.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50186.log.gz 2024-09-10T22:47:11.171 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37088.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37088.log.gz 2024-09-10T22:47:11.171 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38806.log 2024-09-10T22:47:11.174 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38806.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38806.log.gz 2024-09-10T22:47:11.174 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48602.log 2024-09-10T22:47:11.176 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48602.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48602.log.gz 2024-09-10T22:47:11.177 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39130.log 2024-09-10T22:47:11.179 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36299.log 2024-09-10T22:47:11.183 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36299.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36299.log.gz 2024-09-10T22:47:11.183 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39130.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39130.log.gz 2024-09-10T22:47:11.183 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47797.log 2024-09-10T22:47:11.186 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47797.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47797.log.gz 2024-09-10T22:47:11.186 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35689.log 2024-09-10T22:47:11.189 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35689.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35689.log.gz 2024-09-10T22:47:11.189 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42951.log 2024-09-10T22:47:11.192 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42951.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42951.log.gz 2024-09-10T22:47:11.192 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28925.log 2024-09-10T22:47:11.195 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43138.log 2024-09-10T22:47:11.195 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28925.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.28925.log.gz 2024-09-10T22:47:11.198 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43138.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43138.log.gz 2024-09-10T22:47:11.198 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38654.log 2024-09-10T22:47:11.201 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38654.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38654.log.gz 2024-09-10T22:47:11.201 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39417.log 2024-09-10T22:47:11.204 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39417.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39417.log.gz 2024-09-10T22:47:11.204 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39471.log 2024-09-10T22:47:11.207 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39471.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39471.log.gz 2024-09-10T22:47:11.207 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34858.log 2024-09-10T22:47:11.210 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39260.log 2024-09-10T22:47:11.210 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34858.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.34858.log.gz 2024-09-10T22:47:11.213 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39260.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39260.log.gz 2024-09-10T22:47:11.213 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51074.log 2024-09-10T22:47:11.215 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38832.log 2024-09-10T22:47:11.215 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51074.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51074.log.gz 2024-09-10T22:47:11.216 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43017.log 2024-09-10T22:47:11.220 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38832.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38832.log.gz 2024-09-10T22:47:11.221 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43017.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43017.log.gz 2024-09-10T22:47:11.221 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40578.log 2024-09-10T22:47:11.224 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40578.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40578.log.gz 2024-09-10T22:47:11.224 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49613.log 2024-09-10T22:47:11.227 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49613.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.49613.log.gz 2024-09-10T22:47:11.227 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46288.log 2024-09-10T22:47:11.230 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46288.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46288.log.gz 2024-09-10T22:47:11.231 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51237.log 2024-09-10T22:47:11.234 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44370.log 2024-09-10T22:47:11.234 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51237.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51237.log.gz 2024-09-10T22:47:11.235 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50342.log 2024-09-10T22:47:11.236 INFO:teuthology.orchestra.run.smithi103.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44370.log.gz 2024-09-10T22:47:11.238 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49091.log 2024-09-10T22:47:11.241 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50342.log: /var/log/ceph/ceph-client.admin.49091.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49091.log.gz 2024-09-10T22:47:11.242 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41932.log 2024-09-10T22:47:11.243 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50342.log.gz 2024-09-10T22:47:11.245 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41672.log 2024-09-10T22:47:11.246 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41932.log.gz 2024-09-10T22:47:11.247 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41290.log 2024-09-10T22:47:11.250 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41672.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41672.log.gz 2024-09-10T22:47:11.250 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41290.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41290.log.gz 2024-09-10T22:47:11.250 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28889.log 2024-09-10T22:47:11.253 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28889.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.28889.log.gz 2024-09-10T22:47:11.253 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44014.log 2024-09-10T22:47:11.254 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52058.log 2024-09-10T22:47:11.256 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44014.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44014.log.gz 2024-09-10T22:47:11.258 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52058.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52058.log.gz 2024-09-10T22:47:11.259 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46660.log 2024-09-10T22:47:11.262 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46660.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46660.log.gz 2024-09-10T22:47:11.262 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46866.log 2024-09-10T22:47:11.265 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46866.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46866.log.gz 2024-09-10T22:47:11.265 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48081.log 2024-09-10T22:47:11.268 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48081.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48081.log.gz 2024-09-10T22:47:11.268 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51876.log 2024-09-10T22:47:11.271 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51876.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51876.log.gz 2024-09-10T22:47:11.271 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37906.log 2024-09-10T22:47:11.274 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38367.log 2024-09-10T22:47:11.274 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37906.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37906.log.gz 2024-09-10T22:47:11.277 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38367.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.38367.log.gz 2024-09-10T22:47:11.277 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46419.log 2024-09-10T22:47:11.280 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46419.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46419.log.gz 2024-09-10T22:47:11.280 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38720.log 2024-09-10T22:47:11.283 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38720.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38720.log.gz 2024-09-10T22:47:11.283 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38676.log 2024-09-10T22:47:11.286 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38676.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38676.log.gz 2024-09-10T22:47:11.286 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45302.log 2024-09-10T22:47:11.293 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42887.log 2024-09-10T22:47:11.294 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45302.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45302.log.gz 2024-09-10T22:47:11.294 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42887.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42887.log.gz 2024-09-10T22:47:11.294 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44687.log 2024-09-10T22:47:11.296 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44687.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44687.log.gz 2024-09-10T22:47:11.296 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37529.log 2024-09-10T22:47:11.299 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37529.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37529.log.gz 2024-09-10T22:47:11.299 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37804.log 2024-09-10T22:47:11.302 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40622.log 2024-09-10T22:47:11.302 INFO:teuthology.orchestra.run.smithi103.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-10T22:47:11.302 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37804.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37804.log.gz 2024-09-10T22:47:11.305 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40622.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40622.log.gz 2024-09-10T22:47:11.305 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28913.log 2024-09-10T22:47:11.306 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52136.log 2024-09-10T22:47:11.307 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28913.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.28913.log.gz 2024-09-10T22:47:11.308 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52136.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52136.log.gz 2024-09-10T22:47:11.309 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41205.log 2024-09-10T22:47:11.310 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35486.log 2024-09-10T22:47:11.311 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41205.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41205.log.gz 2024-09-10T22:47:11.312 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35486.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35486.log.gz 2024-09-10T22:47:11.313 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46340.log 2024-09-10T22:47:11.314 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45521.log 2024-09-10T22:47:11.316 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46340.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46340.log.gz 2024-09-10T22:47:11.316 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45521.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45521.log.gz 2024-09-10T22:47:11.317 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44123.log 2024-09-10T22:47:11.318 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45443.log 2024-09-10T22:47:11.319 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44123.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44123.log.gz 2024-09-10T22:47:11.320 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45443.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45443.log.gz 2024-09-10T22:47:11.321 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46521.log 2024-09-10T22:47:11.322 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42534.log 2024-09-10T22:47:11.324 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46521.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46521.log.gz 2024-09-10T22:47:11.324 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42534.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42534.log.gz 2024-09-10T22:47:11.325 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52162.log 2024-09-10T22:47:11.326 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45391.log 2024-09-10T22:47:11.327 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52162.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52162.log.gz 2024-09-10T22:47:11.328 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45391.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45391.log.gz 2024-09-10T22:47:11.329 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47514.log 2024-09-10T22:47:11.330 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50922.log 2024-09-10T22:47:11.331 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47514.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47514.log.gz 2024-09-10T22:47:11.333 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50922.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50922.log.gz 2024-09-10T22:47:11.333 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39905.log 2024-09-10T22:47:11.334 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51798.log 2024-09-10T22:47:11.336 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39905.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.39905.log.gz 2024-09-10T22:47:11.337 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51798.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51798.log.gz 2024-09-10T22:47:11.337 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39534.log 2024-09-10T22:47:11.339 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42134.log 2024-09-10T22:47:11.340 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39534.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39534.log.gz 2024-09-10T22:47:11.341 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42134.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42134.log.gz 2024-09-10T22:47:11.341 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45774.log 2024-09-10T22:47:11.343 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38150.log 2024-09-10T22:47:11.344 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45774.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45774.log.gz 2024-09-10T22:47:11.345 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38150.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.38150.log.gz 2024-09-10T22:47:11.346 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51427.log 2024-09-10T22:47:11.347 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29060.log 2024-09-10T22:47:11.348 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51427.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51427.log.gz 2024-09-10T22:47:11.349 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29060.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29060.log.gz 2024-09-10T22:47:11.350 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41698.log 2024-09-10T22:47:11.351 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48302.log 2024-09-10T22:47:11.352 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41698.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41698.log.gz 2024-09-10T22:47:11.353 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48302.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48302.log.gz 2024-09-10T22:47:11.354 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37557.log 2024-09-10T22:47:11.355 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47543.log 2024-09-10T22:47:11.357 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37557.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37557.log.gz 2024-09-10T22:47:11.358 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47543.log: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T22:47:11.358 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47543.log.gz 2024-09-10T22:47:11.358 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49039.log 2024-09-10T22:47:11.360 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49039.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49039.log.gz 2024-09-10T22:47:11.384 INFO:teuthology.orchestra.run.smithi103.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-10T22:47:11.638 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-10T22:47:11.641 INFO:teuthology.orchestra.run.smithi131.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-10T22:47:11.705 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-10T22:47:11.743 INFO:teuthology.orchestra.run.smithi131.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-10T22:47:11.746 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-09-10T22:47:11.746 INFO:teuthology.orchestra.run.smithi131.stderr:real 0m1.277s 2024-09-10T22:47:11.746 INFO:teuthology.orchestra.run.smithi131.stderr:user 0m5.138s 2024-09-10T22:47:11.747 INFO:teuthology.orchestra.run.smithi131.stderr:sys 0m0.514s 2024-09-10T22:47:11.783 INFO:teuthology.orchestra.run.smithi103.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T22:47:11.889 INFO:teuthology.orchestra.run.smithi103.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T22:47:11.972 INFO:teuthology.orchestra.run.smithi103.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T22:47:12.013 INFO:teuthology.orchestra.run.smithi103.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T22:47:12.015 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-10T22:47:12.015 INFO:teuthology.orchestra.run.smithi103.stderr:real 0m1.571s 2024-09-10T22:47:12.016 INFO:teuthology.orchestra.run.smithi103.stderr:user 0m6.795s 2024-09-10T22:47:12.016 INFO:teuthology.orchestra.run.smithi103.stderr:sys 0m1.461s 2024-09-10T22:47:12.017 INFO:tasks.ceph:Archiving logs... 2024-09-10T22:47:12.017 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899733/remote/smithi103/log 2024-09-10T22:47:12.018 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T22:47:12.417 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-10T22:47:12.417 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-09-10T22:47:13.180 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899733/remote/smithi131/log 2024-09-10T22:47:13.180 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T22:47:13.812 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T22:47:13.822 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T22:47:13.822 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T22:47:13.826 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T22:47:13.907 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T22:47:13.916 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T22:47:13.916 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:47:13.919 DEBUG:teuthology.orchestra.run.smithi131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:47:13.932 INFO:teuthology.orchestra.run.smithi103.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T22:47:13.932 INFO:teuthology.orchestra.run.smithi103.stdout:============================================================================== 2024-09-10T22:47:13.932 INFO:teuthology.orchestra.run.smithi103.stdout:*hv01.front.sepi 67.205.162.81 3 u 6 64 377 0.091 -1.857 0.945 2024-09-10T22:47:13.932 INFO:teuthology.orchestra.run.smithi103.stdout:+hv02.front.sepi 96.245.170.99 3 u 11 64 377 0.110 -1.232 0.967 2024-09-10T22:47:13.932 INFO:teuthology.orchestra.run.smithi103.stdout:+hv03.front.sepi 74.6.168.72 3 u 13 64 377 0.105 -0.189 0.682 2024-09-10T22:47:13.932 INFO:teuthology.orchestra.run.smithi103.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-09-10T22:47:13.935 INFO:teuthology.orchestra.run.smithi131.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T22:47:13.935 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================== 2024-09-10T22:47:13.935 INFO:teuthology.orchestra.run.smithi131.stdout:*hv01.front.sepi 67.205.162.81 3 u 16 64 377 0.120 -4.259 2.885 2024-09-10T22:47:13.935 INFO:teuthology.orchestra.run.smithi131.stdout:+hv02.front.sepi 96.245.170.99 3 u 9 64 377 0.080 -0.999 2.388 2024-09-10T22:47:13.935 INFO:teuthology.orchestra.run.smithi131.stdout:+hv03.front.sepi 74.6.168.72 3 u 9 64 377 0.097 -3.708 2.975 2024-09-10T22:47:13.935 INFO:teuthology.orchestra.run.smithi131.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-09-10T22:47:13.936 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T22:47:13.945 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T22:47:13.945 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T22:47:13.954 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T22:47:13.962 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T22:47:13.971 INFO:teuthology.task.internal:Duration was 1228.162979 seconds 2024-09-10T22:47:13.972 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T22:47:13.980 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T22:47:13.981 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T22:47:13.984 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T22:47:14.089 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T22:47:14.089 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T22:47:14.089 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T22:47:14.109 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi131.front.sepia.ceph.com 2024-09-10T22:47:14.109 DEBUG:teuthology.orchestra.run.smithi131:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T22:47:14.129 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T22:47:14.130 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T22:47:14.157 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T22:47:14.212 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T22:47:14.213 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T22:47:14.241 DEBUG:teuthology.orchestra.run.smithi131:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T22:47:14.325 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T22:47:14.336 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T22:47:14.336 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T22:47:14.356 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T22:47:14.380 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T22:47:14.390 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:47:14.401 DEBUG:teuthology.orchestra.run.smithi131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:47:14.415 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2024-09-10T22:47:14.439 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = core 2024-09-10T22:47:14.457 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:47:14.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:47:14.485 DEBUG:teuthology.orchestra.run.smithi131:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:47:14.505 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:47:14.505 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T22:47:14.515 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T22:47:14.515 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899733/remote/smithi103 2024-09-10T22:47:14.516 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T22:47:14.552 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899733/remote/smithi131 2024-09-10T22:47:14.553 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T22:47:14.583 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T22:47:14.583 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T22:47:14.597 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T22:47:14.631 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T22:47:14.641 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T22:47:14.641 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T22:47:14.654 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T22:47:14.654 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T22:47:14.657 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T22:47:14.662 INFO:teuthology.orchestra.run.smithi103.stdout: 658141 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 22:47 /home/ubuntu/cephtest 2024-09-10T22:47:14.686 INFO:teuthology.orchestra.run.smithi131.stdout: 658141 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 22:47 /home/ubuntu/cephtest 2024-09-10T22:47:14.689 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T22:47:14.698 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T22:47:14.726 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/multimds_misc} duration: 1228.162978887558 flavor: default mon.a-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a mon.b-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a owner: scheduled_hyelloji@teuthology success: true 2024-09-10T22:47:14.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T22:47:14.818 INFO:teuthology.run:pass